tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 1200.0 seconds run the VM test script machine: waiting for unit k3s.service machine: waiting for the VM to finish booting machine: starting vm machine # Disk image does not exist, creating the virtualisation disk image... machine: QEMU running (pid 45) machine # Formatting '/build/vm-state-machine/tmp.Y4al9CmB5a', fmt=raw size=17179869184 machine # mke2fs 1.47.4 (6-Mar-2025) machine # Discarding device blocks: 0/4194304 done machine # Creating filesystem with 4194304 4k blocks and 1048576 inodes machine # Filesystem UUID: 1a71d2bb-5728-41be-8746-47e88923d332 machine # Superblock backups stored on blocks: machine # 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208, machine # 4096000 machine # machine # Allocating group tables: 0/128 done machine # Writing inode tables: 0/128 done machine # Creating journal (32768 blocks): done machine # Writing superblocks and filesystem accounting information: 0/128 done machine # machine # Virtualisation disk image created. machine # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) machine # machine # machine # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+7EFCC730+7EF2C730 CA00 machine # Press Ctrl-B to configure iPXE (PCI 00:02.0)... machine # machine # machine # machine # machine # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 7EFCC730 7EF2C730 CB00 machine # Press Ctrl-B to configure iPXE (PCI 00:08.0)... machine # machine # machine # Booting from ROM... machine # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026 machine # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/2pwl8rqzha4xr6s9y3n7iadjg7zq340h-nixos-system-machine-test/init regInfo=/nix/store/h4d4jbnflfj8018ig8pyh5d90xyd5lx8-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.000000] BIOS-provided physical RAM map: machine # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007ffd7fff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000007ffd8000-0x000000007fffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000017fffffff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved machine # [ 0.000000] NX (Execute Disable) protection: active machine # [ 0.000000] APIC: Static calls initialized machine # [ 0.000000] SMBIOS 2.8 present. machine # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 machine # [ 0.000000] DMI: Memory slots populated: 1/1 machine # [ 0.000000] Hypervisor detected: KVM machine # [ 0.000000] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 machine # [ 0.000000] kvm-clock: using sched offset of 483531625 cycles machine # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns machine # [ 0.000005] tsc: Detected 2400.012 MHz processor machine # [ 0.000812] last_pfn = 0x180000 max_arch_pfn = 0x10000000000 machine # [ 0.000839] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs machine # [ 0.000842] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT machine # [ 0.000881] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.002733] found SMP MP-table at [mem 0x000f5450-0x000f545f] machine # [ 0.002744] Using GB pages for direct mapping machine # [ 0.002844] RAMDISK: [mem 0x7e367000-0x7ffcffff] machine # [ 0.002851] ACPI: Early table checksum verification disabled machine # [ 0.002854] ACPI: RSDP 0x00000000000F5250 000014 (v00 BOCHS ) machine # [ 0.002858] ACPI: RSDT 0x000000007FFE2539 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002862] ACPI: FACP 0x000000007FFE2319 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002869] ACPI: DSDT 0x000000007FFE0040 0022D9 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002871] ACPI: FACS 0x000000007FFE0000 000040 machine # [ 0.002872] ACPI: APIC 0x000000007FFE240D 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002874] ACPI: HPET 0x000000007FFE249D 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002875] ACPI: MCFG 0x000000007FFE24D5 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002877] ACPI: WAET 0x000000007FFE2511 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002878] ACPI: Reserving FACP table memory at [mem 0x7ffe2319-0x7ffe240c] machine # [ 0.002879] ACPI: Reserving DSDT table memory at [mem 0x7ffe0040-0x7ffe2318] machine # [ 0.002880] ACPI: Reserving FACS table memory at [mem 0x7ffe0000-0x7ffe003f] machine # [ 0.002880] ACPI: Reserving APIC table memory at [mem 0x7ffe240d-0x7ffe249c] machine # [ 0.002881] ACPI: Reserving HPET table memory at [mem 0x7ffe249d-0x7ffe24d4] machine # [ 0.002881] ACPI: Reserving MCFG table memory at [mem 0x7ffe24d5-0x7ffe2510] machine # [ 0.002882] ACPI: Reserving WAET table memory at [mem 0x7ffe2511-0x7ffe2538] machine # [ 0.003103] No NUMA configuration found machine # [ 0.003104] Faking a node at [mem 0x0000000000000000-0x000000017fffffff] machine # [ 0.003106] NODE_DATA(0) allocated [mem 0x17fff8780-0x17fffdcff] machine # [ 0.005337] Zone ranges: machine # [ 0.005338] DMA [mem 0x0000000000001000-0x0000000000ffffff] machine # [ 0.005340] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] machine # [ 0.005341] Normal [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005342] Device empty machine # [ 0.005343] Movable zone start for each node machine # [ 0.005343] Early memory node ranges machine # [ 0.005344] node 0: [mem 0x0000000000001000-0x000000000009efff] machine # [ 0.005345] node 0: [mem 0x0000000000100000-0x000000007ffd7fff] machine # [ 0.005346] node 0: [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005347] Initmem setup node 0 [mem 0x0000000000001000-0x000000017fffffff] machine # [ 0.005367] On node 0, zone DMA: 1 pages in unavailable ranges machine # [ 0.005626] On node 0, zone DMA: 97 pages in unavailable ranges machine # [ 0.075607] On node 0, zone Normal: 40 pages in unavailable ranges machine # [ 0.076082] ACPI: PM-Timer IO Port: 0x608 machine # [ 0.076097] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) machine # [ 0.076137] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 machine # [ 0.076141] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) machine # [ 0.076142] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) machine # [ 0.076144] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) machine # [ 0.076145] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) machine # [ 0.076145] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) machine # [ 0.076148] ACPI: Using ACPI (MADT) for SMP configuration information machine # [ 0.076149] ACPI: HPET id: 0x8086a201 base: 0xfed00000 machine # [ 0.076154] TSC deadline timer available machine # [ 0.076158] CPU topo: Max. logical packages: 1 machine # [ 0.076159] CPU topo: Max. logical dies: 1 machine # [ 0.076160] CPU topo: Max. dies per package: 1 machine # [ 0.076163] CPU topo: Max. threads per core: 1 machine # [ 0.076164] CPU topo: Num. cores per package: 4 machine # [ 0.076164] CPU topo: Num. threads per package: 4 machine # [ 0.076164] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs machine # [ 0.076188] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() machine # [ 0.076205] kvm-guest: KVM setup pv remote TLB flush machine # [ 0.076208] kvm-guest: setup PV sched yield machine # [ 0.076218] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] machine # [ 0.076219] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] machine # [ 0.076221] PM: hibernation: Registered nosave memory: [mem 0x7ffd8000-0xffffffff] machine # [ 0.076222] [mem 0xc0000000-0xfed1bfff] available for PCI devices machine # [ 0.076224] Booting paravirtualized kernel on KVM machine # [ 0.076227] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns machine # [ 0.080670] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 machine # [ 0.082859] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288 machine # [ 0.082912] kvm-guest: PV spinlocks enabled machine # [ 0.082913] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) machine # [ 0.082916] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/2pwl8rqzha4xr6s9y3n7iadjg7zq340h-nixos-system-machine-test/init regInfo=/nix/store/h4d4jbnflfj8018ig8pyh5d90xyd5lx8-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.083014] Unknown kernel command line parameters "regInfo=/nix/store/h4d4jbnflfj8018ig8pyh5d90xyd5lx8-closure-info/registration", will be passed to user space. machine # [ 0.083027] random: crng init done machine # [ 0.083028] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes machine # [ 0.087434] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) machine # [ 0.089528] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) machine # [ 0.089604] software IO TLB: area num 4. machine # [ 0.161815] Fallback order for Node 0: 0 machine # [ 0.161823] Built 1 zonelists, mobility grouping on. Total pages: 1048438 machine # [ 0.161825] Policy zone: Normal machine # [ 0.164302] mem auto-init: stack:all(zero), heap alloc:on, heap free:off machine # [ 0.171445] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 machine # [ 0.180307] allocated 8388608 bytes of page_ext machine # [ 0.190140] ftrace: allocating 48731 entries in 192 pages machine # [ 0.190142] ftrace: allocated 192 pages with 2 groups machine # [ 0.191005] Dynamic Preempt: lazy machine # [ 0.191198] rcu: Preemptible hierarchical RCU implementation. machine # [ 0.191199] rcu: RCU event tracing is enabled. machine # [ 0.191200] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. machine # [ 0.191201] Trampoline variant of Tasks RCU enabled. machine # [ 0.191202] Rude variant of Tasks RCU enabled. machine # [ 0.191202] Tracing variant of Tasks RCU enabled. machine # [ 0.191203] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. machine # [ 0.191203] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 machine # [ 0.191219] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.191221] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.191222] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.195596] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16 machine # [ 0.195904] rcu: srcu_init: Setting srcu_struct sizes based on contention. machine # [ 0.195912] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns machine # [ 0.196025] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) machine # [ 0.199563] Console: colour VGA+ 80x25 machine # [ 0.199566] printk: legacy console [tty0] enabled machine # [ 0.231194] printk: legacy console [ttyS0] enabled machine # [ 0.334843] ACPI: Core revision 20250807 machine # [ 0.335686] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns machine # [ 0.337205] APIC: Switch to symmetric I/O mode setup machine # [ 0.338163] x2apic enabled machine # [ 0.338927] APIC: Switched APIC routing to: physical x2apic machine # [ 0.339798] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask() machine # [ 0.340938] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself() machine # [ 0.342381] kvm-guest: setup PV IPIs machine # [ 0.343949] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 machine # [ 0.344951] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.349334] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) machine # [ 0.350418] x86/cpu: User Mode Instruction Prevention (UMIP) activated machine # [ 0.351466] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 machine # [ 0.353046] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 machine # [ 0.353335] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto machine # [ 0.355332] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl machine # [ 0.356331] Transient Scheduler Attacks: Vulnerable: No microcode machine # [ 0.358078] Spectre V2 : Mitigation: Enhanced / Automatic IBRS machine # [ 0.359043] Speculative Return Stack Overflow: Mitigation: Safe RET machine # [ 0.360097] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization machine # [ 0.361338] Spectre V2 : Enabling IBPB for BPF machine # [ 0.362332] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier machine # [ 0.363332] active return thunk: srso_alias_return_thunk machine # [ 0.364352] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' machine # [ 0.365331] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' machine # [ 0.366331] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' machine # [ 0.367331] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' machine # [ 0.368331] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' machine # [ 0.369331] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' machine # [ 0.370331] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' machine # [ 0.372331] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 machine # [ 0.373331] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 machine # [ 0.374331] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 machine # [ 0.375302] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 machine # [ 0.376088] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 machine # [ 0.377088] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. machine # [ 0.406563] Freeing SMP alternatives memory: 44K machine # [ 0.407333] pid_max: default: 32768 minimum: 301 machine # [ 0.408192] LSM: initializing lsm=capability,landlock,yama,bpf,ima machine # [ 0.409345] landlock: Up and running. machine # [ 0.409969] Yama: becoming mindful. machine # [ 0.410543] LSM support for eBPF active machine # [ 0.411519] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.412403] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.415430] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) machine # [ 0.416929] Performance Events: Fam17h+ core perfctr, AMD PMU driver. machine # [ 0.417340] ... version: 2 machine # [ 0.418055] ... bit width: 48 machine # [ 0.418333] ... generic counters: 6 machine # [ 0.419061] ... generic bitmap: 000000000000003f machine # [ 0.419334] ... fixed-purpose counters: 0 machine # [ 0.420062] ... fixed-purpose bitmap: 0000000000000000 machine # [ 0.420333] ... value mask: 0000ffffffffffff machine # [ 0.421226] ... max period: 00007fffffffffff machine # [ 0.422011] ... global_ctrl mask: 000000000000003f machine # [ 0.422453] signal: max sigframe size: 3376 machine # [ 0.423233] rcu: Hierarchical SRCU implementation. machine # [ 0.423940] rcu: Max phase no-delay instances is 400. machine # [ 0.424507] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level machine # [ 0.429932] smp: Bringing up secondary CPUs ... machine # [ 0.430722] smpboot: x86: Booting SMP configuration: machine # [ 0.431337] .... node #0, CPUs: #1 #2 #3 machine # [ 0.433406] smp: Brought up 1 node, 4 CPUs machine # [ 0.435041] smpboot: Total of 4 processors activated (19200.09 BogoMIPS) machine # [ 0.435665] Memory: 3957848K/4193752K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 220896K reserved, 0K cma-reserved) machine # [ 0.436839] devtmpfs: initialized machine # [ 0.437999] x86/mm: Memory block size: 128MB machine # [ 0.440395] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.441421] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). machine # [ 0.442428] pinctrl core: initialized pinctrl subsystem machine # [ 0.443621] PM: RTC time: 10:34:46, date: 2026-09-22 machine # [ 0.447227] NET: Registered PF_NETLINK/PF_ROUTE protocol family machine # [ 0.448921] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations machine # [ 0.449371] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations machine # [ 0.450905] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations machine # [ 0.451346] audit: initializing netlink subsys (disabled) machine # [ 0.452392] audit: type=2000 audit(1790073287.080:1): state=initialized audit_enabled=0 res=1 machine # [ 0.452631] thermal_sys: Registered thermal governor 'fair_share' machine # [ 0.453335] thermal_sys: Registered thermal governor 'bang_bang' machine # [ 0.454316] thermal_sys: Registered thermal governor 'step_wise' machine # [ 0.455065] thermal_sys: Registered thermal governor 'user_space' machine # [ 0.455333] thermal_sys: Registered thermal governor 'power_allocator' machine # [ 0.456339] cpuidle: using governor menu machine # [ 0.458507] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 machine # [ 0.459696] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] machine # [ 0.460337] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry machine # [ 0.461347] PCI: Using configuration type 1 for base access machine # [ 0.462448] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. machine # [ 0.464717] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages machine # [ 0.465335] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page machine # [ 0.466334] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages machine # [ 0.467333] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page machine # [ 0.472232] ACPI: Added _OSI(Module Device) machine # [ 0.474354] ACPI: Added _OSI(Processor Device) machine # [ 0.475341] ACPI: Added _OSI(Processor Aggregator Device) machine # [ 0.485120] ACPI: 1 ACPI AML tables successfully acquired and loaded machine # [ 0.490705] ACPI: Interpreter enabled machine # [ 0.491404] ACPI: PM: (supports S0 S3 S4 S5) machine # [ 0.492339] ACPI: Using IOAPIC for interrupt routing machine # [ 0.494545] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug machine # [ 0.498338] PCI: Using E820 reservations for host bridge windows machine # [ 0.501794] ACPI: Enabled 2 GPEs in block 00 to 3F machine # [ 0.514083] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) machine # [ 0.517390] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] machine # [ 0.520605] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] machine # [ 0.523590] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] machine # [ 0.526116] PCI host bridge to bus 0000:00 machine # [ 0.527345] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] machine # [ 0.530338] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] machine # [ 0.532337] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] machine # [ 0.534337] pci_bus 0000:00: root bus resource [mem 0x80000000-0xafffffff window] machine # [ 0.537338] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] machine # [ 0.539334] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.540335] pci_bus 0000:00: root bus resource [bus 00-ff] machine # [ 0.541423] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint machine # [ 0.542799] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint machine # [ 0.555636] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] machine # [ 0.556346] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] machine # [ 0.557355] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] machine # [ 0.558513] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] machine # [ 0.561084] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.566348] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f] machine # [ 0.567342] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] machine # [ 0.568322] pci 0000:00:02.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref] machine # [ 0.569303] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] machine # [ 0.572271] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.575342] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f] machine # [ 0.576231] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] machine # [ 0.578133] pci 0000:00:03.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref] machine # [ 0.579862] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint machine # [ 0.583344] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf] machine # [ 0.584244] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] machine # [ 0.585133] pci 0000:00:04.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref] machine # [ 0.586872] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint machine # [ 0.590351] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f] machine # [ 0.591267] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] machine # [ 0.592141] pci 0000:00:05.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref] machine # [ 0.593862] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint machine # [ 0.599268] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf] machine # [ 0.601034] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] machine # [ 0.601355] pci 0000:00:06.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref] machine # [ 0.603888] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint machine # [ 0.607352] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f] machine # [ 0.608261] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] machine # [ 0.609137] pci 0000:00:07.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref] machine # [ 0.610882] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.627342] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df] machine # [ 0.628245] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] machine # [ 0.629127] pci 0000:00:08.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref] machine # [ 0.630314] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref] machine # [ 0.631917] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint machine # [ 0.635323] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] machine # [ 0.637127] pci 0000:00:09.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref] machine # [ 0.638895] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint machine # [ 0.642352] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff] machine # [ 0.643230] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] machine # [ 0.644136] pci 0000:00:0a.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref] machine # [ 0.645802] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.649351] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff] machine # [ 0.650231] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] machine # [ 0.651099] pci 0000:00:0b.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref] machine # [ 0.653824] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.655127] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f] machine # [ 0.656198] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.659028] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f] machine # [ 0.660538] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.661987] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f] machine # [ 0.663546] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint machine # [ 0.665991] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] machine # [ 0.666571] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint machine # [ 0.668630] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO machine # [ 0.670596] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint machine # [ 0.673368] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f] machine # [ 0.674221] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] machine # [ 0.675437] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint machine # [ 0.676991] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] machine # [ 0.681965] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 machine # [ 0.682452] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 machine # [ 0.683440] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 machine # [ 0.684436] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 machine # [ 0.686434] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 machine # [ 0.687434] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 machine # [ 0.688433] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 machine # [ 0.689438] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 machine # [ 0.690372] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 machine # [ 0.691352] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 machine # [ 0.692350] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 machine # [ 0.693321] ACPI: PCI: Interrupt link GSID configured for IRQ 19 machine # [ 0.695097] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 machine # [ 0.695346] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 machine # [ 0.696334] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 machine # [ 0.697291] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 machine # [ 0.700686] iommu: Default domain type: Translated machine # [ 0.701336] iommu: DMA domain TLB invalidation policy: lazy mode machine # [ 0.702595] ACPI: bus type USB registered machine # [ 0.703398] usbcore: registered new interface driver usbfs machine # [ 0.704346] usbcore: registered new interface driver hub machine # [ 0.705215] usbcore: registered new device driver usb machine # [ 0.707409] NetLabel: Initializing machine # [ 0.708014] NetLabel: domain hash size = 128 machine # [ 0.709336] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO machine # [ 0.710357] NetLabel: unlabeled traffic allowed by default machine # [ 0.711287] PCI: Using ACPI for IRQ routing machine # [ 0.754488] pci 0000:00:01.0: vgaarb: setting as boot VGA device machine # [ 0.755330] pci 0000:00:01.0: vgaarb: bridge control possible machine # [ 0.755330] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none machine # [ 0.758340] vgaarb: loaded machine # [ 0.759142] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 machine # [ 0.759986] hpet0: 3 comparators, 64-bit 100.000000 MHz counter machine # [ 0.765332] clocksource: Switched to clocksource kvm-clock machine # [ 0.767344] VFS: Disk quotas dquot_6.6.0 machine # [ 0.768104] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) machine # [ 0.769794] pnp: PnP ACPI init machine # [ 0.770679] ACPI: IRQ 4 override to edge(!), high(!) machine # [ 0.771717] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved machine # [ 0.773392] pnp: PnP ACPI: found 6 devices machine # [ 0.782146] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns machine # [ 0.783795] clocksource: Switched to clocksource acpi_pm machine # [ 0.784830] NET: Registered PF_INET protocol family machine # [ 0.786439] IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear) machine # [ 0.803785] tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.805335] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) machine # [ 0.806802] TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear) machine # [ 0.809449] TCP bind hash table entries: 32768 (order: 8, 1048576 bytes, linear) machine # [ 0.810806] TCP: Hash tables configured (established 32768 bind 32768) machine # [ 0.812033] MPTCP token hash table entries: 4096 (order: 5, 98304 bytes, linear) machine # [ 0.813385] UDP hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.814584] UDP-Lite hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.815950] NET: Registered PF_UNIX/PF_LOCAL protocol family machine # [ 0.817003] NET: Registered PF_XDP protocol family machine # [ 0.817906] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] machine # [ 0.818987] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] machine # [ 0.820059] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] machine # [ 0.821230] pci_bus 0000:00: resource 7 [mem 0x80000000-0xafffffff window] machine # [ 0.822455] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] machine # [ 0.823629] pci_bus 0000:00: resource 9 [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.825574] ACPI: \_SB_.GSIA: Enabled at IRQ 16 machine # [ 0.827700] ACPI: \_SB_.GSIB: Enabled at IRQ 17 machine # [ 0.829824] ACPI: \_SB_.GSIC: Enabled at IRQ 18 machine # [ 0.831854] ACPI: \_SB_.GSID: Enabled at IRQ 19 machine # [ 0.833625] PCI: CLS 0 bytes, default 64 machine # [ 0.834469] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) machine # [ 0.834792] Trying to unpack rootfs image as initramfs... machine # [ 0.835579] software IO TLB: mapped [mem 0x000000007a367000-0x000000007e367000] (64MB) machine # [ 0.835717] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.858667] Initialise system trusted keyrings machine # [ 0.859935] workingset: timestamp_bits=40 max_order=20 bucket_order=0 machine # [ 0.871686] Key type asymmetric registered machine # [ 0.872437] Asymmetric key parser 'x509' registered machine # [ 0.873313] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) machine # [ 0.875083] io scheduler mq-deadline registered machine # [ 0.875931] io scheduler kyber registered machine # [ 0.881176] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled machine # [ 0.882678] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A machine # [ 0.885228] Linux agpgart interface v0.103 machine # [ 0.886057] ACPI: bus type drm_connector registered machine # [ 0.889343] usbcore: registered new interface driver usbserial_generic machine # [ 0.890492] usbserial: USB Serial support registered for generic machine # [ 0.891528] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. machine # [ 0.891528] Please enable it if your BIOS has the CPPC option. machine # [ 0.893911] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled machine # [ 0.895385] drop_monitor: Initializing network drop monitor service machine # [ 0.896630] NET: Registered PF_INET6 protocol family machine # [ 0.898364] Segment Routing with IPv6 machine # [ 0.899073] In-situ OAM (IOAM) with IPv6 machine # [ 0.901942] IPI shorthand broadcast: enabled machine # [ 0.906354] sched_clock: Marking stable (760012333, 145418163)->(924130059, -18699563) machine # [ 0.908220] registered taskstats version 1 machine # [ 0.909302] Loading compiled-in X.509 certificates machine # [ 0.919315] Demotion targets for Node 0: null machine # [ 0.920577] Key type .fscrypt registered machine # [ 0.921259] Key type fscrypt-provisioning registered machine # [ 0.922286] ima: No TPM chip found, activating TPM-bypass! machine # [ 0.923268] ima: Allocated hash algorithm: sha1 machine # [ 0.924122] ima: No architecture policies found machine # [ 0.925279] PM: Magic number: 10:760:578 machine # [ 0.926057] platform pcspkr: hash matches machine # [ 0.927772] RAS: Correctable Errors collector initialized. machine # [ 0.932308] clk: Disabling unused clocks machine # [ 0.933063] PM: genpd: Disabling unused power domains machine # [ 1.090760] Freeing initrd memory: 29092K machine # [ 1.094558] Freeing unused decrypted memory: 2028K machine # [ 1.097306] Freeing unused kernel image (initmem) memory: 3644K machine # [ 1.098459] Write protecting the kernel read-only data: 32768k machine # [ 1.100643] Freeing unused kernel image (text/rodata gap) memory: 1208K machine # [ 1.102283] Freeing unused kernel image (rodata/data gap) memory: 752K machine # [ 1.167119] x86/mm: Checked W+X mappings: passed, no W+X pages found. machine # [ 1.168310] Run /init as init process machine # [ 1.181118] systemd[1]: Inserted module 'autofs4' machine # [ 1.204537] fuse: init (API version 7.45) machine # [ 1.211862] ACPI: \_SB_.GSIG: Enabled at IRQ 22 machine # [ 1.214293] ACPI: \_SB_.GSIH: Enabled at IRQ 23 machine # [ 1.217550] ACPI: \_SB_.GSIE: Enabled at IRQ 20 machine # [ 1.231799] ACPI: \_SB_.GSIF: Enabled at IRQ 21 machine # [ 1.264144] systemd[1]: Successfully made /usr/ read-only. machine # [ 1.600854] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 1.613269] systemd[1]: Detected virtualization kvm. machine # [ 1.615505] systemd[1]: Detected architecture x86-64. machine # [ 1.617693] systemd[1]: Running in initrd. machine # [ 1.620109] systemd[1]: Initializing machine ID from random generator. machine # [ 1.623085] systemd[1]: Hostname set to . machine # [ 1.759775] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 1.810875] systemd[1]: Queued start job for default target Initrd Default Target. machine # [ 1.820070] systemd[1]: Created slice Slice /system/modprobe. machine # [ 1.821308] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 1.822769] systemd[1]: Expecting device /dev/disk/by-label/nixos... machine # [ 1.823946] systemd[1]: Reached target Path Units. machine # [ 1.824862] systemd[1]: Reached target Slice Units. machine # [ 1.825785] systemd[1]: Reached target Swaps. machine # [ 1.826641] systemd[1]: Reached target Timer Units. machine # [ 1.827665] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 1.828915] systemd[1]: Listening on Journal Socket (/dev/log). machine # [ 1.830087] systemd[1]: Listening on Journal Sockets. machine # [ 1.831143] systemd[1]: Listening on udev Control Socket. machine # [ 1.832226] systemd[1]: Listening on udev Kernel Socket. machine # [ 1.833222] systemd[1]: Reached target Socket Units. machine # [ 1.835310] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 1.837493] systemd[1]: Starting Load Kernel Module 9pnet_virtio... machine # [ 1.839588] systemd[1]: Starting Load Kernel Module configfs... machine # [ 1.842503] systemd[1]: Starting Journal Service... machine # [ 1.846510] systemd[1]: Starting Load Kernel Modules... machine # [ 1.848508] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 1.857279] systemd[1]: Starting Coldplug All udev Devices... machine # [ 1.866255] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 1.868212] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 1.873811] systemd[1]: Finished Load Kernel Module configfs. machine # [ 1.878525] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config machine # [ 1.882344] netfs: FS-Cache loaded machine # [ 1.884975] systemd-journald[91]: Collecting audit messages is disabled. machine # [ 1.888560] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 1.898947] 9pnet: Installing 9P2000 support machine # [ 1.901522] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 1.905551] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 1.910617] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. machine # [ 1.910988] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. machine # [ 1.911289] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev machine # [ 1.917637] systemd[1]: Finished Load Kernel Module 9pnet_virtio. machine # [ 1.919553] systemd[1]: Finished Load Kernel Modules. machine # [ 1.923499] systemd[1]: Starting Apply Kernel Variables... machine # [ 1.925067] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 1.926467] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 1.927884] systemd[1]: Reached target Local File Systems. machine # [ 1.931501] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 1.934188] systemd[1]: Finished Apply Kernel Variables. machine # [ 1.938072] systemd[1]: Started Journal Service. machine # [ 1.792738] systemd-modules-load[93]: Using 4 probe threads machine # [ 1.794789] systemd-modules-load[93]: Inserted module 'virtio_balloon' machine # [ 1.795946] systemd-modules-load[93]: Inserted module 'virtio_gpu' machine # [ 1.797129] systemd-modules-load[93]: Inserted module 'dm_mod' machine # [ 1.798119] systemd[1]: Starting Create System Files and Directories... machine # [ 1.808326] systemd-udevd[103]: Using default interface naming scheme 'v261'. machine # [ 1.809483] systemd[1]: Finished Create System Files and Directories. machine # [ 1.817836] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 1.848722] systemd[1]: Finished Coldplug All udev Devices. machine # [ 1.849789] systemd[1]: Reached target System Initialization. machine # [ 1.850605] systemd[1]: Reached target Basic System. machine # [ 2.079125] uhci_hcd 0000:00:1d.0: UHCI Host Controller machine # [ 2.080595] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 1 machine # [ 2.081768] uhci_hcd 0000:00:1d.0: detected 2 ports machine # [ 2.082663] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c200 machine # [ 2.083625] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.084841] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.085936] usb usb1: Product: UHCI Host Controller machine # [ 2.086778] usb usb1: Manufacturer: Linux 6.18.50 uhci_hcd machine # [ 2.087565] usb usb1: SerialNumber: 0000:00:1d.0 machine # [ 2.091692] virtio_blk virtio5: 4/0/0 default/read/poll queues machine # [ 2.092471] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 machine # [ 2.095071] hub 1-0:1.0: USB hub found machine # [ 2.095889] hub 1-0:1.0: 2 ports detected machine # [ 2.098807] serio: i8042 KBD port at 0x60,0x64 irq 1 machine # [ 2.099662] serio: i8042 AUX port at 0x60,0x64 irq 12 machine # [ 2.104801] virtio_blk virtio5: [vda] 33554432 512-byte logical blocks (17.2 GB/16.0 GiB) machine # [ 1.991813] systemd[1]: Starting Virtual Console Setup... machine # [ 1.993055] (udev-worker)[124]: Network interface NamePolicy= disabled on kernel command line. machine # [ 1.994574] (udev-worker)[128]: 2.140601] ehci-pci 0000:00:1d.7: EHCI Host Controller machine # 1;38:5:185meth1: Config file /etc/systemd/network/40-eth1.link i[ 2.141684] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 2 machine # s applied to device based on potentially unpredictable interface name. machine # [ 1.998878] (udev-worker)[128]: Network interface NamePolicy= disabled on kernel command line. machine # [ 2.145522] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 machine # [ 2.152471] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 machine # [ 2.153398] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 machine # [ 2.008898] systemd-vconsole-setup[142]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 2.154651] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.154661] usb usb2: Product: EHCI Host Controller machine # [ 2.154663] usb usb2: Manufacturer: Linux 6.18.50 ehci_hcd machine # [ 2.154667] usb usb2: SerialNumber: 0000:00:1d.7 machine # [ 2.014344] systemd[1]: Finished Virtual Console Setup. machine # [ 2.159718] hub 2-0:1.0: USB hub found machine # [ 2.160980] hub 2-0:1.0: 6 ports detected machine # [ 2.182586] hub 1-0:1.0: USB hub found machine # [ 2.183176] hub 1-0:1.0: 2 ports detected machine # [ 2.184092] uhci_hcd 0000:00:1d.1: UHCI Host Controller machine # [ 2.184973] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 machine # [ 2.186130] uhci_hcd 0000:00:1d.1: detected 2 ports machine # [ 2.187128] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c220 machine # [ 2.188338] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.189799] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.190939] usb usb3: Product: UHCI Host Controller machine # [ 2.191747] usb usb3: Manufacturer: Linux 6.18.50 uhci_hcd machine # [ 2.192626] usb usb3: SerialNumber: 0000:00:1d.1 machine # [ 2.193602] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 machine # [ 2.194169] hub 3-0:1.0: USB hub found machine # [ 2.195857] hub 3-0:1.0: 2 ports detected machine # [ 2.198723] uhci_hcd 0000:00:1d.2: UHCI Host Controller machine # [ 2.199674] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 machine # [ 2.201087] uhci_hcd 0000:00:1d.2: detected 2 ports machine # [ 2.201936] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c240 machine # [ 2.202876] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.204158] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.205331] usb usb4: Product: UHCI Host Controller machine # [ 2.060122] systemd[1]: Found device /dev/disk/by-label/nixos. machine # [ 2.206089] usb usb4: Manufacturer: Linux 6.18.50 uhci_hcd machine # [ 2.207724] usb usb4: SerialNumber: 0000:00:1d.2 machine # [ 2.063192] systemd[1]: Reached target Initrd Root Device. machine # [ 2.209694] hub 4-0:1.0: USB hub found machine # [ 2.064460] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... machine # [ 2.211072] hub 4-0:1.0: 2 ports detected machine # [ 2.213158] SCSI subsystem initialized machine # [ 2.086149] systemd-fsck[150]: nixos: clean, 12/1048576 files, 109865/4194304 blocks machine # [ 2.091852] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. machine # [ 2.240499] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode machine # [ 2.241750] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) machine # [ 2.242880] ahci 0000:00:1f.2: flags: 64bit ncq only machine # [ 2.246150] scsi host0: ahci machine # [ 2.247208] scsi host1: ahci machine # [ 2.248585] scsi host2: ahci machine # [ 2.249472] scsi host3: ahci machine # [ 2.250278] scsi host4: ahci machine # [ 2.251257] scsi host5: ahci machine # [ 2.251875] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 machine # [ 2.253066] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 machine # [ 2.254259] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 machine # [ 2.255495] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 machine # [ 2.256733] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 machine # [ 2.257970] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 machine # [ 2.396616] usb 2-1: new high-speed USB device number 2 using ehci-pci machine # [ 2.529984] usb 2-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 machine # [ 2.532988] usb 2-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 machine # [ 2.535717] usb 2-1: Product: QEMU USB Tablet machine # [ 2.537330] usb 2-1: Manufacturer: QEMU machine # [ 2.538868] usb 2-1: SerialNumber: 28754-0000:00:1d.7-1 machine # [ 2.568809] hid: raw HID events driver (C) Jiri Kosina machine # [ 2.579825] ata4: SATA link down (SStatus 0 SControl 300) machine # [ 2.582185] ata2: SATA link down (SStatus 0 SControl 300) machine # [ 2.584579] ata1: SATA link down (SStatus 0 SControl 300) machine # [ 2.586901] ata5: SATA link down (SStatus 0 SControl 300) machine # [ 2.589194] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) machine # [ 2.591794] ata6: SATA link down (SStatus 0 SControl 300) machine # [ 2.593885] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 machine # [ 2.595940] ata3.00: applying bridge limits machine # [ 2.597886] ata3.00: configured for UDMA/100 machine # [ 2.600263] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 machine # [ 2.631361] usbcore: registered new interface driver usbhid machine # [ 2.633472] usbhid: USB HID core driver machine # [ 2.642633] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb2/2-1/2-1:1.0/0003:0627:0001.0001/input/input2 machine # [ 2.674590] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 machine # [ 2.694881] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray machine # [ 2.727887] cdrom: Uniform CD-ROM driver Revision: 3.20 machine # [ 2.719528] systemd[1]: Mounting /sysroot... machine # [ 3.003128] EXT4-fs (vda): mounted filesystem 1a71d2bb-5728-41be-8746-47e88923d332 r/w with ordered data mode. Quota mode: none. machine # [ 2.861395] systemd[1]: Mounted /sysroot. machine # [ 2.862412] systemd[1]: Reached target Initrd Root File System. machine # [ 2.864510] systemd[1]: Mounting /sysroot/nix/.ro-store... machine # [ 2.866283] systemd[1]: Mounting /sysroot/nix/.rw-store... machine # [ 2.868446] systemd[1]: Mounting /sysroot/run... machine # [ 2.870822] systemd[1]: Mounting /sysroot/tmp/shared... machine # [ 2.872207] systemd[1]: Mounting /sysroot/tmp/xchg... machine # [ 2.879212] systemd[1]: Starting Mountpoints Configured in the Real Root... machine # [ 2.883730] systemd[1]: Mounted /sysroot/run. machine # [ 2.886057] systemd-sysroot-fstab-check[192]: /sysroot should be mounted in the initrd, will request daemon-reload. machine # [ 2.888115] systemd[1]: Reload requested from client PID 192 ('systemd-sysroot') (unit initrd-parse-etc.service)... machine # [ 2.889672] systemd[1]: Reloading... machine # [ 3.044634] 9p: Installing v9fs 9p2000 file system support machine # [ 2.949599] systemd[1]: Reloading finished in 60 ms. machine # [ 2.975108] systemd-sysroot-fstab-check[192]: Requesting initrd-fs.target/start/replace... machine # [ 2.977446] systemd[1]: Mounted /sysroot/nix/.ro-store. machine # [ 2.978919] systemd[1]: Mounted /sysroot/nix/.rw-store. machine # [ 2.980462] systemd[1]: Mounted /sysroot/tmp/shared. machine # [ 2.981874] systemd[1]: Mounted /sysroot/tmp/xchg. machine # [ 2.983395] systemd-sysroot-fstab-check[192]: Requesting swap.target/start/replace... machine # [ 2.985736] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 2.987688] systemd[1]: initrd-parse-etc.service: Deactivated successfully. machine # [ 2.989891] systemd[1]: Finished Mountpoints Configured in the Real Root. machine # [ 2.992096] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. machine # [ 3.002491] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.004855] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.720146] systemd[1]: Mounting /sysroot/nix/store... machine # [ 3.771099] systemd[1]: Mounted /sysroot/nix/store. machine # [ 3.773123] systemd[1]: Reached target Initrd File Systems. machine # [ 3.775603] systemd[1]: Starting Find NixOS closure... machine # [ 3.777726] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... machine # [ 3.815265] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. machine # [ 3.818727] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. machine # [ 3.832904] systemd[1]: Finished Find NixOS closure. machine # [ 3.834984] systemd[1]: Reached target Initrd Default Target. machine # [ 3.837724] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... machine # [ 3.868229] systemd[1]: Stopped target Initrd Default Target. machine # [ 3.870490] systemd[1]: Stopped target Basic System. machine # [ 3.872452] systemd[1]: Stopped target Initrd Root Device. machine # [ 3.874551] systemd[1]: Stopped target Path Units. machine # [ 3.876454] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. machine # [ 3.879266] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. machine # [ 3.883083] systemd[1]: Stopped target Slice Units. machine # [ 3.885122] systemd[1]: Stopped target Socket Units. machine # [ 3.890554] systemd[1]: Stopped target System Initialization. machine # [ 3.893243] systemd[1]: Stopped target Swaps. machine # [ 3.895621] systemd[1]: Stopped target Timer Units. machine # [ 3.897800] systemd[1]: dbus.socket: Deactivated successfully. machine # [ 3.900410] systemd[1]: Closed D-Bus System Message Bus Socket. machine # [ 3.903121] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. machine # [ 3.906181] systemd[1]: Stopped Find NixOS closure. machine # [ 3.907869] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio machine # [ 3.911376] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.913411] systemd[1]: systemd-sysctl.service: Deactivated successfully. machine # [ 3.915601] systemd[1]: Stopped Apply Kernel Variables. machine # [ 3.917432] systemd[1]: systemd-modules-load.service: Deactivated successfully. machine # [ 3.919767] systemd[1]: Stopped Load Kernel Modules. machine # [ 3.921519] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. machine # [ 3.923970] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. machine # [ 3.925260] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. machine # [ 3.926449] systemd[1]: Stopped Create System Files and Directories. machine # [ 3.927512] systemd[1]: Stopped target Local File Systems. machine # [ 3.928457] systemd[1]: Stopped target Preparation for Local File Systems. machine # [ 3.929587] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. machine # [ 3.930773] systemd[1]: Stopped Coldplug All udev Devices. machine # [ 3.931719] systemd[1]: Stopping Rule-based Manager for Device Events and Files... machine # [ 3.932941] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 3.934199] systemd[1]: Stopped Virtual Console Setup. machine # [ 3.935089] systemd[1]: initrd-cleanup.service: Deactivated successfully. machine # [ 3.936305] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. machine # [ 3.937382] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.938549] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.939562] systemd[1]: systemd-udevd.service: Deactivated successfully. machine # [ 3.940636] systemd[1]: Stopped Rule-based Manager for Device Events and Files. machine # [ 3.941811] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. machine # [ 3.942988] systemd[1]: Closed udev Control Socket. machine # [ 3.943862] systemd[1]: Starting Cleanup udev Database... machine # [ 3.944800] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. machine # [ 3.946054] systemd[1]: Stopped Create Static Device Nodes in /dev. machine # [ 3.947083] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. machine # [ 3.948385] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. machine # [ 3.949557] systemd[1]: kmod-static-nodes.service: Deactivated successfully. machine # [ 3.950681] systemd[1]: Stopped Create List of Static Device Nodes. machine # [ 3.957292] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. machine # [ 3.958560] systemd[1]: Finished Cleanup udev Database. machine # [ 3.959624] systemd[1]: Reached target Switch Root. machine # [ 3.961370] systemd[1]: Starting NixOS Activation... machine # [ 4.156488] initrd-nixos-activation-start[242]: booting system configuration /nix/store/2pwl8rqzha4xr6s9y3n7iadjg7zq340h-nixos-system-machine-test machine # [ 4.226066] initrd-nixos-activation-start[242]: running activation script... machine # [ 4.613108] initrd-nixos-activation-start[265]: setting up /etc... machine # [ 4.850586] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. machine # [ 4.852950] systemd[1]: Finished NixOS Activation. machine # [ 4.854471] systemd[1]: Starting Switch Root... machine # [ 4.874714] systemd[1]: Switching root. machine # [ 5.078088] systemd-journald[91]: Received SIGTERM from PID 1 (systemd). machine # [ 5.225060] NET: Registered PF_VSOCK protocol family machine # [ 5.616943] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 5.627197] systemd[1]: Detected virtualization kvm. machine # [ 5.629091] systemd[1]: Detected architecture x86-64. machine # [ 5.631100] systemd[1]: Detected first boot. machine # [ 5.638977] systemd[1]: Initializing machine ID from random generator. machine # [ 5.801439] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 5.923366] systemd[1]: Applying preset policy. machine # [ 6.319651] systemd[1]: Populated /etc with preset unit settings. machine # [ 6.842132] systemd[1]: initrd-switch-root.service: Deactivated successfully. machine # [ 6.843617] systemd[1]: Stopped initrd-switch-root.service. machine # [ 6.846714] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. machine # [ 6.849106] systemd[1]: Created slice Slice /system/getty. machine # [ 6.850591] systemd[1]: Created slice User and Session Slice. machine # [ 6.851551] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 6.852882] systemd[1]: Started Forward Password Requests to Wall Directory Watch. machine # [ 6.854023] systemd[1]: Expecting device /dev/hvc0... machine # [ 6.854955] systemd[1]: Expecting device /dev/ttyS0... machine # [ 6.855846] systemd[1]: Reached target Local Encrypted Volumes. machine # [ 6.856761] systemd[1]: Stopped target initrd-fs.target. machine # [ 6.857549] systemd[1]: Stopped target initrd-root-fs.target. machine # [ 6.858520] systemd[1]: Stopped target initrd-switch-root.target. machine # [ 6.859443] systemd[1]: Reached target Virtual Machines and Containers. machine # [ 6.860428] systemd[1]: Reached target Path Units. machine # [ 6.861243] systemd[1]: Reached target Remote File Systems. machine # [ 6.862177] systemd[1]: Reached target Slice Units. machine # [ 6.863034] systemd[1]: Reached target Swaps. machine # [ 6.866984] systemd[1]: Listening on Query the User Interactively for a Password. machine # [ 6.871021] systemd[1]: Listening on Process Core Dump Socket. machine # [ 6.874164] systemd[1]: Listening on Credential Encryption/Decryption. machine # [ 6.877343] systemd[1]: Listening on Factory Reset Management. machine # [ 6.878490] systemd[1]: Listening on Hostname Service Socket. machine # [ 6.882719] systemd[1]: Starting Journal Log Access Socket... machine # [ 6.884531] systemd[1]: Listening on Journal Audit Socket. machine # [ 6.887794] systemd[1]: Listening on Console Output Muting Service Socket. machine # [ 6.889111] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. machine # [ 6.891129] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.892770] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki machine # [ 6.903485] systemd[1]: Listening on Disk Repartitioning Service Socket. machine # [ 6.904561] systemd[1]: Listening on udev Control Socket. machine # [ 6.905507] systemd[1]: Listening on udev Varlink Socket. machine # [ 6.912125] systemd[1]: Mounting Huge Pages File System... machine # [ 6.915295] systemd[1]: Mounting POSIX Message Queue File System... machine # [ 6.918607] systemd[1]: Mounting Kernel Debug File System... machine # [ 6.921575] systemd[1]: Mounting Kernel Trace File System... machine # [ 6.930412] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 6.931668] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio machine # [ 6.935575] systemd[1]: Starting Load Kernel Module configfs... machine # [ 6.936957] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm machine # [ 6.939097] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.941022] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.945239] systemd[1]: Mounting FUSE Control File System... machine # [ 6.946583] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.952803] systemd[1]: Starting Journal Service... machine # [ 6.956634] systemd[1]: Starting Load Kernel Modules... machine # [ 6.982704] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... machine # [ 6.993245] systemd[1]: Starting Remount Root and Kernel File Systems... machine # [ 6.995646] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 7.001175] systemd[1]: Starting Coldplug All udev Devices... machine # [ 7.004357] systemd[1]: Listening on Journal Log Access Socket. machine # [ 7.016528] systemd[1]: Mounted Kernel Debug File System. machine # [ 7.019048] systemd[1]: Mounted Huge Pages File System. machine # [ 7.022248] systemd[1]: Mounted POSIX Message Queue File System. machine # [ 7.023918] systemd[1]: Mounted Kernel Trace File System. machine # [ 7.026002] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 7.027969] systemd[1]: Mounted FUSE Control File System. machine # [ 7.032560] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 7.034185] systemd-journald[335]: Collecting audit messages is enabled. machine # [ 7.036800] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 7.040827] systemd[1]: Finished Load Kernel Module configfs. machine # [ 7.044508] systemd[1]: Mounting Kernel Configuration File System... machine # [ 7.052528] EXT4-fs (vda): re-mounted 1a71d2bb-5728-41be-8746-47e88923d332. machine # [ 7.060509] systemd[1]: Finished Remount Root and Kernel File Systems. machine # [ 7.062577] systemd[1]: Listening on Disk Image Download Service Socket. machine # [ 7.064156] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.919280] systemd[1]: Queued start job for default target Multi-User System. machine # [ 6.922444] systemd[1]: systemd-journald.service: Deactivated successfully. machine # [ 7.067780] loop: module loaded machine # [ 7.068486] systemd[1]: Starting Load/Save OS Random Seed... machine # [ 6.926523] systemd-modules-load[336]: Using 2 probe threads machine # [ 7.068513] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 7.068690] systemd[1]: Started Journal Service. machine # [ 6.932298] systemd-oomd[337]: No swap; memory pressure usage will be degraded machine # [ 6.934350] systemd[1]: Starting Flush Journal to Persistent Storage... machine # [ 6.936656] systemd-modules-load[336]: Inserted module 'loop' machine # [ 6.938875] systemd[1]: Mounted Kernel Configuration File System. machine # [ 6.942738] systemd[1]: Finished Load Kernel Modules. machine # [ 6.945065] systemd[1]: Starting Apply Kernel Variables... machine # [ 6.946586] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. machine # [ 7.109630] systemd-journald[335]: Received client request to flush runtime journal. machine # [ 7.001473] systemd[1]: Finished Load/Save OS Random Seed. machine # [ 7.002758] systemd[1]: Reached target First Boot Complete. machine # [ 7.003942] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 7.005314] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 7.006504] systemd[1]: Finished Apply Kernel Variables. machine # [ 7.007883] systemd[1]: Finished Flush Journal to Persistent Storage. machine # [ 7.041484] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 7.043039] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 7.046092] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 7.048045] systemd[1]: Finished Coldplug All udev Devices. machine # [ 7.114807] systemd-udevd[368]: Using default interface naming scheme 'v261'. machine # [ 7.212141] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 7.276755] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 7.294316] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. machine # [ 7.308430] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. machine # [ 7.315094] (udev-worker)[375]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 7.317531] (udev-worker)[375]: Network interface NamePolicy= disabled on kernel command line. machine # [ 7.319324] (udev-worker)[383]: Network interface NamePolicy= disabled on kernel command line. machine # [ 7.350662] systemd[1]: Condition check resulted in Virtio network device being skipped. machine # [ 7.354234] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 7.356159] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc6[ 7.502716] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console machine # 7 machine # [ 7.359433] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 7.361215] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 7.362690] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 7.510005] mousedev: PS/2 mouse device common for all mice machine # [ 7.517524] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 machine # [ 7.522226] Console: switching to colour dummy device 80x25 machine # [ 7.523580] ACPI: button: Power Button [PWRF] machine # [ 7.526604] [drm] Found bochs VGA, ID 0xb0c5. machine # [ 7.527124] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. machine # [ 7.535884] rtc_cmos 00:04: RTC can wake from S4 machine # [ 7.541323] parport_pc 00:02: reported by Plug and Play ACPI machine # [ 7.542037] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized machine # [ 7.542673] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic machine # [ 7.543765] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 machine # [ 7.545826] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] machine # [ 7.553189] rtc_cmos 00:04: registered as rtc0 machine # [ 7.553294] rtc_cmos 00:04: setting system clock to 2026-09-22T10:34:54 UTC (1790073294) machine # [ 7.553793] rtc_cmos 00:04: alarms up to one day, y3k, 242 bytes nvram, hpet irqs machine # [ 7.554905] Console: switching to colour frame buffer device 160x50 machine # [ 7.558499] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device machine # [ 7.580127] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:09.0/virtio7/input/input4 machine # [ 7.601005] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 machine # [ 7.605043] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 machine # [ 7.613602] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt machine # [ 7.628181] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD machine # [ 7.494393] systemd[1]: Starting Virtual Console Setup... machine # [ 7.641761] ppdev: user-space parallel port driver machine # [ 7.650081] iTCO_wdt iTCO_wdt.0.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) machine # [ 7.652684] iTCO_wdt iTCO_wdt.0.auto: initialized. heartbeat=30 sec (nowayout=0) machine # [ 7.519923] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 7.521228] systemd[1]: Stopped Virtual Console Setup. machine # [ 7.525639] systemd[1]: Starting Virtual Console Setup... machine # [ 7.779367] kvm_amd: TSC scaling supported machine # [ 7.780168] kvm_amd: Nested Virtualization enabled machine # [ 7.780956] kvm_amd: Nested Paging enabled machine # [ 7.781636] kvm_amd: LBR virtualization supported machine # [ 7.782334] kvm_amd: Virtual VMLOAD VMSAVE supported machine # [ 7.783133] kvm_amd: Virtual GIF supported machine # [ 7.783806] kvm_amd: Virtual NMI enabled machine # [ 7.819999] EDAC MC: Ver: 3.0.0 machine # [ 7.698883] systemd[1]: Mounting /run/wrappers... machine # [ 7.725099] systemd[1]: Mounted /run/wrappers. machine # [ 7.726712] systemd[1]: Reached target Local File Systems. machine # [ 7.729481] systemd[1]: Listening on Boot Loader Control Service Socket. machine # [ 7.731265] systemd[1]: Starting register-nix-paths.service... machine # [ 7.734041] systemd[1]: Starting Create SUID/SGID Wrappers... machine # [ 7.734924] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. machine # [ 7.736415] systemd[1]: Starting Save Transient machine-id to Disk... machine # [ 7.740985] systemd[1]: Starting Create System Files and Directories... machine # [ 7.768098] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. machine # [ 7.770759] systemd[1]: Finished Save Transient machine-id to Disk. machine # [ 7.791823] systemd[1]: Finished Create System Files and Directories. machine # [ 7.794561] systemd[1]: Starting Rebuild Journal Catalog... machine # [ 7.797314] systemd[1]: Starting Record System Boot/Shutdown in UTMP... machine # [ 7.824516] systemd[1]: Finished Record System Boot/Shutdown in UTMP. machine # [ 7.849123] systemd[1]: Finished Rebuild Journal Catalog. machine # [ 7.852781] systemd[1]: Starting Update is Completed... machine # [ 7.879225] systemd[1]: Finished Update is Completed. machine # [ 7.900276] systemd-vconsole-setup[409]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 7.904921] systemd[1]: Finished Virtual Console Setup. machine # [ 8.037410] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. machine # [ 8.039187] systemd[1]: Finished Create SUID/SGID Wrappers. machine # [ 8.643043] systemd[1]: Finished register-nix-paths.service. machine # [ 8.644192] systemd[1]: Reached target System Initialization. machine # [ 8.645469] systemd[1]: Started Discard unused filesystem blocks once a week. machine # [ 8.646506] systemd[1]: Started niks3 garbage collection timer. machine # [ 8.647336] systemd[1]: Started Daily Cleanup of Temporary Directories. machine # [ 8.648253] systemd[1]: Reached target Timer Units. machine # [ 8.648935] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 8.660712] systemd[1]: Listening on niks3 server socket. machine # [ 8.661612] systemd[1]: Listening on Nix Daemon Socket. machine # [ 8.662451] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. machine # [ 8.663592] systemd[1]: Reached target Socket Units. machine # [ 8.664312] systemd[1]: Reached target Basic System. machine # [ 8.667584] systemd[1]: Started backdoor.service. machine # [ 8.670237] systemd[1]: Starting Import lastlog data into lastlog2 database... machine # [ 8.673234] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 8.675935] systemd[1]: Starting Post-Boot Actions... machine # [ 8.690111] systemd[1]: Started Reset console on configuration changes. machine # [ 8.694871] systemd[1]: Starting resolvconf update... machine # [ 8.697901] systemd[1]: Started rustfs.service. machine # [ 8.700111] systemd[1]: Starting rustfs-bucket.service... machine # [ 8.708741] systemd[1]: Starting D-Bus System Message Bus... machine # [ 8.726730] systemd[1]: Finished Post-Boot Actions. machine # [ 8.749359] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # connecting to host... machine # [ 8.753220] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 8.754617] nsncd[492]: Sep 22 10:34:55.840 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 8.755969] systemd[1]: Reached target User and Group Name Lookups. machine # [ 8.757110] systemd[1]: Starting User Login Management... machine # [ 8.758155] systemd[1]: Finished Import lastlog data into lastlog2 database. machine: Guest shell says: b'Spawning backdoor root shell...\n' machine: connected to guest root shell machine: (connecting took 9.41 seconds) machine: (finished: waiting for the VM to finish booting, in 9.64 seconds) machine # [ 8.798300] dbus-broker-launch[499]: Looking up NSS user entry for 'systemd-timesync'... machine # [ 8.811875] dbus-broker-launch[499]: NSS returned no entry for 'systemd-timesync' machine # [ 8.812061] dbus-broker-launch[499]: Invalid user-name in /nix/store/sjdn8ydiry7lgasbr6jfz0ilm5vcd4dl-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" machine # [ 8.825706] systemd-logind[521]: New seat seat0. machine # [ 8.830043] systemd-logind[521]: Watching system buttons on /dev/input/event2 (Power Button) machine # [ 8.832342] systemd-logind[521]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) machine # [ 8.834175] systemd-logind[521]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) machine # [ 8.852710] systemd[1]: Started User Login Management. machine # [ 8.853746] systemd[1]: Started D-Bus System Message Bus. machine # [ 8.856561] systemd[1]: Stopped target Host and Network Name Lookups. machine # [ 8.858076] systemd[1]: Stopping Host and Network Name Lookups... machine # [ 8.859546] systemd[1]: Stopped target User and Group Name Lookups. machine # [ 8.861822] systemd[1]: Stopping User and Group Name Lookups... machine # [ 8.863542] dbus-broker-launch[499]: Ready machine # [ 8.864491] systemd[1]: Starting linger-users.service... machine # [ 8.865514] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... machine # [ 8.866968] systemd[1]: nscd.service: Deactivated successfully. machine # [ 8.868350] systemd[1]: Stopped Name Service Cache Daemon (nsncd). machine # [ 8.873276] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 8.893372] systemd[1]: linger-users.service: Deactivated successfully. machine # [ 8.893972] systemd[1]: Finished linger-users.service. machine # [ 8.909807] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 8.911335] nsncd[583]: Sep 22 10:34:56.001 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 8.911547] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 8.912087] systemd[1]: Reached target User and Group Name Lookups. machine # [ 8.931313] systemd[1]: Finished resolvconf update. machine # [ 8.931779] systemd[1]: Reached target Preparation for Network. machine # [ 8.934626] systemd[1]: Starting DHCP Client... machine # [ 8.937663] systemd[1]: Starting Address configuration of eth1... machine # [ 8.940676] systemd[1]: Starting Extra networking commands.... machine # [ 9.011039] network-addresses-eth1-start[615]: adding address 192.168.1.1/24... done machine # [ 9.026448] network-addresses-eth1-start[615]: adding address 2001:db8:1::1/64... done machine # [ 9.034862] dhcpcd[622]: dhcpcd-10.3.2 starting machine # [ 9.039504] systemd[1]: Finished Address configuration of eth1. machine # [ 9.043557] dhcpcd[675]: dev: loaded udev machine # [ 9.208973] 8021q: 802.1Q VLAN Support v1.8 machine # [ 9.209752] 8021q: adding VLAN 0 to HW filter on device eth1 machine # [ 9.066978] systemd[1]: Finished Extra networking commands.. machine # [ 9.067748] systemd[1]: Reached target Network. machine # [ 9.071364] systemd[1]: Starting PostgreSQL Server... machine # [ 9.076710] systemd[1]: Starting Permit User Sessions... machine # [ 9.088223] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. machine # [ 9.101899] systemd[1]: Finished Permit User Sessions. machine # [ 9.105926] systemd[1]: Started Getty on tty1. machine # [ 9.107508] systemd[1]: Reached target Login Prompts. machine # [ 9.318585] cfg80211: Loading compiled-in X.509 certificates for regulatory database machine # [ 9.339807] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' machine # [ 9.340887] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' machine # [ 9.343829] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 machine # [ 9.345524] cfg80211: failed to load regulatory.db machine # [ 9.230124] postgresql-pre-start[703]: The files belonging to this database system will be owned by user "postgres". machine # [ 9.230333] postgresql-pre-start[703]: This user must also own the server process. machine # [ 9.239948] postgresql-pre-start[703]: The database cluster will be initialized with locale "en_US.UTF-8". machine # [ 9.240260] postgresql-pre-start[703]: The default database encoding has accordingly been set to "UTF8". machine # [ 9.240769] postgresql-pre-start[703]: The default text search configuration will be set to "english". machine # [ 9.241430] postgresql-pre-start[703]: Data page checksums are enabled. machine # [ 9.241925] postgresql-pre-start[703]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok machine # [ 9.242541] postgresql-pre-start[703]: creating subdirectories ... ok machine # [ 9.247325] postgresql-pre-start[703]: selecting dynamic shared memory implem[ 9.392942] 8021q: adding VLAN 0 to HW filter on device eth0 machine # entation ... posix machine # [ 9.249452] dhcpcd[675]: eth0: waiting for carrier machine # [ 9.249866] dhcpcd[675]: eth0: carrier acquired machine # [ 9.256946] dhcpcd[675]: DUID 00:01:00:01:32:45:16:50:52:54:00:12:34:56 machine # [ 9.257461] dhcpcd[675]: eth0: IAID 00:12:34:56 machine # [ 9.258177] dhcpcd[675]: eth0: adding address fe80::5054:ff:fe12:3456 machine # [ 9.325536] postgresql-pre-start[703]: selecting default "max_connections" ... 100 machine # [ 9.384219] postgresql-pre-start[703]: selecting default "shared_buffers" ... 128MB machine # [ 11.017542] postgresql-pre-start[703]: selecting default time zone ... UTC machine # [ 11.021669] postgresql-pre-start[703]: creating configuration files ... ok machine # [ 11.142294] dhcpcd[675]: eth0: soliciting an IPv6 router machine # [ 11.143182] dhcpcd[675]: eth0: Router Advertisement from fe80::2 machine # [ 11.146149] dhcpcd[675]: eth0: adding address fec0::5054:ff:fe12:3456/64 machine # [ 11.148440] dhcpcd[675]: eth0: adding route to fec0::/64 machine # [ 11.149960] dhcpcd[675]: eth0: adding default route via fe80::2 machine # [ 11.174197] dhcpcd[675]: eth0: soliciting a DHCP lease machine # [ 11.346840] NET: Registered PF_PACKET protocol family machine # [ 11.208588] dhcpcd[675]: eth0: offered 10.0.2.15 from 10.0.2.2 machine # [ 11.214239] dhcpcd[675]: eth0: probing address 10.0.2.15/24 machine # [ 11.270104] postgresql-pre-start[703]: running bootstrap script ... ok machine # [ 11.833561] postgresql-pre-start[703]: performing post-bootstrap initialization ... ok machine # [ 11.979523] postgresql-pre-start[703]: syncing data to disk ... ok machine # [ 11.980170] postgresql-pre-start[703]: initdb: warning: enabling "trust" authentication for local connections machine # [ 11.980781] postgresql-pre-start[703]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. machine # [ 11.981473] postgresql-pre-start[703]: Success. You can now start the database server using: machine # [ 11.982160] postgresql-pre-start[703]: pg_ctl -D /var/lib/postgresql/18 -l logfile start machine # [ 12.145637] postgres[756]: [756] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit machine # [ 12.150748] postgres[756]: [756] LOG: listening on IPv6 address "::1", port 5432 machine # [ 12.151882] postgres[756]: [756] LOG: listening on IPv4 address "127.0.0.1", port 5432 machine # [ 12.153977] postgres[756]: [756] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" machine # [ 12.164922] postgres[774]: [774] LOG: database system was shut down at 2026-09-22 10:34:58 GMT machine # [ 12.170451] postgres[756]: [756] LOG: database system is ready to accept connections machine # [ 12.174744] systemd[1]: Started PostgreSQL Server. machine # [ 12.178568] systemd[1]: Starting PostgreSQL Setup Scripts... machine # [ 12.464946] postgresql-setup-start[785]: CREATE DATABASE machine # [ 12.521736] postgresql-setup-start[795]: CREATE ROLE machine # [ 12.554240] postgresql-setup-start[797]: ALTER DATABASE machine # [ 12.559411] systemd[1]: Finished PostgreSQL Setup Scripts. machine # [ 12.560655] systemd[1]: Reached target PostgreSQL. machine # [ 16.556151] dhcpcd[675]: eth0: leased 10.0.2.15 for 86400 seconds machine # [ 16.556608] dhcpcd[675]: eth0: adding route to 10.0.2.0/24 machine # [ 16.560081] dhcpcd[675]: eth0: adding default route via 10.0.2.2 machine # [ 16.740468] systemd[1]: Started DHCP Client. machine # [ 16.741870] systemd[1]: Reached target Network is Online. machine # [ 16.746099] systemd[1]: Starting k3s service... machine # [ 16.934894] k3s[892]: time="2026-09-22T10:35:04Z" level=info msg="Acquiring lock file /var/lib/rancher/k3s/data/.lock" machine # [ 16.936819] k3s[892]: time="2026-09-22T10:35:04Z" level=info msg="Preparing data dir /var/lib/rancher/k3s/data/76c98da5fd74d9a243cba8d533ae287fc547ab08ccd8c5ea4811608ce7075724" machine # [ 20.667516] k3s[892]: time="2026-09-22T10:35:07Z" level=info msg="Starting k3s 1.35.8+k3s1 (e952d68a)" machine # [ 20.673869] k3s[892]: time="2026-09-22T10:35:07Z" level=info msg="Configuring sqlite3 database connection pooling: maxIdle=20, maxOpen=0, maxLifetime=0s, maxIdleTime=2m0s" machine # [ 20.674093] k3s[892]: time="2026-09-22T10:35:07Z" level=info msg="Kine built with sqlite from github.com/mattn/go-sqlite3 version 3.53.3" machine # [ 20.674798] k3s[892]: time="2026-09-22T10:35:07Z" level=info msg="Configuring database table schema and indexes, this may take a moment..." machine # [ 20.693238] k3s[892]: time="2026-09-22T10:35:07Z" level=info msg="Database tables and indexes are up to date" machine # [ 20.693368] k3s[892]: time="2026-09-22T10:35:07Z" level=info msg="Running startup VACUUM to reclaim disk space, this may take a moment..." machine # [ 20.696890] k3s[892]: time="2026-09-22T10:35:07Z" level=info msg="Startup VACUUM completed successfully" machine # [ 20.698627] k3s[892]: time="2026-09-22T10:35:07Z" level=info msg="Kine available at unix://kine.sock" machine # [ 20.699830] k3s[892]: time="2026-09-22T10:35:07Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 20.702072] k3s[892]: time="2026-09-22T10:35:07Z" level=info msg="Datastore connection validated successfully, proceeding with bootstrap data generation" machine # [ 20.702619] k3s[892]: time="2026-09-22T10:35:07Z" level=info msg="generated self-signed CA certificate CN=k3s-client-ca@1790073307: notBefore=2026-09-22 09:35:07.793509369 +0000 UTC notAfter=2036-09-19 09:35:07.793509369 +0000 UTC" machine # [ 20.703520] k3s[892]: time="2026-09-22T10:35:07Z" level=info msg="certificate CN=system:admin,O=system:masters signed by CN=k3s-client-ca@1790073307: notBefore=2026-09-22 09:35:07 +0000 UTC notAfter=2027-09-22 09:35:07 +0000 UTC" machine # [ 20.704473] k3s[892]: time="2026-09-22T10:35:07Z" level=info msg="certificate CN=system:k3s-supervisor,O=system:masters signed by CN=k3s-client-ca@1790073307: notBefore=2026-09-22 09:35:07 +0000 UTC notAfter=2027-09-22 09:35:07 +0000 UTC" machine # [ 20.705049] k3s[892]: time="2026-09-22T10:35:07Z" level=info msg="certificate CN=system:kube-controller-manager signed by CN=k3s-client-ca@1790073307: notBefore=2026-09-22 09:35:07 +0000 UTC notAfter=2027-09-22 09:35:07 +0000 UTC" machine # [ 20.705666] k3s[892]: time="2026-09-22T10:35:07Z" level=info msg="certificate CN=system:kube-scheduler signed by CN=k3s-client-ca@1790073307: notBefore=2026-09-22 09:35:07 +0000 UTC notAfter=2027-09-22 09:35:07 +0000 UTC" machine # [ 20.706573] k3s[892]: time="2026-09-22T10:35:07Z" level=info msg="certificate CN=system:apiserver,O=system:masters signed by CN=k3s-client-ca@1790073307: notBefore=2026-09-22 09:35:07 +0000 UTC notAfter=2027-09-22 09:35:07 +0000 UTC" machine # [ 20.707496] k3s[892]: time="2026-09-22T10:35:07Z" level=info msg="certificate CN=k3s-cloud-controller-manager signed by CN=k3s-client-ca@1790073307: notBefore=2026-09-22 09:35:07 +0000 UTC notAfter=2027-09-22 09:35:07 +0000 UTC" machine # [ 20.708742] k3s[892]: time="2026-09-22T10:35:07Z" level=info msg="generated self-signed CA certificate CN=k3s-server-ca@1790073307: notBefore=2026-09-22 09:35:07.796489077 +0000 UTC notAfter=2036-09-19 09:35:07.796489077 +0000 UTC" machine # [ 20.709614] k3s[892]: time="2026-09-22T10:35:07Z" level=info msg="certificate CN=kube-apiserver signed by CN=k3s-server-ca@1790073307: notBefore=2026-09-22 09:35:07 +0000 UTC notAfter=2027-09-22 09:35:07 +0000 UTC" machine # [ 20.710525] k3s[892]: time="2026-09-22T10:35:07Z" level=info msg="certificate CN=kube-scheduler signed by CN=k3s-server-ca@1790073307: notBefore=2026-09-22 09:35:07 +0000 UTC notAfter=2027-09-22 09:35:07 +0000 UTC" machine # [ 20.711445] k3s[892]: time="2026-09-22T10:35:07Z" level=info msg="certificate CN=kube-controller-manager signed by CN=k3s-server-ca@1790073307: notBefore=2026-09-22 09:35:07 +0000 UTC notAfter=2027-09-22 09:35:07 +0000 UTC" machine # [ 20.712360] k3s[892]: time="2026-09-22T10:35:07Z" level=info msg="generated self-signed CA certificate CN=k3s-request-header-ca@1790073307: notBefore=2026-09-22 09:35:07.797984239 +0000 UTC notAfter=2036-09-19 09:35:07.797984239 +0000 UTC" machine # [ 20.712962] k3s[892]: time="2026-09-22T10:35:07Z" level=info msg="certificate CN=system:auth-proxy signed by CN=k3s-request-header-ca@1790073307: notBefore=2026-09-22 09:35:07 +0000 UTC notAfter=2027-09-22 09:35:07 +0000 UTC" machine # [ 20.713868] k3s[892]: time="2026-09-22T10:35:07Z" level=info msg="generated self-signed CA certificate CN=etcd-server-ca@1790073307: notBefore=2026-09-22 09:35:07.798682093 +0000 UTC notAfter=2036-09-19 09:35:07.798682093 +0000 UTC" machine # [ 20.714783] k3s[892]: time="2026-09-22T10:35:07Z" level=info msg="certificate CN=etcd-client signed by CN=etcd-server-ca@1790073307: notBefore=2026-09-22 09:35:07 +0000 UTC notAfter=2027-09-22 09:35:07 +0000 UTC" machine # [ 20.715689] k3s[892]: time="2026-09-22T10:35:07Z" level=info msg="generated self-signed CA certificate CN=etcd-peer-ca@1790073307: notBefore=2026-09-22 09:35:07.79933888 +0000 UTC notAfter=2036-09-19 09:35:07.79933888 +0000 UTC" machine # [ 20.716600] k3s[892]: time="2026-09-22T10:35:07Z" level=info msg="certificate CN=etcd-peer signed by CN=etcd-peer-ca@1790073307: notBefore=2026-09-22 09:35:07 +0000 UTC notAfter=2027-09-22 09:35:07 +0000 UTC" machine # [ 20.717546] k3s[892]: time="2026-09-22T10:35:07Z" level=info msg="certificate CN=etcd-server signed by CN=etcd-server-ca@1790073307: notBefore=2026-09-22 09:35:07 +0000 UTC notAfter=2027-09-22 09:35:07 +0000 UTC" machine # [ 20.726063] k3s[892]: time="2026-09-22T10:35:07Z" level=info msg="certificate CN=k3s,O=k3s signed by CN=k3s-server-ca@1790073307: notBefore=2026-09-22 09:35:07 +0000 UTC notAfter=2027-09-22 09:35:07 +0000 UTC" machine # [ 20.726614] k3s[892]: time="2026-09-22T10:35:07Z" level=warning msg="dynamiclistener [::]:6443: no cached certificate available for preload - deferring certificate load until storage initialization or first client request" machine # [ 20.728980] k3s[892]: time="2026-09-22T10:35:07Z" level=info msg="Active TLS secret / (ver=) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__f275_f13c_a7f6_f10e-dc709f:fec0::f275:f13c:a7f6:f10e listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=3CA9B48706B481664B50E92061C1F76B3A95C72B]" machine # [ 21.570484] k3s[892]: time="2026-09-22T10:35:08Z" level=info msg="Password verified locally for node machine" machine # [ 21.571122] k3s[892]: time="2026-09-22T10:35:08Z" level=info msg="certificate CN=machine signed by CN=k3s-server-ca@1790073307: notBefore=2026-09-22 09:35:08 +0000 UTC notAfter=2027-09-22 09:35:08 +0000 UTC" machine # [ 21.805449] k3s[892]: time="2026-09-22T10:35:08Z" level=info msg="certificate CN=system:node:machine,O=system:nodes signed by CN=k3s-client-ca@1790073307: notBefore=2026-09-22 09:35:08 +0000 UTC notAfter=2027-09-22 09:35:08 +0000 UTC" machine # [ 21.890476] k3s[892]: time="2026-09-22T10:35:08Z" level=info msg="certificate CN=system:kube-proxy signed by CN=k3s-client-ca@1790073307: notBefore=2026-09-22 09:35:08 +0000 UTC notAfter=2027-09-22 09:35:08 +0000 UTC" machine # [ 21.967768] rustfs-bucket-start[929]: mb s3://farm machine # [ 21.971657] k3s[892]: time="2026-09-22T10:35:09Z" level=info msg="certificate CN=system:k3s-controller signed by CN=k3s-client-ca@1790073307: notBefore=2026-09-22 09:35:09 +0000 UTC notAfter=2027-09-22 09:35:09 +0000 UTC" machine # [ 21.980988] systemd[1]: Finished rustfs-bucket.service. machine # [ 22.053125] k3s[892]: time="2026-09-22T10:35:09Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:44358: runtime core not ready" machine # [ 22.131848] k3s[892]: time="2026-09-22T10:35:09Z" level=info msg="Module overlay was already loaded" machine # [ 22.387522] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. machine # [ 22.393034] Bridge firewalling registered machine # [ 22.273666] k3s[892]: time="2026-09-22T10:35:09Z" level=warning msg="Failed to load kernel module iptable_nat with modprobe" machine # [ 22.297104] k3s[892]: time="2026-09-22T10:35:09Z" level=warning msg="Failed to load kernel module iptable_filter with modprobe" machine # [ 22.317271] k3s[892]: time="2026-09-22T10:35:09Z" level=warning msg="Failed to load kernel module nft-expr-counter with modprobe" machine # [ 22.414054] k3s[892]: time="2026-09-22T10:35:09Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_max' to 131072" machine # [ 22.414398] k3s[892]: time="2026-09-22T10:35:09Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400" machine # [ 22.415702] k3s[892]: time="2026-09-22T10:35:09Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600" machine # [ 22.417412] k3s[892]: time="2026-09-22T10:35:09Z" level=info msg="Set sysctl 'net/ipv4/conf/all/forwarding' to 1" machine # [ 22.418601] k3s[892]: time="2026-09-22T10:35:09Z" level=info msg="Creating k3s-cert-monitor event broadcaster" machine # [ 22.420211] k3s[892]: time="2026-09-22T10:35:09Z" level=info msg="Connecting to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 22.422296] k3s[892]: time="2026-09-22T10:35:09Z" level=info msg="Saving cluster bootstrap data to datastore" machine # [ 22.423472] k3s[892]: time="2026-09-22T10:35:09Z" level=info msg="Connection to etcd is ready" machine # [ 22.425788] k3s[892]: time="2026-09-22T10:35:09Z" level=info msg="ETCD server is now running" machine # [ 22.428799] k3s[892]: time="2026-09-22T10:35:09Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 22.431197] k3s[892]: time="2026-09-22T10:35:09Z" level=info msg="Handling backend connection request [machine]" machine # [ 22.432620] k3s[892]: time="2026-09-22T10:35:09Z" level=info msg="Polling for API server readiness: GET /readyz failed: the server is currently unable to handle the request" machine # [ 22.434225] k3s[892]: time="2026-09-22T10:35:09Z" level=info msg="Connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 22.435274] k3s[892]: time="2026-09-22T10:35:09Z" level=info msg="Remotedialer connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 22.437095] k3s[892]: time="2026-09-22T10:35:09Z" level=info msg="Running kube-apiserver --advertise-port=6443 --allow-privileged=true --anonymous-auth=false --api-audiences=https://kubernetes.default.svc.cluster.local,k3s --authorization-mode=Node,RBAC --bind-address=127.0.0.1 --cert-dir=/var/lib/rancher/k3s/server/tls/temporary-certs --client-ca-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --egress-selector-config-file=/var/lib/rancher/k3s/server/etc/egress-selector-config.yaml --enable-admission-plugins=NodeRestriction --enable-aggregator-routing=true --enable-bootstrap-token-auth=true --etcd-servers=unix://kine.sock --kubelet-certificate-authority=/var/lib/rancher/k3s/server/tls/server-ca.crt --kubelet-client-certificate=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.crt --kubelet-client-key=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.key --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --profiling=false --proxy-client-cert-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt --proxy-client-key-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.key --requestheader-allowed-names=system:auth-proxy --requestheader-client-ca-file=/var/lib/rancher/k3s/server/tls/request-header-ca.crt --requestheader-extra-headers-prefix=X-Remote-Extra- --requestheader-group-headers=X-Remote-Group --requestheader-username-headers=X-Remote-User --secure-port=6444 --service-account-issuer=https://kubernetes.default.svc.cluster.local --service-account-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-account-signing-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --storage-backend=etcd3 --tls-cert-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --tls-private-key-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 22.440315] k3s[892]: time="2026-09-22T10:35:09Z" level=info msg="Running kube-scheduler --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --bind-address=127.0.0.1 --kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --leader-elect=false --profiling=false --secure-port=10259 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 22.441146] k3s[892]: time="2026-09-22T10:35:09Z" level=info msg="Running kube-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --bind-address=127.0.0.1 --cluster-cidr=10.42.0.0/16 --cluster-signing-kube-apiserver-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kube-apiserver-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kubelet-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-serving-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-kubelet-serving-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --cluster-signing-legacy-unknown-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-legacy-unknown-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --configure-cloud-routes=false --controllers=*,tokencleaner,-service,-route,-cloud-node-lifecycle --kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --leader-elect=false --profiling=false --root-ca-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --secure-port=10257 --service-account-private-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key --use-service-account-credentials=true" machine # [ 22.519704] k3s[892]: time="2026-09-22T10:35:09Z" level=info msg="Running cloud-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --bind-address=127.0.0.1 --cloud-config=/var/lib/rancher/k3s/server/etc/cloud-config.yaml --cloud-provider=k3s --cluster-cidr=10.42.0.0/16 --configure-cloud-routes=false --controllers=*,-route --kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --leader-elect=false --leader-elect-resource-name=k3s-cloud-controller-manager --node-status-update-frequency=1m0s --profiling=false" machine # [ 22.520584] k3s[892]: time="2026-09-22T10:35:09Z" level=info msg="Server node token is available at /var/lib/rancher/k3s/server/token" machine # [ 22.521076] k3s[892]: time="2026-09-22T10:35:09Z" level=info msg="To join server node to cluster: k3s server -s https://10.0.2.15:6443 -t ${SERVER_NODE_TOKEN}" machine # [ 22.521578] k3s[892]: time="2026-09-22T10:35:09Z" level=info msg="Agent node token is available at /var/lib/rancher/k3s/server/agent-token" machine # [ 22.523060] k3s[892]: time="2026-09-22T10:35:09Z" level=info msg="To join agent node to cluster: k3s agent -s https://10.0.2.15:6443 -t ${AGENT_NODE_TOKEN}" machine # [ 22.523129] k3s[892]: time="2026-09-22T10:35:09Z" level=info msg="Wrote kubeconfig /etc/rancher/k3s/k3s.yaml" machine # [ 22.523663] k3s[892]: time="2026-09-22T10:35:09Z" level=info msg="Run: k3s kubectl" machine # [ 22.524230] k3s[892]: I0922 10:35:09.526576 892 options.go:263] external host was not specified, using 10.0.2.15 machine # [ 22.524732] k3s[892]: I0922 10:35:09.528040 892 server.go:158] Version: v1.35.8+k3s1 machine # [ 22.525412] k3s[892]: I0922 10:35:09.528062 892 server.go:160] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 22.526041] k3s[892]: time="2026-09-22T10:35:09Z" level=info msg="Logging containerd to /var/lib/rancher/k3s/agent/containerd/containerd.log" machine # [ 22.526564] k3s[892]: time="2026-09-22T10:35:09Z" level=info msg="Running containerd -c /var/lib/rancher/k3s/agent/etc/containerd/config.toml" machine # [ 22.527064] k3s[892]: time="2026-09-22T10:35:09Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:44400: runtime core not ready" machine # [ 22.573264] k3s[892]: I0922 10:35:09.665269 892 shared_informer.go:349] "Waiting for caches to sync" controller="node_authorizer" machine # [ 22.576327] k3s[892]: I0922 10:35:09.668375 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 22.578440] k3s[892]: I0922 10:35:09.670505 892 plugins.go:157] Loaded 14 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,PodTopologyLabels,MutatingAdmissionPolicy,MutatingAdmissionWebhook. machine # [ 22.579360] k3s[892]: I0922 10:35:09.670528 892 plugins.go:160] Loaded 14 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,NodeDeclaredFeatureValidator,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. machine # [ 22.579972] k3s[892]: I0922 10:35:09.671336 892 instance.go:240] Using reconciler: lease machine # [ 22.585785] k3s[892]: I0922 10:35:09.677854 892 handler.go:304] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager machine # [ 22.586705] k3s[892]: W0922 10:35:09.677882 892 genericapiserver.go:787] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. machine # [ 22.588047] k3s[892]: I0922 10:35:09.680097 892 cidrallocator.go:198] starting ServiceCIDR Allocator Controller machine # [ 22.624083] k3s[892]: I0922 10:35:09.715966 892 handler.go:304] Adding GroupVersion v1 to ResourceManager machine # [ 22.624246] k3s[892]: I0922 10:35:09.716108 892 apis.go:112] API group "internal.apiserver.k8s.io" is not enabled, skipping. machine # [ 22.644868] k3s[892]: time="2026-09-22T10:35:09Z" level=info msg="Running kube-proxy --cluster-cidr=10.42.0.0/16 --conntrack-max-per-core=0 --conntrack-tcp-timeout-close-wait=0s --conntrack-tcp-timeout-established=0s --healthz-bind-address=127.0.0.1 --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubeproxy.kubeconfig --proxy-mode=iptables" machine # [ 22.658696] k3s[892]: I0922 10:35:09.750737 892 apis.go:112] API group "storagemigration.k8s.io" is not enabled, skipping. machine # [ 22.696983] k3s[892]: I0922 10:35:09.788995 892 handler.go:304] Adding GroupVersion authentication.k8s.io v1 to ResourceManager machine # [ 22.697274] k3s[892]: W0922 10:35:09.789032 892 genericapiserver.go:787] Skipping API authentication.k8s.io/v1beta1 because it has no resources. machine # [ 22.698065] k3s[892]: W0922 10:35:09.789044 892 genericapiserver.go:787] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. machine # [ 22.698721] k3s[892]: I0922 10:35:09.789390 892 handler.go:304] Adding GroupVersion authorization.k8s.io v1 to ResourceManager machine # [ 22.699292] k3s[892]: W0922 10:35:09.789404 892 genericapiserver.go:787] Skipping API authorization.k8s.io/v1beta1 because it has no resources. machine # [ 22.699693] k3s[892]: I0922 10:35:09.789898 892 handler.go:304] Adding GroupVersion autoscaling v2 to ResourceManager machine # [ 22.700205] k3s[892]: I0922 10:35:09.790462 892 handler.go:304] Adding GroupVersion autoscaling v1 to ResourceManager machine # [ 22.703186] k3s[892]: W0922 10:35:09.790479 892 genericapiserver.go:787] Skipping API autoscaling/v2beta1 because it has no resources. machine # [ 22.703604] k3s[892]: W0922 10:35:09.790489 892 genericapiserver.go:787] Skipping API autoscaling/v2beta2 because it has no resources. machine # [ 22.704121] k3s[892]: I0922 10:35:09.791308 892 handler.go:304] Adding GroupVersion batch v1 to ResourceManager machine # [ 22.704542] k3s[892]: W0922 10:35:09.791323 892 genericapiserver.go:787] Skipping API batch/v1beta1 because it has no resources. machine # [ 22.705040] k3s[892]: I0922 10:35:09.791824 892 handler.go:304] Adding GroupVersion certificates.k8s.io v1 to ResourceManager machine # [ 22.705576] k3s[892]: W0922 10:35:09.791839 892 genericapiserver.go:787] Skipping API certificates.k8s.io/v1beta1 because it has no resources. machine # [ 22.706082] k3s[892]: W0922 10:35:09.791849 892 genericapiserver.go:787] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. machine # [ 22.706581] k3s[892]: I0922 10:35:09.792192 892 handler.go:304] Adding GroupVersion coordination.k8s.io v1 to ResourceManager machine # [ 22.707056] k3s[892]: W0922 10:35:09.792205 892 genericapiserver.go:787] Skipping API coordination.k8s.io/v1beta1 because it has no resources. machine # [ 22.707533] k3s[892]: W0922 10:35:09.792215 892 genericapiserver.go:787] Skipping API coordination.k8s.io/v1alpha2 because it has no resources. machine # [ 22.711090] k3s[892]: I0922 10:35:09.792512 892 handler.go:304] Adding GroupVersion discovery.k8s.io v1 to ResourceManager machine # [ 22.711694] k3s[892]: W0922 10:35:09.792527 892 genericapiserver.go:787] Skipping API discovery.k8s.io/v1beta1 because it has no resources. machine # [ 22.712253] k3s[892]: I0922 10:35:09.793873 892 handler.go:304] Adding GroupVersion networking.k8s.io v1 to ResourceManager machine # [ 22.712702] k3s[892]: W0922 10:35:09.793889 892 genericapiserver.go:787] Skipping API networking.k8s.io/v1beta1 because it has no resources. machine # [ 22.713411] k3s[892]: I0922 10:35:09.794154 892 handler.go:304] Adding GroupVersion node.k8s.io v1 to ResourceManager machine # [ 22.713891] k3s[892]: W0922 10:35:09.794166 892 genericapiserver.go:787] Skipping API node.k8s.io/v1beta1 because it has no resources. machine # [ 22.714582] k3s[892]: W0922 10:35:09.794177 892 genericapiserver.go:787] Skipping API node.k8s.io/v1alpha1 because it has no resources. machine # [ 22.715069] k3s[892]: I0922 10:35:09.794573 892 handler.go:304] Adding GroupVersion policy v1 to ResourceManager machine # [ 22.715561] k3s[892]: W0922 10:35:09.794587 892 genericapiserver.go:787] Skipping API policy/v1beta1 because it has no resources. machine # [ 22.716044] k3s[892]: I0922 10:35:09.795464 892 handler.go:304] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager machine # [ 22.716507] k3s[892]: W0922 10:35:09.795480 892 genericapiserver.go:787] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. machine # [ 22.720031] k3s[892]: W0922 10:35:09.795490 892 genericapiserver.go:787] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. machine # [ 22.720756] k3s[892]: I0922 10:35:09.795736 892 handler.go:304] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager machine # [ 22.721429] k3s[892]: W0922 10:35:09.795749 892 genericapiserver.go:787] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. machine # [ 22.721879] k3s[892]: W0922 10:35:09.795758 892 genericapiserver.go:787] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. machine # [ 22.722626] k3s[892]: I0922 10:35:09.797042 892 handler.go:304] Adding GroupVersion storage.k8s.io v1 to ResourceManager machine # [ 22.723118] k3s[892]: W0922 10:35:09.797060 892 genericapiserver.go:787] Skipping API storage.k8s.io/v1beta1 because it has no resources. machine # [ 22.723597] k3s[892]: W0922 10:35:09.797071 892 genericapiserver.go:787] Skipping API storage.k8s.io/v1alpha1 because it has no resources. machine # [ 22.724086] k3s[892]: I0922 10:35:09.797703 892 handler.go:304] Adding GroupVersion flowcontrol.apiserver.k8s.io v1 to ResourceManager machine # [ 22.724603] k3s[892]: W0922 10:35:09.797719 892 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta3 because it has no resources. machine # [ 22.725093] k3s[892]: W0922 10:35:09.797730 892 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta2 because it has no resources. machine # [ 22.725604] k3s[892]: W0922 10:35:09.797740 892 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. machine # [ 22.726111] k3s[892]: I0922 10:35:09.799599 892 handler.go:304] Adding GroupVersion apps v1 to ResourceManager machine # [ 22.726598] k3s[892]: W0922 10:35:09.799616 892 genericapiserver.go:787] Skipping API apps/v1beta2 because it has no resources. machine # [ 22.730113] k3s[892]: W0922 10:35:09.799627 892 genericapiserver.go:787] Skipping API apps/v1beta1 because it has no resources. machine # [ 22.730662] k3s[892]: I0922 10:35:09.800579 892 handler.go:304] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager machine # [ 22.731161] k3s[892]: W0922 10:35:09.800595 892 genericapiserver.go:787] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. machine # [ 22.731614] k3s[892]: W0922 10:35:09.800605 892 genericapiserver.go:787] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. machine # [ 22.732093] k3s[892]: I0922 10:35:09.800884 892 handler.go:304] Adding GroupVersion events.k8s.io v1 to ResourceManager machine # [ 22.732610] k3s[892]: W0922 10:35:09.800897 892 genericapiserver.go:787] Skipping API events.k8s.io/v1beta1 because it has no resources. machine # [ 22.733110] k3s[892]: I0922 10:35:09.802698 892 handler.go:304] Adding GroupVersion resource.k8s.io v1 to ResourceManager machine # [ 22.733615] k3s[892]: W0922 10:35:09.802715 892 genericapiserver.go:787] Skipping API resource.k8s.io/v1beta2 because it has no resources. machine # [ 22.734102] k3s[892]: W0922 10:35:09.802727 892 genericapiserver.go:787] Skipping API resource.k8s.io/v1beta1 because it has no resources. machine # [ 22.734597] k3s[892]: W0922 10:35:09.802736 892 genericapiserver.go:787] Skipping API resource.k8s.io/v1alpha3 because it has no resources. machine # [ 22.735123] k3s[892]: I0922 10:35:09.805674 892 handler.go:304] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager machine # [ 22.735610] k3s[892]: W0922 10:35:09.805693 892 genericapiserver.go:787] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. machine # [ 23.061576] k3s[892]: I0922 10:35:10.153275 892 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 23.061903] k3s[892]: I0922 10:35:10.153309 892 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 23.062653] k3s[892]: I0922 10:35:10.153420 892 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 23.063050] k3s[892]: I0922 10:35:10.153653 892 secure_serving.go:211] Serving securely on 127.0.0.1:6444 machine # [ 23.063524] k3s[892]: I0922 10:35:10.153690 892 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 23.064082] k3s[892]: I0922 10:35:10.154802 892 dynamic_serving_content.go:135] "Starting controller" name="aggregator-proxy-cert::/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt::/var/lib/rancher/k3s/server/tls/client-auth-proxy.key" machine # [ 23.064535] k3s[892]: I0922 10:35:10.154920 892 aggregator.go:185] waiting for initial CRD sync... machine # [ 23.068097] k3s[892]: time="2026-09-22T10:35:10Z" level=info msg="Starting apiserver lease garbage collector" logger=k3s machine # [ 23.068660] k3s[892]: time="2026-09-22T10:35:10Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 23.069150] k3s[892]: I0922 10:35:10.155279 892 system_namespaces_controller.go:66] Starting system namespaces controller machine # [ 23.069639] k3s[892]: I0922 10:35:10.155312 892 cluster_authentication_trust_controller.go:459] Starting cluster_authentication_trust_controller controller machine # [ 23.070155] k3s[892]: time="2026-09-22T10:35:10Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 23.070654] k3s[892]: I0922 10:35:10.155376 892 local_available_controller.go:156] Starting LocalAvailability controller machine # [ 23.071202] k3s[892]: I0922 10:35:10.155389 892 cache.go:32] Waiting for caches to sync for LocalAvailability controller machine # [ 23.071675] k3s[892]: I0922 10:35:10.155427 892 apiservice_controller.go:100] Starting APIServiceRegistrationController machine # [ 23.072229] k3s[892]: I0922 10:35:10.155438 892 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller machine # [ 23.072676] k3s[892]: I0922 10:35:10.155478 892 controller.go:80] Starting OpenAPI V3 AggregationController machine # [ 23.073185] k3s[892]: I0922 10:35:10.155571 892 controller.go:113] "Deleting old lease on startup" lease="kube-system/apiserver-ik4pcwfs7qgdl76byc4pomgvia" machine # [ 23.073640] k3s[892]: I0922 10:35:10.155637 892 customresource_discovery_controller.go:294] Starting DiscoveryController machine # [ 23.074112] k3s[892]: I0922 10:35:10.155994 892 remote_available_controller.go:425] Starting RemoteAvailability controller machine # [ 23.074599] k3s[892]: I0922 10:35:10.156009 892 cache.go:32] Waiting for caches to sync for RemoteAvailability controller machine # [ 23.075117] k3s[892]: I0922 10:35:10.156024 892 crdregistration_controller.go:114] Starting crd-autoregister controller machine # [ 23.075567] k3s[892]: I0922 10:35:10.156041 892 shared_informer.go:349] "Waiting for caches to sync" controller="crd-autoregister" machine # [ 23.076041] k3s[892]: I0922 10:35:10.156068 892 controller.go:78] Starting OpenAPI AggregationController machine # [ 23.076509] k3s[892]: I0922 10:35:10.156108 892 apf_controller.go:377] Starting API Priority and Fairness config controller machine # [ 23.077063] k3s[892]: I0922 10:35:10.156405 892 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 23.077489] k3s[892]: time="2026-09-22T10:35:10Z" level=info msg="Starting legacy_token_tracking_controller" logger=k3s machine # [ 23.077962] k3s[892]: time="2026-09-22T10:35:10Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 23.081503] k3s[892]: I0922 10:35:10.157531 892 repairip.go:210] Starting ipallocator-repair-controller machine # [ 23.081961] k3s[892]: I0922 10:35:10.157546 892 shared_informer.go:349] "Waiting for caches to sync" controller="ipallocator-repair-controller" machine # [ 23.082631] k3s[892]: I0922 10:35:10.157860 892 controller.go:142] Starting OpenAPI controller machine # [ 23.083158] k3s[892]: I0922 10:35:10.158332 892 controller.go:90] Starting OpenAPI V3 controller machine # [ 23.083631] k3s[892]: I0922 10:35:10.158363 892 naming_controller.go:305] Starting NamingConditionController machine # [ 23.084179] k3s[892]: I0922 10:35:10.158422 892 nonstructuralschema_controller.go:202] Starting NonStructuralSchemaConditionController machine # [ 23.084673] k3s[892]: I0922 10:35:10.158452 892 apiapproval_controller.go:196] Starting KubernetesAPIApprovalPolicyConformantConditionController machine # [ 23.085223] k3s[892]: I0922 10:35:10.158483 892 crd_finalizer.go:273] Starting CRDFinalizer machine # [ 23.085662] k3s[892]: I0922 10:35:10.159251 892 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 23.086158] k3s[892]: I0922 10:35:10.164401 892 default_servicecidr_controller.go:110] Starting kubernetes-service-cidr-controller machine # [ 23.086629] k3s[892]: I0922 10:35:10.164419 892 shared_informer.go:349] "Waiting for caches to sync" controller="kubernetes-service-cidr-controller" machine # [ 23.163593] k3s[892]: I0922 10:35:10.255608 892 cache.go:39] Caches are synced for APIServiceRegistrationController controller machine # [ 23.164031] k3s[892]: time="2026-09-22T10:35:10Z" level=info msg="Caches are synced" logger=k3s machine # [ 23.164447] k3s[892]: I0922 10:35:10.255764 892 cache.go:39] Caches are synced for LocalAvailability controller machine # [ 23.164937] k3s[892]: I0922 10:35:10.255824 892 handler_discovery.go:451] Starting ResourceDiscoveryManager machine # [ 23.165616] k3s[892]: time="2026-09-22T10:35:10Z" level=info msg="Caches are synced" logger=k3s machine # [ 23.166286] k3s[892]: I0922 10:35:10.256229 892 shared_informer.go:356] "Caches are synced" controller="crd-autoregister" machine # [ 23.166927] k3s[892]: I0922 10:35:10.256439 892 aggregator.go:187] initial CRD sync complete... machine # [ 23.167803] k3s[892]: I0922 10:35:10.256452 892 autoregister_controller.go:144] Starting autoregister controller machine # [ 23.168501] k3s[892]: I0922 10:35:10.256463 892 cache.go:32] Waiting for caches to sync for autoregister controller machine # [ 23.169179] k3s[892]: I0922 10:35:10.256474 892 cache.go:39] Caches are synced for autoregister controller machine # [ 23.169831] k3s[892]: time="2026-09-22T10:35:10Z" level=info msg="Caches are synced" logger=k3s machine # [ 23.170560] k3s[892]: I0922 10:35:10.260930 892 cache.go:39] Caches are synced for RemoteAvailability controller machine # [ 23.171415] k3s[892]: I0922 10:35:10.260970 892 apf_controller.go:382] Running API Priority and Fairness config worker machine # [ 23.172247] k3s[892]: I0922 10:35:10.260981 892 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process machine # [ 23.172953] k3s[892]: I0922 10:35:10.261057 892 shared_informer.go:356] "Caches are synced" controller="ipallocator-repair-controller" machine # [ 23.173945] k3s[892]: I0922 10:35:10.265465 892 shared_informer.go:356] "Caches are synced" controller="node_authorizer" machine # [ 23.174553] k3s[892]: I0922 10:35:10.265615 892 shared_informer.go:356] "Caches are synced" controller="kubernetes-service-cidr-controller" machine # [ 23.175264] k3s[892]: I0922 10:35:10.265647 892 default_servicecidr_controller.go:169] Creating default ServiceCIDR with CIDRs: [10.43.0.0/16] machine # [ 23.175895] k3s[892]: E0922 10:35:10.265756 892 controller.go:201] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" machine # [ 23.176888] k3s[892]: I0922 10:35:10.268969 892 shared_informer.go:377] "Caches are synced" machine # [ 23.177608] k3s[892]: I0922 10:35:10.269033 892 policy_source.go:248] refreshing policies machine # [ 23.218900] k3s[892]: E0922 10:35:10.310952 892 controller.go:95] Unable to perform initial Kubernetes service initialization: namespaces "default" not found machine # [ 23.224958] k3s[892]: time="2026-09-22T10:35:10Z" level=error msg="Error while syncing ConfigMap" configmap=kube-system/kube-apiserver-legacy-service-account-token-tracking error="namespaces \"kube-system\" not found" logger=k3s/UnhandledError machine # [ 23.268167] k3s[892]: I0922 10:35:10.360112 892 controller.go:667] quota admission added evaluator for: namespaces machine # [ 23.280671] k3s[892]: I0922 10:35:10.372737 892 cidrallocator.go:302] created ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 23.284064] k3s[892]: I0922 10:35:10.373549 892 default_servicecidr_controller.go:231] Setting default ServiceCIDR condition Ready to True machine # [ 23.290063] k3s[892]: I0922 10:35:10.382102 892 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 23.378538] k3s[892]: I0922 10:35:10.470495 892 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io machine # [ 23.492396] k3s[892]: time="2026-09-22T10:35:10Z" level=info msg="containerd is now running" machine # [ 23.500548] k3s[892]: time="2026-09-22T10:35:10Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/k3s-airgap-images-amd64.tar.zst" machine # [ 24.069265] k3s[892]: I0922 10:35:11.160923 892 storage_scheduling.go:123] created PriorityClass system-node-critical with value 2000001000 machine # [ 24.073243] k3s[892]: I0922 10:35:11.165320 892 storage_scheduling.go:123] created PriorityClass system-cluster-critical with value 2000000000 machine # [ 24.075494] k3s[892]: I0922 10:35:11.165339 892 storage_scheduling.go:139] all system priority classes are created successfully or already exist. machine # [ 24.421098] k3s[892]: time="2026-09-22T10:35:11Z" level=info msg="Polling for API server readiness: GET /readyz failed: unknown" machine # [ 25.281839] k3s[892]: I0922 10:35:12.373607 892 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io machine # [ 25.319187] k3s[892]: I0922 10:35:12.411232 892 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io machine # [ 25.430065] k3s[892]: I0922 10:35:12.522034 892 alloc.go:329] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.43.0.1"} machine # [ 25.434906] k3s[892]: W0922 10:35:12.526933 892 lease.go:265] Resetting endpoints for master service "kubernetes" to [10.0.2.15] machine # [ 25.438080] k3s[892]: I0922 10:35:12.530157 892 controller.go:667] quota admission added evaluator for: endpoints machine # [ 25.447643] k3s[892]: I0922 10:35:12.539701 892 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io machine # [ 26.423124] k3s[892]: time="2026-09-22T10:35:13Z" level=info msg="Kube API server is now running" machine # [ 26.423518] k3s[892]: time="2026-09-22T10:35:13Z" level=info msg="k3s is up and running" machine # [ 26.424060] k3s[892]: time="2026-09-22T10:35:13Z" level=info msg="Waiting for untainted node" machine # [ 26.424562] k3s[892]: time="2026-09-22T10:35:13Z" level=info msg="Creating k3s-supervisor event broadcaster" machine # [ 26.428074] systemd[1]: Started k3s service. machine # [ 26.431063] systemd[1]: Starting niks3 server... machine # [ 26.433561] k3s[892]: time="2026-09-22T10:35:13Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Node and Certificate Authority certificates managed by k3s are OK" object=machine reason=CertificateExpirationOK type=Normal machine # [ 26.444808] k3s[892]: I0922 10:35:13.536878 892 controllermanager.go:189] "Starting" version="v1.35.8+k3s1" machine # [ 26.444929] k3s[892]: I0922 10:35:13.536903 892 controllermanager.go:191] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 26.452395] k3s[892]: I0922 10:35:13.543949 892 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 26.452727] k3s[892]: I0922 10:35:13.543970 892 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 26.453070] k3s[892]: I0922 10:35:13.543981 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.453933] k3s[892]: I0922 10:35:13.543996 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.455055] k3s[892]: I0922 10:35:13.543945 892 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 26.455871] k3s[892]: I0922 10:35:13.544029 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.456753] k3s[892]: I0922 10:35:13.544192 892 secure_serving.go:211] Serving securely on 127.0.0.1:10257 machine # [ 26.457889] k3s[892]: I0922 10:35:13.544314 892 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 26.458894] k3s[892]: I0922 10:35:13.544368 892 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key" machine # [ 26.470492] k3s[892]: I0922 10:35:13.562545 892 controller.go:667] quota admission added evaluator for: serviceaccounts machine # [ 26.482814] k3s[892]: I0922 10:35:13.574878 892 controllermanager.go:627] "Warning: controller is disabled" controller="node-route-controller" machine # [ 26.492161] k3s[892]: I0922 10:35:13.584196 892 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" requiredFeatureGates=["ClusterTrustBundle"] machine # [ 26.492528] k3s[892]: I0922 10:35:13.584235 892 controllermanager.go:579] "Warning: skipping controller" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" machine # [ 26.525331] k3s[892]: time="2026-09-22T10:35:13Z" level=info msg="Creating embedded CRD addons.k3s.cattle.io" machine # [ 26.530729] k3s[892]: time="2026-09-22T10:35:13Z" level=info msg="Creating embedded CRD etcdsnapshotfiles.k3s.cattle.io" machine # [ 26.541822] k3s[892]: I0922 10:35:13.633885 892 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 26.547537] k3s[892]: time="2026-09-22T10:35:13Z" level=info msg="Creating embedded CRD helmchartconfigs.helm.cattle.io" machine # [ 26.552769] k3s[892]: I0922 10:35:13.644842 892 shared_informer.go:377] "Caches are synced" machine # [ 26.553228] k3s[892]: I0922 10:35:13.644916 892 shared_informer.go:377] "Caches are synced" machine # [ 26.557126] k3s[892]: I0922 10:35:13.649206 892 shared_informer.go:377] "Caches are synced" machine # [ 26.557579] k3s[892]: time="2026-09-22T10:35:13Z" level=info msg="Creating embedded CRD helmcharts.helm.cattle.io" machine # [ 26.560941] k3s[892]: I0922 10:35:13.653016 892 controllermanager.go:579] "Warning: skipping controller" controller="storage-version-migrator-controller" machine # [ 26.564859] k3s[892]: I0922 10:35:13.656818 892 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="podcertificaterequest-cleaner-controller" requiredFeatureGates=["PodCertificateRequest"] machine # [ 26.564968] k3s[892]: I0922 10:35:13.656841 892 controllermanager.go:579] "Warning: skipping controller" controller="podcertificaterequest-cleaner-controller" machine # [ 26.573500] k3s[892]: I0922 10:35:13.665520 892 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 26.574696] k3s[892]: time="2026-09-22T10:35:13Z" level=info msg="Waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 26.577546] k3s[892]: I0922 10:35:13.669616 892 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 26.578347] k3s[892]: time="2026-09-22T10:35:13Z" level=info msg="Done waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 26.579104] k3s[892]: time="2026-09-22T10:35:13Z" level=info msg="Waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 26.594940] k3s[892]: I0922 10:35:13.687008 892 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 26.606589] k3s[892]: I0922 10:35:13.698651 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.707366] k3s[892]: I0922 10:35:13.799362 892 shared_informer.go:377] "Caches are synced" machine # [ 26.917235] k3s[892]: I0922 10:35:14.009231 892 controllermanager.go:627] "Warning: controller is disabled" controller="cloud-node-lifecycle-controller" machine: (finished: waiting for unit k3s.service, in 27.85 seconds) machine: waiting for success: kubectl get ns farm machine # [ 27.094614] k3s[892]: time="2026-09-22T10:35:14Z" level=info msg="Done waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 27.094847] k3s[892]: time="2026-09-22T10:35:14Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-40.1.4+up40.1.0.tgz" machine # [ 27.101419] k3s[892]: time="2026-09-22T10:35:14Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-crd-40.1.4+up40.1.0.tgz" machine # [ 27.101703] k3s[892]: time="2026-09-22T10:35:14Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/ccm.yaml" machine # [ 27.102483] k3s[892]: time="2026-09-22T10:35:14Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/coredns.yaml" machine # [ 27.106192] k3s[892]: time="2026-09-22T10:35:14Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/local-storage.yaml" machine # [ 27.106624] k3s[892]: time="2026-09-22T10:35:14Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/rolebindings.yaml" machine # [ 27.109336] k3s[892]: time="2026-09-22T10:35:14Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/runtimes.yaml" machine # [ 27.110615] k3s[892]: time="2026-09-22T10:35:14Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/traefik.yaml" machine # [ 27.218220] k3s[892]: time="2026-09-22T10:35:14Z" level=info msg="Starting dynamiclistener CN filter node controller with SANs: [127.0.0.1 ::1 localhost machine 10.0.2.15 fec0::f275:f13c:a7f6:f10e 10.43.0.1 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local]" machine # [ 27.218418] k3s[892]: time="2026-09-22T10:35:14Z" level=info msg="Tunnel server egress proxy mode: agent" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 27.722740] k3s[892]: time="2026-09-22T10:35:14Z" level=info msg="Creating new TLS secret for kube-system/k3s-serving (count: 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__f275_f13c_a7f6_f10e-dc709f:fec0::f275:f13c:a7f6:f10e listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=3CA9B48706B481664B50E92061C1F76B3A95C72B]" machine # [ 27.742116] k3s[892]: time="2026-09-22T10:35:14Z" level=info msg="Active TLS secret kube-system/k3s-serving (ver=235) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__f275_f13c_a7f6_f10e-dc709f:fec0::f275:f13c:a7f6:f10e listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=3CA9B48706B481664B50E92061C1F76B3A95C72B]" machine # [ 27.767423] k3s[892]: I0922 10:35:14.859461 892 node_lifecycle_controller.go:419] "Controller will reconcile labels" logger="node-lifecycle-controller" machine # [ 27.918194] k3s[892]: I0922 10:35:15.010206 892 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="device-taint-eviction-controller" requiredFeatureGates=["DynamicResourceAllocation","DRADeviceTaints"] machine # [ 27.918408] k3s[892]: I0922 10:35:15.010241 892 controllermanager.go:579] "Warning: skipping controller" controller="device-taint-eviction-controller" machine # [ 28.274450] k3s[892]: I0922 10:35:15.366475 892 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="cronjobs.batch" machine # [ 28.277029] k3s[892]: I0922 10:35:15.366565 892 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="rolebindings.rbac.authorization.k8s.io" machine # [ 28.279600] k3s[892]: I0922 10:35:15.366597 892 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="limitranges" machine # [ 28.282032] k3s[892]: I0922 10:35:15.366627 892 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="serviceaccounts" machine # [ 28.284885] k3s[892]: I0922 10:35:15.366667 892 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="deployments.apps" machine # [ 28.287970] k3s[892]: I0922 10:35:15.366696 892 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="replicasets.apps" machine # [ 28.290642] k3s[892]: I0922 10:35:15.366733 892 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="horizontalpodautoscalers.autoscaling" machine # [ 28.293255] k3s[892]: I0922 10:35:15.366775 892 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="podtemplates" machine # [ 28.295293] k3s[892]: I0922 10:35:15.366838 892 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="roles.rbac.authorization.k8s.io" machine # [ 28.297641] k3s[892]: I0922 10:35:15.366866 892 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="leases.coordination.k8s.io" machine # [ 28.299925] k3s[892]: I0922 10:35:15.366914 892 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="daemonsets.apps" machine # [ 28.302175] k3s[892]: I0922 10:35:15.366942 892 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="jobs.batch" machine # [ 28.304448] k3s[892]: I0922 10:35:15.366969 892 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpointslices.discovery.k8s.io" machine # [ 28.307708] k3s[892]: I0922 10:35:15.367028 892 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="resourceclaimtemplates.resource.k8s.io" machine # [ 28.310330] k3s[892]: I0922 10:35:15.367067 892 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="addons.k3s.cattle.io" machine # [ 28.312666] k3s[892]: I0922 10:35:15.367113 892 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="statefulsets.apps" machine # [ 28.314871] k3s[892]: I0922 10:35:15.367175 892 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmchartconfigs.helm.cattle.io" machine # [ 28.317168] k3s[892]: I0922 10:35:15.367206 892 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="csistoragecapacities.storage.k8s.io" machine # [ 28.319716] k3s[892]: I0922 10:35:15.367251 892 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="controllerrevisions.apps" machine # [ 28.322167] k3s[892]: I0922 10:35:15.367293 892 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="ingresses.networking.k8s.io" machine # [ 28.324483] k3s[892]: I0922 10:35:15.367327 892 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="networkpolicies.networking.k8s.io" machine # [ 28.326969] k3s[892]: I0922 10:35:15.367399 892 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmcharts.helm.cattle.io" machine # [ 28.329466] k3s[892]: I0922 10:35:15.367478 892 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpoints" machine # [ 28.331700] k3s[892]: I0922 10:35:15.367507 892 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="poddisruptionbudgets.policy" machine # [ 28.384779] k3s[892]: time="2026-09-22T10:35:15Z" level=info msg="Imported docker.io/rancher/klipper-helm:v0.13.3-build20260727" machine # [ 28.389723] k3s[892]: time="2026-09-22T10:35:15Z" level=info msg="Tagged docker.io/rancher/klipper-helm@sha256:5425a2b4613d2458dbdff99218e8d487ebb59c20e7a941f061c0777070f0aac1" machine # [ 28.390299] k3s[892]: time="2026-09-22T10:35:15Z" level=info msg="Imported docker.io/rancher/klipper-lb:v0.4.17" machine # [ 28.396473] k3s[892]: time="2026-09-22T10:35:15Z" level=info msg="Tagged docker.io/rancher/klipper-lb@sha256:910944bb0bd94f060a82a56ca1ea1c577d3e49b3473a093a47a985f32e92d94a" machine # [ 28.396779] k3s[892]: time="2026-09-22T10:35:15Z" level=info msg="Imported docker.io/rancher/local-path-provisioner:v0.0.37" machine # [ 28.400654] k3s[892]: time="2026-09-22T10:35:15Z" level=info msg="Tagged docker.io/rancher/local-path-provisioner@sha256:e757967a5ec338f6a9b371c5a9688bedaa8c3578ea3dd4db329ea0084be0a86f" machine # [ 28.400771] k3s[892]: time="2026-09-22T10:35:15Z" level=info msg="Imported docker.io/rancher/mirrored-coredns-coredns:1.14.6" machine # [ 28.405565] k3s[892]: time="2026-09-22T10:35:15Z" level=info msg="Tagged docker.io/rancher/mirrored-coredns-coredns@sha256:900f9c109f7a33545d3c811516e8376df9019147b750f5ce3e254468769176ea" machine # [ 28.406122] k3s[892]: time="2026-09-22T10:35:15Z" level=info msg="Imported docker.io/rancher/mirrored-library-busybox:1.37.0" machine # [ 28.411799] k3s[892]: time="2026-09-22T10:35:15Z" level=info msg="Tagged docker.io/rancher/mirrored-library-busybox@sha256:101b4afd76732482eff9b95cae5f94bcf295e521fbec4e01b69c5421f3f3f3e5" machine # [ 28.412172] k3s[892]: time="2026-09-22T10:35:15Z" level=info msg="Imported docker.io/rancher/mirrored-library-traefik:3.7.8" machine # [ 28.422127] k3s[892]: time="2026-09-22T10:35:15Z" level=info msg="Tagged docker.io/rancher/mirrored-library-traefik@sha256:4299bbed850421258fc5448c2e0e6ad350981d4d335a68de11b92448aedbefe5" machine # [ 28.422536] k3s[892]: time="2026-09-22T10:35:15Z" level=info msg="Imported docker.io/rancher/mirrored-metrics-server:v0.9.0" machine # [ 28.431806] k3s[892]: time="2026-09-22T10:35:15Z" level=info msg="Tagged docker.io/rancher/mirrored-metrics-server@sha256:d9862115e7c7881280d3d75ca26bda8ffc0fc213315979575bf23ce9826205c0" machine # [ 28.432354] k3s[892]: time="2026-09-22T10:35:15Z" level=info msg="Imported docker.io/rancher/mirrored-pause:3.10.2" machine # [ 28.436598] k3s[892]: time="2026-09-22T10:35:15Z" level=info msg="Tagged docker.io/rancher/mirrored-pause@sha256:f548e0e8e3dc1896ca956272154dde3314e8cc4fde0a57577ee9fa1c63f5baf4" machine # [ 28.437242] k3s[892]: time="2026-09-22T10:35:15Z" level=info msg="Starting k3s.cattle.io/v1, Kind=Addon controller" machine # [ 28.438401] k3s[892]: time="2026-09-22T10:35:15Z" level=info msg="Creating deploy event broadcaster" machine # [ 28.441639] k3s[892]: I0922 10:35:15.533705 892 controller.go:667] quota admission added evaluator for: addons.k3s.cattle.io machine # [ 28.444183] k3s[892]: time="2026-09-22T10:35:15Z" level=info msg="Creating helm-controller event broadcaster" machine # [ 28.445791] k3s[892]: time="2026-09-22T10:35:15Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 28.447585] k3s[892]: time="2026-09-22T10:35:15Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 28.452099] k3s[892]: time="2026-09-22T10:35:15Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=ApplyingManifest type=Normal machine # [ 28.463474] k3s[892]: time="2026-09-22T10:35:15Z" level=info msg="Cluster dns configmap has been set successfully" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 28.691340] k3s[892]: time="2026-09-22T10:35:15Z" level=info msg="Imported 8 images from /var/lib/rancher/k3s/agent/images/k3s-airgap-images-amd64.tar.zst in 5.191637484s" machine # [ 28.692712] k3s[892]: time="2026-09-22T10:35:15Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-client.tar" machine # [ 28.703787] k3s[892]: I0922 10:35:15.795267 892 range_allocator.go:113] "No Secondary Service CIDR provided. Skipping filtering out secondary service addresses" logger="node-ipam-controller" machine # [ 28.704090] k3s[892]: I0922 10:35:15.795357 892 controllermanager.go:627] "Warning: controller is disabled" controller="service-lb-controller" machine # [ 29.022460] k3s[892]: time="2026-09-22T10:35:16Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=AppliedManifest type=Normal machine # [ 29.033354] k3s[892]: time="2026-09-22T10:35:16Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=ApplyingManifest type=Normal machine # [ 29.376571] k3s[892]: time="2026-09-22T10:35:16Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=AppliedManifest type=Normal machine # [ 29.388186] k3s[892]: time="2026-09-22T10:35:16Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=ApplyingManifest type=Normal machine # [ 29.446846] k3s[892]: time="2026-09-22T10:35:16Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 29.520196] k3s[892]: I0922 10:35:16.612238 892 controllermanager.go:627] "Warning: controller is disabled" controller="bootstrap-signer-controller" machine # [ 29.537855] k3s[892]: I0922 10:35:16.629914 892 serving.go:392] Generated self-signed cert in-memory machine # [ 29.564996] k3s[892]: time="2026-09-22T10:35:16Z" level=info msg="Starting rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding controller" machine # [ 29.570753] k3s[892]: time="2026-09-22T10:35:16Z" level=info msg="Starting batch/v1, Kind=Job controller" machine # [ 29.572050] k3s[892]: time="2026-09-22T10:35:16Z" level=info msg="Starting /v1, Kind=Secret controller" machine # [ 29.573681] k3s[892]: time="2026-09-22T10:35:16Z" level=info msg="Starting /v1, Kind=ConfigMap controller" machine # [ 29.575602] k3s[892]: time="2026-09-22T10:35:16Z" level=info msg="Starting /v1, Kind=ServiceAccount controller" machine # [ 29.577790] k3s[892]: time="2026-09-22T10:35:16Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChart controller" machine # [ 29.579768] k3s[892]: time="2026-09-22T10:35:16Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChartConfig controller" machine # [ 29.623100] k3s[892]: I0922 10:35:16.713990 892 serving.go:392] Generated self-signed cert in-memory machine: (finished: waiting for success: kubectl get ns farm, in 2.73 seconds) machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/lb.crt --key=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/lb.key machine # [ 29.760334] k3s[892]: I0922 10:35:16.852368 892 controllermanager.go:160] Version: v1.35.8+k3s1 machine # [ 29.763684] k3s[892]: I0922 10:35:16.855755 892 secure_serving.go:211] Serving securely on 127.0.0.1:10258 machine # [ 29.765067] k3s[892]: I0922 10:35:16.856166 892 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 29.766583] k3s[892]: I0922 10:35:16.856188 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.767937] k3s[892]: I0922 10:35:16.856224 892 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 29.769459] k3s[892]: I0922 10:35:16.856305 892 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 29.771535] k3s[892]: I0922 10:35:16.856322 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.772754] k3s[892]: I0922 10:35:16.856351 892 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 29.774949] k3s[892]: I0922 10:35:16.856366 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.776228] k3s[892]: time="2026-09-22T10:35:16Z" level=info msg="Creating service-lb-controller event broadcaster" machine # [ 29.865151] k3s[892]: I0922 10:35:16.956283 892 shared_informer.go:377] "Caches are synced" machine # [ 29.865367] k3s[892]: I0922 10:35:16.956419 892 shared_informer.go:377] "Caches are synced" machine # [ 29.865830] k3s[892]: I0922 10:35:16.956506 892 shared_informer.go:377] "Caches are synced" machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/lb.crt --key=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/lb.key, in 0.21 seconds) machine: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/worker.crt --key=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/worker.key machine # [ 29.945057] k3s[892]: I0922 10:35:17.037019 892 controller.go:667] quota admission added evaluator for: deployments.apps machine # [ 30.031484] k3s[892]: time="2026-09-22T10:35:17Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 30.035038] k3s[892]: time="2026-09-22T10:35:17Z" level=info msg="Starting /v1, Kind=Pod controller" machine # [ 30.038840] k3s[892]: time="2026-09-22T10:35:17Z" level=info msg="Starting apps/v1, Kind=DaemonSet controller" machine # [ 30.042695] k3s[892]: I0922 10:35:17.134758 892 controllermanager.go:329] Started "service-lb-controller" machine # [ 30.043978] k3s[892]: W0922 10:35:17.134801 892 controllermanager.go:306] "node-route-controller" is disabled machine # [ 30.045368] k3s[892]: I0922 10:35:17.134978 892 controllermanager.go:329] Started "cloud-node-controller" machine # [ 30.046653] k3s[892]: I0922 10:35:17.135078 892 controllermanager.go:329] Started "cloud-node-lifecycle-controller" machine # [ 30.048107] k3s[892]: time="2026-09-22T10:35:17Z" level=info msg="Starting discovery.k8s.io/v1, Kind=EndpointSlice controller" machine # [ 30.049554] k3s[892]: I0922 10:35:17.135890 892 node_controller.go:176] Sending events to api server. machine # [ 30.050778] k3s[892]: I0922 10:35:17.135936 892 node_lifecycle_controller.go:112] Sending events to api server machine # [ 30.052235] k3s[892]: I0922 10:35:17.136008 892 controller.go:235] Starting service controller machine # [ 30.053873] k3s[892]: I0922 10:35:17.136026 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.055597] k3s[892]: I0922 10:35:17.136088 892 node_controller.go:185] Waiting for informer caches to sync machine # [ 30.123594] k3s[892]: I0922 10:35:17.215618 892 alloc.go:329] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.43.0.10"} machine # [ 30.124846] k3s[892]: time="2026-09-22T10:35:17Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=AppliedManifest type=Normal machine # [ 30.144605] k3s[892]: I0922 10:35:17.236645 892 shared_informer.go:377] "Caches are synced" machine: (finished: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/worker.crt --key=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/worker.key, in 0.20 seconds) machine: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt machine: (finished: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt, in 0.18 seconds) subtest: chart deploys and workers become Ready machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine # [ 30.447979] k3s[892]: time="2026-09-22T10:35:17Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 30.716112] k3s[892]: W0922 10:35:17.808051 892 probe.go:272] Flexvolume plugin directory at /usr/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating. machine # [ 30.867297] k3s[892]: time="2026-09-22T10:35:17Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" object=kube-system/local-storage reason=DeletingManifest type=Normal machine # [ 30.875685] k3s[892]: time="2026-09-22T10:35:17Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=ApplyingManifest type=Normal machine # [ 31.019591] k3s[892]: I0922 10:35:18.111553 892 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="storageversion-garbage-collector-controller" requiredFeatureGates=["APIServerIdentity","StorageVersionAPI"] machine # [ 31.019821] k3s[892]: I0922 10:35:18.111588 892 controllermanager.go:579] "Warning: skipping controller" controller="storageversion-garbage-collector-controller" machine # [ 31.020471] k3s[892]: I0922 10:35:18.111602 892 controllermanager.go:627] "Warning: controller is disabled" controller="selinux-warning-controller" machine # [ 31.021843] k3s[892]: I0922 10:35:18.113907 892 controller.go:667] quota admission added evaluator for: helmcharts.helm.cattle.io machine # [ 31.025056] k3s[892]: time="2026-09-22T10:35:18Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=AppliedManifest type=Normal machine # [ 31.033133] k3s[892]: I0922 10:35:18.124884 892 publisher.go:107] "Starting root CA cert publisher controller" machine # [ 31.033553] k3s[892]: I0922 10:35:18.124921 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.036338] k3s[892]: I0922 10:35:18.128356 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.036835] k3s[892]: I0922 10:35:18.128424 892 horizontal.go:204] "Starting HPA controller" machine # [ 31.037459] k3s[892]: I0922 10:35:18.128437 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.037959] k3s[892]: I0922 10:35:18.128506 892 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-legacy-unknown" machine # [ 31.038597] k3s[892]: I0922 10:35:18.128522 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.042429] k3s[892]: I0922 10:35:18.134504 892 pv_protection_controller.go:81] "Starting PV protection controller" machine # [ 31.042946] k3s[892]: I0922 10:35:18.134530 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.045625] k3s[892]: I0922 10:35:18.134570 892 legacy_serviceaccount_token_cleaner.go:103] "Starting legacy service account token cleaner controller" machine # [ 31.046085] k3s[892]: I0922 10:35:18.137724 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.047244] k3s[892]: I0922 10:35:18.139318 892 vac_protection_controller.go:206] "Starting VAC protection controller" machine # [ 31.047763] k3s[892]: I0922 10:35:18.139348 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.048475] k3s[892]: I0922 10:35:18.139386 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.048896] k3s[892]: I0922 10:35:18.139485 892 endpointslicemirroring_controller.go:226] "Starting EndpointSliceMirroring controller" machine # [ 31.049862] k3s[892]: I0922 10:35:18.139499 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.050553] k3s[892]: I0922 10:35:18.139585 892 replica_set.go:241] "Starting controller" name="replicationcontroller" machine # [ 31.051823] k3s[892]: I0922 10:35:18.139598 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.052981] k3s[892]: I0922 10:35:18.139658 892 replica_set.go:241] "Starting controller" name="replicaset" machine # [ 31.054157] k3s[892]: I0922 10:35:18.139672 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.055103] k3s[892]: I0922 10:35:18.139731 892 servicecidrs_controller.go:136] "Starting" controller="service-cidr-controller" machine # [ 31.055918] k3s[892]: I0922 10:35:18.139744 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.056923] k3s[892]: I0922 10:35:18.139779 892 cleaner.go:83] "Starting CSR cleaner controller" machine # [ 31.057419] k3s[892]: I0922 10:35:18.139843 892 tokencleaner.go:117] "Starting token cleaner controller" machine # [ 31.058263] k3s[892]: I0922 10:35:18.139855 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.059076] k3s[892]: I0922 10:35:18.139895 892 serviceaccounts_controller.go:117] "Starting service account controller" machine # [ 31.059857] k3s[892]: I0922 10:35:18.139908 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.060686] k3s[892]: I0922 10:35:18.139971 892 cronjob_controllerv2.go:143] "Starting cronjob controller v2" machine # [ 31.061655] k3s[892]: I0922 10:35:18.139984 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.062616] k3s[892]: I0922 10:35:18.140022 892 expand_controller.go:328] "Starting expand controller" machine # [ 31.063635] k3s[892]: I0922 10:35:18.140035 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.064607] k3s[892]: I0922 10:35:18.140068 892 ttlafterfinished_controller.go:112] "Starting TTL after finished controller" machine # [ 31.065583] k3s[892]: I0922 10:35:18.140080 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.066552] k3s[892]: I0922 10:35:18.140317 892 daemon_controller.go:309] "Starting daemon sets controller" machine # [ 31.067519] k3s[892]: I0922 10:35:18.140331 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.068496] k3s[892]: I0922 10:35:18.140387 892 node_lifecycle_controller.go:453] "Sending events to api server" machine # [ 31.069460] k3s[892]: I0922 10:35:18.140416 892 node_lifecycle_controller.go:460] "Starting node controller" machine # [ 31.070499] k3s[892]: I0922 10:35:18.140426 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.071592] k3s[892]: I0922 10:35:18.140467 892 pvc_protection_controller.go:166] "Starting PVC protection controller" machine # [ 31.072596] k3s[892]: I0922 10:35:18.140479 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.073606] k3s[892]: I0922 10:35:18.140512 892 taint_eviction.go:283] "Starting" controller="taint-eviction-controller" machine # [ 31.074634] k3s[892]: I0922 10:35:18.140569 892 taint_eviction.go:288] "Sending events to API server" machine # [ 31.075330] k3s[892]: I0922 10:35:18.140580 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.076315] k3s[892]: I0922 10:35:18.140818 892 stateful_set.go:180] "Starting stateful set controller" machine # [ 31.077242] k3s[892]: I0922 10:35:18.140832 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.077867] k3s[892]: I0922 10:35:18.140904 892 node_ipam_controller.go:142] "Starting ipam controller" machine # [ 31.078716] k3s[892]: I0922 10:35:18.140918 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.079562] k3s[892]: I0922 10:35:18.140963 892 controller.go:174] "Starting ephemeral volume controller" machine # [ 31.080631] k3s[892]: I0922 10:35:18.140976 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.081633] k3s[892]: I0922 10:35:18.141049 892 controller.go:423] "Starting resource claim controller" machine # [ 31.082574] k3s[892]: I0922 10:35:18.141061 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.083545] k3s[892]: I0922 10:35:18.141166 892 job_controller.go:254] "Starting job controller" machine # [ 31.084051] k3s[892]: I0922 10:35:18.141179 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.084851] k3s[892]: I0922 10:35:18.141211 892 certificate_controller.go:120] "Starting certificate controller" name="csrapproving" machine # [ 31.085647] k3s[892]: I0922 10:35:18.141223 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.086644] k3s[892]: I0922 10:35:18.141259 892 ttl_controller.go:127] "Starting TTL controller" machine # [ 31.087500] k3s[892]: I0922 10:35:18.141272 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.088517] k3s[892]: I0922 10:35:18.141333 892 pv_controller_base.go:307] "Starting persistent volume controller" machine # [ 31.089197] k3s[892]: I0922 10:35:18.141346 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.089710] k3s[892]: I0922 10:35:18.141454 892 garbagecollector.go:141] "Starting controller" controller="garbagecollector" machine # [ 31.090396] k3s[892]: I0922 10:35:18.141484 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.090913] k3s[892]: I0922 10:35:18.141542 892 resource_quota_controller.go:297] "Starting resource quota controller" machine # [ 31.091684] k3s[892]: I0922 10:35:18.141554 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.092211] k3s[892]: I0922 10:35:18.141630 892 graph_builder.go:386] "Running" component="GraphBuilder" machine # [ 31.092674] k3s[892]: I0922 10:35:18.141653 892 resource_quota_monitor.go:309] "QuotaMonitor running" machine # [ 31.093481] k3s[892]: time="2026-09-22T10:35:18Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=ApplyingManifest type=Normal machine # [ 31.094181] k3s[892]: I0922 10:35:18.157682 892 endpoints_controller.go:193] "Starting endpoint controller" machine # [ 31.094362] k3s[892]: I0922 10:35:18.157703 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.094756] k3s[892]: I0922 10:35:18.157774 892 endpointslice_controller.go:283] "Starting endpoint slice controller" machine # [ 31.095575] k3s[892]: I0922 10:35:18.157786 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.096226] k3s[892]: I0922 10:35:18.157820 892 gc_controller.go:98] "Starting GC controller" machine # [ 31.096858] k3s[892]: I0922 10:35:18.157832 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.097623] k3s[892]: I0922 10:35:18.157869 892 namespace_controller.go:202] "Starting namespace controller" machine # [ 31.098055] k3s[892]: I0922 10:35:18.157882 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.098668] k3s[892]: I0922 10:35:18.157949 892 deployment_controller.go:172] "Starting controller" controller="deployment" machine # [ 31.099325] k3s[892]: I0922 10:35:18.157961 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.099915] k3s[892]: I0922 10:35:18.157992 892 disruption.go:458] "Sending events to api server." machine # [ 31.100781] k3s[892]: I0922 10:35:18.158020 892 disruption.go:465] "Starting disruption controller" machine # [ 31.101282] k3s[892]: I0922 10:35:18.158030 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.101857] k3s[892]: I0922 10:35:18.158095 892 attach_detach_controller.go:335] "Starting attach detach controller" machine # [ 31.102695] k3s[892]: I0922 10:35:18.158107 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.103142] k3s[892]: I0922 10:35:18.161177 892 clusterroleaggregation_controller.go:194] "Starting ClusterRoleAggregator controller" machine # [ 31.103615] k3s[892]: I0922 10:35:18.161199 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.104215] k3s[892]: I0922 10:35:18.164153 892 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-client" machine # [ 31.104646] k3s[892]: I0922 10:35:18.164172 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.105105] k3s[892]: I0922 10:35:18.164436 892 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-serving" machine # [ 31.105576] k3s[892]: I0922 10:35:18.164451 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.105963] k3s[892]: I0922 10:35:18.164493 892 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 31.150389] k3s[892]: I0922 10:35:18.164587 892 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 31.150823] k3s[892]: I0922 10:35:18.167780 892 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kube-apiserver-client" machine # [ 31.151417] k3s[892]: I0922 10:35:18.167799 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.151813] k3s[892]: I0922 10:35:18.167830 892 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 31.153710] k3s[892]: I0922 10:35:18.167875 892 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 31.154313] k3s[892]: I0922 10:35:18.169440 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.154853] k3s[892]: I0922 10:35:18.238236 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.155630] k3s[892]: I0922 10:35:18.241807 892 shared_informer.go:377] "Caches are synced" machine # [ 31.447448] k3s[892]: time="2026-09-22T10:35:18Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 31.662131] k3s[892]: time="2026-09-22T10:35:18Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Deferred node password secret validation complete" object=machine reason=NodePasswordValidationComplete type=Normal machine # [ 31.673068] k3s[892]: I0922 10:35:18.764233 892 shared_informer.go:377] "Caches are synced" machine # [ 31.673190] k3s[892]: I0922 10:35:18.764502 892 shared_informer.go:377] "Caches are synced" machine # [ 31.676813] k3s[892]: time="2026-09-22T10:35:18Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Applying HelmChart from https://%{KUBERNETES_API}%/static/charts/nix-grpc-farm.tgz using Job kube-system/helm-install-nix-grpc-farm " object=kube-system/nix-grpc-farm reason=ApplyJob type=Normal machine # [ 31.677874] k3s[892]: I0922 10:35:18.769963 892 shared_informer.go:377] "Caches are synced" machine # [ 31.679510] k3s[892]: I0922 10:35:18.771597 892 shared_informer.go:377] "Caches are synced" machine # [ 31.683523] k3s[892]: I0922 10:35:18.774547 892 shared_informer.go:377] "Caches are synced" machine # [ 31.705663] k3s[892]: I0922 10:35:18.797676 892 controller.go:667] quota admission added evaluator for: jobs.batch machine # [ 31.733656] k3s[892]: I0922 10:35:18.825687 892 shared_informer.go:377] "Caches are synced" machine # [ 31.737638] k3s[892]: I0922 10:35:18.828448 892 shared_informer.go:377] "Caches are synced" machine # [ 31.737976] k3s[892]: I0922 10:35:18.828511 892 shared_informer.go:377] "Caches are synced" machine # [ 31.742623] k3s[892]: I0922 10:35:18.834677 892 shared_informer.go:377] "Caches are synced" machine # [ 31.747768] k3s[892]: I0922 10:35:18.839849 892 shared_informer.go:377] "Caches are synced" machine # [ 31.748173] k3s[892]: I0922 10:35:18.840268 892 shared_informer.go:377] "Caches are synced" machine # [ 31.750066] k3s[892]: I0922 10:35:18.839890 892 shared_informer.go:377] "Caches are synced" machine # [ 31.750887] k3s[892]: I0922 10:35:18.839927 892 shared_informer.go:377] "Caches are synced" machine # [ 31.751679] k3s[892]: I0922 10:35:18.839952 892 shared_informer.go:377] "Caches are synced" machine # [ 31.752548] k3s[892]: I0922 10:35:18.840091 892 shared_informer.go:377] "Caches are synced" machine # [ 31.754077] k3s[892]: I0922 10:35:18.839854 892 shared_informer.go:377] "Caches are synced" machine # [ 31.754589] k3s[892]: I0922 10:35:18.841864 892 shared_informer.go:377] "Caches are synced" machine # [ 31.755109] k3s[892]: I0922 10:35:18.841899 892 shared_informer.go:377] "Caches are synced" machine # [ 31.755639] k3s[892]: I0922 10:35:18.841928 892 shared_informer.go:377] "Caches are synced" machine # [ 31.759095] k3s[892]: I0922 10:35:18.841961 892 shared_informer.go:377] "Caches are synced" machine # [ 31.759396] k3s[892]: I0922 10:35:18.842176 892 shared_informer.go:377] "Caches are synced" machine # [ 31.759870] k3s[892]: I0922 10:35:18.842201 892 shared_informer.go:377] "Caches are synced" machine # [ 31.760542] k3s[892]: I0922 10:35:18.842225 892 shared_informer.go:377] "Caches are synced" machine # [ 31.761041] k3s[892]: I0922 10:35:18.842247 892 shared_informer.go:377] "Caches are synced" machine # [ 31.761535] k3s[892]: I0922 10:35:18.842276 892 shared_informer.go:377] "Caches are synced" machine # [ 31.762036] k3s[892]: I0922 10:35:18.842302 892 shared_informer.go:377] "Caches are synced" machine # [ 31.762538] k3s[892]: I0922 10:35:18.842329 892 shared_informer.go:377] "Caches are synced" machine # [ 31.765054] k3s[892]: I0922 10:35:18.843469 892 range_allocator.go:177] "Sending events to api server" machine # [ 31.765642] k3s[892]: I0922 10:35:18.843496 892 range_allocator.go:181] "Starting range CIDR allocator" machine # [ 31.766152] k3s[892]: I0922 10:35:18.843508 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.766621] k3s[892]: I0922 10:35:18.842362 892 shared_informer.go:377] "Caches are synced" machine # [ 31.767119] k3s[892]: I0922 10:35:18.843519 892 shared_informer.go:377] "Caches are synced" machine # [ 31.767614] k3s[892]: I0922 10:35:18.842496 892 shared_informer.go:377] "Caches are synced" machine # [ 31.768118] k3s[892]: I0922 10:35:18.842409 892 shared_informer.go:377] "Caches are synced" machine # [ 31.768599] k3s[892]: I0922 10:35:18.842470 892 shared_informer.go:377] "Caches are synced" machine # [ 31.770076] k3s[892]: I0922 10:35:18.842524 892 shared_informer.go:377] "Caches are synced" machine # [ 31.770734] k3s[892]: I0922 10:35:18.842385 892 shared_informer.go:377] "Caches are synced" machine # [ 31.774124] k3s[892]: I0922 10:35:18.861324 892 shared_informer.go:377] "Caches are synced" machine # [ 31.774767] k3s[892]: I0922 10:35:18.861709 892 shared_informer.go:377] "Caches are synced" machine # [ 31.775433] k3s[892]: I0922 10:35:18.861840 892 shared_informer.go:377] "Caches are synced" machine # [ 31.775909] k3s[892]: I0922 10:35:18.861897 892 shared_informer.go:377] "Caches are synced" machine # [ 31.776589] k3s[892]: I0922 10:35:18.861945 892 shared_informer.go:377] "Caches are synced" machine # [ 31.777092] k3s[892]: I0922 10:35:18.861987 892 shared_informer.go:377] "Caches are synced" machine # [ 31.777575] k3s[892]: I0922 10:35:18.862033 892 shared_informer.go:377] "Caches are synced" machine # [ 31.778081] k3s[892]: I0922 10:35:18.863440 892 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 31.778588] k3s[892]: I0922 10:35:18.866860 892 shared_informer.go:377] "Caches are synced" machine # [ 31.779067] k3s[892]: time="2026-09-22T10:35:18Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=AppliedManifest type=Normal machine # [ 31.780461] k3s[892]: I0922 10:35:18.872544 892 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 31.791255] k3s[892]: time="2026-09-22T10:35:18Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=ApplyingManifest type=Normal machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 31.881830] k3s[892]: time="2026-09-22T10:35:18Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Resumed synced Job kube-system/helm-install-nix-grpc-farm" object=kube-system/nix-grpc-farm reason=ResumeJob type=Normal machine # [ 31.929828] k3s[892]: time="2026-09-22T10:35:19Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=AppliedManifest type=Normal machine # [ 31.972122] k3s[892]: time="2026-09-22T10:35:19Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/traefik.yaml\"" object=kube-system/traefik reason=DeletingManifest type=Normal machine # [ 32.020133] k3s[892]: I0922 10:35:19.112169 892 controller.go:667] quota admission added evaluator for: replicasets.apps machine # [ 32.448573] k3s[892]: time="2026-09-22T10:35:19Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 32.746425] k3s[892]: I0922 10:35:19.838380 892 shared_informer.go:377] "Caches are synced" machine # [ 32.749527] k3s[892]: I0922 10:35:19.841554 892 shared_informer.go:377] "Caches are synced" machine # [ 32.750164] k3s[892]: I0922 10:35:19.841576 892 garbagecollector.go:166] "Garbage collector: all resource monitors have synced" machine # [ 32.750736] k3s[892]: I0922 10:35:19.841587 892 garbagecollector.go:169] "Proceeding to collect garbage" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 33.447555] k3s[892]: time="2026-09-22T10:35:20Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 33.583473] postgres[1206]: [1206] ERROR: relation "goose_db_version" does not exist at character 36 machine # [ 33.583692] postgres[1206]: [1206] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC machine # [ 33.614022] niks3-server[1198]: 2026/09/22 10:35:20 OK 20241026095416_initial_model.sql (11.27ms) machine # [ 33.618465] niks3-server[1198]: 2026/09/22 10:35:20 OK 20251210153512_drop_unused_gin_index.sql (2.63ms) machine # [ 33.622909] niks3-server[1198]: 2026/09/22 10:35:20 OK 20251218171726_add_pins.sql (3.21ms) machine # [ 33.625821] niks3-server[1198]: 2026/09/22 10:35:20 OK 20260628120000_add_object_size_and_stats.sql (4.02ms) machine # [ 33.629129] niks3-server[1198]: 2026/09/22 10:35:20 OK 20260905000000_add_claims.sql (3.22ms) machine # [ 33.633853] niks3-server[1198]: 2026/09/22 10:35:20 OK 20260920000000_drop_claims.sql (4.69ms) machine # [ 33.634228] niks3-server[1198]: 2026/09/22 10:35:20 goose: successfully migrated database to version: 20260920000000 machine # [ 33.640071] niks3-server[1198]: 2026/09/22 10:35:20 OK 1_commit_pending_closure.sql (5.69ms) machine # [ 33.642133] niks3-server[1198]: 2026/09/22 10:35:20 OK 2_object_stats_trigger.sql (2.12ms) machine # [ 33.642506] niks3-server[1198]: 2026/09/22 10:35:20 goose: up to current file version: 2 machine # [ 33.661091] niks3-server[1198]: 2026/09/22 10:35:20 INFO OIDC provider initialized name=kubernetes issuer=https://kubernetes.default.svc.cluster.local machine # [ 33.661469] niks3-server[1198]: 2026/09/22 10:35:20 INFO OIDC authentication enabled config=/nix/store/2xcn0lgmca14rg9xzcfqj65j9hs85hn6-niks3-oidc.json machine # [ 33.666506] niks3-server[1198]: 2026/09/22 10:35:20 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key machine # [ 33.740525] niks3-server[1198]: 2026/09/22 10:35:20 INFO Read proxy enabled — serving cache objects from S3 machine # [ 33.740874] niks3-server[1198]: 2026/09/22 10:35:20 INFO Using socket-activated listener address=0.0.0.0:5751 machine # [ 33.742611] niks3-server[1198]: 2026/09/22 10:35:20 INFO systemd watchdog enabled interval=15s machine # [ 33.744493] niks3-server[1198]: 2026/09/22 10:35:20 INFO Starting HTTP server address=0.0.0.0:5751 machine # [ 33.746936] systemd[1]: Started niks3 server. machine # [ 33.748053] systemd[1]: Reached target Multi-User System. machine # [ 33.748568] systemd[1]: Startup finished in 1.027s (kernel) + 3.998s (initrd) + 28.722s (userspace) = 33.748s. machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 34.448323] k3s[892]: time="2026-09-22T10:35:21Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 35.448541] k3s[892]: time="2026-09-22T10:35:22Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 35.702696] k3s[892]: time="2026-09-22T10:35:22Z" level=info msg="Started tunnel to 10.0.2.15:6443" machine # [ 35.702907] k3s[892]: time="2026-09-22T10:35:22Z" level=info msg="Stopped tunnel to 127.0.0.1:6443" machine # [ 35.703677] k3s[892]: time="2026-09-22T10:35:22Z" level=info msg="Connecting to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 35.704187] k3s[892]: time="2026-09-22T10:35:22Z" level=info msg="Proxy done" err="context canceled" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 35.704655] k3s[892]: time="2026-09-22T10:35:22Z" level=info msg="error in remotedialer server [400]: websocket: close 1006 (abnormal closure): unexpected EOF" machine # [ 35.705180] k3s[892]: time="2026-09-22T10:35:22Z" level=info msg="Handling backend connection request [machine]" machine # [ 35.705749] k3s[892]: time="2026-09-22T10:35:22Z" level=info msg="Connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 35.706530] k3s[892]: time="2026-09-22T10:35:22Z" level=info msg="Remotedialer connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 36.447578] k3s[892]: time="2026-09-22T10:35:23Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 37.447558] k3s[892]: time="2026-09-22T10:35:24Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 38.448373] k3s[892]: time="2026-09-22T10:35:25Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 39.447432] k3s[892]: time="2026-09-22T10:35:26Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 40.447821] k3s[892]: time="2026-09-22T10:35:27Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 41.448790] k3s[892]: time="2026-09-22T10:35:28Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 42.447051] k3s[892]: time="2026-09-22T10:35:29Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 42.589623] k3s[892]: time="2026-09-22T10:35:29Z" level=info msg="Imported docker.io/library/nix-grpc-farm-client:0.1.0-beta.1" machine # [ 42.592062] k3s[892]: time="2026-09-22T10:35:29Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-client@sha256:a42b16610573f6170067712582617cab65247dd064785ebb87b146c23f0630c4" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 42.916308] k3s[892]: time="2026-09-22T10:35:30Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-client.tar in 14.224145526s" machine # [ 42.920796] k3s[892]: time="2026-09-22T10:35:30Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-lb.tar" machine # [ 43.447809] k3s[892]: time="2026-09-22T10:35:30Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 44.448050] k3s[892]: time="2026-09-22T10:35:31Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 45.447398] k3s[892]: time="2026-09-22T10:35:32Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 46.329145] k3s[892]: time="2026-09-22T10:35:33Z" level=info msg="Imported docker.io/library/nix-grpc-farm-lb:0.1.0-beta.1" machine # [ 46.331054] k3s[892]: time="2026-09-22T10:35:33Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-lb@sha256:a3fb275e15335967c368c203214cabcce2886a8867fcd31c07e4effd2ad9a5ec" machine # [ 46.368340] k3s[892]: time="2026-09-22T10:35:33Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-lb.tar in 3.451429442s" machine # [ 46.370876] k3s[892]: time="2026-09-22T10:35:33Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm.tar" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 46.446394] k3s[892]: time="2026-09-22T10:35:33Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 46.519888] k3s[892]: time="2026-09-22T10:35:33Z" level=info msg="Running kubelet --cloud-provider=external --config-dir=/var/lib/rancher/k3s/agent/etc/kubelet.conf.d --containerd=/run/k3s/containerd/containerd.sock --eviction-hard=nodefs.available<1%,imagefs.available<1% --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubelet.kubeconfig --node-ip=10.0.2.15,fec0::f275:f13c:a7f6:f10e --node-labels= --read-only-port=0" machine # [ 46.526222] k3s[892]: Flag --containerd has been deprecated, This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed. machine # [ 46.540676] k3s[892]: I0922 10:35:33.632732 892 server.go:521] "Kubelet version" kubeletVersion="v1.35.8+k3s1" machine # [ 46.540978] k3s[892]: I0922 10:35:33.632761 892 server.go:523] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 46.541672] k3s[892]: I0922 10:35:33.632790 892 watchdog_linux.go:95] "Systemd watchdog is not enabled" machine # [ 46.542349] k3s[892]: I0922 10:35:33.632801 892 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." machine # [ 46.549213] k3s[892]: I0922 10:35:33.641247 892 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/agent/client-ca.crt" machine # [ 46.552806] k3s[892]: I0922 10:35:33.644881 892 server.go:1414] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" machine # [ 46.557218] k3s[892]: I0922 10:35:33.649286 892 server.go:771] "--cgroups-per-qos enabled, but --cgroup-root was not specified. Defaulting to /" machine # [ 46.557496] k3s[892]: I0922 10:35:33.649316 892 server.go:832] "NoSwap is set due to memorySwapBehavior not specified" memorySwapBehavior="" FailSwapOn=false machine # [ 46.558028] k3s[892]: I0922 10:35:33.649503 892 container_manager_linux.go:272] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] machine # [ 46.558520] k3s[892]: I0922 10:35:33.649524 892 container_manager_linux.go:277] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"machine","RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} machine # [ 46.559094] k3s[892]: I0922 10:35:33.649721 892 topology_manager.go:143] "Creating topology manager with none policy" machine # [ 46.559365] k3s[892]: I0922 10:35:33.649736 892 container_manager_linux.go:308] "Creating device plugin manager" machine # [ 46.559824] k3s[892]: I0922 10:35:33.649808 892 container_manager_linux.go:317] "Creating Dynamic Resource Allocation (DRA) manager" machine # [ 46.560479] k3s[892]: I0922 10:35:33.651488 892 state_mem.go:41] "Initialized" logger="CPUManager state memory" machine # [ 46.560914] k3s[892]: I0922 10:35:33.651697 892 kubelet.go:482] "Attempting to sync node with API server" machine # [ 46.561560] k3s[892]: I0922 10:35:33.651714 892 kubelet.go:383] "Adding static pod path" path="/var/lib/rancher/k3s/agent/pod-manifests" machine # [ 46.562039] k3s[892]: I0922 10:35:33.651738 892 kubelet.go:394] "Adding apiserver pod source" machine # [ 46.562510] k3s[892]: I0922 10:35:33.651757 892 apiserver.go:42] "Waiting for node sync before watching apiserver pods" machine # [ 46.562988] k3s[892]: I0922 10:35:33.655054 892 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="containerd" version="2.2.7-k3s1" apiVersion="v1" machine # [ 46.563533] k3s[892]: I0922 10:35:33.655620 892 kubelet.go:945] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" machine # [ 46.563932] k3s[892]: I0922 10:35:33.655649 892 kubelet.go:972] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" machine # [ 46.592131] k3s[892]: I0922 10:35:33.683940 892 server.go:1252] "Started kubelet" machine # [ 46.593316] k3s[892]: I0922 10:35:33.684220 892 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 machine # [ 46.595269] k3s[892]: I0922 10:35:33.684281 892 server_v1.go:49] "podresources" method="list" useActivePods=true machine # [ 46.595847] k3s[892]: I0922 10:35:33.684323 892 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 machine # [ 46.596384] k3s[892]: I0922 10:35:33.685080 892 server.go:317] "Adding debug handlers to kubelet server" machine # [ 46.597444] k3s[892]: I0922 10:35:33.685081 892 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" machine # [ 46.597883] k3s[892]: I0922 10:35:33.686014 892 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" machine # [ 46.598512] k3s[892]: I0922 10:35:33.686210 892 dynamic_serving_content.go:135] "Starting controller" name="kubelet-server-cert-files::/var/lib/rancher/k3s/agent/serving-kubelet.crt::/var/lib/rancher/k3s/agent/serving-kubelet.key" machine # [ 46.599067] k3s[892]: E0922 10:35:33.686994 892 kubelet_node_status.go:392] "Error getting the current node from lister" err="node \"machine\" not found" machine # [ 46.599708] k3s[892]: I0922 10:35:33.687029 892 volume_manager.go:311] "Starting Kubelet Volume Manager" machine # [ 46.600718] k3s[892]: I0922 10:35:33.687340 892 desired_state_of_world_populator.go:146] "Desired state populator starts to run" machine # [ 46.601442] k3s[892]: I0922 10:35:33.687393 892 reconciler.go:29] "Reconciler: start to sync state" machine # [ 46.601944] k3s[892]: I0922 10:35:33.689898 892 factory.go:223] Registration of the systemd container factory successfully machine # [ 46.602861] k3s[892]: I0922 10:35:33.690002 892 factory.go:221] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory machine # [ 46.603468] k3s[892]: E0922 10:35:33.692912 892 kubelet.go:1661] "Image garbage collection failed once. Stats initialization may not have completed yet" err="invalid capacity 0 on image filesystem" machine # [ 46.604711] k3s[892]: I0922 10:35:33.693052 892 factory.go:223] Registration of the containerd container factory successfully machine # [ 46.605531] k3s[892]: E0922 10:35:33.695251 892 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"machine\" not found" node="machine" machine # [ 46.629573] k3s[892]: I0922 10:35:33.721642 892 cpu_manager.go:225] "Starting" policy="none" machine # [ 46.630160] k3s[892]: I0922 10:35:33.721658 892 cpu_manager.go:226] "Reconciling" reconcilePeriod="10s" machine # [ 46.630570] k3s[892]: I0922 10:35:33.721679 892 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" machine # [ 46.636744] k3s[892]: I0922 10:35:33.728727 892 policy_none.go:50] "Start" machine # [ 46.637279] k3s[892]: I0922 10:35:33.728750 892 memory_manager.go:187] "Starting memorymanager" policy="None" machine # [ 46.637885] k3s[892]: I0922 10:35:33.728767 892 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" machine # [ 46.642790] k3s[892]: I0922 10:35:33.734870 892 policy_none.go:44] "Start" machine # [ 46.647079] systemd[1]: Created slice libcontainer container kubepods.slice. machine # [ 46.658040] systemd[1]: Created slice libcontainer container kubepods-burstable.slice. machine # [ 46.661297] systemd[1]: Created slice libcontainer container kubepods-besteffort.slice. machine # [ 46.669605] k3s[892]: E0922 10:35:33.761668 892 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" machine # [ 46.671918] k3s[892]: I0922 10:35:33.761810 892 eviction_manager.go:194] "Eviction manager: starting control loop" machine # [ 46.673429] k3s[892]: I0922 10:35:33.761839 892 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" machine # [ 46.675193] k3s[892]: I0922 10:35:33.762306 892 plugin_manager.go:121] "Starting Kubelet Plugin Manager" machine # [ 46.676729] k3s[892]: E0922 10:35:33.763982 892 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="no imagefs label for configured runtime" machine # [ 46.679787] k3s[892]: E0922 10:35:33.764015 892 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"machine\" not found" machine # [ 46.745958] k3s[892]: I0922 10:35:33.837852 892 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" machine # [ 46.755080] k3s[892]: I0922 10:35:33.847111 892 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" machine # [ 46.755504] k3s[892]: I0922 10:35:33.847194 892 status_manager.go:249] "Starting to sync pod status with apiserver" machine # [ 46.756308] k3s[892]: I0922 10:35:33.847241 892 kubelet.go:2506] "Starting kubelet main sync loop" machine # [ 46.772195] k3s[892]: I0922 10:35:33.864219 892 kubelet_node_status.go:74] "Attempting to register node" node="machine" machine # [ 46.778070] k3s[892]: I0922 10:35:33.869740 892 kubelet_node_status.go:77] "Successfully registered node" node="machine" machine # [ 46.778200] k3s[892]: E0922 10:35:33.869763 892 kubelet_node_status.go:474] "Error updating node status, will retry" err="error getting node \"machine\": node \"machine\" not found" machine # [ 46.778713] k3s[892]: I0922 10:35:33.870200 892 node_controller.go:429] Initializing node machine with cloud provider machine # [ 46.779212] k3s[892]: I0922 10:35:33.870246 892 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 46.779662] k3s[892]: E0922 10:35:33.870265 892 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 46.780195] k3s[892]: time="2026-09-22T10:35:33Z" level=info msg="Adding node OwnerReference to node-password secret machine.node-password.k3s" machine # [ 46.781949] k3s[892]: I0922 10:35:33.872763 892 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"machine\" does not exist" machine # [ 46.787665] k3s[892]: I0922 10:35:33.879434 892 node_controller.go:429] Initializing node machine with cloud provider machine # [ 46.788708] k3s[892]: I0922 10:35:33.879483 892 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 46.789436] k3s[892]: E0922 10:35:33.879502 892 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 46.789920] k3s[892]: I0922 10:35:33.879515 892 range_allocator.go:433] "Set node PodCIDR" node="machine" podCIDRs=["10.42.0.0/24"] machine # [ 46.790757] k3s[892]: I0922 10:35:33.879567 892 node_controller.go:429] Initializing node machine with cloud provider machine # [ 46.791386] k3s[892]: I0922 10:35:33.879601 892 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 46.792019] k3s[892]: E0922 10:35:33.879615 892 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 46.795568] k3s[892]: I0922 10:35:33.887642 892 node_controller.go:429] Initializing node machine with cloud provider machine # [ 46.796652] k3s[892]: I0922 10:35:33.887688 892 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 46.797280] k3s[892]: E0922 10:35:33.887706 892 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 46.801104] k3s[892]: time="2026-09-22T10:35:33Z" level=info msg="Synced coredns NodeHosts entries for machine" machine # [ 46.803051] k3s[892]: I0922 10:35:33.895098 892 node_controller.go:429] Initializing node machine with cloud provider machine # [ 46.804198] k3s[892]: time="2026-09-22T10:35:33Z" level=info msg="Annotations and labels have been set successfully on node: machine" machine # [ 46.805158] k3s[892]: time="2026-09-22T10:35:33Z" level=info msg="Starting flannel with backend vxlan" machine # [ 46.815540] k3s[892]: I0922 10:35:33.907618 892 kuberuntime_manager.go:2095] "Updating runtime config through cri with podcidr" CIDR="10.42.0.0/24" machine # [ 46.817070] k3s[892]: I0922 10:35:33.909116 892 kubelet_network.go:47] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.42.0.0/24" machine # [ 46.823150] k3s[892]: I0922 10:35:33.915022 892 node_controller.go:474] Successfully initialized node machine with cloud provider machine # [ 46.824604] k3s[892]: I0922 10:35:33.916682 892 event.go:389] "Event occurred" object="machine" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="Synced" message="Node synced successfully" machine # [ 46.828653] k3s[892]: I0922 10:35:33.920574 892 server.go:173] "Starting Kubernetes Scheduler" version="v1.35.8+k3s1" machine # [ 46.828909] k3s[892]: I0922 10:35:33.920597 892 server.go:175] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 46.831604] k3s[892]: I0922 10:35:33.923676 892 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 46.831856] k3s[892]: I0922 10:35:33.923699 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 46.832551] k3s[892]: I0922 10:35:33.923735 892 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 46.832984] k3s[892]: I0922 10:35:33.923751 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 46.833534] k3s[892]: I0922 10:35:33.923776 892 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 46.835038] k3s[892]: I0922 10:35:33.923787 892 secure_serving.go:211] Serving securely on 127.0.0.1:10259 machine # [ 46.835300] k3s[892]: I0922 10:35:33.923858 892 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 46.835754] k3s[892]: I0922 10:35:33.923942 892 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 46.836402] k3s[892]: I0922 10:35:33.923789 892 shared_informer.go:370] "Waiting for caches to sync" machine # [ 46.930882] k3s[892]: time="2026-09-22T10:35:34Z" level=info msg="Flannel found PodCIDR assigned for node machine" machine # [ 46.933078] k3s[892]: time="2026-09-22T10:35:34Z" level=info msg="The interface eth0 with ipv4 address 10.0.2.15 will be used by flannel" machine # [ 46.933692] k3s[892]: I0922 10:35:34.025779 892 kube.go:139] Waiting 10m0s for node controller to sync machine # [ 46.934228] k3s[892]: I0922 10:35:34.025852 892 kube.go:537] Starting kube subnet manager machine # [ 47.026471] k3s[892]: I0922 10:35:34.118506 892 kubelet_node_status.go:427] "Fast updating node status as it just became ready" machine # [ 47.035062] k3s[892]: I0922 10:35:34.126680 892 topologycache.go:237] "Can't get CPU or zone information for node" node="machine" machine # [ 47.132334] k3s[892]: I0922 10:35:34.224326 892 shared_informer.go:377] "Caches are synced" machine # [ 47.132560] k3s[892]: I0922 10:35:34.224342 892 shared_informer.go:377] "Caches are synced" machine # [ 47.132821] k3s[892]: I0922 10:35:34.224373 892 shared_informer.go:377] "Caches are synced" machine # [ 47.442524] k3s[892]: time="2026-09-22T10:35:34Z" level=info msg="Tunnel authorizer set Kubelet Port 0.0.0.0:10250" machine # [ 47.452565] k3s[892]: time="2026-09-22T10:35:34Z" level=info msg="Labels and annotations have been set successfully on node: machine" machine # [ 47.560947] k3s[892]: I0922 10:35:34.652943 892 apiserver.go:52] "Watching apiserver" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 47.708808] k3s[892]: I0922 10:35:34.800714 892 server.go:218] "Successfully retrieved NodeIPs" NodeIPs=["10.0.2.15","fec0::f275:f13c:a7f6:f10e"] machine # [ 47.710723] k3s[892]: E0922 10:35:34.801212 892 server.go:255] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`" machine # [ 47.719028] systemd[1]: Created slice libcontainer container kubepods-burstable-podd3effcc4_fbcc_4402_8e37_eda7c8f330ea.slice. machine # [ 47.729795] systemd[1]: Created slice libcontainer container kubepods-burstable-pod85841907_6b26_485b_9726_66c10388ddcb.slice. machine # [ 47.749294] k3s[892]: I0922 10:35:34.841340 892 server.go:264] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4" machine # [ 47.751350] k3s[892]: I0922 10:35:34.841378 892 server_linux.go:136] "Using iptables Proxier" machine # [ 47.776419] k3s[892]: I0922 10:35:34.868452 892 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4" machine # [ 47.795626] k3s[892]: I0922 10:35:34.887663 892 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" machine # [ 47.796644] k3s[892]: I0922 10:35:34.888709 892 server.go:529] "Version info" version="v1.35.8+k3s1" machine # [ 47.797419] k3s[892]: I0922 10:35:34.888743 892 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 47.798212] k3s[892]: I0922 10:35:34.890116 892 config.go:309] "Starting node config controller" machine # [ 47.798638] k3s[892]: I0922 10:35:34.890167 892 shared_informer.go:349] "Waiting for caches to sync" controller="node config" machine # [ 47.799160] k3s[892]: I0922 10:35:34.890181 892 shared_informer.go:356] "Caches are synced" controller="node config" machine # [ 47.799664] k3s[892]: I0922 10:35:34.890278 892 config.go:200] "Starting service config controller" machine # [ 47.800256] k3s[892]: I0922 10:35:34.890299 892 shared_informer.go:349] "Waiting for caches to sync" controller="service config" machine # [ 47.801284] k3s[892]: I0922 10:35:34.890343 892 config.go:106] "Starting endpoint slice config controller" machine # [ 47.802114] k3s[892]: I0922 10:35:34.890355 892 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config" machine # [ 47.802687] k3s[892]: I0922 10:35:34.890383 892 config.go:403] "Starting serviceCIDR config controller" machine # [ 47.803654] k3s[892]: I0922 10:35:34.890396 892 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config" machine # [ 47.804639] k3s[892]: I0922 10:35:34.894376 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/85841907-6b26-485b-9726-66c10388ddcb-klipper-helm\") pod \"helm-install-nix-grpc-farm-kk65h\" (UID: \"85841907-6b26-485b-9726-66c10388ddcb\") " pod="kube-system/helm-install-nix-grpc-farm-kk65h" machine # [ 47.805303] k3s[892]: I0922 10:35:34.894407 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/85841907-6b26-485b-9726-66c10388ddcb-klipper-cache\") pod \"helm-install-nix-grpc-farm-kk65h\" (UID: \"85841907-6b26-485b-9726-66c10388ddcb\") " pod="kube-system/helm-install-nix-grpc-farm-kk65h" machine # [ 47.805835] k3s[892]: I0922 10:35:34.894432 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/85841907-6b26-485b-9726-66c10388ddcb-klipper-config\") pod \"helm-install-nix-grpc-farm-kk65h\" (UID: \"85841907-6b26-485b-9726-66c10388ddcb\") " pod="kube-system/helm-install-nix-grpc-farm-kk65h" machine # [ 47.806019] k3s[892]: I0922 10:35:34.894458 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vwl7\" (UniqueName: \"kubernetes.io/projected/85841907-6b26-485b-9726-66c10388ddcb-kube-api-access-7vwl7\") pod \"helm-install-nix-grpc-farm-kk65h\" (UID: \"85841907-6b26-485b-9726-66c10388ddcb\") " pod="kube-system/helm-install-nix-grpc-farm-kk65h" machine # [ 47.806842] k3s[892]: I0922 10:35:34.894486 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/85841907-6b26-485b-9726-66c10388ddcb-tmp\") pod \"helm-install-nix-grpc-farm-kk65h\" (UID: \"85841907-6b26-485b-9726-66c10388ddcb\") " pod="kube-system/helm-install-nix-grpc-farm-kk65h" machine # [ 47.807573] k3s[892]: I0922 10:35:34.894515 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"values\" (UniqueName: \"kubernetes.io/projected/85841907-6b26-485b-9726-66c10388ddcb-values\") pod \"helm-install-nix-grpc-farm-kk65h\" (UID: \"85841907-6b26-485b-9726-66c10388ddcb\") " pod="kube-system/helm-install-nix-grpc-farm-kk65h" machine # [ 47.808729] k3s[892]: I0922 10:35:34.894547 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"content\" (UniqueName: \"kubernetes.io/configmap/85841907-6b26-485b-9726-66c10388ddcb-content\") pod \"helm-install-nix-grpc-farm-kk65h\" (UID: \"85841907-6b26-485b-9726-66c10388ddcb\") " pod="kube-system/helm-install-nix-grpc-farm-kk65h" machine # [ 47.809373] k3s[892]: I0922 10:35:34.894570 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d3effcc4-fbcc-4402-8e37-eda7c8f330ea-config-volume\") pod \"coredns-c5fdd76cf-chl9b\" (UID: \"d3effcc4-fbcc-4402-8e37-eda7c8f330ea\") " pod="kube-system/coredns-c5fdd76cf-chl9b" machine # [ 47.810067] k3s[892]: I0922 10:35:34.894594 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3effcc4-fbcc-4402-8e37-eda7c8f330ea-custom-config-volume\") pod \"coredns-c5fdd76cf-chl9b\" (UID: \"d3effcc4-fbcc-4402-8e37-eda7c8f330ea\") " pod="kube-system/coredns-c5fdd76cf-chl9b" machine # [ 47.810854] k3s[892]: I0922 10:35:34.894619 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdwmp\" (UniqueName: \"kubernetes.io/projected/d3effcc4-fbcc-4402-8e37-eda7c8f330ea-kube-api-access-sdwmp\") pod \"coredns-c5fdd76cf-chl9b\" (UID: \"d3effcc4-fbcc-4402-8e37-eda7c8f330ea\") " pod="kube-system/coredns-c5fdd76cf-chl9b" machine # [ 47.934380] k3s[892]: I0922 10:35:35.026358 892 kube.go:163] Node controller sync successful machine # [ 47.934555] k3s[892]: I0922 10:35:35.026423 892 vxlan.go:128] VXLAN config: VNI=1 Port=0 GBP=false Learning=false DirectRouting=false machine # [ 47.937292] k3s[892]: I0922 10:35:35.029316 892 kube.go:704] List of node(machine) annotations: map[string]string{"alpha.kubernetes.io/provided-node-ip":"10.0.2.15,fec0::f275:f13c:a7f6:f10e", "k3s.io/hostname":"machine", "k3s.io/internal-ip":"10.0.2.15,fec0::f275:f13c:a7f6:f10e", "k3s.io/node-args":"[\"server\",\"--disable\",\"traefik\",\"--disable\",\"metrics-server\",\"--disable\",\"local-storage\",\"--kubelet-arg\",\"eviction-hard=nodefs.available\\u003c1%,imagefs.available\\u003c1%\"]", "k3s.io/node-config-hash":"EFXPOZ7ZWHRCLFNW4X4ZDPFQMSAOP3BLEIN2VE47TDRKQ4UIWKUQ====", "k3s.io/node-env":"{}", "node.alpha.kubernetes.io/ttl":"0", "volumes.kubernetes.io/controller-managed-attach-detach":"true"} machine # [ 47.974945] (udev-worker)[1433]: Network interface NamePolicy= disabled on kernel command line. machine # [ 47.981740] k3s[892]: I0922 10:35:35.072778 892 iptables.go:50] Starting flannel in iptables mode... machine # [ 47.982203] k3s[892]: time="2026-09-22T10:35:35Z" level=warning msg="no subnet found for key: FLANNEL_NETWORK in file: /run/flannel/subnet.env" machine # [ 47.982637] k3s[892]: time="2026-09-22T10:35:35Z" level=warning msg="no subnet found for key: FLANNEL_SUBNET in file: /run/flannel/subnet.env" machine # [ 47.983139] k3s[892]: time="2026-09-22T10:35:35Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_NETWORK in file: /run/flannel/subnet.env" machine # [ 47.983626] k3s[892]: time="2026-09-22T10:35:35Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_SUBNET in file: /run/flannel/subnet.env" machine # [ 47.984196] k3s[892]: I0922 10:35:35.072938 892 iptables.go:101] Current network or subnet (10.42.0.0/16, 10.42.0.0/24) is not equal to previous one (0.0.0.0/0, 0.0.0.0/0), trying to recycle old iptables rules machine # [ 47.984978] k3s[892]: I0922 10:35:35.073479 892 kube.go:558] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.42.0.0/24] machine # [ 47.998368] k3s[892]: I0922 10:35:35.090398 892 shared_informer.go:356] "Caches are synced" controller="service config" machine # [ 48.001304] k3s[892]: I0922 10:35:35.090423 892 shared_informer.go:356] "Caches are synced" controller="endpoint slice config" machine # [ 48.001431] k3s[892]: I0922 10:35:35.090451 892 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config" machine # [ 48.024391] dhcpcd[675]: flannel.1: IAID 9d:9c:06:52 machine # [ 48.024727] dhcpcd[675]: flannel.1: adding address fe80::54f4:9dff:fe9c:652 machine # [ 48.075571] k3s[892]: I0922 10:35:35.167602 892 iptables.go:111] Setting up masking rules machine # [ 48.095530] k3s[892]: I0922 10:35:35.187532 892 iptables.go:212] Changing default FORWARD chain policy to ACCEPT machine # [ 48.109307] k3s[892]: time="2026-09-22T10:35:35Z" level=info msg="Wrote flannel subnet file to /run/flannel/subnet.env" machine # [ 48.109513] k3s[892]: time="2026-09-22T10:35:35Z" level=info msg="Running flannel backend" machine # [ 48.109898] k3s[892]: I0922 10:35:35.201199 892 vxlan_network.go:68] watching for new subnet leases machine # [ 48.110793] k3s[892]: I0922 10:35:35.201234 892 vxlan_network.go:115] starting vxlan device watcher machine # [ 48.164165] k3s[892]: I0922 10:35:35.256204 892 iptables.go:358] bootstrap done machine # [ 48.231525] k3s[892]: I0922 10:35:35.323501 892 iptables.go:358] bootstrap done machine # [ 48.478095] cni0: port 1(vethe790ce61) entered blocking state machine # [ 48.479608] cni0: port 1(vethe790ce61) entered disabled state machine # [ 48.481116] vethe790ce61: entered allmulticast mode machine # [ 48.482282] vethe790ce61: entered promiscuous mode machine # [ 48.339113] (udev-worker)[1620]: Network interface NamePolicy= disabled on ke[ 48.485502] cni0: port 2(vethe95e9a99) entered blocking state machine # rnel command line. machine # [ 48.486640] cni0: port 2(vethe95e9a99) entered disabled state machine # [ 48.487672] vethe95e9a99: entered allmulticast mode machine # [ 48.488790] vethe95e9a99: entered promiscuous mode machine # [ 48.507275] cni0: port 2(vethe95e9a99) entered blocking state machine # [ 48.508080] cni0: port 2(vethe95e9a99) entered forwarding state machine # [ 48.510848] cni0: port 1(vethe790ce61) entered blocking state machine # [ 48.511585] cni0: port 1(vethe790ce61) entered forwarding state machine # [ 48.400417] dhcpcd[675]: vethe95e9a99: waiting for carrier machine # [ 48.418532] dhcpcd[675]: vethe790ce61: IAID 3d:10:03:e1 machine # [ 48.418914] dhcpcd[675]: vethe790ce61: adding address fe80::6842:3dff:fe10:3e1 machine # [ 48.419521] dhcpcd[675]: vethe95e9a99: carrier acquired machine # [ 48.427510] dhcpcd[675]: vethe95e9a99: IAID 74:3e:fb:b9 machine # [ 48.428767] dhcpcd[675]: vethe95e9a99: adding address fe80::58c8:74ff:fe3e:fbb9 machine # [ 48.550463] systemd[1]: Started libcontainer container 078e2d1fa98031517ce6999661f16744d10e181831ed7d294a47a85ccc18464f. machine # [ 48.552251] systemd[1]: Started libcontainer container e66914b5ceae0d932eed688290c66c32b4e4388365926f88e33be319cf35cdb8. machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 49.085892] k3s[892]: time="2026-09-22T10:35:36Z" level=info msg="Starting network policy controller version v2.6.3-k3s1, built on 1970-01-01T01:01:01Z, go1.26.7" machine # [ 49.088785] k3s[892]: I0922 10:35:36.177646 892 network_policy_controller.go:164] Starting network policy controller machine # [ 49.163553] dhcpcd[675]: flannel.1: soliciting a DHCP lease machine # [ 49.449455] systemd[1]: Started libcontainer container d40c9b9eaad97227d2df33abaaaed95735b48b51770b687f863ffc8d5495a789. machine # [ 49.496852] k3s[892]: I0922 10:35:36.588792 892 network_policy_controller.go:179] Starting network policy controller full sync goroutine machine # [ 49.703435] systemd[1]: Started libcontainer container d3d141114ff5e9bf7559d1d6bf5e678ef806a9ce08242565c983130bd5bbee64. machine # [ 49.834663] k3s[892]: I0922 10:35:36.926658 892 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/helm-install-nix-grpc-farm-kk65h" podStartSLOduration=17.92663662 podStartE2EDuration="17.92663662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-22 10:35:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-22 10:35:36.919643832 +0000 UTC m=+29.323440826" watchObservedRunningTime="2026-09-22 10:35:36.92663662 +0000 UTC m=+29.330433615" machine # [ 49.850423] k3s[892]: I0922 10:35:36.940584 892 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/coredns-c5fdd76cf-chl9b" podStartSLOduration=17.939977701 podStartE2EDuration="17.939977701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-22 10:35:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-22 10:35:36.937963758 +0000 UTC m=+29.341761311" watchObservedRunningTime="2026-09-22 10:35:36.939977701 +0000 UTC m=+29.343774416" machine # [ 50.049674] dhcpcd[675]: vethe790ce61: soliciting a DHCP lease machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 50.165623] dhcpcd[675]: vethe95e9a99: soliciting an IPv6 router machine # [ 50.280621] dhcpcd[675]: flannel.1: soliciting an IPv6 router machine # [ 50.320882] dhcpcd[675]: vethe95e9a99: soliciting a DHCP lease machine # [ 50.838558] dhcpcd[675]: vethe790ce61: soliciting an IPv6 router machine # [ 51.083872] k3s[892]: I0922 10:35:38.175589 892 alloc.go:329] "allocated clusterIPs" service="farm/nix-grpc-farm" clusterIPs={"IPv4":"10.43.32.205"} machine # [ 51.122313] systemd[1]: cri-containerd-d3d141114ff5e9bf7559d1d6bf5e678ef806a9ce08242565c983130bd5bbee64.scope: Deactivated successfully. machine # [ 51.124790] systemd[1]: cri-containerd-d3d141114ff5e9bf7559d1d6bf5e678ef806a9ce08242565c983130bd5bbee64.scope: Consumed 564ms CPU time over 1.419s wall clock time, 32M memory peak, 2.4M incoming IP traffic, 142K outgoing IP traffic. machine # [ 51.174563] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-d3d141114ff5e9bf7559d1d6bf5e678ef806a9ce08242565c983130bd5bbee64-rootfs.mount: Deactivated successfully. machine # [ 51.738829] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod8f253228_0cfd_44dd_9a4e_1117f8f3797b.slice. machine # [ 51.754977] k3s[892]: I0922 10:35:38.846973 892 node_lifecycle_controller.go:1234] "Initializing eviction metric for zone" zone="" machine # [ 51.759065] systemd[1]: Created slice libcontainer container kubepods-besteffort-poda214dbf2_70e5_479b_9dfa_739c5a5cdeda.slice. machine # [ 51.761301] k3s[892]: I0922 10:35:38.849629 892 node_lifecycle_controller.go:886] "Missing timestamp for Node. Assuming now as a timestamp" node="machine" machine # [ 51.764034] k3s[892]: I0922 10:35:38.849711 892 node_lifecycle_controller.go:1080] "Controller detected that zone is now in new state" zone="" newState="Normal" machine # [ 51.774150] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod2893bc93_b6de_49c4_aacf_683fcae29bfa.slice. machine # [ 51.785892] systemd[1]: Created slice libcontainer container kubepods-besteffort-poded0a1fc8_5ad8_447a_adab_0669ada6b772.slice. machine # [ 51.833478] k3s[892]: I0922 10:35:38.925148 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf4vg\" (UniqueName: \"kubernetes.io/projected/ed0a1fc8-5ad8-447a-adab-0669ada6b772-kube-api-access-tf4vg\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-t5tqs\" (UID: \"ed0a1fc8-5ad8-447a-adab-0669ada6b772\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-t5tqs" machine # [ 51.833702] k3s[892]: I0922 10:35:38.925212 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a214dbf2-70e5-479b-9dfa-739c5a5cdeda-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-d5cw4\" (UID: \"a214dbf2-70e5-479b-9dfa-739c5a5cdeda\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-d5cw4" machine # [ 51.834985] k3s[892]: I0922 10:35:38.925247 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/ed0a1fc8-5ad8-447a-adab-0669ada6b772-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-t5tqs\" (UID: \"ed0a1fc8-5ad8-447a-adab-0669ada6b772\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-t5tqs" machine # [ 51.835875] k3s[892]: I0922 10:35:38.925272 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/a214dbf2-70e5-479b-9dfa-739c5a5cdeda-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-d5cw4\" (UID: \"a214dbf2-70e5-479b-9dfa-739c5a5cdeda\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-d5cw4" machine # [ 51.836944] k3s[892]: I0922 10:35:38.925298 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/ed0a1fc8-5ad8-447a-adab-0669ada6b772-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-t5tqs\" (UID: \"ed0a1fc8-5ad8-447a-adab-0669ada6b772\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-t5tqs" machine # [ 51.837951] k3s[892]: I0922 10:35:38.925329 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/ed0a1fc8-5ad8-447a-adab-0669ada6b772-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-t5tqs\" (UID: \"ed0a1fc8-5ad8-447a-adab-0669ada6b772\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-t5tqs" machine # [ 51.839167] k3s[892]: I0922 10:35:38.925352 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/ed0a1fc8-5ad8-447a-adab-0669ada6b772-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-t5tqs\" (UID: \"ed0a1fc8-5ad8-447a-adab-0669ada6b772\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-t5tqs" machine # [ 51.839744] k3s[892]: I0922 10:35:38.925379 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/2893bc93-b6de-49c4-aacf-683fcae29bfa-oidc\") pod \"nix-grpc-farm-scheduler-5844ddf54b-k2vbk\" (UID: \"2893bc93-b6de-49c4-aacf-683fcae29bfa\") " pod="farm/nix-grpc-farm-scheduler-5844ddf54b-k2vbk" machine # [ 51.840130] k3s[892]: I0922 10:35:38.925410 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f253228-0cfd-44dd-9a4e-1117f8f3797b-tmp\") pod \"nix-grpc-farm-lb-68c8f49bd6-wt8rf\" (UID: \"8f253228-0cfd-44dd-9a4e-1117f8f3797b\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-wt8rf" machine # [ 51.840577] k3s[892]: I0922 10:35:38.925437 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2893bc93-b6de-49c4-aacf-683fcae29bfa-ca\") pod \"nix-grpc-farm-scheduler-5844ddf54b-k2vbk\" (UID: \"2893bc93-b6de-49c4-aacf-683fcae29bfa\") " pod="farm/nix-grpc-farm-scheduler-5844ddf54b-k2vbk" machine # [ 51.841235] k3s[892]: I0922 10:35:38.925464 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/ed0a1fc8-5ad8-447a-adab-0669ada6b772-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-t5tqs\" (UID: \"ed0a1fc8-5ad8-447a-adab-0669ada6b772\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-t5tqs" machine # [ 51.842092] k3s[892]: I0922 10:35:38.925507 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ed0a1fc8-5ad8-447a-adab-0669ada6b772-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-t5tqs\" (UID: \"ed0a1fc8-5ad8-447a-adab-0669ada6b772\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-t5tqs" machine # [ 51.848413] k3s[892]: I0922 10:35:38.925534 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/a214dbf2-70e5-479b-9dfa-739c5a5cdeda-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-d5cw4\" (UID: \"a214dbf2-70e5-479b-9dfa-739c5a5cdeda\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-d5cw4" machine # [ 51.854671] k3s[892]: I0922 10:35:38.925563 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfn9k\" (UniqueName: \"kubernetes.io/projected/2893bc93-b6de-49c4-aacf-683fcae29bfa-kube-api-access-pfn9k\") pod \"nix-grpc-farm-scheduler-5844ddf54b-k2vbk\" (UID: \"2893bc93-b6de-49c4-aacf-683fcae29bfa\") " pod="farm/nix-grpc-farm-scheduler-5844ddf54b-k2vbk" machine # [ 51.860470] k3s[892]: I0922 10:35:38.925590 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/8f253228-0cfd-44dd-9a4e-1117f8f3797b-tls-lb\") pod \"nix-grpc-farm-lb-68c8f49bd6-wt8rf\" (UID: \"8f253228-0cfd-44dd-9a4e-1117f8f3797b\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-wt8rf" machine # [ 51.924304] k3s[892]: I0922 10:35:38.925635 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/a214dbf2-70e5-479b-9dfa-739c5a5cdeda-build\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-d5cw4\" (UID: \"a214dbf2-70e5-479b-9dfa-739c5a5cdeda\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-d5cw4" machine # [ 51.925160] k3s[892]: I0922 10:35:38.925658 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/ed0a1fc8-5ad8-447a-adab-0669ada6b772-build\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-t5tqs\" (UID: \"ed0a1fc8-5ad8-447a-adab-0669ada6b772\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-t5tqs" machine # [ 51.926184] k3s[892]: I0922 10:35:38.925690 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8f253228-0cfd-44dd-9a4e-1117f8f3797b-config\") pod \"nix-grpc-farm-lb-68c8f49bd6-wt8rf\" (UID: \"8f253228-0cfd-44dd-9a4e-1117f8f3797b\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-wt8rf" machine # [ 51.926948] k3s[892]: I0922 10:35:38.925716 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/a214dbf2-70e5-479b-9dfa-739c5a5cdeda-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-d5cw4\" (UID: \"a214dbf2-70e5-479b-9dfa-739c5a5cdeda\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-d5cw4" machine # [ 51.928057] k3s[892]: I0922 10:35:38.925740 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/a214dbf2-70e5-479b-9dfa-739c5a5cdeda-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-d5cw4\" (UID: \"a214dbf2-70e5-479b-9dfa-739c5a5cdeda\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-d5cw4" machine # [ 51.928787] k3s[892]: I0922 10:35:38.925766 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztvfs\" (UniqueName: \"kubernetes.io/projected/a214dbf2-70e5-479b-9dfa-739c5a5cdeda-kube-api-access-ztvfs\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-d5cw4\" (UID: \"a214dbf2-70e5-479b-9dfa-739c5a5cdeda\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-d5cw4" machine # [ 51.929772] k3s[892]: I0922 10:35:38.925789 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/2893bc93-b6de-49c4-aacf-683fcae29bfa-niks3-token\") pod \"nix-grpc-farm-scheduler-5844ddf54b-k2vbk\" (UID: \"2893bc93-b6de-49c4-aacf-683fcae29bfa\") " pod="farm/nix-grpc-farm-scheduler-5844ddf54b-k2vbk" machine # [ 51.930504] k3s[892]: I0922 10:35:38.925816 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/2893bc93-b6de-49c4-aacf-683fcae29bfa-tls\") pod \"nix-grpc-farm-scheduler-5844ddf54b-k2vbk\" (UID: \"2893bc93-b6de-49c4-aacf-683fcae29bfa\") " pod="farm/nix-grpc-farm-scheduler-5844ddf54b-k2vbk" machine # [ 51.931171] k3s[892]: I0922 10:35:38.925844 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/8f253228-0cfd-44dd-9a4e-1117f8f3797b-tls-ca\") pod \"nix-grpc-farm-lb-68c8f49bd6-wt8rf\" (UID: \"8f253228-0cfd-44dd-9a4e-1117f8f3797b\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-wt8rf" machine # [ 51.931822] k3s[892]: I0922 10:35:38.925868 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/a214dbf2-70e5-479b-9dfa-739c5a5cdeda-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-d5cw4\" (UID: \"a214dbf2-70e5-479b-9dfa-739c5a5cdeda\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-d5cw4" machine # [ 52.223397] cni0: port 3(veth46a5c2ab) entered blocking state machine # [ 52.078340] (udev-worker)[2023]: Network interface NamePolicy= disabled on ke[ 52.225620] cni0: port 3(veth46a5c2ab) entered disabled state machine # rnel command line. machine # [ 52.227618] veth46a5c2ab: entered allmulticast mode machine # [ 52.228550] veth46a5c2ab: entered promiscuous mode machine # [ 52.254779] cni0: port 3(veth46a5c2ab) entered blocking state machine # [ 52.255569] cni0: port 3(veth46a5c2ab) entered forwarding state machine # [ 52.123964] (udev-worker)[2173]: Network interface NamePolicy= disabled on kernel command line. machine # [ 52.271969] cni0: port 4(veth609d6927) entered blocking state machine # [ 52.272937] cni0: port 4(veth609d6927) entered disabled state machine # [ 52.273837] veth609d6927: entered allmulticast mode machine # [ 52.274702] veth609d6927: entered promiscuous mode machine # [ 52.292822] cni0: port 4(veth609d6927) entered blocking state machine # [ 52.293725] cni0: port 4(veth609d6927) entered forwarding state machine # [ 52.159814] (udev-worker)[2175]: Network interface NamePolicy= disabled on kernel command line. machine # [ 52.307079] cni0: port 5(vethc5da90ce) entered blocking state machine # [ 52.308776] cni0: port 5(vethc5da90ce) entered disabled state machine # [ 52.309834] vethc5da90ce: entered allmulticast mode machine # [ 52.310783] vethc5da90ce: entered promiscuous mode machine # [ 52.168339] dhcpcd[675]: veth46a5c2ab: waiting for carrier machine # [ 52.325726] cni0: port 5(vethc5da90ce) entered blocking state machine # [ 52.327023] cni0: port 5(vethc5da90ce) entered forwarding state machine # [ 52.193574] dhcpcd[675]: veth609d6927: IAID 85:53:d1:82 machine # [ 52.195165] dhcpcd[675]: veth609d6927: adding address fe80::d883:85ff:fe53:d182 machine # [ 52.346158] cni0: port 6(veth67d21afd) entered blocking state machine # [ 52.347558] cni0: port 6(veth67d21afd) entered disabled state machine # [ 52.349377] veth67d21afd: entered allmulticast mode machine # [ 52.350879] veth67d21afd: entered promiscuous mode machine # [ 52.217494] dhcpcd[675]: vethc5da90ce: IAID 76:af:8a:fb machine # [ 52.219512] dhcpcd[675]: vethc5da90ce: adding address fe80::d485:76ff:feaf:8afb machine # [ 52.221462] dhcpcd[675]: veth46a5c2ab: carrier acquired machine # [ 52.368590] cni0: port 6(veth67d21afd) entered blocking state machine # [ 52.369710] cni0: port 6(veth67d21afd) entered forwarding state machine # [ 52.231263] dhcpcd[675]: veth46a5c2ab: IAID 26:07:d7:a4 machine # [ 52.231592] dhcpcd[675]: veth46a5c2ab: adding address fe80::8466:26ff:fe07:d7a4 machine # [ 52.250163] dhcpcd[675]: veth67d21afd: IAID b7:1e:98:36 machine # [ 52.250334] dhcpcd[675]: veth67d21afd: adding address fe80::a0e1:b7ff:fe1e:9836 machine # [ 52.252160] dhcpcd[675]: veth609d6927: old hardware address: da:83:85:53:d1:82 machine # [ 52.254521] dhcpcd[675]: veth609d6927: new hardware address: 3e:a7:70:fe:6c:28 machine # [ 52.256350] dhcpcd[675]: veth609d6927: carrier lost machine # [ 52.288373] dhcpcd[675]: veth609d6927: deleting address fe80::d883:85ff:fe53:d182 machine # [ 52.289300] dhcpcd[675]: veth609d6927: old hardware address: 3e:a7:70:fe:6c:28 machine # [ 52.291394] systemd[1]: Started libcontainer container bde649153d7d1a67380dcd598363512f47e6a8fa66bfe288232d89c5536d9ff2. machine # [ 52.292287] dhcpcd[675]: veth609d6927: new hardware address: da:83:85:53:d1:82 machine # [ 52.292722] dhcpcd[675]: veth609d6927: carrier acquired machine # [ 52.301307] dhcpcd[675]: veth609d6927: IAID 85:53:d1:82 machine # [ 52.301735] dhcpcd[675]: veth609d6927: adding address fe80::d883:85ff:fe53:d182 machine # [ 52.302434] dhcpcd[675]: vethc5da90ce: old hardware address: d6:85:76:af:8a:fb machine # [ 52.303057] dhcpcd[675]: vethc5da90ce: new hardware address: 42:ae:02:05:8a:d0 machine # [ 52.303743] dhcpcd[675]: vethc5da90ce: carrier lost machine # [ 52.343360] dhcpcd[675]: vethc5da90ce: deleting address fe80::d485:76ff:feaf:8afb machine # [ 52.343630] dhcpcd[675]: veth609d6927: soliciting a DHCP lease machine # [ 52.348342] dhcpcd[675]: vethc5da90ce: old hardware address: 42:ae:02:05:8a:d0 machine # [ 52.348862] dhcpcd[675]: vethc5da90ce: new hardware address: d6:85:76:af:8a:fb machine # [ 52.349505] dhcpcd[675]: vethc5da90ce: carrier acquired machine # [ 52.360578] dhcpcd[675]: vethc5da90ce: IAID 76:af:8a:fb machine # [ 52.360727] dhcpcd[675]: vethc5da90ce: adding address fe80::d485:76ff:feaf:8afb machine # [ 52.361077] dhcpcd[675]: veth67d21afd: old hardware address: a2:e1:b7:1e:98:36 machine # [ 52.361331] dhcpcd[675]: veth67d21afd: new hardware address: 0a:bf:a0:2d:4f:92 machine # [ 52.361813] dhcpcd[675]: veth67d21afd: carrier lost machine # [ 52.365401] systemd[1]: Started libcontainer container 4e775fe05753187c396cfdf398b8cbf97d0ebd90fb79474c261ff7be0b67ef88. machine # [ 52.369108] systemd[1]: Started libcontainer container cd85e9a31abd5ffa1a83858c6c5ca0805aad63eab619a85f53f7b3c4367a9caf. machine # [ 52.413842] dhcpcd[675]: veth67d21afd: deleting address fe80::a0e1:b7ff:fe1e:9836 machine # [ 52.414090] dhcpcd[675]: veth46a5c2ab: soliciting a DHCP lease machine # [ 52.418409] dhcpcd[675]: veth67d21afd: old hardware address: 0a:bf:a0:2d:4f:92 machine # [ 52.418709] dhcpcd[675]: veth67d21afd: new hardware address: a2:e1:b7:1e:98:36 machine # [ 52.419268] dhcpcd[675]: veth67d21afd: carrier acquired machine # [ 52.427409] systemd[1]: Started libcontainer container 375fc5a0e360fe03b2872078b9934e3c039c383aa2116c96242fb988420810b4. machine # [ 52.430612] dhcpcd[675]: veth67d21afd: IAID b7:1e:98:36 machine # [ 52.431796] dhcpcd[675]: veth67d21afd: adding address fe80::a0e1:b7ff:fe1e:9836 machine # [ 52.433319] dhcpcd[675]: vethc5da90ce: soliciting a DHCP lease machine # [ 52.471703] k3s[892]: E0922 10:35:39.563476 892 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.1" machine # [ 52.477494] k3s[892]: E0922 10:35:39.563554 892 kuberuntime_image.go:43] "Failed to pull image" err="failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.1" machine # [ 52.482996] k3s[892]: E0922 10:35:39.563690 892 kuberuntime_manager.go:1674] "Unhandled Error" err="container nix-grpc-daemon start failed in pod nix-grpc-farm-scheduler-5844ddf54b-k2vbk_farm(2893bc93-b6de-49c4-aacf-683fcae29bfa): ErrImagePull: failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" logger="UnhandledError" machine # [ 52.492952] k3s[892]: E0922 10:35:39.563746 892 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nix-grpc-daemon\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-scheduler-5844ddf54b-k2vbk" podUID="2893bc93-b6de-49c4-aacf-683fcae29bfa" machine # [ 52.501681] k3s[892]: E0922 10:35:39.582531 892 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.1" machine # [ 52.509412] k3s[892]: E0922 10:35:39.582570 892 kuberuntime_image.go:43] "Failed to pull image" err="failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.1" machine # [ 52.509520] k3s[892]: E0922 10:35:39.582780 892 kuberuntime_manager.go:1674] "Unhandled Error" err="init container seed-store start failed in pod nix-grpc-farm-worker-x86-64-linux-7777686f4d-d5cw4_farm(a214dbf2-70e5-479b-9dfa-739c5a5cdeda): ErrImagePull: failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" logger="UnhandledError" machine # [ 52.510170] k3s[892]: E0922 10:35:39.582833 892 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-d5cw4" podUID="a214dbf2-70e5-479b-9dfa-739c5a5cdeda" machine # [ 52.553267] k3s[892]: E0922 10:35:39.645290 892 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.1" machine # [ 52.559263] k3s[892]: E0922 10:35:39.645343 892 kuberuntime_image.go:43] "Failed to pull image" err="failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.1" machine # [ 52.560028] k3s[892]: E0922 10:35:39.645542 892 kuberuntime_manager.go:1674] "Unhandled Error" err="init container seed-store start failed in pod nix-grpc-farm-worker-x86-64-linux-7777686f4d-t5tqs_farm(ed0a1fc8-5ad8-447a-adab-0669ada6b772): ErrImagePull: failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" logger="UnhandledError" machine # [ 52.560445] k3s[892]: E0922 10:35:39.645603 892 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-t5tqs" podUID="ed0a1fc8-5ad8-447a-adab-0669ada6b772" machine # [ 52.651643] dhcpcd[675]: veth67d21afd: soliciting a DHCP lease machine # [ 52.832681] k3s[892]: E0922 10:35:39.924566 892 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ImagePullBackOff: \"Back-off pulling image \\\"nix-grpc-farm:0.1.0-beta.1\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-t5tqs" podUID="ed0a1fc8-5ad8-447a-adab-0669ada6b772" machine # [ 52.843394] k3s[892]: E0922 10:35:39.935384 892 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nix-grpc-daemon\" with ImagePullBackOff: \"Back-off pulling image \\\"nix-grpc-farm:0.1.0-beta.1\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-scheduler-5844ddf54b-k2vbk" podUID="2893bc93-b6de-49c4-aacf-683fcae29bfa" machine # [ 52.854372] k3s[892]: E0922 10:35:39.945742 892 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ImagePullBackOff: \"Back-off pulling image \\\"nix-grpc-farm:0.1.0-beta.1\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-d5cw4" podUID="a214dbf2-70e5-479b-9dfa-739c5a5cdeda" machine # [ 52.881378] systemd[1]: cri-containerd-e66914b5ceae0d932eed688290c66c32b4e4388365926f88e33be319cf35cdb8.scope: Deactivated successfully. machine # [ 52.920312] systemd[1]: Started libcontainer container 3cbe43fe92d6b4fdfc4fa2d8883795fa3511f621271ba6f417b36bf9526beddd. machine # [ 53.263383] cni0: port 2(vethe95e9a99) entered disabled state machine # [ 53.118374] dhcpcd[675]: vethe95e9a99: carrier lost machine # [ 53.265744] vethe95e9a99 (unregistering): left allmulticast mode machine # [ 53.267092] vethe95e9a99 (unregistering): left promiscuous mode machine # [ 53.268128] cni0: port 2(vethe95e9a99) entered disabled state machine # [ 53.170966] dhcpcd[675]: vethe95e9a99: deleting address fe80::58c8:74ff:fe3e:fbb9 machine # [ 53.185558] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-e66914b5ceae0d932eed688290c66c32b4e4388365926f88e33be319cf35cdb8-rootfs.mount: Deactivated successfully. machine # [ 53.185783] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-e66914b5ceae0d932eed688290c66c32b4e4388365926f88e33be319cf35cdb8-shm.mount: Deactivated successfully. machine # [ 53.186176] systemd[1]: run-netns-cni\x2d614c2fff\x2d31ea\x2db379\x2d190a\x2d524dd6220463.mount: Deactivated successfully. machine # [ 53.242082] k3s[892]: I0922 10:35:40.333786 892 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/85841907-6b26-485b-9726-66c10388ddcb-kube-api-access-7vwl7\" (UniqueName: \"kubernetes.io/projected/85841907-6b26-485b-9726-66c10388ddcb-kube-api-access-7vwl7\") pod \"85841907-6b26-485b-9726-66c10388ddcb\" (UID: \"85841907-6b26-485b-9726-66c10388ddcb\") " machine # [ 53.242287] k3s[892]: I0922 10:35:40.333859 892 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/85841907-6b26-485b-9726-66c10388ddcb-tmp\" (UniqueName: \"kubernetes.io/empty-dir/85841907-6b26-485b-9726-66c10388ddcb-tmp\") pod \"85841907-6b26-485b-9726-66c10388ddcb\" (UID: \"85841907-6b26-485b-9726-66c10388ddcb\") " machine # [ 53.242932] k3s[892]: I0922 10:35:40.333898 892 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/85841907-6b26-485b-9726-66c10388ddcb-content\" (UniqueName: \"kubernetes.io/configmap/85841907-6b26-485b-9726-66c10388ddcb-content\") pod \"85841907-6b26-485b-9726-66c10388ddcb\" (UID: \"85841907-6b26-485b-9726-66c10388ddcb\") " machine # [ 53.244145] k3s[892]: I0922 10:35:40.333934 892 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/85841907-6b26-485b-9726-66c10388ddcb-klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/85841907-6b26-485b-9726-66c10388ddcb-klipper-helm\") pod \"85841907-6b26-485b-9726-66c10388ddcb\" (UID: \"85841907-6b26-485b-9726-66c10388ddcb\") " machine # [ 53.245382] k3s[892]: I0922 10:35:40.333962 892 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/85841907-6b26-485b-9726-66c10388ddcb-klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/85841907-6b26-485b-9726-66c10388ddcb-klipper-cache\") pod \"85841907-6b26-485b-9726-66c10388ddcb\" (UID: \"85841907-6b26-485b-9726-66c10388ddcb\") " machine # [ 53.245789] k3s[892]: I0922 10:35:40.333991 892 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/85841907-6b26-485b-9726-66c10388ddcb-klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/85841907-6b26-485b-9726-66c10388ddcb-klipper-config\") pod \"85841907-6b26-485b-9726-66c10388ddcb\" (UID: \"85841907-6b26-485b-9726-66c10388ddcb\") " machine # [ 53.247086] k3s[892]: I0922 10:35:40.334019 892 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/85841907-6b26-485b-9726-66c10388ddcb-values\" (UniqueName: \"kubernetes.io/projected/85841907-6b26-485b-9726-66c10388ddcb-values\") pod \"85841907-6b26-485b-9726-66c10388ddcb\" (UID: \"85841907-6b26-485b-9726-66c10388ddcb\") " machine # [ 53.247277] k3s[892]: I0922 10:35:40.338616 892 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85841907-6b26-485b-9726-66c10388ddcb-content" pod "85841907-6b26-485b-9726-66c10388ddcb" (UID: "85841907-6b26-485b-9726-66c10388ddcb"). InnerVolumeSpecName "content". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 53.250816] dhcpcd[675]: vethe95e9a99: removing interface machine # [ 53.254616] systemd[1]: var-lib-kubelet-pods-85841907\x2d6b26\x2d485b\x2d9726\x2d66c10388ddcb-volumes-kubernetes.io\x7eprojected-values.mount: Deactivated successfully. machine # [ 53.259926] systemd[1]: var-lib-kubelet-pods-85841907\x2d6b26\x2d485b\x2d9726\x2d66c10388ddcb-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2d7vwl7.mount: Deactivated successfully. machine # [ 53.263358] systemd[1]: var-lib-kubelet-pods-85841907\x2d6b26\x2d485b\x2d9726\x2d66c10388ddcb-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dhelm.mount: Deactivated successfully. machine # [ 53.264618] systemd[1]: var-lib-kubelet-pods-85841907\x2d6b26\x2d485b\x2d9726\x2d66c10388ddcb-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dcache.mount: Deactivated successfully. machine # [ 53.265363] systemd[1]: var-lib-kubelet-pods-85841907\x2d6b26\x2d485b\x2d9726\x2d66c10388ddcb-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dconfig.mount: Deactivated successfully. machine # [ 53.308559] k3s[892]: I0922 10:35:40.400504 892 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85841907-6b26-485b-9726-66c10388ddcb-values" pod "85841907-6b26-485b-9726-66c10388ddcb" (UID: "85841907-6b26-485b-9726-66c10388ddcb"). InnerVolumeSpecName "values". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 53.308803] k3s[892]: I0922 10:35:40.400865 892 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85841907-6b26-485b-9726-66c10388ddcb-kube-api-access-7vwl7" pod "85841907-6b26-485b-9726-66c10388ddcb" (UID: "85841907-6b26-485b-9726-66c10388ddcb"). InnerVolumeSpecName "kube-api-access-7vwl7". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 53.309808] k3s[892]: I0922 10:35:40.401318 892 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85841907-6b26-485b-9726-66c10388ddcb-klipper-config" pod "85841907-6b26-485b-9726-66c10388ddcb" (UID: "85841907-6b26-485b-9726-66c10388ddcb"). InnerVolumeSpecName "klipper-config". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 53.310458] k3s[892]: I0922 10:35:40.401394 892 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85841907-6b26-485b-9726-66c10388ddcb-tmp" pod "85841907-6b26-485b-9726-66c10388ddcb" (UID: "85841907-6b26-485b-9726-66c10388ddcb"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 53.311051] k3s[892]: I0922 10:35:40.401330 892 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85841907-6b26-485b-9726-66c10388ddcb-klipper-helm" pod "85841907-6b26-485b-9726-66c10388ddcb" (UID: "85841907-6b26-485b-9726-66c10388ddcb"). InnerVolumeSpecName "klipper-helm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 53.311882] k3s[892]: I0922 10:35:40.402380 892 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85841907-6b26-485b-9726-66c10388ddcb-klipper-cache" pod "85841907-6b26-485b-9726-66c10388ddcb" (UID: "85841907-6b26-485b-9726-66c10388ddcb"). InnerVolumeSpecName "klipper-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 53.343149] k3s[892]: I0922 10:35:40.435188 892 reconciler_common.go:299] "Volume detached for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/85841907-6b26-485b-9726-66c10388ddcb-klipper-cache\") on node \"machine\" DevicePath \"\"" machine # [ 53.343574] k3s[892]: I0922 10:35:40.435223 892 reconciler_common.go:299] "Volume detached for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/85841907-6b26-485b-9726-66c10388ddcb-klipper-config\") on node \"machine\" DevicePath \"\"" machine # [ 53.344427] k3s[892]: I0922 10:35:40.435244 892 reconciler_common.go:299] "Volume detached for volume \"values\" (UniqueName: \"kubernetes.io/projected/85841907-6b26-485b-9726-66c10388ddcb-values\") on node \"machine\" DevicePath \"\"" machine # [ 53.345041] k3s[892]: I0922 10:35:40.435396 892 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vwl7\" (UniqueName: \"kubernetes.io/projected/85841907-6b26-485b-9726-66c10388ddcb-kube-api-access-7vwl7\") on node \"machine\" DevicePath \"\"" machine # [ 53.345675] k3s[892]: I0922 10:35:40.435410 892 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/85841907-6b26-485b-9726-66c10388ddcb-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 53.346514] k3s[892]: I0922 10:35:40.435422 892 reconciler_common.go:299] "Volume detached for volume \"content\" (UniqueName: \"kubernetes.io/configmap/85841907-6b26-485b-9726-66c10388ddcb-content\") on node \"machine\" DevicePath \"\"" machine # [ 53.347205] k3s[892]: I0922 10:35:40.435435 892 reconciler_common.go:299] "Volume detached for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/85841907-6b26-485b-9726-66c10388ddcb-klipper-helm\") on node \"machine\" DevicePath \"\"" machine # [ 53.864791] k3s[892]: I0922 10:35:40.956519 892 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e66914b5ceae0d932eed688290c66c32b4e4388365926f88e33be319cf35cdb8" machine # [ 53.872828] systemd[1]: Removed slice libcontainer container kubepods-burstable-pod85841907_6b26_485b_9726_66c10388ddcb.slice. machine # [ 53.873365] systemd[1]: kubepods-burstable-pod85841907_6b26_485b_9726_66c10388ddcb.slice: Consumed 598ms CPU time over 6.142s wall clock time, 32.3M memory peak, 2.4M incoming IP traffic, 142K outgoing IP traffic. machine # [ 53.875445] k3s[892]: I0922 10:35:40.967084 892 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-68c8f49bd6-wt8rf" podStartSLOduration=2.9670680149999997 podStartE2EDuration="2.967068015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-22 10:35:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-22 10:35:40.967031977 +0000 UTC m=+33.370829251" watchObservedRunningTime="2026-09-22 10:35:40.967068015 +0000 UTC m=+33.370864730" machine # [ 54.149439] dhcpcd[675]: veth67d21afd: soliciting an IPv6 router machine # [ 54.163527] dhcpcd[675]: flannel.1: probing for an IPv4LL address machine # [ 54.175211] systemd[1]: var-lib-kubelet-pods-85841907\x2d6b26\x2d485b\x2d9726\x2d66c10388ddcb-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 54.283845] dhcpcd[675]: veth609d6927: soliciting an IPv6 router machine # [ 54.489885] dhcpcd[675]: veth46a5c2ab: soliciting an IPv6 router machine # [ 54.674179] dhcpcd[675]: vethc5da90ce: soliciting an IPv6 router machine # [ 55.050384] dhcpcd[675]: vethe790ce61: probing for an IPv4LL address machine # [ 55.183459] k3s[892]: time="2026-09-22T10:35:42Z" level=info msg="Imported docker.io/library/nix-grpc-farm:0.1.0-beta.1" machine # [ 55.189671] k3s[892]: time="2026-09-22T10:35:42Z" level=info msg="Tagged docker.io/library/nix-grpc-farm@sha256:0695b7c1852626d8d2cb4f4ffa88a8f788ce46df1c2cab03a052ad2cf3042d89" machine # [ 55.430110] k3s[892]: time="2026-09-22T10:35:42Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm.tar in 9.059530749s" machine # [ 57.344806] dhcpcd[675]: veth609d6927: probing for an IPv4LL address machine # [ 57.414740] dhcpcd[675]: veth46a5c2ab: probing for an IPv4LL address machine # [ 57.432306] dhcpcd[675]: vethc5da90ce: probing for an IPv4LL address machine # [ 57.652974] dhcpcd[675]: veth67d21afd: probing for an IPv4LL address machine # [ 58.392539] dhcpcd[675]: flannel.1: using IPv4LL address 169.254.177.196 machine # [ 58.392811] dhcpcd[675]: flannel.1: adding route to 169.254.0.0/16 machine # [ 59.376133] dhcpcd[675]: vethe790ce61: using IPv4LL address 169.254.161.36 machine # [ 59.376633] dhcpcd[675]: vethe790ce61: adding route to 169.254.0.0/16 machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 29.62 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s machine # [ 62.283586] dhcpcd[675]: flannel.1: no IPv6 Routers available machine # [ 62.437951] dhcpcd[675]: veth46a5c2ab: using IPv4LL address 169.254.241.12 machine # [ 62.438249] dhcpcd[675]: veth46a5c2ab: adding route to 169.254.0.0/16 machine # [ 62.599622] dhcpcd[675]: vethc5da90ce: using IPv4LL address 169.254.52.106 machine # [ 62.600250] dhcpcd[675]: vethc5da90ce: adding route to 169.254.0.0/16 machine # [ 62.802750] dhcpcd[675]: veth609d6927: using IPv4LL address 169.254.192.29 machine # [ 62.803403] dhcpcd[675]: veth609d6927: adding route to 169.254.0.0/16 machine # [ 62.863979] dhcpcd[675]: vethe790ce61: no IPv6 Routers available machine # [ 63.247801] dhcpcd[675]: veth67d21afd: using IPv4LL address 169.254.118.117 machine # [ 63.248348] dhcpcd[675]: veth67d21afd: adding route to 169.254.0.0/16 machine # [ 64.798200] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount4279105779.mount: Deactivated successfully. machine # [ 65.572997] dhcpcd[675]: segfault at 5af6e9448 ip 00005af6c973ecb3 sp 00007ffdcaac4788 error 4 in dhcpcd[38cb3,5af6c970f000+40000] likely on CPU 3 (core 3, socket 0) machine # [ 65.578635] Code: 45 ae 01 e9 0f fe ff ff 0f 1f 80 00 00 00 00 c6 45 af 01 e9 ff fd ff ff e8 fa 05 fd ff 66 2e 0f 1f 84 00 00 00 00 00 48 8b 07 <48> 8b 80 50 03 00 00 48 85 c0 74 31 90 48 8b 00 48 85 c0 74 1e 48 machine # [ 65.455658] systemd-coredump[2874]: Process 675 (dhcpcd) of user 999 terminated abnormally with signal 11/SEGV, processing... machine # [ 65.462741] systemd[1]: Created slice Slice /system/systemd-coredump. machine # [ 65.466272] systemd[1]: Started Process Core Dump (PID 2874/UID 0). machine # [ 65.694262] systemd-coredump[2875]: Process 675 (dhcpcd) of user 999 dumped core. machine # machine # Module udev.so without build-id. machine # Module dhcpcd without build-id. machine # Stack trace of thread 675: machine # #0 0x00005af6c973ecb3 ipv6nd_expire (dhcpcd + 0x38cb3) machine # #1 0x00005af6c971806a eloop_start (dhcpcd + 0x1206a) machine # #2 0x00005af6c9710300 main (dhcpcd + 0xa300) machine # #3 0x000075cfbe841285 __libc_start_call_main (libc.so.6 + 0x2b285) machine # #4 0x000075cfbe841338 __libc_start_main@@GLIBC_2.34 (libc.so.6 + 0x2b338) machine # #5 0x00005af6c9711365 _start (dhcpcd + 0xb365) machine # ELF object binary architecture: AMD x86-64 machine # machine # [ 65.701808] systemd[1]: systemd-coredump@0-1-2874_2875-0.service: Deactivated successfully. machine # [ 65.761784] systemd[1]: dhcpcd.service: Main process exited, code=dumped, status=11/SEGV machine # [ 65.766555] systemd[1]: dhcpcd.service: Failed with result 'core-dump'. machine # [ 65.769369] systemd[1]: dhcpcd.service: Consumed 585ms CPU time over 56.827s wall clock time, 6.2M memory peak, 8K written to disk, 96B incoming IP traffic, 1.2K outgoing IP traffic. machine # [ 65.938884] systemd[1]: dhcpcd.service: Scheduled restart job, restart counter is at 1. machine # [ 65.944126] systemd[1]: Starting DHCP Client... machine # [ 66.111489] dhcpcd[2887]: dhcpcd-10.3.2 starting machine # [ 66.121135] dhcpcd[2891]: dev: loaded udev machine # [ 66.121366] dhcpcd[2891]: DUID 00:01:00:01:32:45:16:50:52:54:00:12:34:56 machine # [ 66.280212] dhcpcd[2891]: eth0: IAID 00:12:34:56 machine # [ 66.281249] dhcpcd[2891]: flannel.1: IAID 9d:9c:06:52 machine # [ 66.282097] dhcpcd[2891]: vethe790ce61: IAID 3d:10:03:e1 machine # [ 66.283081] dhcpcd[2891]: veth46a5c2ab: IAID 26:07:d7:a4 machine # [ 66.284109] dhcpcd[2891]: veth609d6927: IAID 85:53:d1:82 machine # [ 66.284988] dhcpcd[2891]: vethc5da90ce: IAID 76:af:8a:fb machine # [ 66.285952] dhcpcd[2891]: veth67d21afd: IAID b7:1e:98:36 machine # [ 66.403821] dhcpcd[2891]: eth0: soliciting an IPv6 router machine # [ 66.407443] dhcpcd[2891]: eth0: Router Advertisement from fe80::2 machine # [ 66.410567] dhcpcd[2891]: eth0: adding address fec0::5054:ff:fe12:3456/64 machine # [ 66.471147] dhcpcd[2891]: veth46a5c2ab: soliciting an IPv6 router machine # [ 66.570846] dhcpcd[2891]: vethe790ce61: soliciting an IPv6 router machine # [ 66.574891] dhcpcd[2891]: vethc5da90ce: soliciting an IPv6 router machine # [ 66.749481] dhcpcd[2891]: flannel.1: soliciting an IPv6 router machine # [ 66.790700] dhcpcd[2891]: veth67d21afd: soliciting an IPv6 router machine # [ 66.833550] dhcpcd[2891]: veth609d6927: soliciting a DHCP lease machine # [ 66.857571] dhcpcd[2891]: veth609d6927: soliciting an IPv6 router machine # [ 66.872560] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped1733028251.mount: Deactivated successfully. machine # [ 66.876929] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount1995246565.mount: Deactivated successfully. machine # [ 66.978644] systemd[1]: Started libcontainer container 94f9da5c4f310db4f4e2ace07baacdfcb9ff0b4287a848e27c4e3602ce1a4259. machine # [ 67.085818] systemd[1]: Started libcontainer container c743f73325645886d125eb24182c278d8983d518e18ed5655074e51ddeb8476e. machine # [ 67.388215] dhcpcd[2891]: veth46a5c2ab: soliciting a DHCP lease machine # [ 67.446696] dhcpcd[2891]: vethc5da90ce: soliciting a DHCP lease machine # [ 67.466485] dhcpcd[2891]: veth67d21afd: soliciting a DHCP lease machine # [ 67.735821] dhcpcd[2891]: vethe790ce61: soliciting a DHCP lease machine # [ 67.824544] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped1955691258.mount: Deactivated successfully. machine # [ 67.851290] systemd[1]: cri-containerd-94f9da5c4f310db4f4e2ace07baacdfcb9ff0b4287a848e27c4e3602ce1a4259.scope: Deactivated successfully. machine # [ 67.852113] systemd[1]: cri-containerd-94f9da5c4f310db4f4e2ace07baacdfcb9ff0b4287a848e27c4e3602ce1a4259.scope: Consumed 561ms CPU time over 872ms wall clock time, 295.2M memory peak, 30.9M read from disk, 247.7M written to disk. machine # [ 67.854469] systemd[1]: cri-containerd-c743f73325645886d125eb24182c278d8983d518e18ed5655074e51ddeb8476e.scope: Deactivated successfully. machine # [ 67.855406] systemd[1]: cri-containerd-c743f73325645886d125eb24182c278d8983d518e18ed5655074e51ddeb8476e.scope: Consumed 543ms CPU time over 769ms wall clock time, 320.7M memory peak, 44.5M read from disk, 247.7M written to disk. machine # [ 67.917145] dhcpcd[2891]: eth0: rebinding lease of 10.0.2.15 machine # [ 67.917806] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-c743f73325645886d125eb24182c278d8983d518e18ed5655074e51ddeb8476e-rootfs.mount: Deactivated successfully. machine # [ 67.923282] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-94f9da5c4f310db4f4e2ace07baacdfcb9ff0b4287a848e27c4e3602ce1a4259-rootfs.mount: Deactivated successfully. machine # [ 67.931394] dhcpcd[2891]: flannel.1: soliciting a DHCP lease machine # [ 67.938395] dhcpcd[2891]: eth0: leased 10.0.2.15 for 86400 seconds machine # [ 68.005372] systemd[1]: Started DHCP Client. machine # [ 68.823815] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount2182067809.mount: Deactivated successfully. machine # [ 68.880812] systemd[1]: Started libcontainer container 81d726ec5012fae1d7d86f43867a370edece1e384d9bcd61bb49802bf5649928. machine # [ 69.048608] niks3-server[1198]: 2026/09/22 10:35:56 INFO lead: acquired remote=10.42.0.6:46036 machine # [ 69.089575] systemd[1]: Started libcontainer container 97459de852b9b93c509a141973b9a0dbe76ae8c36df900ce579f42ea004f74f7. machine # [ 69.122286] systemd[1]: Started libcontainer container 2189cbf9987a8f3fef3c08f84f01342eab766d725842c3dd73eab58ce2c4ac87. machine # [ 69.269342] systemd[1]: Started libcontainer container 6c7f594b8c495743f36a015a6b86b6e73bc58e6bf67021788b80ac5c525757fa. machine # [ 69.345428] systemd[1]: Started libcontainer container 48b6e991b90e3b5279672d3d13be4ef843b3bdf88fa0d271f64184c0dd736560. machine # [ 69.506114] systemd[1]: Started libcontainer container 77f2500ec2c9c10a9618cd08323a88185df49f51dd1e37902331b39175684d6b. machine # [ 69.584374] systemd[1]: Started libcontainer container 52be6db07d7b9ec065997af79280ed6a54f9a2206eced431f8a422c6a7974c07. machine # [ 69.850541] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped3473599844.mount: Deactivated successfully. machine # [ 69.994456] k3s[892]: I0922 10:35:57.085725 892 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-d5cw4" podStartSLOduration=5.099425899 podStartE2EDuration="19.085678619s" totalImagesPullingTime="13.288429114s" totalInitContainerRuntime="697.823606ms" isStatefulPod=false podCreationTimestamp="2026-09-22 10:35:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-22 10:35:57.068034198 +0000 UTC m=+49.471835662" watchObservedRunningTime="2026-09-22 10:35:57.085678619 +0000 UTC m=+49.489479804" machine # [ 70.021329] k3s[892]: I0922 10:35:57.085931 892 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-scheduler-5844ddf54b-k2vbk" podStartSLOduration=2.7806842720000002 podStartE2EDuration="19.085908537s" totalImagesPullingTime="16.305224265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-22 10:35:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-22 10:35:57.084016117 +0000 UTC m=+49.487817861" watchObservedRunningTime="2026-09-22 10:35:57.085908537 +0000 UTC m=+49.489710001" machine # [ 70.021812] k3s[892]: I0922 10:35:57.108922 892 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-t5tqs" podStartSLOduration=6.054165956 podStartE2EDuration="19.108830165s" totalImagesPullingTime="12.212355201s" totalInitContainerRuntime="842.309008ms" isStatefulPod=false podCreationTimestamp="2026-09-22 10:35:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-22 10:35:57.107490609 +0000 UTC m=+49.511290677" watchObservedRunningTime="2026-09-22 10:35:57.108830165 +0000 UTC m=+49.512685547" machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s, in 10.09 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s, in 3.01 seconds) machine: waiting for unit niks3.service machine: (finished: waiting for unit niks3.service, in 0.10 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.56 seconds) machine: waiting for success: test $(curl -sf 10.42.0.4:9901/clusters | grep -c 'health_flags::healthy') -ge 3 machine # [ 76.466888] dhcpcd[2891]: veth609d6927: using IPv4LL address 169.254.192.29 machine # [ 76.467629] dhcpcd[2891]: flannel.1: adding route to 169.254.0.0/16 machine # [ 76.469620] dhcpcd[2891]: vethe790ce61: adding route to 169.254.0.0/16 machine # [ 76.471690] dhcpcd[2891]: veth46a5c2ab: adding route to 169.254.0.0/16 machine # [ 76.474654] dhcpcd[2891]: veth609d6927: adding route to 169.254.0.0/16 machine # [ 76.476154] dhcpcd[2891]: vethc5da90ce: adding route to 169.254.0.0/16 machine # [ 76.477304] dhcpcd[2891]: veth67d21afd: adding route to 169.254.0.0/16 machine # [ 77.227701] dhcpcd[2891]: vethe790ce61: using IPv4LL address 169.254.161.36 machine # [ 77.400288] dhcpcd[2891]: vethc5da90ce: using IPv4LL address 169.254.52.106 machine # [ 77.635142] dhcpcd[2891]: flannel.1: using IPv4LL address 169.254.177.196 machine # [ 77.795425] dhcpcd[2891]: veth46a5c2ab: using IPv4LL address 169.254.241.12 machine # [ 78.161304] dhcpcd[2891]: veth67d21afd: using IPv4LL address 169.254.118.117 machine: (finished: waiting for success: test $(curl -sf 10.42.0.4:9901/clusters | grep -c 'health_flags::healthy') -ge 3, in 4.48 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.26 seconds) machine: waiting for success: curl -sf http://10.42.0.6:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2' machine # [ 78.473771] dhcpcd[2891]: veth46a5c2ab: no IPv6 Routers available machine # [ 78.573349] dhcpcd[2891]: vethe790ce61: no IPv6 Routers available machine # [ 78.577462] dhcpcd[2891]: vethc5da90ce: no IPv6 Routers available machine # [ 78.752519] dhcpcd[2891]: flannel.1: no IPv6 Routers available machine # [ 78.793352] dhcpcd[2891]: veth67d21afd: no IPv6 Routers available machine # [ 78.859892] dhcpcd[2891]: veth609d6927: no IPv6 Routers available machine: (finished: waiting for success: curl -sf http://10.42.0.6:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2', in 3.30 seconds) (finished: subtest: chart deploys and workers become Ready, in 51.43 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}', in 0.23 seconds) machine: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt machine: (finished: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt, in 0.25 seconds) subtest: build through the balancer lands in the cache machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag t1 2>&1 machine # [ 111.638339] niks3-server[1198]: 2026/09/22 10:36:38 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 111.668625] niks3-server[1198]: 2026/09/22 10:36:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign machine # [ 111.672591] niks3-server[1198]: 2026/09/22 10:36:38 INFO Registered completed upload object_key=nar/0nzzbas7l8d37mridr7mg162smfjvn7lhs6am4crl4ydaxicigj8.nar.zst machine # [ 111.678425] niks3-server[1198]: 2026/09/22 10:36:38 INFO Signed narinfos id=1 count=1 machine # [ 111.679698] niks3-server[1198]: 2026/09/22 10:36:38 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.ls machine # [ 111.684752] niks3-server[1198]: 2026/09/22 10:36:38 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete machine # [ 111.689666] niks3-server[1198]: 2026/09/22 10:36:38 INFO Completed upload id=1 machine # [ 111.692072] niks3-server[1198]: 2026/09/22 10:36:38 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.narinfo machine # [ 120.372301] niks3-server[1198]: 2026/09/22 10:36:47 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 120.391561] niks3-server[1198]: 2026/09/22 10:36:47 INFO Registered completed upload object_key=log/yz1sqzb72i8v6h2ass0v76ba8cncqj9r-k3s-a.drv machine # [ 120.397349] niks3-server[1198]: 2026/09/22 10:36:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign machine # [ 120.399791] niks3-server[1198]: 2026/09/22 10:36:47 INFO Signed narinfos id=2 count=1 machine # [ 120.400616] niks3-server[1198]: 2026/09/22 10:36:47 INFO Registered completed upload object_key=nar/1p7jh5nyz9n68k5f18ymmdpgr34mpnnch1njw7ki7b2b97qlfbjk.nar.zst machine # [ 120.404789] niks3-server[1198]: 2026/09/22 10:36:47 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.ls machine # [ 120.410453] niks3-server[1198]: 2026/09/22 10:36:47 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete machine # [ 120.415381] niks3-server[1198]: 2026/09/22 10:36:47 INFO Completed upload id=2 machine # [ 120.417080] niks3-server[1198]: 2026/09/22 10:36:47 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.narinfo machine # [ 120.515130] niks3-server[1198]: 2026/09/22 10:36:47 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 120.528899] niks3-server[1198]: 2026/09/22 10:36:47 INFO Registered completed upload object_key=nar/03a4ywhyr5knmbc93z4gyml5y8fvgb431xvlmfxrwsm8mrb0qgx2.nar.zst machine # [ 120.531741] niks3-server[1198]: 2026/09/22 10:36:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign machine # [ 120.533804] niks3-server[1198]: 2026/09/22 10:36:47 INFO Signed narinfos id=3 count=1 machine # [ 120.535682] niks3-server[1198]: 2026/09/22 10:36:47 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.ls machine # [ 120.540528] niks3-server[1198]: 2026/09/22 10:36:47 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete machine # [ 120.543421] niks3-server[1198]: 2026/09/22 10:36:47 INFO Completed upload id=3 machine # [ 120.544722] niks3-server[1198]: 2026/09/22 10:36:47 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.narinfo machine # [ 129.618558] niks3-server[1198]: 2026/09/22 10:36:56 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 129.639147] niks3-server[1198]: 2026/09/22 10:36:56 INFO Registered completed upload object_key=nar/05qjsj5ff3a6vnxkhb6k5f3m446dcc206p7cd37w4v3mgi95d7kh.nar.zst machine # [ 129.643497] niks3-server[1198]: 2026/09/22 10:36:56 INFO Registered completed upload object_key=log/zfq1xw9bmycqh35l0s44lmv65z4xc7br-k3s-b.drv machine # [ 129.644814] niks3-server[1198]: 2026/09/22 10:36:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign machine # [ 129.646553] niks3-server[1198]: 2026/09/22 10:36:56 INFO Signed narinfos id=4 count=1 machine # [ 129.651391] niks3-server[1198]: 2026/09/22 10:36:56 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.ls machine # [ 129.656742] niks3-server[1198]: 2026/09/22 10:36:56 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete machine # [ 129.659415] niks3-server[1198]: 2026/09/22 10:36:56 INFO Completed upload id=4 machine # [ 129.663105] niks3-server[1198]: 2026/09/22 10:36:56 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.narinfo machine # [ 129.760172] niks3-server[1198]: 2026/09/22 10:36:56 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 129.772626] niks3-server[1198]: 2026/09/22 10:36:56 INFO Registered completed upload object_key=nar/0jyw88klkf3nwxpnj5m5lx3i1dv2idf3hcn6im7883hnldm3gvyq.nar.zst machine # [ 129.774639] niks3-server[1198]: 2026/09/22 10:36:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign machine # [ 129.776415] niks3-server[1198]: 2026/09/22 10:36:56 INFO Signed narinfos id=5 count=1 machine # [ 129.778400] niks3-server[1198]: 2026/09/22 10:36:56 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.ls machine # [ 129.782276] niks3-server[1198]: 2026/09/22 10:36:56 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete machine # [ 129.784858] niks3-server[1198]: 2026/09/22 10:36:56 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.narinfo machine # [ 129.785936] niks3-server[1198]: 2026/09/22 10:36:56 INFO Completed upload id=5 machine # [ 138.241800] niks3-server[1198]: 2026/09/22 10:37:05 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 138.257731] niks3-server[1198]: 2026/09/22 10:37:05 INFO Registered completed upload object_key=nar/1q8vp5xqws560mpf8rxk8r8jhqrzibivh13x4wxy0cfqlzbk7cr5.nar.zst machine # [ 138.265550] niks3-server[1198]: 2026/09/22 10:37:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign machine # [ 138.266619] niks3-server[1198]: 2026/09/22 10:37:05 INFO Signed narinfos id=6 count=1 machine # [ 138.267961] niks3-server[1198]: 2026/09/22 10:37:05 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.ls machine # [ 138.272653] niks3-server[1198]: 2026/09/22 10:37:05 INFO Registered completed upload object_key=log/n40czam6a4ldp1mh5fdmlcy07fv0akbm-k3s-top.drv machine # [ 138.277738] niks3-server[1198]: 2026/09/22 10:37:05 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete machine # [ 138.281374] niks3-server[1198]: 2026/09/22 10:37:05 INFO Completed upload id=6 machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag t1 2>&1, in 57.12 seconds) machine: must succeed: nix eval --raw -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag t1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag t1 outPath, in 0.26 seconds) machine: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine: (finished: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.02 seconds) machine: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine # copying 3 paths... machine # copying path '/nix/store/r95r891injj9ski5c4w89yxjvjy065mx-k3s-a' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/mrqsh0475wxsmnsvkk55g94v6g5nrcra-k3s-b' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top' from 'http://192.168.1.1:5751'... machine: (finished: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.33 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag t2 2>&1 machine # [ 140.373527] niks3-server[1198]: 2026/09/22 10:37:07 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 140.393461] niks3-server[1198]: 2026/09/22 10:37:07 INFO Registered completed upload object_key=nar/1fr26arhri17j9bj6hyjzmmd74v730biz1gb3kqd194vjx3ccvp9.nar.zst machine # [ 140.398374] niks3-server[1198]: 2026/09/22 10:37:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign machine # [ 140.401330] niks3-server[1198]: 2026/09/22 10:37:07 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.ls machine # [ 140.405892] niks3-server[1198]: 2026/09/22 10:37:07 INFO Signed narinfos id=7 count=1 machine # [ 140.417384] niks3-server[1198]: 2026/09/22 10:37:07 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete machine # [ 140.419120] niks3-server[1198]: 2026/09/22 10:37:07 INFO Completed upload id=7 machine # [ 140.426196] niks3-server[1198]: 2026/09/22 10:37:07 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.narinfo machine # [ 148.909177] niks3-server[1198]: 2026/09/22 10:37:16 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 148.925990] niks3-server[1198]: 2026/09/22 10:37:16 INFO Registered completed upload object_key=nar/1hfc6x4x25k3b0fk091d3nb0k3mympfp05fkslcx19synp3ig0zd.nar.zst machine # [ 148.930111] niks3-server[1198]: 2026/09/22 10:37:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign machine # [ 148.932464] niks3-server[1198]: 2026/09/22 10:37:16 INFO Signed narinfos id=8 count=1 machine # [ 148.935222] niks3-server[1198]: 2026/09/22 10:37:16 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.ls machine # [ 148.937567] niks3-server[1198]: 2026/09/22 10:37:16 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete machine # [ 148.940158] niks3-server[1198]: 2026/09/22 10:37:16 INFO Completed upload id=8 machine # [ 149.026211] niks3-server[1198]: 2026/09/22 10:37:16 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 149.040134] niks3-server[1198]: 2026/09/22 10:37:16 INFO Registered completed upload object_key=nar/0zzq2vgjln4shvh57091n14sam6wh6w06vja6lzb9ppcj4ffyx1n.nar.zst machine # [ 149.045435] niks3-server[1198]: 2026/09/22 10:37:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign machine # [ 149.049432] niks3-server[1198]: 2026/09/22 10:37:16 INFO Signed narinfos id=9 count=1 machine # [ 149.051744] niks3-server[1198]: 2026/09/22 10:37:16 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.ls machine # [ 149.054722] niks3-server[1198]: 2026/09/22 10:37:16 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete machine # [ 149.057842] niks3-server[1198]: 2026/09/22 10:37:16 INFO Completed upload id=9 machine # [ 149.059826] niks3-server[1198]: 2026/09/22 10:37:16 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.narinfo machine # [ 157.710448] niks3-server[1198]: 2026/09/22 10:37:24 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 157.728305] niks3-server[1198]: 2026/09/22 10:37:24 INFO Registered completed upload object_key=log/894h6wzw2l4w5f0hikj1k6q57jfnyi87-k3s-b.drv machine # [ 157.735810] niks3-server[1198]: 2026/09/22 10:37:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign machine # [ 157.736028] niks3-server[1198]: 2026/09/22 10:37:24 INFO Registered completed upload object_key=nar/0hh3nqk95r6g32lhdmxw8cxjv694vbpx9876zkhcpg4r4qxni2ch.nar.zst machine # [ 157.737519] niks3-server[1198]: 2026/09/22 10:37:24 INFO Signed narinfos id=10 count=1 machine # [ 157.741025] niks3-server[1198]: 2026/09/22 10:37:24 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.ls machine # [ 157.746522] niks3-server[1198]: 2026/09/22 10:37:24 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete machine # [ 157.749132] niks3-server[1198]: 2026/09/22 10:37:24 INFO Completed upload id=10 machine # [ 157.751429] niks3-server[1198]: 2026/09/22 10:37:24 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.narinfo machine # [ 157.844928] niks3-server[1198]: 2026/09/22 10:37:24 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 157.861776] niks3-server[1198]: 2026/09/22 10:37:24 INFO Registered completed upload object_key=nar/0ingamx56k31lwiyxmnxmscjj4n3qfx6sr2kpaynsrwhwz1278iw.nar.zst machine # [ 157.862918] niks3-server[1198]: 2026/09/22 10:37:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign machine # [ 157.864411] niks3-server[1198]: 2026/09/22 10:37:24 INFO Signed narinfos id=11 count=1 machine # [ 157.866596] niks3-server[1198]: 2026/09/22 10:37:24 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.ls machine # [ 157.872461] niks3-server[1198]: 2026/09/22 10:37:24 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete machine # [ 157.875195] niks3-server[1198]: 2026/09/22 10:37:24 INFO Completed upload id=11 machine # [ 157.876437] niks3-server[1198]: 2026/09/22 10:37:24 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.narinfo machine # [ 166.148429] niks3-server[1198]: 2026/09/22 10:37:33 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 166.165421] niks3-server[1198]: 2026/09/22 10:37:33 INFO Registered completed upload object_key=log/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g-k3s-top.drv machine # [ 166.169735] niks3-server[1198]: 2026/09/22 10:37:33 INFO Registered completed upload object_key=nar/0v48x4sp58bvfra08axgkz7yl1n9nc4nirskyv1hwann4i7q277i.nar.zst machine # [ 166.174236] niks3-server[1198]: 2026/09/22 10:37:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign machine # [ 166.177881] niks3-server[1198]: 2026/09/22 10:37:33 INFO Signed narinfos id=12 count=1 machine # [ 166.180699] niks3-server[1198]: 2026/09/22 10:37:33 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.ls machine # [ 166.184938] niks3-server[1198]: 2026/09/22 10:37:33 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete machine # [ 166.188804] niks3-server[1198]: 2026/09/22 10:37:33 INFO Completed upload id=12 machine # [ 166.191246] niks3-server[1198]: 2026/09/22 10:37:33 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag t2 2>&1, in 26.26 seconds) (finished: subtest: build through the balancer lands in the cache, in 83.98 seconds) subtest: a Job with the client image builds through the farm with its service account machine: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt machine: (finished: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt, in 0.23 seconds) machine: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --from-file=flake.nix=/nix/store/b7xpzyk27yxzb4n6qbkzaknbd7x4jfx9-flake.nix machine: (finished: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --from-file=flake.nix=/nix/store/b7xpzyk27yxzb4n6qbkzaknbd7x4jfx9-flake.nix, in 0.21 seconds) machine: must succeed: kubectl apply -f /nix/store/xmn7479wyv43i1vcg4rqv7yh3mwzvqd3-ci-job.json machine: (finished: must succeed: kubectl apply -f /nix/store/xmn7479wyv43i1vcg4rqv7yh3mwzvqd3-ci-job.json, in 0.22 seconds) machine: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed' machine # [ 167.052783] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod3690e808_4688_4521_b5da_364b867fe5b7.slice. machine # [ 167.172841] k3s[892]: I0922 10:37:34.264520 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/3690e808-4688-4521-b5da-364b867fe5b7-nix-grpc-farm\") pod \"ci-jzwcz\" (UID: \"3690e808-4688-4521-b5da-364b867fe5b7\") " pod="ci/ci-jzwcz" machine # [ 167.173109] k3s[892]: I0922 10:37:34.264620 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"job\" (UniqueName: \"kubernetes.io/configmap/3690e808-4688-4521-b5da-364b867fe5b7-job\") pod \"ci-jzwcz\" (UID: \"3690e808-4688-4521-b5da-364b867fe5b7\") " pod="ci/ci-jzwcz" machine # [ 167.173752] k3s[892]: I0922 10:37:34.264691 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx7q7\" (UniqueName: \"kubernetes.io/projected/3690e808-4688-4521-b5da-364b867fe5b7-kube-api-access-mx7q7\") pod \"ci-jzwcz\" (UID: \"3690e808-4688-4521-b5da-364b867fe5b7\") " pod="ci/ci-jzwcz" machine # [ 168.134153] cni0: port 2(vethe3c9ea65) entered blocking state machine # [ 168.135556] cni0: port 2(vethe3c9ea65) entered disabled state machine # [ 168.136611] vethe3c9ea65: entered allmulticast mode machine # [ 168.137597] vethe3c9ea65: entered promiscuous mode machine # [ 168.147644] cni0: port 2(vethe3c9ea65) entered blocking state machine # [ 168.148492] cni0: port 2(vethe3c9ea65) entered forwarding state machine # [ 168.085547] (udev-worker)[4590]: Network interface NamePolicy= disabled on kernel command line. machine # [ 168.111383] systemd[1]: Started libcontainer container e7fad058cc0a312f636749952bc4996c3f765a2c66fb29de95c0151cd8889f63. machine # [ 168.133596] dhcpcd[2891]: vethe3c9ea65: IAID 70:76:82:f4 machine # [ 168.134192] dhcpcd[2891]: vethe3c9ea65: adding address fe80::d04e:70ff:fe76:82f4 machine # [ 169.950639] dhcpcd[2891]: vethe3c9ea65: soliciting a DHCP lease machine # [ 169.994715] dhcpcd[2891]: vethe3c9ea65: soliciting an IPv6 router machine # [ 170.119523] systemd[1]: Started libcontainer container 8547a9bd265c036b8df26e49b14cc19b00428bf87a5eb4b35c7d885b21c510b9. machine # [ 170.352443] k3s[892]: I0922 10:37:37.443541 892 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ci/ci-jzwcz" podStartSLOduration=3.443501459 podStartE2EDuration="3.443501459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-22 10:37:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-22 10:37:37.443335237 +0000 UTC m=+149.847135305" watchObservedRunningTime="2026-09-22 10:37:37.443501459 +0000 UTC m=+149.847301247" machine # [ 171.530776] niks3-server[1198]: 2026/09/22 10:37:38 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 171.549491] niks3-server[1198]: 2026/09/22 10:37:38 INFO Registered completed upload object_key=nar/111g6dyibwcf2z7jhpn72rgja0qvjgpdiv9nc06g2dp7ih0a6kyq.nar.zst machine # [ 171.553285] niks3-server[1198]: 2026/09/22 10:37:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign machine # [ 171.555553] niks3-server[1198]: 2026/09/22 10:37:38 INFO Signed narinfos id=13 count=1 machine # [ 171.558527] niks3-server[1198]: 2026/09/22 10:37:38 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.ls machine # [ 171.566853] niks3-server[1198]: 2026/09/22 10:37:38 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete machine # [ 171.569255] niks3-server[1198]: 2026/09/22 10:37:38 INFO Completed upload id=13 machine # [ 171.572481] niks3-server[1198]: 2026/09/22 10:37:38 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.narinfo machine # [ 174.952137] dhcpcd[2891]: vethe3c9ea65: probing for an IPv4LL address machine # [ 179.098326] dhcpcd[2891]: vethe3c9ea65: using IPv4LL address 169.254.99.202 machine # [ 179.102829] dhcpcd[2891]: vethe3c9ea65: adding route to 169.254.0.0/16 machine # [ 180.448668] niks3-server[1198]: 2026/09/22 10:37:47 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 180.471431] niks3-server[1198]: 2026/09/22 10:37:47 INFO Registered completed upload object_key=nar/058kjd2vfl1r27b4d9ixvwf77d8rkr18a4v894kwx8lg0nwpajnr.nar.zst machine # [ 180.474086] niks3-server[1198]: 2026/09/22 10:37:47 INFO Registered completed upload object_key=log/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # [ 180.476300] niks3-server[1198]: 2026/09/22 10:37:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign machine # [ 180.478150] niks3-server[1198]: 2026/09/22 10:37:47 INFO Signed narinfos id=14 count=1 machine # [ 180.481570] niks3-server[1198]: 2026/09/22 10:37:47 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.ls machine # [ 180.487069] niks3-server[1198]: 2026/09/22 10:37:47 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete machine # [ 180.489954] niks3-server[1198]: 2026/09/22 10:37:47 INFO Completed upload id=14 machine # [ 180.493145] niks3-server[1198]: 2026/09/22 10:37:47 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.narinfo machine # [ 180.594161] niks3-server[1198]: 2026/09/22 10:37:47 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 180.612319] niks3-server[1198]: 2026/09/22 10:37:47 INFO Registered completed upload object_key=nar/138ynhcd5wxzz485x9qcq7xsargaklrf2li31ai69m5r46am35q6.nar.zst machine # [ 180.615822] niks3-server[1198]: 2026/09/22 10:37:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign machine # [ 180.616402] niks3-server[1198]: 2026/09/22 10:37:47 INFO Signed narinfos id=15 count=1 machine # [ 180.620148] niks3-server[1198]: 2026/09/22 10:37:47 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.ls machine # [ 180.625318] niks3-server[1198]: 2026/09/22 10:37:47 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete machine # [ 180.627500] niks3-server[1198]: 2026/09/22 10:37:47 INFO Completed upload id=15 machine # [ 180.631066] niks3-server[1198]: 2026/09/22 10:37:47 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.narinfo machine # [ 181.997930] dhcpcd[2891]: vethe3c9ea65: no IPv6 Routers available machine # [ 189.290121] niks3-server[1198]: 2026/09/22 10:37:56 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 189.302261] niks3-server[1198]: 2026/09/22 10:37:56 INFO Registered completed upload object_key=log/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # [ 189.303947] niks3-server[1198]: 2026/09/22 10:37:56 INFO Registered completed upload object_key=nar/0n4lbdlp8w72fs3qbavl2lwrzbrn55i2b1vyglc89cc3pi8vbb1m.nar.zst machine # [ 189.305883] niks3-server[1198]: 2026/09/22 10:37:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign machine # [ 189.307595] niks3-server[1198]: 2026/09/22 10:37:56 INFO Signed narinfos id=16 count=1 machine # [ 189.308639] niks3-server[1198]: 2026/09/22 10:37:56 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.ls machine # [ 189.311742] niks3-server[1198]: 2026/09/22 10:37:56 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete machine # [ 189.313880] niks3-server[1198]: 2026/09/22 10:37:56 INFO Completed upload id=16 machine # [ 189.314851] niks3-server[1198]: 2026/09/22 10:37:56 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo machine # [ 189.398809] niks3-server[1198]: 2026/09/22 10:37:56 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 189.410554] niks3-server[1198]: 2026/09/22 10:37:56 INFO Registered completed upload object_key=nar/1f3gvnvqsm2pm3laixkxkg44kvjb251zqhszcfpp0a00h6x66ljs.nar.zst machine # [ 189.414493] niks3-server[1198]: 2026/09/22 10:37:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign machine # [ 189.416972] niks3-server[1198]: 2026/09/22 10:37:56 INFO Signed narinfos id=17 count=1 machine # [ 189.419324] niks3-server[1198]: 2026/09/22 10:37:56 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.ls machine # [ 189.422130] niks3-server[1198]: 2026/09/22 10:37:56 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete machine # [ 189.424381] niks3-server[1198]: 2026/09/22 10:37:56 INFO Completed upload id=17 machine # [ 189.428385] niks3-server[1198]: 2026/09/22 10:37:56 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.narinfo machine # [ 198.299889] niks3-server[1198]: 2026/09/22 10:38:05 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 198.317871] niks3-server[1198]: 2026/09/22 10:38:05 INFO Registered completed upload object_key=nar/1zwf0asrdv12q40fmqga5lx5330dvn9y4in4i9ficz9ij5lhvnf5.nar.zst machine # [ 198.320821] niks3-server[1198]: 2026/09/22 10:38:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign machine # [ 198.323297] niks3-server[1198]: 2026/09/22 10:38:05 INFO Signed narinfos id=18 count=1 machine # [ 198.324793] niks3-server[1198]: 2026/09/22 10:38:05 INFO Registered completed upload object_key=log/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # [ 198.327119] niks3-server[1198]: 2026/09/22 10:38:05 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.ls machine # [ 198.328671] niks3-server[1198]: 2026/09/22 10:38:05 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete machine # [ 198.330225] niks3-server[1198]: 2026/09/22 10:38:05 INFO Completed upload id=18 machine # [ 198.331227] niks3-server[1198]: 2026/09/22 10:38:05 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo machine # [ 201.003564] niks3-server[1198]: 2026/09/22 10:38:08 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 201.021291] niks3-server[1198]: 2026/09/22 10:38:08 INFO Registered completed upload object_key=nar/0xiyqcsl8db7dnrq2gqnx5izavr51ma3dcdswrriaxfgj3qzk7xf.nar.zst machine # [ 201.025446] niks3-server[1198]: 2026/09/22 10:38:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign machine # [ 201.027092] niks3-server[1198]: 2026/09/22 10:38:08 INFO Signed narinfos id=19 count=1 machine # [ 201.029142] niks3-server[1198]: 2026/09/22 10:38:08 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.ls machine # [ 201.034544] niks3-server[1198]: 2026/09/22 10:38:08 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete machine # [ 201.036455] niks3-server[1198]: 2026/09/22 10:38:08 INFO Completed upload id=19 machine # [ 201.038895] niks3-server[1198]: 2026/09/22 10:38:08 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.narinfo machine # [ 209.707805] niks3-server[1198]: 2026/09/22 10:38:16 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 209.723753] niks3-server[1198]: 2026/09/22 10:38:16 INFO Registered completed upload object_key=log/fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # [ 209.728802] niks3-server[1198]: 2026/09/22 10:38:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign machine # [ 209.729129] niks3-server[1198]: 2026/09/22 10:38:16 INFO Registered completed upload object_key=nar/0p3l2z3riilylr2rxb1aq2blxdfxg55wbgp4gxkns93srbr4bwyq.nar.zst machine # [ 209.731981] niks3-server[1198]: 2026/09/22 10:38:16 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.ls machine # [ 209.739865] niks3-server[1198]: 2026/09/22 10:38:16 INFO Signed narinfos id=20 count=1 machine # [ 209.745723] niks3-server[1198]: 2026/09/22 10:38:16 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete machine # [ 209.747588] niks3-server[1198]: 2026/09/22 10:38:16 INFO Completed upload id=20 machine # [ 210.889292] systemd[1]: cri-containerd-8547a9bd265c036b8df26e49b14cc19b00428bf87a5eb4b35c7d885b21c510b9.scope: Deactivated successfully. machine # [ 210.890763] systemd[1]: cri-containerd-8547a9bd265c036b8df26e49b14cc19b00428bf87a5eb4b35c7d885b21c510b9.scope: Consumed 916ms CPU time over 40.769s wall clock time, 123.6M memory peak, 71.2M read from disk, 424K written to disk, 16.8K incoming IP traffic, 44K outgoing IP traffic. machine # [ 210.931707] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-8547a9bd265c036b8df26e49b14cc19b00428bf87a5eb4b35c7d885b21c510b9-rootfs.mount: Deactivated successfully. machine # [ 212.521128] systemd[1]: cri-containerd-e7fad058cc0a312f636749952bc4996c3f765a2c66fb29de95c0151cd8889f63.scope: Deactivated successfully. machine # [ 212.585845] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-e7fad058cc0a312f636749952bc4996c3f765a2c66fb29de95c0151cd8889f63-rootfs.mount: Deactivated successfully. machine # [ 212.633502] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-e7fad058cc0a312f636749952bc4996c3f765a2c66fb29de95c0151cd8889f63-shm.mount: Deactivated successfully. machine # [ 212.700658] d[ 212.844748] cni0: port 2(vethe3c9ea65) entered disabled state machine # hcpcd[2891]: vethe3c9ea65: carrier lost machine # [ 212.848647] vethe3c9ea65 (unregistering): left allmulticast mode machine # [ 212.852331] vethe3c9ea65 (unregistering): left promiscuous mode machine # [ 212.855011] cni0: port 2(vethe3c9ea65) entered disabled state machine # [ 212.740840] systemd[1]: run-netns-cni\x2d1bc128b7\x2d007c\x2d1936\x2d0a49\x2dfb3ce886d78b.mount: Deactivated successfully. machine # [ 212.764789] dhcpcd[2891]: vethe3c9ea65: deleting address fe80::d04e:70ff:fe76:82f4 machine # [ 212.769210] dhcpcd[2891]: vethe3c9ea65: deleting route to 169.254.0.0/16 machine # [ 212.878373] dhcpcd[2891]: vethe3c9ea65: removing interface machine # [ 212.909632] k3s[892]: I0922 10:38:20.000797 892 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3690e808-4688-4521-b5da-364b867fe5b7-nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/3690e808-4688-4521-b5da-364b867fe5b7-nix-grpc-farm\") pod \"3690e808-4688-4521-b5da-364b867fe5b7\" (UID: \"3690e808-4688-4521-b5da-364b867fe5b7\") " machine # [ 212.910232] k3s[892]: I0922 10:38:20.000863 892 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3690e808-4688-4521-b5da-364b867fe5b7-job\" (UniqueName: \"kubernetes.io/configmap/3690e808-4688-4521-b5da-364b867fe5b7-job\") pod \"3690e808-4688-4521-b5da-364b867fe5b7\" (UID: \"3690e808-4688-4521-b5da-364b867fe5b7\") " machine # [ 212.910888] k3s[892]: I0922 10:38:20.000889 892 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3690e808-4688-4521-b5da-364b867fe5b7-kube-api-access-mx7q7\" (UniqueName: \"kubernetes.io/projected/3690e808-4688-4521-b5da-364b867fe5b7-kube-api-access-mx7q7\") pod \"3690e808-4688-4521-b5da-364b867fe5b7\" (UID: \"3690e808-4688-4521-b5da-364b867fe5b7\") " machine # [ 212.911709] k3s[892]: I0922 10:38:20.001416 892 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3690e808-4688-4521-b5da-364b867fe5b7-job" pod "3690e808-4688-4521-b5da-364b867fe5b7" (UID: "3690e808-4688-4521-b5da-364b867fe5b7"). InnerVolumeSpecName "job". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 212.915207] systemd[1]: var-lib-kubelet-pods-3690e808\x2d4688\x2d4521\x2db5da\x2d364b867fe5b7-volumes-kubernetes.io\x7eprojected-nix\x2dgrpc\x2dfarm.mount: Deactivated successfully. machine # [ 212.929627] k3s[892]: I0922 10:38:20.021666 892 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3690e808-4688-4521-b5da-364b867fe5b7-nix-grpc-farm" pod "3690e808-4688-4521-b5da-364b867fe5b7" (UID: "3690e808-4688-4521-b5da-364b867fe5b7"). InnerVolumeSpecName "nix-grpc-farm". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 212.933527] systemd[1]: var-lib-kubelet-pods-3690e808\x2d4688\x2d4521\x2db5da\x2d364b867fe5b7-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dmx7q7.mount: Deactivated successfully. machine # [ 212.939473] k3s[892]: I0922 10:38:20.031522 892 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3690e808-4688-4521-b5da-364b867fe5b7-kube-api-access-mx7q7" pod "3690e808-4688-4521-b5da-364b867fe5b7" (UID: "3690e808-4688-4521-b5da-364b867fe5b7"). InnerVolumeSpecName "kube-api-access-mx7q7". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 213.009248] k3s[892]: I0922 10:38:20.101244 892 reconciler_common.go:299] "Volume detached for volume \"job\" (UniqueName: \"kubernetes.io/configmap/3690e808-4688-4521-b5da-364b867fe5b7-job\") on node \"machine\" DevicePath \"\"" machine # [ 213.009613] k3s[892]: I0922 10:38:20.101316 892 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mx7q7\" (UniqueName: \"kubernetes.io/projected/3690e808-4688-4521-b5da-364b867fe5b7-kube-api-access-mx7q7\") on node \"machine\" DevicePath \"\"" machine # [ 213.010084] k3s[892]: I0922 10:38:20.101353 892 reconciler_common.go:299] "Volume detached for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/3690e808-4688-4521-b5da-364b867fe5b7-nix-grpc-farm\") on node \"machine\" DevicePath \"\"" machine # [ 213.499786] k3s[892]: I0922 10:38:20.591764 892 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e7fad058cc0a312f636749952bc4996c3f765a2c66fb29de95c0151cd8889f63" machine # [ 213.515629] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod3690e808_4688_4521_b5da_364b867fe5b7.slice. machine # [ 213.519540] systemd[1]: kubepods-besteffort-pod3690e808_4688_4521_b5da_364b867fe5b7.slice: Consumed 947ms CPU time over 46.461s wall clock time, 123.8M memory peak, 71.2M read from disk, 628K written to disk, 16.8K incoming IP traffic, 44K outgoing IP traffic. machine: (finished: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed', in 47.84 seconds) machine: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1 machine: (finished: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1, in 0.22 seconds) machine # don't know how to build these paths: machine # /nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-a> machine/nix-grpc-farm-worker-x86-64-linux-7777686f4d-d5cw4: building fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-b> machine/nix-grpc-farm-worker-x86-64-linux-7777686f4d-d5cw4: building 1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-top> machine/nix-grpc-farm-worker-x86-64-linux-7777686f4d-d5cw4: building rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # INFO:nix_fast_build.processes:run nix-eval-jobs --gc-roots-dir /tmp/tmp4qex8u6m/gcroots --force-recurse --max-memory-size 4096 --workers 4 --flake '.#checks' --check-cache-status machine # INFO:nix_fast_build.workers:builds: 0 machine # warning: Git tree '/tmp' is dirty machine # warning: Git tree '/tmp' is dirty machine # ▶ x86_64-linux.t started machine # INFO:nix_fast_build.workers:builds: 2 machine # ✔ x86_64-linux.t (10s) machine # x86_64-linux.t> machine/nix-grpc-farm-worker-x86-64-linux-7777686f4d-t5tqs: building fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # warning: Git tree '/tmp' is dirty machine: must succeed: nix eval --raw -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag ci outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag ci outPath, in 0.27 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null, in 0.07 seconds) (finished: subtest: a Job with the client image builds through the farm with its service account, in 49.46 seconds) subtest: a renewed balancer certificate is served without a rollout machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/lb-renewed.crt --key=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f - machine # Warning: resource secrets/farm-lb-tls is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically. machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/lb-renewed.crt --key=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f -, in 0.35 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}', in 0.68 seconds) machine: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-68c8f49bd6-wt8rf -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine # [ 217.059269] k3s[892]: E0922 10:38:24.150565 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41706: use of closed network connection machine # [ 218.408662] k3s[892]: E0922 10:38:25.500380 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41728: use of closed network connection machine # [ 219.756685] k3s[892]: E0922 10:38:26.848352 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41748: use of closed network connection machine # [ 221.033553] k3s[892]: E0922 10:38:28.125308 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41768: use of closed network connection machine # [ 222.389453] k3s[892]: E0922 10:38:29.480723 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41792: use of closed network connection machine # [ 222.390131] k3s[892]: E0922 10:38:29.481054 892 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:51966->127.0.0.1:10010: write tcp 127.0.0.1:51966->127.0.0.1:10010: write: broken pipe machine # [ 223.768577] k3s[892]: E0922 10:38:30.860272 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35340: use of closed network connection machine # [ 225.065839] k3s[892]: E0922 10:38:32.157579 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35366: use of closed network connection machine # [ 226.392249] k3s[892]: E0922 10:38:33.483554 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35404: use of closed network connection machine # [ 227.725486] k3s[892]: E0922 10:38:34.817190 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35436: use of closed network connection machine # [ 229.066939] k3s[892]: E0922 10:38:36.158694 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35474: use of closed network connection machine # [ 230.410054] k3s[892]: E0922 10:38:37.501744 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35504: use of closed network connection machine # [ 231.731396] k3s[892]: E0922 10:38:38.823111 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35536: use of closed network connection machine # [ 233.001368] k3s[892]: E0922 10:38:40.092877 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56652: use of closed network connection machine # [ 234.292386] k3s[892]: E0922 10:38:41.383926 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56666: use of closed network connection machine # [ 235.649212] k3s[892]: E0922 10:38:42.740336 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56704: use of closed network connection machine # [ 236.977739] k3s[892]: E0922 10:38:44.069481 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56716: use of closed network connection machine # [ 239.667062] k3s[892]: E0922 10:38:46.758724 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56786: use of closed network connection machine # [ 240.979612] k3s[892]: E0922 10:38:48.071214 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56814: use of closed network connection machine # [ 242.234414] k3s[892]: E0922 10:38:49.325813 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56830: use of closed network connection machine # [ 243.549247] k3s[892]: E0922 10:38:50.640862 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40258: use of closed network connection machine # [ 244.906790] k3s[892]: E0922 10:38:51.997947 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40280: use of closed network connection machine # [ 246.206509] k3s[892]: E0922 10:38:53.298226 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40306: use of closed network connection machine # [ 247.536249] k3s[892]: E0922 10:38:54.627835 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40330: use of closed network connection machine # [ 248.903709] k3s[892]: E0922 10:38:55.995015 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40348: use of closed network connection machine # [ 250.276752] k3s[892]: E0922 10:38:57.368386 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40362: use of closed network connection machine # [ 251.622564] k3s[892]: E0922 10:38:58.714333 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40380: use of closed network connection machine # [ 252.912246] k3s[892]: E0922 10:39:00.003656 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40394: use of closed network connection machine # [ 254.275788] k3s[892]: E0922 10:39:01.367523 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53556: use of closed network connection machine # [ 255.625032] k3s[892]: E0922 10:39:02.716348 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53580: use of closed network connection machine # [ 255.625259] k3s[892]: E0922 10:39:02.716448 892 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:59710->127.0.0.1:10010: write tcp 127.0.0.1:59710->127.0.0.1:10010: write: broken pipe machine # [ 255.625651] k3s[892]: time="2026-09-22T10:39:02Z" level=warning msg="Proxy error: read failed: read tcp 127.0.0.1:40180->127.0.0.1:10250: read: connection reset by peer" machine # [ 256.974757] k3s[892]: E0922 10:39:04.066171 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53596: use of closed network connection machine # [ 256.975142] k3s[892]: time="2026-09-22T10:39:04Z" level=warning msg="Proxy error: read failed: read tcp 127.0.0.1:40192->127.0.0.1:10250: read: connection reset by peer" machine # [ 258.272573] k3s[892]: E0922 10:39:05.364151 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53616: use of closed network connection machine # [ 259.600211] k3s[892]: E0922 10:39:06.691671 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53636: use of closed network connection machine # [ 260.928416] k3s[892]: E0922 10:39:08.020001 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53662: use of closed network connection machine # [ 262.263269] k3s[892]: E0922 10:39:09.354706 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53680: use of closed network connection machine # [ 263.589357] k3s[892]: E0922 10:39:10.680902 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33402: use of closed network connection machine # [ 264.940573] k3s[892]: E0922 10:39:12.031916 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33436: use of closed network connection machine # [ 266.307213] k3s[892]: E0922 10:39:13.398491 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33474: use of closed network connection machine # [ 267.606986] k3s[892]: E0922 10:39:14.698747 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33490: use of closed network connection machine # [ 268.949461] k3s[892]: E0922 10:39:16.039813 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33514: use of closed network connection machine # [ 270.296180] k3s[892]: E0922 10:39:17.387409 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33544: use of closed network connection machine # [ 271.631108] k3s[892]: E0922 10:39:18.722594 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33562: use of closed network connection machine # [ 272.982385] k3s[892]: E0922 10:39:20.073852 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33580: use of closed network connection machine # [ 275.707723] k3s[892]: time="2026-09-22T10:39:22Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:35448->127.0.0.1:10250: write: broken pipe" machine: (finished: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-68c8f49bd6-wt8rf -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 59.01 seconds) machine: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine: (finished: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 0.06 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag t-renewed 2>&1 machine # [ 276.161520] niks3-server[1198]: 2026/09/22 10:39:23 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 276.180810] niks3-server[1198]: 2026/09/22 10:39:23 INFO Registered completed upload object_key=nar/0g42hgwa9jp9abmqxz90dkwxpybsznzbpsy35rm921mlk5sw56jq.nar.zst machine # [ 276.186253] niks3-server[1198]: 2026/09/22 10:39:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign machine # [ 276.187180] niks3-server[1198]: 2026/09/22 10:39:23 INFO Signed narinfos id=21 count=1 machine # [ 276.196704] niks3-server[1198]: 2026/09/22 10:39:23 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.ls machine # [ 276.202181] niks3-server[1198]: 2026/09/22 10:39:23 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete machine # [ 276.205731] niks3-server[1198]: 2026/09/22 10:39:23 INFO Completed upload id=21 machine # [ 276.206607] niks3-server[1198]: 2026/09/22 10:39:23 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.narinfo machine # [ 284.893770] niks3-server[1198]: 2026/09/22 10:39:31 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 284.910467] niks3-server[1198]: 2026/09/22 10:39:32 INFO Registered completed upload object_key=nar/1vxmmzwi16s4iri6dcmi9v62dpq1ys7wz15b497ncik3sd67nfzg.nar.zst machine # [ 284.911896] niks3-server[1198]: 2026/09/22 10:39:32 INFO Registered completed upload object_key=log/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31-k3s-a.drv machine # [ 284.914126] niks3-server[1198]: 2026/09/22 10:39:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign machine # [ 284.915316] niks3-server[1198]: 2026/09/22 10:39:32 INFO Signed narinfos id=22 count=1 machine # [ 284.919578] niks3-server[1198]: 2026/09/22 10:39:32 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.ls machine # [ 284.921756] niks3-server[1198]: 2026/09/22 10:39:32 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete machine # [ 284.923810] niks3-server[1198]: 2026/09/22 10:39:32 INFO Completed upload id=22 machine # [ 284.925676] niks3-server[1198]: 2026/09/22 10:39:32 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo machine # [ 285.007752] niks3-server[1198]: 2026/09/22 10:39:32 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 285.020051] niks3-server[1198]: 2026/09/22 10:39:32 INFO Registered completed upload object_key=nar/0cbxkyxz068xc5mivh2h67kw6y01n1x28cbs11v1a03g8m4c71zm.nar.zst machine # [ 285.023454] niks3-server[1198]: 2026/09/22 10:39:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign machine # [ 285.023843] niks3-server[1198]: 2026/09/22 10:39:32 INFO Signed narinfos id=23 count=1 machine # [ 285.026880] niks3-server[1198]: 2026/09/22 10:39:32 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.ls machine # [ 285.029158] niks3-server[1198]: 2026/09/22 10:39:32 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete machine # [ 285.030684] niks3-server[1198]: 2026/09/22 10:39:32 INFO Completed upload id=23 machine # [ 285.031926] niks3-server[1198]: 2026/09/22 10:39:32 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.narinfo machine # [ 293.493402] niks3-server[1198]: 2026/09/22 10:39:40 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 293.512837] niks3-server[1198]: 2026/09/22 10:39:40 INFO Registered completed upload object_key=nar/0khxywxb2r78vhpc5hsmha3ymgp910z0aka7550jmaqzs333rmzp.nar.zst machine # [ 293.515610] niks3-server[1198]: 2026/09/22 10:39:40 INFO Registered completed upload object_key=log/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4-k3s-b.drv machine # [ 293.517963] niks3-server[1198]: 2026/09/22 10:39:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign machine # [ 293.519560] niks3-server[1198]: 2026/09/22 10:39:40 INFO Signed narinfos id=24 count=1 machine # [ 293.521953] niks3-server[1198]: 2026/09/22 10:39:40 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.ls machine # [ 293.528241] niks3-server[1198]: 2026/09/22 10:39:40 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete machine # [ 293.531958] niks3-server[1198]: 2026/09/22 10:39:40 INFO Completed upload id=24 machine # [ 293.533312] niks3-server[1198]: 2026/09/22 10:39:40 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.narinfo machine # [ 293.622719] niks3-server[1198]: 2026/09/22 10:39:40 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 293.640040] niks3-server[1198]: 2026/09/22 10:39:40 INFO Registered completed upload object_key=nar/04bim5f8bvjh25xncf5x40kb529khrlzcbc92qxvapgbc0bdfv2h.nar.zst machine # [ 293.641867] niks3-server[1198]: 2026/09/22 10:39:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign machine # [ 293.643410] niks3-server[1198]: 2026/09/22 10:39:40 INFO Signed narinfos id=25 count=1 machine # [ 293.645523] niks3-server[1198]: 2026/09/22 10:39:40 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.ls machine # [ 293.649654] niks3-server[1198]: 2026/09/22 10:39:40 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete machine # [ 293.651491] niks3-server[1198]: 2026/09/22 10:39:40 INFO Completed upload id=25 machine # [ 293.652561] niks3-server[1198]: 2026/09/22 10:39:40 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.narinfo machine # [ 302.133503] niks3-server[1198]: 2026/09/22 10:39:49 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 302.150371] niks3-server[1198]: 2026/09/22 10:39:49 INFO Registered completed upload object_key=nar/11f7f1hixry25c2yc6np9hs10a2pwwqmymmrxxbswhdjabcyvv0s.nar.zst machine # [ 302.152624] niks3-server[1198]: 2026/09/22 10:39:49 INFO Registered completed upload object_key=log/jz7biafi8rj5r3r392blyazw5mdpvy0d-k3s-top.drv machine # [ 302.156231] niks3-server[1198]: 2026/09/22 10:39:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign machine # [ 302.157816] niks3-server[1198]: 2026/09/22 10:39:49 INFO Signed narinfos id=26 count=1 machine # [ 302.160919] niks3-server[1198]: 2026/09/22 10:39:49 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.ls machine # [ 302.166071] niks3-server[1198]: 2026/09/22 10:39:49 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete machine # [ 302.168252] niks3-server[1198]: 2026/09/22 10:39:49 INFO Completed upload id=26 machine # [ 302.172077] niks3-server[1198]: 2026/09/22 10:39:49 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag t-renewed 2>&1, in 26.42 seconds) (finished: subtest: a renewed balancer certificate is served without a rollout, in 86.52 seconds) subtest: metrics carry build_info machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-7777686f4d-d5cw4 -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-7777686f4d-d5cw4 -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.21 seconds) machine: must succeed: curl -sf http://10.42.0.5:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-7777686f4d-d5cw4"' machine: (finished: must succeed: curl -sf http://10.42.0.5:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-7777686f4d-d5cw4"', in 0.05 seconds) (finished: subtest: metrics carry build_info, in 0.27 seconds) subtest: harmonia-gc frees space and the worker stays Ready machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7777686f4d-d5cw4 -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'' machine # [ 302.738635] k3s[892]: E0922 10:39:49.830327 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39626: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7777686f4d-d5cw4 -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'', in 0.27 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7777686f4d-d5cw4 -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done' machine # [ 303.061740] k3s[892]: E0922 10:39:50.153480 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58958: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7777686f4d-d5cw4 -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done', in 0.33 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7777686f4d-d5cw4 -c gc -- sh -c 'fallocate -l 11471093760 /nix/fill' machine # [ 303.348155] k3s[892]: E0922 10:39:50.439790 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58986: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7777686f4d-d5cw4 -c gc -- sh -c 'fallocate -l 11471093760 /nix/fill', in 0.29 seconds) machine: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-7777686f4d-d5cw4 -c gc --since=30s | grep -q 'store paths deleted' machine: (finished: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-7777686f4d-d5cw4 -c gc --since=30s | grep -q 'store paths deleted', in 6.65 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7777686f4d-d5cw4 -c gc -- sh -c 'rm /nix/fill' machine # [ 310.339407] k3s[892]: E0922 10:39:57.430608 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59084: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7777686f4d-d5cw4 -c gc -- sh -c 'rm /nix/fill', in 0.33 seconds) machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-7777686f4d-d5cw4 -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-7777686f4d-d5cw4 -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}', in 0.24 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7777686f4d-d5cw4 -c gc -- sh -c 'command -v nix-daemon && command -v niks3' machine # [ 310.884572] k3s[892]: E0922 10:39:57.976558 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59120: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7777686f4d-d5cw4 -c gc -- sh -c 'command -v nix-daemon && command -v niks3', in 0.31 seconds) (finished: subtest: harmonia-gc frees space and the worker stays Ready, in 8.42 seconds) subtest: losing the balancer mid-build: the client reconnects and the build succeeds machine: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/434skfxjp21wrad1nb0qdhhpgrbh812m-slow.nix --argstr tag lb1 machine # [ 310.933478] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/434skfxjp21wrad1nb0qdhhpgrbh812m-slow.nix --argstr tag lb1. machine # Running as unit: vialb.service; invocation ID: 3247bead4ea244efb0ca896dfdc87933 machine: (finished: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/434skfxjp21wrad1nb0qdhhpgrbh812m-slow.nix --argstr tag lb1, in 0.04 seconds) machine: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'" machine # [ 311.125617] nix[8796]: don't know how to build these paths: machine # [ 311.125905] nix[8796]: /nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 311.151696] nix[8796]: copying 1 paths to '127.0.0.1:30051'... machine # [ 311.154256] nix[8796]: copying path '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' to '127.0.0.1:30051'... machine # [ 311.243861] niks3-server[1198]: 2026/09/22 10:39:58 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 311.261291] niks3-server[1198]: 2026/09/22 10:39:58 INFO Registered completed upload object_key=nar/0kkr2vb091wkq0cb0f1q92413dsfskh76wydp8mwysv7rawns0ar.nar.zst machine # [ 311.266302] niks3-server[1198]: 2026/09/22 10:39:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign machine # [ 311.267778] niks3-server[1198]: 2026/09/22 10:39:58 INFO Signed narinfos id=27 count=1 machine # [ 311.270405] niks3-server[1198]: 2026/09/22 10:39:58 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.ls machine # [ 311.275446] niks3-server[1198]: 2026/09/22 10:39:58 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete machine # [ 311.279389] niks3-server[1198]: 2026/09/22 10:39:58 INFO Completed upload id=27 machine # [ 311.282970] niks3-server[1198]: 2026/09/22 10:39:58 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.narinfo machine # [ 311.289323] nix[8796]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 311.289479] nix[8796]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-7777686f4d-t5tqs: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine: (finished: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'", in 1.09 seconds) machine: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false machine # [ 312.244386] postgres[772]: [772] LOG: checkpoint starting: time machine: (finished: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false, in 0.35 seconds) machine: waiting for success: ! systemctl is-active vialb machine # [ 312.412720] nix[8796]: scheduler at 127.0.0.1:30051: Stream removed (Socket closed), reconnecting machine # [ 312.415465] nix[8796]: d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv: Stream removed (Socket closed), asking the scheduler again machine # [ 312.422874] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod6d227413_b539_4f82_9abc_419f3194975e.slice. machine # [ 312.436065] k3s[892]: I0922 10:39:59.527635 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d227413-b539-4f82-9abc-419f3194975e-config\") pod \"nix-grpc-farm-lb-68c8f49bd6-z24d6\" (UID: \"6d227413-b539-4f82-9abc-419f3194975e\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-z24d6" machine # [ 312.436929] k3s[892]: I0922 10:39:59.527679 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/6d227413-b539-4f82-9abc-419f3194975e-tls-ca\") pod \"nix-grpc-farm-lb-68c8f49bd6-z24d6\" (UID: \"6d227413-b539-4f82-9abc-419f3194975e\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-z24d6" machine # [ 312.437309] k3s[892]: I0922 10:39:59.527710 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d227413-b539-4f82-9abc-419f3194975e-tmp\") pod \"nix-grpc-farm-lb-68c8f49bd6-z24d6\" (UID: \"6d227413-b539-4f82-9abc-419f3194975e\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-z24d6" machine # [ 312.437870] k3s[892]: I0922 10:39:59.527735 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/6d227413-b539-4f82-9abc-419f3194975e-tls-lb\") pod \"nix-grpc-farm-lb-68c8f49bd6-z24d6\" (UID: \"6d227413-b539-4f82-9abc-419f3194975e\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-z24d6" machine # [ 312.454801] systemd[1]: cri-containerd-3cbe43fe92d6b4fdfc4fa2d8883795fa3511f621271ba6f417b36bf9526beddd.scope: Deactivated successfully. machine # [ 312.455916] systemd[1]: cri-containerd-3cbe43fe92d6b4fdfc4fa2d8883795fa3511f621271ba6f417b36bf9526beddd.scope: Consumed 3.304s CPU time over 4min 19.534s wall clock time, 51.9M memory peak, 30M read from disk, 499.3K incoming IP traffic, 473.2K outgoing IP traffic. machine # [ 312.501793] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-3cbe43fe92d6b4fdfc4fa2d8883795fa3511f621271ba6f417b36bf9526beddd-rootfs.mount: Deactivated successfully. machine # [ 312.535278] systemd[1]: cri-containerd-bde649153d7d1a67380dcd598363512f47e6a8fa66bfe288232d89c5536d9ff2.scope: Deactivated successfully. machine # [ 312.574870] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-bde649153d7d1a67380dcd598363512f47e6a8fa66bfe288232d89c5536d9ff2-rootfs.mount: Deactivated successfully. machine # [ 312.801286] cni0: port 3(veth46a5c2ab) entered disabled state machine # [ 312.657609] dhcpcd[2891]: veth46a5c2ab: carrier lost machine # [ 312.803997] veth46a5c2ab (unregistering): left allmulticast mode machine # [ 312.805835] veth46a5c2ab (unregistering): left promiscuous mode machine # [ 312.807523] cni0: port 3(veth46a5c2ab) entered disabled state machine # [ 312.714283] dhcpcd[2891]: veth46a5c2ab: deleting route to 169.254.0.0/16 machine # [ 312.738526] k3s[892]: I0922 10:39:59.830329 892 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8f253228-0cfd-44dd-9a4e-1117f8f3797b-tls-lb\" (UniqueName: \"kubernetes.io/secret/8f253228-0cfd-44dd-9a4e-1117f8f3797b-tls-lb\") pod \"8f253228-0cfd-44dd-9a4e-1117f8f3797b\" (UID: \"8f253228-0cfd-44dd-9a4e-1117f8f3797b\") " machine # [ 312.739726] k3s[892]: I0922 10:39:59.830383 892 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8f253228-0cfd-44dd-9a4e-1117f8f3797b-tls-ca\" (UniqueName: \"kubernetes.io/secret/8f253228-0cfd-44dd-9a4e-1117f8f3797b-tls-ca\") pod \"8f253228-0cfd-44dd-9a4e-1117f8f3797b\" (UID: \"8f253228-0cfd-44dd-9a4e-1117f8f3797b\") " machine # [ 312.742478] k3s[892]: I0922 10:39:59.830417 892 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8f253228-0cfd-44dd-9a4e-1117f8f3797b-tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f253228-0cfd-44dd-9a4e-1117f8f3797b-tmp\") pod \"8f253228-0cfd-44dd-9a4e-1117f8f3797b\" (UID: \"8f253228-0cfd-44dd-9a4e-1117f8f3797b\") " machine # [ 312.742998] k3s[892]: I0922 10:39:59.830449 892 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8f253228-0cfd-44dd-9a4e-1117f8f3797b-config\" (UniqueName: \"kubernetes.io/configmap/8f253228-0cfd-44dd-9a4e-1117f8f3797b-config\") pod \"8f253228-0cfd-44dd-9a4e-1117f8f3797b\" (UID: \"8f253228-0cfd-44dd-9a4e-1117f8f3797b\") " machine # [ 312.766715] k3s[892]: I0922 10:39:59.858091 [ 312.911206] cni0: port 2(vethaca516a5) entered blocking state machine # 892 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f253228-0cfd-44dd-9a4e-111[ 312.913756] cni0: port 2(vethaca516a5) entered disabled state machine # 7f8f3797b-tls-lb" pod "8f253228-0cfd-44dd-9a4e-1117f8f3797b" (UI[ 312.915463] vethaca516a5: entered allmulticast mode machine # D: "8f253228-0cfd-44dd-9a4e-1117f8f3797b"). InnerVolumeSpecName [ 312.916957] vethaca516a5: entered promiscuous mode machine # "tls-lb". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 312.767350] k3s[892]: I0922 10:39:59.859397 892 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f253228-0cfd-44dd-9a4e-1117f8f3797b-tmp" pod "8f253228-0cfd-44dd-9a4e-1117f8f3797b" (UID: "8f253228-0cfd-44dd-9a4e-1117f8f3797b"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 312.769244] k3s[892]: I0922 10:39:59.859842 892 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f253228-0cfd-44dd-9a4e-1117f8f3797b-tls-ca" pod "8f253228-0cfd-44dd-9a4e-1117f8f3797b" (UID: "8f253228-0cfd-44dd-9a4e-1117f8f3797b"). InnerVolumeSpecName "tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 312.770524] (udev-worker)[9029]: Network interface NamePolicy= disabled on kernel command lin[ 312.932619] cni0: port 2(vethaca516a5) entered blocking state machine # e. machine # [ 312.933761] cni0: port 2(vethaca516a5) entered forwarding state machine # [ 312.803103] k3s[892]: I0922 10:39:59.894933 892 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f253228-0cfd-44dd-9a4e-1117f8f3797b-config" pod "8f253228-0cfd-44dd-9a4e-1117f8f3797b" (UID: "8f253228-0cfd-44dd-9a4e-1117f8f3797b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 312.838771] k3s[892]: I0922 10:39:59.930784 892 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8f253228-0cfd-44dd-9a4e-1117f8f3797b-config\") on node \"machine\" DevicePath \"\"" machine # [ 312.838986] k3s[892]: I0922 10:39:59.930826 892 reconciler_common.go:299] "Volume detached for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/8f253228-0cfd-44dd-9a4e-1117f8f3797b-tls-lb\") on node \"machine\" DevicePath \"\"" machine # [ 312.839596] k3s[892]: I0922 10:39:59.930839 892 reconciler_common.go:299] "Volume detached for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/8f253228-0cfd-44dd-9a4e-1117f8f3797b-tls-ca\") on node \"machine\" DevicePath \"\"" machine # [ 312.840102] k3s[892]: I0922 10:39:59.930852 892 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f253228-0cfd-44dd-9a4e-1117f8f3797b-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 312.853069] k3s[892]: I0922 10:39:59.943275 892 scope.go:122] "RemoveContainer" containerID="3cbe43fe92d6b4fdfc4fa2d8883795fa3511f621271ba6f417b36bf9526beddd" machine # [ 312.862946] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod8f253228_0cfd_44dd_9a4e_1117f8f3797b.slice. machine # [ 312.863550] systemd[1]: kubepods-besteffort-pod8f253228_0cfd_44dd_9a4e_1117f8f3797b.slice: Consumed 3.338s CPU time over 4min 21.123s wall clock time, 52.2M memory peak, 30M read from disk, 499.3K incoming IP traffic, 473.2K outgoing IP traffic. machine # [ 312.864441] k3s[892]: I0922 10:39:59.955729 892 scope.go:122] "RemoveContainer" containerID="3cbe43fe92d6b4fdfc4fa2d8883795fa3511f621271ba6f417b36bf9526beddd" machine # [ 312.865749] k3s[892]: E0922 10:39:59.956666 892 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"3cbe43fe92d6b4fdfc4fa2d8883795fa3511f621271ba6f417b36bf9526beddd\": not found" containerID="3cbe43fe92d6b4fdfc4fa2d8883795fa3511f621271ba6f417b36bf9526beddd" machine # [ 312.866563] k3s[892]: I0922 10:39:59.956700 892 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"3cbe43fe92d6b4fdfc4fa2d8883795fa3511f621271ba6f417b36bf9526beddd"} err="failed to get container status \"3cbe43fe92d6b4fdfc4fa2d8883795fa3511f621271ba6f417b36bf9526beddd\": rpc error: code = NotFound desc = an error occurred when try to find container \"3cbe43fe92d6b4fdfc4fa2d8883795fa3511f621271ba6f417b36bf9526beddd\": not found" machine # [ 312.886631] dhcpcd[2891]: veth46a5c2ab: removing interface machine # [ 312.917637] systemd[1]: Started libcontainer container f364495174a479ab582e5198d3835051774f6c13e5ea606040d91fbb1b3906f4. machine # [ 312.929931] dhcpcd[2891]: vethaca516a5: IAID 22:91:54:5b machine # [ 312.930369] dhcpcd[2891]: vethaca516a5: adding address fe80::707c:22ff:fe91:545b machine # [ 312.932551] dhcpcd[2891]: vethaca516a5: old hardware address: 72:7c:22:91:54:5b machine # [ 312.932703] dhcpcd[2891]: vethaca516a5: new hardware address: 62:ad:94:88:a8:00 machine # [ 312.933424] dhcpcd[2891]: vethaca516a5: carrier lost machine # [ 312.975637] dhcpcd[2891]: vethaca516a5: deleting address fe80::707c:22ff:fe91:545b machine # [ 312.976657] dhcpcd[2891]: vethaca516a5: carrier acquired machine # [ 312.988717] dhcpcd[2891]: vethaca516a5: IAID 94:88:a8:00 machine # [ 312.990432] dhcpcd[2891]: vethaca516a5: adding address fe80::60ad:94ff:fe88:a800 machine # [ 313.064896] systemd[1]: Started libcontainer container 81d51bd5e4d05be4e6038284c5717a02a48c670e5f1b39ec4b09e52a58d7ca14. machine # [ 313.510588] systemd[1]: var-lib-kubelet-pods-8f253228\x2d0cfd\x2d44dd\x2d9a4e\x2d1117f8f3797b-volume\x2dsubpaths-config-envoy-2.mount: Deactivated successfully. machine # [ 313.510872] systemd[1]: var-lib-kubelet-pods-8f253228\x2d0cfd\x2d44dd\x2d9a4e\x2d1117f8f3797b-volume\x2dsubpaths-config-envoy-1.mount: Deactivated successfully. machine # [ 313.511744] systemd[1]: var-lib-kubelet-pods-8f253228\x2d0cfd\x2d44dd\x2d9a4e\x2d1117f8f3797b-volume\x2dsubpaths-config-envoy-0.mount: Deactivated successfully. machine # [ 313.512243] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-bde649153d7d1a67380dcd598363512f47e6a8fa66bfe288232d89c5536d9ff2-shm.mount: Deactivated successfully. machine # [ 313.512923] systemd[1]: run-netns-cni\x2d4106f8bd\x2dafa2\x2dcebb\x2d8ae9\x2d5e41b653eef6.mount: Deactivated successfully. machine # [ 313.513709] systemd[1]: var-lib-kubelet-pods-8f253228\x2d0cfd\x2d44dd\x2d9a4e\x2d1117f8f3797b-volumes-kubernetes.io\x7esecret-tls\x2dlb.mount: Deactivated successfully. machine # [ 313.514590] systemd[1]: var-lib-kubelet-pods-8f253228\x2d0cfd\x2d44dd\x2d9a4e\x2d1117f8f3797b-volumes-kubernetes.io\x7esecret-tls\x2dca.mount: Deactivated successfully. machine # [ 313.525860] systemd[1]: var-lib-kubelet-pods-8f253228\x2d0cfd\x2d44dd\x2d9a4e\x2d1117f8f3797b-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 313.879245] k3s[892]: I0922 10:40:00.970421 892 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-68c8f49bd6-z24d6" podStartSLOduration=1.970398018 podStartE2EDuration="1.970398018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-22 10:39:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-22 10:40:00.969629764 +0000 UTC m=+293.373431228" watchObservedRunningTime="2026-09-22 10:40:00.970398018 +0000 UTC m=+293.374194733" machine # [ 314.188319] dhcpcd[2891]: vethaca516a5: soliciting a DHCP lease machine # [ 314.763897] k3s[892]: I0922 10:40:01.855844 892 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8f253228-0cfd-44dd-9a4e-1117f8f3797b" path="/var/lib/kubelet/pods/8f253228-0cfd-44dd-9a4e-1117f8f3797b/volumes" machine # [ 314.916310] nix[8796]: scheduler at 127.0.0.1:30051: failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:30051: tcp handshaker shutdown, reconnecting machine # [ 315.102311] dhcpcd[2891]: vethaca516a5: soliciting an IPv6 router machine # [ 315.952153] nix[8796]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 315.952595] nix[8796]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-7777686f4d-d5cw4: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 319.189278] dhcpcd[2891]: vethaca516a5: probing for an IPv4LL address machine # [ 324.410116] dhcpcd[2891]: vethaca516a5: using IPv4LL address 169.254.202.209 machine # [ 324.414153] dhcpcd[2891]: vethaca516a5: adding route to 169.254.0.0/16 machine # [ 327.106573] dhcpcd[2891]: vethaca516a5: no IPv6 Routers available machine # [ 344.865972] niks3-server[1198]: 2026/09/22 10:40:31 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 344.887468] niks3-server[1198]: 2026/09/22 10:40:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign machine # [ 344.891310] niks3-server[1198]: 2026/09/22 10:40:31 INFO Signed narinfos id=28 count=1 machine # [ 344.893395] niks3-server[1198]: 2026/09/22 10:40:31 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.ls machine # [ 344.894497] niks3-server[1198]: 2026/09/22 10:40:31 INFO Registered completed upload object_key=log/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 344.903427] niks3-server[1198]: 2026/09/22 10:40:31 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete machine # [ 344.905912] niks3-server[1198]: 2026/09/22 10:40:31 INFO Completed upload id=28 machine # [ 344.909649] niks3-server[1198]: 2026/09/22 10:40:32 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.narinfo machine # [ 344.948823] systemd[1]: vialb.service: Deactivated successfully. machine # [ 344.950224] systemd[1]: vialb.service: Consumed 177ms CPU time over 34.015s wall clock time, 40.5M memory peak, 4K written to disk, 7.9K incoming IP traffic, 17K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active vialb, in 32.58 seconds) machine: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; }, in 0.03 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 0.20 seconds) (finished: subtest: losing the balancer mid-build: the client reconnects and the build succeeds, in 34.30 seconds) subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes machine: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/434skfxjp21wrad1nb0qdhhpgrbh812m-slow.nix --argstr tag s1 machine # [ 345.227141] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/434skfxjp21wrad1nb0qdhhpgrbh812m-slow.nix --argstr tag s1. machine # Running as unit: slow.service; invocation ID: 82a90aca6b254ca99ce19f9e00b6d63d machine: (finished: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/434skfxjp21wrad1nb0qdhhpgrbh812m-slow.nix --argstr tag s1, in 0.04 seconds) machine # [ 345.440089] nix[9587]: don't know how to build these paths: machine # [ 345.441039] nix[9587]: /nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 345.456372] nix[9587]: copying 1 paths to '127.0.0.1:30051'... machine # [ 345.459318] nix[9587]: copying path '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' to '127.0.0.1:30051'... machine # [ 345.488544] k3s[892]: E0922 10:40:32.580287 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59802: use of closed network connection machine # command terminated with exit code 1 machine # [ 345.527083] niks3-server[1198]: 2026/09/22 10:40:32 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 345.541420] niks3-server[1198]: 2026/09/22 10:40:32 INFO Registered completed upload object_key=nar/0wl2i9xpw0gwrx1xqdgx9ka4n503ky9qhl20pdrdlphn8d6lcx0i.nar.zst machine # [ 345.545737] niks3-server[1198]: 2026/09/22 10:40:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign machine # [ 345.548129] niks3-server[1198]: 2026/09/22 10:40:32 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.ls machine # [ 345.548798] niks3-server[1198]: 2026/09/22 10:40:32 INFO Signed narinfos id=29 count=1 machine # [ 345.553537] niks3-server[1198]: 2026/09/22 10:40:32 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete machine # [ 345.555199] niks3-server[1198]: 2026/09/22 10:40:32 INFO Completed upload id=29 machine # [ 345.556342] niks3-server[1198]: 2026/09/22 10:40:32 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.narinfo machine # [ 345.563507] nix[9587]: building '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' on 127.0.0.1:30051... machine # [ 345.564037] nix[9587]: slow-s1> machine/nix-grpc-farm-worker-x86-64-linux-7777686f4d-t5tqs: building zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 345.772982] k3s[892]: E0922 10:40:32.864856 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59834: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 347.058412] k3s[892]: E0922 10:40:34.150001 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59862: use of closed network connection machine # [ 347.341723] k3s[892]: E0922 10:40:34.433551 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59902: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 348.588506] k3s[892]: E0922 10:40:35.679759 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59926: use of closed network connection machine # [ 348.859329] k3s[892]: E0922 10:40:35.950930 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59952: use of closed network connection machine # command terminated with exit code 1 machine # [ 350.181250] k3s[892]: time="2026-09-22T10:40:37Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:45950->127.0.0.1:10250: write: broken pipe" machine # [ 350.181496] k3s[892]: E0922 10:40:37.273105 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59988: use of closed network connection machine # command terminated with exit code 1 machine # [ 350.494777] k3s[892]: E0922 10:40:37.586782 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60008: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 351.811040] k3s[892]: E0922 10:40:38.901965 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60048: use of closed network connection machine # [ 352.081744] k3s[892]: E0922 10:40:39.173726 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60072: use of closed network connection machine # [ 352.082166] k3s[892]: time="2026-09-22T10:40:39Z" level=warning msg="Proxy error: read failed: read tcp 127.0.0.1:45976->127.0.0.1:10250: read: connection reset by peer" machine # command terminated with exit code 1 machine # [ 352.083381] k3s[892]: time="2026-09-22T10:40:39Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:45976->127.0.0.1:10250: write: broken pipe" machine # [ 353.425310] k3s[892]: E0922 10:40:40.517006 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40946: use of closed network connection machine # command terminated with exit code 1 machine # [ 353.734932] k3s[892]: E0922 10:40:40.826956 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40974: use of closed network connection machine # command terminated with exit code 1 machine # [ 355.052417] k3s[892]: E0922 10:40:42.143905 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40988: use of closed network connection machine # command terminated with exit code 1 machine # [ 355.301967] k3s[892]: E0922 10:40:42.393972 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41016: use of closed network connection machine # [ 355.539944] k3s[892]: E0922 10:40:42.631958 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41036: use of closed network connection machine # command terminated with exit code 1 machine # [ 355.803136] k3s[892]: E0922 10:40:42.894975 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41062: use of closed network connection machine: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-7777686f4d-t5tqs --wait=false machine: (finished: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-7777686f4d-t5tqs --wait=false, in 0.20 seconds) machine: must succeed: sleep 5.0 machine # [ 356.054769] systemd[1]: cri-containerd-77f2500ec2c9c10a9618cd08323a88185df49f51dd1e37902331b39175684d6b.scope: Deactivated successfully. machine # [ 356.056847] systemd[1]: cri-containerd-77f2500ec2c9c10a9618cd08323a88185df49f51dd1e37902331b39175684d6b.scope: Consumed 284ms CPU time over 4min 46.547s wall clock time, 12.7M memory peak, 5.7M read from disk. machine # [ 356.092279] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-77f2500ec2c9c10a9618cd08323a88185df49f51dd1e37902331b39175684d6b-rootfs.mount: Deactivated successfully. machine # [ 356.729419] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod5c483383_b610_4ec1_8452_9b1589fb2aae.slice. machine # [ 356.782487] k3s[892]: I0922 10:40:43.874231 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/5c483383-b610-4ec1-8452-9b1589fb2aae-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-d8jwt\" (UID: \"5c483383-b610-4ec1-8452-9b1589fb2aae\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-d8jwt" machine # [ 356.782671] k3s[892]: I0922 10:40:43.874277 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/5c483383-b610-4ec1-8452-9b1589fb2aae-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-d8jwt\" (UID: \"5c483383-b610-4ec1-8452-9b1589fb2aae\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-d8jwt" machine # [ 356.783171] k3s[892]: I0922 10:40:43.874313 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/5c483383-b610-4ec1-8452-9b1589fb2aae-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-d8jwt\" (UID: \"5c483383-b610-4ec1-8452-9b1589fb2aae\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-d8jwt" machine # [ 356.783628] k3s[892]: I0922 10:40:43.874343 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltfzz\" (UniqueName: \"kubernetes.io/projected/5c483383-b610-4ec1-8452-9b1589fb2aae-kube-api-access-ltfzz\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-d8jwt\" (UID: \"5c483383-b610-4ec1-8452-9b1589fb2aae\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-d8jwt" machine # [ 356.784098] k3s[892]: I0922 10:40:43.874372 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/5c483383-b610-4ec1-8452-9b1589fb2aae-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-d8jwt\" (UID: \"5c483383-b610-4ec1-8452-9b1589fb2aae\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-d8jwt" machine # [ 356.784593] k3s[892]: I0922 10:40:43.874400 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/5c483383-b610-4ec1-8452-9b1589fb2aae-build\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-d8jwt\" (UID: \"5c483383-b610-4ec1-8452-9b1589fb2aae\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-d8jwt" machine # [ 356.785248] k3s[892]: I0922 10:40:43.874424 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/5c483383-b610-4ec1-8452-9b1589fb2aae-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-d8jwt\" (UID: \"5c483383-b610-4ec1-8452-9b1589fb2aae\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-d8jwt" machine # [ 356.785734] k3s[892]: I0922 10:40:43.874448 892 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5c483383-b610-4ec1-8452-9b1589fb2aae-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-d8jwt\" (UID: \"5c483383-b610-4ec1-8452-9b1589fb2aae\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-d8jwt" machine # [ 357.209192] cni0: port 3(veth3d10af4f) entered blocking state machine # [ 357.210599] cni0: port 3(veth3d10af4f) entered disabled state machine # [ 357.212488] veth3d10af4f: entered allmulticast mode machine # [ 357.213572] veth3d10af4f: entered promiscuous mode machine # [ 357.224250] cni0: port 3(veth3d10af4f) entered blocking state machine # [ 357.225114] cni0: port 3(veth3d10af4f) entered forwarding state machine # [ 357.143166] (udev-worker)[10525]: Network interface NamePolicy= disabled on kernel command line. machine # [ 357.176908] systemd[1]: tmp-ovl\x2didmapped2684365001.mount: Deactivated successfully. machine # [ 357.182881] dhcpcd[2891]: veth3d10af4f: IAID 32:38:61:39 machine # [ 357.183566] dhcpcd[2891]: veth3d10af4f: adding address fe80::2447:32ff:fe38:6139 machine # [ 357.199275] systemd[1]: Started libcontainer container 9156018b7a143cd62bd84b206b02c53e62e60b9710ac2cced5e37cacbbcd0847. machine # [ 357.406635] systemd[1]: Started libcontainer container 8c27bbd3439369881694f657da227cd59c10748884065a81d933bd2f92d39f4f. machine # [ 358.476898] systemd[1]: cri-containerd-8c27bbd3439369881694f657da227cd59c10748884065a81d933bd2f92d39f4f.scope: Deactivated successfully. machine # [ 358.479396] systemd[1]: cri-containerd-8c27bbd3439369881694f657da227cd59c10748884065a81d933bd2f92d39f4f.scope: Consumed 581ms CPU time over 1.071s wall clock time, 441.1M memory peak, 140.2M read from disk, 266M written to disk. machine # [ 358.539170] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-8c27bbd3439369881694f657da227cd59c10748884065a81d933bd2f92d39f4f-rootfs.mount: Deactivated successfully. machine # [ 359.090506] dhcpcd[2891]: veth3d10af4f: soliciting an IPv6 router machine # [ 359.115744] dhcpcd[2891]: veth3d10af4f: soliciting a DHCP lease machine # [ 359.133156] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount3068441917.mount: Deactivated successfully. machine # [ 359.142221] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount2269536328.mount: Deactivated successfully. machine # [ 359.226365] systemd[1]: Started libcontainer container 1f883a3c3410e4a0c1c0ceb815d83777ce660442a91fca4b9ad4279b213f3b9e. machine # [ 359.452510] systemd[1]: Started libcontainer container 317fc567c565d5e4086a3c7747bb65fa13a3674bb92a1de1df61a6721e40e2e4. machine # [ 359.709819] systemd[1]: Started libcontainer container df9c9818f5aef7562346a821f8959b11ee0ac59df1813842adb73bb40f6e47d0. machine # [ 360.094579] k3s[892]: I0922 10:40:47.186008 892 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-d8jwt" podStartSLOduration=3.163241516 podStartE2EDuration="4.185970103s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.022728587s" isStatefulPod=false podCreationTimestamp="2026-09-22 10:40:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-22 10:40:47.183793849 +0000 UTC m=+339.587590564" watchObservedRunningTime="2026-09-22 10:40:47.185970103 +0000 UTC m=+339.589771288" machine # [ 360.139514] systemd[1]: tmp-ovl\x2didmapped78020787.mount: Deactivated successfully. machine: (finished: must succeed: sleep 5.0, in 5.04 seconds) machine # [ 361.343497] k3s[892]: E0922 10:40:48.435108 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41092: use of closed network connection machine # command terminated with exit code 1 machine # [ 361.591089] k3s[892]: E0922 10:40:48.683104 892 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41116: use of closed network connection machine: waiting for success: ! systemctl is-active slow machine # [ 364.117439] dhcpcd[2891]: veth3d10af4f: probing for an IPv4LL address machine # [ 368.308760] dhcpcd[2891]: veth3d10af4f: using IPv4LL address 169.254.49.50 machine # [ 368.313840] dhcpcd[2891]: veth3d10af4f: adding route to 169.254.0.0/16 machine # [ 371.092766] dhcpcd[2891]: veth3d10af4f: no IPv6 Routers available machine # [ 374.047145] niks3-server[1198]: 2026/09/22 10:41:01 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 374.061118] niks3-server[1198]: 2026/09/22 10:41:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign machine # [ 374.064266] niks3-server[1198]: 2026/09/22 10:41:01 INFO Signed narinfos id=30 count=1 machine # [ 374.064887] niks3-server[1198]: 2026/09/22 10:41:01 INFO Registered completed upload object_key=log/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 374.069099] niks3-server[1198]: 2026/09/22 10:41:01 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete machine # [ 374.073527] niks3-server[1198]: 2026/09/22 10:41:01 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo machine # [ 374.075531] niks3-server[1198]: 2026/09/22 10:41:01 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.ls machine # [ 374.082452] niks3-server[1198]: 2026/09/22 10:41:01 INFO Completed upload id=30 machine # [ 375.142434] systemd[1]: slow.service: Deactivated successfully. machine # [ 375.144892] systemd[1]: slow.service: Consumed 147ms CPU time over 29.914s wall clock time, 38.2M memory peak, 4K written to disk, 4.8K incoming IP traffic, 11.3K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active slow, in 13.71 seconds) machine: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; }, in 0.05 seconds) machine: must fail: journalctl -u slow | grep -q 'asking the scheduler again' machine: (finished: must fail: journalctl -u slow | grep -q 'asking the scheduler again', in 0.03 seconds) machine: must succeed: nix eval --raw -f /nix/store/434skfxjp21wrad1nb0qdhhpgrbh812m-slow.nix --argstr tag s1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/434skfxjp21wrad1nb0qdhhpgrbh812m-slow.nix --argstr tag s1 outPath, in 0.27 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null machine # [ 375.663576] systemd[1]: cri-containerd-6c7f594b8c495743f36a015a6b86b6e73bc58e6bf67021788b80ac5c525757fa.scope: Deactivated successfully. machine # [ 375.672269] systemd[1]: cri-containerd-6c7f594b8c495743f36a015a6b86b6e73bc58e6bf67021788b80ac5c525757fa.scope: Consumed 2.016s CPU time over 5min 6.394s wall clock time, 65.8M memory peak, 32.7M read from disk, 210.6K incoming IP traffic, 288.2K outgoing IP traffic. machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null, in 0.06 seconds) (finished: subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes, in 30.53 seconds) (finished: run the VM test script, in 376.58 seconds) machine # [ 375.744377] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-6c7f594b8c495743f36a015a6b86b6e73bc58e6bf67021788b80ac5c525757fa-rootfs.mount: Deactivated successfully. test script finished in 376.63s cleanup kill QemuMachine (pid 45) machine # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14) (finished: cleanup, in 1.02 seconds) additionally exposed symbols: machine, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh