tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 1200.0 seconds run the VM test script machine: waiting for unit k3s.service machine: waiting for the VM to finish booting machine: starting vm machine: QEMU running (pid 45) machine # Disk image does not exist, creating the virtualisation disk image... machine # Formatting '/build/vm-state-machine/tmp.Ty9Hqju5nH', fmt=raw size=17179869184 machine # mke2fs 1.47.4 (6-Mar-2025) machine # Discarding device blocks: 0/4194304 done machine # Creating filesystem with 4194304 4k blocks and 1048576 inodes machine # Filesystem UUID: dce2beee-4547-4590-97a9-df35ff495d1f machine # Superblock backups stored on blocks: machine # 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208, machine # 4096000 machine # machine # Allocating group tables: 0/128 done machine # Writing inode tables: 0/128 done machine # Creating journal (32768 blocks): done machine # Writing superblocks and filesystem accounting information: 0/128 done machine # machine # Virtualisation disk image created. machine # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) machine # machine # machine # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+7EFCC730+7EF2C730 CA00 machine # Press Ctrl-B to configure iPXE (PCI 00:02.0)... machine # machine # machine # machine # machine # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 7EFCC730 7EF2C730 CB00 machine # Press Ctrl-B to configure iPXE (PCI 00:08.0)... machine # machine # machine # Booting from ROM... machine # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026 machine # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/grk8wwp4yvhndymngwa4q9bsxm5jhnb4-nixos-system-machine-test/init regInfo=/nix/store/866wmm9cp3hx3dll40liaprgdwfzhpid-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.000000] BIOS-provided physical RAM map: machine # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007ffd7fff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000007ffd8000-0x000000007fffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000017fffffff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved machine # [ 0.000000] NX (Execute Disable) protection: active machine # [ 0.000000] APIC: Static calls initialized machine # [ 0.000000] SMBIOS 2.8 present. machine # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 machine # [ 0.000000] DMI: Memory slots populated: 1/1 machine # [ 0.000000] Hypervisor detected: KVM machine # [ 0.000000] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 machine # [ 0.000000] kvm-clock: using sched offset of 506838379 cycles machine # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns machine # [ 0.000005] tsc: Detected 2400.012 MHz processor machine # [ 0.000813] last_pfn = 0x180000 max_arch_pfn = 0x10000000000 machine # [ 0.000839] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs machine # [ 0.000842] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT machine # [ 0.000881] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.002737] found SMP MP-table at [mem 0x000f5450-0x000f545f] machine # [ 0.002748] Using GB pages for direct mapping machine # [ 0.002867] RAMDISK: [mem 0x7e367000-0x7ffcffff] machine # [ 0.002877] ACPI: Early table checksum verification disabled machine # [ 0.002880] ACPI: RSDP 0x00000000000F5250 000014 (v00 BOCHS ) machine # [ 0.002884] ACPI: RSDT 0x000000007FFE2539 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002888] ACPI: FACP 0x000000007FFE2319 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002895] ACPI: DSDT 0x000000007FFE0040 0022D9 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002897] ACPI: FACS 0x000000007FFE0000 000040 machine # [ 0.002899] ACPI: APIC 0x000000007FFE240D 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002900] ACPI: HPET 0x000000007FFE249D 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002902] ACPI: MCFG 0x000000007FFE24D5 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002903] ACPI: WAET 0x000000007FFE2511 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002904] ACPI: Reserving FACP table memory at [mem 0x7ffe2319-0x7ffe240c] machine # [ 0.002905] ACPI: Reserving DSDT table memory at [mem 0x7ffe0040-0x7ffe2318] machine # [ 0.002906] ACPI: Reserving FACS table memory at [mem 0x7ffe0000-0x7ffe003f] machine # [ 0.002906] ACPI: Reserving APIC table memory at [mem 0x7ffe240d-0x7ffe249c] machine # [ 0.002907] ACPI: Reserving HPET table memory at [mem 0x7ffe249d-0x7ffe24d4] machine # [ 0.002907] ACPI: Reserving MCFG table memory at [mem 0x7ffe24d5-0x7ffe2510] machine # [ 0.002908] ACPI: Reserving WAET table memory at [mem 0x7ffe2511-0x7ffe2538] machine # [ 0.003145] No NUMA configuration found machine # [ 0.003146] Faking a node at [mem 0x0000000000000000-0x000000017fffffff] machine # [ 0.003148] NODE_DATA(0) allocated [mem 0x17fffa780-0x17ffffcff] machine # [ 0.005511] Zone ranges: machine # [ 0.005512] DMA [mem 0x0000000000001000-0x0000000000ffffff] machine # [ 0.005513] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] machine # [ 0.005515] Normal [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005516] Device empty machine # [ 0.005516] Movable zone start for each node machine # [ 0.005517] Early memory node ranges machine # [ 0.005518] node 0: [mem 0x0000000000001000-0x000000000009efff] machine # [ 0.005519] node 0: [mem 0x0000000000100000-0x000000007ffd7fff] machine # [ 0.005520] node 0: [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005521] Initmem setup node 0 [mem 0x0000000000001000-0x000000017fffffff] machine # [ 0.005544] On node 0, zone DMA: 1 pages in unavailable ranges machine # [ 0.005816] On node 0, zone DMA: 97 pages in unavailable ranges machine # [ 0.080972] On node 0, zone Normal: 40 pages in unavailable ranges machine # [ 0.081461] ACPI: PM-Timer IO Port: 0x608 machine # [ 0.081476] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) machine # [ 0.081513] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 machine # [ 0.081515] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) machine # [ 0.081517] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) machine # [ 0.081519] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) machine # [ 0.081520] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) machine # [ 0.081520] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) machine # [ 0.081523] ACPI: Using ACPI (MADT) for SMP configuration information machine # [ 0.081524] ACPI: HPET id: 0x8086a201 base: 0xfed00000 machine # [ 0.081529] TSC deadline timer available machine # [ 0.081534] CPU topo: Max. logical packages: 1 machine # [ 0.081535] CPU topo: Max. logical dies: 1 machine # [ 0.081535] CPU topo: Max. dies per package: 1 machine # [ 0.081538] CPU topo: Max. threads per core: 1 machine # [ 0.081539] CPU topo: Num. cores per package: 4 machine # [ 0.081540] CPU topo: Num. threads per package: 4 machine # [ 0.081540] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs machine # [ 0.081565] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() machine # [ 0.081583] kvm-guest: KVM setup pv remote TLB flush machine # [ 0.081585] kvm-guest: setup PV sched yield machine # [ 0.081596] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] machine # [ 0.081598] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] machine # [ 0.081599] PM: hibernation: Registered nosave memory: [mem 0x7ffd8000-0xffffffff] machine # [ 0.081600] [mem 0xc0000000-0xfed1bfff] available for PCI devices machine # [ 0.081602] Booting paravirtualized kernel on KVM machine # [ 0.081606] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns machine # [ 0.086081] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 machine # [ 0.088375] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288 machine # [ 0.088428] kvm-guest: PV spinlocks enabled machine # [ 0.088430] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) machine # [ 0.088433] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/grk8wwp4yvhndymngwa4q9bsxm5jhnb4-nixos-system-machine-test/init regInfo=/nix/store/866wmm9cp3hx3dll40liaprgdwfzhpid-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.088541] Unknown kernel command line parameters "regInfo=/nix/store/866wmm9cp3hx3dll40liaprgdwfzhpid-closure-info/registration", will be passed to user space. machine # [ 0.088554] random: crng init done machine # [ 0.088555] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes machine # [ 0.093288] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) machine # [ 0.095513] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) machine # [ 0.095587] software IO TLB: area num 4. machine # [ 0.173621] Fallback order for Node 0: 0 machine # [ 0.173628] Built 1 zonelists, mobility grouping on. Total pages: 1048438 machine # [ 0.173631] Policy zone: Normal machine # [ 0.176238] mem auto-init: stack:all(zero), heap alloc:on, heap free:off machine # [ 0.184028] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 machine # [ 0.193560] allocated 8388608 bytes of page_ext machine # [ 0.203678] ftrace: allocating 48731 entries in 192 pages machine # [ 0.203681] ftrace: allocated 192 pages with 2 groups machine # [ 0.204601] Dynamic Preempt: lazy machine # [ 0.204793] rcu: Preemptible hierarchical RCU implementation. machine # [ 0.204794] rcu: RCU event tracing is enabled. machine # [ 0.204795] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. machine # [ 0.204796] Trampoline variant of Tasks RCU enabled. machine # [ 0.204797] Rude variant of Tasks RCU enabled. machine # [ 0.204797] Tracing variant of Tasks RCU enabled. machine # [ 0.204798] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. machine # [ 0.204799] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 machine # [ 0.204826] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.204828] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.204829] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.209276] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16 machine # [ 0.209569] rcu: srcu_init: Setting srcu_struct sizes based on contention. machine # [ 0.209579] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns machine # [ 0.209693] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) machine # [ 0.213308] Console: colour VGA+ 80x25 machine # [ 0.213312] printk: legacy console [tty0] enabled machine # [ 0.245001] printk: legacy console [ttyS0] enabled machine # [ 0.358201] ACPI: Core revision 20250807 machine # [ 0.359142] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns machine # [ 0.360794] APIC: Switch to symmetric I/O mode setup machine # [ 0.361874] x2apic enabled machine # [ 0.362641] APIC: Switched APIC routing to: physical x2apic machine # [ 0.363590] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask() machine # [ 0.364863] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself() machine # [ 0.366455] kvm-guest: setup PV IPIs machine # [ 0.368081] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 machine # [ 0.369150] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.373540] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) machine # [ 0.375625] x86/cpu: User Mode Instruction Prevention (UMIP) activated machine # [ 0.376654] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 machine # [ 0.377537] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 machine # [ 0.378541] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto machine # [ 0.380537] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl machine # [ 0.381537] Transient Scheduler Attacks: Vulnerable: No microcode machine # [ 0.382536] Spectre V2 : Mitigation: Enhanced / Automatic IBRS machine # [ 0.383531] Speculative Return Stack Overflow: Mitigation: Safe RET machine # [ 0.384536] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization machine # [ 0.385545] Spectre V2 : Enabling IBPB for BPF machine # [ 0.386537] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier machine # [ 0.387537] active return thunk: srso_alias_return_thunk machine # [ 0.388558] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' machine # [ 0.389536] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' machine # [ 0.390536] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' machine # [ 0.391537] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' machine # [ 0.392537] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' machine # [ 0.393536] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' machine # [ 0.395414] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' machine # [ 0.396537] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 machine # [ 0.397536] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 machine # [ 0.398536] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 machine # [ 0.399536] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 machine # [ 0.400537] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 machine # [ 0.401536] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. machine # [ 0.431444] Freeing SMP alternatives memory: 44K machine # [ 0.432173] pid_max: default: 32768 minimum: 301 machine # [ 0.432650] LSM: initializing lsm=capability,landlock,yama,bpf,ima machine # [ 0.433647] landlock: Up and running. machine # [ 0.435020] Yama: becoming mindful. machine # [ 0.435749] LSM support for eBPF active machine # [ 0.436738] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.437661] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.440919] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) machine # [ 0.442126] Performance Events: Fam17h+ core perfctr, AMD PMU driver. machine # [ 0.442546] ... version: 2 machine # [ 0.443315] ... bit width: 48 machine # [ 0.443539] ... generic counters: 6 machine # [ 0.444293] ... generic bitmap: 000000000000003f machine # [ 0.444539] ... fixed-purpose counters: 0 machine # [ 0.445304] ... fixed-purpose bitmap: 0000000000000000 machine # [ 0.446276] ... value mask: 0000ffffffffffff machine # [ 0.446539] ... max period: 00007fffffffffff machine # [ 0.447507] ... global_ctrl mask: 000000000000003f machine # [ 0.448409] signal: max sigframe size: 3376 machine # [ 0.449236] rcu: Hierarchical SRCU implementation. machine # [ 0.449542] rcu: Max phase no-delay instances is 400. machine # [ 0.450654] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level machine # [ 0.456137] smp: Bringing up secondary CPUs ... machine # [ 0.456952] smpboot: x86: Booting SMP configuration: machine # [ 0.457542] .... node #0, CPUs: #1 #2 #3 machine # [ 0.460616] smp: Brought up 1 node, 4 CPUs machine # [ 0.462267] smpboot: Total of 4 processors activated (19200.09 BogoMIPS) machine # [ 0.462990] Memory: 3957580K/4193752K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 220888K reserved, 0K cma-reserved) machine # [ 0.464045] devtmpfs: initialized machine # [ 0.465262] x86/mm: Memory block size: 128MB machine # [ 0.467721] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.469633] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). machine # [ 0.470622] pinctrl core: initialized pinctrl subsystem machine # [ 0.471850] PM: RTC time: 12:53:42, date: 2026-09-21 machine # [ 0.475867] NET: Registered PF_NETLINK/PF_ROUTE protocol family machine # [ 0.477374] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations machine # [ 0.478539] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations machine # [ 0.480126] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations machine # [ 0.480551] audit: initializing netlink subsys (disabled) machine # [ 0.481569] audit: type=2000 audit(1789995223.675:1): state=initialized audit_enabled=0 res=1 machine # [ 0.481818] thermal_sys: Registered thermal governor 'fair_share' machine # [ 0.483540] thermal_sys: Registered thermal governor 'bang_bang' machine # [ 0.484540] thermal_sys: Registered thermal governor 'step_wise' machine # [ 0.485539] thermal_sys: Registered thermal governor 'user_space' machine # [ 0.486539] thermal_sys: Registered thermal governor 'power_allocator' machine # [ 0.487556] cpuidle: using governor menu machine # [ 0.489734] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 machine # [ 0.490812] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] machine # [ 0.491542] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry machine # [ 0.492553] PCI: Using configuration type 1 for base access machine # [ 0.493669] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. machine # [ 0.496655] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages machine # [ 0.499546] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page machine # [ 0.501546] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages machine # [ 0.504545] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page machine # [ 0.511071] ACPI: Added _OSI(Module Device) machine # [ 0.513545] ACPI: Added _OSI(Processor Device) machine # [ 0.514545] ACPI: Added _OSI(Processor Aggregator Device) machine # [ 0.524287] ACPI: 1 ACPI AML tables successfully acquired and loaded machine # [ 0.530202] ACPI: Interpreter enabled machine # [ 0.531604] ACPI: PM: (supports S0 S3 S4 S5) machine # [ 0.532547] ACPI: Using IOAPIC for interrupt routing machine # [ 0.534989] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug machine # [ 0.537543] PCI: Using E820 reservations for host bridge windows machine # [ 0.539940] ACPI: Enabled 2 GPEs in block 00 to 3F machine # [ 0.549195] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) machine # [ 0.550547] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] machine # [ 0.551632] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] machine # [ 0.553667] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] machine # [ 0.555045] PCI host bridge to bus 0000:00 machine # [ 0.555544] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] machine # [ 0.557539] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] machine # [ 0.558539] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] machine # [ 0.559540] pci_bus 0000:00: root bus resource [mem 0x80000000-0xafffffff window] machine # [ 0.560539] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] machine # [ 0.562540] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.563554] pci_bus 0000:00: root bus resource [bus 00-ff] machine # [ 0.564704] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint machine # [ 0.567031] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint machine # [ 0.580625] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] machine # [ 0.581552] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] machine # [ 0.582586] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] machine # [ 0.583721] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] machine # [ 0.586301] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.591575] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f] machine # [ 0.592513] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] machine # [ 0.593657] pci 0000:00:02.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref] machine # [ 0.596561] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] machine # [ 0.601764] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.613352] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f] machine # [ 0.615583] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] machine # [ 0.617600] pci 0000:00:03.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref] machine # [ 0.622033] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint machine # [ 0.631581] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf] machine # [ 0.634562] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] machine # [ 0.636600] pci 0000:00:04.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref] machine # [ 0.640947] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint machine # [ 0.647559] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f] machine # [ 0.650558] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] machine # [ 0.652587] pci 0000:00:05.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref] machine # [ 0.655984] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint machine # [ 0.665569] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf] machine # [ 0.667562] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] machine # [ 0.669600] pci 0000:00:06.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref] machine # [ 0.675793] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint machine # [ 0.684581] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f] machine # [ 0.686561] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] machine # [ 0.689601] pci 0000:00:07.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref] machine # [ 0.693949] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.727571] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df] machine # [ 0.729564] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] machine # [ 0.731601] pci 0000:00:08.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref] machine # [ 0.734561] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref] machine # [ 0.738996] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint machine # [ 0.745578] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] machine # [ 0.748601] pci 0000:00:09.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref] machine # [ 0.752968] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint machine # [ 0.762584] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff] machine # [ 0.765562] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] machine # [ 0.767599] pci 0000:00:0a.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref] machine # [ 0.772044] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.780571] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff] machine # [ 0.782557] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] machine # [ 0.784587] pci 0000:00:0b.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref] machine # [ 0.788722] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.793011] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f] machine # [ 0.795040] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.800635] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f] machine # [ 0.804051] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.809632] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f] machine # [ 0.812107] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint machine # [ 0.817561] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] machine # [ 0.821097] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint machine # [ 0.825289] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO machine # [ 0.830280] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint machine # [ 0.837633] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f] machine # [ 0.839561] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] machine # [ 0.842424] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint machine # [ 0.848279] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] machine # [ 0.855696] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 machine # [ 0.858768] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 machine # [ 0.861234] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 machine # [ 0.863782] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 machine # [ 0.865750] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 machine # [ 0.867739] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 machine # [ 0.869745] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 machine # [ 0.871738] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 machine # [ 0.874620] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 machine # [ 0.876578] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 machine # [ 0.878569] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 machine # [ 0.880567] ACPI: PCI: Interrupt link GSID configured for IRQ 19 machine # [ 0.882573] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 machine # [ 0.884578] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 machine # [ 0.886578] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 machine # [ 0.888577] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 machine # [ 0.893754] iommu: Default domain type: Translated machine # [ 0.895545] iommu: DMA domain TLB invalidation policy: lazy mode machine # [ 0.898071] ACPI: bus type USB registered machine # [ 0.899647] usbcore: registered new interface driver usbfs machine # [ 0.901627] usbcore: registered new interface driver hub machine # [ 0.903663] usbcore: registered new device driver usb machine # [ 0.907391] NetLabel: Initializing machine # [ 0.909420] NetLabel: domain hash size = 128 machine # [ 0.910542] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO machine # [ 0.912693] NetLabel: unlabeled traffic allowed by default machine # [ 0.914567] PCI: Using ACPI for IRQ routing machine # [ 0.976743] pci 0000:00:01.0: vgaarb: setting as boot VGA device machine # [ 0.977535] pci 0000:00:01.0: vgaarb: bridge control possible machine # [ 0.977535] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none machine # [ 0.980544] vgaarb: loaded machine # [ 0.981320] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 machine # [ 0.981539] hpet0: 3 comparators, 64-bit 100.000000 MHz counter machine # [ 0.987713] clocksource: Switched to clocksource kvm-clock machine # [ 0.990446] VFS: Disk quotas dquot_6.6.0 machine # [ 0.991197] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) machine # [ 0.992736] pnp: PnP ACPI init machine # [ 0.993625] ACPI: IRQ 4 override to edge(!), high(!) machine # [ 0.994632] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved machine # [ 0.996234] pnp: PnP ACPI: found 6 devices machine # [ 1.006323] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns machine # [ 1.007875] clocksource: Switched to clocksource acpi_pm machine # [ 1.008937] NET: Registered PF_INET protocol family machine # [ 1.010504] IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear) machine # [ 1.028369] tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 1.029847] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) machine # [ 1.031231] TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear) machine # [ 1.032608] TCP bind hash table entries: 32768 (order: 8, 1048576 bytes, linear) machine # [ 1.033894] TCP: Hash tables configured (established 32768 bind 32768) machine # [ 1.035248] MPTCP token hash table entries: 4096 (order: 5, 98304 bytes, linear) machine # [ 1.036857] UDP hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 1.038119] UDP-Lite hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 1.039430] NET: Registered PF_UNIX/PF_LOCAL protocol family machine # [ 1.040421] NET: Registered PF_XDP protocol family machine # [ 1.041297] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] machine # [ 1.042328] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] machine # [ 1.043367] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] machine # [ 1.044487] pci_bus 0000:00: resource 7 [mem 0x80000000-0xafffffff window] machine # [ 1.045610] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] machine # [ 1.046729] pci_bus 0000:00: resource 9 [mem 0xe0000000000-0xe07ffffffff window] machine # [ 1.048600] ACPI: \_SB_.GSIA: Enabled at IRQ 16 machine # [ 1.050779] ACPI: \_SB_.GSIB: Enabled at IRQ 17 machine # [ 1.053003] ACPI: \_SB_.GSIC: Enabled at IRQ 18 machine # [ 1.055041] ACPI: \_SB_.GSID: Enabled at IRQ 19 machine # [ 1.056749] PCI: CLS 0 bytes, default 64 machine # [ 1.057601] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) machine # [ 1.058056] Trying to unpack rootfs image as initramfs... machine # [ 1.058672] software IO TLB: mapped [mem 0x000000007a367000-0x000000007e367000] (64MB) machine # [ 1.061467] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 1.082437] Initialise system trusted keyrings machine # [ 1.083617] workingset: timestamp_bits=40 max_order=20 bucket_order=0 machine # [ 1.095244] Key type asymmetric registered machine # [ 1.095972] Asymmetric key parser 'x509' registered machine # [ 1.096883] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) machine # [ 1.098450] io scheduler mq-deadline registered machine # [ 1.099248] io scheduler kyber registered machine # [ 1.104441] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled machine # [ 1.105729] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A machine # [ 1.108149] Linux agpgart interface v0.103 machine # [ 1.108924] ACPI: bus type drm_connector registered machine # [ 1.111391] usbcore: registered new interface driver usbserial_generic machine # [ 1.112528] usbserial: USB Serial support registered for generic machine # [ 1.113570] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. machine # [ 1.113570] Please enable it if your BIOS has the CPPC option. machine # [ 1.115945] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled machine # [ 1.117434] drop_monitor: Initializing network drop monitor service machine # [ 1.118682] NET: Registered PF_INET6 protocol family machine # [ 1.120725] Segment Routing with IPv6 machine # [ 1.121484] In-situ OAM (IOAM) with IPv6 machine # [ 1.124394] IPI shorthand broadcast: enabled machine # [ 1.128825] sched_clock: Marking stable (973010605, 154957101)->(1151649022, -23681316) machine # [ 1.130659] registered taskstats version 1 machine # [ 1.131810] Loading compiled-in X.509 certificates machine # [ 1.142221] Demotion targets for Node 0: null machine # [ 1.143253] Key type .fscrypt registered machine # [ 1.143943] Key type fscrypt-provisioning registered machine # [ 1.144939] ima: No TPM chip found, activating TPM-bypass! machine # [ 1.145892] ima: Allocated hash algorithm: sha1 machine # [ 1.146741] ima: No architecture policies found machine # [ 1.147876] PM: Magic number: 10:209:886 machine # [ 1.149583] RAS: Correctable Errors collector initialized. machine # [ 1.154086] clk: Disabling unused clocks machine # [ 1.154813] PM: genpd: Disabling unused power domains machine # [ 1.351065] Freeing initrd memory: 29092K machine # [ 1.356573] Freeing unused decrypted memory: 2028K machine # [ 1.362444] Freeing unused kernel image (initmem) memory: 3644K machine # [ 1.365220] Write protecting the kernel read-only data: 32768k machine # [ 1.370091] Freeing unused kernel image (text/rodata gap) memory: 1208K machine # [ 1.373924] Freeing unused kernel image (rodata/data gap) memory: 752K machine # [ 1.442195] x86/mm: Checked W+X mappings: passed, no W+X pages found. machine # [ 1.443404] Run /init as init process machine # [ 1.455168] systemd[1]: Inserted module 'autofs4' machine # [ 1.477535] fuse: init (API version 7.45) machine # [ 1.484914] ACPI: \_SB_.GSIG: Enabled at IRQ 22 machine # [ 1.487502] ACPI: \_SB_.GSIH: Enabled at IRQ 23 machine # [ 1.490640] ACPI: \_SB_.GSIE: Enabled at IRQ 20 machine # [ 1.493059] ACPI: \_SB_.GSIF: Enabled at IRQ 21 machine # [ 1.540107] systemd[1]: Successfully made /usr/ read-only. machine # [ 1.879169] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 1.891426] systemd[1]: Detected virtualization kvm. machine # [ 1.893595] systemd[1]: Detected architecture x86-64. machine # [ 1.895820] systemd[1]: Running in initrd. machine # [ 1.898520] systemd[1]: Initializing machine ID from random generator. machine # [ 1.901666] systemd[1]: Hostname set to . machine # [ 2.034192] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 2.073440] systemd[1]: Queued start job for default target Initrd Default Target. machine # [ 2.082689] systemd[1]: Created slice Slice /system/modprobe. machine # [ 2.083904] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 2.085387] systemd[1]: Expecting device /dev/disk/by-label/nixos... machine # [ 2.086537] systemd[1]: Reached target Path Units. machine # [ 2.087444] systemd[1]: Reached target Slice Units. machine # [ 2.088379] systemd[1]: Reached target Swaps. machine # [ 2.089231] systemd[1]: Reached target Timer Units. machine # [ 2.090216] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 2.091457] systemd[1]: Listening on Journal Socket (/dev/log). machine # [ 2.092618] systemd[1]: Listening on Journal Sockets. machine # [ 2.093671] systemd[1]: Listening on udev Control Socket. machine # [ 2.094765] systemd[1]: Listening on udev Kernel Socket. machine # [ 2.095761] systemd[1]: Reached target Socket Units. machine # [ 2.097704] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 2.099834] systemd[1]: Starting Load Kernel Module 9pnet_virtio... machine # [ 2.101852] systemd[1]: Starting Load Kernel Module configfs... machine # [ 2.106046] systemd[1]: Starting Journal Service... machine # [ 2.108336] systemd[1]: Starting Load Kernel Modules... machine # [ 2.109366] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 2.118234] systemd[1]: Starting Coldplug All udev Devices... machine # [ 2.123532] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 2.129514] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 2.140947] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 2.146688] systemd-journald[92]: Collecting audit messages is disabled. machine # [ 2.158529] netfs: FS-Cache loaded machine # [ 2.160083] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. machine # [ 2.163102] systemd[1]: Finished Load Kernel Module configfs. machine # [ 2.163173] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev machine # [ 2.169031] 9pnet: Installing 9P2000 support machine # [ 2.170093] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config machine # [ 2.175516] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 2.177995] systemd[1]: Finished Load Kernel Modules. machine # [ 2.179250] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. machine # [ 2.180985] systemd[1]: Finished Load Kernel Module 9pnet_virtio. machine # [ 2.183255] systemd[1]: Starting Apply Kernel Variables... machine # [ 2.185153] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 2.042438] systemd-modules-load[93]: Using 4 probe threads machine # [ 2.198200] systemd[1]: Started Journal Service. machine # [ 2.044630] systemd-modules-load[93]: Inserted module 'virtio_gpu' machine # [ 2.046450] systemd-modules-load[93]: Inserted module 'dm_mod' machine # [ 2.047503] systemd-modules-load[93]: Inserted module 'virtio_balloon' machine # [ 2.052036] systemd[1]: Finished Apply Kernel Variables. machine # [ 2.053103] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 2.054125] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 2.055079] systemd[1]: Reached target Local File Systems. machine # [ 2.055978] systemd[1]: Starting Create System Files and Directories... machine # [ 2.057062] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 2.080839] systemd[1]: Finished Create System Files and Directories. machine # [ 2.089626] systemd-udevd[113]: Using default interface naming scheme 'v261'. machine # [ 2.100844] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 2.106867] systemd[1]: Finished Coldplug All udev Devices. machine # [ 2.108449] systemd[1]: Reached target System Initialization. machine # [ 2.109924] systemd[1]: Reached target Basic System. machine # [ 2.364378] uhci_hcd 0000:00:1d.0: UHCI Host Controller machine # [ 2.365293] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 1 machine # [ 2.366438] uhci_hcd 0000:00:1d.0: detected 2 ports machine # [ 2.368352] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c200 machine # [ 2.370096] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.371405] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.372532] usb usb1: Product: UHCI Host Controller machine # [ 2.373297] usb usb1: Manufacturer: Linux 6.18.50 uhci_hcd machine # [ 2.374152] usb usb1: SerialNumber: 0000:00:1d.0 machine # [ 2.381027] SCSI subsystem initialized machine # [ 2.381408] virtio_blk virtio5: 4/0/0 default/read/poll queues machine # [ 2.384678] virtio_blk virtio5: [vda] 33554432 512-byte logical blocks (17.2 GB/16.0 GiB) machine # [ 2.385011] hub 1-0:1.0: USB hub found machine # [ 2.387580] hub 1-0:1.0: 2 ports detected machine # [ 2.391591] uhci_hcd 0000:00:1d.1: UHCI Host Controller machine # [ 2.392437] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 2 machine # [ 2.393536] uhci_hcd 0000:00:1d.1: detected 2 ports machine # [ 2.401873] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c220 machine # [ 2.405230] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.406483] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.406802] usb usb2: Product: UHCI Host Controller machine # [ 2.409249] usb usb2: Manufacturer: Linux 6.18.50 uhci_hcd machine # [ 2.410091] usb usb2: SerialNumber: 0000:00:1d.1 machine # [ 2.412534] hub 2-0:1.0: USB hub found machine # [ 2.413430] hub 2-0:1.0: 2 ports detected machine # [ 2.277592] (udev-worker)[129]: Network interface NamePolicy= disabled on kernel command line. machine # [ 2.279173] (udev-worker)[132]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 2.281475] (udev-worker)[132]: Network interface NamePolicy= disabled on kernel command line. machine # [ 2.286058] systemd[1]: Starting Virtual Console Setup... machine # [ 2.292565] systemd[1]: Found device /dev/disk/by-label/nixos. machine # [ 2.293579] systemd[1]: Reached target Initrd Root Device. machine # [ 2.295151] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... machine # [ 2.457237] ehci-pci 0000:00:1d.7: EHCI Host Controller machine # [ 2.303289] systemd-vconsole-setup[148]: 2.458050] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 3 machine # 1;39mConfigurati[ 2.458311] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 machine # on of first virtual console was skipped, ignoring remaining ones. machine # [ 2.307742] systemd[1]: Finished Virtual Console Setup. machine # [ 2.466000] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 machine # [ 2.466876] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 machine # [ 2.468115] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.469378] usb usb3: Product: EHCI Host Controller machine # [ 2.470316] usb usb3: Manufacturer: Linux 6.18.50 ehci_hcd machine # [ 2.471316] usb usb3: SerialNumber: 0000:00:1d.7 machine # [ 2.472555] hub 3-0:1.0: USB hub found machine # [ 2.473429] hub 3-0:1.0: 6 ports detected machine # [ 2.323145] systemd-fsck[154]: nixos: clean, 12/1048576 files, 109865/4194304 blocks machine # [ 2.326671] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. machine # [ 2.496133] hub 1-0:1.0: USB hub found machine # [ 2.496837] hub 1-0:1.0: 2 ports detected machine # [ 2.519106] hub 2-0:1.0: USB hub found machine # [ 2.519744] hub 2-0:1.0: 2 ports detected machine # [ 2.520579] uhci_hcd 0000:00:1d.2: UHCI Host Controller machine # [ 2.521450] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 machine # [ 2.522592] uhci_hcd 0000:00:1d.2: detected 2 ports machine # [ 2.524222] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c240 machine # [ 2.526007] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.527286] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.528449] usb usb4: Product: UHCI Host Controller machine # [ 2.529254] usb usb4: Manufacturer: Linux 6.18.50 uhci_hcd machine # [ 2.530095] usb usb4: SerialNumber: 0000:00:1d.2 machine # [ 2.531363] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 machine # [ 2.532851] hub 4-0:1.0: USB hub found machine # [ 2.533732] hub 4-0:1.0: 2 ports detected machine # [ 2.533894] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode machine # [ 2.534135] serio: i8042 KBD port at 0x60,0x64 irq 1 machine # [ 2.534143] serio: i8042 AUX port at 0x60,0x64 irq 12 machine # [ 2.537432] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) machine # [ 2.538371] ahci 0000:00:1f.2: flags: 64bit ncq only machine # [ 2.542729] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 machine # [ 2.544641] scsi host0: ahci machine # [ 2.545706] scsi host1: ahci machine # [ 2.547993] scsi host2: ahci machine # [ 2.550039] scsi host3: ahci machine # [ 2.551211] scsi host4: ahci machine # [ 2.552364] scsi host5: ahci machine # [ 2.553021] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 machine # [ 2.554204] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 machine # [ 2.555421] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 machine # [ 2.556606] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 machine # [ 2.557800] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 machine # [ 2.558986] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 machine # [ 2.716137] usb 3-1: new high-speed USB device number 2 using ehci-pci machine # [ 2.847021] usb 3-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 machine # [ 2.850040] usb 3-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 machine # [ 2.852824] usb 3-1: Product: QEMU USB Tablet machine # [ 2.854546] usb 3-1: Manufacturer: QEMU machine # [ 2.856084] usb 3-1: SerialNumber: 28754-0000:00:1d.7-1 machine # [ 2.880540] hid: raw HID events driver (C) Jiri Kosina machine # [ 2.882305] ata2: SATA link down (SStatus 0 SControl 300) machine # [ 2.884604] ata6: SATA link down (SStatus 0 SControl 300) machine # [ 2.887067] ata4: SATA link down (SStatus 0 SControl 300) machine # [ 2.889343] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) machine # [ 2.891861] ata5: SATA link down (SStatus 0 SControl 300) machine # [ 2.894109] ata1: SATA link down (SStatus 0 SControl 300) machine # [ 2.895768] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 machine # [ 2.897830] ata3.00: applying bridge limits machine # [ 2.899697] ata3.00: configured for UDMA/100 machine # [ 2.902117] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 machine # [ 2.936081] usbcore: registered new interface driver usbhid machine # [ 2.938127] usbhid: USB HID core driver machine # [ 2.947319] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb3/3-1/3-1:1.0/0003:0627:0001.0001/input/input2 machine # [ 2.951555] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 machine # [ 2.972495] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray machine # [ 3.002351] cdrom: Uniform CD-ROM driver Revision: 3.20 machine # [ 2.969387] systemd[1]: Mounting /sysroot... machine # [ 3.268357] EXT4-fs (vda): mounted filesystem dce2beee-4547-4590-97a9-df35ff495d1f r/w with ordered data mode. Quota mode: none. machine # [ 3.129560] systemd[1]: Mounted /sysroot. machine # [ 3.131318] systemd[1]: Reached target Initrd Root File System. machine # [ 3.134065] systemd[1]: Mounting /sysroot/nix/.ro-store... machine # [ 3.136100] systemd[1]: Mounting /sysroot/nix/.rw-store... machine # [ 3.143724] systemd[1]: Mounting /sysroot/run... machine # [ 3.148199] systemd[1]: Mounting /sysroot/tmp/shared... machine # [ 3.150204] systemd[1]: Mounting /sysroot/tmp/xchg... machine # [ 3.155303] systemd[1]: Starting Mountpoints Configured in the Real Root... machine # [ 3.161206] systemd[1]: Mounted /sysroot/nix/.rw-store. machine # [ 3.319003] 9p: Installing v9fs 9p2000 file system support machine # [ 3.166783] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.173351] systemd[1]: Mounted /sysroot/nix/.ro-store. machine # [ 3.174787] systemd[1]: Mounted /sysroot/tmp/shared. machine # [ 3.178494] systemd[1]: Mounted /sysroot/run. machine # [ 3.180422] systemd-sysroot-fstab-check[195]: /sysroot should be mounted in the initrd, will request daemon-reload. machine # [ 3.183193] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.185226] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.186741] systemd[1]: Reload requested from client PID 195 ('systemd-sysroot') (unit initrd-parse-etc.service)... machine # [ 3.189479] systemd[1]: Reloading... machine # [ 3.239989] systemd[1]: Reloading finished in 56 ms. machine # [ 3.259190] systemd-sysroot-fstab-check[195]: Requesting initrd-fs.target/start/replace... machine # [ 3.262157] systemd[1]: Mounted /sysroot/tmp/xchg. machine # [ 3.263995] systemd-sysroot-fstab-check[195]: Requesting swap.target/start/replace... machine # [ 3.266792] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.268983] systemd[1]: initrd-parse-etc.service: Deactivated successfully. machine # [ 3.271454] systemd[1]: Finished Mountpoints Configured in the Real Root. machine # [ 3.273870] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. machine # [ 3.292813] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.295224] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.970167] systemd[1]: Mounting /sysroot/nix/store... machine # [ 4.023509] systemd[1]: Mounted /sysroot/nix/store. machine # [ 4.025496] systemd[1]: Reached target Initrd File Systems. machine # [ 4.027529] systemd[1]: Starting Find NixOS closure... machine # [ 4.028493] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... machine # [ 4.050864] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. machine # [ 4.052111] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. machine # [ 4.066607] systemd[1]: Finished Find NixOS closure. machine # [ 4.067731] systemd[1]: Reached target Initrd Default Target. machine # [ 4.069695] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... machine # [ 4.093712] systemd[1]: Stopped target Initrd Default Target. machine # [ 4.096400] systemd[1]: Stopped target Basic System. machine # [ 4.098435] systemd[1]: Stopped target Initrd Root Device. machine # [ 4.100654] systemd[1]: Stopped target Path Units. machine # [ 4.102562] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. machine # [ 4.108354] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. machine # [ 4.111289] systemd[1]: Stopped target Slice Units. machine # [ 4.113515] systemd[1]: Stopped target Socket Units. machine # [ 4.115719] systemd[1]: Stopped target System Initialization. machine # [ 4.119466] systemd[1]: Stopped target Swaps. machine # [ 4.121262] systemd[1]: Stopped target Timer Units. machine # [ 4.122091] systemd[1]: dbus.socket: Deactivated successfully. machine # [ 4.122955] systemd[1]: Closed D-Bus System Message Bus Socket. machine # [ 4.123964] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. machine # [ 4.125249] systemd[1]: Stopped Find NixOS closure. machine # [ 4.126051] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio machine # [ 4.127657] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 4.128573] systemd[1]: systemd-sysctl.service: Deactivated successfully. machine # [ 4.129836] systemd[1]: Stopped Apply Kernel Variables. machine # [ 4.130646] systemd[1]: systemd-modules-load.service: Deactivated successfully. machine # [ 4.131751] systemd[1]: Stopped Load Kernel Modules. machine # [ 4.132557] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. machine # [ 4.133746] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. machine # [ 4.134885] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. machine # [ 4.135959] systemd[1]: Stopped Create System Files and Directories. machine # [ 4.136993] systemd[1]: Stopped target Local File Systems. machine # [ 4.137851] systemd[1]: Stopped target Preparation for Local File Systems. machine # [ 4.138902] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. machine # [ 4.139961] systemd[1]: Stopped Coldplug All udev Devices. machine # [ 4.140791] systemd[1]: Stopping Rule-based Manager for Device Events and Files... machine # [ 4.141883] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 4.142983] systemd[1]: Stopped Virtual Console Setup. machine # [ 4.143791] systemd[1]: initrd-cleanup.service: Deactivated successfully. machine # [ 4.144868] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. machine # [ 4.145911] systemd[1]: systemd-udevd.service: Deactivated successfully. machine # [ 4.147103] systemd[1]: Stopped Rule-based Manager for Device Events and Files. machine # [ 4.148156] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 4.149152] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 4.150001] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. machine # [ 4.151058] systemd[1]: Closed udev Control Socket. machine # [ 4.151822] systemd[1]: Starting Cleanup udev Database... machine # [ 4.152674] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. machine # [ 4.153756] systemd[1]: Stopped Create Static Device Nodes in /dev. machine # [ 4.154729] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. machine # [ 4.155911] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. machine # [ 4.156950] systemd[1]: kmod-static-nodes.service: Deactivated successfully. machine # [ 4.157929] systemd[1]: Stopped Create List of Static Device Nodes. machine # [ 4.168869] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. machine # [ 4.170147] systemd[1]: Finished Cleanup udev Database. machine # [ 4.171263] systemd[1]: Reached target Switch Root. machine # [ 4.173343] systemd[1]: Starting NixOS Activation... machine # [ 4.366303] initrd-nixos-activation-start[244]: booting system configuration /nix/store/grk8wwp4yvhndymngwa4q9bsxm5jhnb4-nixos-system-machine-test machine # [ 4.437396] initrd-nixos-activation-start[244]: running activation script... machine # [ 4.848495] initrd-nixos-activation-start[267]: setting up /etc... machine # [ 5.068565] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. machine # [ 5.069883] systemd[1]: Finished NixOS Activation. machine # [ 5.072139] systemd[1]: Starting Switch Root... machine # [ 5.096534] systemd[1]: Switching root. machine # [ 5.311352] systemd-journald[92]: Received SIGTERM from PID 1 (systemd). machine # [ 5.472252] NET: Registered PF_VSOCK protocol family machine # [ 5.875981] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 5.882179] systemd[1]: Detected virtualization kvm. machine # [ 5.884003] systemd[1]: Detected architecture x86-64. machine # [ 5.886000] systemd[1]: Detected first boot. machine # [ 5.893524] systemd[1]: Initializing machine ID from random generator. machine # [ 6.041857] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 6.158579] systemd[1]: Applying preset policy. machine # [ 6.637548] systemd[1]: Populated /etc with preset unit settings. machine # [ 7.186773] systemd[1]: initrd-switch-root.service: Deactivated successfully. machine # [ 7.188262] systemd[1]: Stopped initrd-switch-root.service. machine # [ 7.191112] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. machine # [ 7.193331] systemd[1]: Created slice Slice /system/getty. machine # [ 7.194775] systemd[1]: Created slice User and Session Slice. machine # [ 7.195676] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 7.197019] systemd[1]: Started Forward Password Requests to Wall Directory Watch. machine # [ 7.198332] systemd[1]: Expecting device /dev/hvc0... machine # [ 7.199192] systemd[1]: Expecting device /dev/ttyS0... machine # [ 7.200033] systemd[1]: Reached target Local Encrypted Volumes. machine # [ 7.200887] systemd[1]: Stopped target initrd-fs.target. machine # [ 7.201653] systemd[1]: Stopped target initrd-root-fs.target. machine # [ 7.202530] systemd[1]: Stopped target initrd-switch-root.target. machine # [ 7.203424] systemd[1]: Reached target Virtual Machines and Containers. machine # [ 7.204377] systemd[1]: Reached target Path Units. machine # [ 7.205147] systemd[1]: Reached target Remote File Systems. machine # [ 7.206065] systemd[1]: Reached target Slice Units. machine # [ 7.206770] systemd[1]: Reached target Swaps. machine # [ 7.210210] systemd[1]: Listening on Query the User Interactively for a Password. machine # [ 7.214418] systemd[1]: Listening on Process Core Dump Socket. machine # [ 7.217609] systemd[1]: Listening on Credential Encryption/Decryption. machine # [ 7.220796] systemd[1]: Listening on Factory Reset Management. machine # [ 7.223240] systemd[1]: Listening on Hostname Service Socket. machine # [ 7.231205] systemd[1]: Starting Journal Log Access Socket... machine # [ 7.234542] systemd[1]: Listening on Journal Audit Socket. machine # [ 7.240340] systemd[1]: Listening on Console Output Muting Service Socket. machine # [ 7.243164] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. machine # [ 7.246130] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os machine # [ 7.248870] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki machine # [ 7.262914] systemd[1]: Listening on Disk Repartitioning Service Socket. machine # [ 7.264987] systemd[1]: Listening on udev Control Socket. machine # [ 7.265920] systemd[1]: Listening on udev Varlink Socket. machine # [ 7.271211] systemd[1]: Mounting Huge Pages File System... machine # [ 7.274178] systemd[1]: Mounting POSIX Message Queue File System... machine # [ 7.277277] systemd[1]: Mounting Kernel Debug File System... machine # [ 7.280150] systemd[1]: Mounting Kernel Trace File System... machine # [ 7.294044] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 7.295710] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio machine # [ 7.300045] systemd[1]: Starting Load Kernel Module configfs... machine # [ 7.302014] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm machine # [ 7.304535] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 7.307264] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 7.312396] systemd[1]: Mounting FUSE Control File System... machine # [ 7.315099] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 7.338382] systemd[1]: Starting Journal Service... machine # [ 7.347419] systemd[1]: Starting Load Kernel Modules... machine # [ 7.358680] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... machine # [ 7.364827] systemd[1]: Starting Remount Root and Kernel File Systems... machine # [ 7.368900] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 7.375966] systemd[1]: Starting Coldplug All udev Devices... machine # [ 7.379616] systemd[1]: Listening on Journal Log Access Socket. machine # [ 7.381232] systemd[1]: Mounted Huge Pages File System. machine # [ 7.382197] systemd[1]: Mounted POSIX Message Queue File System. machine # [ 7.383488] systemd[1]: Mounted Kernel Debug File System. machine # [ 7.385818] systemd[1]: Mounted Kernel Trace File System. machine # [ 7.387583] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 7.390619] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 7.393444] systemd[1]: Finished Load Kernel Module configfs. machine # [ 7.395963] systemd[1]: Mounted FUSE Control File System. machine # [ 7.399803] systemd-journald[337]: Collecting audit messages is enabled. machine # [ 7.400064] systemd[1]: Mounting Kernel Configuration File System... machine # [ 7.405256] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 7.262826] systemd[1]: Queued start job for default target Multi-User System. machine # [ 7.417363] systemd[1]: Started Journal Service. machine # [ 7.420257] EXT4-fs (vda): re-mounted dce2beee-4547-4590-97a9-df35ff495d1f. machine # [ 7.264889] systemd[1]: systemd-journald.service: Deactivated successfully. machine # [ 7.269413] systemd-modules-load[339]: Using 2 probe threads machine # [ 7.271622] systemd[1]: Finished Remount Root and Kernel File Systems. machine # [ 7.277142] systemd[1]: Listening on Disk Image Download Service Socket. machine # [ 7.279484] systemd[1]: Starting Flush Journal to Persistent Storage... machine # [ 7.281536] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 7.284223] systemd[1]: Starting Load/Save OS Random Seed... machine # [ 7.285206] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 7.442242] loop: module loaded machine # [ 7.288214] systemd[1]: Mounted Kernel Configuration File System. machine # [ 7.289191] systemd-modules-load[339]: Inserted module 'loop' machine # [ 7.293677] systemd[1]: Finished Load Kernel Modules. machine # [ 7.296083] systemd[1]: Starting Apply Kernel Variables... machine # [ 7.306104] systemd-oomd[340]: No swap; memory pressure usage will be degraded machine # [ 7.471056] systemd-journald[337]: Received client request to flush runtime journal. machine # [ 7.365712] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. machine # [ 7.366940] systemd[1]: Finished Load/Save OS Random Seed. machine # [ 7.368051] systemd[1]: Reached target First Boot Complete. machine # [ 7.369116] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 7.370364] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 7.371554] systemd[1]: Finished Apply Kernel Variables. machine # [ 7.372506] systemd[1]: Finished Flush Journal to Persistent Storage. machine # [ 7.401655] systemd[1]: Finished Coldplug All udev Devices. machine # [ 7.403197] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 7.404651] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 7.407619] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 7.466381] systemd-udevd[370]: Using default interface naming scheme 'v261'. machine # [ 7.569650] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 7.640102] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 7.663808] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. machine # [ 7.666350] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. machine # [ 7.684494] (udev-worker)[388]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 7.689531] (udev-worker)[388]: Network interface NamePolicy= disabled on kernel command line. machine # [ 7.692734] (udev-worker)[386]: Network interface NamePolicy= disabled on kernel command line. machine # [ 7.714190] systemd[1]: Condition check resulted in Virtio network device being skipped. machine # [ 7.715455] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 7.717381] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 7.720273] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 7.721963] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 7.723985] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 7.890034] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:09.0/virtio7/input/input3 machine # [ 7.895465] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console machine # [ 7.898211] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input4 machine # [ 7.908037] Console: switching to colour dummy device 80x25 machine # [ 7.909769] [drm] Found bochs VGA, ID 0xb0c5. machine # [ 7.909771] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. machine # [ 7.911181] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized machine # [ 7.917641] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic machine # [ 7.918417] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 machine # [ 7.938077] rtc_cmos 00:04: RTC can wake from S4 machine # [ 7.946532] Console: switching to colour frame buffer device 160x50 machine # [ 7.950552] mousedev: PS/2 mouse device common for all mice machine # [ 7.952539] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device machine # [ 7.954132] parport_pc 00:02: reported by Plug and Play ACPI machine # [ 7.954493] ACPI: button: Power Button [PWRF] machine # [ 7.957643] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] machine # [ 7.967568] rtc_cmos 00:04: registered as rtc0 machine # [ 7.968906] rtc_cmos 00:04: setting system clock to 2026-09-21T12:53:50 UTC (1789995230) machine # [ 7.970211] rtc_cmos 00:04: alarms up to one day, y3k, 242 bytes nvram, hpet irqs machine # [ 7.970592] systemd-journald[337]: Time jumped backwards, rotating. machine # [ 7.977362] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 machine # [ 7.977394] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt machine # [ 7.985098] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD machine # [ 7.987470] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 machine # [ 7.911415] systemd[1]: Starting Virtual Console Setup... machine # [ 8.068425] ppdev: user-space parallel port driver machine # [ 7.930929] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 7.932901] systemd[1]: Stopped Virtual Console Setup. machine # [ 7.939126] systemd[1]: Starting Virtual Console Setup... machine # [ 8.107041] iTCO_wdt iTCO_wdt.0.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) machine # [ 8.108311] iTCO_wdt iTCO_wdt.0.auto: initialized. heartbeat=30 sec (nowayout=0) machine # [ 8.132464] kvm_amd: TSC scaling supported machine # [ 8.133292] kvm_amd: Nested Virtualization enabled machine # [ 8.134136] kvm_amd: Nested Paging enabled machine # [ 8.134559] kvm_amd: LBR virtualization supported machine # [ 8.135254] kvm_amd: Virtual VMLOAD VMSAVE supported machine # [ 8.136276] kvm_amd: Virtual GIF supported machine # [ 8.137211] kvm_amd: Virtual NMI enabled machine # [ 8.174584] EDAC MC: Ver: 3.0.0 machine # [ 8.033698] systemd[1]: Mounting /run/wrappers... machine # [ 8.066885] systemd[1]: Mounted /run/wrappers. machine # [ 8.068660] systemd[1]: Reached target Local File Systems. machine # [ 8.071834] systemd[1]: Listening on Boot Loader Control Service Socket. machine # [ 8.075447] systemd[1]: Starting register-nix-paths.service... machine # [ 8.079277] systemd[1]: Starting Create SUID/SGID Wrappers... machine # [ 8.080117] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. machine # [ 8.089035] systemd[1]: Starting Save Transient machine-id to Disk... machine # [ 8.091374] systemd[1]: Starting Create System Files and Directories... machine # [ 8.122548] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. machine # [ 8.124512] systemd[1]: Finished Save Transient machine-id to Disk. machine # [ 8.148119] systemd[1]: Finished Create System Files and Directories. machine # [ 8.151430] systemd[1]: Starting Rebuild Journal Catalog... machine # [ 8.153499] systemd[1]: Starting Record System Boot/Shutdown in UTMP... machine # [ 8.187989] systemd[1]: Finished Record System Boot/Shutdown in UTMP. machine # [ 8.212276] systemd[1]: Finished Rebuild Journal Catalog. machine # [ 8.216774] systemd[1]: Starting Update is Completed... machine # [ 8.240650] systemd[1]: Finished Update is Completed. machine # [ 8.350570] systemd-vconsole-setup[412]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 8.353893] systemd[1]: Finished Virtual Console Setup. machine # [ 8.399441] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. machine # [ 8.400608] systemd[1]: Finished Create SUID/SGID Wrappers. machine # [ 8.996674] systemd[1]: Finished register-nix-paths.service. machine # [ 8.997908] systemd[1]: Reached target System Initialization. machine # [ 8.999320] systemd[1]: Started Discard unused filesystem blocks once a week. machine # [ 9.000549] systemd[1]: Started niks3 garbage collection timer. machine # [ 9.001560] systemd[1]: Started Daily Cleanup of Temporary Directories. machine # [ 9.002671] systemd[1]: Reached target Timer Units. machine # [ 9.003547] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 9.011572] systemd[1]: Listening on niks3 server socket. machine # [ 9.012590] systemd[1]: Listening on Nix Daemon Socket. machine # [ 9.013567] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. machine # [ 9.014924] systemd[1]: Reached target Socket Units. machine # [ 9.015786] systemd[1]: Reached target Basic System. machine # [ 9.019058] systemd[1]: Started backdoor.service. machine # [ 9.022795] systemd[1]: Starting Import lastlog data into lastlog2 database... machine # [ 9.024999] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 9.028203] systemd[1]: Starting Post-Boot Actions... machine # [ 9.029788] systemd[1]: Started Reset console on configuration changes. machine # [ 9.037301] systemd[1]: Starting resolvconf update... machine # [ 9.039697] systemd[1]: Started rustfs.service. machine # [ 9.043352] systemd[1]: Starting rustfs-bucket.service... machine # [ 9.051676] systemd[1]: Starting D-Bus System Message Bus... machine # [ 9.071843] systemd[1]: Finished Post-Boot Actions. machine # [ 9.093435] nsncd[495]: Sep 21 12:53:51.778 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 9.097842] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 9.100572] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 9.102768] systemd[1]: Reached target User and Group Name Lookups. machine # connecting to host... machine # [ 9.104561] systemd[1]: Starting User Login Management... machine # [ 9.112656] systemd[1]: Finished Import lastlog data into lastlog2 database. machine: Guest shell says: b'Spawning backdoor root shell...\n' machine: connected to guest root shell machine: (connecting took 9.79 seconds) machine: (finished: waiting for the VM to finish booting, in 10.21 seconds) machine # [ 9.144925] dbus-broker-launch[502]: Looking up NSS user entry for 'systemd-timesync'... machine # [ 9.152173] systemd-logind[520]: New seat seat0. machine # [ 9.155911] systemd-logind[520]: Watching system buttons on /dev/input/event3 (Power Button) machine # [ 9.158946] systemd-logind[520]: Watching system buttons on /dev/input/event2 (QEMU Virtio Keyboard) machine # [ 9.161358] systemd-logind[520]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) machine # [ 9.163732] systemd[1]: Started User Login Management. machine # [ 9.164932] systemd[1]: Starting linger-users.service... machine # [ 9.166218] dbus-broker-launch[502]: NSS returned no entry for 'systemd-timesync' machine # [ 9.167830] dbus-broker-launch[502]: Invalid user-name in /nix/store/sjdn8ydiry7lgasbr6jfz0ilm5vcd4dl-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" machine # [ 9.169577] systemd[1]: Stopped target Host and Network Name Lookups. machine # [ 9.170070] systemd[1]: Stopping Host and Network Name Lookups... machine # [ 9.170209] systemd[1]: Stopped target User and Group Name Lookups. machine # [ 9.170632] systemd[1]: Stopping User and Group Name Lookups... machine # [ 9.171544] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... machine # [ 9.178514] systemd[1]: nscd.service: Deactivated successfully. machine # [ 9.179454] systemd[1]: Stopped Name Service Cache Daemon (nsncd). machine # [ 9.185119] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 9.207449] systemd[1]: Started D-Bus System Message Bus. machine # [ 9.208057] systemd[1]: linger-users.service: Deactivated successfully. machine # [ 9.208688] systemd[1]: Finished linger-users.service. machine # [ 9.217115] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 9.218275] nsncd[585]: Sep 21 12:53:51.903 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 9.223083] dbus-broker-launch[502]: Ready machine # [ 9.225593] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 9.226991] systemd[1]: Reached target User and Group Name Lookups. machine # [ 9.239600] systemd[1]: Finished resolvconf update. machine # [ 9.240499] systemd[1]: Reached target Preparation for Network. machine # [ 9.243605] systemd[1]: Starting DHCP Client... machine # [ 9.245322] systemd[1]: Starting Address configuration of eth1... machine # [ 9.248448] systemd[1]: Starting Extra networking commands.... machine # [ 9.313209] network-addresses-eth1-start[615]: adding address 192.168.1.1/24... done machine # [ 9.322667] network-addresses-eth1-start[615]: adding address 2001:db8:1::1/64... done machine # [ 9.334873] systemd[1]: Finished Address configuration of eth1. machine # [ 9.339690] dhcpcd[624]: dhcpcd-10.3.2 starting machine # [ 9.347194] dhcpcd[676]: dev: loaded udev machine # [ 9.358062] systemd[1]: Finished Extra networking commands.. machine # [ 9.360138] systemd[1]: Reached target Network. machine # [ 9.363634] systemd[1]: Starting PostgreSQL Server... machine # [ 9.364947] systemd[1]: Starting Permit User Sessions... machine # [ 9.523568] 8021q: 802.1Q VLAN Support v1.8 machine # [ 9.524858] 8021q: adding VLAN 0 to HW filter on device eth1 machine # [ 9.392324] systemd[1]: Finished Permit User Sessions. machine # [ 9.393486] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. machine # [ 9.395749] systemd[1]: Started Getty on tty1. machine # [ 9.396755] systemd[1]: Reached target Login Prompts. machine # [ 9.632783] cfg80211: Loading compiled-in X.509 certificates for regulatory database machine # [ 9.657037] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' machine # [ 9.658752] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' machine # [ 9.661798] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 machine # [ 9.663814] cfg80211: failed to load regulatory.db machine # [ 9.516919] postgresql-pre-start[702]: The files belonging to this database system will be owned by user "postgres". machine # [ 9.517432] postgresql-pre-start[702]: This user must also own the server process. machine # [ 9.525607] postgresql-pre-start[702]: The database cluster will be initialized with locale "en_US.UTF-8". machine # [ 9.525968] postgresql-pre-start[702]: The default database encoding has accordingly been set to "UTF8". machine # [ 9.526584] postgresql-pre-start[702]: The default text search configuration will be set to "english". machine # [ 9.527028] postgresql-pre-start[702]: Data page checksums are enabled. machine # [ 9.527719] postgresql-pre-start[702]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok machine # [ 9.532928] postgresql-pre-start[702]: creating subdirectories ... ok machine # [ 9.534487] postgresql-pre-start[702]: selecting dynamic shared memory implementation ... posix machine # [ 9.713695] 8021q: adding VLAN 0 to HW filter on device eth0 machine # [ 9.560183] dhcpcd[676]: eth0: waiting for carrier machine # [ 9.561271] dhcpcd[676]: eth0: carrier acquired machine # [ 9.569921] dhcpcd[676]: DUID 00:01:00:01:32:43:e5:60:52:54:00:12:34:56 machine # [ 9.570309] dhcpcd[676]: eth0: IAID 00:12:34:56 machine # [ 9.570741] dhcpcd[676]: eth0: adding address fe80::5054:ff:fe12:3456 machine # [ 9.615153] postgresql-pre-start[702]: selecting default "max_connections" ... 100 machine # [ 9.688148] postgresql-pre-start[702]: selecting default "shared_buffers" ... 128MB machine # [ 11.050594] dhcpcd[676]: eth0: soliciting a DHCP lease machine # [ 11.228126] NET: Registered PF_PACKET protocol family machine # [ 11.080600] dhcpcd[676]: eth0: offered 10.0.2.15 from 10.0.2.2 machine # [ 11.087327] dhcpcd[676]: eth0: probing address 10.0.2.15/24 machine # [ 11.268695] dhcpcd[676]: eth0: soliciting an IPv6 router machine # [ 11.270718] dhcpcd[676]: eth0: Router Advertisement from fe80::2 machine # [ 11.273439] dhcpcd[676]: eth0: adding address fec0::5054:ff:fe12:3456/64 machine # [ 11.276941] dhcpcd[676]: eth0: adding route to fec0::/64 machine # [ 11.277151] dhcpcd[676]: eth0: adding default route via fe80::2 machine # [ 11.580506] postgresql-pre-start[702]: selecting default time zone ... UTC machine # [ 11.584484] postgresql-pre-start[702]: creating configuration files ... ok machine # [ 11.855069] postgresql-pre-start[702]: running bootstrap script ... ok machine # [ 12.492429] postgresql-pre-start[702]: performing post-bootstrap initialization ... ok machine # [ 12.668854] postgresql-pre-start[702]: syncing data to disk ... ok machine # [ 12.671121] postgresql-pre-start[702]: initdb: warning: enabling "trust" authentication for local connections machine # [ 12.675323] postgresql-pre-start[702]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. machine # [ 12.678506] postgresql-pre-start[702]: Success. You can now start the database server using: machine # [ 12.680171] postgresql-pre-start[702]: pg_ctl -D /var/lib/postgresql/18 -l logfile start machine # [ 12.822159] postgres[769]: [769] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit machine # [ 12.827425] postgres[769]: [769] LOG: listening on IPv6 address "::1", port 5432 machine # [ 12.828105] postgres[769]: [769] LOG: listening on IPv4 address "127.0.0.1", port 5432 machine # [ 12.831317] postgres[769]: [769] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" machine # [ 12.845497] postgres[783]: [783] LOG: database system was shut down at 2026-09-21 12:53:55 GMT machine # [ 12.851722] postgres[769]: [769] LOG: database system is ready to accept connections machine # [ 12.856432] systemd[1]: Started PostgreSQL Server. machine # [ 12.859275] systemd[1]: Starting PostgreSQL Setup Scripts... machine # [ 13.093135] postgresql-setup-start[794]: CREATE DATABASE machine # [ 13.150528] postgresql-setup-start[799]: CREATE ROLE machine # [ 13.176361] postgresql-setup-start[801]: ALTER DATABASE machine # [ 13.180417] systemd[1]: Finished PostgreSQL Setup Scripts. machine # [ 13.181607] systemd[1]: Reached target PostgreSQL. machine # [ 16.861748] dhcpcd[676]: eth0: leased 10.0.2.15 for 86400 seconds machine # [ 16.863453] dhcpcd[676]: eth0: adding route to 10.0.2.0/24 machine # [ 16.864758] dhcpcd[676]: eth0: adding default route via 10.0.2.2 machine # [ 17.047485] systemd[1]: Started DHCP Client. machine # [ 17.048883] systemd[1]: Reached target Network is Online. machine # [ 17.053467] systemd[1]: Starting k3s service... machine # [ 17.223992] k3s[896]: time="2026-09-21T12:53:59Z" level=info msg="Acquiring lock file /var/lib/rancher/k3s/data/.lock" machine # [ 17.224244] k3s[896]: time="2026-09-21T12:53:59Z" level=info msg="Preparing data dir /var/lib/rancher/k3s/data/76c98da5fd74d9a243cba8d533ae287fc547ab08ccd8c5ea4811608ce7075724" machine # [ 17.469154] rustfs-bucket-start[901]: mb s3://farm machine # [ 17.474423] systemd[1]: Finished rustfs-bucket.service. machine # [ 21.100669] k3s[896]: time="2026-09-21T12:54:03Z" level=info msg="Starting k3s 1.35.8+k3s1 (e952d68a)" machine # [ 21.112370] k3s[896]: time="2026-09-21T12:54:03Z" level=info msg="Configuring sqlite3 database connection pooling: maxIdle=20, maxOpen=0, maxLifetime=0s, maxIdleTime=2m0s" machine # [ 21.113206] k3s[896]: time="2026-09-21T12:54:03Z" level=info msg="Kine built with sqlite from github.com/mattn/go-sqlite3 version 3.53.3" machine # [ 21.114261] k3s[896]: time="2026-09-21T12:54:03Z" level=info msg="Configuring database table schema and indexes, this may take a moment..." machine # [ 21.133741] k3s[896]: time="2026-09-21T12:54:03Z" level=info msg="Database tables and indexes are up to date" machine # [ 21.134495] k3s[896]: time="2026-09-21T12:54:03Z" level=info msg="Running startup VACUUM to reclaim disk space, this may take a moment..." machine # [ 21.137066] k3s[896]: time="2026-09-21T12:54:03Z" level=info msg="Startup VACUUM completed successfully" machine # [ 21.138445] k3s[896]: time="2026-09-21T12:54:03Z" level=info msg="Kine available at unix://kine.sock" machine # [ 21.139486] k3s[896]: time="2026-09-21T12:54:03Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 21.140959] k3s[896]: time="2026-09-21T12:54:03Z" level=info msg="Datastore connection validated successfully, proceeding with bootstrap data generation" machine # [ 21.142593] k3s[896]: time="2026-09-21T12:54:03Z" level=info msg="generated self-signed CA certificate CN=k3s-client-ca@1789995243: notBefore=2026-09-21 11:54:03.827207506 +0000 UTC notAfter=2036-09-18 11:54:03.827207506 +0000 UTC" machine # [ 21.143992] k3s[896]: time="2026-09-21T12:54:03Z" level=info msg="certificate CN=system:admin,O=system:masters signed by CN=k3s-client-ca@1789995243: notBefore=2026-09-21 11:54:03 +0000 UTC notAfter=2027-09-21 11:54:03 +0000 UTC" machine # [ 21.145225] k3s[896]: time="2026-09-21T12:54:03Z" level=info msg="certificate CN=system:k3s-supervisor,O=system:masters signed by CN=k3s-client-ca@1789995243: notBefore=2026-09-21 11:54:03 +0000 UTC notAfter=2027-09-21 11:54:03 +0000 UTC" machine # [ 21.146405] k3s[896]: time="2026-09-21T12:54:03Z" level=info msg="certificate CN=system:kube-controller-manager signed by CN=k3s-client-ca@1789995243: notBefore=2026-09-21 11:54:03 +0000 UTC notAfter=2027-09-21 11:54:03 +0000 UTC" machine # [ 21.147545] k3s[896]: time="2026-09-21T12:54:03Z" level=info msg="certificate CN=system:kube-scheduler signed by CN=k3s-client-ca@1789995243: notBefore=2026-09-21 11:54:03 +0000 UTC notAfter=2027-09-21 11:54:03 +0000 UTC" machine # [ 21.148974] k3s[896]: time="2026-09-21T12:54:03Z" level=info msg="certificate CN=system:apiserver,O=system:masters signed by CN=k3s-client-ca@1789995243: notBefore=2026-09-21 11:54:03 +0000 UTC notAfter=2027-09-21 11:54:03 +0000 UTC" machine # [ 21.150474] k3s[896]: time="2026-09-21T12:54:03Z" level=info msg="certificate CN=k3s-cloud-controller-manager signed by CN=k3s-client-ca@1789995243: notBefore=2026-09-21 11:54:03 +0000 UTC notAfter=2027-09-21 11:54:03 +0000 UTC" machine # [ 21.151609] k3s[896]: time="2026-09-21T12:54:03Z" level=info msg="generated self-signed CA certificate CN=k3s-server-ca@1789995243: notBefore=2026-09-21 11:54:03.830340027 +0000 UTC notAfter=2036-09-18 11:54:03.830340027 +0000 UTC" machine # [ 21.153169] k3s[896]: time="2026-09-21T12:54:03Z" level=info msg="certificate CN=kube-apiserver signed by CN=k3s-server-ca@1789995243: notBefore=2026-09-21 11:54:03 +0000 UTC notAfter=2027-09-21 11:54:03 +0000 UTC" machine # [ 21.154339] k3s[896]: time="2026-09-21T12:54:03Z" level=info msg="certificate CN=kube-scheduler signed by CN=k3s-server-ca@1789995243: notBefore=2026-09-21 11:54:03 +0000 UTC notAfter=2027-09-21 11:54:03 +0000 UTC" machine # [ 21.155485] k3s[896]: time="2026-09-21T12:54:03Z" level=info msg="certificate CN=kube-controller-manager signed by CN=k3s-server-ca@1789995243: notBefore=2026-09-21 11:54:03 +0000 UTC notAfter=2027-09-21 11:54:03 +0000 UTC" machine # [ 21.156968] k3s[896]: time="2026-09-21T12:54:03Z" level=info msg="generated self-signed CA certificate CN=k3s-request-header-ca@1789995243: notBefore=2026-09-21 11:54:03.831917323 +0000 UTC notAfter=2036-09-18 11:54:03.831917323 +0000 UTC" machine # [ 21.158288] k3s[896]: time="2026-09-21T12:54:03Z" level=info msg="certificate CN=system:auth-proxy signed by CN=k3s-request-header-ca@1789995243: notBefore=2026-09-21 11:54:03 +0000 UTC notAfter=2027-09-21 11:54:03 +0000 UTC" machine # [ 21.159157] k3s[896]: time="2026-09-21T12:54:03Z" level=info msg="generated self-signed CA certificate CN=etcd-server-ca@1789995243: notBefore=2026-09-21 11:54:03.832633335 +0000 UTC notAfter=2036-09-18 11:54:03.832633335 +0000 UTC" machine # [ 21.160044] k3s[896]: time="2026-09-21T12:54:03Z" level=info msg="certificate CN=etcd-client signed by CN=etcd-server-ca@1789995243: notBefore=2026-09-21 11:54:03 +0000 UTC notAfter=2027-09-21 11:54:03 +0000 UTC" machine # [ 21.160630] k3s[896]: time="2026-09-21T12:54:03Z" level=info msg="generated self-signed CA certificate CN=etcd-peer-ca@1789995243: notBefore=2026-09-21 11:54:03.833360523 +0000 UTC notAfter=2036-09-18 11:54:03.833360523 +0000 UTC" machine # [ 21.161544] k3s[896]: time="2026-09-21T12:54:03Z" level=info msg="certificate CN=etcd-peer signed by CN=etcd-peer-ca@1789995243: notBefore=2026-09-21 11:54:03 +0000 UTC notAfter=2027-09-21 11:54:03 +0000 UTC" machine # [ 21.162461] k3s[896]: time="2026-09-21T12:54:03Z" level=info msg="certificate CN=etcd-server signed by CN=etcd-server-ca@1789995243: notBefore=2026-09-21 11:54:03 +0000 UTC notAfter=2027-09-21 11:54:03 +0000 UTC" machine # [ 21.204129] k3s[896]: time="2026-09-21T12:54:03Z" level=info msg="certificate CN=k3s,O=k3s signed by CN=k3s-server-ca@1789995243: notBefore=2026-09-21 11:54:03 +0000 UTC notAfter=2027-09-21 11:54:03 +0000 UTC" machine # [ 21.205173] k3s[896]: time="2026-09-21T12:54:03Z" level=warning msg="dynamiclistener [::]:6443: no cached certificate available for preload - deferring certificate load until storage initialization or first client request" machine # [ 21.208359] k3s[896]: time="2026-09-21T12:54:03Z" level=info msg="Active TLS secret / (ver=) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__f591_dc8e_8e2c_368-e9d459:fec0::f591:dc8e:8e2c:368 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=E7DBDFC7E06E1B2729656B8BB49E90AA0DEBC058]" machine # [ 22.331426] k3s[896]: time="2026-09-21T12:54:05Z" level=info msg="Password verified locally for node machine" machine # [ 22.331917] k3s[896]: time="2026-09-21T12:54:05Z" level=info msg="certificate CN=machine signed by CN=k3s-server-ca@1789995243: notBefore=2026-09-21 11:54:05 +0000 UTC notAfter=2027-09-21 11:54:05 +0000 UTC" machine # [ 22.579647] k3s[896]: time="2026-09-21T12:54:05Z" level=info msg="certificate CN=system:node:machine,O=system:nodes signed by CN=k3s-client-ca@1789995243: notBefore=2026-09-21 11:54:05 +0000 UTC notAfter=2027-09-21 11:54:05 +0000 UTC" machine # [ 22.654550] k3s[896]: time="2026-09-21T12:54:05Z" level=info msg="certificate CN=system:kube-proxy signed by CN=k3s-client-ca@1789995243: notBefore=2026-09-21 11:54:05 +0000 UTC notAfter=2027-09-21 11:54:05 +0000 UTC" machine # [ 22.757518] k3s[896]: time="2026-09-21T12:54:05Z" level=info msg="certificate CN=system:k3s-controller signed by CN=k3s-client-ca@1789995243: notBefore=2026-09-21 11:54:05 +0000 UTC notAfter=2027-09-21 11:54:05 +0000 UTC" machine # [ 22.867160] k3s[896]: time="2026-09-21T12:54:05Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:47412: runtime core not ready" machine # [ 22.972458] k3s[896]: time="2026-09-21T12:54:05Z" level=info msg="Module overlay was already loaded" machine # [ 23.269545] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. machine # [ 23.279174] Bridge firewalling registered machine # [ 23.151925] k3s[896]: time="2026-09-21T12:54:05Z" level=warning msg="Failed to load kernel module iptable_nat with modprobe" machine # [ 23.178334] k3s[896]: time="2026-09-21T12:54:05Z" level=warning msg="Failed to load kernel module iptable_filter with modprobe" machine # [ 23.198763] k3s[896]: time="2026-09-21T12:54:05Z" level=warning msg="Failed to load kernel module nft-expr-counter with modprobe" machine # [ 23.315103] k3s[896]: time="2026-09-21T12:54:06Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_max' to 131072" machine # [ 23.315873] k3s[896]: time="2026-09-21T12:54:06Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400" machine # [ 23.318422] k3s[896]: time="2026-09-21T12:54:06Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600" machine # [ 23.319474] k3s[896]: time="2026-09-21T12:54:06Z" level=info msg="Set sysctl 'net/ipv4/conf/all/forwarding' to 1" machine # [ 23.335720] k3s[896]: time="2026-09-21T12:54:06Z" level=info msg="Connecting to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 23.337220] k3s[896]: time="2026-09-21T12:54:06Z" level=info msg="Creating k3s-cert-monitor event broadcaster" machine # [ 23.339675] k3s[896]: time="2026-09-21T12:54:06Z" level=info msg="Saving cluster bootstrap data to datastore" machine # [ 23.340670] k3s[896]: time="2026-09-21T12:54:06Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 23.343393] k3s[896]: time="2026-09-21T12:54:06Z" level=info msg="Connection to etcd is ready" machine # [ 23.345065] k3s[896]: time="2026-09-21T12:54:06Z" level=info msg="ETCD server is now running" machine # [ 23.357501] k3s[896]: time="2026-09-21T12:54:06Z" level=info msg="Polling for API server readiness: GET /readyz failed: the server is currently unable to handle the request" machine # [ 23.364455] k3s[896]: time="2026-09-21T12:54:06Z" level=info msg="Running kube-apiserver --advertise-port=6443 --allow-privileged=true --anonymous-auth=false --api-audiences=https://kubernetes.default.svc.cluster.local,k3s --authorization-mode=Node,RBAC --bind-address=127.0.0.1 --cert-dir=/var/lib/rancher/k3s/server/tls/temporary-certs --client-ca-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --egress-selector-config-file=/var/lib/rancher/k3s/server/etc/egress-selector-config.yaml --enable-admission-plugins=NodeRestriction --enable-aggregator-routing=true --enable-bootstrap-token-auth=true --etcd-servers=unix://kine.sock --kubelet-certificate-authority=/var/lib/rancher/k3s/server/tls/server-ca.crt --kubelet-client-certificate=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.crt --kubelet-client-key=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.key --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --profiling=false --proxy-client-cert-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt --proxy-client-key-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.key --requestheader-allowed-names=system:auth-proxy --requestheader-client-ca-file=/var/lib/rancher/k3s/server/tls/request-header-ca.crt --requestheader-extra-headers-prefix=X-Remote-Extra- --requestheader-group-headers=X-Remote-Group --requestheader-username-headers=X-Remote-User --secure-port=6444 --service-account-issuer=https://kubernetes.default.svc.cluster.local --service-account-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-account-signing-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --storage-backend=etcd3 --tls-cert-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --tls-private-key-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 23.366532] k3s[896]: time="2026-09-21T12:54:06Z" level=info msg="Handling backend connection request [machine]" machine # [ 23.368252] k3s[896]: time="2026-09-21T12:54:06Z" level=info msg="Connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 23.369592] k3s[896]: time="2026-09-21T12:54:06Z" level=info msg="Remotedialer connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 23.385069] k3s[896]: time="2026-09-21T12:54:06Z" level=info msg="Logging containerd to /var/lib/rancher/k3s/agent/containerd/containerd.log" machine # [ 23.386969] k3s[896]: time="2026-09-21T12:54:06Z" level=info msg="Running containerd -c /var/lib/rancher/k3s/agent/etc/containerd/config.toml" machine # [ 23.412153] k3s[896]: I0921 12:54:06.097774 896 options.go:263] external host was not specified, using 10.0.2.15 machine # [ 23.414093] k3s[896]: I0921 12:54:06.099969 896 server.go:158] Version: v1.35.8+k3s1 machine # [ 23.414637] k3s[896]: I0921 12:54:06.100000 896 server.go:160] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 23.415443] k3s[896]: time="2026-09-21T12:54:06Z" level=info msg="Running kube-scheduler --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --bind-address=127.0.0.1 --kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --leader-elect=false --profiling=false --secure-port=10259 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 23.416245] k3s[896]: time="2026-09-21T12:54:06Z" level=info msg="Running kube-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --bind-address=127.0.0.1 --cluster-cidr=10.42.0.0/16 --cluster-signing-kube-apiserver-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kube-apiserver-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kubelet-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-serving-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-kubelet-serving-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --cluster-signing-legacy-unknown-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-legacy-unknown-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --configure-cloud-routes=false --controllers=*,tokencleaner,-service,-route,-cloud-node-lifecycle --kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --leader-elect=false --profiling=false --root-ca-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --secure-port=10257 --service-account-private-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key --use-service-account-credentials=true" machine # [ 23.417222] k3s[896]: time="2026-09-21T12:54:06Z" level=info msg="Running cloud-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --bind-address=127.0.0.1 --cloud-config=/var/lib/rancher/k3s/server/etc/cloud-config.yaml --cloud-provider=k3s --cluster-cidr=10.42.0.0/16 --configure-cloud-routes=false --controllers=*,-route --kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --leader-elect=false --leader-elect-resource-name=k3s-cloud-controller-manager --node-status-update-frequency=1m0s --profiling=false" machine # [ 23.417944] k3s[896]: time="2026-09-21T12:54:06Z" level=info msg="Server node token is available at /var/lib/rancher/k3s/server/token" machine # [ 23.418740] k3s[896]: time="2026-09-21T12:54:06Z" level=info msg="To join server node to cluster: k3s server -s https://10.0.2.15:6443 -t ${SERVER_NODE_TOKEN}" machine # [ 23.419592] k3s[896]: time="2026-09-21T12:54:06Z" level=info msg="Agent node token is available at /var/lib/rancher/k3s/server/agent-token" machine # [ 23.420540] k3s[896]: time="2026-09-21T12:54:06Z" level=info msg="To join agent node to cluster: k3s agent -s https://10.0.2.15:6443 -t ${AGENT_NODE_TOKEN}" machine # [ 23.421282] k3s[896]: time="2026-09-21T12:54:06Z" level=info msg="Wrote kubeconfig /etc/rancher/k3s/k3s.yaml" machine # [ 23.422080] k3s[896]: time="2026-09-21T12:54:06Z" level=info msg="Run: k3s kubectl" machine # [ 23.487133] k3s[896]: time="2026-09-21T12:54:06Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:59980: runtime core not ready" machine # [ 23.557582] k3s[896]: I0921 12:54:06.243529 896 shared_informer.go:349] "Waiting for caches to sync" controller="node_authorizer" machine # [ 23.560681] k3s[896]: I0921 12:54:06.246646 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 23.562355] k3s[896]: I0921 12:54:06.248337 896 plugins.go:157] Loaded 14 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,PodTopologyLabels,MutatingAdmissionPolicy,MutatingAdmissionWebhook. machine # [ 23.562460] k3s[896]: I0921 12:54:06.248362 896 plugins.go:160] Loaded 14 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,NodeDeclaredFeatureValidator,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. machine # [ 23.563122] k3s[896]: I0921 12:54:06.248647 896 instance.go:240] Using reconciler: lease machine # [ 23.569265] k3s[896]: I0921 12:54:06.255211 896 handler.go:304] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager machine # [ 23.569897] k3s[896]: W0921 12:54:06.255236 896 genericapiserver.go:787] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. machine # [ 23.572028] k3s[896]: I0921 12:54:06.257999 896 cidrallocator.go:198] starting ServiceCIDR Allocator Controller machine # [ 23.595517] k3s[896]: time="2026-09-21T12:54:06Z" level=info msg="Running kube-proxy --cluster-cidr=10.42.0.0/16 --conntrack-max-per-core=0 --conntrack-tcp-timeout-close-wait=0s --conntrack-tcp-timeout-established=0s --healthz-bind-address=127.0.0.1 --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubeproxy.kubeconfig --proxy-mode=iptables" machine # [ 23.608203] k3s[896]: I0921 12:54:06.294167 896 handler.go:304] Adding GroupVersion v1 to ResourceManager machine # [ 23.608690] k3s[896]: I0921 12:54:06.294314 896 apis.go:112] API group "internal.apiserver.k8s.io" is not enabled, skipping. machine # [ 23.632651] k3s[896]: I0921 12:54:06.318626 896 apis.go:112] API group "storagemigration.k8s.io" is not enabled, skipping. machine # [ 23.670587] k3s[896]: I0921 12:54:06.356526 896 handler.go:304] Adding GroupVersion authentication.k8s.io v1 to ResourceManager machine # [ 23.670952] k3s[896]: W0921 12:54:06.356556 896 genericapiserver.go:787] Skipping API authentication.k8s.io/v1beta1 because it has no resources. machine # [ 23.671386] k3s[896]: W0921 12:54:06.356568 896 genericapiserver.go:787] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. machine # [ 23.671870] k3s[896]: I0921 12:54:06.356875 896 handler.go:304] Adding GroupVersion authorization.k8s.io v1 to ResourceManager machine # [ 23.672498] k3s[896]: W0921 12:54:06.356890 896 genericapiserver.go:787] Skipping API authorization.k8s.io/v1beta1 because it has no resources. machine # [ 23.672955] k3s[896]: I0921 12:54:06.357468 896 handler.go:304] Adding GroupVersion autoscaling v2 to ResourceManager machine # [ 23.673615] k3s[896]: I0921 12:54:06.357928 896 handler.go:304] Adding GroupVersion autoscaling v1 to ResourceManager machine # [ 23.674072] k3s[896]: W0921 12:54:06.357945 896 genericapiserver.go:787] Skipping API autoscaling/v2beta1 because it has no resources. machine # [ 23.674538] k3s[896]: W0921 12:54:06.357955 896 genericapiserver.go:787] Skipping API autoscaling/v2beta2 because it has no resources. machine # [ 23.675028] k3s[896]: I0921 12:54:06.358909 896 handler.go:304] Adding GroupVersion batch v1 to ResourceManager machine # [ 23.675493] k3s[896]: W0921 12:54:06.358927 896 genericapiserver.go:787] Skipping API batch/v1beta1 because it has no resources. machine # [ 23.675958] k3s[896]: I0921 12:54:06.359529 896 handler.go:304] Adding GroupVersion certificates.k8s.io v1 to ResourceManager machine # [ 23.676584] k3s[896]: W0921 12:54:06.359548 896 genericapiserver.go:787] Skipping API certificates.k8s.io/v1beta1 because it has no resources. machine # [ 23.677062] k3s[896]: W0921 12:54:06.359559 896 genericapiserver.go:787] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. machine # [ 23.677560] k3s[896]: I0921 12:54:06.359895 896 handler.go:304] Adding GroupVersion coordination.k8s.io v1 to ResourceManager machine # [ 23.677984] k3s[896]: W0921 12:54:06.359911 896 genericapiserver.go:787] Skipping API coordination.k8s.io/v1beta1 because it has no resources. machine # [ 23.678628] k3s[896]: W0921 12:54:06.359921 896 genericapiserver.go:787] Skipping API coordination.k8s.io/v1alpha2 because it has no resources. machine # [ 23.679106] k3s[896]: I0921 12:54:06.360265 896 handler.go:304] Adding GroupVersion discovery.k8s.io v1 to ResourceManager machine # [ 23.679569] k3s[896]: W0921 12:54:06.360280 896 genericapiserver.go:787] Skipping API discovery.k8s.io/v1beta1 because it has no resources. machine # [ 23.680053] k3s[896]: I0921 12:54:06.361573 896 handler.go:304] Adding GroupVersion networking.k8s.io v1 to ResourceManager machine # [ 23.680507] k3s[896]: W0921 12:54:06.361591 896 genericapiserver.go:787] Skipping API networking.k8s.io/v1beta1 because it has no resources. machine # [ 23.680971] k3s[896]: I0921 12:54:06.361835 896 handler.go:304] Adding GroupVersion node.k8s.io v1 to ResourceManager machine # [ 23.681604] k3s[896]: W0921 12:54:06.361858 896 genericapiserver.go:787] Skipping API node.k8s.io/v1beta1 because it has no resources. machine # [ 23.682079] k3s[896]: W0921 12:54:06.361869 896 genericapiserver.go:787] Skipping API node.k8s.io/v1alpha1 because it has no resources. machine # [ 23.682542] k3s[896]: I0921 12:54:06.362309 896 handler.go:304] Adding GroupVersion policy v1 to ResourceManager machine # [ 23.683030] k3s[896]: W0921 12:54:06.362324 896 genericapiserver.go:787] Skipping API policy/v1beta1 because it has no resources. machine # [ 23.683480] k3s[896]: I0921 12:54:06.363223 896 handler.go:304] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager machine # [ 23.683950] k3s[896]: W0921 12:54:06.363239 896 genericapiserver.go:787] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. machine # [ 23.684577] k3s[896]: W0921 12:54:06.363251 896 genericapiserver.go:787] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. machine # [ 23.685062] k3s[896]: I0921 12:54:06.363519 896 handler.go:304] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager machine # [ 23.685523] k3s[896]: W0921 12:54:06.363535 896 genericapiserver.go:787] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. machine # [ 23.685985] k3s[896]: W0921 12:54:06.363546 896 genericapiserver.go:787] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. machine # [ 23.686658] k3s[896]: I0921 12:54:06.364849 896 handler.go:304] Adding GroupVersion storage.k8s.io v1 to ResourceManager machine # [ 23.687136] k3s[896]: W0921 12:54:06.364868 896 genericapiserver.go:787] Skipping API storage.k8s.io/v1beta1 because it has no resources. machine # [ 23.687647] k3s[896]: W0921 12:54:06.364880 896 genericapiserver.go:787] Skipping API storage.k8s.io/v1alpha1 because it has no resources. machine # [ 23.688189] k3s[896]: I0921 12:54:06.365672 896 handler.go:304] Adding GroupVersion flowcontrol.apiserver.k8s.io v1 to ResourceManager machine # [ 23.688667] k3s[896]: W0921 12:54:06.365689 896 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta3 because it has no resources. machine # [ 23.689149] k3s[896]: W0921 12:54:06.365700 896 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta2 because it has no resources. machine # [ 23.689620] k3s[896]: W0921 12:54:06.365710 896 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. machine # [ 23.690098] k3s[896]: I0921 12:54:06.368761 896 handler.go:304] Adding GroupVersion apps v1 to ResourceManager machine # [ 23.690563] k3s[896]: W0921 12:54:06.368780 896 genericapiserver.go:787] Skipping API apps/v1beta2 because it has no resources. machine # [ 23.691051] k3s[896]: W0921 12:54:06.368792 896 genericapiserver.go:787] Skipping API apps/v1beta1 because it has no resources. machine # [ 23.691500] k3s[896]: I0921 12:54:06.371254 896 handler.go:304] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager machine # [ 23.691965] k3s[896]: W0921 12:54:06.371278 896 genericapiserver.go:787] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. machine # [ 23.692605] k3s[896]: W0921 12:54:06.371289 896 genericapiserver.go:787] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. machine # [ 23.694027] k3s[896]: I0921 12:54:06.371988 896 handler.go:304] Adding GroupVersion events.k8s.io v1 to ResourceManager machine # [ 23.695423] k3s[896]: W0921 12:54:06.372003 896 genericapiserver.go:787] Skipping API events.k8s.io/v1beta1 because it has no resources. machine # [ 23.696687] k3s[896]: I0921 12:54:06.376014 896 handler.go:304] Adding GroupVersion resource.k8s.io v1 to ResourceManager machine # [ 23.698077] k3s[896]: W0921 12:54:06.376034 896 genericapiserver.go:787] Skipping API resource.k8s.io/v1beta2 because it has no resources. machine # [ 23.699659] k3s[896]: W0921 12:54:06.376068 896 genericapiserver.go:787] Skipping API resource.k8s.io/v1beta1 because it has no resources. machine # [ 23.700925] k3s[896]: W0921 12:54:06.376077 896 genericapiserver.go:787] Skipping API resource.k8s.io/v1alpha3 because it has no resources. machine # [ 23.702494] k3s[896]: I0921 12:54:06.378888 896 handler.go:304] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager machine # [ 23.703738] k3s[896]: W0921 12:54:06.378907 896 genericapiserver.go:787] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. machine # [ 24.012178] k3s[896]: I0921 12:54:06.697298 896 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 24.012525] k3s[896]: I0921 12:54:06.697418 896 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 24.012937] k3s[896]: I0921 12:54:06.697316 896 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 24.013572] k3s[896]: I0921 12:54:06.697650 896 secure_serving.go:211] Serving securely on 127.0.0.1:6444 machine # [ 24.014056] k3s[896]: I0921 12:54:06.697785 896 controller.go:78] Starting OpenAPI AggregationController machine # [ 24.014487] k3s[896]: I0921 12:54:06.697793 896 controller.go:80] Starting OpenAPI V3 AggregationController machine # [ 24.014951] k3s[896]: I0921 12:54:06.697820 896 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 24.021933] k3s[896]: I0921 12:54:06.697863 896 apf_controller.go:377] Starting API Priority and Fairness config controller machine # [ 24.022551] k3s[896]: I0921 12:54:06.697915 896 dynamic_serving_content.go:135] "Starting controller" name="aggregator-proxy-cert::/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt::/var/lib/rancher/k3s/server/tls/client-auth-proxy.key" machine # [ 24.023024] k3s[896]: time="2026-09-21T12:54:06Z" level=info msg="Starting legacy_token_tracking_controller" logger=k3s machine # [ 24.023488] k3s[896]: time="2026-09-21T12:54:06Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 24.024026] k3s[896]: I0921 12:54:06.698200 896 customresource_discovery_controller.go:294] Starting DiscoveryController machine # [ 24.024431] k3s[896]: I0921 12:54:06.698468 896 cluster_authentication_trust_controller.go:459] Starting cluster_authentication_trust_controller controller machine # [ 24.024900] k3s[896]: time="2026-09-21T12:54:06Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 24.025525] k3s[896]: I0921 12:54:06.698555 896 local_available_controller.go:156] Starting LocalAvailability controller machine # [ 24.025992] k3s[896]: I0921 12:54:06.698559 896 controller.go:142] Starting OpenAPI controller machine # [ 24.026617] k3s[896]: I0921 12:54:06.698569 896 cache.go:32] Waiting for caches to sync for LocalAvailability controller machine # [ 24.027102] k3s[896]: I0921 12:54:06.698620 896 controller.go:90] Starting OpenAPI V3 controller machine # [ 24.027567] k3s[896]: time="2026-09-21T12:54:06Z" level=info msg="Starting apiserver lease garbage collector" logger=k3s machine # [ 24.028046] k3s[896]: I0921 12:54:06.698669 896 naming_controller.go:305] Starting NamingConditionController machine # [ 24.028507] k3s[896]: time="2026-09-21T12:54:06Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 24.028955] k3s[896]: I0921 12:54:06.698727 896 nonstructuralschema_controller.go:202] Starting NonStructuralSchemaConditionController machine # [ 24.029597] k3s[896]: I0921 12:54:06.698728 896 controller.go:113] "Deleting old lease on startup" lease="kube-system/apiserver-ik4pcwfs7qgdl76byc4pomgvia" machine # [ 24.030076] k3s[896]: I0921 12:54:06.698756 896 apiapproval_controller.go:196] Starting KubernetesAPIApprovalPolicyConformantConditionController machine # [ 24.030536] k3s[896]: I0921 12:54:06.698819 896 crd_finalizer.go:273] Starting CRDFinalizer machine # [ 24.031023] k3s[896]: I0921 12:54:06.698949 896 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 24.031496] k3s[896]: I0921 12:54:06.699021 896 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 24.031954] k3s[896]: I0921 12:54:06.699223 896 remote_available_controller.go:425] Starting RemoteAvailability controller machine # [ 24.032592] k3s[896]: I0921 12:54:06.699235 896 cache.go:32] Waiting for caches to sync for RemoteAvailability controller machine # [ 24.033078] k3s[896]: I0921 12:54:06.699272 896 apiservice_controller.go:100] Starting APIServiceRegistrationController machine # [ 24.033565] k3s[896]: I0921 12:54:06.699282 896 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller machine # [ 24.034079] k3s[896]: I0921 12:54:06.699328 896 aggregator.go:185] waiting for initial CRD sync... machine # [ 24.034518] k3s[896]: I0921 12:54:06.699447 896 system_namespaces_controller.go:66] Starting system namespaces controller machine # [ 24.035029] k3s[896]: I0921 12:54:06.699530 896 repairip.go:210] Starting ipallocator-repair-controller machine # [ 24.035473] k3s[896]: I0921 12:54:06.699543 896 shared_informer.go:349] "Waiting for caches to sync" controller="ipallocator-repair-controller" machine # [ 24.035992] k3s[896]: I0921 12:54:06.701365 896 crdregistration_controller.go:114] Starting crd-autoregister controller machine # [ 24.036626] k3s[896]: I0921 12:54:06.701380 896 shared_informer.go:349] "Waiting for caches to sync" controller="crd-autoregister" machine # [ 24.037130] k3s[896]: I0921 12:54:06.701451 896 default_servicecidr_controller.go:110] Starting kubernetes-service-cidr-controller machine # [ 24.037595] k3s[896]: I0921 12:54:06.701463 896 shared_informer.go:349] "Waiting for caches to sync" controller="kubernetes-service-cidr-controller" machine # [ 24.112256] k3s[896]: I0921 12:54:06.798095 896 apf_controller.go:382] Running API Priority and Fairness config worker machine # [ 24.112623] k3s[896]: I0921 12:54:06.798126 896 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process machine # [ 24.113071] k3s[896]: time="2026-09-21T12:54:06Z" level=info msg="Caches are synced" logger=k3s machine # [ 24.113590] k3s[896]: time="2026-09-21T12:54:06Z" level=info msg="Caches are synced" logger=k3s machine # [ 24.114060] k3s[896]: time="2026-09-21T12:54:06Z" level=info msg="Caches are synced" logger=k3s machine # [ 24.114560] k3s[896]: I0921 12:54:06.799277 896 cache.go:39] Caches are synced for RemoteAvailability controller machine # [ 24.115049] k3s[896]: I0921 12:54:06.799316 896 cache.go:39] Caches are synced for APIServiceRegistrationController controller machine # [ 24.115195] k3s[896]: I0921 12:54:06.799353 896 cache.go:39] Caches are synced for LocalAvailability controller machine # [ 24.115702] k3s[896]: I0921 12:54:06.799449 896 handler_discovery.go:451] Starting ResourceDiscoveryManager machine # [ 24.116222] k3s[896]: I0921 12:54:06.799655 896 shared_informer.go:356] "Caches are synced" controller="ipallocator-repair-controller" machine # [ 24.124819] k3s[896]: I0921 12:54:06.810772 896 shared_informer.go:356] "Caches are synced" controller="kubernetes-service-cidr-controller" machine # [ 24.125453] k3s[896]: I0921 12:54:06.810809 896 default_servicecidr_controller.go:169] Creating default ServiceCIDR with CIDRs: [10.43.0.0/16] machine # [ 24.125963] k3s[896]: I0921 12:54:06.810894 896 shared_informer.go:356] "Caches are synced" controller="crd-autoregister" machine # [ 24.126840] k3s[896]: I0921 12:54:06.810940 896 aggregator.go:187] initial CRD sync complete... machine # [ 24.127531] k3s[896]: I0921 12:54:06.810953 896 autoregister_controller.go:144] Starting autoregister controller machine # [ 24.127991] k3s[896]: I0921 12:54:06.810965 896 cache.go:32] Waiting for caches to sync for autoregister controller machine # [ 24.128653] k3s[896]: I0921 12:54:06.810976 896 cache.go:39] Caches are synced for autoregister controller machine # [ 24.154734] k3s[896]: E0921 12:54:06.840692 896 controller.go:201] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" machine # [ 24.158860] k3s[896]: I0921 12:54:06.844822 896 shared_informer.go:356] "Caches are synced" controller="node_authorizer" machine # [ 24.161102] k3s[896]: I0921 12:54:06.847094 896 shared_informer.go:377] "Caches are synced" machine # [ 24.161239] k3s[896]: I0921 12:54:06.847128 896 policy_source.go:248] refreshing policies machine # [ 24.165758] k3s[896]: time="2026-09-21T12:54:06Z" level=error msg="Error while syncing ConfigMap" configmap=kube-system/kube-apiserver-legacy-service-account-token-tracking error="namespaces \"kube-system\" not found" logger=k3s/UnhandledError machine # [ 24.188700] k3s[896]: E0921 12:54:06.874657 896 controller.go:95] Unable to perform initial Kubernetes service initialization: namespaces "default" not found machine # [ 24.225221] k3s[896]: time="2026-09-21T12:54:06Z" level=error msg="Error while syncing ConfigMap" configmap=kube-system/kube-apiserver-legacy-service-account-token-tracking error="namespaces \"kube-system\" not found" logger=k3s/UnhandledError machine # [ 24.235783] k3s[896]: I0921 12:54:06.921716 896 controller.go:667] quota admission added evaluator for: namespaces machine # [ 24.242061] k3s[896]: I0921 12:54:06.927550 896 cidrallocator.go:302] created ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 24.243696] k3s[896]: I0921 12:54:06.927698 896 default_servicecidr_controller.go:231] Setting default ServiceCIDR condition Ready to True machine # [ 24.250898] k3s[896]: I0921 12:54:06.936868 896 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 24.361942] k3s[896]: I0921 12:54:07.047014 896 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io machine # [ 24.390408] k3s[896]: time="2026-09-21T12:54:07Z" level=info msg="containerd is now running" machine # [ 24.401704] k3s[896]: time="2026-09-21T12:54:07Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/k3s-airgap-images-amd64.tar.zst" machine # [ 25.018550] k3s[896]: I0921 12:54:07.704472 896 storage_scheduling.go:123] created PriorityClass system-node-critical with value 2000001000 machine # [ 25.023136] k3s[896]: I0921 12:54:07.709080 896 storage_scheduling.go:123] created PriorityClass system-cluster-critical with value 2000000000 machine # [ 25.023370] k3s[896]: I0921 12:54:07.709103 896 storage_scheduling.go:139] all system priority classes are created successfully or already exist. machine # [ 25.320524] k3s[896]: time="2026-09-21T12:54:08Z" level=info msg="Polling for API server readiness: GET /readyz failed: unknown" machine # [ 25.705572] k3s[896]: I0921 12:54:08.391104 896 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io machine # [ 25.747400] k3s[896]: I0921 12:54:08.433362 896 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io machine # [ 25.796980] k3s[896]: I0921 12:54:08.482892 896 alloc.go:329] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.43.0.1"} machine # [ 25.802686] k3s[896]: W0921 12:54:08.488673 896 lease.go:265] Resetting endpoints for master service "kubernetes" to [10.0.2.15] machine # [ 25.804790] k3s[896]: I0921 12:54:08.490139 896 controller.go:667] quota admission added evaluator for: endpoints machine # [ 25.809118] k3s[896]: I0921 12:54:08.495096 896 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io machine # [ 27.329993] k3s[896]: time="2026-09-21T12:54:10Z" level=info msg="Kube API server is now running" machine # [ 27.333625] k3s[896]: time="2026-09-21T12:54:10Z" level=info msg="k3s is up and running" machine # [ 27.339525] k3s[896]: time="2026-09-21T12:54:10Z" level=info msg="Waiting for untainted node" machine # [ 27.342419] k3s[896]: time="2026-09-21T12:54:10Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Node and Certificate Authority certificates managed by k3s are OK" object=machine reason=CertificateExpirationOK type=Normal machine # [ 27.357235] k3s[896]: time="2026-09-21T12:54:10Z" level=info msg="Creating k3s-supervisor event broadcaster" machine # [ 27.361652] systemd[1]: Started k3s service. machine # [ 27.365250] k3s[896]: I0921 12:54:10.044249 896 controllermanager.go:189] "Starting" version="v1.35.8+k3s1" machine # [ 27.371114] k3s[896]: I0921 12:54:10.044287 896 controllermanager.go:191] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 27.376921] k3s[896]: I0921 12:54:10.050205 896 secure_serving.go:211] Serving securely on 127.0.0.1:10257 machine # [ 27.381608] k3s[896]: I0921 12:54:10.050641 896 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 27.385195] k3s[896]: I0921 12:54:10.050658 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.388631] k3s[896]: I0921 12:54:10.050698 896 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key" machine # [ 27.394075] k3s[896]: I0921 12:54:10.050777 896 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 27.397663] k3s[896]: I0921 12:54:10.050838 896 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 27.398535] k3s[896]: I0921 12:54:10.050864 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.400891] k3s[896]: I0921 12:54:10.050890 896 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 27.402565] k3s[896]: I0921 12:54:10.050904 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.404102] systemd[1]: Starting niks3 server... machine # [ 27.405604] k3s[896]: I0921 12:54:10.067346 896 controller.go:667] quota admission added evaluator for: serviceaccounts machine # [ 27.407588] k3s[896]: I0921 12:54:10.083875 896 controllermanager.go:579] "Warning: skipping controller" controller="storage-version-migrator-controller" machine # [ 27.409864] k3s[896]: time="2026-09-21T12:54:10Z" level=info msg="Creating embedded CRD addons.k3s.cattle.io" machine # [ 27.415967] k3s[896]: time="2026-09-21T12:54:10Z" level=info msg="Creating embedded CRD etcdsnapshotfiles.k3s.cattle.io" machine # [ 27.423479] k3s[896]: time="2026-09-21T12:54:10Z" level=info msg="Creating embedded CRD helmcharts.helm.cattle.io" machine: (finished: waiting for unit k3s.service, in 28.50 seconds) machine: waiting for success: kubectl get ns farm machine # [ 27.436997] k3s[896]: time="2026-09-21T12:54:10Z" level=info msg="Creating embedded CRD helmchartconfigs.helm.cattle.io" machine # [ 27.438890] k3s[896]: I0921 12:54:10.124809 896 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 27.451485] k3s[896]: I0921 12:54:10.137452 896 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 27.459830] k3s[896]: time="2026-09-21T12:54:10Z" level=info msg="Waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 27.463063] k3s[896]: I0921 12:54:10.148829 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="addons.k3s.cattle.io" machine # [ 27.463713] k3s[896]: I0921 12:54:10.149573 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="ingresses.networking.k8s.io" machine # [ 27.464431] k3s[896]: I0921 12:54:10.149629 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="controllerrevisions.apps" machine # [ 27.465056] k3s[896]: I0921 12:54:10.149654 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="networkpolicies.networking.k8s.io" machine # [ 27.469142] k3s[896]: I0921 12:54:10.155075 896 shared_informer.go:377] "Caches are synced" machine # [ 27.473247] k3s[896]: I0921 12:54:10.159241 896 shared_informer.go:377] "Caches are synced" machine # [ 27.474263] k3s[896]: I0921 12:54:10.159400 896 shared_informer.go:377] "Caches are synced" machine # [ 27.482704] k3s[896]: I0921 12:54:10.166895 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="roles.rbac.authorization.k8s.io" machine # [ 27.483143] k3s[896]: I0921 12:54:10.168152 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="resourceclaimtemplates.resource.k8s.io" machine # [ 27.484464] k3s[896]: I0921 12:54:10.168219 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="statefulsets.apps" machine # [ 27.485506] k3s[896]: I0921 12:54:10.168243 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="poddisruptionbudgets.policy" machine # [ 27.486853] k3s[896]: I0921 12:54:10.168281 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="rolebindings.rbac.authorization.k8s.io" machine # [ 27.488813] k3s[896]: I0921 12:54:10.168319 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="daemonsets.apps" machine # [ 27.490436] k3s[896]: I0921 12:54:10.168349 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="deployments.apps" machine # [ 27.492343] k3s[896]: I0921 12:54:10.168372 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="replicasets.apps" machine # [ 27.494371] k3s[896]: I0921 12:54:10.168398 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="csistoragecapacities.storage.k8s.io" machine # [ 27.494934] k3s[896]: I0921 12:54:10.168422 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="leases.coordination.k8s.io" machine # [ 27.496071] k3s[896]: I0921 12:54:10.168444 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpointslices.discovery.k8s.io" machine # [ 27.497102] k3s[896]: I0921 12:54:10.168484 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="serviceaccounts" machine # [ 27.499069] k3s[896]: I0921 12:54:10.168506 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="limitranges" machine # [ 27.499506] k3s[896]: I0921 12:54:10.168536 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="jobs.batch" machine # [ 27.501075] k3s[896]: I0921 12:54:10.168558 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="podtemplates" machine # [ 27.501692] k3s[896]: I0921 12:54:10.168584 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpoints" machine # [ 27.502144] k3s[896]: I0921 12:54:10.168637 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="horizontalpodautoscalers.autoscaling" machine # [ 27.502705] k3s[896]: I0921 12:54:10.168671 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="cronjobs.batch" machine # [ 27.550647] k3s[896]: I0921 12:54:10.236531 896 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 27.552578] k3s[896]: I0921 12:54:10.237001 896 controllermanager.go:627] "Warning: controller is disabled" controller="cloud-node-lifecycle-controller" machine # [ 27.572459] k3s[896]: W0921 12:54:10.258427 896 probe.go:272] Flexvolume plugin directory at /usr/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating. machine # [ 27.576406] k3s[896]: I0921 12:54:10.262378 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.588445] k3s[896]: I0921 12:54:10.274365 896 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 27.600755] k3s[896]: I0921 12:54:10.286111 896 controllermanager.go:627] "Warning: controller is disabled" controller="service-lb-controller" machine # [ 27.600893] k3s[896]: I0921 12:54:10.286133 896 controllermanager.go:627] "Warning: controller is disabled" controller="selinux-warning-controller" machine # [ 27.676718] k3s[896]: I0921 12:54:10.362612 896 shared_informer.go:377] "Caches are synced" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 27.990773] k3s[896]: time="2026-09-21T12:54:10Z" level=info msg="Done waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 27.990988] k3s[896]: time="2026-09-21T12:54:10Z" level=info msg="Waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 27.994177] k3s[896]: time="2026-09-21T12:54:10Z" level=info msg="Done waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 27.998082] k3s[896]: time="2026-09-21T12:54:10Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-40.1.4+up40.1.0.tgz" machine # [ 28.000929] k3s[896]: time="2026-09-21T12:54:10Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-crd-40.1.4+up40.1.0.tgz" machine # [ 28.003388] k3s[896]: time="2026-09-21T12:54:10Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/ccm.yaml" machine # [ 28.005410] k3s[896]: time="2026-09-21T12:54:10Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/coredns.yaml" machine # [ 28.007456] k3s[896]: time="2026-09-21T12:54:10Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/local-storage.yaml" machine # [ 28.009775] k3s[896]: time="2026-09-21T12:54:10Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/rolebindings.yaml" machine # [ 28.012080] k3s[896]: time="2026-09-21T12:54:10Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/runtimes.yaml" machine # [ 28.014091] k3s[896]: time="2026-09-21T12:54:10Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/traefik.yaml" machine # [ 28.129137] k3s[896]: time="2026-09-21T12:54:10Z" level=info msg="Tunnel server egress proxy mode: agent" machine # [ 28.129461] k3s[896]: time="2026-09-21T12:54:10Z" level=info msg="Starting dynamiclistener CN filter node controller with SANs: [127.0.0.1 ::1 localhost machine 10.0.2.15 fec0::f591:dc8e:8e2c:368 10.43.0.1 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local]" machine # [ 28.204269] k3s[896]: time="2026-09-21T12:54:10Z" level=info msg="Creating new TLS secret for kube-system/k3s-serving (count: 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__f591_dc8e_8e2c_368-e9d459:fec0::f591:dc8e:8e2c:368 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=E7DBDFC7E06E1B2729656B8BB49E90AA0DEBC058]" machine # [ 28.214357] k3s[896]: time="2026-09-21T12:54:10Z" level=info msg="Active TLS secret kube-system/k3s-serving (ver=232) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__f591_dc8e_8e2c_368-e9d459:fec0::f591:dc8e:8e2c:368 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=E7DBDFC7E06E1B2729656B8BB49E90AA0DEBC058]" machine # [ 28.590750] k3s[896]: I0921 12:54:11.276338 896 controllermanager.go:627] "Warning: controller is disabled" controller="node-route-controller" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 29.241746] k3s[896]: time="2026-09-21T12:54:11Z" level=info msg="Starting k3s.cattle.io/v1, Kind=Addon controller" machine # [ 29.243856] k3s[896]: time="2026-09-21T12:54:11Z" level=info msg="Creating deploy event broadcaster" machine # [ 29.249060] k3s[896]: time="2026-09-21T12:54:11Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 29.250727] k3s[896]: time="2026-09-21T12:54:11Z" level=info msg="Creating helm-controller event broadcaster" machine # [ 29.252137] k3s[896]: time="2026-09-21T12:54:11Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 29.256604] k3s[896]: time="2026-09-21T12:54:11Z" level=info msg="Cluster dns configmap has been set successfully" machine # [ 29.479194] k3s[896]: I0921 12:54:12.165117 896 controllermanager.go:627] "Warning: controller is disabled" controller="bootstrap-signer-controller" machine # [ 29.780333] k3s[896]: I0921 12:54:12.465863 896 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="storageversion-garbage-collector-controller" requiredFeatureGates=["APIServerIdentity","StorageVersionAPI"] machine # [ 29.780495] k3s[896]: I0921 12:54:12.465949 896 controllermanager.go:579] "Warning: skipping controller" controller="storageversion-garbage-collector-controller" machine # [ 30.179553] k3s[896]: I0921 12:54:12.865428 896 node_lifecycle_controller.go:419] "Controller will reconcile labels" logger="node-lifecycle-controller" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 30.249529] k3s[896]: time="2026-09-21T12:54:12Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 30.457589] k3s[896]: time="2026-09-21T12:54:13Z" level=info msg="Starting rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding controller" machine # [ 30.462710] k3s[896]: time="2026-09-21T12:54:13Z" level=info msg="Starting batch/v1, Kind=Job controller" machine # [ 30.463040] k3s[896]: time="2026-09-21T12:54:13Z" level=info msg="Starting /v1, Kind=Secret controller" machine # [ 30.463503] k3s[896]: time="2026-09-21T12:54:13Z" level=info msg="Starting /v1, Kind=ServiceAccount controller" machine # [ 30.464037] k3s[896]: time="2026-09-21T12:54:13Z" level=info msg="Starting /v1, Kind=ConfigMap controller" machine # [ 30.467724] k3s[896]: time="2026-09-21T12:54:13Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChart controller" machine # [ 30.468510] k3s[896]: time="2026-09-21T12:54:13Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChartConfig controller" machine # [ 30.494295] k3s[896]: time="2026-09-21T12:54:13Z" level=info msg="Imported docker.io/rancher/klipper-helm:v0.13.3-build20260727" machine # [ 30.500506] k3s[896]: time="2026-09-21T12:54:13Z" level=info msg="Tagged docker.io/rancher/klipper-helm@sha256:5425a2b4613d2458dbdff99218e8d487ebb59c20e7a941f061c0777070f0aac1" machine # [ 30.502923] k3s[896]: time="2026-09-21T12:54:13Z" level=info msg="Imported docker.io/rancher/klipper-lb:v0.4.17" machine # [ 30.504418] k3s[896]: time="2026-09-21T12:54:13Z" level=info msg="Tagged docker.io/rancher/klipper-lb@sha256:910944bb0bd94f060a82a56ca1ea1c577d3e49b3473a093a47a985f32e92d94a" machine # [ 30.506677] k3s[896]: time="2026-09-21T12:54:13Z" level=info msg="Imported docker.io/rancher/local-path-provisioner:v0.0.37" machine # [ 30.508254] k3s[896]: time="2026-09-21T12:54:13Z" level=info msg="Tagged docker.io/rancher/local-path-provisioner@sha256:e757967a5ec338f6a9b371c5a9688bedaa8c3578ea3dd4db329ea0084be0a86f" machine # [ 30.510666] k3s[896]: time="2026-09-21T12:54:13Z" level=info msg="Imported docker.io/rancher/mirrored-coredns-coredns:1.14.6" machine # [ 30.512275] k3s[896]: time="2026-09-21T12:54:13Z" level=info msg="Tagged docker.io/rancher/mirrored-coredns-coredns@sha256:900f9c109f7a33545d3c811516e8376df9019147b750f5ce3e254468769176ea" machine # [ 30.514647] k3s[896]: time="2026-09-21T12:54:13Z" level=info msg="Imported docker.io/rancher/mirrored-library-busybox:1.37.0" machine # [ 30.516301] k3s[896]: time="2026-09-21T12:54:13Z" level=info msg="Tagged docker.io/rancher/mirrored-library-busybox@sha256:101b4afd76732482eff9b95cae5f94bcf295e521fbec4e01b69c5421f3f3f3e5" machine # [ 30.518638] k3s[896]: time="2026-09-21T12:54:13Z" level=info msg="Imported docker.io/rancher/mirrored-library-traefik:3.7.8" machine # [ 30.520261] k3s[896]: time="2026-09-21T12:54:13Z" level=info msg="Tagged docker.io/rancher/mirrored-library-traefik@sha256:4299bbed850421258fc5448c2e0e6ad350981d4d335a68de11b92448aedbefe5" machine # [ 30.522556] k3s[896]: time="2026-09-21T12:54:13Z" level=info msg="Imported docker.io/rancher/mirrored-metrics-server:v0.9.0" machine # [ 30.524145] k3s[896]: time="2026-09-21T12:54:13Z" level=info msg="Tagged docker.io/rancher/mirrored-metrics-server@sha256:d9862115e7c7881280d3d75ca26bda8ffc0fc213315979575bf23ce9826205c0" machine # [ 30.526544] k3s[896]: time="2026-09-21T12:54:13Z" level=info msg="Imported docker.io/rancher/mirrored-pause:3.10.2" machine # [ 30.528352] k3s[896]: I0921 12:54:13.214306 896 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="podcertificaterequest-cleaner-controller" requiredFeatureGates=["PodCertificateRequest"] machine # [ 30.529055] k3s[896]: I0921 12:54:13.214338 896 controllermanager.go:579] "Warning: skipping controller" controller="podcertificaterequest-cleaner-controller" machine # [ 30.530024] k3s[896]: time="2026-09-21T12:54:13Z" level=info msg="Tagged docker.io/rancher/mirrored-pause@sha256:f548e0e8e3dc1896ca956272154dde3314e8cc4fde0a57577ee9fa1c63f5baf4" machine # [ 30.805623] k3s[896]: time="2026-09-21T12:54:13Z" level=info msg="Imported 8 images from /var/lib/rancher/k3s/agent/images/k3s-airgap-images-amd64.tar.zst in 6.403901892s" machine # [ 30.810821] k3s[896]: time="2026-09-21T12:54:13Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-client.tar" machine # [ 31.144656] k3s[896]: I0921 12:54:13.830291 896 range_allocator.go:113] "No Secondary Service CIDR provided. Skipping filtering out secondary service addresses" logger="node-ipam-controller" machine # [ 31.190136] k3s[896]: I0921 12:54:13.875995 896 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" requiredFeatureGates=["ClusterTrustBundle"] machine # [ 31.196249] k3s[896]: I0921 12:54:13.876025 896 controllermanager.go:579] "Warning: skipping controller" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" machine # [ 31.248724] k3s[896]: I0921 12:54:13.934649 896 controller.go:667] quota admission added evaluator for: addons.k3s.cattle.io machine # [ 31.250767] k3s[896]: time="2026-09-21T12:54:13Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 31.253716] k3s[896]: time="2026-09-21T12:54:13Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=ApplyingManifest type=Normal machine # Error from server (NotFound): namespaces "farm" not found machine # [ 31.785945] k3s[896]: time="2026-09-21T12:54:14Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=AppliedManifest type=Normal machine # [ 31.798561] k3s[896]: time="2026-09-21T12:54:14Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=ApplyingManifest type=Normal machine # [ 31.929530] k3s[896]: I0921 12:54:14.615176 896 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="device-taint-eviction-controller" requiredFeatureGates=["DynamicResourceAllocation","DRADeviceTaints"] machine # [ 31.929685] k3s[896]: I0921 12:54:14.615208 896 controllermanager.go:579] "Warning: skipping controller" controller="device-taint-eviction-controller" machine # [ 31.934392] k3s[896]: I0921 12:54:14.617446 896 controller.go:423] "Starting resource claim controller" machine # [ 31.934942] k3s[896]: I0921 12:54:14.617478 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.935858] k3s[896]: I0921 12:54:14.620122 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.936746] k3s[896]: I0921 12:54:14.620163 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.937616] k3s[896]: I0921 12:54:14.620252 896 endpointslice_controller.go:283] "Starting endpoint slice controller" machine # [ 31.941105] k3s[896]: I0921 12:54:14.620266 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.941993] k3s[896]: I0921 12:54:14.620464 896 serviceaccounts_controller.go:117] "Starting service account controller" machine # [ 31.942836] k3s[896]: I0921 12:54:14.620477 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.943716] k3s[896]: I0921 12:54:14.620565 896 pv_controller_base.go:307] "Starting persistent volume controller" machine # [ 31.944208] k3s[896]: I0921 12:54:14.620578 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.944828] k3s[896]: I0921 12:54:14.620635 896 attach_detach_controller.go:335] "Starting attach detach controller" machine # [ 31.948653] k3s[896]: I0921 12:54:14.620648 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.949691] k3s[896]: I0921 12:54:14.620689 896 legacy_serviceaccount_token_cleaner.go:103] "Starting legacy service account token cleaner controller" machine # [ 31.950636] k3s[896]: I0921 12:54:14.620703 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.950915] k3s[896]: I0921 12:54:14.620767 896 servicecidrs_controller.go:136] "Starting" controller="service-cidr-controller" machine # [ 31.951701] k3s[896]: I0921 12:54:14.620779 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.952395] k3s[896]: I0921 12:54:14.620858 896 endpoints_controller.go:193] "Starting endpoint controller" machine # [ 31.953115] k3s[896]: I0921 12:54:14.620871 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.953623] k3s[896]: I0921 12:54:14.620946 896 stateful_set.go:180] "Starting stateful set controller" machine # [ 31.954115] k3s[896]: I0921 12:54:14.620958 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.954599] k3s[896]: I0921 12:54:14.620989 896 cleaner.go:83] "Starting CSR cleaner controller" machine # [ 31.958097] k3s[896]: I0921 12:54:14.621058 896 namespace_controller.go:202] "Starting namespace controller" machine # [ 31.958778] k3s[896]: I0921 12:54:14.621070 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.959449] k3s[896]: I0921 12:54:14.621155 896 daemon_controller.go:309] "Starting daemon sets controller" machine # [ 31.959940] k3s[896]: I0921 12:54:14.621166 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.960579] k3s[896]: I0921 12:54:14.621241 896 job_controller.go:254] "Starting job controller" machine # [ 31.961125] k3s[896]: I0921 12:54:14.621253 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.961554] k3s[896]: I0921 12:54:14.621336 896 cronjob_controllerv2.go:143] "Starting cronjob controller v2" machine # [ 31.962068] k3s[896]: I0921 12:54:14.621349 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.962568] k3s[896]: I0921 12:54:14.621379 896 ttl_controller.go:127] "Starting TTL controller" machine # [ 31.963068] k3s[896]: I0921 12:54:14.621390 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.963543] k3s[896]: I0921 12:54:14.621419 896 expand_controller.go:328] "Starting expand controller" machine # [ 31.964099] k3s[896]: I0921 12:54:14.621432 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.964609] k3s[896]: I0921 12:54:14.621462 896 clusterroleaggregation_controller.go:194] "Starting ClusterRoleAggregator controller" machine # [ 31.968096] k3s[896]: I0921 12:54:14.621473 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.968850] k3s[896]: I0921 12:54:14.621534 896 replica_set.go:241] "Starting controller" name="replicationcontroller" machine # [ 31.969650] k3s[896]: I0921 12:54:14.621547 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.970522] k3s[896]: I0921 12:54:14.621742 896 replica_set.go:241] "Starting controller" name="replicaset" machine # [ 31.971186] k3s[896]: I0921 12:54:14.621754 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.971849] k3s[896]: I0921 12:54:14.621813 896 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-legacy-unknown" machine # [ 31.972478] k3s[896]: I0921 12:54:14.621825 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.973156] k3s[896]: I0921 12:54:14.621868 896 pvc_protection_controller.go:166] "Starting PVC protection controller" machine # [ 31.973700] k3s[896]: I0921 12:54:14.621880 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.974433] k3s[896]: I0921 12:54:14.621914 896 controller.go:174] "Starting ephemeral volume controller" machine # [ 31.975084] k3s[896]: I0921 12:54:14.621928 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.977584] k3s[896]: I0921 12:54:14.621962 896 disruption.go:458] "Sending events to api server." machine # [ 31.978531] k3s[896]: I0921 12:54:14.621993 896 disruption.go:465] "Starting disruption controller" machine # [ 31.979055] k3s[896]: I0921 12:54:14.622003 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.979530] k3s[896]: I0921 12:54:14.622030 896 certificate_controller.go:120] "Starting certificate controller" name="csrapproving" machine # [ 31.979988] k3s[896]: I0921 12:54:14.622062 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.980642] k3s[896]: I0921 12:54:14.622112 896 node_lifecycle_controller.go:453] "Sending events to api server" machine # [ 31.981148] k3s[896]: I0921 12:54:14.622142 896 node_lifecycle_controller.go:460] "Starting node controller" machine # [ 31.981644] k3s[896]: I0921 12:54:14.622153 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.983267] k3s[896]: I0921 12:54:14.622190 896 taint_eviction.go:283] "Starting" controller="taint-eviction-controller" machine # [ 31.983700] k3s[896]: I0921 12:54:14.622236 896 taint_eviction.go:288] "Sending events to API server" machine # [ 31.984172] k3s[896]: I0921 12:54:14.622249 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.984671] k3s[896]: I0921 12:54:14.622319 896 endpointslicemirroring_controller.go:226] "Starting EndpointSliceMirroring controller" machine # [ 31.985157] k3s[896]: I0921 12:54:14.622332 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.985646] k3s[896]: I0921 12:54:14.622367 896 gc_controller.go:98] "Starting GC controller" machine # [ 31.988079] k3s[896]: I0921 12:54:14.622379 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.988649] k3s[896]: I0921 12:54:14.622449 896 node_ipam_controller.go:142] "Starting ipam controller" machine # [ 31.989121] k3s[896]: I0921 12:54:14.622461 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.989609] k3s[896]: I0921 12:54:14.622488 896 pv_protection_controller.go:81] "Starting PV protection controller" machine # [ 31.990128] k3s[896]: I0921 12:54:14.622501 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.990622] k3s[896]: I0921 12:54:14.622530 896 vac_protection_controller.go:206] "Starting VAC protection controller" machine # [ 31.993307] k3s[896]: I0921 12:54:14.622541 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.993944] k3s[896]: I0921 12:54:14.622571 896 ttlafterfinished_controller.go:112] "Starting TTL after finished controller" machine # [ 31.994590] k3s[896]: I0921 12:54:14.622584 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.995071] k3s[896]: I0921 12:54:14.622644 896 deployment_controller.go:172] "Starting controller" controller="deployment" machine # [ 31.995557] k3s[896]: I0921 12:54:14.622656 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.997738] k3s[896]: I0921 12:54:14.622694 896 horizontal.go:204] "Starting HPA controller" machine # [ 31.998583] k3s[896]: I0921 12:54:14.622711 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.999078] k3s[896]: I0921 12:54:14.622741 896 tokencleaner.go:117] "Starting token cleaner controller" machine # [ 31.999563] k3s[896]: I0921 12:54:14.622753 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 32.001699] k3s[896]: I0921 12:54:14.622789 896 publisher.go:107] "Starting root CA cert publisher controller" machine # [ 32.002445] k3s[896]: I0921 12:54:14.622801 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 32.002940] k3s[896]: I0921 12:54:14.623398 896 resource_quota_controller.go:297] "Starting resource quota controller" machine # [ 32.003647] k3s[896]: I0921 12:54:14.623411 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 32.006093] k3s[896]: I0921 12:54:14.623550 896 garbagecollector.go:141] "Starting controller" controller="garbagecollector" machine # [ 32.006732] k3s[896]: I0921 12:54:14.623576 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 32.007366] k3s[896]: I0921 12:54:14.623616 896 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-serving" machine # [ 32.007830] k3s[896]: I0921 12:54:14.623628 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 32.008519] k3s[896]: I0921 12:54:14.623665 896 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-client" machine # [ 32.010254] k3s[896]: I0921 12:54:14.623676 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 32.010843] k3s[896]: I0921 12:54:14.623727 896 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kube-apiserver-client" machine # [ 32.011492] k3s[896]: I0921 12:54:14.623743 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 32.011970] k3s[896]: I0921 12:54:14.623777 896 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 32.012670] k3s[896]: I0921 12:54:14.624411 896 resource_quota_monitor.go:309] "QuotaMonitor running" machine # [ 32.014922] k3s[896]: I0921 12:54:14.624529 896 graph_builder.go:386] "Running" component="GraphBuilder" machine # [ 32.015677] k3s[896]: I0921 12:54:14.624553 896 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 32.016194] k3s[896]: I0921 12:54:14.624620 896 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 32.016662] k3s[896]: I0921 12:54:14.624677 896 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 32.018739] k3s[896]: I0921 12:54:14.690209 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" resource="helmcharts.helm.cattle.io" machine # [ 32.019613] k3s[896]: I0921 12:54:14.690382 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" resource="helmchartconfigs.helm.cattle.io" machine # [ 32.020100] k3s[896]: I0921 12:54:14.690559 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 32.089935] k3s[896]: I0921 12:54:14.775799 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 32.135099] k3s[896]: I0921 12:54:14.821007 896 shared_informer.go:377] "Caches are synced" machine # [ 32.135312] k3s[896]: I0921 12:54:14.821036 896 shared_informer.go:377] "Caches are synced" machine # [ 32.135824] k3s[896]: I0921 12:54:14.821118 896 shared_informer.go:377] "Caches are synced" machine # [ 32.136440] k3s[896]: I0921 12:54:14.821212 896 shared_informer.go:377] "Caches are synced" machine # [ 32.136978] k3s[896]: I0921 12:54:14.821411 896 shared_informer.go:377] "Caches are synced" machine # [ 32.138050] k3s[896]: I0921 12:54:14.821462 896 shared_informer.go:377] "Caches are synced" machine # [ 32.139258] k3s[896]: I0921 12:54:14.825225 896 shared_informer.go:377] "Caches are synced" machine # [ 32.140385] k3s[896]: I0921 12:54:14.825495 896 shared_informer.go:377] "Caches are synced" machine # [ 32.146266] k3s[896]: I0921 12:54:14.832188 896 shared_informer.go:377] "Caches are synced" machine # [ 32.147954] k3s[896]: I0921 12:54:14.832241 896 shared_informer.go:377] "Caches are synced" machine # [ 32.148147] k3s[896]: I0921 12:54:14.832289 896 shared_informer.go:377] "Caches are synced" machine # [ 32.148584] k3s[896]: I0921 12:54:14.832811 896 shared_informer.go:377] "Caches are synced" machine # [ 32.149067] k3s[896]: I0921 12:54:14.832870 896 shared_informer.go:377] "Caches are synced" machine # [ 32.149559] k3s[896]: I0921 12:54:14.832928 896 shared_informer.go:377] "Caches are synced" machine # [ 32.150161] k3s[896]: I0921 12:54:14.832985 896 shared_informer.go:377] "Caches are synced" machine # [ 32.150682] k3s[896]: I0921 12:54:14.833020 896 shared_informer.go:377] "Caches are synced" machine # [ 32.151300] k3s[896]: I0921 12:54:14.833154 896 shared_informer.go:377] "Caches are synced" machine # [ 32.151440] k3s[896]: I0921 12:54:14.833212 896 shared_informer.go:377] "Caches are synced" machine # [ 32.152528] k3s[896]: I0921 12:54:14.833256 896 shared_informer.go:377] "Caches are synced" machine # [ 32.153091] k3s[896]: I0921 12:54:14.833297 896 range_allocator.go:177] "Sending events to api server" machine # [ 32.153645] k3s[896]: I0921 12:54:14.833323 896 range_allocator.go:181] "Starting range CIDR allocator" machine # [ 32.154223] k3s[896]: I0921 12:54:14.833333 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 32.154816] k3s[896]: I0921 12:54:14.833344 896 shared_informer.go:377] "Caches are synced" machine # [ 32.155219] k3s[896]: I0921 12:54:14.833407 896 shared_informer.go:377] "Caches are synced" machine # [ 32.155785] k3s[896]: I0921 12:54:14.833439 896 shared_informer.go:377] "Caches are synced" machine # [ 32.156508] k3s[896]: I0921 12:54:14.833480 896 shared_informer.go:377] "Caches are synced" machine # [ 32.160338] k3s[896]: I0921 12:54:14.833513 896 shared_informer.go:377] "Caches are synced" machine # [ 32.160933] k3s[896]: I0921 12:54:14.833557 896 shared_informer.go:377] "Caches are synced" machine # [ 32.161613] k3s[896]: I0921 12:54:14.833585 896 shared_informer.go:377] "Caches are synced" machine # [ 32.162113] k3s[896]: I0921 12:54:14.833822 896 shared_informer.go:377] "Caches are synced" machine # [ 32.162590] k3s[896]: I0921 12:54:14.833864 896 shared_informer.go:377] "Caches are synced" machine # [ 32.163111] k3s[896]: I0921 12:54:14.833895 896 shared_informer.go:377] "Caches are synced" machine # [ 32.163634] k3s[896]: I0921 12:54:14.834376 896 shared_informer.go:377] "Caches are synced" machine # [ 32.165928] k3s[896]: time="2026-09-21T12:54:14Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=AppliedManifest type=Normal machine # [ 32.175432] k3s[896]: time="2026-09-21T12:54:14Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=ApplyingManifest type=Normal machine # [ 32.206333] k3s[896]: I0921 12:54:14.892268 896 shared_informer.go:377] "Caches are synced" machine # [ 32.231697] k3s[896]: I0921 12:54:14.917633 896 shared_informer.go:377] "Caches are synced" machine # [ 32.235202] k3s[896]: I0921 12:54:14.921125 896 shared_informer.go:377] "Caches are synced" machine # [ 32.235702] k3s[896]: I0921 12:54:14.921177 896 shared_informer.go:377] "Caches are synced" machine # [ 32.236155] k3s[896]: I0921 12:54:14.921209 896 shared_informer.go:377] "Caches are synced" machine # [ 32.236624] k3s[896]: I0921 12:54:14.921215 896 shared_informer.go:377] "Caches are synced" machine # [ 32.237122] k3s[896]: I0921 12:54:14.921292 896 shared_informer.go:377] "Caches are synced" machine # [ 32.237537] k3s[896]: I0921 12:54:14.921388 896 shared_informer.go:377] "Caches are synced" machine # [ 32.238140] k3s[896]: I0921 12:54:14.922646 896 shared_informer.go:377] "Caches are synced" machine # [ 32.238914] k3s[896]: I0921 12:54:14.922690 896 shared_informer.go:377] "Caches are synced" machine # [ 32.239780] k3s[896]: I0921 12:54:14.922742 896 shared_informer.go:377] "Caches are synced" machine # [ 32.240598] k3s[896]: I0921 12:54:14.922776 896 shared_informer.go:377] "Caches are synced" machine # [ 32.241389] k3s[896]: I0921 12:54:14.923635 896 shared_informer.go:377] "Caches are synced" machine # [ 32.249735] k3s[896]: time="2026-09-21T12:54:14Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 32.384175] k3s[896]: I0921 12:54:15.069514 896 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 32.395057] k3s[896]: I0921 12:54:15.080288 896 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 32.429739] k3s[896]: I0921 12:54:15.115565 896 serving.go:392] Generated self-signed cert in-memory machine # [ 32.460320] k3s[896]: time="2026-09-21T12:54:15Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Deferred node password secret validation complete" object=machine reason=NodePasswordValidationComplete type=Normal machine # [ 32.542029] k3s[896]: I0921 12:54:15.227918 896 serving.go:392] Generated self-signed cert in-memory machine # [ 32.621167] k3s[896]: I0921 12:54:15.307123 896 controllermanager.go:160] Version: v1.35.8+k3s1 machine # [ 32.625811] k3s[896]: I0921 12:54:15.311774 896 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 32.627876] k3s[896]: I0921 12:54:15.311805 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 32.629982] k3s[896]: I0921 12:54:15.311856 896 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 32.633794] k3s[896]: I0921 12:54:15.311867 896 secure_serving.go:211] Serving securely on 127.0.0.1:10258 machine # [ 32.636097] k3s[896]: I0921 12:54:15.312126 896 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 32.639186] k3s[896]: I0921 12:54:15.312145 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 32.640911] k3s[896]: I0921 12:54:15.312282 896 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 32.642739] k3s[896]: I0921 12:54:15.311872 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 32.644609] k3s[896]: time="2026-09-21T12:54:15Z" level=info msg="Creating service-lb-controller event broadcaster" machine # [ 32.651722] k3s[896]: I0921 12:54:15.337686 896 controller.go:667] quota admission added evaluator for: deployments.apps machine # [ 32.667051] k3s[896]: I0921 12:54:15.353001 896 controller.go:667] quota admission added evaluator for: replicasets.apps machine # [ 32.726527] k3s[896]: I0921 12:54:15.412439 896 shared_informer.go:377] "Caches are synced" machine # [ 32.728546] k3s[896]: I0921 12:54:15.412501 896 shared_informer.go:377] "Caches are synced" machine: (finished: waiting for success: kubectl get ns farm, in 5.31 seconds) machine # [ 32.731054] k3s[896]: I0921 12:54:15.412519 896 shared_informer.go:377] "Caches are synced" machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/lb.crt --key=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/lb.key machine # [ 32.749622] postgres[1143]: [1143] ERROR: relation "goose_db_version" does not exist at character 36 machine # [ 32.751868] postgres[1143]: [1143] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC machine # [ 32.784988] niks3-server[1116]: 2026/09/21 12:54:15 OK 20241026095416_initial_model.sql (11.98ms) machine # [ 32.794122] niks3-server[1116]: 2026/09/21 12:54:15 OK 20251210153512_drop_unused_gin_index.sql (7.52ms) machine # [ 32.798332] niks3-server[1116]: 2026/09/21 12:54:15 OK 20251218171726_add_pins.sql (4.17ms) machine # [ 32.804643] niks3-server[1116]: 2026/09/21 12:54:15 OK 20260628120000_add_object_size_and_stats.sql (6.21ms) machine # [ 32.809906] niks3-server[1116]: 2026/09/21 12:54:15 OK 20260905000000_add_claims.sql (5.22ms) machine # [ 32.813463] niks3-server[1116]: 2026/09/21 12:54:15 OK 20260920000000_drop_claims.sql (3.52ms) machine # [ 32.813799] niks3-server[1116]: 2026/09/21 12:54:15 goose: successfully migrated database to version: 20260920000000 machine # [ 32.819236] niks3-server[1116]: 2026/09/21 12:54:15 OK 1_commit_pending_closure.sql (5.66ms) machine # [ 32.821222] niks3-server[1116]: 2026/09/21 12:54:15 OK 2_object_stats_trigger.sql (1.96ms) machine # [ 32.821888] niks3-server[1116]: 2026/09/21 12:54:15 goose: up to current file version: 2 machine # [ 32.846420] niks3-server[1116]: 2026/09/21 12:54:15 INFO OIDC provider initialized name=kubernetes issuer=https://kubernetes.default.svc.cluster.local machine # [ 32.846620] niks3-server[1116]: 2026/09/21 12:54:15 INFO OIDC authentication enabled config=/nix/store/2xcn0lgmca14rg9xzcfqj65j9hs85hn6-niks3-oidc.json machine # [ 32.852934] niks3-server[1116]: 2026/09/21 12:54:15 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key machine # [ 32.943099] niks3-server[1116]: 2026/09/21 12:54:15 INFO Read proxy enabled — serving cache objects from S3 machine # [ 32.943932] niks3-server[1116]: 2026/09/21 12:54:15 INFO Using socket-activated listener address=0.0.0.0:5751 machine # [ 32.945723] niks3-server[1116]: 2026/09/21 12:54:15 INFO systemd watchdog enabled interval=15s machine # [ 32.947396] systemd[1]: Started niks3 server. machine # [ 32.947928] systemd[1]: Reached target Multi-User System. machine # [ 32.949671] niks3-server[1116]: 2026/09/21 12:54:15 INFO Starting HTTP server address=0.0.0.0:5751 machine # [ 32.950626] systemd[1]: Startup finished in 1.292s (kernel) + 3.970s (initrd) + 27.683s (userspace) = 32.946s. machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/lb.crt --key=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/lb.key, in 0.23 seconds) machine # [ 32.972200] k3s[896]: I0921 12:54:15.657565 896 alloc.go:329] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.43.0.10"} machine: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/worker.crt --key=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/worker.key machine # [ 32.974671] k3s[896]: time="2026-09-21T12:54:15Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=AppliedManifest type=Normal machine # [ 33.174547] k3s[896]: time="2026-09-21T12:54:15Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 33.178704] k3s[896]: time="2026-09-21T12:54:15Z" level=info msg="Starting /v1, Kind=Pod controller" machine: (finished: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/worker.crt --key=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/worker.key, in 0.21 seconds) machine: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt machine # [ 33.184242] k3s[896]: time="2026-09-21T12:54:15Z" level=info msg="Starting apps/v1, Kind=DaemonSet controller" machine # [ 33.188222] k3s[896]: time="2026-09-21T12:54:15Z" level=info msg="Starting discovery.k8s.io/v1, Kind=EndpointSlice controller" machine # [ 33.188554] k3s[896]: I0921 12:54:15.874204 896 controllermanager.go:329] Started "cloud-node-lifecycle-controller" machine # [ 33.189048] k3s[896]: I0921 12:54:15.874259 896 node_lifecycle_controller.go:112] Sending events to api server machine # [ 33.189566] k3s[896]: I0921 12:54:15.874665 896 controllermanager.go:329] Started "service-lb-controller" machine # [ 33.190042] k3s[896]: W0921 12:54:15.874678 896 controllermanager.go:306] "node-route-controller" is disabled machine # [ 33.190491] k3s[896]: I0921 12:54:15.874834 896 controllermanager.go:329] Started "cloud-node-controller" machine # [ 33.190987] k3s[896]: I0921 12:54:15.875328 896 node_controller.go:176] Sending events to api server. machine # [ 33.191719] k3s[896]: I0921 12:54:15.875375 896 controller.go:235] Starting service controller machine # [ 33.192287] k3s[896]: I0921 12:54:15.875394 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 33.192779] k3s[896]: I0921 12:54:15.875455 896 node_controller.go:185] Waiting for informer caches to sync machine # [ 33.193069] k3s[896]: I0921 12:54:15.877622 896 shared_informer.go:377] "Caches are synced" machine # [ 33.237873] k3s[896]: I0921 12:54:15.923738 896 shared_informer.go:377] "Caches are synced" machine # [ 33.239222] k3s[896]: I0921 12:54:15.923767 896 garbagecollector.go:166] "Garbage collector: all resource monitors have synced" machine # [ 33.241315] k3s[896]: I0921 12:54:15.923777 896 garbagecollector.go:169] "Proceeding to collect garbage" machine # [ 33.249897] k3s[896]: time="2026-09-21T12:54:15Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine: (finished: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt, in 0.22 seconds) subtest: chart deploys and workers become Ready machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine # [ 33.489834] k3s[896]: I0921 12:54:16.175687 896 shared_informer.go:377] "Caches are synced" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 34.242614] k3s[896]: time="2026-09-21T12:54:16Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" object=kube-system/local-storage reason=DeletingManifest type=Normal machine # [ 34.249029] k3s[896]: time="2026-09-21T12:54:16Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 34.252052] k3s[896]: time="2026-09-21T12:54:16Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=ApplyingManifest type=Normal machine # [ 34.561285] k3s[896]: I0921 12:54:17.247013 896 controller.go:667] quota admission added evaluator for: helmcharts.helm.cattle.io machine # [ 34.566309] k3s[896]: time="2026-09-21T12:54:17Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=AppliedManifest type=Normal machine # [ 34.577276] k3s[896]: time="2026-09-21T12:54:17Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=ApplyingManifest type=Normal machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 35.146122] k3s[896]: time="2026-09-21T12:54:17Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Applying HelmChart from https://%{KUBERNETES_API}%/static/charts/nix-grpc-farm.tgz using Job kube-system/helm-install-nix-grpc-farm " object=kube-system/nix-grpc-farm reason=ApplyJob type=Normal machine # [ 35.165189] k3s[896]: I0921 12:54:17.851130 896 controller.go:667] quota admission added evaluator for: jobs.batch machine # [ 35.203340] k3s[896]: time="2026-09-21T12:54:17Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Resumed synced Job kube-system/helm-install-nix-grpc-farm" object=kube-system/nix-grpc-farm reason=ResumeJob type=Normal machine # [ 35.212057] k3s[896]: time="2026-09-21T12:54:17Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=AppliedManifest type=Normal machine # [ 35.222894] k3s[896]: time="2026-09-21T12:54:17Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=ApplyingManifest type=Normal machine # [ 35.250137] k3s[896]: time="2026-09-21T12:54:17Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 35.841167] k3s[896]: time="2026-09-21T12:54:18Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=AppliedManifest type=Normal machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 36.141777] k3s[896]: time="2026-09-21T12:54:18Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/traefik.yaml\"" object=kube-system/traefik reason=DeletingManifest type=Normal machine # [ 36.250716] k3s[896]: time="2026-09-21T12:54:18Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 37.249693] k3s[896]: time="2026-09-21T12:54:19Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 38.251761] k3s[896]: time="2026-09-21T12:54:20Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 38.797541] k3s[896]: time="2026-09-21T12:54:21Z" level=info msg="Started tunnel to 10.0.2.15:6443" machine # [ 38.797792] k3s[896]: time="2026-09-21T12:54:21Z" level=info msg="Stopped tunnel to 127.0.0.1:6443" machine # [ 38.800073] k3s[896]: time="2026-09-21T12:54:21Z" level=info msg="Connecting to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 38.808167] k3s[896]: time="2026-09-21T12:54:21Z" level=info msg="Proxy done" err="context canceled" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 38.810458] k3s[896]: time="2026-09-21T12:54:21Z" level=info msg="Handling backend connection request [machine]" machine # [ 38.812059] k3s[896]: time="2026-09-21T12:54:21Z" level=info msg="Connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 38.813470] k3s[896]: time="2026-09-21T12:54:21Z" level=info msg="Remotedialer connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 38.822164] k3s[896]: time="2026-09-21T12:54:21Z" level=info msg="error in remotedialer server [400]: websocket: close 1006 (abnormal closure): unexpected EOF" machine # [ 39.252213] k3s[896]: time="2026-09-21T12:54:21Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 40.250609] k3s[896]: time="2026-09-21T12:54:22Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 41.251655] k3s[896]: time="2026-09-21T12:54:23Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 42.250449] k3s[896]: time="2026-09-21T12:54:24Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 43.252080] k3s[896]: time="2026-09-21T12:54:25Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 44.249714] k3s[896]: time="2026-09-21T12:54:26Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 45.251712] k3s[896]: time="2026-09-21T12:54:27Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 46.250296] k3s[896]: time="2026-09-21T12:54:28Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 47.250327] k3s[896]: time="2026-09-21T12:54:29Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 48.251173] k3s[896]: time="2026-09-21T12:54:30Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 49.249526] k3s[896]: time="2026-09-21T12:54:31Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 49.351899] k3s[896]: time="2026-09-21T12:54:32Z" level=info msg="Imported docker.io/library/nix-grpc-farm-client:0.1.0-beta.1" machine # [ 49.355255] k3s[896]: time="2026-09-21T12:54:32Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-client@sha256:db66e1d5f1ebe06290530874107c93b0d1ad52e8e922f5f4af314bdf23c691de" machine # [ 49.762370] k3s[896]: time="2026-09-21T12:54:32Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-client.tar in 18.956747014s" machine # [ 49.764148] k3s[896]: time="2026-09-21T12:54:32Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-lb.tar" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 50.250268] k3s[896]: time="2026-09-21T12:54:32Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 51.252730] k3s[896]: time="2026-09-21T12:54:33Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 52.249415] k3s[896]: time="2026-09-21T12:54:34Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 53.251124] k3s[896]: time="2026-09-21T12:54:35Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 54.251987] k3s[896]: time="2026-09-21T12:54:36Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 54.598798] k3s[896]: time="2026-09-21T12:54:37Z" level=info msg="Imported docker.io/library/nix-grpc-farm-lb:0.1.0-beta.1" machine # [ 54.606584] k3s[896]: time="2026-09-21T12:54:37Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-lb@sha256:a3fb275e15335967c368c203214cabcce2886a8867fcd31c07e4effd2ad9a5ec" machine # [ 54.650796] k3s[896]: time="2026-09-21T12:54:37Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-lb.tar in 4.887574817s" machine # [ 54.653600] k3s[896]: time="2026-09-21T12:54:37Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm.tar" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 54.932437] k3s[896]: time="2026-09-21T12:54:37Z" level=info msg="Running kubelet --cloud-provider=external --config-dir=/var/lib/rancher/k3s/agent/etc/kubelet.conf.d --containerd=/run/k3s/containerd/containerd.sock --eviction-hard=nodefs.available<1%,imagefs.available<1% --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubelet.kubeconfig --node-ip=10.0.2.15,fec0::f591:dc8e:8e2c:368 --node-labels= --read-only-port=0" machine # [ 54.946839] k3s[896]: Flag --containerd has been deprecated, This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed. machine # [ 54.973225] k3s[896]: I0921 12:54:37.659166 896 server.go:521] "Kubelet version" kubeletVersion="v1.35.8+k3s1" machine # [ 54.973383] k3s[896]: I0921 12:54:37.659224 896 server.go:523] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 54.975075] k3s[896]: I0921 12:54:37.659286 896 watchdog_linux.go:95] "Systemd watchdog is not enabled" machine # [ 54.975343] k3s[896]: I0921 12:54:37.659313 896 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." machine # [ 54.976476] k3s[896]: I0921 12:54:37.662398 896 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/agent/client-ca.crt" machine # [ 54.982328] k3s[896]: I0921 12:54:37.667556 896 server.go:1414] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" machine # [ 54.986441] k3s[896]: I0921 12:54:37.672392 896 server.go:771] "--cgroups-per-qos enabled, but --cgroup-root was not specified. Defaulting to /" machine # [ 54.987119] k3s[896]: I0921 12:54:37.672423 896 server.go:832] "NoSwap is set due to memorySwapBehavior not specified" memorySwapBehavior="" FailSwapOn=false machine # [ 54.988095] k3s[896]: I0921 12:54:37.672611 896 container_manager_linux.go:272] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] machine # [ 54.989277] k3s[896]: I0921 12:54:37.672635 896 container_manager_linux.go:277] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"machine","RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} machine # [ 54.990319] k3s[896]: I0921 12:54:37.672818 896 topology_manager.go:143] "Creating topology manager with none policy" machine # [ 54.991222] k3s[896]: I0921 12:54:37.672832 896 container_manager_linux.go:308] "Creating device plugin manager" machine # [ 54.992097] k3s[896]: I0921 12:54:37.672916 896 container_manager_linux.go:317] "Creating Dynamic Resource Allocation (DRA) manager" machine # [ 54.993474] k3s[896]: I0921 12:54:37.679447 896 state_mem.go:41] "Initialized" logger="CPUManager state memory" machine # [ 54.994266] k3s[896]: I0921 12:54:37.679668 896 kubelet.go:482] "Attempting to sync node with API server" machine # [ 54.994961] k3s[896]: I0921 12:54:37.679686 896 kubelet.go:383] "Adding static pod path" path="/var/lib/rancher/k3s/agent/pod-manifests" machine # [ 54.995887] k3s[896]: I0921 12:54:37.679714 896 kubelet.go:394] "Adding apiserver pod source" machine # [ 54.996789] k3s[896]: I0921 12:54:37.679733 896 apiserver.go:42] "Waiting for node sync before watching apiserver pods" machine # [ 55.020310] k3s[896]: I0921 12:54:37.706204 896 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="containerd" version="2.2.7-k3s1" apiVersion="v1" machine # [ 55.023130] k3s[896]: I0921 12:54:37.707438 896 kubelet.go:945] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" machine # [ 55.025682] k3s[896]: I0921 12:54:37.707498 896 kubelet.go:972] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" machine # [ 55.025952] k3s[896]: I0921 12:54:37.710960 896 server.go:1252] "Started kubelet" machine # [ 55.026571] k3s[896]: I0921 12:54:37.711395 896 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 machine # [ 55.027055] k3s[896]: I0921 12:54:37.711459 896 server_v1.go:49] "podresources" method="list" useActivePods=true machine # [ 55.027210] k3s[896]: I0921 12:54:37.711445 896 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 machine # [ 55.027685] k3s[896]: I0921 12:54:37.712927 896 server.go:317] "Adding debug handlers to kubelet server" machine # [ 55.029458] k3s[896]: I0921 12:54:37.714243 896 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" machine # [ 55.030683] k3s[896]: I0921 12:54:37.715315 896 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" machine # [ 55.035048] k3s[896]: I0921 12:54:37.718879 896 dynamic_serving_content.go:135] "Starting controller" name="kubelet-server-cert-files::/var/lib/rancher/k3s/agent/serving-kubelet.crt::/var/lib/rancher/k3s/agent/serving-kubelet.key" machine # [ 55.036398] k3s[896]: I0921 12:54:37.722365 896 volume_manager.go:311] "Starting Kubelet Volume Manager" machine # [ 55.036996] k3s[896]: I0921 12:54:37.722759 896 desired_state_of_world_populator.go:146] "Desired state populator starts to run" machine # [ 55.037488] k3s[896]: E0921 12:54:37.722829 896 kubelet_node_status.go:392] "Error getting the current node from lister" err="node \"machine\" not found" machine # [ 55.038047] k3s[896]: I0921 12:54:37.722874 896 reconciler.go:29] "Reconciler: start to sync state" machine # [ 55.040561] k3s[896]: I0921 12:54:37.726507 896 factory.go:223] Registration of the systemd container factory successfully machine # [ 55.041241] k3s[896]: I0921 12:54:37.726636 896 factory.go:221] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory machine # [ 55.042872] k3s[896]: E0921 12:54:37.728825 896 kubelet.go:1661] "Image garbage collection failed once. Stats initialization may not have completed yet" err="invalid capacity 0 on image filesystem" machine # [ 55.043426] k3s[896]: E0921 12:54:37.729390 896 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"machine\" not found" node="machine" machine # [ 55.046403] k3s[896]: I0921 12:54:37.730863 896 factory.go:223] Registration of the containerd container factory successfully machine # [ 55.057819] k3s[896]: I0921 12:54:37.743771 896 cpu_manager.go:225] "Starting" policy="none" machine # [ 55.058779] k3s[896]: I0921 12:54:37.743791 896 cpu_manager.go:226] "Reconciling" reconcilePeriod="10s" machine # [ 55.059211] k3s[896]: I0921 12:54:37.743813 896 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" machine # [ 55.060068] k3s[896]: I0921 12:54:37.746027 896 policy_none.go:50] "Start" machine # [ 55.060915] k3s[896]: I0921 12:54:37.746069 896 memory_manager.go:187] "Starting memorymanager" policy="None" machine # [ 55.062135] k3s[896]: I0921 12:54:37.746085 896 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" machine # [ 55.066481] k3s[896]: I0921 12:54:37.751992 896 policy_none.go:44] "Start" machine # [ 55.073784] systemd[1]: Created slice libcontainer container kubepods.slice. machine # [ 55.086286] systemd[1]: Created slice libcontainer container kubepods-besteffort.slice. machine # [ 55.094486] systemd[1]: Created slice libcontainer container kubepods-burstable.slice. machine # [ 55.096577] k3s[896]: E0921 12:54:37.782563 896 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" machine # [ 55.096702] k3s[896]: I0921 12:54:37.782684 896 eviction_manager.go:194] "Eviction manager: starting control loop" machine # [ 55.097625] k3s[896]: I0921 12:54:37.782709 896 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" machine # [ 55.098110] k3s[896]: I0921 12:54:37.783394 896 plugin_manager.go:121] "Starting Kubelet Plugin Manager" machine # [ 55.100417] k3s[896]: E0921 12:54:37.786405 896 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="no imagefs label for configured runtime" machine # [ 55.101047] k3s[896]: E0921 12:54:37.786443 896 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"machine\" not found" machine # [ 55.198491] k3s[896]: I0921 12:54:37.884450 896 kubelet_node_status.go:74] "Attempting to register node" node="machine" machine # [ 55.204151] k3s[896]: I0921 12:54:37.889736 896 kubelet_node_status.go:77] "Successfully registered node" node="machine" machine # [ 55.204677] k3s[896]: E0921 12:54:37.889779 896 kubelet_node_status.go:474] "Error updating node status, will retry" err="error getting node \"machine\": node \"machine\" not found" machine # [ 55.205198] k3s[896]: time="2026-09-21T12:54:37Z" level=info msg="Adding node OwnerReference to node-password secret machine.node-password.k3s" machine # [ 55.205710] k3s[896]: I0921 12:54:37.891444 896 node_controller.go:429] Initializing node machine with cloud provider machine # [ 55.206166] k3s[896]: I0921 12:54:37.891492 896 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 55.206647] k3s[896]: E0921 12:54:37.891512 896 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 55.209117] k3s[896]: I0921 12:54:37.892987 896 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"machine\" does not exist" machine # [ 55.211543] k3s[896]: I0921 12:54:37.897465 896 node_controller.go:429] Initializing node machine with cloud provider machine # [ 55.212566] k3s[896]: I0921 12:54:37.897520 896 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 55.213057] k3s[896]: E0921 12:54:37.897537 896 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 55.216106] k3s[896]: time="2026-09-21T12:54:37Z" level=info msg="Synced coredns NodeHosts entries for machine" machine # [ 55.220061] k3s[896]: I0921 12:54:37.905603 896 node_controller.go:429] Initializing node machine with cloud provider machine # [ 55.220727] k3s[896]: I0921 12:54:37.905652 896 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 55.221249] k3s[896]: E0921 12:54:37.905669 896 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 55.221686] k3s[896]: I0921 12:54:37.905669 896 range_allocator.go:433] "Set node PodCIDR" node="machine" podCIDRs=["10.42.0.0/24"] machine # [ 55.224359] k3s[896]: I0921 12:54:37.908498 896 node_controller.go:429] Initializing node machine with cloud provider machine # [ 55.225239] k3s[896]: I0921 12:54:37.908541 896 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 55.225692] k3s[896]: E0921 12:54:37.908558 896 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 55.229042] k3s[896]: I0921 12:54:37.915002 896 node_controller.go:429] Initializing node machine with cloud provider machine # [ 55.234024] k3s[896]: time="2026-09-21T12:54:37Z" level=info msg="Annotations and labels have been set successfully on node: machine" machine # [ 55.234840] k3s[896]: time="2026-09-21T12:54:37Z" level=info msg="Starting flannel with backend vxlan" machine # [ 55.236118] k3s[896]: I0921 12:54:37.921320 896 kuberuntime_manager.go:2095] "Updating runtime config through cri with podcidr" CIDR="10.42.0.0/24" machine # [ 55.238139] k3s[896]: I0921 12:54:37.924076 896 kubelet_network.go:47] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.42.0.0/24" machine # [ 55.253718] k3s[896]: time="2026-09-21T12:54:37Z" level=info msg="Labels and annotations have been set successfully on node: machine" machine # [ 55.254108] k3s[896]: time="2026-09-21T12:54:37Z" level=info msg="Flannel found PodCIDR assigned for node machine" machine # [ 55.254888] k3s[896]: time="2026-09-21T12:54:37Z" level=info msg="The interface eth0 with ipv4 address 10.0.2.15 will be used by flannel" machine # [ 55.256308] k3s[896]: I0921 12:54:37.941389 896 kube.go:139] Waiting 10m0s for node controller to sync machine # [ 55.257255] k3s[896]: I0921 12:54:37.941460 896 kube.go:537] Starting kube subnet manager machine # [ 55.300768] k3s[896]: I0921 12:54:37.986719 896 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" machine # [ 55.315561] k3s[896]: I0921 12:54:38.001470 896 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" machine # [ 55.317916] k3s[896]: I0921 12:54:38.001514 896 status_manager.go:249] "Starting to sync pod status with apiserver" machine # [ 55.318875] k3s[896]: I0921 12:54:38.001556 896 kubelet.go:2506] "Starting kubelet main sync loop" machine # [ 55.319564] k3s[896]: E0921 12:54:38.001610 896 kubelet.go:2530] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" machine # [ 55.320821] k3s[896]: I0921 12:54:38.002920 896 node_controller.go:474] Successfully initialized node machine with cloud provider machine # [ 55.322066] k3s[896]: I0921 12:54:38.003243 896 event.go:389] "Event occurred" object="machine" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="Synced" message="Node synced successfully" machine # [ 55.335394] k3s[896]: I0921 12:54:38.021371 896 server.go:173] "Starting Kubernetes Scheduler" version="v1.35.8+k3s1" machine # [ 55.335537] k3s[896]: I0921 12:54:38.021396 896 server.go:175] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 55.343425] k3s[896]: I0921 12:54:38.029151 896 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 55.346605] k3s[896]: I0921 12:54:38.029184 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 55.348250] k3s[896]: I0921 12:54:38.029208 896 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 55.349780] k3s[896]: I0921 12:54:38.029234 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 55.351068] k3s[896]: I0921 12:54:38.029242 896 secure_serving.go:211] Serving securely on 127.0.0.1:10259 machine # [ 55.352944] k3s[896]: I0921 12:54:38.029331 896 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 55.356933] k3s[896]: I0921 12:54:38.029389 896 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 55.360128] k3s[896]: I0921 12:54:38.029409 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 55.361938] k3s[896]: I0921 12:54:38.029425 896 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 55.457255] k3s[896]: I0921 12:54:38.143141 896 kubelet_node_status.go:427] "Fast updating node status as it just became ready" machine # [ 55.544281] k3s[896]: I0921 12:54:38.230204 896 shared_informer.go:377] "Caches are synced" machine # [ 55.544519] k3s[896]: I0921 12:54:38.230243 896 shared_informer.go:377] "Caches are synced" machine # [ 55.544959] k3s[896]: I0921 12:54:38.230813 896 shared_informer.go:377] "Caches are synced" machine # [ 55.677130] k3s[896]: I0921 12:54:38.362963 896 server.go:218] "Successfully retrieved NodeIPs" NodeIPs=["10.0.2.15","fec0::f591:dc8e:8e2c:368"] machine # [ 55.677386] k3s[896]: E0921 12:54:38.363153 896 server.go:255] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`" machine # [ 55.718611] k3s[896]: I0921 12:54:38.404493 896 server.go:264] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4" machine # [ 55.718771] k3s[896]: I0921 12:54:38.404569 896 server_linux.go:136] "Using iptables Proxier" machine # [ 55.756864] k3s[896]: I0921 12:54:38.442769 896 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4" machine # [ 55.777441] k3s[896]: I0921 12:54:38.463401 896 server.go:529] "Version info" version="v1.35.8+k3s1" machine # [ 55.777824] k3s[896]: I0921 12:54:38.463439 896 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 55.779247] k3s[896]: I0921 12:54:38.465211 896 config.go:200] "Starting service config controller" machine # [ 55.779717] k3s[896]: I0921 12:54:38.465239 896 shared_informer.go:349] "Waiting for caches to sync" controller="service config" machine # [ 55.781108] k3s[896]: I0921 12:54:38.465251 896 config.go:309] "Starting node config controller" machine # [ 55.782451] k3s[896]: I0921 12:54:38.465268 896 shared_informer.go:349] "Waiting for caches to sync" controller="node config" machine # [ 55.785071] k3s[896]: I0921 12:54:38.465276 896 config.go:106] "Starting endpoint slice config controller" machine # [ 55.785520] k3s[896]: I0921 12:54:38.465281 896 shared_informer.go:356] "Caches are synced" controller="node config" machine # [ 55.786039] k3s[896]: I0921 12:54:38.465291 896 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config" machine # [ 55.786743] k3s[896]: I0921 12:54:38.465457 896 config.go:403] "Starting serviceCIDR config controller" machine # [ 55.787668] k3s[896]: I0921 12:54:38.465473 896 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 55.995185] k3s[896]: I0921 12:54:38.680885 896 apiserver.go:52] "Watching apiserver" machine # [ 56.154643] systemd[1]: Created slice libcontainer container kubepods-burstable-poddd679374_936f_4ef9_a9fd_c67bfe3ee2f9.slice. machine # [ 56.164136] systemd[1]: Created slice libcontainer container kubepods-burstable-pod2cbbdcd6_b9ea_44b2_bf6b_4a65dcc5306a.slice. machine # [ 56.179549] k3s[896]: I0921 12:54:38.865497 896 shared_informer.go:356] "Caches are synced" controller="service config" machine # [ 56.179864] k3s[896]: I0921 12:54:38.865559 896 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config" machine # [ 56.182907] k3s[896]: I0921 12:54:38.868879 896 shared_informer.go:356] "Caches are synced" controller="endpoint slice config" machine # [ 56.237985] k3s[896]: I0921 12:54:38.923920 896 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" machine # [ 56.245043] k3s[896]: I0921 12:54:38.930981 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qlgp\" (UniqueName: \"kubernetes.io/projected/dd679374-936f-4ef9-a9fd-c67bfe3ee2f9-kube-api-access-9qlgp\") pod \"coredns-c5fdd76cf-95hgz\" (UID: \"dd679374-936f-4ef9-a9fd-c67bfe3ee2f9\") " pod="kube-system/coredns-c5fdd76cf-95hgz" machine # [ 56.245531] k3s[896]: I0921 12:54:38.931104 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a-klipper-cache\") pod \"helm-install-nix-grpc-farm-9z2sv\" (UID: \"2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a\") " pod="kube-system/helm-install-nix-grpc-farm-9z2sv" machine # [ 56.246190] k3s[896]: I0921 12:54:38.931139 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a-klipper-config\") pod \"helm-install-nix-grpc-farm-9z2sv\" (UID: \"2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a\") " pod="kube-system/helm-install-nix-grpc-farm-9z2sv" machine # [ 56.246849] k3s[896]: I0921 12:54:38.931171 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"values\" (UniqueName: \"kubernetes.io/projected/2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a-values\") pod \"helm-install-nix-grpc-farm-9z2sv\" (UID: \"2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a\") " pod="kube-system/helm-install-nix-grpc-farm-9z2sv" machine # [ 56.247661] k3s[896]: I0921 12:54:38.931202 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"content\" (UniqueName: \"kubernetes.io/configmap/2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a-content\") pod \"helm-install-nix-grpc-farm-9z2sv\" (UID: \"2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a\") " pod="kube-system/helm-install-nix-grpc-farm-9z2sv" machine # [ 56.248170] k3s[896]: I0921 12:54:38.931227 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dd679374-936f-4ef9-a9fd-c67bfe3ee2f9-config-volume\") pod \"coredns-c5fdd76cf-95hgz\" (UID: \"dd679374-936f-4ef9-a9fd-c67bfe3ee2f9\") " pod="kube-system/coredns-c5fdd76cf-95hgz" machine # [ 56.248679] k3s[896]: I0921 12:54:38.931253 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd679374-936f-4ef9-a9fd-c67bfe3ee2f9-custom-config-volume\") pod \"coredns-c5fdd76cf-95hgz\" (UID: \"dd679374-936f-4ef9-a9fd-c67bfe3ee2f9\") " pod="kube-system/coredns-c5fdd76cf-95hgz" machine # [ 56.249416] k3s[896]: I0921 12:54:38.931293 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a-klipper-helm\") pod \"helm-install-nix-grpc-farm-9z2sv\" (UID: \"2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a\") " pod="kube-system/helm-install-nix-grpc-farm-9z2sv" machine # [ 56.249965] k3s[896]: I0921 12:54:38.931326 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a-tmp\") pod \"helm-install-nix-grpc-farm-9z2sv\" (UID: \"2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a\") " pod="kube-system/helm-install-nix-grpc-farm-9z2sv" machine # [ 56.250664] k3s[896]: I0921 12:54:38.931350 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc27d\" (UniqueName: \"kubernetes.io/projected/2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a-kube-api-access-xc27d\") pod \"helm-install-nix-grpc-farm-9z2sv\" (UID: \"2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a\") " pod="kube-system/helm-install-nix-grpc-farm-9z2sv" machine # [ 56.291712] k3s[896]: I0921 12:54:38.977319 896 kube.go:163] Node controller sync successful machine # [ 56.293456] k3s[896]: I0921 12:54:38.977404 896 vxlan.go:128] VXLAN config: VNI=1 Port=0 GBP=false Learning=false DirectRouting=false machine # [ 56.296146] k3s[896]: I0921 12:54:38.980865 896 kube.go:704] List of node(machine) annotations: map[string]string{"alpha.kubernetes.io/provided-node-ip":"10.0.2.15,fec0::f591:dc8e:8e2c:368", "k3s.io/hostname":"machine", "k3s.io/internal-ip":"10.0.2.15,fec0::f591:dc8e:8e2c:368", "k3s.io/node-args":"[\"server\",\"--disable\",\"traefik\",\"--disable\",\"metrics-server\",\"--disable\",\"local-storage\",\"--kubelet-arg\",\"eviction-hard=nodefs.available\\u003c1%,imagefs.available\\u003c1%\"]", "k3s.io/node-config-hash":"EFXPOZ7ZWHRCLFNW4X4ZDPFQMSAOP3BLEIN2VE47TDRKQ4UIWKUQ====", "k3s.io/node-env":"{}", "node.alpha.kubernetes.io/ttl":"0", "volumes.kubernetes.io/controller-managed-attach-detach":"true"} machine # [ 56.335713] (udev-worker)[1548]: Network interface NamePolicy= disabled on kernel command line. machine # [ 56.335978] k3s[896]: time="2026-09-21T12:54:39Z" level=info msg="Tunnel authorizer set Kubelet Port 0.0.0.0:10250" machine # [ 56.344138] k3s[896]: I0921 12:54:39.029365 896 iptables.go:50] Starting flannel in iptables mode... machine # [ 56.344303] k3s[896]: time="2026-09-21T12:54:39Z" level=warning msg="no subnet found for key: FLANNEL_NETWORK in file: /run/flannel/subnet.env" machine # [ 56.345566] k3s[896]: time="2026-09-21T12:54:39Z" level=warning msg="no subnet found for key: FLANNEL_SUBNET in file: /run/flannel/subnet.env" machine # [ 56.346451] k3s[896]: I0921 12:54:39.029422 896 kube.go:558] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.42.0.0/24] machine # [ 56.347754] k3s[896]: time="2026-09-21T12:54:39Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_NETWORK in file: /run/flannel/subnet.env" machine # [ 56.348438] k3s[896]: time="2026-09-21T12:54:39Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_SUBNET in file: /run/flannel/subnet.env" machine # [ 56.349062] k3s[896]: I0921 12:54:39.029486 896 iptables.go:101] Current network or subnet (10.42.0.0/16, 10.42.0.0/24) is not equal to previous one (0.0.0.0/0, 0.0.0.0/0), trying to recycle old iptables rules machine # [ 56.390584] dhcpcd[676]: flannel.1: IAID de:4b:1e:ce machine # [ 56.391062] dhcpcd[676]: flannel.1: adding address fe80::ec60:deff:fe4b:1ece machine # [ 56.452926] k3s[896]: I0921 12:54:39.138834 896 iptables.go:111] Setting up masking rules machine # [ 56.474994] k3s[896]: I0921 12:54:39.160944 896 iptables.go:212] Changing default FORWARD chain policy to ACCEPT machine # [ 56.489976] k3s[896]: time="2026-09-21T12:54:39Z" level=info msg="Wrote flannel subnet file to /run/flannel/subnet.env" machine # [ 56.490355] k3s[896]: time="2026-09-21T12:54:39Z" level=info msg="Running flannel backend" machine # [ 56.490553] k3s[896]: I0921 12:54:39.175985 896 vxlan_network.go:68] watching for new subnet leases machine # [ 56.490945] k3s[896]: I0921 12:54:39.176011 896 vxlan_network.go:115] starting vxlan device watcher machine # [ 56.569359] k3s[896]: I0921 12:54:39.255273 896 iptables.go:358] bootstrap done machine # [ 56.746478] cni0: port 1(vethb7ddb90a) entered blocking state machine # [ 56.747447] cni0: port 1(vethb7ddb90a) entered disabled state machine # [ 56.749251] vethb7ddb90a: entered allmulticast mode machine # [ 56.750270] vethb7ddb90a: entered promiscuous mode machine # [ 56.752656] cni0: port 2(vethde987c7b) entered blocking state machine # [ 56.598396] ([ 56.753879] cni0: port 2(vethde987c7b) entered disabled state machine # udev-worker)[154[ 56.754560] vethde987c7b: entered allmulticast mode machine # 7]: Network interface NamePolicy[ 56.755489] vethde987c7b: entered promiscuous mode machine # = disabled on kernel command line. machine # [ 56.775815] cni0: port 1(vethb7ddb90a) entered blocking state machine # [ 56.776498] cni0: port 1(vethb7ddb90a) entered forwarding state machine # [ 56.778476] cni0: port 2(vethde987c7b) entered blocking state machine # [ 56.779413] cni0: port 2(vethde987c7b) entered forwarding state machine # [ 56.670111] dhcpcd[676]: vethb7ddb90a: waiting for carrier machine # [ 56.681980] k3s[896]: I0921 12:54:39.367939 896 iptables.go:358] bootstrap done machine # [ 56.688613] dhcpcd[676]: vethde987c7b: IAID 62:41:87:78 machine # [ 56.689941] dhcpcd[676]: vethde987c7b: adding address fe80::88d0:62ff:fe41:8778 machine # [ 56.691677] dhcpcd[676]: vethb7ddb90a: carrier acquired machine # [ 56.698570] dhcpcd[676]: vethb7ddb90a: IAID 53:8d:d9:22 machine # [ 56.698798] dhcpcd[676]: vethb7ddb90a: adding address fe80::183d:53ff:fe8d:d922 machine # [ 56.846535] systemd[1]: Started libcontainer container 062dbad7d0413e047fb2cf841704d910cd1d5165031b38f877914ef5c7f0c6f4. machine # [ 56.848974] systemd[1]: Started libcontainer container a66c00ba7628563ab662c92859be6399d14ec66e628d725b9f180401488e4cd6. machine # [ 57.021898] dhcpcd[676]: vethb7ddb90a: soliciting a DHCP lease machine # [ 57.150535] k3s[896]: I0921 12:54:39.836423 896 node_lifecycle_controller.go:1234] "Initializing eviction metric for zone" zone="" machine # [ 57.154298] k3s[896]: I0921 12:54:39.840180 896 node_lifecycle_controller.go:886] "Missing timestamp for Node. Assuming now as a timestamp" node="machine" machine # [ 57.156386] k3s[896]: I0921 12:54:39.840258 896 node_lifecycle_controller.go:1080] "Controller detected that zone is now in new state" zone="" newState="Normal" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 57.601934] dhcpcd[676]: flannel.1: soliciting a DHCP lease machine # [ 57.804641] systemd[1]: Started libcontainer container 597a4731ed09a4dfd72d6d590385a2fbcea94428441804440b57c2160fcd2517. machine # [ 57.824878] k3s[896]: time="2026-09-21T12:54:40Z" level=info msg="Starting network policy controller version v2.6.3-k3s1, built on 1970-01-01T01:01:01Z, go1.26.7" machine # [ 57.825233] k3s[896]: I0921 12:54:40.510525 896 network_policy_controller.go:164] Starting network policy controller machine # [ 58.090837] dhcpcd[676]: flannel.1: soliciting an IPv6 router machine # [ 58.109299] systemd[1]: Started libcontainer container 8eeb91b6f18bdfdad567abe75451e1a91ff1ebf247096295f216e8930ec49689. machine # [ 58.258364] k3s[896]: I0921 12:54:40.944293 896 network_policy_controller.go:179] Starting network policy controller full sync goroutine machine # [ 58.306703] dhcpcd[676]: vethde987c7b: soliciting a DHCP lease machine # [ 58.406165] k3s[896]: I0921 12:54:41.091510 896 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/coredns-c5fdd76cf-95hgz" podStartSLOduration=26.091487739 podStartE2EDuration="26.091487739s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-21 12:54:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-21 12:54:41.060440776 +0000 UTC m=+37.420891758" watchObservedRunningTime="2026-09-21 12:54:41.091487739 +0000 UTC m=+37.451938721" machine # [ 58.417183] dhcpcd[676]: vethde987c7b: soliciting an IPv6 router machine # [ 58.440466] k3s[896]: I0921 12:54:41.124563 896 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/helm-install-nix-grpc-farm-9z2sv" podStartSLOduration=24.124540263 podStartE2EDuration="24.124540263s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-21 12:54:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-21 12:54:41.11810844 +0000 UTC m=+37.478560261" watchObservedRunningTime="2026-09-21 12:54:41.124540263 +0000 UTC m=+37.484991246" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 58.726799] dhcpcd[676]: vethb7ddb90a: soliciting an IPv6 router machine # [ 59.474170] k3s[896]: I0921 12:54:42.159481 896 alloc.go:329] "allocated clusterIPs" service="farm/nix-grpc-farm" clusterIPs={"IPv4":"10.43.149.59"} machine # [ 59.522484] systemd[1]: cri-containerd-8eeb91b6f18bdfdad567abe75451e1a91ff1ebf247096295f216e8930ec49689.scope: Deactivated successfully. machine # [ 59.526437] systemd[1]: cri-containerd-8eeb91b6f18bdfdad567abe75451e1a91ff1ebf247096295f216e8930ec49689.scope: Consumed 584ms CPU time over 1.411s wall clock time, 32.9M memory peak, 2.4M incoming IP traffic, 140.3K outgoing IP traffic. machine # [ 59.588881] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-8eeb91b6f18bdfdad567abe75451e1a91ff1ebf247096295f216e8930ec49689-rootfs.mount: Deactivated successfully. machine # [ 60.181431] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod2d6fd6dc_95e5_4115_84ac_25fa446d9bb2.slice. machine # [ 60.201099] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod9dc12634_dfd3_4adf_ac15_f22dcd199a00.slice. machine # [ 60.219903] systemd[1]: Created slice libcontainer container kubepods-besteffort-podfd2a7de8_9d99_44b3_b0ba_9001acbb58ed.slice. machine # [ 60.241134] systemd[1]: Created slice libcontainer container kubepods-besteffort-podb15e765a_c1e9_426d_8a7d_578bc497a234.slice. machine # [ 60.277941] k3s[896]: I0921 12:54:42.963880 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/b15e765a-c1e9-426d-8a7d-578bc497a234-build\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-zhdvd\" (UID: \"b15e765a-c1e9-426d-8a7d-578bc497a234\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-zhdvd" machine # [ 60.278557] k3s[896]: I0921 12:54:42.963946 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/b15e765a-c1e9-426d-8a7d-578bc497a234-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-zhdvd\" (UID: \"b15e765a-c1e9-426d-8a7d-578bc497a234\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-zhdvd" machine # [ 60.279134] k3s[896]: I0921 12:54:42.963984 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/2d6fd6dc-95e5-4115-84ac-25fa446d9bb2-tls\") pod \"nix-grpc-farm-scheduler-5844ddf54b-5f99x\" (UID: \"2d6fd6dc-95e5-4115-84ac-25fa446d9bb2\") " pod="farm/nix-grpc-farm-scheduler-5844ddf54b-5f99x" machine # [ 60.279847] k3s[896]: I0921 12:54:42.964009 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9dc12634-dfd3-4adf-ac15-f22dcd199a00-tmp\") pod \"nix-grpc-farm-lb-68c8f49bd6-8nzqq\" (UID: \"9dc12634-dfd3-4adf-ac15-f22dcd199a00\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-8nzqq" machine # [ 60.280667] k3s[896]: I0921 12:54:42.964034 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/fd2a7de8-9d99-44b3-b0ba-9001acbb58ed-build\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-t28jn\" (UID: \"fd2a7de8-9d99-44b3-b0ba-9001acbb58ed\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-t28jn" machine # [ 60.281220] k3s[896]: I0921 12:54:42.964154 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/fd2a7de8-9d99-44b3-b0ba-9001acbb58ed-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-t28jn\" (UID: \"fd2a7de8-9d99-44b3-b0ba-9001acbb58ed\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-t28jn" machine # [ 60.281810] k3s[896]: I0921 12:54:42.964188 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b15e765a-c1e9-426d-8a7d-578bc497a234-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-zhdvd\" (UID: \"b15e765a-c1e9-426d-8a7d-578bc497a234\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-zhdvd" machine # [ 60.282618] k3s[896]: I0921 12:54:42.964210 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/b15e765a-c1e9-426d-8a7d-578bc497a234-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-zhdvd\" (UID: \"b15e765a-c1e9-426d-8a7d-578bc497a234\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-zhdvd" machine # [ 60.283485] k3s[896]: I0921 12:54:42.964233 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/b15e765a-c1e9-426d-8a7d-578bc497a234-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-zhdvd\" (UID: \"b15e765a-c1e9-426d-8a7d-578bc497a234\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-zhdvd" machine # [ 60.284121] k3s[896]: I0921 12:54:42.964258 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crxlb\" (UniqueName: \"kubernetes.io/projected/fd2a7de8-9d99-44b3-b0ba-9001acbb58ed-kube-api-access-crxlb\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-t28jn\" (UID: \"fd2a7de8-9d99-44b3-b0ba-9001acbb58ed\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-t28jn" machine # [ 60.284742] k3s[896]: I0921 12:54:42.964283 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2d6fd6dc-95e5-4115-84ac-25fa446d9bb2-ca\") pod \"nix-grpc-farm-scheduler-5844ddf54b-5f99x\" (UID: \"2d6fd6dc-95e5-4115-84ac-25fa446d9bb2\") " pod="farm/nix-grpc-farm-scheduler-5844ddf54b-5f99x" machine # [ 60.285603] k3s[896]: I0921 12:54:42.964315 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/fd2a7de8-9d99-44b3-b0ba-9001acbb58ed-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-t28jn\" (UID: \"fd2a7de8-9d99-44b3-b0ba-9001acbb58ed\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-t28jn" machine # [ 60.334760] k3s[896]: I0921 12:54:42.964371 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/b15e765a-c1e9-426d-8a7d-578bc497a234-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-zhdvd\" (UID: \"b15e765a-c1e9-426d-8a7d-578bc497a234\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-zhdvd" machine # [ 60.335647] k3s[896]: I0921 12:54:42.964396 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/2d6fd6dc-95e5-4115-84ac-25fa446d9bb2-niks3-token\") pod \"nix-grpc-farm-scheduler-5844ddf54b-5f99x\" (UID: \"2d6fd6dc-95e5-4115-84ac-25fa446d9bb2\") " pod="farm/nix-grpc-farm-scheduler-5844ddf54b-5f99x" machine # [ 60.336453] k3s[896]: I0921 12:54:42.964434 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbcht\" (UniqueName: \"kubernetes.io/projected/b15e765a-c1e9-426d-8a7d-578bc497a234-kube-api-access-wbcht\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-zhdvd\" (UID: \"b15e765a-c1e9-426d-8a7d-578bc497a234\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-zhdvd" machine # [ 60.337079] k3s[896]: I0921 12:54:42.964458 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/2d6fd6dc-95e5-4115-84ac-25fa446d9bb2-oidc\") pod \"nix-grpc-farm-scheduler-5844ddf54b-5f99x\" (UID: \"2d6fd6dc-95e5-4115-84ac-25fa446d9bb2\") " pod="farm/nix-grpc-farm-scheduler-5844ddf54b-5f99x" machine # [ 60.337700] k3s[896]: I0921 12:54:42.964490 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/9dc12634-dfd3-4adf-ac15-f22dcd199a00-tls-ca\") pod \"nix-grpc-farm-lb-68c8f49bd6-8nzqq\" (UID: \"9dc12634-dfd3-4adf-ac15-f22dcd199a00\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-8nzqq" machine # [ 60.338438] k3s[896]: I0921 12:54:42.964536 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/fd2a7de8-9d99-44b3-b0ba-9001acbb58ed-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-t28jn\" (UID: \"fd2a7de8-9d99-44b3-b0ba-9001acbb58ed\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-t28jn" machine # [ 60.339043] k3s[896]: I0921 12:54:42.964558 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/fd2a7de8-9d99-44b3-b0ba-9001acbb58ed-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-t28jn\" (UID: \"fd2a7de8-9d99-44b3-b0ba-9001acbb58ed\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-t28jn" machine # [ 60.339572] k3s[896]: I0921 12:54:42.964620 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/b15e765a-c1e9-426d-8a7d-578bc497a234-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-zhdvd\" (UID: \"b15e765a-c1e9-426d-8a7d-578bc497a234\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-zhdvd" machine # [ 60.340183] k3s[896]: I0921 12:54:42.964647 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls7v2\" (UniqueName: \"kubernetes.io/projected/2d6fd6dc-95e5-4115-84ac-25fa446d9bb2-kube-api-access-ls7v2\") pod \"nix-grpc-farm-scheduler-5844ddf54b-5f99x\" (UID: \"2d6fd6dc-95e5-4115-84ac-25fa446d9bb2\") " pod="farm/nix-grpc-farm-scheduler-5844ddf54b-5f99x" machine # [ 60.340767] k3s[896]: I0921 12:54:42.964692 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9dc12634-dfd3-4adf-ac15-f22dcd199a00-config\") pod \"nix-grpc-farm-lb-68c8f49bd6-8nzqq\" (UID: \"9dc12634-dfd3-4adf-ac15-f22dcd199a00\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-8nzqq" machine # [ 60.341535] k3s[896]: I0921 12:54:42.964728 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/fd2a7de8-9d99-44b3-b0ba-9001acbb58ed-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-t28jn\" (UID: \"fd2a7de8-9d99-44b3-b0ba-9001acbb58ed\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-t28jn" machine # [ 60.345787] k3s[896]: I0921 12:54:42.964750 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/9dc12634-dfd3-4adf-ac15-f22dcd199a00-tls-lb\") pod \"nix-grpc-farm-lb-68c8f49bd6-8nzqq\" (UID: \"9dc12634-dfd3-4adf-ac15-f22dcd199a00\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-8nzqq" machine # [ 60.350592] k3s[896]: I0921 12:54:42.964771 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/fd2a7de8-9d99-44b3-b0ba-9001acbb58ed-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-t28jn\" (UID: \"fd2a7de8-9d99-44b3-b0ba-9001acbb58ed\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-t28jn" machine # [ 60.528208] (udev-worker)[2125]: Network interface NamePolicy= disabled on kernel command line. machine # [ 60.684550] cni0: port 3(veth943ad649) entered blocking state machine # [ 60.685647] cni0: port 3(veth943ad649) entered disabled state machine # [ 60.686741] veth943ad649: entered allmulticast mode machine # [ 60.687481] veth943ad649: entered promiscuous mode machine # [ 60.698111] cni0: port 3(veth943ad649) entered blocking state machine # [ 60.698831] cni0: port 3(veth943ad649) entered forwarding state machine # [ 60.551626] (udev-worker)[2299]: Network interface NamePolicy= disabled on kernel command line. machine # [ 60.708181] cni0: port 4(vethc3125c10) entered blocking state machine # [ 60.711381] cni0: port 4(vethc3125c10) entered disabled state machine # [ 60.715806] vethc3125c10: entered allmulticast mode machine # [ 60.716554] vethc3125c10: entered promiscuous mode machine # [ 60.580623] (udev-worker)[2321]: Network interface NamePolicy= disabled on kernel command line. machine # [ 60.737049] cni0: port 5(veth92dc5c5b) entered blocking state machine # [ 60.583944] dhcpcd[676]: veth943ad649: IAID ea:0b:07:ec machine # [ 60.584881] dhcpcd[676]: veth[ 60.739891] cni0: port 5(veth92dc5c5b) entered disabled state machine # 943ad649: adding address fe80::9073:eaff:fe0b:7ec machine # [ 60.742777] veth92dc5c5b: entered allmulticast mode machine # [ 60.743654] veth92dc5c5b: entered promiscuous mode machine # [ 60.755668] cni0: port 4(vethc3125c10) entered blocking state machine # [ 60.756471] cni0: port 4(vethc3125c10) entered forwarding state machine # [ 60.758951] cni0: port 5(veth92dc5c5b) entered blocking state machine # [ 60.759788] cni0: port 5(veth92dc5c5b) entered forwarding state machine # [ 60.609846] (udev-worker)[2319]: Network interface NamePolicy= disabled on kernel command line. machine # [ 60.768256] cni0: port 6(veth343429bf) entered blocking state machine # [ 60.772417] cni0: port 6(veth343429bf) entered disabled state machine # [ 60.774669] veth343429bf: entered allmulticast mode machine # [ 60.775876] veth343429bf: entered promiscuous mode machine # [ 60.793024] cni0: port 6(veth343429bf) entered blocking state machine # [ 60.794042] cni0: port 6(veth343429bf) entered forwarding state machine # [ 60.659408] dhcpcd[676]: vethc3125c10: waiting for carrier machine # [ 60.679754] dhcpcd[676]: veth92dc5c5b: IAID 51:b1:c1:bf machine # [ 60.680945] dhcpcd[676]: veth92dc5c5b: adding address fe80::c825:51ff:feb1:c1bf machine # [ 60.682445] dhcpcd[676]: veth92dc5c5b: carrier lost machine # [ 60.718457] dhcpcd[676]: veth92dc5c5b: deleting address fe80::c825:51ff:feb1:c1bf machine # [ 60.739718] dhcpcd[676]: veth343429bf: IAID 8b:b3:15:f6 machine # [ 60.740449] dhcpcd[676]: veth343429bf: adding address fe80::88b9:8bff:feb3:15f6 machine # [ 60.741718] dhcpcd[676]: vethc3125c10: carrier acquired machine # [ 60.752077] dhcpcd[676]: vethc3125c10: IAID aa:27:54:b9 machine # [ 60.752230] dhcpcd[676]: vethc3125c10: adding address fe80::5804:aaff:fe27:54b9 machine # [ 60.753075] dhcpcd[676]: veth92dc5c5b: carrier acquired machine # [ 60.764927] dhcpcd[676]: veth92dc5c5b: IAID 51:b1:c1:bf machine # [ 60.765108] dhcpcd[676]: veth92dc5c5b: adding address fe80::c825:51ff:feb1:c1bf machine # [ 60.765844] dhcpcd[676]: veth343429bf: old hardware address: 8a:b9:8b:b3:15:f6 machine # [ 60.766510] dhcpcd[676]: veth343429bf: new hardware address: 66:ba:b3:b4:63:64 machine # [ 60.766990] dhcpcd[676]: veth343429bf: carrier lost machine # [ 60.779772] systemd[1]: Started libcontainer container ae3fe38f845607a1f4e94cdec573b73eb2aa3902d9470416e6bf1c7e21506975. machine # [ 60.786934] systemd[1]: Started libcontainer container dc06e9562c267afc1ca4d857883fefff27bc9bd15e011f1d027fe210879ed88d. machine # [ 60.793042] systemd[1]: Started libcontainer container f7c039a012bc96f92e38e723710995f421142ba51f80584bc71f48a5ba21fb0b. machine # [ 60.797371] systemd[1]: Started libcontainer container 91c7a82483e6977c5da481398cbd667311d1f8ce6d93fb143ed7a546f21e1a64. machine # [ 60.821875] dhcpcd[676]: veth343429bf: deleting address fe80::88b9:8bff:feb3:15f6 machine # [ 60.822540] dhcpcd[676]: veth343429bf: old hardware address: 66:ba:b3:b4:63:64 machine # [ 60.823310] dhcpcd[676]: veth343429bf: new hardware address: 8a:b9:8b:b3:15:f6 machine # [ 60.823734] dhcpcd[676]: veth343429bf: carrier acquired machine # [ 60.837889] dhcpcd[676]: veth343429bf: IAID 8b:b3:15:f6 machine # [ 60.838319] dhcpcd[676]: veth343429bf: adding address fe80::88b9:8bff:feb3:15f6 machine # [ 60.876907] k3s[896]: E0921 12:54:43.562228 896 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.1" machine # [ 60.877076] k3s[896]: E0921 12:54:43.562317 896 kuberuntime_image.go:43] "Failed to pull image" err="failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.1" machine # [ 60.877709] k3s[896]: E0921 12:54:43.562558 896 kuberuntime_manager.go:1674] "Unhandled Error" err="init container seed-store start failed in pod nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-t28jn_farm(fd2a7de8-9d99-44b3-b0ba-9001acbb58ed): ErrImagePull: failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" logger="UnhandledError" machine # [ 60.878497] k3s[896]: E0921 12:54:43.562629 896 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-t28jn" podUID="fd2a7de8-9d99-44b3-b0ba-9001acbb58ed" machine # [ 60.895025] k3s[896]: E0921 12:54:43.580944 896 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.1" machine # [ 60.896026] k3s[896]: E0921 12:54:43.580999 896 kuberuntime_image.go:43] "Failed to pull image" err="failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.1" machine # [ 60.896781] k3s[896]: E0921 12:54:43.581137 896 kuberuntime_manager.go:1674] "Unhandled Error" err="container nix-grpc-daemon start failed in pod nix-grpc-farm-scheduler-5844ddf54b-5f99x_farm(2d6fd6dc-95e5-4115-84ac-25fa446d9bb2): ErrImagePull: failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" logger="UnhandledError" machine # [ 60.897473] k3s[896]: E0921 12:54:43.581199 896 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nix-grpc-daemon\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-scheduler-5844ddf54b-5f99x" podUID="2d6fd6dc-95e5-4115-84ac-25fa446d9bb2" machine # [ 60.899446] k3s[896]: E0921 12:54:43.585398 896 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.1" machine # [ 60.900341] k3s[896]: E0921 12:54:43.585448 896 kuberuntime_image.go:43] "Failed to pull image" err="failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.1" machine # [ 60.901129] k3s[896]: E0921 12:54:43.585612 896 kuberuntime_manager.go:1674] "Unhandled Error" err="init container seed-store start failed in pod nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-zhdvd_farm(b15e765a-c1e9-426d-8a7d-578bc497a234): ErrImagePull: failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" logger="UnhandledError" machine # [ 60.902487] k3s[896]: E0921 12:54:43.585664 896 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-zhdvd" podUID="b15e765a-c1e9-426d-8a7d-578bc497a234" machine # [ 61.370551] systemd[1]: Started libcontainer container a15d9f2129d51c95b344f481b52ebd8e402cb1bcb91803c4e34508df46b28a37. machine # [ 61.417904] dhcpcd[676]: veth343429bf: soliciting a DHCP lease machine # [ 61.421384] k3s[896]: E0921 12:54:44.107266 896 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ImagePullBackOff: \"Back-off pulling image \\\"nix-grpc-farm:0.1.0-beta.1\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-t28jn" podUID="fd2a7de8-9d99-44b3-b0ba-9001acbb58ed" machine # [ 61.435762] k3s[896]: E0921 12:54:44.121573 896 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nix-grpc-daemon\" with ImagePullBackOff: \"Back-off pulling image \\\"nix-grpc-farm:0.1.0-beta.1\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-scheduler-5844ddf54b-5f99x" podUID="2d6fd6dc-95e5-4115-84ac-25fa446d9bb2" machine # [ 61.438871] k3s[896]: E0921 12:54:44.124855 896 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ImagePullBackOff: \"Back-off pulling image \\\"nix-grpc-farm:0.1.0-beta.1\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-zhdvd" podUID="b15e765a-c1e9-426d-8a7d-578bc497a234" machine # [ 61.454505] dhcpcd[676]: veth92dc5c5b: soliciting a DHCP lease machine # [ 61.475095] systemd[1]: cri-containerd-062dbad7d0413e047fb2cf841704d910cd1d5165031b38f877914ef5c7f0c6f4.scope: Deactivated successfully. machine # [ 61.600024] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-062dbad7d0413e047fb2cf841704d910cd1d5165031b38f877914ef5c7f0c6f4-rootfs.mount: Deactivated successfully. machine # [ 61.720267] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-062dbad7d0413e047fb2cf841704d910cd1d5165031b38f877914ef5c7f0c6f4-shm.mount: Deactivated successfully. machine # [ 61.928877] cni0: port 1(vethb7ddb90a) entered disabled state machine # [ 61.774571] dhcpcd[676]: vethb7ddb90a: carrier lost machine # [ 61.931237] vethb7ddb90a (unregistering): left allmulticast mode machine # [ 61.932429] vethb7ddb90a (unregistering): left promiscuous mode machine # [ 61.933672] cni0: port 1(vethb7ddb90a) entered disabled state machine # [ 61.805116] systemd[1]: run-netns-cni\x2d02bc56be\x2d7852\x2df116\x2d3193\x2d700d11e28dda.mount: Deactivated successfully. machine # [ 61.833441] dhcpcd[676]: vethb7ddb90a: deleting address fe80::183d:53ff:fe8d:d922 machine # [ 61.892323] dhcpcd[676]: vethb7ddb90a: removing interface machine # [ 61.937975] k3s[896]: I0921 12:54:44.623609 896 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a-klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a-klipper-cache\") pod \"2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a\" (UID: \"2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a\") " machine # [ 61.944869] k3s[896]: I0921 12:54:44.623663 896 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a-content\" (UniqueName: \"kubernetes.io/configmap/2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a-content\") pod \"2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a\" (UID: \"2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a\") " machine # [ 61.951434] k3s[896]: I0921 12:54:44.623696 896 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a-kube-api-access-xc27d\" (UniqueName: \"kubernetes.io/projected/2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a-kube-api-access-xc27d\") pod \"2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a\" (UID: \"2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a\") " machine # [ 61.958326] k3s[896]: I0921 12:54:44.623734 896 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a-klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a-klipper-config\") pod \"2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a\" (UID: \"2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a\") " machine # [ 61.964825] k3s[896]: I0921 12:54:44.623760 896 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a-values\" (UniqueName: \"kubernetes.io/projected/2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a-values\") pod \"2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a\" (UID: \"2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a\") " machine # [ 61.970736] k3s[896]: I0921 12:54:44.623791 896 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a-klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a-klipper-helm\") pod \"2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a\" (UID: \"2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a\") " machine # [ 61.976130] k3s[896]: I0921 12:54:44.623821 896 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a-tmp\" (UniqueName: \"kubernetes.io/empty-dir/2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a-tmp\") pod \"2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a\" (UID: \"2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a\") " machine # [ 61.981819] k3s[896]: I0921 12:54:44.631943 896 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a-content" pod "2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a" (UID: "2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a"). InnerVolumeSpecName "content". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 61.987617] k3s[896]: I0921 12:54:44.633021 896 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a-tmp" pod "2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a" (UID: "2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 61.993113] k3s[896]: I0921 12:54:44.633311 896 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a-klipper-cache" pod "2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a" (UID: "2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a"). InnerVolumeSpecName "klipper-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 61.999241] systemd[1]: var-lib-kubelet-pods-2cbbdcd6\x2db9ea\x2d44b2\x2dbf6b\x2d4a65dcc5306a-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 61.999603] dhcpcd[676]: vethc3125c10: soliciting a DHCP lease machine # [ 61.999794] k3s[896]: I0921 12:54:44.645296 896 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a-klipper-helm" pod "2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a" (UID: "2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a"). InnerVolumeSpecName "klipper-helm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 61.999972] k3s[896]: I0921 12:54:44.645353 896 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a-values" pod "2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a" (UID: "2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a"). InnerVolumeSpecName "values". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 62.000879] k3s[896]: I0921 12:54:44.645578 896 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a-kube-api-access-xc27d" pod "2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a" (UID: "2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a"). InnerVolumeSpecName "kube-api-access-xc27d". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 62.001759] k3s[896]: I0921 12:54:44.645629 896 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a-klipper-config" pod "2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a" (UID: "2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a"). InnerVolumeSpecName "klipper-config". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 62.002674] systemd[1]: var-lib-kubelet-pods-2cbbdcd6\x2db9ea\x2d44b2\x2dbf6b\x2d4a65dcc5306a-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dcache.mount: Deactivated successfully. machine # [ 62.003510] systemd[1]: var-lib-kubelet-pods-2cbbdcd6\x2db9ea\x2d44b2\x2dbf6b\x2d4a65dcc5306a-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dhelm.mount: Deactivated successfully. machine # [ 62.038405] k3s[896]: I0921 12:54:44.724247 896 reconciler_common.go:299] "Volume detached for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a-klipper-config\") on node \"machine\" DevicePath \"\"" machine # [ 62.042487] k3s[896]: I0921 12:54:44.724286 896 reconciler_common.go:299] "Volume detached for volume \"values\" (UniqueName: \"kubernetes.io/projected/2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a-values\") on node \"machine\" DevicePath \"\"" machine # [ 62.042770] k3s[896]: I0921 12:54:44.724300 896 reconciler_common.go:299] "Volume detached for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a-klipper-helm\") on node \"machine\" DevicePath \"\"" machine # [ 62.043601] k3s[896]: I0921 12:54:44.724315 896 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 62.044572] k3s[896]: I0921 12:54:44.724327 896 reconciler_common.go:299] "Volume detached for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a-klipper-cache\") on node \"machine\" DevicePath \"\"" machine # [ 62.045544] k3s[896]: I0921 12:54:44.724341 896 reconciler_common.go:299] "Volume detached for volume \"content\" (UniqueName: \"kubernetes.io/configmap/2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a-content\") on node \"machine\" DevicePath \"\"" machine # [ 62.046240] k3s[896]: I0921 12:54:44.724359 896 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xc27d\" (UniqueName: \"kubernetes.io/projected/2cbbdcd6-b9ea-44b2-bf6b-4a65dcc5306a-kube-api-access-xc27d\") on node \"machine\" DevicePath \"\"" machine # [ 62.227409] dhcpcd[676]: veth343429bf: soliciting an IPv6 router machine # [ 62.237521] dhcpcd[676]: veth92dc5c5b: soliciting an IPv6 router machine # [ 62.264724] dhcpcd[676]: vethc3125c10: soliciting an IPv6 router machine # [ 62.415994] dhcpcd[676]: veth943ad649: soliciting an IPv6 router machine # [ 62.442206] k3s[896]: I0921 12:54:45.128146 896 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="062dbad7d0413e047fb2cf841704d910cd1d5165031b38f877914ef5c7f0c6f4" machine # [ 62.451444] systemd[1]: Removed slice libcontainer container kubepods-burstable-pod2cbbdcd6_b9ea_44b2_bf6b_4a65dcc5306a.slice. machine # [ 62.451799] systemd[1]: kubepods-burstable-pod2cbbdcd6_b9ea_44b2_bf6b_4a65dcc5306a.slice: Consumed 617ms CPU time over 6.286s wall clock time, 33.2M memory peak, 2.4M incoming IP traffic, 140.3K outgoing IP traffic. machine # [ 62.464705] k3s[896]: I0921 12:54:45.150106 896 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-68c8f49bd6-8nzqq" podStartSLOduration=3.150087644 podStartE2EDuration="3.150087644s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-21 12:54:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-21 12:54:45.149794031 +0000 UTC m=+41.510244734" watchObservedRunningTime="2026-09-21 12:54:45.150087644 +0000 UTC m=+41.510538626" machine # [ 62.502274] dhcpcd[676]: veth943ad649: soliciting a DHCP lease machine # [ 62.589725] systemd[1]: var-lib-kubelet-pods-2cbbdcd6\x2db9ea\x2d44b2\x2dbf6b\x2d4a65dcc5306a-volumes-kubernetes.io\x7eprojected-values.mount: Deactivated successfully. machine # [ 62.589987] systemd[1]: var-lib-kubelet-pods-2cbbdcd6\x2db9ea\x2d44b2\x2dbf6b\x2d4a65dcc5306a-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dxc27d.mount: Deactivated successfully. machine # [ 62.591352] systemd[1]: var-lib-kubelet-pods-2cbbdcd6\x2db9ea\x2d44b2\x2dbf6b\x2d4a65dcc5306a-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dconfig.mount: Deactivated successfully. machine # [ 62.602419] dhcpcd[676]: flannel.1: probing for an IPv4LL address machine # [ 63.307945] dhcpcd[676]: vethde987c7b: probing for an IPv4LL address machine # [ 65.422750] k3s[896]: time="2026-09-21T12:54:48Z" level=info msg="Imported docker.io/library/nix-grpc-farm:0.1.0-beta.1" machine # [ 65.425921] k3s[896]: time="2026-09-21T12:54:48Z" level=info msg="Tagged docker.io/library/nix-grpc-farm@sha256:55727343126e7fc12a50e8ebcc272a77aaad7eba2039e60e8975ba46fe7b278f" machine # [ 65.804092] k3s[896]: time="2026-09-21T12:54:48Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm.tar in 11.152406799s" machine # [ 66.419168] dhcpcd[676]: veth343429bf: probing for an IPv4LL address machine # [ 66.454738] dhcpcd[676]: veth92dc5c5b: probing for an IPv4LL address machine # [ 66.975314] dhcpcd[676]: vethc3125c10: probing for an IPv4LL address machine # [ 67.376282] dhcpcd[676]: flannel.1: using IPv4LL address 169.254.60.212 machine # [ 67.377277] dhcpcd[676]: flannel.1: adding route to 169.254.0.0/16 machine # [ 67.503347] dhcpcd[676]: veth943ad649: probing for an IPv4LL address machine # [ 68.233576] dhcpcd[676]: vethde987c7b: using IPv4LL address 169.254.185.194 machine # [ 68.237488] dhcpcd[676]: vethde987c7b: adding route to 169.254.0.0/16 machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 36.14 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s machine # [ 70.093950] dhcpcd[676]: flannel.1: no IPv6 Routers available machine # [ 70.423400] dhcpcd[676]: vethde987c7b: no IPv6 Routers available machine # [ 71.400531] dhcpcd[676]: veth92dc5c5b: using IPv4LL address 169.254.183.102 machine # [ 71.403375] dhcpcd[676]: veth92dc5c5b: adding route to 169.254.0.0/16 machine # [ 71.496282] dhcpcd[676]: vethc3125c10: using IPv4LL address 169.254.108.218 machine # [ 71.496720] dhcpcd[676]: vethc3125c10: adding route to 169.254.0.0/16 machine # [ 71.831421] dhcpcd[676]: veth343429bf: using IPv4LL address 169.254.196.60 machine # [ 71.831926] dhcpcd[676]: veth343429bf: adding route to 169.254.0.0/16 machine # [ 71.987070] dhcpcd[676]: veth943ad649: using IPv4LL address 169.254.36.37 machine # [ 71.989177] dhcpcd[676]: veth943ad649: adding route to 169.254.0.0/16 machine # [ 73.853747] dhcpcd[676]: segfault at 61f5995d2 ip 000061f574ecacb3 sp 00007ffe130efff8 error 4 in dhcpcd[38cb3,61f574e9b000+40000] likely on CPU 1 (core 1, socket 0) machine # [ 73.858106] Code: 45 ae 01 e9 0f fe ff ff 0f 1f 80 00 00 00 00 c6 45 af 01 e9 ff fd ff ff e8 fa 05 fd ff 66 2e 0f 1f 84 00 00 00 00 00 48 8b 07 <48> 8b 80 50 03 00 00 48 85 c0 74 31 90 48 8b 00 48 85 c0 74 1e 48 machine # [ 73.730419] systemd-coredump[2972]: Process 676 (dhcpcd) of user 999 terminated abnormally with signal 11/SEGV, processing... machine # [ 73.742365] systemd[1]: Created slice Slice /system/systemd-coredump. machine # [ 73.747746] systemd[1]: Started Process Core Dump (PID 2972/UID 0). machine # [ 74.036506] systemd-coredump[2973]: Process 676 (dhcpcd) of user 999 dumped core. machine # machine # Module udev.so without build-id. machine # Module dhcpcd without build-id. machine # Stack trace of thread 676: machine # #0 0x000061f574ecacb3 ipv6nd_expire (dhcpcd + 0x38cb3) machine # #1 0x000061f574ea406a eloop_start (dhcpcd + 0x1206a) machine # #2 0x000061f574e9c300 main (dhcpcd + 0xa300) machine # #3 0x00007b1de349d285 __libc_start_call_main (libc.so.6 + 0x2b285) machine # #4 0x00007b1de349d338 __libc_start_main@@GLIBC_2.34 (libc.so.6 + 0x2b338) machine # #5 0x000061f574e9d365 _start (dhcpcd + 0xb365) machine # ELF object binary architecture: AMD x86-64 machine # machine # [ 74.045455] systemd[1]: systemd-coredump@0-1-2972_2973-0.service: Deactivated successfully. machine # [ 74.101178] systemd[1]: dhcpcd.service: Main process exited, code=dumped, status=11/SEGV machine # [ 74.102187] systemd[1]: dhcpcd.service: Failed with result 'core-dump'. machine # [ 74.103545] systemd[1]: dhcpcd.service: Consumed 579ms CPU time over 1min 4.858s wall clock time, 6.1M memory peak, 8K written to disk, 96B incoming IP traffic, 1.2K outgoing IP traffic. machine # [ 74.373562] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount4184563407.mount: Deactivated successfully. machine # [ 74.380249] systemd[1]: dhcpcd.service: Scheduled restart job, restart counter is at 1. machine # [ 74.386365] systemd[1]: Starting DHCP Client... machine # [ 74.563116] dhcpcd[2986]: dhcpcd-10.3.2 starting machine # [ 74.571344] dhcpcd[2990]: dev: loaded udev machine # [ 74.572128] dhcpcd[2990]: DUID 00:01:00:01:32:43:e5:60:52:54:00:12:34:56 machine # [ 74.790231] dhcpcd[2990]: eth0: IAID 00:12:34:56 machine # [ 74.791088] dhcpcd[2990]: flannel.1: IAID de:4b:1e:ce machine # [ 74.791922] dhcpcd[2990]: vethde987c7b: IAID 62:41:87:78 machine # [ 74.792823] dhcpcd[2990]: veth943ad649: IAID ea:0b:07:ec machine # [ 74.798124] dhcpcd[2990]: vethc3125c10: IAID aa:27:54:b9 machine # [ 74.798871] dhcpcd[2990]: veth92dc5c5b: IAID 51:b1:c1:bf machine # [ 74.799640] dhcpcd[2990]: veth343429bf: IAID 8b:b3:15:f6 machine # [ 74.960220] dhcpcd[2990]: vethde987c7b: soliciting a DHCP lease machine # [ 74.962698] dhcpcd[2990]: vethc3125c10: soliciting an IPv6 router machine # [ 74.964551] dhcpcd[2990]: veth92dc5c5b: soliciting an IPv6 router machine # [ 75.001079] dhcpcd[2990]: veth92dc5c5b: soliciting a DHCP lease machine # [ 75.377957] dhcpcd[2990]: flannel.1: soliciting an IPv6 router machine # [ 75.399217] dhcpcd[2990]: vethde987c7b: soliciting an IPv6 router machine # [ 75.431507] dhcpcd[2990]: flannel.1: soliciting a DHCP lease machine # [ 75.609432] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount384302440.mount: Deactivated successfully. machine # [ 75.635777] dhcpcd[2990]: veth943ad649: soliciting a DHCP lease machine # [ 75.696495] dhcpcd[2990]: veth943ad649: soliciting an IPv6 router machine # [ 75.768746] dhcpcd[2990]: veth343429bf: soliciting an IPv6 router machine # [ 75.778909] dhcpcd[2990]: eth0: soliciting an IPv6 router machine # [ 75.779763] dhcpcd[2990]: eth0: Router Advertisement from fe80::2 machine # [ 75.784457] dhcpcd[2990]: eth0: adding address fec0::5054:ff:fe12:3456/64 machine # [ 75.880061] dhcpcd[2990]: veth343429bf: soliciting a DHCP lease machine # [ 76.183540] dhcpcd[2990]: vethc3125c10: soliciting a DHCP lease machine # [ 76.285582] dhcpcd[2990]: eth0: rebinding lease of 10.0.2.15 machine # [ 76.293683] dhcpcd[2990]: eth0: leased 10.0.2.15 for 86400 seconds machine # [ 76.367649] systemd[1]: Started DHCP Client. machine # error: timed out waiting for the condition machine # [ 79.872835] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount3382875193.mount: Deactivated successfully. machine # [ 79.874525] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount828648110.mount: Deactivated successfully. machine # [ 79.931332] systemd[1]: Started libcontainer container 1f242981cae8b284132deb75eeff2f6c325df50d7bc403065417fdb1721db90e. machine # [ 79.988134] systemd[1]: Started libcontainer container 84bd8c2825ee94a9056fb2f21568046b7a949ffb1dcfe481cb89174e72a2e92b. machine # [ 80.196342] systemd[1]: Started libcontainer container 9b5ef66f727581cb3acc3f955dbb9873498a75b184b38752da816b0a84ffd4cb. machine # [ 80.289786] niks3-server[1116]: 2026/09/21 12:55:02 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 80.290709] niks3-server[1116]: 2026/09/21 12:55:02 INFO lead: acquired remote=10.42.0.4:51368 machine # [ 80.538597] k3s[896]: I0921 12:55:03.223296 896 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-scheduler-5844ddf54b-5f99x" podStartSLOduration=7.788938391 podStartE2EDuration="21.223270686s" totalImagesPullingTime="13.434332295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-21 12:54:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-21 12:55:03.222799397 +0000 UTC m=+59.583250380" watchObservedRunningTime="2026-09-21 12:55:03.223270686 +0000 UTC m=+59.583721389" machine # [ 80.857818] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount2657520367.mount: Deactivated successfully. machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s, in 11.55 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s machine # [ 81.736781] systemd[1]: cri-containerd-9b5ef66f727581cb3acc3f955dbb9873498a75b184b38752da816b0a84ffd4cb.scope: Deactivated successfully. machine # [ 81.738176] systemd[1]: cri-containerd-9b5ef66f727581cb3acc3f955dbb9873498a75b184b38752da816b0a84ffd4cb.scope: Consumed 662ms CPU time over 1.540s wall clock time, 358.2M memory peak, 84.7M read from disk, 210.5M written to disk. machine # [ 81.741214] systemd[1]: cri-containerd-1f242981cae8b284132deb75eeff2f6c325df50d7bc403065417fdb1721db90e.scope: Deactivated successfully. machine # [ 81.743959] systemd[1]: cri-containerd-1f242981cae8b284132deb75eeff2f6c325df50d7bc403065417fdb1721db90e.scope: Consumed 690ms CPU time over 1.807s wall clock time, 358.1M memory peak, 121.6M read from disk, 151.6M written to disk. machine # [ 81.804758] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-9b5ef66f727581cb3acc3f955dbb9873498a75b184b38752da816b0a84ffd4cb-rootfs.mount: Deactivated successfully. machine # [ 81.829071] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-1f242981cae8b284132deb75eeff2f6c325df50d7bc403065417fdb1721db90e-rootfs.mount: Deactivated successfully. machine # [ 82.602280] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount405472077.mount: Deactivated successfully. machine # [ 82.643334] systemd[1]: Started libcontainer container 2bb6a2b51cb777acac11eda4d2939492c65593e0521dc8a81fc1578a5473db22. machine # [ 82.652533] systemd[1]: Started libcontainer container 08c153e5e0fe12e8e9af98100cf28047a8b1b9dff943cbc4dc562634c9791b63. machine # [ 82.792729] systemd[1]: Started libcontainer container cb2c1ce75caed88e1277a177d8c48532da4692a5dafe078a9919a49fcbbe0c67. machine # [ 82.810910] systemd[1]: Started libcontainer container be3ecf621f473a19d1c47bf859b224ed2051070920027e6f41edf4424b0c1ba2. machine # [ 82.952299] systemd[1]: Started libcontainer container c198bde1fd49f8574b4011408e4d3fedfc3b34f8ee9cabd0803db4620e3a572a. machine # [ 82.954971] systemd[1]: Started libcontainer container ca1627bb0d843be89158e231d0298da099a0cc9abed827014bb1939db480ba9a. machine # [ 83.583500] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount202389400.mount: Deactivated successfully. machine # [ 83.590370] k3s[896]: I0921 12:55:06.275601 896 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-t28jn" podStartSLOduration=9.026067132 podStartE2EDuration="24.275555264s" totalImagesPullingTime="13.456525339s" totalInitContainerRuntime="1.792962793s" isStatefulPod=false podCreationTimestamp="2026-09-21 12:54:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-21 12:55:06.274669677 +0000 UTC m=+62.635125408" watchObservedRunningTime="2026-09-21 12:55:06.275555264 +0000 UTC m=+62.636010437" machine # [ 83.628392] k3s[896]: I0921 12:55:06.314296 896 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-zhdvd" podStartSLOduration=8.36856541 podStartE2EDuration="24.314260462s" totalImagesPullingTime="14.44164775s" totalInitContainerRuntime="1.504047302s" isStatefulPod=false podCreationTimestamp="2026-09-21 12:54:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-21 12:55:06.313010583 +0000 UTC m=+62.673464638" watchObservedRunningTime="2026-09-21 12:55:06.314260462 +0000 UTC m=+62.674714239" machine # [ 84.375992] dhcpcd[2990]: vethde987c7b: using IPv4LL address 169.254.185.194 machine # [ 84.380442] dhcpcd[2990]: flannel.1: adding route to 169.254.0.0/16 machine # [ 84.383559] dhcpcd[2990]: vethde987c7b: adding route to 169.254.0.0/16 machine # [ 84.387666] dhcpcd[2990]: veth943ad649: adding route to 169.254.0.0/16 machine # [ 84.391457] dhcpcd[2990]: vethc3125c10: adding route to 169.254.0.0/16 machine # [ 84.395445] dhcpcd[2990]: veth92dc5c5b: adding route to 169.254.0.0/16 machine # [ 84.398890] dhcpcd[2990]: veth343429bf: adding route to 169.254.0.0/16 machine # [ 85.154295] dhcpcd[2990]: flannel.1: using IPv4LL address 169.254.60.212 machine # [ 85.245737] dhcpcd[2990]: veth92dc5c5b: using IPv4LL address 169.254.183.102 machine # [ 85.332589] dhcpcd[2990]: veth943ad649: using IPv4LL address 169.254.36.37 machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s, in 4.55 seconds) machine: waiting for unit niks3.service machine: (finished: waiting for unit niks3.service, in 0.09 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine # [ 86.136488] dhcpcd[2990]: veth343429bf: using IPv4LL address 169.254.196.60 machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.42 seconds) machine: waiting for success: test $(curl -sf 10.42.0.5:9901/clusters | grep -c 'health_flags::healthy') -ge 3 machine # [ 86.296106] dhcpcd[2990]: vethc3125c10: using IPv4LL address 169.254.108.218 machine: (finished: waiting for success: test $(curl -sf 10.42.0.5:9901/clusters | grep -c 'health_flags::healthy') -ge 3, in 0.17 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.25 seconds) machine: waiting for success: curl -sf http://10.42.0.4:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2' machine # [ 86.967995] dhcpcd[2990]: vethc3125c10: no IPv6 Routers available machine # [ 86.971129] dhcpcd[2990]: veth92dc5c5b: no IPv6 Routers available machine # [ 87.381622] dhcpcd[2990]: flannel.1: no IPv6 Routers available machine # [ 87.402162] dhcpcd[2990]: vethde987c7b: no IPv6 Routers available machine # [ 87.699780] dhcpcd[2990]: veth943ad649: no IPv6 Routers available machine # [ 87.771330] dhcpcd[2990]: veth343429bf: no IPv6 Routers available machine: (finished: waiting for success: curl -sf http://10.42.0.4:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2', in 1.20 seconds) (finished: subtest: chart deploys and workers become Ready, in 54.38 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}', in 0.35 seconds) machine: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt machine: (finished: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt, in 0.33 seconds) subtest: build through the balancer lands in the cache machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag t1 2>&1 machine # [ 110.186492] niks3-server[1116]: 2026/09/21 12:55:32 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 110.307835] niks3-server[1116]: 2026/09/21 12:55:32 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 110.380732] niks3-server[1116]: 2026/09/21 12:55:33 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 110.381418] niks3-server[1116]: 2026/09/21 12:55:33 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 110.417281] niks3-server[1116]: 2026/09/21 12:55:33 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 110.426881] niks3-server[1116]: 2026/09/21 12:55:33 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 110.428285] niks3-server[1116]: 2026/09/21 12:55:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign machine # [ 110.430500] niks3-server[1116]: 2026/09/21 12:55:33 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 110.434071] niks3-server[1116]: 2026/09/21 12:55:33 INFO Signed narinfos id=1 count=1 machine # [ 110.436207] niks3-server[1116]: 2026/09/21 12:55:33 INFO Registered completed upload object_key=nar/0nzzbas7l8d37mridr7mg162smfjvn7lhs6am4crl4ydaxicigj8.nar.zst machine # [ 110.444134] niks3-server[1116]: 2026/09/21 12:55:33 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 110.444698] niks3-server[1116]: 2026/09/21 12:55:33 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete machine # [ 110.447123] niks3-server[1116]: 2026/09/21 12:55:33 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 110.448730] niks3-server[1116]: 2026/09/21 12:55:33 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.ls machine # [ 110.452133] niks3-server[1116]: 2026/09/21 12:55:33 INFO Completed upload id=1 machine # [ 110.458214] niks3-server[1116]: 2026/09/21 12:55:33 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.narinfo machine # [ 119.484156] niks3-server[1116]: 2026/09/21 12:55:42 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 119.522179] niks3-server[1116]: 2026/09/21 12:55:42 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 119.522638] niks3-server[1116]: 2026/09/21 12:55:42 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 119.544676] niks3-server[1116]: 2026/09/21 12:55:42 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 119.546930] niks3-server[1116]: 2026/09/21 12:55:42 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 119.550407] niks3-server[1116]: 2026/09/21 12:55:42 INFO Registered completed upload object_key=log/yz1sqzb72i8v6h2ass0v76ba8cncqj9r-k3s-a.drv machine # [ 119.552958] niks3-server[1116]: 2026/09/21 12:55:42 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 119.555068] niks3-server[1116]: 2026/09/21 12:55:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign machine # [ 119.557224] niks3-server[1116]: 2026/09/21 12:55:42 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 119.558899] niks3-server[1116]: 2026/09/21 12:55:42 INFO Signed narinfos id=2 count=1 machine # [ 119.560358] niks3-server[1116]: 2026/09/21 12:55:42 INFO Registered completed upload object_key=nar/1p7jh5nyz9n68k5f18ymmdpgr34mpnnch1njw7ki7b2b97qlfbjk.nar.zst machine # [ 119.563249] niks3-server[1116]: 2026/09/21 12:55:42 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.ls machine # [ 119.567293] niks3-server[1116]: 2026/09/21 12:55:42 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 119.569528] niks3-server[1116]: 2026/09/21 12:55:42 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete machine # [ 119.571644] niks3-server[1116]: 2026/09/21 12:55:42 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 119.573318] niks3-server[1116]: 2026/09/21 12:55:42 INFO Completed upload id=2 machine # [ 119.574594] niks3-server[1116]: 2026/09/21 12:55:42 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.narinfo machine # [ 119.576727] niks3-server[1116]: 2026/09/21 12:55:42 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 119.587592] niks3-server[1116]: 2026/09/21 12:55:42 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 119.601084] niks3-server[1116]: 2026/09/21 12:55:42 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 119.683426] niks3-server[1116]: 2026/09/21 12:55:42 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 119.685439] niks3-server[1116]: 2026/09/21 12:55:42 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 119.697725] niks3-server[1116]: 2026/09/21 12:55:42 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 119.700954] niks3-server[1116]: 2026/09/21 12:55:42 INFO Registered completed upload object_key=nar/03a4ywhyr5knmbc93z4gyml5y8fvgb431xvlmfxrwsm8mrb0qgx2.nar.zst machine # [ 119.706755] niks3-server[1116]: 2026/09/21 12:55:42 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 119.706978] niks3-server[1116]: 2026/09/21 12:55:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign machine # [ 119.707775] niks3-server[1116]: 2026/09/21 12:55:42 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 119.708872] niks3-server[1116]: 2026/09/21 12:55:42 INFO Signed narinfos id=3 count=1 machine # [ 119.716096] niks3-server[1116]: 2026/09/21 12:55:42 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.ls machine # [ 119.717853] niks3-server[1116]: 2026/09/21 12:55:42 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 119.718238] niks3-server[1116]: 2026/09/21 12:55:42 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete machine # [ 119.718781] niks3-server[1116]: 2026/09/21 12:55:42 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 119.721466] niks3-server[1116]: 2026/09/21 12:55:42 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.narinfo machine # [ 119.726480] niks3-server[1116]: 2026/09/21 12:55:42 INFO Completed upload id=3 machine # [ 128.554424] niks3-server[1116]: 2026/09/21 12:55:51 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 128.611300] niks3-server[1116]: 2026/09/21 12:55:51 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 128.611965] niks3-server[1116]: 2026/09/21 12:55:51 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 128.629920] niks3-server[1116]: 2026/09/21 12:55:51 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 128.633585] niks3-server[1116]: 2026/09/21 12:55:51 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 128.637330] niks3-server[1116]: 2026/09/21 12:55:51 INFO Registered completed upload object_key=log/zfq1xw9bmycqh35l0s44lmv65z4xc7br-k3s-b.drv machine # [ 128.640071] niks3-server[1116]: 2026/09/21 12:55:51 INFO Registered completed upload object_key=nar/05qjsj5ff3a6vnxkhb6k5f3m446dcc206p7cd37w4v3mgi95d7kh.nar.zst machine # [ 128.641910] niks3-server[1116]: 2026/09/21 12:55:51 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 128.643233] niks3-server[1116]: 2026/09/21 12:55:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign machine # [ 128.644736] niks3-server[1116]: 2026/09/21 12:55:51 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 128.646043] niks3-server[1116]: 2026/09/21 12:55:51 INFO Signed narinfos id=4 count=1 machine # [ 128.648108] niks3-server[1116]: 2026/09/21 12:55:51 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.ls machine # [ 128.653100] niks3-server[1116]: 2026/09/21 12:55:51 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 128.653660] niks3-server[1116]: 2026/09/21 12:55:51 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete machine # [ 128.654412] niks3-server[1116]: 2026/09/21 12:55:51 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 128.655662] niks3-server[1116]: 2026/09/21 12:55:51 INFO Completed upload id=4 machine # [ 128.661621] niks3-server[1116]: 2026/09/21 12:55:51 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.narinfo machine # [ 128.663382] niks3-server[1116]: 2026/09/21 12:55:51 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 128.681898] niks3-server[1116]: 2026/09/21 12:55:51 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 128.694880] niks3-server[1116]: 2026/09/21 12:55:51 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 128.766770] niks3-server[1116]: 2026/09/21 12:55:51 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 128.767379] niks3-server[1116]: 2026/09/21 12:55:51 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 128.781881] niks3-server[1116]: 2026/09/21 12:55:51 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 128.785190] niks3-server[1116]: 2026/09/21 12:55:51 INFO Registered completed upload object_key=nar/0jyw88klkf3nwxpnj5m5lx3i1dv2idf3hcn6im7883hnldm3gvyq.nar.zst machine # [ 128.788366] niks3-server[1116]: 2026/09/21 12:55:51 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 128.788689] niks3-server[1116]: 2026/09/21 12:55:51 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 128.789218] niks3-server[1116]: 2026/09/21 12:55:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign machine # [ 128.789806] niks3-server[1116]: 2026/09/21 12:55:51 INFO Signed narinfos id=5 count=1 machine # [ 128.799728] niks3-server[1116]: 2026/09/21 12:55:51 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 128.800094] niks3-server[1116]: 2026/09/21 12:55:51 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 128.800519] niks3-server[1116]: 2026/09/21 12:55:51 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete machine # [ 128.813527] niks3-server[1116]: 2026/09/21 12:55:51 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.ls machine # [ 128.815197] niks3-server[1116]: 2026/09/21 12:55:51 INFO Completed upload id=5 machine # [ 128.817694] niks3-server[1116]: 2026/09/21 12:55:51 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.narinfo machine # [ 137.643094] niks3-server[1116]: 2026/09/21 12:56:00 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 137.673652] niks3-server[1116]: 2026/09/21 12:56:00 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 137.675089] niks3-server[1116]: 2026/09/21 12:56:00 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 137.685870] niks3-server[1116]: 2026/09/21 12:56:00 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 137.687665] niks3-server[1116]: 2026/09/21 12:56:00 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 137.691682] niks3-server[1116]: 2026/09/21 12:56:00 INFO Registered completed upload object_key=nar/1q8vp5xqws560mpf8rxk8r8jhqrzibivh13x4wxy0cfqlzbk7cr5.nar.zst machine # [ 137.692902] niks3-server[1116]: 2026/09/21 12:56:00 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 137.693825] niks3-server[1116]: 2026/09/21 12:56:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign machine # [ 137.694943] niks3-server[1116]: 2026/09/21 12:56:00 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 137.695792] niks3-server[1116]: 2026/09/21 12:56:00 INFO Signed narinfos id=6 count=1 machine # [ 137.699172] niks3-server[1116]: 2026/09/21 12:56:00 INFO Registered completed upload object_key=log/n40czam6a4ldp1mh5fdmlcy07fv0akbm-k3s-top.drv machine # [ 137.701562] niks3-server[1116]: 2026/09/21 12:56:00 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 137.701983] niks3-server[1116]: 2026/09/21 12:56:00 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete machine # [ 137.702652] niks3-server[1116]: 2026/09/21 12:56:00 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 137.703658] niks3-server[1116]: 2026/09/21 12:56:00 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.ls machine # [ 137.705940] niks3-server[1116]: 2026/09/21 12:56:00 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.narinfo machine # [ 137.709889] niks3-server[1116]: 2026/09/21 12:56:00 INFO Completed upload id=6 machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag t1 2>&1, in 50.34 seconds) machine: must succeed: nix eval --raw -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag t1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag t1 outPath, in 0.26 seconds) machine: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine: (finished: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.02 seconds) machine: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine # copying 3 paths... machine # copying path '/nix/store/r95r891injj9ski5c4w89yxjvjy065mx-k3s-a' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/mrqsh0475wxsmnsvkk55g94v6g5nrcra-k3s-b' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top' from 'http://192.168.1.1:5751'... machine: (finished: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.31 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag t2 2>&1 machine # [ 139.646288] niks3-server[1116]: 2026/09/21 12:56:02 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 148.549586] niks3-server[1116]: 2026/09/21 12:56:11 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 148.635673] niks3-server[1116]: 2026/09/21 12:56:11 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 148.635975] niks3-server[1116]: 2026/09/21 12:56:11 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 148.664252] niks3-server[1116]: 2026/09/21 12:56:11 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 148.672469] niks3-server[1116]: 2026/09/21 12:56:11 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 148.673519] niks3-server[1116]: 2026/09/21 12:56:11 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 148.674455] niks3-server[1116]: 2026/09/21 12:56:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign machine # [ 148.675859] niks3-server[1116]: 2026/09/21 12:56:11 INFO Registered completed upload object_key=nar/1fr26arhri17j9bj6hyjzmmd74v730biz1gb3kqd194vjx3ccvp9.nar.zst machine # [ 148.677408] niks3-server[1116]: 2026/09/21 12:56:11 INFO Signed narinfos id=7 count=1 machine # [ 148.678719] niks3-server[1116]: 2026/09/21 12:56:11 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.ls machine # [ 148.681836] niks3-server[1116]: 2026/09/21 12:56:11 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 148.683321] niks3-server[1116]: 2026/09/21 12:56:11 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete machine # [ 148.684572] niks3-server[1116]: 2026/09/21 12:56:11 INFO Completed upload id=7 machine # [ 148.685428] niks3-server[1116]: 2026/09/21 12:56:11 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 157.514465] niks3-server[1116]: 2026/09/21 12:56:20 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 157.571770] niks3-server[1116]: 2026/09/21 12:56:20 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 157.572250] niks3-server[1116]: 2026/09/21 12:56:20 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 157.596116] niks3-server[1116]: 2026/09/21 12:56:20 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 157.597404] niks3-server[1116]: 2026/09/21 12:56:20 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 157.603843] niks3-server[1116]: 2026/09/21 12:56:20 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 157.604601] niks3-server[1116]: 2026/09/21 12:56:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign machine # [ 157.605590] niks3-server[1116]: 2026/09/21 12:56:20 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 157.608168] niks3-server[1116]: 2026/09/21 12:56:20 INFO Signed narinfos id=8 count=1 machine # [ 157.610377] niks3-server[1116]: 2026/09/21 12:56:20 INFO Registered completed upload object_key=log/pbpqsh50ar10fpasdqqx8xg3lmr5j8iz-k3s-a.drv machine # [ 157.615704] niks3-server[1116]: 2026/09/21 12:56:20 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 157.616034] niks3-server[1116]: 2026/09/21 12:56:20 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete machine # [ 157.616565] niks3-server[1116]: 2026/09/21 12:56:20 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 157.620407] niks3-server[1116]: 2026/09/21 12:56:20 INFO Registered completed upload object_key=nar/1hfc6x4x25k3b0fk091d3nb0k3mympfp05fkslcx19synp3ig0zd.nar.zst machine # [ 157.627497] niks3-server[1116]: 2026/09/21 12:56:20 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.ls machine # [ 157.632657] niks3-server[1116]: 2026/09/21 12:56:20 INFO Completed upload id=8 machine # [ 157.636602] niks3-server[1116]: 2026/09/21 12:56:20 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 157.638250] niks3-server[1116]: 2026/09/21 12:56:20 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.narinfo machine # [ 157.650722] niks3-server[1116]: 2026/09/21 12:56:20 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 157.661208] niks3-server[1116]: 2026/09/21 12:56:20 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 157.731239] niks3-server[1116]: 2026/09/21 12:56:20 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 157.731491] niks3-server[1116]: 2026/09/21 12:56:20 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 157.744078] niks3-server[1116]: 2026/09/21 12:56:20 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 157.748997] niks3-server[1116]: 2026/09/21 12:56:20 INFO Registered completed upload object_key=nar/0zzq2vgjln4shvh57091n14sam6wh6w06vja6lzb9ppcj4ffyx1n.nar.zst machine # [ 157.749516] niks3-server[1116]: 2026/09/21 12:56:20 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 157.750552] niks3-server[1116]: 2026/09/21 12:56:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign machine # [ 157.751152] niks3-server[1116]: 2026/09/21 12:56:20 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 157.752718] niks3-server[1116]: 2026/09/21 12:56:20 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.ls machine # [ 157.757671] niks3-server[1116]: 2026/09/21 12:56:20 INFO Signed narinfos id=9 count=1 machine # [ 157.762332] niks3-server[1116]: 2026/09/21 12:56:20 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 157.762948] niks3-server[1116]: 2026/09/21 12:56:20 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete machine # [ 157.765641] niks3-server[1116]: 2026/09/21 12:56:20 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 157.768284] niks3-server[1116]: 2026/09/21 12:56:20 INFO Completed upload id=9 machine # [ 157.770666] niks3-server[1116]: 2026/09/21 12:56:20 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.narinfo machine # [ 166.394115] niks3-server[1116]: 2026/09/21 12:56:29 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 166.437874] niks3-server[1116]: 2026/09/21 12:56:29 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 166.438125] niks3-server[1116]: 2026/09/21 12:56:29 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 166.457695] niks3-server[1116]: 2026/09/21 12:56:29 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 166.461760] niks3-server[1116]: 2026/09/21 12:56:29 INFO Registered completed upload object_key=log/894h6wzw2l4w5f0hikj1k6q57jfnyi87-k3s-b.drv machine # [ 166.468970] niks3-server[1116]: 2026/09/21 12:56:29 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 166.472833] niks3-server[1116]: 2026/09/21 12:56:29 INFO Registered completed upload object_key=nar/0hh3nqk95r6g32lhdmxw8cxjv694vbpx9876zkhcpg4r4qxni2ch.nar.zst machine # [ 166.480046] niks3-server[1116]: 2026/09/21 12:56:29 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 166.483710] niks3-server[1116]: 2026/09/21 12:56:29 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 166.483907] niks3-server[1116]: 2026/09/21 12:56:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign machine # [ 166.490409] niks3-server[1116]: 2026/09/21 12:56:29 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.ls machine # [ 166.491042] niks3-server[1116]: 2026/09/21 12:56:29 INFO Signed narinfos id=10 count=1 machine # [ 166.504394] niks3-server[1116]: 2026/09/21 12:56:29 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 166.504765] niks3-server[1116]: 2026/09/21 12:56:29 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete machine # [ 166.505634] niks3-server[1116]: 2026/09/21 12:56:29 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 166.530809] niks3-server[1116]: 2026/09/21 12:56:29 INFO Completed upload id=10 machine # [ 166.535569] niks3-server[1116]: 2026/09/21 12:56:29 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.narinfo machine # [ 166.540143] niks3-server[1116]: 2026/09/21 12:56:29 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 166.556660] niks3-server[1116]: 2026/09/21 12:56:29 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 166.567741] niks3-server[1116]: 2026/09/21 12:56:29 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 166.635531] niks3-server[1116]: 2026/09/21 12:56:29 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 166.635757] niks3-server[1116]: 2026/09/21 12:56:29 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 166.644539] niks3-server[1116]: 2026/09/21 12:56:29 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 166.647308] niks3-server[1116]: 2026/09/21 12:56:29 INFO Registered completed upload object_key=nar/0ingamx56k31lwiyxmnxmscjj4n3qfx6sr2kpaynsrwhwz1278iw.nar.zst machine # [ 166.648475] niks3-server[1116]: 2026/09/21 12:56:29 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 166.649082] niks3-server[1116]: 2026/09/21 12:56:29 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 166.649709] niks3-server[1116]: 2026/09/21 12:56:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign machine # [ 166.650817] niks3-server[1116]: 2026/09/21 12:56:29 INFO Signed narinfos id=11 count=1 machine # [ 166.652100] niks3-server[1116]: 2026/09/21 12:56:29 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.ls machine # [ 166.656450] niks3-server[1116]: 2026/09/21 12:56:29 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 166.657503] niks3-server[1116]: 2026/09/21 12:56:29 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete machine # [ 166.658528] niks3-server[1116]: 2026/09/21 12:56:29 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 166.667829] niks3-server[1116]: 2026/09/21 12:56:29 INFO Completed upload id=11 machine # [ 166.669291] niks3-server[1116]: 2026/09/21 12:56:29 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.narinfo machine # [ 175.696177] niks3-server[1116]: 2026/09/21 12:56:38 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 175.751515] niks3-server[1116]: 2026/09/21 12:56:38 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 175.751705] niks3-server[1116]: 2026/09/21 12:56:38 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 175.764080] niks3-server[1116]: 2026/09/21 12:56:38 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 175.764725] niks3-server[1116]: 2026/09/21 12:56:38 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 175.769220] niks3-server[1116]: 2026/09/21 12:56:38 INFO Registered completed upload object_key=log/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g-k3s-top.drv machine # [ 175.770482] niks3-server[1116]: 2026/09/21 12:56:38 INFO Registered completed upload object_key=nar/0v48x4sp58bvfra08axgkz7yl1n9nc4nirskyv1hwann4i7q277i.nar.zst machine # [ 175.786757] niks3-server[1116]: 2026/09/21 12:56:38 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 175.787494] niks3-server[1116]: 2026/09/21 12:56:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign machine # [ 175.789212] niks3-server[1116]: 2026/09/21 12:56:38 INFO Signed narinfos id=12 count=1 machine # [ 175.790282] niks3-server[1116]: 2026/09/21 12:56:38 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 175.800770] niks3-server[1116]: 2026/09/21 12:56:38 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.ls machine # [ 175.806602] niks3-server[1116]: 2026/09/21 12:56:38 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 175.807911] niks3-server[1116]: 2026/09/21 12:56:38 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 175.810550] niks3-server[1116]: 2026/09/21 12:56:38 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete machine # [ 175.812394] niks3-server[1116]: 2026/09/21 12:56:38 INFO Completed upload id=12 machine # [ 175.815203] niks3-server[1116]: 2026/09/21 12:56:38 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag t2 2>&1, in 36.45 seconds) (finished: subtest: build through the balancer lands in the cache, in 87.39 seconds) subtest: a Job with the client image builds through the farm with its service account machine: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt machine: (finished: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt, in 0.18 seconds) machine: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --from-file=flake.nix=/nix/store/b7xpzyk27yxzb4n6qbkzaknbd7x4jfx9-flake.nix machine: (finished: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --from-file=flake.nix=/nix/store/b7xpzyk27yxzb4n6qbkzaknbd7x4jfx9-flake.nix, in 0.18 seconds) machine: must succeed: kubectl apply -f /nix/store/xmn7479wyv43i1vcg4rqv7yh3mwzvqd3-ci-job.json machine: (finished: must succeed: kubectl apply -f /nix/store/xmn7479wyv43i1vcg4rqv7yh3mwzvqd3-ci-job.json, in 0.29 seconds) machine: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed' machine # [ 177.176518] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod6a3f83ab_0f02_4e71_99c3_a4cf2a8cacb4.slice. machine # [ 177.197668] k3s[896]: I0921 12:56:39.883003 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/6a3f83ab-0f02-4e71-99c3-a4cf2a8cacb4-nix-grpc-farm\") pod \"ci-cs9n8\" (UID: \"6a3f83ab-0f02-4e71-99c3-a4cf2a8cacb4\") " pod="ci/ci-cs9n8" machine # [ 177.198094] k3s[896]: I0921 12:56:39.883116 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsg2m\" (UniqueName: \"kubernetes.io/projected/6a3f83ab-0f02-4e71-99c3-a4cf2a8cacb4-kube-api-access-hsg2m\") pod \"ci-cs9n8\" (UID: \"6a3f83ab-0f02-4e71-99c3-a4cf2a8cacb4\") " pod="ci/ci-cs9n8" machine # [ 177.199134] k3s[896]: I0921 12:56:39.883178 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"job\" (UniqueName: \"kubernetes.io/configmap/6a3f83ab-0f02-4e71-99c3-a4cf2a8cacb4-job\") pod \"ci-cs9n8\" (UID: \"6a3f83ab-0f02-4e71-99c3-a4cf2a8cacb4\") " pod="ci/ci-cs9n8" machine # [ 178.282871] cni0: port 1(vethf67fbc07) entered blocking state machine # [ 178.285364] cni0: port 1(vethf67fbc07) entered disabled state machine # [ 178.287570] vethf67fbc07: entered allmulticast mode machine # [ 178.289655] vethf67fbc07: entered promiscuous mode machine # [ 178.307499] cni0: port 1(vethf67fbc07) entered blocking state machine # [ 178.310345] cni0: port 1(vethf67fbc07) entered forwarding state machine # [ 178.231660] (udev-worker)[4578]: Network interface NamePolicy= disabled on kernel command line. machine # [ 178.269545] systemd[1]: Started libcontainer container a2c101904c0d9d8b95b7c47207024c71f01f3ca88e34bdbea8c86d69b09a50d3. machine # [ 178.272427] dhcpcd[2990]: vethf67fbc07: IAID 57:b1:db:53 machine # [ 178.273095] dhcpcd[2990]: vethf67fbc07: adding address fe80::34d2:57ff:feb1:db53 machine # [ 179.265361] dhcpcd[2990]: vethf67fbc07: soliciting a DHCP lease machine # [ 179.546949] dhcpcd[2990]: vethf67fbc07: soliciting an IPv6 router machine # [ 180.248770] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount1457812846.mount: Deactivated successfully. machine # [ 180.311510] systemd[1]: Started libcontainer container 34249f1d2a8a112c1c653b5fd37c9aff0d5d99aefc3b8f2266c7f82d181e721a. machine # [ 180.970191] k3s[896]: I0921 12:56:43.654358 896 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ci/ci-cs9n8" podStartSLOduration=4.654314006 podStartE2EDuration="4.654314006s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-21 12:56:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-21 12:56:43.653290133 +0000 UTC m=+160.013746143" watchObservedRunningTime="2026-09-21 12:56:43.654314006 +0000 UTC m=+160.014769458" machine # [ 181.557552] niks3-server[1116]: 2026/09/21 12:56:44 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 181.606610] niks3-server[1116]: 2026/09/21 12:56:44 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 181.673682] niks3-server[1116]: 2026/09/21 12:56:44 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 181.674108] niks3-server[1116]: 2026/09/21 12:56:44 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 181.682715] niks3-server[1116]: 2026/09/21 12:56:44 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 181.688723] niks3-server[1116]: 2026/09/21 12:56:44 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 181.688863] niks3-server[1116]: 2026/09/21 12:56:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign machine # [ 181.689547] niks3-server[1116]: 2026/09/21 12:56:44 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 181.690562] niks3-server[1116]: 2026/09/21 12:56:44 INFO Signed narinfos id=13 count=1 machine # [ 181.691340] niks3-server[1116]: 2026/09/21 12:56:44 INFO Registered completed upload object_key=nar/111g6dyibwcf2z7jhpn72rgja0qvjgpdiv9nc06g2dp7ih0a6kyq.nar.zst machine # [ 181.693896] niks3-server[1116]: 2026/09/21 12:56:44 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.ls machine # [ 181.695868] niks3-server[1116]: 2026/09/21 12:56:44 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 181.696727] niks3-server[1116]: 2026/09/21 12:56:44 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 181.697591] niks3-server[1116]: 2026/09/21 12:56:44 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete machine # [ 181.698667] niks3-server[1116]: 2026/09/21 12:56:44 INFO Completed upload id=13 machine # [ 181.700700] niks3-server[1116]: 2026/09/21 12:56:44 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.narinfo machine # [ 184.266531] dhcpcd[2990]: vethf67fbc07: probing for an IPv4LL address machine # [ 189.196546] dhcpcd[2990]: vethf67fbc07: using IPv4LL address 169.254.217.254 machine # [ 189.197970] dhcpcd[2990]: vethf67fbc07: adding route to 169.254.0.0/16 machine # [ 190.528158] niks3-server[1116]: 2026/09/21 12:56:53 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 190.580324] niks3-server[1116]: 2026/09/21 12:56:53 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 190.583864] niks3-server[1116]: 2026/09/21 12:56:53 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 190.594814] niks3-server[1116]: 2026/09/21 12:56:53 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 190.595063] niks3-server[1116]: 2026/09/21 12:56:53 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 190.599314] niks3-server[1116]: 2026/09/21 12:56:53 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 190.601111] niks3-server[1116]: 2026/09/21 12:56:53 INFO Registered completed upload object_key=nar/058kjd2vfl1r27b4d9ixvwf77d8rkr18a4v894kwx8lg0nwpajnr.nar.zst machine # [ 190.601906] niks3-server[1116]: 2026/09/21 12:56:53 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 190.602708] niks3-server[1116]: 2026/09/21 12:56:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign machine # [ 190.603930] niks3-server[1116]: 2026/09/21 12:56:53 INFO Signed narinfos id=14 count=1 machine # [ 190.604746] niks3-server[1116]: 2026/09/21 12:56:53 INFO Registered completed upload object_key=log/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # [ 190.605877] niks3-server[1116]: 2026/09/21 12:56:53 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.ls machine # [ 190.607104] niks3-server[1116]: 2026/09/21 12:56:53 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 190.607913] niks3-server[1116]: 2026/09/21 12:56:53 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete machine # [ 190.609208] niks3-server[1116]: 2026/09/21 12:56:53 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 190.609992] niks3-server[1116]: 2026/09/21 12:56:53 INFO Completed upload id=14 machine # [ 190.610762] niks3-server[1116]: 2026/09/21 12:56:53 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.narinfo machine # [ 190.621862] niks3-server[1116]: 2026/09/21 12:56:53 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 190.634095] niks3-server[1116]: 2026/09/21 12:56:53 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 190.643527] niks3-server[1116]: 2026/09/21 12:56:53 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 190.703588] niks3-server[1116]: 2026/09/21 12:56:53 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 190.703799] niks3-server[1116]: 2026/09/21 12:56:53 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 190.712479] niks3-server[1116]: 2026/09/21 12:56:53 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 190.715332] niks3-server[1116]: 2026/09/21 12:56:53 INFO Registered completed upload object_key=nar/138ynhcd5wxzz485x9qcq7xsargaklrf2li31ai69m5r46am35q6.nar.zst machine # [ 190.719300] niks3-server[1116]: 2026/09/21 12:56:53 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 190.721454] niks3-server[1116]: 2026/09/21 12:56:53 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 190.723510] niks3-server[1116]: 2026/09/21 12:56:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign machine # [ 190.724104] niks3-server[1116]: 2026/09/21 12:56:53 INFO Signed narinfos id=15 count=1 machine # [ 190.724946] niks3-server[1116]: 2026/09/21 12:56:53 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.ls machine # [ 190.725769] niks3-server[1116]: 2026/09/21 12:56:53 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 190.726191] niks3-server[1116]: 2026/09/21 12:56:53 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 190.728080] niks3-server[1116]: 2026/09/21 12:56:53 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete machine # [ 190.728835] niks3-server[1116]: 2026/09/21 12:56:53 INFO Completed upload id=15 machine # [ 190.729486] niks3-server[1116]: 2026/09/21 12:56:53 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.narinfo machine # [ 191.550134] dhcpcd[2990]: vethf67fbc07: no IPv6 Routers available machine # [ 199.762140] niks3-server[1116]: 2026/09/21 12:57:02 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 199.804719] niks3-server[1116]: 2026/09/21 12:57:02 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 199.809282] niks3-server[1116]: 2026/09/21 12:57:02 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 199.818506] niks3-server[1116]: 2026/09/21 12:57:02 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 199.822320] niks3-server[1116]: 2026/09/21 12:57:02 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 199.823412] niks3-server[1116]: 2026/09/21 12:57:02 INFO Registered completed upload object_key=nar/0n4lbdlp8w72fs3qbavl2lwrzbrn55i2b1vyglc89cc3pi8vbb1m.nar.zst machine # [ 199.826767] niks3-server[1116]: 2026/09/21 12:57:02 INFO Registered completed upload object_key=log/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # [ 199.828792] niks3-server[1116]: 2026/09/21 12:57:02 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 199.830631] niks3-server[1116]: 2026/09/21 12:57:02 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 199.831981] niks3-server[1116]: 2026/09/21 12:57:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign machine # [ 199.833175] niks3-server[1116]: 2026/09/21 12:57:02 INFO Signed narinfos id=16 count=1 machine # [ 199.834330] niks3-server[1116]: 2026/09/21 12:57:02 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.ls machine # [ 199.836789] niks3-server[1116]: 2026/09/21 12:57:02 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 199.838663] niks3-server[1116]: 2026/09/21 12:57:02 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 199.839439] niks3-server[1116]: 2026/09/21 12:57:02 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete machine # [ 199.840514] niks3-server[1116]: 2026/09/21 12:57:02 INFO Completed upload id=16 machine # [ 199.840984] niks3-server[1116]: 2026/09/21 12:57:02 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo machine # [ 199.851107] niks3-server[1116]: 2026/09/21 12:57:02 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 199.862641] niks3-server[1116]: 2026/09/21 12:57:02 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 199.870464] niks3-server[1116]: 2026/09/21 12:57:02 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 199.928860] niks3-server[1116]: 2026/09/21 12:57:02 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 199.929764] niks3-server[1116]: 2026/09/21 12:57:02 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 199.935924] niks3-server[1116]: 2026/09/21 12:57:02 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 199.938167] niks3-server[1116]: 2026/09/21 12:57:02 INFO Registered completed upload object_key=nar/1f3gvnvqsm2pm3laixkxkg44kvjb251zqhszcfpp0a00h6x66ljs.nar.zst machine # [ 199.939726] niks3-server[1116]: 2026/09/21 12:57:02 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 199.940032] niks3-server[1116]: 2026/09/21 12:57:02 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 199.940561] niks3-server[1116]: 2026/09/21 12:57:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign machine # [ 199.941097] niks3-server[1116]: 2026/09/21 12:57:02 INFO Signed narinfos id=17 count=1 machine # [ 199.941921] niks3-server[1116]: 2026/09/21 12:57:02 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.ls machine # [ 199.944887] niks3-server[1116]: 2026/09/21 12:57:02 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 199.945365] niks3-server[1116]: 2026/09/21 12:57:02 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 199.945898] niks3-server[1116]: 2026/09/21 12:57:02 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete machine # [ 199.946686] niks3-server[1116]: 2026/09/21 12:57:02 INFO Completed upload id=17 machine # [ 199.947669] niks3-server[1116]: 2026/09/21 12:57:02 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.narinfo machine # [ 208.169311] niks3-server[1116]: 2026/09/21 12:57:10 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 208.216689] niks3-server[1116]: 2026/09/21 12:57:10 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 208.220236] niks3-server[1116]: 2026/09/21 12:57:10 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 208.231595] niks3-server[1116]: 2026/09/21 12:57:10 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 208.234947] niks3-server[1116]: 2026/09/21 12:57:10 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 208.238336] niks3-server[1116]: 2026/09/21 12:57:10 INFO Registered completed upload object_key=log/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # [ 208.242402] niks3-server[1116]: 2026/09/21 12:57:10 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 208.247419] niks3-server[1116]: 2026/09/21 12:57:10 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 208.250696] niks3-server[1116]: 2026/09/21 12:57:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign machine # [ 208.254461] niks3-server[1116]: 2026/09/21 12:57:10 INFO Registered completed upload object_key=nar/1zwf0asrdv12q40fmqga5lx5330dvn9y4in4i9ficz9ij5lhvnf5.nar.zst machine # [ 208.258060] niks3-server[1116]: 2026/09/21 12:57:10 INFO Signed narinfos id=18 count=1 machine # [ 208.260255] niks3-server[1116]: 2026/09/21 12:57:10 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.ls machine # [ 208.263169] niks3-server[1116]: 2026/09/21 12:57:10 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 208.265689] niks3-server[1116]: 2026/09/21 12:57:10 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete machine # [ 208.268757] niks3-server[1116]: 2026/09/21 12:57:10 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 208.271370] niks3-server[1116]: 2026/09/21 12:57:10 INFO Completed upload id=18 machine # [ 208.273372] niks3-server[1116]: 2026/09/21 12:57:10 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo machine # [ 209.889648] niks3-server[1116]: 2026/09/21 12:57:12 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 209.932230] niks3-server[1116]: 2026/09/21 12:57:12 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 209.996745] niks3-server[1116]: 2026/09/21 12:57:12 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 209.996980] niks3-server[1116]: 2026/09/21 12:57:12 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 210.005854] niks3-server[1116]: 2026/09/21 12:57:12 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 210.008550] niks3-server[1116]: 2026/09/21 12:57:12 INFO Registered completed upload object_key=nar/0xiyqcsl8db7dnrq2gqnx5izavr51ma3dcdswrriaxfgj3qzk7xf.nar.zst machine # [ 210.013226] niks3-server[1116]: 2026/09/21 12:57:12 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 210.013741] niks3-server[1116]: 2026/09/21 12:57:12 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 210.014980] niks3-server[1116]: 2026/09/21 12:57:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign machine # [ 210.017301] niks3-server[1116]: 2026/09/21 12:57:12 INFO Signed narinfos id=19 count=1 machine # [ 210.018371] niks3-server[1116]: 2026/09/21 12:57:12 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.ls machine # [ 210.020644] niks3-server[1116]: 2026/09/21 12:57:12 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 210.021221] niks3-server[1116]: 2026/09/21 12:57:12 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 210.021832] niks3-server[1116]: 2026/09/21 12:57:12 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete machine # [ 210.022991] niks3-server[1116]: 2026/09/21 12:57:12 INFO Completed upload id=19 machine # [ 219.051935] niks3-server[1116]: 2026/09/21 12:57:21 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 219.101584] niks3-server[1116]: 2026/09/21 12:57:21 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 219.101787] niks3-server[1116]: 2026/09/21 12:57:21 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 219.116419] niks3-server[1116]: 2026/09/21 12:57:21 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 219.117565] niks3-server[1116]: 2026/09/21 12:57:21 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 219.122790] niks3-server[1116]: 2026/09/21 12:57:21 INFO Registered completed upload object_key=nar/0p3l2z3riilylr2rxb1aq2blxdfxg55wbgp4gxkns93srbr4bwyq.nar.zst machine # [ 219.123982] niks3-server[1116]: 2026/09/21 12:57:21 INFO Registered completed upload object_key=log/fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # [ 219.132733] niks3-server[1116]: 2026/09/21 12:57:21 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 219.133883] niks3-server[1116]: 2026/09/21 12:57:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign machine # [ 219.135258] niks3-server[1116]: 2026/09/21 12:57:21 INFO Signed narinfos id=20 count=1 machine # [ 219.139968] niks3-server[1116]: 2026/09/21 12:57:21 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 219.143201] niks3-server[1116]: 2026/09/21 12:57:21 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 219.143463] niks3-server[1116]: 2026/09/21 12:57:21 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.ls machine # [ 219.143918] niks3-server[1116]: 2026/09/21 12:57:21 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete machine # [ 219.144567] niks3-server[1116]: 2026/09/21 12:57:21 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 219.147441] niks3-server[1116]: 2026/09/21 12:57:21 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo machine # [ 219.151849] niks3-server[1116]: 2026/09/21 12:57:21 INFO Completed upload id=20 machine # [ 220.289360] systemd[1]: cri-containerd-34249f1d2a8a112c1c653b5fd37c9aff0d5d99aefc3b8f2266c7f82d181e721a.scope: Deactivated successfully. machine # [ 220.291519] systemd[1]: cri-containerd-34249f1d2a8a112c1c653b5fd37c9aff0d5d99aefc3b8f2266c7f82d181e721a.scope: Consumed 934ms CPU time over 39.977s wall clock time, 119.6M memory peak, 65.1M read from disk, 424K written to disk, 16.4K incoming IP traffic, 44.1K outgoing IP traffic. machine # [ 220.337566] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-34249f1d2a8a112c1c653b5fd37c9aff0d5d99aefc3b8f2266c7f82d181e721a-rootfs.mount: Deactivated successfully. machine # [ 222.125164] systemd[1]: cri-containerd-a2c101904c0d9d8b95b7c47207024c71f01f3ca88e34bdbea8c86d69b09a50d3.scope: Deactivated successfully. machine # [ 222.190167] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-a2c101904c0d9d8b95b7c47207024c71f01f3ca88e34bdbea8c86d69b09a50d3-rootfs.mount: Deactivated successfully. machine # [ 222.236622] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-a2c101904c0d9d8b95b7c47207024c71f01f3ca88e34bdbea8c86d69b09a50d3-shm.mount: Deactivated successfully. machine # [ 222.465764] cni0: port 1(vethf67fbc07) entered disabled state machine # [ 222.313367] dhcpcd[2990]: vethf67fbc07: carrier lost machine # [ 222.473376] vethf67fbc07 (unregistering): left allmulticast mode machine # [ 222.476202] vethf67fbc07 (unregistering): left promiscuous mode machine # [ 222.478704] cni0: port 1(vethf67fbc07) entered disabled state machine # [ 222.351696] systemd[1]: run-netns-cni\x2d4d13d810\x2db314\x2dd14b\x2d9881\x2d451aaaaf91f2.mount: Deactivated successfully. machine # [ 222.358790] dhcpcd[2990]: vethf67fbc07: deleting address fe80::34d2:57ff:feb1:db53 machine # [ 222.362268] dhcpcd[2990]: vethf67fbc07: deleting route to 169.254.0.0/16 machine # [ 222.442408] k3s[896]: I0921 12:57:25.128003 896 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6a3f83ab-0f02-4e71-99c3-a4cf2a8cacb4-kube-api-access-hsg2m\" (UniqueName: \"kubernetes.io/projected/6a3f83ab-0f02-4e71-99c3-a4cf2a8cacb4-kube-api-access-hsg2m\") pod \"6a3f83ab-0f02-4e71-99c3-a4cf2a8cacb4\" (UID: \"6a3f83ab-0f02-4e71-99c3-a4cf2a8cacb4\") " machine # [ 222.449245] k3s[896]: I0921 12:57:25.128090 896 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6a3f83ab-0f02-4e71-99c3-a4cf2a8cacb4-job\" (UniqueName: \"kubernetes.io/configmap/6a3f83ab-0f02-4e71-99c3-a4cf2a8cacb4-job\") pod \"6a3f83ab-0f02-4e71-99c3-a4cf2a8cacb4\" (UID: \"6a3f83ab-0f02-4e71-99c3-a4cf2a8cacb4\") " machine # [ 222.455775] k3s[896]: I0921 12:57:25.128124 896 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6a3f83ab-0f02-4e71-99c3-a4cf2a8cacb4-nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/6a3f83ab-0f02-4e71-99c3-a4cf2a8cacb4-nix-grpc-farm\") pod \"6a3f83ab-0f02-4e71-99c3-a4cf2a8cacb4\" (UID: \"6a3f83ab-0f02-4e71-99c3-a4cf2a8cacb4\") " machine # [ 222.462447] k3s[896]: I0921 12:57:25.128487 896 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a3f83ab-0f02-4e71-99c3-a4cf2a8cacb4-job" pod "6a3f83ab-0f02-4e71-99c3-a4cf2a8cacb4" (UID: "6a3f83ab-0f02-4e71-99c3-a4cf2a8cacb4"). InnerVolumeSpecName "job". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 222.469238] k3s[896]: I0921 12:57:25.136559 896 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a3f83ab-0f02-4e71-99c3-a4cf2a8cacb4-kube-api-access-hsg2m" pod "6a3f83ab-0f02-4e71-99c3-a4cf2a8cacb4" (UID: "6a3f83ab-0f02-4e71-99c3-a4cf2a8cacb4"). InnerVolumeSpecName "kube-api-access-hsg2m". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 222.476639] k3s[896]: I0921 12:57:25.136765 896 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a3f83ab-0f02-4e71-99c3-a4cf2a8cacb4-nix-grpc-farm" pod "6a3f83ab-0f02-4e71-99c3-a4cf2a8cacb4" (UID: "6a3f83ab-0f02-4e71-99c3-a4cf2a8cacb4"). InnerVolumeSpecName "nix-grpc-farm". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 222.483051] systemd[1]: var-lib-kubelet-pods-6a3f83ab\x2d0f02\x2d4e71\x2d99c3\x2da4cf2a8cacb4-volumes-kubernetes.io\x7eprojected-nix\x2dgrpc\x2dfarm.mount: Deactivated successfully. machine # [ 222.486085] systemd[1]: var-lib-kubelet-pods-6a3f83ab\x2d0f02\x2d4e71\x2d99c3\x2da4cf2a8cacb4-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dhsg2m.mount: Deactivated successfully. machine # [ 222.489944] dhcpcd[2990]: vethf67fbc07: removing interface machine # [ 222.542624] k3s[896]: I0921 12:57:25.228556 896 reconciler_common.go:299] "Volume detached for volume \"job\" (UniqueName: \"kubernetes.io/configmap/6a3f83ab-0f02-4e71-99c3-a4cf2a8cacb4-job\") on node \"machine\" DevicePath \"\"" machine # [ 222.543061] k3s[896]: I0921 12:57:25.228593 896 reconciler_common.go:299] "Volume detached for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/6a3f83ab-0f02-4e71-99c3-a4cf2a8cacb4-nix-grpc-farm\") on node \"machine\" DevicePath \"\"" machine # [ 222.543499] k3s[896]: I0921 12:57:25.228612 896 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsg2m\" (UniqueName: \"kubernetes.io/projected/6a3f83ab-0f02-4e71-99c3-a4cf2a8cacb4-kube-api-access-hsg2m\") on node \"machine\" DevicePath \"\"" machine # [ 223.106433] k3s[896]: I0921 12:57:25.791123 896 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a2c101904c0d9d8b95b7c47207024c71f01f3ca88e34bdbea8c86d69b09a50d3" machine # [ 223.116173] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod6a3f83ab_0f02_4e71_99c3_a4cf2a8cacb4.slice. machine # [ 223.117954] systemd[1]: kubepods-besteffort-pod6a3f83ab_0f02_4e71_99c3_a4cf2a8cacb4.slice: Consumed 963ms CPU time over 45.938s wall clock time, 119.8M memory peak, 65.1M read from disk, 632K written to disk, 16.4K incoming IP traffic, 44.1K outgoing IP traffic. machine: (finished: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed', in 47.39 seconds) machine: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1 machine: (finished: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1, in 0.21 seconds) machine # don't know how to build these paths: machine # /nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-a> machine/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-zhdvd: building fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-b> machine/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-zhdvd: building 1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-top> machine/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-zhdvd: building rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # INFO:nix_fast_build.processes:run nix-eval-jobs --gc-roots-dir /tmp/tmp6szxfm1n/gcroots --force-recurse --max-memory-size 4096 --workers 4 --flake '.#checks' --check-cache-status machine # INFO:nix_fast_build.workers:builds: 0 machine # warning: Git tree '/tmp' is dirty machine # warning: Git tree '/tmp' is dirty machine # ▶ x86_64-linux.t started machine # INFO:nix_fast_build.workers:builds: 2 machine # ✔ x86_64-linux.t (11s) machine # x86_64-linux.t> machine/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-t28jn: building fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # warning: Git tree '/tmp' is dirty machine: must succeed: nix eval --raw -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag ci outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag ci outPath, in 0.32 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null, in 0.06 seconds) (finished: subtest: a Job with the client image builds through the farm with its service account, in 48.99 seconds) subtest: a renewed balancer certificate is served without a rollout machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/lb-renewed.crt --key=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f - machine # Warning: resource secrets/farm-lb-tls is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically. machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/lb-renewed.crt --key=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f -, in 0.34 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}', in 0.65 seconds) machine: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-68c8f49bd6-8nzqq -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine # [ 226.164696] k3s[896]: E0921 12:57:28.850252 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45058: use of closed network connection machine # [ 227.508945] k3s[896]: E0921 12:57:30.194438 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45074: use of closed network connection machine # [ 228.861695] k3s[896]: E0921 12:57:31.546924 896 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:49000->127.0.0.1:10010: write tcp 127.0.0.1:49000->127.0.0.1:10010: write: broken pipe machine # [ 228.866705] k3s[896]: E0921 12:57:31.547115 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45116: use of closed network connection machine # [ 228.872221] k3s[896]: time="2026-09-21T12:57:31Z" level=warning msg="Proxy error: read failed: read tcp 127.0.0.1:57812->127.0.0.1:10250: read: connection reset by peer" machine # [ 230.269899] k3s[896]: E0921 12:57:32.955448 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45156: use of closed network connection machine # [ 231.652333] k3s[896]: E0921 12:57:34.337222 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45176: use of closed network connection machine # [ 233.001898] k3s[896]: E0921 12:57:35.686774 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45212: use of closed network connection machine # [ 234.361740] k3s[896]: E0921 12:57:37.046942 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55314: use of closed network connection machine # [ 235.741624] k3s[896]: E0921 12:57:38.427133 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55344: use of closed network connection machine # [ 237.179191] k3s[896]: E0921 12:57:39.864405 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55372: use of closed network connection machine # [ 238.554202] k3s[896]: E0921 12:57:41.239304 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55404: use of closed network connection machine # [ 239.966283] k3s[896]: E0921 12:57:42.651321 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55428: use of closed network connection machine # [ 241.272377] k3s[896]: E0921 12:57:43.957066 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55470: use of closed network connection machine # [ 242.673726] k3s[896]: E0921 12:57:45.359214 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55500: use of closed network connection machine # [ 244.072873] k3s[896]: E0921 12:57:46.758526 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54424: use of closed network connection machine # [ 245.467889] k3s[896]: E0921 12:57:48.153236 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54440: use of closed network connection machine # [ 246.848574] k3s[896]: E0921 12:57:49.534230 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54470: use of closed network connection machine # [ 248.232993] k3s[896]: E0921 12:57:50.918363 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54504: use of closed network connection machine # [ 249.651354] k3s[896]: E0921 12:57:52.336530 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54528: use of closed network connection machine # [ 249.651761] k3s[896]: E0921 12:57:52.336746 896 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:60012->127.0.0.1:10010: write tcp 127.0.0.1:60012->127.0.0.1:10010: write: broken pipe machine # [ 252.466226] k3s[896]: E0921 12:57:55.151700 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54584: use of closed network connection machine # [ 253.846576] k3s[896]: E0921 12:57:56.532168 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:36778: use of closed network connection machine # [ 255.272696] k3s[896]: E0921 12:57:57.958246 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:36794: use of closed network connection machine # [ 256.710245] k3s[896]: E0921 12:57:59.395877 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:36812: use of closed network connection machine # [ 258.136155] k3s[896]: E0921 12:58:00.821712 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:36836: use of closed network connection machine # [ 259.561608] k3s[896]: E0921 12:58:02.246824 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:36872: use of closed network connection machine # [ 260.986454] k3s[896]: E0921 12:58:03.671515 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:36908: use of closed network connection machine: (finished: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-68c8f49bd6-8nzqq -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 35.17 seconds) machine: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine: (finished: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 0.08 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag t-renewed 2>&1 machine # [ 261.406505] niks3-server[1116]: 2026/09/21 12:58:04 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 261.437281] niks3-server[1116]: 2026/09/21 12:58:04 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 261.514892] niks3-server[1116]: 2026/09/21 12:58:04 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 261.518789] niks3-server[1116]: 2026/09/21 12:58:04 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 261.526146] niks3-server[1116]: 2026/09/21 12:58:04 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 261.530512] niks3-server[1116]: 2026/09/21 12:58:04 INFO Registered completed upload object_key=nar/0g42hgwa9jp9abmqxz90dkwxpybsznzbpsy35rm921mlk5sw56jq.nar.zst machine # [ 261.535499] niks3-server[1116]: 2026/09/21 12:58:04 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 261.539196] niks3-server[1116]: 2026/09/21 12:58:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign machine # [ 261.540181] niks3-server[1116]: 2026/09/21 12:58:04 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 261.542150] niks3-server[1116]: 2026/09/21 12:58:04 INFO Signed narinfos id=21 count=1 machine # [ 261.543173] niks3-server[1116]: 2026/09/21 12:58:04 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.ls machine # [ 261.549696] niks3-server[1116]: 2026/09/21 12:58:04 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 261.550487] niks3-server[1116]: 2026/09/21 12:58:04 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete machine # [ 261.551971] niks3-server[1116]: 2026/09/21 12:58:04 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 261.559347] niks3-server[1116]: 2026/09/21 12:58:04 INFO Completed upload id=21 machine # [ 261.562265] niks3-server[1116]: 2026/09/21 12:58:04 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.narinfo machine # [ 270.393555] niks3-server[1116]: 2026/09/21 12:58:13 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 270.446695] niks3-server[1116]: 2026/09/21 12:58:13 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 270.447637] niks3-server[1116]: 2026/09/21 12:58:13 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 270.459581] niks3-server[1116]: 2026/09/21 12:58:13 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 270.464959] niks3-server[1116]: 2026/09/21 12:58:13 INFO Registered completed upload object_key=nar/1vxmmzwi16s4iri6dcmi9v62dpq1ys7wz15b497ncik3sd67nfzg.nar.zst machine # [ 270.468402] niks3-server[1116]: 2026/09/21 12:58:13 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 270.470850] niks3-server[1116]: 2026/09/21 12:58:13 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 270.472925] niks3-server[1116]: 2026/09/21 12:58:13 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 270.473697] niks3-server[1116]: 2026/09/21 12:58:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign machine # [ 270.475171] niks3-server[1116]: 2026/09/21 12:58:13 INFO Signed narinfos id=22 count=1 machine # [ 270.476185] niks3-server[1116]: 2026/09/21 12:58:13 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.ls machine # [ 270.476995] niks3-server[1116]: 2026/09/21 12:58:13 INFO Registered completed upload object_key=log/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31-k3s-a.drv machine # [ 270.480925] niks3-server[1116]: 2026/09/21 12:58:13 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 270.481923] niks3-server[1116]: 2026/09/21 12:58:13 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete machine # [ 270.482957] niks3-server[1116]: 2026/09/21 12:58:13 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 270.484273] niks3-server[1116]: 2026/09/21 12:58:13 INFO Completed upload id=22 machine # [ 270.488113] niks3-server[1116]: 2026/09/21 12:58:13 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo machine # [ 270.492290] niks3-server[1116]: 2026/09/21 12:58:13 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 270.507941] niks3-server[1116]: 2026/09/21 12:58:13 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 270.518851] niks3-server[1116]: 2026/09/21 12:58:13 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 270.578198] niks3-server[1116]: 2026/09/21 12:58:13 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 270.578540] niks3-server[1116]: 2026/09/21 12:58:13 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 270.586608] niks3-server[1116]: 2026/09/21 12:58:13 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 270.590141] niks3-server[1116]: 2026/09/21 12:58:13 INFO Registered completed upload object_key=nar/0cbxkyxz068xc5mivh2h67kw6y01n1x28cbs11v1a03g8m4c71zm.nar.zst machine # [ 270.593866] niks3-server[1116]: 2026/09/21 12:58:13 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 270.594148] niks3-server[1116]: 2026/09/21 12:58:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign machine # [ 270.594768] niks3-server[1116]: 2026/09/21 12:58:13 INFO Signed narinfos id=23 count=1 machine # [ 270.597777] niks3-server[1116]: 2026/09/21 12:58:13 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 270.600190] niks3-server[1116]: 2026/09/21 12:58:13 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.ls machine # [ 270.602413] niks3-server[1116]: 2026/09/21 12:58:13 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 270.602956] niks3-server[1116]: 2026/09/21 12:58:13 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 270.603658] niks3-server[1116]: 2026/09/21 12:58:13 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete machine # [ 270.606677] niks3-server[1116]: 2026/09/21 12:58:13 INFO Completed upload id=23 machine # [ 270.609703] niks3-server[1116]: 2026/09/21 12:58:13 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.narinfo machine # [ 279.035258] niks3-server[1116]: 2026/09/21 12:58:21 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 279.095260] niks3-server[1116]: 2026/09/21 12:58:21 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 279.096006] niks3-server[1116]: 2026/09/21 12:58:21 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 279.113874] niks3-server[1116]: 2026/09/21 12:58:21 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 279.118788] niks3-server[1116]: 2026/09/21 12:58:21 INFO Registered completed upload object_key=nar/0khxywxb2r78vhpc5hsmha3ymgp910z0aka7550jmaqzs333rmzp.nar.zst machine # [ 279.121934] niks3-server[1116]: 2026/09/21 12:58:21 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 279.124685] niks3-server[1116]: 2026/09/21 12:58:21 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 279.126111] niks3-server[1116]: 2026/09/21 12:58:21 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 279.127585] niks3-server[1116]: 2026/09/21 12:58:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign machine # [ 279.129144] niks3-server[1116]: 2026/09/21 12:58:21 INFO Signed narinfos id=24 count=1 machine # [ 279.130269] niks3-server[1116]: 2026/09/21 12:58:21 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.ls machine # [ 279.133735] niks3-server[1116]: 2026/09/21 12:58:21 INFO Registered completed upload object_key=log/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4-k3s-b.drv machine # [ 279.137475] niks3-server[1116]: 2026/09/21 12:58:21 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 279.139185] niks3-server[1116]: 2026/09/21 12:58:21 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete machine # [ 279.139825] niks3-server[1116]: 2026/09/21 12:58:21 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 279.140758] niks3-server[1116]: 2026/09/21 12:58:21 INFO Completed upload id=24 machine # [ 279.146111] niks3-server[1116]: 2026/09/21 12:58:21 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 279.146642] niks3-server[1116]: 2026/09/21 12:58:21 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.narinfo machine # [ 279.162563] niks3-server[1116]: 2026/09/21 12:58:21 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 279.173079] niks3-server[1116]: 2026/09/21 12:58:21 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 279.237072] niks3-server[1116]: 2026/09/21 12:58:21 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 279.237312] niks3-server[1116]: 2026/09/21 12:58:21 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 279.250042] niks3-server[1116]: 2026/09/21 12:58:21 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 279.254406] niks3-server[1116]: 2026/09/21 12:58:21 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 279.257341] niks3-server[1116]: 2026/09/21 12:58:21 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 279.259953] niks3-server[1116]: 2026/09/21 12:58:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign machine # [ 279.261864] niks3-server[1116]: 2026/09/21 12:58:21 INFO Signed narinfos id=25 count=1 machine # [ 279.263321] niks3-server[1116]: 2026/09/21 12:58:21 INFO Registered completed upload object_key=nar/04bim5f8bvjh25xncf5x40kb529khrlzcbc92qxvapgbc0bdfv2h.nar.zst machine # [ 279.265125] niks3-server[1116]: 2026/09/21 12:58:21 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.ls machine # [ 279.266666] niks3-server[1116]: 2026/09/21 12:58:21 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 279.268065] niks3-server[1116]: 2026/09/21 12:58:21 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete machine # [ 279.269708] niks3-server[1116]: 2026/09/21 12:58:21 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 279.271079] niks3-server[1116]: 2026/09/21 12:58:21 INFO Completed upload id=25 machine # [ 279.272118] niks3-server[1116]: 2026/09/21 12:58:21 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.narinfo machine # [ 288.291247] niks3-server[1116]: 2026/09/21 12:58:30 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 288.344240] niks3-server[1116]: 2026/09/21 12:58:31 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 288.347953] niks3-server[1116]: 2026/09/21 12:58:31 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 288.357846] niks3-server[1116]: 2026/09/21 12:58:31 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 288.359323] niks3-server[1116]: 2026/09/21 12:58:31 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 288.360645] niks3-server[1116]: 2026/09/21 12:58:31 INFO Registered completed upload object_key=log/jz7biafi8rj5r3r392blyazw5mdpvy0d-k3s-top.drv machine # [ 288.362363] niks3-server[1116]: 2026/09/21 12:58:31 INFO Registered completed upload object_key=nar/11f7f1hixry25c2yc6np9hs10a2pwwqmymmrxxbswhdjabcyvv0s.nar.zst machine # [ 288.376984] niks3-server[1116]: 2026/09/21 12:58:31 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 288.380343] niks3-server[1116]: 2026/09/21 12:58:31 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 288.380428] niks3-server[1116]: 2026/09/21 12:58:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign machine # [ 288.381238] niks3-server[1116]: 2026/09/21 12:58:31 INFO Signed narinfos id=26 count=1 machine # [ 288.382768] niks3-server[1116]: 2026/09/21 12:58:31 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.ls machine # [ 288.385915] niks3-server[1116]: 2026/09/21 12:58:31 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 288.387983] niks3-server[1116]: 2026/09/21 12:58:31 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 288.388622] niks3-server[1116]: 2026/09/21 12:58:31 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete machine # [ 288.390047] niks3-server[1116]: 2026/09/21 12:58:31 INFO Completed upload id=26 machine # [ 288.391300] niks3-server[1116]: 2026/09/21 12:58:31 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag t-renewed 2>&1, in 27.38 seconds) (finished: subtest: a renewed balancer certificate is served without a rollout, in 63.63 seconds) subtest: metrics carry build_info machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-t28jn -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-t28jn -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.22 seconds) machine: must succeed: curl -sf http://10.42.0.6:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-t28jn"' machine: (finished: must succeed: curl -sf http://10.42.0.6:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-t28jn"', in 0.06 seconds) (finished: subtest: metrics carry build_info, in 0.29 seconds) subtest: harmonia-gc frees space and the worker stays Ready machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-t28jn -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'' machine # [ 289.022400] k3s[896]: E0921 12:58:31.707627 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40588: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-t28jn -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'', in 0.28 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-t28jn -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done' machine # [ 289.390631] k3s[896]: E0921 12:58:32.076435 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40624: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-t28jn -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done', in 0.38 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-t28jn -c gc -- sh -c 'fallocate -l 11468161024 /nix/fill' machine # [ 289.751434] k3s[896]: E0921 12:58:32.437366 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40652: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-t28jn -c gc -- sh -c 'fallocate -l 11468161024 /nix/fill', in 0.35 seconds) machine: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-t28jn -c gc --since=30s | grep -q 'store paths deleted' machine: (finished: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-t28jn -c gc --since=30s | grep -q 'store paths deleted', in 4.15 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-t28jn -c gc -- sh -c 'rm /nix/fill' machine # [ 294.243220] k3s[896]: E0921 12:58:36.928374 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40658: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-t28jn -c gc -- sh -c 'rm /nix/fill', in 0.34 seconds) machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-t28jn -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-t28jn -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}', in 0.22 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-t28jn -c gc -- sh -c 'command -v nix-daemon && command -v niks3' machine # [ 294.728775] k3s[896]: E0921 12:58:37.414617 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40690: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-t28jn -c gc -- sh -c 'command -v nix-daemon && command -v niks3', in 0.27 seconds) (finished: subtest: harmonia-gc frees space and the worker stays Ready, in 5.99 seconds) subtest: losing the balancer mid-build: the client reconnects and the build succeeds machine: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/434skfxjp21wrad1nb0qdhhpgrbh812m-slow.nix --argstr tag lb1 machine # [ 294.781378] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/434skfxjp21wrad1nb0qdhhpgrbh812m-slow.nix --argstr tag lb1. machine # Running as unit: vialb.service; invocation ID: fda916f1f2f642e1a0cca8bf79453024 machine: (finished: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/434skfxjp21wrad1nb0qdhhpgrbh812m-slow.nix --argstr tag lb1, in 0.06 seconds) machine: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'" machine # [ 295.088374] nix[7849]: don't know how to build these paths: machine # [ 295.088597] nix[7849]: /nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 295.094084] niks3-server[1116]: 2026/09/21 12:58:37 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 295.117577] nix[7849]: copying 1 paths to '127.0.0.1:30051'... machine # [ 295.118753] nix[7849]: copying path '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' to '127.0.0.1:30051'... machine # [ 295.136307] niks3-server[1116]: 2026/09/21 12:58:37 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 295.213146] niks3-server[1116]: 2026/09/21 12:58:37 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 295.213873] niks3-server[1116]: 2026/09/21 12:58:37 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 295.227452] niks3-server[1116]: 2026/09/21 12:58:37 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 295.231668] niks3-server[1116]: 2026/09/21 12:58:37 INFO Registered completed upload object_key=nar/0kkr2vb091wkq0cb0f1q92413dsfskh76wydp8mwysv7rawns0ar.nar.zst machine # [ 295.232145] niks3-server[1116]: 2026/09/21 12:58:37 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 295.233368] niks3-server[1116]: 2026/09/21 12:58:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign machine # [ 295.234526] niks3-server[1116]: 2026/09/21 12:58:37 INFO Signed narinfos id=27 count=1 machine # [ 295.245049] niks3-server[1116]: 2026/09/21 12:58:37 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 295.245455] niks3-server[1116]: 2026/09/21 12:58:37 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 295.246759] niks3-server[1116]: 2026/09/21 12:58:37 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete machine # [ 295.247136] niks3-server[1116]: 2026/09/21 12:58:37 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 295.247940] niks3-server[1116]: 2026/09/21 12:58:37 INFO Completed upload id=27 machine # [ 295.250988] niks3-server[1116]: 2026/09/21 12:58:37 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.narinfo machine # [ 295.258128] nix[7849]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 295.258825] nix[7849]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-t28jn: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine: (finished: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'", in 1.11 seconds) machine: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false machine: (finished: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false, in 0.30 seconds) machine: waiting for success: ! systemctl is-active vialb machine # [ 296.230355] nix[7849]: d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv: Stream removed (Socket closed), asking the scheduler again machine # [ 296.230590] nix[7849]: scheduler at 127.0.0.1:30051: Stream removed (Socket closed), reconnecting machine # [ 296.262836] systemd[1]: cri-containerd-a15d9f2129d51c95b344f481b52ebd8e402cb1bcb91803c4e34508df46b28a37.scope: Deactivated successfully. machine # [ 296.267630] systemd[1]: cri-containerd-a15d9f2129d51c95b344f481b52ebd8e402cb1bcb91803c4e34508df46b28a37.scope: Consumed 2.734s CPU time over 3min 54.892s wall clock time, 52.1M memory peak, 36.1M read from disk, 464K incoming IP traffic, 431.3K outgoing IP traffic. machine # [ 296.313577] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-a15d9f2129d51c95b344f481b52ebd8e402cb1bcb91803c4e34508df46b28a37-rootfs.mount: Deactivated successfully. machine # [ 296.355762] systemd[1]: cri-containerd-91c7a82483e6977c5da481398cbd667311d1f8ce6d93fb143ed7a546f21e1a64.scope: Deactivated successfully. machine # [ 296.404920] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-91c7a82483e6977c5da481398cbd667311d1f8ce6d93fb143ed7a546f21e1a64-rootfs.mount: Deactivated successfully. machine # [ 296.446699] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-91c7a82483e6977c5da481398cbd667311d1f8ce6d93fb143ed7a546f21e1a64-shm.mount: Deactivated successfully. machine # [ 296.661934] cni0: port 4(vethc3125c10) entered disabled state machine # [ 296.508675] dhcpcd[2990]: vethc3125c10: carrier lost machine # [ 296.665016] vethc3125c10 (unregistering): left allmulticast mode machine # [ 296.666850] vethc3125c10 (unregistering): left promiscuous mode machine # [ 296.668008] cni0: port 4(vethc3125c10) entered disabled state machine # [ 296.535454] systemd[1]: run-netns-cni\x2d40f0f395\x2d8472\x2d5460\x2dd7dc\x2d52af9240ebdd.mount: Deactivated successfully. machine # [ 296.571543] dhcpcd[2990]: vethc3125c10: deleting route to 169.254.0.0/16 machine # [ 296.586919] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod959a214b_43d3_440a_b3e6_f62871edd4b7.slice. machine # [ 296.679892] k3s[896]: I0921 12:58:39.365554 896 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9dc12634-dfd3-4adf-ac15-f22dcd199a00-tls-lb\" (UniqueName: \"kubernetes.io/secret/9dc12634-dfd3-4adf-ac15-f22dcd199a00-tls-lb\") pod \"9dc12634-dfd3-4adf-ac15-f22dcd199a00\" (UID: \"9dc12634-dfd3-4adf-ac15-f22dcd199a00\") " machine # [ 296.680566] k3s[896]: I0921 12:58:39.365604 896 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9dc12634-dfd3-4adf-ac15-f22dcd199a00-tmp\" (UniqueName: \"kubernetes.io/empty-dir/9dc12634-dfd3-4adf-ac15-f22dcd199a00-tmp\") pod \"9dc12634-dfd3-4adf-ac15-f22dcd199a00\" (UID: \"9dc12634-dfd3-4adf-ac15-f22dcd199a00\") " machine # [ 296.681321] k3s[896]: I0921 12:58:39.365636 896 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9dc12634-dfd3-4adf-ac15-f22dcd199a00-tls-ca\" (UniqueName: \"kubernetes.io/secret/9dc12634-dfd3-4adf-ac15-f22dcd199a00-tls-ca\") pod \"9dc12634-dfd3-4adf-ac15-f22dcd199a00\" (UID: \"9dc12634-dfd3-4adf-ac15-f22dcd199a00\") " machine # [ 296.681838] k3s[896]: I0921 12:58:39.365672 896 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9dc12634-dfd3-4adf-ac15-f22dcd199a00-config\" (UniqueName: \"kubernetes.io/configmap/9dc12634-dfd3-4adf-ac15-f22dcd199a00-config\") pod \"9dc12634-dfd3-4adf-ac15-f22dcd199a00\" (UID: \"9dc12634-dfd3-4adf-ac15-f22dcd199a00\") " machine # [ 296.682373] k3s[896]: I0921 12:58:39.365722 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/959a214b-43d3-440a-b3e6-f62871edd4b7-tls-ca\") pod \"nix-grpc-farm-lb-68c8f49bd6-tqkzn\" (UID: \"959a214b-43d3-440a-b3e6-f62871edd4b7\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-tqkzn" machine # [ 296.683149] k3s[896]: I0921 12:58:39.365757 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/959a214b-43d3-440a-b3e6-f62871edd4b7-tls-lb\") pod \"nix-grpc-farm-lb-68c8f49bd6-tqkzn\" (UID: \"959a214b-43d3-440a-b3e6-f62871edd4b7\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-tqkzn" machine # [ 296.684271] k3s[896]: I0921 12:58:39.365782 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/959a214b-43d3-440a-b3e6-f62871edd4b7-config\") pod \"nix-grpc-farm-lb-68c8f49bd6-tqkzn\" (UID: \"959a214b-43d3-440a-b3e6-f62871edd4b7\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-tqkzn" machine # [ 296.685231] k3s[896]: I0921 12:58:39.365808 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/959a214b-43d3-440a-b3e6-f62871edd4b7-tmp\") pod \"nix-grpc-farm-lb-68c8f49bd6-tqkzn\" (UID: \"959a214b-43d3-440a-b3e6-f62871edd4b7\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-tqkzn" machine # [ 296.687662] systemd[1]: var-lib-kubelet-pods-9dc12634\x2ddfd3\x2d4adf\x2dac15\x2df22dcd199a00-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 296.723899] k3s[896]: I0921 12:58:39.409756 896 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dc12634-dfd3-4adf-ac15-f22dcd199a00-tmp" pod "9dc12634-dfd3-4adf-ac15-f22dcd199a00" (UID: "9dc12634-dfd3-4adf-ac15-f22dcd199a00"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 296.731326] k3s[896]: I0921 12:58:39.409970 896 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dc12634-dfd3-4adf-ac15-f22dcd199a00-tls-lb" pod "9dc12634-dfd3-4adf-ac15-f22dcd199a00" (UID: "9dc12634-dfd3-4adf-ac15-f22dcd199a00"). InnerVolumeSpecName "tls-lb". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 296.737244] k3s[896]: I0921 12:58:39.423198 896 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dc12634-dfd3-4adf-ac15-f22dcd199a00-tls-ca" pod "9dc12634-dfd3-4adf-ac15-f22dcd199a00" (UID: "9dc12634-dfd3-4adf-ac15-f22dcd199a00"). InnerVolumeSpecName "tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 296.747418] k3s[896]: I0921 12:58:39.433354 896 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9dc12634-dfd3-4adf-ac15-f22dcd199a00-config" pod "9dc12634-dfd3-4adf-ac15-f22dcd199a00" (UID: "9dc12634-dfd3-4adf-ac15-f22dcd199a00"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 296.755300] dhcpcd[2990]: vethc3125c10: removing interface machine # [ 296.780981] k3s[896]: I0921 12:58:39.466858 896 reconciler_common.go:299] "Volume detached for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/9dc12634-dfd3-4adf-ac15-f22dcd199a00-tls-lb\") on node \"machine\" DevicePath \"\"" machine # [ 296.781405] k3s[896]: I0921 12:58:39.466883 896 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9dc12634-dfd3-4adf-ac15-f22dcd199a00-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 296.782311] k3s[896]: I0921 12:58:39.466896 896 reconciler_common.go:299] "Volume detached for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/9dc12634-dfd3-4adf-ac15-f22dcd199a00-tls-ca\") on node \"machine\" DevicePath \"\"" machine # [ 296.783388] k3s[896]: I0921 12:58:39.466909 896 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9dc12634-dfd3-4adf-ac15-f22dcd199a00-config\") on node \"machine\" DevicePath \"\"" machine # [ 297.076047] cni0: port 1(veth643305f2) entered blocking state machine # [ 297.077413] cni0: port 1(veth643305f2) entered disabled state machine # [ 297.078605] veth643305f2: entered allmulticast mode machine # [ 297.079926] veth643305f2: entered promiscuous mode machine # [ 296.929454] (udev-worker)[8037]: Network interface NamePolicy= disabled on kernel command line. machine # [ 297.092002] cni0: port 1(veth643305f2) entered blocking state machine # [ 297.092926] cni0: port 1(veth643305f2) entered forwarding state machine # [ 296.978446] dhcpcd[2990]: veth643305f2: IAID 1e:3b:fa:25 machine # [ 296.979771] dhcpcd[2990]: veth643305f2: adding address fe80::fc4c:1eff:fe3b:fa25 machine # [ 297.051637] systemd[1]: Started libcontainer container b06d7a1744c9ab1de1d986d8497df71ef72e6da5641236efeaee09eccbf03c18. machine # [ 297.193383] systemd[1]: Started libcontainer container bb64f3069d37d0681f3647b6f25147ae62c46f0abf98435401bea935268eb8f3. machine # [ 297.326200] systemd[1]: var-lib-kubelet-pods-9dc12634\x2ddfd3\x2d4adf\x2dac15\x2df22dcd199a00-volume\x2dsubpaths-config-envoy-2.mount: Deactivated successfully. machine # [ 297.328807] systemd[1]: var-lib-kubelet-pods-9dc12634\x2ddfd3\x2d4adf\x2dac15\x2df22dcd199a00-volume\x2dsubpaths-config-envoy-1.mount: Deactivated successfully. machine # [ 297.331177] systemd[1]: var-lib-kubelet-pods-9dc12634\x2ddfd3\x2d4adf\x2dac15\x2df22dcd199a00-volume\x2dsubpaths-config-envoy-0.mount: Deactivated successfully. machine # [ 297.333651] systemd[1]: var-lib-kubelet-pods-9dc12634\x2ddfd3\x2d4adf\x2dac15\x2df22dcd199a00-volumes-kubernetes.io\x7esecret-tls\x2dca.mount: Deactivated successfully. machine # [ 297.336488] systemd[1]: var-lib-kubelet-pods-9dc12634\x2ddfd3\x2d4adf\x2dac15\x2df22dcd199a00-volumes-kubernetes.io\x7esecret-tls\x2dlb.mount: Deactivated successfully. machine # [ 297.339416] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod9dc12634_dfd3_4adf_ac15_f22dcd199a00.slice. machine # [ 297.341617] systemd[1]: kubepods-besteffort-pod9dc12634_dfd3_4adf_ac15_f22dcd199a00.slice: Consumed 2.766s CPU time over 3min 57.130s wall clock time, 52.4M memory peak, 36.1M read from disk, 464K incoming IP traffic, 431.3K outgoing IP traffic. machine # [ 297.389376] k3s[896]: I0921 12:58:40.075168 896 scope.go:122] "RemoveContainer" containerID="a15d9f2129d51c95b344f481b52ebd8e402cb1bcb91803c4e34508df46b28a37" machine # [ 297.403256] k3s[896]: I0921 12:58:40.089214 896 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-68c8f49bd6-tqkzn" podStartSLOduration=1.089195241 podStartE2EDuration="1.089195241s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-21 12:58:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-21 12:58:40.088330886 +0000 UTC m=+276.448781589" watchObservedRunningTime="2026-09-21 12:58:40.089195241 +0000 UTC m=+276.449645944" machine # [ 297.923786] dhcpcd[2990]: veth643305f2: soliciting a DHCP lease machine # [ 298.527907] dhcpcd[2990]: veth643305f2: soliciting an IPv6 router machine # [ 298.736545] nix[7849]: scheduler at 127.0.0.1:30051: failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:30051: tcp handshaker shutdown, reconnecting machine # [ 299.324895] k3s[896]: I0921 12:58:42.010139 896 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9dc12634-dfd3-4adf-ac15-f22dcd199a00" path="/var/lib/kubelet/pods/9dc12634-dfd3-4adf-ac15-f22dcd199a00/volumes" machine # [ 299.744757] niks3-server[1116]: 2026/09/21 12:58:42 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 299.781255] nix[7849]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 299.781893] nix[7849]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-zhdvd: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 302.937701] dhcpcd[2990]: veth643305f2: probing for an IPv4LL address machine # [ 308.913872] dhcpcd[2990]: veth643305f2: using IPv4LL address 169.254.246.53 machine # [ 308.914762] dhcpcd[2990]: veth643305f2: adding route to 169.254.0.0/16 machine # [ 310.532434] dhcpcd[2990]: veth643305f2: no IPv6 Routers available machine # [ 312.940958] postgres[781]: [781] LOG: checkpoint starting: time machine # [ 328.636945] niks3-server[1116]: 2026/09/21 12:59:11 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 328.675295] niks3-server[1116]: 2026/09/21 12:59:11 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 328.675466] niks3-server[1116]: 2026/09/21 12:59:11 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 328.689391] niks3-server[1116]: 2026/09/21 12:59:11 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 328.690394] niks3-server[1116]: 2026/09/21 12:59:11 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 328.692077] niks3-server[1116]: 2026/09/21 12:59:11 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 328.692306] niks3-server[1116]: 2026/09/21 12:59:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign machine # [ 328.693974] niks3-server[1116]: 2026/09/21 12:59:11 INFO Signed narinfos id=28 count=1 machine # [ 328.698639] niks3-server[1116]: 2026/09/21 12:59:11 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.ls machine # [ 328.708579] niks3-server[1116]: 2026/09/21 12:59:11 INFO Registered completed upload object_key=log/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 328.714950] niks3-server[1116]: 2026/09/21 12:59:11 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 328.718686] niks3-server[1116]: 2026/09/21 12:59:11 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete machine # [ 328.719583] niks3-server[1116]: 2026/09/21 12:59:11 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 328.720422] niks3-server[1116]: 2026/09/21 12:59:11 INFO Completed upload id=28 machine # [ 328.726154] niks3-server[1116]: 2026/09/21 12:59:11 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.narinfo machine # [ 328.767343] systemd[1]: vialb.service: Deactivated successfully. machine # [ 328.767692] systemd[1]: vialb.service: Consumed 213ms CPU time over 33.986s wall clock time, 42.3M memory peak, 4K written to disk, 7.8K incoming IP traffic, 17K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active vialb, in 32.87 seconds) machine: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; }, in 0.06 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 0.32 seconds) (finished: subtest: losing the balancer mid-build: the client reconnects and the build succeeds, in 34.71 seconds) subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes machine: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/434skfxjp21wrad1nb0qdhhpgrbh812m-slow.nix --argstr tag s1 machine # [ 329.478507] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/434skfxjp21wrad1nb0qdhhpgrbh812m-slow.nix --argstr tag s1. machine # Running as unit: slow.service; invocation ID: 9da7702ed9d24fb29ddf99077cc23813 machine: (finished: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/434skfxjp21wrad1nb0qdhhpgrbh812m-slow.nix --argstr tag s1, in 0.05 seconds) machine # [ 329.729699] nix[8658]: don't know how to build these paths: machine # [ 329.729929] nix[8658]: /nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 329.737051] niks3-server[1116]: 2026/09/21 12:59:12 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 329.756377] nix[8658]: copying 1 paths to '127.0.0.1:30051'... machine # [ 329.757911] nix[8658]: copying path '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' to '127.0.0.1:30051'... machine # [ 329.764158] niks3-server[1116]: 2026/09/21 12:59:12 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 329.792039] k3s[896]: E0921 12:59:12.477689 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:48488: use of closed network connection machine # command terminated with exit code 1 machine # [ 329.825611] niks3-server[1116]: 2026/09/21 12:59:12 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 329.826024] niks3-server[1116]: 2026/09/21 12:59:12 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 329.834709] niks3-server[1116]: 2026/09/21 12:59:12 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 329.839401] niks3-server[1116]: 2026/09/21 12:59:12 INFO Registered completed upload object_key=nar/0wl2i9xpw0gwrx1xqdgx9ka4n503ky9qhl20pdrdlphn8d6lcx0i.nar.zst machine # [ 329.839923] niks3-server[1116]: 2026/09/21 12:59:12 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 329.840469] niks3-server[1116]: 2026/09/21 12:59:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign machine # [ 329.840933] niks3-server[1116]: 2026/09/21 12:59:12 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 329.842350] niks3-server[1116]: 2026/09/21 12:59:12 INFO Signed narinfos id=29 count=1 machine # [ 329.845407] niks3-server[1116]: 2026/09/21 12:59:12 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.ls machine # [ 329.848867] niks3-server[1116]: 2026/09/21 12:59:12 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 329.849152] niks3-server[1116]: 2026/09/21 12:59:12 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete machine # [ 329.849696] niks3-server[1116]: 2026/09/21 12:59:12 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 329.853191] niks3-server[1116]: 2026/09/21 12:59:12 INFO Completed upload id=29 machine # [ 329.854611] niks3-server[1116]: 2026/09/21 12:59:12 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.narinfo machine # [ 329.862718] nix[8658]: building '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' on 127.0.0.1:30051... machine # [ 329.863112] nix[8658]: slow-s1> machine/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-t28jn: building zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 330.105835] k3s[896]: E0921 12:59:12.791583 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:48512: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 331.433299] k3s[896]: E0921 12:59:14.118476 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:48534: use of closed network connection machine # [ 331.806759] k3s[896]: E0921 12:59:14.492521 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:48576: use of closed network connection machine # command terminated with exit code 1 machine # [ 333.198939] k3s[896]: E0921 12:59:15.884512 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:49072: use of closed network connection machine # command terminated with exit code 1 machine # [ 333.575084] k3s[896]: E0921 12:59:16.260861 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:49120: use of closed network connection machine # command terminated with exit code 1 machine # [ 334.965860] k3s[896]: E0921 12:59:17.651437 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:49158: use of closed network connection machine # command terminated with exit code 1 machine # [ 335.285894] k3s[896]: E0921 12:59:17.971698 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:49196: use of closed network connection machine # command terminated with exit code 1 machine # [ 336.709505] k3s[896]: E0921 12:59:19.394564 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:49218: use of closed network connection machine # command terminated with exit code 1 machine # [ 337.078257] k3s[896]: E0921 12:59:19.764118 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:49246: use of closed network connection machine # command terminated with exit code 1 machine # [ 338.453051] k3s[896]: E0921 12:59:21.138499 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:49278: use of closed network connection machine # [ 338.735240] k3s[896]: E0921 12:59:21.421018 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:49302: use of closed network connection machine: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-t28jn --wait=false machine: (finished: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-t28jn --wait=false, in 0.22 seconds) machine: must succeed: sleep 5.0 machine # [ 339.024738] systemd[1]: cri-containerd-ca1627bb0d843be89158e231d0298da099a0cc9abed827014bb1939db480ba9a.scope: Deactivated successfully. machine # [ 339.025961] systemd[1]: cri-containerd-ca1627bb0d843be89158e231d0298da099a0cc9abed827014bb1939db480ba9a.scope: Consumed 347ms CPU time over 4min 16.069s wall clock time, 13.5M memory peak, 5.4M read from disk. machine # [ 339.080892] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-ca1627bb0d843be89158e231d0298da099a0cc9abed827014bb1939db480ba9a-rootfs.mount: Deactivated successfully. machine # [ 339.175155] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod73bdd368_1c1d_4639_a4cc_47593c0c4030.slice. machine # [ 339.218916] k3s[896]: I0921 12:59:21.904855 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/73bdd368-1c1d-4639-a4cc-47593c0c4030-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-rhvzv\" (UID: \"73bdd368-1c1d-4639-a4cc-47593c0c4030\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-rhvzv" machine # [ 339.219484] k3s[896]: I0921 12:59:21.904898 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/73bdd368-1c1d-4639-a4cc-47593c0c4030-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-rhvzv\" (UID: \"73bdd368-1c1d-4639-a4cc-47593c0c4030\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-rhvzv" machine # [ 339.219895] k3s[896]: I0921 12:59:21.904927 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw7vq\" (UniqueName: \"kubernetes.io/projected/73bdd368-1c1d-4639-a4cc-47593c0c4030-kube-api-access-vw7vq\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-rhvzv\" (UID: \"73bdd368-1c1d-4639-a4cc-47593c0c4030\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-rhvzv" machine # [ 339.220499] k3s[896]: I0921 12:59:21.904958 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/73bdd368-1c1d-4639-a4cc-47593c0c4030-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-rhvzv\" (UID: \"73bdd368-1c1d-4639-a4cc-47593c0c4030\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-rhvzv" machine # [ 339.220949] k3s[896]: I0921 12:59:21.905239 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/73bdd368-1c1d-4639-a4cc-47593c0c4030-build\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-rhvzv\" (UID: \"73bdd368-1c1d-4639-a4cc-47593c0c4030\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-rhvzv" machine # [ 339.221591] k3s[896]: I0921 12:59:21.905342 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/73bdd368-1c1d-4639-a4cc-47593c0c4030-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-rhvzv\" (UID: \"73bdd368-1c1d-4639-a4cc-47593c0c4030\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-rhvzv" machine # [ 339.222217] k3s[896]: I0921 12:59:21.905368 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/73bdd368-1c1d-4639-a4cc-47593c0c4030-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-rhvzv\" (UID: \"73bdd368-1c1d-4639-a4cc-47593c0c4030\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-rhvzv" machine # [ 339.222658] k3s[896]: I0921 12:59:21.905391 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/73bdd368-1c1d-4639-a4cc-47593c0c4030-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-rhvzv\" (UID: \"73bdd368-1c1d-4639-a4cc-47593c0c4030\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-rhvzv" machine # [ 339.662712] cni0: port 4(veth5e494a5f) entered blocking state machine # [ 339.664892] cni0: port 4(veth5e494a5f) entered disabled state machine # [ 339.666649] veth5e494a5f: entered allmulticast mode machine # [ 339.668166] veth5e494a5f: entered promiscuous mode machine # [ 339.678940] cni0: port 4(veth5e494a5f) entered blocking state machine # [ 339.680287] cni0: port 4(veth5e494a5f) entered forwarding state machine # [ 339.603127] (udev-worker)[9367]: Network interface NamePolicy= disabled on kernel command line. machine # [ 339.646344] systemd[1]: Started libcontainer container a39d509107335f907e2593bde6d0752c2648e5c06100fed52ef84dd20f4caff0. machine # [ 339.654031] dhcpcd[2990]: veth5e494a5f: IAID 7a:20:4e:cb machine # [ 339.655250] dhcpcd[2990]: veth5e494a5f: adding address fe80::9027:7aff:fe20:4ecb machine # [ 339.755423] systemd[1]: Started libcontainer container 96888deda6f2bd53a0718fb54b23d7cf9a82e3388a349845ecdc8deb8175a86d. machine # [ 341.393630] dhcpcd[2990]: veth5e494a5f: soliciting a DHCP lease machine # [ 341.983095] dhcpcd[2990]: veth5e494a5f: soliciting an IPv6 router machine # [ 342.219737] systemd[1]: cri-containerd-96888deda6f2bd53a0718fb54b23d7cf9a82e3388a349845ecdc8deb8175a86d.scope: Deactivated successfully. machine # [ 342.227105] systemd[1]: cri-containerd-96888deda6f2bd53a0718fb54b23d7cf9a82e3388a349845ecdc8deb8175a86d.scope: Consumed 1.024s CPU time over 2.468s wall clock time, 490.5M memory peak, 199.7M read from disk, 159.6M written to disk. machine # [ 342.331129] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-96888deda6f2bd53a0718fb54b23d7cf9a82e3388a349845ecdc8deb8175a86d-rootfs.mount: Deactivated successfully. machine # [ 342.660250] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount1055666678.mount: Deactivated successfully. machine # [ 342.723534] systemd[1]: Started libcontainer container 20ebfd72b9cdc9a5adb2e956847a0f3ac1c8eccc74dbc46798d57548eb744881. machine # [ 342.874298] systemd[1]: Started libcontainer container 2bfceb619a11d121138d25b8b604b113af72630a0f98939ae91c890f6e18edf5. machine # [ 343.011333] systemd[1]: Started libcontainer container 371bef05bc6f9edaa1dd55999779eef35ff21c26cd066d8719074a571d179645. machine # [ 343.637798] k3s[896]: I0921 12:59:26.322534 896 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-rhvzv" podStartSLOduration=2.864413315 podStartE2EDuration="5.322490529s" totalImagesPullingTime="0s" totalInitContainerRuntime="2.458077214s" isStatefulPod=false podCreationTimestamp="2026-09-21 12:59:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-21 12:59:26.320383557 +0000 UTC m=+322.680839289" watchObservedRunningTime="2026-09-21 12:59:26.322490529 +0000 UTC m=+322.682945981" machine: (finished: must succeed: sleep 5.0, in 5.05 seconds) machine # [ 344.297891] k3s[896]: E0921 12:59:26.983831 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:44926: use of closed network connection machine: waiting for success: ! systemctl is-active slow machine # [ 346.394567] dhcpcd[2990]: veth5e494a5f: probing for an IPv4LL address machine # [ 351.356429] dhcpcd[2990]: veth5e494a5f: using IPv4LL address 169.254.57.23 machine # [ 351.356960] dhcpcd[2990]: veth5e494a5f: adding route to 169.254.0.0/16 machine # [ 353.986865] dhcpcd[2990]: veth5e494a5f: no IPv6 Routers available machine # [ 357.918666] niks3-server[1116]: 2026/09/21 12:59:40 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 357.963138] niks3-server[1116]: 2026/09/21 12:59:40 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 357.963364] niks3-server[1116]: 2026/09/21 12:59:40 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 357.983496] niks3-server[1116]: 2026/09/21 12:59:40 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 357.987889] niks3-server[1116]: 2026/09/21 12:59:40 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 357.988133] niks3-server[1116]: 2026/09/21 12:59:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign machine # [ 357.991043] niks3-server[1116]: 2026/09/21 12:59:40 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 357.995182] niks3-server[1116]: 2026/09/21 12:59:40 INFO Registered completed upload object_key=log/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 357.996532] niks3-server[1116]: 2026/09/21 12:59:40 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.ls machine # [ 358.013716] niks3-server[1116]: 2026/09/21 12:59:40 INFO Signed narinfos id=30 count=1 machine # [ 358.025946] niks3-server[1116]: 2026/09/21 12:59:40 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 358.026234] niks3-server[1116]: 2026/09/21 12:59:40 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete machine # [ 358.026871] niks3-server[1116]: 2026/09/21 12:59:40 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 358.028436] niks3-server[1116]: 2026/09/21 12:59:40 INFO Completed upload id=30 machine # [ 358.073917] systemd[1]: slow.service: Deactivated successfully. machine # [ 358.075450] systemd[1]: slow.service: Consumed 137ms CPU time over 28.595s wall clock time, 38.5M memory peak, 4K written to disk, 4.6K incoming IP traffic, 11.3K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active slow, in 13.83 seconds) machine: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; }, in 0.04 seconds) machine: must fail: journalctl -u slow | grep -q 'asking the scheduler again' machine: (finished: must fail: journalctl -u slow | grep -q 'asking the scheduler again', in 0.03 seconds) machine: must succeed: nix eval --raw -f /nix/store/434skfxjp21wrad1nb0qdhhpgrbh812m-slow.nix --argstr tag s1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/434skfxjp21wrad1nb0qdhhpgrbh812m-slow.nix --argstr tag s1 outPath, in 0.26 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null, in 0.08 seconds) (finished: subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes, in 29.11 seconds) (finished: run the VM test script, in 359.63 seconds) test script finished in 359.71s cleanup kill QemuMachine (pid 45) machine # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14) (finished: cleanup, in 1.03 seconds) additionally exposed symbols: machine, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh