tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 1200.0 seconds run the VM test script machine: waiting for unit k3s.service machine: waiting for the VM to finish booting machine: starting vm machine # Disk image does not exist, creating the virtualisation disk image... machine: QEMU running (pid 45) machine # Formatting '/build/vm-state-machine/tmp.IDGggivyQP', fmt=raw size=17179869184 machine # mke2fs 1.47.4 (6-Mar-2025) machine # Discarding device blocks: 0/4194304 done machine # Creating filesystem with 4194304 4k blocks and 1048576 inodes machine # Filesystem UUID: 58c33886-534d-4428-8733-6b8fe9eb2f9b machine # Superblock backups stored on blocks: machine # 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208, machine # 4096000 machine # machine # Allocating group tables: 0/128 done machine # Writing inode tables: 0/128 done machine # Creating journal (32768 blocks): done machine # Writing superblocks and filesystem accounting information: 0/128 done machine # machine # Virtualisation disk image created. machine # Starting virtiofs daemons... machine # [2026-09-23T04:11:32Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-23T04:11:32Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-23T04:11:32Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-23T04:11:32Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-23T04:11:32Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-23T04:11:32Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-23T04:11:32Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-23T04:11:32Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-23T04:11:32Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-23T04:11:32Z INFO virtiofsd] Client connected, servicing requests machine # [2026-09-23T04:11:32Z INFO virtiofsd] Client connected, servicing requests machine # [2026-09-23T04:11:32Z INFO virtiofsd] Client connected, servicing requests machine # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) machine # machine # machine # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+7EFCC730+7EF2C730 CA00 machine # Press Ctrl-B to configure iPXE (PCI 00:02.0)... machine # machine # machine # machine # machine # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 7EFCC730 7EF2C730 CB00 machine # Press Ctrl-B to configure iPXE (PCI 00:05.0)... machine # machine # machine # Booting from ROM... machine # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 machine # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/3lmfc1zldxyw0jw2drgx7xcyrgcg4l39-nixos-system-machine-test/init regInfo=/nix/store/0kh1ascm9j48xmzjg0ryrz5hq1cvyzrs-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.000000] BIOS-provided physical RAM map: machine # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007ffd7fff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000007ffd8000-0x000000007fffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000017fffffff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved machine # [ 0.000000] NX (Execute Disable) protection: active machine # [ 0.000000] APIC: Static calls initialized machine # [ 0.000000] SMBIOS 2.8 present. machine # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 machine # [ 0.000000] DMI: Memory slots populated: 1/1 machine # [ 0.000000] Hypervisor detected: KVM machine # [ 0.000000] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 machine # [ 0.000000] kvm-clock: using sched offset of 516422829 cycles machine # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns machine # [ 0.000005] tsc: Detected 2400.012 MHz processor machine # [ 0.000811] last_pfn = 0x180000 max_arch_pfn = 0x10000000000 machine # [ 0.000838] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs machine # [ 0.000840] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT machine # [ 0.000880] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.002735] found SMP MP-table at [mem 0x000f5450-0x000f545f] machine # [ 0.002747] Using GB pages for direct mapping machine # [ 0.002838] RAMDISK: [mem 0x7e371000-0x7ffcffff] machine # [ 0.002848] ACPI: Early table checksum verification disabled machine # [ 0.002850] ACPI: RSDP 0x00000000000F5250 000014 (v00 BOCHS ) machine # [ 0.002855] ACPI: RSDT 0x000000007FFE2539 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002859] ACPI: FACP 0x000000007FFE2319 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002865] ACPI: DSDT 0x000000007FFE0040 0022D9 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002867] ACPI: FACS 0x000000007FFE0000 000040 machine # [ 0.002869] ACPI: APIC 0x000000007FFE240D 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002870] ACPI: HPET 0x000000007FFE249D 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002872] ACPI: MCFG 0x000000007FFE24D5 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002874] ACPI: WAET 0x000000007FFE2511 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002875] ACPI: Reserving FACP table memory at [mem 0x7ffe2319-0x7ffe240c] machine # [ 0.002876] ACPI: Reserving DSDT table memory at [mem 0x7ffe0040-0x7ffe2318] machine # [ 0.002877] ACPI: Reserving FACS table memory at [mem 0x7ffe0000-0x7ffe003f] machine # [ 0.002877] ACPI: Reserving APIC table memory at [mem 0x7ffe240d-0x7ffe249c] machine # [ 0.002878] ACPI: Reserving HPET table memory at [mem 0x7ffe249d-0x7ffe24d4] machine # [ 0.002878] ACPI: Reserving MCFG table memory at [mem 0x7ffe24d5-0x7ffe2510] machine # [ 0.002878] ACPI: Reserving WAET table memory at [mem 0x7ffe2511-0x7ffe2538] machine # [ 0.003117] No NUMA configuration found machine # [ 0.003118] Faking a node at [mem 0x0000000000000000-0x000000017fffffff] machine # [ 0.003120] NODE_DATA(0) allocated [mem 0x17fffa780-0x17ffffcff] machine # [ 0.005363] Zone ranges: machine # [ 0.005364] DMA [mem 0x0000000000001000-0x0000000000ffffff] machine # [ 0.005365] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] machine # [ 0.005366] Normal [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005367] Device empty machine # [ 0.005368] Movable zone start for each node machine # [ 0.005369] Early memory node ranges machine # [ 0.005369] node 0: [mem 0x0000000000001000-0x000000000009efff] machine # [ 0.005370] node 0: [mem 0x0000000000100000-0x000000007ffd7fff] machine # [ 0.005371] node 0: [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005372] Initmem setup node 0 [mem 0x0000000000001000-0x000000017fffffff] machine # [ 0.005391] On node 0, zone DMA: 1 pages in unavailable ranges machine # [ 0.005654] On node 0, zone DMA: 97 pages in unavailable ranges machine # [ 0.075229] On node 0, zone Normal: 40 pages in unavailable ranges machine # [ 0.075721] ACPI: PM-Timer IO Port: 0x608 machine # [ 0.075737] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) machine # [ 0.075772] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 machine # [ 0.075775] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) machine # [ 0.075776] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) machine # [ 0.075778] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) machine # [ 0.075779] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) machine # [ 0.075779] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) machine # [ 0.075782] ACPI: Using ACPI (MADT) for SMP configuration information machine # [ 0.075783] ACPI: HPET id: 0x8086a201 base: 0xfed00000 machine # [ 0.075788] TSC deadline timer available machine # [ 0.075793] CPU topo: Max. logical packages: 1 machine # [ 0.075793] CPU topo: Max. logical dies: 1 machine # [ 0.075794] CPU topo: Max. dies per package: 1 machine # [ 0.075797] CPU topo: Max. threads per core: 1 machine # [ 0.075798] CPU topo: Num. cores per package: 4 machine # [ 0.075798] CPU topo: Num. threads per package: 4 machine # [ 0.075798] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs machine # [ 0.075824] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() machine # [ 0.075840] kvm-guest: KVM setup pv remote TLB flush machine # [ 0.075843] kvm-guest: setup PV sched yield machine # [ 0.075853] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] machine # [ 0.075855] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] machine # [ 0.075856] PM: hibernation: Registered nosave memory: [mem 0x7ffd8000-0xffffffff] machine # [ 0.075857] [mem 0xc0000000-0xfed1bfff] available for PCI devices machine # [ 0.075859] Booting paravirtualized kernel on KVM machine # [ 0.075863] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns machine # [ 0.080370] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 machine # [ 0.082516] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288 machine # [ 0.082569] kvm-guest: PV spinlocks enabled machine # [ 0.082571] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) machine # [ 0.082573] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/3lmfc1zldxyw0jw2drgx7xcyrgcg4l39-nixos-system-machine-test/init regInfo=/nix/store/0kh1ascm9j48xmzjg0ryrz5hq1cvyzrs-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.082671] Unknown kernel command line parameters "regInfo=/nix/store/0kh1ascm9j48xmzjg0ryrz5hq1cvyzrs-closure-info/registration", will be passed to user space. machine # [ 0.082684] random: crng init done machine # [ 0.082685] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes machine # [ 0.087074] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) machine # [ 0.089183] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) machine # [ 0.089254] software IO TLB: area num 4. machine # [ 0.161795] Fallback order for Node 0: 0 machine # [ 0.161803] Built 1 zonelists, mobility grouping on. Total pages: 1048438 machine # [ 0.161805] Policy zone: Normal machine # [ 0.164472] mem auto-init: stack:all(zero), heap alloc:on, heap free:off machine # [ 0.171347] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 machine # [ 0.180213] allocated 8388608 bytes of page_ext machine # [ 0.190210] ftrace: allocating 48787 entries in 192 pages machine # [ 0.190212] ftrace: allocated 192 pages with 2 groups machine # [ 0.191047] Dynamic Preempt: lazy machine # [ 0.191212] rcu: Preemptible hierarchical RCU implementation. machine # [ 0.191213] rcu: RCU event tracing is enabled. machine # [ 0.191213] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. machine # [ 0.191215] Trampoline variant of Tasks RCU enabled. machine # [ 0.191215] Rude variant of Tasks RCU enabled. machine # [ 0.191216] Tracing variant of Tasks RCU enabled. machine # [ 0.191217] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. machine # [ 0.191217] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 machine # [ 0.191238] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.191239] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.191240] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.195598] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16 machine # [ 0.195889] rcu: srcu_init: Setting srcu_struct sizes based on contention. machine # [ 0.195898] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns machine # [ 0.196003] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) machine # [ 0.199560] Console: colour VGA+ 80x25 machine # [ 0.199562] printk: legacy console [tty0] enabled machine # [ 0.231257] printk: legacy console [ttyS0] enabled machine # [ 0.343273] ACPI: Core revision 20250807 machine # [ 0.344213] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns machine # [ 0.345807] APIC: Switch to symmetric I/O mode setup machine # [ 0.346864] x2apic enabled machine # [ 0.347618] APIC: Switched APIC routing to: physical x2apic machine # [ 0.348603] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask() machine # [ 0.349907] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself() machine # [ 0.351436] kvm-guest: setup PV IPIs machine # [ 0.353065] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 machine # [ 0.354173] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.358549] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) machine # [ 0.360636] x86/cpu: User Mode Instruction Prevention (UMIP) activated machine # [ 0.361734] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 machine # [ 0.362547] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 machine # [ 0.363551] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto machine # [ 0.365545] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl machine # [ 0.366547] Transient Scheduler Attacks: Vulnerable: No microcode machine # [ 0.368547] Spectre V2 : Mitigation: Enhanced / Automatic IBRS machine # [ 0.369546] Speculative Return Stack Overflow: Mitigation: Safe RET machine # [ 0.370546] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization machine # [ 0.371555] Spectre V2 : Enabling IBPB for BPF machine # [ 0.372547] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier machine # [ 0.373547] active return thunk: srso_alias_return_thunk machine # [ 0.374569] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' machine # [ 0.375547] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' machine # [ 0.376546] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' machine # [ 0.377546] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' machine # [ 0.378546] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' machine # [ 0.379546] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' machine # [ 0.381425] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' machine # [ 0.382547] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 machine # [ 0.383546] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 machine # [ 0.384546] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 machine # [ 0.385546] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 machine # [ 0.386546] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 machine # [ 0.387546] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. machine # [ 0.417399] Freeing SMP alternatives memory: 44K machine # [ 0.418163] pid_max: default: 32768 minimum: 301 machine # [ 0.418655] LSM: initializing lsm=capability,landlock,yama,bpf,ima machine # [ 0.419651] landlock: Up and running. machine # [ 0.421035] Yama: becoming mindful. machine # [ 0.421760] LSM support for eBPF active machine # [ 0.422689] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.423619] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.426788] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) machine # [ 0.428108] Performance Events: Fam17h+ core perfctr, AMD PMU driver. machine # [ 0.428555] ... version: 2 machine # [ 0.429332] ... bit width: 48 machine # [ 0.429549] ... generic counters: 6 machine # [ 0.430317] ... generic bitmap: 000000000000003f machine # [ 0.430549] ... fixed-purpose counters: 0 machine # [ 0.431296] ... fixed-purpose bitmap: 0000000000000000 machine # [ 0.431549] ... value mask: 0000ffffffffffff machine # [ 0.432524] ... max period: 00007fffffffffff machine # [ 0.433309] ... global_ctrl mask: 000000000000003f machine # [ 0.433669] signal: max sigframe size: 3376 machine # [ 0.434489] rcu: Hierarchical SRCU implementation. machine # [ 0.435222] rcu: Max phase no-delay instances is 400. machine # [ 0.435731] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level machine # [ 0.441147] smp: Bringing up secondary CPUs ... machine # [ 0.441960] smpboot: x86: Booting SMP configuration: machine # [ 0.442552] .... node #0, CPUs: #1 #2 #3 machine # [ 0.445649] smp: Brought up 1 node, 4 CPUs machine # [ 0.447298] smpboot: Total of 4 processors activated (19200.09 BogoMIPS) machine # [ 0.448728] Memory: 3957748K/4193752K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 220848K reserved, 0K cma-reserved) machine # [ 0.450549] devtmpfs: initialized machine # [ 0.451755] x86/mm: Memory block size: 128MB machine # [ 0.454712] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.456626] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). machine # [ 0.457645] pinctrl core: initialized pinctrl subsystem machine # [ 0.458808] PM: RTC time: 04:11:32, date: 2026-09-23 machine # [ 0.462654] NET: Registered PF_NETLINK/PF_ROUTE protocol family machine # [ 0.464353] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations machine # [ 0.465560] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations machine # [ 0.467092] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations machine # [ 0.467562] audit: initializing netlink subsys (disabled) machine # [ 0.468576] audit: type=2000 audit(1790136693.033:1): state=initialized audit_enabled=0 res=1 machine # [ 0.468831] thermal_sys: Registered thermal governor 'fair_share' machine # [ 0.470550] thermal_sys: Registered thermal governor 'bang_bang' machine # [ 0.471549] thermal_sys: Registered thermal governor 'step_wise' machine # [ 0.472549] thermal_sys: Registered thermal governor 'user_space' machine # [ 0.473549] thermal_sys: Registered thermal governor 'power_allocator' machine # [ 0.474563] cpuidle: using governor menu machine # [ 0.476757] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 machine # [ 0.477848] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] machine # [ 0.478552] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry machine # [ 0.479563] PCI: Using configuration type 1 for base access machine # [ 0.480714] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. machine # [ 0.483602] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages machine # [ 0.484550] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page machine # [ 0.485549] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages machine # [ 0.486549] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page machine # [ 0.491434] ACPI: Added _OSI(Module Device) machine # [ 0.493555] ACPI: Added _OSI(Processor Device) machine # [ 0.495557] ACPI: Added _OSI(Processor Aggregator Device) machine # [ 0.504278] ACPI: 1 ACPI AML tables successfully acquired and loaded machine # [ 0.511860] ACPI: Interpreter enabled machine # [ 0.512568] ACPI: PM: (supports S0 S3 S4 S5) machine # [ 0.513400] ACPI: Using IOAPIC for interrupt routing machine # [ 0.515111] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug machine # [ 0.519555] PCI: Using E820 reservations for host bridge windows machine # [ 0.522199] ACPI: Enabled 2 GPEs in block 00 to 3F machine # [ 0.535836] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) machine # [ 0.538567] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] machine # [ 0.541801] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] machine # [ 0.545868] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] machine # [ 0.549726] PCI host bridge to bus 0000:00 machine # [ 0.551560] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] machine # [ 0.553553] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] machine # [ 0.555553] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] machine # [ 0.557553] pci_bus 0000:00: root bus resource [mem 0x80000000-0xafffffff window] machine # [ 0.560553] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] machine # [ 0.562553] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.565553] pci_bus 0000:00: root bus resource [bus 00-ff] machine # [ 0.567867] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint machine # [ 0.570052] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint machine # [ 0.582634] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] machine # [ 0.584561] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] machine # [ 0.585571] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] machine # [ 0.587011] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] machine # [ 0.592600] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.603589] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] machine # [ 0.605571] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] machine # [ 0.608610] pci 0000:00:02.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref] machine # [ 0.611570] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] machine # [ 0.615981] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.625576] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] machine # [ 0.628571] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] machine # [ 0.630609] pci 0000:00:03.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref] machine # [ 0.634957] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint machine # [ 0.642569] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] machine # [ 0.645566] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] machine # [ 0.647597] pci 0000:00:04.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref] machine # [ 0.651143] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.656587] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] machine # [ 0.657524] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] machine # [ 0.658369] pci 0000:00:05.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref] machine # [ 0.660555] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] machine # [ 0.662282] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint machine # [ 0.666183] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] machine # [ 0.667571] pci 0000:00:06.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref] machine # [ 0.669890] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.675594] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] machine # [ 0.677598] pci 0000:00:07.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref] machine # [ 0.681606] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.686565] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] machine # [ 0.702406] pci 0000:00:08.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref] machine # [ 0.704157] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.708592] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] machine # [ 0.709571] pci 0000:00:09.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref] machine # [ 0.711147] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint machine # [ 0.716684] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] machine # [ 0.718567] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] machine # [ 0.721610] pci 0000:00:0a.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref] machine # [ 0.726018] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.735588] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] machine # [ 0.737570] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] machine # [ 0.739610] pci 0000:00:0b.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref] machine # [ 0.745063] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.750184] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] machine # [ 0.753065] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.757633] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] machine # [ 0.759956] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.764637] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] machine # [ 0.766980] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint machine # [ 0.771296] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] machine # [ 0.774062] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint machine # [ 0.777167] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO machine # [ 0.778951] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint machine # [ 0.782905] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] machine # [ 0.785573] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] machine # [ 0.788427] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint machine # [ 0.794556] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] machine # [ 0.804599] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 machine # [ 0.806785] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 machine # [ 0.808757] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 machine # [ 0.811758] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 machine # [ 0.813753] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 machine # [ 0.815747] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 machine # [ 0.817741] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 machine # [ 0.819742] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 machine # [ 0.821646] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 machine # [ 0.823585] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 machine # [ 0.825564] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 machine # [ 0.826565] ACPI: PCI: Interrupt link GSID configured for IRQ 19 machine # [ 0.827562] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 machine # [ 0.828561] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 machine # [ 0.829560] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 machine # [ 0.830561] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 machine # [ 0.833910] iommu: Default domain type: Translated machine # [ 0.834181] iommu: DMA domain TLB invalidation policy: lazy mode machine # [ 0.835882] ACPI: bus type USB registered machine # [ 0.836622] usbcore: registered new interface driver usbfs machine # [ 0.838574] usbcore: registered new interface driver hub machine # [ 0.839499] usbcore: registered new device driver usb machine # [ 0.841189] NetLabel: Initializing machine # [ 0.842551] NetLabel: domain hash size = 128 machine # [ 0.843320] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO machine # [ 0.844734] NetLabel: unlabeled traffic allowed by default machine # [ 0.846667] PCI: Using ACPI for IRQ routing machine # [ 0.919581] pci 0000:00:01.0: vgaarb: setting as boot VGA device machine # [ 0.920545] pci 0000:00:01.0: vgaarb: bridge control possible machine # [ 0.920545] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none machine # [ 0.922553] vgaarb: loaded machine # [ 0.923375] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 machine # [ 0.924209] hpet0: 3 comparators, 64-bit 100.000000 MHz counter machine # [ 0.928819] clocksource: Switched to clocksource kvm-clock machine # [ 0.932053] VFS: Disk quotas dquot_6.6.0 machine # [ 0.932776] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) machine # [ 0.934504] pnp: PnP ACPI init machine # [ 0.935557] ACPI: IRQ 4 override to edge(!), high(!) machine # [ 0.936597] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved machine # [ 0.938302] pnp: PnP ACPI: found 5 devices machine # [ 0.947813] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns machine # [ 0.949424] clocksource: Switched to clocksource acpi_pm machine # [ 0.950471] NET: Registered PF_INET protocol family machine # [ 0.952121] IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear) machine # [ 0.969841] tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.971371] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) machine # [ 0.972852] TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear) machine # [ 0.974305] TCP bind hash table entries: 32768 (order: 8, 1048576 bytes, linear) machine # [ 0.975693] TCP: Hash tables configured (established 32768 bind 32768) machine # [ 0.977045] MPTCP token hash table entries: 4096 (order: 5, 98304 bytes, linear) machine # [ 0.978544] UDP hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.979878] UDP-Lite hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.981267] NET: Registered PF_UNIX/PF_LOCAL protocol family machine # [ 0.982331] NET: Registered PF_XDP protocol family machine # [ 0.983234] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] machine # [ 0.984303] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] machine # [ 0.985370] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] machine # [ 0.986545] pci_bus 0000:00: resource 7 [mem 0x80000000-0xafffffff window] machine # [ 0.987740] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] machine # [ 0.988899] pci_bus 0000:00: resource 9 [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.990891] ACPI: \_SB_.GSIA: Enabled at IRQ 16 machine # [ 0.993054] ACPI: \_SB_.GSIB: Enabled at IRQ 17 machine # [ 0.995321] ACPI: \_SB_.GSIC: Enabled at IRQ 18 machine # [ 0.997433] ACPI: \_SB_.GSID: Enabled at IRQ 19 machine # [ 0.999222] PCI: CLS 0 bytes, default 64 machine # [ 1.000126] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) machine # [ 1.000586] Trying to unpack rootfs image as initramfs... machine # [ 1.001243] software IO TLB: mapped [mem 0x000000007a371000-0x000000007e371000] (64MB) machine # [ 1.001377] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 1.024723] Initialise system trusted keyrings machine # [ 1.026003] workingset: timestamp_bits=40 max_order=20 bucket_order=0 machine # [ 1.037676] Key type asymmetric registered machine # [ 1.038444] Asymmetric key parser 'x509' registered machine # [ 1.039365] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) machine # [ 1.041179] io scheduler mq-deadline registered machine # [ 1.042017] io scheduler kyber registered machine # [ 1.047446] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled machine # [ 1.048834] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A machine # [ 1.051343] Linux agpgart interface v0.103 machine # [ 1.052171] ACPI: bus type drm_connector registered machine # [ 1.055454] usbcore: registered new interface driver usbserial_generic machine # [ 1.056617] usbserial: USB Serial support registered for generic machine # [ 1.057696] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. machine # [ 1.057696] Please enable it if your BIOS has the CPPC option. machine # [ 1.060050] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled machine # [ 1.061532] drop_monitor: Initializing network drop monitor service machine # [ 1.062783] NET: Registered PF_INET6 protocol family machine # [ 1.064387] Segment Routing with IPv6 machine # [ 1.065116] In-situ OAM (IOAM) with IPv6 machine # [ 1.067227] IPI shorthand broadcast: enabled machine # [ 1.071589] sched_clock: Marking stable (917011126, 153648027)->(1091538503, -20879350) machine # [ 1.073477] registered taskstats version 1 machine # [ 1.074535] Loading compiled-in X.509 certificates machine # [ 1.084377] Demotion targets for Node 0: null machine # [ 1.085662] Key type .fscrypt registered machine # [ 1.086395] Key type fscrypt-provisioning registered machine # [ 1.087418] ima: No TPM chip found, activating TPM-bypass! machine # [ 1.088384] ima: Allocated hash algorithm: sha1 machine # [ 1.089245] ima: No architecture policies found machine # [ 1.090396] PM: Magic number: 10:784:161 machine # [ 1.092091] RAS: Correctable Errors collector initialized. machine # [ 1.096637] clk: Disabling unused clocks machine # [ 1.097385] PM: genpd: Disabling unused power domains machine # [ 1.281893] Freeing initrd memory: 29052K machine # [ 1.289179] Freeing unused decrypted memory: 2028K machine # [ 1.295568] Freeing unused kernel image (initmem) memory: 3652K machine # [ 1.298286] Write protecting the kernel read-only data: 32768k machine # [ 1.303090] Freeing unused kernel image (text/rodata gap) memory: 1184K machine # [ 1.306890] Freeing unused kernel image (rodata/data gap) memory: 720K machine # [ 1.375122] x86/mm: Checked W+X mappings: passed, no W+X pages found. machine # [ 1.376276] Run /init as init process machine # [ 1.389129] systemd[1]: Inserted module 'autofs4' machine # [ 1.417227] fuse: init (API version 7.45) machine # [ 1.426008] ACPI: \_SB_.GSIG: Enabled at IRQ 22 machine # [ 1.428765] ACPI: \_SB_.GSIH: Enabled at IRQ 23 machine # [ 1.432002] ACPI: \_SB_.GSIE: Enabled at IRQ 20 machine # [ 1.434259] ACPI: \_SB_.GSIF: Enabled at IRQ 21 machine # [ 1.439761] virtiofs virtio5: discovered new tag: nix-store machine # [ 1.441381] virtiofs virtio5: virtio_fs_setup_dax: No cache capability machine # [ 1.448042] virtiofs virtio6: discovered new tag: shared machine # [ 1.460975] virtiofs virtio6: virtio_fs_setup_dax: No cache capability machine # [ 1.464417] virtiofs virtio7: discovered new tag: xchg machine # [ 1.465944] virtiofs virtio7: virtio_fs_setup_dax: No cache capability machine # [ 1.490043] systemd[1]: Successfully made /usr/ read-only. machine # [ 1.826858] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 1.839368] systemd[1]: Detected virtualization kvm. machine # [ 1.841584] systemd[1]: Detected architecture x86-64. machine # [ 1.843794] systemd[1]: Running in initrd. machine # [ 1.846267] systemd[1]: Initializing machine ID from random generator. machine # [ 1.849260] systemd[1]: Hostname set to . machine # [ 1.968011] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 2.009271] systemd[1]: Queued start job for default target Initrd Default Target. machine # [ 2.020227] systemd[1]: Created slice Slice /system/modprobe. machine # [ 2.021454] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 2.022925] systemd[1]: Expecting device /dev/disk/by-label/nixos... machine # [ 2.024081] systemd[1]: Reached target Path Units. machine # [ 2.024993] systemd[1]: Reached target Slice Units. machine # [ 2.025930] systemd[1]: Reached target Swaps. machine # [ 2.026749] systemd[1]: Reached target Timer Units. machine # [ 2.027764] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 2.028978] systemd[1]: Listening on Journal Socket (/dev/log). machine # [ 2.030161] systemd[1]: Listening on Journal Sockets. machine # [ 2.031209] systemd[1]: Listening on udev Control Socket. machine # [ 2.032270] systemd[1]: Listening on udev Kernel Socket. machine # [ 2.033267] systemd[1]: Reached target Socket Units. machine # [ 2.035304] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 2.037390] systemd[1]: Starting Load Kernel Module configfs... machine # [ 2.040365] systemd[1]: Starting Journal Service... machine # [ 2.043732] systemd[1]: Starting Load Kernel Modules... machine # [ 2.044754] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 2.050524] systemd[1]: Starting Coldplug All udev Devices... machine # [ 2.055282] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 2.056952] systemd[1]: Finished Load Kernel Module configfs. machine # [ 2.058875] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 2.060302] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config machine # [ 2.063751] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 2.073903] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 2.077034] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 2.083840] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. machine # [ 2.084601] systemd-journald[91]: Collecting audit messages is disabled. machine # [ 2.086825] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev machine # [ 2.093797] systemd[1]: Finished Load Kernel Modules. machine # [ 2.096010] systemd[1]: Starting Apply Kernel Variables... machine # [ 2.107283] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 2.108620] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 2.109893] systemd[1]: Reached target Local File Systems. machine # [ 2.112803] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 2.114797] systemd[1]: Finished Apply Kernel Variables. machine # [ 2.126465] systemd[1]: Started Journal Service. machine # [ 1.972912] systemd-modules-load[92]: Using 4 probe threads machine # [ 1.974956] systemd-modules-load[92]: Inserted module 'virtio_balloon' machine # [ 1.976072] systemd-modules-load[92]: Inserted module 'dm_mod' machine # [ 1.977103] systemd-modules-load[92]: Inserted module 'virtio_gpu' machine # [ 1.979953] systemd[1]: Starting Create System Files and Directories... machine # [ 1.981469] systemd-udevd[103]: Using default interface naming scheme 'v261'. machine # [ 1.992315] systemd[1]: Finished Create System Files and Directories. machine # [ 1.993580] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 2.029695] systemd[1]: Finished Coldplug All udev Devices. machine # [ 2.031255] systemd[1]: Reached target System Initialization. machine # [ 2.032865] systemd[1]: Reached target Basic System. machine # [ 2.268064] virtio_blk virtio2: 4/0/0 default/read/poll queues machine # [ 2.273552] uhci_hcd 0000:00:1d.0: UHCI Host Controller machine # [ 2.274478] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 1 machine # [ 2.275857] uhci_hcd 0000:00:1d.0: detected 2 ports machine # [ 2.278134] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 machine # [ 2.279275] virtio_blk virtio2: [vda] 33554432 512-byte logical blocks (17.2 GB/16.0 GiB) machine # [ 2.279294] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.282992] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.283454] SCSI subsystem initialized machine # [ 2.284305] usb usb1: Product: UHCI Host Controller machine # [ 2.284308] usb usb1: Manufacturer: Linux 6.18.52 uhci_hcd machine # [ 2.284309] usb usb1: SerialNumber: 0000:00:1d.0 machine # [ 2.289043] hub 1-0:1.0: USB hub found machine # [ 2.290182] hub 1-0:1.0: 2 ports detected machine # [ 2.293738] ehci-pci 0000:00:1d.7: EHCI Host Controller machine # [ 2.294614] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 2 machine # [ 2.295996] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 machine # [ 2.302756] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 machine # [ 2.303718] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 machine # [ 2.304891] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.306054] usb usb2: Product: EHCI Host Controller machine # [ 2.306778] usb usb2: Manufacturer: Linux 6.18.52 ehci_hcd machine # [ 2.307562] usb usb2: SerialNumber: 0000:00:1d.7 machine # [ 2.308450] hub 2-0:1.0: USB hub found machine # [ 2.309081] hub 2-0:1.0: 6 ports detected machine # [ 2.172544] systemd[1]: Starting Virtual Console Setup... machine # [ 2.330786] hub 1-0:1.0: USB hub found machine # [ 2.331385] hub 1-0:1.0: 2 ports detected machine # [ 2.332269] uhci_hcd 0000:00:1d.1: UHCI Host Controller machine # [ 2.335825] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 machine # [ 2.337074] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 machine # [ 2.185102] (udev-worker)[129]: Network interface NamePolicy= disabled on kernel command line. machine # [ 2.340088] uhci_hcd 0000:00:1d.1: detected 2 ports machine # [ 2.341110] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 machine # [ 2.189138] (udev-worker)[114]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface[ 2.344195] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # name. machine # [ 2.345949] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.347162] usb usb3: Product: UHCI Host Controller machine # [ 2.194030] (udev-worker)[114]: Network inter[ 2.347953] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd machine # face NamePolicy= disabled on kernel command line[ 2.349211] usb usb3: SerialNumber: 0000:00:1d.1 machine # . machine # [ 2.350713] hub 3-0:1.0: USB hub found machine # [ 2.351418] hub 3-0:1.0: 2 ports detected machine # [ 2.356764] serio: i8042 KBD port at 0x60,0x64 irq 1 machine # [ 2.359697] uhci_hcd 0000:00:1d.2: UHCI Host Controller machine # [ 2.360815] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 machine # [ 2.362035] serio: i8042 AUX port at 0x60,0x64 irq 12 machine # [ 2.362356] uhci_hcd 0000:00:1d.2: detected 2 ports machine # [ 2.363864] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 machine # [ 2.364725] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.209256] systemd-vconsole-setup[143]: Configuration of first virtual console was [ 2.366629] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # skipped, ignoring remaining ones. machine # [ 2.367958] usb usb4: Product: UHCI Host Controller machine # [ 2.215626] systemd[1]: Finished Virtual Console Setup. machine # [ 2.369485] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd machine # [ 2.370765] usb usb4: SerialNumber: 0000:00:1d.2 machine # [ 2.219125] systemd[1]: Found device /dev/disk/by-label/nixos. machine # [ 2.373252] hub 4-0:1.0: USB hub found machine # [ 2.220216] systemd[1]: Reached target Initrd[ 2.374251] hub 4-0:1.0: 2 ports detected machine # Root Device. machine # [ 2.223792] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... machine # [ 2.378846] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 machine # [ 2.384487] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode machine # [ 2.385807] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) machine # [ 2.386720] ahci 0000:00:1f.2: flags: 64bit ncq only machine # [ 2.392469] scsi host0: ahci machine # [ 2.394112] scsi host1: ahci machine # [ 2.395224] scsi host2: ahci machine # [ 2.396001] scsi host3: ahci machine # [ 2.396787] scsi host4: ahci machine # [ 2.397817] scsi host5: ahci machine # [ 2.398609] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 50 lpm-pol 1 machine # [ 2.400288] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 50 lpm-pol 1 machine # [ 2.401750] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 50 lpm-pol 1 machine # [ 2.403137] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 50 lpm-pol 1 machine # [ 2.251189] systemd-fsck[163]: nixos: clean, 12/1048576 files, 109865/4194304 blocks machine # [ 2.405744] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 50 lpm-pol 1 machine # [ 2.407289] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 50 lpm-pol 1 machine # [ 2.256388] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. machine # [ 2.551018] usb 2-1: new high-speed USB device number 2 using ehci-pci machine # [ 2.682256] usb 2-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 machine # [ 2.685313] usb 2-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 machine # [ 2.688044] usb 2-1: Product: QEMU USB Tablet machine # [ 2.689691] usb 2-1: Manufacturer: QEMU machine # [ 2.691182] usb 2-1: SerialNumber: 28754-0000:00:1d.7-1 machine # [ 2.724843] ata1: SATA link down (SStatus 0 SControl 300) machine # [ 2.728834] hid: raw HID events driver (C) Jiri Kosina machine # [ 2.732885] ata5: SATA link down (SStatus 0 SControl 300) machine # [ 2.735207] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) machine # [ 2.737847] ata6: SATA link down (SStatus 0 SControl 300) machine # [ 2.740165] ata4: SATA link down (SStatus 0 SControl 300) machine # [ 2.742462] ata2: SATA link down (SStatus 0 SControl 300) machine # [ 2.744626] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 machine # [ 2.746635] ata3.00: applying bridge limits machine # [ 2.748495] ata3.00: configured for UDMA/100 machine # [ 2.751124] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 machine # [ 2.783185] usbcore: registered new interface driver usbhid machine # [ 2.785311] usbhid: USB HID core driver machine # [ 2.795987] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb2/2-1/2-1:1.0/0003:0627:0001.0001/input/input2 machine # [ 2.800027] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 machine # [ 2.814217] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray machine # [ 2.859130] cdrom: Uniform CD-ROM driver Revision: 3.20 machine # [ 2.901636] systemd[1]: Mounting /sysroot... machine # [ 3.199767] EXT4-fs (vda): mounted filesystem 58c33886-534d-4428-8733-6b8fe9eb2f9b r/w with ordered data mode. Quota mode: none. machine # [ 3.052399] systemd[1]: Mounted /sysroot. machine # [ 3.054278] systemd[1]: Reached target Initrd Root File System. machine # [ 3.056458] systemd[1]: Mounting /sysroot/nix/.ro-store... machine # [ 3.058423] systemd[1]: Mounting /sysroot/nix/.rw-store... machine # [ 3.060399] systemd[1]: Mounting /sysroot/run... machine # [ 3.063554] systemd[1]: Mounting /sysroot/tmp/shared... machine # [ 3.078309] systemd[1]: Mounting /sysroot/tmp/xchg... machine # [ 3.083623] systemd[1]: Starting Mountpoints Configured in the Real Root... machine # [ 3.086430] systemd[1]: Mounted /sysroot/nix/.rw-store. machine # [ 3.088257] systemd[1]: Mounted /sysroot/run. machine # [ 3.092720] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.095093] systemd[1]: Mounted /sysroot/nix/.ro-store. machine # [ 3.097039] systemd[1]: Mounted /sysroot/tmp/shared. machine # [ 3.098606] systemd[1]: Mounted /sysroot/tmp/xchg. machine # [ 3.100857] systemd-sysroot-fstab-check[192]: /sysroot should be mounted in the initrd, will request daemon-reload. machine # [ 3.103592] systemd[1]: Reload requested from client PID 192 ('systemd-sysroot') (unit initrd-parse-etc.service)... machine # [ 3.106285] systemd[1]: Reloading... machine # [ 3.155305] systemd[1]: Reloading finished in 52 ms. machine # [ 3.181291] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.183798] systemd-sysroot-fstab-check[192]: Requesting initrd-fs.target/start/replace... machine # [ 3.186533] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.188531] systemd-sysroot-fstab-check[192]: Requesting swap.target/start/replace... machine # [ 3.191347] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.193353] systemd[1]: initrd-parse-etc.service: Deactivated successfully. machine # [ 3.195654] systemd[1]: Finished Mountpoints Configured in the Real Root. machine # [ 3.197942] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. machine # [ 3.203827] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.206262] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.902225] systemd[1]: Mounting /sysroot/nix/store... machine # [ 3.954704] systemd[1]: Mounted /sysroot/nix/store. machine # [ 3.956610] systemd[1]: Reached target Initrd File Systems. machine # [ 3.958813] systemd[1]: Starting Find NixOS closure... machine # [ 3.960583] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... machine # [ 3.994718] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. machine # [ 3.997653] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. machine # [ 4.009133] systemd[1]: Finished Find NixOS closure. machine # [ 4.010917] systemd[1]: Reached target Initrd Default Target. machine # [ 4.012868] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... machine # [ 4.040061] systemd[1]: Stopped target Initrd Default Target. machine # [ 4.042119] systemd[1]: Stopped target Basic System. machine # [ 4.043826] systemd[1]: Stopped target Initrd Root Device. machine # [ 4.045632] systemd[1]: Stopped target Path Units. machine # [ 4.047304] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. machine # [ 4.050214] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. machine # [ 4.055442] systemd[1]: Stopped target Slice Units. machine # [ 4.059836] systemd[1]: Stopped target Socket Units. machine # [ 4.063058] systemd[1]: Stopped target System Initialization. machine # [ 4.065389] systemd[1]: Stopped target Swaps. machine # [ 4.067203] systemd[1]: Stopped target Timer Units. machine # [ 4.070469] systemd[1]: dbus.socket: Deactivated successfully. machine # [ 4.072697] systemd[1]: Closed D-Bus System Message Bus Socket. machine # [ 4.074778] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. machine # [ 4.077226] systemd[1]: Stopped Find NixOS closure. machine # [ 4.078888] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 4.080825] systemd[1]: systemd-sysctl.service: Deactivated successfully. machine # [ 4.082586] systemd[1]: Stopped Apply Kernel Variables. machine # [ 4.083968] systemd[1]: systemd-modules-load.service: Deactivated successfully. machine # [ 4.085933] systemd[1]: Stopped Load Kernel Modules. machine # [ 4.087295] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. machine # [ 4.089322] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. machine # [ 4.091294] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. machine # [ 4.093176] systemd[1]: Stopped Create System Files and Directories. machine # [ 4.094875] systemd[1]: Stopped target Local File Systems. machine # [ 4.096336] systemd[1]: Stopped target Preparation for Local File Systems. machine # [ 4.098147] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. machine # [ 4.100081] systemd[1]: Stopped Coldplug All udev Devices. machine # [ 4.101429] systemd[1]: Stopping Rule-based Manager for Device Events and Files... machine # [ 4.102748] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 4.103732] systemd[1]: Stopped Virtual Console Setup. machine # [ 4.104438] systemd[1]: initrd-cleanup.service: Deactivated successfully. machine # [ 4.105313] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. machine # [ 4.106194] systemd[1]: systemd-udevd.service: Deactivated successfully. machine # [ 4.107102] systemd[1]: Stopped Rule-based Manager for Device Events and Files. machine # [ 4.108085] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. machine # [ 4.109058] systemd[1]: Closed udev Control Socket. machine # [ 4.109778] systemd[1]: Starting Cleanup udev Database... machine # [ 4.110540] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. machine # [ 4.111531] systemd[1]: Stopped Create Static Device Nodes in /dev. machine # [ 4.112317] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. machine # [ 4.113332] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. machine # [ 4.114293] systemd[1]: kmod-static-nodes.service: Deactivated successfully. machine # [ 4.115193] systemd[1]: Stopped Create List of Static Device Nodes. machine # [ 4.116103] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 4.117077] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 4.118860] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. machine # [ 4.119872] systemd[1]: Finished Cleanup udev Database. machine # [ 4.121055] systemd[1]: Reached target Switch Root. machine # [ 4.123276] systemd[1]: Starting NixOS Activation... machine # [ 4.261504] initrd-nixos-activation-start[240]: booting system configuration /nix/store/3lmfc1zldxyw0jw2drgx7xcyrgcg4l39-nixos-system-machine-test machine # [ 4.319251] initrd-nixos-activation-start[240]: running activation script... machine # [ 4.627128] initrd-nixos-activation-start[263]: setting up /etc... machine # [ 4.792997] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. machine # [ 4.795807] systemd[1]: Finished NixOS Activation. machine # [ 4.797606] systemd[1]: Starting Switch Root... machine # [ 4.819332] systemd[1]: Switching root. machine # [ 5.037084] systemd-journald[91]: Received SIGTERM from PID 1 (systemd). machine # [ 5.160441] NET: Registered PF_VSOCK protocol family machine # [ 5.557906] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 5.568202] systemd[1]: Detected virtualization kvm. machine # [ 5.570264] systemd[1]: Detected architecture x86-64. machine # [ 5.572322] systemd[1]: Detected first boot. machine # [ 5.577426] systemd[1]: Initializing machine ID from random generator. machine # [ 5.722621] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 5.801857] systemd[1]: Applying preset policy. machine # [ 6.018609] systemd[1]: Populated /etc with preset unit settings. machine # [ 6.297513] systemd[1]: initrd-switch-root.service: Deactivated successfully. machine # [ 6.299009] systemd[1]: Stopped initrd-switch-root.service. machine # [ 6.301313] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. machine # [ 6.303529] systemd[1]: Created slice Slice /system/getty. machine # [ 6.304979] systemd[1]: Created slice User and Session Slice. machine # [ 6.305976] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 6.307248] systemd[1]: Started Forward Password Requests to Wall Directory Watch. machine # [ 6.308523] systemd[1]: Expecting device /dev/hvc0... machine # [ 6.309427] systemd[1]: Expecting device /dev/ttyS0... machine # [ 6.310299] systemd[1]: Reached target Local Encrypted Volumes. machine # [ 6.311207] systemd[1]: Stopped target initrd-fs.target. machine # [ 6.312052] systemd[1]: Stopped target initrd-root-fs.target. machine # [ 6.312926] systemd[1]: Stopped target initrd-switch-root.target. machine # [ 6.313814] systemd[1]: Reached target Virtual Machines and Containers. machine # [ 6.314784] systemd[1]: Reached target Path Units. machine # [ 6.315551] systemd[1]: Reached target Remote File Systems. machine # [ 6.316423] systemd[1]: Reached target Slice Units. machine # [ 6.317191] systemd[1]: Reached target Swaps. machine # [ 6.319394] systemd[1]: Listening on Query the User Interactively for a Password. machine # [ 6.322160] systemd[1]: Listening on Process Core Dump Socket. machine # [ 6.325610] systemd[1]: Listening on Credential Encryption/Decryption. machine # [ 6.330717] systemd[1]: Listening on Factory Reset Management. machine # [ 6.333086] systemd[1]: Listening on Hostname Service Socket. machine # [ 6.340199] systemd[1]: Starting Journal Log Access Socket... machine # [ 6.343250] systemd[1]: Listening on Journal Audit Socket. machine # [ 6.347883] systemd[1]: Listening on Console Output Muting Service Socket. machine # [ 6.350864] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. machine # [ 6.353830] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.357359] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki machine # [ 6.367367] systemd[1]: Listening on Disk Repartitioning Service Socket. machine # [ 6.370095] systemd[1]: Listening on udev Control Socket. machine # [ 6.372436] systemd[1]: Listening on udev Varlink Socket. machine # [ 6.377890] systemd[1]: Mounting Huge Pages File System... machine # [ 6.381979] systemd[1]: Mounting POSIX Message Queue File System... machine # [ 6.386362] systemd[1]: Mounting Kernel Debug File System... machine # [ 6.395233] systemd[1]: Mounting Kernel Trace File System... machine # [ 6.398120] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 6.400396] systemd[1]: Starting Load Kernel Module configfs... machine # [ 6.401400] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm machine # [ 6.402923] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.404646] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.407859] systemd[1]: Mounting FUSE Control File System... machine # [ 6.408829] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.416014] systemd[1]: Starting Journal Service... machine # [ 6.421897] systemd[1]: Starting Load Kernel Modules... machine # [ 6.424671] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... machine # [ 6.427936] systemd[1]: Starting Remount Root and Kernel File Systems... machine # [ 6.429077] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.432723] systemd[1]: Starting Coldplug All udev Devices... machine # [ 6.435094] systemd[1]: Listening on Journal Log Access Socket. machine # [ 6.436415] systemd[1]: Mounted Huge Pages File System. machine # [ 6.439953] systemd[1]: Mounted POSIX Message Queue File System. machine # [ 6.441193] systemd[1]: Mounted Kernel Debug File System. machine # [ 6.443500] systemd[1]: Mounted Kernel Trace File System. machine # [ 6.447942] systemd[1]: Mounted FUSE Control File System. machine # [ 6.454699] systemd-journald[335]: Collecting audit messages is enabled. machine # [ 6.454986] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 6.457195] systemd[1]: Finished Load Kernel Module configfs. machine # [ 6.460305] systemd[1]: Mounting Kernel Configuration File System... machine # [ 6.462305] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 6.470689] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 6.317935] systemd[1]: Queued start job for default target M[ 6.472062] systemd[1]: Started Journal Service. machine # ulti-User System. machine # [ 6.323157] systemd[1]: systemd-journald.service: Deactivated successfully. machine # [ 6.324549] systemd-modules-load[336]: Using 2 probe threads machine # [ 6.331478] s[ 6.484883] EXT4-fs (vda): re-mounted 58c33886-534d-4428-8733-6b8fe9eb2f9b. machine # ystemd[1]: Mounted Kernel Configuration File System. machine # [ 6.337350] systemd[1]: Finished Remount Root and Kernel File Systems. machine # [ 6.338364] systemd[1]: Listening on Disk Image Download Service Socket.[ 6.492417] loop: module loaded machine # machine # [ 6.339736] systemd[1]: Starting Flush Journal to Persistent Storage... machine # [ 6.340778] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.342532] systemd-modules-load[336]: Inserted module 'loop' machine # [ 6.343467] systemd[1]: Starting Load/Save OS Random Seed... machine # [ 6.344468] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.345772] systemd[1]: Finished Load Kernel Modules. machine # [ 6.346831] systemd-oomd[338]: No swap; memory pressure usage will be degraded machine # [ 6.348667] systemd[1]: Starting Apply Kernel Variables... machine # [ 6.349730] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. machine # [ 6.523927] systemd-journald[335]: Received client request to flush runtime journal. machine # [ 6.429410] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 6.430836] systemd[1]: Finished Apply Kernel Variables. machine # [ 6.432219] systemd[1]: Finished Load/Save OS Random Seed. machine # [ 6.433061] systemd[1]: Reached target First Boot Complete. machine # [ 6.433920] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 6.434862] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 6.435748] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 6.436795] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 6.437815] systemd[1]: Finished Flush Journal to Persistent Storage. machine # [ 6.457197] systemd-udevd[365]: Using default interface naming scheme 'v261'. machine # [ 6.460517] systemd[1]: Finished Coldplug All udev Devices. machine # [ 6.492323] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 6.566181] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.583577] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. machine # [ 6.597386] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. machine # [ 6.607957] (udev-worker)[373]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 6.611913] (udev-worker)[373]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.626549] (udev-worker)[394]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.628973] systemd[1]: Condition check resulted in Virtio network device being skipped. machine # [ 6.630191] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.631824] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.634139] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.635805] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.637130] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.809410] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 machine # [ 6.815823] ACPI: button: Power Button [PWRF] machine # [ 6.822212] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console machine # [ 6.848100] Console: switching to colour dummy device 80x25 machine # [ 6.848884] [drm] Found bochs VGA, ID 0xb0c5. machine # [ 6.848886] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. machine # [ 6.852809] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic machine # [ 6.853579] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 machine # [ 6.855738] mousedev: PS/2 mouse device common for all mice machine # [ 6.865454] Console: switching to colour frame buffer device 160x50 machine # [ 6.867177] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device machine # [ 6.868412] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 machine # [ 6.869863] rtc_cmos PNP0B00:00: RTC can wake from S4 machine # [ 6.869927] parport_pc 00:02: reported by Plug and Play ACPI machine # [ 6.871401] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] machine # [ 6.872056] rtc_cmos PNP0B00:00: registered as rtc0 machine # [ 6.873022] rtc_cmos PNP0B00:00: setting system clock to 2026-09-23T04:11:39 UTC (1790136699) machine # [ 6.874946] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs machine # [ 6.880863] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized machine # [ 6.907717] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 machine # [ 6.910198] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 machine # [ 6.915564] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt machine # [ 6.917126] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD machine # [ 6.785712] systemd[1]: Starting Virtual Console Setup... machine # [ 6.953315] ppdev: user-space parallel port driver machine # [ 6.825063] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 6.826205] systemd[1]: Stopped Virtual Console Setup. machine # [ 6.834590] systemd[1]: Starting Virtual Console Setup... machine # [ 7.013250] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) machine # [ 7.014519] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) machine # [ 7.039658] kvm_amd: TSC scaling supported machine # [ 7.040194] kvm_amd: Nested Virtualization enabled machine # [ 7.040774] kvm_amd: Nested Paging enabled machine # [ 7.041238] kvm_amd: LBR virtualization supported machine # [ 7.041783] kvm_amd: Virtual VMLOAD VMSAVE supported machine # [ 7.042342] kvm_amd: Virtual GIF supported machine # [ 7.042844] kvm_amd: Virtual NMI enabled machine # [ 7.132964] EDAC MC: Ver: 3.0.0 machine # [ 7.030772] systemd-vconsole-setup[410]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 7.033777] systemd[1]: Finished Virtual Console Setup. machine # [ 7.147199] systemd[1]: Mounting /run/wrappers... machine # [ 7.188355] systemd[1]: Mounted /run/wrappers. machine # [ 7.190162] systemd[1]: Reached target Local File Systems. machine # [ 7.192151] systemd[1]: Listening on Boot Loader Control Service Socket. machine # [ 7.195074] systemd[1]: Starting register-nix-paths.service... machine # [ 7.197914] systemd[1]: Starting Create SUID/SGID Wrappers... machine # [ 7.200397] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. machine # [ 7.203465] systemd[1]: Starting Save Transient machine-id to Disk... machine # [ 7.205791] systemd[1]: Starting Create System Files and Directories... machine # [ 7.281774] systemd[1]: Finished Create System Files and Directories. machine # [ 7.283193] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. machine # [ 7.284385] systemd[1]: Finished Save Transient machine-id to Disk. machine # [ 7.288104] systemd[1]: Starting Rebuild Journal Catalog... machine # [ 7.289369] systemd[1]: Starting Record System Boot/Shutdown in UTMP... machine # [ 7.315429] systemd[1]: Finished Record System Boot/Shutdown in UTMP. machine # [ 7.332134] systemd[1]: Finished Rebuild Journal Catalog. machine # [ 7.334666] systemd[1]: Starting Update is Completed... machine # [ 7.358111] systemd[1]: Finished Update is Completed. machine # [ 7.482280] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. machine # [ 7.483783] systemd[1]: Finished Create SUID/SGID Wrappers. machine # [ 7.736340] systemd[1]: Finished register-nix-paths.service. machine # [ 7.737811] systemd[1]: Reached target System Initialization. machine # [ 7.739210] systemd[1]: Started Discard unused filesystem blocks once a week. machine # [ 7.740717] systemd[1]: Started niks3 garbage collection timer. machine # [ 7.742169] systemd[1]: Started Daily Cleanup of Temporary Directories. machine # [ 7.743509] systemd[1]: Reached target Timer Units. machine # [ 7.744647] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 7.753972] systemd[1]: Listening on niks3 server socket. machine # [ 7.755486] systemd[1]: Listening on Nix Daemon Socket. machine # [ 7.756725] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. machine # [ 7.758323] systemd[1]: Reached target Socket Units. machine # [ 7.759450] systemd[1]: Reached target Basic System. machine # [ 7.760592] systemd[1]: Started backdoor.service. machine # [ 7.762055] systemd[1]: Starting Import lastlog data into lastlog2 database... machine # [ 7.765223] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 7.768258] systemd[1]: Starting Post-Boot Actions... machine # [ 7.781291] systemd[1]: Started Reset console on configuration changes. machine # [ 7.785365] systemd[1]: Starting resolvconf update... machine # [ 7.791131] systemd[1]: Started rustfs.service. machine # [ 7.797880] systemd[1]: Starting rustfs-bucket.service... machine # [ 7.805342] systemd[1]: Starting D-Bus System Message Bus... machine # [ 7.808328] systemd[1]: Finished Post-Boot Actions. machine # [ 7.825852] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 7.830677] nsncd[493]: Sep 23 04:11:40.606 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 7.833147] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 7.834201] systemd[1]: Reached target User and Group Name Lookups. machine # [ 7.835370] systemd[1]: Starting User Login Management... machine # connecting to host... machine # [ 7.870659] systemd[1]: Finished Import lastlog data into lastlog2 database. machine: Guest shell says: b'Spawning backdoor root shell...\n' machine: connected to guest root shell machine: (connecting took 8.55 seconds) machine: (finished: waiting for the VM to finish booting, in 8.79 seconds) machine # [ 7.888344] dbus-broker-launch[501]: Looking up NSS user entry for 'systemd-timesync'... machine # [ 7.897119] dbus-broker-launch[501]: NSS returned no entry for 'systemd-timesync' machine # [ 7.897776] dbus-broker-launch[501]: Invalid user-name in /nix/store/d3mrkr0v9x5sgbb0rb2pnsl0mysb1m4x-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" machine # [ 7.914050] systemd[1]: Started D-Bus System Message Bus. machine # [ 7.917362] systemd-logind[518]: New seat seat0. machine # [ 7.920109] systemd-logind[518]: Watching system buttons on /dev/input/event2 (Power Button) machine # [ 7.922362] systemd-logind[518]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) machine # [ 7.923606] systemd-logind[518]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) machine # [ 7.924868] systemd[1]: Started User Login Management. machine # [ 7.925647] systemd[1]: Starting linger-users.service... machine # [ 7.934296] dbus-broker-launch[501]: Ready machine # [ 7.954126] systemd[1]: Stopped target Host and Network Name Lookups. machine # [ 7.955422] systemd[1]: Stopping Host and Network Name Lookups... machine # [ 7.956059] systemd[1]: Stopped target User and Group Name Lookups. machine # [ 7.956523] systemd[1]: Stopping User and Group Name Lookups... machine # [ 7.956976] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... machine # [ 7.960594] systemd[1]: nscd.service: Deactivated successfully. machine # [ 7.961248] systemd[1]: Stopped Name Service Cache Daemon (nsncd). machine # [ 7.962417] systemd[1]: linger-users.service: Deactivated successfully. machine # [ 7.963411] systemd[1]: Finished linger-users.service. machine # [ 7.967382] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 8.001633] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 8.002661] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 8.003788] nsncd[599]: Sep 23 04:11:40.781 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 8.005859] systemd[1]: Reached target User and Group Name Lookups. machine # [ 8.011799] systemd[1]: Finished resolvconf update. machine # [ 8.012527] systemd[1]: Reached target Preparation for Network. machine # [ 8.014567] systemd[1]: Starting DHCP Client... machine # [ 8.015919] systemd[1]: Starting Address configuration of eth1... machine # [ 8.017923] systemd[1]: Starting Extra networking commands.... machine # [ 8.076081] network-addresses-eth1-start[626]: adding address 192.168.1.1/24... done machine # [ 8.084541] network-addresses-eth1-start[626]: adding address 2001:db8:1::1/64... done machine # [ 8.096908] systemd[1]: Finished Address configuration of eth1. machine # [ 8.108243] dhcpcd[637]: dhcpcd-10.3.2 starting machine # [ 8.112952] dhcpcd[686]: dev: loaded udev machine # [ 8.276090] 8021q: 802.1Q VLAN Support v1.8 machine # [ 8.277263] 8021q: adding VLAN 0 to HW filter on device eth1 machine # [ 8.134364] systemd[1]: Finished Extra networking commands.. machine # [ 8.136170] systemd[1]: Reached target Network. machine # [ 8.137740] systemd[1]: Starting PostgreSQL Server... machine # [ 8.139590] systemd[1]: Starting Permit User Sessions... machine # [ 8.143416] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. machine # [ 8.166311] systemd[1]: Finished Permit User Sessions. machine # [ 8.169916] systemd[1]: Started Getty on tty1. machine # [ 8.170989] systemd[1]: Reached target Login Prompts. machine # [ 8.370348] cfg80211: Loading compiled-in X.509 certificates for regulatory database machine # [ 8.397750] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' machine # [ 8.398756] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' machine # [ 8.400549] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 machine # [ 8.401793] cfg80211: failed to load regulatory.db machine # [ 8.438778] 8021q: adding VLAN 0 to HW filter on device eth0 machine # [ 8.287050] dhcpcd[686]: eth0: waiting for carrier machine # [ 8.287877] dhcpcd[686]: eth0: carrier acquired machine # [ 8.293335] dhcpcd[686]: DUID 00:01:00:01:32:46:0d:fd:52:54:00:12:34:56 machine # [ 8.294469] dhcpcd[686]: eth0: IAID 00:12:34:56 machine # [ 8.295191] dhcpcd[686]: eth0: adding address fe80::5054:ff:fe12:3456 machine # [ 8.300859] postgresql-pre-start[714]: The files belonging to this database system will be owned by user "postgres". machine # [ 8.301622] postgresql-pre-start[714]: This user must also own the server process. machine # [ 8.306337] postgresql-pre-start[714]: The database cluster will be initialized with locale "en_US.UTF-8". machine # [ 8.306915] postgresql-pre-start[714]: The default database encoding has accordingly been set to "UTF8". machine # [ 8.307548] postgresql-pre-start[714]: The default text search configuration will be set to "english". machine # [ 8.308033] postgresql-pre-start[714]: Data page checksums are enabled. machine # [ 8.308571] postgresql-pre-start[714]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok machine # [ 8.308968] postgresql-pre-start[714]: creating subdirectories ... ok machine # [ 8.309782] postgresql-pre-start[714]: selecting dynamic shared memory implementation ... posix machine # [ 8.373385] postgresql-pre-start[714]: selecting default "max_connections" ... 100 machine # [ 8.425698] postgresql-pre-start[714]: selecting default "shared_buffers" ... 128MB machine # [ 9.187113] postgresql-pre-start[714]: selecting default time zone ... UTC machine # [ 9.190081] postgresql-pre-start[714]: creating configuration files ... ok machine # [ 9.389303] postgresql-pre-start[714]: running bootstrap script ... ok machine # [ 9.509096] dhcpcd[686]: eth0: soliciting a DHCP lease machine # [ 9.683029] NET: Registered PF_PACKET protocol family machine # [ 9.539792] dhcpcd[686]: eth0: offered 10.0.2.15 from 10.0.2.2 machine # [ 9.545111] dhcpcd[686]: eth0: probing address 10.0.2.15/24 machine # [ 9.853301] postgresql-pre-start[714]: performing post-bootstrap initialization ... ok machine # [ 10.030463] postgresql-pre-start[714]: syncing data to disk ... ok machine # [ 10.032131] postgresql-pre-start[714]: initdb: warning: enabling "trust" authentication for local connections machine # [ 10.033151] postgresql-pre-start[714]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. machine # [ 10.034330] postgresql-pre-start[714]: Success. You can now start the database server using: machine # [ 10.035520] postgresql-pre-start[714]: pg_ctl -D /var/lib/postgresql/18 -l logfile start machine # [ 10.195181] postgres[754]: [754] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit machine # [ 10.198451] postgres[754]: [754] LOG: listening on IPv6 address "::1", port 5432 machine # [ 10.199641] postgres[754]: [754] LOG: listening on IPv4 address "127.0.0.1", port 5432 machine # [ 10.205102] postgres[754]: [754] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" machine # [ 10.216070] postgres[770]: [770] LOG: database system was shut down at 2026-09-23 04:11:42 GMT machine # [ 10.224951] postgres[754]: [754] LOG: database system is ready to accept connections machine # [ 10.230754] systemd[1]: Started PostgreSQL Server. machine # [ 10.236530] systemd[1]: Starting PostgreSQL Setup Scripts... machine # [ 10.497622] postgresql-setup-start[781]: CREATE DATABASE machine # [ 10.551391] postgresql-setup-start[786]: CREATE ROLE machine # [ 10.577569] postgresql-setup-start[788]: ALTER DATABASE machine # [ 10.584314] systemd[1]: Finished PostgreSQL Setup Scripts. machine # [ 10.586997] systemd[1]: Reached target PostgreSQL. machine # [ 10.976656] dhcpcd[686]: eth0: soliciting an IPv6 router machine # [ 10.978420] dhcpcd[686]: eth0: Router Advertisement from fe80::2 machine # [ 10.979904] dhcpcd[686]: eth0: adding address fec0::5054:ff:fe12:3456/64 machine # [ 10.982088] dhcpcd[686]: eth0: adding route to fec0::/64 machine # [ 10.983673] dhcpcd[686]: eth0: adding default route via fe80::2 machine # [ 14.660169] dhcpcd[686]: eth0: leased 10.0.2.15 for 86400 seconds machine # [ 14.662353] dhcpcd[686]: eth0: adding route to 10.0.2.0/24 machine # [ 14.664192] dhcpcd[686]: eth0: adding default route via 10.0.2.2 machine # [ 14.807800] systemd[1]: Started DHCP Client. machine # [ 14.810104] systemd[1]: Reached target Network is Online. machine # [ 14.813563] systemd[1]: Starting k3s service... machine # [ 14.884937] k3s[888]: time="2026-09-23T04:11:47Z" level=info msg="Acquiring lock file /var/lib/rancher/k3s/data/.lock" machine # [ 14.888580] k3s[888]: time="2026-09-23T04:11:47Z" level=info msg="Preparing data dir /var/lib/rancher/k3s/data/05fb32d1d5d79ab4bf8f805d07e4a7dfb491001fd5137b587aa471efd4746099" machine # [ 16.050188] rustfs-bucket-start[899]: mb s3://farm machine # [ 16.055530] systemd[1]: Finished rustfs-bucket.service. machine # [ 17.004776] k3s[888]: time="2026-09-23T04:11:49Z" level=info msg="Starting k3s 1.35.8+k3s1 (e952d68a)" machine # [ 17.017545] k3s[888]: time="2026-09-23T04:11:49Z" level=info msg="Configuring sqlite3 database connection pooling: maxIdle=20, maxOpen=0, maxLifetime=0s, maxIdleTime=2m0s" machine # [ 17.022699] k3s[888]: time="2026-09-23T04:11:49Z" level=info msg="Kine built with sqlite from github.com/mattn/go-sqlite3 version 3.53.3" machine # [ 17.026947] k3s[888]: time="2026-09-23T04:11:49Z" level=info msg="Configuring database table schema and indexes, this may take a moment..." machine # [ 17.034232] k3s[888]: time="2026-09-23T04:11:49Z" level=info msg="Database tables and indexes are up to date" machine # [ 17.038792] k3s[888]: time="2026-09-23T04:11:49Z" level=info msg="Running startup VACUUM to reclaim disk space, this may take a moment..." machine # [ 17.040276] k3s[888]: time="2026-09-23T04:11:49Z" level=info msg="Startup VACUUM completed successfully" machine # [ 17.041336] k3s[888]: time="2026-09-23T04:11:49Z" level=info msg="Kine available at unix://kine.sock" machine # [ 17.042517] k3s[888]: time="2026-09-23T04:11:49Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 17.044175] k3s[888]: time="2026-09-23T04:11:49Z" level=info msg="Datastore connection validated successfully, proceeding with bootstrap data generation" machine # [ 17.045292] k3s[888]: time="2026-09-23T04:11:49Z" level=info msg="generated self-signed CA certificate CN=k3s-client-ca@1790136709: notBefore=2026-09-23 03:11:49.822786274 +0000 UTC notAfter=2036-09-20 03:11:49.822786274 +0000 UTC" machine # [ 17.046500] k3s[888]: time="2026-09-23T04:11:49Z" level=info msg="certificate CN=system:admin,O=system:masters signed by CN=k3s-client-ca@1790136709: notBefore=2026-09-23 03:11:49 +0000 UTC notAfter=2027-09-23 03:11:49 +0000 UTC" machine # [ 17.048185] k3s[888]: time="2026-09-23T04:11:49Z" level=info msg="certificate CN=system:k3s-supervisor,O=system:masters signed by CN=k3s-client-ca@1790136709: notBefore=2026-09-23 03:11:49 +0000 UTC notAfter=2027-09-23 03:11:49 +0000 UTC" machine # [ 17.048798] k3s[888]: time="2026-09-23T04:11:49Z" level=info msg="certificate CN=system:kube-controller-manager signed by CN=k3s-client-ca@1790136709: notBefore=2026-09-23 03:11:49 +0000 UTC notAfter=2027-09-23 03:11:49 +0000 UTC" machine # [ 17.050388] k3s[888]: time="2026-09-23T04:11:49Z" level=info msg="certificate CN=system:kube-scheduler signed by CN=k3s-client-ca@1790136709: notBefore=2026-09-23 03:11:49 +0000 UTC notAfter=2027-09-23 03:11:49 +0000 UTC" machine # [ 17.051746] k3s[888]: time="2026-09-23T04:11:49Z" level=info msg="certificate CN=system:apiserver,O=system:masters signed by CN=k3s-client-ca@1790136709: notBefore=2026-09-23 03:11:49 +0000 UTC notAfter=2027-09-23 03:11:49 +0000 UTC" machine # [ 17.053070] k3s[888]: time="2026-09-23T04:11:49Z" level=info msg="certificate CN=k3s-cloud-controller-manager signed by CN=k3s-client-ca@1790136709: notBefore=2026-09-23 03:11:49 +0000 UTC notAfter=2027-09-23 03:11:49 +0000 UTC" machine # [ 17.053953] k3s[888]: time="2026-09-23T04:11:49Z" level=info msg="generated self-signed CA certificate CN=k3s-server-ca@1790136709: notBefore=2026-09-23 03:11:49.830481945 +0000 UTC notAfter=2036-09-20 03:11:49.830481945 +0000 UTC" machine # [ 17.055231] k3s[888]: time="2026-09-23T04:11:49Z" level=info msg="certificate CN=kube-apiserver signed by CN=k3s-server-ca@1790136709: notBefore=2026-09-23 03:11:49 +0000 UTC notAfter=2027-09-23 03:11:49 +0000 UTC" machine # [ 17.056183] k3s[888]: time="2026-09-23T04:11:49Z" level=info msg="certificate CN=kube-scheduler signed by CN=k3s-server-ca@1790136709: notBefore=2026-09-23 03:11:49 +0000 UTC notAfter=2027-09-23 03:11:49 +0000 UTC" machine # [ 17.057189] k3s[888]: time="2026-09-23T04:11:49Z" level=info msg="certificate CN=kube-controller-manager signed by CN=k3s-server-ca@1790136709: notBefore=2026-09-23 03:11:49 +0000 UTC notAfter=2027-09-23 03:11:49 +0000 UTC" machine # [ 17.058067] k3s[888]: time="2026-09-23T04:11:49Z" level=info msg="generated self-signed CA certificate CN=k3s-request-header-ca@1790136709: notBefore=2026-09-23 03:11:49.834429653 +0000 UTC notAfter=2036-09-20 03:11:49.834429653 +0000 UTC" machine # [ 17.058976] k3s[888]: time="2026-09-23T04:11:49Z" level=info msg="certificate CN=system:auth-proxy signed by CN=k3s-request-header-ca@1790136709: notBefore=2026-09-23 03:11:49 +0000 UTC notAfter=2027-09-23 03:11:49 +0000 UTC" machine # [ 17.060218] k3s[888]: time="2026-09-23T04:11:49Z" level=info msg="generated self-signed CA certificate CN=etcd-server-ca@1790136709: notBefore=2026-09-23 03:11:49.836543051 +0000 UTC notAfter=2036-09-20 03:11:49.836543051 +0000 UTC" machine # [ 17.060573] k3s[888]: time="2026-09-23T04:11:49Z" level=info msg="certificate CN=etcd-client signed by CN=etcd-server-ca@1790136709: notBefore=2026-09-23 03:11:49 +0000 UTC notAfter=2027-09-23 03:11:49 +0000 UTC" machine # [ 17.061790] k3s[888]: time="2026-09-23T04:11:49Z" level=info msg="generated self-signed CA certificate CN=etcd-peer-ca@1790136709: notBefore=2026-09-23 03:11:49.838270644 +0000 UTC notAfter=2036-09-20 03:11:49.838270644 +0000 UTC" machine # [ 17.062727] k3s[888]: time="2026-09-23T04:11:49Z" level=info msg="certificate CN=etcd-peer signed by CN=etcd-peer-ca@1790136709: notBefore=2026-09-23 03:11:49 +0000 UTC notAfter=2027-09-23 03:11:49 +0000 UTC" machine # [ 17.063953] k3s[888]: time="2026-09-23T04:11:49Z" level=info msg="certificate CN=etcd-server signed by CN=etcd-server-ca@1790136709: notBefore=2026-09-23 03:11:49 +0000 UTC notAfter=2027-09-23 03:11:49 +0000 UTC" machine # [ 17.127268] k3s[888]: time="2026-09-23T04:11:49Z" level=info msg="certificate CN=k3s,O=k3s signed by CN=k3s-server-ca@1790136709: notBefore=2026-09-23 03:11:49 +0000 UTC notAfter=2027-09-23 03:11:49 +0000 UTC" machine # [ 17.128581] k3s[888]: time="2026-09-23T04:11:49Z" level=warning msg="dynamiclistener [::]:6443: no cached certificate available for preload - deferring certificate load until storage initialization or first client request" machine # [ 17.137767] k3s[888]: time="2026-09-23T04:11:49Z" level=info msg="Active TLS secret / (ver=) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__9444_53df_fe15_a875-f43026:fec0::9444:53df:fe15:a875 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=4D7939419C7D5854BBB1B8904A186B2ACBD6981F]" machine # [ 18.093660] k3s[888]: time="2026-09-23T04:11:50Z" level=info msg="Password verified locally for node machine" machine # [ 18.096233] k3s[888]: time="2026-09-23T04:11:50Z" level=info msg="certificate CN=machine signed by CN=k3s-server-ca@1790136709: notBefore=2026-09-23 03:11:50 +0000 UTC notAfter=2027-09-23 03:11:50 +0000 UTC" machine # [ 18.366728] k3s[888]: time="2026-09-23T04:11:51Z" level=info msg="certificate CN=system:node:machine,O=system:nodes signed by CN=k3s-client-ca@1790136709: notBefore=2026-09-23 03:11:51 +0000 UTC notAfter=2027-09-23 03:11:51 +0000 UTC" machine # [ 18.466364] k3s[888]: time="2026-09-23T04:11:51Z" level=info msg="certificate CN=system:kube-proxy signed by CN=k3s-client-ca@1790136709: notBefore=2026-09-23 03:11:51 +0000 UTC notAfter=2027-09-23 03:11:51 +0000 UTC" machine # [ 18.574697] k3s[888]: time="2026-09-23T04:11:51Z" level=info msg="certificate CN=system:k3s-controller signed by CN=k3s-client-ca@1790136709: notBefore=2026-09-23 03:11:51 +0000 UTC notAfter=2027-09-23 03:11:51 +0000 UTC" machine # [ 18.665803] k3s[888]: time="2026-09-23T04:11:51Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:59912: runtime core not ready" machine # [ 18.772630] k3s[888]: time="2026-09-23T04:11:51Z" level=info msg="Module overlay was already loaded" machine # [ 19.033958] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. machine # [ 19.041362] Bridge firewalling registered machine # [ 18.902541] k3s[888]: time="2026-09-23T04:11:51Z" level=warning msg="Failed to load kernel module iptable_nat with modprobe" machine # [ 18.913854] k3s[888]: time="2026-09-23T04:11:51Z" level=warning msg="Failed to load kernel module iptable_filter with modprobe" machine # [ 18.926957] k3s[888]: time="2026-09-23T04:11:51Z" level=warning msg="Failed to load kernel module nft-expr-counter with modprobe" machine # [ 19.019721] k3s[888]: time="2026-09-23T04:11:51Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_max' to 131072" machine # [ 19.020598] k3s[888]: time="2026-09-23T04:11:51Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400" machine # [ 19.021635] k3s[888]: time="2026-09-23T04:11:51Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600" machine # [ 19.022752] k3s[888]: time="2026-09-23T04:11:51Z" level=info msg="Set sysctl 'net/ipv4/conf/all/forwarding' to 1" machine # [ 19.027120] k3s[888]: time="2026-09-23T04:11:51Z" level=info msg="Connecting to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 19.027699] k3s[888]: time="2026-09-23T04:11:51Z" level=info msg="Creating k3s-cert-monitor event broadcaster" machine # [ 19.028847] k3s[888]: time="2026-09-23T04:11:51Z" level=info msg="Saving cluster bootstrap data to datastore" machine # [ 19.029981] k3s[888]: time="2026-09-23T04:11:51Z" level=info msg="Handling backend connection request [machine]" machine # [ 19.033790] k3s[888]: time="2026-09-23T04:11:51Z" level=info msg="Connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 19.034914] k3s[888]: time="2026-09-23T04:11:51Z" level=info msg="Remotedialer connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 19.036088] k3s[888]: time="2026-09-23T04:11:51Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 19.036827] k3s[888]: time="2026-09-23T04:11:51Z" level=info msg="Connection to etcd is ready" machine # [ 19.037965] k3s[888]: time="2026-09-23T04:11:51Z" level=info msg="ETCD server is now running" machine # [ 19.038354] k3s[888]: time="2026-09-23T04:11:51Z" level=info msg="Polling for API server readiness: GET /readyz failed: the server is currently unable to handle the request" machine # [ 19.040913] k3s[888]: time="2026-09-23T04:11:51Z" level=info msg="Running kube-apiserver --advertise-port=6443 --allow-privileged=true --anonymous-auth=false --api-audiences=https://kubernetes.default.svc.cluster.local,k3s --authorization-mode=Node,RBAC --bind-address=127.0.0.1 --cert-dir=/var/lib/rancher/k3s/server/tls/temporary-certs --client-ca-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --egress-selector-config-file=/var/lib/rancher/k3s/server/etc/egress-selector-config.yaml --enable-admission-plugins=NodeRestriction --enable-aggregator-routing=true --enable-bootstrap-token-auth=true --etcd-servers=unix://kine.sock --kubelet-certificate-authority=/var/lib/rancher/k3s/server/tls/server-ca.crt --kubelet-client-certificate=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.crt --kubelet-client-key=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.key --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --profiling=false --proxy-client-cert-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt --proxy-client-key-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.key --requestheader-allowed-names=system:auth-proxy --requestheader-client-ca-file=/var/lib/rancher/k3s/server/tls/request-header-ca.crt --requestheader-extra-headers-prefix=X-Remote-Extra- --requestheader-group-headers=X-Remote-Group --requestheader-username-headers=X-Remote-User --secure-port=6444 --service-account-issuer=https://kubernetes.default.svc.cluster.local --service-account-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-account-signing-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --storage-backend=etcd3 --tls-cert-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --tls-private-key-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 19.043288] k3s[888]: time="2026-09-23T04:11:51Z" level=info msg="Running kube-scheduler --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --bind-address=127.0.0.1 --kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --leader-elect=false --profiling=false --secure-port=10259 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 19.044284] k3s[888]: time="2026-09-23T04:11:51Z" level=info msg="Running kube-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --bind-address=127.0.0.1 --cluster-cidr=10.42.0.0/16 --cluster-signing-kube-apiserver-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kube-apiserver-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kubelet-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-serving-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-kubelet-serving-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --cluster-signing-legacy-unknown-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-legacy-unknown-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --configure-cloud-routes=false --controllers=*,tokencleaner,-service,-route,-cloud-node-lifecycle --kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --leader-elect=false --profiling=false --root-ca-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --secure-port=10257 --service-account-private-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key --use-service-account-credentials=true" machine # [ 19.091764] k3s[888]: time="2026-09-23T04:11:51Z" level=info msg="Running cloud-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --bind-address=127.0.0.1 --cloud-config=/var/lib/rancher/k3s/server/etc/cloud-config.yaml --cloud-provider=k3s --cluster-cidr=10.42.0.0/16 --configure-cloud-routes=false --controllers=*,-route --kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --leader-elect=false --leader-elect-resource-name=k3s-cloud-controller-manager --node-status-update-frequency=1m0s --profiling=false" machine # [ 19.092558] k3s[888]: I0923 04:11:51.827275 888 options.go:263] external host was not specified, using 10.0.2.15 machine # [ 19.093299] k3s[888]: time="2026-09-23T04:11:51Z" level=info msg="Server node token is available at /var/lib/rancher/k3s/server/token" machine # [ 19.093823] k3s[888]: time="2026-09-23T04:11:51Z" level=info msg="To join server node to cluster: k3s server -s https://10.0.2.15:6443 -t ${SERVER_NODE_TOKEN}" machine # [ 19.094670] k3s[888]: time="2026-09-23T04:11:51Z" level=info msg="Agent node token is available at /var/lib/rancher/k3s/server/agent-token" machine # [ 19.095163] k3s[888]: time="2026-09-23T04:11:51Z" level=info msg="To join agent node to cluster: k3s agent -s https://10.0.2.15:6443 -t ${AGENT_NODE_TOKEN}" machine # [ 19.095633] k3s[888]: time="2026-09-23T04:11:51Z" level=info msg="Wrote kubeconfig /etc/rancher/k3s/k3s.yaml" machine # [ 19.096121] k3s[888]: time="2026-09-23T04:11:51Z" level=info msg="Run: k3s kubectl" machine # [ 19.096646] k3s[888]: I0923 04:11:51.830328 888 server.go:158] Version: v1.35.8+k3s1 machine # [ 19.097146] k3s[888]: I0923 04:11:51.830359 888 server.go:160] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 19.097646] k3s[888]: time="2026-09-23T04:11:51Z" level=info msg="Logging containerd to /var/lib/rancher/k3s/agent/containerd/containerd.log" machine # [ 19.098121] k3s[888]: time="2026-09-23T04:11:51Z" level=info msg="Running containerd -c /var/lib/rancher/k3s/agent/etc/containerd/config.toml" machine # [ 19.113918] k3s[888]: time="2026-09-23T04:11:51Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:59954: runtime core not ready" machine # [ 19.192575] k3s[888]: time="2026-09-23T04:11:51Z" level=info msg="Running kube-proxy --cluster-cidr=10.42.0.0/16 --conntrack-max-per-core=0 --conntrack-tcp-timeout-close-wait=0s --conntrack-tcp-timeout-established=0s --healthz-bind-address=127.0.0.1 --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubeproxy.kubeconfig --proxy-mode=iptables" machine # [ 19.202057] k3s[888]: I0923 04:11:51.982555 888 shared_informer.go:349] "Waiting for caches to sync" controller="node_authorizer" machine # [ 19.205277] k3s[888]: I0923 04:11:51.985829 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 19.206919] k3s[888]: I0923 04:11:51.987479 888 plugins.go:157] Loaded 14 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,PodTopologyLabels,MutatingAdmissionPolicy,MutatingAdmissionWebhook. machine # [ 19.207578] k3s[888]: I0923 04:11:51.987548 888 plugins.go:160] Loaded 14 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,NodeDeclaredFeatureValidator,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. machine # [ 19.208129] k3s[888]: I0923 04:11:51.987837 888 instance.go:240] Using reconciler: lease machine # [ 19.212355] k3s[888]: I0923 04:11:51.992907 888 handler.go:304] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager machine # [ 19.212792] k3s[888]: W0923 04:11:51.992932 888 genericapiserver.go:787] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. machine # [ 19.214712] k3s[888]: I0923 04:11:51.995082 888 cidrallocator.go:198] starting ServiceCIDR Allocator Controller machine # [ 19.240060] k3s[888]: I0923 04:11:52.020571 888 handler.go:304] Adding GroupVersion v1 to ResourceManager machine # [ 19.240901] k3s[888]: I0923 04:11:52.021459 888 apis.go:112] API group "internal.apiserver.k8s.io" is not enabled, skipping. machine # [ 19.264340] k3s[888]: I0923 04:11:52.044874 888 apis.go:112] API group "storagemigration.k8s.io" is not enabled, skipping. machine # [ 19.298871] k3s[888]: I0923 04:11:52.079404 888 handler.go:304] Adding GroupVersion authentication.k8s.io v1 to ResourceManager machine # [ 19.299562] k3s[888]: W0923 04:11:52.079438 888 genericapiserver.go:787] Skipping API authentication.k8s.io/v1beta1 because it has no resources. machine # [ 19.300022] k3s[888]: W0923 04:11:52.079449 888 genericapiserver.go:787] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. machine # [ 19.300540] k3s[888]: I0923 04:11:52.079815 888 handler.go:304] Adding GroupVersion authorization.k8s.io v1 to ResourceManager machine # [ 19.300963] k3s[888]: W0923 04:11:52.079831 888 genericapiserver.go:787] Skipping API authorization.k8s.io/v1beta1 because it has no resources. machine # [ 19.301627] k3s[888]: I0923 04:11:52.080438 888 handler.go:304] Adding GroupVersion autoscaling v2 to ResourceManager machine # [ 19.302194] k3s[888]: I0923 04:11:52.080899 888 handler.go:304] Adding GroupVersion autoscaling v1 to ResourceManager machine # [ 19.302663] k3s[888]: W0923 04:11:52.080914 888 genericapiserver.go:787] Skipping API autoscaling/v2beta1 because it has no resources. machine # [ 19.303633] k3s[888]: W0923 04:11:52.080925 888 genericapiserver.go:787] Skipping API autoscaling/v2beta2 because it has no resources. machine # [ 19.304520] k3s[888]: I0923 04:11:52.081813 888 handler.go:304] Adding GroupVersion batch v1 to ResourceManager machine # [ 19.305177] k3s[888]: W0923 04:11:52.081830 888 genericapiserver.go:787] Skipping API batch/v1beta1 because it has no resources. machine # [ 19.305618] k3s[888]: I0923 04:11:52.082329 888 handler.go:304] Adding GroupVersion certificates.k8s.io v1 to ResourceManager machine # [ 19.306428] k3s[888]: W0923 04:11:52.082345 888 genericapiserver.go:787] Skipping API certificates.k8s.io/v1beta1 because it has no resources. machine # [ 19.306949] k3s[888]: W0923 04:11:52.082356 888 genericapiserver.go:787] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. machine # [ 19.307568] k3s[888]: I0923 04:11:52.082733 888 handler.go:304] Adding GroupVersion coordination.k8s.io v1 to ResourceManager machine # [ 19.308094] k3s[888]: W0923 04:11:52.082748 888 genericapiserver.go:787] Skipping API coordination.k8s.io/v1beta1 because it has no resources. machine # [ 19.308576] k3s[888]: W0923 04:11:52.082759 888 genericapiserver.go:787] Skipping API coordination.k8s.io/v1alpha2 because it has no resources. machine # [ 19.309089] k3s[888]: I0923 04:11:52.083103 888 handler.go:304] Adding GroupVersion discovery.k8s.io v1 to ResourceManager machine # [ 19.309565] k3s[888]: W0923 04:11:52.083119 888 genericapiserver.go:787] Skipping API discovery.k8s.io/v1beta1 because it has no resources. machine # [ 19.310053] k3s[888]: I0923 04:11:52.084680 888 handler.go:304] Adding GroupVersion networking.k8s.io v1 to ResourceManager machine # [ 19.310392] k3s[888]: W0923 04:11:52.084697 888 genericapiserver.go:787] Skipping API networking.k8s.io/v1beta1 because it has no resources. machine # [ 19.310864] k3s[888]: I0923 04:11:52.085000 888 handler.go:304] Adding GroupVersion node.k8s.io v1 to ResourceManager machine # [ 19.311529] k3s[888]: W0923 04:11:52.085018 888 genericapiserver.go:787] Skipping API node.k8s.io/v1beta1 because it has no resources. machine # [ 19.312030] k3s[888]: W0923 04:11:52.085028 888 genericapiserver.go:787] Skipping API node.k8s.io/v1alpha1 because it has no resources. machine # [ 19.312549] k3s[888]: I0923 04:11:52.085512 888 handler.go:304] Adding GroupVersion policy v1 to ResourceManager machine # [ 19.313025] k3s[888]: W0923 04:11:52.085530 888 genericapiserver.go:787] Skipping API policy/v1beta1 because it has no resources. machine # [ 19.313518] k3s[888]: I0923 04:11:52.086538 888 handler.go:304] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager machine # [ 19.314029] k3s[888]: W0923 04:11:52.086556 888 genericapiserver.go:787] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. machine # [ 19.314519] k3s[888]: W0923 04:11:52.086567 888 genericapiserver.go:787] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. machine # [ 19.314989] k3s[888]: I0923 04:11:52.086876 888 handler.go:304] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager machine # [ 19.315642] k3s[888]: W0923 04:11:52.086891 888 genericapiserver.go:787] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. machine # [ 19.316150] k3s[888]: W0923 04:11:52.086901 888 genericapiserver.go:787] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. machine # [ 19.316314] k3s[888]: I0923 04:11:52.088652 888 handler.go:304] Adding GroupVersion storage.k8s.io v1 to ResourceManager machine # [ 19.316832] k3s[888]: W0923 04:11:52.088787 888 genericapiserver.go:787] Skipping API storage.k8s.io/v1beta1 because it has no resources. machine # [ 19.317457] k3s[888]: W0923 04:11:52.088798 888 genericapiserver.go:787] Skipping API storage.k8s.io/v1alpha1 because it has no resources. machine # [ 19.317957] k3s[888]: I0923 04:11:52.090218 888 handler.go:304] Adding GroupVersion flowcontrol.apiserver.k8s.io v1 to ResourceManager machine # [ 19.318652] k3s[888]: W0923 04:11:52.090238 888 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta3 because it has no resources. machine # [ 19.319138] k3s[888]: W0923 04:11:52.090249 888 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta2 because it has no resources. machine # [ 19.319638] k3s[888]: W0923 04:11:52.090260 888 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. machine # [ 19.320119] k3s[888]: I0923 04:11:52.092317 888 handler.go:304] Adding GroupVersion apps v1 to ResourceManager machine # [ 19.320621] k3s[888]: W0923 04:11:52.092336 888 genericapiserver.go:787] Skipping API apps/v1beta2 because it has no resources. machine # [ 19.321128] k3s[888]: W0923 04:11:52.092348 888 genericapiserver.go:787] Skipping API apps/v1beta1 because it has no resources. machine # [ 19.321639] k3s[888]: I0923 04:11:52.093489 888 handler.go:304] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager machine # [ 19.322123] k3s[888]: W0923 04:11:52.093509 888 genericapiserver.go:787] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. machine # [ 19.322616] k3s[888]: W0923 04:11:52.093519 888 genericapiserver.go:787] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. machine # [ 19.323575] k3s[888]: I0923 04:11:52.093900 888 handler.go:304] Adding GroupVersion events.k8s.io v1 to ResourceManager machine # [ 19.363992] k3s[888]: W0923 04:11:52.093916 888 genericapiserver.go:787] Skipping API events.k8s.io/v1beta1 because it has no resources. machine # [ 19.364634] k3s[888]: I0923 04:11:52.095035 888 handler.go:304] Adding GroupVersion resource.k8s.io v1 to ResourceManager machine # [ 19.365124] k3s[888]: W0923 04:11:52.095054 888 genericapiserver.go:787] Skipping API resource.k8s.io/v1beta2 because it has no resources. machine # [ 19.365611] k3s[888]: W0923 04:11:52.095066 888 genericapiserver.go:787] Skipping API resource.k8s.io/v1beta1 because it has no resources. machine # [ 19.366115] k3s[888]: W0923 04:11:52.095076 888 genericapiserver.go:787] Skipping API resource.k8s.io/v1alpha3 because it has no resources. machine # [ 19.366599] k3s[888]: I0923 04:11:52.097676 888 handler.go:304] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager machine # [ 19.367112] k3s[888]: W0923 04:11:52.097694 888 genericapiserver.go:787] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. machine # [ 19.691105] k3s[888]: I0923 04:11:52.471430 888 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 19.691526] k3s[888]: I0923 04:11:52.471439 888 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 19.691983] k3s[888]: I0923 04:11:52.471545 888 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 19.692636] k3s[888]: I0923 04:11:52.473002 888 secure_serving.go:211] Serving securely on 127.0.0.1:6444 machine # [ 19.693171] k3s[888]: I0923 04:11:52.473072 888 controller.go:78] Starting OpenAPI AggregationController machine # [ 19.693633] k3s[888]: I0923 04:11:52.473123 888 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 19.694173] k3s[888]: I0923 04:11:52.473147 888 controller.go:80] Starting OpenAPI V3 AggregationController machine # [ 19.694702] k3s[888]: I0923 04:11:52.473466 888 apf_controller.go:377] Starting API Priority and Fairness config controller machine # [ 19.695187] k3s[888]: I0923 04:11:52.473728 888 apiservice_controller.go:100] Starting APIServiceRegistrationController machine # [ 19.695672] k3s[888]: I0923 04:11:52.473751 888 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller machine # [ 19.696207] k3s[888]: I0923 04:11:52.473979 888 cluster_authentication_trust_controller.go:459] Starting cluster_authentication_trust_controller controller machine # [ 19.696703] k3s[888]: time="2026-09-23T04:11:52Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 19.697211] k3s[888]: time="2026-09-23T04:11:52Z" level=info msg="Starting legacy_token_tracking_controller" logger=k3s machine # [ 19.697401] k3s[888]: time="2026-09-23T04:11:52Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 19.697905] k3s[888]: I0923 04:11:52.474251 888 aggregator.go:185] waiting for initial CRD sync... machine # [ 19.698595] k3s[888]: I0923 04:11:52.474288 888 crdregistration_controller.go:114] Starting crd-autoregister controller machine # [ 19.699147] k3s[888]: I0923 04:11:52.474300 888 shared_informer.go:349] "Waiting for caches to sync" controller="crd-autoregister" machine # [ 19.699743] k3s[888]: time="2026-09-23T04:11:52Z" level=info msg="Starting apiserver lease garbage collector" logger=k3s machine # [ 19.700411] k3s[888]: time="2026-09-23T04:11:52Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 19.700881] k3s[888]: I0923 04:11:52.476245 888 system_namespaces_controller.go:66] Starting system namespaces controller machine # [ 19.701403] k3s[888]: I0923 04:11:52.476321 888 dynamic_serving_content.go:135] "Starting controller" name="aggregator-proxy-cert::/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt::/var/lib/rancher/k3s/server/tls/client-auth-proxy.key" machine # [ 19.701866] k3s[888]: I0923 04:11:52.477222 888 local_available_controller.go:156] Starting LocalAvailability controller machine # [ 19.702502] k3s[888]: I0923 04:11:52.477248 888 cache.go:32] Waiting for caches to sync for LocalAvailability controller machine # [ 19.702983] k3s[888]: I0923 04:11:52.477326 888 remote_available_controller.go:425] Starting RemoteAvailability controller machine # [ 19.703633] k3s[888]: I0923 04:11:52.477346 888 cache.go:32] Waiting for caches to sync for RemoteAvailability controller machine # [ 19.730113] k3s[888]: I0923 04:11:52.474659 888 controller.go:113] "Deleting old lease on startup" lease="kube-system/apiserver-ik4pcwfs7qgdl76byc4pomgvia" machine # [ 19.730810] k3s[888]: I0923 04:11:52.508226 888 default_servicecidr_controller.go:110] Starting kubernetes-service-cidr-controller machine # [ 19.731452] k3s[888]: I0923 04:11:52.508252 888 shared_informer.go:349] "Waiting for caches to sync" controller="kubernetes-service-cidr-controller" machine # [ 19.731954] k3s[888]: I0923 04:11:52.508341 888 repairip.go:210] Starting ipallocator-repair-controller machine # [ 19.732616] k3s[888]: I0923 04:11:52.508351 888 shared_informer.go:349] "Waiting for caches to sync" controller="ipallocator-repair-controller" machine # [ 19.733129] k3s[888]: I0923 04:11:52.509601 888 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 19.733614] k3s[888]: I0923 04:11:52.509922 888 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 19.734145] k3s[888]: I0923 04:11:52.510389 888 controller.go:142] Starting OpenAPI controller machine # [ 19.734641] k3s[888]: I0923 04:11:52.510463 888 controller.go:90] Starting OpenAPI V3 controller machine # [ 19.735146] k3s[888]: I0923 04:11:52.510495 888 naming_controller.go:305] Starting NamingConditionController machine # [ 19.735695] k3s[888]: I0923 04:11:52.516276 888 nonstructuralschema_controller.go:202] Starting NonStructuralSchemaConditionController machine # [ 19.736232] k3s[888]: I0923 04:11:52.516819 888 apiapproval_controller.go:196] Starting KubernetesAPIApprovalPolicyConformantConditionController machine # [ 19.736831] k3s[888]: I0923 04:11:52.517420 888 crd_finalizer.go:273] Starting CRDFinalizer machine # [ 19.737515] k3s[888]: I0923 04:11:52.518103 888 customresource_discovery_controller.go:294] Starting DiscoveryController machine # [ 19.793833] k3s[888]: time="2026-09-23T04:11:52Z" level=info msg="Caches are synced" logger=k3s machine # [ 19.794572] k3s[888]: time="2026-09-23T04:11:52Z" level=info msg="Caches are synced" logger=k3s machine # [ 19.795073] k3s[888]: I0923 04:11:52.574877 888 apf_controller.go:382] Running API Priority and Fairness config worker machine # [ 19.795520] k3s[888]: I0923 04:11:52.574893 888 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process machine # [ 19.798658] k3s[888]: I0923 04:11:52.575282 888 cache.go:39] Caches are synced for APIServiceRegistrationController controller machine # [ 19.799146] k3s[888]: I0923 04:11:52.575391 888 handler_discovery.go:451] Starting ResourceDiscoveryManager machine # [ 19.799681] k3s[888]: I0923 04:11:52.576368 888 shared_informer.go:356] "Caches are synced" controller="crd-autoregister" machine # [ 19.800149] k3s[888]: I0923 04:11:52.576446 888 aggregator.go:187] initial CRD sync complete... machine # [ 19.800639] k3s[888]: I0923 04:11:52.576463 888 autoregister_controller.go:144] Starting autoregister controller machine # [ 19.801121] k3s[888]: I0923 04:11:52.576478 888 cache.go:32] Waiting for caches to sync for autoregister controller machine # [ 19.801592] k3s[888]: I0923 04:11:52.576489 888 cache.go:39] Caches are synced for autoregister controller machine # [ 19.802102] k3s[888]: time="2026-09-23T04:11:52Z" level=info msg="Caches are synced" logger=k3s machine # [ 19.802567] k3s[888]: I0923 04:11:52.577737 888 cache.go:39] Caches are synced for RemoteAvailability controller machine # [ 19.803084] k3s[888]: I0923 04:11:52.578038 888 cache.go:39] Caches are synced for LocalAvailability controller machine # [ 19.803609] k3s[888]: I0923 04:11:52.583211 888 shared_informer.go:356] "Caches are synced" controller="node_authorizer" machine # [ 19.805712] k3s[888]: I0923 04:11:52.586286 888 shared_informer.go:377] "Caches are synced" machine # [ 19.806727] k3s[888]: I0923 04:11:52.587216 888 policy_source.go:248] refreshing policies machine # [ 19.816678] k3s[888]: I0923 04:11:52.597021 888 controller.go:667] quota admission added evaluator for: namespaces machine # [ 19.828382] k3s[888]: I0923 04:11:52.608792 888 shared_informer.go:356] "Caches are synced" controller="ipallocator-repair-controller" machine # [ 19.829279] k3s[888]: I0923 04:11:52.608820 888 shared_informer.go:356] "Caches are synced" controller="kubernetes-service-cidr-controller" machine # [ 19.829705] k3s[888]: I0923 04:11:52.608877 888 default_servicecidr_controller.go:169] Creating default ServiceCIDR with CIDRs: [10.43.0.0/16] machine # [ 19.836904] k3s[888]: I0923 04:11:52.617086 888 default_servicecidr_controller.go:231] Setting default ServiceCIDR condition Ready to True machine # [ 19.837573] k3s[888]: I0923 04:11:52.617422 888 cidrallocator.go:302] created ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 19.843060] k3s[888]: I0923 04:11:52.621481 888 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io machine # [ 19.847755] k3s[888]: I0923 04:11:52.627940 888 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 19.851058] k3s[888]: E0923 04:11:52.631289 888 controller.go:95] Unable to perform initial Kubernetes service initialization: namespaces "default" not found machine # [ 20.061879] k3s[888]: time="2026-09-23T04:11:52Z" level=info msg="containerd is now running" machine # [ 20.073545] k3s[888]: time="2026-09-23T04:11:52Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/k3s-airgap-images-amd64.tar.zst" machine # [ 20.700267] k3s[888]: I0923 04:11:53.480481 888 storage_scheduling.go:123] created PriorityClass system-node-critical with value 2000001000 machine # [ 20.705956] k3s[888]: I0923 04:11:53.486481 888 storage_scheduling.go:123] created PriorityClass system-cluster-critical with value 2000000000 machine # [ 20.707745] k3s[888]: I0923 04:11:53.486509 888 storage_scheduling.go:139] all system priority classes are created successfully or already exist. machine # [ 21.031417] k3s[888]: time="2026-09-23T04:11:53Z" level=info msg="Polling for API server readiness: GET /readyz failed: unknown" machine # [ 21.594339] k3s[888]: I0923 04:11:54.374845 888 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io machine # [ 21.634029] k3s[888]: I0923 04:11:54.414520 888 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io machine # [ 21.760791] k3s[888]: I0923 04:11:54.540965 888 alloc.go:329] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.43.0.1"} machine # [ 21.765688] k3s[888]: W0923 04:11:54.546251 888 lease.go:265] Resetting endpoints for master service "kubernetes" to [10.0.2.15] machine # [ 21.768736] k3s[888]: I0923 04:11:54.549293 888 controller.go:667] quota admission added evaluator for: endpoints machine # [ 21.773901] k3s[888]: I0923 04:11:54.554420 888 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io machine # [ 23.032117] k3s[888]: time="2026-09-23T04:11:55Z" level=info msg="Kube API server is now running" machine # [ 23.033445] k3s[888]: time="2026-09-23T04:11:55Z" level=info msg="k3s is up and running" machine # [ 23.034562] k3s[888]: time="2026-09-23T04:11:55Z" level=info msg="Waiting for untainted node" machine # [ 23.035728] k3s[888]: time="2026-09-23T04:11:55Z" level=info msg="Creating k3s-supervisor event broadcaster" machine # [ 23.037090] k3s[888]: time="2026-09-23T04:11:55Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Node and Certificate Authority certificates managed by k3s are OK" object=machine reason=CertificateExpirationOK type=Normal machine # [ 23.040183] systemd[1]: Started k3s service. machine # [ 23.040940] systemd[1]: Starting niks3 server... machine # [ 23.047897] k3s[888]: I0923 04:11:55.828461 888 controllermanager.go:189] "Starting" version="v1.35.8+k3s1" machine # [ 23.052107] k3s[888]: I0923 04:11:55.832682 888 controllermanager.go:191] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 23.061026] k3s[888]: I0923 04:11:55.841441 888 secure_serving.go:211] Serving securely on 127.0.0.1:10257 machine # [ 23.062683] k3s[888]: I0923 04:11:55.843076 888 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 23.064695] k3s[888]: I0923 04:11:55.845240 888 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 23.066585] k3s[888]: I0923 04:11:55.845374 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 23.068052] k3s[888]: I0923 04:11:55.845472 888 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key" machine # [ 23.071881] k3s[888]: I0923 04:11:55.845699 888 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 23.074179] k3s[888]: I0923 04:11:55.845719 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 23.075508] k3s[888]: I0923 04:11:55.845844 888 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 23.079190] k3s[888]: I0923 04:11:55.845861 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 23.085599] k3s[888]: I0923 04:11:55.866113 888 controller.go:667] quota admission added evaluator for: serviceaccounts machine # [ 23.087994] k3s[888]: I0923 04:11:55.868556 888 controllermanager.go:627] "Warning: controller is disabled" controller="node-route-controller" machine # [ 23.090461] k3s[888]: I0923 04:11:55.868579 888 controllermanager.go:627] "Warning: controller is disabled" controller="cloud-node-lifecycle-controller" machine # [ 23.092489] k3s[888]: time="2026-09-23T04:11:55Z" level=info msg="Creating embedded CRD addons.k3s.cattle.io" machine # [ 23.094687] k3s[888]: time="2026-09-23T04:11:55Z" level=info msg="Creating embedded CRD etcdsnapshotfiles.k3s.cattle.io" machine # [ 23.103886] k3s[888]: time="2026-09-23T04:11:55Z" level=info msg="Creating embedded CRD helmcharts.helm.cattle.io" machine # [ 23.121455] k3s[888]: time="2026-09-23T04:11:55Z" level=info msg="Creating embedded CRD helmchartconfigs.helm.cattle.io" machine # [ 23.123279] k3s[888]: I0923 04:11:55.902933 888 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 23.131340] k3s[888]: I0923 04:11:55.911805 888 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 23.135441] k3s[888]: time="2026-09-23T04:11:55Z" level=info msg="Waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 23.142274] k3s[888]: I0923 04:11:55.922842 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 23.153293] k3s[888]: I0923 04:11:55.933847 888 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 23.156886] k3s[888]: I0923 04:11:55.937456 888 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 23.165237] k3s[888]: I0923 04:11:55.945796 888 shared_informer.go:377] "Caches are synced" machine # [ 23.166593] k3s[888]: I0923 04:11:55.945860 888 shared_informer.go:377] "Caches are synced" machine # [ 23.168336] k3s[888]: I0923 04:11:55.945942 888 shared_informer.go:377] "Caches are synced" machine # [ 23.170043] k3s[888]: I0923 04:11:55.950582 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="daemonsets.apps" machine # [ 23.173202] k3s[888]: I0923 04:11:55.950669 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="serviceaccounts" machine # [ 23.173861] k3s[888]: I0923 04:11:55.950698 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="networkpolicies.networking.k8s.io" machine # [ 23.174574] k3s[888]: I0923 04:11:55.950723 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="ingresses.networking.k8s.io" machine # [ 23.175105] k3s[888]: I0923 04:11:55.950746 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="leases.coordination.k8s.io" machine # [ 23.175601] k3s[888]: I0923 04:11:55.950780 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="resourceclaimtemplates.resource.k8s.io" machine # [ 23.176130] k3s[888]: I0923 04:11:55.950812 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmchartconfigs.helm.cattle.io" machine # [ 23.176650] k3s[888]: I0923 04:11:55.950833 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="controllerrevisions.apps" machine # [ 23.177029] k3s[888]: I0923 04:11:55.950870 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="horizontalpodautoscalers.autoscaling" machine # [ 23.177610] k3s[888]: I0923 04:11:55.950894 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="cronjobs.batch" machine # [ 23.178123] k3s[888]: I0923 04:11:55.950923 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="roles.rbac.authorization.k8s.io" machine # [ 23.178678] k3s[888]: I0923 04:11:55.950952 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="csistoragecapacities.storage.k8s.io" machine # [ 23.179214] k3s[888]: I0923 04:11:55.950975 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpointslices.discovery.k8s.io" machine # [ 23.179730] k3s[888]: I0923 04:11:55.951009 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="limitranges" machine # [ 23.180371] k3s[888]: I0923 04:11:55.951031 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="rolebindings.rbac.authorization.k8s.io" machine # [ 23.180911] k3s[888]: I0923 04:11:55.951067 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmcharts.helm.cattle.io" machine # [ 23.181603] k3s[888]: I0923 04:11:55.951088 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="addons.k3s.cattle.io" machine # [ 23.182144] k3s[888]: I0923 04:11:55.951136 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="poddisruptionbudgets.policy" machine # [ 23.182620] k3s[888]: I0923 04:11:55.951161 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpoints" machine # [ 23.183149] k3s[888]: I0923 04:11:55.951184 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="deployments.apps" machine # [ 23.183669] k3s[888]: I0923 04:11:55.951242 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="jobs.batch" machine # [ 23.184203] k3s[888]: I0923 04:11:55.951266 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="podtemplates" machine # [ 23.184720] k3s[888]: I0923 04:11:55.951288 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="statefulsets.apps" machine # [ 23.185396] k3s[888]: I0923 04:11:55.951309 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="replicasets.apps" machine # [ 23.185957] k3s[888]: I0923 04:11:55.960605 888 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="podcertificaterequest-cleaner-controller" requiredFeatureGates=["PodCertificateRequest"] machine # [ 23.186652] k3s[888]: I0923 04:11:55.960662 888 controllermanager.go:579] "Warning: skipping controller" controller="podcertificaterequest-cleaner-controller" machine # [ 23.244293] k3s[888]: I0923 04:11:56.024822 888 shared_informer.go:377] "Caches are synced" machine # [ 23.460676] k3s[888]: time="2026-09-23T04:11:56Z" level=info msg="Imported docker.io/rancher/klipper-helm:v0.13.3-build20260727" machine # [ 23.464634] k3s[888]: time="2026-09-23T04:11:56Z" level=info msg="Tagged docker.io/rancher/klipper-helm@sha256:5425a2b4613d2458dbdff99218e8d487ebb59c20e7a941f061c0777070f0aac1" machine # [ 23.465588] k3s[888]: time="2026-09-23T04:11:56Z" level=info msg="Imported docker.io/rancher/klipper-lb:v0.4.17" machine # [ 23.470287] k3s[888]: time="2026-09-23T04:11:56Z" level=info msg="Tagged docker.io/rancher/klipper-lb@sha256:910944bb0bd94f060a82a56ca1ea1c577d3e49b3473a093a47a985f32e92d94a" machine # [ 23.470921] k3s[888]: time="2026-09-23T04:11:56Z" level=info msg="Imported docker.io/rancher/local-path-provisioner:v0.0.37" machine # [ 23.472897] k3s[888]: time="2026-09-23T04:11:56Z" level=info msg="Tagged docker.io/rancher/local-path-provisioner@sha256:e757967a5ec338f6a9b371c5a9688bedaa8c3578ea3dd4db329ea0084be0a86f" machine # [ 23.473660] k3s[888]: time="2026-09-23T04:11:56Z" level=info msg="Imported docker.io/rancher/mirrored-coredns-coredns:1.14.6" machine # [ 23.478068] k3s[888]: time="2026-09-23T04:11:56Z" level=info msg="Tagged docker.io/rancher/mirrored-coredns-coredns@sha256:900f9c109f7a33545d3c811516e8376df9019147b750f5ce3e254468769176ea" machine # [ 23.478702] k3s[888]: time="2026-09-23T04:11:56Z" level=info msg="Imported docker.io/rancher/mirrored-library-busybox:1.37.0" machine # [ 23.481195] k3s[888]: time="2026-09-23T04:11:56Z" level=info msg="Tagged docker.io/rancher/mirrored-library-busybox@sha256:101b4afd76732482eff9b95cae5f94bcf295e521fbec4e01b69c5421f3f3f3e5" machine # [ 23.481965] k3s[888]: time="2026-09-23T04:11:56Z" level=info msg="Imported docker.io/rancher/mirrored-library-traefik:3.7.8" machine # [ 23.486536] k3s[888]: time="2026-09-23T04:11:56Z" level=info msg="Tagged docker.io/rancher/mirrored-library-traefik@sha256:4299bbed850421258fc5448c2e0e6ad350981d4d335a68de11b92448aedbefe5" machine # [ 23.487213] k3s[888]: time="2026-09-23T04:11:56Z" level=info msg="Imported docker.io/rancher/mirrored-metrics-server:v0.9.0" machine # [ 23.494867] k3s[888]: time="2026-09-23T04:11:56Z" level=info msg="Tagged docker.io/rancher/mirrored-metrics-server@sha256:d9862115e7c7881280d3d75ca26bda8ffc0fc213315979575bf23ce9826205c0" machine # [ 23.495531] k3s[888]: time="2026-09-23T04:11:56Z" level=info msg="Imported docker.io/rancher/mirrored-pause:3.10.2" machine # [ 23.503588] k3s[888]: time="2026-09-23T04:11:56Z" level=info msg="Tagged docker.io/rancher/mirrored-pause@sha256:f548e0e8e3dc1896ca956272154dde3314e8cc4fde0a57577ee9fa1c63f5baf4" machine # [ 23.648069] k3s[888]: time="2026-09-23T04:11:56Z" level=info msg="Done waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 23.648796] k3s[888]: time="2026-09-23T04:11:56Z" level=info msg="Waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 23.650980] k3s[888]: time="2026-09-23T04:11:56Z" level=info msg="Done waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 23.651902] k3s[888]: time="2026-09-23T04:11:56Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-40.1.4+up40.1.0.tgz" machine # [ 23.652493] k3s[888]: time="2026-09-23T04:11:56Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-crd-40.1.4+up40.1.0.tgz" machine # [ 23.653089] k3s[888]: time="2026-09-23T04:11:56Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/ccm.yaml" machine # [ 23.653624] k3s[888]: time="2026-09-23T04:11:56Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/coredns.yaml" machine # [ 23.654556] k3s[888]: time="2026-09-23T04:11:56Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/local-storage.yaml" machine # [ 23.655049] k3s[888]: time="2026-09-23T04:11:56Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/rolebindings.yaml" machine # [ 23.655519] k3s[888]: time="2026-09-23T04:11:56Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/runtimes.yaml" machine # [ 23.656214] k3s[888]: time="2026-09-23T04:11:56Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/traefik.yaml" machine: (finished: waiting for unit k3s.service, in 24.69 seconds) machine # [ 23.777070] k3s[888]: time="2026-09-23T04:11:56Z" level=info msg="Starting dynamiclistener CN filter node controller with SANs: [127.0.0.1 ::1 localhost machine 10.0.2.15 fec0::9444:53df:fe15:a875 10.43.0.1 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local]" machine: waiting for success: kubectl get ns farm machine # [ 23.777763] k3s[888]: time="2026-09-23T04:11:56Z" level=info msg="Tunnel server egress proxy mode: agent" machine # [ 23.784828] k3s[888]: time="2026-09-23T04:11:56Z" level=info msg="Imported 8 images from /var/lib/rancher/k3s/agent/images/k3s-airgap-images-amd64.tar.zst in 3.711855836s" machine # [ 23.785611] k3s[888]: time="2026-09-23T04:11:56Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-client.tar" machine # [ 23.826580] k3s[888]: I0923 04:11:56.606995 888 controllermanager.go:627] "Warning: controller is disabled" controller="service-lb-controller" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 24.126669] k3s[888]: I0923 04:11:56.906867 888 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="device-taint-eviction-controller" requiredFeatureGates=["DynamicResourceAllocation","DRADeviceTaints"] machine # [ 24.127568] k3s[888]: I0923 04:11:56.906906 888 controllermanager.go:579] "Warning: skipping controller" controller="device-taint-eviction-controller" machine # [ 24.131541] k3s[888]: time="2026-09-23T04:11:56Z" level=info msg="Creating new TLS secret for kube-system/k3s-serving (count: 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__9444_53df_fe15_a875-f43026:fec0::9444:53df:fe15:a875 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=4D7939419C7D5854BBB1B8904A186B2ACBD6981F]" machine # [ 24.163271] k3s[888]: time="2026-09-23T04:11:56Z" level=info msg="Active TLS secret kube-system/k3s-serving (ver=234) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__9444_53df_fe15_a875-f43026:fec0::9444:53df:fe15:a875 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=4D7939419C7D5854BBB1B8904A186B2ACBD6981F]" machine # [ 24.638789] k3s[888]: I0923 04:11:57.419196 888 controllermanager.go:627] "Warning: controller is disabled" controller="bootstrap-signer-controller" machine # [ 24.783472] k3s[888]: I0923 04:11:57.563399 888 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" requiredFeatureGates=["ClusterTrustBundle"] machine # [ 24.785198] k3s[888]: I0923 04:11:57.563468 888 controllermanager.go:579] "Warning: skipping controller" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" machine # [ 24.785797] k3s[888]: I0923 04:11:57.563502 888 controllermanager.go:579] "Warning: skipping controller" controller="storage-version-migrator-controller" machine # [ 24.931875] k3s[888]: I0923 04:11:57.712187 888 node_lifecycle_controller.go:419] "Controller will reconcile labels" logger="node-lifecycle-controller" machine # [ 24.988793] k3s[888]: time="2026-09-23T04:11:57Z" level=info msg="Starting k3s.cattle.io/v1, Kind=Addon controller" machine # [ 24.990347] k3s[888]: time="2026-09-23T04:11:57Z" level=info msg="Creating deploy event broadcaster" machine # [ 24.991855] k3s[888]: I0923 04:11:57.772345 888 controller.go:667] quota admission added evaluator for: addons.k3s.cattle.io machine # [ 24.997605] k3s[888]: time="2026-09-23T04:11:57Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=ApplyingManifest type=Normal machine # [ 25.003711] k3s[888]: time="2026-09-23T04:11:57Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 25.006143] k3s[888]: time="2026-09-23T04:11:57Z" level=info msg="Creating helm-controller event broadcaster" machine # [ 25.016117] k3s[888]: time="2026-09-23T04:11:57Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 25.024097] k3s[888]: time="2026-09-23T04:11:57Z" level=info msg="Cluster dns configmap has been set successfully" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 25.434077] k3s[888]: time="2026-09-23T04:11:58Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=AppliedManifest type=Normal machine # [ 25.444540] k3s[888]: time="2026-09-23T04:11:58Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=ApplyingManifest type=Normal machine # [ 25.626261] k3s[888]: I0923 04:11:58.406769 888 controllermanager.go:627] "Warning: controller is disabled" controller="selinux-warning-controller" machine # [ 25.787370] k3s[888]: time="2026-09-23T04:11:58Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=AppliedManifest type=Normal machine # [ 25.802030] k3s[888]: time="2026-09-23T04:11:58Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=ApplyingManifest type=Normal machine # [ 26.006360] k3s[888]: time="2026-09-23T04:11:58Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 26.124716] k3s[888]: time="2026-09-23T04:11:58Z" level=info msg="Starting rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding controller" machine # [ 26.128261] k3s[888]: time="2026-09-23T04:11:58Z" level=info msg="Starting batch/v1, Kind=Job controller" machine # [ 26.129030] k3s[888]: time="2026-09-23T04:11:58Z" level=info msg="Starting /v1, Kind=ConfigMap controller" machine # [ 26.130152] k3s[888]: time="2026-09-23T04:11:58Z" level=info msg="Starting /v1, Kind=ServiceAccount controller" machine # [ 26.130719] k3s[888]: time="2026-09-23T04:11:58Z" level=info msg="Starting /v1, Kind=Secret controller" machine # [ 26.137185] k3s[888]: time="2026-09-23T04:11:58Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChart controller" machine # [ 26.137864] k3s[888]: time="2026-09-23T04:11:58Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChartConfig controller" machine # [ 26.200256] k3s[888]: I0923 04:11:58.980752 888 serving.go:392] Generated self-signed cert in-memory machine # [ 26.239993] k3s[888]: I0923 04:11:59.020402 888 serving.go:392] Generated self-signed cert in-memory machine: (finished: waiting for success: kubectl get ns farm, in 2.57 seconds) machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key machine # [ 26.362442] k3s[888]: I0923 04:11:59.142952 888 controllermanager.go:160] Version: v1.35.8+k3s1 machine # [ 26.366121] k3s[888]: I0923 04:11:59.146392 888 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 26.367982] k3s[888]: I0923 04:11:59.146425 888 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 26.371170] k3s[888]: I0923 04:11:59.146436 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.372814] k3s[888]: I0923 04:11:59.146459 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.374466] k3s[888]: I0923 04:11:59.146485 888 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 26.377086] k3s[888]: I0923 04:11:59.146504 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.380099] k3s[888]: I0923 04:11:59.147052 888 secure_serving.go:211] Serving securely on 127.0.0.1:10258 machine # [ 26.381512] k3s[888]: I0923 04:11:59.147513 888 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 26.385160] k3s[888]: time="2026-09-23T04:11:59Z" level=info msg="Creating service-lb-controller event broadcaster" machine # [ 26.466699] k3s[888]: I0923 04:11:59.246863 888 shared_informer.go:377] "Caches are synced" machine # [ 26.468052] k3s[888]: I0923 04:11:59.246902 888 shared_informer.go:377] "Caches are synced" machine # [ 26.469457] k3s[888]: I0923 04:11:59.246825 888 shared_informer.go:377] "Caches are synced" machine # [ 26.534429] k3s[888]: I0923 04:11:59.314951 888 controller.go:667] quota admission added evaluator for: deployments.apps machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key, in 0.19 seconds) machine: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key machine # [ 26.679680] k3s[888]: I0923 04:11:59.460096 888 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="storageversion-garbage-collector-controller" requiredFeatureGates=["APIServerIdentity","StorageVersionAPI"] machine # [ 26.682688] k3s[888]: I0923 04:11:59.460167 888 controllermanager.go:579] "Warning: skipping controller" controller="storageversion-garbage-collector-controller" machine # [ 26.685106] k3s[888]: I0923 04:11:59.465550 888 alloc.go:329] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.43.0.10"} machine # [ 26.687062] k3s[888]: time="2026-09-23T04:11:59Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=AppliedManifest type=Normal machine: (finished: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key, in 0.18 seconds) machine: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine # [ 26.743424] k3s[888]: time="2026-09-23T04:11:59Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 26.750456] k3s[888]: time="2026-09-23T04:11:59Z" level=info msg="Starting /v1, Kind=Pod controller" machine # [ 26.754931] k3s[888]: time="2026-09-23T04:11:59Z" level=info msg="Starting apps/v1, Kind=DaemonSet controller" machine # [ 26.761827] k3s[888]: I0923 04:11:59.540275 888 controllermanager.go:329] Started "cloud-node-controller" machine # [ 26.763280] k3s[888]: I0923 04:11:59.540409 888 controllermanager.go:329] Started "cloud-node-lifecycle-controller" machine # [ 26.764669] k3s[888]: time="2026-09-23T04:11:59Z" level=info msg="Starting discovery.k8s.io/v1, Kind=EndpointSlice controller" machine # [ 26.766224] k3s[888]: I0923 04:11:59.543464 888 node_controller.go:176] Sending events to api server. machine # [ 26.767550] k3s[888]: I0923 04:11:59.543573 888 node_controller.go:185] Waiting for informer caches to sync machine # [ 26.768846] k3s[888]: I0923 04:11:59.543660 888 node_lifecycle_controller.go:112] Sending events to api server machine # [ 26.770198] k3s[888]: I0923 04:11:59.544002 888 controllermanager.go:329] Started "service-lb-controller" machine # [ 26.771564] k3s[888]: W0923 04:11:59.544017 888 controllermanager.go:306] "node-route-controller" is disabled machine # [ 26.772933] k3s[888]: I0923 04:11:59.544246 888 controller.go:235] Starting service controller machine # [ 26.774075] k3s[888]: I0923 04:11:59.544294 888 shared_informer.go:370] "Waiting for caches to sync" machine: (finished: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.16 seconds) subtest: chart deploys and workers become Ready machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine # [ 26.964032] k3s[888]: I0923 04:11:59.744472 888 shared_informer.go:377] "Caches are synced" machine # [ 27.006931] k3s[888]: time="2026-09-23T04:11:59Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 27.188402] k3s[888]: I0923 04:11:59.968908 888 range_allocator.go:113] "No Secondary Service CIDR provided. Skipping filtering out secondary service addresses" logger="node-ipam-controller" machine # [ 27.220237] k3s[888]: time="2026-09-23T04:12:00Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" object=kube-system/local-storage reason=DeletingManifest type=Normal machine # [ 27.232297] k3s[888]: time="2026-09-23T04:12:00Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=ApplyingManifest type=Normal machine # [ 27.277764] k3s[888]: W0923 04:12:00.057843 888 probe.go:272] Flexvolume plugin directory at /usr/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating. machine # [ 27.281782] k3s[888]: I0923 04:12:00.062284 888 controller.go:667] quota admission added evaluator for: helmcharts.helm.cattle.io machine # [ 27.284931] k3s[888]: time="2026-09-23T04:12:00Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=AppliedManifest type=Normal machine # [ 27.296536] k3s[888]: time="2026-09-23T04:12:00Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=ApplyingManifest type=Normal machine # [ 27.433624] k3s[888]: time="2026-09-23T04:12:00Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Applying HelmChart from https://%{KUBERNETES_API}%/static/charts/nix-grpc-farm.tgz using Job kube-system/helm-install-nix-grpc-farm " object=kube-system/nix-grpc-farm reason=ApplyJob type=Normal machine # [ 27.464567] k3s[888]: I0923 04:12:00.245099 888 controller.go:667] quota admission added evaluator for: jobs.batch machine # [ 27.482087] k3s[888]: time="2026-09-23T04:12:00Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=AppliedManifest type=Normal machine # [ 27.495787] k3s[888]: time="2026-09-23T04:12:00Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=ApplyingManifest type=Normal machine # [ 27.611728] k3s[888]: time="2026-09-23T04:12:00Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=AppliedManifest type=Normal machine # [ 27.627359] k3s[888]: I0923 04:12:00.407901 888 taint_eviction.go:283] "Starting" controller="taint-eviction-controller" machine # [ 27.628045] k3s[888]: I0923 04:12:00.407962 888 taint_eviction.go:288] "Sending events to API server" machine # [ 27.628472] k3s[888]: I0923 04:12:00.407978 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.628971] k3s[888]: I0923 04:12:00.408763 888 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-legacy-unknown" machine # [ 27.629585] k3s[888]: I0923 04:12:00.408764 888 horizontal.go:204] "Starting HPA controller" machine # [ 27.630257] k3s[888]: I0923 04:12:00.408795 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.630689] k3s[888]: I0923 04:12:00.408807 888 publisher.go:107] "Starting root CA cert publisher controller" machine # [ 27.631174] k3s[888]: I0923 04:12:00.408824 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.631336] k3s[888]: I0923 04:12:00.408888 888 node_lifecycle_controller.go:453] "Sending events to api server" machine # [ 27.631806] k3s[888]: I0923 04:12:00.408915 888 node_lifecycle_controller.go:460] "Starting node controller" machine # [ 27.632453] k3s[888]: I0923 04:12:00.408925 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.632918] k3s[888]: I0923 04:12:00.409002 888 endpointslicemirroring_controller.go:226] "Starting EndpointSliceMirroring controller" machine # [ 27.633563] k3s[888]: I0923 04:12:00.409018 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.634055] k3s[888]: I0923 04:12:00.409088 888 cronjob_controllerv2.go:143] "Starting cronjob controller v2" machine # [ 27.634520] k3s[888]: I0923 04:12:00.409101 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.634988] k3s[888]: I0923 04:12:00.409133 888 certificate_controller.go:120] "Starting certificate controller" name="csrapproving" machine # [ 27.635833] k3s[888]: I0923 04:12:00.409146 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.636459] k3s[888]: I0923 04:12:00.409187 888 ttlafterfinished_controller.go:112] "Starting TTL after finished controller" machine # [ 27.636898] k3s[888]: I0923 04:12:00.409201 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.637539] k3s[888]: I0923 04:12:00.409230 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.638035] k3s[888]: I0923 04:12:00.409486 888 daemon_controller.go:309] "Starting daemon sets controller" machine # [ 27.638506] k3s[888]: I0923 04:12:00.409499 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.638969] k3s[888]: I0923 04:12:00.409539 888 cleaner.go:83] "Starting CSR cleaner controller" machine # [ 27.639695] k3s[888]: I0923 04:12:00.409575 888 ttl_controller.go:127] "Starting TTL controller" machine # [ 27.640094] k3s[888]: I0923 04:12:00.409589 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.640572] k3s[888]: I0923 04:12:00.409641 888 tokencleaner.go:117] "Starting token cleaner controller" machine # [ 27.641060] k3s[888]: I0923 04:12:00.409656 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.641585] k3s[888]: I0923 04:12:00.409740 888 pv_controller_base.go:307] "Starting persistent volume controller" machine # [ 27.642074] k3s[888]: I0923 04:12:00.409753 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.642612] k3s[888]: I0923 04:12:00.409784 888 pv_protection_controller.go:81] "Starting PV protection controller" machine # [ 27.643179] k3s[888]: I0923 04:12:00.409796 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.643332] k3s[888]: I0923 04:12:00.409867 888 endpointslice_controller.go:283] "Starting endpoint slice controller" machine # [ 27.643809] k3s[888]: I0923 04:12:00.409879 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.644456] k3s[888]: I0923 04:12:00.409948 888 deployment_controller.go:172] "Starting controller" controller="deployment" machine # [ 27.644968] k3s[888]: I0923 04:12:00.409962 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.645641] k3s[888]: I0923 04:12:00.410054 888 node_ipam_controller.go:142] "Starting ipam controller" machine # [ 27.646185] k3s[888]: I0923 04:12:00.410066 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.646770] k3s[888]: I0923 04:12:00.410132 888 attach_detach_controller.go:335] "Starting attach detach controller" machine # [ 27.647522] k3s[888]: I0923 04:12:00.410146 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.648089] k3s[888]: I0923 04:12:00.410176 888 clusterroleaggregation_controller.go:194] "Starting ClusterRoleAggregator controller" machine # [ 27.648590] k3s[888]: I0923 04:12:00.410233 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.649114] k3s[888]: I0923 04:12:00.410265 888 vac_protection_controller.go:206] "Starting VAC protection controller" machine # [ 27.649708] k3s[888]: I0923 04:12:00.410279 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.649916] k3s[888]: I0923 04:12:00.410495 888 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-serving" machine # [ 27.650629] k3s[888]: I0923 04:12:00.410508 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.651258] k3s[888]: I0923 04:12:00.410545 888 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-client" machine # [ 27.651791] k3s[888]: I0923 04:12:00.410558 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.652626] k3s[888]: I0923 04:12:00.410594 888 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kube-apiserver-client" machine # [ 27.653131] k3s[888]: I0923 04:12:00.410606 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.653688] k3s[888]: I0923 04:12:00.410678 888 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 27.654569] k3s[888]: I0923 04:12:00.410759 888 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 27.655069] k3s[888]: I0923 04:12:00.410874 888 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 27.655594] k3s[888]: I0923 04:12:00.410922 888 garbagecollector.go:141] "Starting controller" controller="garbagecollector" machine # [ 27.655791] k3s[888]: I0923 04:12:00.410933 888 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 27.657647] k3s[888]: I0923 04:12:00.410958 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.659101] k3s[888]: I0923 04:12:00.411306 888 graph_builder.go:386] "Running" component="GraphBuilder" machine # [ 27.660687] k3s[888]: I0923 04:12:00.408780 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.661860] k3s[888]: I0923 04:12:00.411816 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.702508] k3s[888]: I0923 04:12:00.411907 888 replica_set.go:241] "Starting controller" name="replicaset" machine # [ 27.703197] k3s[888]: I0923 04:12:00.411921 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.703669] k3s[888]: I0923 04:12:00.412007 888 servicecidrs_controller.go:136] "Starting" controller="service-cidr-controller" machine # [ 27.704154] k3s[888]: I0923 04:12:00.412020 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.704631] k3s[888]: I0923 04:12:00.412102 888 endpoints_controller.go:193] "Starting endpoint controller" machine # [ 27.705110] k3s[888]: I0923 04:12:00.412115 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.705595] k3s[888]: I0923 04:12:00.412457 888 stateful_set.go:180] "Starting stateful set controller" machine # [ 27.706083] k3s[888]: I0923 04:12:00.412471 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.706553] k3s[888]: I0923 04:12:00.412560 888 controller.go:423] "Starting resource claim controller" machine # [ 27.707037] k3s[888]: I0923 04:12:00.412576 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.707517] k3s[888]: I0923 04:12:00.412588 888 gc_controller.go:98] "Starting GC controller" machine # [ 27.707982] k3s[888]: I0923 04:12:00.412606 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.708644] k3s[888]: I0923 04:12:00.412670 888 serviceaccounts_controller.go:117] "Starting service account controller" machine # [ 27.709192] k3s[888]: I0923 04:12:00.412685 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.712640] k3s[888]: I0923 04:12:00.412742 888 pvc_protection_controller.go:166] "Starting PVC protection controller" machine # [ 27.713484] k3s[888]: I0923 04:12:00.412748 888 replica_set.go:241] "Starting controller" name="replicationcontroller" machine # [ 27.713679] k3s[888]: I0923 04:12:00.412765 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.714472] k3s[888]: I0923 04:12:00.412770 888 namespace_controller.go:202] "Starting namespace controller" machine # [ 27.714958] k3s[888]: I0923 04:12:00.412786 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.715608] k3s[888]: I0923 04:12:00.412799 888 resource_quota_controller.go:297] "Starting resource quota controller" machine # [ 27.716111] k3s[888]: I0923 04:12:00.412815 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.716572] k3s[888]: I0923 04:12:00.412754 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.717116] k3s[888]: I0923 04:12:00.412915 888 resource_quota_monitor.go:309] "QuotaMonitor running" machine # [ 27.717601] k3s[888]: I0923 04:12:00.412936 888 expand_controller.go:328] "Starting expand controller" machine # [ 27.718081] k3s[888]: I0923 04:12:00.412950 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.718668] k3s[888]: I0923 04:12:00.412988 888 controller.go:174] "Starting ephemeral volume controller" machine # [ 27.718986] k3s[888]: I0923 04:12:00.413000 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.719711] k3s[888]: I0923 04:12:00.412874 888 job_controller.go:254] "Starting job controller" machine # [ 27.720480] k3s[888]: I0923 04:12:00.413054 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.720836] k3s[888]: I0923 04:12:00.412898 888 disruption.go:458] "Sending events to api server." machine # [ 27.721488] k3s[888]: I0923 04:12:00.413123 888 disruption.go:465] "Starting disruption controller" machine # [ 27.721967] k3s[888]: I0923 04:12:00.413135 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.722802] k3s[888]: I0923 04:12:00.413038 888 legacy_serviceaccount_token_cleaner.go:103] "Starting legacy service account token cleaner controller" machine # [ 27.723589] k3s[888]: I0923 04:12:00.413248 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.724126] k3s[888]: I0923 04:12:00.416757 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.782620] k3s[888]: I0923 04:12:00.562061 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.004842] k3s[888]: time="2026-09-23T04:12:00Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 28.055663] k3s[888]: time="2026-09-23T04:12:00Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/traefik.yaml\"" object=kube-system/traefik reason=DeletingManifest type=Normal machine # [ 28.128643] k3s[888]: I0923 04:12:00.909133 888 shared_informer.go:377] "Caches are synced" machine # [ 28.129136] k3s[888]: I0923 04:12:00.909165 888 shared_informer.go:377] "Caches are synced" machine # [ 28.129726] k3s[888]: I0923 04:12:00.909203 888 shared_informer.go:377] "Caches are synced" machine # [ 28.130242] k3s[888]: I0923 04:12:00.909243 888 shared_informer.go:377] "Caches are synced" machine # [ 28.130695] k3s[888]: I0923 04:12:00.909285 888 shared_informer.go:377] "Caches are synced" machine # [ 28.132590] k3s[888]: I0923 04:12:00.909339 888 shared_informer.go:377] "Caches are synced" machine # [ 28.133158] k3s[888]: I0923 04:12:00.909641 888 shared_informer.go:377] "Caches are synced" machine # [ 28.133661] k3s[888]: I0923 04:12:00.909662 888 shared_informer.go:377] "Caches are synced" machine # [ 28.134147] k3s[888]: I0923 04:12:00.909711 888 shared_informer.go:377] "Caches are synced" machine # [ 28.134664] k3s[888]: I0923 04:12:00.909799 888 shared_informer.go:377] "Caches are synced" machine # [ 28.136087] k3s[888]: I0923 04:12:00.909842 888 shared_informer.go:377] "Caches are synced" machine # [ 28.136786] k3s[888]: I0923 04:12:00.909918 888 shared_informer.go:377] "Caches are synced" machine # [ 28.137503] k3s[888]: I0923 04:12:00.910000 888 shared_informer.go:377] "Caches are synced" machine # [ 28.138032] k3s[888]: I0923 04:12:00.911407 888 shared_informer.go:377] "Caches are synced" machine # [ 28.138502] k3s[888]: I0923 04:12:00.911910 888 shared_informer.go:377] "Caches are synced" machine # [ 28.138975] k3s[888]: I0923 04:12:00.911958 888 shared_informer.go:377] "Caches are synced" machine # [ 28.139641] k3s[888]: I0923 04:12:00.912071 888 shared_informer.go:377] "Caches are synced" machine # [ 28.140148] k3s[888]: I0923 04:12:00.912295 888 shared_informer.go:377] "Caches are synced" machine # [ 28.140634] k3s[888]: I0923 04:12:00.913502 888 shared_informer.go:377] "Caches are synced" machine # [ 28.141149] k3s[888]: I0923 04:12:00.914302 888 shared_informer.go:377] "Caches are synced" machine # [ 28.141661] k3s[888]: I0923 04:12:00.914339 888 shared_informer.go:377] "Caches are synced" machine # [ 28.142145] k3s[888]: I0923 04:12:00.914420 888 shared_informer.go:377] "Caches are synced" machine # [ 28.142628] k3s[888]: I0923 04:12:00.914461 888 shared_informer.go:377] "Caches are synced" machine # [ 28.143148] k3s[888]: I0923 04:12:00.914518 888 shared_informer.go:377] "Caches are synced" machine # [ 28.143619] k3s[888]: I0923 04:12:00.914556 888 shared_informer.go:377] "Caches are synced" machine # [ 28.144107] k3s[888]: I0923 04:12:00.914616 888 shared_informer.go:377] "Caches are synced" machine # [ 28.144609] k3s[888]: I0923 04:12:00.916994 888 shared_informer.go:377] "Caches are synced" machine # [ 28.157035] k3s[888]: I0923 04:12:00.937530 888 shared_informer.go:377] "Caches are synced" machine # [ 28.157710] k3s[888]: I0923 04:12:00.937595 888 shared_informer.go:377] "Caches are synced" machine # [ 28.159214] k3s[888]: I0923 04:12:00.939758 888 shared_informer.go:377] "Caches are synced" machine # [ 28.161025] k3s[888]: I0923 04:12:00.941556 888 shared_informer.go:377] "Caches are synced" machine # [ 28.166068] k3s[888]: I0923 04:12:00.944295 888 shared_informer.go:377] "Caches are synced" machine # [ 28.166725] k3s[888]: I0923 04:12:00.944431 888 shared_informer.go:377] "Caches are synced" machine # [ 28.167616] k3s[888]: I0923 04:12:00.945220 888 shared_informer.go:377] "Caches are synced" machine # [ 28.168156] k3s[888]: I0923 04:12:00.945251 888 shared_informer.go:377] "Caches are synced" machine # [ 28.168698] k3s[888]: I0923 04:12:00.945284 888 shared_informer.go:377] "Caches are synced" machine # [ 28.169437] k3s[888]: I0923 04:12:00.945316 888 shared_informer.go:377] "Caches are synced" machine # [ 28.169940] k3s[888]: I0923 04:12:00.945352 888 shared_informer.go:377] "Caches are synced" machine # [ 28.171538] k3s[888]: I0923 04:12:00.945412 888 shared_informer.go:377] "Caches are synced" machine # [ 28.172054] k3s[888]: I0923 04:12:00.945599 888 shared_informer.go:377] "Caches are synced" machine # [ 28.172566] k3s[888]: I0923 04:12:00.945668 888 shared_informer.go:377] "Caches are synced" machine # [ 28.175077] k3s[888]: I0923 04:12:00.945703 888 shared_informer.go:377] "Caches are synced" machine # [ 28.175620] k3s[888]: I0923 04:12:00.941614 888 range_allocator.go:177] "Sending events to api server" machine # [ 28.176139] k3s[888]: I0923 04:12:00.950879 888 range_allocator.go:181] "Starting range CIDR allocator" machine # [ 28.176296] k3s[888]: I0923 04:12:00.950900 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.176730] k3s[888]: I0923 04:12:00.950920 888 shared_informer.go:377] "Caches are synced" machine # [ 28.220348] k3s[888]: time="2026-09-23T04:12:01Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Deferred node password secret validation complete" object=machine reason=NodePasswordValidationComplete type=Normal machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 28.330493] k3s[888]: I0923 04:12:01.110938 888 controller.go:667] quota admission added evaluator for: replicasets.apps machine # [ 28.431397] k3s[888]: I0923 04:12:01.211903 888 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 28.435413] k3s[888]: I0923 04:12:01.215911 888 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 28.496841] k3s[888]: time="2026-09-23T04:12:01Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Resumed synced Job kube-system/helm-install-nix-grpc-farm" object=kube-system/nix-grpc-farm reason=ResumeJob type=Normal machine # [ 29.005077] k3s[888]: time="2026-09-23T04:12:01Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 29.082520] k3s[888]: I0923 04:12:01.863013 888 shared_informer.go:377] "Caches are synced" machine # [ 29.131172] k3s[888]: I0923 04:12:01.911674 888 shared_informer.go:377] "Caches are synced" machine # [ 29.131839] k3s[888]: I0923 04:12:01.911707 888 garbagecollector.go:166] "Garbage collector: all resource monitors have synced" machine # [ 29.132475] k3s[888]: I0923 04:12:01.911718 888 garbagecollector.go:169] "Proceeding to collect garbage" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 29.675888] postgres[1196]: [1196] ERROR: relation "goose_db_version" does not exist at character 36 machine # [ 29.676722] postgres[1196]: [1196] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC machine # [ 29.700346] niks3-server[1188]: 2026/09/23 04:12:02 OK 20241026095416_initial_model.sql (10.63ms) machine # [ 29.705352] niks3-server[1188]: 2026/09/23 04:12:02 OK 20251210153512_drop_unused_gin_index.sql (5.4ms) machine # [ 29.711541] niks3-server[1188]: 2026/09/23 04:12:02 OK 20251218171726_add_pins.sql (6.15ms) machine # [ 29.716978] niks3-server[1188]: 2026/09/23 04:12:02 OK 20260628120000_add_object_size_and_stats.sql (5.37ms) machine # [ 29.722491] niks3-server[1188]: 2026/09/23 04:12:02 OK 20260905000000_add_claims.sql (5.44ms) machine # [ 29.727068] niks3-server[1188]: 2026/09/23 04:12:02 OK 20260920000000_drop_claims.sql (4.27ms) machine # [ 29.727750] niks3-server[1188]: 2026/09/23 04:12:02 goose: successfully migrated database to version: 20260920000000 machine # [ 29.733126] niks3-server[1188]: 2026/09/23 04:12:02 OK 1_commit_pending_closure.sql (5.96ms) machine # [ 29.735356] niks3-server[1188]: 2026/09/23 04:12:02 OK 2_object_stats_trigger.sql (2.3ms) machine # [ 29.736165] niks3-server[1188]: 2026/09/23 04:12:02 goose: up to current file version: 2 machine # [ 29.740349] niks3-server[1188]: 2026/09/23 04:12:02 INFO OIDC provider initialized name=kubernetes issuer=https://kubernetes.default.svc.cluster.local machine # [ 29.741087] niks3-server[1188]: 2026/09/23 04:12:02 INFO OIDC authentication enabled config=/nix/store/v0b0sqyzhrjsz48x3klf7b7vl89apzs0-niks3-oidc.json machine # [ 29.742136] niks3-server[1188]: 2026/09/23 04:12:02 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key machine # [ 29.776994] niks3-server[1188]: 2026/09/23 04:12:02 INFO Read proxy enabled — serving cache objects from S3 machine # [ 29.778466] niks3-server[1188]: 2026/09/23 04:12:02 INFO Using socket-activated listener address=0.0.0.0:5751 machine # [ 29.779453] niks3-server[1188]: 2026/09/23 04:12:02 INFO Starting HTTP server address=0.0.0.0:5751 machine # [ 29.780197] niks3-server[1188]: 2026/09/23 04:12:02 INFO systemd watchdog enabled interval=15s machine # [ 29.781797] systemd[1]: Started niks3 server. machine # [ 29.782879] systemd[1]: Reached target Multi-User System. machine # [ 29.783845] systemd[1]: Startup finished in 1.226s (kernel) + 3.737s (initrd) + 24.818s (userspace) = 29.782s. machine # [ 30.005891] k3s[888]: time="2026-09-23T04:12:02Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 30.782934] k3s[888]: time="2026-09-23T04:12:03Z" level=info msg="Imported docker.io/library/nix-grpc-farm-client:0.1.0-beta.3" machine # [ 30.787083] k3s[888]: time="2026-09-23T04:12:03Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-client@sha256:895efb6f27f391b8483e516b3e082c48f1f286de8cab9ab60555e0fcddc52637" machine # [ 31.009094] k3s[888]: time="2026-09-23T04:12:03Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 31.062416] k3s[888]: time="2026-09-23T04:12:03Z" level=info msg="Started tunnel to 10.0.2.15:6443" machine # [ 31.064316] k3s[888]: time="2026-09-23T04:12:03Z" level=info msg="Stopped tunnel to 127.0.0.1:6443" machine # [ 31.065390] k3s[888]: time="2026-09-23T04:12:03Z" level=info msg="Connecting to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 31.066880] k3s[888]: time="2026-09-23T04:12:03Z" level=info msg="Proxy done" err="context canceled" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 31.075077] k3s[888]: time="2026-09-23T04:12:03Z" level=info msg="error in remotedialer server [400]: websocket: close 1006 (abnormal closure): unexpected EOF" machine # [ 31.079095] k3s[888]: time="2026-09-23T04:12:03Z" level=info msg="Handling backend connection request [machine]" machine # [ 31.080144] k3s[888]: time="2026-09-23T04:12:03Z" level=info msg="Connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 31.081317] k3s[888]: time="2026-09-23T04:12:03Z" level=info msg="Remotedialer connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 31.275841] k3s[888]: time="2026-09-23T04:12:04Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-client.tar in 7.490181013s" machine # [ 31.277686] k3s[888]: time="2026-09-23T04:12:04Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-lb.tar" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 32.005206] k3s[888]: time="2026-09-23T04:12:04Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 32.946051] k3s[888]: time="2026-09-23T04:12:05Z" level=info msg="Imported docker.io/library/nix-grpc-farm-lb:0.1.0-beta.3" machine # [ 32.948750] k3s[888]: time="2026-09-23T04:12:05Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-lb@sha256:18ee6724be589622e1aee9d13c5121e7b2c992ca636c935ade90c66423e18f37" machine # [ 32.995957] k3s[888]: time="2026-09-23T04:12:05Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-lb.tar in 1.718560878s" machine # [ 32.998247] k3s[888]: time="2026-09-23T04:12:05Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm.tar" machine # [ 33.005724] k3s[888]: time="2026-09-23T04:12:05Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 33.080385] k3s[888]: time="2026-09-23T04:12:05Z" level=info msg="Running kubelet --cloud-provider=external --config-dir=/var/lib/rancher/k3s/agent/etc/kubelet.conf.d --containerd=/run/k3s/containerd/containerd.sock --eviction-hard=nodefs.available<1%,imagefs.available<1% --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubelet.kubeconfig --node-ip=10.0.2.15,fec0::9444:53df:fe15:a875 --node-labels= --read-only-port=0" machine # [ 33.085861] k3s[888]: Flag --containerd has been deprecated, This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed. machine # [ 33.088808] k3s[888]: I0923 04:12:05.869025 888 server.go:521] "Kubelet version" kubeletVersion="v1.35.8+k3s1" machine # [ 33.090358] k3s[888]: I0923 04:12:05.869046 888 server.go:523] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 33.092070] k3s[888]: I0923 04:12:05.869078 888 watchdog_linux.go:95] "Systemd watchdog is not enabled" machine # [ 33.093486] k3s[888]: I0923 04:12:05.869089 888 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." machine # [ 33.095680] k3s[888]: I0923 04:12:05.870566 888 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/agent/client-ca.crt" machine # [ 33.097840] k3s[888]: I0923 04:12:05.874864 888 server.go:1414] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" machine # [ 33.099671] k3s[888]: I0923 04:12:05.879703 888 server.go:771] "--cgroups-per-qos enabled, but --cgroup-root was not specified. Defaulting to /" machine # [ 33.101548] k3s[888]: I0923 04:12:05.879732 888 server.go:832] "NoSwap is set due to memorySwapBehavior not specified" memorySwapBehavior="" FailSwapOn=false machine # [ 33.103636] k3s[888]: I0923 04:12:05.879940 888 container_manager_linux.go:272] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] machine # [ 33.105590] k3s[888]: I0923 04:12:05.879964 888 container_manager_linux.go:277] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"machine","RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} machine # [ 33.119712] k3s[888]: I0923 04:12:05.880156 888 topology_manager.go:143] "Creating topology manager with none policy" machine # [ 33.121262] k3s[888]: I0923 04:12:05.880172 888 container_manager_linux.go:308] "Creating device plugin manager" machine # [ 33.123357] k3s[888]: I0923 04:12:05.880239 888 container_manager_linux.go:317] "Creating Dynamic Resource Allocation (DRA) manager" machine # [ 33.125176] k3s[888]: I0923 04:12:05.885671 888 state_mem.go:41] "Initialized" logger="CPUManager state memory" machine # [ 33.126720] k3s[888]: I0923 04:12:05.885937 888 kubelet.go:482] "Attempting to sync node with API server" machine # [ 33.128207] k3s[888]: I0923 04:12:05.885955 888 kubelet.go:383] "Adding static pod path" path="/var/lib/rancher/k3s/agent/pod-manifests" machine # [ 33.130075] k3s[888]: I0923 04:12:05.885988 888 kubelet.go:394] "Adding apiserver pod source" machine # [ 33.131579] k3s[888]: I0923 04:12:05.886005 888 apiserver.go:42] "Waiting for node sync before watching apiserver pods" machine # [ 33.132469] k3s[888]: I0923 04:12:05.886892 888 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="containerd" version="2.2.7-k3s1" apiVersion="v1" machine # [ 33.132972] k3s[888]: I0923 04:12:05.887524 888 kubelet.go:945] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" machine # [ 33.133645] k3s[888]: I0923 04:12:05.887548 888 kubelet.go:972] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" machine # [ 33.134199] k3s[888]: I0923 04:12:05.890422 888 server.go:1252] "Started kubelet" machine # [ 33.134709] k3s[888]: I0923 04:12:05.890502 888 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 machine # [ 33.135417] k3s[888]: I0923 04:12:05.891345 888 server.go:317] "Adding debug handlers to kubelet server" machine # [ 33.136063] k3s[888]: I0923 04:12:05.891911 888 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 machine # [ 33.136595] k3s[888]: I0923 04:12:05.891966 888 server_v1.go:49] "podresources" method="list" useActivePods=true machine # [ 33.137138] k3s[888]: I0923 04:12:05.892091 888 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" machine # [ 33.137622] k3s[888]: I0923 04:12:05.892785 888 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" machine # [ 33.138168] k3s[888]: I0923 04:12:05.894246 888 dynamic_serving_content.go:135] "Starting controller" name="kubelet-server-cert-files::/var/lib/rancher/k3s/agent/serving-kubelet.crt::/var/lib/rancher/k3s/agent/serving-kubelet.key" machine # [ 33.138670] k3s[888]: I0923 04:12:05.894903 888 volume_manager.go:311] "Starting Kubelet Volume Manager" machine # [ 33.139432] k3s[888]: I0923 04:12:05.895078 888 desired_state_of_world_populator.go:146] "Desired state populator starts to run" machine # [ 33.139971] k3s[888]: I0923 04:12:05.895135 888 reconciler.go:29] "Reconciler: start to sync state" machine # [ 33.140743] k3s[888]: I0923 04:12:05.898598 888 factory.go:223] Registration of the systemd container factory successfully machine # [ 33.141710] k3s[888]: I0923 04:12:05.898731 888 factory.go:221] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory machine # [ 33.142294] k3s[888]: E0923 04:12:05.899097 888 kubelet_node_status.go:392] "Error getting the current node from lister" err="node \"machine\" not found" machine # [ 33.143098] k3s[888]: I0923 04:12:05.900681 888 factory.go:223] Registration of the containerd container factory successfully machine # [ 33.144826] k3s[888]: E0923 04:12:05.901648 888 kubelet.go:1661] "Image garbage collection failed once. Stats initialization may not have completed yet" err="invalid capacity 0 on image filesystem" machine # [ 33.145617] k3s[888]: E0923 04:12:05.907242 888 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"machine\" not found" node="machine" machine # [ 33.146134] k3s[888]: I0923 04:12:05.915610 888 cpu_manager.go:225] "Starting" policy="none" machine # [ 33.146627] k3s[888]: I0923 04:12:05.915674 888 cpu_manager.go:226] "Reconciling" reconcilePeriod="10s" machine # [ 33.147149] k3s[888]: I0923 04:12:05.915847 888 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" machine # [ 33.147825] k3s[888]: I0923 04:12:05.920862 888 policy_none.go:50] "Start" machine # [ 33.148480] k3s[888]: I0923 04:12:05.920881 888 memory_manager.go:187] "Starting memorymanager" policy="None" machine # [ 33.148960] k3s[888]: I0923 04:12:05.920898 888 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" machine # [ 33.149687] k3s[888]: I0923 04:12:05.924212 888 policy_none.go:44] "Start" machine # [ 33.150850] systemd[1]: Created slice libcontainer container kubepods.slice. machine # [ 33.183746] systemd[1]: Created slice libcontainer container kubepods-burstable.slice. machine # [ 33.187299] systemd[1]: Created slice libcontainer container kubepods-besteffort.slice. machine # [ 33.193675] k3s[888]: E0923 04:12:05.974189 888 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" machine # [ 33.196125] k3s[888]: I0923 04:12:05.974316 888 eviction_manager.go:194] "Eviction manager: starting control loop" machine # [ 33.197616] k3s[888]: I0923 04:12:05.974347 888 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" machine # [ 33.199315] k3s[888]: I0923 04:12:05.974726 888 plugin_manager.go:121] "Starting Kubelet Plugin Manager" machine # [ 33.202067] k3s[888]: E0923 04:12:05.982168 888 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="no imagefs label for configured runtime" machine # [ 33.204906] k3s[888]: E0923 04:12:05.982224 888 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"machine\" not found" machine # [ 33.253697] k3s[888]: I0923 04:12:06.034205 888 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" machine # [ 33.259021] k3s[888]: I0923 04:12:06.039540 888 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" machine # [ 33.259495] k3s[888]: I0923 04:12:06.039592 888 status_manager.go:249] "Starting to sync pod status with apiserver" machine # [ 33.259871] k3s[888]: I0923 04:12:06.039664 888 kubelet.go:2506] "Starting kubelet main sync loop" machine # [ 33.260608] k3s[888]: E0923 04:12:06.039720 888 kubelet.go:2530] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" machine # [ 33.297928] k3s[888]: I0923 04:12:06.078014 888 kubelet_node_status.go:74] "Attempting to register node" node="machine" machine # [ 33.303196] k3s[888]: I0923 04:12:06.083706 888 kubelet_node_status.go:77] "Successfully registered node" node="machine" machine # [ 33.303772] k3s[888]: E0923 04:12:06.083738 888 kubelet_node_status.go:474] "Error updating node status, will retry" err="error getting node \"machine\": node \"machine\" not found" machine # [ 33.306367] k3s[888]: I0923 04:12:06.086913 888 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"machine\" does not exist" machine # [ 33.315104] k3s[888]: time="2026-09-23T04:12:06Z" level=info msg="Adding node OwnerReference to node-password secret machine.node-password.k3s" machine # [ 33.315808] k3s[888]: I0923 04:12:06.094998 888 node_controller.go:429] Initializing node machine with cloud provider machine # [ 33.316288] k3s[888]: I0923 04:12:06.095088 888 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 33.316897] k3s[888]: E0923 04:12:06.095139 888 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 33.323658] k3s[888]: I0923 04:12:06.104227 888 node_controller.go:429] Initializing node machine with cloud provider machine # [ 33.324719] k3s[888]: I0923 04:12:06.105263 888 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 33.325836] k3s[888]: E0923 04:12:06.105297 888 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 33.336071] k3s[888]: I0923 04:12:06.115462 888 node_controller.go:429] Initializing node machine with cloud provider machine # [ 33.336736] k3s[888]: I0923 04:12:06.115519 888 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 33.337196] k3s[888]: E0923 04:12:06.115550 888 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 33.337747] k3s[888]: time="2026-09-23T04:12:06Z" level=info msg="Synced coredns NodeHosts entries for machine" machine # [ 33.338458] k3s[888]: I0923 04:12:06.116873 888 range_allocator.go:433] "Set node PodCIDR" node="machine" podCIDRs=["10.42.0.0/24"] machine # [ 33.342327] k3s[888]: time="2026-09-23T04:12:06Z" level=info msg="Annotations and labels have been set successfully on node: machine" machine # [ 33.347059] k3s[888]: time="2026-09-23T04:12:06Z" level=info msg="Starting flannel with backend vxlan" machine # [ 33.348687] k3s[888]: I0923 04:12:06.129253 888 node_controller.go:429] Initializing node machine with cloud provider machine # [ 33.363814] k3s[888]: I0923 04:12:06.144366 888 node_controller.go:474] Successfully initialized node machine with cloud provider machine # [ 33.364626] k3s[888]: I0923 04:12:06.144695 888 event.go:389] "Event occurred" object="machine" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="Synced" message="Node synced successfully" machine # [ 33.369328] k3s[888]: I0923 04:12:06.149871 888 server.go:173] "Starting Kubernetes Scheduler" version="v1.35.8+k3s1" machine # [ 33.369780] k3s[888]: I0923 04:12:06.149901 888 server.go:175] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 33.373654] k3s[888]: I0923 04:12:06.153040 888 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 33.374487] k3s[888]: I0923 04:12:06.153073 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 33.374990] k3s[888]: I0923 04:12:06.153091 888 secure_serving.go:211] Serving securely on 127.0.0.1:10259 machine # [ 33.375527] k3s[888]: I0923 04:12:06.153101 888 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 33.376952] k3s[888]: I0923 04:12:06.153042 888 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 33.377600] k3s[888]: I0923 04:12:06.153136 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 33.378144] k3s[888]: I0923 04:12:06.153070 888 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 33.378697] k3s[888]: I0923 04:12:06.153397 888 shared_informer.go:370] "Waiting for caches to sync" machine # [ 33.379484] k3s[888]: I0923 04:12:06.153369 888 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 33.454147] k3s[888]: I0923 04:12:06.234529 888 kuberuntime_manager.go:2095] "Updating runtime config through cri with podcidr" CIDR="10.42.0.0/24" machine # [ 33.456825] k3s[888]: I0923 04:12:06.237323 888 kubelet_network.go:47] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.42.0.0/24" machine # [ 33.471374] k3s[888]: time="2026-09-23T04:12:06Z" level=info msg="Flannel found PodCIDR assigned for node machine" machine # [ 33.473058] k3s[888]: I0923 04:12:06.253507 888 shared_informer.go:377] "Caches are synced" machine # [ 33.474350] k3s[888]: I0923 04:12:06.253223 888 shared_informer.go:377] "Caches are synced" machine # [ 33.475661] k3s[888]: time="2026-09-23T04:12:06Z" level=info msg="The interface eth0 with ipv4 address 10.0.2.15 will be used by flannel" machine # [ 33.477308] k3s[888]: I0923 04:12:06.254785 888 kube.go:139] Waiting 10m0s for node controller to sync machine # [ 33.478614] k3s[888]: I0923 04:12:06.253171 888 shared_informer.go:377] "Caches are synced" machine # [ 33.479956] k3s[888]: I0923 04:12:06.254921 888 kube.go:537] Starting kube subnet manager machine # [ 33.564320] k3s[888]: I0923 04:12:06.344536 888 kubelet_node_status.go:427] "Fast updating node status as it just became ready" machine # [ 33.571055] k3s[888]: I0923 04:12:06.351570 888 topologycache.go:237] "Can't get CPU or zone information for node" node="machine" machine # [ 34.013785] k3s[888]: time="2026-09-23T04:12:06Z" level=info msg="Labels and annotations have been set successfully on node: machine" machine # [ 34.041912] k3s[888]: time="2026-09-23T04:12:06Z" level=info msg="Tunnel authorizer set Kubelet Port 0.0.0.0:10250" machine # [ 34.106394] k3s[888]: I0923 04:12:06.886855 888 apiserver.go:52] "Watching apiserver" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 34.220516] k3s[888]: I0923 04:12:07.001046 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-788z2\" (UniqueName: \"kubernetes.io/projected/ec6f0571-67d7-4d2b-b5d2-2301d9e21bbc-kube-api-access-788z2\") pod \"coredns-c5fdd76cf-xsk6r\" (UID: \"ec6f0571-67d7-4d2b-b5d2-2301d9e21bbc\") " pod="kube-system/coredns-c5fdd76cf-xsk6r" machine # [ 34.225407] k3s[888]: I0923 04:12:07.001091 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c258e18c-cfed-4d93-a5c6-2a075ae9ae95-tmp\") pod \"helm-install-nix-grpc-farm-tlfmg\" (UID: \"c258e18c-cfed-4d93-a5c6-2a075ae9ae95\") " pod="kube-system/helm-install-nix-grpc-farm-tlfmg" machine # [ 34.230037] k3s[888]: I0923 04:12:07.001123 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"values\" (UniqueName: \"kubernetes.io/projected/c258e18c-cfed-4d93-a5c6-2a075ae9ae95-values\") pod \"helm-install-nix-grpc-farm-tlfmg\" (UID: \"c258e18c-cfed-4d93-a5c6-2a075ae9ae95\") " pod="kube-system/helm-install-nix-grpc-farm-tlfmg" machine # [ 34.234476] k3s[888]: I0923 04:12:07.001148 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"content\" (UniqueName: \"kubernetes.io/configmap/c258e18c-cfed-4d93-a5c6-2a075ae9ae95-content\") pod \"helm-install-nix-grpc-farm-tlfmg\" (UID: \"c258e18c-cfed-4d93-a5c6-2a075ae9ae95\") " pod="kube-system/helm-install-nix-grpc-farm-tlfmg" machine # [ 34.239241] k3s[888]: I0923 04:12:07.001183 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kgwf\" (UniqueName: \"kubernetes.io/projected/c258e18c-cfed-4d93-a5c6-2a075ae9ae95-kube-api-access-2kgwf\") pod \"helm-install-nix-grpc-farm-tlfmg\" (UID: \"c258e18c-cfed-4d93-a5c6-2a075ae9ae95\") " pod="kube-system/helm-install-nix-grpc-farm-tlfmg" machine # [ 34.244354] k3s[888]: I0923 04:12:07.001211 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/c258e18c-cfed-4d93-a5c6-2a075ae9ae95-klipper-helm\") pod \"helm-install-nix-grpc-farm-tlfmg\" (UID: \"c258e18c-cfed-4d93-a5c6-2a075ae9ae95\") " pod="kube-system/helm-install-nix-grpc-farm-tlfmg" machine # [ 34.248631] k3s[888]: I0923 04:12:07.001246 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/c258e18c-cfed-4d93-a5c6-2a075ae9ae95-klipper-cache\") pod \"helm-install-nix-grpc-farm-tlfmg\" (UID: \"c258e18c-cfed-4d93-a5c6-2a075ae9ae95\") " pod="kube-system/helm-install-nix-grpc-farm-tlfmg" machine # [ 34.252908] k3s[888]: I0923 04:12:07.001272 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/c258e18c-cfed-4d93-a5c6-2a075ae9ae95-klipper-config\") pod \"helm-install-nix-grpc-farm-tlfmg\" (UID: \"c258e18c-cfed-4d93-a5c6-2a075ae9ae95\") " pod="kube-system/helm-install-nix-grpc-farm-tlfmg" machine # [ 34.257994] k3s[888]: I0923 04:12:07.001302 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ec6f0571-67d7-4d2b-b5d2-2301d9e21bbc-config-volume\") pod \"coredns-c5fdd76cf-xsk6r\" (UID: \"ec6f0571-67d7-4d2b-b5d2-2301d9e21bbc\") " pod="kube-system/coredns-c5fdd76cf-xsk6r" machine # [ 34.262554] k3s[888]: I0923 04:12:07.001329 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec6f0571-67d7-4d2b-b5d2-2301d9e21bbc-custom-config-volume\") pod \"coredns-c5fdd76cf-xsk6r\" (UID: \"ec6f0571-67d7-4d2b-b5d2-2301d9e21bbc\") " pod="kube-system/coredns-c5fdd76cf-xsk6r" machine # [ 34.268186] systemd[1]: Created slice libcontainer container kubepods-burstable-podc258e18c_cfed_4d93_a5c6_2a075ae9ae95.slice. machine # [ 34.269911] k3s[888]: I0923 04:12:07.025093 888 server.go:218] "Successfully retrieved NodeIPs" NodeIPs=["10.0.2.15","fec0::9444:53df:fe15:a875"] machine # [ 34.271830] k3s[888]: E0923 04:12:07.025182 888 server.go:255] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`" machine # [ 34.276153] systemd[1]: Created slice libcontainer container kubepods-burstable-podec6f0571_67d7_4d2b_b5d2_2301d9e21bbc.slice. machine # [ 34.308071] k3s[888]: I0923 04:12:07.088572 888 server.go:264] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4" machine # [ 34.308814] k3s[888]: I0923 04:12:07.088665 888 server_linux.go:136] "Using iptables Proxier" machine # [ 34.315271] k3s[888]: I0923 04:12:07.095821 888 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" machine # [ 34.336927] k3s[888]: I0923 04:12:07.117446 888 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4" machine # [ 34.345115] k3s[888]: I0923 04:12:07.125668 888 server.go:529] "Version info" version="v1.35.8+k3s1" machine # [ 34.345777] k3s[888]: I0923 04:12:07.125700 888 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 34.346465] k3s[888]: I0923 04:12:07.126996 888 config.go:200] "Starting service config controller" machine # [ 34.346991] k3s[888]: I0923 04:12:07.127017 888 shared_informer.go:349] "Waiting for caches to sync" controller="service config" machine # [ 34.347728] k3s[888]: I0923 04:12:07.127052 888 config.go:106] "Starting endpoint slice config controller" machine # [ 34.348557] k3s[888]: I0923 04:12:07.127065 888 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config" machine # [ 34.349094] k3s[888]: I0923 04:12:07.127094 888 config.go:403] "Starting serviceCIDR config controller" machine # [ 34.349577] k3s[888]: I0923 04:12:07.127106 888 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config" machine # [ 34.350107] k3s[888]: I0923 04:12:07.127748 888 config.go:309] "Starting node config controller" machine # [ 34.350595] k3s[888]: I0923 04:12:07.127798 888 shared_informer.go:349] "Waiting for caches to sync" controller="node config" machine # [ 34.351133] k3s[888]: I0923 04:12:07.127811 888 shared_informer.go:356] "Caches are synced" controller="node config" machine # [ 34.476075] k3s[888]: I0923 04:12:07.256553 888 kube.go:163] Node controller sync successful machine # [ 34.477413] k3s[888]: I0923 04:12:07.256698 888 vxlan.go:128] VXLAN config: VNI=1 Port=0 GBP=false Learning=false DirectRouting=false machine # [ 34.481189] k3s[888]: I0923 04:12:07.261670 888 kube.go:704] List of node(machine) annotations: map[string]string{"alpha.kubernetes.io/provided-node-ip":"10.0.2.15,fec0::9444:53df:fe15:a875", "k3s.io/hostname":"machine", "k3s.io/internal-ip":"10.0.2.15,fec0::9444:53df:fe15:a875", "k3s.io/node-args":"[\"server\",\"--disable\",\"traefik\",\"--disable\",\"metrics-server\",\"--disable\",\"local-storage\",\"--kubelet-arg\",\"eviction-hard=nodefs.available\\u003c1%,imagefs.available\\u003c1%\"]", "k3s.io/node-config-hash":"EFXPOZ7ZWHRCLFNW4X4ZDPFQMSAOP3BLEIN2VE47TDRKQ4UIWKUQ====", "k3s.io/node-env":"{}", "node.alpha.kubernetes.io/ttl":"0", "volumes.kubernetes.io/controller-managed-attach-detach":"true"} machine # [ 34.505457] (udev-worker)[1282]: Network interface NamePolicy= disabled on kernel command line. machine # [ 34.513629] k3s[888]: I0923 04:12:07.294116 888 iptables.go:50] Starting flannel in iptables mode... machine # [ 34.515036] k3s[888]: time="2026-09-23T04:12:07Z" level=warning msg="no subnet found for key: FLANNEL_NETWORK in file: /run/flannel/subnet.env" machine # [ 34.516916] k3s[888]: time="2026-09-23T04:12:07Z" level=warning msg="no subnet found for key: FLANNEL_SUBNET in file: /run/flannel/subnet.env" machine # [ 34.517561] k3s[888]: I0923 04:12:07.295246 888 kube.go:558] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.42.0.0/24] machine # [ 34.518064] k3s[888]: time="2026-09-23T04:12:07Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_NETWORK in file: /run/flannel/subnet.env" machine # [ 34.518596] k3s[888]: time="2026-09-23T04:12:07Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_SUBNET in file: /run/flannel/subnet.env" machine # [ 34.519146] k3s[888]: I0923 04:12:07.295694 888 iptables.go:101] Current network or subnet (10.42.0.0/16, 10.42.0.0/24) is not equal to previous one (0.0.0.0/0, 0.0.0.0/0), trying to recycle old iptables rules machine # [ 34.537241] dhcpcd[686]: flannel.1: IAID cd:27:4c:35 machine # [ 34.538311] dhcpcd[686]: flannel.1: adding address fe80::34f1:cdff:fe27:4c35 machine # [ 34.546873] k3s[888]: I0923 04:12:07.327416 888 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config" machine # [ 34.547556] k3s[888]: I0923 04:12:07.327415 888 shared_informer.go:356] "Caches are synced" controller="endpoint slice config" machine # [ 34.548182] k3s[888]: I0923 04:12:07.327452 888 shared_informer.go:356] "Caches are synced" controller="service config" machine # [ 34.588819] k3s[888]: I0923 04:12:07.369297 888 iptables.go:111] Setting up masking rules machine # [ 34.618808] k3s[888]: I0923 04:12:07.399247 888 iptables.go:212] Changing default FORWARD chain policy to ACCEPT machine # [ 34.630432] k3s[888]: time="2026-09-23T04:12:07Z" level=info msg="Wrote flannel subnet file to /run/flannel/subnet.env" machine # [ 34.631131] k3s[888]: time="2026-09-23T04:12:07Z" level=info msg="Running flannel backend" machine # [ 34.631809] k3s[888]: I0923 04:12:07.411032 888 vxlan_network.go:68] watching for new subnet leases machine # [ 34.632500] k3s[888]: I0923 04:12:07.411063 888 vxlan_network.go:115] starting vxlan device watcher machine # [ 34.667381] dhcpcd[686]: flannel.1: soliciting a DHCP lease machine # [ 34.677194] k3s[888]: E0923 04:12:07.457673 888 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f018b15dd685f71db9cd32dd3779803da02ed0ea001f2db7a622bf469ee36c3e\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" machine # [ 34.677974] k3s[888]: E0923 04:12:07.457829 888 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f018b15dd685f71db9cd32dd3779803da02ed0ea001f2db7a622bf469ee36c3e\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/helm-install-nix-grpc-farm-tlfmg" machine # [ 34.678820] k3s[888]: E0923 04:12:07.457866 888 kuberuntime_manager.go:1568] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"f018b15dd685f71db9cd32dd3779803da02ed0ea001f2db7a622bf469ee36c3e\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/helm-install-nix-grpc-farm-tlfmg" machine # [ 34.679902] k3s[888]: E0923 04:12:07.457976 888 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"helm-install-nix-grpc-farm-tlfmg_kube-system(c258e18c-cfed-4d93-a5c6-2a075ae9ae95)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"helm-install-nix-grpc-farm-tlfmg_kube-system(c258e18c-cfed-4d93-a5c6-2a075ae9ae95)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"f018b15dd685f71db9cd32dd3779803da02ed0ea001f2db7a622bf469ee36c3e\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/helm-install-nix-grpc-farm-tlfmg" podUID="c258e18c-cfed-4d93-a5c6-2a075ae9ae95" machine # [ 34.699879] k3s[888]: E0923 04:12:07.480060 888 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"32b257bd9234c94ce966f8dfa786beca0ca35385b681961e545ee139d1912fcc\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" machine # [ 34.700631] k3s[888]: E0923 04:12:07.480125 888 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"32b257bd9234c94ce966f8dfa786beca0ca35385b681961e545ee139d1912fcc\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-c5fdd76cf-xsk6r" machine # [ 34.701070] k3s[888]: E0923 04:12:07.480146 888 kuberuntime_manager.go:1568] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"32b257bd9234c94ce966f8dfa786beca0ca35385b681961e545ee139d1912fcc\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-c5fdd76cf-xsk6r" machine # [ 34.701765] k3s[888]: E0923 04:12:07.480212 888 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-c5fdd76cf-xsk6r_kube-system(ec6f0571-67d7-4d2b-b5d2-2301d9e21bbc)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-c5fdd76cf-xsk6r_kube-system(ec6f0571-67d7-4d2b-b5d2-2301d9e21bbc)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"32b257bd9234c94ce966f8dfa786beca0ca35385b681961e545ee139d1912fcc\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-c5fdd76cf-xsk6r" podUID="ec6f0571-67d7-4d2b-b5d2-2301d9e21bbc" machine # [ 34.745074] k3s[888]: I0923 04:12:07.525518 888 iptables.go:358] bootstrap done machine # [ 34.789429] k3s[888]: I0923 04:12:07.569912 888 iptables.go:358] bootstrap done machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 35.715246] k3s[888]: time="2026-09-23T04:12:08Z" level=info msg="Starting network policy controller version v2.6.3-k3s1, built on 1970-01-01T01:01:01Z, go1.26.7" machine # [ 35.715958] k3s[888]: I0923 04:12:08.495275 888 network_policy_controller.go:164] Starting network policy controller machine # [ 35.950146] k3s[888]: I0923 04:12:08.730668 888 network_policy_controller.go:179] Starting network policy controller full sync goroutine machine # [ 36.085190] dhcpcd[686]: flannel.1: soliciting an IPv6 router machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 37.403246] k3s[888]: time="2026-09-23T04:12:10Z" level=info msg="Imported docker.io/library/nix-grpc-farm:0.1.0-beta.3" machine # [ 37.405419] k3s[888]: time="2026-09-23T04:12:10Z" level=info msg="Tagged docker.io/library/nix-grpc-farm@sha256:e30cd496b257b4b26085b63b7cc7c5b12a79d2aa8efb80bc06fa23f5f51aa098" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 37.703521] k3s[888]: time="2026-09-23T04:12:10Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm.tar in 4.707230387s" machine # [ 38.129806] k3s[888]: I0923 04:12:10.910138 888 node_lifecycle_controller.go:1234] "Initializing eviction metric for zone" zone="" machine # [ 38.131485] k3s[888]: I0923 04:12:10.910368 888 node_lifecycle_controller.go:886] "Missing timestamp for Node. Assuming now as a timestamp" node="machine" machine # [ 38.137815] k3s[888]: I0923 04:12:10.918230 888 node_lifecycle_controller.go:1080] "Controller detected that zone is now in new state" zone="" newState="Normal" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 39.669860] dhcpcd[686]: flannel.1: probing for an IPv4LL address machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 45.505356] dhcpcd[686]: flannel.1: using IPv4LL address 169.254.229.172 machine # [ 45.507557] dhcpcd[686]: flannel.1: adding route to 169.254.0.0/16 machine # [ 46.499342] cni0: port 1(veth69bebca2) entered blocking state machine # [ 46.500251] cni0: port 1(veth69bebca2) entered disabled state machine # [ 46.501020] veth69bebca2: entered allmulticast mode machine # [ 46.501762] veth69bebca2: entered promiscuous mode machine # [ 46.506587] cni0: port 2(vethf09f55de) entered blocking state machine # [ 46.507324] cni0: port 2(vethf09f55de) entered disabled state machine # [ 46.509074] vethf09f55de: entered allmulticast mode machine # [ 46.510054] vethf09f55de: entered promiscuous mode machine # [ 46.518046] cni0: port 1(veth69bebca2) entered blocking state machine # [ 46.518704] cni0: port 1(veth69bebca2) entered forwarding state machine # [ 46.521213] cni0: port 2(vethf09f55de) entered blocking state machine # [ 46.521981] cni0: port 2(vethf09f55de) entered forwarding state machine # [ 46.376728] (udev-worker)[1852]: Network interface NamePolicy= disabled on kernel command line. machine # [ 46.385725] (udev-worker)[1857]: Network interface NamePolicy= disabled on kernel command line. machine # [ 46.386784] (udev-worker)[1865]: Network interface NamePolicy= disabled on kernel command line. machine # [ 46.418241] dhcpcd[686]: vethf09f55de: IAID 5d:3a:6f:ef machine # [ 46.419415] dhcpcd[686]: vethf09f55de: adding address fe80::d4bd:5dff:fe3a:6fef machine # [ 46.429191] dhcpcd[686]: veth69bebca2: IAID 6b:e6:7c:b9 machine # [ 46.429936] dhcpcd[686]: veth69bebca2: adding address fe80::8848:6bff:fee6:7cb9 machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 46.465738] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount2565245468.mount: Deactivated successfully. machine # [ 46.545304] systemd[1]: Started libcontainer container 48425da2965c0b5ae89e7a4ecf9e9c5528e8515cd007eca92bc3dd8938322de9. machine # [ 46.548283] systemd[1]: Started libcontainer container 959793450c35d95aa168d88c6692e58b16a8671019d88cd93c8a6e6a27903c38. machine # [ 47.037418] dhcpcd[686]: vethf09f55de: soliciting a DHCP lease machine # [ 47.301606] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount3783252121.mount: Deactivated successfully. machine # [ 47.328356] systemd[1]: Started libcontainer container d674bbac87a326e695b0c07f7d119c6badefb6b621127ba376f52bb6942fb21e. machine # [ 47.443192] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount204579513.mount: Deactivated successfully. machine # [ 47.481774] systemd[1]: Started libcontainer container 2f2aed28ad786a1c6ebc5cb61b20af61db2f727c1d24371641239b33ae9916b3. machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 47.697519] dhcpcd[686]: veth69bebca2: soliciting an IPv6 router machine # [ 47.913800] dhcpcd[686]: veth69bebca2: soliciting a DHCP lease machine # [ 48.088555] dhcpcd[686]: flannel.1: no IPv6 Routers available machine # [ 48.359379] k3s[888]: I0923 04:12:21.138406 888 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/helm-install-nix-grpc-farm-tlfmg" podStartSLOduration=20.138370235 podStartE2EDuration="20.138370235s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-23 04:12:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-23 04:12:21.123926779 +0000 UTC m=+31.465763943" watchObservedRunningTime="2026-09-23 04:12:21.138370235 +0000 UTC m=+31.480207399" machine # [ 48.555440] k3s[888]: I0923 04:12:21.335937 888 alloc.go:329] "allocated clusterIPs" service="farm/nix-grpc-farm" clusterIPs={"IPv4":"10.43.129.241"} machine # [ 48.601969] systemd[1]: cri-containerd-2f2aed28ad786a1c6ebc5cb61b20af61db2f727c1d24371641239b33ae9916b3.scope: Deactivated successfully. machine # [ 48.604888] systemd[1]: cri-containerd-2f2aed28ad786a1c6ebc5cb61b20af61db2f727c1d24371641239b33ae9916b3.scope: Consumed 710ms CPU time over 1.120s wall clock time, 35.4M memory peak, 2.4M incoming IP traffic, 142.5K outgoing IP traffic. machine # [ 48.646271] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-2f2aed28ad786a1c6ebc5cb61b20af61db2f727c1d24371641239b33ae9916b3-rootfs.mount: Deactivated successfully. machine # [ 48.880609] dhcpcd[686]: vethf09f55de: soliciting an IPv6 router machine # [ 49.071686] k3s[888]: I0923 04:12:21.851950 888 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/coredns-c5fdd76cf-xsk6r" podStartSLOduration=20.851906452 podStartE2EDuration="20.851906452s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-23 04:12:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-23 04:12:21.138775314 +0000 UTC m=+31.480612478" watchObservedRunningTime="2026-09-23 04:12:21.851906452 +0000 UTC m=+32.193748645" machine # [ 49.111205] k3s[888]: I0923 04:12:21.891674 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/21dae106-4811-4bcf-8bcd-f491dac23b61-tls-ca\") pod \"nix-grpc-farm-lb-775dbb5c7c-5hjch\" (UID: \"21dae106-4811-4bcf-8bcd-f491dac23b61\") " pod="farm/nix-grpc-farm-lb-775dbb5c7c-5hjch" machine # [ 49.119579] k3s[888]: I0923 04:12:21.891722 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/21dae106-4811-4bcf-8bcd-f491dac23b61-tls-lb\") pod \"nix-grpc-farm-lb-775dbb5c7c-5hjch\" (UID: \"21dae106-4811-4bcf-8bcd-f491dac23b61\") " pod="farm/nix-grpc-farm-lb-775dbb5c7c-5hjch" machine # [ 49.127457] k3s[888]: I0923 04:12:21.891760 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/e0f42e0f-885d-4fff-a7d7-a45f6878c2ca-tls\") pod \"nix-grpc-farm-scheduler-64688b4568-xjnp4\" (UID: \"e0f42e0f-885d-4fff-a7d7-a45f6878c2ca\") " pod="farm/nix-grpc-farm-scheduler-64688b4568-xjnp4" machine # [ 49.132327] k3s[888]: I0923 04:12:21.891793 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c75n\" (UniqueName: \"kubernetes.io/projected/e0f42e0f-885d-4fff-a7d7-a45f6878c2ca-kube-api-access-8c75n\") pod \"nix-grpc-farm-scheduler-64688b4568-xjnp4\" (UID: \"e0f42e0f-885d-4fff-a7d7-a45f6878c2ca\") " pod="farm/nix-grpc-farm-scheduler-64688b4568-xjnp4" machine # [ 49.137210] k3s[888]: I0923 04:12:21.891822 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/21dae106-4811-4bcf-8bcd-f491dac23b61-config\") pod \"nix-grpc-farm-lb-775dbb5c7c-5hjch\" (UID: \"21dae106-4811-4bcf-8bcd-f491dac23b61\") " pod="farm/nix-grpc-farm-lb-775dbb5c7c-5hjch" machine # [ 49.141880] k3s[888]: I0923 04:12:21.891845 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21dae106-4811-4bcf-8bcd-f491dac23b61-tmp\") pod \"nix-grpc-farm-lb-775dbb5c7c-5hjch\" (UID: \"21dae106-4811-4bcf-8bcd-f491dac23b61\") " pod="farm/nix-grpc-farm-lb-775dbb5c7c-5hjch" machine # [ 49.146116] k3s[888]: I0923 04:12:21.891867 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e0f42e0f-885d-4fff-a7d7-a45f6878c2ca-ca\") pod \"nix-grpc-farm-scheduler-64688b4568-xjnp4\" (UID: \"e0f42e0f-885d-4fff-a7d7-a45f6878c2ca\") " pod="farm/nix-grpc-farm-scheduler-64688b4568-xjnp4" machine # [ 49.151497] k3s[888]: I0923 04:12:21.891891 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/e0f42e0f-885d-4fff-a7d7-a45f6878c2ca-niks3-token\") pod \"nix-grpc-farm-scheduler-64688b4568-xjnp4\" (UID: \"e0f42e0f-885d-4fff-a7d7-a45f6878c2ca\") " pod="farm/nix-grpc-farm-scheduler-64688b4568-xjnp4" machine # [ 49.156075] k3s[888]: I0923 04:12:21.891938 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/e0f42e0f-885d-4fff-a7d7-a45f6878c2ca-oidc\") pod \"nix-grpc-farm-scheduler-64688b4568-xjnp4\" (UID: \"e0f42e0f-885d-4fff-a7d7-a45f6878c2ca\") " pod="farm/nix-grpc-farm-scheduler-64688b4568-xjnp4" machine # [ 49.160579] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod21dae106_4811_4bcf_8bcd_f491dac23b61.slice. machine # [ 49.162272] systemd[1]: Created slice libcontainer container kubepods-besteffort-pode0f42e0f_885d_4fff_a7d7_a45f6878c2ca.slice. machine # [ 49.170561] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod18bbc7be_2bd6_43ae_b30b_f5723fc72609.slice. machine # [ 49.186336] systemd[1]: Created slice libcontainer container kubepods-besteffort-podf9d75079_726f_4d01_93e9_5a364ec6d68f.slice. machine # [ 49.211936] k3s[888]: I0923 04:12:21.992457 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/18bbc7be-2bd6-43ae-b30b-f5723fc72609-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-9dqp6\" (UID: \"18bbc7be-2bd6-43ae-b30b-f5723fc72609\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-9dqp6" machine # [ 49.216620] k3s[888]: I0923 04:12:21.992510 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/f9d75079-726f-4d01-93e9-5a364ec6d68f-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lkpnh\" (UID: \"f9d75079-726f-4d01-93e9-5a364ec6d68f\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lkpnh" machine # [ 49.221789] k3s[888]: I0923 04:12:21.992642 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/f9d75079-726f-4d01-93e9-5a364ec6d68f-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lkpnh\" (UID: \"f9d75079-726f-4d01-93e9-5a364ec6d68f\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lkpnh" machine # [ 49.226407] k3s[888]: I0923 04:12:21.992672 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/f9d75079-726f-4d01-93e9-5a364ec6d68f-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lkpnh\" (UID: \"f9d75079-726f-4d01-93e9-5a364ec6d68f\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lkpnh" machine # [ 49.231731] k3s[888]: I0923 04:12:21.992732 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/18bbc7be-2bd6-43ae-b30b-f5723fc72609-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-9dqp6\" (UID: \"18bbc7be-2bd6-43ae-b30b-f5723fc72609\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-9dqp6" machine # [ 49.236871] k3s[888]: I0923 04:12:21.992757 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/18bbc7be-2bd6-43ae-b30b-f5723fc72609-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-9dqp6\" (UID: \"18bbc7be-2bd6-43ae-b30b-f5723fc72609\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-9dqp6" machine # [ 49.237508] k3s[888]: I0923 04:12:21.992784 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/18bbc7be-2bd6-43ae-b30b-f5723fc72609-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-9dqp6\" (UID: \"18bbc7be-2bd6-43ae-b30b-f5723fc72609\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-9dqp6" machine # [ 49.238343] k3s[888]: I0923 04:12:21.992827 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b29b2\" (UniqueName: \"kubernetes.io/projected/18bbc7be-2bd6-43ae-b30b-f5723fc72609-kube-api-access-b29b2\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-9dqp6\" (UID: \"18bbc7be-2bd6-43ae-b30b-f5723fc72609\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-9dqp6" machine # [ 49.239245] k3s[888]: I0923 04:12:21.992854 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/f9d75079-726f-4d01-93e9-5a364ec6d68f-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lkpnh\" (UID: \"f9d75079-726f-4d01-93e9-5a364ec6d68f\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lkpnh" machine # [ 49.239426] k3s[888]: I0923 04:12:21.992878 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/18bbc7be-2bd6-43ae-b30b-f5723fc72609-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-9dqp6\" (UID: \"18bbc7be-2bd6-43ae-b30b-f5723fc72609\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-9dqp6" machine # [ 49.240626] k3s[888]: I0923 04:12:21.992911 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f9d75079-726f-4d01-93e9-5a364ec6d68f-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lkpnh\" (UID: \"f9d75079-726f-4d01-93e9-5a364ec6d68f\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lkpnh" machine # [ 49.241235] k3s[888]: I0923 04:12:21.992942 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/18bbc7be-2bd6-43ae-b30b-f5723fc72609-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-9dqp6\" (UID: \"18bbc7be-2bd6-43ae-b30b-f5723fc72609\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-9dqp6" machine # [ 49.241628] k3s[888]: I0923 04:12:21.992983 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/f9d75079-726f-4d01-93e9-5a364ec6d68f-build\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lkpnh\" (UID: \"f9d75079-726f-4d01-93e9-5a364ec6d68f\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lkpnh" machine # [ 49.242541] k3s[888]: I0923 04:12:21.993007 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmzx2\" (UniqueName: \"kubernetes.io/projected/f9d75079-726f-4d01-93e9-5a364ec6d68f-kube-api-access-xmzx2\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lkpnh\" (UID: \"f9d75079-726f-4d01-93e9-5a364ec6d68f\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lkpnh" machine # [ 49.243151] k3s[888]: I0923 04:12:21.993056 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/18bbc7be-2bd6-43ae-b30b-f5723fc72609-build\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-9dqp6\" (UID: \"18bbc7be-2bd6-43ae-b30b-f5723fc72609\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-9dqp6" machine # [ 49.243888] k3s[888]: I0923 04:12:21.993079 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/f9d75079-726f-4d01-93e9-5a364ec6d68f-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lkpnh\" (UID: \"f9d75079-726f-4d01-93e9-5a364ec6d68f\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lkpnh" machine # [ 49.632846] cni0: port 3(vethafa44b41) entered blocking state machine # [ 49.633507] cni0: port 3(vethafa44b41) entered disabled state machine # [ 49.634148] vethafa44b41: entered allmulticast mode machine # [ 49.634788] vethafa44b41: entered promiscuous mode machine # [ 49.646945] cni0: port 3(vethafa44b41) entered blocking state machine # [ 49.647747] cni0: port 3(vethafa44b41) entered forwarding state machine # [ 49.654672] cni0: port 4(veth94bdfa25) entered blocking state machine # [ 49.655414] cni0: port 4(veth94bdfa25) entered disabled state machine # [ 49.656432] veth94bdfa25: entered allmulticast mode machine # [ 49.657421] veth94bdfa25: entered promiscuous mode machine # [ 49.670532] cni0: port 4(veth94bdfa25) entered blocking state machine # [ 49.671263] cni0: port 4(veth94bdfa25) entered forwarding state machine # [ 49.542455] (udev-worker)[2384]: Network interface NamePolicy= disabled on kernel command line. machine # [ 49.702529] cni0: port 5(veth6ef693ba) entered blocking state machine # [ 49.703298] cni0: port 5(veth6ef693ba) entered disabled state machine # [ 49.551506] (udev-worker)[2387]: Network interface NamePolicy= disabled on kernel command line. machine # [ 49.706220] veth6ef693ba: entered allmulticast mode machine # [ 49.707701] veth6ef693ba: entered promiscuous mode machine # [ 49.557235] (udev-worker)[2399]: Network interface NamePolicy= disabled on kernel command line. machine # [ 49.724545] cni0: port 6(vethffbc5e7d) entered blocking state machine # [ 49.725370] cni0: port 6(vethffbc5e7d) entered disabled state machine # [ 49.728086] vethffbc5e7d: entered allmulticast mode machine # [ 49.729014] vethffbc5e7d: entered promiscuous mode machine # [ 49.735271] cni0: port 5(veth6ef693ba) entered blocking state machine # [ 49.736055] cni0: port 5(veth6ef693ba) entered forwarding state machine # [ 49.584564] dhcpcd[686]: vethafa44b41: IAID 29:f7:0a:d0 machine # [ 49.586385] dhcpcd[686]: vethafa44b41: adding address fe80::7499:29ff:fef7:ad0 machine # [ 49.587813] (udev-worker)[2437]: Network interface NamePolicy= disabled on kernel command line. machine # [ 49.745967] cni0: port 6(vethffbc5e7d) entered blocking state machine # [ 49.746730] cni0: port 6(vethffbc5e7d) entered forwarding state machine # [ 49.601529] dhcpcd[686]: veth6ef693ba: IAID 7f:a9:2c:55 machine # [ 49.602473] dhcpcd[686]: veth6ef693ba: adding address fe80::fc52:7fff:fea9:2c55 machine # [ 49.614094] dhcpcd[686]: veth94bdfa25: IAID d1:32:b5:be machine # [ 49.614885] dhcpcd[686]: veth94bdfa25: adding address fe80::6cbe:d1ff:fe32:b5be machine # [ 49.629183] dhcpcd[686]: vethffbc5e7d: IAID b9:a1:43:93 machine # [ 49.630121] dhcpcd[686]: vethffbc5e7d: adding address fe80::c71:b9ff:fea1:4393 machine # [ 49.631051] dhcpcd[686]: vethffbc5e7d: carrier lost machine # [ 49.660329] dhcpcd[686]: vethffbc5e7d: deleting address fe80::c71:b9ff:fea1:4393 machine # [ 49.661784] dhcpcd[686]: vethffbc5e7d: carrier acquired machine # [ 49.669502] dhcpcd[686]: vethffbc5e7d: IAID b9:a1:43:93 machine # [ 49.670578] dhcpcd[686]: vethffbc5e7d: adding address fe80::c71:b9ff:fea1:4393 machine # [ 49.693313] systemd[1]: Started libcontainer container 1732bb7b207fea59636acb9722009e99287c8db438777a11c4d1ae71c6f51a30. machine # [ 49.698584] systemd[1]: Started libcontainer container 3885bf097d3f69e6eb8e6f9e02adf9db06d533d222e7c42411bfa06aadca930b. machine # [ 49.762407] systemd[1]: Started libcontainer container c40f57ad885d9bbe5100f5dc7766b4b07571c0cff75e155734b21316f2bb9c3e. machine # [ 49.769698] systemd[1]: Started libcontainer container cc13b19bc0137838932ae1460a4af87cdbba69fb14c1297f2e181e30ad56115b. machine # [ 50.381645] systemd[1]: cri-containerd-959793450c35d95aa168d88c6692e58b16a8671019d88cd93c8a6e6a27903c38.scope: Deactivated successfully. machine # [ 50.656173] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-959793450c35d95aa168d88c6692e58b16a8671019d88cd93c8a6e6a27903c38-rootfs.mount: Deactivated successfully. machine # [ 50.705587] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-959793450c35d95aa168d88c6692e58b16a8671019d88cd93c8a6e6a27903c38-shm.mount: Deactivated successfully. machine # [ 50.895867] cni0: port 2(vethf09f55de) entered disabled state machine # [ 50.743146] dhcpcd[686]: vethf09f55de: carrier lost machine # [ 50.897870] vethf09f55de (unregistering): left allmulticast mode machine # [ 50.898828] vethf09f55de (unregistering): left promiscuous mode machine # [ 50.899692] cni0: port 2(vethf09f55de) entered disabled state machine # [ 50.763719] systemd[1]: run-netns-cni\x2dcae6f06e\x2dc651\x2d328d\x2d3a90\x2dbe9123191132.mount: Deactivated successfully. machine # [ 50.780704] dhcpcd[686]: vethf09f55de: deleting address fe80::d4bd:5dff:fe3a:6fef machine # [ 50.818246] dhcpcd[686]: vethafa44b41: soliciting a DHCP lease machine # [ 50.823320] dhcpcd[686]: vethf09f55de: removing interface machine # [ 50.829046] k3s[888]: I0923 04:12:23.609258 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c258e18c-cfed-4d93-a5c6-2a075ae9ae95-klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/c258e18c-cfed-4d93-a5c6-2a075ae9ae95-klipper-helm\") pod \"c258e18c-cfed-4d93-a5c6-2a075ae9ae95\" (UID: \"c258e18c-cfed-4d93-a5c6-2a075ae9ae95\") " machine # [ 50.833529] k3s[888]: I0923 04:12:23.609318 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c258e18c-cfed-4d93-a5c6-2a075ae9ae95-tmp\" (UniqueName: \"kubernetes.io/empty-dir/c258e18c-cfed-4d93-a5c6-2a075ae9ae95-tmp\") pod \"c258e18c-cfed-4d93-a5c6-2a075ae9ae95\" (UID: \"c258e18c-cfed-4d93-a5c6-2a075ae9ae95\") " machine # [ 50.838100] k3s[888]: I0923 04:12:23.609348 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c258e18c-cfed-4d93-a5c6-2a075ae9ae95-values\" (UniqueName: \"kubernetes.io/projected/c258e18c-cfed-4d93-a5c6-2a075ae9ae95-values\") pod \"c258e18c-cfed-4d93-a5c6-2a075ae9ae95\" (UID: \"c258e18c-cfed-4d93-a5c6-2a075ae9ae95\") " machine # [ 50.842697] k3s[888]: I0923 04:12:23.609385 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c258e18c-cfed-4d93-a5c6-2a075ae9ae95-kube-api-access-2kgwf\" (UniqueName: \"kubernetes.io/projected/c258e18c-cfed-4d93-a5c6-2a075ae9ae95-kube-api-access-2kgwf\") pod \"c258e18c-cfed-4d93-a5c6-2a075ae9ae95\" (UID: \"c258e18c-cfed-4d93-a5c6-2a075ae9ae95\") " machine # [ 50.847803] k3s[888]: I0923 04:12:23.609412 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c258e18c-cfed-4d93-a5c6-2a075ae9ae95-klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/c258e18c-cfed-4d93-a5c6-2a075ae9ae95-klipper-cache\") pod \"c258e18c-cfed-4d93-a5c6-2a075ae9ae95\" (UID: \"c258e18c-cfed-4d93-a5c6-2a075ae9ae95\") " machine # [ 50.852609] k3s[888]: I0923 04:12:23.609438 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c258e18c-cfed-4d93-a5c6-2a075ae9ae95-klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/c258e18c-cfed-4d93-a5c6-2a075ae9ae95-klipper-config\") pod \"c258e18c-cfed-4d93-a5c6-2a075ae9ae95\" (UID: \"c258e18c-cfed-4d93-a5c6-2a075ae9ae95\") " machine # [ 50.857137] k3s[888]: I0923 04:12:23.609473 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c258e18c-cfed-4d93-a5c6-2a075ae9ae95-content\" (UniqueName: \"kubernetes.io/configmap/c258e18c-cfed-4d93-a5c6-2a075ae9ae95-content\") pod \"c258e18c-cfed-4d93-a5c6-2a075ae9ae95\" (UID: \"c258e18c-cfed-4d93-a5c6-2a075ae9ae95\") " machine # [ 50.862153] k3s[888]: I0923 04:12:23.609819 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c258e18c-cfed-4d93-a5c6-2a075ae9ae95-content" pod "c258e18c-cfed-4d93-a5c6-2a075ae9ae95" (UID: "c258e18c-cfed-4d93-a5c6-2a075ae9ae95"). InnerVolumeSpecName "content". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 50.867071] systemd[1]: var-lib-kubelet-pods-c258e18c\x2dcfed\x2d4d93\x2da5c6\x2d2a075ae9ae95-volumes-kubernetes.io\x7eprojected-values.mount: Deactivated successfully. machine # [ 50.869148] k3s[888]: I0923 04:12:23.618868 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c258e18c-cfed-4d93-a5c6-2a075ae9ae95-values" pod "c258e18c-cfed-4d93-a5c6-2a075ae9ae95" (UID: "c258e18c-cfed-4d93-a5c6-2a075ae9ae95"). InnerVolumeSpecName "values". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 50.873643] k3s[888]: I0923 04:12:23.626432 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c258e18c-cfed-4d93-a5c6-2a075ae9ae95-klipper-cache" pod "c258e18c-cfed-4d93-a5c6-2a075ae9ae95" (UID: "c258e18c-cfed-4d93-a5c6-2a075ae9ae95"). InnerVolumeSpecName "klipper-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 50.878186] k3s[888]: I0923 04:12:23.629723 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c258e18c-cfed-4d93-a5c6-2a075ae9ae95-klipper-helm" pod "c258e18c-cfed-4d93-a5c6-2a075ae9ae95" (UID: "c258e18c-cfed-4d93-a5c6-2a075ae9ae95"). InnerVolumeSpecName "klipper-helm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 50.882898] k3s[888]: I0923 04:12:23.630551 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c258e18c-cfed-4d93-a5c6-2a075ae9ae95-tmp" pod "c258e18c-cfed-4d93-a5c6-2a075ae9ae95" (UID: "c258e18c-cfed-4d93-a5c6-2a075ae9ae95"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 50.887531] k3s[888]: I0923 04:12:23.630677 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c258e18c-cfed-4d93-a5c6-2a075ae9ae95-klipper-config" pod "c258e18c-cfed-4d93-a5c6-2a075ae9ae95" (UID: "c258e18c-cfed-4d93-a5c6-2a075ae9ae95"). InnerVolumeSpecName "klipper-config". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 50.892229] k3s[888]: I0923 04:12:23.635947 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c258e18c-cfed-4d93-a5c6-2a075ae9ae95-kube-api-access-2kgwf" pod "c258e18c-cfed-4d93-a5c6-2a075ae9ae95" (UID: "c258e18c-cfed-4d93-a5c6-2a075ae9ae95"). InnerVolumeSpecName "kube-api-access-2kgwf". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 50.893399] systemd[1]: var-lib-kubelet-pods-c258e18c\x2dcfed\x2d4d93\x2da5c6\x2d2a075ae9ae95-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dcache.mount: Deactivated successfully. machine # [ 50.930337] k3s[888]: I0923 04:12:23.710772 888 reconciler_common.go:299] "Volume detached for volume \"content\" (UniqueName: \"kubernetes.io/configmap/c258e18c-cfed-4d93-a5c6-2a075ae9ae95-content\") on node \"machine\" DevicePath \"\"" machine # [ 50.930918] k3s[888]: I0923 04:12:23.710808 888 reconciler_common.go:299] "Volume detached for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/c258e18c-cfed-4d93-a5c6-2a075ae9ae95-klipper-helm\") on node \"machine\" DevicePath \"\"" machine # [ 50.931369] k3s[888]: I0923 04:12:23.710823 888 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c258e18c-cfed-4d93-a5c6-2a075ae9ae95-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 50.931993] k3s[888]: I0923 04:12:23.710845 888 reconciler_common.go:299] "Volume detached for volume \"values\" (UniqueName: \"kubernetes.io/projected/c258e18c-cfed-4d93-a5c6-2a075ae9ae95-values\") on node \"machine\" DevicePath \"\"" machine # [ 50.933542] k3s[888]: I0923 04:12:23.710862 888 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kgwf\" (UniqueName: \"kubernetes.io/projected/c258e18c-cfed-4d93-a5c6-2a075ae9ae95-kube-api-access-2kgwf\") on node \"machine\" DevicePath \"\"" machine # [ 50.934088] k3s[888]: I0923 04:12:23.710874 888 reconciler_common.go:299] "Volume detached for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/c258e18c-cfed-4d93-a5c6-2a075ae9ae95-klipper-cache\") on node \"machine\" DevicePath \"\"" machine # [ 50.934644] k3s[888]: I0923 04:12:23.710886 888 reconciler_common.go:299] "Volume detached for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/c258e18c-cfed-4d93-a5c6-2a075ae9ae95-klipper-config\") on node \"machine\" DevicePath \"\"" machine # [ 50.936459] dhcpcd[686]: veth94bdfa25: soliciting a DHCP lease machine # [ 50.972281] systemd[1]: Started libcontainer container 93ec04ece54b411f967659f038c9744caa93df96b362b82ec78ad198879f0add. machine # [ 51.114180] dhcpcd[686]: vethffbc5e7d: soliciting an IPv6 router machine # [ 51.226783] dhcpcd[686]: veth6ef693ba: soliciting a DHCP lease machine # [ 51.275398] systemd[1]: Removed slice libcontainer container kubepods-burstable-podc258e18c_cfed_4d93_a5c6_2a075ae9ae95.slice. machine # [ 51.276772] systemd[1]: kubepods-burstable-podc258e18c_cfed_4d93_a5c6_2a075ae9ae95.slice: Consumed 740ms CPU time over 17.047s wall clock time, 35.7M memory peak, 2.4M incoming IP traffic, 142.5K outgoing IP traffic. machine # [ 51.372974] k3s[888]: I0923 04:12:24.153479 888 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="959793450c35d95aa168d88c6692e58b16a8671019d88cd93c8a6e6a27903c38" machine # [ 51.385765] k3s[888]: I0923 04:12:24.166278 888 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-775dbb5c7c-5hjch" podStartSLOduration=3.166258136 podStartE2EDuration="3.166258136s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-23 04:12:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-23 04:12:24.16549519 +0000 UTC m=+34.507333192" watchObservedRunningTime="2026-09-23 04:12:24.166258136 +0000 UTC m=+34.508095300" machine # [ 51.501914] dhcpcd[686]: vethafa44b41: soliciting an IPv6 router machine # [ 51.538183] dhcpcd[686]: veth94bdfa25: soliciting an IPv6 router machine # [ 51.555390] dhcpcd[686]: vethffbc5e7d: soliciting a DHCP lease machine # [ 51.648201] systemd[1]: var-lib-kubelet-pods-c258e18c\x2dcfed\x2d4d93\x2da5c6\x2d2a075ae9ae95-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2d2kgwf.mount: Deactivated successfully. machine # [ 51.648754] systemd[1]: var-lib-kubelet-pods-c258e18c\x2dcfed\x2d4d93\x2da5c6\x2d2a075ae9ae95-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dconfig.mount: Deactivated successfully. machine # [ 51.649696] systemd[1]: var-lib-kubelet-pods-c258e18c\x2dcfed\x2d4d93\x2da5c6\x2d2a075ae9ae95-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dhelm.mount: Deactivated successfully. machine # [ 51.650555] systemd[1]: var-lib-kubelet-pods-c258e18c\x2dcfed\x2d4d93\x2da5c6\x2d2a075ae9ae95-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 52.168894] dhcpcd[686]: veth6ef693ba: soliciting an IPv6 router machine # [ 52.914823] dhcpcd[686]: veth69bebca2: probing for an IPv4LL address machine # [ 55.642970] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount995849738.mount: Deactivated successfully. machine # [ 55.700711] systemd[1]: Started libcontainer container ebddc8dfeeb6ca1c171a77b75d7502c1845d625762e12f5b433be7c7f86afaa1. machine # [ 55.710225] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount3752090606.mount: Deactivated successfully. machine # [ 55.818727] dhcpcd[686]: vethafa44b41: probing for an IPv4LL address machine # [ 55.845305] systemd[1]: Started libcontainer container 336e5dbe757fa0e8ef1ab5dc855bc9e56c7f69f7febfd509eba56de8188d0d54. machine # [ 55.901420] systemd[1]: Started libcontainer container ee770c21256a068868fde85db09bb7b2192f9c0fccfe381e32e81f391d6452e8. machine # [ 55.940097] dhcpcd[686]: veth94bdfa25: probing for an IPv4LL address machine # [ 55.967164] niks3-server[1188]: 2026/09/23 04:12:28 INFO lead: acquired remote=10.42.0.5:46300 machine # [ 56.227609] dhcpcd[686]: veth6ef693ba: probing for an IPv4LL address machine # [ 56.462429] k3s[888]: I0923 04:12:29.241364 888 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-scheduler-64688b4568-xjnp4" podStartSLOduration=8.241339186 podStartE2EDuration="8.241339186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-23 04:12:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-23 04:12:29.240561155 +0000 UTC m=+39.582398877" watchObservedRunningTime="2026-09-23 04:12:29.241339186 +0000 UTC m=+39.583176630" machine # [ 56.556619] dhcpcd[686]: vethffbc5e7d: probing for an IPv4LL address machine # [ 57.911461] systemd[1]: cri-containerd-336e5dbe757fa0e8ef1ab5dc855bc9e56c7f69f7febfd509eba56de8188d0d54.scope: Deactivated successfully. machine # [ 57.914361] systemd[1]: cri-containerd-336e5dbe757fa0e8ef1ab5dc855bc9e56c7f69f7febfd509eba56de8188d0d54.scope: Consumed 843ms CPU time over 2.064s wall clock time, 329.3M memory peak, 71.8M read from disk, 247.1M written to disk. machine # [ 57.918070] systemd[1]: cri-containerd-ee770c21256a068868fde85db09bb7b2192f9c0fccfe381e32e81f391d6452e8.scope: Deactivated successfully. machine # [ 57.919432] systemd[1]: cri-containerd-ee770c21256a068868fde85db09bb7b2192f9c0fccfe381e32e81f391d6452e8.scope: Consumed 817ms CPU time over 2.013s wall clock time, 343.8M memory peak, 80.9M read from disk, 247.1M written to disk. machine # [ 57.968319] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-336e5dbe757fa0e8ef1ab5dc855bc9e56c7f69f7febfd509eba56de8188d0d54-rootfs.mount: Deactivated successfully. machine # [ 57.970789] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-ee770c21256a068868fde85db09bb7b2192f9c0fccfe381e32e81f391d6452e8-rootfs.mount: Deactivated successfully. machine # [ 58.295845] dhcpcd[686]: veth69bebca2: using IPv4LL address 169.254.58.251 machine # [ 58.297870] dhcpcd[686]: veth69bebca2: adding route to 169.254.0.0/16 machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 31.63 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s machine # [ 58.677431] systemd[1]: Started libcontainer container b32d9e89a1d4fb80c8baaa3dcc92742c2ca1ac09885cad60e009a0728ded2ae3. machine # [ 58.681877] systemd[1]: Started libcontainer container 99a030c4f0a0e30b9b5fca396b5627ba99349d1ce28ff6aaa0a6ba496dcb758c. machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s, in 0.27 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s machine # [ 58.902385] systemd[1]: Started libcontainer container 8de65862414034c3250dbe619b428d29c68c527b4712e1f7019ab2cfc7d952a1. machine # [ 58.960881] systemd[1]: Started libcontainer container 6955f2362be3343a7a2b3a7bb148410e4c9c08dd56ca1e6f471bfd90aafe0d82. machine # [ 58.980350] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped3554865113.mount: Deactivated successfully. machine # [ 59.046103] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped2737479988.mount: Deactivated successfully. machine # [ 59.046568] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount2335213469.mount: Deactivated successfully. machine # [ 59.131422] systemd[1]: Started libcontainer container 17fac097174c9caf91b0e0f3c26c28012810163e0ac8876b00dcd486ed9cb67a. machine # [ 59.176339] systemd[1]: Started libcontainer container c7ebb84273c27de81261d33f043b83432dc2c4d87fbe075dba7929eb305e33ce. machine # [ 59.512193] k3s[888]: I0923 04:12:32.290825 888 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lkpnh" podStartSLOduration=9.250039453 podStartE2EDuration="11.290779268s" totalImagesPullingTime="0s" totalInitContainerRuntime="2.040739815s" isStatefulPod=false podCreationTimestamp="2026-09-23 04:12:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-23 04:12:32.290072754 +0000 UTC m=+42.631916902" watchObservedRunningTime="2026-09-23 04:12:32.290779268 +0000 UTC m=+42.632621461" machine # [ 59.532781] k3s[888]: I0923 04:12:32.313246 888 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-9dqp6" podStartSLOduration=9.37226225 podStartE2EDuration="11.313219271s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.940957021s" isStatefulPod=false podCreationTimestamp="2026-09-23 04:12:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-23 04:12:32.312804694 +0000 UTC m=+42.654645210" watchObservedRunningTime="2026-09-23 04:12:32.313219271 +0000 UTC m=+42.655056435" machine # [ 59.700885] dhcpcd[686]: veth69bebca2: no IPv6 Routers available machine # [ 60.096208] dhcpcd[686]: veth94bdfa25: using IPv4LL address 169.254.108.87 machine # [ 60.098449] dhcpcd[686]: veth94bdfa25: adding route to 169.254.0.0/16 machine # [ 60.381477] dhcpcd[686]: vethafa44b41: using IPv4LL address 169.254.30.68 machine # [ 60.383324] dhcpcd[686]: vethafa44b41: adding route to 169.254.0.0/16 machine # [ 60.737324] dhcpcd[686]: veth6ef693ba: using IPv4LL address 169.254.238.246 machine # [ 60.739591] dhcpcd[686]: veth6ef693ba: adding route to 169.254.0.0/16 machine # [ 60.842573] dhcpcd[686]: vethffbc5e7d: using IPv4LL address 169.254.250.66 machine # [ 60.844436] dhcpcd[686]: vethffbc5e7d: adding route to 169.254.0.0/16 machine # [ 63.117196] dhcpcd[686]: vethffbc5e7d: no IPv6 Routers available machine # [ 63.503901] dhcpcd[686]: vethafa44b41: no IPv6 Routers available machine # [ 63.541066] dhcpcd[686]: veth94bdfa25: no IPv6 Routers available machine # [ 64.170844] dhcpcd[686]: veth6ef693ba: no IPv6 Routers available machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s, in 5.80 seconds) machine: waiting for unit niks3.service machine: (finished: waiting for unit niks3.service, in 0.06 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.42 seconds) machine: waiting for success: test $(curl -sf 10.42.0.4:9901/clusters | grep -c 'health_flags::healthy') -ge 3 machine: (finished: waiting for success: test $(curl -sf 10.42.0.4:9901/clusters | grep -c 'health_flags::healthy') -ge 3, in 2.21 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.20 seconds) machine: waiting for success: curl -sf http://10.42.0.5:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2' machine: (finished: waiting for success: curl -sf http://10.42.0.5:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2', in 0.04 seconds) (finished: subtest: chart deploys and workers become Ready, in 40.64 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}', in 0.16 seconds) machine: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt machine: (finished: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt, in 0.14 seconds) subtest: build through the balancer lands in the cache machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1 machine # [ 129.384388] niks3-server[1188]: 2026/09/23 04:13:42 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 129.412982] niks3-server[1188]: 2026/09/23 04:13:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign machine # [ 129.418710] niks3-server[1188]: 2026/09/23 04:13:42 INFO Signed narinfos id=1 count=1 machine # [ 129.429051] niks3-server[1188]: 2026/09/23 04:13:42 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete machine # [ 129.432186] niks3-server[1188]: 2026/09/23 04:13:42 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.ls machine # [ 129.437684] niks3-server[1188]: 2026/09/23 04:13:42 INFO Registered completed upload object_key=nar/0nzzbas7l8d37mridr7mg162smfjvn7lhs6am4crl4ydaxicigj8.nar.zst machine # [ 129.439483] niks3-server[1188]: 2026/09/23 04:13:42 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.narinfo machine # [ 129.441635] niks3-server[1188]: 2026/09/23 04:13:42 INFO Completed upload id=1 machine # [ 154.558274] niks3-server[1188]: 2026/09/23 04:14:07 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 154.582277] niks3-server[1188]: 2026/09/23 04:14:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign machine # [ 154.584523] niks3-server[1188]: 2026/09/23 04:14:07 INFO Registered completed upload object_key=log/yz1sqzb72i8v6h2ass0v76ba8cncqj9r-k3s-a.drv machine # [ 154.586806] niks3-server[1188]: 2026/09/23 04:14:07 INFO Signed narinfos id=2 count=1 machine # [ 154.589183] niks3-server[1188]: 2026/09/23 04:14:07 INFO Registered completed upload object_key=nar/1p7jh5nyz9n68k5f18ymmdpgr34mpnnch1njw7ki7b2b97qlfbjk.nar.zst machine # [ 154.591642] niks3-server[1188]: 2026/09/23 04:14:07 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.ls machine # [ 154.598412] niks3-server[1188]: 2026/09/23 04:14:07 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete machine # [ 154.602609] niks3-server[1188]: 2026/09/23 04:14:07 INFO Completed upload id=2 machine # [ 154.604542] niks3-server[1188]: 2026/09/23 04:14:07 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.narinfo machine # [ 154.667766] niks3-server[1188]: 2026/09/23 04:14:07 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 154.678463] niks3-server[1188]: 2026/09/23 04:14:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign machine # [ 154.679730] niks3-server[1188]: 2026/09/23 04:14:07 INFO Signed narinfos id=3 count=1 machine # [ 154.681529] niks3-server[1188]: 2026/09/23 04:14:07 INFO Registered completed upload object_key=nar/03a4ywhyr5knmbc93z4gyml5y8fvgb431xvlmfxrwsm8mrb0qgx2.nar.zst machine # [ 154.686665] niks3-server[1188]: 2026/09/23 04:14:07 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.ls machine # [ 154.688043] niks3-server[1188]: 2026/09/23 04:14:07 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete machine # [ 154.690531] niks3-server[1188]: 2026/09/23 04:14:07 INFO Completed upload id=3 machine # [ 154.691943] niks3-server[1188]: 2026/09/23 04:14:07 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.narinfo machine # [ 180.010390] niks3-server[1188]: 2026/09/23 04:14:32 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 180.031288] niks3-server[1188]: 2026/09/23 04:14:32 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.ls machine # [ 180.035846] niks3-server[1188]: 2026/09/23 04:14:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign machine # [ 180.040302] niks3-server[1188]: 2026/09/23 04:14:32 INFO Signed narinfos id=4 count=1 machine # [ 180.043122] niks3-server[1188]: 2026/09/23 04:14:32 INFO Registered completed upload object_key=nar/05qjsj5ff3a6vnxkhb6k5f3m446dcc206p7cd37w4v3mgi95d7kh.nar.zst machine # [ 180.048659] niks3-server[1188]: 2026/09/23 04:14:32 INFO Registered completed upload object_key=log/zfq1xw9bmycqh35l0s44lmv65z4xc7br-k3s-b.drv machine # [ 180.054798] niks3-server[1188]: 2026/09/23 04:14:32 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete machine # [ 180.059769] niks3-server[1188]: 2026/09/23 04:14:32 INFO Completed upload id=4 machine # [ 180.061993] niks3-server[1188]: 2026/09/23 04:14:32 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.narinfo machine # [ 180.113254] niks3-server[1188]: 2026/09/23 04:14:32 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 180.127745] niks3-server[1188]: 2026/09/23 04:14:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign machine # [ 180.129152] niks3-server[1188]: 2026/09/23 04:14:32 INFO Signed narinfos id=5 count=1 machine # [ 180.132120] niks3-server[1188]: 2026/09/23 04:14:32 INFO Registered completed upload object_key=nar/0jyw88klkf3nwxpnj5m5lx3i1dv2idf3hcn6im7883hnldm3gvyq.nar.zst machine # [ 180.133324] niks3-server[1188]: 2026/09/23 04:14:32 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.ls machine # [ 180.138482] niks3-server[1188]: 2026/09/23 04:14:32 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete machine # [ 180.140298] niks3-server[1188]: 2026/09/23 04:14:32 INFO Completed upload id=5 machine # [ 180.141489] niks3-server[1188]: 2026/09/23 04:14:32 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.narinfo machine # [ 204.858296] niks3-server[1188]: 2026/09/23 04:14:57 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 204.876633] niks3-server[1188]: 2026/09/23 04:14:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign machine # [ 204.878649] niks3-server[1188]: 2026/09/23 04:14:57 INFO Signed narinfos id=6 count=1 machine # [ 204.882169] niks3-server[1188]: 2026/09/23 04:14:57 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.ls machine # [ 204.884368] niks3-server[1188]: 2026/09/23 04:14:57 INFO Registered completed upload object_key=log/n40czam6a4ldp1mh5fdmlcy07fv0akbm-k3s-top.drv machine # [ 204.888060] niks3-server[1188]: 2026/09/23 04:14:57 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete machine # [ 204.891549] niks3-server[1188]: 2026/09/23 04:14:57 INFO Completed upload id=6 machine # [ 204.893860] niks3-server[1188]: 2026/09/23 04:14:57 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1, in 138.15 seconds) machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath, in 0.16 seconds) machine: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine: (finished: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.01 seconds) machine: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine # copying 3 paths... machine # copying path '/nix/store/r95r891injj9ski5c4w89yxjvjy065mx-k3s-a' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/mrqsh0475wxsmnsvkk55g94v6g5nrcra-k3s-b' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top' from 'http://192.168.1.1:5751'... machine: (finished: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.19 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1 machine # [ 206.600791] niks3-server[1188]: 2026/09/23 04:14:59 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 206.626407] niks3-server[1188]: 2026/09/23 04:14:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign machine # [ 206.629073] niks3-server[1188]: 2026/09/23 04:14:59 INFO Signed narinfos id=7 count=1 machine # [ 206.632859] niks3-server[1188]: 2026/09/23 04:14:59 INFO Registered completed upload object_key=nar/1fr26arhri17j9bj6hyjzmmd74v730biz1gb3kqd194vjx3ccvp9.nar.zst machine # [ 206.636740] niks3-server[1188]: 2026/09/23 04:14:59 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.ls machine # [ 206.641145] niks3-server[1188]: 2026/09/23 04:14:59 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete machine # [ 206.642533] niks3-server[1188]: 2026/09/23 04:14:59 INFO Completed upload id=7 machine # [ 206.643585] niks3-server[1188]: 2026/09/23 04:14:59 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.narinfo machine # [ 231.150793] niks3-server[1188]: 2026/09/23 04:15:23 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 231.171787] niks3-server[1188]: 2026/09/23 04:15:23 INFO Registered completed upload object_key=log/pbpqsh50ar10fpasdqqx8xg3lmr5j8iz-k3s-a.drv machine # [ 231.174592] niks3-server[1188]: 2026/09/23 04:15:23 INFO Registered completed upload object_key=nar/1hfc6x4x25k3b0fk091d3nb0k3mympfp05fkslcx19synp3ig0zd.nar.zst machine # [ 231.175938] niks3-server[1188]: 2026/09/23 04:15:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign machine # [ 231.179294] niks3-server[1188]: 2026/09/23 04:15:23 INFO Signed narinfos id=8 count=1 machine # [ 231.184669] niks3-server[1188]: 2026/09/23 04:15:23 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.ls machine # [ 231.188197] niks3-server[1188]: 2026/09/23 04:15:23 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete machine # [ 231.191198] niks3-server[1188]: 2026/09/23 04:15:23 INFO Completed upload id=8 machine # [ 231.195119] niks3-server[1188]: 2026/09/23 04:15:23 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.narinfo machine # [ 231.260638] niks3-server[1188]: 2026/09/23 04:15:24 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 231.269047] niks3-server[1188]: 2026/09/23 04:15:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign machine # [ 231.270139] niks3-server[1188]: 2026/09/23 04:15:24 INFO Signed narinfos id=9 count=1 machine # [ 231.272714] niks3-server[1188]: 2026/09/23 04:15:24 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.ls machine # [ 231.274819] niks3-server[1188]: 2026/09/23 04:15:24 INFO Registered completed upload object_key=nar/0zzq2vgjln4shvh57091n14sam6wh6w06vja6lzb9ppcj4ffyx1n.nar.zst machine # [ 231.279819] niks3-server[1188]: 2026/09/23 04:15:24 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete machine # [ 231.282657] niks3-server[1188]: 2026/09/23 04:15:24 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.narinfo machine # [ 231.286400] niks3-server[1188]: 2026/09/23 04:15:24 INFO Completed upload id=9 machine # [ 256.001613] niks3-server[1188]: 2026/09/23 04:15:48 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 256.022462] niks3-server[1188]: 2026/09/23 04:15:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign machine # [ 256.025880] niks3-server[1188]: 2026/09/23 04:15:48 INFO Signed narinfos id=10 count=1 machine # [ 256.028997] niks3-server[1188]: 2026/09/23 04:15:48 INFO Registered completed upload object_key=log/894h6wzw2l4w5f0hikj1k6q57jfnyi87-k3s-b.drv machine # [ 256.034339] niks3-server[1188]: 2026/09/23 04:15:48 INFO Registered completed upload object_key=nar/0hh3nqk95r6g32lhdmxw8cxjv694vbpx9876zkhcpg4r4qxni2ch.nar.zst machine # [ 256.036332] niks3-server[1188]: 2026/09/23 04:15:48 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete machine # [ 256.038810] niks3-server[1188]: 2026/09/23 04:15:48 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.ls machine # [ 256.041213] niks3-server[1188]: 2026/09/23 04:15:48 INFO Completed upload id=10 machine # [ 256.043746] niks3-server[1188]: 2026/09/23 04:15:48 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.narinfo machine # [ 256.115909] niks3-server[1188]: 2026/09/23 04:15:48 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 256.128379] niks3-server[1188]: 2026/09/23 04:15:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign machine # [ 256.131880] niks3-server[1188]: 2026/09/23 04:15:48 INFO Signed narinfos id=11 count=1 machine # [ 256.135685] niks3-server[1188]: 2026/09/23 04:15:48 INFO Registered completed upload object_key=nar/0ingamx56k31lwiyxmnxmscjj4n3qfx6sr2kpaynsrwhwz1278iw.nar.zst machine # [ 256.137108] niks3-server[1188]: 2026/09/23 04:15:48 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete machine # [ 256.140334] niks3-server[1188]: 2026/09/23 04:15:48 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.ls machine # [ 256.141182] niks3-server[1188]: 2026/09/23 04:15:48 INFO Completed upload id=11 machine # [ 280.857577] niks3-server[1188]: 2026/09/23 04:16:13 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 280.880138] niks3-server[1188]: 2026/09/23 04:16:13 INFO Registered completed upload object_key=nar/0v48x4sp58bvfra08axgkz7yl1n9nc4nirskyv1hwann4i7q277i.nar.zst machine # [ 280.881395] niks3-server[1188]: 2026/09/23 04:16:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign machine # [ 280.882133] niks3-server[1188]: 2026/09/23 04:16:13 INFO Signed narinfos id=12 count=1 machine # [ 280.886418] niks3-server[1188]: 2026/09/23 04:16:13 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.ls machine # [ 280.888719] niks3-server[1188]: 2026/09/23 04:16:13 INFO Registered completed upload object_key=log/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g-k3s-top.drv machine # [ 280.893455] niks3-server[1188]: 2026/09/23 04:16:13 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete machine # [ 280.897447] niks3-server[1188]: 2026/09/23 04:16:13 INFO Completed upload id=12 machine # [ 280.899142] niks3-server[1188]: 2026/09/23 04:16:13 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1, in 77.05 seconds) (finished: subtest: build through the balancer lands in the cache, in 215.57 seconds) subtest: a Job with the client image builds through the farm with its service account machine: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine: (finished: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.21 seconds) machine: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix machine: (finished: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix, in 0.16 seconds) machine: must succeed: kubectl apply -f /nix/store/lp0q6rjq0cw1vs9npm6c3ggx088f4vva-ci-job.json machine: (finished: must succeed: kubectl apply -f /nix/store/lp0q6rjq0cw1vs9npm6c3ggx088f4vva-ci-job.json, in 0.16 seconds) machine: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed' machine # [ 284.064232] systemd[1]: Created slice libcontainer container kubepods-besteffort-podc3581c32_d71f_48ca_9c6d_ccee0f25b406.slice. machine # [ 284.163195] k3s[888]: I0923 04:16:16.943372 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/c3581c32-d71f-48ca-9c6d-ccee0f25b406-nix-grpc-farm\") pod \"ci-j5dl4\" (UID: \"c3581c32-d71f-48ca-9c6d-ccee0f25b406\") " pod="ci/ci-j5dl4" machine # [ 284.167232] k3s[888]: I0923 04:16:16.943436 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d65f\" (UniqueName: \"kubernetes.io/projected/c3581c32-d71f-48ca-9c6d-ccee0f25b406-kube-api-access-5d65f\") pod \"ci-j5dl4\" (UID: \"c3581c32-d71f-48ca-9c6d-ccee0f25b406\") " pod="ci/ci-j5dl4" machine # [ 284.171162] k3s[888]: I0923 04:16:16.943466 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"job\" (UniqueName: \"kubernetes.io/configmap/c3581c32-d71f-48ca-9c6d-ccee0f25b406-job\") pod \"ci-j5dl4\" (UID: \"c3581c32-d71f-48ca-9c6d-ccee0f25b406\") " pod="ci/ci-j5dl4" machine # [ 285.450604] cni0: port 2(vethf182221a) entered blocking state machine # [ 285.451335] cni0: port 2(vethf182221a) entered disabled state machine # [ 285.452423] vethf182221a: entered allmulticast mode machine # [ 285.454059] vethf182221a: entered promiscuous mode machine # [ 285.461260] cni0: port 2(vethf182221a) entered blocking state machine # [ 285.462262] cni0: port 2(vethf182221a) entered forwarding state machine # [ 285.342368] (udev-worker)[5045]: Network interface NamePolicy= disabled on kernel command line. machine # [ 285.368355] dhcpcd[686]: vethf182221a: IAID c8:31:fe:bf machine # [ 285.369208] dhcpcd[686]: vethf182221a: adding address fe80::3cad:c8ff:fe31:febf machine # [ 285.391549] systemd[1]: Started libcontainer container 093074cc378f5500c4cc4f92a53d15f6cd0cc77c8e39f4a9350fd69c1c3f3689. machine # [ 287.270669] dhcpcd[686]: vethf182221a: soliciting an IPv6 router machine # [ 287.328517] dhcpcd[686]: vethf182221a: soliciting a DHCP lease machine # [ 287.470635] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount1463474612.mount: Deactivated successfully. machine # [ 287.523502] systemd[1]: Started libcontainer container 30a69e4c3042f68ddf884340c3c7667ad40296bdccab613874e2a8c963675739. machine # [ 288.485441] k3s[888]: I0923 04:16:21.265108 888 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ci/ci-j5dl4" podStartSLOduration=5.2650553030000005 podStartE2EDuration="5.265055303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-23 04:16:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-23 04:16:21.264862541 +0000 UTC m=+271.606704733" watchObservedRunningTime="2026-09-23 04:16:21.265055303 +0000 UTC m=+271.606899171" machine # [ 288.824891] niks3-server[1188]: 2026/09/23 04:16:21 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 288.837246] niks3-server[1188]: 2026/09/23 04:16:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign machine # [ 288.838300] niks3-server[1188]: 2026/09/23 04:16:21 INFO Signed narinfos id=13 count=1 machine # [ 288.840249] niks3-server[1188]: 2026/09/23 04:16:21 INFO Registered completed upload object_key=nar/111g6dyibwcf2z7jhpn72rgja0qvjgpdiv9nc06g2dp7ih0a6kyq.nar.zst machine # [ 288.843062] niks3-server[1188]: 2026/09/23 04:16:21 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.ls machine # [ 288.847844] niks3-server[1188]: 2026/09/23 04:16:21 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete machine # [ 288.849935] niks3-server[1188]: 2026/09/23 04:16:21 INFO Completed upload id=13 machine # [ 288.852623] niks3-server[1188]: 2026/09/23 04:16:21 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.narinfo machine # [ 292.329669] dhcpcd[686]: vethf182221a: probing for an IPv4LL address machine # [ 297.083861] dhcpcd[686]: vethf182221a: using IPv4LL address 169.254.147.133 machine # [ 297.085523] dhcpcd[686]: vethf182221a: adding route to 169.254.0.0/16 machine # [ 299.273473] dhcpcd[686]: vethf182221a: no IPv6 Routers available machine # [ 310.311670] postgres[768]: [768] LOG: checkpoint starting: time machine # [ 313.741225] niks3-server[1188]: 2026/09/23 04:16:46 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 313.751878] niks3-server[1188]: 2026/09/23 04:16:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign machine # [ 313.754898] niks3-server[1188]: 2026/09/23 04:16:46 INFO Signed narinfos id=14 count=1 machine # [ 313.756703] niks3-server[1188]: 2026/09/23 04:16:46 INFO Registered completed upload object_key=log/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # [ 313.759330] niks3-server[1188]: 2026/09/23 04:16:46 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.ls machine # [ 313.761794] niks3-server[1188]: 2026/09/23 04:16:46 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete machine # [ 313.764180] niks3-server[1188]: 2026/09/23 04:16:46 INFO Registered completed upload object_key=nar/058kjd2vfl1r27b4d9ixvwf77d8rkr18a4v894kwx8lg0nwpajnr.nar.zst machine # [ 313.766631] niks3-server[1188]: 2026/09/23 04:16:46 INFO Completed upload id=14 machine # [ 313.767737] niks3-server[1188]: 2026/09/23 04:16:46 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.narinfo machine # [ 313.819501] niks3-server[1188]: 2026/09/23 04:16:46 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 313.829109] niks3-server[1188]: 2026/09/23 04:16:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign machine # [ 313.830321] niks3-server[1188]: 2026/09/23 04:16:46 INFO Signed narinfos id=15 count=1 machine # [ 313.834320] niks3-server[1188]: 2026/09/23 04:16:46 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.ls machine # [ 313.836255] niks3-server[1188]: 2026/09/23 04:16:46 INFO Registered completed upload object_key=nar/138ynhcd5wxzz485x9qcq7xsargaklrf2li31ai69m5r46am35q6.nar.zst machine # [ 313.838553] niks3-server[1188]: 2026/09/23 04:16:46 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete machine # [ 313.840566] niks3-server[1188]: 2026/09/23 04:16:46 INFO Completed upload id=15 machine # [ 313.841727] niks3-server[1188]: 2026/09/23 04:16:46 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.narinfo machine # [ 338.555182] niks3-server[1188]: 2026/09/23 04:17:11 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 338.570500] niks3-server[1188]: 2026/09/23 04:17:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign machine # [ 338.574899] niks3-server[1188]: 2026/09/23 04:17:11 INFO Signed narinfos id=16 count=1 machine # [ 338.578245] niks3-server[1188]: 2026/09/23 04:17:11 INFO Registered completed upload object_key=nar/0n4lbdlp8w72fs3qbavl2lwrzbrn55i2b1vyglc89cc3pi8vbb1m.nar.zst machine # [ 338.583927] niks3-server[1188]: 2026/09/23 04:17:11 INFO Registered completed upload object_key=log/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # [ 338.588307] niks3-server[1188]: 2026/09/23 04:17:11 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.ls machine # [ 338.592403] niks3-server[1188]: 2026/09/23 04:17:11 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete machine # [ 338.596562] niks3-server[1188]: 2026/09/23 04:17:11 INFO Completed upload id=16 machine # [ 338.598933] niks3-server[1188]: 2026/09/23 04:17:11 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo machine # [ 338.647157] niks3-server[1188]: 2026/09/23 04:17:11 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 338.658946] niks3-server[1188]: 2026/09/23 04:17:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign machine # [ 338.659881] niks3-server[1188]: 2026/09/23 04:17:11 INFO Signed narinfos id=17 count=1 machine # [ 338.663835] niks3-server[1188]: 2026/09/23 04:17:11 INFO Registered completed upload object_key=nar/1f3gvnvqsm2pm3laixkxkg44kvjb251zqhszcfpp0a00h6x66ljs.nar.zst machine # [ 338.665866] niks3-server[1188]: 2026/09/23 04:17:11 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.ls machine # [ 338.667525] niks3-server[1188]: 2026/09/23 04:17:11 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete machine # [ 338.669809] niks3-server[1188]: 2026/09/23 04:17:11 INFO Completed upload id=17 machine # [ 338.671341] niks3-server[1188]: 2026/09/23 04:17:11 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.narinfo machine # [ 363.559561] niks3-server[1188]: 2026/09/23 04:17:36 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 363.571875] niks3-server[1188]: 2026/09/23 04:17:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign machine # [ 363.573163] niks3-server[1188]: 2026/09/23 04:17:36 INFO Signed narinfos id=18 count=1 machine # [ 363.575241] niks3-server[1188]: 2026/09/23 04:17:36 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.ls machine # [ 363.576684] niks3-server[1188]: 2026/09/23 04:17:36 INFO Registered completed upload object_key=log/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # [ 363.581568] niks3-server[1188]: 2026/09/23 04:17:36 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete machine # [ 363.583639] niks3-server[1188]: 2026/09/23 04:17:36 INFO Registered completed upload object_key=nar/1zwf0asrdv12q40fmqga5lx5330dvn9y4in4i9ficz9ij5lhvnf5.nar.zst machine # [ 363.585856] niks3-server[1188]: 2026/09/23 04:17:36 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo machine # [ 363.587772] niks3-server[1188]: 2026/09/23 04:17:36 INFO Completed upload id=18 machine # [ 365.285593] niks3-server[1188]: 2026/09/23 04:17:38 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 365.304108] niks3-server[1188]: 2026/09/23 04:17:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign machine # [ 365.306454] niks3-server[1188]: 2026/09/23 04:17:38 INFO Signed narinfos id=19 count=1 machine # [ 365.311653] niks3-server[1188]: 2026/09/23 04:17:38 INFO Registered completed upload object_key=nar/0xiyqcsl8db7dnrq2gqnx5izavr51ma3dcdswrriaxfgj3qzk7xf.nar.zst machine # [ 365.315121] niks3-server[1188]: 2026/09/23 04:17:38 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.ls machine # [ 365.323975] niks3-server[1188]: 2026/09/23 04:17:38 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete machine # [ 365.325853] niks3-server[1188]: 2026/09/23 04:17:38 INFO Completed upload id=19 machine # [ 390.249427] niks3-server[1188]: 2026/09/23 04:18:03 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 390.270918] niks3-server[1188]: 2026/09/23 04:18:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign machine # [ 390.272661] niks3-server[1188]: 2026/09/23 04:18:03 INFO Signed narinfos id=20 count=1 machine # [ 390.276913] niks3-server[1188]: 2026/09/23 04:18:03 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.ls machine # [ 390.278827] niks3-server[1188]: 2026/09/23 04:18:03 INFO Registered completed upload object_key=log/fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # [ 390.281837] niks3-server[1188]: 2026/09/23 04:18:03 INFO Registered completed upload object_key=nar/0p3l2z3riilylr2rxb1aq2blxdfxg55wbgp4gxkns93srbr4bwyq.nar.zst machine # [ 390.285058] niks3-server[1188]: 2026/09/23 04:18:03 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete machine # [ 390.288701] niks3-server[1188]: 2026/09/23 04:18:03 INFO Completed upload id=20 machine # [ 390.291095] niks3-server[1188]: 2026/09/23 04:18:03 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo machine # [ 390.425460] systemd[1]: cri-containerd-30a69e4c3042f68ddf884340c3c7667ad40296bdccab613874e2a8c963675739.scope: Deactivated successfully. machine # [ 390.427506] systemd[1]: cri-containerd-30a69e4c3042f68ddf884340c3c7667ad40296bdccab613874e2a8c963675739.scope: Consumed 987ms CPU time over 1min 42.901s wall clock time, 109.7M memory peak, 40.4M read from disk, 428K written to disk, 18.2K incoming IP traffic, 44.7K outgoing IP traffic. machine # [ 390.463924] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-30a69e4c3042f68ddf884340c3c7667ad40296bdccab613874e2a8c963675739-rootfs.mount: Deactivated successfully. machine # [ 391.933779] systemd[1]: cri-containerd-093074cc378f5500c4cc4f92a53d15f6cd0cc77c8e39f4a9350fd69c1c3f3689.scope: Deactivated successfully. machine # [ 391.989999] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-093074cc378f5500c4cc4f92a53d15f6cd0cc77c8e39f4a9350fd69c1c3f3689-rootfs.mount: Deactivated successfully. machine # [ 392.032526] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-093074cc378f5500c4cc4f92a53d15f6cd0cc77c8e39f4a9350fd69c1c3f3689-shm.mount: Deactivated successfully. machine # [ 392.234787] cni0: port 2(vethf182221a) entered disabled state machine # [ 392.084660] dhcpcd[686]: vethf182221a: carrier lost machine # [ 392.239206] vethf182221a (unregistering): left allmulticast mode machine # [ 392.241595] vethf182221a (unregistering): left promiscuous mode machine # [ 392.244158] cni0: port 2(vethf182221a) entered disabled state machine # [ 392.117373] dhcpcd[686]: vethf182221a: deleting address fe80::3cad:c8ff:fe31:febf machine # [ 392.118434] systemd[1]: run-netns-cni\x2df07076e0\x2d47f0\x2d2344\x2d1c15\x2db0d8a8003fc9.mount: Deactivated successfully. machine # [ 392.121319] dhcpcd[686]: vethf182221a: deleting route to 169.254.0.0/16 machine # [ 392.186425] dhcpcd[686]: vethf182221a: removing interface machine # [ 392.228233] k3s[888]: I0923 04:18:05.008418 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c3581c32-d71f-48ca-9c6d-ccee0f25b406-nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/c3581c32-d71f-48ca-9c6d-ccee0f25b406-nix-grpc-farm\") pod \"c3581c32-d71f-48ca-9c6d-ccee0f25b406\" (UID: \"c3581c32-d71f-48ca-9c6d-ccee0f25b406\") " machine # [ 392.228722] k3s[888]: I0923 04:18:05.008483 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c3581c32-d71f-48ca-9c6d-ccee0f25b406-kube-api-access-5d65f\" (UniqueName: \"kubernetes.io/projected/c3581c32-d71f-48ca-9c6d-ccee0f25b406-kube-api-access-5d65f\") pod \"c3581c32-d71f-48ca-9c6d-ccee0f25b406\" (UID: \"c3581c32-d71f-48ca-9c6d-ccee0f25b406\") " machine # [ 392.229216] k3s[888]: I0923 04:18:05.008523 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c3581c32-d71f-48ca-9c6d-ccee0f25b406-job\" (UniqueName: \"kubernetes.io/configmap/c3581c32-d71f-48ca-9c6d-ccee0f25b406-job\") pod \"c3581c32-d71f-48ca-9c6d-ccee0f25b406\" (UID: \"c3581c32-d71f-48ca-9c6d-ccee0f25b406\") " machine # [ 392.229742] k3s[888]: I0923 04:18:05.009551 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3581c32-d71f-48ca-9c6d-ccee0f25b406-job" pod "c3581c32-d71f-48ca-9c6d-ccee0f25b406" (UID: "c3581c32-d71f-48ca-9c6d-ccee0f25b406"). InnerVolumeSpecName "job". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 392.233544] systemd[1]: var-lib-kubelet-pods-c3581c32\x2dd71f\x2d48ca\x2d9c6d\x2dccee0f25b406-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2d5d65f.mount: Deactivated successfully. machine # [ 392.234320] systemd[1]: var-lib-kubelet-pods-c3581c32\x2dd71f\x2d48ca\x2d9c6d\x2dccee0f25b406-volumes-kubernetes.io\x7eprojected-nix\x2dgrpc\x2dfarm.mount: Deactivated successfully. machine # [ 392.249755] k3s[888]: I0923 04:18:05.030276 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3581c32-d71f-48ca-9c6d-ccee0f25b406-nix-grpc-farm" pod "c3581c32-d71f-48ca-9c6d-ccee0f25b406" (UID: "c3581c32-d71f-48ca-9c6d-ccee0f25b406"). InnerVolumeSpecName "nix-grpc-farm". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 392.254245] k3s[888]: I0923 04:18:05.034785 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3581c32-d71f-48ca-9c6d-ccee0f25b406-kube-api-access-5d65f" pod "c3581c32-d71f-48ca-9c6d-ccee0f25b406" (UID: "c3581c32-d71f-48ca-9c6d-ccee0f25b406"). InnerVolumeSpecName "kube-api-access-5d65f". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 392.328576] k3s[888]: I0923 04:18:05.108995 888 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5d65f\" (UniqueName: \"kubernetes.io/projected/c3581c32-d71f-48ca-9c6d-ccee0f25b406-kube-api-access-5d65f\") on node \"machine\" DevicePath \"\"" machine # [ 392.329636] k3s[888]: I0923 04:18:05.109088 888 reconciler_common.go:299] "Volume detached for volume \"job\" (UniqueName: \"kubernetes.io/configmap/c3581c32-d71f-48ca-9c6d-ccee0f25b406-job\") on node \"machine\" DevicePath \"\"" machine # [ 392.330459] k3s[888]: I0923 04:18:05.109117 888 reconciler_common.go:299] "Volume detached for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/c3581c32-d71f-48ca-9c6d-ccee0f25b406-nix-grpc-farm\") on node \"machine\" DevicePath \"\"" machine # [ 392.918561] k3s[888]: I0923 04:18:05.699002 888 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="093074cc378f5500c4cc4f92a53d15f6cd0cc77c8e39f4a9350fd69c1c3f3689" machine # [ 392.934740] systemd[1]: Removed slice libcontainer container kubepods-besteffort-podc3581c32_d71f_48ca_9c6d_ccee0f25b406.slice. machine # [ 392.936463] systemd[1]: kubepods-besteffort-podc3581c32_d71f_48ca_9c6d_ccee0f25b406.slice: Consumed 1.016s CPU time over 1min 48.868s wall clock time, 110M memory peak, 40.4M read from disk, 632K written to disk, 18.2K incoming IP traffic, 44.7K outgoing IP traffic. machine: (finished: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed', in 110.14 seconds) machine: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1 machine: (finished: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1, in 0.16 seconds) machine # don't know how to build these paths: machine # /nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-a> machine/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lkpnh: building fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-b> machine/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lkpnh: building 1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-top> machine/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lkpnh: building rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # INFO:nix_fast_build.processes:run nix-eval-jobs --gc-roots-dir /tmp/tmpr3z500rf/gcroots --force-recurse --max-memory-size 4096 --workers 4 --flake '.#checks' --check-cache-status machine # INFO:nix_fast_build.workers:builds: 0 machine # warning: Git tree '/tmp' is dirty machine # warning: Git tree '/tmp' is dirty machine # ▶ x86_64-linux.t started machine # INFO:nix_fast_build.workers:builds: 2 machine # ✔ x86_64-linux.t (26s) machine # x86_64-linux.t> machine/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-9dqp6: building fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # warning: Git tree '/tmp' is dirty machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath, in 0.19 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null, in 0.04 seconds) (finished: subtest: a Job with the client image builds through the farm with its service account, in 111.41 seconds) subtest: a renewed balancer certificate is served without a rollout machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f - machine # Warning: resource secrets/farm-lb-tls is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically. machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f -, in 0.28 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}', in 0.99 seconds) machine: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-775dbb5c7c-5hjch -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine # [ 396.296915] k3s[888]: E0923 04:18:09.077113 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53666: use of closed network connection machine # [ 397.572269] k3s[888]: E0923 04:18:10.352329 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53688: use of closed network connection machine # [ 398.888631] k3s[888]: E0923 04:18:11.668770 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53718: use of closed network connection machine # [ 400.210880] k3s[888]: E0923 04:18:12.991056 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53742: use of closed network connection machine # [ 401.516851] k3s[888]: E0923 04:18:14.296788 888 upgradeaware.go:441] Error proxying data from backend to client: writeto tcp 127.0.0.1:38322->127.0.0.1:10010: read tcp 127.0.0.1:38322->127.0.0.1:10010: read: connection reset by peer machine # [ 402.800777] k3s[888]: time="2026-09-23T04:18:15Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:59398->127.0.0.1:10250: write: connection reset by peer" machine # [ 402.802976] k3s[888]: E0923 04:18:15.581186 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53804: use of closed network connection machine # [ 404.071578] k3s[888]: E0923 04:18:16.851463 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59090: use of closed network connection machine # [ 405.414040] k3s[888]: E0923 04:18:18.193949 888 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:34274->127.0.0.1:10010: write tcp 127.0.0.1:34274->127.0.0.1:10010: write: connection reset by peer machine # [ 405.415245] k3s[888]: E0923 04:18:18.194891 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59112: use of closed network connection machine # [ 406.774932] k3s[888]: E0923 04:18:19.554996 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59152: use of closed network connection machine # [ 408.066237] k3s[888]: E0923 04:18:20.846442 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59184: use of closed network connection machine # [ 409.367717] k3s[888]: E0923 04:18:22.147728 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59216: use of closed network connection machine # [ 410.681129] k3s[888]: E0923 04:18:23.461129 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59248: use of closed network connection machine # [ 411.983458] k3s[888]: E0923 04:18:24.763316 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59268: use of closed network connection machine # [ 413.252150] k3s[888]: E0923 04:18:26.032263 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58904: use of closed network connection machine # [ 414.531713] k3s[888]: E0923 04:18:27.311959 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58942: use of closed network connection machine # [ 414.618816] postgres[768]: [768] LOG: checkpoint complete: wrote 1037 buffers (6.3%), wrote 3 SLRU buffers; 1 WAL file(s) added, 0 removed, 0 recycled; write=104.223 s, sync=0.046 s, total=104.308 s; sync files=364, longest=0.004 s, average=0.001 s; distance=4969 kB, estimate=4969 kB; lsn=0/1C71CB8, redo lsn=0/1C408B0 machine # [ 415.832234] k3s[888]: E0923 04:18:28.612274 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58970: use of closed network connection machine # [ 417.150803] k3s[888]: E0923 04:18:29.930996 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58988: use of closed network connection machine # [ 418.428226] k3s[888]: E0923 04:18:31.208145 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59020: use of closed network connection machine # [ 419.721851] k3s[888]: E0923 04:18:32.502077 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59036: use of closed network connection machine # [ 421.003409] k3s[888]: E0923 04:18:33.783516 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59076: use of closed network connection machine # [ 422.295203] k3s[888]: E0923 04:18:35.075408 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59098: use of closed network connection machine # [ 422.296200] k3s[888]: E0923 04:18:35.075805 888 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:39614->127.0.0.1:10010: write tcp 127.0.0.1:39614->127.0.0.1:10010: write: broken pipe machine # [ 423.589265] k3s[888]: E0923 04:18:36.369021 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:47912: use of closed network connection machine # [ 424.877584] k3s[888]: E0923 04:18:37.657792 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:47936: use of closed network connection machine # [ 426.187141] k3s[888]: E0923 04:18:38.967187 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:47966: use of closed network connection machine # [ 427.502973] k3s[888]: E0923 04:18:40.282972 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:47994: use of closed network connection machine # [ 427.503426] k3s[888]: E0923 04:18:40.283217 888 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:51268->127.0.0.1:10010: write tcp 127.0.0.1:51268->127.0.0.1:10010: write: broken pipe machine: (finished: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-775dbb5c7c-5hjch -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 31.46 seconds) machine: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine: (finished: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 0.05 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1 machine # [ 427.779340] niks3-server[1188]: 2026/09/23 04:18:40 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 427.793264] niks3-server[1188]: 2026/09/23 04:18:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign machine # [ 427.796560] niks3-server[1188]: 2026/09/23 04:18:40 INFO Registered completed upload object_key=nar/0g42hgwa9jp9abmqxz90dkwxpybsznzbpsy35rm921mlk5sw56jq.nar.zst machine # [ 427.799523] niks3-server[1188]: 2026/09/23 04:18:40 INFO Signed narinfos id=21 count=1 machine # [ 427.802920] niks3-server[1188]: 2026/09/23 04:18:40 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.ls machine # [ 427.807922] niks3-server[1188]: 2026/09/23 04:18:40 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete machine # [ 427.811842] niks3-server[1188]: 2026/09/23 04:18:40 INFO Completed upload id=21 machine # [ 427.813152] niks3-server[1188]: 2026/09/23 04:18:40 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.narinfo machine # [ 453.331754] niks3-server[1188]: 2026/09/23 04:19:06 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 453.347074] niks3-server[1188]: 2026/09/23 04:19:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign machine # [ 453.349513] niks3-server[1188]: 2026/09/23 04:19:06 INFO Signed narinfos id=22 count=1 machine # [ 453.353150] niks3-server[1188]: 2026/09/23 04:19:06 INFO Registered completed upload object_key=nar/1vxmmzwi16s4iri6dcmi9v62dpq1ys7wz15b497ncik3sd67nfzg.nar.zst machine # [ 453.359311] niks3-server[1188]: 2026/09/23 04:19:06 INFO Registered completed upload object_key=log/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31-k3s-a.drv machine # [ 453.359977] niks3-server[1188]: 2026/09/23 04:19:06 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete machine # [ 453.366125] niks3-server[1188]: 2026/09/23 04:19:06 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.ls machine # [ 453.368482] niks3-server[1188]: 2026/09/23 04:19:06 INFO Completed upload id=22 machine # [ 453.369732] niks3-server[1188]: 2026/09/23 04:19:06 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo machine # [ 453.426728] niks3-server[1188]: 2026/09/23 04:19:06 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 453.435293] niks3-server[1188]: 2026/09/23 04:19:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign machine # [ 453.436375] niks3-server[1188]: 2026/09/23 04:19:06 INFO Signed narinfos id=23 count=1 machine # [ 453.439072] niks3-server[1188]: 2026/09/23 04:19:06 INFO Registered completed upload object_key=nar/0cbxkyxz068xc5mivh2h67kw6y01n1x28cbs11v1a03g8m4c71zm.nar.zst machine # [ 453.441460] niks3-server[1188]: 2026/09/23 04:19:06 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.ls machine # [ 453.443671] niks3-server[1188]: 2026/09/23 04:19:06 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete machine # [ 453.445255] niks3-server[1188]: 2026/09/23 04:19:06 INFO Completed upload id=23 machine # [ 453.451681] niks3-server[1188]: 2026/09/23 04:19:06 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.narinfo machine # [ 478.558421] niks3-server[1188]: 2026/09/23 04:19:31 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 478.575219] niks3-server[1188]: 2026/09/23 04:19:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign machine # [ 478.576952] niks3-server[1188]: 2026/09/23 04:19:31 INFO Signed narinfos id=24 count=1 machine # [ 478.583468] niks3-server[1188]: 2026/09/23 04:19:31 INFO Registered completed upload object_key=log/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4-k3s-b.drv machine # [ 478.585971] niks3-server[1188]: 2026/09/23 04:19:31 INFO Registered completed upload object_key=nar/0khxywxb2r78vhpc5hsmha3ymgp910z0aka7550jmaqzs333rmzp.nar.zst machine # [ 478.589093] niks3-server[1188]: 2026/09/23 04:19:31 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.ls machine # [ 478.592829] niks3-server[1188]: 2026/09/23 04:19:31 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete machine # [ 478.597901] niks3-server[1188]: 2026/09/23 04:19:31 INFO Completed upload id=24 machine # [ 478.599703] niks3-server[1188]: 2026/09/23 04:19:31 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.narinfo machine # [ 478.664655] niks3-server[1188]: 2026/09/23 04:19:31 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 478.675552] niks3-server[1188]: 2026/09/23 04:19:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign machine # [ 478.677549] niks3-server[1188]: 2026/09/23 04:19:31 INFO Signed narinfos id=25 count=1 machine # [ 478.679698] niks3-server[1188]: 2026/09/23 04:19:31 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.ls machine # [ 478.681386] niks3-server[1188]: 2026/09/23 04:19:31 INFO Registered completed upload object_key=nar/04bim5f8bvjh25xncf5x40kb529khrlzcbc92qxvapgbc0bdfv2h.nar.zst machine # [ 478.686303] niks3-server[1188]: 2026/09/23 04:19:31 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete machine # [ 478.688376] niks3-server[1188]: 2026/09/23 04:19:31 INFO Completed upload id=25 machine # [ 478.691113] niks3-server[1188]: 2026/09/23 04:19:31 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.narinfo machine # [ 504.011334] niks3-server[1188]: 2026/09/23 04:19:56 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 504.030471] niks3-server[1188]: 2026/09/23 04:19:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign machine # [ 504.035445] niks3-server[1188]: 2026/09/23 04:19:56 INFO Signed narinfos id=26 count=1 machine # [ 504.039128] niks3-server[1188]: 2026/09/23 04:19:56 INFO Registered completed upload object_key=log/jz7biafi8rj5r3r392blyazw5mdpvy0d-k3s-top.drv machine # [ 504.043858] niks3-server[1188]: 2026/09/23 04:19:56 INFO Registered completed upload object_key=nar/11f7f1hixry25c2yc6np9hs10a2pwwqmymmrxxbswhdjabcyvv0s.nar.zst machine # [ 504.048859] niks3-server[1188]: 2026/09/23 04:19:56 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.ls machine # [ 504.055739] niks3-server[1188]: 2026/09/23 04:19:56 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete machine # [ 504.060752] niks3-server[1188]: 2026/09/23 04:19:56 INFO Completed upload id=26 machine # [ 504.062971] niks3-server[1188]: 2026/09/23 04:19:56 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1, in 76.54 seconds) (finished: subtest: a renewed balancer certificate is served without a rollout, in 109.31 seconds) subtest: metrics carry build_info machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-cfb8578f6-9dqp6 -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-cfb8578f6-9dqp6 -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.17 seconds) machine: must succeed: curl -sf http://10.42.0.6:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-9dqp6"' machine: (finished: must succeed: curl -sf http://10.42.0.6:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-9dqp6"', in 0.03 seconds) (finished: subtest: metrics carry build_info, in 0.20 seconds) subtest: harmonia-gc frees space and the worker stays Ready machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-cfb8578f6-9dqp6 -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'' machine # [ 504.475875] k3s[888]: E0923 04:19:57.255832 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56432: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-cfb8578f6-9dqp6 -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'', in 0.18 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-cfb8578f6-9dqp6 -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done' machine # [ 504.742692] k3s[888]: E0923 04:19:57.522988 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56478: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-cfb8578f6-9dqp6 -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done', in 0.27 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-cfb8578f6-9dqp6 -c gc -- sh -c 'fallocate -l 11443240960 /nix/fill' machine # [ 504.959749] k3s[888]: E0923 04:19:57.740225 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56494: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-cfb8578f6-9dqp6 -c gc -- sh -c 'fallocate -l 11443240960 /nix/fill', in 0.22 seconds) machine: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-cfb8578f6-9dqp6 -c gc --since=30s | grep -q 'store paths deleted' machine: (finished: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-cfb8578f6-9dqp6 -c gc --since=30s | grep -q 'store paths deleted', in 5.13 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-cfb8578f6-9dqp6 -c gc -- sh -c 'rm /nix/fill' machine # [ 510.283488] k3s[888]: E0923 04:20:03.063534 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56608: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-cfb8578f6-9dqp6 -c gc -- sh -c 'rm /nix/fill', in 0.19 seconds) machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-cfb8578f6-9dqp6 -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-cfb8578f6-9dqp6 -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}', in 0.14 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-cfb8578f6-9dqp6 -c gc -- sh -c 'command -v nix-daemon && command -v niks3' machine # [ 510.601991] k3s[888]: E0923 04:20:03.382477 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56640: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-cfb8578f6-9dqp6 -c gc -- sh -c 'command -v nix-daemon && command -v niks3', in 0.18 seconds) (finished: subtest: harmonia-gc frees space and the worker stays Ready, in 6.31 seconds) subtest: losing the balancer mid-build: the client reconnects and the build succeeds machine: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1 machine # [ 510.627559] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1. machine # Running as unit: vialb.service; invocation ID: 89562ba287a049528bed9372acb288de machine: (finished: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1, in 0.02 seconds) machine: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'" machine # [ 510.756130] nix[9741]: don't know how to build these paths: machine # [ 510.757497] nix[9741]: /nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 510.791718] nix[9741]: copying 1 paths to '127.0.0.1:30051'... machine # [ 510.794672] nix[9741]: copying path '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' to '127.0.0.1:30051'... machine # [ 510.847564] niks3-server[1188]: 2026/09/23 04:20:03 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 510.868794] niks3-server[1188]: 2026/09/23 04:20:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign machine # [ 510.870918] niks3-server[1188]: 2026/09/23 04:20:03 INFO Registered completed upload object_key=nar/0kkr2vb091wkq0cb0f1q92413dsfskh76wydp8mwysv7rawns0ar.nar.zst machine # [ 510.873919] niks3-server[1188]: 2026/09/23 04:20:03 INFO Signed narinfos id=27 count=1 machine # [ 510.875344] niks3-server[1188]: 2026/09/23 04:20:03 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.ls machine # [ 510.883516] niks3-server[1188]: 2026/09/23 04:20:03 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete machine # [ 510.885822] niks3-server[1188]: 2026/09/23 04:20:03 INFO Completed upload id=27 machine # [ 510.889929] niks3-server[1188]: 2026/09/23 04:20:03 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.narinfo machine # [ 510.897754] nix[9741]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 510.898580] nix[9741]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-9dqp6: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine: (finished: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'", in 1.06 seconds) machine: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false machine: (finished: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false, in 0.38 seconds) machine: waiting for success: ! systemctl is-active vialb machine # [ 512.107293] nix[9741]: scheduler at 127.0.0.1:30051: Stream removed (Socket closed), reconnecting machine # [ 512.109487] nix[9741]: d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv: Stream removed (Socket closed), asking the scheduler again machine # [ 512.124132] systemd[1]: cri-containerd-93ec04ece54b411f967659f038c9744caa93df96b362b82ec78ad198879f0add.scope: Deactivated successfully. machine # [ 512.125656] systemd[1]: cri-containerd-93ec04ece54b411f967659f038c9744caa93df96b362b82ec78ad198879f0add.scope: Consumed 4.480s CPU time over 7min 41.151s wall clock time, 55M memory peak, 33.1M read from disk, 723K incoming IP traffic, 691.4K outgoing IP traffic. machine # [ 512.159055] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-93ec04ece54b411f967659f038c9744caa93df96b362b82ec78ad198879f0add-rootfs.mount: Deactivated successfully. machine # [ 512.192623] systemd[1]: cri-containerd-3885bf097d3f69e6eb8e6f9e02adf9db06d533d222e7c42411bfa06aadca930b.scope: Deactivated successfully. machine # [ 512.221620] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-3885bf097d3f69e6eb8e6f9e02adf9db06d533d222e7c42411bfa06aadca930b-rootfs.mount: Deactivated successfully. machine # [ 512.247284] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-3885bf097d3f69e6eb8e6f9e02adf9db06d533d222e7c42411bfa06aadca930b-shm.mount: Deactivated successfully. machine # [ 512.432410] cni0: port 3(vethafa44b41) entered disabled state machine # [ 512.281420] dhcpcd[686]: vethafa44b41: carrier lost machine # [ 512.434975] vethafa44b41 (unregistering): left allmulticast mode machine # [ 512.436010] vethafa44b41 (unregistering): left promiscuous mode machine # [ 512.437041] cni0: port 3(vethafa44b41) entered disabled state machine # [ 512.305623] systemd[1]: run-netns-cni\x2d831a0c92\x2d0e4c\x2dc3bc\x2dd269\x2db728c7447866.mount: Deactivated successfully. machine # [ 512.313059] dhcpcd[686]: vethafa44b41: deleting address fe80::7499:29ff:fef7:ad0 machine # [ 512.318195] dhcpcd[686]: vethafa44b41: deleting route to 169.254.0.0/16 machine # [ 512.344461] k3s[888]: I0923 04:20:05.123396 888 endpointslice_controller.go:361] "Error syncing endpoint slices for service, retrying" key="farm/nix-grpc-farm" err="EndpointSlice informer cache is out of date" machine # [ 512.362082] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod9b3da3c4_694e_447f_9832_4a4b17c096b3.slice. machine # [ 512.399288] dhcpcd[686]: vethafa44b41: removing interface machine # [ 512.427699] k3s[888]: I0923 04:20:05.208208 888 scope.go:122] "RemoveContainer" containerID="93ec04ece54b411f967659f038c9744caa93df96b362b82ec78ad198879f0add" machine # [ 512.439853] k3s[888]: I0923 04:20:05.220392 888 scope.go:122] "RemoveContainer" containerID="93ec04ece54b411f967659f038c9744caa93df96b362b82ec78ad198879f0add" machine # [ 512.440626] k3s[888]: E0923 04:20:05.221034 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"93ec04ece54b411f967659f038c9744caa93df96b362b82ec78ad198879f0add\": not found" containerID="93ec04ece54b411f967659f038c9744caa93df96b362b82ec78ad198879f0add" machine # [ 512.441036] k3s[888]: I0923 04:20:05.221073 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"93ec04ece54b411f967659f038c9744caa93df96b362b82ec78ad198879f0add"} err="failed to get container status \"93ec04ece54b411f967659f038c9744caa93df96b362b82ec78ad198879f0add\": rpc error: code = NotFound desc = an error occurred when try to find container \"93ec04ece54b411f967659f038c9744caa93df96b362b82ec78ad198879f0add\": not found" machine # [ 512.446449] k3s[888]: I0923 04:20:05.226998 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/21dae106-4811-4bcf-8bcd-f491dac23b61-tls-ca\" (UniqueName: \"kubernetes.io/secret/21dae106-4811-4bcf-8bcd-f491dac23b61-tls-ca\") pod \"21dae106-4811-4bcf-8bcd-f491dac23b61\" (UID: \"21dae106-4811-4bcf-8bcd-f491dac23b61\") " machine # [ 512.447321] k3s[888]: I0923 04:20:05.227054 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/21dae106-4811-4bcf-8bcd-f491dac23b61-tls-lb\" (UniqueName: \"kubernetes.io/secret/21dae106-4811-4bcf-8bcd-f491dac23b61-tls-lb\") pod \"21dae106-4811-4bcf-8bcd-f491dac23b61\" (UID: \"21dae106-4811-4bcf-8bcd-f491dac23b61\") " machine # [ 512.447476] k3s[888]: I0923 04:20:05.227091 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/21dae106-4811-4bcf-8bcd-f491dac23b61-config\" (UniqueName: \"kubernetes.io/configmap/21dae106-4811-4bcf-8bcd-f491dac23b61-config\") pod \"21dae106-4811-4bcf-8bcd-f491dac23b61\" (UID: \"21dae106-4811-4bcf-8bcd-f491dac23b61\") " machine # [ 512.448131] k3s[888]: I0923 04:20:05.227121 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/21dae106-4811-4bcf-8bcd-f491dac23b61-tmp\" (UniqueName: \"kubernetes.io/empty-dir/21dae106-4811-4bcf-8bcd-f491dac23b61-tmp\") pod \"21dae106-4811-4bcf-8bcd-f491dac23b61\" (UID: \"21dae106-4811-4bcf-8bcd-f491dac23b61\") " machine # [ 512.448679] k3s[888]: I0923 04:20:05.227178 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/9b3da3c4-694e-447f-9832-4a4b17c096b3-tls-lb\") pod \"nix-grpc-farm-lb-775dbb5c7c-bcpbs\" (UID: \"9b3da3c4-694e-447f-9832-4a4b17c096b3\") " pod="farm/nix-grpc-farm-lb-775dbb5c7c-bcpbs" machine # [ 512.449372] k3s[888]: I0923 04:20:05.227209 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9b3da3c4-694e-447f-9832-4a4b17c096b3-config\") pod \"nix-grpc-farm-lb-775dbb5c7c-bcpbs\" (UID: \"9b3da3c4-694e-447f-9832-4a4b17c096b3\") " pod="farm/nix-grpc-farm-lb-775dbb5c7c-bcpbs" machine # [ 512.450514] k3s[888]: I0923 04:20:05.227233 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b3da3c4-694e-447f-9832-4a4b17c096b3-tmp\") pod \"nix-grpc-farm-lb-775dbb5c7c-bcpbs\" (UID: \"9b3da3c4-694e-447f-9832-4a4b17c096b3\") " pod="farm/nix-grpc-farm-lb-775dbb5c7c-bcpbs" machine # [ 512.451242] k3s[888]: I0923 04:20:05.227261 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/9b3da3c4-694e-447f-9832-4a4b17c096b3-tls-ca\") pod \"nix-grpc-farm-lb-775dbb5c7c-bcpbs\" (UID: \"9b3da3c4-694e-447f-9832-4a4b17c096b3\") " pod="farm/nix-grpc-farm-lb-775dbb5c7c-bcpbs" machine # [ 512.452637] systemd[1]: var-lib-kubelet-pods-21dae106\x2d4811\x2d4bcf\x2d8bcd\x2df491dac23b61-volume\x2dsubpaths-config-envoy-0.mount: Deactivated successfully. machine # [ 512.486228] k3s[888]: I0923 04:20:05.266599 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21dae106-4811-4bcf-8bcd-f491dac23b61-tls-lb" pod "21dae106-4811-4bcf-8bcd-f491dac23b61" (UID: "21dae106-4811-4bcf-8bcd-f491dac23b61"). InnerVolumeSpecName "tls-lb". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 512.487082] k3s[888]: I0923 04:20:05.267190 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21dae106-4811-4bcf-8bcd-f491dac23b61-tmp" pod "21dae106-4811-4bcf-8bcd-f491dac23b61" (UID: "21dae106-4811-4bcf-8bcd-f491dac23b61"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 512.487665] k3s[888]: I0923 04:20:05.267250 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21dae106-4811-4bcf-8bcd-f491dac23b61-tls-ca" pod "21dae106-4811-4bcf-8bcd-f491dac23b61" (UID: "21dae106-4811-4bcf-8bcd-f491dac23b61"). InnerVolumeSpecName "tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 512.504194] k3s[888]: I0923 04:20:05.284716 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21dae106-4811-4bcf-8bcd-f491dac23b61-config" pod "21dae106-4811-4bcf-8bcd-f491dac23b61" (UID: "21dae106-4811-4bcf-8bcd-f491dac23b61"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 512.547531] k3s[888]: I0923 04:20:05.328030 888 reconciler_common.go:299] "Volume detached for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/21dae106-4811-4bcf-8bcd-f491dac23b61-tls-ca\") on node \"machine\" DevicePath \"\"" machine # [ 512.548225] k3s[888]: I0923 04:20:05.328090 888 reconciler_common.go:299] "Volume detached for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/21dae106-4811-4bcf-8bcd-f491dac23b61-tls-lb\") on node \"machine\" DevicePath \"\"" machine # [ 512.549121] k3s[888]: I0923 04:20:05.328106 888 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/21dae106-4811-4bcf-8bcd-f491dac23b61-config\") on node \"machine\" DevicePath \"\"" machine # [ 512.549637] k3s[888]: I0923 04:20:05.328119 888 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21dae106-4811-4bcf-8bcd-f491dac23b61-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 512.848394] cni0: port 2(vethd5b4552e) entered blocking state machine # [ 512.849977] cni0: port 2(vethd5b4552e) entered disabled state machine # [ 512.851039] vethd5b4552e: entered allmulticast mode machine # [ 512.852024] vethd5b4552e: entered promiscuous mode machine # [ 512.702303] (udev-worker)[9914]: Network interface NamePolicy= disabled on kernel command line. machine # [ 512.861218] cni0: port 2(vethd5b4552e) entered blocking state machine # [ 512.862455] cni0: port 2(vethd5b4552e) entered forwarding state machine # [ 512.730042] dhcpcd[686]: vethd5b4552e: IAID d1:97:a7:69 machine # [ 512.730594] dhcpcd[686]: vethd5b4552e: adding address fe80::5cac:d1ff:fe97:a769 machine # [ 512.738116] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod21dae106_4811_4bcf_8bcd_f491dac23b61.slice. machine # [ 512.739941] systemd[1]: kubepods-besteffort-pod21dae106_4811_4bcf_8bcd_f491dac23b61.slice: Consumed 4.511s CPU time over 7min 43.614s wall clock time, 55.3M memory peak, 33.1M read from disk, 723K incoming IP traffic, 691.4K outgoing IP traffic. machine # [ 512.801458] systemd[1]: Started libcontainer container c66e3e3fd7dea12e410c208c3a20e2d28514fd51b7547aa9b2c5d8bb25211038. machine # [ 512.931386] systemd[1]: Started libcontainer container de7d00da687379b2e11a7909d4e34dfc6d50309d66167c0d922acb5099845311. machine # [ 513.179492] systemd[1]: var-lib-kubelet-pods-21dae106\x2d4811\x2d4bcf\x2d8bcd\x2df491dac23b61-volume\x2dsubpaths-config-envoy-2.mount: Deactivated successfully. machine # [ 513.183361] systemd[1]: var-lib-kubelet-pods-21dae106\x2d4811\x2d4bcf\x2d8bcd\x2df491dac23b61-volume\x2dsubpaths-config-envoy-1.mount: Deactivated successfully. machine # [ 513.186997] systemd[1]: var-lib-kubelet-pods-21dae106\x2d4811\x2d4bcf\x2d8bcd\x2df491dac23b61-volumes-kubernetes.io\x7esecret-tls\x2dca.mount: Deactivated successfully. machine # [ 513.190928] systemd[1]: var-lib-kubelet-pods-21dae106\x2d4811\x2d4bcf\x2d8bcd\x2df491dac23b61-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 513.194596] systemd[1]: var-lib-kubelet-pods-21dae106\x2d4811\x2d4bcf\x2d8bcd\x2df491dac23b61-volumes-kubernetes.io\x7esecret-tls\x2dlb.mount: Deactivated successfully. machine # [ 513.263438] k3s[888]: I0923 04:20:06.043951 888 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="21dae106-4811-4bcf-8bcd-f491dac23b61" path="/var/lib/kubelet/pods/21dae106-4811-4bcf-8bcd-f491dac23b61/volumes" machine # [ 513.482187] k3s[888]: I0923 04:20:06.261993 888 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-775dbb5c7c-bcpbs" podStartSLOduration=1.2619568380000001 podStartE2EDuration="1.261956838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-23 04:20:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-23 04:20:06.240318055 +0000 UTC m=+496.582159688" watchObservedRunningTime="2026-09-23 04:20:06.261956838 +0000 UTC m=+496.603797075" machine # [ 514.609350] nix[9741]: scheduler at 127.0.0.1:30051: failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:30051: Failed to connect to remote host: connect() timed out, reconnecting machine # [ 514.671727] dhcpcd[686]: vethd5b4552e: soliciting a DHCP lease machine # [ 515.139225] dhcpcd[686]: vethd5b4552e: soliciting an IPv6 router machine # [ 515.659910] nix[9741]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 515.663393] nix[9741]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lkpnh: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 519.673190] dhcpcd[686]: vethd5b4552e: probing for an IPv4LL address machine # [ 524.987176] dhcpcd[686]: vethd5b4552e: using IPv4LL address 169.254.154.132 machine # [ 524.990103] dhcpcd[686]: vethd5b4552e: adding route to 169.254.0.0/16 machine # [ 527.142630] dhcpcd[686]: vethd5b4552e: no IPv6 Routers available machine # [ 560.019306] niks3-server[1188]: 2026/09/23 04:20:52 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 560.046891] niks3-server[1188]: 2026/09/23 04:20:52 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.ls machine # [ 560.050429] niks3-server[1188]: 2026/09/23 04:20:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign machine # [ 560.052303] niks3-server[1188]: 2026/09/23 04:20:52 INFO Signed narinfos id=28 count=1 machine # [ 560.056260] niks3-server[1188]: 2026/09/23 04:20:52 INFO Registered completed upload object_key=log/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 560.061425] niks3-server[1188]: 2026/09/23 04:20:52 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete machine # [ 560.066732] niks3-server[1188]: 2026/09/23 04:20:52 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.narinfo machine # [ 560.070578] niks3-server[1188]: 2026/09/23 04:20:52 INFO Completed upload id=28 machine # [ 560.102562] systemd[1]: vialb.service: Deactivated successfully. machine # [ 560.103499] systemd[1]: vialb.service: Consumed 213ms CPU time over 49.475s wall clock time, 40.7M memory peak, 4K written to disk, 8.6K incoming IP traffic, 17.5K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active vialb, in 49.03 seconds) machine: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; }, in 0.04 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 0.24 seconds) (finished: subtest: losing the balancer mid-build: the client reconnects and the build succeeds, in 50.79 seconds) subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes machine: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 machine # [ 561.421963] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1. machine # Running as unit: slow.service; invocation ID: f211fd60ad0b4776b495acf48bc4cd6b machine: (finished: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1, in 0.03 seconds) machine # [ 561.554841] nix[10724]: don't know how to build these paths: machine # [ 561.555683] nix[10724]: /nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 561.576228] nix[10724]: copying 1 paths to '127.0.0.1:30051'... machine # [ 561.577917] nix[10724]: copying path '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' to '127.0.0.1:30051'... machine # [ 561.621662] niks3-server[1188]: 2026/09/23 04:20:54 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 561.636789] niks3-server[1188]: 2026/09/23 04:20:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign machine # [ 561.637600] niks3-server[1188]: 2026/09/23 04:20:54 INFO Signed narinfos id=29 count=1 machine # [ 561.641068] niks3-server[1188]: 2026/09/23 04:20:54 INFO Registered completed upload object_key=nar/0wl2i9xpw0gwrx1xqdgx9ka4n503ky9qhl20pdrdlphn8d6lcx0i.nar.zst machine # [ 561.646098] niks3-server[1188]: 2026/09/23 04:20:54 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete machine # [ 561.647224] niks3-server[1188]: 2026/09/23 04:20:54 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.ls machine # [ 561.648901] niks3-server[1188]: 2026/09/23 04:20:54 INFO Completed upload id=29 machine # [ 561.651294] niks3-server[1188]: 2026/09/23 04:20:54 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.narinfo machine # [ 561.657344] k3s[888]: E0923 04:20:54.437373 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60700: use of closed network connection machine # command terminated with exit code 1 machine # [ 561.665095] nix[10724]: building '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' on 127.0.0.1:30051... machine # [ 561.667357] nix[10724]: slow-s1> machine/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-9dqp6: building zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 561.875386] k3s[888]: E0923 04:20:54.655787 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60732: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 563.364049] k3s[888]: E0923 04:20:56.144092 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39958: use of closed network connection machine # command terminated with exit code 1 machine # [ 564.651985] k3s[888]: E0923 04:20:57.431020 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39988: use of closed network connection machine # [ 564.853592] k3s[888]: E0923 04:20:57.634022 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40014: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 566.117527] k3s[888]: E0923 04:20:58.897665 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40058: use of closed network connection machine # [ 566.308133] k3s[888]: E0923 04:20:59.088592 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40092: use of closed network connection machine # command terminated with exit code 1 machine # [ 567.569484] k3s[888]: time="2026-09-23T04:21:00Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:40970->127.0.0.1:10250: write: broken pipe" machine # command terminated with exit code 1 machine # [ 567.570140] k3s[888]: E0923 04:21:00.349586 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40126: use of closed network connection machine # [ 567.774882] k3s[888]: E0923 04:21:00.555396 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40150: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 569.073671] k3s[888]: E0923 04:21:01.853616 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40166: use of closed network connection machine # [ 569.299152] k3s[888]: E0923 04:21:02.079615 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40202: use of closed network connection machine # command terminated with exit code 1 machine # [ 570.586653] k3s[888]: E0923 04:21:03.366889 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40230: use of closed network connection machine # command terminated with exit code 1 machine # [ 570.792136] k3s[888]: E0923 04:21:03.572395 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40248: use of closed network connection machine # command terminated with exit code 1 machine # [ 572.080961] k3s[888]: E0923 04:21:04.861141 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40280: use of closed network connection machine # command terminated with exit code 1 machine # [ 572.301547] k3s[888]: E0923 04:21:05.082068 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40304: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 573.588178] k3s[888]: E0923 04:21:06.368051 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53546: use of closed network connection machine # [ 573.771200] k3s[888]: E0923 04:21:06.551687 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53566: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 575.082440] k3s[888]: E0923 04:21:07.861471 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53596: use of closed network connection machine # [ 575.281303] k3s[888]: E0923 04:21:08.061742 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53618: use of closed network connection machine # command terminated with exit code 1 machine # [ 576.542744] k3s[888]: E0923 04:21:09.322935 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53644: use of closed network connection machine # command terminated with exit code 1 machine # [ 576.746391] k3s[888]: E0923 04:21:09.526825 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53680: use of closed network connection machine # command terminated with exit code 1 machine # [ 578.014774] k3s[888]: E0923 04:21:10.794997 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53712: use of closed network connection machine # command terminated with exit code 1 machine # [ 578.194846] k3s[888]: E0923 04:21:10.975338 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53742: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 579.477261] k3s[888]: E0923 04:21:12.257391 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53786: use of closed network connection machine # [ 579.674560] k3s[888]: E0923 04:21:12.455000 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53820: use of closed network connection machine # command terminated with exit code 1 machine # [ 580.994498] k3s[888]: E0923 04:21:13.774747 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53848: use of closed network connection machine # command terminated with exit code 1 machine # [ 581.202292] k3s[888]: E0923 04:21:13.982820 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53856: use of closed network connection machine # command terminated with exit code 1 machine # [ 582.512263] k3s[888]: E0923 04:21:15.292445 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53886: use of closed network connection machine # command terminated with exit code 1 machine # [ 582.695763] k3s[888]: E0923 04:21:15.476260 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53924: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 583.930236] k3s[888]: E0923 04:21:16.709567 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:44872: use of closed network connection machine # [ 584.107256] k3s[888]: E0923 04:21:16.887731 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:44906: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 585.370251] k3s[888]: E0923 04:21:18.149855 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:44934: use of closed network connection machine # [ 585.546673] k3s[888]: E0923 04:21:18.327091 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:44960: use of closed network connection machine # command terminated with exit code 1 machine # [ 586.990584] k3s[888]: E0923 04:21:19.770844 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45018: use of closed network connection machine: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-cfb8578f6-9dqp6 --wait=false machine: (finished: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-cfb8578f6-9dqp6 --wait=false, in 0.15 seconds) machine: must succeed: sleep 5.0 machine # [ 587.197343] systemd[1]: cri-containerd-17fac097174c9caf91b0e0f3c26c28012810163e0ac8876b00dcd486ed9cb67a.scope: Deactivated successfully. machine # [ 587.198822] systemd[1]: cri-containerd-17fac097174c9caf91b0e0f3c26c28012810163e0ac8876b00dcd486ed9cb67a.scope: Consumed 601ms CPU time over 8min 48.066s wall clock time, 14.6M memory peak, 6.4M read from disk. machine # [ 587.227808] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-17fac097174c9caf91b0e0f3c26c28012810163e0ac8876b00dcd486ed9cb67a-rootfs.mount: Deactivated successfully. machine # [ 588.096257] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod15e94049_1333_4145_9348_880a438c2caf.slice. machine # [ 588.146541] k3s[888]: I0923 04:21:20.926812 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/15e94049-1333-4145-9348-880a438c2caf-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-7mxck\" (UID: \"15e94049-1333-4145-9348-880a438c2caf\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-7mxck" machine # [ 588.148346] k3s[888]: I0923 04:21:20.928799 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/15e94049-1333-4145-9348-880a438c2caf-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-7mxck\" (UID: \"15e94049-1333-4145-9348-880a438c2caf\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-7mxck" machine # [ 588.149477] k3s[888]: I0923 04:21:20.928857 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvwtg\" (UniqueName: \"kubernetes.io/projected/15e94049-1333-4145-9348-880a438c2caf-kube-api-access-pvwtg\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-7mxck\" (UID: \"15e94049-1333-4145-9348-880a438c2caf\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-7mxck" machine # [ 588.150146] k3s[888]: I0923 04:21:20.928900 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/15e94049-1333-4145-9348-880a438c2caf-build\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-7mxck\" (UID: \"15e94049-1333-4145-9348-880a438c2caf\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-7mxck" machine # [ 588.150695] k3s[888]: I0923 04:21:20.928934 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/15e94049-1333-4145-9348-880a438c2caf-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-7mxck\" (UID: \"15e94049-1333-4145-9348-880a438c2caf\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-7mxck" machine # [ 588.153109] k3s[888]: I0923 04:21:20.928961 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/15e94049-1333-4145-9348-880a438c2caf-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-7mxck\" (UID: \"15e94049-1333-4145-9348-880a438c2caf\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-7mxck" machine # [ 588.153565] k3s[888]: I0923 04:21:20.928996 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/15e94049-1333-4145-9348-880a438c2caf-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-7mxck\" (UID: \"15e94049-1333-4145-9348-880a438c2caf\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-7mxck" machine # [ 588.154079] k3s[888]: I0923 04:21:20.929036 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/15e94049-1333-4145-9348-880a438c2caf-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-7mxck\" (UID: \"15e94049-1333-4145-9348-880a438c2caf\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-7mxck" machine # [ 588.617711] cni0: port 3(veth19cee508) entered blocking state machine # [ 588.619435] cni0: port 3(veth19cee508) entered disabled state machine # [ 588.625014] veth19cee508: entered allmulticast mode machine # [ 588.626295] veth19cee508: entered promiscuous mode machine # [ 588.638889] cni0: port 3(veth19cee508) entered blocking state machine # [ 588.639864] cni0: port 3(veth19cee508) entered forwarding state machine # [ 588.520090] (udev-worker)[12352]: Network interface NamePolicy= disabled on kernel command line. machine # [ 588.555180] dhcpcd[686]: veth19cee508: IAID d6:20:13:14 machine # [ 588.556171] dhcpcd[686]: veth19cee508: adding address fe80::70bb:d6ff:fe20:1314 machine # [ 588.585582] systemd[1]: Started libcontainer container a260351ba88d7a8be3faf603601f95b44c81c503d373df799f389ccac565de4a. machine # [ 588.728382] systemd[1]: Started libcontainer container 82d952c470ab3c6e3c5deee65483586c3c3b0b04e66787286be99e351fa5f206. machine # [ 588.952668] dhcpcd[686]: veth19cee508: soliciting a DHCP lease machine # [ 590.149554] dhcpcd[686]: veth19cee508: soliciting an IPv6 router machine # [ 591.479611] systemd[1]: cri-containerd-82d952c470ab3c6e3c5deee65483586c3c3b0b04e66787286be99e351fa5f206.scope: Deactivated successfully. machine # [ 591.483182] systemd[1]: cri-containerd-82d952c470ab3c6e3c5deee65483586c3c3b0b04e66787286be99e351fa5f206.scope: Consumed 1.223s CPU time over 2.753s wall clock time, 460.4M memory peak, 157M read from disk, 160.7M written to disk. machine # [ 591.563183] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-82d952c470ab3c6e3c5deee65483586c3c3b0b04e66787286be99e351fa5f206-rootfs.mount: Deactivated successfully. machine # [ 591.868094] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount2430592173.mount: Deactivated successfully. machine # [ 591.877681] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped1412329058.mount: Deactivated successfully. machine # [ 591.992601] systemd[1]: Started libcontainer container 079354f16d46a9164b9d697b913e7a24732187b575db795df66047f7b96308a7. machine: (finished: must succeed: sleep 5.0, in 5.03 seconds) machine # [ 592.278380] systemd[1]: Started libcontainer container 587a1ff2f94dd1e68bbf86720f7ed8ad2fb197df36c26886af887ccac32a51ca. machine # [ 592.383516] k3s[888]: E0923 04:21:25.163735 888 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45046: use of closed network connection machine: waiting for success: ! systemctl is-active slow machine # [ 592.552234] systemd[1]: Started libcontainer container 326d19fbfd6ac143e70128fadf02d7cf23e5411a4b3c1c6986019baae2d8d36d. machine # [ 592.847485] k3s[888]: I0923 04:21:25.627868 888 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-7mxck" podStartSLOduration=2.888044782 podStartE2EDuration="5.627825955s" totalImagesPullingTime="0s" totalInitContainerRuntime="2.739781173s" isStatefulPod=false podCreationTimestamp="2026-09-23 04:21:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-23 04:21:25.626943441 +0000 UTC m=+575.968785913" watchObservedRunningTime="2026-09-23 04:21:25.627825955 +0000 UTC m=+575.969668148" machine # [ 593.955456] dhcpcd[686]: veth19cee508: probing for an IPv4LL address machine # [ 599.025577] dhcpcd[686]: veth19cee508: using IPv4LL address 169.254.166.71 machine # [ 599.028462] dhcpcd[686]: veth19cee508: adding route to 169.254.0.0/16 machine # [ 602.154375] dhcpcd[686]: veth19cee508: no IPv6 Routers available machine # [ 606.205303] niks3-server[1188]: 2026/09/23 04:21:38 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 606.230834] niks3-server[1188]: 2026/09/23 04:21:39 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.ls machine # [ 606.235818] niks3-server[1188]: 2026/09/23 04:21:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign machine # [ 606.237539] niks3-server[1188]: 2026/09/23 04:21:39 INFO Signed narinfos id=30 count=1 machine # [ 606.243858] niks3-server[1188]: 2026/09/23 04:21:39 INFO Registered completed upload object_key=log/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 606.251587] niks3-server[1188]: 2026/09/23 04:21:39 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete machine # [ 606.254338] niks3-server[1188]: 2026/09/23 04:21:39 INFO Completed upload id=30 machine # [ 606.257725] niks3-server[1188]: 2026/09/23 04:21:39 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo machine # [ 608.416281] systemd[1]: cri-containerd-6955f2362be3343a7a2b3a7bb148410e4c9c08dd56ca1e6f471bfd90aafe0d82.scope: Deactivated successfully. machine # [ 608.420564] systemd[1]: cri-containerd-6955f2362be3343a7a2b3a7bb148410e4c9c08dd56ca1e6f471bfd90aafe0d82.scope: Consumed 3.299s CPU time over 9min 9.455s wall clock time, 82M memory peak, 47.7M read from disk, 275.6K incoming IP traffic, 349.7K outgoing IP traffic. machine # [ 608.475040] systemd[1]: slow.service: Deactivated successfully. machine # [ 608.476919] systemd[1]: slow.service: Consumed 182ms CPU time over 47.053s wall clock time, 38.3M memory peak, 4K written to disk, 5.3K incoming IP traffic, 11.6K outgoing IP traffic. machine # [ 608.486745] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-6955f2362be3343a7a2b3a7bb148410e4c9c08dd56ca1e6f471bfd90aafe0d82-rootfs.mount: Deactivated successfully. machine: (finished: waiting for success: ! systemctl is-active slow, in 16.63 seconds) machine: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; }, in 0.04 seconds) machine: must fail: journalctl -u slow | grep -q 'asking the scheduler again' machine: (finished: must fail: journalctl -u slow | grep -q 'asking the scheduler again', in 0.03 seconds) machine: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath, in 0.14 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null, in 0.04 seconds) (finished: subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes, in 47.87 seconds) (finished: run the VM test script, in 610.17 seconds) test script finished in 610.21s cleanup kill QemuMachine (pid 45) machine # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) machine # [2026-09-23T04:21:42Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-09-23T04:21:42Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-09-23T04:21:42Z INFO virtiofsd] Client disconnected, shutting down (finished: cleanup, in 0.99 seconds) additionally exposed symbols: machine, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh