tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 1200.0 seconds run the VM test script machine: waiting for unit k3s.service machine: waiting for the VM to finish booting machine: starting vm machine: QEMU running (pid 45) machine # Disk image does not exist, creating the virtualisation disk image... machine # Formatting '/build/vm-state-machine/tmp.NcB2354qsV', fmt=raw size=17179869184 machine # mke2fs 1.47.4 (6-Mar-2025) machine # Discarding device blocks: 0/4194304 done machine # Creating filesystem with 4194304 4k blocks and 1048576 inodes machine # Filesystem UUID: 565003a1-b532-4712-9ea4-810912ab6ccb machine # Superblock backups stored on blocks: machine # 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208, machine # 4096000 machine # machine # Allocating group tables: 0/128 done machine # Writing inode tables: 0/128 done machine # Creating journal (32768 blocks): done machine # Writing superblocks and filesystem accounting information: 0/128 done machine # machine # Virtualisation disk image created. machine # Starting virtiofs daemons... machine # [2026-09-23T05:32:45Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-23T05:32:45Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-23T05:32:45Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-23T05:32:45Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-23T05:32:45Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-23T05:32:45Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-23T05:32:45Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-23T05:32:45Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-23T05:32:45Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-23T05:32:45Z INFO virtiofsd] Client connected, servicing requests machine # [2026-09-23T05:32:45Z INFO virtiofsd] Client connected, servicing requests machine # [2026-09-23T05:32:45Z INFO virtiofsd] Client connected, servicing requests machine # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) machine # machine # machine # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+7EFCC730+7EF2C730 CA00 machine # Press Ctrl-B to configure iPXE (PCI 00:02.0)... machine # machine # machine # machine # machine # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 7EFCC730 7EF2C730 CB00 machine # Press Ctrl-B to configure iPXE (PCI 00:05.0)... machine # machine # machine # Booting from ROM... machine # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 machine # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/6cff8v9k048yylgkjjydfg2dj50acl5p-nixos-system-machine-test/init regInfo=/nix/store/y2vs0zhhk014iqqih0z000028wwij1yz-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.000000] BIOS-provided physical RAM map: machine # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007ffd7fff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000007ffd8000-0x000000007fffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000017fffffff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved machine # [ 0.000000] NX (Execute Disable) protection: active machine # [ 0.000000] APIC: Static calls initialized machine # [ 0.000000] SMBIOS 2.8 present. machine # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 machine # [ 0.000000] DMI: Memory slots populated: 1/1 machine # [ 0.000000] Hypervisor detected: KVM machine # [ 0.000000] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 machine # [ 0.000000] kvm-clock: using sched offset of 475921553 cycles machine # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns machine # [ 0.000005] tsc: Detected 2400.012 MHz processor machine # [ 0.000810] last_pfn = 0x180000 max_arch_pfn = 0x10000000000 machine # [ 0.000837] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs machine # [ 0.000839] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT machine # [ 0.000877] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.002725] found SMP MP-table at [mem 0x000f5450-0x000f545f] machine # [ 0.002736] Using GB pages for direct mapping machine # [ 0.002821] RAMDISK: [mem 0x7e371000-0x7ffcffff] machine # [ 0.002828] ACPI: Early table checksum verification disabled machine # [ 0.002831] ACPI: RSDP 0x00000000000F5250 000014 (v00 BOCHS ) machine # [ 0.002834] ACPI: RSDT 0x000000007FFE2539 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002838] ACPI: FACP 0x000000007FFE2319 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002844] ACPI: DSDT 0x000000007FFE0040 0022D9 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002847] ACPI: FACS 0x000000007FFE0000 000040 machine # [ 0.002848] ACPI: APIC 0x000000007FFE240D 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002850] ACPI: HPET 0x000000007FFE249D 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002851] ACPI: MCFG 0x000000007FFE24D5 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002853] ACPI: WAET 0x000000007FFE2511 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002854] ACPI: Reserving FACP table memory at [mem 0x7ffe2319-0x7ffe240c] machine # [ 0.002855] ACPI: Reserving DSDT table memory at [mem 0x7ffe0040-0x7ffe2318] machine # [ 0.002855] ACPI: Reserving FACS table memory at [mem 0x7ffe0000-0x7ffe003f] machine # [ 0.002856] ACPI: Reserving APIC table memory at [mem 0x7ffe240d-0x7ffe249c] machine # [ 0.002856] ACPI: Reserving HPET table memory at [mem 0x7ffe249d-0x7ffe24d4] machine # [ 0.002857] ACPI: Reserving MCFG table memory at [mem 0x7ffe24d5-0x7ffe2510] machine # [ 0.002857] ACPI: Reserving WAET table memory at [mem 0x7ffe2511-0x7ffe2538] machine # [ 0.003071] No NUMA configuration found machine # [ 0.003072] Faking a node at [mem 0x0000000000000000-0x000000017fffffff] machine # [ 0.003075] NODE_DATA(0) allocated [mem 0x17fff8780-0x17fffdcff] machine # [ 0.005271] Zone ranges: machine # [ 0.005272] DMA [mem 0x0000000000001000-0x0000000000ffffff] machine # [ 0.005273] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] machine # [ 0.005274] Normal [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005275] Device empty machine # [ 0.005276] Movable zone start for each node machine # [ 0.005277] Early memory node ranges machine # [ 0.005277] node 0: [mem 0x0000000000001000-0x000000000009efff] machine # [ 0.005278] node 0: [mem 0x0000000000100000-0x000000007ffd7fff] machine # [ 0.005279] node 0: [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005280] Initmem setup node 0 [mem 0x0000000000001000-0x000000017fffffff] machine # [ 0.005299] On node 0, zone DMA: 1 pages in unavailable ranges machine # [ 0.005559] On node 0, zone DMA: 97 pages in unavailable ranges machine # [ 0.073793] On node 0, zone Normal: 40 pages in unavailable ranges machine # [ 0.074262] ACPI: PM-Timer IO Port: 0x608 machine # [ 0.074275] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) machine # [ 0.074306] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 machine # [ 0.074309] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) machine # [ 0.074310] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) machine # [ 0.074312] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) machine # [ 0.074313] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) machine # [ 0.074314] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) machine # [ 0.074316] ACPI: Using ACPI (MADT) for SMP configuration information machine # [ 0.074317] ACPI: HPET id: 0x8086a201 base: 0xfed00000 machine # [ 0.074322] TSC deadline timer available machine # [ 0.074326] CPU topo: Max. logical packages: 1 machine # [ 0.074327] CPU topo: Max. logical dies: 1 machine # [ 0.074327] CPU topo: Max. dies per package: 1 machine # [ 0.074331] CPU topo: Max. threads per core: 1 machine # [ 0.074331] CPU topo: Num. cores per package: 4 machine # [ 0.074331] CPU topo: Num. threads per package: 4 machine # [ 0.074332] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs machine # [ 0.074355] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() machine # [ 0.074370] kvm-guest: KVM setup pv remote TLB flush machine # [ 0.074372] kvm-guest: setup PV sched yield machine # [ 0.074383] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] machine # [ 0.074384] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] machine # [ 0.074385] PM: hibernation: Registered nosave memory: [mem 0x7ffd8000-0xffffffff] machine # [ 0.074387] [mem 0xc0000000-0xfed1bfff] available for PCI devices machine # [ 0.074389] Booting paravirtualized kernel on KVM machine # [ 0.074392] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns machine # [ 0.078866] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 machine # [ 0.080986] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288 machine # [ 0.081033] kvm-guest: PV spinlocks enabled machine # [ 0.081034] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) machine # [ 0.081037] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/6cff8v9k048yylgkjjydfg2dj50acl5p-nixos-system-machine-test/init regInfo=/nix/store/y2vs0zhhk014iqqih0z000028wwij1yz-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.081130] Unknown kernel command line parameters "regInfo=/nix/store/y2vs0zhhk014iqqih0z000028wwij1yz-closure-info/registration", will be passed to user space. machine # [ 0.081144] random: crng init done machine # [ 0.081145] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes machine # [ 0.085453] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) machine # [ 0.087525] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) machine # [ 0.087599] software IO TLB: area num 4. machine # [ 0.157877] Fallback order for Node 0: 0 machine # [ 0.157885] Built 1 zonelists, mobility grouping on. Total pages: 1048438 machine # [ 0.157886] Policy zone: Normal machine # [ 0.160478] mem auto-init: stack:all(zero), heap alloc:on, heap free:off machine # [ 0.167129] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 machine # [ 0.175801] allocated 8388608 bytes of page_ext machine # [ 0.185548] ftrace: allocating 48787 entries in 192 pages machine # [ 0.185550] ftrace: allocated 192 pages with 2 groups machine # [ 0.186414] Dynamic Preempt: lazy machine # [ 0.186591] rcu: Preemptible hierarchical RCU implementation. machine # [ 0.186592] rcu: RCU event tracing is enabled. machine # [ 0.186593] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. machine # [ 0.186594] Trampoline variant of Tasks RCU enabled. machine # [ 0.186594] Rude variant of Tasks RCU enabled. machine # [ 0.186594] Tracing variant of Tasks RCU enabled. machine # [ 0.186595] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. machine # [ 0.186596] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 machine # [ 0.186621] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.186623] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.186624] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.191001] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16 machine # [ 0.191269] rcu: srcu_init: Setting srcu_struct sizes based on contention. machine # [ 0.191277] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns machine # [ 0.191387] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) machine # [ 0.194986] Console: colour VGA+ 80x25 machine # [ 0.194989] printk: legacy console [tty0] enabled machine # [ 0.226618] printk: legacy console [ttyS0] enabled machine # [ 0.338536] ACPI: Core revision 20250807 machine # [ 0.339493] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns machine # [ 0.341076] APIC: Switch to symmetric I/O mode setup machine # [ 0.342128] x2apic enabled machine # [ 0.342878] APIC: Switched APIC routing to: physical x2apic machine # [ 0.343840] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask() machine # [ 0.345125] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself() machine # [ 0.346659] kvm-guest: setup PV IPIs machine # [ 0.348257] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 machine # [ 0.349320] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.353678] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) machine # [ 0.354761] x86/cpu: User Mode Instruction Prevention (UMIP) activated machine # [ 0.355812] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 machine # [ 0.356675] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 machine # [ 0.357679] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto machine # [ 0.358675] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl machine # [ 0.359675] Transient Scheduler Attacks: Vulnerable: No microcode machine # [ 0.361465] Spectre V2 : Mitigation: Enhanced / Automatic IBRS machine # [ 0.362427] Speculative Return Stack Overflow: Mitigation: Safe RET machine # [ 0.363497] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization machine # [ 0.364681] Spectre V2 : Enabling IBPB for BPF machine # [ 0.365675] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier machine # [ 0.366675] active return thunk: srso_alias_return_thunk machine # [ 0.367696] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' machine # [ 0.369674] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' machine # [ 0.370675] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' machine # [ 0.371675] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' machine # [ 0.372675] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' machine # [ 0.373675] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' machine # [ 0.374675] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' machine # [ 0.375676] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 machine # [ 0.376675] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 machine # [ 0.377674] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 machine # [ 0.378675] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 machine # [ 0.379675] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 machine # [ 0.380675] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. machine # [ 0.410084] Freeing SMP alternatives memory: 44K machine # [ 0.410677] pid_max: default: 32768 minimum: 301 machine # [ 0.411762] LSM: initializing lsm=capability,landlock,yama,bpf,ima machine # [ 0.412770] landlock: Up and running. machine # [ 0.413676] Yama: becoming mindful. machine # [ 0.414518] LSM support for eBPF active machine # [ 0.415321] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.416738] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.419334] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) machine # [ 0.420254] Performance Events: Fam17h+ core perfctr, AMD PMU driver. machine # [ 0.420680] ... version: 2 machine # [ 0.421458] ... bit width: 48 machine # [ 0.421678] ... generic counters: 6 machine # [ 0.422476] ... generic bitmap: 000000000000003f machine # [ 0.423443] ... fixed-purpose counters: 0 machine # [ 0.423677] ... fixed-purpose bitmap: 0000000000000000 machine # [ 0.424639] ... value mask: 0000ffffffffffff machine # [ 0.425435] ... max period: 00007fffffffffff machine # [ 0.425677] ... global_ctrl mask: 000000000000003f machine # [ 0.426755] signal: max sigframe size: 3376 machine # [ 0.427595] rcu: Hierarchical SRCU implementation. machine # [ 0.428314] rcu: Max phase no-delay instances is 400. machine # [ 0.428858] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level machine # [ 0.434181] smp: Bringing up secondary CPUs ... machine # [ 0.435055] smpboot: x86: Booting SMP configuration: machine # [ 0.435681] .... node #0, CPUs: #1 #2 #3 machine # [ 0.438828] smp: Brought up 1 node, 4 CPUs machine # [ 0.440430] smpboot: Total of 4 processors activated (19200.09 BogoMIPS) machine # [ 0.441019] Memory: 3957848K/4193752K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 220856K reserved, 0K cma-reserved) machine # [ 0.443678] devtmpfs: initialized machine # [ 0.444851] x86/mm: Memory block size: 128MB machine # [ 0.447752] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.448753] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). machine # [ 0.449766] pinctrl core: initialized pinctrl subsystem machine # [ 0.450961] PM: RTC time: 05:32:45, date: 2026-09-23 machine # [ 0.454605] NET: Registered PF_NETLINK/PF_ROUTE protocol family machine # [ 0.456338] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations machine # [ 0.456708] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations machine # [ 0.458215] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations machine # [ 0.458689] audit: initializing netlink subsys (disabled) machine # [ 0.459704] audit: type=2000 audit(1790141566.051:1): state=initialized audit_enabled=0 res=1 machine # [ 0.459894] thermal_sys: Registered thermal governor 'fair_share' machine # [ 0.461678] thermal_sys: Registered thermal governor 'bang_bang' machine # [ 0.462677] thermal_sys: Registered thermal governor 'step_wise' machine # [ 0.463678] thermal_sys: Registered thermal governor 'user_space' machine # [ 0.464677] thermal_sys: Registered thermal governor 'power_allocator' machine # [ 0.465692] cpuidle: using governor menu machine # [ 0.467903] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 machine # [ 0.468908] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] machine # [ 0.469681] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry machine # [ 0.470690] PCI: Using configuration type 1 for base access machine # [ 0.471865] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. machine # [ 0.474879] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages machine # [ 0.477686] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page machine # [ 0.479684] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages machine # [ 0.482683] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page machine # [ 0.490193] ACPI: Added _OSI(Module Device) machine # [ 0.491684] ACPI: Added _OSI(Processor Device) machine # [ 0.493684] ACPI: Added _OSI(Processor Aggregator Device) machine # [ 0.502275] ACPI: 1 ACPI AML tables successfully acquired and loaded machine # [ 0.509475] ACPI: Interpreter enabled machine # [ 0.511761] ACPI: PM: (supports S0 S3 S4 S5) machine # [ 0.513684] ACPI: Using IOAPIC for interrupt routing machine # [ 0.516004] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug machine # [ 0.519685] PCI: Using E820 reservations for host bridge windows machine # [ 0.522064] ACPI: Enabled 2 GPEs in block 00 to 3F machine # [ 0.533685] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) machine # [ 0.535690] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] machine # [ 0.537834] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] machine # [ 0.540936] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] machine # [ 0.543490] PCI host bridge to bus 0000:00 machine # [ 0.545688] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] machine # [ 0.546678] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] machine # [ 0.547678] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] machine # [ 0.549678] pci_bus 0000:00: root bus resource [mem 0x80000000-0xafffffff window] machine # [ 0.550677] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] machine # [ 0.551677] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.553678] pci_bus 0000:00: root bus resource [bus 00-ff] machine # [ 0.554767] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint machine # [ 0.556148] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint machine # [ 0.567768] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] machine # [ 0.569690] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] machine # [ 0.570709] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] machine # [ 0.571868] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] machine # [ 0.574388] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.578748] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] machine # [ 0.580708] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] machine # [ 0.583740] pci 0000:00:02.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref] machine # [ 0.586698] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] machine # [ 0.591174] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.602722] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] machine # [ 0.604700] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] machine # [ 0.607738] pci 0000:00:03.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref] machine # [ 0.612071] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint machine # [ 0.620721] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] machine # [ 0.622699] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] machine # [ 0.625839] pci 0000:00:04.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref] machine # [ 0.630134] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.636717] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] machine # [ 0.638702] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] machine # [ 0.640731] pci 0000:00:05.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref] machine # [ 0.643693] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] machine # [ 0.646781] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint machine # [ 0.655744] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] machine # [ 0.657738] pci 0000:00:06.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref] machine # [ 0.662383] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.669740] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] machine # [ 0.671771] pci 0000:00:07.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref] machine # [ 0.677076] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.681730] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] machine # [ 0.703523] pci 0000:00:08.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref] machine # [ 0.705271] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.708666] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] machine # [ 0.709488] pci 0000:00:09.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref] machine # [ 0.711210] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint machine # [ 0.717839] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] machine # [ 0.719695] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] machine # [ 0.721724] pci 0000:00:0a.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref] machine # [ 0.725889] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.733726] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] machine # [ 0.735694] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] machine # [ 0.737724] pci 0000:00:0b.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref] machine # [ 0.740901] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.744736] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] machine # [ 0.747064] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.751447] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] machine # [ 0.754096] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.757735] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] machine # [ 0.759937] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint machine # [ 0.762381] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] machine # [ 0.763939] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint machine # [ 0.765004] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO machine # [ 0.766924] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint machine # [ 0.769707] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] machine # [ 0.770597] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] machine # [ 0.773005] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint machine # [ 0.774388] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] machine # [ 0.779544] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 machine # [ 0.781966] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 machine # [ 0.783956] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 machine # [ 0.786972] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 machine # [ 0.789926] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 machine # [ 0.792926] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 machine # [ 0.795934] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 machine # [ 0.797934] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 machine # [ 0.800768] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 machine # [ 0.803728] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 machine # [ 0.805720] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 machine # [ 0.808725] ACPI: PCI: Interrupt link GSID configured for IRQ 19 machine # [ 0.810718] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 machine # [ 0.813713] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 machine # [ 0.815711] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 machine # [ 0.818712] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 machine # [ 0.824775] iommu: Default domain type: Translated machine # [ 0.826682] iommu: DMA domain TLB invalidation policy: lazy mode machine # [ 0.830051] ACPI: bus type USB registered machine # [ 0.831898] usbcore: registered new interface driver usbfs machine # [ 0.832732] usbcore: registered new interface driver hub machine # [ 0.833719] usbcore: registered new device driver usb machine # [ 0.836352] NetLabel: Initializing machine # [ 0.837679] NetLabel: domain hash size = 128 machine # [ 0.838474] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO machine # [ 0.839476] NetLabel: unlabeled traffic allowed by default machine # [ 0.840435] PCI: Using ACPI for IRQ routing machine # [ 0.883864] pci 0000:00:01.0: vgaarb: setting as boot VGA device machine # [ 0.884674] pci 0000:00:01.0: vgaarb: bridge control possible machine # [ 0.884674] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none machine # [ 0.887684] vgaarb: loaded machine # [ 0.888458] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 machine # [ 0.888678] hpet0: 3 comparators, 64-bit 100.000000 MHz counter machine # [ 0.893677] clocksource: Switched to clocksource kvm-clock machine # [ 0.898220] VFS: Disk quotas dquot_6.6.0 machine # [ 0.898979] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) machine # [ 0.900780] pnp: PnP ACPI init machine # [ 0.901650] ACPI: IRQ 4 override to edge(!), high(!) machine # [ 0.902682] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved machine # [ 0.904477] pnp: PnP ACPI: found 5 devices machine # [ 0.914350] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns machine # [ 0.915983] clocksource: Switched to clocksource acpi_pm machine # [ 0.917039] NET: Registered PF_INET protocol family machine # [ 0.918585] IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear) machine # [ 0.935693] tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.937237] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) machine # [ 0.938705] TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear) machine # [ 0.940153] TCP bind hash table entries: 32768 (order: 8, 1048576 bytes, linear) machine # [ 0.941553] TCP: Hash tables configured (established 32768 bind 32768) machine # [ 0.943031] MPTCP token hash table entries: 4096 (order: 5, 98304 bytes, linear) machine # [ 0.944553] UDP hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.945872] UDP-Lite hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.947266] NET: Registered PF_UNIX/PF_LOCAL protocol family machine # [ 0.948286] NET: Registered PF_XDP protocol family machine # [ 0.949196] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] machine # [ 0.950237] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] machine # [ 0.951332] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] machine # [ 0.952522] pci_bus 0000:00: resource 7 [mem 0x80000000-0xafffffff window] machine # [ 0.953719] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] machine # [ 0.954885] pci_bus 0000:00: resource 9 [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.956889] ACPI: \_SB_.GSIA: Enabled at IRQ 16 machine # [ 0.959044] ACPI: \_SB_.GSIB: Enabled at IRQ 17 machine # [ 0.961119] ACPI: \_SB_.GSIC: Enabled at IRQ 18 machine # [ 0.963109] ACPI: \_SB_.GSID: Enabled at IRQ 19 machine # [ 0.964820] PCI: CLS 0 bytes, default 64 machine # [ 0.965633] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) machine # [ 0.966088] Trying to unpack rootfs image as initramfs... machine # [ 0.966790] software IO TLB: mapped [mem 0x000000007a371000-0x000000007e371000] (64MB) machine # [ 0.966909] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.990531] Initialise system trusted keyrings machine # [ 0.991806] workingset: timestamp_bits=40 max_order=20 bucket_order=0 machine # [ 1.003317] Key type asymmetric registered machine # [ 1.004080] Asymmetric key parser 'x509' registered machine # [ 1.005045] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) machine # [ 1.006848] io scheduler mq-deadline registered machine # [ 1.007741] io scheduler kyber registered machine # [ 1.012042] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled machine # [ 1.013446] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A machine # [ 1.015850] Linux agpgart interface v0.103 machine # [ 1.016701] ACPI: bus type drm_connector registered machine # [ 1.019681] usbcore: registered new interface driver usbserial_generic machine # [ 1.020837] usbserial: USB Serial support registered for generic machine # [ 1.021894] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. machine # [ 1.021894] Please enable it if your BIOS has the CPPC option. machine # [ 1.024248] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled machine # [ 1.025729] drop_monitor: Initializing network drop monitor service machine # [ 1.026969] NET: Registered PF_INET6 protocol family machine # [ 1.028879] Segment Routing with IPv6 machine # [ 1.029607] In-situ OAM (IOAM) with IPv6 machine # [ 1.032009] IPI shorthand broadcast: enabled machine # [ 1.036446] sched_clock: Marking stable (883010960, 153397668)->(1058177589, -21768961) machine # [ 1.038306] registered taskstats version 1 machine # [ 1.039360] Loading compiled-in X.509 certificates machine # [ 1.049279] Demotion targets for Node 0: null machine # [ 1.050351] Key type .fscrypt registered machine # [ 1.051063] Key type fscrypt-provisioning registered machine # [ 1.052147] ima: No TPM chip found, activating TPM-bypass! machine # [ 1.053099] ima: Allocated hash algorithm: sha1 machine # [ 1.053972] ima: No architecture policies found machine # [ 1.055078] PM: Magic number: 10:752:517 machine # [ 1.056768] RAS: Correctable Errors collector initialized. machine # [ 1.061261] clk: Disabling unused clocks machine # [ 1.062023] PM: genpd: Disabling unused power domains machine # [ 1.242034] Freeing initrd memory: 29052K machine # [ 1.245805] Freeing unused decrypted memory: 2028K machine # [ 1.248547] Freeing unused kernel image (initmem) memory: 3652K machine # [ 1.249674] Write protecting the kernel read-only data: 32768k machine # [ 1.251793] Freeing unused kernel image (text/rodata gap) memory: 1184K machine # [ 1.253446] Freeing unused kernel image (rodata/data gap) memory: 720K machine # [ 1.304572] x86/mm: Checked W+X mappings: passed, no W+X pages found. machine # [ 1.305763] Run /init as init process machine # [ 1.319373] systemd[1]: Inserted module 'autofs4' machine # [ 1.345446] fuse: init (API version 7.45) machine # [ 1.354490] ACPI: \_SB_.GSIG: Enabled at IRQ 22 machine # [ 1.357105] ACPI: \_SB_.GSIH: Enabled at IRQ 23 machine # [ 1.360299] ACPI: \_SB_.GSIE: Enabled at IRQ 20 machine # [ 1.362478] ACPI: \_SB_.GSIF: Enabled at IRQ 21 machine # [ 1.367579] virtiofs virtio5: discovered new tag: nix-store machine # [ 1.369183] virtiofs virtio5: virtio_fs_setup_dax: No cache capability machine # [ 1.376581] virtiofs virtio6: discovered new tag: shared machine # [ 1.389562] virtiofs virtio6: virtio_fs_setup_dax: No cache capability machine # [ 1.393002] virtiofs virtio7: discovered new tag: xchg machine # [ 1.394535] virtiofs virtio7: virtio_fs_setup_dax: No cache capability machine # [ 1.418556] systemd[1]: Successfully made /usr/ read-only. machine # [ 1.757973] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 1.770362] systemd[1]: Detected virtualization kvm. machine # [ 1.772631] systemd[1]: Detected architecture x86-64. machine # [ 1.774855] systemd[1]: Running in initrd. machine # [ 1.777508] systemd[1]: Initializing machine ID from random generator. machine # [ 1.780471] systemd[1]: Hostname set to . machine # [ 1.916783] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 1.979824] systemd[1]: Queued start job for default target Initrd Default Target. machine # [ 1.991002] systemd[1]: Created slice Slice /system/modprobe. machine # [ 1.992212] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 1.993700] systemd[1]: Expecting device /dev/disk/by-label/nixos... machine # [ 1.994852] systemd[1]: Reached target Path Units. machine # [ 1.995766] systemd[1]: Reached target Slice Units. machine # [ 1.996691] systemd[1]: Reached target Swaps. machine # [ 1.997538] systemd[1]: Reached target Timer Units. machine # [ 1.998538] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 1.999792] systemd[1]: Listening on Journal Socket (/dev/log). machine # [ 2.000974] systemd[1]: Listening on Journal Sockets. machine # [ 2.002024] systemd[1]: Listening on udev Control Socket. machine # [ 2.003089] systemd[1]: Listening on udev Kernel Socket. machine # [ 2.004081] systemd[1]: Reached target Socket Units. machine # [ 2.006126] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 2.008251] systemd[1]: Starting Load Kernel Module configfs... machine # [ 2.011303] systemd[1]: Starting Journal Service... machine # [ 2.013143] systemd[1]: Starting Load Kernel Modules... machine # [ 2.015483] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 2.019803] systemd[1]: Starting Coldplug All udev Devices... machine # [ 2.027520] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 2.032816] systemd[1]: Finished Load Kernel Module configfs. machine # [ 2.034824] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config machine # [ 2.041717] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 2.047530] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 2.050082] systemd-journald[91]: Collecting audit messages is disabled. machine # [ 2.054875] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. machine # [ 2.057198] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev machine # [ 2.059988] systemd[1]: Finished Load Kernel Modules. machine # [ 2.061895] systemd[1]: Starting Apply Kernel Variables... machine # [ 2.074956] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 2.079015] systemd[1]: Finished Apply Kernel Variables. machine # [ 2.082776] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 1.936643] systemd-modules-load[92]: Using 4 probe threads machine # [ 2.090028] systemd[1]: Started Journal Service. machine # [ 1.938107] systemd-modules-load[92]: Inserted module 'virtio_balloon' machine # [ 1.939940] systemd-modules-load[92]: Inserted module 'virtio_gpu' machine # [ 1.941203] systemd-modules-load[92]: Inserted module 'dm_mod' machine # [ 1.944883] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 1.946744] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 1.947989] systemd[1]: Reached target Local File Systems. machine # [ 1.949226] systemd[1]: Starting Create System Files and Directories... machine # [ 1.951106] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 1.975188] systemd[1]: Finished Create System Files and Directories. machine # [ 1.984171] systemd-udevd[111]: Using default interface naming scheme 'v261'. machine # [ 1.992311] systemd[1]: Finished Coldplug All udev Devices. machine # [ 1.996387] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 1.997385] systemd[1]: Reached target System Initialization. machine # [ 1.998189] systemd[1]: Reached target Basic System. machine # [ 2.261008] virtio_blk virtio2: 4/0/0 default/read/poll queues machine # [ 2.264011] virtio_blk virtio2: [vda] 33554432 512-byte logical blocks (17.2 GB/16.0 GiB) machine # [ 2.284286] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 machine # [ 2.291148] serio: i8042 KBD port at 0x60,0x64 irq 1 machine # [ 2.294644] ehci-pci 0000:00:1d.7: EHCI Host Controller machine # [ 2.295506] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 machine # [ 2.296951] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 machine # [ 2.298251] serio: i8042 AUX port at 0x60,0x64 irq 12 machine # [ 2.303437] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 machine # [ 2.306697] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 machine # [ 2.307986] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.309056] usb usb1: Product: EHCI Host Controller machine # [ 2.309846] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd machine # [ 2.310650] usb usb1: SerialNumber: 0000:00:1d.7 machine # [ 2.322015] SCSI subsystem initialized machine # [ 2.326619] hub 1-0:1.0: USB hub found machine # [ 2.329855] hub 1-0:1.0: 6 ports detected machine # [ 2.178112] (udev-worker)[115]: Network interface NamePolicy= disabled on kernel command line. machine # [ 2.179759] (udev-worker)[128]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 2.332964] uhci_hcd 0000:00:1d.0: UHCI Host Controller machine # [ 2.181903] (udev-worker)[128]: Network interface NamePolicy= disabled on kernel command line. machine # [ 2.183585] systemd[1]: Starting Virtual Console Setup... machine # [ 2.342462] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 machine # [ 2.344215] uhci_hcd 0000:00:1d.0: detected 2 ports machine # [ 2.345268] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 machine # [ 2.346891] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.348268] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.349511] usb usb2: Product: UHCI Host Controller machine # [ 2.350307] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd machine # [ 2.351142] usb usb2: SerialNumber: 0000:00:1d.0 machine # [ 2.199828] systemd-vconsole-setup[141]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 2.201911] systemd[1]: Finished Virtual Console Setup. machine # [ 2.356441] hub 2-0:1.0: USB hub found machine # [ 2.358447] hub 2-0:1.0: 2 ports detected machine # [ 2.361417] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 machine # [ 2.209061] systemd[1]: Found device /dev/disk/by-label/nixos[ 2.361716] uhci_hcd 0000:00:1d.1: UHCI Host Controller machine # .[ 2.362154] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 machine # machine # [ 2.365346] uhci_hcd 0000:00:1d.1: detected 2 ports machine # [ 2.212546] systemd[1]: Reached target Initrd Root Device. machine # [ 2.366611] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 machine # [ 2.214653] systemd[1]: Starting File System [ 2.367915] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # Check on /dev/disk/by-label/nixos... machine # [ 2.369590] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.371110] usb usb3: Product: UHCI Host Controller machine # [ 2.371959] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd machine # [ 2.372877] usb usb3: SerialNumber: 0000:00:1d.1 machine # [ 2.374516] hub 3-0:1.0: USB hub found machine # [ 2.375126] hub 3-0:1.0: 2 ports detected machine # [ 2.377829] uhci_hcd 0000:00:1d.2: UHCI Host Controller machine # [ 2.378729] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 machine # [ 2.380027] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode machine # [ 2.380122] uhci_hcd 0000:00:1d.2: detected 2 ports machine # [ 2.380366] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) machine # [ 2.380714] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 machine # [ 2.380841] ahci 0000:00:1f.2: flags: 64bit ncq only machine # [ 2.381363] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.386440] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.387312] scsi host0: ahci machine # [ 2.387554] usb usb4: Product: UHCI Host Controller machine # [ 2.388027] scsi host1: ahci machine # [ 2.388364] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd machine # [ 2.388826] scsi host2: ahci machine # [ 2.388841] usb usb4: SerialNumber: 0000:00:1d.2 machine # [ 2.389941] scsi host3: ahci machine # [ 2.390352] hub 4-0:1.0: USB hub found machine # [ 2.390866] scsi host4: ahci machine # [ 2.391202] hub 4-0:1.0: 2 ports detected machine # [ 2.391721] scsi host5: ahci machine # [ 2.394672] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 50 lpm-pol 1 machine # [ 2.394691] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 50 lpm-pol 1 machine # [ 2.394696] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 50 lpm-pol 1 machine # [ 2.394702] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 50 lpm-pol 1 machine # [ 2.394706] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 50 lpm-pol 1 machine # [ 2.394711] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 50 lpm-pol 1 machine # [ 2.258192] systemd-fsck[171]: nixos: clean, 12/1048576 files, 109865/4194304 blocks machine # [ 2.262411] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. machine # [ 2.568607] usb 1-1: new high-speed USB device number 2 using ehci-pci machine # [ 2.699794] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 machine # [ 2.702885] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 machine # [ 2.705638] usb 1-1: Product: QEMU USB Tablet machine # [ 2.707289] usb 1-1: Manufacturer: QEMU machine # [ 2.708848] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 machine # [ 2.711274] ata1: SATA link down (SStatus 0 SControl 300) machine # [ 2.712426] ata6: SATA link down (SStatus 0 SControl 300) machine # [ 2.714731] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) machine # [ 2.715935] ata5: SATA link down (SStatus 0 SControl 300) machine # [ 2.718237] ata2: SATA link down (SStatus 0 SControl 300) machine # [ 2.720814] ata4: SATA link down (SStatus 0 SControl 300) machine # [ 2.723047] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 machine # [ 2.725102] ata3.00: applying bridge limits machine # [ 2.726871] ata3.00: configured for UDMA/100 machine # [ 2.729216] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 machine # [ 2.748719] hid: raw HID events driver (C) Jiri Kosina machine # [ 2.767245] usbcore: registered new interface driver usbhid machine # [ 2.769438] usbhid: USB HID core driver machine # [ 2.778185] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 machine # [ 2.781539] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 machine # [ 2.786748] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray machine # [ 2.820688] cdrom: Uniform CD-ROM driver Revision: 3.20 machine # [ 2.870879] systemd[1]: Mounting /sysroot... machine # [ 3.166957] EXT4-fs (vda): mounted filesystem 565003a1-b532-4712-9ea4-810912ab6ccb r/w with ordered data mode. Quota mode: none. machine # [ 3.020632] systemd[1]: Mounted /sysroot. machine # [ 3.021606] systemd[1]: Reached target Initrd Root File System. machine # [ 3.025242] systemd[1]: Mounting /sysroot/nix/.ro-store... machine # [ 3.027185] systemd[1]: Mounting /sysroot/nix/.rw-store... machine # [ 3.030555] systemd[1]: Mounting /sysroot/run... machine # [ 3.041424] systemd[1]: Mounting /sysroot/tmp/shared... machine # [ 3.042425] systemd[1]: Mounting /sysroot/tmp/xchg... machine # [ 3.046161] systemd[1]: Starting Mountpoints Configured in the Real Root... machine # [ 3.052209] systemd-sysroot-fstab-check[191]: /sysroot should be mounted in the initrd, will request daemon-reload. machine # [ 3.053884] systemd[1]: Mounted /sysroot/nix/.ro-store. machine # [ 3.055812] systemd[1]: Mounted /sysroot/nix/.rw-store. machine # [ 3.056827] systemd[1]: Mounted /sysroot/run. machine # [ 3.062226] systemd[1]: Mounted /sysroot/tmp/shared. machine # [ 3.063060] systemd[1]: Reload requested from client PID 191 ('systemd-sysroot') (unit initrd-parse-etc.service)... machine # [ 3.064560] systemd[1]: Reloading... machine # [ 3.117425] systemd[1]: Reloading finished in 54 ms. machine # [ 3.140213] systemd-sysroot-fstab-check[191]: Requesting initrd-fs.target/start/replace... machine # [ 3.143129] systemd[1]: Mounted /sysroot/tmp/xchg. machine # [ 3.144967] systemd-sysroot-fstab-check[191]: Requesting swap.target/start/replace... machine # [ 3.147773] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.149949] systemd[1]: initrd-parse-etc.service: Deactivated successfully. machine # [ 3.152485] systemd[1]: Finished Mountpoints Configured in the Real Root. machine # [ 3.154837] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. machine # [ 3.165368] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.168101] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.871826] systemd[1]: Mounting /sysroot/nix/store... machine # [ 3.924988] systemd[1]: Mounted /sysroot/nix/store. machine # [ 3.927824] systemd[1]: Reached target Initrd File Systems. machine # [ 3.931503] systemd[1]: Starting Find NixOS closure... machine # [ 3.934901] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... machine # [ 3.972888] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. machine # [ 3.976460] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. machine # [ 3.988911] systemd[1]: Finished Find NixOS closure. machine # [ 3.990708] systemd[1]: Reached target Initrd Default Target. machine # [ 3.992664] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... machine # [ 4.022868] systemd[1]: Stopped target Initrd Default Target. machine # [ 4.025064] systemd[1]: Stopped target Basic System. machine # [ 4.026907] systemd[1]: Stopped target Initrd Root Device. machine # [ 4.028901] systemd[1]: Stopped target Path Units. machine # [ 4.030699] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. machine # [ 4.033341] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. machine # [ 4.036094] systemd[1]: Stopped target Slice Units. machine # [ 4.037932] systemd[1]: Stopped target Socket Units. machine # [ 4.039826] systemd[1]: Stopped target System Initialization. machine # [ 4.043736] systemd[1]: Stopped target Swaps. machine # [ 4.045769] systemd[1]: Stopped target Timer Units. machine # [ 4.047996] systemd[1]: dbus.socket: Deactivated successfully. machine # [ 4.053411] systemd[1]: Closed D-Bus System Message Bus Socket. machine # [ 4.055500] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. machine # [ 4.057914] systemd[1]: Stopped Find NixOS closure. machine # [ 4.059519] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 4.061304] systemd[1]: systemd-sysctl.service: Deactivated successfully. machine # [ 4.063103] systemd[1]: Stopped Apply Kernel Variables. machine # [ 4.064564] systemd[1]: systemd-modules-load.service: Deactivated successfully. machine # [ 4.066394] systemd[1]: Stopped Load Kernel Modules. machine # [ 4.067754] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. machine # [ 4.069812] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. machine # [ 4.071812] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. machine # [ 4.073687] systemd[1]: Stopped Create System Files and Directories. machine # [ 4.075339] systemd[1]: Stopped target Local File Systems. machine # [ 4.076764] systemd[1]: Stopped target Preparation for Local File Systems. machine # [ 4.078517] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. machine # [ 4.080107] systemd[1]: Stopped Coldplug All udev Devices. machine # [ 4.080942] systemd[1]: Stopping Rule-based Manager for Device Events and Files... machine # [ 4.082082] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 4.083223] systemd[1]: Stopped Virtual Console Setup. machine # [ 4.084124] systemd[1]: initrd-cleanup.service: Deactivated successfully. machine # [ 4.085202] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. machine # [ 4.086203] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 4.087347] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 4.088172] systemd[1]: systemd-udevd.service: Deactivated successfully. machine # [ 4.089069] systemd[1]: Stopped Rule-based Manager for Device Events and Files. machine # [ 4.090040] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. machine # [ 4.090985] systemd[1]: Closed udev Control Socket. machine # [ 4.091666] systemd[1]: Starting Cleanup udev Database... machine # [ 4.092435] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. machine # [ 4.093543] systemd[1]: Stopped Create Static Device Nodes in /dev. machine # [ 4.094438] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. machine # [ 4.095539] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. machine # [ 4.096554] systemd[1]: kmod-static-nodes.service: Deactivated successfully. machine # [ 4.097517] systemd[1]: Stopped Create List of Static Device Nodes. machine # [ 4.107810] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. machine # [ 4.108931] systemd[1]: Finished Cleanup udev Database. machine # [ 4.109981] systemd[1]: Reached target Switch Root. machine # [ 4.111882] systemd[1]: Starting NixOS Activation... machine # [ 4.232848] initrd-nixos-activation-start[235]: booting system configuration /nix/store/6cff8v9k048yylgkjjydfg2dj50acl5p-nixos-system-machine-test machine # [ 4.282790] initrd-nixos-activation-start[235]: running activation script... machine # [ 4.577232] initrd-nixos-activation-start[258]: setting up /etc... machine # [ 4.715843] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. machine # [ 4.718934] systemd[1]: Finished NixOS Activation. machine # [ 4.722865] systemd[1]: Starting Switch Root... machine # [ 4.743716] systemd[1]: Switching root. machine # [ 4.967060] systemd-journald[91]: Received SIGTERM from PID 1 (systemd). machine # [ 5.090121] NET: Registered PF_VSOCK protocol family machine # [ 5.474132] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 5.512511] systemd[1]: Detected virtualization kvm. machine # [ 5.514474] systemd[1]: Detected architecture x86-64. machine # [ 5.516495] systemd[1]: Detected first boot. machine # [ 5.520763] systemd[1]: Initializing machine ID from random generator. machine # [ 5.678166] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 5.763170] systemd[1]: Applying preset policy. machine # [ 5.944116] systemd[1]: Populated /etc with preset unit settings. machine # [ 6.154134] systemd[1]: initrd-switch-root.service: Deactivated successfully. machine # [ 6.155581] systemd[1]: Stopped initrd-switch-root.service. machine # [ 6.157762] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. machine # [ 6.160068] systemd[1]: Created slice Slice /system/getty. machine # [ 6.161547] systemd[1]: Created slice User and Session Slice. machine # [ 6.162568] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 6.163965] systemd[1]: Started Forward Password Requests to Wall Directory Watch. machine # [ 6.165114] systemd[1]: Expecting device /dev/hvc0... machine # [ 6.165892] systemd[1]: Expecting device /dev/ttyS0... machine # [ 6.166805] systemd[1]: Reached target Local Encrypted Volumes. machine # [ 6.167723] systemd[1]: Stopped target initrd-fs.target. machine # [ 6.168539] systemd[1]: Stopped target initrd-root-fs.target. machine # [ 6.169407] systemd[1]: Stopped target initrd-switch-root.target. machine # [ 6.170287] systemd[1]: Reached target Virtual Machines and Containers. machine # [ 6.171441] systemd[1]: Reached target Path Units. machine # [ 6.172165] systemd[1]: Reached target Remote File Systems. machine # [ 6.173020] systemd[1]: Reached target Slice Units. machine # [ 6.173879] systemd[1]: Reached target Swaps. machine # [ 6.175932] systemd[1]: Listening on Query the User Interactively for a Password. machine # [ 6.178558] systemd[1]: Listening on Process Core Dump Socket. machine # [ 6.180635] systemd[1]: Listening on Credential Encryption/Decryption. machine # [ 6.182732] systemd[1]: Listening on Factory Reset Management. machine # [ 6.183788] systemd[1]: Listening on Hostname Service Socket. machine # [ 6.186796] systemd[1]: Starting Journal Log Access Socket... machine # [ 6.188227] systemd[1]: Listening on Journal Audit Socket. machine # [ 6.190660] systemd[1]: Listening on Console Output Muting Service Socket. machine # [ 6.192005] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. machine # [ 6.193177] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.194697] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki machine # [ 6.199483] systemd[1]: Listening on Disk Repartitioning Service Socket. machine # [ 6.200675] systemd[1]: Listening on udev Control Socket. machine # [ 6.201635] systemd[1]: Listening on udev Varlink Socket. machine # [ 6.204218] systemd[1]: Mounting Huge Pages File System... machine # [ 6.206640] systemd[1]: Mounting POSIX Message Queue File System... machine # [ 6.210900] systemd[1]: Mounting Kernel Debug File System... machine # [ 6.214958] systemd[1]: Mounting Kernel Trace File System... machine # [ 6.220293] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 6.222951] systemd[1]: Starting Load Kernel Module configfs... machine # [ 6.223900] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm machine # [ 6.225441] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.227069] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.230571] systemd[1]: Mounting FUSE Control File System... machine # [ 6.231561] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.236449] systemd[1]: Starting Journal Service... machine # [ 6.240542] systemd[1]: Starting Load Kernel Modules... machine # [ 6.252045] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... machine # [ 6.255613] systemd[1]: Starting Remount Root and Kernel File Systems... machine # [ 6.256790] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.260911] systemd[1]: Starting Coldplug All udev Devices... machine # [ 6.263282] systemd[1]: Listening on Journal Log Access Socket. machine # [ 6.264342] systemd[1]: Mounted Huge Pages File System. machine # [ 6.265248] systemd[1]: Mounted POSIX Message Queue File System. machine # [ 6.266318] systemd[1]: Mounted Kernel Trace File System. machine # [ 6.268135] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 6.269263] systemd[1]: Mounted Kernel Debug File System. machine # [ 6.271682] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 6.273520] systemd[1]: Mounted FUSE Control File System. machine # [ 6.293861] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 6.294861] systemd-journald[328]: Collecting audit messages is enabled. machine # [ 6.295368] systemd[1]: Finished Load Kernel Module configfs. machine # [ 6.299437] EXT4-fs (vda): re-mounted 565003a1-b532-4712-9ea4-810912ab6ccb. machine # [ 6.300558] systemd[1]: Mounting Kernel Configuration File System... machine # [ 6.309999] systemd[1]: Finished Remount Root and Kernel File Systems. machine # [ 6.311284] systemd[1]: Listening on Disk Image Download Service Socket. machine # [ 6.312317] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.164899] systemd[1]: Queued start job for default target Multi-User System. machine # [ 6.166390] systemd[1]: systemd-journald.service: Deactivated[ 6.319947] systemd[1]: Starting Load/Save OS Random Seed... machine # successfully. machine # [ 6.321165] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.168463] systemd-modules-load[329]: Using 2 probe threads machine # [ 6.323133] systemd[1]: Started Journal Service. machine # [ 6.170471] systemd-oomd[330]: No swap; memory pressure usage will be degraded machine # [ 6.325684] loop: module loaded machine # [ 6.174112] systemd-modules-load[329]: Inserted module 'loop' machine # [ 6.179728] systemd[1]: Starting Flush Journal to Persistent Storage... machine # [ 6.182713] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. machine # [ 6.183756] systemd[1]: Finished Load Kernel Modules. machine # [ 6.187877] systemd[1]: Starting Apply Kernel Variables... machine # [ 6.188931] systemd[1]: Mounted Kernel Configuration File System. machine # [ 6.190629] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 6.198394] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 6.200419] systemd[1]: Finished Load/Save OS Random Seed. machine # [ 6.201895] systemd[1]: Reached target First Boot Complete. machine # [ 6.363584] systemd-journald[328]: Received client request to flush runtime journal. machine # [ 6.262667] systemd[1]: Finished Apply Kernel Variables. machine # [ 6.263662] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 6.264666] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 6.265704] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 6.266861] systemd[1]: Finished Flush Journal to Persistent Storage. machine # [ 6.269130] systemd-udevd[360]: Using default interface naming scheme 'v261'. machine # [ 6.271264] systemd[1]: Finished Coldplug All udev Devices. machine # [ 6.301427] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 6.364847] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.383311] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. machine # [ 6.398281] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. machine # [ 6.402463] (udev-worker)[371]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 6.406572] (udev-worker)[371]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.408098] (udev-worker)[367]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.427233] systemd[1]: Condition check resulted in Virtio network device being skipped. machine # [ 6.429768] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.431392] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.433715] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.435485] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.436789] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.606280] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console machine # [ 6.613478] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 machine # [ 6.619276] Console: switching to colour dummy device 80x25 machine # [ 6.620847] [drm] Found bochs VGA, ID 0xb0c5. machine # [ 6.620849] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. machine # [ 6.623435] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized machine # [ 6.623444] ACPI: button: Power Button [PWRF] machine # [ 6.623557] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic machine # [ 6.623565] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 machine # [ 6.635929] Console: switching to colour frame buffer device 160x50 machine # [ 6.637236] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device machine # [ 6.667598] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 machine # [ 6.680260] parport_pc 00:02: reported by Plug and Play ACPI machine # [ 6.681964] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] machine # [ 6.687962] rtc_cmos PNP0B00:00: RTC can wake from S4 machine # [ 6.690040] rtc_cmos PNP0B00:00: registered as rtc0 machine # [ 6.690716] rtc_cmos PNP0B00:00: setting system clock to 2026-09-23T05:32:52 UTC (1790141572) machine # [ 6.691827] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs machine # [ 6.695926] mousedev: PS/2 mouse device common for all mice machine # [ 6.697190] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 machine # [ 6.698786] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 machine # [ 6.699799] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt machine # [ 6.701194] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD machine # [ 6.615471] systemd[1]: Starting Virtual Console Setup... machine # [ 6.770426] ppdev: user-space parallel port driver machine # [ 6.625655] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 6.631720] systemd[1]: Stopped Virtual Console Setup. machine # [ 6.644117] systemd[1]: Starting Virtual Console Setup... machine # [ 6.651953] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 6.653089] systemd[1]: Stopped Virtual Console Setup. machine # [ 6.665354] systemd[1]: Starting Virtual Console Setup... machine # [ 6.840349] iTCO_wdt iTCO_wdt.0.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) machine # [ 6.843479] iTCO_wdt iTCO_wdt.0.auto: initialized. heartbeat=30 sec (nowayout=0) machine # [ 6.866025] kvm_amd: TSC scaling supported machine # [ 6.866617] kvm_amd: Nested Virtualization enabled machine # [ 6.867102] kvm_amd: Nested Paging enabled machine # [ 6.867610] kvm_amd: LBR virtualization supported machine # [ 6.868178] kvm_amd: Virtual VMLOAD VMSAVE supported machine # [ 6.868788] kvm_amd: Virtual GIF supported machine # [ 6.869235] kvm_amd: Virtual NMI enabled machine # [ 6.967592] EDAC MC: Ver: 3.0.0 machine # [ 6.842331] systemd-vconsole-setup[405]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 6.846721] systemd[1]: Finished Virtual Console Setup. machine # [ 7.005953] systemd[1]: Mounting /run/wrappers... machine # [ 7.039559] systemd[1]: Mounted /run/wrappers. machine # [ 7.041346] systemd[1]: Reached target Local File Systems. machine # [ 7.045068] systemd[1]: Listening on Boot Loader Control Service Socket. machine # [ 7.048058] systemd[1]: Starting register-nix-paths.service... machine # [ 7.050859] systemd[1]: Starting Create SUID/SGID Wrappers... machine # [ 7.052914] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. machine # [ 7.063809] systemd[1]: Starting Save Transient machine-id to Disk... machine # [ 7.067103] systemd[1]: Starting Create System Files and Directories... machine # [ 7.130985] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. machine # [ 7.149088] systemd[1]: Finished Save Transient machine-id to Disk. machine # [ 7.151450] systemd[1]: Finished Create System Files and Directories. machine # [ 7.154811] systemd[1]: Starting Rebuild Journal Catalog... machine # [ 7.156177] systemd[1]: Starting Record System Boot/Shutdown in UTMP... machine # [ 7.187541] systemd[1]: Finished Record System Boot/Shutdown in UTMP. machine # [ 7.203973] systemd[1]: Finished Rebuild Journal Catalog. machine # [ 7.205880] systemd[1]: Starting Update is Completed... machine # [ 7.224994] systemd[1]: Finished Update is Completed. machine # [ 7.327449] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. machine # [ 7.328938] systemd[1]: Finished Create SUID/SGID Wrappers. machine # [ 7.558465] systemd[1]: Finished register-nix-paths.service. machine # [ 7.560986] systemd[1]: Reached target System Initialization. machine # [ 7.563800] systemd[1]: Started Discard unused filesystem blocks once a week. machine # [ 7.566427] systemd[1]: Started niks3 garbage collection timer. machine # [ 7.568491] systemd[1]: Started Daily Cleanup of Temporary Directories. machine # [ 7.570707] systemd[1]: Reached target Timer Units. machine # [ 7.572530] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 7.584455] systemd[1]: Listening on niks3 server socket. machine # [ 7.586441] systemd[1]: Listening on Nix Daemon Socket. machine # [ 7.588314] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. machine # [ 7.591150] systemd[1]: Reached target Socket Units. machine # [ 7.592919] systemd[1]: Reached target Basic System. machine # [ 7.594647] systemd[1]: Started backdoor.service. machine # [ 7.596853] systemd[1]: Starting Import lastlog data into lastlog2 database... machine # [ 7.599578] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 7.602142] systemd[1]: Starting Post-Boot Actions... machine # [ 7.608708] systemd[1]: Started Reset console on configuration changes. machine # [ 7.612240] systemd[1]: Starting resolvconf update... machine # [ 7.616638] systemd[1]: Started rustfs.service. machine # [ 7.623108] systemd[1]: Starting rustfs-bucket.service... machine # [ 7.633636] systemd[1]: Starting D-Bus System Message Bus... machine # [ 7.645152] systemd[1]: Finished Post-Boot Actions. machine # connecting to host... machine # [ 7.689442] nsncd[488]: Sep 23 05:32:53.651 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 7.689888] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 7.693345] systemd[1]: Finished Import lastlog data into lastlog2 database. machine # [ 7.694731] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 7.695983] systemd[1]: Reached target User and Group Name Lookups. machine # [ 7.702613] systemd[1]: Starting User Login Management... machine: Guest shell says: b'Spawning backdoor root shell...\n' machine: connected to guest root shell machine: (connecting took 8.35 seconds) machine: (finished: waiting for the VM to finish booting, in 8.59 seconds) machine # [ 7.728905] dbus-broker-launch[496]: Looking up NSS user entry for 'systemd-timesync'... machine # [ 7.737700] dbus-broker-launch[496]: NSS returned no entry for 'systemd-timesync' machine # [ 7.738028] dbus-broker-launch[496]: Invalid user-name in /nix/store/d3mrkr0v9x5sgbb0rb2pnsl0mysb1m4x-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" machine # [ 7.746611] systemd[1]: Started D-Bus System Message Bus. machine # [ 7.761845] dbus-broker-launch[496]: Ready machine # [ 7.765109] systemd-logind[527]: New seat seat0. machine # [ 7.769579] systemd-logind[527]: Watching system buttons on /dev/input/event2 (Power Button) machine # [ 7.770966] systemd-logind[527]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) machine # [ 7.772380] systemd-logind[527]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) machine # [ 7.773790] systemd[1]: Started User Login Management. machine # [ 7.778030] systemd[1]: Stopped target Host and Network Name Lookups. machine # [ 7.778345] systemd[1]: Stopping Host and Network Name Lookups... machine # [ 7.778762] systemd[1]: Stopped target User and Group Name Lookups. machine # [ 7.779375] systemd[1]: Stopping User and Group Name Lookups... machine # [ 7.781973] systemd[1]: Starting linger-users.service... machine # [ 7.782452] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... machine # [ 7.785565] systemd[1]: nscd.service: Deactivated successfully. machine # [ 7.787135] systemd[1]: Stopped Name Service Cache Daemon (nsncd). machine # [ 7.789992] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 7.812965] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 7.814356] nsncd[591]: Sep 23 05:32:53.775 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 7.814829] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 7.815418] systemd[1]: Reached target User and Group Name Lookups. machine # [ 7.817137] systemd[1]: linger-users.service: Deactivated successfully. machine # [ 7.818534] systemd[1]: Finished linger-users.service. machine # [ 7.838763] systemd[1]: Finished resolvconf update. machine # [ 7.839174] systemd[1]: Reached target Preparation for Network. machine # [ 7.841527] systemd[1]: Starting DHCP Client... machine # [ 7.843956] systemd[1]: Starting Address configuration of eth1... machine # [ 7.844962] systemd[1]: Starting Extra networking commands.... machine # [ 7.901440] network-addresses-eth1-start[626]: adding address 192.168.1.1/24... done machine # [ 7.910522] network-addresses-eth1-start[626]: adding address 2001:db8:1::1/64... done machine # [ 7.921780] systemd[1]: Finished Address configuration of eth1. machine # [ 7.935095] dhcpcd[637]: dhcpcd-10.3.2 starting machine # [ 7.940272] dhcpcd[694]: dev: loaded udev machine # [ 7.946962] systemd[1]: Finished Extra networking commands.. machine # [ 7.947484] systemd[1]: Reached target Network. machine # [ 7.949645] systemd[1]: Starting PostgreSQL Server... machine # [ 7.951369] systemd[1]: Starting Permit User Sessions... machine # [ 8.107703] 8021q: 802.1Q VLAN Support v1.8 machine # [ 8.109877] 8021q: adding VLAN 0 to HW filter on device eth1 machine # [ 7.972730] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. machine # [ 7.976138] systemd[1]: Finished Permit User Sessions. machine # [ 7.979435] systemd[1]: Started Getty on tty1. machine # [ 7.980515] systemd[1]: Reached target Login Prompts. machine # [ 8.203430] cfg80211: Loading compiled-in X.509 certificates for regulatory database machine # [ 8.067692] p[ 8.220890] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' machine # ostgresql-pre-start[709]: The files belonging to[ 8.222085] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' machine # this database system will be owned by user "postgres". machine # [ 8.067902] postgresql-pre-start[709]: This user must also own the server process. machine # [ 8.224960] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 machine # [ 8.226354] cfg80211: failed to load regulatory.db machine # [ 8.077106] postgresql-pre-start[709]: The database cluster will be initialized with locale "en_US.UTF-8". machine # [ 8.078473] postgresql-pre-start[709]: The default database encoding has accordingly been set to "UTF8". machine # [ 8.079719] postgresql-pre-start[709]: The default text search configuration will be set to "english". machine # [ 8.080897] postgresql-pre-start[709]: Data page checksums are enabled. machine # [ 8.081806] postgresql-pre-start[709]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok machine # [ 8.083121] postgresql-pre-start[709]: creating subdirectories ... ok machine # [ 8.083974] postgresql-pre-start[709]: selecting dynamic shared memory implementation ... posix machine # [ 8.271408] 8021q: adding VLAN 0 to HW filter on device eth0 machine # [ 8.119660] dhcpcd[694]: eth0: waiting for carrier machine # [ 8.120582] dhcpcd[694]: eth0: carrier acquired machine # [ 8.126813] dhcpcd[694]: DUID 00:01:00:01:32:46:21:06:52:54:00:12:34:56 machine # [ 8.126952] dhcpcd[694]: eth0: IAID 00:12:34:56 machine # [ 8.127633] dhcpcd[694]: eth0: adding address fe80::5054:ff:fe12:3456 machine # [ 8.143964] postgresql-pre-start[709]: selecting default "max_connections" ... 100 machine # [ 8.197553] postgresql-pre-start[709]: selecting default "shared_buffers" ... 128MB machine # [ 8.240373] dhcpcd[694]: eth0: soliciting a DHCP lease machine # [ 8.402979] NET: Registered PF_PACKET protocol family machine # [ 8.261596] dhcpcd[694]: eth0: offered 10.0.2.15 from 10.0.2.2 machine # [ 8.267211] dhcpcd[694]: eth0: probing address 10.0.2.15/24 machine # [ 8.834275] postgresql-pre-start[709]: selecting default time zone ... UTC machine # [ 8.835886] postgresql-pre-start[709]: creating configuration files ... ok machine # [ 9.004566] postgresql-pre-start[709]: running bootstrap script ... ok machine # [ 9.479508] postgresql-pre-start[709]: performing post-bootstrap initialization ... ok machine # [ 9.626920] dhcpcd[694]: eth0: soliciting an IPv6 router machine # [ 9.628219] dhcpcd[694]: eth0: Router Advertisement from fe80::2 machine # [ 9.629368] postgresql-pre-start[709]: syncing data to disk ... ok machine # [ 9.630439] postgresql-pre-start[709]: initdb: warning: enabling "trust" authentication for local connections machine # [ 9.631891] postgresql-pre-start[709]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. machine # [ 9.633512] postgresql-pre-start[709]: Success. You can now start the database server using: machine # [ 9.634995] postgresql-pre-start[709]: pg_ctl -D /var/lib/postgresql/18 -l logfile start machine # [ 9.644205] dhcpcd[694]: eth0: adding address fec0::5054:ff:fe12:3456/64 machine # [ 9.646630] dhcpcd[694]: eth0: adding route to fec0::/64 machine # [ 9.647644] dhcpcd[694]: eth0: adding default route via fe80::2 machine # [ 9.787545] postgres[745]: [745] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit machine # [ 9.793426] postgres[745]: [745] LOG: listening on IPv6 address "::1", port 5432 machine # [ 9.794243] postgres[745]: [745] LOG: listening on IPv4 address "127.0.0.1", port 5432 machine # [ 9.798050] postgres[745]: [745] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" machine # [ 9.808375] postgres[754]: [754] LOG: database system was shut down at 2026-09-23 05:32:55 GMT machine # [ 9.816777] postgres[745]: [745] LOG: database system is ready to accept connections machine # [ 9.821916] systemd[1]: Started PostgreSQL Server. machine # [ 9.827798] systemd[1]: Starting PostgreSQL Setup Scripts... machine # [ 10.048549] postgresql-setup-start[773]: CREATE DATABASE machine # [ 10.092573] postgresql-setup-start[779]: CREATE ROLE machine # [ 10.113591] postgresql-setup-start[781]: ALTER DATABASE machine # [ 10.117237] systemd[1]: Finished PostgreSQL Setup Scripts. machine # [ 10.119422] systemd[1]: Reached target PostgreSQL. machine # [ 13.305410] dhcpcd[694]: eth0: leased 10.0.2.15 for 86400 seconds machine # [ 13.307831] dhcpcd[694]: eth0: adding route to 10.0.2.0/24 machine # [ 13.309817] dhcpcd[694]: eth0: adding default route via 10.0.2.2 machine # [ 13.443890] systemd[1]: Started DHCP Client. machine # [ 13.445700] systemd[1]: Reached target Network is Online. machine # [ 13.448703] systemd[1]: Starting k3s service... machine # [ 13.521320] k3s[872]: time="2026-09-23T05:32:59Z" level=info msg="Acquiring lock file /var/lib/rancher/k3s/data/.lock" machine # [ 13.521756] k3s[872]: time="2026-09-23T05:32:59Z" level=info msg="Preparing data dir /var/lib/rancher/k3s/data/05fb32d1d5d79ab4bf8f805d07e4a7dfb491001fd5137b587aa471efd4746099" machine # [ 15.281351] rustfs-bucket-start[886]: mb s3://farm machine # [ 15.285640] systemd[1]: Finished rustfs-bucket.service. machine # [ 15.624627] k3s[872]: time="2026-09-23T05:33:01Z" level=info msg="Starting k3s 1.35.8+k3s1 (e952d68a)" machine # [ 15.635655] k3s[872]: time="2026-09-23T05:33:01Z" level=info msg="Configuring sqlite3 database connection pooling: maxIdle=20, maxOpen=0, maxLifetime=0s, maxIdleTime=2m0s" machine # [ 15.640756] k3s[872]: time="2026-09-23T05:33:01Z" level=info msg="Kine built with sqlite from github.com/mattn/go-sqlite3 version 3.53.3" machine # [ 15.644901] k3s[872]: time="2026-09-23T05:33:01Z" level=info msg="Configuring database table schema and indexes, this may take a moment..." machine # [ 15.653080] k3s[872]: time="2026-09-23T05:33:01Z" level=info msg="Database tables and indexes are up to date" machine # [ 15.656658] k3s[872]: time="2026-09-23T05:33:01Z" level=info msg="Running startup VACUUM to reclaim disk space, this may take a moment..." machine # [ 15.657453] k3s[872]: time="2026-09-23T05:33:01Z" level=info msg="Startup VACUUM completed successfully" machine # [ 15.659844] k3s[872]: time="2026-09-23T05:33:01Z" level=info msg="Kine available at unix://kine.sock" machine # [ 15.661605] k3s[872]: time="2026-09-23T05:33:01Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 15.663938] k3s[872]: time="2026-09-23T05:33:01Z" level=info msg="Datastore connection validated successfully, proceeding with bootstrap data generation" machine # [ 15.665421] k3s[872]: time="2026-09-23T05:33:01Z" level=info msg="generated self-signed CA certificate CN=k3s-client-ca@1790141581: notBefore=2026-09-23 04:33:01.627434072 +0000 UTC notAfter=2036-09-20 04:33:01.627434072 +0000 UTC" machine # [ 15.666458] k3s[872]: time="2026-09-23T05:33:01Z" level=info msg="certificate CN=system:admin,O=system:masters signed by CN=k3s-client-ca@1790141581: notBefore=2026-09-23 04:33:01 +0000 UTC notAfter=2027-09-23 04:33:01 +0000 UTC" machine # [ 15.667404] k3s[872]: time="2026-09-23T05:33:01Z" level=info msg="certificate CN=system:k3s-supervisor,O=system:masters signed by CN=k3s-client-ca@1790141581: notBefore=2026-09-23 04:33:01 +0000 UTC notAfter=2027-09-23 04:33:01 +0000 UTC" machine # [ 15.668328] k3s[872]: time="2026-09-23T05:33:01Z" level=info msg="certificate CN=system:kube-controller-manager signed by CN=k3s-client-ca@1790141581: notBefore=2026-09-23 04:33:01 +0000 UTC notAfter=2027-09-23 04:33:01 +0000 UTC" machine # [ 15.669803] k3s[872]: time="2026-09-23T05:33:01Z" level=info msg="certificate CN=system:kube-scheduler signed by CN=k3s-client-ca@1790141581: notBefore=2026-09-23 04:33:01 +0000 UTC notAfter=2027-09-23 04:33:01 +0000 UTC" machine # [ 15.671044] k3s[872]: time="2026-09-23T05:33:01Z" level=info msg="certificate CN=system:apiserver,O=system:masters signed by CN=k3s-client-ca@1790141581: notBefore=2026-09-23 04:33:01 +0000 UTC notAfter=2027-09-23 04:33:01 +0000 UTC" machine # [ 15.671942] k3s[872]: time="2026-09-23T05:33:01Z" level=info msg="certificate CN=k3s-cloud-controller-manager signed by CN=k3s-client-ca@1790141581: notBefore=2026-09-23 04:33:01 +0000 UTC notAfter=2027-09-23 04:33:01 +0000 UTC" machine # [ 15.673311] k3s[872]: time="2026-09-23T05:33:01Z" level=info msg="generated self-signed CA certificate CN=k3s-server-ca@1790141581: notBefore=2026-09-23 04:33:01.634656219 +0000 UTC notAfter=2036-09-20 04:33:01.634656219 +0000 UTC" machine # [ 15.674512] k3s[872]: time="2026-09-23T05:33:01Z" level=info msg="certificate CN=kube-apiserver signed by CN=k3s-server-ca@1790141581: notBefore=2026-09-23 04:33:01 +0000 UTC notAfter=2027-09-23 04:33:01 +0000 UTC" machine # [ 15.675756] k3s[872]: time="2026-09-23T05:33:01Z" level=info msg="certificate CN=kube-scheduler signed by CN=k3s-server-ca@1790141581: notBefore=2026-09-23 04:33:01 +0000 UTC notAfter=2027-09-23 04:33:01 +0000 UTC" machine # [ 15.676365] k3s[872]: time="2026-09-23T05:33:01Z" level=info msg="certificate CN=kube-controller-manager signed by CN=k3s-server-ca@1790141581: notBefore=2026-09-23 04:33:01 +0000 UTC notAfter=2027-09-23 04:33:01 +0000 UTC" machine # [ 15.677311] k3s[872]: time="2026-09-23T05:33:01Z" level=info msg="generated self-signed CA certificate CN=k3s-request-header-ca@1790141581: notBefore=2026-09-23 04:33:01.638604207 +0000 UTC notAfter=2036-09-20 04:33:01.638604207 +0000 UTC" machine # [ 15.678229] k3s[872]: time="2026-09-23T05:33:01Z" level=info msg="certificate CN=system:auth-proxy signed by CN=k3s-request-header-ca@1790141581: notBefore=2026-09-23 04:33:01 +0000 UTC notAfter=2027-09-23 04:33:01 +0000 UTC" machine # [ 15.679202] k3s[872]: time="2026-09-23T05:33:01Z" level=info msg="generated self-signed CA certificate CN=etcd-server-ca@1790141581: notBefore=2026-09-23 04:33:01.639936219 +0000 UTC notAfter=2036-09-20 04:33:01.639936219 +0000 UTC" machine # [ 15.680126] k3s[872]: time="2026-09-23T05:33:01Z" level=info msg="certificate CN=etcd-client signed by CN=etcd-server-ca@1790141581: notBefore=2026-09-23 04:33:01 +0000 UTC notAfter=2027-09-23 04:33:01 +0000 UTC" machine # [ 15.680966] k3s[872]: time="2026-09-23T05:33:01Z" level=info msg="generated self-signed CA certificate CN=etcd-peer-ca@1790141581: notBefore=2026-09-23 04:33:01.641184423 +0000 UTC notAfter=2036-09-20 04:33:01.641184423 +0000 UTC" machine # [ 15.682315] k3s[872]: time="2026-09-23T05:33:01Z" level=info msg="certificate CN=etcd-peer signed by CN=etcd-peer-ca@1790141581: notBefore=2026-09-23 04:33:01 +0000 UTC notAfter=2027-09-23 04:33:01 +0000 UTC" machine # [ 15.683092] k3s[872]: time="2026-09-23T05:33:01Z" level=info msg="certificate CN=etcd-server signed by CN=etcd-server-ca@1790141581: notBefore=2026-09-23 04:33:01 +0000 UTC notAfter=2027-09-23 04:33:01 +0000 UTC" machine # [ 15.721241] k3s[872]: time="2026-09-23T05:33:01Z" level=info msg="certificate CN=k3s,O=k3s signed by CN=k3s-server-ca@1790141581: notBefore=2026-09-23 04:33:01 +0000 UTC notAfter=2027-09-23 04:33:01 +0000 UTC" machine # [ 15.723573] k3s[872]: time="2026-09-23T05:33:01Z" level=warning msg="dynamiclistener [::]:6443: no cached certificate available for preload - deferring certificate load until storage initialization or first client request" machine # [ 15.732739] k3s[872]: time="2026-09-23T05:33:01Z" level=info msg="Active TLS secret / (ver=) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__d141_82ed_b650_1ac0-8199f5:fec0::d141:82ed:b650:1ac0 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=1BD3724FA4A4516165BD9CA05A1619BF7AB971E3]" machine # [ 16.639555] k3s[872]: time="2026-09-23T05:33:02Z" level=info msg="Password verified locally for node machine" machine # [ 16.640115] k3s[872]: time="2026-09-23T05:33:02Z" level=info msg="certificate CN=machine signed by CN=k3s-server-ca@1790141581: notBefore=2026-09-23 04:33:02 +0000 UTC notAfter=2027-09-23 04:33:02 +0000 UTC" machine # [ 16.887169] k3s[872]: time="2026-09-23T05:33:02Z" level=info msg="certificate CN=system:node:machine,O=system:nodes signed by CN=k3s-client-ca@1790141581: notBefore=2026-09-23 04:33:02 +0000 UTC notAfter=2027-09-23 04:33:02 +0000 UTC" machine # [ 16.984895] k3s[872]: time="2026-09-23T05:33:02Z" level=info msg="certificate CN=system:kube-proxy signed by CN=k3s-client-ca@1790141581: notBefore=2026-09-23 04:33:02 +0000 UTC notAfter=2027-09-23 04:33:02 +0000 UTC" machine # [ 17.068807] k3s[872]: time="2026-09-23T05:33:03Z" level=info msg="certificate CN=system:k3s-controller signed by CN=k3s-client-ca@1790141581: notBefore=2026-09-23 04:33:03 +0000 UTC notAfter=2027-09-23 04:33:03 +0000 UTC" machine # [ 17.177555] k3s[872]: time="2026-09-23T05:33:03Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:43024: runtime core not ready" machine # [ 17.280835] k3s[872]: time="2026-09-23T05:33:03Z" level=info msg="Module overlay was already loaded" machine # [ 17.506715] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. machine # [ 17.510986] Bridge firewalling registered machine # [ 17.366625] k3s[872]: time="2026-09-23T05:33:03Z" level=warning msg="Failed to load kernel module iptable_nat with modprobe" machine # [ 17.373356] k3s[872]: time="2026-09-23T05:33:03Z" level=warning msg="Failed to load kernel module iptable_filter with modprobe" machine # [ 17.379839] k3s[872]: time="2026-09-23T05:33:03Z" level=warning msg="Failed to load kernel module nft-expr-counter with modprobe" machine # [ 17.436446] k3s[872]: time="2026-09-23T05:33:03Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400" machine # [ 17.440475] k3s[872]: time="2026-09-23T05:33:03Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600" machine # [ 17.444227] k3s[872]: time="2026-09-23T05:33:03Z" level=info msg="Set sysctl 'net/ipv4/conf/all/forwarding' to 1" machine # [ 17.447403] k3s[872]: time="2026-09-23T05:33:03Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_max' to 131072" machine # [ 17.450722] k3s[872]: time="2026-09-23T05:33:03Z" level=info msg="Connecting to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 17.454307] k3s[872]: time="2026-09-23T05:33:03Z" level=info msg="Creating k3s-cert-monitor event broadcaster" machine # [ 17.457474] k3s[872]: time="2026-09-23T05:33:03Z" level=info msg="Saving cluster bootstrap data to datastore" machine # [ 17.460554] k3s[872]: time="2026-09-23T05:33:03Z" level=info msg="Polling for API server readiness: GET /readyz failed: the server is currently unable to handle the request" machine # [ 17.464817] k3s[872]: time="2026-09-23T05:33:03Z" level=info msg="Handling backend connection request [machine]" machine # [ 17.467315] k3s[872]: time="2026-09-23T05:33:03Z" level=info msg="Connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 17.470124] k3s[872]: time="2026-09-23T05:33:03Z" level=info msg="Remotedialer connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 17.473133] k3s[872]: time="2026-09-23T05:33:03Z" level=info msg="Connection to etcd is ready" machine # [ 17.475272] k3s[872]: time="2026-09-23T05:33:03Z" level=info msg="ETCD server is now running" machine # [ 17.477389] k3s[872]: time="2026-09-23T05:33:03Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 17.480362] k3s[872]: time="2026-09-23T05:33:03Z" level=info msg="Running kube-apiserver --advertise-port=6443 --allow-privileged=true --anonymous-auth=false --api-audiences=https://kubernetes.default.svc.cluster.local,k3s --authorization-mode=Node,RBAC --bind-address=127.0.0.1 --cert-dir=/var/lib/rancher/k3s/server/tls/temporary-certs --client-ca-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --egress-selector-config-file=/var/lib/rancher/k3s/server/etc/egress-selector-config.yaml --enable-admission-plugins=NodeRestriction --enable-aggregator-routing=true --enable-bootstrap-token-auth=true --etcd-servers=unix://kine.sock --kubelet-certificate-authority=/var/lib/rancher/k3s/server/tls/server-ca.crt --kubelet-client-certificate=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.crt --kubelet-client-key=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.key --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --profiling=false --proxy-client-cert-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt --proxy-client-key-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.key --requestheader-allowed-names=system:auth-proxy --requestheader-client-ca-file=/var/lib/rancher/k3s/server/tls/request-header-ca.crt --requestheader-extra-headers-prefix=X-Remote-Extra- --requestheader-group-headers=X-Remote-Group --requestheader-username-headers=X-Remote-User --secure-port=6444 --service-account-issuer=https://kubernetes.default.svc.cluster.local --service-account-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-account-signing-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --storage-backend=etcd3 --tls-cert-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --tls-private-key-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 17.505060] k3s[872]: time="2026-09-23T05:33:03Z" level=info msg="Running kube-scheduler --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --bind-address=127.0.0.1 --kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --leader-elect=false --profiling=false --secure-port=10259 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 17.511389] k3s[872]: time="2026-09-23T05:33:03Z" level=info msg="Running kube-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --bind-address=127.0.0.1 --cluster-cidr=10.42.0.0/16 --cluster-signing-kube-apiserver-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kube-apiserver-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kubelet-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-serving-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-kubelet-serving-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --cluster-signing-legacy-unknown-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-legacy-unknown-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --configure-cloud-routes=false --controllers=*,tokencleaner,-service,-route,-cloud-node-lifecycle --kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --leader-elect=false --profiling=false --root-ca-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --secure-port=10257 --service-account-private-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key --use-service-account-credentials=true" machine # [ 17.529355] k3s[872]: time="2026-09-23T05:33:03Z" level=info msg="Running cloud-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --bind-address=127.0.0.1 --cloud-config=/var/lib/rancher/k3s/server/etc/cloud-config.yaml --cloud-provider=k3s --cluster-cidr=10.42.0.0/16 --configure-cloud-routes=false --controllers=*,-route --kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --leader-elect=false --leader-elect-resource-name=k3s-cloud-controller-manager --node-status-update-frequency=1m0s --profiling=false" machine # [ 17.536553] k3s[872]: time="2026-09-23T05:33:03Z" level=info msg="Server node token is available at /var/lib/rancher/k3s/server/token" machine # [ 17.538149] k3s[872]: time="2026-09-23T05:33:03Z" level=info msg="To join server node to cluster: k3s server -s https://10.0.2.15:6443 -t ${SERVER_NODE_TOKEN}" machine # [ 17.539893] k3s[872]: time="2026-09-23T05:33:03Z" level=info msg="Agent node token is available at /var/lib/rancher/k3s/server/agent-token" machine # [ 17.541458] k3s[872]: time="2026-09-23T05:33:03Z" level=info msg="To join agent node to cluster: k3s agent -s https://10.0.2.15:6443 -t ${AGENT_NODE_TOKEN}" machine # [ 17.543187] k3s[872]: I0923 05:33:03.414258 872 options.go:263] external host was not specified, using 10.0.2.15 machine # [ 17.544538] k3s[872]: I0923 05:33:03.415800 872 server.go:158] Version: v1.35.8+k3s1 machine # [ 17.545591] k3s[872]: I0923 05:33:03.415823 872 server.go:160] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 17.546923] k3s[872]: time="2026-09-23T05:33:03Z" level=info msg="Wrote kubeconfig /etc/rancher/k3s/k3s.yaml" machine # [ 17.548183] k3s[872]: time="2026-09-23T05:33:03Z" level=info msg="Run: k3s kubectl" machine # [ 17.549215] k3s[872]: time="2026-09-23T05:33:03Z" level=info msg="Logging containerd to /var/lib/rancher/k3s/agent/containerd/containerd.log" machine # [ 17.550886] k3s[872]: time="2026-09-23T05:33:03Z" level=info msg="Running containerd -c /var/lib/rancher/k3s/agent/etc/containerd/config.toml" machine # [ 17.552476] k3s[872]: time="2026-09-23T05:33:03Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:43086: runtime core not ready" machine # [ 17.603053] k3s[872]: I0923 05:33:03.565578 872 shared_informer.go:349] "Waiting for caches to sync" controller="node_authorizer" machine # [ 17.607220] k3s[872]: I0923 05:33:03.569823 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 17.608708] k3s[872]: I0923 05:33:03.570060 872 plugins.go:157] Loaded 14 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,PodTopologyLabels,MutatingAdmissionPolicy,MutatingAdmissionWebhook. machine # [ 17.613168] k3s[872]: I0923 05:33:03.570129 872 plugins.go:160] Loaded 14 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,NodeDeclaredFeatureValidator,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. machine # [ 17.618021] k3s[872]: I0923 05:33:03.570398 872 instance.go:240] Using reconciler: lease machine # [ 17.619992] k3s[872]: I0923 05:33:03.577270 872 handler.go:304] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager machine # [ 17.621657] k3s[872]: W0923 05:33:03.577290 872 genericapiserver.go:787] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. machine # [ 17.623625] k3s[872]: I0923 05:33:03.582906 872 cidrallocator.go:198] starting ServiceCIDR Allocator Controller machine # [ 17.649871] k3s[872]: time="2026-09-23T05:33:03Z" level=info msg="Running kube-proxy --cluster-cidr=10.42.0.0/16 --conntrack-max-per-core=0 --conntrack-tcp-timeout-close-wait=0s --conntrack-tcp-timeout-established=0s --healthz-bind-address=127.0.0.1 --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubeproxy.kubeconfig --proxy-mode=iptables" machine # [ 17.656122] k3s[872]: I0923 05:33:03.618728 872 handler.go:304] Adding GroupVersion v1 to ResourceManager machine # [ 17.657613] k3s[872]: I0923 05:33:03.618879 872 apis.go:112] API group "internal.apiserver.k8s.io" is not enabled, skipping. machine # [ 17.685354] k3s[872]: I0923 05:33:03.647937 872 apis.go:112] API group "storagemigration.k8s.io" is not enabled, skipping. machine # [ 17.720890] k3s[872]: I0923 05:33:03.683478 872 handler.go:304] Adding GroupVersion authentication.k8s.io v1 to ResourceManager machine # [ 17.721090] k3s[872]: W0923 05:33:03.683510 872 genericapiserver.go:787] Skipping API authentication.k8s.io/v1beta1 because it has no resources. machine # [ 17.721554] k3s[872]: W0923 05:33:03.683521 872 genericapiserver.go:787] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. machine # [ 17.722124] k3s[872]: I0923 05:33:03.683821 872 handler.go:304] Adding GroupVersion authorization.k8s.io v1 to ResourceManager machine # [ 17.722558] k3s[872]: W0923 05:33:03.683835 872 genericapiserver.go:787] Skipping API authorization.k8s.io/v1beta1 because it has no resources. machine # [ 17.723114] k3s[872]: I0923 05:33:03.684373 872 handler.go:304] Adding GroupVersion autoscaling v2 to ResourceManager machine # [ 17.723577] k3s[872]: I0923 05:33:03.684884 872 handler.go:304] Adding GroupVersion autoscaling v1 to ResourceManager machine # [ 17.724100] k3s[872]: W0923 05:33:03.684900 872 genericapiserver.go:787] Skipping API autoscaling/v2beta1 because it has no resources. machine # [ 17.724531] k3s[872]: W0923 05:33:03.684912 872 genericapiserver.go:787] Skipping API autoscaling/v2beta2 because it has no resources. machine # [ 17.725042] k3s[872]: I0923 05:33:03.685746 872 handler.go:304] Adding GroupVersion batch v1 to ResourceManager machine # [ 17.725515] k3s[872]: W0923 05:33:03.685761 872 genericapiserver.go:787] Skipping API batch/v1beta1 because it has no resources. machine # [ 17.726121] k3s[872]: I0923 05:33:03.686247 872 handler.go:304] Adding GroupVersion certificates.k8s.io v1 to ResourceManager machine # [ 17.726546] k3s[872]: W0923 05:33:03.686262 872 genericapiserver.go:787] Skipping API certificates.k8s.io/v1beta1 because it has no resources. machine # [ 17.727087] k3s[872]: W0923 05:33:03.686273 872 genericapiserver.go:787] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. machine # [ 17.727545] k3s[872]: I0923 05:33:03.686626 872 handler.go:304] Adding GroupVersion coordination.k8s.io v1 to ResourceManager machine # [ 17.728123] k3s[872]: W0923 05:33:03.686640 872 genericapiserver.go:787] Skipping API coordination.k8s.io/v1beta1 because it has no resources. machine # [ 17.728572] k3s[872]: W0923 05:33:03.686651 872 genericapiserver.go:787] Skipping API coordination.k8s.io/v1alpha2 because it has no resources. machine # [ 17.729162] k3s[872]: I0923 05:33:03.687002 872 handler.go:304] Adding GroupVersion discovery.k8s.io v1 to ResourceManager machine # [ 17.729728] k3s[872]: W0923 05:33:03.687018 872 genericapiserver.go:787] Skipping API discovery.k8s.io/v1beta1 because it has no resources. machine # [ 17.730434] k3s[872]: I0923 05:33:03.688270 872 handler.go:304] Adding GroupVersion networking.k8s.io v1 to ResourceManager machine # [ 17.730912] k3s[872]: W0923 05:33:03.688287 872 genericapiserver.go:787] Skipping API networking.k8s.io/v1beta1 because it has no resources. machine # [ 17.731579] k3s[872]: I0923 05:33:03.688530 872 handler.go:304] Adding GroupVersion node.k8s.io v1 to ResourceManager machine # [ 17.732128] k3s[872]: W0923 05:33:03.688544 872 genericapiserver.go:787] Skipping API node.k8s.io/v1beta1 because it has no resources. machine # [ 17.732584] k3s[872]: W0923 05:33:03.688554 872 genericapiserver.go:787] Skipping API node.k8s.io/v1alpha1 because it has no resources. machine # [ 17.733149] k3s[872]: I0923 05:33:03.688996 872 handler.go:304] Adding GroupVersion policy v1 to ResourceManager machine # [ 17.733590] k3s[872]: W0923 05:33:03.689012 872 genericapiserver.go:787] Skipping API policy/v1beta1 because it has no resources. machine # [ 17.734116] k3s[872]: I0923 05:33:03.689939 872 handler.go:304] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager machine # [ 17.734558] k3s[872]: W0923 05:33:03.689955 872 genericapiserver.go:787] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. machine # [ 17.735091] k3s[872]: W0923 05:33:03.689978 872 genericapiserver.go:787] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. machine # [ 17.735545] k3s[872]: I0923 05:33:03.690222 872 handler.go:304] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager machine # [ 17.736100] k3s[872]: W0923 05:33:03.690235 872 genericapiserver.go:787] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. machine # [ 17.736571] k3s[872]: W0923 05:33:03.690246 872 genericapiserver.go:787] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. machine # [ 17.737083] k3s[872]: I0923 05:33:03.691532 872 handler.go:304] Adding GroupVersion storage.k8s.io v1 to ResourceManager machine # [ 17.737552] k3s[872]: W0923 05:33:03.691551 872 genericapiserver.go:787] Skipping API storage.k8s.io/v1beta1 because it has no resources. machine # [ 17.738052] k3s[872]: W0923 05:33:03.691562 872 genericapiserver.go:787] Skipping API storage.k8s.io/v1alpha1 because it has no resources. machine # [ 17.738530] k3s[872]: I0923 05:33:03.692392 872 handler.go:304] Adding GroupVersion flowcontrol.apiserver.k8s.io v1 to ResourceManager machine # [ 17.739128] k3s[872]: W0923 05:33:03.692413 872 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta3 because it has no resources. machine # [ 17.739594] k3s[872]: W0923 05:33:03.692424 872 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta2 because it has no resources. machine # [ 17.740230] k3s[872]: W0923 05:33:03.692435 872 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. machine # [ 17.740586] k3s[872]: I0923 05:33:03.695116 872 handler.go:304] Adding GroupVersion apps v1 to ResourceManager machine # [ 17.741146] k3s[872]: W0923 05:33:03.695135 872 genericapiserver.go:787] Skipping API apps/v1beta2 because it has no resources. machine # [ 17.741683] k3s[872]: W0923 05:33:03.695187 872 genericapiserver.go:787] Skipping API apps/v1beta1 because it has no resources. machine # [ 17.742221] k3s[872]: I0923 05:33:03.696546 872 handler.go:304] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager machine # [ 17.742667] k3s[872]: W0923 05:33:03.696564 872 genericapiserver.go:787] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. machine # [ 17.744200] k3s[872]: W0923 05:33:03.696575 872 genericapiserver.go:787] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. machine # [ 17.745797] k3s[872]: I0923 05:33:03.697023 872 handler.go:304] Adding GroupVersion events.k8s.io v1 to ResourceManager machine # [ 17.747160] k3s[872]: W0923 05:33:03.697038 872 genericapiserver.go:787] Skipping API events.k8s.io/v1beta1 because it has no resources. machine # [ 17.748626] k3s[872]: I0923 05:33:03.698368 872 handler.go:304] Adding GroupVersion resource.k8s.io v1 to ResourceManager machine # [ 17.750145] k3s[872]: W0923 05:33:03.698384 872 genericapiserver.go:787] Skipping API resource.k8s.io/v1beta2 because it has no resources. machine # [ 17.751588] k3s[872]: W0923 05:33:03.698395 872 genericapiserver.go:787] Skipping API resource.k8s.io/v1beta1 because it has no resources. machine # [ 17.753020] k3s[872]: W0923 05:33:03.698405 872 genericapiserver.go:787] Skipping API resource.k8s.io/v1alpha3 because it has no resources. machine # [ 17.757063] k3s[872]: I0923 05:33:03.718842 872 handler.go:304] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager machine # [ 17.757692] k3s[872]: W0923 05:33:03.718875 872 genericapiserver.go:787] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. machine # [ 18.069314] k3s[872]: I0923 05:33:04.031856 872 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 18.069499] k3s[872]: I0923 05:33:04.031878 872 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 18.069987] k3s[872]: I0923 05:33:04.031977 872 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 18.070950] k3s[872]: I0923 05:33:04.033564 872 secure_serving.go:211] Serving securely on 127.0.0.1:6444 machine # [ 18.072057] k3s[872]: I0923 05:33:04.034655 872 cluster_authentication_trust_controller.go:459] Starting cluster_authentication_trust_controller controller machine # [ 18.072452] k3s[872]: time="2026-09-23T05:33:04Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 18.073024] k3s[872]: time="2026-09-23T05:33:04Z" level=info msg="Starting legacy_token_tracking_controller" logger=k3s machine # [ 18.073482] k3s[872]: time="2026-09-23T05:33:04Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 18.074038] k3s[872]: time="2026-09-23T05:33:04Z" level=info msg="Starting apiserver lease garbage collector" logger=k3s machine # [ 18.074551] k3s[872]: time="2026-09-23T05:33:04Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 18.075088] k3s[872]: I0923 05:33:04.035144 872 aggregator.go:185] waiting for initial CRD sync... machine # [ 18.075598] k3s[872]: I0923 05:33:04.035173 872 controller.go:78] Starting OpenAPI AggregationController machine # [ 18.076156] k3s[872]: I0923 05:33:04.035212 872 controller.go:80] Starting OpenAPI V3 AggregationController machine # [ 18.076614] k3s[872]: I0923 05:33:04.035315 872 controller.go:113] "Deleting old lease on startup" lease="kube-system/apiserver-ik4pcwfs7qgdl76byc4pomgvia" machine # [ 18.089477] k3s[872]: I0923 05:33:04.041333 872 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 18.089918] k3s[872]: I0923 05:33:04.041441 872 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 18.090540] k3s[872]: I0923 05:33:04.042268 872 crdregistration_controller.go:114] Starting crd-autoregister controller machine # [ 18.091067] k3s[872]: I0923 05:33:04.042283 872 shared_informer.go:349] "Waiting for caches to sync" controller="crd-autoregister" machine # [ 18.091547] k3s[872]: I0923 05:33:04.052428 872 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 18.098241] k3s[872]: I0923 05:33:04.060855 872 apf_controller.go:377] Starting API Priority and Fairness config controller machine # [ 18.098548] k3s[872]: I0923 05:33:04.060917 872 dynamic_serving_content.go:135] "Starting controller" name="aggregator-proxy-cert::/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt::/var/lib/rancher/k3s/server/tls/client-auth-proxy.key" machine # [ 18.098982] k3s[872]: I0923 05:33:04.061036 872 apiservice_controller.go:100] Starting APIServiceRegistrationController machine # [ 18.099702] k3s[872]: I0923 05:33:04.061049 872 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller machine # [ 18.100379] k3s[872]: I0923 05:33:04.061205 872 system_namespaces_controller.go:66] Starting system namespaces controller machine # [ 18.100887] k3s[872]: I0923 05:33:04.061408 872 local_available_controller.go:156] Starting LocalAvailability controller machine # [ 18.101533] k3s[872]: I0923 05:33:04.061420 872 cache.go:32] Waiting for caches to sync for LocalAvailability controller machine # [ 18.102148] k3s[872]: I0923 05:33:04.061471 872 remote_available_controller.go:425] Starting RemoteAvailability controller machine # [ 18.102617] k3s[872]: I0923 05:33:04.061482 872 cache.go:32] Waiting for caches to sync for RemoteAvailability controller machine # [ 18.103146] k3s[872]: I0923 05:33:04.061586 872 controller.go:142] Starting OpenAPI controller machine # [ 18.103610] k3s[872]: I0923 05:33:04.061650 872 controller.go:90] Starting OpenAPI V3 controller machine # [ 18.103954] k3s[872]: I0923 05:33:04.061702 872 naming_controller.go:305] Starting NamingConditionController machine # [ 18.104641] k3s[872]: I0923 05:33:04.061762 872 nonstructuralschema_controller.go:202] Starting NonStructuralSchemaConditionController machine # [ 18.105228] k3s[872]: I0923 05:33:04.061791 872 apiapproval_controller.go:196] Starting KubernetesAPIApprovalPolicyConformantConditionController machine # [ 18.105714] k3s[872]: I0923 05:33:04.061827 872 crd_finalizer.go:273] Starting CRDFinalizer machine # [ 18.106376] k3s[872]: I0923 05:33:04.061867 872 customresource_discovery_controller.go:294] Starting DiscoveryController machine # [ 18.106823] k3s[872]: I0923 05:33:04.062175 872 repairip.go:210] Starting ipallocator-repair-controller machine # [ 18.107509] k3s[872]: I0923 05:33:04.062190 872 shared_informer.go:349] "Waiting for caches to sync" controller="ipallocator-repair-controller" machine # [ 18.108032] k3s[872]: I0923 05:33:04.062534 872 default_servicecidr_controller.go:110] Starting kubernetes-service-cidr-controller machine # [ 18.108530] k3s[872]: I0923 05:33:04.062553 872 shared_informer.go:349] "Waiting for caches to sync" controller="kubernetes-service-cidr-controller" machine # [ 18.173113] k3s[872]: time="2026-09-23T05:33:04Z" level=info msg="Caches are synced" logger=k3s machine # [ 18.173357] k3s[872]: time="2026-09-23T05:33:04Z" level=info msg="Caches are synced" logger=k3s machine # [ 18.173743] k3s[872]: time="2026-09-23T05:33:04Z" level=info msg="Caches are synced" logger=k3s machine # [ 18.194602] k3s[872]: E0923 05:33:04.157201 872 controller.go:201] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" machine # [ 18.199060] k3s[872]: I0923 05:33:04.161635 872 cache.go:39] Caches are synced for RemoteAvailability controller machine # [ 18.199616] k3s[872]: I0923 05:33:04.161826 872 shared_informer.go:356] "Caches are synced" controller="crd-autoregister" machine # [ 18.203281] k3s[872]: I0923 05:33:04.161862 872 apf_controller.go:382] Running API Priority and Fairness config worker machine # [ 18.203806] k3s[872]: I0923 05:33:04.161883 872 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process machine # [ 18.204680] k3s[872]: I0923 05:33:04.162050 872 aggregator.go:187] initial CRD sync complete... machine # [ 18.205514] k3s[872]: I0923 05:33:04.162066 872 autoregister_controller.go:144] Starting autoregister controller machine # [ 18.206229] k3s[872]: I0923 05:33:04.162080 872 cache.go:32] Waiting for caches to sync for autoregister controller machine # [ 18.206867] k3s[872]: I0923 05:33:04.162092 872 cache.go:39] Caches are synced for autoregister controller machine # [ 18.207716] k3s[872]: I0923 05:33:04.162106 872 cache.go:39] Caches are synced for APIServiceRegistrationController controller machine # [ 18.208559] k3s[872]: I0923 05:33:04.162179 872 handler_discovery.go:451] Starting ResourceDiscoveryManager machine # [ 18.209495] k3s[872]: I0923 05:33:04.162318 872 shared_informer.go:356] "Caches are synced" controller="ipallocator-repair-controller" machine # [ 18.210153] k3s[872]: I0923 05:33:04.162609 872 shared_informer.go:356] "Caches are synced" controller="kubernetes-service-cidr-controller" machine # [ 18.210761] k3s[872]: I0923 05:33:04.162631 872 default_servicecidr_controller.go:169] Creating default ServiceCIDR with CIDRs: [10.43.0.0/16] machine # [ 18.211419] k3s[872]: I0923 05:33:04.163110 872 cache.go:39] Caches are synced for LocalAvailability controller machine # [ 18.211885] k3s[872]: I0923 05:33:04.166495 872 shared_informer.go:356] "Caches are synced" controller="node_authorizer" machine # [ 18.212592] k3s[872]: I0923 05:33:04.170047 872 shared_informer.go:377] "Caches are synced" machine # [ 18.213134] k3s[872]: I0923 05:33:04.170082 872 policy_source.go:248] refreshing policies machine # [ 18.223045] k3s[872]: I0923 05:33:04.185574 872 controller.go:667] quota admission added evaluator for: namespaces machine # [ 18.253315] k3s[872]: E0923 05:33:04.215830 872 controller.go:95] Unable to perform initial Kubernetes service initialization: Service "kubernetes" is invalid: spec.clusterIPs: Invalid value: ["10.43.0.1"]: failed to allocate IP 10.43.0.1: the provided network does not match the current range machine # [ 18.308140] k3s[872]: I0923 05:33:04.269853 872 cidrallocator.go:302] created ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 18.308778] k3s[872]: I0923 05:33:04.269981 872 default_servicecidr_controller.go:231] Setting default ServiceCIDR condition Ready to True machine # [ 18.315110] k3s[872]: I0923 05:33:04.277119 872 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 18.398934] k3s[872]: I0923 05:33:04.361449 872 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io machine # [ 18.472619] k3s[872]: time="2026-09-23T05:33:04Z" level=info msg="containerd is now running" machine # [ 18.481381] k3s[872]: time="2026-09-23T05:33:04Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/k3s-airgap-images-amd64.tar.zst" machine # [ 19.079399] k3s[872]: I0923 05:33:05.041547 872 storage_scheduling.go:123] created PriorityClass system-node-critical with value 2000001000 machine # [ 19.084731] k3s[872]: I0923 05:33:05.047314 872 storage_scheduling.go:123] created PriorityClass system-cluster-critical with value 2000000000 machine # [ 19.085170] k3s[872]: I0923 05:33:05.047333 872 storage_scheduling.go:139] all system priority classes are created successfully or already exist. machine # [ 19.445673] k3s[872]: time="2026-09-23T05:33:05Z" level=info msg="Polling for API server readiness: GET /readyz failed: unknown" machine # [ 20.240123] k3s[872]: I0923 05:33:06.202344 872 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io machine # [ 20.279222] k3s[872]: I0923 05:33:06.241807 872 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io machine # [ 20.363519] k3s[872]: I0923 05:33:06.324812 872 alloc.go:329] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.43.0.1"} machine # [ 20.367281] k3s[872]: W0923 05:33:06.329904 872 lease.go:265] Resetting endpoints for master service "kubernetes" to [10.0.2.15] machine # [ 20.368879] k3s[872]: I0923 05:33:06.331505 872 controller.go:667] quota admission added evaluator for: endpoints machine # [ 20.375198] k3s[872]: I0923 05:33:06.337812 872 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io machine # [ 21.444350] k3s[872]: time="2026-09-23T05:33:07Z" level=info msg="Kube API server is now running" machine # [ 21.444511] k3s[872]: time="2026-09-23T05:33:07Z" level=info msg="k3s is up and running" machine # [ 21.444949] k3s[872]: time="2026-09-23T05:33:07Z" level=info msg="Waiting for untainted node" machine # [ 21.448067] k3s[872]: time="2026-09-23T05:33:07Z" level=info msg="Creating k3s-supervisor event broadcaster" machine # [ 21.448745] k3s[872]: time="2026-09-23T05:33:07Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Node and Certificate Authority certificates managed by k3s are OK" object=machine reason=CertificateExpirationOK type=Normal machine # [ 21.452683] systemd[1]: Started k3s service. machine # [ 21.456536] systemd[1]: Starting niks3 server... machine # [ 21.461677] k3s[872]: I0923 05:33:07.424280 872 controllermanager.go:189] "Starting" version="v1.35.8+k3s1" machine # [ 21.461956] k3s[872]: I0923 05:33:07.424319 872 controllermanager.go:191] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 21.464944] k3s[872]: I0923 05:33:07.427533 872 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 21.465513] k3s[872]: I0923 05:33:07.427539 872 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 21.465934] k3s[872]: I0923 05:33:07.427568 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 21.466609] k3s[872]: I0923 05:33:07.427565 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 21.467186] k3s[872]: I0923 05:33:07.427616 872 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 21.467632] k3s[872]: I0923 05:33:07.427632 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 21.468029] k3s[872]: I0923 05:33:07.429927 872 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key" machine # [ 21.468486] k3s[872]: I0923 05:33:07.430222 872 secure_serving.go:211] Serving securely on 127.0.0.1:10257 machine # [ 21.469017] k3s[872]: I0923 05:33:07.430246 872 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 21.472100] k3s[872]: I0923 05:33:07.434543 872 controllermanager.go:627] "Warning: controller is disabled" controller="selinux-warning-controller" machine # [ 21.477251] k3s[872]: I0923 05:33:07.439867 872 controller.go:667] quota admission added evaluator for: serviceaccounts machine # [ 21.537917] k3s[872]: I0923 05:33:07.500505 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 21.577365] k3s[872]: time="2026-09-23T05:33:07Z" level=info msg="Creating embedded CRD addons.k3s.cattle.io" machine # [ 21.583266] k3s[872]: time="2026-09-23T05:33:07Z" level=info msg="Creating embedded CRD etcdsnapshotfiles.k3s.cattle.io" machine # [ 21.590683] k3s[872]: time="2026-09-23T05:33:07Z" level=info msg="Creating embedded CRD helmcharts.helm.cattle.io" machine # [ 21.591044] k3s[872]: I0923 05:33:07.553272 872 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 21.599850] k3s[872]: I0923 05:33:07.562138 872 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 21.605850] k3s[872]: time="2026-09-23T05:33:07Z" level=info msg="Creating embedded CRD helmchartconfigs.helm.cattle.io" machine # [ 21.617253] k3s[872]: time="2026-09-23T05:33:07Z" level=info msg="Waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 21.625759] k3s[872]: I0923 05:33:07.588350 872 controllermanager.go:627] "Warning: controller is disabled" controller="node-route-controller" machine # [ 21.638187] k3s[872]: I0923 05:33:07.600773 872 shared_informer.go:377] "Caches are synced" machine # [ 21.648830] k3s[872]: I0923 05:33:07.611241 872 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 21.651097] k3s[872]: I0923 05:33:07.613722 872 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 21.665416] k3s[872]: I0923 05:33:07.627940 872 shared_informer.go:377] "Caches are synced" machine # [ 21.665810] k3s[872]: I0923 05:33:07.628062 872 shared_informer.go:377] "Caches are synced" machine # [ 21.666449] k3s[872]: I0923 05:33:07.628435 872 shared_informer.go:377] "Caches are synced" machine # [ 21.808956] k3s[872]: time="2026-09-23T05:33:07Z" level=info msg="Imported docker.io/rancher/klipper-helm:v0.13.3-build20260727" machine # [ 21.812511] k3s[872]: time="2026-09-23T05:33:07Z" level=info msg="Tagged docker.io/rancher/klipper-helm@sha256:5425a2b4613d2458dbdff99218e8d487ebb59c20e7a941f061c0777070f0aac1" machine # [ 21.813110] k3s[872]: time="2026-09-23T05:33:07Z" level=info msg="Imported docker.io/rancher/klipper-lb:v0.4.17" machine # [ 21.818215] k3s[872]: time="2026-09-23T05:33:07Z" level=info msg="Tagged docker.io/rancher/klipper-lb@sha256:910944bb0bd94f060a82a56ca1ea1c577d3e49b3473a093a47a985f32e92d94a" machine # [ 21.818677] k3s[872]: time="2026-09-23T05:33:07Z" level=info msg="Imported docker.io/rancher/local-path-provisioner:v0.0.37" machine # [ 21.825066] k3s[872]: time="2026-09-23T05:33:07Z" level=info msg="Tagged docker.io/rancher/local-path-provisioner@sha256:e757967a5ec338f6a9b371c5a9688bedaa8c3578ea3dd4db329ea0084be0a86f" machine # [ 21.825383] k3s[872]: time="2026-09-23T05:33:07Z" level=info msg="Imported docker.io/rancher/mirrored-coredns-coredns:1.14.6" machine # [ 21.832554] k3s[872]: time="2026-09-23T05:33:07Z" level=info msg="Tagged docker.io/rancher/mirrored-coredns-coredns@sha256:900f9c109f7a33545d3c811516e8376df9019147b750f5ce3e254468769176ea" machine # [ 21.832913] k3s[872]: time="2026-09-23T05:33:07Z" level=info msg="Imported docker.io/rancher/mirrored-library-busybox:1.37.0" machine # [ 21.837935] k3s[872]: time="2026-09-23T05:33:07Z" level=info msg="Tagged docker.io/rancher/mirrored-library-busybox@sha256:101b4afd76732482eff9b95cae5f94bcf295e521fbec4e01b69c5421f3f3f3e5" machine # [ 21.840612] k3s[872]: time="2026-09-23T05:33:07Z" level=info msg="Imported docker.io/rancher/mirrored-library-traefik:3.7.8" machine # [ 21.843741] k3s[872]: time="2026-09-23T05:33:07Z" level=info msg="Tagged docker.io/rancher/mirrored-library-traefik@sha256:4299bbed850421258fc5448c2e0e6ad350981d4d335a68de11b92448aedbefe5" machine # [ 21.846286] k3s[872]: time="2026-09-23T05:33:07Z" level=info msg="Imported docker.io/rancher/mirrored-metrics-server:v0.9.0" machine # [ 21.849101] k3s[872]: time="2026-09-23T05:33:07Z" level=info msg="Tagged docker.io/rancher/mirrored-metrics-server@sha256:d9862115e7c7881280d3d75ca26bda8ffc0fc213315979575bf23ce9826205c0" machine # [ 21.851632] k3s[872]: time="2026-09-23T05:33:07Z" level=info msg="Imported docker.io/rancher/mirrored-pause:3.10.2" machine # [ 21.856297] k3s[872]: time="2026-09-23T05:33:07Z" level=info msg="Tagged docker.io/rancher/mirrored-pause@sha256:f548e0e8e3dc1896ca956272154dde3314e8cc4fde0a57577ee9fa1c63f5baf4" machine # [ 21.926599] k3s[872]: I0923 05:33:07.889164 872 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="device-taint-eviction-controller" requiredFeatureGates=["DynamicResourceAllocation","DRADeviceTaints"] machine # [ 21.926791] k3s[872]: I0923 05:33:07.889212 872 controllermanager.go:579] "Warning: skipping controller" controller="device-taint-eviction-controller" machine # [ 22.128953] k3s[872]: time="2026-09-23T05:33:08Z" level=info msg="Done waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 22.129371] k3s[872]: time="2026-09-23T05:33:08Z" level=info msg="Waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 22.132148] k3s[872]: time="2026-09-23T05:33:08Z" level=info msg="Done waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 22.132807] k3s[872]: time="2026-09-23T05:33:08Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-40.1.4+up40.1.0.tgz" machine # [ 22.133602] k3s[872]: time="2026-09-23T05:33:08Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-crd-40.1.4+up40.1.0.tgz" machine # [ 22.134189] k3s[872]: time="2026-09-23T05:33:08Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/ccm.yaml" machine # [ 22.134616] k3s[872]: time="2026-09-23T05:33:08Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/coredns.yaml" machine # [ 22.135135] k3s[872]: time="2026-09-23T05:33:08Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/local-storage.yaml" machine # [ 22.135605] k3s[872]: time="2026-09-23T05:33:08Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/rolebindings.yaml" machine # [ 22.136107] k3s[872]: time="2026-09-23T05:33:08Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/runtimes.yaml" machine # [ 22.136576] k3s[872]: time="2026-09-23T05:33:08Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/traefik.yaml" machine # [ 22.147272] k3s[872]: time="2026-09-23T05:33:08Z" level=info msg="Imported 8 images from /var/lib/rancher/k3s/agent/images/k3s-airgap-images-amd64.tar.zst in 3.666397265s" machine # [ 22.147860] k3s[872]: time="2026-09-23T05:33:08Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-client.tar" machine: (finished: waiting for unit k3s.service, in 23.35 seconds) machine: waiting for success: kubectl get ns farm machine # Error from server (NotFound): namespaces "farm" not found machine # [ 22.664537] k3s[872]: I0923 05:33:08.626456 872 range_allocator.go:113] "No Secondary Service CIDR provided. Skipping filtering out secondary service addresses" logger="node-ipam-controller" machine # [ 22.666913] k3s[872]: time="2026-09-23T05:33:08Z" level=info msg="Starting dynamiclistener CN filter node controller with SANs: [127.0.0.1 ::1 localhost machine 10.0.2.15 fec0::d141:82ed:b650:1ac0 10.43.0.1 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local]" machine # [ 22.670395] k3s[872]: time="2026-09-23T05:33:08Z" level=info msg="Tunnel server egress proxy mode: agent" machine # [ 22.690341] k3s[872]: I0923 05:33:08.652938 872 controllermanager.go:579] "Warning: skipping controller" controller="storage-version-migrator-controller" machine # [ 22.722150] k3s[872]: time="2026-09-23T05:33:08Z" level=info msg="Creating new TLS secret for kube-system/k3s-serving (count: 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__d141_82ed_b650_1ac0-8199f5:fec0::d141:82ed:b650:1ac0 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=1BD3724FA4A4516165BD9CA05A1619BF7AB971E3]" machine # [ 22.734122] k3s[872]: time="2026-09-23T05:33:08Z" level=info msg="Active TLS secret kube-system/k3s-serving (ver=235) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__d141_82ed_b650_1ac0-8199f5:fec0::d141:82ed:b650:1ac0 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=1BD3724FA4A4516165BD9CA05A1619BF7AB971E3]" machine # [ 22.991773] k3s[872]: I0923 05:33:08.954284 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="csistoragecapacities.storage.k8s.io" machine # [ 22.996833] k3s[872]: I0923 05:33:08.954425 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="statefulsets.apps" machine # [ 23.000842] k3s[872]: I0923 05:33:08.954483 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="jobs.batch" machine # [ 23.004937] k3s[872]: I0923 05:33:08.954541 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="resourceclaimtemplates.resource.k8s.io" machine # [ 23.009758] k3s[872]: I0923 05:33:08.954609 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="limitranges" machine # [ 23.012152] k3s[872]: I0923 05:33:08.954766 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpoints" machine # [ 23.014416] k3s[872]: I0923 05:33:08.954827 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpointslices.discovery.k8s.io" machine # [ 23.016893] k3s[872]: I0923 05:33:08.954986 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="roles.rbac.authorization.k8s.io" machine # [ 23.019391] k3s[872]: I0923 05:33:08.955092 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmcharts.helm.cattle.io" machine # [ 23.021872] k3s[872]: I0923 05:33:08.955153 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="podtemplates" machine # [ 23.024302] k3s[872]: I0923 05:33:08.955222 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="cronjobs.batch" machine # [ 23.026357] k3s[872]: I0923 05:33:08.955288 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="poddisruptionbudgets.policy" machine # [ 23.028535] k3s[872]: I0923 05:33:08.955369 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="controllerrevisions.apps" machine # [ 23.030790] k3s[872]: I0923 05:33:08.955459 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="ingresses.networking.k8s.io" machine # [ 23.033265] k3s[872]: I0923 05:33:08.955517 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="networkpolicies.networking.k8s.io" machine # [ 23.035634] k3s[872]: I0923 05:33:08.955572 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="rolebindings.rbac.authorization.k8s.io" machine # [ 23.038246] k3s[872]: I0923 05:33:08.955629 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="daemonsets.apps" machine # [ 23.040632] k3s[872]: I0923 05:33:08.955737 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="horizontalpodautoscalers.autoscaling" machine # [ 23.043124] k3s[872]: I0923 05:33:08.955808 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmchartconfigs.helm.cattle.io" machine # [ 23.045624] k3s[872]: I0923 05:33:08.955865 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="addons.k3s.cattle.io" machine # [ 23.048457] k3s[872]: I0923 05:33:08.955993 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="leases.coordination.k8s.io" machine # [ 23.050903] k3s[872]: I0923 05:33:08.956051 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="serviceaccounts" machine # [ 23.053245] k3s[872]: I0923 05:33:08.956106 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="deployments.apps" machine # [ 23.055492] k3s[872]: I0923 05:33:08.956172 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="replicasets.apps" machine # [ 23.477055] k3s[872]: I0923 05:33:09.439560 872 controllermanager.go:627] "Warning: controller is disabled" controller="bootstrap-signer-controller" machine # [ 23.775969] k3s[872]: time="2026-09-23T05:33:09Z" level=info msg="Starting k3s.cattle.io/v1, Kind=Addon controller" machine # [ 23.776565] k3s[872]: time="2026-09-23T05:33:09Z" level=info msg="Creating deploy event broadcaster" machine # [ 23.784714] k3s[872]: I0923 05:33:09.746490 872 controller.go:667] quota admission added evaluator for: addons.k3s.cattle.io machine # [ 23.786654] k3s[872]: time="2026-09-23T05:33:09Z" level=info msg="Creating helm-controller event broadcaster" machine # [ 23.787489] k3s[872]: time="2026-09-23T05:33:09Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 23.801061] k3s[872]: time="2026-09-23T05:33:09Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 23.802025] k3s[872]: time="2026-09-23T05:33:09Z" level=info msg="Cluster dns configmap has been set successfully" machine # [ 23.804455] k3s[872]: time="2026-09-23T05:33:09Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=ApplyingManifest type=Normal machine # Error from server (NotFound): namespaces "farm" not found machine # [ 24.226375] k3s[872]: I0923 05:33:10.188917 872 controllermanager.go:627] "Warning: controller is disabled" controller="cloud-node-lifecycle-controller" machine # [ 24.379897] k3s[872]: W0923 05:33:10.342384 872 probe.go:272] Flexvolume plugin directory at /usr/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating. machine # [ 24.388765] k3s[872]: time="2026-09-23T05:33:10Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=AppliedManifest type=Normal machine # [ 24.406124] k3s[872]: time="2026-09-23T05:33:10Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=ApplyingManifest type=Normal machine # [ 24.541713] k3s[872]: I0923 05:33:10.504221 872 serving.go:392] Generated self-signed cert in-memory machine # [ 24.607772] k3s[872]: I0923 05:33:10.570343 872 serving.go:392] Generated self-signed cert in-memory machine # [ 24.669961] k3s[872]: time="2026-09-23T05:33:10Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=AppliedManifest type=Normal machine # [ 24.688648] k3s[872]: I0923 05:33:10.651178 872 controllermanager.go:160] Version: v1.35.8+k3s1 machine # [ 24.692614] k3s[872]: I0923 05:33:10.655185 872 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 24.693183] k3s[872]: I0923 05:33:10.655213 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 24.693602] k3s[872]: I0923 05:33:10.655252 872 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 24.694191] k3s[872]: I0923 05:33:10.655272 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 24.694637] k3s[872]: I0923 05:33:10.655289 872 secure_serving.go:211] Serving securely on 127.0.0.1:10258 machine # [ 24.695201] k3s[872]: I0923 05:33:10.655299 872 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 24.695667] k3s[872]: I0923 05:33:10.655313 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 24.696377] k3s[872]: I0923 05:33:10.655745 872 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 24.697647] k3s[872]: time="2026-09-23T05:33:10Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=ApplyingManifest type=Normal machine # [ 24.700595] k3s[872]: time="2026-09-23T05:33:10Z" level=info msg="Creating service-lb-controller event broadcaster" machine # [ 24.788691] k3s[872]: time="2026-09-23T05:33:10Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 24.893953] k3s[872]: I0923 05:33:10.855492 872 shared_informer.go:377] "Caches are synced" machine # [ 24.894168] k3s[872]: I0923 05:33:10.855590 872 shared_informer.go:377] "Caches are synced" machine # [ 24.894608] k3s[872]: I0923 05:33:10.855719 872 shared_informer.go:377] "Caches are synced" machine # [ 24.901130] k3s[872]: time="2026-09-23T05:33:10Z" level=info msg="Starting rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding controller" machine # [ 24.905925] k3s[872]: time="2026-09-23T05:33:10Z" level=info msg="Starting batch/v1, Kind=Job controller" machine # [ 24.906803] k3s[872]: time="2026-09-23T05:33:10Z" level=info msg="Starting /v1, Kind=ConfigMap controller" machine # [ 24.907304] k3s[872]: time="2026-09-23T05:33:10Z" level=info msg="Starting /v1, Kind=Secret controller" machine # [ 24.907776] k3s[872]: time="2026-09-23T05:33:10Z" level=info msg="Starting /v1, Kind=ServiceAccount controller" machine # [ 24.911967] k3s[872]: time="2026-09-23T05:33:10Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChartConfig controller" machine # [ 24.912470] k3s[872]: time="2026-09-23T05:33:10Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChart controller" machine: (finished: waiting for success: kubectl get ns farm, in 2.51 seconds) machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key machine # [ 25.039476] k3s[872]: time="2026-09-23T05:33:11Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 25.044325] k3s[872]: time="2026-09-23T05:33:11Z" level=info msg="Starting /v1, Kind=Pod controller" machine # [ 25.048468] k3s[872]: time="2026-09-23T05:33:11Z" level=info msg="Starting apps/v1, Kind=DaemonSet controller" machine # [ 25.052928] k3s[872]: time="2026-09-23T05:33:11Z" level=info msg="Starting discovery.k8s.io/v1, Kind=EndpointSlice controller" machine # [ 25.053278] k3s[872]: I0923 05:33:11.015011 872 controllermanager.go:329] Started "cloud-node-lifecycle-controller" machine # [ 25.053673] k3s[872]: I0923 05:33:11.015323 872 controllermanager.go:329] Started "service-lb-controller" machine # [ 25.054273] k3s[872]: W0923 05:33:11.015335 872 controllermanager.go:306] "node-route-controller" is disabled machine # [ 25.054725] k3s[872]: I0923 05:33:11.015491 872 controllermanager.go:329] Started "cloud-node-controller" machine # [ 25.055863] k3s[872]: I0923 05:33:11.015868 872 node_lifecycle_controller.go:112] Sending events to api server machine # [ 25.056602] k3s[872]: I0923 05:33:11.016028 872 node_controller.go:176] Sending events to api server. machine # [ 25.057143] k3s[872]: I0923 05:33:11.016120 872 controller.go:235] Starting service controller machine # [ 25.057656] k3s[872]: I0923 05:33:11.016138 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.060160] k3s[872]: I0923 05:33:11.016202 872 node_controller.go:185] Waiting for informer caches to sync machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key, in 0.17 seconds) machine: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key machine # [ 25.177484] k3s[872]: I0923 05:33:11.139996 872 controllermanager.go:627] "Warning: controller is disabled" controller="service-lb-controller" machine # [ 25.254089] k3s[872]: I0923 05:33:11.216509 872 shared_informer.go:377] "Caches are synced" machine # [ 25.311710] k3s[872]: I0923 05:33:11.273954 872 controller.go:667] quota admission added evaluator for: deployments.apps machine: (finished: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key, in 0.14 seconds) machine: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine # [ 25.326071] k3s[872]: I0923 05:33:11.288641 872 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" requiredFeatureGates=["ClusterTrustBundle"] machine # [ 25.326376] k3s[872]: I0923 05:33:11.288702 872 controllermanager.go:579] "Warning: skipping controller" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" machine # [ 25.326857] k3s[872]: I0923 05:33:11.288716 872 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="storageversion-garbage-collector-controller" requiredFeatureGates=["APIServerIdentity","StorageVersionAPI"] machine # [ 25.327647] k3s[872]: I0923 05:33:11.288727 872 controllermanager.go:579] "Warning: skipping controller" controller="storageversion-garbage-collector-controller" machine: (finished: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.15 seconds) subtest: chart deploys and workers become Ready machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine # [ 25.465158] k3s[872]: I0923 05:33:11.427641 872 alloc.go:329] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.43.0.10"} machine # [ 25.466261] k3s[872]: time="2026-09-23T05:33:11Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=AppliedManifest type=Normal machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 25.626462] k3s[872]: I0923 05:33:11.589032 872 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="podcertificaterequest-cleaner-controller" requiredFeatureGates=["PodCertificateRequest"] machine # [ 25.626635] k3s[872]: I0923 05:33:11.589060 872 controllermanager.go:579] "Warning: skipping controller" controller="podcertificaterequest-cleaner-controller" machine # [ 25.675901] k3s[872]: I0923 05:33:11.638443 872 node_lifecycle_controller.go:419] "Controller will reconcile labels" logger="node-lifecycle-controller" machine # [ 25.788113] k3s[872]: time="2026-09-23T05:33:11Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 26.030566] k3s[872]: I0923 05:33:11.991608 872 servicecidrs_controller.go:136] "Starting" controller="service-cidr-controller" machine # [ 26.030721] k3s[872]: I0923 05:33:11.991640 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.031387] k3s[872]: I0923 05:33:11.992308 872 ttlafterfinished_controller.go:112] "Starting TTL after finished controller" machine # [ 26.031853] k3s[872]: I0923 05:33:11.992323 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.032505] k3s[872]: I0923 05:33:11.992334 872 horizontal.go:204] "Starting HPA controller" machine # [ 26.033093] k3s[872]: I0923 05:33:11.992362 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.033567] k3s[872]: I0923 05:33:11.992394 872 controller.go:423] "Starting resource claim controller" machine # [ 26.034086] k3s[872]: I0923 05:33:11.992408 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.034578] k3s[872]: I0923 05:33:11.992451 872 expand_controller.go:328] "Starting expand controller" machine # [ 26.035155] k3s[872]: I0923 05:33:11.992475 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.035595] k3s[872]: I0923 05:33:11.992541 872 daemon_controller.go:309] "Starting daemon sets controller" machine # [ 26.036121] k3s[872]: I0923 05:33:11.992555 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.036625] k3s[872]: I0923 05:33:11.992566 872 vac_protection_controller.go:206] "Starting VAC protection controller" machine # [ 26.037163] k3s[872]: I0923 05:33:11.992579 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.037655] k3s[872]: I0923 05:33:11.992601 872 node_lifecycle_controller.go:453] "Sending events to api server" machine # [ 26.038183] k3s[872]: I0923 05:33:11.992618 872 publisher.go:107] "Starting root CA cert publisher controller" machine # [ 26.038632] k3s[872]: I0923 05:33:11.992627 872 node_lifecycle_controller.go:460] "Starting node controller" machine # [ 26.039141] k3s[872]: I0923 05:33:11.992633 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.039608] k3s[872]: I0923 05:33:11.992637 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.040159] k3s[872]: I0923 05:33:11.992666 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.040663] k3s[872]: I0923 05:33:11.992695 872 legacy_serviceaccount_token_cleaner.go:103] "Starting legacy service account token cleaner controller" machine # [ 26.041194] k3s[872]: I0923 05:33:11.992707 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.041671] k3s[872]: I0923 05:33:11.992796 872 endpointslice_controller.go:283] "Starting endpoint slice controller" machine # [ 26.042222] k3s[872]: I0923 05:33:11.992809 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.042836] k3s[872]: I0923 05:33:11.993058 872 replica_set.go:241] "Starting controller" name="replicaset" machine # [ 26.043353] k3s[872]: I0923 05:33:11.993073 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.043845] k3s[872]: I0923 05:33:11.993150 872 endpoints_controller.go:193] "Starting endpoint controller" machine # [ 26.044507] k3s[872]: I0923 05:33:11.993163 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.045072] k3s[872]: I0923 05:33:11.993104 872 disruption.go:458] "Sending events to api server." machine # [ 26.045547] k3s[872]: I0923 05:33:11.993977 872 disruption.go:465] "Starting disruption controller" machine # [ 26.046066] k3s[872]: I0923 05:33:11.993996 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.046515] k3s[872]: I0923 05:33:11.994048 872 serviceaccounts_controller.go:117] "Starting service account controller" machine # [ 26.047073] k3s[872]: I0923 05:33:11.994062 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.047560] k3s[872]: I0923 05:33:11.994097 872 cleaner.go:83] "Starting CSR cleaner controller" machine # [ 26.048094] k3s[872]: I0923 05:33:11.994163 872 tokencleaner.go:117] "Starting token cleaner controller" machine # [ 26.048578] k3s[872]: I0923 05:33:11.994176 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.049111] k3s[872]: I0923 05:33:11.992473 872 replica_set.go:241] "Starting controller" name="replicationcontroller" machine # [ 26.049584] k3s[872]: I0923 05:33:11.994210 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.050149] k3s[872]: I0923 05:33:11.994278 872 node_ipam_controller.go:142] "Starting ipam controller" machine # [ 26.050632] k3s[872]: I0923 05:33:11.994294 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.051191] k3s[872]: I0923 05:33:11.994342 872 resource_quota_controller.go:297] "Starting resource quota controller" machine # [ 26.051642] k3s[872]: I0923 05:33:11.994355 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.051954] k3s[872]: I0923 05:33:11.994407 872 resource_quota_monitor.go:309] "QuotaMonitor running" machine # [ 26.052638] k3s[872]: I0923 05:33:11.993241 872 cronjob_controllerv2.go:143] "Starting cronjob controller v2" machine # [ 26.053138] k3s[872]: I0923 05:33:11.994713 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.053604] k3s[872]: I0923 05:33:11.994748 872 pv_protection_controller.go:81] "Starting PV protection controller" machine # [ 26.054106] k3s[872]: I0923 05:33:11.994761 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.054586] k3s[872]: I0923 05:33:11.994836 872 endpointslicemirroring_controller.go:226] "Starting EndpointSliceMirroring controller" machine # [ 26.055114] k3s[872]: I0923 05:33:11.994848 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.055564] k3s[872]: I0923 05:33:11.994879 872 namespace_controller.go:202] "Starting namespace controller" machine # [ 26.056095] k3s[872]: I0923 05:33:11.994890 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.056563] k3s[872]: I0923 05:33:11.994920 872 certificate_controller.go:120] "Starting certificate controller" name="csrapproving" machine # [ 26.057128] k3s[872]: I0923 05:33:11.994932 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.057617] k3s[872]: I0923 05:33:11.994968 872 ttl_controller.go:127] "Starting TTL controller" machine # [ 26.058180] k3s[872]: I0923 05:33:11.994980 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.058666] k3s[872]: I0923 05:33:11.995044 872 attach_detach_controller.go:335] "Starting attach detach controller" machine # [ 26.059178] k3s[872]: I0923 05:33:11.995057 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.059622] k3s[872]: I0923 05:33:11.995089 872 pvc_protection_controller.go:166] "Starting PVC protection controller" machine # [ 26.060142] k3s[872]: I0923 05:33:11.995101 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.060632] k3s[872]: I0923 05:33:11.995138 872 controller.go:174] "Starting ephemeral volume controller" machine # [ 26.061171] k3s[872]: I0923 05:33:11.995149 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.061757] k3s[872]: I0923 05:33:12.002189 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.062955] k3s[872]: I0923 05:33:12.002270 872 pv_controller_base.go:307] "Starting persistent volume controller" machine # [ 26.064425] k3s[872]: I0923 05:33:12.002282 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.065592] k3s[872]: I0923 05:33:12.002492 872 job_controller.go:254] "Starting job controller" machine # [ 26.066591] k3s[872]: I0923 05:33:12.002513 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.067625] k3s[872]: I0923 05:33:12.002573 872 deployment_controller.go:172] "Starting controller" controller="deployment" machine # [ 26.068868] k3s[872]: I0923 05:33:12.002585 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.070067] k3s[872]: I0923 05:33:12.002643 872 stateful_set.go:180] "Starting stateful set controller" machine # [ 26.071185] k3s[872]: I0923 05:33:12.002656 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.072465] k3s[872]: I0923 05:33:12.003079 872 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-legacy-unknown" machine # [ 26.073765] k3s[872]: I0923 05:33:12.003093 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.074906] k3s[872]: I0923 05:33:12.003124 872 clusterroleaggregation_controller.go:194] "Starting ClusterRoleAggregator controller" machine # [ 26.076374] k3s[872]: I0923 05:33:12.003136 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.077501] k3s[872]: I0923 05:33:12.003172 872 taint_eviction.go:283] "Starting" controller="taint-eviction-controller" machine # [ 26.078824] k3s[872]: I0923 05:33:12.003217 872 taint_eviction.go:288] "Sending events to API server" machine # [ 26.079885] k3s[872]: I0923 05:33:12.003227 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.081077] k3s[872]: I0923 05:33:12.003269 872 gc_controller.go:98] "Starting GC controller" machine # [ 26.082059] k3s[872]: I0923 05:33:12.003282 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.083363] k3s[872]: I0923 05:33:12.004199 872 garbagecollector.go:141] "Starting controller" controller="garbagecollector" machine # [ 26.084611] k3s[872]: I0923 05:33:12.004227 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.085602] k3s[872]: I0923 05:33:12.004294 872 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-serving" machine # [ 26.127134] k3s[872]: I0923 05:33:12.004307 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.127817] k3s[872]: I0923 05:33:12.004337 872 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-client" machine # [ 26.128448] k3s[872]: I0923 05:33:12.004349 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.128939] k3s[872]: I0923 05:33:12.004379 872 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kube-apiserver-client" machine # [ 26.129590] k3s[872]: I0923 05:33:12.004391 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.130140] k3s[872]: I0923 05:33:12.004428 872 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 26.130595] k3s[872]: I0923 05:33:12.005019 872 graph_builder.go:386] "Running" component="GraphBuilder" machine # [ 26.131287] k3s[872]: I0923 05:33:12.005042 872 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 26.132192] k3s[872]: I0923 05:33:12.005115 872 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 26.133057] k3s[872]: I0923 05:33:12.005187 872 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 26.133835] k3s[872]: I0923 05:33:12.083728 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.142460] k3s[872]: I0923 05:33:12.105067 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.703764] k3s[872]: time="2026-09-23T05:33:12Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" object=kube-system/local-storage reason=DeletingManifest type=Normal machine # [ 26.722060] k3s[872]: I0923 05:33:12.684111 872 shared_informer.go:377] "Caches are synced" machine # [ 26.729165] k3s[872]: I0923 05:33:12.691776 872 shared_informer.go:377] "Caches are synced" machine # [ 26.729908] k3s[872]: I0923 05:33:12.692518 872 shared_informer.go:377] "Caches are synced" machine # [ 26.731916] k3s[872]: I0923 05:33:12.694494 872 shared_informer.go:377] "Caches are synced" machine # [ 26.732517] k3s[872]: I0923 05:33:12.694536 872 shared_informer.go:377] "Caches are synced" machine # [ 26.732996] k3s[872]: I0923 05:33:12.694623 872 shared_informer.go:377] "Caches are synced" machine # [ 26.733464] k3s[872]: I0923 05:33:12.694705 872 shared_informer.go:377] "Caches are synced" machine # [ 26.733928] k3s[872]: I0923 05:33:12.694750 872 shared_informer.go:377] "Caches are synced" machine # [ 26.734765] k3s[872]: I0923 05:33:12.694794 872 shared_informer.go:377] "Caches are synced" machine # [ 26.735633] k3s[872]: I0923 05:33:12.694822 872 shared_informer.go:377] "Caches are synced" machine # [ 26.736649] k3s[872]: I0923 05:33:12.694860 872 shared_informer.go:377] "Caches are synced" machine # [ 26.737678] k3s[872]: I0923 05:33:12.694905 872 shared_informer.go:377] "Caches are synced" machine # [ 26.738650] k3s[872]: I0923 05:33:12.694941 872 shared_informer.go:377] "Caches are synced" machine # [ 26.738975] k3s[872]: I0923 05:33:12.694991 872 shared_informer.go:377] "Caches are synced" machine # [ 26.739770] k3s[872]: I0923 05:33:12.695019 872 shared_informer.go:377] "Caches are synced" machine # [ 26.740631] k3s[872]: I0923 05:33:12.695106 872 shared_informer.go:377] "Caches are synced" machine # [ 26.741642] k3s[872]: I0923 05:33:12.695142 872 shared_informer.go:377] "Caches are synced" machine # [ 26.746527] k3s[872]: I0923 05:33:12.709089 872 shared_informer.go:377] "Caches are synced" machine # [ 26.747785] k3s[872]: I0923 05:33:12.710363 872 shared_informer.go:377] "Caches are synced" machine # [ 26.748391] k3s[872]: I0923 05:33:12.710762 872 shared_informer.go:377] "Caches are synced" machine # [ 26.751508] k3s[872]: I0923 05:33:12.712773 872 shared_informer.go:377] "Caches are synced" machine # [ 26.751790] k3s[872]: I0923 05:33:12.713894 872 shared_informer.go:377] "Caches are synced" machine # [ 26.752702] k3s[872]: I0923 05:33:12.714975 872 shared_informer.go:377] "Caches are synced" machine # [ 26.754825] k3s[872]: I0923 05:33:12.711597 872 shared_informer.go:377] "Caches are synced" machine # [ 26.755450] k3s[872]: I0923 05:33:12.711630 872 shared_informer.go:377] "Caches are synced" machine # [ 26.755941] k3s[872]: I0923 05:33:12.711653 872 shared_informer.go:377] "Caches are synced" machine # [ 26.756602] k3s[872]: I0923 05:33:12.711712 872 shared_informer.go:377] "Caches are synced" machine # [ 26.757116] k3s[872]: I0923 05:33:12.711738 872 shared_informer.go:377] "Caches are synced" machine # [ 26.757603] k3s[872]: I0923 05:33:12.711762 872 shared_informer.go:377] "Caches are synced" machine # [ 26.758124] k3s[872]: I0923 05:33:12.711784 872 shared_informer.go:377] "Caches are synced" machine # [ 26.758599] k3s[872]: I0923 05:33:12.711820 872 shared_informer.go:377] "Caches are synced" machine # [ 26.759258] k3s[872]: I0923 05:33:12.718604 872 range_allocator.go:177] "Sending events to api server" machine # [ 26.759750] k3s[872]: I0923 05:33:12.718637 872 range_allocator.go:181] "Starting range CIDR allocator" machine # [ 26.760910] k3s[872]: I0923 05:33:12.718652 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.761535] k3s[872]: I0923 05:33:12.718664 872 shared_informer.go:377] "Caches are synced" machine # [ 26.762132] k3s[872]: I0923 05:33:12.711855 872 shared_informer.go:377] "Caches are synced" machine # [ 26.762562] k3s[872]: I0923 05:33:12.711544 872 shared_informer.go:377] "Caches are synced" machine # [ 26.763499] k3s[872]: I0923 05:33:12.716743 872 shared_informer.go:377] "Caches are synced" machine # [ 26.764565] k3s[872]: I0923 05:33:12.716810 872 shared_informer.go:377] "Caches are synced" machine # [ 26.765083] k3s[872]: I0923 05:33:12.716837 872 shared_informer.go:377] "Caches are synced" machine # [ 26.765527] k3s[872]: I0923 05:33:12.716899 872 shared_informer.go:377] "Caches are synced" machine # [ 26.766500] k3s[872]: I0923 05:33:12.716947 872 shared_informer.go:377] "Caches are synced" machine # [ 26.766890] k3s[872]: I0923 05:33:12.716980 872 shared_informer.go:377] "Caches are synced" machine # [ 26.767633] k3s[872]: I0923 05:33:12.717006 872 shared_informer.go:377] "Caches are synced" machine # [ 26.768160] k3s[872]: I0923 05:33:12.711360 872 shared_informer.go:377] "Caches are synced" machine # [ 26.768635] k3s[872]: I0923 05:33:12.711573 872 shared_informer.go:377] "Caches are synced" machine # [ 26.772377] k3s[872]: time="2026-09-23T05:33:12Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=ApplyingManifest type=Normal machine # [ 26.781926] k3s[872]: time="2026-09-23T05:33:12Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Deferred node password secret validation complete" object=machine reason=NodePasswordValidationComplete type=Normal machine # [ 26.803056] k3s[872]: I0923 05:33:12.765642 872 controller.go:667] quota admission added evaluator for: replicasets.apps machine # [ 26.813058] k3s[872]: time="2026-09-23T05:33:12Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 26.817200] k3s[872]: I0923 05:33:12.779828 872 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 26.824067] k3s[872]: I0923 05:33:12.786446 872 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 26.882693] k3s[872]: I0923 05:33:12.845283 872 controller.go:667] quota admission added evaluator for: helmcharts.helm.cattle.io machine # [ 26.886315] k3s[872]: time="2026-09-23T05:33:12Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=AppliedManifest type=Normal machine # [ 26.899113] k3s[872]: time="2026-09-23T05:33:12Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=ApplyingManifest type=Normal machine # [ 27.668407] k3s[872]: time="2026-09-23T05:33:13Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Applying HelmChart from https://%{KUBERNETES_API}%/static/charts/nix-grpc-farm.tgz using Job kube-system/helm-install-nix-grpc-farm " object=kube-system/nix-grpc-farm reason=ApplyJob type=Normal machine # [ 27.692737] k3s[872]: I0923 05:33:13.655344 872 controller.go:667] quota admission added evaluator for: jobs.batch machine # [ 27.742164] k3s[872]: I0923 05:33:13.704728 872 shared_informer.go:377] "Caches are synced" machine # [ 27.742531] k3s[872]: I0923 05:33:13.704756 872 garbagecollector.go:166] "Garbage collector: all resource monitors have synced" machine # [ 27.743037] k3s[872]: I0923 05:33:13.704767 872 garbagecollector.go:169] "Proceeding to collect garbage" machine # [ 27.743511] k3s[872]: I0923 05:33:13.705141 872 shared_informer.go:377] "Caches are synced" machine # [ 27.788967] k3s[872]: time="2026-09-23T05:33:13Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 28.100596] postgres[1182]: [1182] ERROR: relation "goose_db_version" does not exist at character 36 machine # [ 28.100785] postgres[1182]: [1182] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC machine # [ 28.121654] niks3-server[1171]: 2026/09/23 05:33:14 OK 20241026095416_initial_model.sql (9ms) machine # [ 28.126186] niks3-server[1171]: 2026/09/23 05:33:14 OK 20251210153512_drop_unused_gin_index.sql (4.8ms) machine # [ 28.131364] niks3-server[1171]: 2026/09/23 05:33:14 OK 20251218171726_add_pins.sql (4.49ms) machine # [ 28.136033] niks3-server[1171]: 2026/09/23 05:33:14 OK 20260628120000_add_object_size_and_stats.sql (3.87ms) machine # [ 28.140990] niks3-server[1171]: 2026/09/23 05:33:14 OK 20260905000000_add_claims.sql (4.53ms) machine # [ 28.145154] niks3-server[1171]: 2026/09/23 05:33:14 OK 20260920000000_drop_claims.sql (3.25ms) machine # [ 28.145494] niks3-server[1171]: 2026/09/23 05:33:14 goose: successfully migrated database to version: 20260920000000 machine # [ 28.148959] niks3-server[1171]: 2026/09/23 05:33:14 OK 1_commit_pending_closure.sql (3.73ms) machine # [ 28.151832] niks3-server[1171]: 2026/09/23 05:33:14 OK 2_object_stats_trigger.sql (2.78ms) machine # [ 28.151983] niks3-server[1171]: 2026/09/23 05:33:14 goose: up to current file version: 2 machine # [ 28.155190] niks3-server[1171]: 2026/09/23 05:33:14 INFO OIDC provider initialized name=kubernetes issuer=https://kubernetes.default.svc.cluster.local machine # [ 28.155484] niks3-server[1171]: 2026/09/23 05:33:14 INFO OIDC authentication enabled config=/nix/store/v0b0sqyzhrjsz48x3klf7b7vl89apzs0-niks3-oidc.json machine # [ 28.159423] niks3-server[1171]: 2026/09/23 05:33:14 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key machine # [ 28.189180] niks3-server[1171]: 2026/09/23 05:33:14 INFO Read proxy enabled — serving cache objects from S3 machine # [ 28.189668] niks3-server[1171]: 2026/09/23 05:33:14 INFO Using socket-activated listener address=0.0.0.0:5751 machine # [ 28.190083] niks3-server[1171]: 2026/09/23 05:33:14 INFO systemd watchdog enabled interval=15s machine # [ 28.190933] niks3-server[1171]: 2026/09/23 05:33:14 INFO Starting HTTP server address=0.0.0.0:5751 machine # [ 28.194623] systemd[1]: Started niks3 server. machine # [ 28.195711] systemd[1]: Reached target Multi-User System. machine # [ 28.196678] systemd[1]: Startup finished in 1.156s (kernel) + 3.735s (initrd) + 23.302s (userspace) = 28.195s. machine # [ 28.609755] k3s[872]: time="2026-09-23T05:33:14Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Resumed synced Job kube-system/helm-install-nix-grpc-farm" object=kube-system/nix-grpc-farm reason=ResumeJob type=Normal machine # [ 28.612367] k3s[872]: time="2026-09-23T05:33:14Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=AppliedManifest type=Normal machine # [ 28.626143] k3s[872]: time="2026-09-23T05:33:14Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=ApplyingManifest type=Normal machine # [ 28.721657] k3s[872]: time="2026-09-23T05:33:14Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=AppliedManifest type=Normal machine # [ 28.788429] k3s[872]: time="2026-09-23T05:33:14Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 28.924424] k3s[872]: time="2026-09-23T05:33:14Z" level=info msg="Imported docker.io/library/nix-grpc-farm-client:0.1.0-beta.3" machine # [ 28.927271] k3s[872]: time="2026-09-23T05:33:14Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-client@sha256:a6b3116953ee7a255faee1fa216a1d2c003d9c67d83f14083aa098ee7b59040e" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 29.377274] k3s[872]: time="2026-09-23T05:33:15Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-client.tar in 7.22919952s" machine # [ 29.381961] k3s[872]: time="2026-09-23T05:33:15Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-lb.tar" machine # [ 29.665151] k3s[872]: time="2026-09-23T05:33:15Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/traefik.yaml\"" object=kube-system/traefik reason=DeletingManifest type=Normal machine # [ 29.789611] k3s[872]: time="2026-09-23T05:33:15Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 30.789248] k3s[872]: time="2026-09-23T05:33:16Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 30.989988] k3s[872]: time="2026-09-23T05:33:16Z" level=info msg="Imported docker.io/library/nix-grpc-farm-lb:0.1.0-beta.3" machine # [ 30.996748] k3s[872]: time="2026-09-23T05:33:16Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-lb@sha256:18ee6724be589622e1aee9d13c5121e7b2c992ca636c935ade90c66423e18f37" machine # [ 31.066270] k3s[872]: time="2026-09-23T05:33:17Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-lb.tar in 1.684346754s" machine # [ 31.066989] k3s[872]: time="2026-09-23T05:33:17Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm.tar" machine # [ 31.491865] k3s[872]: time="2026-09-23T05:33:17Z" level=info msg="Running kubelet --cloud-provider=external --config-dir=/var/lib/rancher/k3s/agent/etc/kubelet.conf.d --containerd=/run/k3s/containerd/containerd.sock --eviction-hard=nodefs.available<1%,imagefs.available<1% --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubelet.kubeconfig --node-ip=10.0.2.15,fec0::d141:82ed:b650:1ac0 --node-labels= --read-only-port=0" machine # [ 31.492188] k3s[872]: Flag --containerd has been deprecated, This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed. machine # [ 31.500321] k3s[872]: I0923 05:33:17.462913 872 server.go:521] "Kubelet version" kubeletVersion="v1.35.8+k3s1" machine # [ 31.501414] k3s[872]: I0923 05:33:17.462943 872 server.go:523] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 31.502356] k3s[872]: I0923 05:33:17.462979 872 watchdog_linux.go:95] "Systemd watchdog is not enabled" machine # [ 31.503811] k3s[872]: I0923 05:33:17.462992 872 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." machine # [ 31.504717] k3s[872]: I0923 05:33:17.464192 872 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/agent/client-ca.crt" machine # [ 31.506274] k3s[872]: I0923 05:33:17.468853 872 server.go:1414] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" machine # [ 31.510083] k3s[872]: I0923 05:33:17.472700 872 server.go:771] "--cgroups-per-qos enabled, but --cgroup-root was not specified. Defaulting to /" machine # [ 31.510717] k3s[872]: I0923 05:33:17.472731 872 server.go:832] "NoSwap is set due to memorySwapBehavior not specified" memorySwapBehavior="" FailSwapOn=false machine # [ 31.511508] k3s[872]: I0923 05:33:17.472927 872 container_manager_linux.go:272] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] machine # [ 31.512040] k3s[872]: I0923 05:33:17.472947 872 container_manager_linux.go:277] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"machine","RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} machine # [ 31.512659] k3s[872]: I0923 05:33:17.473116 872 topology_manager.go:143] "Creating topology manager with none policy" machine # [ 31.513166] k3s[872]: I0923 05:33:17.473131 872 container_manager_linux.go:308] "Creating device plugin manager" machine # [ 31.513619] k3s[872]: I0923 05:33:17.473193 872 container_manager_linux.go:317] "Creating Dynamic Resource Allocation (DRA) manager" machine # [ 31.543285] k3s[872]: I0923 05:33:17.504697 872 state_mem.go:41] "Initialized" logger="CPUManager state memory" machine # [ 31.543453] k3s[872]: I0923 05:33:17.504972 872 kubelet.go:482] "Attempting to sync node with API server" machine # [ 31.543903] k3s[872]: I0923 05:33:17.504994 872 kubelet.go:383] "Adding static pod path" path="/var/lib/rancher/k3s/agent/pod-manifests" machine # [ 31.544559] k3s[872]: I0923 05:33:17.505022 872 kubelet.go:394] "Adding apiserver pod source" machine # [ 31.545126] k3s[872]: I0923 05:33:17.505038 872 apiserver.go:42] "Waiting for node sync before watching apiserver pods" machine # [ 31.547060] k3s[872]: I0923 05:33:17.508517 872 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="containerd" version="2.2.7-k3s1" apiVersion="v1" machine # [ 31.547614] k3s[872]: I0923 05:33:17.509219 872 kubelet.go:945] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" machine # [ 31.547936] k3s[872]: I0923 05:33:17.509243 872 kubelet.go:972] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" machine # [ 31.558033] k3s[872]: I0923 05:33:17.520614 872 server.go:1252] "Started kubelet" machine # [ 31.560433] k3s[872]: I0923 05:33:17.522624 872 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 machine # [ 31.560682] k3s[872]: I0923 05:33:17.522642 872 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 machine # [ 31.561391] k3s[872]: I0923 05:33:17.522746 872 server_v1.go:49] "podresources" method="list" useActivePods=true machine # [ 31.561847] k3s[872]: I0923 05:33:17.522916 872 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" machine # [ 31.562566] k3s[872]: I0923 05:33:17.523467 872 server.go:317] "Adding debug handlers to kubelet server" machine # [ 31.565126] k3s[872]: I0923 05:33:17.527476 872 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" machine # [ 31.568061] k3s[872]: I0923 05:33:17.528619 872 dynamic_serving_content.go:135] "Starting controller" name="kubelet-server-cert-files::/var/lib/rancher/k3s/agent/serving-kubelet.crt::/var/lib/rancher/k3s/agent/serving-kubelet.key" machine # [ 31.569469] k3s[872]: I0923 05:33:17.532086 872 volume_manager.go:311] "Starting Kubelet Volume Manager" machine # [ 31.570756] k3s[872]: I0923 05:33:17.533381 872 factory.go:223] Registration of the systemd container factory successfully machine # [ 31.571408] k3s[872]: I0923 05:33:17.533490 872 factory.go:221] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory machine # [ 31.571867] k3s[872]: E0923 05:33:17.533725 872 kubelet.go:1661] "Image garbage collection failed once. Stats initialization may not have completed yet" err="invalid capacity 0 on image filesystem" machine # [ 31.572642] k3s[872]: I0923 05:33:17.533372 872 desired_state_of_world_populator.go:146] "Desired state populator starts to run" machine # [ 31.574201] k3s[872]: I0923 05:33:17.536222 872 reconciler.go:29] "Reconciler: start to sync state" machine # [ 31.576104] k3s[872]: I0923 05:33:17.537698 872 factory.go:223] Registration of the containerd container factory successfully machine # [ 31.577920] k3s[872]: E0923 05:33:17.540474 872 kubelet_node_status.go:392] "Error getting the current node from lister" err="node \"machine\" not found" machine # [ 31.589462] k3s[872]: E0923 05:33:17.552061 872 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"machine\" not found" node="machine" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 31.601810] k3s[872]: I0923 05:33:17.564419 872 cpu_manager.go:225] "Starting" policy="none" machine # [ 31.602149] k3s[872]: I0923 05:33:17.564439 872 cpu_manager.go:226] "Reconciling" reconcilePeriod="10s" machine # [ 31.604035] k3s[872]: I0923 05:33:17.564464 872 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" machine # [ 31.608361] k3s[872]: I0923 05:33:17.570953 872 policy_none.go:50] "Start" machine # [ 31.609029] k3s[872]: I0923 05:33:17.570985 872 memory_manager.go:187] "Starting memorymanager" policy="None" machine # [ 31.610842] k3s[872]: I0923 05:33:17.571002 872 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" machine # [ 31.613156] k3s[872]: I0923 05:33:17.575771 872 policy_none.go:44] "Start" machine # [ 31.620558] systemd[1]: Created slice libcontainer container kubepods.slice. machine # [ 31.632307] systemd[1]: Created slice libcontainer container kubepods-besteffort.slice. machine # [ 31.643389] systemd[1]: Created slice libcontainer container kubepods-burstable.slice. machine # [ 31.645966] k3s[872]: E0923 05:33:17.608583 872 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" machine # [ 31.648214] k3s[872]: I0923 05:33:17.608717 872 eviction_manager.go:194] "Eviction manager: starting control loop" machine # [ 31.648735] k3s[872]: I0923 05:33:17.608743 872 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" machine # [ 31.649239] k3s[872]: I0923 05:33:17.609409 872 plugin_manager.go:121] "Starting Kubelet Plugin Manager" machine # [ 31.650099] k3s[872]: E0923 05:33:17.611214 872 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="no imagefs label for configured runtime" machine # [ 31.650889] k3s[872]: E0923 05:33:17.611250 872 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"machine\" not found" machine # [ 31.707498] k3s[872]: I0923 05:33:17.670079 872 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" machine # [ 31.713366] k3s[872]: I0923 05:33:17.675979 872 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" machine # [ 31.713845] k3s[872]: I0923 05:33:17.676394 872 status_manager.go:249] "Starting to sync pod status with apiserver" machine # [ 31.715212] k3s[872]: I0923 05:33:17.677185 872 kubelet.go:2506] "Starting kubelet main sync loop" machine # [ 31.715765] k3s[872]: E0923 05:33:17.677250 872 kubelet.go:2530] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" machine # [ 31.748091] k3s[872]: I0923 05:33:17.710161 872 kubelet_node_status.go:74] "Attempting to register node" node="machine" machine # [ 31.754227] k3s[872]: time="2026-09-23T05:33:17Z" level=info msg="Adding node OwnerReference to node-password secret machine.node-password.k3s" machine # [ 31.754839] k3s[872]: I0923 05:33:17.717450 872 node_controller.go:429] Initializing node machine with cloud provider machine # [ 31.755534] k3s[872]: I0923 05:33:17.717508 872 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 31.755987] k3s[872]: E0923 05:33:17.717530 872 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 31.756683] k3s[872]: I0923 05:33:17.718471 872 kubelet_node_status.go:77] "Successfully registered node" node="machine" machine # [ 31.757551] k3s[872]: E0923 05:33:17.718492 872 kubelet_node_status.go:474] "Error updating node status, will retry" err="error getting node \"machine\": node \"machine\" not found" machine # [ 31.761224] k3s[872]: I0923 05:33:17.723848 872 node_controller.go:429] Initializing node machine with cloud provider machine # [ 31.762737] k3s[872]: I0923 05:33:17.724034 872 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 31.763605] k3s[872]: E0923 05:33:17.724053 872 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 31.765347] k3s[872]: time="2026-09-23T05:33:17Z" level=info msg="Annotations and labels have been set successfully on node: machine" machine # [ 31.765894] k3s[872]: time="2026-09-23T05:33:17Z" level=info msg="Starting flannel with backend vxlan" machine # [ 31.773071] k3s[872]: I0923 05:33:17.734860 872 node_controller.go:429] Initializing node machine with cloud provider machine # [ 31.773609] k3s[872]: time="2026-09-23T05:33:17Z" level=info msg="Synced coredns NodeHosts entries for machine" machine # [ 31.777361] k3s[872]: I0923 05:33:17.739959 872 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"machine\" does not exist" machine # [ 31.799895] k3s[872]: time="2026-09-23T05:33:17Z" level=info msg="Labels and annotations have been set successfully on node: machine" machine # [ 31.800054] k3s[872]: I0923 05:33:17.762027 872 node_controller.go:474] Successfully initialized node machine with cloud provider machine # [ 31.800916] k3s[872]: I0923 05:33:17.763508 872 event.go:389] "Event occurred" object="machine" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="Synced" message="Node synced successfully" machine # [ 31.805492] k3s[872]: I0923 05:33:17.768074 872 range_allocator.go:433] "Set node PodCIDR" node="machine" podCIDRs=["10.42.0.0/24"] machine # [ 31.810196] k3s[872]: I0923 05:33:17.772810 872 server.go:173] "Starting Kubernetes Scheduler" version="v1.35.8+k3s1" machine # [ 31.810466] k3s[872]: I0923 05:33:17.772836 872 server.go:175] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 31.819170] k3s[872]: I0923 05:33:17.780838 872 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 31.819441] k3s[872]: I0923 05:33:17.780863 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.819905] k3s[872]: I0923 05:33:17.780916 872 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 31.820587] k3s[872]: I0923 05:33:17.780934 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.821153] k3s[872]: I0923 05:33:17.780937 872 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 31.821603] k3s[872]: I0923 05:33:17.780969 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.822985] k3s[872]: I0923 05:33:17.781048 872 secure_serving.go:211] Serving securely on 127.0.0.1:10259 machine # [ 31.823575] k3s[872]: I0923 05:33:17.781137 872 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 31.824130] k3s[872]: I0923 05:33:17.781354 872 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 31.851139] k3s[872]: time="2026-09-23T05:33:17Z" level=info msg="Flannel found PodCIDR assigned for node machine" machine # [ 31.851908] k3s[872]: time="2026-09-23T05:33:17Z" level=info msg="The interface eth0 with ipv4 address 10.0.2.15 will be used by flannel" machine # [ 31.852887] k3s[872]: I0923 05:33:17.815481 872 kube.go:139] Waiting 10m0s for node controller to sync machine # [ 31.853772] k3s[872]: I0923 05:33:17.815555 872 kube.go:537] Starting kube subnet manager machine # [ 31.910887] k3s[872]: I0923 05:33:17.873446 872 kuberuntime_manager.go:2095] "Updating runtime config through cri with podcidr" CIDR="10.42.0.0/24" machine # [ 31.911584] k3s[872]: I0923 05:33:17.874207 872 kubelet_network.go:47] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.42.0.0/24" machine # [ 31.913463] k3s[872]: I0923 05:33:17.875356 872 kubelet_node_status.go:427] "Fast updating node status as it just became ready" machine # [ 32.019886] k3s[872]: I0923 05:33:17.982090 872 shared_informer.go:377] "Caches are synced" machine # [ 32.020069] k3s[872]: I0923 05:33:17.982206 872 shared_informer.go:377] "Caches are synced" machine # [ 32.020546] k3s[872]: I0923 05:33:17.982343 872 shared_informer.go:377] "Caches are synced" machine # [ 32.457327] k3s[872]: time="2026-09-23T05:33:18Z" level=info msg="Tunnel authorizer set Kubelet Port 0.0.0.0:10250" machine # [ 32.543306] k3s[872]: I0923 05:33:18.505630 872 apiserver.go:52] "Watching apiserver" machine # [ 32.638693] k3s[872]: I0923 05:33:18.601119 872 server.go:218] "Successfully retrieved NodeIPs" NodeIPs=["10.0.2.15","fec0::d141:82ed:b650:1ac0"] machine # [ 32.643515] k3s[872]: E0923 05:33:18.601280 872 server.go:255] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`" machine # [ 32.665867] k3s[872]: time="2026-09-23T05:33:18Z" level=info msg="Started tunnel to 10.0.2.15:6443" machine # [ 32.667169] k3s[872]: time="2026-09-23T05:33:18Z" level=info msg="Stopped tunnel to 127.0.0.1:6443" machine # [ 32.668446] k3s[872]: time="2026-09-23T05:33:18Z" level=info msg="Connecting to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 32.670065] k3s[872]: time="2026-09-23T05:33:18Z" level=info msg="Proxy done" err="context canceled" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 32.671813] k3s[872]: time="2026-09-23T05:33:18Z" level=info msg="error in remotedialer server [400]: websocket: close 1006 (abnormal closure): unexpected EOF" machine # [ 32.673728] k3s[872]: time="2026-09-23T05:33:18Z" level=info msg="Handling backend connection request [machine]" machine # [ 32.675268] k3s[872]: time="2026-09-23T05:33:18Z" level=info msg="Connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 32.676827] k3s[872]: time="2026-09-23T05:33:18Z" level=info msg="Remotedialer connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 32.677183] k3s[872]: I0923 05:33:18.633723 872 server.go:264] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4" machine # [ 32.678235] k3s[872]: I0923 05:33:18.633758 872 server_linux.go:136] "Using iptables Proxier" machine # [ 32.680070] k3s[872]: I0923 05:33:18.642480 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a326c871-1c74-4a3f-a563-692f1a9aa632-config-volume\") pod \"coredns-c5fdd76cf-7cq84\" (UID: \"a326c871-1c74-4a3f-a563-692f1a9aa632\") " pod="kube-system/coredns-c5fdd76cf-7cq84" machine # [ 32.681056] k3s[872]: I0923 05:33:18.642620 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-config-volume\" (UniqueName: \"kubernetes.io/configmap/a326c871-1c74-4a3f-a563-692f1a9aa632-custom-config-volume\") pod \"coredns-c5fdd76cf-7cq84\" (UID: \"a326c871-1c74-4a3f-a563-692f1a9aa632\") " pod="kube-system/coredns-c5fdd76cf-7cq84" machine # [ 32.682206] k3s[872]: I0923 05:33:18.642655 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzlwl\" (UniqueName: \"kubernetes.io/projected/a326c871-1c74-4a3f-a563-692f1a9aa632-kube-api-access-kzlwl\") pod \"coredns-c5fdd76cf-7cq84\" (UID: \"a326c871-1c74-4a3f-a563-692f1a9aa632\") " pod="kube-system/coredns-c5fdd76cf-7cq84" machine # [ 32.704704] systemd[1]: Created slice libcontainer container kubepods-burstable-poda326c871_1c74_4a3f_a563_692f1a9aa632.slice. machine # [ 32.713572] k3s[872]: I0923 05:33:18.676125 872 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4" machine # [ 32.725450] systemd[1]: Created slice libcontainer container kubepods-burstable-pod25360217_5176_4928_800d_0e1297f7881d.slice. machine # [ 32.731662] k3s[872]: I0923 05:33:18.694259 872 server.go:529] "Version info" version="v1.35.8+k3s1" machine # [ 32.731942] k3s[872]: I0923 05:33:18.694288 872 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 32.735701] k3s[872]: I0923 05:33:18.698256 872 config.go:200] "Starting service config controller" machine # [ 32.736038] k3s[872]: I0923 05:33:18.698282 872 shared_informer.go:349] "Waiting for caches to sync" controller="service config" machine # [ 32.738084] k3s[872]: I0923 05:33:18.700020 872 config.go:106] "Starting endpoint slice config controller" machine # [ 32.738720] k3s[872]: I0923 05:33:18.700058 872 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config" machine # [ 32.739204] k3s[872]: I0923 05:33:18.700090 872 config.go:403] "Starting serviceCIDR config controller" machine # [ 32.739779] k3s[872]: I0923 05:33:18.700105 872 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config" machine # [ 32.746461] k3s[872]: I0923 05:33:18.709063 872 config.go:309] "Starting node config controller" machine # [ 32.746752] k3s[872]: I0923 05:33:18.709084 872 shared_informer.go:349] "Waiting for caches to sync" controller="node config" machine # [ 32.747618] k3s[872]: I0923 05:33:18.709096 872 shared_informer.go:356] "Caches are synced" controller="node config" machine # [ 32.773825] k3s[872]: I0923 05:33:18.736363 872 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" machine # [ 32.781139] k3s[872]: I0923 05:33:18.742838 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/25360217-5176-4928-800d-0e1297f7881d-klipper-helm\") pod \"helm-install-nix-grpc-farm-m7jhd\" (UID: \"25360217-5176-4928-800d-0e1297f7881d\") " pod="kube-system/helm-install-nix-grpc-farm-m7jhd" machine # [ 32.781434] k3s[872]: I0923 05:33:18.742880 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/25360217-5176-4928-800d-0e1297f7881d-klipper-cache\") pod \"helm-install-nix-grpc-farm-m7jhd\" (UID: \"25360217-5176-4928-800d-0e1297f7881d\") " pod="kube-system/helm-install-nix-grpc-farm-m7jhd" machine # [ 32.781923] k3s[872]: I0923 05:33:18.742905 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/25360217-5176-4928-800d-0e1297f7881d-klipper-config\") pod \"helm-install-nix-grpc-farm-m7jhd\" (UID: \"25360217-5176-4928-800d-0e1297f7881d\") " pod="kube-system/helm-install-nix-grpc-farm-m7jhd" machine # [ 32.782613] k3s[872]: I0923 05:33:18.743010 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"values\" (UniqueName: \"kubernetes.io/projected/25360217-5176-4928-800d-0e1297f7881d-values\") pod \"helm-install-nix-grpc-farm-m7jhd\" (UID: \"25360217-5176-4928-800d-0e1297f7881d\") " pod="kube-system/helm-install-nix-grpc-farm-m7jhd" machine # [ 32.783162] k3s[872]: I0923 05:33:18.743087 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"content\" (UniqueName: \"kubernetes.io/configmap/25360217-5176-4928-800d-0e1297f7881d-content\") pod \"helm-install-nix-grpc-farm-m7jhd\" (UID: \"25360217-5176-4928-800d-0e1297f7881d\") " pod="kube-system/helm-install-nix-grpc-farm-m7jhd" machine # [ 32.783677] k3s[872]: I0923 05:33:18.743117 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h88wv\" (UniqueName: \"kubernetes.io/projected/25360217-5176-4928-800d-0e1297f7881d-kube-api-access-h88wv\") pod \"helm-install-nix-grpc-farm-m7jhd\" (UID: \"25360217-5176-4928-800d-0e1297f7881d\") " pod="kube-system/helm-install-nix-grpc-farm-m7jhd" machine # [ 32.784213] k3s[872]: I0923 05:33:18.743261 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25360217-5176-4928-800d-0e1297f7881d-tmp\") pod \"helm-install-nix-grpc-farm-m7jhd\" (UID: \"25360217-5176-4928-800d-0e1297f7881d\") " pod="kube-system/helm-install-nix-grpc-farm-m7jhd" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 32.853116] k3s[872]: I0923 05:33:18.815702 872 kube.go:163] Node controller sync successful machine # [ 32.853373] k3s[872]: I0923 05:33:18.815796 872 vxlan.go:128] VXLAN config: VNI=1 Port=0 GBP=false Learning=false DirectRouting=false machine # [ 32.856332] k3s[872]: I0923 05:33:18.818886 872 kube.go:704] List of node(machine) annotations: map[string]string{"alpha.kubernetes.io/provided-node-ip":"10.0.2.15,fec0::d141:82ed:b650:1ac0", "k3s.io/hostname":"machine", "k3s.io/internal-ip":"10.0.2.15,fec0::d141:82ed:b650:1ac0", "k3s.io/node-args":"[\"server\",\"--disable\",\"traefik\",\"--disable\",\"metrics-server\",\"--disable\",\"local-storage\",\"--kubelet-arg\",\"eviction-hard=nodefs.available\\u003c1%,imagefs.available\\u003c1%\"]", "k3s.io/node-config-hash":"EFXPOZ7ZWHRCLFNW4X4ZDPFQMSAOP3BLEIN2VE47TDRKQ4UIWKUQ====", "k3s.io/node-env":"{}", "node.alpha.kubernetes.io/ttl":"0", "volumes.kubernetes.io/controller-managed-attach-detach":"true"} machine # [ 32.882270] (udev-worker)[1222]: Network interface NamePolicy= disabled on kernel command line. machine # [ 32.896077] k3s[872]: I0923 05:33:18.857797 872 kube.go:558] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.42.0.0/24] machine # [ 32.897884] k3s[872]: I0923 05:33:18.860469 872 iptables.go:50] Starting flannel in iptables mode... machine # [ 32.898535] k3s[872]: time="2026-09-23T05:33:18Z" level=warning msg="no subnet found for key: FLANNEL_NETWORK in file: /run/flannel/subnet.env" machine # [ 32.899167] k3s[872]: time="2026-09-23T05:33:18Z" level=warning msg="no subnet found for key: FLANNEL_SUBNET in file: /run/flannel/subnet.env" machine # [ 32.899689] k3s[872]: time="2026-09-23T05:33:18Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_NETWORK in file: /run/flannel/subnet.env" machine # [ 32.902615] k3s[872]: time="2026-09-23T05:33:18Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_SUBNET in file: /run/flannel/subnet.env" machine # [ 32.903454] k3s[872]: I0923 05:33:18.860560 872 iptables.go:101] Current network or subnet (10.42.0.0/16, 10.42.0.0/24) is not equal to previous one (0.0.0.0/0, 0.0.0.0/0), trying to recycle old iptables rules machine # [ 32.914740] dhcpcd[694]: flannel.1: IAID 34:1b:b5:42 machine # [ 32.915131] dhcpcd[694]: flannel.1: adding address fe80::f0ab:34ff:fe1b:b542 machine # [ 32.937550] k3s[872]: I0923 05:33:18.900157 872 shared_informer.go:356] "Caches are synced" controller="endpoint slice config" machine # [ 32.944051] k3s[872]: I0923 05:33:18.906610 872 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config" machine # [ 32.951630] k3s[872]: I0923 05:33:18.914229 872 shared_informer.go:356] "Caches are synced" controller="service config" machine # [ 32.953847] k3s[872]: I0923 05:33:18.916456 872 iptables.go:111] Setting up masking rules machine # [ 32.959792] dhcpcd[694]: flannel.1: soliciting a DHCP lease machine # [ 32.969836] k3s[872]: I0923 05:33:18.932376 872 iptables.go:212] Changing default FORWARD chain policy to ACCEPT machine # [ 32.982794] k3s[872]: time="2026-09-23T05:33:18Z" level=info msg="Wrote flannel subnet file to /run/flannel/subnet.env" machine # [ 32.983183] k3s[872]: time="2026-09-23T05:33:18Z" level=info msg="Running flannel backend" machine # [ 32.983866] k3s[872]: I0923 05:33:18.945442 872 vxlan_network.go:68] watching for new subnet leases machine # [ 32.984659] k3s[872]: I0923 05:33:18.945467 872 vxlan_network.go:115] starting vxlan device watcher machine # [ 33.035691] k3s[872]: I0923 05:33:18.998027 872 iptables.go:358] bootstrap done machine # [ 33.092881] (udev-worker)[1312]: Network interface NamePolicy= disabled on kernel command line. machine # [ 33.095665] k3s[872]: I0923 05:33:19.058225 872 iptables.go:358] bootstrap done machine # [ 33.264529] cni0: port 1(vethf381a3ea) entered blocking state machine # [ 33.111258] (udev-worker)[143[ 33.265596] cni0: port 1(vethf381a3ea) entered disabled state machine # 4]: Network interface NamePolicy[ 33.266635] vethf381a3ea: entered allmulticast mode machine # = disabled on kernel command lin[ 33.267587] vethf381a3ea: entered promiscuous mode machine # e. machine # [ 33.269121] cni0: port 2(veth25de2890) entered blocking state machine # [ 33.269976] cni0: port 2(veth25de2890) entered disabled state machine # [ 33.271646] veth25de2890: entered allmulticast mode machine # [ 33.272484] veth25de2890: entered promiscuous mode machine # [ 33.285573] cni0: port 2(veth25de2890) entered blocking state machine # [ 33.286300] cni0: port 2(veth25de2890) entered forwarding state machine # [ 33.288033] cni0: port 1(vethf381a3ea) entered blocking state machine # [ 33.288807] cni0: port 1(vethf381a3ea) entered forwarding state machine # [ 33.162433] dhcpcd[694]: vethf381a3ea: waiting for carrier machine # [ 33.175256] dhcpcd[694]: veth25de2890: IAID 42:e6:fc:6f machine # [ 33.175743] dhcpcd[694]: veth25de2890: adding address fe80::848b:42ff:fee6:fc6f machine # [ 33.177205] dhcpcd[694]: vethf381a3ea: carrier acquired machine # [ 33.188586] dhcpcd[694]: vethf381a3ea: IAID ba:1c:85:ab machine # [ 33.188966] dhcpcd[694]: vethf381a3ea: adding address fe80::543f:baff:fe1c:85ab machine # [ 33.314771] systemd[1]: Started libcontainer container 141f4f1183d66f5cd5a0911569c4a8b2eaa46335afd42abd485ac4ef57f77372. machine # [ 33.330332] systemd[1]: Started libcontainer container 22e7bdb81d8f8b712f9325690faa0af18f8e70e87b0e705108b3ad151d8ec7a9. machine # [ 33.994115] k3s[872]: time="2026-09-23T05:33:19Z" level=info msg="Starting network policy controller version v2.6.3-k3s1, built on 1970-01-01T01:01:01Z, go1.26.7" machine # [ 33.996323] k3s[872]: I0923 05:33:19.956618 872 network_policy_controller.go:164] Starting network policy controller machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 34.239500] k3s[872]: I0923 05:33:20.201314 872 network_policy_controller.go:179] Starting network policy controller full sync goroutine machine # [ 34.350818] systemd[1]: Started libcontainer container 80564644c170354669ef7781cbddcc1269a3becce64e1428a63cb5b747e481d3. machine # [ 34.541761] dhcpcd[694]: vethf381a3ea: soliciting a DHCP lease machine # [ 34.597487] systemd[1]: Started libcontainer container 884db89d696fc34895552bb6d063b5fab878b24584c719b00152a2762c63735d. machine # [ 34.647868] dhcpcd[694]: vethf381a3ea: soliciting an IPv6 router machine # [ 34.774194] k3s[872]: I0923 05:33:20.736729 872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/helm-install-nix-grpc-farm-m7jhd" podStartSLOduration=6.736711087 podStartE2EDuration="6.736711087s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-23 05:33:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-23 05:33:20.736361322 +0000 UTC m=+19.330784498" watchObservedRunningTime="2026-09-23 05:33:20.736711087 +0000 UTC m=+19.331134542" machine # [ 34.949468] dhcpcd[694]: veth25de2890: soliciting a DHCP lease machine # [ 35.074525] dhcpcd[694]: flannel.1: soliciting an IPv6 router machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 35.767499] dhcpcd[694]: veth25de2890: soliciting an IPv6 router machine # [ 36.005439] k3s[872]: I0923 05:33:21.966297 872 alloc.go:329] "allocated clusterIPs" service="farm/nix-grpc-farm" clusterIPs={"IPv4":"10.43.214.138"} machine # [ 36.060846] systemd[1]: cri-containerd-884db89d696fc34895552bb6d063b5fab878b24584c719b00152a2762c63735d.scope: Deactivated successfully. machine # [ 36.062784] systemd[1]: cri-containerd-884db89d696fc34895552bb6d063b5fab878b24584c719b00152a2762c63735d.scope: Consumed 603ms CPU time over 1.461s wall clock time, 30.7M memory peak, 2.4M incoming IP traffic, 145K outgoing IP traffic. machine # [ 36.106711] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-884db89d696fc34895552bb6d063b5fab878b24584c719b00152a2762c63735d-rootfs.mount: Deactivated successfully. machine # [ 36.277633] k3s[872]: time="2026-09-23T05:33:22Z" level=info msg="Imported docker.io/library/nix-grpc-farm:0.1.0-beta.3" machine # [ 36.282849] k3s[872]: time="2026-09-23T05:33:22Z" level=info msg="Tagged docker.io/library/nix-grpc-farm@sha256:2209224ca40b6eddf6bc032b8f59edd4719a8a9ae876cba280087eef3f1a9764" machine # [ 36.593047] k3s[872]: time="2026-09-23T05:33:22Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm.tar in 5.526487583s" machine # [ 36.703546] k3s[872]: I0923 05:33:22.665942 872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/coredns-c5fdd76cf-7cq84" podStartSLOduration=9.665902646 podStartE2EDuration="9.665902646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-23 05:33:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-23 05:33:20.752436549 +0000 UTC m=+19.346859725" watchObservedRunningTime="2026-09-23 05:33:22.665902646 +0000 UTC m=+21.260328336" machine # [ 36.735096] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod37b2e518_f771_4af6_b55e_f5458fcf0f45.slice. machine # [ 36.749561] k3s[872]: I0923 05:33:22.712136 872 node_lifecycle_controller.go:1234] "Initializing eviction metric for zone" zone="" machine # [ 36.749722] k3s[872]: I0923 05:33:22.712231 872 node_lifecycle_controller.go:886] "Missing timestamp for Node. Assuming now as a timestamp" node="machine" machine # [ 36.750440] k3s[872]: I0923 05:33:22.712293 872 node_lifecycle_controller.go:1080] "Controller detected that zone is now in new state" zone="" newState="Normal" machine # [ 36.753479] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod5f1333ce_7689_407b_b56c_677fc2cc48c1.slice. machine # [ 36.771793] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod52148980_ad1f_4e39_a816_13214b0f4423.slice. machine # [ 36.778466] systemd[1]: Created slice libcontainer container kubepods-besteffort-podf004191e_9473_4698_ab15_6b5c00fc331f.slice. machine # [ 36.818893] k3s[872]: I0923 05:33:22.781483 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f004191e-9473-4698-ab15-6b5c00fc331f-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-n8tvr\" (UID: \"f004191e-9473-4698-ab15-6b5c00fc331f\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-n8tvr" machine # [ 36.819113] k3s[872]: I0923 05:33:22.781571 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/37b2e518-f771-4af6-b55e-f5458fcf0f45-tls\") pod \"nix-grpc-farm-scheduler-887c9b678-z7kmp\" (UID: \"37b2e518-f771-4af6-b55e-f5458fcf0f45\") " pod="farm/nix-grpc-farm-scheduler-887c9b678-z7kmp" machine # [ 36.819529] k3s[872]: I0923 05:33:22.781602 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-558xb\" (UniqueName: \"kubernetes.io/projected/37b2e518-f771-4af6-b55e-f5458fcf0f45-kube-api-access-558xb\") pod \"nix-grpc-farm-scheduler-887c9b678-z7kmp\" (UID: \"37b2e518-f771-4af6-b55e-f5458fcf0f45\") " pod="farm/nix-grpc-farm-scheduler-887c9b678-z7kmp" machine # [ 36.820092] k3s[872]: I0923 05:33:22.781629 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/52148980-ad1f-4e39-a816-13214b0f4423-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-74qhn\" (UID: \"52148980-ad1f-4e39-a816-13214b0f4423\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-74qhn" machine # [ 36.820566] k3s[872]: I0923 05:33:22.781657 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/f004191e-9473-4698-ab15-6b5c00fc331f-build\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-n8tvr\" (UID: \"f004191e-9473-4698-ab15-6b5c00fc331f\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-n8tvr" machine # [ 36.821192] k3s[872]: I0923 05:33:22.782189 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/37b2e518-f771-4af6-b55e-f5458fcf0f45-ca\") pod \"nix-grpc-farm-scheduler-887c9b678-z7kmp\" (UID: \"37b2e518-f771-4af6-b55e-f5458fcf0f45\") " pod="farm/nix-grpc-farm-scheduler-887c9b678-z7kmp" machine # [ 36.821645] k3s[872]: I0923 05:33:22.782285 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/f004191e-9473-4698-ab15-6b5c00fc331f-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-n8tvr\" (UID: \"f004191e-9473-4698-ab15-6b5c00fc331f\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-n8tvr" machine # [ 36.822234] k3s[872]: I0923 05:33:22.782314 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/f004191e-9473-4698-ab15-6b5c00fc331f-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-n8tvr\" (UID: \"f004191e-9473-4698-ab15-6b5c00fc331f\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-n8tvr" machine # [ 36.822739] k3s[872]: I0923 05:33:22.782395 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/52148980-ad1f-4e39-a816-13214b0f4423-build\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-74qhn\" (UID: \"52148980-ad1f-4e39-a816-13214b0f4423\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-74qhn" machine # [ 36.823482] k3s[872]: I0923 05:33:22.782452 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/52148980-ad1f-4e39-a816-13214b0f4423-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-74qhn\" (UID: \"52148980-ad1f-4e39-a816-13214b0f4423\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-74qhn" machine # [ 36.823929] k3s[872]: I0923 05:33:22.782476 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/f004191e-9473-4698-ab15-6b5c00fc331f-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-n8tvr\" (UID: \"f004191e-9473-4698-ab15-6b5c00fc331f\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-n8tvr" machine # [ 36.824632] k3s[872]: I0923 05:33:22.782546 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/52148980-ad1f-4e39-a816-13214b0f4423-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-74qhn\" (UID: \"52148980-ad1f-4e39-a816-13214b0f4423\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-74qhn" machine # [ 36.828573] k3s[872]: I0923 05:33:22.782571 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/52148980-ad1f-4e39-a816-13214b0f4423-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-74qhn\" (UID: \"52148980-ad1f-4e39-a816-13214b0f4423\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-74qhn" machine # [ 36.832750] k3s[872]: I0923 05:33:22.782595 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/f004191e-9473-4698-ab15-6b5c00fc331f-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-n8tvr\" (UID: \"f004191e-9473-4698-ab15-6b5c00fc331f\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-n8tvr" machine # [ 36.837456] k3s[872]: I0923 05:33:22.782620 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spzwb\" (UniqueName: \"kubernetes.io/projected/f004191e-9473-4698-ab15-6b5c00fc331f-kube-api-access-spzwb\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-n8tvr\" (UID: \"f004191e-9473-4698-ab15-6b5c00fc331f\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-n8tvr" machine # [ 36.881648] k3s[872]: I0923 05:33:22.782722 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5f1333ce-7689-407b-b56c-677fc2cc48c1-config\") pod \"nix-grpc-farm-lb-85f6f9c7c8-8wz9l\" (UID: \"5f1333ce-7689-407b-b56c-677fc2cc48c1\") " pod="farm/nix-grpc-farm-lb-85f6f9c7c8-8wz9l" machine # [ 36.882456] k3s[872]: I0923 05:33:22.782759 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/f004191e-9473-4698-ab15-6b5c00fc331f-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-n8tvr\" (UID: \"f004191e-9473-4698-ab15-6b5c00fc331f\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-n8tvr" machine # [ 36.882955] k3s[872]: I0923 05:33:22.782783 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/37b2e518-f771-4af6-b55e-f5458fcf0f45-oidc\") pod \"nix-grpc-farm-scheduler-887c9b678-z7kmp\" (UID: \"37b2e518-f771-4af6-b55e-f5458fcf0f45\") " pod="farm/nix-grpc-farm-scheduler-887c9b678-z7kmp" machine # [ 36.883663] k3s[872]: I0923 05:33:22.782808 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f1333ce-7689-407b-b56c-677fc2cc48c1-tmp\") pod \"nix-grpc-farm-lb-85f6f9c7c8-8wz9l\" (UID: \"5f1333ce-7689-407b-b56c-677fc2cc48c1\") " pod="farm/nix-grpc-farm-lb-85f6f9c7c8-8wz9l" machine # [ 36.884195] k3s[872]: I0923 05:33:22.782833 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/52148980-ad1f-4e39-a816-13214b0f4423-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-74qhn\" (UID: \"52148980-ad1f-4e39-a816-13214b0f4423\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-74qhn" machine # [ 36.884672] k3s[872]: I0923 05:33:22.783099 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/37b2e518-f771-4af6-b55e-f5458fcf0f45-niks3-token\") pod \"nix-grpc-farm-scheduler-887c9b678-z7kmp\" (UID: \"37b2e518-f771-4af6-b55e-f5458fcf0f45\") " pod="farm/nix-grpc-farm-scheduler-887c9b678-z7kmp" machine # [ 36.885305] k3s[872]: I0923 05:33:22.783165 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/5f1333ce-7689-407b-b56c-677fc2cc48c1-tls-lb\") pod \"nix-grpc-farm-lb-85f6f9c7c8-8wz9l\" (UID: \"5f1333ce-7689-407b-b56c-677fc2cc48c1\") " pod="farm/nix-grpc-farm-lb-85f6f9c7c8-8wz9l" machine # [ 36.885741] k3s[872]: I0923 05:33:22.783189 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/5f1333ce-7689-407b-b56c-677fc2cc48c1-tls-ca\") pod \"nix-grpc-farm-lb-85f6f9c7c8-8wz9l\" (UID: \"5f1333ce-7689-407b-b56c-677fc2cc48c1\") " pod="farm/nix-grpc-farm-lb-85f6f9c7c8-8wz9l" machine # [ 36.886487] k3s[872]: I0923 05:33:22.783243 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/52148980-ad1f-4e39-a816-13214b0f4423-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-74qhn\" (UID: \"52148980-ad1f-4e39-a816-13214b0f4423\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-74qhn" machine # [ 36.887079] k3s[872]: I0923 05:33:22.783268 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdg9f\" (UniqueName: \"kubernetes.io/projected/52148980-ad1f-4e39-a816-13214b0f4423-kube-api-access-pdg9f\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-74qhn\" (UID: \"52148980-ad1f-4e39-a816-13214b0f4423\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-74qhn" machine # [ 37.903702] cni0: port 3(veth4942924a) entered blocking state machine # [ 37.750535] ([ 37.905711] cni0: port 3(veth4942924a) entered disabled state machine # udev-worker)[201[ 37.907549] veth4942924a: entered allmulticast mode machine # 1]: Network interface NamePolicy[ 37.909465] veth4942924a: entered promiscuous mode machine # = disabled on kernel command line. machine # [ 37.925686] cni0: port 3(veth4942924a) entered blocking state machine # [ 37.926975] cni0: port 3(veth4942924a) entered forwarding state machine # [ 37.798091] systemd[1]: cri-containerd-22e7bdb81d8f8b712f9325690faa0af18f8e70e87b0e705108b3ad151d8ec7a9.scope: Deactivated successfully. machine # [ 37.801706] dhcpcd[694]: veth4942924a: IAID e3:b0:77:8e machine # [ 37.805440] dhcpcd[694]: veth4942924a: adding address fe80::7898:e3ff:feb0:778e machine # [ 37.883535] systemd[1]: Started libcontainer container da97c0a56508d3e8b4b471928cc82d2fede45928a615b08b878921ca40db609c. machine # [ 38.050364] cni0: port 2(veth25de2890) entered disabled state machine # [ 37.897218] dhcpcd[694]: veth25de2890: carrier lost machine # [ 38.052175] veth25de2890 (unregistering): left allmulticast mode machine # [ 38.052967] veth25de2890 (unregistering): left promiscuous mode machine # [ 38.053899] cni0: port 2(veth25de2890) entered disabled state machine # [ 37.930929] dhcpcd[694]: veth25de2890: deleting address fe80::848b:42ff:fee6:fc6f machine # [ 37.967257] dhcpcd[694]: flannel.1: probing for an IPv4LL address machine # [ 37.972585] dhcpcd[694]: veth25de2890: removing interface machine # [ 37.987697] (udev-worker)[2075]: Network interface NamePolicy= disabled on kernel command line. machine # [ 38.142484] cni0: port 2(vethd8726c78) entered blocking state machine # [ 38.143750] cni0: port 2(vethd8726c78) entered disabled state machine # [ 38.144739] vethd8726c78: entered allmulticast mode machine # [ 38.145526] vethd8726c78: entered promiscuous mode machine # [ 38.156654] cni0: port 2(vethd8726c78) entered blocking state machine # [ 38.157345] cni0: port 2(vethd8726c78) entered forwarding state machine # [ 38.169453] cni0: port 4(vethe89cfee7) entered blocking state machine # [ 38.170381] cni0: port 4(vethe89cfee7) entered disabled state machine # [ 38.171125] vethe89cfee7: entered allmulticast mode machine # [ 38.171907] vethe89cfee7: entered promiscuous mode machine # [ 38.180938] cni0: port 4(vethe89cfee7) entered blocking state machine # [ 38.181714] cni0: port 4(vethe89cfee7) entered forwarding state machine # [ 38.033338] k3s[872]: I0923 05:33:23.994517 872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/25360217-5176-4928-800d-0e1297f7881d-klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/25360217-5176-4928-800d-0e1297f7881d-klipper-helm\") pod \"25360217-5176-4928-800d-0e1297f7881d\" (UID: \"25360217-5176-4928-800d-0e1297f7881d\") " machine # [ 38.033497] k3s[872]: I0923 05:33:23.995360 872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/25360217-5176-4928-800d-0e1297f7881d-klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/25360217-5176-4928-800d-0e1297f7881d-klipper-cache\") pod \"25360217-5176-4928-800d-0e1297f7881d\" (UID: \"25360217-5176-4928-800d-0e1297f7881d\") " machine # [ 38.033947] k3s[872]: I0923 05:33:23.995395 872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/25360217-5176-4928-800d-0e1297f7881d-values\" (UniqueName: \"kubernetes.io/projected/25360217-5176-4928-800d-0e1297f7881d-values\") pod \"25360217-5176-4928-800d-0e1297f7881d\" (UID: \"25360217-5176-4928-800d-0e1297f7881d\") " machine # [ 38.034611] k3s[872]: I0923 05:33:23.995438 872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/25360217-5176-4928-800d-0e1297f7881d-tmp\" (UniqueName: \"kubernetes.io/empty-dir/25360217-5176-4928-800d-0e1297f7881d-tmp\") pod \"25360217-5176-4928-800d-0e1297f7881d\" (UID: \"25360217-5176-4928-800d-0e1297f7881d\") " machine # [ 38.035195] k3s[872]: I0923 05:33:23.995469 872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/25360217-5176-4928-800d-0e1297f7881d-kube-api-access-h88wv\" (UniqueName: \"kubernetes.io/projected/25360217-5176-4928-800d-0e1297f7881d-kube-api-access-h88wv\") pod \"25360217-5176-4928-800d-0e1297f7881d\" (UID: \"25360217-5176-4928-800d-0e1297f7881d\") " machine # [ 38.035811] k3s[872]: I0923 05:33:23.995502 872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/25360217-5176-4928-800d-0e1297f7881d-content\" (UniqueName: \"kubernetes.io/configmap/25360217-5176-4928-800d-0e1297f7881d-content\") pod \"25360217-5176-4928-800d-0e1297f7881d\" (UID: \"25360217-5176-4928-800d-0e1297f7881d\") " machine # [ 38.050624] k3s[872]: I0923 05:33:23.995535 872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/25360217-5176-4928-800d-0e1297f7881d-klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/25360217-5176-4928-800d-0e1297f7881d-klipper-config\") pod \"25360217-5176-4928-800d-0e1297f7881d\" (UID: \"25360217-5176-4928-800d-0e1297f7881d\") " machine # [ 38.051619] k3s[872]: I0923 05:33:23.998471 872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25360217-5176-4928-800d-0e1297f7881d-content" pod "25360217-5176-4928-800d-0e1297f7881d" (UID: "25360217-5176-4928-800d-0e1297f7881d"). InnerVolumeSpecName "content". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 38.066801] dhcpcd[694]: vethd8726c78: waiting for carrier machine # [ 38.067079] k3s[872]: I0923 05:33:24.029057 872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25360217-5176-4928-800d-0e1297f7881d-tmp" pod "25360217-5176-4928-800d-0e1297f7881d" (UID: "25360217-5176-4928-800d-0e1297f7881d"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 38.067629] k3s[872]: I0923 05:33:24.029276 872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25360217-5176-4928-800d-0e1297f7881d-kube-api-access-h88wv" pod "25360217-5176-4928-800d-0e1297f7881d" (UID: "25360217-5176-4928-800d-0e1297f7881d"). InnerVolumeSpecName "kube-api-access-h88wv". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 38.079837] k3s[872]: I0923 05:33:24.042392 872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25360217-5176-4928-800d-0e1297f7881d-klipper-helm" pod "25360217-5176-4928-800d-0e1297f7881d" (UID: "25360217-5176-4928-800d-0e1297f7881d"). InnerVolumeSpecName "klipper-helm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 38.085256] k3s[872]: I0923 05:33:24.047722 872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25360217-5176-4928-800d-0e1297f7881d-klipper-config" pod "25360217-5176-4928-800d-0e1297f7881d" (UID: "25360217-5176-4928-800d-0e1297f7881d"). InnerVolumeSpecName "klipper-config". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 38.089145] dhcpcd[694]: vethe89cfee7: IAID 12:12:31:9e machine # [ 38.089816] dhcpcd[694]: vethe89cfee7: adding address fe80::e07e:12ff:fe12:319e machine # [ 38.090822] dhcpcd[694]: vethd8726c78: carrier acquired machine # [ 38.093362] k3s[872]: I0923 05:33:24.055939 872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25360217-5176-4928-800d-0e1297f7881d-values" pod "25360217-5176-4928-800d-0e1297f7881d" (UID: "25360217-5176-4928-800d-0e1297f7881d"). InnerVolumeSpecName "values". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 38.096980] dhcpcd[694]: vethd8726c78: IAID 9f:63:54:72 machine # [ 38.097635] dhcpcd[694]: vethd8726c78: adding address fe80::703e:9fff:fe63:5472 machine # [ 38.098443] dhcpcd[694]: vethe89cfee7: old hardware address: e2:7e:12:12:31:9e machine # [ 38.099083] dhcpcd[694]: vethe89cfee7: new hardware address: 8a:45:84:fc:64:96 machine # [ 38.099675] dhcpcd[694]: vethe89cfee7: carrier lost machine # [ 38.103133] k3s[872]: I0923 05:33:24.065706 872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25360217-5176-4928-800d-0e1297f7881d-klipper-cache" pod "25360217-5176-4928-800d-0e1297f7881d" (UID: "25360217-5176-4928-800d-0e1297f7881d"). InnerVolumeSpecName "klipper-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 38.114330] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-22e7bdb81d8f8b712f9325690faa0af18f8e70e87b0e705108b3ad151d8ec7a9-rootfs.mount: Deactivated successfully. machine # [ 38.117305] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-22e7bdb81d8f8b712f9325690faa0af18f8e70e87b0e705108b3ad151d8ec7a9-shm.mount: Deactivated successfully. machine # [ 38.117774] systemd[1]: run-netns-cni\x2df79ea632\x2da627\x2d5ce4\x2d9034\x2d36c7c627f6e5.mount: Deactivated successfully. machine # [ 38.118505] systemd[1]: var-lib-kubelet-pods-25360217\x2d5176\x2d4928\x2d800d\x2d0e1297f7881d-volumes-kubernetes.io\x7eprojected-values.mount: Deactivated successfully. machine # [ 38.119026] systemd[1]: var-lib-kubelet-pods-25360217\x2d5176\x2d4928\x2d800d\x2d0e1297f7881d-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dh88wv.mount: Deactivated successfully. machine # [ 38.119631] systemd[1]: var-lib-kubelet-pods-25360217\x2d5176\x2d4928\x2d800d\x2d0e1297f7881d-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 38.120799] systemd[1]: var-lib-kubelet-pods-25360217\x2d5176\x2d4928\x2d800d\x2d0e1297f7881d-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dhelm.mount: Deactivated successfully. machine # [ 38.121711] systemd[1]: var-lib-kubelet-pods-25360217\x2d5176\x2d4928\x2d800d\x2d0e1297f7881d-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dconfig.mount: Deactivated successfully. machine # [ 38.123419] systemd[1]: var-lib-kubelet-pods-25360217\x2d5176\x2d4928\x2d800d\x2d0e1297f7881d-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dcache.mount: Deactivated successfully. machine # [ 38.130403] dhcpcd[694]: vethe89cfee7: deleting address fe80::e07e:12ff:fe12:319e machine # [ 38.131345] dhcpcd[694]: vethe89cfee7: old hardware address: 8a:45:84:fc:64:96 machine # [ 38.131831] dhcpcd[694]: vethe89cfee7: new hardware address: e2:7e:12:12:31:9e machine # [ 38.132199] dhcpcd[694]: vethe89cfee7: carrier acquired machine # [ 38.138411] k3s[872]: I0923 05:33:24.100990 872 reconciler_common.go:299] "Volume detached for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/25360217-5176-4928-800d-0e1297f7881d-klipper-config\") on node \"machine\" DevicePath \"\"" machine # [ 38.138699] k3s[872]: I0923 05:33:24.101039 872 reconciler_common.go:299] "Volume detached for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/25360217-5176-4928-800d-0e1297f7881d-klipper-helm\") on node \"machine\" DevicePath \"\"" machine # [ 38.139448] k3s[872]: I0923 05:33:24.101054 872 reconciler_common.go:299] "Volume detached for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/25360217-5176-4928-800d-0e1297f7881d-klipper-cache\") on node \"machine\" DevicePath \"\"" machine # [ 38.139960] k3s[872]: I0923 05:33:24.101069 872 reconciler_common.go:299] "Volume detached for volume \"values\" (UniqueName: \"kubernetes.io/projected/25360217-5176-4928-800d-0e1297f7881d-values\") on node \"machine\" DevicePath \"\"" machine # [ 38.140772] k3s[872]: I0923 05:33:24.101084 872 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25360217-5176-4928-800d-0e1297f7881d-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 38.141557] k3s[872]: I0923 05:33:24.101101 872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h88wv\" (UniqueName: \"kubernetes.io/projected/25360217-5176-4928-800d-0e1297f7881d-kube-api-access-h88wv\") on node \"machine\" DevicePath \"\"" machine # [ 38.142158] dhcpcd[694]: vethe89cfee7: IAID 12:12:31:9e machine # [ 38.142641] dhcpcd[694]: vethe89cfee7: adding address fe80::e07e:12ff:fe12:319e machine # [ 38.157509] k3s[872]: I0923 05:33:24.120070 872 reconciler_common.go:299] "Volume detached for volume \"content\" (UniqueName: \"kubernetes.io/configmap/25360217-5176-4928-800d-0e1297f7881d-content\") on node \"machine\" DevicePath \"\"" machine # [ 38.314754] cni0: port 5(veth147d15e1) entered blocking state machine # [ 38.316919] cni0: port 5(veth147d15e1) entered disabled state machine # [ 38.318774] veth147d15e1: entered allmulticast mode machine # [ 38.319629] veth147d15e1: entered promiscuous mode machine # [ 38.336554] cni0: port 5(veth147d15e1) entered blocking state machine # [ 38.337372] cni0: port 5(veth147d15e1) entered forwarding state machine # [ 38.198701] dhcpcd[694]: veth147d15e1: waiting for carrier machine # [ 38.199471] dhcpcd[694]: veth147d15e1: carrier acquired machine # [ 38.202784] systemd[1]: Started libcontainer container ba35850e1b05b71b52691dae7123750a002cc0b817f8a697c39b4d78e70cda9e. machine # [ 38.205817] dhcpcd[694]: veth147d15e1: IAID bc:46:50:d9 machine # [ 38.206229] dhcpcd[694]: veth147d15e1: adding address fe80::b8ea:bcff:fe46:50d9 machine # [ 38.247483] systemd[1]: Started libcontainer container f7e2c344f2afa439b553e15f37c455909119dcba68c94bf8827c3f8a7b16d853. machine # [ 38.352496] systemd[1]: Started libcontainer container bd5ffe6072c0919fcee4e99be63d39ca7d898a9e49677313dc8b1852885eb062. machine # [ 38.354638] dhcpcd[694]: veth4942924a: soliciting a DHCP lease machine # [ 38.537539] dhcpcd[694]: veth147d15e1: soliciting a DHCP lease machine # [ 38.738908] dhcpcd[694]: vethd8726c78: soliciting a DHCP lease machine # [ 38.787188] k3s[872]: I0923 05:33:24.748706 872 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="22e7bdb81d8f8b712f9325690faa0af18f8e70e87b0e705108b3ad151d8ec7a9" machine # [ 38.797643] systemd[1]: Removed slice libcontainer container kubepods-burstable-pod25360217_5176_4928_800d_0e1297f7881d.slice. machine # [ 38.798822] systemd[1]: kubepods-burstable-pod25360217_5176_4928_800d_0e1297f7881d.slice: Consumed 636ms CPU time over 6.071s wall clock time, 31M memory peak, 2.4M incoming IP traffic, 145K outgoing IP traffic. machine # [ 39.071870] dhcpcd[694]: vethe89cfee7: soliciting a DHCP lease machine # [ 39.352723] dhcpcd[694]: vethd8726c78: soliciting an IPv6 router machine # [ 39.469312] systemd[1]: Started libcontainer container cfbe2cb5ca7849e859e8f2d25b1b93d1523155fce6f0ec453c23696d01b16477. machine # [ 39.542611] dhcpcd[694]: vethf381a3ea: probing for an IPv4LL address machine # [ 39.721545] dhcpcd[694]: vethe89cfee7: soliciting an IPv6 router machine # [ 39.767794] dhcpcd[694]: veth4942924a: soliciting an IPv6 router machine # [ 39.817615] k3s[872]: I0923 05:33:25.779738 872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-85f6f9c7c8-8wz9l" podStartSLOduration=3.779716831 podStartE2EDuration="3.779716831s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-23 05:33:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-23 05:33:25.779399752 +0000 UTC m=+24.373822928" watchObservedRunningTime="2026-09-23 05:33:25.779716831 +0000 UTC m=+24.374140008" machine # [ 40.366555] dhcpcd[694]: veth147d15e1: soliciting an IPv6 router machine # [ 43.184657] dhcpcd[694]: flannel.1: using IPv4LL address 169.254.99.174 machine # [ 43.185146] dhcpcd[694]: flannel.1: adding route to 169.254.0.0/16 machine # [ 43.355883] dhcpcd[694]: veth4942924a: probing for an IPv4LL address machine # [ 43.538927] dhcpcd[694]: veth147d15e1: probing for an IPv4LL address machine # [ 43.598919] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped2483437668.mount: Deactivated successfully. machine # [ 43.620782] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped3903538165.mount: Deactivated successfully. machine # [ 43.706316] systemd[1]: Started libcontainer container 5aa6b75cbe7e653b55761835b76b7f7ce652201ed3b99a832d14b5fd3580667b. machine # [ 43.739845] dhcpcd[694]: vethd8726c78: probing for an IPv4LL address machine # [ 43.745337] systemd[1]: Started libcontainer container af416d6737b463a3ddc319df133960fea0d37f0be0ced458f6d3710f0676a8c5. machine # [ 43.853457] k3s[872]: I0923 05:33:29.814566 872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-scheduler-887c9b678-z7kmp" podStartSLOduration=7.814543603 podStartE2EDuration="7.814543603s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-23 05:33:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-23 05:33:29.796082598 +0000 UTC m=+28.390505774" watchObservedRunningTime="2026-09-23 05:33:29.814543603 +0000 UTC m=+28.408966500" machine # [ 43.934379] systemd[1]: Started libcontainer container 975d18caeb021b71cc56bbb0346c615223029eb376102db6fedea00261d36b69. machine # [ 44.039502] niks3-server[1171]: 2026/09/23 05:33:30 INFO lead: acquired remote=10.42.0.5:39946 machine # [ 44.072534] dhcpcd[694]: vethe89cfee7: probing for an IPv4LL address machine # [ 44.593811] systemd[1]: tmp-ovl\x2didmapped2620280367.mount: Deactivated successfully. machine # [ 44.792548] dhcpcd[694]: vethf381a3ea: using IPv4LL address 169.254.174.180 machine # [ 44.792759] dhcpcd[694]: vethf381a3ea: adding route to 169.254.0.0/16 machine # [ 45.365535] systemd[1]: cri-containerd-5aa6b75cbe7e653b55761835b76b7f7ce652201ed3b99a832d14b5fd3580667b.scope: Deactivated successfully. machine # [ 45.370148] systemd[1]: cri-containerd-5aa6b75cbe7e653b55761835b76b7f7ce652201ed3b99a832d14b5fd3580667b.scope: Consumed 652ms CPU time over 1.658s wall clock time, 383.4M memory peak, 120.5M read from disk, 160.6M written to disk. machine # [ 45.373489] systemd[1]: cri-containerd-975d18caeb021b71cc56bbb0346c615223029eb376102db6fedea00261d36b69.scope: Deactivated successfully. machine # [ 45.375518] systemd[1]: cri-containerd-975d18caeb021b71cc56bbb0346c615223029eb376102db6fedea00261d36b69.scope: Consumed 611ms CPU time over 1.439s wall clock time, 359.1M memory peak, 75.1M read from disk, 174.9M written to disk. machine # [ 45.432849] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-5aa6b75cbe7e653b55761835b76b7f7ce652201ed3b99a832d14b5fd3580667b-rootfs.mount: Deactivated successfully. machine # [ 45.435045] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-975d18caeb021b71cc56bbb0346c615223029eb376102db6fedea00261d36b69-rootfs.mount: Deactivated successfully. machine # [ 45.973916] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped3489676759.mount: Deactivated successfully. machine # [ 46.149331] systemd[1]: Started libcontainer container e1c5032f23f6a4b856448bdd018d9a1cf6eb84f1a7a5f14de854417f7cf0a8c4. machine # [ 46.150326] systemd[1]: Started libcontainer container f43b5b6eba78de0c3f8121cd8193af8cc6c0da3eb11a57a83f4498309a12e1f9. machine # [ 46.285200] systemd[1]: Started libcontainer container bca702cb0036fe8ad5bf0551862604e721525fc75ae8b7f38fcf4be9b49e32ec. machine # error: timed out waiting for the condition machine # [ 46.394340] systemd[1]: Started libcontainer container f87789b09e516d119852ee73d3fd8662ad994882eb039339d166a30436eeef74. machine # [ 46.468453] systemd[1]: Started libcontainer container 66307a32c11e1e6dafabaeca2984926087e9ae738ee4c3eef5a561e1e16e13a1. machine # [ 46.548501] systemd[1]: Started libcontainer container d8b491355405c3b6a2a5acd0d04ca3bebc943917bac3c3d9eb6be3cddc94a855. machine # [ 46.652587] dhcpcd[694]: vethf381a3ea: no IPv6 Routers available machine # [ 46.880964] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount1828455913.mount: Deactivated successfully. machine # [ 46.882279] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped2395694102.mount: Deactivated successfully. machine # [ 46.883421] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount1401820376.mount: Deactivated successfully. machine # [ 46.923121] k3s[872]: I0923 05:33:32.884957 872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-n8tvr" podStartSLOduration=9.256120116 podStartE2EDuration="10.884915117s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.628795001s" isStatefulPod=false podCreationTimestamp="2026-09-23 05:33:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-23 05:33:32.863087203 +0000 UTC m=+31.457515128" watchObservedRunningTime="2026-09-23 05:33:32.884915117 +0000 UTC m=+31.479342484" machine # [ 47.077294] dhcpcd[694]: flannel.1: no IPv6 Routers available machine # [ 47.709111] k3s[872]: I0923 05:33:33.671455 872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-74qhn" podStartSLOduration=10.255618936 podStartE2EDuration="11.671415077s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.415796141s" isStatefulPod=false podCreationTimestamp="2026-09-23 05:33:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-23 05:33:32.886813961 +0000 UTC m=+31.481241049" watchObservedRunningTime="2026-09-23 05:33:33.671415077 +0000 UTC m=+32.265842444" machine # [ 47.946679] dhcpcd[694]: vethd8726c78: using IPv4LL address 169.254.182.116 machine # [ 47.947309] dhcpcd[694]: vethd8726c78: adding route to 169.254.0.0/16 machine # [ 48.188181] dhcpcd[694]: veth4942924a: using IPv4LL address 169.254.16.211 machine # [ 48.188762] dhcpcd[694]: veth4942924a: adding route to 169.254.0.0/16 machine # [ 48.284597] dhcpcd[694]: veth147d15e1: using IPv4LL address 169.254.42.84 machine # [ 48.285168] dhcpcd[694]: veth147d15e1: adding route to 169.254.0.0/16 machine # [ 48.845064] dhcpcd[694]: vethe89cfee7: using IPv4LL address 169.254.181.58 machine # [ 48.845552] dhcpcd[694]: vethe89cfee7: adding route to 169.254.0.0/16 machine # [ 48.926776] k3s[872]: I0923 05:33:34.888454 872 endpointslice_controller.go:361] "Error syncing endpoint slices for service, retrying" key="farm/nix-grpc-farm-worker-x86-64-linux" err="EndpointSlice informer cache is out of date" machine # [ 51.358324] dhcpcd[694]: vethd8726c78: no IPv6 Routers available machine # [ 51.725389] dhcpcd[694]: vethe89cfee7: no IPv6 Routers available machine # [ 51.770614] dhcpcd[694]: veth4942924a: no IPv6 Routers available machine # [ 52.369197] dhcpcd[694]: veth147d15e1: no IPv6 Routers available machine # error: timed out waiting for the condition machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 35.44 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s, in 0.19 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s, in 0.16 seconds) machine: waiting for unit niks3.service machine: (finished: waiting for unit niks3.service, in 0.03 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.40 seconds) machine: waiting for success: test $(curl -sf 10.42.0.6:9901/clusters | grep -c 'health_flags::healthy') -ge 3 machine: (finished: waiting for success: test $(curl -sf 10.42.0.6:9901/clusters | grep -c 'health_flags::healthy') -ge 3, in 8.54 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.45 seconds) machine: waiting for success: curl -sf http://10.42.0.5:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2' machine: (finished: waiting for success: curl -sf http://10.42.0.5:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2', in 0.06 seconds) (finished: subtest: chart deploys and workers become Ready, in 45.27 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}', in 0.20 seconds) machine: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt machine: (finished: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt, in 0.15 seconds) subtest: build through the balancer lands in the cache machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1 machine # [ 132.073152] niks3-server[1171]: 2026/09/23 05:34:58 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 132.097389] niks3-server[1171]: 2026/09/23 05:34:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign machine # [ 132.101973] niks3-server[1171]: 2026/09/23 05:34:58 INFO Signed narinfos id=1 count=1 machine # [ 132.106983] niks3-server[1171]: 2026/09/23 05:34:58 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.ls machine # [ 132.108364] niks3-server[1171]: 2026/09/23 05:34:58 INFO Registered completed upload object_key=nar/0nzzbas7l8d37mridr7mg162smfjvn7lhs6am4crl4ydaxicigj8.nar.zst machine # [ 132.113363] niks3-server[1171]: 2026/09/23 05:34:58 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete machine # [ 132.116423] niks3-server[1171]: 2026/09/23 05:34:58 INFO Completed upload id=1 machine # [ 132.118640] niks3-server[1171]: 2026/09/23 05:34:58 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.narinfo machine # [ 157.235171] niks3-server[1171]: 2026/09/23 05:35:23 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 157.255153] niks3-server[1171]: 2026/09/23 05:35:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign machine # [ 157.259902] niks3-server[1171]: 2026/09/23 05:35:23 INFO Registered completed upload object_key=nar/1p7jh5nyz9n68k5f18ymmdpgr34mpnnch1njw7ki7b2b97qlfbjk.nar.zst machine # [ 157.262912] niks3-server[1171]: 2026/09/23 05:35:23 INFO Registered completed upload object_key=log/yz1sqzb72i8v6h2ass0v76ba8cncqj9r-k3s-a.drv machine # [ 157.265587] niks3-server[1171]: 2026/09/23 05:35:23 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.ls machine # [ 157.266680] niks3-server[1171]: 2026/09/23 05:35:23 INFO Signed narinfos id=2 count=1 machine # [ 157.276434] niks3-server[1171]: 2026/09/23 05:35:23 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete machine # [ 157.283183] niks3-server[1171]: 2026/09/23 05:35:23 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.narinfo machine # [ 157.286240] niks3-server[1171]: 2026/09/23 05:35:23 INFO Completed upload id=2 machine # [ 157.355860] niks3-server[1171]: 2026/09/23 05:35:23 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 157.365553] niks3-server[1171]: 2026/09/23 05:35:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign machine # [ 157.367491] niks3-server[1171]: 2026/09/23 05:35:23 INFO Signed narinfos id=3 count=1 machine # [ 157.369791] niks3-server[1171]: 2026/09/23 05:35:23 INFO Registered completed upload object_key=nar/03a4ywhyr5knmbc93z4gyml5y8fvgb431xvlmfxrwsm8mrb0qgx2.nar.zst machine # [ 157.371935] niks3-server[1171]: 2026/09/23 05:35:23 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.ls machine # [ 157.373753] niks3-server[1171]: 2026/09/23 05:35:23 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete machine # [ 157.375675] niks3-server[1171]: 2026/09/23 05:35:23 INFO Completed upload id=3 machine # [ 157.377491] niks3-server[1171]: 2026/09/23 05:35:23 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.narinfo machine # [ 182.273575] niks3-server[1171]: 2026/09/23 05:35:48 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 182.293360] niks3-server[1171]: 2026/09/23 05:35:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign machine # [ 182.295439] niks3-server[1171]: 2026/09/23 05:35:48 INFO Signed narinfos id=4 count=1 machine # [ 182.296717] niks3-server[1171]: 2026/09/23 05:35:48 INFO Registered completed upload object_key=log/zfq1xw9bmycqh35l0s44lmv65z4xc7br-k3s-b.drv machine # [ 182.298800] niks3-server[1171]: 2026/09/23 05:35:48 INFO Registered completed upload object_key=nar/05qjsj5ff3a6vnxkhb6k5f3m446dcc206p7cd37w4v3mgi95d7kh.nar.zst machine # [ 182.301070] niks3-server[1171]: 2026/09/23 05:35:48 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.ls machine # [ 182.304135] niks3-server[1171]: 2026/09/23 05:35:48 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete machine # [ 182.307978] niks3-server[1171]: 2026/09/23 05:35:48 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.narinfo machine # [ 182.310367] niks3-server[1171]: 2026/09/23 05:35:48 INFO Completed upload id=4 machine # [ 182.375882] niks3-server[1171]: 2026/09/23 05:35:48 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 182.387853] niks3-server[1171]: 2026/09/23 05:35:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign machine # [ 182.390443] niks3-server[1171]: 2026/09/23 05:35:48 INFO Signed narinfos id=5 count=1 machine # [ 182.394376] niks3-server[1171]: 2026/09/23 05:35:48 INFO Registered completed upload object_key=nar/0jyw88klkf3nwxpnj5m5lx3i1dv2idf3hcn6im7883hnldm3gvyq.nar.zst machine # [ 182.396792] niks3-server[1171]: 2026/09/23 05:35:48 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.ls machine # [ 182.397581] niks3-server[1171]: 2026/09/23 05:35:48 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete machine # [ 182.399645] niks3-server[1171]: 2026/09/23 05:35:48 INFO Completed upload id=5 machine # [ 182.402517] niks3-server[1171]: 2026/09/23 05:35:48 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.narinfo machine # [ 207.315393] niks3-server[1171]: 2026/09/23 05:36:13 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 207.336475] niks3-server[1171]: 2026/09/23 05:36:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign machine # [ 207.338408] niks3-server[1171]: 2026/09/23 05:36:13 INFO Signed narinfos id=6 count=1 machine # [ 207.343263] niks3-server[1171]: 2026/09/23 05:36:13 INFO Registered completed upload object_key=nar/1q8vp5xqws560mpf8rxk8r8jhqrzibivh13x4wxy0cfqlzbk7cr5.nar.zst machine # [ 207.347424] niks3-server[1171]: 2026/09/23 05:36:13 INFO Registered completed upload object_key=log/n40czam6a4ldp1mh5fdmlcy07fv0akbm-k3s-top.drv machine # [ 207.351877] niks3-server[1171]: 2026/09/23 05:36:13 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete machine # [ 207.353820] niks3-server[1171]: 2026/09/23 05:36:13 INFO Completed upload id=6 machine # [ 207.356217] niks3-server[1171]: 2026/09/23 05:36:13 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.narinfo machine # [ 207.367611] niks3-server[1171]: 2026/09/23 05:36:13 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.ls machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1, in 136.32 seconds) machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath, in 0.13 seconds) machine: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine: (finished: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.01 seconds) machine: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine # copying 3 paths... machine # copying path '/nix/store/r95r891injj9ski5c4w89yxjvjy065mx-k3s-a' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/mrqsh0475wxsmnsvkk55g94v6g5nrcra-k3s-b' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top' from 'http://192.168.1.1:5751'... machine: (finished: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.18 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1 machine # [ 208.022785] niks3-server[1171]: 2026/09/23 05:36:13 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 208.046369] niks3-server[1171]: 2026/09/23 05:36:14 INFO Registered completed upload object_key=nar/1fr26arhri17j9bj6hyjzmmd74v730biz1gb3kqd194vjx3ccvp9.nar.zst machine # [ 208.048890] niks3-server[1171]: 2026/09/23 05:36:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign machine # [ 208.049723] niks3-server[1171]: 2026/09/23 05:36:14 INFO Signed narinfos id=7 count=1 machine # [ 208.053423] niks3-server[1171]: 2026/09/23 05:36:14 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.ls machine # [ 208.058799] niks3-server[1171]: 2026/09/23 05:36:14 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete machine # [ 208.061350] niks3-server[1171]: 2026/09/23 05:36:14 INFO Completed upload id=7 machine # [ 208.062649] niks3-server[1171]: 2026/09/23 05:36:14 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.narinfo machine # [ 232.572564] niks3-server[1171]: 2026/09/23 05:36:38 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 232.590436] niks3-server[1171]: 2026/09/23 05:36:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign machine # [ 232.591167] niks3-server[1171]: 2026/09/23 05:36:38 INFO Signed narinfos id=8 count=1 machine # [ 232.597310] niks3-server[1171]: 2026/09/23 05:36:38 INFO Registered completed upload object_key=log/pbpqsh50ar10fpasdqqx8xg3lmr5j8iz-k3s-a.drv machine # [ 232.600486] niks3-server[1171]: 2026/09/23 05:36:38 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.ls machine # [ 232.604220] niks3-server[1171]: 2026/09/23 05:36:38 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete machine # [ 232.606331] niks3-server[1171]: 2026/09/23 05:36:38 INFO Completed upload id=8 machine # [ 232.608472] niks3-server[1171]: 2026/09/23 05:36:38 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.narinfo machine # [ 232.618502] niks3-server[1171]: 2026/09/23 05:36:38 INFO Registered completed upload object_key=nar/1hfc6x4x25k3b0fk091d3nb0k3mympfp05fkslcx19synp3ig0zd.nar.zst machine # [ 232.672152] niks3-server[1171]: 2026/09/23 05:36:38 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 232.685326] niks3-server[1171]: 2026/09/23 05:36:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign machine # [ 232.688905] niks3-server[1171]: 2026/09/23 05:36:38 INFO Signed narinfos id=9 count=1 machine # [ 232.689812] niks3-server[1171]: 2026/09/23 05:36:38 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.ls machine # [ 232.691089] niks3-server[1171]: 2026/09/23 05:36:38 INFO Registered completed upload object_key=nar/0zzq2vgjln4shvh57091n14sam6wh6w06vja6lzb9ppcj4ffyx1n.nar.zst machine # [ 232.704528] niks3-server[1171]: 2026/09/23 05:36:38 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete machine # [ 232.706677] niks3-server[1171]: 2026/09/23 05:36:38 INFO Completed upload id=9 machine # [ 232.708340] niks3-server[1171]: 2026/09/23 05:36:38 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.narinfo machine # [ 257.622602] niks3-server[1171]: 2026/09/23 05:37:03 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 257.644680] niks3-server[1171]: 2026/09/23 05:37:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign machine # [ 257.647898] niks3-server[1171]: 2026/09/23 05:37:03 INFO Registered completed upload object_key=log/894h6wzw2l4w5f0hikj1k6q57jfnyi87-k3s-b.drv machine # [ 257.651051] niks3-server[1171]: 2026/09/23 05:37:03 INFO Signed narinfos id=10 count=1 machine # [ 257.653592] niks3-server[1171]: 2026/09/23 05:37:03 INFO Registered completed upload object_key=nar/0hh3nqk95r6g32lhdmxw8cxjv694vbpx9876zkhcpg4r4qxni2ch.nar.zst machine # [ 257.658235] niks3-server[1171]: 2026/09/23 05:37:03 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.ls machine # [ 257.661414] niks3-server[1171]: 2026/09/23 05:37:03 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete machine # [ 257.663769] niks3-server[1171]: 2026/09/23 05:37:03 INFO Completed upload id=10 machine # [ 257.669145] niks3-server[1171]: 2026/09/23 05:37:03 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.narinfo machine # [ 257.730927] niks3-server[1171]: 2026/09/23 05:37:03 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 257.739658] niks3-server[1171]: 2026/09/23 05:37:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign machine # [ 257.740177] niks3-server[1171]: 2026/09/23 05:37:03 INFO Signed narinfos id=11 count=1 machine # [ 257.744130] niks3-server[1171]: 2026/09/23 05:37:03 INFO Registered completed upload object_key=nar/0ingamx56k31lwiyxmnxmscjj4n3qfx6sr2kpaynsrwhwz1278iw.nar.zst machine # [ 257.746717] niks3-server[1171]: 2026/09/23 05:37:03 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete machine # [ 257.747617] niks3-server[1171]: 2026/09/23 05:37:03 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.ls machine # [ 257.750401] niks3-server[1171]: 2026/09/23 05:37:03 INFO Completed upload id=11 machine # [ 257.751564] niks3-server[1171]: 2026/09/23 05:37:03 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.narinfo machine # [ 282.062901] niks3-server[1171]: 2026/09/23 05:37:28 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 282.081311] niks3-server[1171]: 2026/09/23 05:37:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign machine # [ 282.083620] niks3-server[1171]: 2026/09/23 05:37:28 INFO Signed narinfos id=12 count=1 machine # [ 282.085907] niks3-server[1171]: 2026/09/23 05:37:28 INFO Registered completed upload object_key=nar/0v48x4sp58bvfra08axgkz7yl1n9nc4nirskyv1hwann4i7q277i.nar.zst machine # [ 282.087158] niks3-server[1171]: 2026/09/23 05:37:28 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.ls machine # [ 282.093185] niks3-server[1171]: 2026/09/23 05:37:28 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete machine # [ 282.095663] niks3-server[1171]: 2026/09/23 05:37:28 INFO Completed upload id=12 machine # [ 282.099547] niks3-server[1171]: 2026/09/23 05:37:28 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1, in 75.41 seconds) (finished: subtest: build through the balancer lands in the cache, in 212.06 seconds) subtest: a Job with the client image builds through the farm with its service account machine: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine: (finished: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.19 seconds) machine: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix machine: (finished: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix, in 0.13 seconds) machine: must succeed: kubectl apply -f /nix/store/lp0q6rjq0cw1vs9npm6c3ggx088f4vva-ci-job.json machine: (finished: must succeed: kubectl apply -f /nix/store/lp0q6rjq0cw1vs9npm6c3ggx088f4vva-ci-job.json, in 0.16 seconds) machine: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed' machine # [ 283.711614] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod337d8894_6385_46d8_ae4a_bbe471f85348.slice. machine # [ 283.819955] k3s[872]: I0923 05:37:29.782169 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gfx8\" (UniqueName: \"kubernetes.io/projected/337d8894-6385-46d8-ae4a-bbe471f85348-kube-api-access-7gfx8\") pod \"ci-cmnxt\" (UID: \"337d8894-6385-46d8-ae4a-bbe471f85348\") " pod="ci/ci-cmnxt" machine # [ 283.820460] k3s[872]: I0923 05:37:29.782229 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/337d8894-6385-46d8-ae4a-bbe471f85348-nix-grpc-farm\") pod \"ci-cmnxt\" (UID: \"337d8894-6385-46d8-ae4a-bbe471f85348\") " pod="ci/ci-cmnxt" machine # [ 283.820882] k3s[872]: I0923 05:37:29.782325 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"job\" (UniqueName: \"kubernetes.io/configmap/337d8894-6385-46d8-ae4a-bbe471f85348-job\") pod \"ci-cmnxt\" (UID: \"337d8894-6385-46d8-ae4a-bbe471f85348\") " pod="ci/ci-cmnxt" machine # [ 285.104355] cni0: port 6(vethbbd3f3c7) entered blocking state machine # [ 285.104985] cni0: port 6(vethbbd3f3c7) entered disabled state machine # [ 285.105880] vethbbd3f3c7: entered allmulticast mode machine # [ 285.106710] vethbbd3f3c7: entered promiscuous mode machine # [ 285.122481] cni0: port 6(vethbbd3f3c7) entered blocking state machine # [ 285.123414] cni0: port 6(vethbbd3f3c7) entered forwarding state machine # [ 285.010382] (udev-worker)[4946]: Network interface NamePolicy= disabled on kernel command line. machine # [ 285.036324] dhcpcd[694]: vethbbd3f3c7: IAID 4d:17:fa:3d machine # [ 285.036658] dhcpcd[694]: vethbbd3f3c7: adding address fe80::b834:4dff:fe17:fa3d machine # [ 285.054507] systemd[1]: Started libcontainer container 1b37e9363c1efc37e562a170a0c24fc5aa1ea0ca752e3e1e4f60f0bd4231690e. machine # [ 286.835729] dhcpcd[694]: vethbbd3f3c7: soliciting a DHCP lease machine # [ 287.063319] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount631251944.mount: Deactivated successfully. machine # [ 287.127188] dhcpcd[694]: vethbbd3f3c7: soliciting an IPv6 router machine # [ 287.161249] systemd[1]: Started libcontainer container a73115b17137dd4e9acfb5d1f5ba61ff4944a8b1d2eb4777b49662c8aaf986fd. machine # [ 287.871563] k3s[872]: I0923 05:37:33.833312 872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ci/ci-cmnxt" podStartSLOduration=4.833273051 podStartE2EDuration="4.833273051s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-23 05:37:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-23 05:37:33.833073584 +0000 UTC m=+272.427501230" watchObservedRunningTime="2026-09-23 05:37:33.833273051 +0000 UTC m=+272.427700418" machine # [ 288.537632] niks3-server[1171]: 2026/09/23 05:37:34 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 288.552734] niks3-server[1171]: 2026/09/23 05:37:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign machine # [ 288.555152] niks3-server[1171]: 2026/09/23 05:37:34 INFO Signed narinfos id=13 count=1 machine # [ 288.556488] niks3-server[1171]: 2026/09/23 05:37:34 INFO Registered completed upload object_key=nar/111g6dyibwcf2z7jhpn72rgja0qvjgpdiv9nc06g2dp7ih0a6kyq.nar.zst machine # [ 288.557344] niks3-server[1171]: 2026/09/23 05:37:34 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.ls machine # [ 288.564208] niks3-server[1171]: 2026/09/23 05:37:34 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete machine # [ 288.566266] niks3-server[1171]: 2026/09/23 05:37:34 INFO Completed upload id=13 machine # [ 288.571200] niks3-server[1171]: 2026/09/23 05:37:34 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.narinfo machine # [ 291.836954] dhcpcd[694]: vethbbd3f3c7: probing for an IPv4LL address machine # [ 297.449226] dhcpcd[694]: vethbbd3f3c7: using IPv4LL address 169.254.217.128 machine # [ 297.451928] dhcpcd[694]: vethbbd3f3c7: adding route to 169.254.0.0/16 machine # [ 299.131931] dhcpcd[694]: vethbbd3f3c7: no IPv6 Routers available machine # [ 309.904841] postgres[752]: [752] LOG: checkpoint starting: time machine # [ 313.274899] niks3-server[1171]: 2026/09/23 05:37:59 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 313.289513] niks3-server[1171]: 2026/09/23 05:37:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign machine # [ 313.290682] niks3-server[1171]: 2026/09/23 05:37:59 INFO Signed narinfos id=14 count=1 machine # [ 313.293744] niks3-server[1171]: 2026/09/23 05:37:59 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.ls machine # [ 313.296693] niks3-server[1171]: 2026/09/23 05:37:59 INFO Registered completed upload object_key=nar/058kjd2vfl1r27b4d9ixvwf77d8rkr18a4v894kwx8lg0nwpajnr.nar.zst machine # [ 313.300180] niks3-server[1171]: 2026/09/23 05:37:59 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete machine # [ 313.301627] niks3-server[1171]: 2026/09/23 05:37:59 INFO Registered completed upload object_key=log/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # [ 313.306601] niks3-server[1171]: 2026/09/23 05:37:59 INFO Completed upload id=14 machine # [ 313.308728] niks3-server[1171]: 2026/09/23 05:37:59 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.narinfo machine # [ 313.373994] niks3-server[1171]: 2026/09/23 05:37:59 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 313.385143] niks3-server[1171]: 2026/09/23 05:37:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign machine # [ 313.388196] niks3-server[1171]: 2026/09/23 05:37:59 INFO Signed narinfos id=15 count=1 machine # [ 313.392279] niks3-server[1171]: 2026/09/23 05:37:59 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.ls machine # [ 313.393830] niks3-server[1171]: 2026/09/23 05:37:59 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete machine # [ 313.397326] niks3-server[1171]: 2026/09/23 05:37:59 INFO Registered completed upload object_key=nar/138ynhcd5wxzz485x9qcq7xsargaklrf2li31ai69m5r46am35q6.nar.zst machine # [ 313.400847] niks3-server[1171]: 2026/09/23 05:37:59 INFO Completed upload id=15 machine # [ 313.403734] niks3-server[1171]: 2026/09/23 05:37:59 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.narinfo machine # [ 337.912941] niks3-server[1171]: 2026/09/23 05:38:23 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 337.933996] niks3-server[1171]: 2026/09/23 05:38:23 INFO Registered completed upload object_key=nar/0n4lbdlp8w72fs3qbavl2lwrzbrn55i2b1vyglc89cc3pi8vbb1m.nar.zst machine # [ 337.935816] niks3-server[1171]: 2026/09/23 05:38:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign machine # [ 337.938749] niks3-server[1171]: 2026/09/23 05:38:23 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.ls machine # [ 337.940065] niks3-server[1171]: 2026/09/23 05:38:23 INFO Signed narinfos id=16 count=1 machine # [ 337.941827] niks3-server[1171]: 2026/09/23 05:38:23 INFO Registered completed upload object_key=log/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # [ 337.953425] niks3-server[1171]: 2026/09/23 05:38:23 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete machine # [ 337.957286] niks3-server[1171]: 2026/09/23 05:38:23 INFO Completed upload id=16 machine # [ 337.960696] niks3-server[1171]: 2026/09/23 05:38:23 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo machine # [ 338.023992] niks3-server[1171]: 2026/09/23 05:38:23 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 338.037721] niks3-server[1171]: 2026/09/23 05:38:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign machine # [ 338.039205] niks3-server[1171]: 2026/09/23 05:38:24 INFO Signed narinfos id=17 count=1 machine # [ 338.041644] niks3-server[1171]: 2026/09/23 05:38:24 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.ls machine # [ 338.043513] niks3-server[1171]: 2026/09/23 05:38:24 INFO Registered completed upload object_key=nar/1f3gvnvqsm2pm3laixkxkg44kvjb251zqhszcfpp0a00h6x66ljs.nar.zst machine # [ 338.045745] niks3-server[1171]: 2026/09/23 05:38:24 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete machine # [ 338.047953] niks3-server[1171]: 2026/09/23 05:38:24 INFO Completed upload id=17 machine # [ 338.049328] niks3-server[1171]: 2026/09/23 05:38:24 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.narinfo machine # [ 362.958515] niks3-server[1171]: 2026/09/23 05:38:48 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 362.978337] niks3-server[1171]: 2026/09/23 05:38:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign machine # [ 362.979485] niks3-server[1171]: 2026/09/23 05:38:48 INFO Signed narinfos id=18 count=1 machine # [ 362.983164] niks3-server[1171]: 2026/09/23 05:38:48 INFO Registered completed upload object_key=log/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # [ 362.984819] niks3-server[1171]: 2026/09/23 05:38:48 INFO Registered completed upload object_key=nar/1zwf0asrdv12q40fmqga5lx5330dvn9y4in4i9ficz9ij5lhvnf5.nar.zst machine # [ 362.986651] niks3-server[1171]: 2026/09/23 05:38:48 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete machine # [ 362.990049] niks3-server[1171]: 2026/09/23 05:38:48 INFO Completed upload id=18 machine # [ 362.992052] niks3-server[1171]: 2026/09/23 05:38:48 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo machine # [ 365.777859] niks3-server[1171]: 2026/09/23 05:38:51 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 365.796760] niks3-server[1171]: 2026/09/23 05:38:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign machine # [ 365.799810] niks3-server[1171]: 2026/09/23 05:38:51 INFO Signed narinfos id=19 count=1 machine # [ 365.801951] niks3-server[1171]: 2026/09/23 05:38:51 INFO Registered completed upload object_key=nar/0xiyqcsl8db7dnrq2gqnx5izavr51ma3dcdswrriaxfgj3qzk7xf.nar.zst machine # [ 365.806854] niks3-server[1171]: 2026/09/23 05:38:51 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.ls machine # [ 365.810203] niks3-server[1171]: 2026/09/23 05:38:51 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete machine # [ 365.812508] niks3-server[1171]: 2026/09/23 05:38:51 INFO Completed upload id=19 machine # [ 365.816114] niks3-server[1171]: 2026/09/23 05:38:51 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.narinfo machine # [ 390.328543] niks3-server[1171]: 2026/09/23 05:39:16 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 390.349100] niks3-server[1171]: 2026/09/23 05:39:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign machine # [ 390.354689] niks3-server[1171]: 2026/09/23 05:39:16 INFO Signed narinfos id=20 count=1 machine # [ 390.358088] niks3-server[1171]: 2026/09/23 05:39:16 INFO Registered completed upload object_key=log/fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # [ 390.362667] niks3-server[1171]: 2026/09/23 05:39:16 INFO Registered completed upload object_key=nar/0p3l2z3riilylr2rxb1aq2blxdfxg55wbgp4gxkns93srbr4bwyq.nar.zst machine # [ 390.370133] niks3-server[1171]: 2026/09/23 05:39:16 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.ls machine # [ 390.374401] niks3-server[1171]: 2026/09/23 05:39:16 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete machine # [ 390.378488] niks3-server[1171]: 2026/09/23 05:39:16 INFO Completed upload id=20 machine # [ 390.380784] niks3-server[1171]: 2026/09/23 05:39:16 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo machine # [ 390.491870] systemd[1]: cri-containerd-a73115b17137dd4e9acfb5d1f5ba61ff4944a8b1d2eb4777b49662c8aaf986fd.scope: Deactivated successfully. machine # [ 390.496276] systemd[1]: cri-containerd-a73115b17137dd4e9acfb5d1f5ba61ff4944a8b1d2eb4777b49662c8aaf986fd.scope: Consumed 1.024s CPU time over 1min 43.331s wall clock time, 159.7M memory peak, 90.2M read from disk, 428K written to disk, 18.2K incoming IP traffic, 44.8K outgoing IP traffic. machine # [ 390.539670] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-a73115b17137dd4e9acfb5d1f5ba61ff4944a8b1d2eb4777b49662c8aaf986fd-rootfs.mount: Deactivated successfully. machine # [ 392.305208] systemd[1]: cri-containerd-1b37e9363c1efc37e562a170a0c24fc5aa1ea0ca752e3e1e4f60f0bd4231690e.scope: Deactivated successfully. machine # [ 392.362368] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-1b37e9363c1efc37e562a170a0c24fc5aa1ea0ca752e3e1e4f60f0bd4231690e-rootfs.mount: Deactivated successfully. machine # [ 392.414118] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-1b37e9363c1efc37e562a170a0c24fc5aa1ea0ca752e3e1e4f60f0bd4231690e-shm.mount: Deactivated successfully. machine # [ 392.463395] dhcpcd[694]: vethbbd3f3c7: carrier lost machine # [ 392.615061] cni0: port 6(vethbbd3f3c7) entered disabled state machine # [ 392.619514] vethbbd3f3c7 (unregistering): left allmulticast mode machine # [ 392.621411] vethbbd3f3c7 (unregistering): left promiscuous mode machine # [ 392.623243] cni0: port 6(vethbbd3f3c7) entered disabled state machine # [ 392.489676] dhcpcd[694]: vethbbd3f3c7: deleting address fe80::b834:4dff:fe17:fa3d machine # [ 392.490871] systemd[1]: run-netns-cni\x2dfa38156c\x2d7812\x2d305e\x2d86ba\x2dd3b32ebc8cb3.mount: Deactivated successfully. machine # [ 392.493180] dhcpcd[694]: vethbbd3f3c7: deleting route to 169.254.0.0/16 machine # [ 392.555347] dhcpcd[694]: vethbbd3f3c7: removing interface machine # [ 392.622222] k3s[872]: I0923 05:39:18.584435 872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/337d8894-6385-46d8-ae4a-bbe471f85348-nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/337d8894-6385-46d8-ae4a-bbe471f85348-nix-grpc-farm\") pod \"337d8894-6385-46d8-ae4a-bbe471f85348\" (UID: \"337d8894-6385-46d8-ae4a-bbe471f85348\") " machine # [ 392.622425] k3s[872]: I0923 05:39:18.584539 872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/337d8894-6385-46d8-ae4a-bbe471f85348-job\" (UniqueName: \"kubernetes.io/configmap/337d8894-6385-46d8-ae4a-bbe471f85348-job\") pod \"337d8894-6385-46d8-ae4a-bbe471f85348\" (UID: \"337d8894-6385-46d8-ae4a-bbe471f85348\") " machine # [ 392.622842] k3s[872]: I0923 05:39:18.584602 872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/337d8894-6385-46d8-ae4a-bbe471f85348-kube-api-access-7gfx8\" (UniqueName: \"kubernetes.io/projected/337d8894-6385-46d8-ae4a-bbe471f85348-kube-api-access-7gfx8\") pod \"337d8894-6385-46d8-ae4a-bbe471f85348\" (UID: \"337d8894-6385-46d8-ae4a-bbe471f85348\") " machine # [ 392.623497] k3s[872]: I0923 05:39:18.585111 872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/337d8894-6385-46d8-ae4a-bbe471f85348-job" pod "337d8894-6385-46d8-ae4a-bbe471f85348" (UID: "337d8894-6385-46d8-ae4a-bbe471f85348"). InnerVolumeSpecName "job". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 392.626591] systemd[1]: var-lib-kubelet-pods-337d8894\x2d6385\x2d46d8\x2dae4a\x2dbbe471f85348-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2d7gfx8.mount: Deactivated successfully. machine # [ 392.628157] systemd[1]: var-lib-kubelet-pods-337d8894\x2d6385\x2d46d8\x2dae4a\x2dbbe471f85348-volumes-kubernetes.io\x7eprojected-nix\x2dgrpc\x2dfarm.mount: Deactivated successfully. machine # [ 392.643466] k3s[872]: I0923 05:39:18.605985 872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/337d8894-6385-46d8-ae4a-bbe471f85348-kube-api-access-7gfx8" pod "337d8894-6385-46d8-ae4a-bbe471f85348" (UID: "337d8894-6385-46d8-ae4a-bbe471f85348"). InnerVolumeSpecName "kube-api-access-7gfx8". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 392.644382] k3s[872]: I0923 05:39:18.606947 872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/337d8894-6385-46d8-ae4a-bbe471f85348-nix-grpc-farm" pod "337d8894-6385-46d8-ae4a-bbe471f85348" (UID: "337d8894-6385-46d8-ae4a-bbe471f85348"). InnerVolumeSpecName "nix-grpc-farm". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 392.722541] k3s[872]: I0923 05:39:18.685011 872 reconciler_common.go:299] "Volume detached for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/337d8894-6385-46d8-ae4a-bbe471f85348-nix-grpc-farm\") on node \"machine\" DevicePath \"\"" machine # [ 392.722850] k3s[872]: I0923 05:39:18.685078 872 reconciler_common.go:299] "Volume detached for volume \"job\" (UniqueName: \"kubernetes.io/configmap/337d8894-6385-46d8-ae4a-bbe471f85348-job\") on node \"machine\" DevicePath \"\"" machine # [ 392.724130] k3s[872]: I0923 05:39:18.685113 872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gfx8\" (UniqueName: \"kubernetes.io/projected/337d8894-6385-46d8-ae4a-bbe471f85348-kube-api-access-7gfx8\") on node \"machine\" DevicePath \"\"" machine # [ 393.288691] k3s[872]: I0923 05:39:19.250394 872 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1b37e9363c1efc37e562a170a0c24fc5aa1ea0ca752e3e1e4f60f0bd4231690e" machine # [ 393.309562] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod337d8894_6385_46d8_ae4a_bbe471f85348.slice. machine # [ 393.310716] systemd[1]: kubepods-besteffort-pod337d8894_6385_46d8_ae4a_bbe471f85348.slice: Consumed 1.051s CPU time over 1min 49.596s wall clock time, 160M memory peak, 90.2M read from disk, 632K written to disk, 18.2K incoming IP traffic, 44.8K outgoing IP traffic. machine: (finished: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed', in 110.77 seconds) machine: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1 machine: (finished: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1, in 0.14 seconds) machine # don't know how to build these paths: machine # /nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-a> machine/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-n8tvr: building fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-b> machine/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-n8tvr: building 1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-top> machine/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-n8tvr: building rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # INFO:nix_fast_build.processes:run nix-eval-jobs --gc-roots-dir /tmp/tmpf1h46wi5/gcroots --force-recurse --max-memory-size 4096 --workers 4 --flake '.#checks' --check-cache-status machine # INFO:nix_fast_build.workers:builds: 0 machine # warning: Git tree '/tmp' is dirty machine # warning: Git tree '/tmp' is dirty machine # ▶ x86_64-linux.t started machine # INFO:nix_fast_build.workers:builds: 2 machine # ✔ x86_64-linux.t (25s) machine # x86_64-linux.t> machine/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-74qhn: building fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # warning: Git tree '/tmp' is dirty machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath, in 0.12 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null, in 0.03 seconds) (finished: subtest: a Job with the client image builds through the farm with its service account, in 111.73 seconds) subtest: a renewed balancer certificate is served without a rollout machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f - machine # Warning: resource secrets/farm-lb-tls is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically. machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f -, in 0.27 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}', in 0.53 seconds) machine: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-85f6f9c7c8-8wz9l -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine # [ 395.927063] k3s[872]: E0923 05:39:21.889304 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:34306: use of closed network connection machine # [ 397.224566] k3s[872]: E0923 05:39:23.186833 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:34334: use of closed network connection machine # [ 398.499497] k3s[872]: E0923 05:39:24.461566 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:34350: use of closed network connection machine # [ 399.791502] k3s[872]: E0923 05:39:25.753175 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:34376: use of closed network connection machine # [ 401.076133] k3s[872]: E0923 05:39:27.037215 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:34384: use of closed network connection machine # [ 402.394246] k3s[872]: E0923 05:39:28.356337 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:34430: use of closed network connection machine # [ 403.727959] k3s[872]: E0923 05:39:29.689569 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58812: use of closed network connection machine # [ 405.023393] k3s[872]: E0923 05:39:30.984858 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58840: use of closed network connection machine # [ 406.295206] k3s[872]: E0923 05:39:32.257107 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58884: use of closed network connection machine # [ 406.295380] k3s[872]: E0923 05:39:32.257386 872 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:58398->127.0.0.1:10010: write tcp 127.0.0.1:58398->127.0.0.1:10010: write: broken pipe machine # [ 407.584295] k3s[872]: E0923 05:39:33.545585 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58914: use of closed network connection machine # [ 408.850368] k3s[872]: E0923 05:39:34.812070 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58942: use of closed network connection machine # [ 410.152076] k3s[872]: E0923 05:39:36.114070 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58976: use of closed network connection machine # [ 411.421444] k3s[872]: E0923 05:39:37.383696 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59006: use of closed network connection machine # [ 412.707905] k3s[872]: E0923 05:39:38.669669 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59042: use of closed network connection machine # [ 413.880118] postgres[752]: [752] LOG: checkpoint complete: wrote 1037 buffers (6.3%), wrote 3 SLRU buffers; 1 WAL file(s) added, 0 removed, 0 recycled; write=103.891 s, sync=0.043 s, total=103.976 s; sync files=364, longest=0.003 s, average=0.001 s; distance=4970 kB, estimate=4970 kB; lsn=0/1C71CF0, redo lsn=0/1C40A58 machine # [ 413.983683] k3s[872]: E0923 05:39:39.945574 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60586: use of closed network connection machine # [ 415.275404] k3s[872]: E0923 05:39:41.237602 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60600: use of closed network connection machine # [ 416.575285] k3s[872]: E0923 05:39:42.537221 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60634: use of closed network connection machine # [ 416.575662] k3s[872]: E0923 05:39:42.537301 872 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:59188->127.0.0.1:10010: write tcp 127.0.0.1:59188->127.0.0.1:10010: write: broken pipe machine # [ 416.576132] k3s[872]: time="2026-09-23T05:39:42Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:43224->127.0.0.1:10250: write: connection reset by peer" machine # [ 417.927319] k3s[872]: E0923 05:39:43.888868 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60654: use of closed network connection machine # [ 419.191194] k3s[872]: time="2026-09-23T05:39:45Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:43232->127.0.0.1:10250: write: connection reset by peer" machine # [ 419.191918] k3s[872]: E0923 05:39:45.153162 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60686: use of closed network connection machine # [ 420.472383] k3s[872]: E0923 05:39:46.434650 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60706: use of closed network connection machine # [ 421.754569] k3s[872]: E0923 05:39:47.716470 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60738: use of closed network connection machine # [ 424.302262] k3s[872]: E0923 05:39:50.264266 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:34326: use of closed network connection machine # [ 425.587334] k3s[872]: E0923 05:39:51.549420 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:34362: use of closed network connection machine # [ 426.864995] k3s[872]: E0923 05:39:52.827276 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:34378: use of closed network connection machine # [ 428.165923] k3s[872]: E0923 05:39:54.127822 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:34406: use of closed network connection machine # [ 428.166910] k3s[872]: time="2026-09-23T05:39:54Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:53950->127.0.0.1:10250: write: broken pipe" machine # [ 429.487306] k3s[872]: E0923 05:39:55.449494 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:34434: use of closed network connection machine # [ 430.798097] k3s[872]: E0923 05:39:56.759638 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:34460: use of closed network connection machine # [ 432.095103] k3s[872]: E0923 05:39:58.057319 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:34490: use of closed network connection machine # [ 433.359530] k3s[872]: E0923 05:39:59.321787 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:50486: use of closed network connection machine # [ 434.652434] k3s[872]: E0923 05:40:00.614515 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:50508: use of closed network connection machine # [ 435.909584] k3s[872]: E0923 05:40:01.871852 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:50534: use of closed network connection machine # [ 437.239238] k3s[872]: E0923 05:40:03.201239 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:50544: use of closed network connection machine # [ 438.534811] k3s[872]: E0923 05:40:04.496966 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:50564: use of closed network connection machine # [ 439.850590] k3s[872]: E0923 05:40:05.812802 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:50584: use of closed network connection machine # [ 441.152453] k3s[872]: E0923 05:40:07.114743 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:50602: use of closed network connection machine # [ 442.427340] k3s[872]: E0923 05:40:08.389279 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:50640: use of closed network connection machine # [ 443.723659] k3s[872]: E0923 05:40:09.685940 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56292: use of closed network connection machine # [ 445.012416] k3s[872]: E0923 05:40:10.974717 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56314: use of closed network connection machine # [ 445.014386] k3s[872]: E0923 05:40:10.975731 872 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:39294->127.0.0.1:10010: write tcp 127.0.0.1:39294->127.0.0.1:10010: write: broken pipe machine # [ 445.014873] k3s[872]: time="2026-09-23T05:40:10Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:45006->127.0.0.1:10250: write: connection reset by peer" machine # [ 446.300688] k3s[872]: E0923 05:40:12.262720 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56358: use of closed network connection machine # [ 447.583984] k3s[872]: E0923 05:40:13.546087 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56384: use of closed network connection machine # [ 448.858139] k3s[872]: E0923 05:40:14.819805 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56398: use of closed network connection machine # [ 448.860181] k3s[872]: E0923 05:40:14.819892 872 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:39318->127.0.0.1:10010: write tcp 127.0.0.1:39318->127.0.0.1:10010: write: broken pipe machine # [ 448.862668] k3s[872]: time="2026-09-23T05:40:14Z" level=warning msg="Proxy error: read failed: read tcp 127.0.0.1:45042->127.0.0.1:10250: read: connection reset by peer" machine # [ 448.864692] k3s[872]: time="2026-09-23T05:40:14Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:45042->127.0.0.1:10250: write: broken pipe" machine # [ 450.150879] k3s[872]: E0923 05:40:16.113112 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56430: use of closed network connection machine # [ 451.403691] k3s[872]: E0923 05:40:17.365873 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56468: use of closed network connection machine # [ 452.696276] k3s[872]: E0923 05:40:18.658479 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56488: use of closed network connection machine # [ 455.233941] k3s[872]: E0923 05:40:21.196159 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45950: use of closed network connection machine # [ 456.511852] k3s[872]: E0923 05:40:22.473960 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45970: use of closed network connection machine: (finished: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-85f6f9c7c8-8wz9l -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 60.84 seconds) machine: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine: (finished: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 0.04 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1 machine # [ 456.760178] niks3-server[1171]: 2026/09/23 05:40:22 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 456.773910] niks3-server[1171]: 2026/09/23 05:40:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign machine # [ 456.778657] niks3-server[1171]: 2026/09/23 05:40:22 INFO Signed narinfos id=21 count=1 machine # [ 456.781671] niks3-server[1171]: 2026/09/23 05:40:22 INFO Registered completed upload object_key=nar/0g42hgwa9jp9abmqxz90dkwxpybsznzbpsy35rm921mlk5sw56jq.nar.zst machine # [ 456.786583] niks3-server[1171]: 2026/09/23 05:40:22 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.ls machine # [ 456.790673] niks3-server[1171]: 2026/09/23 05:40:22 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete machine # [ 456.794943] niks3-server[1171]: 2026/09/23 05:40:22 INFO Completed upload id=21 machine # [ 456.797170] niks3-server[1171]: 2026/09/23 05:40:22 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.narinfo machine # [ 481.499679] niks3-server[1171]: 2026/09/23 05:40:47 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 481.521560] niks3-server[1171]: 2026/09/23 05:40:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign machine # [ 481.523123] niks3-server[1171]: 2026/09/23 05:40:47 INFO Signed narinfos id=22 count=1 machine # [ 481.528198] niks3-server[1171]: 2026/09/23 05:40:47 INFO Registered completed upload object_key=nar/1vxmmzwi16s4iri6dcmi9v62dpq1ys7wz15b497ncik3sd67nfzg.nar.zst machine # [ 481.530057] niks3-server[1171]: 2026/09/23 05:40:47 INFO Registered completed upload object_key=log/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31-k3s-a.drv machine # [ 481.532149] niks3-server[1171]: 2026/09/23 05:40:47 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.ls machine # [ 481.535109] niks3-server[1171]: 2026/09/23 05:40:47 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete machine # [ 481.537115] niks3-server[1171]: 2026/09/23 05:40:47 INFO Completed upload id=22 machine # [ 481.538598] niks3-server[1171]: 2026/09/23 05:40:47 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo machine # [ 481.605488] niks3-server[1171]: 2026/09/23 05:40:47 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 481.615840] niks3-server[1171]: 2026/09/23 05:40:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign machine # [ 481.618046] niks3-server[1171]: 2026/09/23 05:40:47 INFO Signed narinfos id=23 count=1 machine # [ 481.620669] niks3-server[1171]: 2026/09/23 05:40:47 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.ls machine # [ 481.623448] niks3-server[1171]: 2026/09/23 05:40:47 INFO Registered completed upload object_key=nar/0cbxkyxz068xc5mivh2h67kw6y01n1x28cbs11v1a03g8m4c71zm.nar.zst machine # [ 481.625776] niks3-server[1171]: 2026/09/23 05:40:47 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete machine # [ 481.626669] niks3-server[1171]: 2026/09/23 05:40:47 INFO Completed upload id=23 machine # [ 481.628464] niks3-server[1171]: 2026/09/23 05:40:47 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.narinfo machine # [ 506.320287] niks3-server[1171]: 2026/09/23 05:41:12 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 506.335579] niks3-server[1171]: 2026/09/23 05:41:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign machine # [ 506.337430] niks3-server[1171]: 2026/09/23 05:41:12 INFO Signed narinfos id=24 count=1 machine # [ 506.341535] niks3-server[1171]: 2026/09/23 05:41:12 INFO Registered completed upload object_key=log/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4-k3s-b.drv machine # [ 506.343847] niks3-server[1171]: 2026/09/23 05:41:12 INFO Registered completed upload object_key=nar/0khxywxb2r78vhpc5hsmha3ymgp910z0aka7550jmaqzs333rmzp.nar.zst machine # [ 506.349556] niks3-server[1171]: 2026/09/23 05:41:12 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.ls machine # [ 506.351599] niks3-server[1171]: 2026/09/23 05:41:12 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete machine # [ 506.353582] niks3-server[1171]: 2026/09/23 05:41:12 INFO Completed upload id=24 machine # [ 506.428533] niks3-server[1171]: 2026/09/23 05:41:12 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 506.441154] niks3-server[1171]: 2026/09/23 05:41:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign machine # [ 506.441645] niks3-server[1171]: 2026/09/23 05:41:12 INFO Signed narinfos id=25 count=1 machine # [ 506.444747] niks3-server[1171]: 2026/09/23 05:41:12 INFO Registered completed upload object_key=nar/04bim5f8bvjh25xncf5x40kb529khrlzcbc92qxvapgbc0bdfv2h.nar.zst machine # [ 506.446693] niks3-server[1171]: 2026/09/23 05:41:12 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.ls machine # [ 506.449638] niks3-server[1171]: 2026/09/23 05:41:12 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete machine # [ 506.451668] niks3-server[1171]: 2026/09/23 05:41:12 INFO Completed upload id=25 machine # [ 506.452622] niks3-server[1171]: 2026/09/23 05:41:12 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.narinfo machine # [ 531.368363] niks3-server[1171]: 2026/09/23 05:41:37 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 531.387542] niks3-server[1171]: 2026/09/23 05:41:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign machine # [ 531.389392] niks3-server[1171]: 2026/09/23 05:41:37 INFO Signed narinfos id=26 count=1 machine # [ 531.392670] niks3-server[1171]: 2026/09/23 05:41:37 INFO Registered completed upload object_key=nar/11f7f1hixry25c2yc6np9hs10a2pwwqmymmrxxbswhdjabcyvv0s.nar.zst machine # [ 531.395433] niks3-server[1171]: 2026/09/23 05:41:37 INFO Registered completed upload object_key=log/jz7biafi8rj5r3r392blyazw5mdpvy0d-k3s-top.drv machine # [ 531.397315] niks3-server[1171]: 2026/09/23 05:41:37 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.ls machine # [ 531.400171] niks3-server[1171]: 2026/09/23 05:41:37 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete machine # [ 531.402485] niks3-server[1171]: 2026/09/23 05:41:37 INFO Completed upload id=26 machine # [ 531.404414] niks3-server[1171]: 2026/09/23 05:41:37 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1, in 75.90 seconds) (finished: subtest: a renewed balancer certificate is served without a rollout, in 137.58 seconds) subtest: metrics carry build_info machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-cfb8578f6-74qhn -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-cfb8578f6-74qhn -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.22 seconds) machine: must succeed: curl -sf http://10.42.0.7:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-74qhn"' machine: (finished: must succeed: curl -sf http://10.42.0.7:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-74qhn"', in 0.04 seconds) (finished: subtest: metrics carry build_info, in 0.26 seconds) subtest: harmonia-gc frees space and the worker stays Ready machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-cfb8578f6-74qhn -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'' machine # [ 532.895937] k3s[872]: E0923 05:41:38.858020 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:48490: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-cfb8578f6-74qhn -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'', in 0.19 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-cfb8578f6-74qhn -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done' machine # [ 533.154249] k3s[872]: E0923 05:41:39.116779 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:47874: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-cfb8578f6-74qhn -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done', in 0.26 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-cfb8578f6-74qhn -c gc -- sh -c 'fallocate -l 11441954816 /nix/fill' machine # [ 533.356590] k3s[872]: E0923 05:41:39.319075 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:47902: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-cfb8578f6-74qhn -c gc -- sh -c 'fallocate -l 11441954816 /nix/fill', in 0.20 seconds) machine: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-cfb8578f6-74qhn -c gc --since=30s | grep -q 'store paths deleted' machine: (finished: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-cfb8578f6-74qhn -c gc --since=30s | grep -q 'store paths deleted', in 3.77 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-cfb8578f6-74qhn -c gc -- sh -c 'rm /nix/fill' machine # [ 537.291306] k3s[872]: E0923 05:41:43.253509 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:47970: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-cfb8578f6-74qhn -c gc -- sh -c 'rm /nix/fill', in 0.17 seconds) machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-cfb8578f6-74qhn -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-cfb8578f6-74qhn -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}', in 0.12 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-cfb8578f6-74qhn -c gc -- sh -c 'command -v nix-daemon && command -v niks3' machine # [ 537.576865] k3s[872]: E0923 05:41:43.539253 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:48006: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-cfb8578f6-74qhn -c gc -- sh -c 'command -v nix-daemon && command -v niks3', in 0.16 seconds) (finished: subtest: harmonia-gc frees space and the worker stays Ready, in 4.87 seconds) subtest: losing the balancer mid-build: the client reconnects and the build succeeds machine: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1 machine # [ 537.601583] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1. machine # Running as unit: vialb.service; invocation ID: 9b477851dcc54dae9cdc3c236efef7ae machine: (finished: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1, in 0.02 seconds) machine: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'" machine # [ 537.718101] nix[10665]: don't know how to build these paths: machine # [ 537.718341] nix[10665]: /nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 537.734097] nix[10665]: copying 1 paths to '127.0.0.1:30051'... machine # [ 537.734702] nix[10665]: copying path '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' to '127.0.0.1:30051'... machine # [ 537.775515] niks3-server[1171]: 2026/09/23 05:41:43 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 537.788495] niks3-server[1171]: 2026/09/23 05:41:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign machine # [ 537.789545] niks3-server[1171]: 2026/09/23 05:41:43 INFO Signed narinfos id=27 count=1 machine # [ 537.791577] niks3-server[1171]: 2026/09/23 05:41:43 INFO Registered completed upload object_key=nar/0kkr2vb091wkq0cb0f1q92413dsfskh76wydp8mwysv7rawns0ar.nar.zst machine # [ 537.793681] niks3-server[1171]: 2026/09/23 05:41:43 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.ls machine # [ 537.796192] niks3-server[1171]: 2026/09/23 05:41:43 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete machine # [ 537.798314] niks3-server[1171]: 2026/09/23 05:41:43 INFO Completed upload id=27 machine # [ 537.799813] niks3-server[1171]: 2026/09/23 05:41:43 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.narinfo machine # [ 537.806217] nix[10665]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 537.806529] nix[10665]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-74qhn: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine: (finished: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'", in 1.06 seconds) machine: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false machine: (finished: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false, in 0.24 seconds) machine: waiting for success: ! systemctl is-active vialb machine # [ 538.926580] nix[10665]: d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv: Stream removed (Socket closed), asking the scheduler again machine # [ 538.929985] nix[10665]: scheduler at 127.0.0.1:30051: Stream removed (Socket closed), reconnecting machine # [ 538.944163] systemd[1]: cri-containerd-cfbe2cb5ca7849e859e8f2d25b1b93d1523155fce6f0ec453c23696d01b16477.scope: Deactivated successfully. machine # [ 538.950225] systemd[1]: cri-containerd-cfbe2cb5ca7849e859e8f2d25b1b93d1523155fce6f0ec453c23696d01b16477.scope: Consumed 4.973s CPU time over 8min 19.474s wall clock time, 55.1M memory peak, 32.9M read from disk, 631.4K incoming IP traffic, 781.4K outgoing IP traffic. machine # [ 538.955618] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod66638098_47c4_40e2_bad3_27b389fa3560.slice. machine # [ 538.982538] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-cfbe2cb5ca7849e859e8f2d25b1b93d1523155fce6f0ec453c23696d01b16477-rootfs.mount: Deactivated successfully. machine # [ 539.003199] k3s[872]: I0923 05:41:44.965500 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/66638098-47c4-40e2-bad3-27b389fa3560-config\") pod \"nix-grpc-farm-lb-85f6f9c7c8-v8wkl\" (UID: \"66638098-47c4-40e2-bad3-27b389fa3560\") " pod="farm/nix-grpc-farm-lb-85f6f9c7c8-v8wkl" machine # [ 539.003570] k3s[872]: I0923 05:41:44.965545 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/66638098-47c4-40e2-bad3-27b389fa3560-tls-lb\") pod \"nix-grpc-farm-lb-85f6f9c7c8-v8wkl\" (UID: \"66638098-47c4-40e2-bad3-27b389fa3560\") " pod="farm/nix-grpc-farm-lb-85f6f9c7c8-v8wkl" machine # [ 539.004141] k3s[872]: I0923 05:41:44.965578 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66638098-47c4-40e2-bad3-27b389fa3560-tmp\") pod \"nix-grpc-farm-lb-85f6f9c7c8-v8wkl\" (UID: \"66638098-47c4-40e2-bad3-27b389fa3560\") " pod="farm/nix-grpc-farm-lb-85f6f9c7c8-v8wkl" machine # [ 539.004569] k3s[872]: I0923 05:41:44.965606 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/66638098-47c4-40e2-bad3-27b389fa3560-tls-ca\") pod \"nix-grpc-farm-lb-85f6f9c7c8-v8wkl\" (UID: \"66638098-47c4-40e2-bad3-27b389fa3560\") " pod="farm/nix-grpc-farm-lb-85f6f9c7c8-v8wkl" machine # [ 539.020531] systemd[1]: cri-containerd-f7e2c344f2afa439b553e15f37c455909119dcba68c94bf8827c3f8a7b16d853.scope: Deactivated successfully. machine # [ 539.049219] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-f7e2c344f2afa439b553e15f37c455909119dcba68c94bf8827c3f8a7b16d853-rootfs.mount: Deactivated successfully. machine # [ 539.074600] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-f7e2c344f2afa439b553e15f37c455909119dcba68c94bf8827c3f8a7b16d853-shm.mount: Deactivated successfully. machine # [ 539.259378] cni0: port 4(vethe89cfee7) entered disabled state machine # [ 539.109737] dhcpcd[694]: vethe89cfee7: carrier lost machine # [ 539.262060] vethe89cfee7 (unregistering): left allmulticast mode machine # [ 539.263174] vethe89cfee7 (unregistering): left promiscuous mode machine # [ 539.264169] cni0: port 4(vethe89cfee7) entered disabled state machine # [ 539.135506] dhcpcd[694]: vethe89cfee7: deleting address fe80::e07e:12ff:fe12:319e machine # [ 539.138238] dhcpcd[694]: vethe89cfee7: deleting route to 169.254.0.0/16 machine # [ 539.196341] dhcpcd[694]: vethe89cfee7: removing interface machine # [ 539.204125] k3s[872]: I0923 05:41:45.166658 872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5f1333ce-7689-407b-b56c-677fc2cc48c1-tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f1333ce-7689-407b-b56c-677fc2cc48c1-tmp\") pod \"5f1333ce-7689-407b-b56c-677fc2cc48c1\" (UID: \"5f1333ce-7689-407b-b56c-677fc2cc48c1\") " machine # [ 539.208586] k3s[872]: I0923 05:41:45.166732 872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5f1333ce-7689-407b-b56c-677fc2cc48c1-config\" (UniqueName: \"kubernetes.io/configmap/5f1333ce-7689-407b-b56c-677fc2cc48c1-config\") pod \"5f1333ce-7689-407b-b56c-677fc2cc48c1\" (UID: \"5f1333ce-7689-407b-b56c-677fc2cc48c1\") " machine # [ 539.213049] k3s[872]: I0923 05:41:45.166764 872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5f1333ce-7689-407b-b56c-677fc2cc48c1-tls-ca\" (UniqueName: \"kubernetes.io/secret/5f1333ce-7689-407b-b56c-677fc2cc48c1-tls-ca\") pod \"5f1333ce-7689-407b-b56c-677fc2cc48c1\" (UID: \"5f1333ce-7689-407b-b56c-677fc2cc48c1\") " machine # [ 539.217229] k3s[872]: I0923 05:41:45.166791 872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5f1333ce-7689-407b-b56c-677fc2cc48c1-tls-lb\" (UniqueName: \"kubernetes.io/secret/5f1333ce-7689-407b-b56c-677fc2cc48c1-tls-lb\") pod \"5f1333ce-7689-407b-b56c-677fc2cc48c1\" (UID: \"5f1333ce-7689-407b-b56c-677fc2cc48c1\") " machine # [ 539.221498] k3s[872]: I0923 05:41:45.172641 872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f1333ce-7689-407b-b56c-677fc2cc48c1-tls-lb" pod "5f1333ce-7689-407b-b56c-677fc2cc48c1" (UID: "5f1333ce-7689-407b-b56c-677fc2cc48c1"). InnerVolumeSpecName "tls-lb". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 539.225601] k3s[872]: I0923 05:41:45.179451 872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f1333ce-7689-407b-b56c-677fc2cc48c1-tmp" pod "5f1333ce-7689-407b-b56c-677fc2cc48c1" (UID: "5f1333ce-7689-407b-b56c-677fc2cc48c1"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 539.229667] k3s[872]: I0923 05:41:45.180777 872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f1333ce-7689-407b-b56c-677fc2cc48c1-tls-ca" pod "5f1333ce-7689-407b-b56c-677fc2cc48c1" (UID: "5f1333ce-7689-407b-b56c-677fc2cc48c1"). InnerVolumeSpecName "tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 539.233716] k3s[872]: I0923 05:41:45.185852 872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f1333ce-7689-407b-b56c-677fc2cc48c1-config" pod "5f1333ce-7689-407b-b56c-677fc2cc48c1" (UID: "5f1333ce-7689-407b-b56c-677fc2cc48c1"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 539.287863] (udev-worker)[10874]: Network interface NamePolicy= disabled on kernel command line.[ 539.439931] cni0: port 4(vethc94406d6) entered blocking state machine # machine # [ 539.441149] cni0: port 4(vethc94406d6) entered disabled state machine # [ 539.442177] vethc94406d6: entered allmulticast mode machine # [ 539.443089] vethc94406d6: entered promiscuous mode machine # [ 539.452300] cni0: port 4(vethc94406d6) entered blocking state machine # [ 539.453529] cni0: port 4(vethc94406d6) entered forwarding state machine # [ 539.304747] k3s[872]: I0923 05:41:45.267351 872 reconciler_common.go:299] "Volume detached for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/5f1333ce-7689-407b-b56c-677fc2cc48c1-tls-lb\") on node \"machine\" DevicePath \"\"" machine # [ 539.305138] k3s[872]: I0923 05:41:45.267382 872 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f1333ce-7689-407b-b56c-677fc2cc48c1-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 539.305593] k3s[872]: I0923 05:41:45.267396 872 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5f1333ce-7689-407b-b56c-677fc2cc48c1-config\") on node \"machine\" DevicePath \"\"" machine # [ 539.306154] k3s[872]: I0923 05:41:45.267411 872 reconciler_common.go:299] "Volume detached for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/5f1333ce-7689-407b-b56c-677fc2cc48c1-tls-ca\") on node \"machine\" DevicePath \"\"" machine # [ 539.328947] dhcpcd[694]: vethc94406d6: waiting for carrier machine # [ 539.329311] dhcpcd[694]: vethc94406d6: carrier acquired machine # [ 539.333760] dhcpcd[694]: vethc94406d6: IAID 6c:6e:53:4e machine # [ 539.334134] dhcpcd[694]: vethc94406d6: adding address fe80::742a:6cff:fe6e:534e machine # [ 539.388607] systemd[1]: Started libcontainer container dd293e1f3cc14ebad4af316b7b01891152828316b4d6166160bd2b7a48d52377. machine # [ 539.499482] systemd[1]: Started libcontainer container 137c77c80d71c0916de2f456ae64ae49bde8c6d65bb224892c7c1f9ad69a8cc0. machine # [ 539.593292] dhcpcd[694]: vethc94406d6: soliciting a DHCP lease machine # [ 539.738264] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod5f1333ce_7689_407b_b56c_677fc2cc48c1.slice. machine # [ 539.742220] systemd[1]: kubepods-besteffort-pod5f1333ce_7689_407b_b56c_677fc2cc48c1.slice: Consumed 5.004s CPU time over 8min 22.983s wall clock time, 55.3M memory peak, 32.9M read from disk, 631.4K incoming IP traffic, 781.4K outgoing IP traffic. machine # [ 539.885663] k3s[872]: I0923 05:41:45.848023 872 scope.go:122] "RemoveContainer" containerID="cfbe2cb5ca7849e859e8f2d25b1b93d1523155fce6f0ec453c23696d01b16477" machine # [ 539.905086] k3s[872]: I0923 05:41:45.867564 872 scope.go:122] "RemoveContainer" containerID="cfbe2cb5ca7849e859e8f2d25b1b93d1523155fce6f0ec453c23696d01b16477" machine # [ 539.906139] k3s[872]: E0923 05:41:45.868620 872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"cfbe2cb5ca7849e859e8f2d25b1b93d1523155fce6f0ec453c23696d01b16477\": not found" containerID="cfbe2cb5ca7849e859e8f2d25b1b93d1523155fce6f0ec453c23696d01b16477" machine # [ 539.907487] k3s[872]: I0923 05:41:45.868736 872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"cfbe2cb5ca7849e859e8f2d25b1b93d1523155fce6f0ec453c23696d01b16477"} err="failed to get container status \"cfbe2cb5ca7849e859e8f2d25b1b93d1523155fce6f0ec453c23696d01b16477\": rpc error: code = NotFound desc = an error occurred when try to find container \"cfbe2cb5ca7849e859e8f2d25b1b93d1523155fce6f0ec453c23696d01b16477\": not found" machine # [ 539.964134] k3s[872]: I0923 05:41:45.926252 872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-85f6f9c7c8-v8wkl" podStartSLOduration=1.926209974 podStartE2EDuration="1.926209974s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-23 05:41:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-23 05:41:45.924392704 +0000 UTC m=+524.518818674" watchObservedRunningTime="2026-09-23 05:41:45.926209974 +0000 UTC m=+524.520636223" machine # [ 539.989282] systemd[1]: var-lib-kubelet-pods-5f1333ce\x2d7689\x2d407b\x2db56c\x2d677fc2cc48c1-volume\x2dsubpaths-config-envoy-2.mount: Deactivated successfully. machine # [ 539.989910] systemd[1]: var-lib-kubelet-pods-5f1333ce\x2d7689\x2d407b\x2db56c\x2d677fc2cc48c1-volume\x2dsubpaths-config-envoy-1.mount: Deactivated successfully. machine # [ 539.991309] systemd[1]: var-lib-kubelet-pods-5f1333ce\x2d7689\x2d407b\x2db56c\x2d677fc2cc48c1-volume\x2dsubpaths-config-envoy-0.mount: Deactivated successfully. machine # [ 539.991769] systemd[1]: run-netns-cni\x2db0269bcf\x2db3a9\x2da59e\x2dc572\x2d229ead2585e3.mount: Deactivated successfully. machine # [ 539.992574] systemd[1]: var-lib-kubelet-pods-5f1333ce\x2d7689\x2d407b\x2db56c\x2d677fc2cc48c1-volumes-kubernetes.io\x7esecret-tls\x2dca.mount: Deactivated successfully. machine # [ 539.993086] systemd[1]: var-lib-kubelet-pods-5f1333ce\x2d7689\x2d407b\x2db56c\x2d677fc2cc48c1-volumes-kubernetes.io\x7esecret-tls\x2dlb.mount: Deactivated successfully. machine # [ 539.993576] systemd[1]: var-lib-kubelet-pods-5f1333ce\x2d7689\x2d407b\x2db56c\x2d677fc2cc48c1-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 541.429427] nix[10665]: scheduler at 127.0.0.1:30051: failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:30051: tcp handshaker shutdown, reconnecting machine # [ 541.624633] dhcpcd[694]: vethc94406d6: soliciting an IPv6 router machine # [ 541.723432] k3s[872]: I0923 05:41:47.685131 872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5f1333ce-7689-407b-b56c-677fc2cc48c1" path="/var/lib/kubelet/pods/5f1333ce-7689-407b-b56c-677fc2cc48c1/volumes" machine # [ 542.475833] nix[10665]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 542.476229] nix[10665]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-n8tvr: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 544.595286] dhcpcd[694]: vethc94406d6: probing for an IPv4LL address machine # [ 549.480354] dhcpcd[694]: vethc94406d6: using IPv4LL address 169.254.117.127 machine # [ 549.481667] dhcpcd[694]: vethc94406d6: adding route to 169.254.0.0/16 machine # [ 553.628215] dhcpcd[694]: vethc94406d6: no IPv6 Routers available machine # [ 586.821944] niks3-server[1171]: 2026/09/23 05:42:32 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 586.835104] niks3-server[1171]: 2026/09/23 05:42:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign machine # [ 586.837458] niks3-server[1171]: 2026/09/23 05:42:32 INFO Signed narinfos id=28 count=1 machine # [ 586.841785] niks3-server[1171]: 2026/09/23 05:42:32 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.ls machine # [ 586.843069] niks3-server[1171]: 2026/09/23 05:42:32 INFO Registered completed upload object_key=log/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 586.847183] niks3-server[1171]: 2026/09/23 05:42:32 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete machine # [ 586.850530] niks3-server[1171]: 2026/09/23 05:42:32 INFO Completed upload id=28 machine # [ 586.853908] niks3-server[1171]: 2026/09/23 05:42:32 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.narinfo machine # [ 586.900832] systemd[1]: vialb.service: Deactivated successfully. machine # [ 586.901862] systemd[1]: vialb.service: Consumed 187ms CPU time over 49.299s wall clock time, 42.5M memory peak, 4K written to disk, 8.5K incoming IP traffic, 17.1K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active vialb, in 48.87 seconds) machine: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; }, in 0.03 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 0.19 seconds) (finished: subtest: losing the balancer mid-build: the client reconnects and the build succeeds, in 50.42 seconds) subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes machine: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 machine # [ 588.018916] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1. machine # Running as unit: slow.service; invocation ID: 3305ef6e8d6f40b6b479fd9534c48727 machine: (finished: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1, in 0.02 seconds) machine # [ 588.139214] nix[11660]: don't know how to build these paths: machine # [ 588.140657] nix[11660]: /nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 588.157132] nix[11660]: copying 1 paths to '127.0.0.1:30051'... machine # [ 588.158681] nix[11660]: copying path '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' to '127.0.0.1:30051'... machine # [ 588.192910] niks3-server[1171]: 2026/09/23 05:42:34 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 588.197684] k3s[872]: E0923 05:42:34.160088 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59012: use of closed network connection machine # command terminated with exit code 1 machine # [ 588.205461] niks3-server[1171]: 2026/09/23 05:42:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign machine # [ 588.206241] niks3-server[1171]: 2026/09/23 05:42:34 INFO Signed narinfos id=29 count=1 machine # [ 588.210266] niks3-server[1171]: 2026/09/23 05:42:34 INFO Registered completed upload object_key=nar/0wl2i9xpw0gwrx1xqdgx9ka4n503ky9qhl20pdrdlphn8d6lcx0i.nar.zst machine # [ 588.211654] niks3-server[1171]: 2026/09/23 05:42:34 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete machine # [ 588.215711] niks3-server[1171]: 2026/09/23 05:42:34 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.ls machine # [ 588.218437] niks3-server[1171]: 2026/09/23 05:42:34 INFO Completed upload id=29 machine # [ 588.220077] niks3-server[1171]: 2026/09/23 05:42:34 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.narinfo machine # [ 588.225927] nix[11660]: building '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' on 127.0.0.1:30051... machine # [ 588.226108] nix[11660]: slow-s1> machine/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-74qhn: building zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # command terminated with exit code 1 machine # [ 588.387751] k3s[872]: E0923 05:42:34.350031 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59038: use of closed network connection machine # command terminated with exit code 1 machine # [ 589.667317] k3s[872]: time="2026-09-23T05:42:35Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:34628->127.0.0.1:10250: write: broken pipe" machine # [ 589.667998] k3s[872]: E0923 05:42:35.629255 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59064: use of closed network connection machine # [ 589.839293] k3s[872]: E0923 05:42:35.801852 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59088: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 591.088768] k3s[872]: E0923 05:42:37.051083 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59120: use of closed network connection machine # [ 591.253054] k3s[872]: E0923 05:42:37.215553 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59148: use of closed network connection machine # command terminated with exit code 1 machine # [ 592.511936] k3s[872]: E0923 05:42:38.474229 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59176: use of closed network connection machine # command terminated with exit code 1 machine # [ 592.684847] k3s[872]: E0923 05:42:38.647414 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59214: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 593.956254] k3s[872]: E0923 05:42:39.918533 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45830: use of closed network connection machine # [ 594.119093] k3s[872]: E0923 05:42:40.081496 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45860: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 595.401236] k3s[872]: E0923 05:42:41.359301 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45896: use of closed network connection machine # [ 595.605058] k3s[872]: E0923 05:42:41.567557 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45920: use of closed network connection machine # command terminated with exit code 1 machine # [ 596.881573] k3s[872]: E0923 05:42:42.843799 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45958: use of closed network connection machine # command terminated with exit code 1 machine # [ 597.091878] k3s[872]: E0923 05:42:43.054427 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45980: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 598.397107] k3s[872]: E0923 05:42:44.354930 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46012: use of closed network connection machine # [ 598.564125] k3s[872]: E0923 05:42:44.526662 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46026: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 599.839093] k3s[872]: E0923 05:42:45.801380 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46046: use of closed network connection machine # [ 600.012756] k3s[872]: time="2026-09-23T05:42:45Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:54032->127.0.0.1:10250: write: broken pipe" machine # command terminated with exit code 1 machine # [ 600.015282] k3s[872]: E0923 05:42:45.975653 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46070: use of closed network connection machine # command terminated with exit code 1 machine # [ 601.297133] k3s[872]: E0923 05:42:47.258282 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46084: use of closed network connection machine # [ 601.480566] k3s[872]: E0923 05:42:47.443131 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46102: use of closed network connection machine # command terminated with exit code 1 machine # [ 602.755914] k3s[872]: E0923 05:42:48.718222 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46136: use of closed network connection machine # command terminated with exit code 1 machine # [ 602.920972] k3s[872]: E0923 05:42:48.883560 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46164: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 604.173992] k3s[872]: E0923 05:42:50.136053 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59520: use of closed network connection machine # [ 604.347458] k3s[872]: E0923 05:42:50.310014 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59564: use of closed network connection machine # command terminated with exit code 1 machine # [ 605.647976] k3s[872]: E0923 05:42:51.610278 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59594: use of closed network connection machine # command terminated with exit code 1 machine # [ 605.844949] k3s[872]: E0923 05:42:51.807516 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59622: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 607.137494] k3s[872]: E0923 05:42:53.099644 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59646: use of closed network connection machine # [ 607.303986] k3s[872]: E0923 05:42:53.266459 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59680: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 608.584117] k3s[872]: E0923 05:42:54.546308 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59690: use of closed network connection machine # [ 608.776224] k3s[872]: E0923 05:42:54.738792 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59712: use of closed network connection machine # command terminated with exit code 1 machine # [ 609.971899] postgres[752]: [752] LOG: checkpoint starting: time machine # command terminated with exit code 1 machine # [ 610.065852] k3s[872]: E0923 05:42:56.028065 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59746: use of closed network connection machine # [ 610.241414] k3s[872]: E0923 05:42:56.203872 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59762: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 611.537480] k3s[872]: E0923 05:42:57.498823 872 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:53860->127.0.0.1:10010: write tcp 127.0.0.1:53860->127.0.0.1:10010: write: broken pipe machine # [ 611.539974] k3s[872]: E0923 05:42:57.498870 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59788: use of closed network connection machine # command terminated with exit code 1 machine # [ 612.404710] postgres[752]: [752] LOG: checkpoint complete: wrote 24 buffers (0.1%), wrote 1 SLRU buffers; 0 WAL file(s) added, 0 removed, 0 recycled; write=2.412 s, sync=0.008 s, total=2.433 s; sync files=21, longest=0.003 s, average=0.001 s; distance=234 kB, estimate=4496 kB; lsn=0/1C7B550, redo lsn=0/1C7B4F8 machine # [ 612.971080] k3s[872]: E0923 05:42:58.933081 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35630: use of closed network connection machine # [ 613.150956] k3s[872]: E0923 05:42:59.113542 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35654: use of closed network connection machine: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-cfb8578f6-74qhn --wait=false machine: (finished: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-cfb8578f6-74qhn --wait=false, in 0.13 seconds) machine: must succeed: sleep 5.0 machine # [ 613.322333] systemd[1]: cri-containerd-d8b491355405c3b6a2a5acd0d04ca3bebc943917bac3c3d9eb6be3cddc94a855.scope: Deactivated successfully. machine # [ 613.322561] systemd[1]: cri-containerd-d8b491355405c3b6a2a5acd0d04ca3bebc943917bac3c3d9eb6be3cddc94a855.scope: Consumed 580ms CPU time over 9min 26.772s wall clock time, 14.1M memory peak, 5.8M read from disk. machine # [ 613.358262] systemd[1]: Created slice libcontainer container kubepods-besteffort-podb289da42_895a_430d_93ba_51b578524b0c.slice. machine # [ 613.381716] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-d8b491355405c3b6a2a5acd0d04ca3bebc943917bac3c3d9eb6be3cddc94a855-rootfs.mount: Deactivated successfully. machine # [ 613.448801] k3s[872]: I0923 05:42:59.411371 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/b289da42-895a-430d-93ba-51b578524b0c-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-z68wh\" (UID: \"b289da42-895a-430d-93ba-51b578524b0c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-z68wh" machine # [ 613.449312] k3s[872]: I0923 05:42:59.411408 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b289da42-895a-430d-93ba-51b578524b0c-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-z68wh\" (UID: \"b289da42-895a-430d-93ba-51b578524b0c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-z68wh" machine # [ 613.449791] k3s[872]: I0923 05:42:59.411435 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/b289da42-895a-430d-93ba-51b578524b0c-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-z68wh\" (UID: \"b289da42-895a-430d-93ba-51b578524b0c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-z68wh" machine # [ 613.450481] k3s[872]: I0923 05:42:59.411464 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mglh\" (UniqueName: \"kubernetes.io/projected/b289da42-895a-430d-93ba-51b578524b0c-kube-api-access-8mglh\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-z68wh\" (UID: \"b289da42-895a-430d-93ba-51b578524b0c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-z68wh" machine # [ 613.450991] k3s[872]: I0923 05:42:59.411593 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/b289da42-895a-430d-93ba-51b578524b0c-build\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-z68wh\" (UID: \"b289da42-895a-430d-93ba-51b578524b0c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-z68wh" machine # [ 613.451680] k3s[872]: I0923 05:42:59.411706 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/b289da42-895a-430d-93ba-51b578524b0c-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-z68wh\" (UID: \"b289da42-895a-430d-93ba-51b578524b0c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-z68wh" machine # [ 613.452394] k3s[872]: I0923 05:42:59.411860 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/b289da42-895a-430d-93ba-51b578524b0c-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-z68wh\" (UID: \"b289da42-895a-430d-93ba-51b578524b0c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-z68wh" machine # [ 613.452865] k3s[872]: I0923 05:42:59.411888 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/b289da42-895a-430d-93ba-51b578524b0c-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-z68wh\" (UID: \"b289da42-895a-430d-93ba-51b578524b0c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-z68wh" machine # [ 613.874267] cni0: port 6(veth7a34315a) entered blocking state machine # [ 613.877898] cni0: port 6(veth7a34315a) entered disabled state machine # [ 613.880237] veth7a34315a: entered allmulticast mode machine # [ 613.882471] veth7a34315a: entered promiscuous mode machine # [ 613.897576] cni0: port 6(veth7a34315a) entered blocking state machine # [ 613.898557] cni0: port 6(veth7a34315a) entered forwarding state machine # [ 613.788460] (udev-worker)[13255]: Network interface NamePolicy= disabled on kernel command line. machine # [ 613.819075] dhcpcd[694]: veth7a34315a: IAID 6d:03:92:7f machine # [ 613.819421] dhcpcd[694]: veth7a34315a: adding address fe80::f028:6dff:fe03:927f machine # [ 613.839279] systemd[1]: Started libcontainer container 42c5396c642c7c11ec5cfa778daff84988c02bb772d3dd6d815bc8ff83dfcdee. machine # [ 614.023379] systemd[1]: Started libcontainer container ff659041b5cab1b8de8aeb15ce02ecc58b385ba7d134a695a0df65096dc2d04e. machine # [ 614.488065] dhcpcd[694]: veth7a34315a: soliciting a DHCP lease machine # [ 615.383556] dhcpcd[694]: veth7a34315a: soliciting an IPv6 router machine # [ 616.267431] systemd[1]: cri-containerd-ff659041b5cab1b8de8aeb15ce02ecc58b385ba7d134a695a0df65096dc2d04e.scope: Deactivated successfully. machine # [ 616.271096] systemd[1]: cri-containerd-ff659041b5cab1b8de8aeb15ce02ecc58b385ba7d134a695a0df65096dc2d04e.scope: Consumed 1.018s CPU time over 2.243s wall clock time, 457.9M memory peak, 191.2M read from disk, 129.7M written to disk. machine # [ 616.327430] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-ff659041b5cab1b8de8aeb15ce02ecc58b385ba7d134a695a0df65096dc2d04e-rootfs.mount: Deactivated successfully. machine # [ 617.281647] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped714508054.mount: Deactivated successfully. machine # [ 617.339522] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped1805198662.mount: Deactivated successfully. machine # [ 617.346590] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount613435978.mount: Deactivated successfully. machine # [ 617.407498] systemd[1]: tmp-ovl\x2didmapped1629230911.mount: Deactivated successfully. machine # [ 617.422368] systemd[1]: Started libcontainer container 590bc32f5c1db76f3f9cf6c39ab0c0ddc4eefe3c747105d21cdd5af62f9b3eca. machine # [ 617.619518] systemd[1]: Started libcontainer container c34f21861efc1b8a97a095ec6e8a70ed3bfb05e6851e8acaf8083e9dc5e78894. machine # [ 617.825328] systemd[1]: Started libcontainer container ba4e9fe7f7228205ed5545df09ad21feaf2680a6d5ffba6d653b5120fd9e14a3. machine # [ 618.137914] k3s[872]: I0923 05:43:04.099731 872 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 618.282086] k3s[872]: I0923 05:43:04.243402 872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-z68wh" podStartSLOduration=3.023098257 podStartE2EDuration="5.243383237s" totalImagesPullingTime="0s" totalInitContainerRuntime="2.22028498s" isStatefulPod=false podCreationTimestamp="2026-09-23 05:42:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-23 05:43:04.242339529 +0000 UTC m=+602.836762705" watchObservedRunningTime="2026-09-23 05:43:04.243383237 +0000 UTC m=+602.837806134" machine: (finished: must succeed: sleep 5.0, in 5.03 seconds) machine # [ 618.503544] k3s[872]: E0923 05:43:04.466118 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35698: use of closed network connection machine: waiting for success: ! systemctl is-active slow machine # [ 619.489454] dhcpcd[694]: veth7a34315a: probing for an IPv4LL address machine # [ 624.577971] dhcpcd[694]: veth7a34315a: using IPv4LL address 169.254.193.4 machine # [ 624.578868] dhcpcd[694]: veth7a34315a: adding route to 169.254.0.0/16 machine # [ 627.386922] dhcpcd[694]: veth7a34315a: no IPv6 Routers available machine # [ 632.964726] niks3-server[1171]: 2026/09/23 05:43:18 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 632.987335] niks3-server[1171]: 2026/09/23 05:43:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign machine # [ 632.988375] niks3-server[1171]: 2026/09/23 05:43:18 INFO Signed narinfos id=30 count=1 machine # [ 632.996516] niks3-server[1171]: 2026/09/23 05:43:18 INFO Registered completed upload object_key=log/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 632.998171] niks3-server[1171]: 2026/09/23 05:43:18 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.ls machine # [ 633.000831] niks3-server[1171]: 2026/09/23 05:43:18 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete machine # [ 633.003789] niks3-server[1171]: 2026/09/23 05:43:18 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo machine # [ 633.010865] niks3-server[1171]: 2026/09/23 05:43:18 INFO Completed upload id=30 machine # [ 633.042877] systemd[1]: slow.service: Deactivated successfully. machine # [ 633.043820] systemd[1]: slow.service: Consumed 139ms CPU time over 45.024s wall clock time, 42.1M memory peak, 4K written to disk, 5.3K incoming IP traffic, 11.5K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active slow, in 14.55 seconds) machine: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; }, in 0.02 seconds) machine: must fail: journalctl -u slow | grep -q 'asking the scheduler again' machine: (finished: must fail: journalctl -u slow | grep -q 'asking the scheduler again', in 0.01 seconds) machine: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath, in 0.11 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null, in 0.04 seconds) (finished: subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes, in 45.25 seconds) (finished: run the VM test script, in 634.11 seconds) test script finished in 634.15s cleanup kill QemuMachine (pid 45) machine # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) machine # [2026-09-23T05:43:19Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-09-23T05:43:19Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-09-23T05:43:19Z INFO virtiofsd] Client disconnected, shutting down (finished: cleanup, in 0.97 seconds) additionally exposed symbols: machine, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh