tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 1200.0 seconds run the VM test script machine: waiting for unit k3s.service machine: waiting for the VM to finish booting machine: starting vm machine: QEMU running (pid 45) machine # Disk image does not exist, creating the virtualisation disk image... machine # Formatting '/build/vm-state-machine/tmp.sIhUAfgWqg', fmt=raw size=17179869184 machine # mke2fs 1.47.4 (6-Mar-2025) machine # Discarding device blocks: 0/4194304 done machine # Creating filesystem with 4194304 4k blocks and 1048576 inodes machine # Filesystem UUID: 5f33f235-d74e-4677-b94a-ca977445e2f8 machine # Superblock backups stored on blocks: machine # 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208, machine # 4096000 machine # machine # Allocating group tables: 0/128 done machine # Writing inode tables: 0/128 done machine # Creating journal (32768 blocks): done machine # Writing superblocks and filesystem accounting information: 0/128 done machine # machine # Virtualisation disk image created. machine # Starting virtiofs daemons... machine # [2026-09-25T16:31:41Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-25T16:31:41Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-25T16:31:41Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-25T16:31:41Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-25T16:31:41Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-25T16:31:41Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-25T16:31:41Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-25T16:31:41Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-25T16:31:41Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-25T16:31:41Z INFO virtiofsd] Client connected, servicing requests machine # [2026-09-25T16:31:41Z INFO virtiofsd] Client connected, servicing requests machine # [2026-09-25T16:31:41Z INFO virtiofsd] Client connected, servicing requests machine # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) machine # machine # machine # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+7EFCC730+7EF2C730 CA00 machine # Press Ctrl-B to configure iPXE (PCI 00:02.0)... machine # machine # machine # machine # machine # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 7EFCC730 7EF2C730 CB00 machine # Press Ctrl-B to configure iPXE (PCI 00:05.0)... machine # machine # machine # Booting from ROM... machine # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 machine # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ikr9kcb27rb59nz6f4clv8y0hnda15jd-nixos-system-machine-test/init regInfo=/nix/store/kki4xp6b7npychrvb45nkia5p8ilngwc-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.000000] BIOS-provided physical RAM map: machine # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007ffd7fff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000007ffd8000-0x000000007fffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000017fffffff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved machine # [ 0.000000] NX (Execute Disable) protection: active machine # [ 0.000000] APIC: Static calls initialized machine # [ 0.000000] SMBIOS 2.8 present. machine # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 machine # [ 0.000000] DMI: Memory slots populated: 1/1 machine # [ 0.000000] Hypervisor detected: KVM machine # [ 0.000000] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 machine # [ 0.000000] kvm-clock: using sched offset of 498273241 cycles machine # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns machine # [ 0.000005] tsc: Detected 2400.012 MHz processor machine # [ 0.000809] last_pfn = 0x180000 max_arch_pfn = 0x10000000000 machine # [ 0.000837] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs machine # [ 0.000840] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT machine # [ 0.000878] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.002725] found SMP MP-table at [mem 0x000f5450-0x000f545f] machine # [ 0.002736] Using GB pages for direct mapping machine # [ 0.002819] RAMDISK: [mem 0x7e371000-0x7ffcffff] machine # [ 0.002827] ACPI: Early table checksum verification disabled machine # [ 0.002830] ACPI: RSDP 0x00000000000F5250 000014 (v00 BOCHS ) machine # [ 0.002834] ACPI: RSDT 0x000000007FFE2539 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002838] ACPI: FACP 0x000000007FFE2319 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002845] ACPI: DSDT 0x000000007FFE0040 0022D9 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002847] ACPI: FACS 0x000000007FFE0000 000040 machine # [ 0.002848] ACPI: APIC 0x000000007FFE240D 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002850] ACPI: HPET 0x000000007FFE249D 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002852] ACPI: MCFG 0x000000007FFE24D5 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002853] ACPI: WAET 0x000000007FFE2511 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002854] ACPI: Reserving FACP table memory at [mem 0x7ffe2319-0x7ffe240c] machine # [ 0.002855] ACPI: Reserving DSDT table memory at [mem 0x7ffe0040-0x7ffe2318] machine # [ 0.002856] ACPI: Reserving FACS table memory at [mem 0x7ffe0000-0x7ffe003f] machine # [ 0.002857] ACPI: Reserving APIC table memory at [mem 0x7ffe240d-0x7ffe249c] machine # [ 0.002857] ACPI: Reserving HPET table memory at [mem 0x7ffe249d-0x7ffe24d4] machine # [ 0.002858] ACPI: Reserving MCFG table memory at [mem 0x7ffe24d5-0x7ffe2510] machine # [ 0.002858] ACPI: Reserving WAET table memory at [mem 0x7ffe2511-0x7ffe2538] machine # [ 0.003069] No NUMA configuration found machine # [ 0.003070] Faking a node at [mem 0x0000000000000000-0x000000017fffffff] machine # [ 0.003073] NODE_DATA(0) allocated [mem 0x17fff8780-0x17fffdcff] machine # [ 0.005348] Zone ranges: machine # [ 0.005350] DMA [mem 0x0000000000001000-0x0000000000ffffff] machine # [ 0.005351] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] machine # [ 0.005352] Normal [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005353] Device empty machine # [ 0.005354] Movable zone start for each node machine # [ 0.005355] Early memory node ranges machine # [ 0.005355] node 0: [mem 0x0000000000001000-0x000000000009efff] machine # [ 0.005356] node 0: [mem 0x0000000000100000-0x000000007ffd7fff] machine # [ 0.005357] node 0: [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005358] Initmem setup node 0 [mem 0x0000000000001000-0x000000017fffffff] machine # [ 0.005379] On node 0, zone DMA: 1 pages in unavailable ranges machine # [ 0.005643] On node 0, zone DMA: 97 pages in unavailable ranges machine # [ 0.075801] On node 0, zone Normal: 40 pages in unavailable ranges machine # [ 0.076250] ACPI: PM-Timer IO Port: 0x608 machine # [ 0.076265] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) machine # [ 0.076300] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 machine # [ 0.076303] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) machine # [ 0.076304] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) machine # [ 0.076306] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) machine # [ 0.076307] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) machine # [ 0.076307] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) machine # [ 0.076310] ACPI: Using ACPI (MADT) for SMP configuration information machine # [ 0.076311] ACPI: HPET id: 0x8086a201 base: 0xfed00000 machine # [ 0.076316] TSC deadline timer available machine # [ 0.076320] CPU topo: Max. logical packages: 1 machine # [ 0.076321] CPU topo: Max. logical dies: 1 machine # [ 0.076321] CPU topo: Max. dies per package: 1 machine # [ 0.076325] CPU topo: Max. threads per core: 1 machine # [ 0.076325] CPU topo: Num. cores per package: 4 machine # [ 0.076326] CPU topo: Num. threads per package: 4 machine # [ 0.076326] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs machine # [ 0.076351] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() machine # [ 0.076367] kvm-guest: KVM setup pv remote TLB flush machine # [ 0.076370] kvm-guest: setup PV sched yield machine # [ 0.076380] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] machine # [ 0.076382] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] machine # [ 0.076383] PM: hibernation: Registered nosave memory: [mem 0x7ffd8000-0xffffffff] machine # [ 0.076384] [mem 0xc0000000-0xfed1bfff] available for PCI devices machine # [ 0.076386] Booting paravirtualized kernel on KVM machine # [ 0.076390] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns machine # [ 0.080917] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 machine # [ 0.083060] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288 machine # [ 0.083113] kvm-guest: PV spinlocks enabled machine # [ 0.083115] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) machine # [ 0.083117] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ikr9kcb27rb59nz6f4clv8y0hnda15jd-nixos-system-machine-test/init regInfo=/nix/store/kki4xp6b7npychrvb45nkia5p8ilngwc-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.083215] Unknown kernel command line parameters "regInfo=/nix/store/kki4xp6b7npychrvb45nkia5p8ilngwc-closure-info/registration", will be passed to user space. machine # [ 0.083228] random: crng init done machine # [ 0.083229] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes machine # [ 0.087571] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) machine # [ 0.089673] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) machine # [ 0.089747] software IO TLB: area num 4. machine # [ 0.162186] Fallback order for Node 0: 0 machine # [ 0.162195] Built 1 zonelists, mobility grouping on. Total pages: 1048438 machine # [ 0.162197] Policy zone: Normal machine # [ 0.164667] mem auto-init: stack:all(zero), heap alloc:on, heap free:off machine # [ 0.171742] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 machine # [ 0.180487] allocated 8388608 bytes of page_ext machine # [ 0.190366] ftrace: allocating 48787 entries in 192 pages machine # [ 0.190368] ftrace: allocated 192 pages with 2 groups machine # [ 0.191218] Dynamic Preempt: lazy machine # [ 0.191374] rcu: Preemptible hierarchical RCU implementation. machine # [ 0.191375] rcu: RCU event tracing is enabled. machine # [ 0.191375] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. machine # [ 0.191377] Trampoline variant of Tasks RCU enabled. machine # [ 0.191377] Rude variant of Tasks RCU enabled. machine # [ 0.191377] Tracing variant of Tasks RCU enabled. machine # [ 0.191378] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. machine # [ 0.191379] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 machine # [ 0.191403] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.191405] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.191406] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.195835] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16 machine # [ 0.196117] rcu: srcu_init: Setting srcu_struct sizes based on contention. machine # [ 0.196126] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns machine # [ 0.196241] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) machine # [ 0.199640] Console: colour VGA+ 80x25 machine # [ 0.199643] printk: legacy console [tty0] enabled machine # [ 0.230576] printk: legacy console [ttyS0] enabled machine # [ 0.341630] ACPI: Core revision 20250807 machine # [ 0.342607] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns machine # [ 0.344209] APIC: Switch to symmetric I/O mode setup machine # [ 0.345199] x2apic enabled machine # [ 0.345961] APIC: Switched APIC routing to: physical x2apic machine # [ 0.346843] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask() machine # [ 0.348001] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself() machine # [ 0.349522] kvm-guest: setup PV IPIs machine # [ 0.351074] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 machine # [ 0.352086] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.356279] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) machine # [ 0.357371] x86/cpu: User Mode Instruction Prevention (UMIP) activated machine # [ 0.358414] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 machine # [ 0.360026] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 machine # [ 0.361111] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto machine # [ 0.362276] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl machine # [ 0.363276] Transient Scheduler Attacks: Vulnerable: No microcode machine # [ 0.364275] Spectre V2 : Mitigation: Enhanced / Automatic IBRS machine # [ 0.365276] Speculative Return Stack Overflow: Mitigation: Safe RET machine # [ 0.366275] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization machine # [ 0.367283] Spectre V2 : Enabling IBPB for BPF machine # [ 0.368276] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier machine # [ 0.369276] active return thunk: srso_alias_return_thunk machine # [ 0.370980] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' machine # [ 0.372276] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' machine # [ 0.373275] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' machine # [ 0.374275] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' machine # [ 0.375275] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' machine # [ 0.376275] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' machine # [ 0.377276] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' machine # [ 0.378276] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 machine # [ 0.380076] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 machine # [ 0.381067] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 machine # [ 0.382066] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 machine # [ 0.383064] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 machine # [ 0.384064] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. machine # [ 0.413909] Freeing SMP alternatives memory: 44K machine # [ 0.414278] pid_max: default: 32768 minimum: 301 machine # [ 0.415371] LSM: initializing lsm=capability,landlock,yama,bpf,ima machine # [ 0.416395] landlock: Up and running. machine # [ 0.417276] Yama: becoming mindful. machine # [ 0.418365] LSM support for eBPF active machine # [ 0.419195] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.420354] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.423100] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) machine # [ 0.423826] Performance Events: Fam17h+ core perfctr, AMD PMU driver. machine # [ 0.424281] ... version: 2 machine # [ 0.425021] ... bit width: 48 machine # [ 0.425279] ... generic counters: 6 machine # [ 0.426018] ... generic bitmap: 000000000000003f machine # [ 0.426289] ... fixed-purpose counters: 0 machine # [ 0.427032] ... fixed-purpose bitmap: 0000000000000000 machine # [ 0.427278] ... value mask: 0000ffffffffffff machine # [ 0.428205] ... max period: 00007fffffffffff machine # [ 0.429008] ... global_ctrl mask: 000000000000003f machine # [ 0.429415] signal: max sigframe size: 3376 machine # [ 0.430257] rcu: Hierarchical SRCU implementation. machine # [ 0.430925] rcu: Max phase no-delay instances is 400. machine # [ 0.431471] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level machine # [ 0.436902] smp: Bringing up secondary CPUs ... machine # [ 0.437672] smpboot: x86: Booting SMP configuration: machine # [ 0.438282] .... node #0, CPUs: #1 #2 #3 machine # [ 0.441377] smp: Brought up 1 node, 4 CPUs machine # [ 0.442989] smpboot: Total of 4 processors activated (19200.09 BogoMIPS) machine # [ 0.443752] Memory: 3957896K/4193752K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 220856K reserved, 0K cma-reserved) machine # [ 0.445278] devtmpfs: initialized machine # [ 0.446390] x86/mm: Memory block size: 128MB machine # [ 0.449555] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.451329] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). machine # [ 0.452377] pinctrl core: initialized pinctrl subsystem machine # [ 0.453542] PM: RTC time: 16:31:41, date: 2026-09-25 machine # [ 0.457323] NET: Registered PF_NETLINK/PF_ROUTE protocol family machine # [ 0.459120] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations machine # [ 0.460245] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations machine # [ 0.461819] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations machine # [ 0.462289] audit: initializing netlink subsys (disabled) machine # [ 0.463300] audit: type=2000 audit(1790353901.986:1): state=initialized audit_enabled=0 res=1 machine # [ 0.463532] thermal_sys: Registered thermal governor 'fair_share' machine # [ 0.464279] thermal_sys: Registered thermal governor 'bang_bang' machine # [ 0.465278] thermal_sys: Registered thermal governor 'step_wise' machine # [ 0.466257] thermal_sys: Registered thermal governor 'user_space' machine # [ 0.467064] thermal_sys: Registered thermal governor 'power_allocator' machine # [ 0.468071] cpuidle: using governor menu machine # [ 0.470488] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 machine # [ 0.471552] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] machine # [ 0.472281] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry machine # [ 0.473290] PCI: Using configuration type 1 for base access machine # [ 0.474417] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. machine # [ 0.476372] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages machine # [ 0.478286] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page machine # [ 0.481287] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages machine # [ 0.483282] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page machine # [ 0.491499] ACPI: Added _OSI(Module Device) machine # [ 0.493286] ACPI: Added _OSI(Processor Device) machine # [ 0.495284] ACPI: Added _OSI(Processor Aggregator Device) machine # [ 0.504258] ACPI: 1 ACPI AML tables successfully acquired and loaded machine # [ 0.509982] ACPI: Interpreter enabled machine # [ 0.511335] ACPI: PM: (supports S0 S3 S4 S5) machine # [ 0.513297] ACPI: Using IOAPIC for interrupt routing machine # [ 0.515837] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug machine # [ 0.519285] PCI: Using E820 reservations for host bridge windows machine # [ 0.522908] ACPI: Enabled 2 GPEs in block 00 to 3F machine # [ 0.535579] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) machine # [ 0.538295] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] machine # [ 0.542517] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] machine # [ 0.545601] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] machine # [ 0.549585] PCI host bridge to bus 0000:00 machine # [ 0.551294] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] machine # [ 0.554284] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] machine # [ 0.557284] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] machine # [ 0.560284] pci_bus 0000:00: root bus resource [mem 0x80000000-0xafffffff window] machine # [ 0.563282] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] machine # [ 0.565292] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.568283] pci_bus 0000:00: root bus resource [bus 00-ff] machine # [ 0.570642] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint machine # [ 0.574208] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint machine # [ 0.590442] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] machine # [ 0.593313] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] machine # [ 0.595334] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] machine # [ 0.598855] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] machine # [ 0.604212] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.613302] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] machine # [ 0.616299] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] machine # [ 0.618333] pci 0000:00:02.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref] machine # [ 0.621297] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] machine # [ 0.624590] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.633296] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] machine # [ 0.636299] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] machine # [ 0.637321] pci 0000:00:03.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref] machine # [ 0.641635] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint machine # [ 0.648313] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] machine # [ 0.650294] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] machine # [ 0.652324] pci 0000:00:04.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref] machine # [ 0.653985] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.659302] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] machine # [ 0.660212] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] machine # [ 0.661065] pci 0000:00:05.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref] machine # [ 0.662284] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] machine # [ 0.663846] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint machine # [ 0.669158] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] machine # [ 0.670078] pci 0000:00:06.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref] machine # [ 0.671828] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.675324] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] machine # [ 0.676301] pci 0000:00:07.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref] machine # [ 0.678834] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.682291] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] machine # [ 0.694111] pci 0000:00:08.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref] machine # [ 0.695815] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.699292] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] machine # [ 0.700300] pci 0000:00:09.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref] machine # [ 0.702835] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint machine # [ 0.706311] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] machine # [ 0.707232] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] machine # [ 0.708084] pci 0000:00:0a.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref] machine # [ 0.709860] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.713112] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] machine # [ 0.714994] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] machine # [ 0.715305] pci 0000:00:0b.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref] machine # [ 0.717889] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.720059] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] machine # [ 0.722348] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.727355] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] machine # [ 0.729772] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.737357] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] machine # [ 0.739851] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint machine # [ 0.745301] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] machine # [ 0.748928] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint machine # [ 0.753011] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO machine # [ 0.756888] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint machine # [ 0.766079] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] machine # [ 0.768299] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] machine # [ 0.771118] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint machine # [ 0.775337] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] machine # [ 0.783665] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 machine # [ 0.786667] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 machine # [ 0.787387] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 machine # [ 0.788382] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 machine # [ 0.790384] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 machine # [ 0.791383] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 machine # [ 0.792390] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 machine # [ 0.793374] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 machine # [ 0.794339] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 machine # [ 0.795296] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 machine # [ 0.796290] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 machine # [ 0.797294] ACPI: PCI: Interrupt link GSID configured for IRQ 19 machine # [ 0.798295] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 machine # [ 0.799291] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 machine # [ 0.800290] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 machine # [ 0.802295] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 machine # [ 0.804582] iommu: Default domain type: Translated machine # [ 0.805279] iommu: DMA domain TLB invalidation policy: lazy mode machine # [ 0.806526] ACPI: bus type USB registered machine # [ 0.807350] usbcore: registered new interface driver usbfs machine # [ 0.808304] usbcore: registered new interface driver hub machine # [ 0.809235] usbcore: registered new device driver usb machine # [ 0.810994] NetLabel: Initializing machine # [ 0.812279] NetLabel: domain hash size = 128 machine # [ 0.813054] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO machine # [ 0.813368] NetLabel: unlabeled traffic allowed by default machine # [ 0.815290] PCI: Using ACPI for IRQ routing machine # [ 0.855466] pci 0000:00:01.0: vgaarb: setting as boot VGA device machine # [ 0.856274] pci 0000:00:01.0: vgaarb: bridge control possible machine # [ 0.856274] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none machine # [ 0.858284] vgaarb: loaded machine # [ 0.859080] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 machine # [ 0.859942] hpet0: 3 comparators, 64-bit 100.000000 MHz counter machine # [ 0.864370] clocksource: Switched to clocksource kvm-clock machine # [ 0.867548] VFS: Disk quotas dquot_6.6.0 machine # [ 0.868313] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) machine # [ 0.869862] pnp: PnP ACPI init machine # [ 0.870656] ACPI: IRQ 4 override to edge(!), high(!) machine # [ 0.871604] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved machine # [ 0.873211] pnp: PnP ACPI: found 5 devices machine # [ 0.882912] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns machine # [ 0.884504] clocksource: Switched to clocksource acpi_pm machine # [ 0.885534] NET: Registered PF_INET protocol family machine # [ 0.887073] IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear) machine # [ 0.904047] tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.905604] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) machine # [ 0.907011] TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear) machine # [ 0.909654] TCP bind hash table entries: 32768 (order: 8, 1048576 bytes, linear) machine # [ 0.910998] TCP: Hash tables configured (established 32768 bind 32768) machine # [ 0.912212] MPTCP token hash table entries: 4096 (order: 5, 98304 bytes, linear) machine # [ 0.913542] UDP hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.914682] UDP-Lite hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.916060] NET: Registered PF_UNIX/PF_LOCAL protocol family machine # [ 0.917174] NET: Registered PF_XDP protocol family machine # [ 0.918054] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] machine # [ 0.919122] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] machine # [ 0.920190] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] machine # [ 0.921349] pci_bus 0000:00: resource 7 [mem 0x80000000-0xafffffff window] machine # [ 0.922507] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] machine # [ 0.923665] pci_bus 0000:00: resource 9 [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.925603] ACPI: \_SB_.GSIA: Enabled at IRQ 16 machine # [ 0.927916] ACPI: \_SB_.GSIB: Enabled at IRQ 17 machine # [ 0.930113] ACPI: \_SB_.GSIC: Enabled at IRQ 18 machine # [ 0.932312] ACPI: \_SB_.GSID: Enabled at IRQ 19 machine # [ 0.934134] PCI: CLS 0 bytes, default 64 machine # [ 0.935071] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) machine # [ 0.935663] Trying to unpack rootfs image as initramfs... machine # [ 0.936186] software IO TLB: mapped [mem 0x000000007a371000-0x000000007e371000] (64MB) machine # [ 0.936314] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.959425] Initialise system trusted keyrings machine # [ 0.960651] workingset: timestamp_bits=40 max_order=20 bucket_order=0 machine # [ 0.972110] Key type asymmetric registered machine # [ 0.972908] Asymmetric key parser 'x509' registered machine # [ 0.973784] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) machine # [ 0.975484] io scheduler mq-deadline registered machine # [ 0.976327] io scheduler kyber registered machine # [ 0.979567] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled machine # [ 0.980857] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A machine # [ 0.983206] Linux agpgart interface v0.103 machine # [ 0.984011] ACPI: bus type drm_connector registered machine # [ 0.986536] usbcore: registered new interface driver usbserial_generic machine # [ 0.987648] usbserial: USB Serial support registered for generic machine # [ 0.988642] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. machine # [ 0.988642] Please enable it if your BIOS has the CPPC option. machine # [ 0.990981] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled machine # [ 0.992443] drop_monitor: Initializing network drop monitor service machine # [ 0.993679] NET: Registered PF_INET6 protocol family machine # [ 0.995817] Segment Routing with IPv6 machine # [ 0.996508] In-situ OAM (IOAM) with IPv6 machine # [ 0.998433] IPI shorthand broadcast: enabled machine # [ 1.002802] sched_clock: Marking stable (850010003, 152149069)->(1021629441, -19470369) machine # [ 1.004574] registered taskstats version 1 machine # [ 1.005628] Loading compiled-in X.509 certificates machine # [ 1.015826] Demotion targets for Node 0: null machine # [ 1.016833] Key type .fscrypt registered machine # [ 1.017559] Key type fscrypt-provisioning registered machine # [ 1.018772] ima: No TPM chip found, activating TPM-bypass! machine # [ 1.019706] ima: Allocated hash algorithm: sha1 machine # [ 1.020538] ima: No architecture policies found machine # [ 1.021603] PM: Magic number: 10:74:541 machine # [ 1.023272] RAS: Correctable Errors collector initialized. machine # [ 1.027769] clk: Disabling unused clocks machine # [ 1.028475] PM: genpd: Disabling unused power domains machine # [ 1.225937] Freeing initrd memory: 29052K machine # [ 1.231918] Freeing unused decrypted memory: 2028K machine # [ 1.236994] Freeing unused kernel image (initmem) memory: 3652K machine # [ 1.239145] Write protecting the kernel read-only data: 32768k machine # [ 1.243873] Freeing unused kernel image (text/rodata gap) memory: 1184K machine # [ 1.247680] Freeing unused kernel image (rodata/data gap) memory: 720K machine # [ 1.313645] x86/mm: Checked W+X mappings: passed, no W+X pages found. machine # [ 1.314763] Run /init as init process machine # [ 1.328971] systemd[1]: Inserted module 'autofs4' machine # [ 1.354966] fuse: init (API version 7.45) machine # [ 1.363872] ACPI: \_SB_.GSIG: Enabled at IRQ 22 machine # [ 1.366285] ACPI: \_SB_.GSIH: Enabled at IRQ 23 machine # [ 1.369317] ACPI: \_SB_.GSIE: Enabled at IRQ 20 machine # [ 1.371494] ACPI: \_SB_.GSIF: Enabled at IRQ 21 machine # [ 1.377015] virtiofs virtio5: discovered new tag: nix-store machine # [ 1.378563] virtiofs virtio5: virtio_fs_setup_dax: No cache capability machine # [ 1.386116] virtiofs virtio6: discovered new tag: shared machine # [ 1.399255] virtiofs virtio6: virtio_fs_setup_dax: No cache capability machine # [ 1.402846] virtiofs virtio7: discovered new tag: xchg machine # [ 1.404417] virtiofs virtio7: virtio_fs_setup_dax: No cache capability machine # [ 1.433212] systemd[1]: Successfully made /usr/ read-only. machine # [ 1.770013] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 1.782562] systemd[1]: Detected virtualization kvm. machine # [ 1.784791] systemd[1]: Detected architecture x86-64. machine # [ 1.787071] systemd[1]: Running in initrd. machine # [ 1.789665] systemd[1]: Initializing machine ID from random generator. machine # [ 1.792664] systemd[1]: Hostname set to . machine # [ 1.913579] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 1.955870] systemd[1]: Queued start job for default target Initrd Default Target. machine # [ 1.964658] systemd[1]: Created slice Slice /system/modprobe. machine # [ 1.965842] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 1.967353] systemd[1]: Expecting device /dev/disk/by-label/nixos... machine # [ 1.968517] systemd[1]: Reached target Path Units. machine # [ 1.969455] systemd[1]: Reached target Slice Units. machine # [ 1.970407] systemd[1]: Reached target Swaps. machine # [ 1.971271] systemd[1]: Reached target Timer Units. machine # [ 1.972299] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 1.973556] systemd[1]: Listening on Journal Socket (/dev/log). machine # [ 1.974709] systemd[1]: Listening on Journal Sockets. machine # [ 1.975740] systemd[1]: Listening on udev Control Socket. machine # [ 1.976777] systemd[1]: Listening on udev Kernel Socket. machine # [ 1.977736] systemd[1]: Reached target Socket Units. machine # [ 1.979975] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 1.982283] systemd[1]: Starting Load Kernel Module configfs... machine # [ 1.985229] systemd[1]: Starting Journal Service... machine # [ 1.989239] systemd[1]: Starting Load Kernel Modules... machine # [ 1.990343] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 1.994583] systemd[1]: Starting Coldplug All udev Devices... machine # [ 2.001467] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 2.009252] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 2.010943] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 2.016426] systemd[1]: Finished Load Kernel Module configfs. machine # [ 2.017948] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config machine # [ 2.025280] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. machine # [ 2.027715] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev machine # [ 2.029479] systemd-journald[92]: Collecting audit messages is disabled. machine # [ 2.033688] systemd[1]: Finished Load Kernel Modules. machine # [ 2.037261] systemd[1]: Starting Apply Kernel Variables... machine # [ 2.038965] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 2.045244] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 2.049436] systemd[1]: Finished Apply Kernel Variables. machine # [ 2.057533] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 2.058889] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 2.060132] systemd[1]: Reached target Local File Systems. machine # [ 2.062099] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 2.071368] systemd[1]: Started Journal Service. machine # [ 1.919311] systemd-modules-load[93]: Using 4 probe threads machine # [ 1.921392] systemd-modules-load[93]: Inserted module 'virtio_balloon' machine # [ 1.922456] systemd-modules-load[93]: Inserted module 'dm_mod' machine # [ 1.923421] systemd-modules-load[93]: Inserted module 'virtio_gpu' machine # [ 1.924436] systemd[1]: Starting Create System Files and Directories... machine # [ 1.934914] systemd[1]: Finished Create System Files and Directories. machine # [ 1.938795] systemd-udevd[104]: Using default interface naming scheme 'v261'. machine # [ 1.949794] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 1.983595] systemd[1]: Finished Coldplug All udev Devices. machine # [ 1.984443] systemd[1]: Reached target System Initialization. machine # [ 1.985292] systemd[1]: Reached target Basic System. machine # [ 2.223811] virtio_blk virtio2: 4/0/0 default/read/poll queues machine # [ 2.233364] uhci_hcd 0000:00:1d.0: UHCI Host Controller machine # [ 2.236621] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 1 machine # [ 2.237893] uhci_hcd 0000:00:1d.0: detected 2 ports machine # [ 2.240747] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 machine # [ 2.242190] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.242447] virtio_blk virtio2: [vda] 33554432 512-byte logical blocks (17.2 GB/16.0 GiB) machine # [ 2.242529] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.247017] usb usb1: Product: UHCI Host Controller machine # [ 2.247758] usb usb1: Manufacturer: Linux 6.18.52 uhci_hcd machine # [ 2.248589] usb usb1: SerialNumber: 0000:00:1d.0 machine # [ 2.248728] SCSI subsystem initialized machine # [ 2.251620] hub 1-0:1.0: USB hub found machine # [ 2.252501] hub 1-0:1.0: 2 ports detected machine # [ 2.254321] ehci-pci 0000:00:1d.7: EHCI Host Controller machine # [ 2.255948] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 2 machine # [ 2.258631] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 machine # [ 2.265205] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 machine # [ 2.266547] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 machine # [ 2.268269] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.268410] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 machine # [ 2.268644] usb usb2: Product: EHCI Host Controller machine # [ 2.272512] usb usb2: Manufacturer: Linux 6.18.52 ehci_hcd machine # [ 2.272584] serio: i8042 KBD port at 0x60,0x64 irq 1 machine # [ 2.272777] usb usb2: SerialNumber: 0000:00:1d.7 machine # [ 2.272995] serio: i8042 AUX port at 0x60,0x64 irq 12 machine # [ 2.276033] hub 2-0:1.0: USB hub found machine # [ 2.276780] hub 2-0:1.0: 6 ports detected machine # [ 2.140059] systemd[1]: Starting Virtual Console Setup... machine # [ 2.312293] hub 1-0:1.0: USB hub found machine # [ 2.312944] hub 1-0:1.0: 2 ports detected machine # [ 2.316316] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 machine # [ 2.318294] uhci_hcd 0000:00:1d.1: UHCI Host Controller machine # [ 2.319190] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 machine # [ 2.320382] uhci_hcd 0000:00:1d.1: detected 2 ports machine # [ 2.321293] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 machine # [ 2.321478] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.324977] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.326185] usb usb3: Product: UHCI Host Controller machine # [ 2.326982] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd machine # [ 2.328071] usb usb3: SerialNumber: 0000:00:1d.1 machine # [ 2.329707] hub 3-0:1.0: USB hub found machine # [ 2.330411] hub 3-0:1.0: 2 ports detected machine # [ 2.186544] (udev-worker)[125]: Network interface NamePolicy= disabled on ker[ 2.339974] uhci_hcd 0000:00:1d.2: UHCI Host Controller machine # nel command line. machine # [ 2.341057] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 machine # [ 2.189723] (udev-worker)[138]: 2.342741] uhci_hcd 0000:00:1d.2: detected 2 ports machine # 1;38:5:185meth1: Config file /etc/systemd/networ[ 2.344032] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 machine # k/40-eth1.link is applied to device based on potentially unpredictable interface[ 2.345466] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # name. machine # [ 2.346937] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.195372] (udev-worker)[138]: Network inter[ 2.348272] usb usb4: Product: UHCI Host Controller machine # face NamePolicy= disabled on kernel command line[ 2.349488] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd machine # . machine # [ 2.350877] usb usb4: SerialNumber: 0000:00:1d.2 machine # [ 2.199270] systemd-vconsole-setup[145]: Configurati[ 2.352446] hub 4-0:1.0: USB hub found machine # on of first virtual console was skipped, ignorin[ 2.353542] hub 4-0:1.0: 2 ports detected machine # g remaining ones. machine # [ 2.203214] systemd[1]: Finished Virtual Console Setup. machine # [ 2.210826] systemd[1]: Found device /dev/disk/by-label/nixos. machine # [ 2.211749] systemd[1]: Reached target Initrd Root Device. machine # [ 2.212516] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... machine # [ 2.371447] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode machine # [ 2.372752] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) machine # [ 2.373717] ahci 0000:00:1f.2: flags: 64bit ncq only machine # [ 2.376509] scsi host0: ahci machine # [ 2.377422] scsi host1: ahci machine # [ 2.379334] scsi host2: ahci machine # [ 2.380317] scsi host3: ahci machine # [ 2.381265] scsi host4: ahci machine # [ 2.382611] scsi host5: ahci machine # [ 2.383297] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 50 lpm-pol 1 machine # [ 2.385034] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 50 lpm-pol 1 machine # [ 2.386347] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 50 lpm-pol 1 machine # [ 2.387623] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 50 lpm-pol 1 machine # [ 2.389072] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 50 lpm-pol 1 machine # [ 2.237775] systemd-fsck[165][ 2.390568] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 50 lpm-pol 1 machine # : nixos: clean, 12/1048576 files, 109865/4194304 blocks machine # [ 2.242192] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. machine # [ 2.525279] usb 2-1: new high-speed USB device number 2 using ehci-pci machine # [ 2.654593] usb 2-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 machine # [ 2.655918] usb 2-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 machine # [ 2.657213] usb 2-1: Product: QEMU USB Tablet machine # [ 2.657963] usb 2-1: Manufacturer: QEMU machine # [ 2.658564] usb 2-1: SerialNumber: 28754-0000:00:1d.7-1 machine # [ 2.691330] hid: raw HID events driver (C) Jiri Kosina machine # [ 2.708163] ata4: SATA link down (SStatus 0 SControl 300) machine # [ 2.709351] ata5: SATA link down (SStatus 0 SControl 300) machine # [ 2.711622] ata6: SATA link down (SStatus 0 SControl 300) machine # [ 2.713903] ata1: SATA link down (SStatus 0 SControl 300) machine # [ 2.715017] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) machine # [ 2.717613] ata2: SATA link down (SStatus 0 SControl 300) machine # [ 2.719790] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 machine # [ 2.721910] ata3.00: applying bridge limits machine # [ 2.723854] ata3.00: configured for UDMA/100 machine # [ 2.726523] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 machine # [ 2.763113] usbcore: registered new interface driver usbhid machine # [ 2.763983] usbhid: USB HID core driver machine # [ 2.768752] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb2/2-1/2-1:1.0/0003:0627:0001.0001/input/input2 machine # [ 2.770770] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 machine # [ 2.795746] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray machine # [ 2.819541] cdrom: Uniform CD-ROM driver Revision: 3.20 machine # [ 2.846607] systemd[1]: Mounting /sysroot... machine # [ 3.153855] EXT4-fs (vda): mounted filesystem 5f33f235-d74e-4677-b94a-ca977445e2f8 r/w with ordered data mode. Quota mode: none. machine # [ 3.008093] systemd[1]: Mounted /sysroot. machine # [ 3.009383] systemd[1]: Reached target Initrd Root File System. machine # [ 3.011084] systemd[1]: Mounting /sysroot/nix/.ro-store... machine # [ 3.012344] systemd[1]: Mounting /sysroot/nix/.rw-store... machine # [ 3.014232] systemd[1]: Mounting /sysroot/run... machine # [ 3.016134] systemd[1]: Mounting /sysroot/tmp/shared... machine # [ 3.025095] systemd[1]: Mounting /sysroot/tmp/xchg... machine # [ 3.027307] systemd[1]: Starting Mountpoints Configured in the Real Root... machine # [ 3.036571] systemd[1]: Mounted /sysroot/nix/.ro-store. machine # [ 3.037809] systemd[1]: Mounted /sysroot/nix/.rw-store. machine # [ 3.038601] systemd[1]: Mounted /sysroot/run. machine # [ 3.039315] systemd[1]: Mounted /sysroot/tmp/shared. machine # [ 3.044309] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.045390] systemd-sysroot-fstab-check[194]: /sysroot should be mounted in the initrd, will request daemon-reload. machine # [ 3.046895] systemd[1]: Reload requested from client PID 194 ('systemd-sysroot') (unit initrd-parse-etc.service)... machine # [ 3.049046] systemd[1]: Reloading... machine # [ 3.103860] systemd[1]: Reloading finished in 56 ms. machine # [ 3.125140] systemd-sysroot-fstab-check[194]: Requesting initrd-fs.target/start/replace... machine # [ 3.128058] systemd[1]: Mounted /sysroot/tmp/xchg. machine # [ 3.129946] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.132533] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.134710] systemd-sysroot-fstab-check[194]: Requesting swap.target/start/replace... machine # [ 3.137419] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.139561] systemd[1]: initrd-parse-etc.service: Deactivated successfully. machine # [ 3.141964] systemd[1]: Finished Mountpoints Configured in the Real Root. machine # [ 3.144409] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. machine # [ 3.148617] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.151096] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.848464] systemd[1]: Mounting /sysroot/nix/store... machine # [ 3.900523] systemd[1]: Mounted /sysroot/nix/store. machine # [ 3.902431] systemd[1]: Reached target Initrd File Systems. machine # [ 3.904640] systemd[1]: Starting Find NixOS closure... machine # [ 3.906643] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... machine # [ 3.933370] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. machine # [ 3.936140] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. machine # [ 3.954369] systemd[1]: Finished Find NixOS closure. machine # [ 3.956262] systemd[1]: Reached target Initrd Default Target. machine # [ 3.958488] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... machine # [ 3.994702] systemd[1]: Stopped target Initrd Default Target. machine # [ 3.996865] systemd[1]: Stopped target Basic System. machine # [ 3.998731] systemd[1]: Stopped target Initrd Root Device. machine # [ 4.000723] systemd[1]: Stopped target Path Units. machine # [ 4.002539] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. machine # [ 4.006144] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. machine # [ 4.010594] systemd[1]: Stopped target Slice Units. machine # [ 4.012447] systemd[1]: Stopped target Socket Units. machine # [ 4.016695] systemd[1]: Stopped target System Initialization. machine # [ 4.018856] systemd[1]: Stopped target Swaps. machine # [ 4.020663] systemd[1]: Stopped target Timer Units. machine # [ 4.022478] systemd[1]: dbus.socket: Deactivated successfully. machine # [ 4.024629] systemd[1]: Closed D-Bus System Message Bus Socket. machine # [ 4.026847] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. machine # [ 4.029570] systemd[1]: Stopped Find NixOS closure. machine # [ 4.031535] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 4.033253] systemd[1]: systemd-sysctl.service: Deactivated successfully. machine # [ 4.034994] systemd[1]: Stopped Apply Kernel Variables. machine # [ 4.036399] systemd[1]: systemd-modules-load.service: Deactivated successfully. machine # [ 4.038263] systemd[1]: Stopped Load Kernel Modules. machine # [ 4.039605] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. machine # [ 4.041572] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. machine # [ 4.043501] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. machine # [ 4.045387] systemd[1]: Stopped Create System Files and Directories. machine # [ 4.047061] systemd[1]: Stopped target Local File Systems. machine # [ 4.048501] systemd[1]: Stopped target Preparation for Local File Systems. machine # [ 4.050297] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. machine # [ 4.051412] systemd[1]: Stopped Coldplug All udev Devices. machine # [ 4.052197] systemd[1]: Stopping Rule-based Manager for Device Events and Files... machine # [ 4.053241] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 4.054316] systemd[1]: Stopped Virtual Console Setup. machine # [ 4.055061] systemd[1]: initrd-cleanup.service: Deactivated successfully. machine # [ 4.055988] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. machine # [ 4.056951] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 4.057920] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 4.058796] systemd[1]: systemd-udevd.service: Deactivated successfully. machine # [ 4.059842] systemd[1]: Stopped Rule-based Manager for Device Events and Files. machine # [ 4.060868] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. machine # [ 4.061870] systemd[1]: Closed udev Control Socket. machine # [ 4.062553] systemd[1]: Starting Cleanup udev Database... machine # [ 4.063313] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. machine # [ 4.064356] systemd[1]: Stopped Create Static Device Nodes in /dev. machine # [ 4.065196] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. machine # [ 4.066295] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. machine # [ 4.067254] systemd[1]: kmod-static-nodes.service: Deactivated successfully. machine # [ 4.068188] systemd[1]: Stopped Create List of Static Device Nodes. machine # [ 4.078394] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. machine # [ 4.079578] systemd[1]: Finished Cleanup udev Database. machine # [ 4.080303] systemd[1]: Reached target Switch Root. machine # [ 4.081541] systemd[1]: Starting NixOS Activation... machine # [ 4.237115] initrd-nixos-activation-start[240]: booting system configuration /nix/store/ikr9kcb27rb59nz6f4clv8y0hnda15jd-nixos-system-machine-test machine # [ 4.306764] initrd-nixos-activation-start[240]: running activation script... machine # [ 4.676151] initrd-nixos-activation-start[263]: setting up /etc... machine # [ 4.857299] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. machine # [ 4.858563] systemd[1]: Finished NixOS Activation. machine # [ 4.859354] systemd[1]: Starting Switch Root... machine # [ 4.890618] systemd[1]: Switching root. machine # [ 5.099466] systemd-journald[92]: Received SIGTERM from PID 1 (systemd). machine # [ 5.220682] NET: Registered PF_VSOCK protocol family machine # [ 5.611420] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 5.621888] systemd[1]: Detected virtualization kvm. machine # [ 5.623862] systemd[1]: Detected architecture x86-64. machine # [ 5.625971] systemd[1]: Detected first boot. machine # [ 5.630485] systemd[1]: Initializing machine ID from random generator. machine # [ 5.793017] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 5.885420] systemd[1]: Applying preset policy. machine # [ 6.138270] systemd[1]: Populated /etc with preset unit settings. machine # [ 6.412698] systemd[1]: initrd-switch-root.service: Deactivated successfully. machine # [ 6.414232] systemd[1]: Stopped initrd-switch-root.service. machine # [ 6.416826] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. machine # [ 6.419206] systemd[1]: Created slice Slice /system/getty. machine # [ 6.420759] systemd[1]: Created slice User and Session Slice. machine # [ 6.421939] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 6.423314] systemd[1]: Started Forward Password Requests to Wall Directory Watch. machine # [ 6.424572] systemd[1]: Expecting device /dev/hvc0... machine # [ 6.425403] systemd[1]: Expecting device /dev/ttyS0... machine # [ 6.426332] systemd[1]: Reached target Local Encrypted Volumes. machine # [ 6.427266] systemd[1]: Stopped target initrd-fs.target. machine # [ 6.428167] systemd[1]: Stopped target initrd-root-fs.target. machine # [ 6.429087] systemd[1]: Stopped target initrd-switch-root.target. machine # [ 6.430221] systemd[1]: Reached target Virtual Machines and Containers. machine # [ 6.431316] systemd[1]: Reached target Path Units. machine # [ 6.432164] systemd[1]: Reached target Remote File Systems. machine # [ 6.433042] systemd[1]: Reached target Slice Units. machine # [ 6.433892] systemd[1]: Reached target Swaps. machine # [ 6.436191] systemd[1]: Listening on Query the User Interactively for a Password. machine # [ 6.439243] systemd[1]: Listening on Process Core Dump Socket. machine # [ 6.441544] systemd[1]: Listening on Credential Encryption/Decryption. machine # [ 6.443874] systemd[1]: Listening on Factory Reset Management. machine # [ 6.444919] systemd[1]: Listening on Hostname Service Socket. machine # [ 6.451295] systemd[1]: Starting Journal Log Access Socket... machine # [ 6.454451] systemd[1]: Listening on Journal Audit Socket. machine # [ 6.459277] systemd[1]: Listening on Console Output Muting Service Socket. machine # [ 6.462097] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. machine # [ 6.465033] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.468454] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki machine # [ 6.478090] systemd[1]: Listening on Disk Repartitioning Service Socket. machine # [ 6.480901] systemd[1]: Listening on udev Control Socket. machine # [ 6.483311] systemd[1]: Listening on udev Varlink Socket. machine # [ 6.488656] systemd[1]: Mounting Huge Pages File System... machine # [ 6.493930] systemd[1]: Mounting POSIX Message Queue File System... machine # [ 6.501681] systemd[1]: Mounting Kernel Debug File System... machine # [ 6.506843] systemd[1]: Mounting Kernel Trace File System... machine # [ 6.516501] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 6.521668] systemd[1]: Starting Load Kernel Module configfs... machine # [ 6.523617] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm machine # [ 6.526950] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.530403] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.536608] systemd[1]: Mounting FUSE Control File System... machine # [ 6.538507] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.550295] systemd[1]: Starting Journal Service... machine # [ 6.553831] systemd[1]: Starting Load Kernel Modules... machine # [ 6.558398] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... machine # [ 6.563725] systemd[1]: Starting Remount Root and Kernel File Systems... machine # [ 6.564842] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.568639] systemd[1]: Starting Coldplug All udev Devices... machine # [ 6.574850] systemd[1]: Listening on Journal Log Access Socket. machine # [ 6.577169] systemd[1]: Mounted Huge Pages File System. machine # [ 6.579230] systemd[1]: Mounted POSIX Message Queue File System. machine # [ 6.581486] systemd[1]: Mounted Kernel Debug File System. machine # [ 6.583506] systemd[1]: Mounted Kernel Trace File System. machine # [ 6.586532] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 6.589064] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 6.591959] systemd[1]: Finished Load Kernel Module configfs. machine # [ 6.594080] systemd-journald[333]: Collecting audit messages is enabled. machine # [ 6.594121] systemd[1]: Mounted FUSE Control File System. machine # [ 6.598312] EXT4-fs (vda): re-mounted 5f33f235-d74e-4677-b94a-ca977445e2f8. machine # [ 6.598822] systemd[1]: Mounting Kernel Configuration File System... machine # [ 6.456347] systemd[1]: Queue[ 6.608209] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # d start job for default target Multi-User System. machine # [ 6.458742] systemd[1]: systemd-journald.serv[ 6.610993] systemd[1]: Started Journal Service. machine # ice: Deactivated successfully. machine # [ 6.461715] systemd-modules-load[334]: Using 2 probe threads machine # [ 6.462926] systemd[1]: Finished Remount Root and Kernel File Systems. machine # [ 6.466321] systemd[1]: Listening on Disk Image Download Service Socket. machine # [ 6.619292] loop: module loaded machine # [ 6.468210] systemd[1]: Starting Flush Journal to Persistent Storage... machine # [ 6.470661] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.474158] systemd[1]: Starting Load/Save OS Random Seed... machine # [ 6.475311] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.476778] systemd-modules-load[334]: Inserted module 'loop' machine # [ 6.479218] systemd[1]: Finished Load Kernel Modules. machine # [ 6.480666] systemd[1]: Mounted Kernel Configuration File System. machine # [ 6.484701] systemd[1]: Starting Apply Kernel Variables... machine # [ 6.488203] systemd-oomd[335]: No swap; memory pressure usage will be degraded machine # [ 6.490248] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. machine # [ 6.648952] systemd-journald[333]: Received client request to flush runtime journal. machine # [ 6.554602] systemd[1]: Finished Load/Save OS Random Seed. machine # [ 6.555900] systemd[1]: Reached target First Boot Complete. machine # [ 6.556923] systemd[1]: Finished Apply Kernel Variables. machine # [ 6.557811] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 6.558957] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 6.559971] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 6.560931] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 6.561956] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 6.563109] systemd[1]: Finished Flush Journal to Persistent Storage. machine # [ 6.593238] systemd[1]: Finished Coldplug All udev Devices. machine # [ 6.605522] systemd-udevd[364]: Using default interface naming scheme 'v261'. machine # [ 6.644126] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 6.732684] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.760401] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. machine # [ 6.774607] (udev-worker)[373]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 6.778517] (udev-worker)[373]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.780850] (udev-worker)[390]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.788594] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. machine # [ 6.809452] systemd[1]: Condition check resulted in Virtio network device being skipped. machine # [ 6.810865] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.812459] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.815177] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.816846] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.818179] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.981080] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console machine # [ 6.997621] Console: switching to colour dummy device 80x25 machine # [ 6.999379] [drm] Found bochs VGA, ID 0xb0c5. machine # [ 6.999883] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. machine # [ 7.001742] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic machine # [ 7.003504] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 machine # [ 7.010659] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input3 machine # [ 7.012879] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized machine # [ 7.016166] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input4 machine # [ 7.037735] Console: switching to colour frame buffer device 160x50 machine # [ 7.040874] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device machine # [ 7.058074] parport_pc 00:02: reported by Plug and Play ACPI machine # [ 7.058115] mousedev: PS/2 mouse device common for all mice machine # [ 7.061760] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] machine # [ 7.062787] ACPI: button: Power Button [PWRF] machine # [ 7.062827] rtc_cmos PNP0B00:00: RTC can wake from S4 machine # [ 7.064774] rtc_cmos PNP0B00:00: registered as rtc0 machine # [ 7.065610] rtc_cmos PNP0B00:00: setting system clock to 2026-09-25T16:31:48 UTC (1790353908) machine # [ 7.068455] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs machine # [ 7.080353] systemd-journald[333]: Time jumped backwards, rotating. machine # [ 7.117095] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt machine # [ 7.118662] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD machine # [ 7.122163] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 machine # [ 7.123797] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 machine # [ 6.993113] systemd[1]: Starting Virtual Console Setup... machine # [ 7.004192] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 7.010063] systemd[1]: Stopped Virtual Console Setup. machine # [ 7.018215] systemd[1]: Starting Virtual Console Setup... machine # [ 7.034409] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 7.037156] systemd[1]: Stopped Virtual Console Setup. machine # [ 7.052164] systemd[1]: Starting Virtual Console Setup... machine # [ 7.217479] ppdev: user-space parallel port driver machine # [ 7.221532] iTCO_wdt iTCO_wdt.0.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) machine # [ 7.223013] iTCO_wdt iTCO_wdt.0.auto: initialized. heartbeat=30 sec (nowayout=0) machine # [ 7.245868] kvm_amd: TSC scaling supported machine # [ 7.246567] kvm_amd: Nested Virtualization enabled machine # [ 7.247235] kvm_amd: Nested Paging enabled machine # [ 7.247687] kvm_amd: LBR virtualization supported machine # [ 7.248319] kvm_amd: Virtual VMLOAD VMSAVE supported machine # [ 7.248906] kvm_amd: Virtual GIF supported machine # [ 7.250148] kvm_amd: Virtual NMI enabled machine # [ 7.349806] EDAC MC: Ver: 3.0.0 machine # [ 7.208469] systemd-vconsole-setup[408]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 7.211355] systemd[1]: Finished Virtual Console Setup. machine # [ 7.262839] systemd[1]: Mounting /run/wrappers... machine # [ 7.292714] systemd[1]: Mounted /run/wrappers. machine # [ 7.295509] systemd[1]: Reached target Local File Systems. machine # [ 7.299661] systemd[1]: Listening on Boot Loader Control Service Socket. machine # [ 7.304807] systemd[1]: Starting register-nix-paths.service... machine # [ 7.309928] systemd[1]: Starting Create SUID/SGID Wrappers... machine # [ 7.312147] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. machine # [ 7.319090] systemd[1]: Starting Save Transient machine-id to Disk... machine # [ 7.321217] systemd[1]: Starting Create System Files and Directories... machine # [ 7.384094] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. machine # [ 7.387236] systemd[1]: Finished Save Transient machine-id to Disk. machine # [ 7.398567] systemd[1]: Finished Create System Files and Directories. machine # [ 7.401589] systemd[1]: Starting Rebuild Journal Catalog... machine # [ 7.402988] systemd[1]: Starting Record System Boot/Shutdown in UTMP... machine # [ 7.429932] systemd[1]: Finished Record System Boot/Shutdown in UTMP. machine # [ 7.442191] systemd[1]: Finished Rebuild Journal Catalog. machine # [ 7.444184] systemd[1]: Starting Update is Completed... machine # [ 7.469896] systemd[1]: Finished Update is Completed. machine # [ 7.583553] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. machine # [ 7.584683] systemd[1]: Finished Create SUID/SGID Wrappers. machine # [ 7.838867] systemd[1]: Finished register-nix-paths.service. machine # [ 7.841247] systemd[1]: Reached target System Initialization. machine # [ 7.843401] systemd[1]: Started Discard unused filesystem blocks once a week. machine # [ 7.845960] systemd[1]: Started niks3 garbage collection timer. machine # [ 7.848249] systemd[1]: Started Daily Cleanup of Temporary Directories. machine # [ 7.850653] systemd[1]: Reached target Timer Units. machine # [ 7.852592] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 7.854969] systemd[1]: Listening on niks3 server socket. machine # [ 7.857144] systemd[1]: Listening on Nix Daemon Socket. machine # [ 7.859159] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. machine # [ 7.862230] systemd[1]: Reached target Socket Units. machine # [ 7.864212] systemd[1]: Reached target Basic System. machine # [ 7.866280] systemd[1]: Started backdoor.service. machine # [ 7.868161] systemd[1]: Starting Import lastlog data into lastlog2 database... machine # [ 7.870906] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 7.873633] systemd[1]: Starting Post-Boot Actions... machine # [ 7.875840] systemd[1]: Started Reset console on configuration changes. machine # [ 7.878705] systemd[1]: Starting resolvconf update... machine # [ 7.887095] systemd[1]: Started rustfs.service. machine # [ 7.890853] systemd[1]: Starting rustfs-bucket.service... machine # [ 7.893201] systemd[1]: Starting D-Bus System Message Bus... machine # [ 7.911723] systemd[1]: Finished Post-Boot Actions. machine # connecting to host... machine # [ 7.940641] nsncd[492]: Sep 25 16:31:49.526 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 7.941792] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 7.942962] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 7.944054] systemd[1]: Reached target User and Group Name Lookups. machine # [ 7.946565] systemd[1]: Starting User Login Management... machine # [ 7.973109] systemd[1]: Finished Import lastlog data into lastlog2 database. machine: Guest shell says: b'Spawning backdoor root shell...\n' machine: connected to guest root shell machine: (connecting took 8.64 seconds) machine: (finished: waiting for the VM to finish booting, in 8.86 seconds) machine # [ 8.000793] dbus-broker-launch[498]: Looking up NSS user entry for 'systemd-timesync'... machine # [ 8.009550] systemd[1]: Stopped target Host and Network Name Lookups. machine # [ 8.011173] systemd[1]: Stopping Host and Network Name Lookups... machine # [ 8.015128] systemd[1]: Stopped target User and Group Name Lookups. machine # [ 8.015629] dbus-broker-launch[498]: NSS returned no entry for 'systemd-timesync' machine # [ 8.018828] dbus-broker-launch[498]: Invalid user-name in /nix/store/d3mrkr0v9x5sgbb0rb2pnsl0mysb1m4x-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" machine # [ 8.019844] systemd[1]: Stopping User and Group Name Lookups... machine # [ 8.020813] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... machine # [ 8.021584] systemd[1]: nscd.service: Deactivated successfully. machine # [ 8.022414] systemd[1]: Stopped Name Service Cache Daemon (nsncd). machine # [ 8.023332] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 8.025959] systemd[1]: Started D-Bus System Message Bus. machine # [ 8.029469] systemd-logind[524]: New seat seat0. machine # [ 8.032563] systemd-logind[524]: Watching system buttons on /dev/input/event3 (Power Button) machine # [ 8.034724] systemd-logind[524]: Watching system buttons on /dev/input/event2 (QEMU Virtio Keyboard) machine # [ 8.035494] systemd-logind[524]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) machine # [ 8.036779] systemd[1]: Started User Login Management. machine # [ 8.040399] systemd[1]: Starting linger-users.service... machine # [ 8.042703] dbus-broker-launch[498]: Ready machine # [ 8.064393] nsncd[583]: Sep 25 16:31:49.649 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 8.065238] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 8.065801] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 8.066503] systemd[1]: Reached target User and Group Name Lookups. machine # [ 8.077573] systemd[1]: linger-users.service: Deactivated successfully. machine # [ 8.078353] systemd[1]: Finished linger-users.service. machine # [ 8.096271] systemd[1]: Finished resolvconf update. machine # [ 8.098130] systemd[1]: Reached target Preparation for Network. machine # [ 8.100687] systemd[1]: Starting DHCP Client... machine # [ 8.102368] systemd[1]: Starting Address configuration of eth1... machine # [ 8.104098] systemd[1]: Starting Extra networking commands.... machine # [ 8.167686] network-addresses-eth1-start[623]: adding address 192.168.1.1/24... done machine # [ 8.179255] network-addresses-eth1-start[623]: adding address 2001:db8:1::1/64... done machine # [ 8.192650] systemd[1]: Finished Address configuration of eth1. machine # [ 8.205158] dhcpcd[635]: dhcpcd-10.3.2 starting machine # [ 8.211776] dhcpcd[686]: dev: loaded udev machine # [ 8.376011] 8021q: 802.1Q VLAN Support v1.8 machine # [ 8.377319] 8021q: adding VLAN 0 to HW filter on device eth1 machine # [ 8.227936] systemd[1]: Finished Extra networking commands.. machine # [ 8.228585] systemd[1]: Reached target Network. machine # [ 8.231056] systemd[1]: Starting PostgreSQL Server... machine # [ 8.233246] systemd[1]: Starting Permit User Sessions... machine # [ 8.250685] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. machine # [ 8.262351] systemd[1]: Finished Permit User Sessions. machine # [ 8.265235] systemd[1]: Started Getty on tty1. machine # [ 8.266048] systemd[1]: Reached target Login Prompts. machine # [ 8.484011] cfg80211: Loading compiled-in X.509 certificates for regulatory database machine # [ 8.509939] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' machine # [ 8.511384] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' machine # [ 8.513850] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 machine # [ 8.515137] cfg80211: failed to load regulatory.db machine # [ 8.364726] postgresql-pre-start[709]: The files belonging to this database system will be owned by user "postgres". machine # [ 8.365614] postgresql-pre-start[709]: This user must also own the server process. machine # [ 8.367403] postgresql-pre-start[709]: The database cluster will be initialized with locale "en_US.UTF-8". machine # [ 8.368129] postgresql-pre-start[709]: The default database encoding has accordingly been set to "UTF8". machine # [ 8.368593] postgresql-pre-start[709]: The default text search configuration will be set to "english". machine # [ 8.369167] postgresql-pre-start[709]: Data page checksums are enabled. machine # [ 8.369756] postgresql-pre-start[709]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok machine # [ 8.370490] postgresql-pre-start[709]: creating subdirectories ... ok machine # [ 8.371439] postgresql-pre-start[709]: selecting dynamic shared memory implementation ... posix machine # [ 8.565007] 8021q: adding VLAN 0 to HW filter on device eth0 machine # [ 8.415222] dhcpcd[686]: eth0: waiting for carrier machine # [ 8.416063] dhcpcd[686]: eth0: carrier acquired machine # [ 8.420781] dhcpcd[686]: DUID 00:01:00:01:32:49:5e:76:52:54:00:12:34:56 machine # [ 8.421938] dhcpcd[686]: eth0: IAID 00:12:34:56 machine # [ 8.422682] dhcpcd[686]: eth0: adding address fe80::5054:ff:fe12:3456 machine # [ 8.431669] postgresql-pre-start[709]: selecting default "max_connections" ... 100 machine # [ 8.482436] postgresql-pre-start[709]: selecting default "shared_buffers" ... 128MB machine # [ 9.203771] postgresql-pre-start[709]: selecting default time zone ... UTC machine # [ 9.206838] postgresql-pre-start[709]: creating configuration files ... ok machine # [ 9.394989] postgresql-pre-start[709]: running bootstrap script ... ok machine # [ 9.856507] postgresql-pre-start[709]: performing post-bootstrap initialization ... ok machine # [ 10.029732] postgresql-pre-start[709]: syncing data to disk ... ok machine # [ 10.031092] postgresql-pre-start[709]: initdb: warning: enabling "trust" authentication for local connections machine # [ 10.031998] postgresql-pre-start[709]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. machine # [ 10.032737] postgresql-pre-start[709]: Success. You can now start the database server using: machine # [ 10.033596] postgresql-pre-start[709]: pg_ctl -D /var/lib/postgresql/18 -l logfile start machine # [ 10.178295] postgres[747]: [747] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit machine # [ 10.183833] postgres[747]: [747] LOG: listening on IPv6 address "::1", port 5432 machine # [ 10.185512] postgres[747]: [747] LOG: listening on IPv4 address "127.0.0.1", port 5432 machine # [ 10.187413] postgres[747]: [747] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" machine # [ 10.203371] postgres[760]: [760] LOG: database system was shut down at 2026-09-25 16:31:51 GMT machine # [ 10.211628] postgres[747]: [747] LOG: database system is ready to accept connections machine # [ 10.213215] dhcpcd[686]: eth0: soliciting a DHCP lease machine # [ 10.219584] systemd[1]: Started PostgreSQL Server. machine # [ 10.224719] systemd[1]: Starting PostgreSQL Setup Scripts... machine # [ 10.386555] NET: Registered PF_PACKET protocol family machine # [ 10.245512] dhcpcd[686]: eth0: offered 10.0.2.15 from 10.0.2.2 machine # [ 10.249371] dhcpcd[686]: eth0: probing address 10.0.2.15/24 machine # [ 10.380918] postgresql-setup-start[778]: CREATE DATABASE machine # [ 10.407888] postgresql-setup-start[783]: CREATE ROLE machine # [ 10.421209] postgresql-setup-start[785]: ALTER DATABASE machine # [ 10.424534] systemd[1]: Finished PostgreSQL Setup Scripts. machine # [ 10.425462] systemd[1]: Reached target PostgreSQL. machine # [ 10.427430] dhcpcd[686]: eth0: soliciting an IPv6 router machine # [ 10.428494] dhcpcd[686]: eth0: Router Advertisement from fe80::2 machine # [ 10.429213] dhcpcd[686]: eth0: adding address fec0::5054:ff:fe12:3456/64 machine # [ 10.429626] dhcpcd[686]: eth0: adding route to fec0::/64 machine # [ 10.430217] dhcpcd[686]: eth0: adding default route via fe80::2 machine # [ 15.566912] dhcpcd[686]: eth0: leased 10.0.2.15 for 86400 seconds machine # [ 15.569751] dhcpcd[686]: eth0: adding route to 10.0.2.0/24 machine # [ 15.571674] dhcpcd[686]: eth0: adding default route via 10.0.2.2 machine # [ 15.734063] systemd[1]: Started DHCP Client. machine # [ 15.736206] systemd[1]: Reached target Network is Online. machine # [ 15.739941] systemd[1]: Starting k3s service... machine # [ 15.816718] k3s[894]: time="2026-09-25T16:31:57Z" level=info msg="Acquiring lock file /var/lib/rancher/k3s/data/.lock" machine # [ 15.818535] k3s[894]: time="2026-09-25T16:31:57Z" level=info msg="Preparing data dir /var/lib/rancher/k3s/data/05fb32d1d5d79ab4bf8f805d07e4a7dfb491001fd5137b587aa471efd4746099" machine # [ 16.037733] rustfs-bucket-start[900]: mb s3://farm machine # [ 16.045177] systemd[1]: Finished rustfs-bucket.service. machine # [ 18.429520] k3s[894]: time="2026-09-25T16:32:00Z" level=info msg="Starting k3s 1.35.8+k3s1 (e952d68a)" machine # [ 18.442890] k3s[894]: time="2026-09-25T16:32:00Z" level=info msg="Configuring sqlite3 database connection pooling: maxIdle=20, maxOpen=0, maxLifetime=0s, maxIdleTime=2m0s" machine # [ 18.445334] k3s[894]: time="2026-09-25T16:32:00Z" level=info msg="Kine built with sqlite from github.com/mattn/go-sqlite3 version 3.53.3" machine # [ 18.446482] k3s[894]: time="2026-09-25T16:32:00Z" level=info msg="Configuring database table schema and indexes, this may take a moment..." machine # [ 18.464065] k3s[894]: time="2026-09-25T16:32:00Z" level=info msg="Database tables and indexes are up to date" machine # [ 18.465113] k3s[894]: time="2026-09-25T16:32:00Z" level=info msg="Running startup VACUUM to reclaim disk space, this may take a moment..." machine # [ 18.472341] k3s[894]: time="2026-09-25T16:32:00Z" level=info msg="Startup VACUUM completed successfully" machine # [ 18.476949] k3s[894]: time="2026-09-25T16:32:00Z" level=info msg="Kine available at unix://kine.sock" machine # [ 18.478276] k3s[894]: time="2026-09-25T16:32:00Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 18.483243] k3s[894]: time="2026-09-25T16:32:00Z" level=info msg="Datastore connection validated successfully, proceeding with bootstrap data generation" machine # [ 18.484617] k3s[894]: time="2026-09-25T16:32:00Z" level=info msg="generated self-signed CA certificate CN=k3s-client-ca@1790353920: notBefore=2026-09-25 15:32:00.070496248 +0000 UTC notAfter=2036-09-22 15:32:00.070496248 +0000 UTC" machine # [ 18.485676] k3s[894]: time="2026-09-25T16:32:00Z" level=info msg="certificate CN=system:admin,O=system:masters signed by CN=k3s-client-ca@1790353920: notBefore=2026-09-25 15:32:00 +0000 UTC notAfter=2027-09-25 15:32:00 +0000 UTC" machine # [ 18.486731] k3s[894]: time="2026-09-25T16:32:00Z" level=info msg="certificate CN=system:k3s-supervisor,O=system:masters signed by CN=k3s-client-ca@1790353920: notBefore=2026-09-25 15:32:00 +0000 UTC notAfter=2027-09-25 15:32:00 +0000 UTC" machine # [ 18.487723] k3s[894]: time="2026-09-25T16:32:00Z" level=info msg="certificate CN=system:kube-controller-manager signed by CN=k3s-client-ca@1790353920: notBefore=2026-09-25 15:32:00 +0000 UTC notAfter=2027-09-25 15:32:00 +0000 UTC" machine # [ 18.488668] k3s[894]: time="2026-09-25T16:32:00Z" level=info msg="certificate CN=system:kube-scheduler signed by CN=k3s-client-ca@1790353920: notBefore=2026-09-25 15:32:00 +0000 UTC notAfter=2027-09-25 15:32:00 +0000 UTC" machine # [ 18.498451] k3s[894]: time="2026-09-25T16:32:00Z" level=info msg="certificate CN=system:apiserver,O=system:masters signed by CN=k3s-client-ca@1790353920: notBefore=2026-09-25 15:32:00 +0000 UTC notAfter=2027-09-25 15:32:00 +0000 UTC" machine # [ 18.499911] k3s[894]: time="2026-09-25T16:32:00Z" level=info msg="certificate CN=k3s-cloud-controller-manager signed by CN=k3s-client-ca@1790353920: notBefore=2026-09-25 15:32:00 +0000 UTC notAfter=2027-09-25 15:32:00 +0000 UTC" machine # [ 18.500775] k3s[894]: time="2026-09-25T16:32:00Z" level=info msg="generated self-signed CA certificate CN=k3s-server-ca@1790353920: notBefore=2026-09-25 15:32:00.086854193 +0000 UTC notAfter=2036-09-22 15:32:00.086854193 +0000 UTC" machine # [ 18.501825] k3s[894]: time="2026-09-25T16:32:00Z" level=info msg="certificate CN=kube-apiserver signed by CN=k3s-server-ca@1790353920: notBefore=2026-09-25 15:32:00 +0000 UTC notAfter=2027-09-25 15:32:00 +0000 UTC" machine # [ 18.503109] k3s[894]: time="2026-09-25T16:32:00Z" level=info msg="certificate CN=kube-scheduler signed by CN=k3s-server-ca@1790353920: notBefore=2026-09-25 15:32:00 +0000 UTC notAfter=2027-09-25 15:32:00 +0000 UTC" machine # [ 18.503959] k3s[894]: time="2026-09-25T16:32:00Z" level=info msg="certificate CN=kube-controller-manager signed by CN=k3s-server-ca@1790353920: notBefore=2026-09-25 15:32:00 +0000 UTC notAfter=2027-09-25 15:32:00 +0000 UTC" machine # [ 18.504844] k3s[894]: time="2026-09-25T16:32:00Z" level=info msg="generated self-signed CA certificate CN=k3s-request-header-ca@1790353920: notBefore=2026-09-25 15:32:00.090821178 +0000 UTC notAfter=2036-09-22 15:32:00.090821178 +0000 UTC" machine # [ 18.505722] k3s[894]: time="2026-09-25T16:32:00Z" level=info msg="certificate CN=system:auth-proxy signed by CN=k3s-request-header-ca@1790353920: notBefore=2026-09-25 15:32:00 +0000 UTC notAfter=2027-09-25 15:32:00 +0000 UTC" machine # [ 18.506640] k3s[894]: time="2026-09-25T16:32:00Z" level=info msg="generated self-signed CA certificate CN=etcd-server-ca@1790353920: notBefore=2026-09-25 15:32:00.092400708 +0000 UTC notAfter=2036-09-22 15:32:00.092400708 +0000 UTC" machine # [ 18.507552] k3s[894]: time="2026-09-25T16:32:00Z" level=info msg="certificate CN=etcd-client signed by CN=etcd-server-ca@1790353920: notBefore=2026-09-25 15:32:00 +0000 UTC notAfter=2027-09-25 15:32:00 +0000 UTC" machine # [ 18.508361] k3s[894]: time="2026-09-25T16:32:00Z" level=info msg="generated self-signed CA certificate CN=etcd-peer-ca@1790353920: notBefore=2026-09-25 15:32:00.09379055 +0000 UTC notAfter=2036-09-22 15:32:00.09379055 +0000 UTC" machine # [ 18.509272] k3s[894]: time="2026-09-25T16:32:00Z" level=info msg="certificate CN=etcd-peer signed by CN=etcd-peer-ca@1790353920: notBefore=2026-09-25 15:32:00 +0000 UTC notAfter=2027-09-25 15:32:00 +0000 UTC" machine # [ 18.510234] k3s[894]: time="2026-09-25T16:32:00Z" level=info msg="certificate CN=etcd-server signed by CN=etcd-server-ca@1790353920: notBefore=2026-09-25 15:32:00 +0000 UTC notAfter=2027-09-25 15:32:00 +0000 UTC" machine # [ 18.544070] k3s[894]: time="2026-09-25T16:32:00Z" level=info msg="certificate CN=k3s,O=k3s signed by CN=k3s-server-ca@1790353920: notBefore=2026-09-25 15:32:00 +0000 UTC notAfter=2027-09-25 15:32:00 +0000 UTC" machine # [ 18.547067] k3s[894]: time="2026-09-25T16:32:00Z" level=warning msg="dynamiclistener [::]:6443: no cached certificate available for preload - deferring certificate load until storage initialization or first client request" machine # [ 18.550739] k3s[894]: time="2026-09-25T16:32:00Z" level=info msg="Active TLS secret / (ver=) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__139c_1f9b_479c_fae-52374b:fec0::139c:1f9b:479c:fae listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=95EEFB9FBC866CF52134F95FEA67C823FF9B6B32]" machine # [ 19.582772] k3s[894]: time="2026-09-25T16:32:01Z" level=info msg="Password verified locally for node machine" machine # [ 19.585134] k3s[894]: time="2026-09-25T16:32:01Z" level=info msg="certificate CN=machine signed by CN=k3s-server-ca@1790353920: notBefore=2026-09-25 15:32:01 +0000 UTC notAfter=2027-09-25 15:32:01 +0000 UTC" machine # [ 19.825924] k3s[894]: time="2026-09-25T16:32:01Z" level=info msg="certificate CN=system:node:machine,O=system:nodes signed by CN=k3s-client-ca@1790353920: notBefore=2026-09-25 15:32:01 +0000 UTC notAfter=2027-09-25 15:32:01 +0000 UTC" machine # [ 19.929523] k3s[894]: time="2026-09-25T16:32:01Z" level=info msg="certificate CN=system:kube-proxy signed by CN=k3s-client-ca@1790353920: notBefore=2026-09-25 15:32:01 +0000 UTC notAfter=2027-09-25 15:32:01 +0000 UTC" machine # [ 20.023237] k3s[894]: time="2026-09-25T16:32:01Z" level=info msg="certificate CN=system:k3s-controller signed by CN=k3s-client-ca@1790353920: notBefore=2026-09-25 15:32:01 +0000 UTC notAfter=2027-09-25 15:32:01 +0000 UTC" machine # [ 20.137980] k3s[894]: time="2026-09-25T16:32:01Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:58806: runtime core not ready" machine # [ 20.227654] k3s[894]: time="2026-09-25T16:32:01Z" level=info msg="Module overlay was already loaded" machine # [ 20.439227] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. machine # [ 20.443687] Bridge firewalling registered machine # [ 20.305463] k3s[894]: time="2026-09-25T16:32:01Z" level=warning msg="Failed to load kernel module iptable_nat with modprobe" machine # [ 20.317319] k3s[894]: time="2026-09-25T16:32:01Z" level=warning msg="Failed to load kernel module iptable_filter with modprobe" machine # [ 20.329397] k3s[894]: time="2026-09-25T16:32:01Z" level=warning msg="Failed to load kernel module nft-expr-counter with modprobe" machine # [ 20.403520] k3s[894]: time="2026-09-25T16:32:01Z" level=info msg="Set sysctl 'net/ipv4/conf/all/forwarding' to 1" machine # [ 20.405059] k3s[894]: time="2026-09-25T16:32:01Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_max' to 131072" machine # [ 20.408940] k3s[894]: time="2026-09-25T16:32:01Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400" machine # [ 20.409869] k3s[894]: time="2026-09-25T16:32:01Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600" machine # [ 20.418143] k3s[894]: time="2026-09-25T16:32:02Z" level=info msg="Polling for API server readiness: GET /readyz failed: the server is currently unable to handle the request" machine # [ 20.419339] k3s[894]: time="2026-09-25T16:32:02Z" level=info msg="Connecting to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 20.422556] k3s[894]: time="2026-09-25T16:32:02Z" level=info msg="Handling backend connection request [machine]" machine # [ 20.423734] k3s[894]: time="2026-09-25T16:32:02Z" level=info msg="Connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 20.424701] k3s[894]: time="2026-09-25T16:32:02Z" level=info msg="Remotedialer connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 20.429666] k3s[894]: time="2026-09-25T16:32:02Z" level=info msg="Creating k3s-cert-monitor event broadcaster" machine # [ 20.430835] k3s[894]: time="2026-09-25T16:32:02Z" level=info msg="Saving cluster bootstrap data to datastore" machine # [ 20.431706] k3s[894]: time="2026-09-25T16:32:02Z" level=info msg="Connection to etcd is ready" machine # [ 20.432518] k3s[894]: time="2026-09-25T16:32:02Z" level=info msg="ETCD server is now running" machine # [ 20.436704] k3s[894]: time="2026-09-25T16:32:02Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 20.441954] k3s[894]: time="2026-09-25T16:32:02Z" level=info msg="Running kube-apiserver --advertise-port=6443 --allow-privileged=true --anonymous-auth=false --api-audiences=https://kubernetes.default.svc.cluster.local,k3s --authorization-mode=Node,RBAC --bind-address=127.0.0.1 --cert-dir=/var/lib/rancher/k3s/server/tls/temporary-certs --client-ca-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --egress-selector-config-file=/var/lib/rancher/k3s/server/etc/egress-selector-config.yaml --enable-admission-plugins=NodeRestriction --enable-aggregator-routing=true --enable-bootstrap-token-auth=true --etcd-servers=unix://kine.sock --kubelet-certificate-authority=/var/lib/rancher/k3s/server/tls/server-ca.crt --kubelet-client-certificate=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.crt --kubelet-client-key=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.key --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --profiling=false --proxy-client-cert-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt --proxy-client-key-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.key --requestheader-allowed-names=system:auth-proxy --requestheader-client-ca-file=/var/lib/rancher/k3s/server/tls/request-header-ca.crt --requestheader-extra-headers-prefix=X-Remote-Extra- --requestheader-group-headers=X-Remote-Group --requestheader-username-headers=X-Remote-User --secure-port=6444 --service-account-issuer=https://kubernetes.default.svc.cluster.local --service-account-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-account-signing-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --storage-backend=etcd3 --tls-cert-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --tls-private-key-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 20.443187] k3s[894]: time="2026-09-25T16:32:02Z" level=info msg="Running kube-scheduler --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --bind-address=127.0.0.1 --kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --leader-elect=false --profiling=false --secure-port=10259 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 20.443879] k3s[894]: time="2026-09-25T16:32:02Z" level=info msg="Running kube-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --bind-address=127.0.0.1 --cluster-cidr=10.42.0.0/16 --cluster-signing-kube-apiserver-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kube-apiserver-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kubelet-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-serving-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-kubelet-serving-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --cluster-signing-legacy-unknown-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-legacy-unknown-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --configure-cloud-routes=false --controllers=*,tokencleaner,-service,-route,-cloud-node-lifecycle --kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --leader-elect=false --profiling=false --root-ca-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --secure-port=10257 --service-account-private-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key --use-service-account-credentials=true" machine # [ 20.446944] k3s[894]: time="2026-09-25T16:32:02Z" level=info msg="Running cloud-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --bind-address=127.0.0.1 --cloud-config=/var/lib/rancher/k3s/server/etc/cloud-config.yaml --cloud-provider=k3s --cluster-cidr=10.42.0.0/16 --configure-cloud-routes=false --controllers=*,-route --kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --leader-elect=false --leader-elect-resource-name=k3s-cloud-controller-manager --node-status-update-frequency=1m0s --profiling=false" machine # [ 20.454423] k3s[894]: time="2026-09-25T16:32:02Z" level=info msg="Server node token is available at /var/lib/rancher/k3s/server/token" machine # [ 20.455788] k3s[894]: I0925 16:32:02.031468 894 options.go:263] external host was not specified, using 10.0.2.15 machine # [ 20.456943] k3s[894]: I0925 16:32:02.033325 894 server.go:158] Version: v1.35.8+k3s1 machine # [ 20.457943] k3s[894]: I0925 16:32:02.033360 894 server.go:160] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 20.459458] k3s[894]: time="2026-09-25T16:32:02Z" level=info msg="To join server node to cluster: k3s server -s https://10.0.2.15:6443 -t ${SERVER_NODE_TOKEN}" machine # [ 20.460935] k3s[894]: time="2026-09-25T16:32:02Z" level=info msg="Agent node token is available at /var/lib/rancher/k3s/server/agent-token" machine # [ 20.462564] k3s[894]: time="2026-09-25T16:32:02Z" level=info msg="To join agent node to cluster: k3s agent -s https://10.0.2.15:6443 -t ${AGENT_NODE_TOKEN}" machine # [ 20.464107] k3s[894]: time="2026-09-25T16:32:02Z" level=info msg="Wrote kubeconfig /etc/rancher/k3s/k3s.yaml" machine # [ 20.465367] k3s[894]: time="2026-09-25T16:32:02Z" level=info msg="Run: k3s kubectl" machine # [ 20.510790] k3s[894]: time="2026-09-25T16:32:02Z" level=info msg="Logging containerd to /var/lib/rancher/k3s/agent/containerd/containerd.log" machine # [ 20.511490] k3s[894]: time="2026-09-25T16:32:02Z" level=info msg="Running containerd -c /var/lib/rancher/k3s/agent/etc/containerd/config.toml" machine # [ 20.517272] k3s[894]: time="2026-09-25T16:32:02Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:58866: runtime core not ready" machine # [ 20.550855] k3s[894]: I0925 16:32:02.136676 894 shared_informer.go:349] "Waiting for caches to sync" controller="node_authorizer" machine # [ 20.555758] k3s[894]: I0925 16:32:02.142230 894 plugins.go:157] Loaded 14 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,PodTopologyLabels,MutatingAdmissionPolicy,MutatingAdmissionWebhook. machine # [ 20.556607] k3s[894]: I0925 16:32:02.143097 894 plugins.go:160] Loaded 14 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,NodeDeclaredFeatureValidator,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. machine # [ 20.557440] k3s[894]: I0925 16:32:02.143924 894 instance.go:240] Using reconciler: lease machine # [ 20.558351] k3s[894]: I0925 16:32:02.144833 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 20.575912] k3s[894]: I0925 16:32:02.162347 894 handler.go:304] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager machine # [ 20.576607] k3s[894]: W0925 16:32:02.162393 894 genericapiserver.go:787] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. machine # [ 20.579770] k3s[894]: I0925 16:32:02.166236 894 cidrallocator.go:198] starting ServiceCIDR Allocator Controller machine # [ 20.635401] k3s[894]: I0925 16:32:02.221096 894 handler.go:304] Adding GroupVersion v1 to ResourceManager machine # [ 20.635773] k3s[894]: I0925 16:32:02.221355 894 apis.go:112] API group "internal.apiserver.k8s.io" is not enabled, skipping. machine # [ 20.641507] k3s[894]: time="2026-09-25T16:32:02Z" level=info msg="Running kube-proxy --cluster-cidr=10.42.0.0/16 --conntrack-max-per-core=0 --conntrack-tcp-timeout-close-wait=0s --conntrack-tcp-timeout-established=0s --healthz-bind-address=127.0.0.1 --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubeproxy.kubeconfig --proxy-mode=iptables" machine # [ 20.665684] k3s[894]: I0925 16:32:02.252131 894 apis.go:112] API group "storagemigration.k8s.io" is not enabled, skipping. machine # [ 20.702515] k3s[894]: I0925 16:32:02.288572 894 handler.go:304] Adding GroupVersion authentication.k8s.io v1 to ResourceManager machine # [ 20.703294] k3s[894]: W0925 16:32:02.288616 894 genericapiserver.go:787] Skipping API authentication.k8s.io/v1beta1 because it has no resources. machine # [ 20.703881] k3s[894]: W0925 16:32:02.288629 894 genericapiserver.go:787] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. machine # [ 20.704397] k3s[894]: I0925 16:32:02.289035 894 handler.go:304] Adding GroupVersion authorization.k8s.io v1 to ResourceManager machine # [ 20.704902] k3s[894]: W0925 16:32:02.289053 894 genericapiserver.go:787] Skipping API authorization.k8s.io/v1beta1 because it has no resources. machine # [ 20.705565] k3s[894]: I0925 16:32:02.289807 894 handler.go:304] Adding GroupVersion autoscaling v2 to ResourceManager machine # [ 20.706123] k3s[894]: I0925 16:32:02.290442 894 handler.go:304] Adding GroupVersion autoscaling v1 to ResourceManager machine # [ 20.706604] k3s[894]: W0925 16:32:02.290460 894 genericapiserver.go:787] Skipping API autoscaling/v2beta1 because it has no resources. machine # [ 20.707165] k3s[894]: W0925 16:32:02.290471 894 genericapiserver.go:787] Skipping API autoscaling/v2beta2 because it has no resources. machine # [ 20.707709] k3s[894]: I0925 16:32:02.291508 894 handler.go:304] Adding GroupVersion batch v1 to ResourceManager machine # [ 20.708203] k3s[894]: W0925 16:32:02.291560 894 genericapiserver.go:787] Skipping API batch/v1beta1 because it has no resources. machine # [ 20.708726] k3s[894]: I0925 16:32:02.292193 894 handler.go:304] Adding GroupVersion certificates.k8s.io v1 to ResourceManager machine # [ 20.709466] k3s[894]: W0925 16:32:02.292213 894 genericapiserver.go:787] Skipping API certificates.k8s.io/v1beta1 because it has no resources. machine # [ 20.709890] k3s[894]: W0925 16:32:02.292225 894 genericapiserver.go:787] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. machine # [ 20.710530] k3s[894]: I0925 16:32:02.292683 894 handler.go:304] Adding GroupVersion coordination.k8s.io v1 to ResourceManager machine # [ 20.711083] k3s[894]: W0925 16:32:02.292700 894 genericapiserver.go:787] Skipping API coordination.k8s.io/v1beta1 because it has no resources. machine # [ 20.711543] k3s[894]: W0925 16:32:02.292718 894 genericapiserver.go:787] Skipping API coordination.k8s.io/v1alpha2 because it has no resources. machine # [ 20.712088] k3s[894]: I0925 16:32:02.293085 894 handler.go:304] Adding GroupVersion discovery.k8s.io v1 to ResourceManager machine # [ 20.712549] k3s[894]: W0925 16:32:02.293101 894 genericapiserver.go:787] Skipping API discovery.k8s.io/v1beta1 because it has no resources. machine # [ 20.713131] k3s[894]: I0925 16:32:02.294750 894 handler.go:304] Adding GroupVersion networking.k8s.io v1 to ResourceManager machine # [ 20.713550] k3s[894]: W0925 16:32:02.294778 894 genericapiserver.go:787] Skipping API networking.k8s.io/v1beta1 because it has no resources. machine # [ 20.714105] k3s[894]: I0925 16:32:02.295161 894 handler.go:304] Adding GroupVersion node.k8s.io v1 to ResourceManager machine # [ 20.714553] k3s[894]: W0925 16:32:02.295178 894 genericapiserver.go:787] Skipping API node.k8s.io/v1beta1 because it has no resources. machine # [ 20.715099] k3s[894]: W0925 16:32:02.295189 894 genericapiserver.go:787] Skipping API node.k8s.io/v1alpha1 because it has no resources. machine # [ 20.715559] k3s[894]: I0925 16:32:02.295704 894 handler.go:304] Adding GroupVersion policy v1 to ResourceManager machine # [ 20.716103] k3s[894]: W0925 16:32:02.295719 894 genericapiserver.go:787] Skipping API policy/v1beta1 because it has no resources. machine # [ 20.716569] k3s[894]: I0925 16:32:02.296879 894 handler.go:304] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager machine # [ 20.717112] k3s[894]: W0925 16:32:02.296896 894 genericapiserver.go:787] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. machine # [ 20.717564] k3s[894]: W0925 16:32:02.296908 894 genericapiserver.go:787] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. machine # [ 20.718119] k3s[894]: I0925 16:32:02.297206 894 handler.go:304] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager machine # [ 20.718568] k3s[894]: W0925 16:32:02.297220 894 genericapiserver.go:787] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. machine # [ 20.719109] k3s[894]: W0925 16:32:02.297231 894 genericapiserver.go:787] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. machine # [ 20.719569] k3s[894]: I0925 16:32:02.298854 894 handler.go:304] Adding GroupVersion storage.k8s.io v1 to ResourceManager machine # [ 20.720142] k3s[894]: W0925 16:32:02.298873 894 genericapiserver.go:787] Skipping API storage.k8s.io/v1beta1 because it has no resources. machine # [ 20.720572] k3s[894]: W0925 16:32:02.298884 894 genericapiserver.go:787] Skipping API storage.k8s.io/v1alpha1 because it has no resources. machine # [ 20.721163] k3s[894]: I0925 16:32:02.299728 894 handler.go:304] Adding GroupVersion flowcontrol.apiserver.k8s.io v1 to ResourceManager machine # [ 20.721586] k3s[894]: W0925 16:32:02.299745 894 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta3 because it has no resources. machine # [ 20.722142] k3s[894]: W0925 16:32:02.299757 894 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta2 because it has no resources. machine # [ 20.722591] k3s[894]: W0925 16:32:02.299767 894 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. machine # [ 20.723140] k3s[894]: I0925 16:32:02.302058 894 handler.go:304] Adding GroupVersion apps v1 to ResourceManager machine # [ 20.723603] k3s[894]: W0925 16:32:02.302076 894 genericapiserver.go:787] Skipping API apps/v1beta2 because it has no resources. machine # [ 20.724139] k3s[894]: W0925 16:32:02.302087 894 genericapiserver.go:787] Skipping API apps/v1beta1 because it has no resources. machine # [ 20.724611] k3s[894]: I0925 16:32:02.303346 894 handler.go:304] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager machine # [ 20.725149] k3s[894]: W0925 16:32:02.303365 894 genericapiserver.go:787] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. machine # [ 20.725810] k3s[894]: W0925 16:32:02.303376 894 genericapiserver.go:787] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. machine # [ 20.768625] k3s[894]: I0925 16:32:02.303783 894 handler.go:304] Adding GroupVersion events.k8s.io v1 to ResourceManager machine # [ 20.769391] k3s[894]: W0925 16:32:02.303800 894 genericapiserver.go:787] Skipping API events.k8s.io/v1beta1 because it has no resources. machine # [ 20.769929] k3s[894]: I0925 16:32:02.304954 894 handler.go:304] Adding GroupVersion resource.k8s.io v1 to ResourceManager machine # [ 20.770603] k3s[894]: W0925 16:32:02.304972 894 genericapiserver.go:787] Skipping API resource.k8s.io/v1beta2 because it has no resources. machine # [ 20.771172] k3s[894]: W0925 16:32:02.304983 894 genericapiserver.go:787] Skipping API resource.k8s.io/v1beta1 because it has no resources. machine # [ 20.771677] k3s[894]: W0925 16:32:02.304993 894 genericapiserver.go:787] Skipping API resource.k8s.io/v1alpha3 because it has no resources. machine # [ 20.772278] k3s[894]: I0925 16:32:02.309074 894 handler.go:304] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager machine # [ 20.772725] k3s[894]: W0925 16:32:02.309095 894 genericapiserver.go:787] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. machine # [ 21.082095] k3s[894]: I0925 16:32:02.668351 894 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 21.086276] k3s[894]: I0925 16:32:02.668667 894 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 21.089941] k3s[894]: I0925 16:32:02.668707 894 secure_serving.go:211] Serving securely on 127.0.0.1:6444 machine # [ 21.091343] k3s[894]: I0925 16:32:02.668841 894 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 21.094188] k3s[894]: I0925 16:32:02.668888 894 controller.go:78] Starting OpenAPI AggregationController machine # [ 21.095526] k3s[894]: I0925 16:32:02.668932 894 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 21.097017] k3s[894]: I0925 16:32:02.668981 894 controller.go:80] Starting OpenAPI V3 AggregationController machine # [ 21.098458] k3s[894]: I0925 16:32:02.669099 894 controller.go:113] "Deleting old lease on startup" lease="kube-system/apiserver-ik4pcwfs7qgdl76byc4pomgvia" machine # [ 21.100373] k3s[894]: I0925 16:32:02.669280 894 system_namespaces_controller.go:66] Starting system namespaces controller machine # [ 21.101959] k3s[894]: I0925 16:32:02.669413 894 local_available_controller.go:156] Starting LocalAvailability controller machine # [ 21.103468] k3s[894]: I0925 16:32:02.669427 894 cache.go:32] Waiting for caches to sync for LocalAvailability controller machine # [ 21.105089] k3s[894]: I0925 16:32:02.669472 894 apiservice_controller.go:100] Starting APIServiceRegistrationController machine # [ 21.106567] k3s[894]: I0925 16:32:02.669485 894 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller machine # [ 21.108300] k3s[894]: I0925 16:32:02.669704 894 customresource_discovery_controller.go:294] Starting DiscoveryController machine # [ 21.109829] k3s[894]: I0925 16:32:02.669758 894 remote_available_controller.go:425] Starting RemoteAvailability controller machine # [ 21.111375] k3s[894]: I0925 16:32:02.669770 894 cache.go:32] Waiting for caches to sync for RemoteAvailability controller machine # [ 21.112885] k3s[894]: I0925 16:32:02.670052 894 controller.go:142] Starting OpenAPI controller machine # [ 21.114146] k3s[894]: I0925 16:32:02.670122 894 controller.go:90] Starting OpenAPI V3 controller machine # [ 21.115404] k3s[894]: I0925 16:32:02.670155 894 naming_controller.go:305] Starting NamingConditionController machine # [ 21.116819] k3s[894]: I0925 16:32:02.670235 894 nonstructuralschema_controller.go:202] Starting NonStructuralSchemaConditionController machine # [ 21.118391] k3s[894]: I0925 16:32:02.670269 894 apiapproval_controller.go:196] Starting KubernetesAPIApprovalPolicyConformantConditionController machine # [ 21.120101] k3s[894]: I0925 16:32:02.670300 894 crd_finalizer.go:273] Starting CRDFinalizer machine # [ 21.121237] k3s[894]: time="2026-09-25T16:32:02Z" level=info msg="Starting legacy_token_tracking_controller" logger=k3s machine # [ 21.122589] k3s[894]: time="2026-09-25T16:32:02Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 21.123820] k3s[894]: time="2026-09-25T16:32:02Z" level=info msg="Starting apiserver lease garbage collector" logger=k3s machine # [ 21.125215] k3s[894]: time="2026-09-25T16:32:02Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 21.126433] k3s[894]: I0925 16:32:02.670975 894 apf_controller.go:377] Starting API Priority and Fairness config controller machine # [ 21.127925] k3s[894]: I0925 16:32:02.671029 894 dynamic_serving_content.go:135] "Starting controller" name="aggregator-proxy-cert::/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt::/var/lib/rancher/k3s/server/tls/client-auth-proxy.key" machine # [ 21.130570] k3s[894]: I0925 16:32:02.672569 894 aggregator.go:185] waiting for initial CRD sync... machine # [ 21.131880] k3s[894]: I0925 16:32:02.672807 894 cluster_authentication_trust_controller.go:459] Starting cluster_authentication_trust_controller controller machine # [ 21.133725] k3s[894]: time="2026-09-25T16:32:02Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 21.134947] k3s[894]: I0925 16:32:02.672998 894 repairip.go:210] Starting ipallocator-repair-controller machine # [ 21.136217] k3s[894]: I0925 16:32:02.673015 894 shared_informer.go:349] "Waiting for caches to sync" controller="ipallocator-repair-controller" machine # [ 21.137885] k3s[894]: I0925 16:32:02.673361 894 crdregistration_controller.go:114] Starting crd-autoregister controller machine # [ 21.139309] k3s[894]: I0925 16:32:02.673375 894 shared_informer.go:349] "Waiting for caches to sync" controller="crd-autoregister" machine # [ 21.140864] k3s[894]: I0925 16:32:02.673442 894 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 21.142843] k3s[894]: I0925 16:32:02.673517 894 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 21.144955] k3s[894]: I0925 16:32:02.680619 894 default_servicecidr_controller.go:110] Starting kubernetes-service-cidr-controller machine # [ 21.146501] k3s[894]: I0925 16:32:02.680644 894 shared_informer.go:349] "Waiting for caches to sync" controller="kubernetes-service-cidr-controller" machine # [ 21.151379] k3s[894]: I0925 16:32:02.737811 894 shared_informer.go:356] "Caches are synced" controller="node_authorizer" machine # [ 21.159986] k3s[894]: I0925 16:32:02.746351 894 shared_informer.go:377] "Caches are synced" machine # [ 21.160860] k3s[894]: I0925 16:32:02.746410 894 policy_source.go:248] refreshing policies machine # [ 21.173219] k3s[894]: E0925 16:32:02.759493 894 controller.go:201] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" machine # [ 21.183359] k3s[894]: I0925 16:32:02.769782 894 cache.go:39] Caches are synced for APIServiceRegistrationController controller machine # [ 21.184211] k3s[894]: I0925 16:32:02.769840 894 cache.go:39] Caches are synced for RemoteAvailability controller machine # [ 21.184728] k3s[894]: I0925 16:32:02.769868 894 cache.go:39] Caches are synced for LocalAvailability controller machine # [ 21.185217] k3s[894]: I0925 16:32:02.769953 894 handler_discovery.go:451] Starting ResourceDiscoveryManager machine # [ 21.185922] k3s[894]: I0925 16:32:02.771840 894 controller.go:667] quota admission added evaluator for: namespaces machine # [ 21.189847] k3s[894]: I0925 16:32:02.772673 894 apf_controller.go:382] Running API Priority and Fairness config worker machine # [ 21.190455] k3s[894]: I0925 16:32:02.772706 894 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process machine # [ 21.190632] k3s[894]: I0925 16:32:02.773281 894 shared_informer.go:356] "Caches are synced" controller="ipallocator-repair-controller" machine # [ 21.191182] k3s[894]: time="2026-09-25T16:32:02Z" level=info msg="Caches are synced" logger=k3s machine # [ 21.191702] k3s[894]: I0925 16:32:02.773441 894 shared_informer.go:356] "Caches are synced" controller="crd-autoregister" machine # [ 21.192311] k3s[894]: time="2026-09-25T16:32:02Z" level=info msg="Caches are synced" logger=k3s machine # [ 21.193146] k3s[894]: time="2026-09-25T16:32:02Z" level=info msg="Caches are synced" logger=k3s machine # [ 21.196490] k3s[894]: I0925 16:32:02.773777 894 aggregator.go:187] initial CRD sync complete... machine # [ 21.197201] k3s[894]: I0925 16:32:02.773800 894 autoregister_controller.go:144] Starting autoregister controller machine # [ 21.197713] k3s[894]: I0925 16:32:02.773823 894 cache.go:32] Waiting for caches to sync for autoregister controller machine # [ 21.198274] k3s[894]: I0925 16:32:02.773844 894 cache.go:39] Caches are synced for autoregister controller machine # [ 21.198990] k3s[894]: I0925 16:32:02.780907 894 shared_informer.go:356] "Caches are synced" controller="kubernetes-service-cidr-controller" machine # [ 21.199666] k3s[894]: I0925 16:32:02.780949 894 default_servicecidr_controller.go:169] Creating default ServiceCIDR with CIDRs: [10.43.0.0/16] machine # [ 21.208186] k3s[894]: I0925 16:32:02.794648 894 cidrallocator.go:302] created ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 21.210845] k3s[894]: I0925 16:32:02.797299 894 default_servicecidr_controller.go:231] Setting default ServiceCIDR condition Ready to True machine # [ 21.220454] k3s[894]: I0925 16:32:02.806454 894 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 21.245090] k3s[894]: I0925 16:32:02.831064 894 alloc.go:329] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.43.0.1"} machine # [ 21.255698] k3s[894]: W0925 16:32:02.842165 894 lease.go:265] Resetting endpoints for master service "kubernetes" to [10.0.2.15] machine # [ 21.259128] k3s[894]: I0925 16:32:02.844822 894 controller.go:667] quota admission added evaluator for: endpoints machine # [ 21.264063] k3s[894]: I0925 16:32:02.849519 894 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io machine # [ 21.269901] k3s[894]: E0925 16:32:02.856361 894 controller.go:102] Error removing old endpoints from kubernetes service: no API server IP addresses were listed in storage, refusing to erase all endpoints for the kubernetes Service machine # [ 21.382285] k3s[894]: I0925 16:32:02.968420 894 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io machine # [ 21.518770] k3s[894]: time="2026-09-25T16:32:03Z" level=info msg="containerd is now running" machine # [ 21.533123] k3s[894]: time="2026-09-25T16:32:03Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/k3s-airgap-images-amd64.tar.zst" machine # [ 22.091038] k3s[894]: I0925 16:32:03.676397 894 storage_scheduling.go:123] created PriorityClass system-node-critical with value 2000001000 machine # [ 22.096055] k3s[894]: I0925 16:32:03.682453 894 storage_scheduling.go:123] created PriorityClass system-cluster-critical with value 2000000000 machine # [ 22.096849] k3s[894]: I0925 16:32:03.682474 894 storage_scheduling.go:139] all system priority classes are created successfully or already exist. machine # [ 22.416462] k3s[894]: time="2026-09-25T16:32:04Z" level=info msg="Polling for API server readiness: GET /readyz failed: unknown" machine # [ 23.046501] k3s[894]: I0925 16:32:04.632894 894 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io machine # [ 23.091833] k3s[894]: I0925 16:32:04.677834 894 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io machine # [ 24.423596] k3s[894]: time="2026-09-25T16:32:06Z" level=info msg="Waiting for untainted node" machine # [ 24.424831] k3s[894]: time="2026-09-25T16:32:06Z" level=info msg="Creating k3s-supervisor event broadcaster" machine # [ 24.426548] k3s[894]: time="2026-09-25T16:32:06Z" level=info msg="Kube API server is now running" machine # [ 24.427301] k3s[894]: time="2026-09-25T16:32:06Z" level=info msg="k3s is up and running" machine # [ 24.427986] k3s[894]: time="2026-09-25T16:32:06Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Node and Certificate Authority certificates managed by k3s are OK" object=machine reason=CertificateExpirationOK type=Normal machine # [ 24.429609] systemd[1]: Started k3s service. machine # [ 24.432283] systemd[1]: Starting niks3 server... machine # [ 24.451439] k3s[894]: I0925 16:32:06.037206 894 controllermanager.go:189] "Starting" version="v1.35.8+k3s1" machine # [ 24.452154] k3s[894]: I0925 16:32:06.037236 894 controllermanager.go:191] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 24.457548] k3s[894]: I0925 16:32:06.044019 894 secure_serving.go:211] Serving securely on 127.0.0.1:10257 machine # [ 24.460148] k3s[894]: I0925 16:32:06.044813 894 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key" machine # [ 24.460776] k3s[894]: I0925 16:32:06.044941 894 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 24.461418] k3s[894]: I0925 16:32:06.044565 894 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 24.461946] k3s[894]: I0925 16:32:06.046484 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 24.462579] k3s[894]: I0925 16:32:06.046602 894 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 24.463398] k3s[894]: I0925 16:32:06.046630 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 24.463977] k3s[894]: I0925 16:32:06.046665 894 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 24.464602] k3s[894]: I0925 16:32:06.046681 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 24.477234] k3s[894]: I0925 16:32:06.063689 894 controller.go:667] quota admission added evaluator for: serviceaccounts machine # [ 24.499340] k3s[894]: I0925 16:32:06.085737 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="networkpolicies.networking.k8s.io" machine # [ 24.500418] k3s[894]: I0925 16:32:06.085787 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="resourceclaimtemplates.resource.k8s.io" machine # [ 24.502691] k3s[894]: I0925 16:32:06.085827 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="serviceaccounts" machine # [ 24.504137] k3s[894]: I0925 16:32:06.085876 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="csistoragecapacities.storage.k8s.io" machine # [ 24.504596] k3s[894]: I0925 16:32:06.085917 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpointslices.discovery.k8s.io" machine # [ 24.505174] k3s[894]: I0925 16:32:06.085951 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="replicasets.apps" machine # [ 24.506863] k3s[894]: I0925 16:32:06.085981 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="horizontalpodautoscalers.autoscaling" machine # [ 24.507979] k3s[894]: I0925 16:32:06.086011 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="cronjobs.batch" machine # [ 24.508736] k3s[894]: I0925 16:32:06.086039 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="poddisruptionbudgets.policy" machine # [ 24.509404] k3s[894]: I0925 16:32:06.086066 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="rolebindings.rbac.authorization.k8s.io" machine # [ 24.509934] k3s[894]: I0925 16:32:06.086095 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="deployments.apps" machine # [ 24.511188] k3s[894]: I0925 16:32:06.086123 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="roles.rbac.authorization.k8s.io" machine # [ 24.512288] k3s[894]: I0925 16:32:06.086173 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="limitranges" machine # [ 24.513533] k3s[894]: I0925 16:32:06.086219 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpoints" machine # [ 24.514070] k3s[894]: I0925 16:32:06.086247 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="podtemplates" machine # [ 24.514549] k3s[894]: I0925 16:32:06.086328 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="controllerrevisions.apps" machine # [ 24.515129] k3s[894]: I0925 16:32:06.086453 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="ingresses.networking.k8s.io" machine # [ 24.515693] k3s[894]: I0925 16:32:06.086698 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="leases.coordination.k8s.io" machine # [ 24.516213] k3s[894]: I0925 16:32:06.086730 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="statefulsets.apps" machine # [ 24.516731] k3s[894]: I0925 16:32:06.086757 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="daemonsets.apps" machine # [ 24.517386] k3s[894]: I0925 16:32:06.086797 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="jobs.batch" machine # [ 24.520810] k3s[894]: time="2026-09-25T16:32:06Z" level=info msg="Creating embedded CRD addons.k3s.cattle.io" machine # [ 24.531633] k3s[894]: time="2026-09-25T16:32:06Z" level=info msg="Creating embedded CRD etcdsnapshotfiles.k3s.cattle.io" machine # [ 24.545072] k3s[894]: time="2026-09-25T16:32:06Z" level=info msg="Creating embedded CRD helmchartconfigs.helm.cattle.io" machine # [ 24.551374] k3s[894]: I0925 16:32:06.137833 894 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 24.555184] k3s[894]: time="2026-09-25T16:32:06Z" level=info msg="Creating embedded CRD helmcharts.helm.cattle.io" machine # [ 24.558210] k3s[894]: I0925 16:32:06.144622 894 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="podcertificaterequest-cleaner-controller" requiredFeatureGates=["PodCertificateRequest"] machine # [ 24.558881] k3s[894]: I0925 16:32:06.144668 894 controllermanager.go:579] "Warning: skipping controller" controller="podcertificaterequest-cleaner-controller" machine # [ 24.559530] k3s[894]: I0925 16:32:06.144682 894 controllermanager.go:627] "Warning: controller is disabled" controller="bootstrap-signer-controller" machine # [ 24.564272] k3s[894]: I0925 16:32:06.150726 894 shared_informer.go:377] "Caches are synced" machine # [ 24.566459] k3s[894]: I0925 16:32:06.152915 894 shared_informer.go:377] "Caches are synced" machine # [ 24.567743] k3s[894]: I0925 16:32:06.153008 894 shared_informer.go:377] "Caches are synced" machine # [ 24.583085] k3s[894]: I0925 16:32:06.169507 894 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 24.583893] k3s[894]: I0925 16:32:06.169633 894 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="device-taint-eviction-controller" requiredFeatureGates=["DynamicResourceAllocation","DRADeviceTaints"] machine # [ 24.584718] k3s[894]: I0925 16:32:06.170414 894 controllermanager.go:579] "Warning: skipping controller" controller="device-taint-eviction-controller" machine # [ 24.594167] k3s[894]: I0925 16:32:06.180523 894 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 24.594893] k3s[894]: time="2026-09-25T16:32:06Z" level=info msg="Waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 24.620080] k3s[894]: I0925 16:32:06.205365 894 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 24.637637] k3s[894]: I0925 16:32:06.224090 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 24.649359] k3s[894]: I0925 16:32:06.235824 894 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="storageversion-garbage-collector-controller" requiredFeatureGates=["APIServerIdentity","StorageVersionAPI"] machine # [ 24.650113] k3s[894]: I0925 16:32:06.236595 894 controllermanager.go:579] "Warning: skipping controller" controller="storageversion-garbage-collector-controller" machine # [ 24.738333] k3s[894]: I0925 16:32:06.324663 894 shared_informer.go:377] "Caches are synced" machine: (finished: waiting for unit k3s.service, in 25.87 seconds) machine: waiting for success: kubectl get ns farm machine # [ 25.114168] k3s[894]: time="2026-09-25T16:32:06Z" level=info msg="Done waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 25.114565] k3s[894]: time="2026-09-25T16:32:06Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-40.1.4+up40.1.0.tgz" machine # [ 25.115086] k3s[894]: time="2026-09-25T16:32:06Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-crd-40.1.4+up40.1.0.tgz" machine # [ 25.115549] k3s[894]: time="2026-09-25T16:32:06Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/ccm.yaml" machine # [ 25.116087] k3s[894]: time="2026-09-25T16:32:06Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/coredns.yaml" machine # [ 25.116538] k3s[894]: time="2026-09-25T16:32:06Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/local-storage.yaml" machine # [ 25.117112] k3s[894]: time="2026-09-25T16:32:06Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/rolebindings.yaml" machine # [ 25.117575] k3s[894]: time="2026-09-25T16:32:06Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/runtimes.yaml" machine # [ 25.118139] k3s[894]: time="2026-09-25T16:32:06Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/traefik.yaml" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 25.315747] k3s[894]: time="2026-09-25T16:32:06Z" level=info msg="Tunnel server egress proxy mode: agent" machine # [ 25.316961] k3s[894]: time="2026-09-25T16:32:06Z" level=info msg="Starting dynamiclistener CN filter node controller with SANs: [127.0.0.1 ::1 localhost machine 10.0.2.15 fec0::139c:1f9b:479c:fae 10.43.0.1 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local]" machine # [ 25.320548] k3s[894]: I0925 16:32:06.907015 894 controllermanager.go:627] "Warning: controller is disabled" controller="service-lb-controller" machine # [ 25.427817] k3s[894]: W0925 16:32:07.012312 894 probe.go:272] Flexvolume plugin directory at /usr/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating. machine # [ 25.430074] k3s[894]: I0925 16:32:07.013681 894 controllermanager.go:627] "Warning: controller is disabled" controller="selinux-warning-controller" machine # [ 25.544178] k3s[894]: time="2026-09-25T16:32:07Z" level=info msg="Creating new TLS secret for kube-system/k3s-serving (count: 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__139c_1f9b_479c_fae-52374b:fec0::139c:1f9b:479c:fae listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=95EEFB9FBC866CF52134F95FEA67C823FF9B6B32]" machine # [ 25.554514] k3s[894]: time="2026-09-25T16:32:07Z" level=info msg="Active TLS secret kube-system/k3s-serving (ver=235) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__139c_1f9b_479c_fae-52374b:fec0::139c:1f9b:479c:fae listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=95EEFB9FBC866CF52134F95FEA67C823FF9B6B32]" machine # [ 25.717926] k3s[894]: time="2026-09-25T16:32:07Z" level=info msg="Imported docker.io/rancher/klipper-helm:v0.13.3-build20260727" machine # [ 25.723372] k3s[894]: time="2026-09-25T16:32:07Z" level=info msg="Tagged docker.io/rancher/klipper-helm@sha256:5425a2b4613d2458dbdff99218e8d487ebb59c20e7a941f061c0777070f0aac1" machine # [ 25.724320] k3s[894]: time="2026-09-25T16:32:07Z" level=info msg="Imported docker.io/rancher/klipper-lb:v0.4.17" machine # [ 25.730667] k3s[894]: time="2026-09-25T16:32:07Z" level=info msg="Tagged docker.io/rancher/klipper-lb@sha256:910944bb0bd94f060a82a56ca1ea1c577d3e49b3473a093a47a985f32e92d94a" machine # [ 25.731592] k3s[894]: time="2026-09-25T16:32:07Z" level=info msg="Imported docker.io/rancher/local-path-provisioner:v0.0.37" machine # [ 25.738210] k3s[894]: time="2026-09-25T16:32:07Z" level=info msg="Tagged docker.io/rancher/local-path-provisioner@sha256:e757967a5ec338f6a9b371c5a9688bedaa8c3578ea3dd4db329ea0084be0a86f" machine # [ 25.739118] k3s[894]: time="2026-09-25T16:32:07Z" level=info msg="Imported docker.io/rancher/mirrored-coredns-coredns:1.14.6" machine # [ 25.743125] k3s[894]: time="2026-09-25T16:32:07Z" level=info msg="Tagged docker.io/rancher/mirrored-coredns-coredns@sha256:900f9c109f7a33545d3c811516e8376df9019147b750f5ce3e254468769176ea" machine # [ 25.743872] k3s[894]: time="2026-09-25T16:32:07Z" level=info msg="Imported docker.io/rancher/mirrored-library-busybox:1.37.0" machine # [ 25.751407] k3s[894]: time="2026-09-25T16:32:07Z" level=info msg="Tagged docker.io/rancher/mirrored-library-busybox@sha256:101b4afd76732482eff9b95cae5f94bcf295e521fbec4e01b69c5421f3f3f3e5" machine # [ 25.752157] k3s[894]: time="2026-09-25T16:32:07Z" level=info msg="Imported docker.io/rancher/mirrored-library-traefik:3.7.8" machine # [ 25.764175] k3s[894]: time="2026-09-25T16:32:07Z" level=info msg="Tagged docker.io/rancher/mirrored-library-traefik@sha256:4299bbed850421258fc5448c2e0e6ad350981d4d335a68de11b92448aedbefe5" machine # [ 25.766752] k3s[894]: time="2026-09-25T16:32:07Z" level=info msg="Imported docker.io/rancher/mirrored-metrics-server:v0.9.0" machine # [ 25.767921] k3s[894]: time="2026-09-25T16:32:07Z" level=info msg="Tagged docker.io/rancher/mirrored-metrics-server@sha256:d9862115e7c7881280d3d75ca26bda8ffc0fc213315979575bf23ce9826205c0" machine # [ 25.768669] k3s[894]: time="2026-09-25T16:32:07Z" level=info msg="Imported docker.io/rancher/mirrored-pause:3.10.2" machine # [ 25.773539] k3s[894]: time="2026-09-25T16:32:07Z" level=info msg="Tagged docker.io/rancher/mirrored-pause@sha256:f548e0e8e3dc1896ca956272154dde3314e8cc4fde0a57577ee9fa1c63f5baf4" machine # [ 26.062400] k3s[894]: time="2026-09-25T16:32:07Z" level=info msg="Imported 8 images from /var/lib/rancher/k3s/agent/images/k3s-airgap-images-amd64.tar.zst in 4.529803927s" machine # [ 26.064614] k3s[894]: time="2026-09-25T16:32:07Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-client.tar" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 26.428146] k3s[894]: time="2026-09-25T16:32:08Z" level=info msg="Starting k3s.cattle.io/v1, Kind=Addon controller" machine # [ 26.429689] k3s[894]: time="2026-09-25T16:32:08Z" level=info msg="Creating deploy event broadcaster" machine # [ 26.430943] k3s[894]: I0925 16:32:08.017211 894 controller.go:667] quota admission added evaluator for: addons.k3s.cattle.io machine # [ 26.436121] k3s[894]: time="2026-09-25T16:32:08Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 26.436904] k3s[894]: time="2026-09-25T16:32:08Z" level=info msg="Creating helm-controller event broadcaster" machine # [ 26.438087] k3s[894]: time="2026-09-25T16:32:08Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=ApplyingManifest type=Normal machine # [ 26.443986] k3s[894]: time="2026-09-25T16:32:08Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 26.452528] k3s[894]: time="2026-09-25T16:32:08Z" level=info msg="Cluster dns configmap has been set successfully" machine # [ 27.439769] k3s[894]: time="2026-09-25T16:32:09Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 27.482278] k3s[894]: I0925 16:32:09.068486 894 range_allocator.go:113] "No Secondary Service CIDR provided. Skipping filtering out secondary service addresses" logger="node-ipam-controller" machine # [ 27.490955] k3s[894]: I0925 16:32:09.077206 894 node_lifecycle_controller.go:419] "Controller will reconcile labels" logger="node-lifecycle-controller" machine # [ 27.491727] k3s[894]: I0925 16:32:09.077278 894 controllermanager.go:627] "Warning: controller is disabled" controller="cloud-node-lifecycle-controller" machine # [ 27.492240] k3s[894]: I0925 16:32:09.077295 894 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" requiredFeatureGates=["ClusterTrustBundle"] machine # [ 27.492750] k3s[894]: I0925 16:32:09.077310 894 controllermanager.go:579] "Warning: skipping controller" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" machine # [ 27.517087] k3s[894]: I0925 16:32:09.103032 894 controllermanager.go:579] "Warning: skipping controller" controller="storage-version-migrator-controller" machine # [ 27.548441] k3s[894]: I0925 16:32:09.134726 894 controllermanager.go:627] "Warning: controller is disabled" controller="node-route-controller" machine # [ 27.557272] k3s[894]: time="2026-09-25T16:32:09Z" level=info msg="Starting rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding controller" machine # [ 27.568139] k3s[894]: time="2026-09-25T16:32:09Z" level=info msg="Starting batch/v1, Kind=Job controller" machine # [ 27.568872] k3s[894]: time="2026-09-25T16:32:09Z" level=info msg="Starting /v1, Kind=ConfigMap controller" machine # [ 27.570339] k3s[894]: time="2026-09-25T16:32:09Z" level=info msg="Starting /v1, Kind=ServiceAccount controller" machine # [ 27.572425] k3s[894]: time="2026-09-25T16:32:09Z" level=info msg="Starting /v1, Kind=Secret controller" machine # [ 27.583224] k3s[894]: time="2026-09-25T16:32:09Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChartConfig controller" machine # [ 27.583939] k3s[894]: time="2026-09-25T16:32:09Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChart controller" machine # [ 27.625625] k3s[894]: time="2026-09-25T16:32:09Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=AppliedManifest type=Normal machine # Error from server (NotFound): namespaces "farm" not found machine # [ 27.636891] k3s[894]: time="2026-09-25T16:32:09Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=ApplyingManifest type=Normal machine # [ 27.926776] k3s[894]: time="2026-09-25T16:32:09Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=AppliedManifest type=Normal machine # [ 27.939876] k3s[894]: time="2026-09-25T16:32:09Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=ApplyingManifest type=Normal machine # [ 28.440266] k3s[894]: time="2026-09-25T16:32:10Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 28.532107] k3s[894]: I0925 16:32:10.118255 894 controller.go:667] quota admission added evaluator for: deployments.apps machine # [ 28.556453] k3s[894]: I0925 16:32:10.142899 894 serving.go:392] Generated self-signed cert in-memory machine # [ 28.616708] k3s[894]: I0925 16:32:10.203129 894 serving.go:392] Generated self-signed cert in-memory machine # [ 28.683452] k3s[894]: I0925 16:32:10.269480 894 alloc.go:329] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.43.0.10"} machine # [ 28.685606] k3s[894]: time="2026-09-25T16:32:10Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=AppliedManifest type=Normal machine # [ 28.802170] k3s[894]: I0925 16:32:10.388435 894 controllermanager.go:160] Version: v1.35.8+k3s1 machine # [ 28.808168] k3s[894]: I0925 16:32:10.393330 894 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 28.808964] k3s[894]: I0925 16:32:10.393369 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.809606] k3s[894]: I0925 16:32:10.393423 894 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 28.810147] k3s[894]: I0925 16:32:10.393439 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.810622] k3s[894]: I0925 16:32:10.393467 894 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 28.813342] k3s[894]: I0925 16:32:10.393483 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.814045] k3s[894]: I0925 16:32:10.393664 894 secure_serving.go:211] Serving securely on 127.0.0.1:10258 machine # [ 28.814536] k3s[894]: I0925 16:32:10.394027 894 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 28.815115] k3s[894]: time="2026-09-25T16:32:10Z" level=info msg="Creating service-lb-controller event broadcaster" machine: (finished: waiting for success: kubectl get ns farm, in 3.83 seconds) machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key machine # [ 28.907512] k3s[894]: I0925 16:32:10.493676 894 shared_informer.go:377] "Caches are synced" machine # [ 28.908370] k3s[894]: I0925 16:32:10.493698 894 shared_informer.go:377] "Caches are synced" machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key, in 0.16 seconds) machine: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key machine # [ 29.007906] k3s[894]: I0925 16:32:10.594334 894 shared_informer.go:377] "Caches are synced" machine # [ 29.026373] k3s[894]: I0925 16:32:10.612827 894 pv_protection_controller.go:81] "Starting PV protection controller" machine # [ 29.028198] k3s[894]: I0925 16:32:10.614687 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.028977] k3s[894]: I0925 16:32:10.615464 894 certificate_controller.go:120] "Starting certificate controller" name="csrapproving" machine # [ 29.031071] k3s[894]: I0925 16:32:10.616269 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.031730] k3s[894]: I0925 16:32:10.616321 894 clusterroleaggregation_controller.go:194] "Starting ClusterRoleAggregator controller" machine # [ 29.032420] k3s[894]: I0925 16:32:10.616336 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.033024] k3s[894]: I0925 16:32:10.616381 894 legacy_serviceaccount_token_cleaner.go:103] "Starting legacy service account token cleaner controller" machine # [ 29.033534] k3s[894]: I0925 16:32:10.616399 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.035111] k3s[894]: I0925 16:32:10.616505 894 replica_set.go:241] "Starting controller" name="replicationcontroller" machine # [ 29.035629] k3s[894]: I0925 16:32:10.616520 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.038107] k3s[894]: I0925 16:32:10.616597 894 gc_controller.go:98] "Starting GC controller" machine # [ 29.038856] k3s[894]: I0925 16:32:10.616619 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.039561] k3s[894]: I0925 16:32:10.616701 894 stateful_set.go:180] "Starting stateful set controller" machine # [ 29.040165] k3s[894]: I0925 16:32:10.616715 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.040685] k3s[894]: I0925 16:32:10.616753 894 tokencleaner.go:117] "Starting token cleaner controller" machine # [ 29.041423] k3s[894]: I0925 16:32:10.616769 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.041982] k3s[894]: I0925 16:32:10.616802 894 taint_eviction.go:283] "Starting" controller="taint-eviction-controller" machine # [ 29.043532] k3s[894]: I0925 16:32:10.616865 894 taint_eviction.go:288] "Sending events to API server" machine # [ 29.044084] k3s[894]: I0925 16:32:10.616875 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.044550] k3s[894]: I0925 16:32:10.616957 894 replica_set.go:241] "Starting controller" name="replicaset" machine # [ 29.048099] k3s[894]: I0925 16:32:10.616972 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.048801] k3s[894]: I0925 16:32:10.617004 894 disruption.go:458] "Sending events to api server." machine # [ 29.049449] k3s[894]: I0925 16:32:10.617036 894 disruption.go:465] "Starting disruption controller" machine # [ 29.049991] k3s[894]: I0925 16:32:10.617046 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.050500] k3s[894]: I0925 16:32:10.617077 894 cleaner.go:83] "Starting CSR cleaner controller" machine # [ 29.051071] k3s[894]: I0925 16:32:10.617135 894 ttl_controller.go:127] "Starting TTL controller" machine # [ 29.051583] k3s[894]: I0925 16:32:10.617148 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.052160] k3s[894]: I0925 16:32:10.617235 894 attach_detach_controller.go:335] "Starting attach detach controller" machine # [ 29.052658] k3s[894]: I0925 16:32:10.617249 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.054089] k3s[894]: I0925 16:32:10.617478 894 daemon_controller.go:309] "Starting daemon sets controller" machine # [ 29.054623] k3s[894]: I0925 16:32:10.617498 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.055323] k3s[894]: I0925 16:32:10.622732 894 horizontal.go:204] "Starting HPA controller" machine # [ 29.055930] k3s[894]: I0925 16:32:10.622753 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.056689] k3s[894]: I0925 16:32:10.622810 894 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-legacy-unknown" machine # [ 29.059117] k3s[894]: I0925 16:32:10.622826 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.059534] k3s[894]: I0925 16:32:10.622860 894 pvc_protection_controller.go:166] "Starting PVC protection controller" machine # [ 29.060139] k3s[894]: I0925 16:32:10.622879 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.060668] k3s[894]: I0925 16:32:10.622974 894 endpointslicemirroring_controller.go:226] "Starting EndpointSliceMirroring controller" machine # [ 29.061206] k3s[894]: I0925 16:32:10.622990 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.061738] k3s[894]: I0925 16:32:10.623092 894 node_ipam_controller.go:142] "Starting ipam controller" machine # [ 29.065109] k3s[894]: I0925 16:32:10.623106 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.065579] k3s[894]: I0925 16:32:10.623170 894 node_lifecycle_controller.go:453] "Sending events to api server" machine # [ 29.066169] k3s[894]: I0925 16:32:10.623200 894 node_lifecycle_controller.go:460] "Starting node controller" machine # [ 29.066708] k3s[894]: I0925 16:32:10.623211 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.067426] k3s[894]: I0925 16:32:10.623292 894 servicecidrs_controller.go:136] "Starting" controller="service-cidr-controller" machine # [ 29.067989] k3s[894]: I0925 16:32:10.623308 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.068723] k3s[894]: I0925 16:32:10.623350 894 serviceaccounts_controller.go:117] "Starting service account controller" machine # [ 29.070104] k3s[894]: I0925 16:32:10.623364 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.070810] k3s[894]: I0925 16:32:10.623457 894 job_controller.go:254] "Starting job controller" machine # [ 29.071505] k3s[894]: I0925 16:32:10.623471 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.072103] k3s[894]: I0925 16:32:10.623506 894 expand_controller.go:328] "Starting expand controller" machine # [ 29.072600] k3s[894]: I0925 16:32:10.623520 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.075112] k3s[894]: I0925 16:32:10.623580 894 ttlafterfinished_controller.go:112] "Starting TTL after finished controller" machine # [ 29.075752] k3s[894]: I0925 16:32:10.623595 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.076453] k3s[894]: I0925 16:32:10.623644 894 controller.go:174] "Starting ephemeral volume controller" machine # [ 29.077029] k3s[894]: I0925 16:32:10.623658 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.077531] k3s[894]: I0925 16:32:10.623753 894 controller.go:423] "Starting resource claim controller" machine # [ 29.081108] k3s[894]: I0925 16:32:10.623767 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.081613] k3s[894]: I0925 16:32:10.623846 894 endpoints_controller.go:193] "Starting endpoint controller" machine # [ 29.082211] k3s[894]: I0925 16:32:10.623860 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.082728] k3s[894]: I0925 16:32:10.623933 894 deployment_controller.go:172] "Starting controller" controller="deployment" machine # [ 29.083425] k3s[894]: I0925 16:32:10.623948 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.083623] k3s[894]: I0925 16:32:10.624066 894 pv_controller_base.go:307] "Starting persistent volume controller" machine # [ 29.084327] k3s[894]: I0925 16:32:10.624079 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.085072] k3s[894]: I0925 16:32:10.624114 894 vac_protection_controller.go:206] "Starting VAC protection controller" machine # [ 29.085561] k3s[894]: I0925 16:32:10.624128 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.086148] k3s[894]: I0925 16:32:10.624167 894 publisher.go:107] "Starting root CA cert publisher controller" machine # [ 29.086653] k3s[894]: I0925 16:32:10.624182 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.088093] k3s[894]: I0925 16:32:10.624216 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.088733] k3s[894]: I0925 16:32:10.624309 894 endpointslice_controller.go:283] "Starting endpoint slice controller" machine # [ 29.089450] k3s[894]: I0925 16:32:10.624322 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.091584] k3s[894]: I0925 16:32:10.614392 894 namespace_controller.go:202] "Starting namespace controller" machine # [ 29.092179] k3s[894]: I0925 16:32:10.624354 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.092675] k3s[894]: I0925 16:32:10.629420 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.095109] k3s[894]: I0925 16:32:10.632165 894 resource_quota_controller.go:297] "Starting resource quota controller" machine # [ 29.095687] k3s[894]: I0925 16:32:10.632187 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.096190] k3s[894]: I0925 16:32:10.632417 894 resource_quota_monitor.go:309] "QuotaMonitor running" machine # [ 29.096675] k3s[894]: I0925 16:32:10.640012 894 garbagecollector.go:141] "Starting controller" controller="garbagecollector" machine # [ 29.097214] k3s[894]: I0925 16:32:10.640052 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.097701] k3s[894]: I0925 16:32:10.640125 894 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-serving" machine # [ 29.098244] k3s[894]: I0925 16:32:10.640138 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.098806] k3s[894]: I0925 16:32:10.640205 894 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-client" machine # [ 29.100089] k3s[894]: I0925 16:32:10.640218 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.100666] k3s[894]: I0925 16:32:10.640249 894 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kube-apiserver-client" machine # [ 29.101193] k3s[894]: I0925 16:32:10.640262 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.101707] k3s[894]: I0925 16:32:10.640297 894 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 29.104125] k3s[894]: I0925 16:32:10.640503 894 cronjob_controllerv2.go:143] "Starting cronjob controller v2" machine # [ 29.104725] k3s[894]: I0925 16:32:10.640518 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.105450] k3s[894]: I0925 16:32:10.643828 894 graph_builder.go:386] "Running" component="GraphBuilder" machine # [ 29.105948] k3s[894]: I0925 16:32:10.643874 894 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 29.106669] k3s[894]: I0925 16:32:10.643953 894 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 29.108089] k3s[894]: I0925 16:32:10.644020 894 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 29.123340] k3s[894]: I0925 16:32:10.709737 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" resource="helmchartconfigs.helm.cattle.io" machine # [ 29.124242] k3s[894]: I0925 16:32:10.709853 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" resource="addons.k3s.cattle.io" machine # [ 29.124507] k3s[894]: I0925 16:32:10.709882 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" resource="helmcharts.helm.cattle.io" machine # [ 29.125213] k3s[894]: I0925 16:32:10.709942 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.138025] k3s[894]: I0925 16:32:10.724285 894 shared_informer.go:370] "Waiting for caches to sync" machine: (finished: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key, in 0.21 seconds) machine: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine # [ 29.224262] k3s[894]: I0925 16:32:10.810662 894 shared_informer.go:377] "Caches are synced" machine # [ 29.230686] k3s[894]: I0925 16:32:10.816626 894 shared_informer.go:377] "Caches are synced" machine # [ 29.232235] k3s[894]: I0925 16:32:10.816761 894 shared_informer.go:377] "Caches are synced" machine # [ 29.233445] k3s[894]: I0925 16:32:10.816867 894 shared_informer.go:377] "Caches are synced" machine # [ 29.234914] k3s[894]: I0925 16:32:10.819985 894 shared_informer.go:377] "Caches are synced" machine # [ 29.236213] k3s[894]: I0925 16:32:10.820049 894 shared_informer.go:377] "Caches are synced" machine # [ 29.237319] k3s[894]: I0925 16:32:10.820112 894 shared_informer.go:377] "Caches are synced" machine # [ 29.238395] k3s[894]: I0925 16:32:10.820149 894 shared_informer.go:377] "Caches are synced" machine # [ 29.239491] k3s[894]: I0925 16:32:10.820199 894 shared_informer.go:377] "Caches are synced" machine # [ 29.240604] k3s[894]: I0925 16:32:10.820014 894 shared_informer.go:377] "Caches are synced" machine # [ 29.241748] k3s[894]: I0925 16:32:10.820505 894 shared_informer.go:377] "Caches are synced" machine # [ 29.242968] k3s[894]: I0925 16:32:10.820561 894 shared_informer.go:377] "Caches are synced" machine # [ 29.244235] k3s[894]: I0925 16:32:10.820590 894 shared_informer.go:377] "Caches are synced" machine # [ 29.245451] k3s[894]: I0925 16:32:10.820626 894 shared_informer.go:377] "Caches are synced" machine # [ 29.246688] k3s[894]: I0925 16:32:10.822928 894 shared_informer.go:377] "Caches are synced" machine # [ 29.247904] k3s[894]: I0925 16:32:10.822977 894 shared_informer.go:377] "Caches are synced" machine # [ 29.249148] k3s[894]: I0925 16:32:10.823118 894 shared_informer.go:377] "Caches are synced" machine # [ 29.250354] k3s[894]: I0925 16:32:10.823229 894 shared_informer.go:377] "Caches are synced" machine # [ 29.251562] k3s[894]: I0925 16:32:10.823315 894 shared_informer.go:377] "Caches are synced" machine # [ 29.252778] k3s[894]: I0925 16:32:10.823390 894 shared_informer.go:377] "Caches are synced" machine # [ 29.254099] k3s[894]: I0925 16:32:10.823434 894 range_allocator.go:177] "Sending events to api server" machine # [ 29.255524] k3s[894]: I0925 16:32:10.823469 894 range_allocator.go:181] "Starting range CIDR allocator" machine # [ 29.256143] k3s[894]: I0925 16:32:10.823479 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.256715] k3s[894]: I0925 16:32:10.823490 894 shared_informer.go:377] "Caches are synced" machine # [ 29.257395] k3s[894]: I0925 16:32:10.823972 894 shared_informer.go:377] "Caches are synced" machine # [ 29.257939] k3s[894]: I0925 16:32:10.824019 894 shared_informer.go:377] "Caches are synced" machine # [ 29.258641] k3s[894]: I0925 16:32:10.824246 894 shared_informer.go:377] "Caches are synced" machine # [ 29.259471] k3s[894]: I0925 16:32:10.824435 894 shared_informer.go:377] "Caches are synced" machine # [ 29.260228] k3s[894]: I0925 16:32:10.824498 894 shared_informer.go:377] "Caches are synced" machine # [ 29.261569] k3s[894]: I0925 16:32:10.824658 894 shared_informer.go:377] "Caches are synced" machine # [ 29.262207] k3s[894]: I0925 16:32:10.824701 894 shared_informer.go:377] "Caches are synced" machine # [ 29.262714] k3s[894]: I0925 16:32:10.825176 894 shared_informer.go:377] "Caches are synced" machine # [ 29.263390] k3s[894]: I0925 16:32:10.825255 894 shared_informer.go:377] "Caches are synced" machine # [ 29.264073] k3s[894]: I0925 16:32:10.825321 894 shared_informer.go:377] "Caches are synced" machine # [ 29.264572] k3s[894]: I0925 16:32:10.825373 894 shared_informer.go:377] "Caches are synced" machine # [ 29.266452] k3s[894]: I0925 16:32:10.825403 894 shared_informer.go:377] "Caches are synced" machine # [ 29.267024] k3s[894]: I0925 16:32:10.825658 894 shared_informer.go:377] "Caches are synced" machine # [ 29.267553] k3s[894]: I0925 16:32:10.825702 894 shared_informer.go:377] "Caches are synced" machine # [ 29.269058] k3s[894]: I0925 16:32:10.825756 894 shared_informer.go:377] "Caches are synced" machine # [ 29.269986] k3s[894]: I0925 16:32:10.826456 894 shared_informer.go:377] "Caches are synced" machine # [ 29.270587] k3s[894]: I0925 16:32:10.830428 894 shared_informer.go:377] "Caches are synced" machine # [ 29.271582] k3s[894]: I0925 16:32:10.832415 894 shared_informer.go:377] "Caches are synced" machine # [ 29.272445] k3s[894]: I0925 16:32:10.840244 894 shared_informer.go:377] "Caches are synced" machine # [ 29.273202] k3s[894]: I0925 16:32:10.840322 894 shared_informer.go:377] "Caches are synced" machine # [ 29.274711] k3s[894]: I0925 16:32:10.840363 894 shared_informer.go:377] "Caches are synced" machine # [ 29.275661] k3s[894]: I0925 16:32:10.844137 894 shared_informer.go:377] "Caches are synced" machine # [ 29.290984] k3s[894]: time="2026-09-25T16:32:10Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 29.296559] k3s[894]: time="2026-09-25T16:32:10Z" level=info msg="Starting /v1, Kind=Pod controller" machine # [ 29.300831] k3s[894]: time="2026-09-25T16:32:10Z" level=info msg="Starting apps/v1, Kind=DaemonSet controller" machine # [ 29.305558] k3s[894]: time="2026-09-25T16:32:10Z" level=info msg="Starting discovery.k8s.io/v1, Kind=EndpointSlice controller" machine # [ 29.307579] k3s[894]: I0925 16:32:10.894045 894 controllermanager.go:329] Started "cloud-node-controller" machine # [ 29.308240] k3s[894]: I0925 16:32:10.894711 894 node_controller.go:176] Sending events to api server. machine # [ 29.308814] k3s[894]: I0925 16:32:10.894782 894 node_controller.go:185] Waiting for informer caches to sync machine # [ 29.311577] k3s[894]: I0925 16:32:10.898058 894 controllermanager.go:329] Started "cloud-node-lifecycle-controller" machine # [ 29.313214] k3s[894]: I0925 16:32:10.898408 894 node_lifecycle_controller.go:112] Sending events to api server machine # [ 29.315318] k3s[894]: I0925 16:32:10.901758 894 controllermanager.go:329] Started "service-lb-controller" machine # [ 29.315962] k3s[894]: W0925 16:32:10.901804 894 controllermanager.go:306] "node-route-controller" is disabled machine # [ 29.316396] k3s[894]: I0925 16:32:10.902514 894 controller.go:235] Starting service controller machine # [ 29.316932] k3s[894]: I0925 16:32:10.902581 894 shared_informer.go:370] "Waiting for caches to sync" machine: (finished: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.19 seconds) subtest: chart deploys and workers become Ready machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine # [ 29.439139] k3s[894]: time="2026-09-25T16:32:11Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 29.482993] k3s[894]: time="2026-09-25T16:32:11Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" object=kube-system/local-storage reason=DeletingManifest type=Normal machine # [ 29.495958] k3s[894]: time="2026-09-25T16:32:11Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=ApplyingManifest type=Normal machine # [ 29.516271] k3s[894]: I0925 16:32:11.102734 894 shared_informer.go:377] "Caches are synced" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 29.631031] k3s[894]: I0925 16:32:11.217352 894 controller.go:667] quota admission added evaluator for: helmcharts.helm.cattle.io machine # [ 29.635994] k3s[894]: time="2026-09-25T16:32:11Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=AppliedManifest type=Normal machine # [ 29.646693] k3s[894]: time="2026-09-25T16:32:11Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=ApplyingManifest type=Normal machine # [ 29.675761] k3s[894]: time="2026-09-25T16:32:11Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Deferred node password secret validation complete" object=machine reason=NodePasswordValidationComplete type=Normal machine # [ 29.680693] k3s[894]: time="2026-09-25T16:32:11Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Applying HelmChart from https://%{KUBERNETES_API}%/static/charts/nix-grpc-farm.tgz using Job kube-system/helm-install-nix-grpc-farm " object=kube-system/nix-grpc-farm reason=ApplyJob type=Normal machine # [ 29.702372] k3s[894]: I0925 16:32:11.288832 894 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 29.710425] k3s[894]: I0925 16:32:11.296860 894 controller.go:667] quota admission added evaluator for: jobs.batch machine # [ 29.714108] k3s[894]: I0925 16:32:11.300577 894 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 29.774975] k3s[894]: I0925 16:32:11.361384 894 controller.go:667] quota admission added evaluator for: replicasets.apps machine # [ 29.801589] k3s[894]: time="2026-09-25T16:32:11Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=AppliedManifest type=Normal machine # [ 29.811179] k3s[894]: time="2026-09-25T16:32:11Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=ApplyingManifest type=Normal machine # [ 29.921918] k3s[894]: time="2026-09-25T16:32:11Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=AppliedManifest type=Normal machine # [ 30.077051] k3s[894]: time="2026-09-25T16:32:11Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/traefik.yaml\"" object=kube-system/traefik reason=DeletingManifest type=Normal machine # [ 30.094944] k3s[894]: time="2026-09-25T16:32:11Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Resumed synced Job kube-system/helm-install-nix-grpc-farm" object=kube-system/nix-grpc-farm reason=ResumeJob type=Normal machine # [ 30.438681] k3s[894]: time="2026-09-25T16:32:12Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 30.542571] k3s[894]: I0925 16:32:12.128668 894 shared_informer.go:377] "Caches are synced" machine # [ 30.557791] k3s[894]: I0925 16:32:12.144176 894 shared_informer.go:377] "Caches are synced" machine # [ 30.559224] k3s[894]: I0925 16:32:12.144206 894 garbagecollector.go:166] "Garbage collector: all resource monitors have synced" machine # [ 30.560933] k3s[894]: I0925 16:32:12.144374 894 garbagecollector.go:169] "Proceeding to collect garbage" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 31.356127] postgres[1201]: [1201] ERROR: relation "goose_db_version" does not exist at character 36 machine # [ 31.356930] postgres[1201]: [1201] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC machine # [ 31.382541] niks3-server[1193]: 2026/09/25 16:32:12 OK 20241026095416_initial_model.sql (10.63ms) machine # [ 31.393199] niks3-server[1193]: 2026/09/25 16:32:12 OK 20251210153512_drop_unused_gin_index.sql (3.22ms) machine # [ 31.396819] niks3-server[1193]: 2026/09/25 16:32:12 OK 20251218171726_add_pins.sql (3.63ms) machine # [ 31.403925] niks3-server[1193]: 2026/09/25 16:32:12 OK 20260628120000_add_object_size_and_stats.sql (5.8ms) machine # [ 31.407495] niks3-server[1193]: 2026/09/25 16:32:12 OK 20260905000000_add_claims.sql (4.53ms) machine # [ 31.412050] niks3-server[1193]: 2026/09/25 16:32:12 OK 20260920000000_drop_claims.sql (4.44ms) machine # [ 31.413898] niks3-server[1193]: 2026/09/25 16:32:13 OK 20260923120000_add_pushes.sql (1.97ms) machine # [ 31.414591] niks3-server[1193]: 2026/09/25 16:32:13 goose: successfully migrated database to version: 20260923120000 machine # [ 31.420450] niks3-server[1193]: 2026/09/25 16:32:13 OK 1_commit_pending_closure.sql (6.4ms) machine # [ 31.424899] niks3-server[1193]: 2026/09/25 16:32:13 OK 2_object_stats_trigger.sql (3.09ms) machine # [ 31.431165] niks3-server[1193]: 2026/09/25 16:32:13 OK 3_commit_push.sql (6.22ms) machine # [ 31.431717] niks3-server[1193]: 2026/09/25 16:32:13 goose: up to current file version: 3 machine # [ 31.435418] niks3-server[1193]: 2026/09/25 16:32:13 INFO OIDC provider initialized name=kubernetes issuer=https://kubernetes.default.svc.cluster.local machine # [ 31.436317] niks3-server[1193]: 2026/09/25 16:32:13 INFO OIDC authentication enabled config=/nix/store/v0b0sqyzhrjsz48x3klf7b7vl89apzs0-niks3-oidc.json machine # [ 31.438071] niks3-server[1193]: 2026/09/25 16:32:13 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key machine # [ 31.438873] k3s[894]: time="2026-09-25T16:32:13Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 31.468601] niks3-server[1193]: 2026/09/25 16:32:13 INFO Read proxy enabled — serving cache objects from S3 machine # [ 31.469580] niks3-server[1193]: 2026/09/25 16:32:13 INFO Using socket-activated listener address=0.0.0.0:5751 machine # [ 31.469845] niks3-server[1193]: 2026/09/25 16:32:13 INFO systemd watchdog enabled interval=15s machine # [ 31.470857] systemd[1]: Started niks3 server. machine # [ 31.471517] niks3-server[1193]: 2026/09/25 16:32:13 INFO Starting HTTP server address=0.0.0.0:5751 machine # [ 31.472098] systemd[1]: Reached target Multi-User System. machine # [ 31.472670] systemd[1]: Startup finished in 1.167s (kernel) + 3.856s (initrd) + 26.447s (userspace) = 31.471s. machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 32.438167] k3s[894]: time="2026-09-25T16:32:14Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 33.441713] k3s[894]: time="2026-09-25T16:32:15Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 33.482380] k3s[894]: time="2026-09-25T16:32:15Z" level=info msg="Started tunnel to 10.0.2.15:6443" machine # [ 33.484116] k3s[894]: time="2026-09-25T16:32:15Z" level=info msg="Stopped tunnel to 127.0.0.1:6443" machine # [ 33.485886] k3s[894]: time="2026-09-25T16:32:15Z" level=info msg="Connecting to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 33.491279] k3s[894]: time="2026-09-25T16:32:15Z" level=info msg="Proxy done" err="context canceled" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 33.493574] k3s[894]: time="2026-09-25T16:32:15Z" level=info msg="error in remotedialer server [400]: websocket: close 1006 (abnormal closure): unexpected EOF" machine # [ 33.494712] k3s[894]: time="2026-09-25T16:32:15Z" level=info msg="Handling backend connection request [machine]" machine # [ 33.496523] k3s[894]: time="2026-09-25T16:32:15Z" level=info msg="Connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 33.498247] k3s[894]: time="2026-09-25T16:32:15Z" level=info msg="Imported docker.io/library/nix-grpc-farm-client:0.1.0-beta.4" machine # [ 33.499395] k3s[894]: time="2026-09-25T16:32:15Z" level=info msg="Remotedialer connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 33.501122] k3s[894]: time="2026-09-25T16:32:15Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-client@sha256:3d30d0587c09c728a9b30380d9515571b95152e3fee9f98ebbdbc4d4fc6f2128" machine # [ 34.210763] k3s[894]: time="2026-09-25T16:32:15Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-client.tar in 8.148163522s" machine # [ 34.212828] k3s[894]: time="2026-09-25T16:32:15Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-lb.tar" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 34.438035] k3s[894]: time="2026-09-25T16:32:16Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 35.439262] k3s[894]: time="2026-09-25T16:32:17Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 36.441353] k3s[894]: time="2026-09-25T16:32:18Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 36.514330] k3s[894]: time="2026-09-25T16:32:18Z" level=info msg="Imported docker.io/library/nix-grpc-farm-lb:0.1.0-beta.4" machine # [ 36.518965] k3s[894]: time="2026-09-25T16:32:18Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-lb@sha256:18ee6724be589622e1aee9d13c5121e7b2c992ca636c935ade90c66423e18f37" machine # [ 36.583480] k3s[894]: time="2026-09-25T16:32:18Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-lb.tar in 2.370787907s" machine # [ 36.584340] k3s[894]: time="2026-09-25T16:32:18Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm.tar" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 37.050841] k3s[894]: time="2026-09-25T16:32:18Z" level=info msg="Running kubelet --cloud-provider=external --config-dir=/var/lib/rancher/k3s/agent/etc/kubelet.conf.d --containerd=/run/k3s/containerd/containerd.sock --eviction-hard=nodefs.available<1%,imagefs.available<1% --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubelet.kubeconfig --node-ip=10.0.2.15,fec0::139c:1f9b:479c:fae --node-labels= --read-only-port=0" machine # [ 37.058905] k3s[894]: Flag --containerd has been deprecated, This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed. machine # [ 37.068859] k3s[894]: I0925 16:32:18.655193 894 server.go:521] "Kubelet version" kubeletVersion="v1.35.8+k3s1" machine # [ 37.070113] k3s[894]: I0925 16:32:18.655226 894 server.go:523] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 37.070797] k3s[894]: I0925 16:32:18.655263 894 watchdog_linux.go:95] "Systemd watchdog is not enabled" machine # [ 37.074303] k3s[894]: I0925 16:32:18.655275 894 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." machine # [ 37.075064] k3s[894]: I0925 16:32:18.656749 894 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/agent/client-ca.crt" machine # [ 37.076762] k3s[894]: I0925 16:32:18.663227 894 server.go:1414] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" machine # [ 37.082781] k3s[894]: I0925 16:32:18.667919 894 server.go:771] "--cgroups-per-qos enabled, but --cgroup-root was not specified. Defaulting to /" machine # [ 37.086905] k3s[894]: I0925 16:32:18.667955 894 server.go:832] "NoSwap is set due to memorySwapBehavior not specified" memorySwapBehavior="" FailSwapOn=false machine # [ 37.087536] k3s[894]: I0925 16:32:18.668145 894 container_manager_linux.go:272] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] machine # [ 37.088221] k3s[894]: I0925 16:32:18.668169 894 container_manager_linux.go:277] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"machine","RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} machine # [ 37.088878] k3s[894]: I0925 16:32:18.668347 894 topology_manager.go:143] "Creating topology manager with none policy" machine # [ 37.089502] k3s[894]: I0925 16:32:18.668363 894 container_manager_linux.go:308] "Creating device plugin manager" machine # [ 37.090041] k3s[894]: I0925 16:32:18.668433 894 container_manager_linux.go:317] "Creating Dynamic Resource Allocation (DRA) manager" machine # [ 37.347798] k3s[894]: I0925 16:32:18.934055 894 state_mem.go:41] "Initialized" logger="CPUManager state memory" machine # [ 37.349359] k3s[894]: I0925 16:32:18.934630 894 kubelet.go:482] "Attempting to sync node with API server" machine # [ 37.351006] k3s[894]: I0925 16:32:18.934668 894 kubelet.go:383] "Adding static pod path" path="/var/lib/rancher/k3s/agent/pod-manifests" machine # [ 37.352211] k3s[894]: I0925 16:32:18.934725 894 kubelet.go:394] "Adding apiserver pod source" machine # [ 37.353421] k3s[894]: I0925 16:32:18.934757 894 apiserver.go:42] "Waiting for node sync before watching apiserver pods" machine # [ 37.356804] k3s[894]: I0925 16:32:18.943131 894 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="containerd" version="2.2.7-k3s1" apiVersion="v1" machine # [ 37.359510] k3s[894]: I0925 16:32:18.944446 894 kubelet.go:945] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" machine # [ 37.361464] k3s[894]: I0925 16:32:18.944497 894 kubelet.go:972] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" machine # [ 37.377542] k3s[894]: I0925 16:32:18.963905 894 server.go:1252] "Started kubelet" machine # [ 37.379754] k3s[894]: I0925 16:32:18.964680 894 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 machine # [ 37.383116] k3s[894]: I0925 16:32:18.964834 894 server_v1.go:49] "podresources" method="list" useActivePods=true machine # [ 37.384599] k3s[894]: I0925 16:32:18.965231 894 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" machine # [ 37.386587] k3s[894]: I0925 16:32:18.965323 894 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 machine # [ 37.388141] k3s[894]: I0925 16:32:18.967115 894 server.go:317] "Adding debug handlers to kubelet server" machine # [ 37.389522] k3s[894]: I0925 16:32:18.971661 894 dynamic_serving_content.go:135] "Starting controller" name="kubelet-server-cert-files::/var/lib/rancher/k3s/agent/serving-kubelet.crt::/var/lib/rancher/k3s/agent/serving-kubelet.key" machine # [ 37.392313] k3s[894]: I0925 16:32:18.972678 894 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" machine # [ 37.393788] k3s[894]: I0925 16:32:18.977757 894 volume_manager.go:311] "Starting Kubelet Volume Manager" machine # [ 37.395238] k3s[894]: E0925 16:32:18.977919 894 kubelet.go:1661] "Image garbage collection failed once. Stats initialization may not have completed yet" err="invalid capacity 0 on image filesystem" machine # [ 37.397732] k3s[894]: I0925 16:32:18.978157 894 desired_state_of_world_populator.go:146] "Desired state populator starts to run" machine # [ 37.399360] k3s[894]: I0925 16:32:18.978261 894 reconciler.go:29] "Reconciler: start to sync state" machine # [ 37.400700] k3s[894]: E0925 16:32:18.980102 894 kubelet_node_status.go:392] "Error getting the current node from lister" err="node \"machine\" not found" machine # [ 37.402689] k3s[894]: I0925 16:32:18.984040 894 factory.go:223] Registration of the containerd container factory successfully machine # [ 37.404294] k3s[894]: I0925 16:32:18.984058 894 factory.go:223] Registration of the systemd container factory successfully machine # [ 37.405870] k3s[894]: I0925 16:32:18.984170 894 factory.go:221] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory machine # [ 37.408919] k3s[894]: E0925 16:32:18.986667 894 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"machine\" not found" node="machine" machine # [ 37.411802] k3s[894]: I0925 16:32:18.998256 894 cpu_manager.go:225] "Starting" policy="none" machine # [ 37.413660] k3s[894]: I0925 16:32:18.998277 894 cpu_manager.go:226] "Reconciling" reconcilePeriod="10s" machine # [ 37.414850] k3s[894]: I0925 16:32:18.998304 894 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" machine # [ 37.428458] k3s[894]: I0925 16:32:19.014909 894 policy_none.go:50] "Start" machine # [ 37.429713] k3s[894]: I0925 16:32:19.014935 894 memory_manager.go:187] "Starting memorymanager" policy="None" machine # [ 37.432094] k3s[894]: I0925 16:32:19.014956 894 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" machine # [ 37.437142] k3s[894]: I0925 16:32:19.023572 894 policy_none.go:44] "Start" machine # [ 37.439598] k3s[894]: time="2026-09-25T16:32:19Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 37.443394] systemd[1]: Created slice libcontainer container kubepods.slice. machine # [ 37.454751] systemd[1]: Created slice libcontainer container kubepods-burstable.slice. machine # [ 37.458963] systemd[1]: Created slice libcontainer container kubepods-besteffort.slice. machine # [ 37.465857] k3s[894]: E0925 16:32:19.052050 894 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" machine # [ 37.467219] k3s[894]: I0925 16:32:19.052189 894 eviction_manager.go:194] "Eviction manager: starting control loop" machine # [ 37.467747] k3s[894]: I0925 16:32:19.052216 894 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" machine # [ 37.468459] k3s[894]: I0925 16:32:19.052693 894 plugin_manager.go:121] "Starting Kubelet Plugin Manager" machine # [ 37.469390] k3s[894]: E0925 16:32:19.055760 894 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="no imagefs label for configured runtime" machine # [ 37.470063] k3s[894]: E0925 16:32:19.055823 894 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"machine\" not found" machine # [ 37.492903] k3s[894]: I0925 16:32:19.079323 894 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" machine # [ 37.497688] k3s[894]: I0925 16:32:19.084105 894 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" machine # [ 37.498523] k3s[894]: I0925 16:32:19.084162 894 status_manager.go:249] "Starting to sync pod status with apiserver" machine # [ 37.499202] k3s[894]: I0925 16:32:19.084223 894 kubelet.go:2506] "Starting kubelet main sync loop" machine # [ 37.499868] k3s[894]: E0925 16:32:19.084288 894 kubelet.go:2530] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" machine # [ 37.568520] k3s[894]: I0925 16:32:19.154909 894 kubelet_node_status.go:74] "Attempting to register node" node="machine" machine # [ 37.574594] k3s[894]: I0925 16:32:19.161050 894 kubelet_node_status.go:77] "Successfully registered node" node="machine" machine # [ 37.575246] k3s[894]: E0925 16:32:19.161097 894 kubelet_node_status.go:474] "Error updating node status, will retry" err="error getting node \"machine\": node \"machine\" not found" machine # [ 37.576096] k3s[894]: time="2026-09-25T16:32:19Z" level=info msg="Adding node OwnerReference to node-password secret machine.node-password.k3s" machine # [ 37.577526] k3s[894]: I0925 16:32:19.162375 894 node_controller.go:429] Initializing node machine with cloud provider machine # [ 37.578816] k3s[894]: I0925 16:32:19.162435 894 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 37.579774] k3s[894]: E0925 16:32:19.162461 894 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 37.580583] k3s[894]: I0925 16:32:19.163448 894 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"machine\" does not exist" machine # [ 37.583055] k3s[894]: I0925 16:32:19.169495 894 node_controller.go:429] Initializing node machine with cloud provider machine # [ 37.583805] k3s[894]: I0925 16:32:19.169590 894 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 37.584401] k3s[894]: E0925 16:32:19.169617 894 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 37.588027] k3s[894]: I0925 16:32:19.174472 894 node_controller.go:429] Initializing node machine with cloud provider machine # [ 37.588866] k3s[894]: I0925 16:32:19.175359 894 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 37.589693] k3s[894]: E0925 16:32:19.176149 894 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 37.590387] k3s[894]: I0925 16:32:19.175806 894 range_allocator.go:433] "Set node PodCIDR" node="machine" podCIDRs=["10.42.0.0/24"] machine # [ 37.594059] k3s[894]: I0925 16:32:19.179755 894 node_controller.go:429] Initializing node machine with cloud provider machine # [ 37.594974] k3s[894]: I0925 16:32:19.179802 894 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 37.595764] k3s[894]: E0925 16:32:19.179821 894 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 37.597115] k3s[894]: I0925 16:32:19.183166 894 node_controller.go:429] Initializing node machine with cloud provider machine # [ 37.597680] k3s[894]: I0925 16:32:19.183294 894 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 37.598199] k3s[894]: E0925 16:32:19.183323 894 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 37.598796] k3s[894]: time="2026-09-25T16:32:19Z" level=info msg="Synced coredns NodeHosts entries for machine" machine # [ 37.601120] k3s[894]: I0925 16:32:19.186463 894 kuberuntime_manager.go:2095] "Updating runtime config through cri with podcidr" CIDR="10.42.0.0/24" machine # [ 37.601903] k3s[894]: I0925 16:32:19.188367 894 node_controller.go:429] Initializing node machine with cloud provider machine # [ 37.602558] k3s[894]: time="2026-09-25T16:32:19Z" level=info msg="Annotations and labels have been set successfully on node: machine" machine # [ 37.603154] k3s[894]: time="2026-09-25T16:32:19Z" level=info msg="Starting flannel with backend vxlan" machine # [ 37.604851] k3s[894]: I0925 16:32:19.191168 894 kubelet_network.go:47] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.42.0.0/24" machine # [ 37.638149] k3s[894]: I0925 16:32:19.223658 894 node_controller.go:474] Successfully initialized node machine with cloud provider machine # [ 37.639103] k3s[894]: I0925 16:32:19.223894 894 event.go:389] "Event occurred" object="machine" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="Synced" message="Node synced successfully" machine # [ 37.643925] k3s[894]: I0925 16:32:19.230384 894 server.go:173] "Starting Kubernetes Scheduler" version="v1.35.8+k3s1" machine # [ 37.644645] k3s[894]: I0925 16:32:19.230410 894 server.go:175] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 37.648255] k3s[894]: I0925 16:32:19.234704 894 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 37.649032] k3s[894]: I0925 16:32:19.234737 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 37.649767] k3s[894]: I0925 16:32:19.234783 894 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 37.650523] k3s[894]: I0925 16:32:19.234801 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 37.651155] k3s[894]: I0925 16:32:19.234830 894 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 37.651787] k3s[894]: I0925 16:32:19.234850 894 shared_informer.go:370] "Waiting for caches to sync" machine # [ 37.652344] k3s[894]: I0925 16:32:19.235503 894 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 37.653223] k3s[894]: I0925 16:32:19.239564 894 secure_serving.go:211] Serving securely on 127.0.0.1:10259 machine # [ 37.654055] k3s[894]: I0925 16:32:19.239962 894 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 37.737858] k3s[894]: I0925 16:32:19.324283 894 kubelet_node_status.go:427] "Fast updating node status as it just became ready" machine # [ 37.738753] k3s[894]: I0925 16:32:19.325151 894 server.go:218] "Successfully retrieved NodeIPs" NodeIPs=["10.0.2.15","fec0::139c:1f9b:479c:fae"] machine # [ 37.739576] k3s[894]: E0925 16:32:19.325285 894 server.go:255] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`" machine # [ 37.747761] k3s[894]: time="2026-09-25T16:32:19Z" level=info msg="Flannel found PodCIDR assigned for node machine" machine # [ 37.748547] k3s[894]: I0925 16:32:19.334811 894 shared_informer.go:377] "Caches are synced" machine # [ 37.748958] k3s[894]: I0925 16:32:19.334856 894 shared_informer.go:377] "Caches are synced" machine # [ 37.749594] k3s[894]: I0925 16:32:19.334889 894 shared_informer.go:377] "Caches are synced" machine # [ 37.750472] k3s[894]: time="2026-09-25T16:32:19Z" level=info msg="The interface eth0 with ipv4 address 10.0.2.15 will be used by flannel" machine # [ 37.751572] k3s[894]: I0925 16:32:19.337249 894 kube.go:139] Waiting 10m0s for node controller to sync machine # [ 37.752223] k3s[894]: I0925 16:32:19.337318 894 kube.go:537] Starting kube subnet manager machine # [ 37.765362] k3s[894]: I0925 16:32:19.351759 894 topologycache.go:237] "Can't get CPU or zone information for node" node="machine" machine # [ 37.780743] k3s[894]: I0925 16:32:19.367184 894 server.go:264] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4" machine # [ 37.781975] k3s[894]: I0925 16:32:19.367238 894 server_linux.go:136] "Using iptables Proxier" machine # [ 37.802911] k3s[894]: I0925 16:32:19.389343 894 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4" machine # [ 37.816492] k3s[894]: I0925 16:32:19.402904 894 server.go:529] "Version info" version="v1.35.8+k3s1" machine # [ 37.817346] k3s[894]: I0925 16:32:19.402944 894 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 37.818180] k3s[894]: I0925 16:32:19.404493 894 config.go:200] "Starting service config controller" machine # [ 37.818773] k3s[894]: I0925 16:32:19.404520 894 shared_informer.go:349] "Waiting for caches to sync" controller="service config" machine # [ 37.819480] k3s[894]: I0925 16:32:19.404597 894 config.go:106] "Starting endpoint slice config controller" machine # [ 37.820027] k3s[894]: I0925 16:32:19.404618 894 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config" machine # [ 37.820525] k3s[894]: I0925 16:32:19.404656 894 config.go:403] "Starting serviceCIDR config controller" machine # [ 37.821211] k3s[894]: I0925 16:32:19.404670 894 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config" machine # [ 37.821824] k3s[894]: I0925 16:32:19.405281 894 config.go:309] "Starting node config controller" machine # [ 37.823989] k3s[894]: I0925 16:32:19.405305 894 shared_informer.go:349] "Waiting for caches to sync" controller="node config" machine # [ 37.825048] k3s[894]: I0925 16:32:19.405318 894 shared_informer.go:356] "Caches are synced" controller="node config" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 37.918380] k3s[894]: I0925 16:32:19.504743 894 shared_informer.go:356] "Caches are synced" controller="service config" machine # [ 37.919394] k3s[894]: I0925 16:32:19.504905 894 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config" machine # [ 38.350404] k3s[894]: I0925 16:32:19.936715 894 apiserver.go:52] "Watching apiserver" machine # [ 38.430632] k3s[894]: time="2026-09-25T16:32:20Z" level=info msg="Tunnel authorizer set Kubelet Port 0.0.0.0:10250" machine # [ 38.443838] k3s[894]: time="2026-09-25T16:32:20Z" level=info msg="Labels and annotations have been set successfully on node: machine" machine # [ 38.459125] systemd[1]: Created slice libcontainer container kubepods-burstable-podb707b4e5_9460_4200_adc0_9b0dde059eb6.slice. machine # [ 38.476308] systemd[1]: Created slice libcontainer container kubepods-burstable-podfc9e55e9_3251_4298_8c8d_9fd47ba609b5.slice. machine # [ 38.492324] k3s[894]: I0925 16:32:20.078484 894 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" machine # [ 38.492986] k3s[894]: time="2026-09-25T16:32:20Z" level=info msg="Starting network policy controller version v2.6.3-k3s1, built on 1970-01-01T01:01:01Z, go1.26.7" machine # [ 38.493685] k3s[894]: I0925 16:32:20.079506 894 network_policy_controller.go:164] Starting network policy controller machine # [ 38.497611] k3s[894]: I0925 16:32:20.083941 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b707b4e5-9460-4200-adc0-9b0dde059eb6-config-volume\") pod \"coredns-c5fdd76cf-d29pb\" (UID: \"b707b4e5-9460-4200-adc0-9b0dde059eb6\") " pod="kube-system/coredns-c5fdd76cf-d29pb" machine # [ 38.498976] k3s[894]: I0925 16:32:20.084600 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-config-volume\" (UniqueName: \"kubernetes.io/configmap/b707b4e5-9460-4200-adc0-9b0dde059eb6-custom-config-volume\") pod \"coredns-c5fdd76cf-d29pb\" (UID: \"b707b4e5-9460-4200-adc0-9b0dde059eb6\") " pod="kube-system/coredns-c5fdd76cf-d29pb" machine # [ 38.499665] k3s[894]: I0925 16:32:20.084654 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc9e55e9-3251-4298-8c8d-9fd47ba609b5-klipper-cache\") pod \"helm-install-nix-grpc-farm-h8q6p\" (UID: \"fc9e55e9-3251-4298-8c8d-9fd47ba609b5\") " pod="kube-system/helm-install-nix-grpc-farm-h8q6p" machine # [ 38.500268] k3s[894]: I0925 16:32:20.084683 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"content\" (UniqueName: \"kubernetes.io/configmap/fc9e55e9-3251-4298-8c8d-9fd47ba609b5-content\") pod \"helm-install-nix-grpc-farm-h8q6p\" (UID: \"fc9e55e9-3251-4298-8c8d-9fd47ba609b5\") " pod="kube-system/helm-install-nix-grpc-farm-h8q6p" machine # [ 38.500836] k3s[894]: I0925 16:32:20.084713 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29x7s\" (UniqueName: \"kubernetes.io/projected/fc9e55e9-3251-4298-8c8d-9fd47ba609b5-kube-api-access-29x7s\") pod \"helm-install-nix-grpc-farm-h8q6p\" (UID: \"fc9e55e9-3251-4298-8c8d-9fd47ba609b5\") " pod="kube-system/helm-install-nix-grpc-farm-h8q6p" machine # [ 38.501485] k3s[894]: I0925 16:32:20.084743 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8n8r\" (UniqueName: \"kubernetes.io/projected/b707b4e5-9460-4200-adc0-9b0dde059eb6-kube-api-access-c8n8r\") pod \"coredns-c5fdd76cf-d29pb\" (UID: \"b707b4e5-9460-4200-adc0-9b0dde059eb6\") " pod="kube-system/coredns-c5fdd76cf-d29pb" machine # [ 38.502066] k3s[894]: I0925 16:32:20.084767 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/fc9e55e9-3251-4298-8c8d-9fd47ba609b5-klipper-helm\") pod \"helm-install-nix-grpc-farm-h8q6p\" (UID: \"fc9e55e9-3251-4298-8c8d-9fd47ba609b5\") " pod="kube-system/helm-install-nix-grpc-farm-h8q6p" machine # [ 38.502546] k3s[894]: I0925 16:32:20.084794 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/fc9e55e9-3251-4298-8c8d-9fd47ba609b5-klipper-config\") pod \"helm-install-nix-grpc-farm-h8q6p\" (UID: \"fc9e55e9-3251-4298-8c8d-9fd47ba609b5\") " pod="kube-system/helm-install-nix-grpc-farm-h8q6p" machine # [ 38.503159] k3s[894]: I0925 16:32:20.084820 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc9e55e9-3251-4298-8c8d-9fd47ba609b5-tmp\") pod \"helm-install-nix-grpc-farm-h8q6p\" (UID: \"fc9e55e9-3251-4298-8c8d-9fd47ba609b5\") " pod="kube-system/helm-install-nix-grpc-farm-h8q6p" machine # [ 38.503681] k3s[894]: I0925 16:32:20.084848 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"values\" (UniqueName: \"kubernetes.io/projected/fc9e55e9-3251-4298-8c8d-9fd47ba609b5-values\") pod \"helm-install-nix-grpc-farm-h8q6p\" (UID: \"fc9e55e9-3251-4298-8c8d-9fd47ba609b5\") " pod="kube-system/helm-install-nix-grpc-farm-h8q6p" machine # [ 38.518391] k3s[894]: I0925 16:32:20.104748 894 shared_informer.go:356] "Caches are synced" controller="endpoint slice config" machine # [ 38.752073] k3s[894]: I0925 16:32:20.338400 894 kube.go:163] Node controller sync successful machine # [ 38.753301] k3s[894]: I0925 16:32:20.339598 894 vxlan.go:128] VXLAN config: VNI=1 Port=0 GBP=false Learning=false DirectRouting=false machine # [ 38.760862] k3s[894]: I0925 16:32:20.347308 894 kube.go:704] List of node(machine) annotations: map[string]string{"alpha.kubernetes.io/provided-node-ip":"10.0.2.15,fec0::139c:1f9b:479c:fae", "k3s.io/hostname":"machine", "k3s.io/internal-ip":"10.0.2.15,fec0::139c:1f9b:479c:fae", "k3s.io/node-args":"[\"server\",\"--disable\",\"traefik\",\"--disable\",\"metrics-server\",\"--disable\",\"local-storage\",\"--kubelet-arg\",\"eviction-hard=nodefs.available\\u003c1%,imagefs.available\\u003c1%\"]", "k3s.io/node-config-hash":"EFXPOZ7ZWHRCLFNW4X4ZDPFQMSAOP3BLEIN2VE47TDRKQ4UIWKUQ====", "k3s.io/node-env":"{}", "node.alpha.kubernetes.io/ttl":"0", "volumes.kubernetes.io/controller-managed-attach-detach":"true"} machine # [ 38.785305] (udev-worker)[1295]: Network interface NamePolicy= disabled on kernel command line. machine # [ 38.793057] k3s[894]: I0925 16:32:20.379138 894 iptables.go:50] Starting flannel in iptables mode... machine # [ 38.794258] k3s[894]: time="2026-09-25T16:32:20Z" level=warning msg="no subnet found for key: FLANNEL_NETWORK in file: /run/flannel/subnet.env" machine # [ 38.795728] k3s[894]: time="2026-09-25T16:32:20Z" level=warning msg="no subnet found for key: FLANNEL_SUBNET in file: /run/flannel/subnet.env" machine # [ 38.796942] k3s[894]: time="2026-09-25T16:32:20Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_NETWORK in file: /run/flannel/subnet.env" machine # [ 38.797692] k3s[894]: time="2026-09-25T16:32:20Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_SUBNET in file: /run/flannel/subnet.env" machine # [ 38.798247] k3s[894]: I0925 16:32:20.379259 894 iptables.go:101] Current network or subnet (10.42.0.0/16, 10.42.0.0/24) is not equal to previous one (0.0.0.0/0, 0.0.0.0/0), trying to recycle old iptables rules machine # [ 38.798821] k3s[894]: I0925 16:32:20.383423 894 kube.go:558] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.42.0.0/24] machine # [ 38.813802] k3s[894]: I0925 16:32:20.400249 894 network_policy_controller.go:179] Starting network policy controller full sync goroutine machine # [ 38.825979] dhcpcd[686]: flannel.1: IAID 4c:f1:fe:cf machine # [ 38.827356] dhcpcd[686]: flannel.1: adding address fe80::94eb:4cff:fef1:fecf machine # [ 38.885618] k3s[894]: I0925 16:32:20.472000 894 iptables.go:111] Setting up masking rules machine # [ 38.903208] k3s[894]: I0925 16:32:20.489590 894 iptables.go:212] Changing default FORWARD chain policy to ACCEPT machine # [ 38.914684] k3s[894]: time="2026-09-25T16:32:20Z" level=info msg="Wrote flannel subnet file to /run/flannel/subnet.env" machine # [ 38.915522] k3s[894]: time="2026-09-25T16:32:20Z" level=info msg="Running flannel backend" machine # [ 38.916105] k3s[894]: I0925 16:32:20.501183 894 vxlan_network.go:68] watching for new subnet leases machine # [ 38.916567] k3s[894]: I0925 16:32:20.501243 894 vxlan_network.go:115] starting vxlan device watcher machine # [ 38.977121] k3s[894]: I0925 16:32:20.563448 894 iptables.go:358] bootstrap done machine # [ 39.013303] k3s[894]: I0925 16:32:20.599624 894 iptables.go:358] bootstrap done machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 39.198410] k3s[894]: E0925 16:32:20.784676 894 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"58e9f5ad37b1fad7b642e2046de9298c3c1f297093cd79223aac95dadaabe602\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" machine # [ 39.200265] k3s[894]: E0925 16:32:20.784899 894 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"58e9f5ad37b1fad7b642e2046de9298c3c1f297093cd79223aac95dadaabe602\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-c5fdd76cf-d29pb" machine # [ 39.201995] k3s[894]: E0925 16:32:20.784947 894 kuberuntime_manager.go:1568] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"58e9f5ad37b1fad7b642e2046de9298c3c1f297093cd79223aac95dadaabe602\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-c5fdd76cf-d29pb" machine # [ 39.203271] k3s[894]: E0925 16:32:20.785115 894 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-c5fdd76cf-d29pb_kube-system(b707b4e5-9460-4200-adc0-9b0dde059eb6)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-c5fdd76cf-d29pb_kube-system(b707b4e5-9460-4200-adc0-9b0dde059eb6)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"58e9f5ad37b1fad7b642e2046de9298c3c1f297093cd79223aac95dadaabe602\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-c5fdd76cf-d29pb" podUID="b707b4e5-9460-4200-adc0-9b0dde059eb6" machine # [ 39.238287] k3s[894]: I0925 16:32:20.824342 894 node_lifecycle_controller.go:1234] "Initializing eviction metric for zone" zone="" machine # [ 39.238875] k3s[894]: I0925 16:32:20.824680 894 node_lifecycle_controller.go:886] "Missing timestamp for Node. Assuming now as a timestamp" node="machine" machine # [ 39.240158] k3s[894]: I0925 16:32:20.824858 894 node_lifecycle_controller.go:1080] "Controller detected that zone is now in new state" zone="" newState="Normal" machine # [ 39.250813] k3s[894]: E0925 16:32:20.837014 894 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"84b76c68f3b3b000d71bb2d71bbf71fc389e8e68d7442dce010f813aa9c93040\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" machine # [ 39.255800] k3s[894]: E0925 16:32:20.837144 894 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"84b76c68f3b3b000d71bb2d71bbf71fc389e8e68d7442dce010f813aa9c93040\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/helm-install-nix-grpc-farm-h8q6p" machine # [ 39.256786] k3s[894]: E0925 16:32:20.837199 894 kuberuntime_manager.go:1568] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"84b76c68f3b3b000d71bb2d71bbf71fc389e8e68d7442dce010f813aa9c93040\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/helm-install-nix-grpc-farm-h8q6p" machine # [ 39.258050] k3s[894]: E0925 16:32:20.837383 894 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"helm-install-nix-grpc-farm-h8q6p_kube-system(fc9e55e9-3251-4298-8c8d-9fd47ba609b5)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"helm-install-nix-grpc-farm-h8q6p_kube-system(fc9e55e9-3251-4298-8c8d-9fd47ba609b5)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"84b76c68f3b3b000d71bb2d71bbf71fc389e8e68d7442dce010f813aa9c93040\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/helm-install-nix-grpc-farm-h8q6p" podUID="fc9e55e9-3251-4298-8c8d-9fd47ba609b5" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 40.621843] dhcpcd[686]: flannel.1: soliciting a DHCP lease machine # [ 40.917541] dhcpcd[686]: flannel.1: soliciting an IPv6 router machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 42.027640] k3s[894]: time="2026-09-25T16:32:23Z" level=info msg="Imported docker.io/library/nix-grpc-farm:0.1.0-beta.4" machine # [ 42.031409] k3s[894]: time="2026-09-25T16:32:23Z" level=info msg="Tagged docker.io/library/nix-grpc-farm@sha256:1abb054fb2ae1d9022fabaea19e1af8ae8b253f5f7043039039075ebb3abf9a2" machine # [ 42.399226] k3s[894]: time="2026-09-25T16:32:23Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm.tar in 5.815521525s" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 45.623140] dhcpcd[686]: flannel.1: probing for an IPv4LL address machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 50.661396] dhcpcd[686]: flannel.1: using IPv4LL address 169.254.215.107 machine # [ 50.663332] dhcpcd[686]: flannel.1: adding route to 169.254.0.0/16 machine # [ 51.713091] cni0: port 1(vethcf8b62f3) entered blocking state machine # [ 51.713830] cni0: port 1(vethcf8b62f3) entered disabled state machine # [ 51.715293] vethcf8b62f3: entered allmulticast mode machine # [ 51.717106] vethcf8b62f3: entered promiscuous mode machine # [ 51.728319] cni0: port 1(vethcf8b62f3) entered blocking state machine # [ 51.729042] cni0: port 1(vethcf8b62f3) entered forwarding state machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 51.595628] (udev-worker)[1904]: Network interface NamePolicy= disabled on kernel command line. machine # [ 51.598631] (udev-worker)[1906]: Network interface NamePolicy= disabled on kernel command line. machine # [ 51.625209] dhcpcd[686]: vethcf8b62f3: IAID 23:fd:97:c9 machine # [ 51.626194] dhcpcd[686]: vethcf8b62f3: adding address fe80::c4e2:23ff:fefd:97c9 machine # [ 51.649915] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount1224742613.mount: Deactivated successfully. machine # [ 51.730332] systemd[1]: Started libcontainer container e546661976ad056361357ab2962a77aa7570e72ff116a464430822e8905b767f. machine # [ 52.651531] systemd[1]: Started libcontainer container d205a5fecdcbb6680b101dd6361feeda58c6b2ae9612de041e4a3c661e7835df. machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 52.854145] dhcpcd[686]: vethcf8b62f3: soliciting a DHCP lease machine # [ 52.921811] dhcpcd[686]: flannel.1: no IPv6 Routers available machine # [ 53.520205] dhcpcd[686]: vethcf8b62f3: soliciting an IPv6 router machine # [ 53.702118] cni0: port 2(veth52ddcb5f) entered blocking state machine # [ 53.550526] ([ 53.702825] cni0: port 2(veth52ddcb5f) entered disabled state machine # udev-worker)[192[ 53.703899] veth52ddcb5f: entered allmulticast mode machine # 0]: Network inte[ 53.704731] veth52ddcb5f: entered promiscuous mode machine # rface NamePolicy= disabled on kernel command line. machine # [ 53.715790] cni0: port 2(veth52ddcb5f) entered blocking state machine # [ 53.716573] cni0: port 2(veth52ddcb5f) entered forwarding state machine # [ 53.584976] k3s[894]: I0925 16:32:35.171035 894 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/helm-install-nix-grpc-farm-h8q6p" podStartSLOduration=23.170950073 podStartE2EDuration="23.170950073s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-25 16:32:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-25 16:32:35.169680638 +0000 UTC m=+35.299930854" watchObservedRunningTime="2026-09-25 16:32:35.170950073 +0000 UTC m=+35.301200289" machine # [ 53.591767] dhcpcd[686]: veth52ddcb5f: IAID 07:e2:20:1c machine # [ 53.592577] dhcpcd[686]: veth52ddcb5f: adding address fe80::cc48:7ff:fee2:201c machine # [ 53.673149] systemd[1]: Started libcontainer container b1085baf096d23874bbc495e0411e30d4a5cf91c7a25d42e6b464afc3c265f91. machine # [ 53.774143] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount3222850365.mount: Deactivated successfully. machine # [ 53.821273] dhcpcd[686]: veth52ddcb5f: soliciting a DHCP lease machine # [ 53.935107] k3s[894]: I0925 16:32:35.521448 894 alloc.go:329] "allocated clusterIPs" service="farm/nix-grpc-farm" clusterIPs={"IPv4":"10.43.79.32"} machine # [ 54.016700] systemd[1]: cri-containerd-d205a5fecdcbb6680b101dd6361feeda58c6b2ae9612de041e4a3c661e7835df.scope: Deactivated successfully. machine # [ 54.017363] systemd[1]: cri-containerd-d205a5fecdcbb6680b101dd6361feeda58c6b2ae9612de041e4a3c661e7835df.scope: Consumed 699ms CPU time over 1.365s wall clock time, 33.8M memory peak, 2.4M incoming IP traffic, 151.9K outgoing IP traffic. machine # [ 54.504586] systemd[1]: Started libcontainer container 4f192f7de7d3f6c87dc68ceb2049554c0babd8195ecde817f086cda865084ad6. machine # [ 54.529091] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-d205a5fecdcbb6680b101dd6361feeda58c6b2ae9612de041e4a3c661e7835df-rootfs.mount: Deactivated successfully. machine # [ 54.541110] systemd[1]: Created slice libcontainer container kubepods-besteffort-podc600981f_3343_4136_8e24_5ecaa15b08e5.slice. machine # [ 54.563861] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod8222a4eb_aee8_4c46_aab0_7ae14c613af1.slice. machine # [ 54.584408] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod1aef550b_e553_4617_a5f3_119270f18a39.slice. machine # [ 54.599396] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod27925fea_6d12_4818_a156_7e9391663387.slice. machine # [ 54.613913] k3s[894]: I0925 16:32:36.200130 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/27925fea-6d12-4818-a156-7e9391663387-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-mj954\" (UID: \"27925fea-6d12-4818-a156-7e9391663387\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-mj954" machine # [ 54.618869] k3s[894]: I0925 16:32:36.205353 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn567\" (UniqueName: \"kubernetes.io/projected/27925fea-6d12-4818-a156-7e9391663387-kube-api-access-kn567\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-mj954\" (UID: \"27925fea-6d12-4818-a156-7e9391663387\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-mj954" machine # [ 54.624098] k3s[894]: I0925 16:32:36.210577 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c600981f-3343-4136-8e24-5ecaa15b08e5-ca\") pod \"nix-grpc-farm-scheduler-c5d75967-kz2pf\" (UID: \"c600981f-3343-4136-8e24-5ecaa15b08e5\") " pod="farm/nix-grpc-farm-scheduler-c5d75967-kz2pf" machine # [ 54.628705] k3s[894]: I0925 16:32:36.215163 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/c600981f-3343-4136-8e24-5ecaa15b08e5-oidc\") pod \"nix-grpc-farm-scheduler-c5d75967-kz2pf\" (UID: \"c600981f-3343-4136-8e24-5ecaa15b08e5\") " pod="farm/nix-grpc-farm-scheduler-c5d75967-kz2pf" machine # [ 54.633210] k3s[894]: I0925 16:32:36.215209 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/8222a4eb-aee8-4c46-aab0-7ae14c613af1-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-r4jjf\" (UID: \"8222a4eb-aee8-4c46-aab0-7ae14c613af1\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-r4jjf" machine # [ 54.637896] k3s[894]: I0925 16:32:36.215240 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/27925fea-6d12-4818-a156-7e9391663387-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-mj954\" (UID: \"27925fea-6d12-4818-a156-7e9391663387\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-mj954" machine # [ 54.642671] k3s[894]: I0925 16:32:36.215274 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/c600981f-3343-4136-8e24-5ecaa15b08e5-tls\") pod \"nix-grpc-farm-scheduler-c5d75967-kz2pf\" (UID: \"c600981f-3343-4136-8e24-5ecaa15b08e5\") " pod="farm/nix-grpc-farm-scheduler-c5d75967-kz2pf" machine # [ 54.646933] k3s[894]: I0925 16:32:36.215308 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1aef550b-e553-4617-a5f3-119270f18a39-config\") pod \"nix-grpc-farm-lb-75b44f88dd-9v6s5\" (UID: \"1aef550b-e553-4617-a5f3-119270f18a39\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-9v6s5" machine # [ 54.651328] k3s[894]: I0925 16:32:36.215333 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/8222a4eb-aee8-4c46-aab0-7ae14c613af1-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-r4jjf\" (UID: \"8222a4eb-aee8-4c46-aab0-7ae14c613af1\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-r4jjf" machine # [ 54.656053] k3s[894]: I0925 16:32:36.215365 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/8222a4eb-aee8-4c46-aab0-7ae14c613af1-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-r4jjf\" (UID: \"8222a4eb-aee8-4c46-aab0-7ae14c613af1\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-r4jjf" machine # [ 54.660819] k3s[894]: I0925 16:32:36.215396 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/8222a4eb-aee8-4c46-aab0-7ae14c613af1-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-r4jjf\" (UID: \"8222a4eb-aee8-4c46-aab0-7ae14c613af1\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-r4jjf" machine # [ 54.665553] k3s[894]: I0925 16:32:36.215423 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/27925fea-6d12-4818-a156-7e9391663387-build\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-mj954\" (UID: \"27925fea-6d12-4818-a156-7e9391663387\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-mj954" machine # [ 54.670203] k3s[894]: I0925 16:32:36.215448 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/27925fea-6d12-4818-a156-7e9391663387-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-mj954\" (UID: \"27925fea-6d12-4818-a156-7e9391663387\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-mj954" machine # [ 54.675105] k3s[894]: I0925 16:32:36.215478 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ztff\" (UniqueName: \"kubernetes.io/projected/8222a4eb-aee8-4c46-aab0-7ae14c613af1-kube-api-access-5ztff\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-r4jjf\" (UID: \"8222a4eb-aee8-4c46-aab0-7ae14c613af1\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-r4jjf" machine # [ 54.675760] k3s[894]: I0925 16:32:36.215509 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1aef550b-e553-4617-a5f3-119270f18a39-tmp\") pod \"nix-grpc-farm-lb-75b44f88dd-9v6s5\" (UID: \"1aef550b-e553-4617-a5f3-119270f18a39\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-9v6s5" machine # [ 54.676442] k3s[894]: I0925 16:32:36.215701 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/1aef550b-e553-4617-a5f3-119270f18a39-tls-ca\") pod \"nix-grpc-farm-lb-75b44f88dd-9v6s5\" (UID: \"1aef550b-e553-4617-a5f3-119270f18a39\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-9v6s5" machine # [ 54.677061] k3s[894]: I0925 16:32:36.215783 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/27925fea-6d12-4818-a156-7e9391663387-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-mj954\" (UID: \"27925fea-6d12-4818-a156-7e9391663387\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-mj954" machine # [ 54.677534] k3s[894]: I0925 16:32:36.215890 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/27925fea-6d12-4818-a156-7e9391663387-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-mj954\" (UID: \"27925fea-6d12-4818-a156-7e9391663387\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-mj954" machine # [ 54.678131] k3s[894]: I0925 16:32:36.215948 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/c600981f-3343-4136-8e24-5ecaa15b08e5-niks3-token\") pod \"nix-grpc-farm-scheduler-c5d75967-kz2pf\" (UID: \"c600981f-3343-4136-8e24-5ecaa15b08e5\") " pod="farm/nix-grpc-farm-scheduler-c5d75967-kz2pf" machine # [ 54.678685] k3s[894]: I0925 16:32:36.215975 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/8222a4eb-aee8-4c46-aab0-7ae14c613af1-build\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-r4jjf\" (UID: \"8222a4eb-aee8-4c46-aab0-7ae14c613af1\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-r4jjf" machine # [ 54.679226] k3s[894]: I0925 16:32:36.216027 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/8222a4eb-aee8-4c46-aab0-7ae14c613af1-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-r4jjf\" (UID: \"8222a4eb-aee8-4c46-aab0-7ae14c613af1\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-r4jjf" machine # [ 54.679844] k3s[894]: I0925 16:32:36.216127 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/8222a4eb-aee8-4c46-aab0-7ae14c613af1-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-r4jjf\" (UID: \"8222a4eb-aee8-4c46-aab0-7ae14c613af1\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-r4jjf" machine # [ 54.680468] k3s[894]: I0925 16:32:36.216203 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/1aef550b-e553-4617-a5f3-119270f18a39-tls-lb\") pod \"nix-grpc-farm-lb-75b44f88dd-9v6s5\" (UID: \"1aef550b-e553-4617-a5f3-119270f18a39\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-9v6s5" machine # [ 54.681054] k3s[894]: I0925 16:32:36.216229 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/27925fea-6d12-4818-a156-7e9391663387-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-mj954\" (UID: \"27925fea-6d12-4818-a156-7e9391663387\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-mj954" machine # [ 54.681605] k3s[894]: I0925 16:32:36.216384 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ph7z\" (UniqueName: \"kubernetes.io/projected/c600981f-3343-4136-8e24-5ecaa15b08e5-kube-api-access-2ph7z\") pod \"nix-grpc-farm-scheduler-c5d75967-kz2pf\" (UID: \"c600981f-3343-4136-8e24-5ecaa15b08e5\") " pod="farm/nix-grpc-farm-scheduler-c5d75967-kz2pf" machine # [ 54.684697] k3s[894]: I0925 16:32:36.237321 894 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/coredns-c5fdd76cf-d29pb" podStartSLOduration=24.2372937 podStartE2EDuration="24.2372937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-25 16:32:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-25 16:32:36.236284634 +0000 UTC m=+36.366534570" watchObservedRunningTime="2026-09-25 16:32:36.2372937 +0000 UTC m=+36.367543637" machine # [ 55.047859] cni0: port 3(vethdec509fc) entered blocking state machine # [ 55.048852] cni0: port 3(vethdec509fc) entered disabled state machine # [ 55.049758] vethdec509fc: entered allmulticast mode machine # [ 55.050612] vethdec509fc: entered promiscuous mode machine # [ 55.067185] cni0: port 3(vethdec509fc) entered blocking state machine # [ 55.067965] cni0: port 3(vethdec509fc) entered forwarding state machine # [ 55.075245] cni0: port 4(veth61c90fc7) entered blocking state machine # [ 55.076222] cni0: port 4(veth61c90fc7) entered disabled state machine # [ 55.077525] veth61c90fc7: entered allmulticast mode machine # [ 55.078436] veth61c90fc7: entered promiscuous mode machine # [ 55.087093] cni0: port 5(vethcca457c0) entered blocking state machine # [ 55.087861] cni0: port 5(vethcca457c0) entered disabled state machine # [ 55.089097] vethcca457c0: entered allmulticast mode machine # [ 55.089805] vethcca457c0: entered promiscuous mode machine # [ 55.094721] cni0: port 4(veth61c90fc7) entered blocking state machine # [ 55.095491] cni0: port 4(veth61c90fc7) entered forwarding state machine # [ 55.103019] cni0: port 5(vethcca457c0) entered blocking state machine # [ 55.103732] cni0: port 5(vethcca457c0) entered forwarding state machine # [ 54.958216] (udev-worker)[2412]: Network interface NamePolicy= disabled on kernel command line. machine # [ 54.964812] (udev-worker)[2430]: Network interface NamePolicy= disabled on kernel command line. machine # [ 54.966149] (udev-worker)[2429]: Network interface NamePolicy= disabled on kernel command line. machine # [ 54.992656] dhcpcd[686]: vethdec509fc: IAID 83:5c:a0:7f machine # [ 54.993804] dhcpcd[686]: vethdec509fc: adding address fe80::5c68:83ff:fe5c:a07f machine # [ 55.004710] (udev-worker)[2455]: Network interface NamePolicy= disabled on kernel command line. machine # [ 55.159182] cni0: port 6(veth6a2ad947) entered blocking state machine # [ 55.160240] cni0: port 6(veth6a2ad947) entered disabled state machine # [ 55.161099] veth6a2ad947: entered allmulticast mode machine # [ 55.161856] veth6a2ad947: entered promiscuous mode machine # [ 55.169873] cni0: port 6(veth6a2ad947) entered blocking state machine # [ 55.170661] cni0: port 6(veth6a2ad947) entered forwarding state machine # [ 55.019869] dhcpcd[686]: veth61c90fc7: IAID db:4b:e0:37 machine # [ 55.020733] dhcpcd[686]: veth61c90fc7: adding address fe80::e6:dbff:fe4b:e037 machine # [ 55.034025] dhcpcd[686]: vethcca457c0: IAID a6:eb:c9:1f machine # [ 55.034963] dhcpcd[686]: vethcca457c0: adding address fe80::5095:a6ff:feeb:c91f machine # [ 55.044495] dhcpcd[686]: veth6a2ad947: IAID 6f:c0:9e:bb machine # [ 55.045343] dhcpcd[686]: veth6a2ad947: adding address fe80::4ce9:6fff:fec0:9ebb machine # [ 55.046149] dhcpcd[686]: veth6a2ad947: old hardware address: 4e:e9:6f:c0:9e:bb machine # [ 55.047636] dhcpcd[686]: veth6a2ad947: new hardware address: c2:4c:17:70:8b:4c machine # [ 55.048280] dhcpcd[686]: veth6a2ad947: carrier lost machine # [ 55.082265] dhcpcd[686]: veth6a2ad947: deleting address fe80::4ce9:6fff:fec0:9ebb machine # [ 55.083372] dhcpcd[686]: veth6a2ad947: old hardware address: c2:4c:17:70:8b:4c machine # [ 55.084204] dhcpcd[686]: veth6a2ad947: new hardware address: 4e:e9:6f:c0:9e:bb machine # [ 55.084786] dhcpcd[686]: veth6a2ad947: carrier acquired machine # [ 55.092087] dhcpcd[686]: veth6a2ad947: IAID 6f:c0:9e:bb machine # [ 55.092945] dhcpcd[686]: veth6a2ad947: adding address fe80::4ce9:6fff:fec0:9ebb machine # [ 55.105607] systemd[1]: Started libcontainer container c80f474dc817ec74be657e46ef3fa7130f3c2c04d902b7b3856f027896b79ba9. machine # [ 55.121308] systemd[1]: Started libcontainer container b8782824f6072d8d981d98408f99734b8ac067eab823677154e7afc9b59832e7. machine # [ 55.173514] systemd[1]: Started libcontainer container 02bf8b7c901157e042c7c9ae3f2dd31d21e6d9ea664b4a9c3c05d570dd18a99e. machine # [ 55.176915] systemd[1]: Started libcontainer container 2f499b12f7ac921e5ebedcc27f2760272d53a57ce35535aed2090f19a6fd362b. machine # [ 55.488702] dhcpcd[686]: vethdec509fc: soliciting a DHCP lease machine # [ 55.637438] dhcpcd[686]: vethcca457c0: soliciting a DHCP lease machine # [ 55.670484] dhcpcd[686]: veth61c90fc7: soliciting a DHCP lease machine # [ 55.710489] systemd[1]: cri-containerd-e546661976ad056361357ab2962a77aa7570e72ff116a464430822e8905b767f.scope: Deactivated successfully. machine # [ 55.750515] dhcpcd[686]: veth52ddcb5f: soliciting an IPv6 router machine # [ 55.781175] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-e546661976ad056361357ab2962a77aa7570e72ff116a464430822e8905b767f-rootfs.mount: Deactivated successfully. machine # [ 55.978549] dhcpcd[686]: veth6a2ad947: soliciting a DHCP lease machine # [ 56.039320] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-e546661976ad056361357ab2962a77aa7570e72ff116a464430822e8905b767f-shm.mount: Deactivated successfully. machine # [ 56.258759] cni0: port 1(vethcf8b62f3) entered disabled state machine # [ 56.107575] dhcpcd[686]: vethcf8b62f3: carrier lost machine # [ 56.261192] vethcf8b62f3 (unregistering): left allmulticast mode machine # [ 56.261894] vethcf8b62f3 (unregistering): left promiscuous mode machine # [ 56.262844] cni0: port 1(vethcf8b62f3) entered disabled state machine # [ 56.137252] systemd[1]: run-netns-cni\x2d8b54faf7\x2d8eec\x2ddd67\x2de745\x2d864777fe0556.mount: Deactivated successfully. machine # [ 56.146488] dhcpcd[686]: vethcf8b62f3: deleting address fe80::c4e2:23ff:fefd:97c9 machine # [ 56.193512] dhcpcd[686]: vethcf8b62f3: removing interface machine # [ 56.249191] k3s[894]: I0925 16:32:37.835253 894 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fc9e55e9-3251-4298-8c8d-9fd47ba609b5-values\" (UniqueName: \"kubernetes.io/projected/fc9e55e9-3251-4298-8c8d-9fd47ba609b5-values\") pod \"fc9e55e9-3251-4298-8c8d-9fd47ba609b5\" (UID: \"fc9e55e9-3251-4298-8c8d-9fd47ba609b5\") " machine # [ 56.249636] k3s[894]: I0925 16:32:37.835310 894 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fc9e55e9-3251-4298-8c8d-9fd47ba609b5-klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/fc9e55e9-3251-4298-8c8d-9fd47ba609b5-klipper-helm\") pod \"fc9e55e9-3251-4298-8c8d-9fd47ba609b5\" (UID: \"fc9e55e9-3251-4298-8c8d-9fd47ba609b5\") " machine # [ 56.250215] k3s[894]: I0925 16:32:37.835344 894 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fc9e55e9-3251-4298-8c8d-9fd47ba609b5-klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/fc9e55e9-3251-4298-8c8d-9fd47ba609b5-klipper-config\") pod \"fc9e55e9-3251-4298-8c8d-9fd47ba609b5\" (UID: \"fc9e55e9-3251-4298-8c8d-9fd47ba609b5\") " machine # [ 56.250793] k3s[894]: I0925 16:32:37.835377 894 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fc9e55e9-3251-4298-8c8d-9fd47ba609b5-kube-api-access-29x7s\" (UniqueName: \"kubernetes.io/projected/fc9e55e9-3251-4298-8c8d-9fd47ba609b5-kube-api-access-29x7s\") pod \"fc9e55e9-3251-4298-8c8d-9fd47ba609b5\" (UID: \"fc9e55e9-3251-4298-8c8d-9fd47ba609b5\") " machine # [ 56.251548] k3s[894]: I0925 16:32:37.835409 894 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fc9e55e9-3251-4298-8c8d-9fd47ba609b5-klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc9e55e9-3251-4298-8c8d-9fd47ba609b5-klipper-cache\") pod \"fc9e55e9-3251-4298-8c8d-9fd47ba609b5\" (UID: \"fc9e55e9-3251-4298-8c8d-9fd47ba609b5\") " machine # [ 56.252720] k3s[894]: I0925 16:32:37.835438 894 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fc9e55e9-3251-4298-8c8d-9fd47ba609b5-content\" (UniqueName: \"kubernetes.io/configmap/fc9e55e9-3251-4298-8c8d-9fd47ba609b5-content\") pod \"fc9e55e9-3251-4298-8c8d-9fd47ba609b5\" (UID: \"fc9e55e9-3251-4298-8c8d-9fd47ba609b5\") " machine # [ 56.254453] k3s[894]: I0925 16:32:37.835473 894 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fc9e55e9-3251-4298-8c8d-9fd47ba609b5-tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc9e55e9-3251-4298-8c8d-9fd47ba609b5-tmp\") pod \"fc9e55e9-3251-4298-8c8d-9fd47ba609b5\" (UID: \"fc9e55e9-3251-4298-8c8d-9fd47ba609b5\") " machine # [ 56.255812] k3s[894]: I0925 16:32:37.836760 894 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc9e55e9-3251-4298-8c8d-9fd47ba609b5-content" pod "fc9e55e9-3251-4298-8c8d-9fd47ba609b5" (UID: "fc9e55e9-3251-4298-8c8d-9fd47ba609b5"). InnerVolumeSpecName "content". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 56.259262] systemd[1]: var-lib-kubelet-pods-fc9e55e9\x2d3251\x2d4298\x2d8c8d\x2d9fd47ba609b5-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2d29x7s.mount: Deactivated successfully. machine # [ 56.292665] k3s[894]: I0925 16:32:37.878977 894 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc9e55e9-3251-4298-8c8d-9fd47ba609b5-kube-api-access-29x7s" pod "fc9e55e9-3251-4298-8c8d-9fd47ba609b5" (UID: "fc9e55e9-3251-4298-8c8d-9fd47ba609b5"). InnerVolumeSpecName "kube-api-access-29x7s". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 56.297354] k3s[894]: I0925 16:32:37.883750 894 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc9e55e9-3251-4298-8c8d-9fd47ba609b5-klipper-config" pod "fc9e55e9-3251-4298-8c8d-9fd47ba609b5" (UID: "fc9e55e9-3251-4298-8c8d-9fd47ba609b5"). InnerVolumeSpecName "klipper-config". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 56.298519] k3s[894]: I0925 16:32:37.884955 894 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc9e55e9-3251-4298-8c8d-9fd47ba609b5-klipper-helm" pod "fc9e55e9-3251-4298-8c8d-9fd47ba609b5" (UID: "fc9e55e9-3251-4298-8c8d-9fd47ba609b5"). InnerVolumeSpecName "klipper-helm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 56.299177] k3s[894]: I0925 16:32:37.885186 894 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc9e55e9-3251-4298-8c8d-9fd47ba609b5-klipper-cache" pod "fc9e55e9-3251-4298-8c8d-9fd47ba609b5" (UID: "fc9e55e9-3251-4298-8c8d-9fd47ba609b5"). InnerVolumeSpecName "klipper-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 56.310072] k3s[894]: I0925 16:32:37.891234 894 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc9e55e9-3251-4298-8c8d-9fd47ba609b5-values" pod "fc9e55e9-3251-4298-8c8d-9fd47ba609b5" (UID: "fc9e55e9-3251-4298-8c8d-9fd47ba609b5"). InnerVolumeSpecName "values". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 56.315233] k3s[894]: I0925 16:32:37.901368 894 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc9e55e9-3251-4298-8c8d-9fd47ba609b5-tmp" pod "fc9e55e9-3251-4298-8c8d-9fd47ba609b5" (UID: "fc9e55e9-3251-4298-8c8d-9fd47ba609b5"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 56.349433] k3s[894]: I0925 16:32:37.935834 894 reconciler_common.go:299] "Volume detached for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/fc9e55e9-3251-4298-8c8d-9fd47ba609b5-klipper-helm\") on node \"machine\" DevicePath \"\"" machine # [ 56.350261] k3s[894]: I0925 16:32:37.935871 894 reconciler_common.go:299] "Volume detached for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/fc9e55e9-3251-4298-8c8d-9fd47ba609b5-klipper-config\") on node \"machine\" DevicePath \"\"" machine # [ 56.350876] k3s[894]: I0925 16:32:37.935889 894 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29x7s\" (UniqueName: \"kubernetes.io/projected/fc9e55e9-3251-4298-8c8d-9fd47ba609b5-kube-api-access-29x7s\") on node \"machine\" DevicePath \"\"" machine # [ 56.351378] k3s[894]: I0925 16:32:37.935904 894 reconciler_common.go:299] "Volume detached for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc9e55e9-3251-4298-8c8d-9fd47ba609b5-klipper-cache\") on node \"machine\" DevicePath \"\"" machine # [ 56.351912] k3s[894]: I0925 16:32:37.935919 894 reconciler_common.go:299] "Volume detached for volume \"content\" (UniqueName: \"kubernetes.io/configmap/fc9e55e9-3251-4298-8c8d-9fd47ba609b5-content\") on node \"machine\" DevicePath \"\"" machine # [ 56.352572] k3s[894]: I0925 16:32:37.935932 894 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc9e55e9-3251-4298-8c8d-9fd47ba609b5-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 56.353199] k3s[894]: I0925 16:32:37.935944 894 reconciler_common.go:299] "Volume detached for volume \"values\" (UniqueName: \"kubernetes.io/projected/fc9e55e9-3251-4298-8c8d-9fd47ba609b5-values\") on node \"machine\" DevicePath \"\"" machine # [ 56.528900] systemd[1]: var-lib-kubelet-pods-fc9e55e9\x2d3251\x2d4298\x2d8c8d\x2d9fd47ba609b5-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dhelm.mount: Deactivated successfully. machine # [ 56.532423] systemd[1]: var-lib-kubelet-pods-fc9e55e9\x2d3251\x2d4298\x2d8c8d\x2d9fd47ba609b5-volumes-kubernetes.io\x7eprojected-values.mount: Deactivated successfully. machine # [ 56.534153] systemd[1]: var-lib-kubelet-pods-fc9e55e9\x2d3251\x2d4298\x2d8c8d\x2d9fd47ba609b5-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 56.535313] systemd[1]: var-lib-kubelet-pods-fc9e55e9\x2d3251\x2d4298\x2d8c8d\x2d9fd47ba609b5-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dcache.mount: Deactivated successfully. machine # [ 56.536465] systemd[1]: var-lib-kubelet-pods-fc9e55e9\x2d3251\x2d4298\x2d8c8d\x2d9fd47ba609b5-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dconfig.mount: Deactivated successfully. machine # [ 56.690291] k3s[894]: I0925 16:32:38.276701 894 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e546661976ad056361357ab2962a77aa7570e72ff116a464430822e8905b767f" machine # [ 56.699793] systemd[1]: Removed slice libcontainer container kubepods-burstable-podfc9e55e9_3251_4298_8c8d_9fd47ba609b5.slice. machine # [ 56.701862] systemd[1]: kubepods-burstable-podfc9e55e9_3251_4298_8c8d_9fd47ba609b5.slice: Consumed 730ms CPU time over 18.222s wall clock time, 34.1M memory peak, 2.4M incoming IP traffic, 151.9K outgoing IP traffic. machine # [ 56.741979] systemd[1]: Started libcontainer container 39edc04edbb5502906a75ddc5192298e47df5da6643039fffe958ff2d6466a3b. machine # [ 56.935477] dhcpcd[686]: vethdec509fc: soliciting an IPv6 router machine # [ 57.127181] dhcpcd[686]: vethcca457c0: soliciting an IPv6 router machine # [ 57.546232] dhcpcd[686]: veth61c90fc7: soliciting an IPv6 router machine # [ 57.719962] k3s[894]: I0925 16:32:39.305798 894 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-75b44f88dd-9v6s5" podStartSLOduration=3.305773633 podStartE2EDuration="3.305773633s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-25 16:32:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-25 16:32:39.305442305 +0000 UTC m=+39.435692242" watchObservedRunningTime="2026-09-25 16:32:39.305773633 +0000 UTC m=+39.436023010" machine # [ 57.849733] dhcpcd[686]: veth6a2ad947: soliciting an IPv6 router machine # [ 58.822645] dhcpcd[686]: veth52ddcb5f: probing for an IPv4LL address machine # [ 60.489450] dhcpcd[686]: vethdec509fc: probing for an IPv4LL address machine # [ 60.637921] dhcpcd[686]: vethcca457c0: probing for an IPv4LL address machine # [ 60.670713] dhcpcd[686]: veth61c90fc7: probing for an IPv4LL address machine # [ 60.979232] dhcpcd[686]: veth6a2ad947: probing for an IPv4LL address machine # [ 61.372570] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount3320720669.mount: Deactivated successfully. machine # [ 61.449661] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped3214073298.mount: Deactivated successfully. machine # [ 61.454392] systemd[1]: Started libcontainer container c2a97e7fb9f43545337da3bc8ab9ba24663a4024be370680cf06f10e68236f20. machine # [ 61.521326] systemd[1]: Started libcontainer container f5a25f787bc7bc9b136f543dcd8f93a760dec9049e26211e1e348d050bbd2e0c. machine # [ 61.620470] systemd[1]: Started libcontainer container b2489bb43cc9af7d39c7e807f80737fc23e71309423c5ddceff48c9d6720e8be. machine # [ 61.776135] niks3-server[1193]: 2026/09/25 16:32:43 INFO lead: acquired remote=10.42.0.4:36164 machine # [ 61.804715] k3s[894]: I0925 16:32:43.390858 894 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-scheduler-c5d75967-kz2pf" podStartSLOduration=7.390832767 podStartE2EDuration="7.390832767s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-25 16:32:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-25 16:32:43.386909642 +0000 UTC m=+43.517159299" watchObservedRunningTime="2026-09-25 16:32:43.390832767 +0000 UTC m=+43.521082703" machine # [ 62.370293] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount2026716104.mount: Deactivated successfully. machine # [ 63.614351] systemd[1]: cri-containerd-b2489bb43cc9af7d39c7e807f80737fc23e71309423c5ddceff48c9d6720e8be.scope: Deactivated successfully. machine # [ 63.623146] systemd[1]: cri-containerd-b2489bb43cc9af7d39c7e807f80737fc23e71309423c5ddceff48c9d6720e8be.scope: Consumed 784ms CPU time over 1.992s wall clock time, 405.1M memory peak, 89.9M read from disk, 157.2M written to disk. machine # [ 63.629785] systemd[1]: cri-containerd-f5a25f787bc7bc9b136f543dcd8f93a760dec9049e26211e1e348d050bbd2e0c.scope: Deactivated successfully. machine # [ 63.633363] systemd[1]: cri-containerd-f5a25f787bc7bc9b136f543dcd8f93a760dec9049e26211e1e348d050bbd2e0c.scope: Consumed 817ms CPU time over 2.095s wall clock time, 391.9M memory peak, 77.1M read from disk, 157.9M written to disk. machine # [ 63.684111] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-b2489bb43cc9af7d39c7e807f80737fc23e71309423c5ddceff48c9d6720e8be-rootfs.mount: Deactivated successfully. machine # [ 63.688164] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-f5a25f787bc7bc9b136f543dcd8f93a760dec9049e26211e1e348d050bbd2e0c-rootfs.mount: Deactivated successfully. machine # error: timed out waiting for the condition machine # [ 64.052597] dhcpcd[686]: veth52ddcb5f: using IPv4LL address 169.254.217.199 machine # [ 64.055390] dhcpcd[686]: veth52ddcb5f: adding route to 169.254.0.0/16 machine # [ 64.851951] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped1955822169.mount: Deactivated successfully. machine # [ 64.992407] systemd[1]: Started libcontainer container 3b35f2bab053352ffaf00f78195022bbadb567d6e576fe77c9ed3a413f266bd6. machine # [ 65.080105] systemd[1]: Started libcontainer container 015f92dde8505e58b10f7b25c9229774b6881e4355e349ce149e811450d4735e. machine # [ 65.185070] dhcpcd[686]: veth61c90fc7: using IPv4LL address 169.254.89.98 machine # [ 65.185859] dhcpcd[686]: veth61c90fc7: adding route to 169.254.0.0/16 machine # [ 65.197721] systemd[1]: Started libcontainer container 97e62ab22a5e1b3081b05209b81bc63cf2c4621b12fcf5e4232ec7141ad01957. machine # [ 65.295335] systemd[1]: Started libcontainer container c01ee45599675772863cc1ed0c57567e53ae55ba1f28611c9560b905341beb44. machine # [ 65.410963] dhcpcd[686]: vethdec509fc: using IPv4LL address 169.254.249.9 machine # [ 65.411460] dhcpcd[686]: vethdec509fc: adding route to 169.254.0.0/16 machine # [ 65.440690] dhcpcd[686]: vethcca457c0: using IPv4LL address 169.254.100.19 machine # [ 65.441887] dhcpcd[686]: vethcca457c0: adding route to 169.254.0.0/16 machine # [ 65.463441] systemd[1]: Started libcontainer container 4239574e39950509d6aefc1b6a8fea1a2a3a695cd0f58a7480d4857bfe1aad14. machine # [ 65.523334] systemd[1]: Started libcontainer container af451b150f17f66d229de74ec345099a01bb5b391a04094c23284ce1cb31356e. machine # [ 65.796727] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount638316763.mount: Deactivated successfully. machine # [ 65.798556] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped2499174632.mount: Deactivated successfully. machine # [ 65.800410] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount3213896767.mount: Deactivated successfully. machine # [ 65.801571] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped3739004050.mount: Deactivated successfully. machine # [ 65.830522] k3s[894]: I0925 16:32:47.416252 894 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-mj954" podStartSLOduration=9.333068721 podStartE2EDuration="11.416201633s" totalImagesPullingTime="0s" totalInitContainerRuntime="2.083132912s" isStatefulPod=false podCreationTimestamp="2026-09-25 16:32:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-25 16:32:47.415782865 +0000 UTC m=+47.546038668" watchObservedRunningTime="2026-09-25 16:32:47.416201633 +0000 UTC m=+47.546456039" machine # [ 65.857529] k3s[894]: I0925 16:32:47.443809 894 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-r4jjf" podStartSLOduration=9.481077197 podStartE2EDuration="11.44377944s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.962702243s" isStatefulPod=false podCreationTimestamp="2026-09-25 16:32:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-25 16:32:47.442831833 +0000 UTC m=+47.573085122" watchObservedRunningTime="2026-09-25 16:32:47.44377944 +0000 UTC m=+47.574032170" machine # [ 66.460966] dhcpcd[686]: veth6a2ad947: using IPv4LL address 169.254.130.84 machine # [ 66.463282] dhcpcd[686]: veth6a2ad947: adding route to 169.254.0.0/16 machine # [ 67.754748] dhcpcd[686]: veth52ddcb5f: no IPv6 Routers available machine # [ 68.938789] dhcpcd[686]: vethdec509fc: no IPv6 Routers available machine # [ 69.129590] dhcpcd[686]: vethcca457c0: no IPv6 Routers available machine # [ 69.549179] dhcpcd[686]: veth61c90fc7: no IPv6 Routers available machine # [ 69.852889] dhcpcd[686]: veth6a2ad947: no IPv6 Routers available machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 45.42 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s, in 0.22 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s, in 0.19 seconds) machine: waiting for unit niks3.service machine: (finished: waiting for unit niks3.service, in 0.04 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.26 seconds) machine: waiting for success: test $(curl -sf 10.42.0.6:9901/clusters | grep -c 'health_flags::healthy') -ge 3 machine: (finished: waiting for success: test $(curl -sf 10.42.0.6:9901/clusters | grep -c 'health_flags::healthy') -ge 3, in 0.08 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.19 seconds) machine: waiting for success: curl -sf http://10.42.0.4:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2' machine: (finished: waiting for success: curl -sf http://10.42.0.4:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2', in 0.03 seconds) (finished: subtest: chart deploys and workers become Ready, in 46.43 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}', in 0.17 seconds) machine: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt machine: (finished: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt, in 0.17 seconds) subtest: build through the balancer lands in the cache machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1 machine # [ 113.906927] niks3-server[1193]: 2026/09/25 16:33:35 INFO Received push request method=POST path=/api/pushes machine # [ 113.944704] niks3-server[1193]: 2026/09/25 16:33:35 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign machine # [ 113.949537] niks3-server[1193]: 2026/09/25 16:33:35 INFO Signed narinfos id=1 count=1 machine # [ 113.950914] niks3-server[1193]: 2026/09/25 16:33:35 INFO Registered completed upload object_key=nar/0nzzbas7l8d37mridr7mg162smfjvn7lhs6am4crl4ydaxicigj8.nar.zst machine # [ 113.958773] niks3-server[1193]: 2026/09/25 16:33:35 INFO Received complete push request method=POST path=/api/pushes/1/complete machine # [ 113.965365] niks3-server[1193]: 2026/09/25 16:33:35 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.ls machine # [ 113.967398] niks3-server[1193]: 2026/09/25 16:33:35 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.narinfo machine # [ 139.294471] niks3-server[1193]: 2026/09/25 16:34:00 INFO Received push request method=POST path=/api/pushes machine # [ 139.317555] niks3-server[1193]: 2026/09/25 16:34:00 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign machine # [ 139.321973] niks3-server[1193]: 2026/09/25 16:34:00 INFO Signed narinfos id=2 count=1 machine # [ 139.324868] niks3-server[1193]: 2026/09/25 16:34:00 INFO Registered completed upload object_key=nar/1p7jh5nyz9n68k5f18ymmdpgr34mpnnch1njw7ki7b2b97qlfbjk.nar.zst machine # [ 139.327633] niks3-server[1193]: 2026/09/25 16:34:00 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.ls machine # [ 139.329469] niks3-server[1193]: 2026/09/25 16:34:00 INFO Registered completed upload object_key=log/yz1sqzb72i8v6h2ass0v76ba8cncqj9r-k3s-a.drv machine # [ 139.334326] niks3-server[1193]: 2026/09/25 16:34:00 INFO Received complete push request method=POST path=/api/pushes/2/complete machine # [ 139.341319] niks3-server[1193]: 2026/09/25 16:34:00 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.narinfo machine # [ 139.410292] niks3-server[1193]: 2026/09/25 16:34:00 INFO Received push request method=POST path=/api/pushes machine # [ 139.422235] niks3-server[1193]: 2026/09/25 16:34:01 INFO Received sign narinfos request method=POST path=/api/pushes/3/sign machine # [ 139.423828] niks3-server[1193]: 2026/09/25 16:34:01 INFO Registered completed upload object_key=nar/03a4ywhyr5knmbc93z4gyml5y8fvgb431xvlmfxrwsm8mrb0qgx2.nar.zst machine # [ 139.425761] niks3-server[1193]: 2026/09/25 16:34:01 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.ls machine # [ 139.428518] niks3-server[1193]: 2026/09/25 16:34:01 INFO Signed narinfos id=3 count=1 machine # [ 139.436812] niks3-server[1193]: 2026/09/25 16:34:01 INFO Received complete push request method=POST path=/api/pushes/3/complete machine # [ 139.440773] niks3-server[1193]: 2026/09/25 16:34:01 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.narinfo machine # [ 164.363649] niks3-server[1193]: 2026/09/25 16:34:25 INFO Received push request method=POST path=/api/pushes machine # [ 164.384425] niks3-server[1193]: 2026/09/25 16:34:25 INFO Received sign narinfos request method=POST path=/api/pushes/4/sign machine # [ 164.388883] niks3-server[1193]: 2026/09/25 16:34:25 INFO Signed narinfos id=4 count=1 machine # [ 164.394401] niks3-server[1193]: 2026/09/25 16:34:25 INFO Registered completed upload object_key=nar/05qjsj5ff3a6vnxkhb6k5f3m446dcc206p7cd37w4v3mgi95d7kh.nar.zst machine # [ 164.399990] niks3-server[1193]: 2026/09/25 16:34:25 INFO Registered completed upload object_key=log/zfq1xw9bmycqh35l0s44lmv65z4xc7br-k3s-b.drv machine # [ 164.404364] niks3-server[1193]: 2026/09/25 16:34:25 INFO Received complete push request method=POST path=/api/pushes/4/complete machine # [ 164.408286] niks3-server[1193]: 2026/09/25 16:34:25 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.ls machine # [ 164.412177] niks3-server[1193]: 2026/09/25 16:34:25 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.narinfo machine # [ 164.471113] niks3-server[1193]: 2026/09/25 16:34:26 INFO Received push request method=POST path=/api/pushes machine # [ 164.480671] niks3-server[1193]: 2026/09/25 16:34:26 INFO Received sign narinfos request method=POST path=/api/pushes/5/sign machine # [ 164.481862] niks3-server[1193]: 2026/09/25 16:34:26 INFO Signed narinfos id=5 count=1 machine # [ 164.484862] niks3-server[1193]: 2026/09/25 16:34:26 INFO Registered completed upload object_key=nar/0jyw88klkf3nwxpnj5m5lx3i1dv2idf3hcn6im7883hnldm3gvyq.nar.zst machine # [ 164.487472] niks3-server[1193]: 2026/09/25 16:34:26 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.ls machine # [ 164.489840] niks3-server[1193]: 2026/09/25 16:34:26 INFO Received complete push request method=POST path=/api/pushes/5/complete machine # [ 164.493131] niks3-server[1193]: 2026/09/25 16:34:26 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.narinfo machine # [ 189.203728] niks3-server[1193]: 2026/09/25 16:34:50 INFO Received push request method=POST path=/api/pushes machine # [ 189.221501] niks3-server[1193]: 2026/09/25 16:34:50 INFO Received sign narinfos request method=POST path=/api/pushes/6/sign machine # [ 189.225487] niks3-server[1193]: 2026/09/25 16:34:50 INFO Signed narinfos id=6 count=1 machine # [ 189.228721] niks3-server[1193]: 2026/09/25 16:34:50 INFO Registered completed upload object_key=log/n40czam6a4ldp1mh5fdmlcy07fv0akbm-k3s-top.drv machine # [ 189.233623] niks3-server[1193]: 2026/09/25 16:34:50 INFO Received complete push request method=POST path=/api/pushes/6/complete machine # [ 189.238627] niks3-server[1193]: 2026/09/25 16:34:50 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.ls machine # [ 189.242276] niks3-server[1193]: 2026/09/25 16:34:50 INFO Registered completed upload object_key=nar/1q8vp5xqws560mpf8rxk8r8jhqrzibivh13x4wxy0cfqlzbk7cr5.nar.zst machine # [ 189.246374] niks3-server[1193]: 2026/09/25 16:34:50 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1, in 113.13 seconds) machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath, in 0.14 seconds) machine: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine: (finished: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.01 seconds) machine: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine # copying 3 paths... machine # copying path '/nix/store/r95r891injj9ski5c4w89yxjvjy065mx-k3s-a' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/mrqsh0475wxsmnsvkk55g94v6g5nrcra-k3s-b' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top' from 'http://192.168.1.1:5751'... machine: (finished: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.20 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1 machine # [ 214.451772] niks3-server[1193]: 2026/09/25 16:35:16 INFO Received push request method=POST path=/api/pushes machine # [ 214.479880] niks3-server[1193]: 2026/09/25 16:35:16 INFO Received sign narinfos request method=POST path=/api/pushes/7/sign machine # [ 214.482391] niks3-server[1193]: 2026/09/25 16:35:16 INFO Signed narinfos id=7 count=1 machine # [ 214.487771] niks3-server[1193]: 2026/09/25 16:35:16 INFO Registered completed upload object_key=nar/1fr26arhri17j9bj6hyjzmmd74v730biz1gb3kqd194vjx3ccvp9.nar.zst machine # [ 214.491675] niks3-server[1193]: 2026/09/25 16:35:16 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.ls machine # [ 214.495190] niks3-server[1193]: 2026/09/25 16:35:16 INFO Received complete push request method=POST path=/api/pushes/7/complete machine # [ 214.500024] niks3-server[1193]: 2026/09/25 16:35:16 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.narinfo machine # [ 239.429459] niks3-server[1193]: 2026/09/25 16:35:41 INFO Received push request method=POST path=/api/pushes machine # [ 239.454949] niks3-server[1193]: 2026/09/25 16:35:41 INFO Received sign narinfos request method=POST path=/api/pushes/8/sign machine # [ 239.459544] niks3-server[1193]: 2026/09/25 16:35:41 INFO Signed narinfos id=8 count=1 machine # [ 239.463365] niks3-server[1193]: 2026/09/25 16:35:41 INFO Registered completed upload object_key=nar/1hfc6x4x25k3b0fk091d3nb0k3mympfp05fkslcx19synp3ig0zd.nar.zst machine # [ 239.468344] niks3-server[1193]: 2026/09/25 16:35:41 INFO Registered completed upload object_key=log/pbpqsh50ar10fpasdqqx8xg3lmr5j8iz-k3s-a.drv machine # [ 239.471844] niks3-server[1193]: 2026/09/25 16:35:41 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.ls machine # [ 239.475207] niks3-server[1193]: 2026/09/25 16:35:41 INFO Received complete push request method=POST path=/api/pushes/8/complete machine # [ 239.478483] niks3-server[1193]: 2026/09/25 16:35:41 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.narinfo machine # [ 239.547993] niks3-server[1193]: 2026/09/25 16:35:41 INFO Received push request method=POST path=/api/pushes machine # [ 239.558918] niks3-server[1193]: 2026/09/25 16:35:41 INFO Received sign narinfos request method=POST path=/api/pushes/9/sign machine # [ 239.561456] niks3-server[1193]: 2026/09/25 16:35:41 INFO Signed narinfos id=9 count=1 machine # [ 239.563358] niks3-server[1193]: 2026/09/25 16:35:41 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.ls machine # [ 239.565729] niks3-server[1193]: 2026/09/25 16:35:41 INFO Received complete push request method=POST path=/api/pushes/9/complete machine # [ 239.567744] niks3-server[1193]: 2026/09/25 16:35:41 INFO Registered completed upload object_key=nar/0zzq2vgjln4shvh57091n14sam6wh6w06vja6lzb9ppcj4ffyx1n.nar.zst machine # [ 239.569833] niks3-server[1193]: 2026/09/25 16:35:41 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.narinfo machine # [ 264.087983] niks3-server[1193]: 2026/09/25 16:36:05 INFO Received push request method=POST path=/api/pushes machine # [ 264.107716] niks3-server[1193]: 2026/09/25 16:36:05 INFO Received sign narinfos request method=POST path=/api/pushes/10/sign machine # [ 264.112760] niks3-server[1193]: 2026/09/25 16:36:05 INFO Signed narinfos id=10 count=1 machine # [ 264.115608] niks3-server[1193]: 2026/09/25 16:36:05 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.ls machine # [ 264.119941] niks3-server[1193]: 2026/09/25 16:36:05 INFO Registered completed upload object_key=nar/0hh3nqk95r6g32lhdmxw8cxjv694vbpx9876zkhcpg4r4qxni2ch.nar.zst machine # [ 264.125364] niks3-server[1193]: 2026/09/25 16:36:05 INFO Registered completed upload object_key=log/894h6wzw2l4w5f0hikj1k6q57jfnyi87-k3s-b.drv machine # [ 264.130237] niks3-server[1193]: 2026/09/25 16:36:05 INFO Received complete push request method=POST path=/api/pushes/10/complete machine # [ 264.133561] niks3-server[1193]: 2026/09/25 16:36:05 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.narinfo machine # [ 264.197419] niks3-server[1193]: 2026/09/25 16:36:05 INFO Received push request method=POST path=/api/pushes machine # [ 264.211050] niks3-server[1193]: 2026/09/25 16:36:05 INFO Received sign narinfos request method=POST path=/api/pushes/11/sign machine # [ 264.212425] niks3-server[1193]: 2026/09/25 16:36:05 INFO Signed narinfos id=11 count=1 machine # [ 264.215929] niks3-server[1193]: 2026/09/25 16:36:05 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.ls machine # [ 264.221342] niks3-server[1193]: 2026/09/25 16:36:05 INFO Received complete push request method=POST path=/api/pushes/11/complete machine # [ 264.224327] niks3-server[1193]: 2026/09/25 16:36:05 INFO Registered completed upload object_key=nar/0ingamx56k31lwiyxmnxmscjj4n3qfx6sr2kpaynsrwhwz1278iw.nar.zst machine # [ 264.230158] niks3-server[1193]: 2026/09/25 16:36:05 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.narinfo machine # [ 289.339854] niks3-server[1193]: 2026/09/25 16:36:30 INFO Received push request method=POST path=/api/pushes machine # [ 289.360633] niks3-server[1193]: 2026/09/25 16:36:30 INFO Received sign narinfos request method=POST path=/api/pushes/12/sign machine # [ 289.362846] niks3-server[1193]: 2026/09/25 16:36:30 INFO Signed narinfos id=12 count=1 machine # [ 289.365457] niks3-server[1193]: 2026/09/25 16:36:30 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.ls machine # [ 289.367784] niks3-server[1193]: 2026/09/25 16:36:30 INFO Registered completed upload object_key=log/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g-k3s-top.drv machine # [ 289.369034] niks3-server[1193]: 2026/09/25 16:36:30 INFO Registered completed upload object_key=nar/0v48x4sp58bvfra08axgkz7yl1n9nc4nirskyv1hwann4i7q277i.nar.zst machine # [ 289.372659] niks3-server[1193]: 2026/09/25 16:36:30 INFO Received complete push request method=POST path=/api/pushes/12/complete machine # [ 289.379391] niks3-server[1193]: 2026/09/25 16:36:30 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1, in 99.79 seconds) (finished: subtest: build through the balancer lands in the cache, in 213.27 seconds) subtest: a Job with the client image builds through the farm with its service account machine: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine: (finished: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.16 seconds) machine: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix machine: (finished: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix, in 0.15 seconds) machine: must succeed: kubectl apply -f /nix/store/4qg21n7g16x8lyv0fhhdx9dx3lxqkcdn-ci-job.json machine: (finished: must succeed: kubectl apply -f /nix/store/4qg21n7g16x8lyv0fhhdx9dx3lxqkcdn-ci-job.json, in 0.18 seconds) machine: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed' machine # [ 290.523585] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod12397e07_cdd2_4fc8_aae8_11374cf9e868.slice. machine # [ 290.615344] k3s[894]: I0925 16:36:32.201312 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"job\" (UniqueName: \"kubernetes.io/configmap/12397e07-cdd2-4fc8-aae8-11374cf9e868-job\") pod \"ci-h7qh6\" (UID: \"12397e07-cdd2-4fc8-aae8-11374cf9e868\") " pod="ci/ci-h7qh6" machine # [ 290.616640] k3s[894]: I0925 16:36:32.201385 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/12397e07-cdd2-4fc8-aae8-11374cf9e868-nix-grpc-farm\") pod \"ci-h7qh6\" (UID: \"12397e07-cdd2-4fc8-aae8-11374cf9e868\") " pod="ci/ci-h7qh6" machine # [ 290.618177] k3s[894]: I0925 16:36:32.201426 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4pt8\" (UniqueName: \"kubernetes.io/projected/12397e07-cdd2-4fc8-aae8-11374cf9e868-kube-api-access-x4pt8\") pod \"ci-h7qh6\" (UID: \"12397e07-cdd2-4fc8-aae8-11374cf9e868\") " pod="ci/ci-h7qh6" machine # [ 291.927453] cni0: port 1(veth5edb05ff) entered blocking state machine # [ 291.929255] cni0: port 1(veth5edb05ff) entered disabled state machine # [ 291.932053] veth5edb05ff: entered allmulticast mode machine # [ 291.934780] veth5edb05ff: entered promiscuous mode machine # [ 291.955543] cni0: port 1(veth5edb05ff) entered blocking state machine # [ 291.957511] cni0: port 1(veth5edb05ff) entered forwarding state machine # [ 291.857492] (udev-worker)[5081]: Network interface NamePolicy= disabled on kernel command line. machine # [ 291.886202] dhcpcd[686]: veth5edb05ff: IAID 25:cf:32:7a machine # [ 291.887042] dhcpcd[686]: veth5edb05ff: adding address fe80::40d5:25ff:fecf:327a machine # [ 291.923577] systemd[1]: Started libcontainer container c5eadb9bb1629bbde81da6a23fdeef69a8cfe51e540a50f4eda0bbe35a819391. machine # [ 293.260309] dhcpcd[686]: veth5edb05ff: soliciting a DHCP lease machine # [ 293.908195] dhcpcd[686]: veth5edb05ff: soliciting an IPv6 router machine # [ 294.096716] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount1250923467.mount: Deactivated successfully. machine # [ 294.174689] systemd[1]: Started libcontainer container 9de7ae1c22f80b437f06c5aa1d8b4ffed71431bd78b7fd8bb6515c05b73ff653. machine # [ 294.863119] k3s[894]: I0925 16:36:36.449136 894 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ci/ci-h7qh6" podStartSLOduration=4.449106068 podStartE2EDuration="4.449106068s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-25 16:36:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-25 16:36:36.44844062 +0000 UTC m=+276.578691115" watchObservedRunningTime="2026-09-25 16:36:36.449106068 +0000 UTC m=+276.579356843" machine # [ 295.694720] niks3-server[1193]: 2026/09/25 16:36:37 INFO Received push request method=POST path=/api/pushes machine # [ 295.721243] niks3-server[1193]: 2026/09/25 16:36:37 INFO Received sign narinfos request method=POST path=/api/pushes/13/sign machine # [ 295.724546] niks3-server[1193]: 2026/09/25 16:36:37 INFO Signed narinfos id=13 count=1 machine # [ 295.726525] niks3-server[1193]: 2026/09/25 16:36:37 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.ls machine # [ 295.730355] niks3-server[1193]: 2026/09/25 16:36:37 INFO Registered completed upload object_key=nar/111g6dyibwcf2z7jhpn72rgja0qvjgpdiv9nc06g2dp7ih0a6kyq.nar.zst machine # [ 295.735821] niks3-server[1193]: 2026/09/25 16:36:37 INFO Received complete push request method=POST path=/api/pushes/13/complete machine # [ 295.740908] niks3-server[1193]: 2026/09/25 16:36:37 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.narinfo machine # [ 298.260967] dhcpcd[686]: veth5edb05ff: probing for an IPv4LL address machine # [ 304.133137] dhcpcd[686]: veth5edb05ff: using IPv4LL address 169.254.199.109 machine # [ 304.134975] dhcpcd[686]: veth5edb05ff: adding route to 169.254.0.0/16 machine # [ 305.914791] dhcpcd[686]: veth5edb05ff: no IPv6 Routers available machine # [ 310.301880] postgres[758]: [758] LOG: checkpoint starting: time machine # [ 320.063982] niks3-server[1193]: 2026/09/25 16:37:01 INFO Received push request method=POST path=/api/pushes machine # [ 320.084555] niks3-server[1193]: 2026/09/25 16:37:01 INFO Registered completed upload object_key=nar/058kjd2vfl1r27b4d9ixvwf77d8rkr18a4v894kwx8lg0nwpajnr.nar.zst machine # [ 320.086537] niks3-server[1193]: 2026/09/25 16:37:01 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.ls machine # [ 320.091685] niks3-server[1193]: 2026/09/25 16:37:01 INFO Received sign narinfos request method=POST path=/api/pushes/14/sign machine # [ 320.093550] niks3-server[1193]: 2026/09/25 16:37:01 INFO Signed narinfos id=14 count=1 machine # [ 320.096031] niks3-server[1193]: 2026/09/25 16:37:01 INFO Registered completed upload object_key=log/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # [ 320.104802] niks3-server[1193]: 2026/09/25 16:37:01 INFO Received complete push request method=POST path=/api/pushes/14/complete machine # [ 320.109160] niks3-server[1193]: 2026/09/25 16:37:01 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.narinfo machine # [ 320.178763] niks3-server[1193]: 2026/09/25 16:37:01 INFO Received push request method=POST path=/api/pushes machine # [ 320.189828] niks3-server[1193]: 2026/09/25 16:37:01 INFO Received sign narinfos request method=POST path=/api/pushes/15/sign machine # [ 320.191655] niks3-server[1193]: 2026/09/25 16:37:01 INFO Signed narinfos id=15 count=1 machine # [ 320.194325] niks3-server[1193]: 2026/09/25 16:37:01 INFO Registered completed upload object_key=nar/138ynhcd5wxzz485x9qcq7xsargaklrf2li31ai69m5r46am35q6.nar.zst machine # [ 320.196973] niks3-server[1193]: 2026/09/25 16:37:01 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.ls machine # [ 320.198860] niks3-server[1193]: 2026/09/25 16:37:01 INFO Received complete push request method=POST path=/api/pushes/15/complete machine # [ 320.200830] niks3-server[1193]: 2026/09/25 16:37:01 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.narinfo machine # [ 345.502521] niks3-server[1193]: 2026/09/25 16:37:27 INFO Received push request method=POST path=/api/pushes machine # [ 345.519674] niks3-server[1193]: 2026/09/25 16:37:27 INFO Received sign narinfos request method=POST path=/api/pushes/16/sign machine # [ 345.523358] niks3-server[1193]: 2026/09/25 16:37:27 INFO Signed narinfos id=16 count=1 machine # [ 345.525881] niks3-server[1193]: 2026/09/25 16:37:27 INFO Registered completed upload object_key=log/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # [ 345.529606] niks3-server[1193]: 2026/09/25 16:37:27 INFO Registered completed upload object_key=nar/0n4lbdlp8w72fs3qbavl2lwrzbrn55i2b1vyglc89cc3pi8vbb1m.nar.zst machine # [ 345.534372] niks3-server[1193]: 2026/09/25 16:37:27 INFO Received complete push request method=POST path=/api/pushes/16/complete machine # [ 345.538699] niks3-server[1193]: 2026/09/25 16:37:27 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.ls machine # [ 345.542293] niks3-server[1193]: 2026/09/25 16:37:27 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo machine # [ 345.598242] niks3-server[1193]: 2026/09/25 16:37:27 INFO Received push request method=POST path=/api/pushes machine # [ 345.608402] niks3-server[1193]: 2026/09/25 16:37:27 INFO Received sign narinfos request method=POST path=/api/pushes/17/sign machine # [ 345.610244] niks3-server[1193]: 2026/09/25 16:37:27 INFO Signed narinfos id=17 count=1 machine # [ 345.611377] niks3-server[1193]: 2026/09/25 16:37:27 INFO Registered completed upload object_key=nar/1f3gvnvqsm2pm3laixkxkg44kvjb251zqhszcfpp0a00h6x66ljs.nar.zst machine # [ 345.613582] niks3-server[1193]: 2026/09/25 16:37:27 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.ls machine # [ 345.615436] niks3-server[1193]: 2026/09/25 16:37:27 INFO Received complete push request method=POST path=/api/pushes/17/complete machine # [ 345.618865] niks3-server[1193]: 2026/09/25 16:37:27 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.narinfo machine # [ 370.326849] niks3-server[1193]: 2026/09/25 16:37:51 INFO Received push request method=POST path=/api/pushes machine # [ 370.349765] niks3-server[1193]: 2026/09/25 16:37:51 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.ls machine # [ 370.352229] niks3-server[1193]: 2026/09/25 16:37:51 INFO Received sign narinfos request method=POST path=/api/pushes/18/sign machine # [ 370.355093] niks3-server[1193]: 2026/09/25 16:37:51 INFO Signed narinfos id=18 count=1 machine # [ 370.356667] niks3-server[1193]: 2026/09/25 16:37:51 INFO Registered completed upload object_key=nar/1zwf0asrdv12q40fmqga5lx5330dvn9y4in4i9ficz9ij5lhvnf5.nar.zst machine # [ 370.359364] niks3-server[1193]: 2026/09/25 16:37:51 INFO Registered completed upload object_key=log/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # [ 370.362411] niks3-server[1193]: 2026/09/25 16:37:51 INFO Received complete push request method=POST path=/api/pushes/18/complete machine # [ 370.365971] niks3-server[1193]: 2026/09/25 16:37:51 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo machine # [ 372.202606] niks3-server[1193]: 2026/09/25 16:37:53 INFO Received push request method=POST path=/api/pushes machine # [ 372.218954] niks3-server[1193]: 2026/09/25 16:37:53 INFO Received sign narinfos request method=POST path=/api/pushes/19/sign machine # [ 372.220737] niks3-server[1193]: 2026/09/25 16:37:53 INFO Signed narinfos id=19 count=1 machine # [ 372.225331] niks3-server[1193]: 2026/09/25 16:37:53 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.ls machine # [ 372.227423] niks3-server[1193]: 2026/09/25 16:37:53 INFO Registered completed upload object_key=nar/0xiyqcsl8db7dnrq2gqnx5izavr51ma3dcdswrriaxfgj3qzk7xf.nar.zst machine # [ 372.229824] niks3-server[1193]: 2026/09/25 16:37:53 INFO Received complete push request method=POST path=/api/pushes/19/complete machine # [ 372.236450] niks3-server[1193]: 2026/09/25 16:37:53 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.narinfo machine # [ 396.555964] niks3-server[1193]: 2026/09/25 16:38:18 INFO Received push request method=POST path=/api/pushes machine # [ 396.581094] niks3-server[1193]: 2026/09/25 16:38:18 INFO Registered completed upload object_key=nar/0p3l2z3riilylr2rxb1aq2blxdfxg55wbgp4gxkns93srbr4bwyq.nar.zst machine # [ 396.586327] niks3-server[1193]: 2026/09/25 16:38:18 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.ls machine # [ 396.589887] niks3-server[1193]: 2026/09/25 16:38:18 INFO Received sign narinfos request method=POST path=/api/pushes/20/sign machine # [ 396.592543] niks3-server[1193]: 2026/09/25 16:38:18 INFO Registered completed upload object_key=log/fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # [ 396.596621] niks3-server[1193]: 2026/09/25 16:38:18 INFO Signed narinfos id=20 count=1 machine # [ 396.605255] niks3-server[1193]: 2026/09/25 16:38:18 INFO Received complete push request method=POST path=/api/pushes/20/complete machine # [ 396.610880] niks3-server[1193]: 2026/09/25 16:38:18 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo machine # [ 396.748690] systemd[1]: cri-containerd-9de7ae1c22f80b437f06c5aa1d8b4ffed71431bd78b7fd8bb6515c05b73ff653.scope: Deactivated successfully. machine # [ 396.749988] systemd[1]: cri-containerd-9de7ae1c22f80b437f06c5aa1d8b4ffed71431bd78b7fd8bb6515c05b73ff653.scope: Consumed 1.180s CPU time over 1min 42.573s wall clock time, 142.5M memory peak, 73M read from disk, 428K written to disk, 18.3K incoming IP traffic, 44.8K outgoing IP traffic. machine # [ 396.794523] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-9de7ae1c22f80b437f06c5aa1d8b4ffed71431bd78b7fd8bb6515c05b73ff653-rootfs.mount: Deactivated successfully. machine # [ 398.349789] systemd[1]: cri-containerd-c5eadb9bb1629bbde81da6a23fdeef69a8cfe51e540a50f4eda0bbe35a819391.scope: Deactivated successfully. machine # [ 398.413704] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-c5eadb9bb1629bbde81da6a23fdeef69a8cfe51e540a50f4eda0bbe35a819391-rootfs.mount: Deactivated successfully. machine # [ 398.460738] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-c5eadb9bb1629bbde81da6a23fdeef69a8cfe51e540a50f4eda0bbe35a819391-shm.mount: Deactivated successfully. machine # [ 398.649976] cni0: port 1(veth5edb05ff) entered disabled state machine # [ 398.500364] dhcpcd[686]: veth5edb05ff: carrier lost machine # [ 398.653333] veth5edb05ff (unregistering): left allmulticast mode machine # [ 398.655523] veth5edb05ff (unregistering): left promiscuous mode machine # [ 398.657119] cni0: port 1(veth5edb05ff) entered disabled state machine # [ 398.527831] dhcpcd[686]: veth5edb05ff: deleting address fe80::40d5:25ff:fecf:327a machine # [ 398.530527] dhcpcd[686]: veth5edb05ff: deleting route to 169.254.0.0/16 machine # [ 398.532084] systemd[1]: run-netns-cni\x2d14652f5e\x2dcd01\x2d2a80\x2d5e0e\x2d960715bdb8c5.mount: Deactivated successfully. machine # [ 398.596371] dhcpcd[686]: veth5edb05ff: removing interface machine # [ 398.604980] k3s[894]: I0925 16:38:20.191039 894 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/12397e07-cdd2-4fc8-aae8-11374cf9e868-kube-api-access-x4pt8\" (UniqueName: \"kubernetes.io/projected/12397e07-cdd2-4fc8-aae8-11374cf9e868-kube-api-access-x4pt8\") pod \"12397e07-cdd2-4fc8-aae8-11374cf9e868\" (UID: \"12397e07-cdd2-4fc8-aae8-11374cf9e868\") " machine # [ 398.605731] k3s[894]: I0925 16:38:20.191132 894 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/12397e07-cdd2-4fc8-aae8-11374cf9e868-job\" (UniqueName: \"kubernetes.io/configmap/12397e07-cdd2-4fc8-aae8-11374cf9e868-job\") pod \"12397e07-cdd2-4fc8-aae8-11374cf9e868\" (UID: \"12397e07-cdd2-4fc8-aae8-11374cf9e868\") " machine # [ 398.606511] k3s[894]: I0925 16:38:20.191180 894 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/12397e07-cdd2-4fc8-aae8-11374cf9e868-nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/12397e07-cdd2-4fc8-aae8-11374cf9e868-nix-grpc-farm\") pod \"12397e07-cdd2-4fc8-aae8-11374cf9e868\" (UID: \"12397e07-cdd2-4fc8-aae8-11374cf9e868\") " machine # [ 398.607253] k3s[894]: I0925 16:38:20.191691 894 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12397e07-cdd2-4fc8-aae8-11374cf9e868-job" pod "12397e07-cdd2-4fc8-aae8-11374cf9e868" (UID: "12397e07-cdd2-4fc8-aae8-11374cf9e868"). InnerVolumeSpecName "job". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 398.610140] systemd[1]: var-lib-kubelet-pods-12397e07\x2dcdd2\x2d4fc8\x2daae8\x2d11374cf9e868-volumes-kubernetes.io\x7eprojected-nix\x2dgrpc\x2dfarm.mount: Deactivated successfully. machine # [ 398.625279] k3s[894]: I0925 16:38:20.211693 894 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12397e07-cdd2-4fc8-aae8-11374cf9e868-nix-grpc-farm" pod "12397e07-cdd2-4fc8-aae8-11374cf9e868" (UID: "12397e07-cdd2-4fc8-aae8-11374cf9e868"). InnerVolumeSpecName "nix-grpc-farm". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 398.633720] systemd[1]: var-lib-kubelet-pods-12397e07\x2dcdd2\x2d4fc8\x2daae8\x2d11374cf9e868-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dx4pt8.mount: Deactivated successfully. machine # [ 398.634703] k3s[894]: I0925 16:38:20.221090 894 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12397e07-cdd2-4fc8-aae8-11374cf9e868-kube-api-access-x4pt8" pod "12397e07-cdd2-4fc8-aae8-11374cf9e868" (UID: "12397e07-cdd2-4fc8-aae8-11374cf9e868"). InnerVolumeSpecName "kube-api-access-x4pt8". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 398.705495] k3s[894]: I0925 16:38:20.291850 894 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4pt8\" (UniqueName: \"kubernetes.io/projected/12397e07-cdd2-4fc8-aae8-11374cf9e868-kube-api-access-x4pt8\") on node \"machine\" DevicePath \"\"" machine # [ 398.706310] k3s[894]: I0925 16:38:20.291895 894 reconciler_common.go:299] "Volume detached for volume \"job\" (UniqueName: \"kubernetes.io/configmap/12397e07-cdd2-4fc8-aae8-11374cf9e868-job\") on node \"machine\" DevicePath \"\"" machine # [ 398.706931] k3s[894]: I0925 16:38:20.291915 894 reconciler_common.go:299] "Volume detached for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/12397e07-cdd2-4fc8-aae8-11374cf9e868-nix-grpc-farm\") on node \"machine\" DevicePath \"\"" machine # [ 399.334191] k3s[894]: I0925 16:38:20.920329 894 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c5eadb9bb1629bbde81da6a23fdeef69a8cfe51e540a50f4eda0bbe35a819391" machine # [ 399.352648] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod12397e07_cdd2_4fc8_aae8_11374cf9e868.slice. machine # [ 399.354463] systemd[1]: kubepods-besteffort-pod12397e07_cdd2_4fc8_aae8_11374cf9e868.slice: Consumed 1.211s CPU time over 1min 48.826s wall clock time, 142.8M memory peak, 73M read from disk, 632K written to disk, 18.3K incoming IP traffic, 44.8K outgoing IP traffic. machine: (finished: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed', in 110.10 seconds) machine: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1 machine: (finished: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1, in 0.17 seconds) machine # don't know how to build these paths: machine # /nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-a> machine/nix-grpc-farm-worker-x86-64-linux-c74f46454-mj954: building fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-b> machine/nix-grpc-farm-worker-x86-64-linux-c74f46454-mj954: building 1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-top> machine/nix-grpc-farm-worker-x86-64-linux-c74f46454-mj954: building rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # INFO:nix_fast_build.processes:run nix-eval-jobs --gc-roots-dir /tmp/tmp1uicjeee/gcroots --force-recurse --max-memory-size 4096 --workers 4 --flake '.#checks' --check-cache-status machine # INFO:nix_fast_build.workers:builds: 0 machine # warning: Git tree '/tmp' is dirty machine # warning: Git tree '/tmp' is dirty machine # ▶ x86_64-linux.t started machine # INFO:nix_fast_build.workers:builds: 2 machine # ✔ x86_64-linux.t (25s) machine # x86_64-linux.t> machine/nix-grpc-farm-worker-x86-64-linux-c74f46454-r4jjf: building fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # warning: Git tree '/tmp' is dirty machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath, in 0.18 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null, in 0.05 seconds) (finished: subtest: a Job with the client image builds through the farm with its service account, in 111.32 seconds) subtest: a renewed balancer certificate is served without a rollout machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f - machine # Warning: resource secrets/farm-lb-tls is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically. machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f -, in 0.32 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}', in 0.44 seconds) machine: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-75b44f88dd-9v6s5 -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine # [ 401.794889] k3s[894]: E0925 16:38:23.380422 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33604: use of closed network connection machine # [ 401.796453] k3s[894]: E0925 16:38:23.380469 894 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:43246->127.0.0.1:10010: write tcp 127.0.0.1:43246->127.0.0.1:10010: write: broken pipe machine # [ 403.113795] k3s[894]: E0925 16:38:24.699420 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56244: use of closed network connection machine # [ 404.442486] k3s[894]: E0925 16:38:26.028473 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56266: use of closed network connection machine # [ 405.724440] k3s[894]: E0925 16:38:27.310354 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56294: use of closed network connection machine # [ 405.726098] k3s[894]: E0925 16:38:27.310418 894 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:55930->127.0.0.1:10010: write tcp 127.0.0.1:55930->127.0.0.1:10010: write: broken pipe machine # [ 405.726854] k3s[894]: time="2026-09-25T16:38:27Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:36684->127.0.0.1:10250: write: connection reset by peer" machine # [ 406.989979] k3s[894]: E0925 16:38:28.576030 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56326: use of closed network connection machine # [ 408.302844] k3s[894]: E0925 16:38:29.888934 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56344: use of closed network connection machine # [ 409.616746] k3s[894]: E0925 16:38:31.202486 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56388: use of closed network connection machine # [ 412.224550] k3s[894]: E0925 16:38:33.810287 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56440: use of closed network connection machine # [ 413.512450] k3s[894]: E0925 16:38:35.098167 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:47954: use of closed network connection machine # [ 414.331497] postgres[758]: [758] LOG: checkpoint complete: wrote 1037 buffers (6.3%), wrote 3 SLRU buffers; 1 WAL file(s) added, 0 removed, 0 recycled; write=103.948 s, sync=0.043 s, total=104.030 s; sync files=364, longest=0.003 s, average=0.001 s; distance=4979 kB, estimate=4979 kB; lsn=0/1C72D70, redo lsn=0/1C42CE8 machine # [ 414.809697] k3s[894]: E0925 16:38:36.395751 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:47968: use of closed network connection machine # [ 416.138954] k3s[894]: time="2026-09-25T16:38:37Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:51160->127.0.0.1:10250: write: connection reset by peer" machine # [ 416.139892] k3s[894]: E0925 16:38:37.724898 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:47976: use of closed network connection machine # [ 418.736664] k3s[894]: time="2026-09-25T16:38:40Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:51178->127.0.0.1:10250: write: broken pipe" machine # [ 420.037059] k3s[894]: E0925 16:38:41.623080 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:48058: use of closed network connection machine # [ 421.330735] k3s[894]: E0925 16:38:42.916268 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:48080: use of closed network connection machine # [ 421.333350] k3s[894]: E0925 16:38:42.916413 894 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:38996->127.0.0.1:10010: write tcp 127.0.0.1:38996->127.0.0.1:10010: write: broken pipe machine # [ 421.334798] k3s[894]: time="2026-09-25T16:38:42Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:51188->127.0.0.1:10250: write: connection reset by peer" machine # [ 422.639212] k3s[894]: E0925 16:38:44.224927 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:48098: use of closed network connection machine # [ 423.928802] k3s[894]: E0925 16:38:45.514787 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:42404: use of closed network connection machine # [ 425.225293] k3s[894]: E0925 16:38:46.811316 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:42434: use of closed network connection machine # [ 426.556286] k3s[894]: E0925 16:38:48.142153 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:42470: use of closed network connection machine # [ 427.849566] k3s[894]: E0925 16:38:49.435679 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:42498: use of closed network connection machine # [ 429.147387] k3s[894]: time="2026-09-25T16:38:50Z" level=warning msg="Proxy error: read failed: read tcp 127.0.0.1:57610->127.0.0.1:10250: read: connection reset by peer" machine # [ 429.148854] k3s[894]: E0925 16:38:50.732700 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:42526: use of closed network connection machine # [ 430.461149] k3s[894]: E0925 16:38:52.046934 894 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:35376->127.0.0.1:10010: write tcp 127.0.0.1:35376->127.0.0.1:10010: write: broken pipe machine # [ 430.462534] k3s[894]: time="2026-09-25T16:38:52Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:57616->127.0.0.1:10250: write: connection reset by peer" machine # [ 431.782480] k3s[894]: E0925 16:38:53.367407 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:42552: use of closed network connection machine # [ 433.118635] k3s[894]: E0925 16:38:54.704667 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:49348: use of closed network connection machine: (finished: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-75b44f88dd-9v6s5 -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 31.63 seconds) machine: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine: (finished: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 0.04 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1 machine # [ 433.399196] niks3-server[1193]: 2026/09/25 16:38:54 INFO Received push request method=POST path=/api/pushes machine # [ 433.414488] niks3-server[1193]: 2026/09/25 16:38:55 INFO Received sign narinfos request method=POST path=/api/pushes/21/sign machine # [ 433.417453] niks3-server[1193]: 2026/09/25 16:38:55 INFO Signed narinfos id=21 count=1 machine # [ 433.420270] niks3-server[1193]: 2026/09/25 16:38:55 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.ls machine # [ 433.422513] niks3-server[1193]: 2026/09/25 16:38:55 INFO Registered completed upload object_key=nar/0g42hgwa9jp9abmqxz90dkwxpybsznzbpsy35rm921mlk5sw56jq.nar.zst machine # [ 433.426937] niks3-server[1193]: 2026/09/25 16:38:55 INFO Received complete push request method=POST path=/api/pushes/21/complete machine # [ 433.429903] niks3-server[1193]: 2026/09/25 16:38:55 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.narinfo machine # [ 458.157735] niks3-server[1193]: 2026/09/25 16:39:19 INFO Received push request method=POST path=/api/pushes machine # [ 458.173828] niks3-server[1193]: 2026/09/25 16:39:19 INFO Received sign narinfos request method=POST path=/api/pushes/22/sign machine # [ 458.176225] niks3-server[1193]: 2026/09/25 16:39:19 INFO Signed narinfos id=22 count=1 machine # [ 458.183585] niks3-server[1193]: 2026/09/25 16:39:19 INFO Registered completed upload object_key=log/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31-k3s-a.drv machine # [ 458.188239] niks3-server[1193]: 2026/09/25 16:39:19 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.ls machine # [ 458.191325] niks3-server[1193]: 2026/09/25 16:39:19 INFO Received complete push request method=POST path=/api/pushes/22/complete machine # [ 458.194525] niks3-server[1193]: 2026/09/25 16:39:19 INFO Registered completed upload object_key=nar/1vxmmzwi16s4iri6dcmi9v62dpq1ys7wz15b497ncik3sd67nfzg.nar.zst machine # [ 458.194888] niks3-server[1193]: 2026/09/25 16:39:19 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo machine # [ 458.286969] niks3-server[1193]: 2026/09/25 16:39:19 INFO Received push request method=POST path=/api/pushes machine # [ 458.301031] niks3-server[1193]: 2026/09/25 16:39:19 INFO Received sign narinfos request method=POST path=/api/pushes/23/sign machine # [ 458.302030] niks3-server[1193]: 2026/09/25 16:39:19 INFO Signed narinfos id=23 count=1 machine # [ 458.307068] niks3-server[1193]: 2026/09/25 16:39:19 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.ls machine # [ 458.308963] niks3-server[1193]: 2026/09/25 16:39:19 INFO Registered completed upload object_key=nar/0cbxkyxz068xc5mivh2h67kw6y01n1x28cbs11v1a03g8m4c71zm.nar.zst machine # [ 458.315575] niks3-server[1193]: 2026/09/25 16:39:19 INFO Received complete push request method=POST path=/api/pushes/23/complete machine # [ 458.321536] niks3-server[1193]: 2026/09/25 16:39:19 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.narinfo machine # [ 482.841896] niks3-server[1193]: 2026/09/25 16:39:44 INFO Received push request method=POST path=/api/pushes machine # [ 482.863373] niks3-server[1193]: 2026/09/25 16:39:44 INFO Received sign narinfos request method=POST path=/api/pushes/24/sign machine # [ 482.866831] niks3-server[1193]: 2026/09/25 16:39:44 INFO Signed narinfos id=24 count=1 machine # [ 482.869243] niks3-server[1193]: 2026/09/25 16:39:44 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.ls machine # [ 482.871309] niks3-server[1193]: 2026/09/25 16:39:44 INFO Registered completed upload object_key=log/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4-k3s-b.drv machine # [ 482.873107] niks3-server[1193]: 2026/09/25 16:39:44 INFO Registered completed upload object_key=nar/0khxywxb2r78vhpc5hsmha3ymgp910z0aka7550jmaqzs333rmzp.nar.zst machine # [ 482.877690] niks3-server[1193]: 2026/09/25 16:39:44 INFO Received complete push request method=POST path=/api/pushes/24/complete machine # [ 482.886453] niks3-server[1193]: 2026/09/25 16:39:44 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.narinfo machine # [ 482.959589] niks3-server[1193]: 2026/09/25 16:39:44 INFO Received push request method=POST path=/api/pushes machine # [ 482.974569] niks3-server[1193]: 2026/09/25 16:39:44 INFO Received sign narinfos request method=POST path=/api/pushes/25/sign machine # [ 482.976068] niks3-server[1193]: 2026/09/25 16:39:44 INFO Signed narinfos id=25 count=1 machine # [ 482.976755] niks3-server[1193]: 2026/09/25 16:39:44 INFO Registered completed upload object_key=nar/04bim5f8bvjh25xncf5x40kb529khrlzcbc92qxvapgbc0bdfv2h.nar.zst machine # [ 482.982248] niks3-server[1193]: 2026/09/25 16:39:44 INFO Received complete push request method=POST path=/api/pushes/25/complete machine # [ 482.983039] niks3-server[1193]: 2026/09/25 16:39:44 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.ls machine # [ 482.987109] niks3-server[1193]: 2026/09/25 16:39:44 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.narinfo machine # [ 507.704833] niks3-server[1193]: 2026/09/25 16:40:09 INFO Received push request method=POST path=/api/pushes machine # [ 507.720474] niks3-server[1193]: 2026/09/25 16:40:09 INFO Received sign narinfos request method=POST path=/api/pushes/26/sign machine # [ 507.726636] niks3-server[1193]: 2026/09/25 16:40:09 INFO Signed narinfos id=26 count=1 machine # [ 507.729755] niks3-server[1193]: 2026/09/25 16:40:09 INFO Registered completed upload object_key=log/jz7biafi8rj5r3r392blyazw5mdpvy0d-k3s-top.drv machine # [ 507.734643] niks3-server[1193]: 2026/09/25 16:40:09 INFO Registered completed upload object_key=nar/11f7f1hixry25c2yc6np9hs10a2pwwqmymmrxxbswhdjabcyvv0s.nar.zst machine # [ 507.739659] niks3-server[1193]: 2026/09/25 16:40:09 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.ls machine # [ 507.744345] niks3-server[1193]: 2026/09/25 16:40:09 INFO Received complete push request method=POST path=/api/pushes/26/complete machine # [ 507.747576] niks3-server[1193]: 2026/09/25 16:40:09 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1, in 74.60 seconds) (finished: subtest: a renewed balancer certificate is served without a rollout, in 107.04 seconds) subtest: metrics carry build_info machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-c74f46454-mj954 -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-c74f46454-mj954 -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.16 seconds) machine: must succeed: curl -sf http://10.42.0.7:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-c74f46454-mj954"' machine: (finished: must succeed: curl -sf http://10.42.0.7:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-c74f46454-mj954"', in 0.04 seconds) (finished: subtest: metrics carry build_info, in 0.20 seconds) subtest: harmonia-gc frees space and the worker stays Ready machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-c74f46454-mj954 -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'' machine # [ 508.180509] k3s[894]: E0925 16:40:09.766517 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:52288: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-c74f46454-mj954 -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'', in 0.21 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-c74f46454-mj954 -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done' machine # [ 508.495515] k3s[894]: E0925 16:40:10.081704 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:52308: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-c74f46454-mj954 -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done', in 0.32 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-c74f46454-mj954 -c gc -- sh -c 'fallocate -l 11438694400 /nix/fill' machine # [ 508.754187] k3s[894]: E0925 16:40:10.340411 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:52328: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-c74f46454-mj954 -c gc -- sh -c 'fallocate -l 11438694400 /nix/fill', in 0.25 seconds) machine: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-c74f46454-mj954 -c gc --since=30s | grep -q 'store paths deleted' machine: (finished: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-c74f46454-mj954 -c gc --since=30s | grep -q 'store paths deleted', in 7.64 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-c74f46454-mj954 -c gc -- sh -c 'rm /nix/fill' machine # [ 516.637201] k3s[894]: E0925 16:40:18.223218 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37738: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-c74f46454-mj954 -c gc -- sh -c 'rm /nix/fill', in 0.24 seconds) machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-c74f46454-mj954 -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-c74f46454-mj954 -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}', in 0.15 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-c74f46454-mj954 -c gc -- sh -c 'command -v nix-daemon && command -v niks3' machine # [ 516.989901] k3s[894]: E0925 16:40:18.576126 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37780: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-c74f46454-mj954 -c gc -- sh -c 'command -v nix-daemon && command -v niks3', in 0.20 seconds) (finished: subtest: harmonia-gc frees space and the worker stays Ready, in 9.02 seconds) subtest: losing the balancer mid-build: the client reconnects and the build succeeds machine: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1 machine # [ 517.017204] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1. machine # Running as unit: vialb.service; invocation ID: c85b17aa5d044dcb91639123cf6ad315 machine: (finished: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1, in 0.02 seconds) machine: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'" machine # [ 517.152443] nix[9781]: don't know how to build these paths: machine # [ 517.154574] nix[9781]: /nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 517.183208] nix[9781]: copying 1 paths to '127.0.0.1:30051'... machine # [ 517.185513] nix[9781]: copying path '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' to '127.0.0.1:30051'... machine # [ 517.246931] niks3-server[1193]: 2026/09/25 16:40:18 INFO Received push request method=POST path=/api/pushes machine # [ 517.266448] niks3-server[1193]: 2026/09/25 16:40:18 INFO Received sign narinfos request method=POST path=/api/pushes/27/sign machine # [ 517.268270] niks3-server[1193]: 2026/09/25 16:40:18 INFO Registered completed upload object_key=nar/0kkr2vb091wkq0cb0f1q92413dsfskh76wydp8mwysv7rawns0ar.nar.zst machine # [ 517.270494] niks3-server[1193]: 2026/09/25 16:40:18 INFO Signed narinfos id=27 count=1 machine # [ 517.274542] niks3-server[1193]: 2026/09/25 16:40:18 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.ls machine # [ 517.278162] niks3-server[1193]: 2026/09/25 16:40:18 INFO Received complete push request method=POST path=/api/pushes/27/complete machine # [ 517.283464] niks3-server[1193]: 2026/09/25 16:40:18 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.narinfo machine # [ 517.295960] nix[9781]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 517.296659] nix[9781]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-c74f46454-r4jjf: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine: (finished: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'", in 1.06 seconds) machine: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false machine: (finished: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false, in 0.43 seconds) machine: waiting for success: ! systemctl is-active vialb machine # [ 518.549397] nix[9781]: scheduler at 127.0.0.1:30051: Stream removed (Socket closed), reconnecting machine # [ 518.550957] nix[9781]: d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv: Stream removed (Socket closed), asking the scheduler again machine # [ 518.574617] systemd[1]: cri-containerd-39edc04edbb5502906a75ddc5192298e47df5da6643039fffe958ff2d6466a3b.scope: Deactivated successfully. machine # [ 518.576433] systemd[1]: cri-containerd-39edc04edbb5502906a75ddc5192298e47df5da6643039fffe958ff2d6466a3b.scope: Consumed 4.751s CPU time over 7min 41.832s wall clock time, 51.8M memory peak, 29.9M read from disk, 598.8K incoming IP traffic, 734.6K outgoing IP traffic. machine # [ 518.608072] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-39edc04edbb5502906a75ddc5192298e47df5da6643039fffe958ff2d6466a3b-rootfs.mount: Deactivated successfully. machine # [ 518.638108] systemd[1]: cri-containerd-2f499b12f7ac921e5ebedcc27f2760272d53a57ce35535aed2090f19a6fd362b.scope: Deactivated successfully. machine # [ 518.669677] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-2f499b12f7ac921e5ebedcc27f2760272d53a57ce35535aed2090f19a6fd362b-rootfs.mount: Deactivated successfully. machine # [ 518.695662] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-2f499b12f7ac921e5ebedcc27f2760272d53a57ce35535aed2090f19a6fd362b-shm.mount: Deactivated successfully. machine # [ 518.885952] cni0: port 5(vethcca457c0) entered disabled state machine # [ 518.736560] dhcpcd[686]: vethcca457c0: carrier lost machine # [ 518.889522] vethcca457c0 (unregistering): left allmulticast mode machine # [ 518.890879] vethcca457c0 (unregistering): left promiscuous mode machine # [ 518.892110] cni0: port 5(vethcca457c0) entered disabled state machine # [ 518.762254] systemd[1]: run-netns-cni\x2d80751f11\x2de6c8\x2d67ae\x2d62af\x2d8ec057c94a04.mount: Deactivated successfully. machine # [ 518.779252] dhcpcd[686]: vethcca457c0: deleting address fe80::5095:a6ff:feeb:c91f machine # [ 518.781352] dhcpcd[686]: vethcca457c0: deleting route to 169.254.0.0/16 machine # [ 518.823159] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod7b62dff7_a098_4ed6_9f46_eb680377e1ed.slice. machine # [ 518.863583] dhcpcd[686]: vethcca457c0: removing interface machine # [ 518.868492] k3s[894]: I0925 16:40:20.454417 894 scope.go:122] "RemoveContainer" containerID="39edc04edbb5502906a75ddc5192298e47df5da6643039fffe958ff2d6466a3b" machine # [ 518.881157] k3s[894]: I0925 16:40:20.467603 894 scope.go:122] "RemoveContainer" containerID="39edc04edbb5502906a75ddc5192298e47df5da6643039fffe958ff2d6466a3b" machine # [ 518.883404] k3s[894]: E0925 16:40:20.469819 894 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"39edc04edbb5502906a75ddc5192298e47df5da6643039fffe958ff2d6466a3b\": not found" containerID="39edc04edbb5502906a75ddc5192298e47df5da6643039fffe958ff2d6466a3b" machine # [ 518.884218] k3s[894]: I0925 16:40:20.469865 894 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"39edc04edbb5502906a75ddc5192298e47df5da6643039fffe958ff2d6466a3b"} err="failed to get container status \"39edc04edbb5502906a75ddc5192298e47df5da6643039fffe958ff2d6466a3b\": rpc error: code = NotFound desc = an error occurred when try to find container \"39edc04edbb5502906a75ddc5192298e47df5da6643039fffe958ff2d6466a3b\": not found" machine # [ 518.926414] k3s[894]: I0925 16:40:20.512819 894 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1aef550b-e553-4617-a5f3-119270f18a39-tmp\" (UniqueName: \"kubernetes.io/empty-dir/1aef550b-e553-4617-a5f3-119270f18a39-tmp\") pod \"1aef550b-e553-4617-a5f3-119270f18a39\" (UID: \"1aef550b-e553-4617-a5f3-119270f18a39\") " machine # [ 518.926915] k3s[894]: I0925 16:40:20.512876 894 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1aef550b-e553-4617-a5f3-119270f18a39-tls-ca\" (UniqueName: \"kubernetes.io/secret/1aef550b-e553-4617-a5f3-119270f18a39-tls-ca\") pod \"1aef550b-e553-4617-a5f3-119270f18a39\" (UID: \"1aef550b-e553-4617-a5f3-119270f18a39\") " machine # [ 518.927595] k3s[894]: I0925 16:40:20.512911 894 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1aef550b-e553-4617-a5f3-119270f18a39-tls-lb\" (UniqueName: \"kubernetes.io/secret/1aef550b-e553-4617-a5f3-119270f18a39-tls-lb\") pod \"1aef550b-e553-4617-a5f3-119270f18a39\" (UID: \"1aef550b-e553-4617-a5f3-119270f18a39\") " machine # [ 518.928231] k3s[894]: I0925 16:40:20.512959 894 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1aef550b-e553-4617-a5f3-119270f18a39-config\" (UniqueName: \"kubernetes.io/configmap/1aef550b-e553-4617-a5f3-119270f18a39-config\") pod \"1aef550b-e553-4617-a5f3-119270f18a39\" (UID: \"1aef550b-e553-4617-a5f3-119270f18a39\") " machine # [ 518.928772] k3s[894]: I0925 16:40:20.513018 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b62dff7-a098-4ed6-9f46-eb680377e1ed-tmp\") pod \"nix-grpc-farm-lb-75b44f88dd-4ks8c\" (UID: \"7b62dff7-a098-4ed6-9f46-eb680377e1ed\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-4ks8c" machine # [ 518.929482] k3s[894]: I0925 16:40:20.513049 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/7b62dff7-a098-4ed6-9f46-eb680377e1ed-tls-lb\") pod \"nix-grpc-farm-lb-75b44f88dd-4ks8c\" (UID: \"7b62dff7-a098-4ed6-9f46-eb680377e1ed\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-4ks8c" machine # [ 518.929987] k3s[894]: I0925 16:40:20.513080 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/7b62dff7-a098-4ed6-9f46-eb680377e1ed-tls-ca\") pod \"nix-grpc-farm-lb-75b44f88dd-4ks8c\" (UID: \"7b62dff7-a098-4ed6-9f46-eb680377e1ed\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-4ks8c" machine # [ 518.930713] k3s[894]: I0925 16:40:20.513110 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7b62dff7-a098-4ed6-9f46-eb680377e1ed-config\") pod \"nix-grpc-farm-lb-75b44f88dd-4ks8c\" (UID: \"7b62dff7-a098-4ed6-9f46-eb680377e1ed\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-4ks8c" machine # [ 518.931702] systemd[1]: var-lib-kubelet-pods-1aef550b\x2de553\x2d4617\x2da5f3\x2d119270f18a39-volumes-kubernetes.io\x7esecret-tls\x2dca.mount: Deactivated successfully. machine # [ 518.962906] k3s[894]: I0925 16:40:20.549285 894 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1aef550b-e553-4617-a5f3-119270f18a39-tls-ca" pod "1aef550b-e553-4617-a5f3-119270f18a39" (UID: "1aef550b-e553-4617-a5f3-119270f18a39"). InnerVolumeSpecName "tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 518.967453] k3s[894]: I0925 16:40:20.550692 894 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1aef550b-e553-4617-a5f3-119270f18a39-tls-lb" pod "1aef550b-e553-4617-a5f3-119270f18a39" (UID: "1aef550b-e553-4617-a5f3-119270f18a39"). InnerVolumeSpecName "tls-lb". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 518.972491] k3s[894]: I0925 16:40:20.558943 894 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1aef550b-e553-4617-a5f3-119270f18a39-tmp" pod "1aef550b-e553-4617-a5f3-119270f18a39" (UID: "1aef550b-e553-4617-a5f3-119270f18a39"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 518.977354] k3s[894]: I0925 16:40:20.563807 894 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1aef550b-e553-4617-a5f3-119270f18a39-config" pod "1aef550b-e553-4617-a5f3-119270f18a39" (UID: "1aef550b-e553-4617-a5f3-119270f18a39"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 519.027256] k3s[894]: I0925 16:40:20.613657 894 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1aef550b-e553-4617-a5f3-119270f18a39-config\") on node \"machine\" DevicePath \"\"" machine # [ 519.030506] k3s[894]: I0925 16:40:20.613700 894 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1aef550b-e553-4617-a5f3-119270f18a39-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 519.031212] k3s[894]: I0925 16:40:20.613714 894 reconciler_common.go:299] "Volume detached for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/1aef550b-e553-4617-a5f3-119270f18a39-tls-ca\") on node \"machine\" DevicePath \"\"" machine # [ 519.031888] k3s[894]: I0925 16:40:20.613728 894 reconciler_common.go:299] "Volume detached for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/1aef550b-e553-4617-a5f3-119270f18a39-tls-lb\") on node \"machine\" DevicePath \"\"" machine # [ 519.305673] cni0: port 1(vethd02f15e9) entered blocking state machine # [ 519.307982] cni0: port 1(vethd02f15e9) entered disabled state machine # [ 519.309739] vethd02f15e9: entered allmulticast mode machine # [ 519.311044] vethd02f15e9: entered promiscuous mode machine # [ 519.162994] (udev-worker)[9959]: Network interface NamePolicy= disabled on kernel command line. machine # [ 519.322220] cni0: port 1(vethd02f15e9) entered blocking state machine # [ 519.323671] cni0: port 1(vethd02f15e9) entered forwarding state machine # [ 519.181976] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod1aef550b_e553_4617_a5f3_119270f18a39.slice. machine # [ 519.183887] systemd[1]: kubepods-besteffort-pod1aef550b_e553_4617_a5f3_119270f18a39.slice: Consumed 4.782s CPU time over 7min 44.596s wall clock time, 52M memory peak, 29.9M read from disk, 598.8K incoming IP traffic, 734.6K outgoing IP traffic. machine # [ 519.196788] dhcpcd[686]: vethd02f15e9: IAID 5d:14:5f:0b machine # [ 519.198107] dhcpcd[686]: vethd02f15e9: adding address fe80::1c65:5dff:fe14:5f0b machine # [ 519.274357] systemd[1]: Started libcontainer container 78aee60a09226268ef0542ce96eab9b45f1c55b22aeee0305f3253789f15e340. machine # [ 519.408460] systemd[1]: Started libcontainer container 7134acd18997d5fcec11cfeb6003d4eeaada038e25a9a48d2c4b8e7b3622afe8. machine # [ 519.501936] k3s[894]: I0925 16:40:21.088271 894 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1aef550b-e553-4617-a5f3-119270f18a39" path="/var/lib/kubelet/pods/1aef550b-e553-4617-a5f3-119270f18a39/volumes" machine # [ 519.623263] systemd[1]: var-lib-kubelet-pods-1aef550b\x2de553\x2d4617\x2da5f3\x2d119270f18a39-volume\x2dsubpaths-config-envoy-2.mount: Deactivated successfully. machine # [ 519.627240] systemd[1]: var-lib-kubelet-pods-1aef550b\x2de553\x2d4617\x2da5f3\x2d119270f18a39-volume\x2dsubpaths-config-envoy-1.mount: Deactivated successfully. machine # [ 519.630872] systemd[1]: var-lib-kubelet-pods-1aef550b\x2de553\x2d4617\x2da5f3\x2d119270f18a39-volume\x2dsubpaths-config-envoy-0.mount: Deactivated successfully. machine # [ 519.634522] systemd[1]: var-lib-kubelet-pods-1aef550b\x2de553\x2d4617\x2da5f3\x2d119270f18a39-volumes-kubernetes.io\x7esecret-tls\x2dlb.mount: Deactivated successfully. machine # [ 519.637471] systemd[1]: var-lib-kubelet-pods-1aef550b\x2de553\x2d4617\x2da5f3\x2d119270f18a39-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 519.697490] dhcpcd[686]: vethd02f15e9: soliciting a DHCP lease machine # [ 519.905692] k3s[894]: I0925 16:40:21.491339 894 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-75b44f88dd-4ks8c" podStartSLOduration=1.491288778 podStartE2EDuration="1.491288778s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-25 16:40:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-25 16:40:21.490312676 +0000 UTC m=+501.620637482" watchObservedRunningTime="2026-09-25 16:40:21.491288778 +0000 UTC m=+501.621543463" machine # [ 521.055418] nix[9781]: scheduler at 127.0.0.1:30051: failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:30051: tcp handshaker shutdown, reconnecting machine # [ 521.342233] dhcpcd[686]: vethd02f15e9: soliciting an IPv6 router machine # [ 522.056345] nix[9781]: scheduler at 127.0.0.1:30051: failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:30051: tcp handshaker shutdown, reconnecting machine # [ 524.056966] nix[9781]: scheduler at 127.0.0.1:30051: failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:30051: Failed to connect to remote host: Connection refused, reconnecting machine # [ 524.699464] dhcpcd[686]: vethd02f15e9: probing for an IPv4LL address machine # [ 528.103879] nix[9781]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 528.105898] nix[9781]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-c74f46454-mj954: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 529.971965] dhcpcd[686]: vethd02f15e9: using IPv4LL address 169.254.91.67 machine # [ 529.974593] dhcpcd[686]: vethd02f15e9: adding route to 169.254.0.0/16 machine # [ 533.347631] dhcpcd[686]: vethd02f15e9: no IPv6 Routers available machine # [ 573.065136] niks3-server[1193]: 2026/09/25 16:41:14 INFO Received push request method=POST path=/api/pushes machine # [ 573.086305] niks3-server[1193]: 2026/09/25 16:41:14 INFO Received sign narinfos request method=POST path=/api/pushes/28/sign machine # [ 573.089083] niks3-server[1193]: 2026/09/25 16:41:14 INFO Signed narinfos id=28 count=1 machine # [ 573.090729] niks3-server[1193]: 2026/09/25 16:41:14 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.ls machine # [ 573.093698] niks3-server[1193]: 2026/09/25 16:41:14 INFO Registered completed upload object_key=log/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 573.100303] niks3-server[1193]: 2026/09/25 16:41:14 INFO Received complete push request method=POST path=/api/pushes/28/complete machine # [ 573.106282] niks3-server[1193]: 2026/09/25 16:41:14 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.narinfo machine # [ 574.157921] systemd[1]: vialb.service: Deactivated successfully. machine # [ 574.161151] systemd[1]: vialb.service: Consumed 278ms CPU time over 57.140s wall clock time, 44.5M memory peak, 4K written to disk, 8.5K incoming IP traffic, 17.6K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active vialb, in 56.33 seconds) machine: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; }, in 0.04 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 0.28 seconds) (finished: subtest: losing the balancer mid-build: the client reconnects and the build succeeds, in 58.17 seconds) subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes machine: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 machine # [ 575.200054] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1. machine # Running as unit: slow.service; invocation ID: 0a4b94c650c34e4cb493c0c255fccfd8 machine: (finished: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1, in 0.04 seconds) machine # [ 575.336943] nix[10778]: don't know how to build these paths: machine # [ 575.338723] nix[10778]: /nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 575.359519] nix[10778]: copying 1 paths to '127.0.0.1:30051'... machine # [ 575.362312] nix[10778]: copying path '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' to '127.0.0.1:30051'... machine # [ 575.404591] niks3-server[1193]: 2026/09/25 16:41:16 INFO Received push request method=POST path=/api/pushes machine # [ 575.430329] k3s[894]: E0925 16:41:17.016371 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35130: use of closed network connection machine # command terminated with exit code 1 machine # [ 575.435860] niks3-server[1193]: 2026/09/25 16:41:17 INFO Received sign narinfos request method=POST path=/api/pushes/29/sign machine # [ 575.436631] niks3-server[1193]: 2026/09/25 16:41:17 INFO Signed narinfos id=29 count=1 machine # [ 575.437776] niks3-server[1193]: 2026/09/25 16:41:17 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.ls machine # [ 575.439770] niks3-server[1193]: 2026/09/25 16:41:17 INFO Registered completed upload object_key=nar/0wl2i9xpw0gwrx1xqdgx9ka4n503ky9qhl20pdrdlphn8d6lcx0i.nar.zst machine # [ 575.443071] niks3-server[1193]: 2026/09/25 16:41:17 INFO Received complete push request method=POST path=/api/pushes/29/complete machine # [ 575.450118] niks3-server[1193]: 2026/09/25 16:41:17 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.narinfo machine # [ 575.457323] nix[10778]: building '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' on 127.0.0.1:30051... machine # [ 575.458098] nix[10778]: slow-s1> machine/nix-grpc-farm-worker-x86-64-linux-c74f46454-r4jjf: building zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 575.648295] k3s[894]: E0925 16:41:17.234585 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35164: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 576.952816] k3s[894]: time="2026-09-25T16:41:18Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:47216->127.0.0.1:10250: write: connection reset by peer" machine # [ 576.955433] k3s[894]: E0925 16:41:18.538757 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35206: use of closed network connection machine # [ 577.156248] k3s[894]: E0925 16:41:18.742519 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35250: use of closed network connection machine # command terminated with exit code 1 machine # [ 578.444712] k3s[894]: E0925 16:41:20.030769 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35278: use of closed network connection machine # command terminated with exit code 1 machine # [ 578.649117] k3s[894]: E0925 16:41:20.235452 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35294: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 579.909396] k3s[894]: E0925 16:41:21.495448 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35322: use of closed network connection machine # [ 580.095961] k3s[894]: time="2026-09-25T16:41:21Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:47266->127.0.0.1:10250: write: broken pipe" machine # [ 580.097348] k3s[894]: E0925 16:41:21.682555 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35360: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 581.408394] k3s[894]: E0925 16:41:22.994014 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35384: use of closed network connection machine # [ 581.626281] k3s[894]: E0925 16:41:23.212633 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35402: use of closed network connection machine # command terminated with exit code 1 machine # [ 582.920270] k3s[894]: E0925 16:41:24.506192 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35422: use of closed network connection machine # command terminated with exit code 1 machine # [ 582.921118] k3s[894]: time="2026-09-25T16:41:24Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:47310->127.0.0.1:10250: write: broken pipe" machine # [ 583.112931] k3s[894]: E0925 16:41:24.699250 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43434: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 584.419815] k3s[894]: E0925 16:41:26.005825 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43462: use of closed network connection machine # [ 584.613707] k3s[894]: E0925 16:41:26.200033 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43492: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 585.888291] k3s[894]: E0925 16:41:27.474338 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43510: use of closed network connection machine # [ 586.096391] k3s[894]: E0925 16:41:27.682810 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43542: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 587.339379] k3s[894]: E0925 16:41:28.924941 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43572: use of closed network connection machine # [ 587.526754] k3s[894]: E0925 16:41:29.113056 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43592: use of closed network connection machine # command terminated with exit code 1 machine # [ 588.777694] k3s[894]: E0925 16:41:30.363712 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43626: use of closed network connection machine # command terminated with exit code 1 machine # [ 589.010249] k3s[894]: E0925 16:41:30.596657 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43652: use of closed network connection machine # command terminated with exit code 1 machine # [ 590.318967] k3s[894]: E0925 16:41:31.904957 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43670: use of closed network connection machine # command terminated with exit code 1 machine # [ 590.546907] k3s[894]: E0925 16:41:32.133287 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43702: use of closed network connection machine # command terminated with exit code 1 machine # [ 591.863084] k3s[894]: E0925 16:41:33.449022 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43720: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 592.064832] k3s[894]: E0925 16:41:33.651061 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43734: use of closed network connection machine # [ 593.354189] k3s[894]: E0925 16:41:34.940210 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:52738: use of closed network connection machine # command terminated with exit code 1 machine # [ 593.582750] k3s[894]: E0925 16:41:35.169040 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:52754: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 594.863936] k3s[894]: E0925 16:41:36.449713 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:52778: use of closed network connection machine # [ 595.081454] k3s[894]: E0925 16:41:36.667848 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:52814: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 596.361035] k3s[894]: E0925 16:41:37.946886 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:52840: use of closed network connection machine # [ 596.566809] k3s[894]: E0925 16:41:38.153187 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:52870: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 597.880919] k3s[894]: E0925 16:41:39.466876 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:52892: use of closed network connection machine # [ 598.089048] k3s[894]: E0925 16:41:39.675350 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:52936: use of closed network connection machine # command terminated with exit code 1 machine # [ 599.405782] k3s[894]: time="2026-09-25T16:41:40Z" level=warning msg="Proxy error: read failed: read tcp 127.0.0.1:6443->127.0.0.1:52972: read: connection reset by peer" machine # command terminated with exit code 1 machine # [ 599.406717] k3s[894]: E0925 16:41:40.991897 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:52962: use of closed network connection machine # [ 599.618517] k3s[894]: E0925 16:41:41.204916 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:52986: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 600.858429] k3s[894]: E0925 16:41:42.444230 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53014: use of closed network connection machine # [ 601.048032] k3s[894]: E0925 16:41:42.634432 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53044: use of closed network connection machine # [ 601.237928] k3s[894]: E0925 16:41:42.824351 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53072: use of closed network connection machine # command terminated with exit code 1 machine # [ 601.425855] k3s[894]: E0925 16:41:43.012252 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53102: use of closed network connection machine: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-c74f46454-r4jjf --wait=false machine: (finished: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-c74f46454-r4jjf --wait=false, in 0.15 seconds) machine: must succeed: sleep 5.0 machine # [ 601.626573] systemd[1]: cri-containerd-af451b150f17f66d229de74ec345099a01bb5b391a04094c23284ce1cb31356e.scope: Deactivated successfully. machine # [ 601.628354] systemd[1]: cri-containerd-af451b150f17f66d229de74ec345099a01bb5b391a04094c23284ce1cb31356e.scope: Consumed 554ms CPU time over 8min 56.102s wall clock time, 12.4M memory peak, 5.2M read from disk. machine # [ 601.667274] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-af451b150f17f66d229de74ec345099a01bb5b391a04094c23284ce1cb31356e-rootfs.mount: Deactivated successfully. machine # [ 602.545773] systemd[1]: Created slice libcontainer container kubepods-besteffort-podd195bb27_8f12_4074_86cc_3d637a00efaa.slice. machine # [ 602.616693] k3s[894]: I0925 16:41:44.202742 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/d195bb27-8f12-4074-86cc-3d637a00efaa-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-bjm7w\" (UID: \"d195bb27-8f12-4074-86cc-3d637a00efaa\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-bjm7w" machine # [ 602.618194] k3s[894]: I0925 16:41:44.202806 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/d195bb27-8f12-4074-86cc-3d637a00efaa-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-bjm7w\" (UID: \"d195bb27-8f12-4074-86cc-3d637a00efaa\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-bjm7w" machine # [ 602.618682] k3s[894]: I0925 16:41:44.202844 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/d195bb27-8f12-4074-86cc-3d637a00efaa-build\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-bjm7w\" (UID: \"d195bb27-8f12-4074-86cc-3d637a00efaa\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-bjm7w" machine # [ 602.619732] k3s[894]: I0925 16:41:44.202876 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/d195bb27-8f12-4074-86cc-3d637a00efaa-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-bjm7w\" (UID: \"d195bb27-8f12-4074-86cc-3d637a00efaa\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-bjm7w" machine # [ 602.621041] k3s[894]: I0925 16:41:44.202906 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d195bb27-8f12-4074-86cc-3d637a00efaa-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-bjm7w\" (UID: \"d195bb27-8f12-4074-86cc-3d637a00efaa\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-bjm7w" machine # [ 602.621991] k3s[894]: I0925 16:41:44.202934 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/d195bb27-8f12-4074-86cc-3d637a00efaa-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-bjm7w\" (UID: \"d195bb27-8f12-4074-86cc-3d637a00efaa\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-bjm7w" machine # [ 602.623293] k3s[894]: I0925 16:41:44.202965 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/d195bb27-8f12-4074-86cc-3d637a00efaa-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-bjm7w\" (UID: \"d195bb27-8f12-4074-86cc-3d637a00efaa\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-bjm7w" machine # [ 602.624267] k3s[894]: I0925 16:41:44.202998 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8ksd\" (UniqueName: \"kubernetes.io/projected/d195bb27-8f12-4074-86cc-3d637a00efaa-kube-api-access-q8ksd\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-bjm7w\" (UID: \"d195bb27-8f12-4074-86cc-3d637a00efaa\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-bjm7w" machine # [ 603.065679] cni0: port 5(veth15ac05eb) entered blocking state machine # [ 603.066758] cni0: port 5(veth15ac05eb) entered disabled state machine # [ 603.068154] veth15ac05eb: entered allmulticast mode machine # [ 603.069330] veth15ac05eb: entered promiscuous mode machine # [ 603.086298] cni0: port 5(veth15ac05eb) entered blocking state machine # [ 603.088093] cni0: port 5(veth15ac05eb) entered forwarding state machine # [ 602.969907] (udev-worker)[12550]: Network interface NamePolicy= disabled on kernel command line. machine # [ 602.998829] dhcpcd[686]: veth15ac05eb: IAID cb:a6:df:10 machine # [ 602.999612] dhcpcd[686]: veth15ac05eb: adding address fe80::d447:cbff:fea6:df10 machine # [ 603.045561] systemd[1]: Started libcontainer container 5d451839a44fab0879926b7f1eab2083aea5f2423e1faf81c27dd3dcb29126bc. machine # [ 603.216423] systemd[1]: Started libcontainer container d31dd5719fa97f2442735fd69407c8b987bbbda8e71ecaf8ae38758b9eb0c2d0. machine # [ 603.992334] dhcpcd[686]: veth15ac05eb: soliciting a DHCP lease machine # [ 604.772982] dhcpcd[686]: veth15ac05eb: soliciting an IPv6 router machine # [ 605.507772] systemd[1]: cri-containerd-d31dd5719fa97f2442735fd69407c8b987bbbda8e71ecaf8ae38758b9eb0c2d0.scope: Deactivated successfully. machine # [ 605.510480] systemd[1]: cri-containerd-d31dd5719fa97f2442735fd69407c8b987bbbda8e71ecaf8ae38758b9eb0c2d0.scope: Consumed 1.065s CPU time over 2.290s wall clock time, 472.1M memory peak, 191.2M read from disk, 84.5M written to disk. machine # [ 605.570788] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-d31dd5719fa97f2442735fd69407c8b987bbbda8e71ecaf8ae38758b9eb0c2d0-rootfs.mount: Deactivated successfully. machine # [ 606.453195] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped4068229868.mount: Deactivated successfully. machine # [ 606.573189] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount1917565206.mount: Deactivated successfully. machine: (finished: must succeed: sleep 5.0, in 5.03 seconds) machine # [ 606.649589] systemd[1]: tmp-ovl\x2didmapped2669562959.mount: Deactivated successfully. machine # [ 606.682849] systemd[1]: Started libcontainer container 85ec2a55e39c60f30b186977876671815274b291e8fc039c385079cd65c01bd1. machine # [ 606.855348] k3s[894]: E0925 16:41:48.441274 894 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56204: use of closed network connection machine # command terminated with exit code 1 machine # [ 606.910760] systemd[1]: Started libcontainer container c11d2b181b8b16125ba4b5a618a2eedca5e6779b1b34b229ac13e70b2da329bd. machine: waiting for success: ! systemctl is-active slow machine # [ 607.186568] systemd[1]: Started libcontainer container 021ee8c3bd5a877fc5fa1b833193a07dd30984ed9f4490111d990d5521079f43. machine # [ 607.330382] k3s[894]: I0925 16:41:48.916516 894 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-bjm7w" podStartSLOduration=2.657583926 podStartE2EDuration="4.916488898s" totalImagesPullingTime="0s" totalInitContainerRuntime="2.258904972s" isStatefulPod=false podCreationTimestamp="2026-09-25 16:41:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-25 16:41:48.914799298 +0000 UTC m=+589.045049793" watchObservedRunningTime="2026-09-25 16:41:48.916488898 +0000 UTC m=+589.046738834" machine # [ 608.993530] dhcpcd[686]: veth15ac05eb: probing for an IPv4LL address machine # [ 610.423486] postgres[758]: [758] LOG: checkpoint starting: time machine # [ 612.860765] postgres[758]: [758] LOG: checkpoint complete: wrote 24 buffers (0.1%), wrote 1 SLRU buffers; 0 WAL file(s) added, 0 removed, 0 recycled; write=2.414 s, sync=0.009 s, total=2.438 s; sync files=21, longest=0.004 s, average=0.001 s; distance=234 kB, estimate=4504 kB; lsn=0/1C7D8B0, redo lsn=0/1C7D858 machine # [ 614.221287] dhcpcd[686]: veth15ac05eb: using IPv4LL address 169.254.91.235 machine # [ 614.224249] dhcpcd[686]: veth15ac05eb: adding route to 169.254.0.0/16 machine # [ 616.777828] dhcpcd[686]: veth15ac05eb: no IPv6 Routers available machine # [ 620.407261] niks3-server[1193]: 2026/09/25 16:42:01 INFO Received push request method=POST path=/api/pushes machine # [ 620.421369] niks3-server[1193]: 2026/09/25 16:42:02 INFO Received sign narinfos request method=POST path=/api/pushes/30/sign machine # [ 620.423747] niks3-server[1193]: 2026/09/25 16:42:02 INFO Signed narinfos id=30 count=1 machine # [ 620.427613] niks3-server[1193]: 2026/09/25 16:42:02 INFO Registered completed upload object_key=log/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 620.435533] niks3-server[1193]: 2026/09/25 16:42:02 INFO Received complete push request method=POST path=/api/pushes/30/complete machine # [ 620.440671] niks3-server[1193]: 2026/09/25 16:42:02 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.ls machine # [ 620.445191] niks3-server[1193]: 2026/09/25 16:42:02 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo machine # [ 621.113381] k3s[894]: I0925 16:42:02.698959 894 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 621.515641] systemd[1]: slow.service: Deactivated successfully. machine # [ 621.518622] systemd[1]: slow.service: Consumed 192ms CPU time over 46.315s wall clock time, 38.3M memory peak, 4K written to disk, 5.4K incoming IP traffic, 11.7K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active slow, in 14.64 seconds) machine: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; }, in 0.04 seconds) machine: must fail: journalctl -u slow | grep -q 'asking the scheduler again' machine: (finished: must fail: journalctl -u slow | grep -q 'asking the scheduler again', in 0.03 seconds) machine: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath machine # [ 621.903769] systemd[1]: cri-containerd-c01ee45599675772863cc1ed0c57567e53ae55ba1f28611c9560b905341beb44.scope: Deactivated successfully. machine # [ 621.905447] systemd[1]: cri-containerd-c01ee45599675772863cc1ed0c57567e53ae55ba1f28611c9560b905341beb44.scope: Consumed 3.582s CPU time over 9min 16.607s wall clock time, 58.1M memory peak, 19.6M read from disk, 8K written to disk, 275.7K incoming IP traffic, 342.6K outgoing IP traffic. machine # [ 621.960990] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-c01ee45599675772863cc1ed0c57567e53ae55ba1f28611c9560b905341beb44-rootfs.mount: Deactivated successfully. machine: (finished: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath, in 0.18 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null, in 0.03 seconds) (finished: subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes, in 46.84 seconds) (finished: run the VM test script, in 622.88 seconds) test script finished in 622.91s cleanup kill QemuMachine (pid 45) machine # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) machine # [2026-09-25T16:42:03Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-09-25T16:42:03Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-09-25T16:42:03Z INFO virtiofsd] Client disconnected, shutting down (finished: cleanup, in 1.24 seconds) additionally exposed symbols: machine, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh