tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 1200.0 seconds run the VM test script machine: waiting for unit k3s.service machine: waiting for the VM to finish booting machine: starting vm machine: QEMU running (pid 45) machine # Disk image does not exist, creating the virtualisation disk image... machine # Formatting '/build/vm-state-machine/tmp.tr54kK27MD', fmt=raw size=17179869184 machine # mke2fs 1.47.4 (6-Mar-2025) machine # Discarding device blocks: 0/4194304 done machine # Creating filesystem with 4194304 4k blocks and 1048576 inodes machine # Filesystem UUID: ea501fab-bd13-4fe7-95c7-71f29886a325 machine # Superblock backups stored on blocks: machine # 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208, machine # 4096000 machine # machine # Allocating group tables: 0/128 done machine # Writing inode tables: 0/128 done machine # Creating journal (32768 blocks): done machine # Writing superblocks and filesystem accounting information: 0/128 done machine # machine # Virtualisation disk image created. machine # Starting virtiofs daemons... machine # [2026-09-25T15:12:54Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-25T15:12:54Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-25T15:12:54Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-25T15:12:54Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-25T15:12:54Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-25T15:12:54Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-25T15:12:54Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-25T15:12:54Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-25T15:12:54Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-25T15:12:54Z INFO virtiofsd] Client connected, servicing requests machine # [2026-09-25T15:12:54Z INFO virtiofsd] Client connected, servicing requests machine # [2026-09-25T15:12:54Z INFO virtiofsd] Client connected, servicing requests machine # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) machine # machine # machine # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+7EFCC730+7EF2C730 CA00 machine # Press Ctrl-B to configure iPXE (PCI 00:02.0)... machine # machine # machine # machine # machine # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 7EFCC730 7EF2C730 CB00 machine # Press Ctrl-B to configure iPXE (PCI 00:05.0)... machine # machine # machine # Booting from ROM... machine # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 machine # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/9yadj56z0z3lm4yw0alvgw6cvkmy5i18-nixos-system-machine-test/init regInfo=/nix/store/84l28r3gxxain61dvb3k3ql82jkr8829-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.000000] BIOS-provided physical RAM map: machine # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007ffd7fff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000007ffd8000-0x000000007fffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000017fffffff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved machine # [ 0.000000] NX (Execute Disable) protection: active machine # [ 0.000000] APIC: Static calls initialized machine # [ 0.000000] SMBIOS 2.8 present. machine # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 machine # [ 0.000000] DMI: Memory slots populated: 1/1 machine # [ 0.000000] Hypervisor detected: KVM machine # [ 0.000000] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 machine # [ 0.000000] kvm-clock: using sched offset of 472468759 cycles machine # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns machine # [ 0.000005] tsc: Detected 2400.012 MHz processor machine # [ 0.000805] last_pfn = 0x180000 max_arch_pfn = 0x10000000000 machine # [ 0.000832] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs machine # [ 0.000834] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT machine # [ 0.000879] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.002721] found SMP MP-table at [mem 0x000f5450-0x000f545f] machine # [ 0.002732] Using GB pages for direct mapping machine # [ 0.002825] RAMDISK: [mem 0x7e371000-0x7ffcffff] machine # [ 0.002834] ACPI: Early table checksum verification disabled machine # [ 0.002836] ACPI: RSDP 0x00000000000F5250 000014 (v00 BOCHS ) machine # [ 0.002839] ACPI: RSDT 0x000000007FFE2539 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002844] ACPI: FACP 0x000000007FFE2319 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002850] ACPI: DSDT 0x000000007FFE0040 0022D9 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002852] ACPI: FACS 0x000000007FFE0000 000040 machine # [ 0.002854] ACPI: APIC 0x000000007FFE240D 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002863] ACPI: HPET 0x000000007FFE249D 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002865] ACPI: MCFG 0x000000007FFE24D5 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002866] ACPI: WAET 0x000000007FFE2511 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002867] ACPI: Reserving FACP table memory at [mem 0x7ffe2319-0x7ffe240c] machine # [ 0.002868] ACPI: Reserving DSDT table memory at [mem 0x7ffe0040-0x7ffe2318] machine # [ 0.002869] ACPI: Reserving FACS table memory at [mem 0x7ffe0000-0x7ffe003f] machine # [ 0.002869] ACPI: Reserving APIC table memory at [mem 0x7ffe240d-0x7ffe249c] machine # [ 0.002870] ACPI: Reserving HPET table memory at [mem 0x7ffe249d-0x7ffe24d4] machine # [ 0.002870] ACPI: Reserving MCFG table memory at [mem 0x7ffe24d5-0x7ffe2510] machine # [ 0.002871] ACPI: Reserving WAET table memory at [mem 0x7ffe2511-0x7ffe2538] machine # [ 0.003100] No NUMA configuration found machine # [ 0.003101] Faking a node at [mem 0x0000000000000000-0x000000017fffffff] machine # [ 0.003103] NODE_DATA(0) allocated [mem 0x17fffa780-0x17ffffcff] machine # [ 0.005210] Zone ranges: machine # [ 0.005211] DMA [mem 0x0000000000001000-0x0000000000ffffff] machine # [ 0.005212] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] machine # [ 0.005213] Normal [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005214] Device empty machine # [ 0.005215] Movable zone start for each node machine # [ 0.005216] Early memory node ranges machine # [ 0.005216] node 0: [mem 0x0000000000001000-0x000000000009efff] machine # [ 0.005217] node 0: [mem 0x0000000000100000-0x000000007ffd7fff] machine # [ 0.005218] node 0: [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005219] Initmem setup node 0 [mem 0x0000000000001000-0x000000017fffffff] machine # [ 0.005240] On node 0, zone DMA: 1 pages in unavailable ranges machine # [ 0.005487] On node 0, zone DMA: 97 pages in unavailable ranges machine # [ 0.072223] On node 0, zone Normal: 40 pages in unavailable ranges machine # [ 0.072694] ACPI: PM-Timer IO Port: 0x608 machine # [ 0.072708] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) machine # [ 0.072738] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 machine # [ 0.072741] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) machine # [ 0.072743] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) machine # [ 0.072744] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) machine # [ 0.072745] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) machine # [ 0.072746] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) machine # [ 0.072748] ACPI: Using ACPI (MADT) for SMP configuration information machine # [ 0.072749] ACPI: HPET id: 0x8086a201 base: 0xfed00000 machine # [ 0.072754] TSC deadline timer available machine # [ 0.072758] CPU topo: Max. logical packages: 1 machine # [ 0.072758] CPU topo: Max. logical dies: 1 machine # [ 0.072759] CPU topo: Max. dies per package: 1 machine # [ 0.072762] CPU topo: Max. threads per core: 1 machine # [ 0.072763] CPU topo: Num. cores per package: 4 machine # [ 0.072763] CPU topo: Num. threads per package: 4 machine # [ 0.072763] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs machine # [ 0.072785] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() machine # [ 0.072799] kvm-guest: KVM setup pv remote TLB flush machine # [ 0.072802] kvm-guest: setup PV sched yield machine # [ 0.072812] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] machine # [ 0.072813] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] machine # [ 0.072814] PM: hibernation: Registered nosave memory: [mem 0x7ffd8000-0xffffffff] machine # [ 0.072815] [mem 0xc0000000-0xfed1bfff] available for PCI devices machine # [ 0.072817] Booting paravirtualized kernel on KVM machine # [ 0.072820] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns machine # [ 0.077325] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 machine # [ 0.079369] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288 machine # [ 0.079416] kvm-guest: PV spinlocks enabled machine # [ 0.079417] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) machine # [ 0.079420] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/9yadj56z0z3lm4yw0alvgw6cvkmy5i18-nixos-system-machine-test/init regInfo=/nix/store/84l28r3gxxain61dvb3k3ql82jkr8829-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.079513] Unknown kernel command line parameters "regInfo=/nix/store/84l28r3gxxain61dvb3k3ql82jkr8829-closure-info/registration", will be passed to user space. machine # [ 0.079525] random: crng init done machine # [ 0.079526] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes machine # [ 0.083673] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) machine # [ 0.085693] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) machine # [ 0.085761] software IO TLB: area num 4. machine # [ 0.154184] Fallback order for Node 0: 0 machine # [ 0.154191] Built 1 zonelists, mobility grouping on. Total pages: 1048438 machine # [ 0.154193] Policy zone: Normal machine # [ 0.156681] mem auto-init: stack:all(zero), heap alloc:on, heap free:off machine # [ 0.163145] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 machine # [ 0.171566] allocated 8388608 bytes of page_ext machine # [ 0.181171] ftrace: allocating 48787 entries in 192 pages machine # [ 0.181174] ftrace: allocated 192 pages with 2 groups machine # [ 0.182002] Dynamic Preempt: lazy machine # [ 0.182159] rcu: Preemptible hierarchical RCU implementation. machine # [ 0.182160] rcu: RCU event tracing is enabled. machine # [ 0.182161] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. machine # [ 0.182162] Trampoline variant of Tasks RCU enabled. machine # [ 0.182162] Rude variant of Tasks RCU enabled. machine # [ 0.182163] Tracing variant of Tasks RCU enabled. machine # [ 0.182163] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. machine # [ 0.182164] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 machine # [ 0.182189] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.182191] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.182192] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.186505] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16 machine # [ 0.186794] rcu: srcu_init: Setting srcu_struct sizes based on contention. machine # [ 0.186801] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns machine # [ 0.186917] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) machine # [ 0.190454] Console: colour VGA+ 80x25 machine # [ 0.190457] printk: legacy console [tty0] enabled machine # [ 0.222046] printk: legacy console [ttyS0] enabled machine # [ 0.334153] ACPI: Core revision 20250807 machine # [ 0.335101] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns machine # [ 0.336710] APIC: Switch to symmetric I/O mode setup machine # [ 0.337772] x2apic enabled machine # [ 0.338521] APIC: Switched APIC routing to: physical x2apic machine # [ 0.339494] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask() machine # [ 0.340736] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself() machine # [ 0.342316] kvm-guest: setup PV IPIs machine # [ 0.343923] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 machine # [ 0.344990] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.349311] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) machine # [ 0.351390] x86/cpu: User Mode Instruction Prevention (UMIP) activated machine # [ 0.352406] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 machine # [ 0.353308] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 machine # [ 0.354312] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto machine # [ 0.355309] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl machine # [ 0.356308] Transient Scheduler Attacks: Vulnerable: No microcode machine # [ 0.358110] Spectre V2 : Mitigation: Enhanced / Automatic IBRS machine # [ 0.359071] Speculative Return Stack Overflow: Mitigation: Safe RET machine # [ 0.360127] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization machine # [ 0.361315] Spectre V2 : Enabling IBPB for BPF machine # [ 0.362111] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier machine # [ 0.363309] active return thunk: srso_alias_return_thunk machine # [ 0.364330] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' machine # [ 0.366308] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' machine # [ 0.367307] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' machine # [ 0.368308] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' machine # [ 0.369308] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' machine # [ 0.370308] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' machine # [ 0.371308] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' machine # [ 0.372309] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 machine # [ 0.373307] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 machine # [ 0.374308] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 machine # [ 0.375308] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 machine # [ 0.376308] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 machine # [ 0.377308] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. machine # [ 0.406277] Freeing SMP alternatives memory: 44K machine # [ 0.406910] pid_max: default: 32768 minimum: 301 machine # [ 0.407999] LSM: initializing lsm=capability,landlock,yama,bpf,ima machine # [ 0.409372] landlock: Up and running. machine # [ 0.410033] Yama: becoming mindful. machine # [ 0.410522] LSM support for eBPF active machine # [ 0.411465] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.412378] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.415709] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) machine # [ 0.416871] Performance Events: Fam17h+ core perfctr, AMD PMU driver. machine # [ 0.417317] ... version: 2 machine # [ 0.418098] ... bit width: 48 machine # [ 0.418311] ... generic counters: 6 machine # [ 0.419076] ... generic bitmap: 000000000000003f machine # [ 0.419311] ... fixed-purpose counters: 0 machine # [ 0.420062] ... fixed-purpose bitmap: 0000000000000000 machine # [ 0.420310] ... value mask: 0000ffffffffffff machine # [ 0.421310] ... max period: 00007fffffffffff machine # [ 0.422274] ... global_ctrl mask: 000000000000003f machine # [ 0.423169] signal: max sigframe size: 3376 machine # [ 0.423935] rcu: Hierarchical SRCU implementation. machine # [ 0.424314] rcu: Max phase no-delay instances is 400. machine # [ 0.425402] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level machine # [ 0.430733] smp: Bringing up secondary CPUs ... machine # [ 0.431690] smpboot: x86: Booting SMP configuration: machine # [ 0.432321] .... node #0, CPUs: #1 #2 #3 machine # [ 0.435457] smp: Brought up 1 node, 4 CPUs machine # [ 0.437066] smpboot: Total of 4 processors activated (19200.09 BogoMIPS) machine # [ 0.437647] Memory: 3957684K/4193752K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 220848K reserved, 0K cma-reserved) machine # [ 0.439312] devtmpfs: initialized machine # [ 0.440424] x86/mm: Memory block size: 128MB machine # [ 0.443383] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.444382] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). machine # [ 0.445404] pinctrl core: initialized pinctrl subsystem machine # [ 0.446603] PM: RTC time: 15:12:54, date: 2026-09-25 machine # [ 0.450292] NET: Registered PF_NETLINK/PF_ROUTE protocol family machine # [ 0.451889] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations machine # [ 0.452339] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations machine # [ 0.453831] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations machine # [ 0.454322] audit: initializing netlink subsys (disabled) machine # [ 0.455338] audit: type=2000 audit(1790349175.481:1): state=initialized audit_enabled=0 res=1 machine # [ 0.455588] thermal_sys: Registered thermal governor 'fair_share' machine # [ 0.457311] thermal_sys: Registered thermal governor 'bang_bang' machine # [ 0.458311] thermal_sys: Registered thermal governor 'step_wise' machine # [ 0.459311] thermal_sys: Registered thermal governor 'user_space' machine # [ 0.460310] thermal_sys: Registered thermal governor 'power_allocator' machine # [ 0.461326] cpuidle: using governor menu machine # [ 0.463526] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 machine # [ 0.464567] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] machine # [ 0.465314] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry machine # [ 0.466325] PCI: Using configuration type 1 for base access machine # [ 0.467449] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. machine # [ 0.470338] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages machine # [ 0.471311] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page machine # [ 0.472311] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages machine # [ 0.473311] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page machine # [ 0.478750] ACPI: Added _OSI(Module Device) machine # [ 0.481321] ACPI: Added _OSI(Processor Device) machine # [ 0.482316] ACPI: Added _OSI(Processor Aggregator Device) machine # [ 0.492108] ACPI: 1 ACPI AML tables successfully acquired and loaded machine # [ 0.499401] ACPI: Interpreter enabled machine # [ 0.500198] ACPI: PM: (supports S0 S3 S4 S5) machine # [ 0.500903] ACPI: Using IOAPIC for interrupt routing machine # [ 0.501927] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug machine # [ 0.505320] PCI: Using E820 reservations for host bridge windows machine # [ 0.509062] ACPI: Enabled 2 GPEs in block 00 to 3F machine # [ 0.521339] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) machine # [ 0.524369] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] machine # [ 0.528677] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] machine # [ 0.531644] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] machine # [ 0.535461] PCI host bridge to bus 0000:00 machine # [ 0.537339] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] machine # [ 0.539316] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] machine # [ 0.541315] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] machine # [ 0.544314] pci_bus 0000:00: root bus resource [mem 0x80000000-0xafffffff window] machine # [ 0.546314] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] machine # [ 0.549315] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.551336] pci_bus 0000:00: root bus resource [bus 00-ff] machine # [ 0.553709] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint machine # [ 0.556789] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint machine # [ 0.568402] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] machine # [ 0.570346] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] machine # [ 0.571333] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] machine # [ 0.572488] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] machine # [ 0.576037] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.588358] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] machine # [ 0.590334] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] machine # [ 0.593374] pci 0000:00:02.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref] machine # [ 0.596368] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] machine # [ 0.601004] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.611357] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] machine # [ 0.613334] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] machine # [ 0.615372] pci 0000:00:03.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref] machine # [ 0.620762] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint machine # [ 0.628360] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] machine # [ 0.630329] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] machine # [ 0.632357] pci 0000:00:04.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref] machine # [ 0.636813] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.642354] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] machine # [ 0.643321] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] machine # [ 0.644334] pci 0000:00:05.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref] machine # [ 0.645317] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] machine # [ 0.648386] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint machine # [ 0.651357] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] machine # [ 0.652332] pci 0000:00:06.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref] machine # [ 0.653891] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.658346] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] machine # [ 0.660108] pci 0000:00:07.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref] machine # [ 0.661846] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.664357] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] machine # [ 0.677144] pci 0000:00:08.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref] machine # [ 0.678889] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.684357] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] machine # [ 0.685333] pci 0000:00:09.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref] machine # [ 0.686903] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint machine # [ 0.691358] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] machine # [ 0.692288] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] machine # [ 0.694334] pci 0000:00:0a.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref] machine # [ 0.695886] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.699312] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] machine # [ 0.700262] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] machine # [ 0.701138] pci 0000:00:0b.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref] machine # [ 0.702934] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.706448] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] machine # [ 0.709726] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.716418] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] machine # [ 0.718805] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.725757] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] machine # [ 0.728896] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint machine # [ 0.734238] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] machine # [ 0.736935] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint machine # [ 0.741064] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO machine # [ 0.744916] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint machine # [ 0.752408] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] machine # [ 0.754333] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] machine # [ 0.758182] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint machine # [ 0.762404] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] machine # [ 0.770602] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 machine # [ 0.773714] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 machine # [ 0.775616] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 machine # [ 0.777525] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 machine # [ 0.780509] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 machine # [ 0.782512] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 machine # [ 0.784549] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 machine # [ 0.786522] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 machine # [ 0.788393] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 machine # [ 0.790349] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 machine # [ 0.792345] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 machine # [ 0.794340] ACPI: PCI: Interrupt link GSID configured for IRQ 19 machine # [ 0.796341] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 machine # [ 0.798345] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 machine # [ 0.800340] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 machine # [ 0.802339] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 machine # [ 0.807668] iommu: Default domain type: Translated machine # [ 0.809316] iommu: DMA domain TLB invalidation policy: lazy mode machine # [ 0.811756] ACPI: bus type USB registered machine # [ 0.813452] usbcore: registered new interface driver usbfs machine # [ 0.815380] usbcore: registered new interface driver hub machine # [ 0.816372] usbcore: registered new device driver usb machine # [ 0.820660] NetLabel: Initializing machine # [ 0.822317] NetLabel: domain hash size = 128 machine # [ 0.824316] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO machine # [ 0.826418] NetLabel: unlabeled traffic allowed by default machine # [ 0.828346] PCI: Using ACPI for IRQ routing machine # [ 0.897641] pci 0000:00:01.0: vgaarb: setting as boot VGA device machine # [ 0.898307] pci 0000:00:01.0: vgaarb: bridge control possible machine # [ 0.898307] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none machine # [ 0.901318] vgaarb: loaded machine # [ 0.902096] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 machine # [ 0.903311] hpet0: 3 comparators, 64-bit 100.000000 MHz counter machine # [ 0.907528] clocksource: Switched to clocksource kvm-clock machine # [ 0.912779] VFS: Disk quotas dquot_6.6.0 machine # [ 0.913566] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) machine # [ 0.915209] pnp: PnP ACPI init machine # [ 0.916089] ACPI: IRQ 4 override to edge(!), high(!) machine # [ 0.917109] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved machine # [ 0.918793] pnp: PnP ACPI: found 5 devices machine # [ 0.928725] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns machine # [ 0.930341] clocksource: Switched to clocksource acpi_pm machine # [ 0.931370] NET: Registered PF_INET protocol family machine # [ 0.932858] IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear) machine # [ 0.949636] tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.951244] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) machine # [ 0.952652] TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear) machine # [ 0.955130] TCP bind hash table entries: 32768 (order: 8, 1048576 bytes, linear) machine # [ 0.956491] TCP: Hash tables configured (established 32768 bind 32768) machine # [ 0.957713] MPTCP token hash table entries: 4096 (order: 5, 98304 bytes, linear) machine # [ 0.959053] UDP hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.960239] UDP-Lite hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.961639] NET: Registered PF_UNIX/PF_LOCAL protocol family machine # [ 0.962698] NET: Registered PF_XDP protocol family machine # [ 0.963612] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] machine # [ 0.964688] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] machine # [ 0.965763] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] machine # [ 0.966965] pci_bus 0000:00: resource 7 [mem 0x80000000-0xafffffff window] machine # [ 0.968137] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] machine # [ 0.969283] pci_bus 0000:00: resource 9 [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.971267] ACPI: \_SB_.GSIA: Enabled at IRQ 16 machine # [ 0.973480] ACPI: \_SB_.GSIB: Enabled at IRQ 17 machine # [ 0.975578] ACPI: \_SB_.GSIC: Enabled at IRQ 18 machine # [ 0.977604] ACPI: \_SB_.GSID: Enabled at IRQ 19 machine # [ 0.979361] PCI: CLS 0 bytes, default 64 machine # [ 0.980206] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) machine # [ 0.980808] Trying to unpack rootfs image as initramfs... machine # [ 0.981289] software IO TLB: mapped [mem 0x000000007a371000-0x000000007e371000] (64MB) machine # [ 0.984151] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 1.004874] Initialise system trusted keyrings machine # [ 1.006173] workingset: timestamp_bits=40 max_order=20 bucket_order=0 machine # [ 1.017804] Key type asymmetric registered machine # [ 1.018608] Asymmetric key parser 'x509' registered machine # [ 1.019557] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) machine # [ 1.021228] io scheduler mq-deadline registered machine # [ 1.022051] io scheduler kyber registered machine # [ 1.027102] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled machine # [ 1.028476] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A machine # [ 1.031100] Linux agpgart interface v0.103 machine # [ 1.031940] ACPI: bus type drm_connector registered machine # [ 1.034988] usbcore: registered new interface driver usbserial_generic machine # [ 1.036169] usbserial: USB Serial support registered for generic machine # [ 1.037217] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. machine # [ 1.037217] Please enable it if your BIOS has the CPPC option. machine # [ 1.039604] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled machine # [ 1.041076] drop_monitor: Initializing network drop monitor service machine # [ 1.042281] NET: Registered PF_INET6 protocol family machine # [ 1.044078] Segment Routing with IPv6 machine # [ 1.044853] In-situ OAM (IOAM) with IPv6 machine # [ 1.046898] IPI shorthand broadcast: enabled machine # [ 1.051345] sched_clock: Marking stable (897011730, 153506178)->(1075905341, -25387433) machine # [ 1.053279] registered taskstats version 1 machine # [ 1.054391] Loading compiled-in X.509 certificates machine # [ 1.065190] Demotion targets for Node 0: null machine # [ 1.066428] Key type .fscrypt registered machine # [ 1.067151] Key type fscrypt-provisioning registered machine # [ 1.068140] ima: No TPM chip found, activating TPM-bypass! machine # [ 1.069101] ima: Allocated hash algorithm: sha1 machine # [ 1.069964] ima: No architecture policies found machine # [ 1.071084] PM: Magic number: 10:656:235 machine # [ 1.072750] RAS: Correctable Errors collector initialized. machine # [ 1.077282] clk: Disabling unused clocks machine # [ 1.078042] PM: genpd: Disabling unused power domains machine # [ 1.269973] Freeing initrd memory: 29052K machine # [ 1.277445] Freeing unused decrypted memory: 2028K machine # [ 1.283980] Freeing unused kernel image (initmem) memory: 3652K machine # [ 1.286802] Write protecting the kernel read-only data: 32768k machine # [ 1.291809] Freeing unused kernel image (text/rodata gap) memory: 1184K machine # [ 1.295771] Freeing unused kernel image (rodata/data gap) memory: 720K machine # [ 1.366075] x86/mm: Checked W+X mappings: passed, no W+X pages found. machine # [ 1.367544] Run /init as init process machine # [ 1.382009] systemd[1]: Inserted module 'autofs4' machine # [ 1.408988] fuse: init (API version 7.45) machine # [ 1.418703] ACPI: \_SB_.GSIG: Enabled at IRQ 22 machine # [ 1.422496] ACPI: \_SB_.GSIH: Enabled at IRQ 23 machine # [ 1.426782] ACPI: \_SB_.GSIE: Enabled at IRQ 20 machine # [ 1.429790] ACPI: \_SB_.GSIF: Enabled at IRQ 21 machine # [ 1.436069] virtiofs virtio5: discovered new tag: nix-store machine # [ 1.437850] virtiofs virtio5: virtio_fs_setup_dax: No cache capability machine # [ 1.446362] virtiofs virtio6: discovered new tag: shared machine # [ 1.460448] virtiofs virtio6: virtio_fs_setup_dax: No cache capability machine # [ 1.464851] virtiofs virtio7: discovered new tag: xchg machine # [ 1.466561] virtiofs virtio7: virtio_fs_setup_dax: No cache capability machine # [ 1.495710] systemd[1]: Successfully made /usr/ read-only. machine # [ 1.832790] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 1.847064] systemd[1]: Detected virtualization kvm. machine # [ 1.849703] systemd[1]: Detected architecture x86-64. machine # [ 1.852187] systemd[1]: Running in initrd. machine # [ 1.855051] systemd[1]: Initializing machine ID from random generator. machine # [ 1.858713] systemd[1]: Hostname set to . machine # [ 1.979234] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 2.017175] systemd[1]: Queued start job for default target Initrd Default Target. machine # [ 2.028260] systemd[1]: Created slice Slice /system/modprobe. machine # [ 2.029642] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 2.031226] systemd[1]: Expecting device /dev/disk/by-label/nixos... machine # [ 2.032569] systemd[1]: Reached target Path Units. machine # [ 2.033617] systemd[1]: Reached target Slice Units. machine # [ 2.034643] systemd[1]: Reached target Swaps. machine # [ 2.035585] systemd[1]: Reached target Timer Units. machine # [ 2.036711] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 2.038121] systemd[1]: Listening on Journal Socket (/dev/log). machine # [ 2.039470] systemd[1]: Listening on Journal Sockets. machine # [ 2.040678] systemd[1]: Listening on udev Control Socket. machine # [ 2.041858] systemd[1]: Listening on udev Kernel Socket. machine # [ 2.042972] systemd[1]: Reached target Socket Units. machine # [ 2.045155] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 2.047424] systemd[1]: Starting Load Kernel Module configfs... machine # [ 2.050788] systemd[1]: Starting Journal Service... machine # [ 2.052775] systemd[1]: Starting Load Kernel Modules... machine # [ 2.055606] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 2.062757] systemd[1]: Starting Coldplug All udev Devices... machine # [ 2.075911] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 2.081315] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. machine # [ 2.081602] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 2.081975] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev machine # [ 2.084308] systemd[1]: Finished Load Kernel Module configfs. machine # [ 2.095303] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config machine # [ 2.101250] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 2.106654] systemd-journald[90]: Collecting audit messages is disabled. machine # [ 2.107072] systemd[1]: Finished Load Kernel Modules. machine # [ 2.112711] systemd[1]: Starting Apply Kernel Variables... machine # [ 2.128918] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 2.131564] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 2.135172] systemd[1]: Finished Apply Kernel Variables. machine # [ 2.145565] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 2.146979] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 1.994259] systemd-modules-l[ 2.148322] systemd[1]: Reached target Local File Systems. machine # oad[91]: Using 4 probe threads machine # [ 1.996667] systemd-modules-load[91]: Inserted module 'virtio_balloon' machine # [ 1.997749] systemd-modules-l[ 2.151223] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # oad[91]: Inserted module 'dm_mod' machine # [ 2.152636] systemd[1]: Started Journal Service. machine # [ 1.999603] systemd-modules-load[91]: Inserted module 'virtio_gpu' machine # [ 2.024402] systemd[1]: Starting Create System Files and Directories... machine # [ 2.038333] systemd[1]: Finished Coldplug All udev Devices. machine # [ 2.040613] systemd-udevd[102]: Using default interface naming scheme 'v261'. machine # [ 2.043081] systemd[1]: Finished Create System Files and Directories. machine # [ 2.052718] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 2.054197] systemd[1]: Reached target System Initialization. machine # [ 2.055202] systemd[1]: Reached target Basic System. machine # [ 2.313300] virtio_blk virtio2: 4/0/0 default/read/poll queues machine # [ 2.317024] uhci_hcd 0000:00:1d.0: UHCI Host Controller machine # [ 2.317546] virtio_blk virtio2: [vda] 33554432 512-byte logical blocks (17.2 GB/16.0 GiB) machine # [ 2.318817] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 1 machine # [ 2.322585] uhci_hcd 0000:00:1d.0: detected 2 ports machine # [ 2.333140] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 machine # [ 2.334453] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.335889] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.337129] usb usb1: Product: UHCI Host Controller machine # [ 2.337896] usb usb1: Manufacturer: Linux 6.18.52 uhci_hcd machine # [ 2.338745] usb usb1: SerialNumber: 0000:00:1d.0 machine # [ 2.345980] SCSI subsystem initialized machine # [ 2.347662] hub 1-0:1.0: USB hub found machine # [ 2.348311] hub 1-0:1.0: 2 ports detected machine # [ 2.230641] systemd[1]: Starting Virtual Console Setup... machine # [ 2.391836] ehci-pci 0000:00:1d.7: EHCI Host Controller machine # [ 2.239081] systemd[1]: Found device /dev/disk/by-label/nixos[ 2.392886] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 2 machine # . machine # [ 2.240851] systemd[1]: Reached target Initrd Root Device. machine # [ 2.394796] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 machine # [ 2.243547] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... machine # [ 2.403221] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 machine # [ 2.404200] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 machine # [ 2.405406] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.406570] usb usb2: Product: EHCI Host Controller machine # [ 2.407248] usb usb2: Manufacturer: Linux 6.18.52 ehci_hcd machine # [ 2.407250] usb usb2: SerialNumber: 0000:00:1d.7 machine # [ 2.407407] hub 2-0:1.0: USB hub found machine # [ 2.409453] hub 2-0:1.0: 6 ports detected machine # [ 2.256186] systemd-vconsole-setup[141]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 2.259422] systemd[1]: Finished Virtual Console Setup. machine # [ 2.265231] systemd-fsck[146]: nixos: clean, 12/1048576 files, 109865/4194304 blocks machine # [ 2.268651] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. machine # [ 2.430656] hub 1-0:1.0: USB hub found machine # [ 2.431328] hub 1-0:1.0: 2 ports detected machine # [ 2.432323] uhci_hcd 0000:00:1d.1: UHCI Host Controller machine # [ 2.433230] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 machine # [ 2.434837] uhci_hcd 0000:00:1d.1: detected 2 ports machine # [ 2.435918] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 machine # [ 2.437049] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.438349] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.439905] usb usb3: Product: UHCI Host Controller machine # [ 2.440706] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd machine # [ 2.441596] usb usb3: SerialNumber: 0000:00:1d.1 machine # [ 2.444784] hub 3-0:1.0: USB hub found machine # [ 2.446543] hub 3-0:1.0: 2 ports detected machine # [ 2.294329] (udev-worker)[123]: Network interface NamePolicy= disabled on kernel command line. machine # [ 2.295977] (udev-worker)[124]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 2.450308] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 machine # [ 2.299797] (udev-worker)[124]: Network interface NamePolicy= disabled on kernel command line. machine # [ 2.457249] uhci_hcd 0000:00:1d.2: UHCI Host Controller machine # [ 2.457688] serio: i8042 KBD port at 0x60,0x64 irq 1 machine # [ 2.457742] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 machine # [ 2.457931] serio: i8042 AUX port at 0x60,0x64 irq 12 machine # [ 2.458263] uhci_hcd 0000:00:1d.2: detected 2 ports machine # [ 2.461955] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 machine # [ 2.463043] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.464311] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.465466] usb usb4: Product: UHCI Host Controller machine # [ 2.466247] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd machine # [ 2.467084] usb usb4: SerialNumber: 0000:00:1d.2 machine # [ 2.468217] hub 4-0:1.0: USB hub found machine # [ 2.468976] hub 4-0:1.0: 2 ports detected machine # [ 2.474714] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 machine # [ 2.484766] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode machine # [ 2.485978] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) machine # [ 2.486981] ahci 0000:00:1f.2: flags: 64bit ncq only machine # [ 2.489699] scsi host0: ahci machine # [ 2.490486] scsi host1: ahci machine # [ 2.491283] scsi host2: ahci machine # [ 2.492151] scsi host3: ahci machine # [ 2.493025] scsi host4: ahci machine # [ 2.493878] scsi host5: ahci machine # [ 2.494492] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 50 lpm-pol 1 machine # [ 2.495761] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 50 lpm-pol 1 machine # [ 2.496985] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 50 lpm-pol 1 machine # [ 2.498223] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 50 lpm-pol 1 machine # [ 2.499493] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 50 lpm-pol 1 machine # [ 2.500708] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 50 lpm-pol 1 machine # [ 2.643757] usb 2-1: new high-speed USB device number 2 using ehci-pci machine # [ 2.774943] usb 2-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 machine # [ 2.778030] usb 2-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 machine # [ 2.780749] usb 2-1: Product: QEMU USB Tablet machine # [ 2.782430] usb 2-1: Manufacturer: QEMU machine # [ 2.783979] usb 2-1: SerialNumber: 28754-0000:00:1d.7-1 machine # [ 2.817857] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) machine # [ 2.819169] ata1: SATA link down (SStatus 0 SControl 300) machine # [ 2.821630] ata2: SATA link down (SStatus 0 SControl 300) machine # [ 2.822576] hid: raw HID events driver (C) Jiri Kosina machine # [ 2.823943] ata6: SATA link down (SStatus 0 SControl 300) machine # [ 2.827747] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 machine # [ 2.828609] ata3.00: applying bridge limits machine # [ 2.829490] ata4: SATA link down (SStatus 0 SControl 300) machine # [ 2.831918] ata5: SATA link down (SStatus 0 SControl 300) machine # [ 2.833968] ata3.00: configured for UDMA/100 machine # [ 2.835560] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 machine # [ 2.864447] usbcore: registered new interface driver usbhid machine # [ 2.866578] usbhid: USB HID core driver machine # [ 2.877044] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb2/2-1/2-1:1.0/0003:0627:0001.0001/input/input2 machine # [ 2.881242] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 machine # [ 2.900949] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray machine # [ 2.929870] cdrom: Uniform CD-ROM driver Revision: 3.20 machine # [ 2.921973] systemd[1]: Mounting /sysroot... machine # [ 3.215067] EXT4-fs (vda): mounted filesystem ea501fab-bd13-4fe7-95c7-71f29886a325 r/w with ordered data mode. Quota mode: none. machine # [ 3.066617] systemd[1]: Mounted /sysroot. machine # [ 3.068906] systemd[1]: Reached target Initrd Root File System. machine # [ 3.073443] systemd[1]: Mounting /sysroot/nix/.ro-store... machine # [ 3.075403] systemd[1]: Mounting /sysroot/nix/.rw-store... machine # [ 3.078600] systemd[1]: Mounting /sysroot/run... machine # [ 3.093097] systemd[1]: Mounting /sysroot/tmp/shared... machine # [ 3.095276] systemd[1]: Mounting /sysroot/tmp/xchg... machine # [ 3.099220] systemd[1]: Starting Mountpoints Configured in the Real Root... machine # [ 3.106398] systemd[1]: Mounted /sysroot/nix/.rw-store. machine # [ 3.107500] systemd[1]: Mounted /sysroot/run. machine # [ 3.111077] systemd[1]: Mounted /sysroot/nix/.ro-store. machine # [ 3.111872] systemd[1]: Mounted /sysroot/tmp/xchg. machine # [ 3.115545] systemd-sysroot-fstab-check[193]: /sysroot should be mounted in the initrd, will request daemon-reload. machine # [ 3.117052] systemd[1]: Mounted /sysroot/tmp/shared. machine # [ 3.121710] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.122642] systemd[1]: Reload requested from client PID 193 ('systemd-sysroot') (unit initrd-parse-etc.service)... machine # [ 3.124174] systemd[1]: Reloading... machine # [ 3.181302] systemd[1]: Reloading finished in 58 ms. machine # [ 3.201605] systemd-sysroot-fstab-check[193]: Requesting initrd-fs.target/start/replace... machine # [ 3.204727] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.207445] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.209563] systemd-sysroot-fstab-check[193]: Requesting swap.target/start/replace... machine # [ 3.212492] systemd[1]: initrd-parse-etc.service: Deactivated successfully. machine # [ 3.214918] systemd[1]: Finished Mountpoints Configured in the Real Root. machine # [ 3.217368] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. machine # [ 3.219997] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.236150] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.238897] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.922989] systemd[1]: Mounting /sysroot/nix/store... machine # [ 3.976404] systemd[1]: Mounted /sysroot/nix/store. machine # [ 3.978525] systemd[1]: Reached target Initrd File Systems. machine # [ 3.980657] systemd[1]: Starting Find NixOS closure... machine # [ 3.982634] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... machine # [ 4.010354] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. machine # [ 4.013173] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. machine # [ 4.033855] systemd[1]: Finished Find NixOS closure. machine # [ 4.035855] systemd[1]: Reached target Initrd Default Target. machine # [ 4.037925] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... machine # [ 4.067172] systemd[1]: Stopped target Initrd Default Target. machine # [ 4.069348] systemd[1]: Stopped target Basic System. machine # [ 4.071276] systemd[1]: Stopped target Initrd Root Device. machine # [ 4.073304] systemd[1]: Stopped target Path Units. machine # [ 4.075183] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. machine # [ 4.079113] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. machine # [ 4.081779] systemd[1]: Stopped target Slice Units. machine # [ 4.085723] systemd[1]: Stopped target Socket Units. machine # [ 4.089280] systemd[1]: Stopped target System Initialization. machine # [ 4.092441] systemd[1]: Stopped target Swaps. machine # [ 4.094482] systemd[1]: Stopped target Timer Units. machine # [ 4.096394] systemd[1]: dbus.socket: Deactivated successfully. machine # [ 4.098566] systemd[1]: Closed D-Bus System Message Bus Socket. machine # [ 4.100804] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. machine # [ 4.103455] systemd[1]: Stopped Find NixOS closure. machine # [ 4.105436] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 4.107585] systemd[1]: systemd-sysctl.service: Deactivated successfully. machine # [ 4.109505] systemd[1]: Stopped Apply Kernel Variables. machine # [ 4.111062] systemd[1]: systemd-modules-load.service: Deactivated successfully. machine # [ 4.113048] systemd[1]: Stopped Load Kernel Modules. machine # [ 4.114530] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. machine # [ 4.116694] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. machine # [ 4.118929] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. machine # [ 4.121296] systemd[1]: Stopped Create System Files and Directories. machine # [ 4.123155] systemd[1]: Stopped target Local File Systems. machine # [ 4.124714] systemd[1]: Stopped target Preparation for Local File Systems. machine # [ 4.126703] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. machine # [ 4.128195] systemd[1]: Stopped Coldplug All udev Devices. machine # [ 4.129000] systemd[1]: Stopping Rule-based Manager for Device Events and Files... machine # [ 4.130079] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 4.131143] systemd[1]: Stopped Virtual Console Setup. machine # [ 4.131910] systemd[1]: initrd-cleanup.service: Deactivated successfully. machine # [ 4.132828] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. machine # [ 4.133718] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 4.134724] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 4.135594] systemd[1]: systemd-udevd.service: Deactivated successfully. machine # [ 4.136615] systemd[1]: Stopped Rule-based Manager for Device Events and Files. machine # [ 4.137628] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. machine # [ 4.138669] systemd[1]: Closed udev Control Socket. machine # [ 4.139426] systemd[1]: Starting Cleanup udev Database... machine # [ 4.140265] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. machine # [ 4.141308] systemd[1]: Stopped Create Static Device Nodes in /dev. machine # [ 4.142204] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. machine # [ 4.143355] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. machine # [ 4.144349] systemd[1]: kmod-static-nodes.service: Deactivated successfully. machine # [ 4.145360] systemd[1]: Stopped Create List of Static Device Nodes. machine # [ 4.146299] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. machine # [ 4.147425] systemd[1]: Finished Cleanup udev Database. machine # [ 4.148260] systemd[1]: Reached target Switch Root. machine # [ 4.149033] systemd[1]: Starting NixOS Activation... machine # [ 4.296867] initrd-nixos-activation-start[238]: booting system configuration /nix/store/9yadj56z0z3lm4yw0alvgw6cvkmy5i18-nixos-system-machine-test machine # [ 4.357054] initrd-nixos-activation-start[238]: running activation script... machine # [ 4.652637] initrd-nixos-activation-start[261]: setting up /etc... machine # [ 4.792907] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. machine # [ 4.795717] systemd[1]: Finished NixOS Activation. machine # [ 4.797579] systemd[1]: Starting Switch Root... machine # [ 4.810917] systemd[1]: Switching root. machine # [ 5.028729] systemd-journald[90]: Received SIGTERM from PID 1 (systemd). machine # [ 5.145317] NET: Registered PF_VSOCK protocol family machine # [ 5.540996] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 5.551281] systemd[1]: Detected virtualization kvm. machine # [ 5.553183] systemd[1]: Detected architecture x86-64. machine # [ 5.555162] systemd[1]: Detected first boot. machine # [ 5.559801] systemd[1]: Initializing machine ID from random generator. machine # [ 5.709589] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 5.808638] systemd[1]: Applying preset policy. machine # [ 6.025229] systemd[1]: Populated /etc with preset unit settings. machine # [ 6.301930] systemd[1]: initrd-switch-root.service: Deactivated successfully. machine # [ 6.303437] systemd[1]: Stopped initrd-switch-root.service. machine # [ 6.305942] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. machine # [ 6.308160] systemd[1]: Created slice Slice /system/getty. machine # [ 6.309678] systemd[1]: Created slice User and Session Slice. machine # [ 6.310778] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 6.312084] systemd[1]: Started Forward Password Requests to Wall Directory Watch. machine # [ 6.313277] systemd[1]: Expecting device /dev/hvc0... machine # [ 6.314164] systemd[1]: Expecting device /dev/ttyS0... machine # [ 6.315045] systemd[1]: Reached target Local Encrypted Volumes. machine # [ 6.316038] systemd[1]: Stopped target initrd-fs.target. machine # [ 6.316966] systemd[1]: Stopped target initrd-root-fs.target. machine # [ 6.317894] systemd[1]: Stopped target initrd-switch-root.target. machine # [ 6.318877] systemd[1]: Reached target Virtual Machines and Containers. machine # [ 6.319836] systemd[1]: Reached target Path Units. machine # [ 6.320676] systemd[1]: Reached target Remote File Systems. machine # [ 6.321550] systemd[1]: Reached target Slice Units. machine # [ 6.322263] systemd[1]: Reached target Swaps. machine # [ 6.324677] systemd[1]: Listening on Query the User Interactively for a Password. machine # [ 6.327592] systemd[1]: Listening on Process Core Dump Socket. machine # [ 6.329689] systemd[1]: Listening on Credential Encryption/Decryption. machine # [ 6.331839] systemd[1]: Listening on Factory Reset Management. machine # [ 6.332970] systemd[1]: Listening on Hostname Service Socket. machine # [ 6.336135] systemd[1]: Starting Journal Log Access Socket... machine # [ 6.337697] systemd[1]: Listening on Journal Audit Socket. machine # [ 6.339977] systemd[1]: Listening on Console Output Muting Service Socket. machine # [ 6.341232] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. machine # [ 6.342567] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.344051] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki machine # [ 6.352579] systemd[1]: Listening on Disk Repartitioning Service Socket. machine # [ 6.355374] systemd[1]: Listening on udev Control Socket. machine # [ 6.357794] systemd[1]: Listening on udev Varlink Socket. machine # [ 6.363271] systemd[1]: Mounting Huge Pages File System... machine # [ 6.368557] systemd[1]: Mounting POSIX Message Queue File System... machine # [ 6.375256] systemd[1]: Mounting Kernel Debug File System... machine # [ 6.381779] systemd[1]: Mounting Kernel Trace File System... machine # [ 6.387727] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 6.393213] systemd[1]: Starting Load Kernel Module configfs... machine # [ 6.395671] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm machine # [ 6.399231] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.403218] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.417855] systemd[1]: Mounting FUSE Control File System... machine # [ 6.418880] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.424139] systemd[1]: Starting Journal Service... machine # [ 6.431920] systemd[1]: Starting Load Kernel Modules... machine # [ 6.434747] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... machine # [ 6.439987] systemd[1]: Starting Remount Root and Kernel File Systems... machine # [ 6.441041] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.444806] systemd[1]: Starting Coldplug All udev Devices... machine # [ 6.448030] systemd[1]: Listening on Journal Log Access Socket. machine # [ 6.449131] systemd[1]: Mounted Huge Pages File System. machine # [ 6.450057] systemd[1]: Mounted POSIX Message Queue File System. machine # [ 6.451122] systemd[1]: Mounted Kernel Debug File System. machine # [ 6.452061] systemd[1]: Mounted Kernel Trace File System. machine # [ 6.453683] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 6.457798] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 6.459795] systemd[1]: Mounted FUSE Control File System. machine # [ 6.468775] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 6.470362] systemd[1]: Finished Load Kernel Module configfs. machine # [ 6.472678] systemd-journald[332]: Collecting audit messages is enabled. machine # [ 6.473859] systemd[1]: Mounting Kernel Configuration File System... machine # [ 6.491475] EXT4-fs (vda): re-mounted ea501fab-bd13-4fe7-95c7-71f29886a325. machine # [ 6.339537] s[ 6.492972] systemd[1]: Started Journal Service. machine # ystemd[1]: Queued start job for default target Multi-User System. machine # [ 6.343115] systemd[1]: systemd-journald.service: Deactivated successfully. machine # [ 6.344772] systemd-modules-load[333]: Using 2 probe threads machine # [ 6.347141] systemd[1]: Finished Remount Root and Kernel File Systems. machine # [ 6.349560] systemd[1]: Mounted Kernel Configuration File System. machine # [ 6.355846] systemd[1]: Listening on Disk Image Download Service Socket. machine # [ 6.357487] systemd-oomd[335]: No swap; memory pressure usage will be degraded machine # [ 6.360383] systemd[1]: Starting Flush Journal to Persistent Storage... machine # [ 6.361513] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.363184] systemd[1]: Starting Load/Save OS Random Seed... machine # [ 6.364126] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.520252] loop: module loaded machine # [ 6.367574] systemd-modules-load[333]: Inserted module 'loop' machine # [ 6.368556] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. machine # [ 6.370993] systemd[1]: Finished Load Kernel Modules. machine # [ 6.373625] systemd[1]: Starting Apply Kernel Variables... machine # [ 6.384860] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 6.386994] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 6.545161] systemd-journald[332]: Received client request to flush runtime journal. machine # [ 6.453551] systemd[1]: Finished Load/Save OS Random Seed. machine # [ 6.454734] systemd[1]: Reached target First Boot Complete. machine # [ 6.455809] systemd[1]: Finished Apply Kernel Variables. machine # [ 6.456850] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 6.457820] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 6.458826] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 6.459954] systemd[1]: Finished Flush Journal to Persistent Storage. machine # [ 6.479075] systemd[1]: Finished Coldplug All udev Devices. machine # [ 6.484735] systemd-udevd[361]: Using default interface naming scheme 'v261'. machine # [ 6.522735] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 6.596028] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.622242] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. machine # [ 6.628514] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. machine # [ 6.646691] (udev-worker)[381]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 6.649128] (udev-worker)[381]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.650709] (udev-worker)[386]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.673445] systemd[1]: Condition check resulted in Virtio network device being skipped. machine # [ 6.674693] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.676273] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.678570] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.680322] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.681714] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.855615] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 machine # [ 6.865049] ACPI: button: Power Button [PWRF] machine # [ 6.873629] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console machine # [ 6.875177] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 machine # [ 6.880324] mousedev: PS/2 mouse device common for all mice machine # [ 6.887762] Console: switching to colour dummy device 80x25 machine # [ 6.890157] [drm] Found bochs VGA, ID 0xb0c5. machine # [ 6.890159] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. machine # [ 6.893983] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic machine # [ 6.895012] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 machine # [ 6.912181] Console: switching to colour frame buffer device 160x50 machine # [ 6.915919] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device machine # [ 6.917858] rtc_cmos PNP0B00:00: RTC can wake from S4 machine # [ 6.923143] rtc_cmos PNP0B00:00: registered as rtc0 machine # [ 6.924427] rtc_cmos PNP0B00:00: setting system clock to 2026-09-25T15:13:01 UTC (1790349181) machine # [ 6.928356] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs machine # [ 6.929931] systemd-journald[332]: Time jumped backwards, rotating. machine # [ 6.949833] parport_pc 00:02: reported by Plug and Play ACPI machine # [ 6.956633] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] machine # [ 6.964959] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized machine # [ 6.966043] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt machine # [ 6.968085] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD machine # [ 6.974260] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 machine # [ 6.991834] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 machine # [ 6.863948] systemd[1]: Starting Virtual Console Setup... machine # [ 6.875659] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 6.880916] systemd[1]: Stopped Virtual Console Setup. machine # [ 6.891637] systemd[1]: Starting Virtual Console Setup... machine # [ 7.065581] ppdev: user-space parallel port driver machine # [ 7.071688] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) machine # [ 7.073297] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) machine # [ 7.165119] kvm_amd: TSC scaling supported machine # [ 7.165760] kvm_amd: Nested Virtualization enabled machine # [ 7.166235] kvm_amd: Nested Paging enabled machine # [ 7.166757] kvm_amd: LBR virtualization supported machine # [ 7.167325] kvm_amd: Virtual VMLOAD VMSAVE supported machine # [ 7.167939] kvm_amd: Virtual GIF supported machine # [ 7.168411] kvm_amd: Virtual NMI enabled machine # [ 7.262785] EDAC MC: Ver: 3.0.0 machine # [ 7.117919] systemd-vconsole-setup[406]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 7.121585] systemd[1]: Finished Virtual Console Setup. machine # [ 7.150561] systemd[1]: Mounting /run/wrappers... machine # [ 7.182119] systemd[1]: Mounted /run/wrappers. machine # [ 7.183851] systemd[1]: Reached target Local File Systems. machine # [ 7.185679] systemd[1]: Listening on Boot Loader Control Service Socket. machine # [ 7.187876] systemd[1]: Starting register-nix-paths.service... machine # [ 7.190141] systemd[1]: Starting Create SUID/SGID Wrappers... machine # [ 7.192214] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. machine # [ 7.197735] systemd[1]: Starting Save Transient machine-id to Disk... machine # [ 7.200151] systemd[1]: Starting Create System Files and Directories... machine # [ 7.247553] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. machine # [ 7.251828] systemd[1]: Finished Save Transient machine-id to Disk. machine # [ 7.272366] systemd[1]: Finished Create System Files and Directories. machine # [ 7.276868] systemd[1]: Starting Rebuild Journal Catalog... machine # [ 7.278422] systemd[1]: Starting Record System Boot/Shutdown in UTMP... machine # [ 7.313737] systemd[1]: Finished Record System Boot/Shutdown in UTMP. machine # [ 7.326239] systemd[1]: Finished Rebuild Journal Catalog. machine # [ 7.328281] systemd[1]: Starting Update is Completed... machine # [ 7.351799] systemd[1]: Finished Update is Completed. machine # [ 7.489878] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. machine # [ 7.491172] systemd[1]: Finished Create SUID/SGID Wrappers. machine # [ 7.722822] systemd[1]: Finished register-nix-paths.service. machine # [ 7.725223] systemd[1]: Reached target System Initialization. machine # [ 7.727410] systemd[1]: Started Discard unused filesystem blocks once a week. machine # [ 7.729941] systemd[1]: Started niks3 garbage collection timer. machine # [ 7.732237] systemd[1]: Started Daily Cleanup of Temporary Directories. machine # [ 7.734620] systemd[1]: Reached target Timer Units. machine # [ 7.736575] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 7.738942] systemd[1]: Listening on niks3 server socket. machine # [ 7.741122] systemd[1]: Listening on Nix Daemon Socket. machine # [ 7.743227] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. machine # [ 7.746271] systemd[1]: Reached target Socket Units. machine # [ 7.748233] systemd[1]: Reached target Basic System. machine # [ 7.750154] systemd[1]: Started backdoor.service. machine # [ 7.751967] systemd[1]: Starting Import lastlog data into lastlog2 database... machine # [ 7.754701] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 7.757333] systemd[1]: Starting Post-Boot Actions... machine # [ 7.759639] systemd[1]: Started Reset console on configuration changes. machine # [ 7.761884] systemd[1]: Starting resolvconf update... machine # [ 7.764950] systemd[1]: Started rustfs.service. machine # [ 7.773414] systemd[1]: Starting rustfs-bucket.service... machine # [ 7.782123] systemd[1]: Starting D-Bus System Message Bus... machine # [ 7.808339] nsncd[490]: Sep 25 15:13:02.536 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 7.812148] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 7.814928] systemd[1]: Reached target Host and Network Name Lookups. machine # connecting to host... machine # [ 7.817230] systemd[1]: Reached target User and Group Name Lookups. machine # [ 7.818423] systemd[1]: Starting User Login Management... machine # [ 7.819395] systemd[1]: Finished Post-Boot Actions. machine # [ 7.844645] systemd[1]: Finished Import lastlog data into lastlog2 database. machine: Guest shell says: b'Spawning backdoor root shell...\n' machine: connected to guest root shell machine: (connecting took 8.49 seconds) machine: (finished: waiting for the VM to finish booting, in 8.71 seconds) machine # [ 7.882856] systemd-logind[516]: New seat seat0. machine # [ 7.886221] dbus-broker-launch[497]: Looking up NSS user entry for 'systemd-timesync'... machine # [ 7.889751] systemd-logind[516]: Watching system buttons on /dev/input/event2 (Power Button) machine # [ 7.891147] systemd-logind[516]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) machine # [ 7.895503] systemd-logind[516]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) machine # [ 7.897609] systemd[1]: Started User Login Management. machine # [ 7.898715] systemd[1]: Starting linger-users.service... machine # [ 7.900371] dbus-broker-launch[497]: NSS returned no entry for 'systemd-timesync' machine # [ 7.901450] dbus-broker-launch[497]: Invalid user-name in /nix/store/d3mrkr0v9x5sgbb0rb2pnsl0mysb1m4x-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" machine # [ 7.919913] systemd[1]: Started D-Bus System Message Bus. machine # [ 7.927545] dbus-broker-launch[497]: Ready machine # [ 7.932612] systemd[1]: Stopped target Host and Network Name Lookups. machine # [ 7.934134] systemd[1]: Stopping Host and Network Name Lookups... machine # [ 7.934881] systemd[1]: Stopped target User and Group Name Lookups. machine # [ 7.935489] systemd[1]: Stopping User and Group Name Lookups... machine # [ 7.935983] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... machine # [ 7.941327] systemd[1]: nscd.service: Deactivated successfully. machine # [ 7.942053] systemd[1]: Stopped Name Service Cache Daemon (nsncd). machine # [ 7.948225] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 7.948721] systemd[1]: linger-users.service: Deactivated successfully. machine # [ 7.949240] systemd[1]: Finished linger-users.service. machine # [ 7.985670] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 7.986091] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 7.986574] systemd[1]: Reached target User and Group Name Lookups. machine # [ 7.987449] nsncd[594]: Sep 25 15:13:02.714 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 8.005476] systemd[1]: Finished resolvconf update. machine # [ 8.006681] systemd[1]: Reached target Preparation for Network. machine # [ 8.011244] systemd[1]: Starting DHCP Client... machine # [ 8.012208] systemd[1]: Starting Address configuration of eth1... machine # [ 8.015358] systemd[1]: Starting Extra networking commands.... machine # [ 8.072248] network-addresses-eth1-start[622]: adding address 192.168.1.1/24... done machine # [ 8.082391] network-addresses-eth1-start[622]: adding address 2001:db8:1::1/64... done machine # [ 8.094178] systemd[1]: Finished Address configuration of eth1. machine # [ 8.117740] dhcpcd[634]: dhcpcd-10.3.2 starting machine # [ 8.123256] dhcpcd[691]: dev: loaded udev machine # [ 8.134827] systemd[1]: Finis[ 8.288120] 8021q: 802.1Q VLAN Support v1.8 machine # hed Extra networking commands.. machine # [ 8.136253] s[ 8.289547] 8021q: adding VLAN 0 to HW filter on device eth1 machine # ystemd[1]: Reached target Network. machine # [ 8.138337] systemd[1]: Starting PostgreSQL Server... machine # [ 8.140221] systemd[1]: Starting Permit User Sessions... machine # [ 8.154895] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. machine # [ 8.222931] systemd[1]: Finished Permit User Sessions. machine # [ 8.227642] systemd[1]: Started Getty on tty1. machine # [ 8.228543] systemd[1]: Reached target Login Prompts. machine # [ 8.386397] cfg80211: Loading compiled-in X.509 certificates for regulatory database machine # [ 8.409910] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' machine # [ 8.411192] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' machine # [ 8.413526] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 machine # [ 8.414928] cfg80211: failed to load regulatory.db machine # [ 8.452120] 8021q: adding VLAN 0 to HW filter on device eth0 machine # [ 8.300267] dhcpcd[691]: eth0: waiting for carrier machine # [ 8.301148] dhcpcd[691]: eth0: carrier acquired machine # [ 8.308034] dhcpcd[691]: DUID 00:01:00:01:32:49:4b:ff:52:54:00:12:34:56 machine # [ 8.309108] dhcpcd[691]: eth0: IAID 00:12:34:56 machine # [ 8.309769] dhcpcd[691]: eth0: adding address fe80::5054:ff:fe12:3456 machine # [ 8.320539] postgresql-pre-start[713]: The files belonging to this database system will be owned by user "postgres". machine # [ 8.322133] postgresql-pre-start[713]: This user must also own the server process. machine # [ 8.323582] postgresql-pre-start[713]: The database cluster will be initialized with locale "en_US.UTF-8". machine # [ 8.324956] postgresql-pre-start[713]: The default database encoding has accordingly been set to "UTF8". machine # [ 8.326392] postgresql-pre-start[713]: The default text search configuration will be set to "english". machine # [ 8.327815] postgresql-pre-start[713]: Data page checksums are enabled. machine # [ 8.328907] postgresql-pre-start[713]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok machine # [ 8.330368] postgresql-pre-start[713]: creating subdirectories ... ok machine # [ 8.331384] postgresql-pre-start[713]: selecting dynamic shared memory implementation ... posix machine # [ 8.388721] postgresql-pre-start[713]: selecting default "max_connections" ... 100 machine # [ 8.448463] postgresql-pre-start[713]: selecting default "shared_buffers" ... 128MB machine # [ 9.232526] postgresql-pre-start[713]: selecting default time zone ... UTC machine # [ 9.236135] postgresql-pre-start[713]: creating configuration files ... ok machine # [ 9.367576] dhcpcd[691]: eth0: soliciting a DHCP lease machine # [ 9.539400] NET: Registered PF_PACKET protocol family machine # [ 9.399992] dhcpcd[691]: eth0: offered 10.0.2.15 from 10.0.2.2 machine # [ 9.404402] dhcpcd[691]: eth0: probing address 10.0.2.15/24 machine # [ 9.419666] postgresql-pre-start[713]: running bootstrap script ... ok machine # [ 9.914430] postgresql-pre-start[713]: performing post-bootstrap initialization ... ok machine # [ 10.069397] postgresql-pre-start[713]: syncing data to disk ... ok machine # [ 10.071805] postgresql-pre-start[713]: initdb: warning: enabling "trust" authentication for local connections machine # [ 10.075181] postgresql-pre-start[713]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. machine # [ 10.080374] postgresql-pre-start[713]: Success. You can now start the database server using: machine # [ 10.083132] postgresql-pre-start[713]: pg_ctl -D /var/lib/postgresql/18 -l logfile start machine # [ 10.216512] postgres[753]: [753] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit machine # [ 10.220104] postgres[753]: [753] LOG: listening on IPv6 address "::1", port 5432 machine # [ 10.221194] postgres[753]: [753] LOG: listening on IPv4 address "127.0.0.1", port 5432 machine # [ 10.226941] postgres[753]: [753] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" machine # [ 10.239179] postgres[763]: [763] LOG: database system was shut down at 2026-09-25 15:13:04 GMT machine # [ 10.248634] postgres[753]: [753] LOG: database system is ready to accept connections machine # [ 10.255154] systemd[1]: Started PostgreSQL Server. machine # [ 10.259766] systemd[1]: Starting PostgreSQL Setup Scripts... machine # [ 10.453140] postgresql-setup-start[774]: CREATE DATABASE machine # [ 10.488880] postgresql-setup-start[779]: CREATE ROLE machine # [ 10.508223] postgresql-setup-start[781]: ALTER DATABASE machine # [ 10.511882] systemd[1]: Finished PostgreSQL Setup Scripts. machine # [ 10.514464] systemd[1]: Reached target PostgreSQL. machine # [ 10.987586] dhcpcd[691]: eth0: soliciting an IPv6 router machine # [ 10.989411] dhcpcd[691]: eth0: Router Advertisement from fe80::2 machine # [ 10.991284] dhcpcd[691]: eth0: adding address fec0::5054:ff:fe12:3456/64 machine # [ 10.993155] dhcpcd[691]: eth0: adding route to fec0::/64 machine # [ 10.995077] dhcpcd[691]: eth0: adding default route via fe80::2 machine # [ 14.494161] dhcpcd[691]: eth0: leased 10.0.2.15 for 86400 seconds machine # [ 14.496452] dhcpcd[691]: eth0: adding route to 10.0.2.0/24 machine # [ 14.498460] dhcpcd[691]: eth0: adding default route via 10.0.2.2 machine # [ 14.636955] systemd[1]: Started DHCP Client. machine # [ 14.639445] systemd[1]: Reached target Network is Online. machine # [ 14.644435] systemd[1]: Starting k3s service... machine # [ 14.713350] k3s[881]: time="2026-09-25T15:13:09Z" level=info msg="Acquiring lock file /var/lib/rancher/k3s/data/.lock" machine # [ 14.714650] k3s[881]: time="2026-09-25T15:13:09Z" level=info msg="Preparing data dir /var/lib/rancher/k3s/data/05fb32d1d5d79ab4bf8f805d07e4a7dfb491001fd5137b587aa471efd4746099" machine # [ 17.241686] rustfs-bucket-start[896]: mb s3://farm machine # [ 17.256871] systemd[1]: Finished rustfs-bucket.service. machine # [ 17.310316] k3s[881]: time="2026-09-25T15:13:12Z" level=info msg="Starting k3s 1.35.8+k3s1 (e952d68a)" machine # [ 17.323519] k3s[881]: time="2026-09-25T15:13:12Z" level=info msg="Configuring sqlite3 database connection pooling: maxIdle=20, maxOpen=0, maxLifetime=0s, maxIdleTime=2m0s" machine # [ 17.325615] k3s[881]: time="2026-09-25T15:13:12Z" level=info msg="Kine built with sqlite from github.com/mattn/go-sqlite3 version 3.53.3" machine # [ 17.326753] k3s[881]: time="2026-09-25T15:13:12Z" level=info msg="Configuring database table schema and indexes, this may take a moment..." machine # [ 17.343148] k3s[881]: time="2026-09-25T15:13:12Z" level=info msg="Database tables and indexes are up to date" machine # [ 17.343617] k3s[881]: time="2026-09-25T15:13:12Z" level=info msg="Running startup VACUUM to reclaim disk space, this may take a moment..." machine # [ 17.349435] k3s[881]: time="2026-09-25T15:13:12Z" level=info msg="Startup VACUUM completed successfully" machine # [ 17.351929] k3s[881]: time="2026-09-25T15:13:12Z" level=info msg="Kine available at unix://kine.sock" machine # [ 17.353144] k3s[881]: time="2026-09-25T15:13:12Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 17.357133] k3s[881]: time="2026-09-25T15:13:12Z" level=info msg="Datastore connection validated successfully, proceeding with bootstrap data generation" machine # [ 17.359894] k3s[881]: time="2026-09-25T15:13:12Z" level=info msg="generated self-signed CA certificate CN=k3s-client-ca@1790349192: notBefore=2026-09-25 14:13:12.08844406 +0000 UTC notAfter=2036-09-22 14:13:12.08844406 +0000 UTC" machine # [ 17.361155] k3s[881]: time="2026-09-25T15:13:12Z" level=info msg="certificate CN=system:admin,O=system:masters signed by CN=k3s-client-ca@1790349192: notBefore=2026-09-25 14:13:12 +0000 UTC notAfter=2027-09-25 14:13:12 +0000 UTC" machine # [ 17.362182] k3s[881]: time="2026-09-25T15:13:12Z" level=info msg="certificate CN=system:k3s-supervisor,O=system:masters signed by CN=k3s-client-ca@1790349192: notBefore=2026-09-25 14:13:12 +0000 UTC notAfter=2027-09-25 14:13:12 +0000 UTC" machine # [ 17.363158] k3s[881]: time="2026-09-25T15:13:12Z" level=info msg="certificate CN=system:kube-controller-manager signed by CN=k3s-client-ca@1790349192: notBefore=2026-09-25 14:13:12 +0000 UTC notAfter=2027-09-25 14:13:12 +0000 UTC" machine # [ 17.364134] k3s[881]: time="2026-09-25T15:13:12Z" level=info msg="certificate CN=system:kube-scheduler signed by CN=k3s-client-ca@1790349192: notBefore=2026-09-25 14:13:12 +0000 UTC notAfter=2027-09-25 14:13:12 +0000 UTC" machine # [ 17.365119] k3s[881]: time="2026-09-25T15:13:12Z" level=info msg="certificate CN=system:apiserver,O=system:masters signed by CN=k3s-client-ca@1790349192: notBefore=2026-09-25 14:13:12 +0000 UTC notAfter=2027-09-25 14:13:12 +0000 UTC" machine # [ 17.366473] k3s[881]: time="2026-09-25T15:13:12Z" level=info msg="certificate CN=k3s-cloud-controller-manager signed by CN=k3s-client-ca@1790349192: notBefore=2026-09-25 14:13:12 +0000 UTC notAfter=2027-09-25 14:13:12 +0000 UTC" machine # [ 17.367377] k3s[881]: time="2026-09-25T15:13:12Z" level=info msg="generated self-signed CA certificate CN=k3s-server-ca@1790349192: notBefore=2026-09-25 14:13:12.095951998 +0000 UTC notAfter=2036-09-22 14:13:12.095951998 +0000 UTC" machine # [ 17.368500] k3s[881]: time="2026-09-25T15:13:12Z" level=info msg="certificate CN=kube-apiserver signed by CN=k3s-server-ca@1790349192: notBefore=2026-09-25 14:13:12 +0000 UTC notAfter=2027-09-25 14:13:12 +0000 UTC" machine # [ 17.369606] k3s[881]: time="2026-09-25T15:13:12Z" level=info msg="certificate CN=kube-scheduler signed by CN=k3s-server-ca@1790349192: notBefore=2026-09-25 14:13:12 +0000 UTC notAfter=2027-09-25 14:13:12 +0000 UTC" machine # [ 17.370649] k3s[881]: time="2026-09-25T15:13:12Z" level=info msg="certificate CN=kube-controller-manager signed by CN=k3s-server-ca@1790349192: notBefore=2026-09-25 14:13:12 +0000 UTC notAfter=2027-09-25 14:13:12 +0000 UTC" machine # [ 17.371312] k3s[881]: time="2026-09-25T15:13:12Z" level=info msg="generated self-signed CA certificate CN=k3s-request-header-ca@1790349192: notBefore=2026-09-25 14:13:12.099980443 +0000 UTC notAfter=2036-09-22 14:13:12.099980443 +0000 UTC" machine # [ 17.372048] k3s[881]: time="2026-09-25T15:13:12Z" level=info msg="certificate CN=system:auth-proxy signed by CN=k3s-request-header-ca@1790349192: notBefore=2026-09-25 14:13:12 +0000 UTC notAfter=2027-09-25 14:13:12 +0000 UTC" machine # [ 17.372717] k3s[881]: time="2026-09-25T15:13:12Z" level=info msg="generated self-signed CA certificate CN=etcd-server-ca@1790349192: notBefore=2026-09-25 14:13:12.101438729 +0000 UTC notAfter=2036-09-22 14:13:12.101438729 +0000 UTC" machine # [ 17.373486] k3s[881]: time="2026-09-25T15:13:12Z" level=info msg="certificate CN=etcd-client signed by CN=etcd-server-ca@1790349192: notBefore=2026-09-25 14:13:12 +0000 UTC notAfter=2027-09-25 14:13:12 +0000 UTC" machine # [ 17.374083] k3s[881]: time="2026-09-25T15:13:12Z" level=info msg="generated self-signed CA certificate CN=etcd-peer-ca@1790349192: notBefore=2026-09-25 14:13:12.102784989 +0000 UTC notAfter=2036-09-22 14:13:12.102784989 +0000 UTC" machine # [ 17.374844] k3s[881]: time="2026-09-25T15:13:12Z" level=info msg="certificate CN=etcd-peer signed by CN=etcd-peer-ca@1790349192: notBefore=2026-09-25 14:13:12 +0000 UTC notAfter=2027-09-25 14:13:12 +0000 UTC" machine # [ 17.375614] k3s[881]: time="2026-09-25T15:13:12Z" level=info msg="certificate CN=etcd-server signed by CN=etcd-server-ca@1790349192: notBefore=2026-09-25 14:13:12 +0000 UTC notAfter=2027-09-25 14:13:12 +0000 UTC" machine # [ 17.411627] k3s[881]: time="2026-09-25T15:13:12Z" level=info msg="certificate CN=k3s,O=k3s signed by CN=k3s-server-ca@1790349192: notBefore=2026-09-25 14:13:12 +0000 UTC notAfter=2027-09-25 14:13:12 +0000 UTC" machine # [ 17.414831] k3s[881]: time="2026-09-25T15:13:12Z" level=warning msg="dynamiclistener [::]:6443: no cached certificate available for preload - deferring certificate load until storage initialization or first client request" machine # [ 17.417995] k3s[881]: time="2026-09-25T15:13:12Z" level=info msg="Active TLS secret / (ver=) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__f7cb_f594_f394_d938-ddba68:fec0::f7cb:f594:f394:d938 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=7EFB415A54D93B98E61B14144528A95731A77D40]" machine # [ 18.364176] k3s[881]: time="2026-09-25T15:13:13Z" level=info msg="Password verified locally for node machine" machine # [ 18.366755] k3s[881]: time="2026-09-25T15:13:13Z" level=info msg="certificate CN=machine signed by CN=k3s-server-ca@1790349192: notBefore=2026-09-25 14:13:13 +0000 UTC notAfter=2027-09-25 14:13:13 +0000 UTC" machine # [ 18.649603] k3s[881]: time="2026-09-25T15:13:13Z" level=info msg="certificate CN=system:node:machine,O=system:nodes signed by CN=k3s-client-ca@1790349192: notBefore=2026-09-25 14:13:13 +0000 UTC notAfter=2027-09-25 14:13:13 +0000 UTC" machine # [ 18.753360] k3s[881]: time="2026-09-25T15:13:13Z" level=info msg="certificate CN=system:kube-proxy signed by CN=k3s-client-ca@1790349192: notBefore=2026-09-25 14:13:13 +0000 UTC notAfter=2027-09-25 14:13:13 +0000 UTC" machine # [ 18.858401] k3s[881]: time="2026-09-25T15:13:13Z" level=info msg="certificate CN=system:k3s-controller signed by CN=k3s-client-ca@1790349192: notBefore=2026-09-25 14:13:13 +0000 UTC notAfter=2027-09-25 14:13:13 +0000 UTC" machine # [ 18.970688] k3s[881]: time="2026-09-25T15:13:13Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:49678: runtime core not ready" machine # [ 19.055852] k3s[881]: time="2026-09-25T15:13:13Z" level=info msg="Module overlay was already loaded" machine # [ 19.299359] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. machine # [ 19.307060] Bridge firewalling registered machine # [ 19.165492] k3s[881]: time="2026-09-25T15:13:13Z" level=warning msg="Failed to load kernel module iptable_nat with modprobe" machine # [ 19.176641] k3s[881]: time="2026-09-25T15:13:13Z" level=warning msg="Failed to load kernel module iptable_filter with modprobe" machine # [ 19.189841] k3s[881]: time="2026-09-25T15:13:13Z" level=warning msg="Failed to load kernel module nft-expr-counter with modprobe" machine # [ 19.270723] k3s[881]: time="2026-09-25T15:13:13Z" level=info msg="Set sysctl 'net/ipv4/conf/default/forwarding' to 1" machine # [ 19.274320] k3s[881]: time="2026-09-25T15:13:13Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_max' to 131072" machine # [ 19.277750] k3s[881]: time="2026-09-25T15:13:13Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400" machine # [ 19.281639] k3s[881]: time="2026-09-25T15:13:13Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600" machine # [ 19.285484] k3s[881]: time="2026-09-25T15:13:13Z" level=info msg="Set sysctl 'net/ipv4/conf/all/forwarding' to 1" machine # [ 19.288781] k3s[881]: time="2026-09-25T15:13:14Z" level=info msg="Creating k3s-cert-monitor event broadcaster" machine # [ 19.292086] k3s[881]: time="2026-09-25T15:13:14Z" level=info msg="Connecting to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 19.295082] k3s[881]: time="2026-09-25T15:13:14Z" level=info msg="Saving cluster bootstrap data to datastore" machine # [ 19.297492] k3s[881]: time="2026-09-25T15:13:14Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 19.300337] k3s[881]: time="2026-09-25T15:13:14Z" level=info msg="Connection to etcd is ready" machine # [ 19.302595] k3s[881]: time="2026-09-25T15:13:14Z" level=info msg="ETCD server is now running" machine # [ 19.304759] k3s[881]: time="2026-09-25T15:13:14Z" level=info msg="Handling backend connection request [machine]" machine # [ 19.307544] k3s[881]: time="2026-09-25T15:13:14Z" level=info msg="Running kube-apiserver --advertise-port=6443 --allow-privileged=true --anonymous-auth=false --api-audiences=https://kubernetes.default.svc.cluster.local,k3s --authorization-mode=Node,RBAC --bind-address=127.0.0.1 --cert-dir=/var/lib/rancher/k3s/server/tls/temporary-certs --client-ca-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --egress-selector-config-file=/var/lib/rancher/k3s/server/etc/egress-selector-config.yaml --enable-admission-plugins=NodeRestriction --enable-aggregator-routing=true --enable-bootstrap-token-auth=true --etcd-servers=unix://kine.sock --kubelet-certificate-authority=/var/lib/rancher/k3s/server/tls/server-ca.crt --kubelet-client-certificate=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.crt --kubelet-client-key=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.key --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --profiling=false --proxy-client-cert-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt --proxy-client-key-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.key --requestheader-allowed-names=system:auth-proxy --requestheader-client-ca-file=/var/lib/rancher/k3s/server/tls/request-header-ca.crt --requestheader-extra-headers-prefix=X-Remote-Extra- --requestheader-group-headers=X-Remote-Group --requestheader-username-headers=X-Remote-User --secure-port=6444 --service-account-issuer=https://kubernetes.default.svc.cluster.local --service-account-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-account-signing-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --storage-backend=etcd3 --tls-cert-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --tls-private-key-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 19.332215] k3s[881]: time="2026-09-25T15:13:14Z" level=info msg="Polling for API server readiness: GET /readyz failed: the server is currently unable to handle the request" machine # [ 19.334905] k3s[881]: time="2026-09-25T15:13:14Z" level=info msg="Connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 19.336372] k3s[881]: time="2026-09-25T15:13:14Z" level=info msg="Remotedialer connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 19.337925] k3s[881]: time="2026-09-25T15:13:14Z" level=info msg="Running kube-scheduler --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --bind-address=127.0.0.1 --kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --leader-elect=false --profiling=false --secure-port=10259 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 19.343886] k3s[881]: time="2026-09-25T15:13:14Z" level=info msg="Running kube-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --bind-address=127.0.0.1 --cluster-cidr=10.42.0.0/16 --cluster-signing-kube-apiserver-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kube-apiserver-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kubelet-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-serving-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-kubelet-serving-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --cluster-signing-legacy-unknown-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-legacy-unknown-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --configure-cloud-routes=false --controllers=*,tokencleaner,-service,-route,-cloud-node-lifecycle --kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --leader-elect=false --profiling=false --root-ca-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --secure-port=10257 --service-account-private-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key --use-service-account-credentials=true" machine # [ 19.361662] k3s[881]: time="2026-09-25T15:13:14Z" level=info msg="Running cloud-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --bind-address=127.0.0.1 --cloud-config=/var/lib/rancher/k3s/server/etc/cloud-config.yaml --cloud-provider=k3s --cluster-cidr=10.42.0.0/16 --configure-cloud-routes=false --controllers=*,-route --kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --leader-elect=false --leader-elect-resource-name=k3s-cloud-controller-manager --node-status-update-frequency=1m0s --profiling=false" machine # [ 19.369490] k3s[881]: time="2026-09-25T15:13:14Z" level=info msg="Server node token is available at /var/lib/rancher/k3s/server/token" machine # [ 19.371064] k3s[881]: time="2026-09-25T15:13:14Z" level=info msg="To join server node to cluster: k3s server -s https://10.0.2.15:6443 -t ${SERVER_NODE_TOKEN}" machine # [ 19.373948] k3s[881]: time="2026-09-25T15:13:14Z" level=info msg="Agent node token is available at /var/lib/rancher/k3s/server/agent-token" machine # [ 19.375600] k3s[881]: time="2026-09-25T15:13:14Z" level=info msg="To join agent node to cluster: k3s agent -s https://10.0.2.15:6443 -t ${AGENT_NODE_TOKEN}" machine # [ 19.377480] k3s[881]: time="2026-09-25T15:13:14Z" level=info msg="Wrote kubeconfig /etc/rancher/k3s/k3s.yaml" machine # [ 19.378713] k3s[881]: time="2026-09-25T15:13:14Z" level=info msg="Run: k3s kubectl" machine # [ 19.382156] k3s[881]: I0925 15:13:14.015069 881 options.go:263] external host was not specified, using 10.0.2.15 machine # [ 19.383532] k3s[881]: I0925 15:13:14.018218 881 server.go:158] Version: v1.35.8+k3s1 machine # [ 19.384625] k3s[881]: I0925 15:13:14.018265 881 server.go:160] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 19.386059] k3s[881]: time="2026-09-25T15:13:14Z" level=info msg="Logging containerd to /var/lib/rancher/k3s/agent/containerd/containerd.log" machine # [ 19.387664] k3s[881]: time="2026-09-25T15:13:14Z" level=info msg="Running containerd -c /var/lib/rancher/k3s/agent/etc/containerd/config.toml" machine # [ 19.389274] k3s[881]: time="2026-09-25T15:13:14Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:49738: runtime core not ready" machine # [ 19.473229] k3s[881]: I0925 15:13:14.202185 881 shared_informer.go:349] "Waiting for caches to sync" controller="node_authorizer" machine # [ 19.476485] k3s[881]: I0925 15:13:14.205248 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 19.477755] k3s[881]: I0925 15:13:14.206536 881 plugins.go:157] Loaded 14 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,PodTopologyLabels,MutatingAdmissionPolicy,MutatingAdmissionWebhook. machine # [ 19.482533] k3s[881]: I0925 15:13:14.206562 881 plugins.go:160] Loaded 14 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,NodeDeclaredFeatureValidator,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. machine # [ 19.487592] k3s[881]: I0925 15:13:14.206856 881 instance.go:240] Using reconciler: lease machine # [ 19.488887] k3s[881]: I0925 15:13:14.215273 881 handler.go:304] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager machine # [ 19.490587] k3s[881]: W0925 15:13:14.215296 881 genericapiserver.go:787] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. machine # [ 19.492467] k3s[881]: I0925 15:13:14.217465 881 cidrallocator.go:198] starting ServiceCIDR Allocator Controller machine # [ 19.515635] k3s[881]: time="2026-09-25T15:13:14Z" level=info msg="Running kube-proxy --cluster-cidr=10.42.0.0/16 --conntrack-max-per-core=0 --conntrack-tcp-timeout-close-wait=0s --conntrack-tcp-timeout-established=0s --healthz-bind-address=127.0.0.1 --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubeproxy.kubeconfig --proxy-mode=iptables" machine # [ 19.520387] k3s[881]: I0925 15:13:14.249389 881 handler.go:304] Adding GroupVersion v1 to ResourceManager machine # [ 19.520966] k3s[881]: I0925 15:13:14.249573 881 apis.go:112] API group "internal.apiserver.k8s.io" is not enabled, skipping. machine # [ 19.552098] k3s[881]: I0925 15:13:14.280907 881 apis.go:112] API group "storagemigration.k8s.io" is not enabled, skipping. machine # [ 19.597233] k3s[881]: I0925 15:13:14.326192 881 handler.go:304] Adding GroupVersion authentication.k8s.io v1 to ResourceManager machine # [ 19.597799] k3s[881]: W0925 15:13:14.326229 881 genericapiserver.go:787] Skipping API authentication.k8s.io/v1beta1 because it has no resources. machine # [ 19.598464] k3s[881]: W0925 15:13:14.326242 881 genericapiserver.go:787] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. machine # [ 19.599054] k3s[881]: I0925 15:13:14.326669 881 handler.go:304] Adding GroupVersion authorization.k8s.io v1 to ResourceManager machine # [ 19.599422] k3s[881]: W0925 15:13:14.326686 881 genericapiserver.go:787] Skipping API authorization.k8s.io/v1beta1 because it has no resources. machine # [ 19.599941] k3s[881]: I0925 15:13:14.327342 881 handler.go:304] Adding GroupVersion autoscaling v2 to ResourceManager machine # [ 19.600616] k3s[881]: I0925 15:13:14.327843 881 handler.go:304] Adding GroupVersion autoscaling v1 to ResourceManager machine # [ 19.601233] k3s[881]: W0925 15:13:14.327864 881 genericapiserver.go:787] Skipping API autoscaling/v2beta1 because it has no resources. machine # [ 19.601696] k3s[881]: W0925 15:13:14.327879 881 genericapiserver.go:787] Skipping API autoscaling/v2beta2 because it has no resources. machine # [ 19.602794] k3s[881]: I0925 15:13:14.328956 881 handler.go:304] Adding GroupVersion batch v1 to ResourceManager machine # [ 19.603464] k3s[881]: W0925 15:13:14.328974 881 genericapiserver.go:787] Skipping API batch/v1beta1 because it has no resources. machine # [ 19.603983] k3s[881]: I0925 15:13:14.329615 881 handler.go:304] Adding GroupVersion certificates.k8s.io v1 to ResourceManager machine # [ 19.604662] k3s[881]: W0925 15:13:14.329631 881 genericapiserver.go:787] Skipping API certificates.k8s.io/v1beta1 because it has no resources. machine # [ 19.605210] k3s[881]: W0925 15:13:14.329642 881 genericapiserver.go:787] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. machine # [ 19.605672] k3s[881]: I0925 15:13:14.330011 881 handler.go:304] Adding GroupVersion coordination.k8s.io v1 to ResourceManager machine # [ 19.606234] k3s[881]: W0925 15:13:14.330025 881 genericapiserver.go:787] Skipping API coordination.k8s.io/v1beta1 because it has no resources. machine # [ 19.606705] k3s[881]: W0925 15:13:14.330036 881 genericapiserver.go:787] Skipping API coordination.k8s.io/v1alpha2 because it has no resources. machine # [ 19.607405] k3s[881]: I0925 15:13:14.330435 881 handler.go:304] Adding GroupVersion discovery.k8s.io v1 to ResourceManager machine # [ 19.607935] k3s[881]: W0925 15:13:14.330451 881 genericapiserver.go:787] Skipping API discovery.k8s.io/v1beta1 because it has no resources. machine # [ 19.608637] k3s[881]: I0925 15:13:14.331948 881 handler.go:304] Adding GroupVersion networking.k8s.io v1 to ResourceManager machine # [ 19.609158] k3s[881]: W0925 15:13:14.331968 881 genericapiserver.go:787] Skipping API networking.k8s.io/v1beta1 because it has no resources. machine # [ 19.609594] k3s[881]: I0925 15:13:14.332280 881 handler.go:304] Adding GroupVersion node.k8s.io v1 to ResourceManager machine # [ 19.610192] k3s[881]: W0925 15:13:14.332294 881 genericapiserver.go:787] Skipping API node.k8s.io/v1beta1 because it has no resources. machine # [ 19.610651] k3s[881]: W0925 15:13:14.332305 881 genericapiserver.go:787] Skipping API node.k8s.io/v1alpha1 because it has no resources. machine # [ 19.611308] k3s[881]: I0925 15:13:14.332773 881 handler.go:304] Adding GroupVersion policy v1 to ResourceManager machine # [ 19.611703] k3s[881]: W0925 15:13:14.332788 881 genericapiserver.go:787] Skipping API policy/v1beta1 because it has no resources. machine # [ 19.612403] k3s[881]: I0925 15:13:14.333804 881 handler.go:304] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager machine # [ 19.612924] k3s[881]: W0925 15:13:14.333820 881 genericapiserver.go:787] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. machine # [ 19.613554] k3s[881]: W0925 15:13:14.333832 881 genericapiserver.go:787] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. machine # [ 19.614123] k3s[881]: I0925 15:13:14.334156 881 handler.go:304] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager machine # [ 19.614566] k3s[881]: W0925 15:13:14.334169 881 genericapiserver.go:787] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. machine # [ 19.615166] k3s[881]: W0925 15:13:14.334180 881 genericapiserver.go:787] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. machine # [ 19.615628] k3s[881]: I0925 15:13:14.335650 881 handler.go:304] Adding GroupVersion storage.k8s.io v1 to ResourceManager machine # [ 19.616179] k3s[881]: W0925 15:13:14.335669 881 genericapiserver.go:787] Skipping API storage.k8s.io/v1beta1 because it has no resources. machine # [ 19.616655] k3s[881]: W0925 15:13:14.335679 881 genericapiserver.go:787] Skipping API storage.k8s.io/v1alpha1 because it has no resources. machine # [ 19.617237] k3s[881]: I0925 15:13:14.336424 881 handler.go:304] Adding GroupVersion flowcontrol.apiserver.k8s.io v1 to ResourceManager machine # [ 19.617670] k3s[881]: W0925 15:13:14.336440 881 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta3 because it has no resources. machine # [ 19.618364] k3s[881]: W0925 15:13:14.336451 881 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta2 because it has no resources. machine # [ 19.618856] k3s[881]: W0925 15:13:14.336461 881 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. machine # [ 19.619640] k3s[881]: I0925 15:13:14.339127 881 handler.go:304] Adding GroupVersion apps v1 to ResourceManager machine # [ 19.620236] k3s[881]: W0925 15:13:14.339145 881 genericapiserver.go:787] Skipping API apps/v1beta2 because it has no resources. machine # [ 19.620755] k3s[881]: W0925 15:13:14.339156 881 genericapiserver.go:787] Skipping API apps/v1beta1 because it has no resources. machine # [ 19.621431] k3s[881]: I0925 15:13:14.341054 881 handler.go:304] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager machine # [ 19.621983] k3s[881]: W0925 15:13:14.341071 881 genericapiserver.go:787] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. machine # [ 19.622626] k3s[881]: W0925 15:13:14.341104 881 genericapiserver.go:787] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. machine # [ 19.623241] k3s[881]: I0925 15:13:14.341750 881 handler.go:304] Adding GroupVersion events.k8s.io v1 to ResourceManager machine # [ 19.624567] k3s[881]: W0925 15:13:14.341766 881 genericapiserver.go:787] Skipping API events.k8s.io/v1beta1 because it has no resources. machine # [ 19.626132] k3s[881]: I0925 15:13:14.343994 881 handler.go:304] Adding GroupVersion resource.k8s.io v1 to ResourceManager machine # [ 19.627558] k3s[881]: W0925 15:13:14.344012 881 genericapiserver.go:787] Skipping API resource.k8s.io/v1beta2 because it has no resources. machine # [ 19.629073] k3s[881]: W0925 15:13:14.344024 881 genericapiserver.go:787] Skipping API resource.k8s.io/v1beta1 because it has no resources. machine # [ 19.630580] k3s[881]: W0925 15:13:14.344033 881 genericapiserver.go:787] Skipping API resource.k8s.io/v1alpha3 because it has no resources. machine # [ 19.656564] k3s[881]: I0925 15:13:14.385523 881 handler.go:304] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager machine # [ 19.657449] k3s[881]: W0925 15:13:14.385569 881 genericapiserver.go:787] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. machine # [ 20.004535] k3s[881]: I0925 15:13:14.733380 881 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 20.012309] k3s[881]: I0925 15:13:14.733408 881 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 20.017188] k3s[881]: I0925 15:13:14.733778 881 secure_serving.go:211] Serving securely on 127.0.0.1:6444 machine # [ 20.019769] k3s[881]: I0925 15:13:14.733823 881 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 20.024876] k3s[881]: I0925 15:13:14.733898 881 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 20.027469] k3s[881]: I0925 15:13:14.734172 881 dynamic_serving_content.go:135] "Starting controller" name="aggregator-proxy-cert::/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt::/var/lib/rancher/k3s/server/tls/client-auth-proxy.key" machine # [ 20.032451] k3s[881]: I0925 15:13:14.734303 881 remote_available_controller.go:425] Starting RemoteAvailability controller machine # [ 20.035212] k3s[881]: I0925 15:13:14.734317 881 cache.go:32] Waiting for caches to sync for RemoteAvailability controller machine # [ 20.037427] k3s[881]: I0925 15:13:14.734454 881 apiservice_controller.go:100] Starting APIServiceRegistrationController machine # [ 20.038837] k3s[881]: I0925 15:13:14.734475 881 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller machine # [ 20.040508] k3s[881]: I0925 15:13:14.734501 881 local_available_controller.go:156] Starting LocalAvailability controller machine # [ 20.042099] k3s[881]: I0925 15:13:14.734533 881 aggregator.go:185] waiting for initial CRD sync... machine # [ 20.043318] k3s[881]: I0925 15:13:14.734536 881 cache.go:32] Waiting for caches to sync for LocalAvailability controller machine # [ 20.044681] k3s[881]: I0925 15:13:14.734586 881 controller.go:113] "Deleting old lease on startup" lease="kube-system/apiserver-ik4pcwfs7qgdl76byc4pomgvia" machine # [ 20.046464] k3s[881]: I0925 15:13:14.734637 881 controller.go:78] Starting OpenAPI AggregationController machine # [ 20.047761] k3s[881]: I0925 15:13:14.734714 881 controller.go:80] Starting OpenAPI V3 AggregationController machine # [ 20.049153] k3s[881]: I0925 15:13:14.735001 881 apf_controller.go:377] Starting API Priority and Fairness config controller machine # [ 20.050827] k3s[881]: time="2026-09-25T15:13:14Z" level=info msg="Starting apiserver lease garbage collector" logger=k3s machine # [ 20.052277] k3s[881]: time="2026-09-25T15:13:14Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 20.053551] k3s[881]: I0925 15:13:14.735190 881 system_namespaces_controller.go:66] Starting system namespaces controller machine # [ 20.055085] k3s[881]: I0925 15:13:14.735228 881 cluster_authentication_trust_controller.go:459] Starting cluster_authentication_trust_controller controller machine # [ 20.056811] k3s[881]: I0925 15:13:14.735241 881 crdregistration_controller.go:114] Starting crd-autoregister controller machine # [ 20.058212] k3s[881]: I0925 15:13:14.735265 881 shared_informer.go:349] "Waiting for caches to sync" controller="crd-autoregister" machine # [ 20.059709] k3s[881]: time="2026-09-25T15:13:14Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 20.060919] k3s[881]: time="2026-09-25T15:13:14Z" level=info msg="Starting legacy_token_tracking_controller" logger=k3s machine # [ 20.062367] k3s[881]: time="2026-09-25T15:13:14Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 20.063549] k3s[881]: I0925 15:13:14.735496 881 default_servicecidr_controller.go:110] Starting kubernetes-service-cidr-controller machine # [ 20.065092] k3s[881]: I0925 15:13:14.735511 881 shared_informer.go:349] "Waiting for caches to sync" controller="kubernetes-service-cidr-controller" machine # [ 20.066731] k3s[881]: I0925 15:13:14.735653 881 repairip.go:210] Starting ipallocator-repair-controller machine # [ 20.068092] k3s[881]: I0925 15:13:14.735668 881 shared_informer.go:349] "Waiting for caches to sync" controller="ipallocator-repair-controller" machine # [ 20.069792] k3s[881]: I0925 15:13:14.736971 881 customresource_discovery_controller.go:294] Starting DiscoveryController machine # [ 20.071276] k3s[881]: I0925 15:13:14.737284 881 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 20.073238] k3s[881]: I0925 15:13:14.737459 881 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 20.075235] k3s[881]: I0925 15:13:14.738345 881 controller.go:142] Starting OpenAPI controller machine # [ 20.076379] k3s[881]: I0925 15:13:14.738520 881 controller.go:90] Starting OpenAPI V3 controller machine # [ 20.077572] k3s[881]: I0925 15:13:14.738597 881 naming_controller.go:305] Starting NamingConditionController machine # [ 20.078921] k3s[881]: I0925 15:13:14.738747 881 nonstructuralschema_controller.go:202] Starting NonStructuralSchemaConditionController machine # [ 20.080504] k3s[881]: I0925 15:13:14.738814 881 apiapproval_controller.go:196] Starting KubernetesAPIApprovalPolicyConformantConditionController machine # [ 20.082201] k3s[881]: I0925 15:13:14.738882 881 crd_finalizer.go:273] Starting CRDFinalizer machine # [ 20.083332] k3s[881]: I0925 15:13:14.802683 881 shared_informer.go:356] "Caches are synced" controller="node_authorizer" machine # [ 20.084721] k3s[881]: I0925 15:13:14.805982 881 shared_informer.go:377] "Caches are synced" machine # [ 20.085923] k3s[881]: I0925 15:13:14.806021 881 policy_source.go:248] refreshing policies machine # [ 20.105938] k3s[881]: I0925 15:13:14.834942 881 cache.go:39] Caches are synced for LocalAvailability controller machine # [ 20.107392] k3s[881]: I0925 15:13:14.834990 881 cache.go:39] Caches are synced for APIServiceRegistrationController controller machine # [ 20.109019] k3s[881]: I0925 15:13:14.835113 881 handler_discovery.go:451] Starting ResourceDiscoveryManager machine # [ 20.110462] k3s[881]: time="2026-09-25T15:13:14Z" level=info msg="Caches are synced" logger=k3s machine # [ 20.111703] k3s[881]: I0925 15:13:14.835389 881 shared_informer.go:356] "Caches are synced" controller="crd-autoregister" machine # [ 20.113217] k3s[881]: time="2026-09-25T15:13:14Z" level=info msg="Caches are synced" logger=k3s machine # [ 20.114467] k3s[881]: E0925 15:13:14.835569 881 controller.go:201] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" machine # [ 20.116496] k3s[881]: I0925 15:13:14.835657 881 aggregator.go:187] initial CRD sync complete... machine # [ 20.120114] k3s[881]: I0925 15:13:14.835689 881 autoregister_controller.go:144] Starting autoregister controller machine # [ 20.121611] k3s[881]: I0925 15:13:14.835720 881 cache.go:32] Waiting for caches to sync for autoregister controller machine # [ 20.123126] k3s[881]: I0925 15:13:14.835747 881 cache.go:39] Caches are synced for autoregister controller machine # [ 20.124511] k3s[881]: I0925 15:13:14.835834 881 shared_informer.go:356] "Caches are synced" controller="ipallocator-repair-controller" machine # [ 20.126157] k3s[881]: I0925 15:13:14.844057 881 controller.go:667] quota admission added evaluator for: namespaces machine # [ 20.127577] k3s[881]: I0925 15:13:14.846911 881 shared_informer.go:356] "Caches are synced" controller="kubernetes-service-cidr-controller" machine # [ 20.129287] k3s[881]: I0925 15:13:14.846982 881 default_servicecidr_controller.go:169] Creating default ServiceCIDR with CIDRs: [10.43.0.0/16] machine # [ 20.131083] k3s[881]: time="2026-09-25T15:13:14Z" level=info msg="Caches are synced" logger=k3s machine # [ 20.132323] k3s[881]: I0925 15:13:14.847541 881 apf_controller.go:382] Running API Priority and Fairness config worker machine # [ 20.133763] k3s[881]: I0925 15:13:14.847557 881 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process machine # [ 20.135453] k3s[881]: I0925 15:13:14.847621 881 cache.go:39] Caches are synced for RemoteAvailability controller machine # [ 20.136902] k3s[881]: I0925 15:13:14.858675 881 cidrallocator.go:302] created ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 20.138455] k3s[881]: I0925 15:13:14.860882 881 default_servicecidr_controller.go:231] Setting default ServiceCIDR condition Ready to True machine # [ 20.142505] k3s[881]: I0925 15:13:14.871256 881 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 20.170700] k3s[881]: I0925 15:13:14.899669 881 alloc.go:329] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.43.0.1"} machine # [ 20.177788] k3s[881]: W0925 15:13:14.906797 881 lease.go:265] Resetting endpoints for master service "kubernetes" to [10.0.2.15] machine # [ 20.179777] k3s[881]: I0925 15:13:14.908748 881 controller.go:667] quota admission added evaluator for: endpoints machine # [ 20.189778] k3s[881]: I0925 15:13:14.916618 881 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io machine # [ 20.195518] k3s[881]: E0925 15:13:14.924530 881 controller.go:102] Error removing old endpoints from kubernetes service: no API server IP addresses were listed in storage, refusing to erase all endpoints for the kubernetes Service machine # [ 20.300204] k3s[881]: time="2026-09-25T15:13:15Z" level=info msg="containerd is now running" machine # [ 20.311417] k3s[881]: time="2026-09-25T15:13:15Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/k3s-airgap-images-amd64.tar.zst" machine # [ 20.332322] k3s[881]: I0925 15:13:15.061166 881 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io machine # [ 21.013583] k3s[881]: I0925 15:13:15.742219 881 storage_scheduling.go:123] created PriorityClass system-node-critical with value 2000001000 machine # [ 21.019320] k3s[881]: I0925 15:13:15.748124 881 storage_scheduling.go:123] created PriorityClass system-cluster-critical with value 2000000000 machine # [ 21.020143] k3s[881]: I0925 15:13:15.748150 881 storage_scheduling.go:139] all system priority classes are created successfully or already exist. machine # [ 21.280537] k3s[881]: time="2026-09-25T15:13:16Z" level=info msg="Polling for API server readiness: GET /readyz failed: unknown" machine # [ 21.964104] k3s[881]: I0925 15:13:16.692598 881 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io machine # [ 22.007689] k3s[881]: I0925 15:13:16.736661 881 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io machine # [ 23.281068] k3s[881]: time="2026-09-25T15:13:18Z" level=info msg="Waiting for untainted node" machine # [ 23.285070] k3s[881]: time="2026-09-25T15:13:18Z" level=info msg="Creating k3s-supervisor event broadcaster" machine # [ 23.285530] k3s[881]: time="2026-09-25T15:13:18Z" level=info msg="Kube API server is now running" machine # [ 23.286025] k3s[881]: time="2026-09-25T15:13:18Z" level=info msg="k3s is up and running" machine # [ 23.286466] k3s[881]: time="2026-09-25T15:13:18Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Node and Certificate Authority certificates managed by k3s are OK" object=machine reason=CertificateExpirationOK type=Normal machine # [ 23.287189] systemd[1]: Started k3s service. machine # [ 23.292041] systemd[1]: Starting niks3 server... machine # [ 23.308854] k3s[881]: I0925 15:13:18.037714 881 controllermanager.go:189] "Starting" version="v1.35.8+k3s1" machine # [ 23.309649] k3s[881]: I0925 15:13:18.037747 881 controllermanager.go:191] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 23.314692] k3s[881]: I0925 15:13:18.043669 881 secure_serving.go:211] Serving securely on 127.0.0.1:10257 machine # [ 23.315625] k3s[881]: I0925 15:13:18.044644 881 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 23.316662] k3s[881]: I0925 15:13:18.044728 881 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 23.317578] k3s[881]: I0925 15:13:18.044746 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 23.318583] k3s[881]: I0925 15:13:18.044790 881 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key" machine # [ 23.319227] k3s[881]: I0925 15:13:18.044903 881 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 23.320058] k3s[881]: I0925 15:13:18.044922 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 23.320824] k3s[881]: I0925 15:13:18.044951 881 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 23.321647] k3s[881]: I0925 15:13:18.044967 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 23.336581] k3s[881]: I0925 15:13:18.065494 881 controller.go:667] quota admission added evaluator for: serviceaccounts machine # [ 23.366241] k3s[881]: I0925 15:13:18.095108 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="jobs.batch" machine # [ 23.366770] k3s[881]: I0925 15:13:18.095166 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="roles.rbac.authorization.k8s.io" machine # [ 23.366926] k3s[881]: I0925 15:13:18.095196 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="networkpolicies.networking.k8s.io" machine # [ 23.367634] k3s[881]: I0925 15:13:18.095241 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="serviceaccounts" machine # [ 23.368435] k3s[881]: I0925 15:13:18.095268 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="limitranges" machine # [ 23.369108] k3s[881]: I0925 15:13:18.095299 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="daemonsets.apps" machine # [ 23.369694] k3s[881]: I0925 15:13:18.095352 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="ingresses.networking.k8s.io" machine # [ 23.370354] k3s[881]: I0925 15:13:18.095380 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="controllerrevisions.apps" machine # [ 23.370861] k3s[881]: I0925 15:13:18.095428 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="rolebindings.rbac.authorization.k8s.io" machine # [ 23.371493] k3s[881]: I0925 15:13:18.095486 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="horizontalpodautoscalers.autoscaling" machine # [ 23.372518] k3s[881]: I0925 15:13:18.095515 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="csistoragecapacities.storage.k8s.io" machine # [ 23.372844] k3s[881]: I0925 15:13:18.095541 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="leases.coordination.k8s.io" machine # [ 23.373356] k3s[881]: I0925 15:13:18.095597 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="podtemplates" machine # [ 23.373806] k3s[881]: I0925 15:13:18.095622 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="deployments.apps" machine # [ 23.374659] k3s[881]: I0925 15:13:18.095650 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="replicasets.apps" machine # [ 23.375183] k3s[881]: I0925 15:13:18.095676 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="cronjobs.batch" machine # [ 23.375618] k3s[881]: I0925 15:13:18.095703 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="resourceclaimtemplates.resource.k8s.io" machine # [ 23.376300] k3s[881]: I0925 15:13:18.095728 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpointslices.discovery.k8s.io" machine # [ 23.376933] k3s[881]: I0925 15:13:18.095767 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpoints" machine # [ 23.377546] k3s[881]: I0925 15:13:18.095808 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="statefulsets.apps" machine # [ 23.378073] k3s[881]: I0925 15:13:18.095841 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="poddisruptionbudgets.policy" machine # [ 23.378795] k3s[881]: I0925 15:13:18.107799 881 controllermanager.go:627] "Warning: controller is disabled" controller="bootstrap-signer-controller" machine # [ 23.395418] k3s[881]: I0925 15:13:18.124396 881 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" requiredFeatureGates=["ClusterTrustBundle"] machine # [ 23.396448] k3s[881]: I0925 15:13:18.124442 881 controllermanager.go:579] "Warning: skipping controller" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" machine # [ 23.412626] k3s[881]: I0925 15:13:18.141507 881 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="podcertificaterequest-cleaner-controller" requiredFeatureGates=["PodCertificateRequest"] machine # [ 23.413795] k3s[881]: I0925 15:13:18.141535 881 controllermanager.go:579] "Warning: skipping controller" controller="podcertificaterequest-cleaner-controller" machine # [ 23.414441] k3s[881]: time="2026-09-25T15:13:18Z" level=info msg="Creating embedded CRD addons.k3s.cattle.io" machine # [ 23.416027] k3s[881]: I0925 15:13:18.145032 881 shared_informer.go:377] "Caches are synced" machine # [ 23.417379] k3s[881]: I0925 15:13:18.146227 881 shared_informer.go:377] "Caches are synced" machine # [ 23.418261] k3s[881]: I0925 15:13:18.146311 881 shared_informer.go:377] "Caches are synced" machine # [ 23.420867] k3s[881]: I0925 15:13:18.149870 881 controllermanager.go:627] "Warning: controller is disabled" controller="selinux-warning-controller" machine # [ 23.422298] k3s[881]: time="2026-09-25T15:13:18Z" level=info msg="Creating embedded CRD etcdsnapshotfiles.k3s.cattle.io" machine # [ 23.428843] k3s[881]: time="2026-09-25T15:13:18Z" level=info msg="Creating embedded CRD helmcharts.helm.cattle.io" machine # [ 23.439478] k3s[881]: I0925 15:13:18.168455 881 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 23.442434] k3s[881]: time="2026-09-25T15:13:18Z" level=info msg="Creating embedded CRD helmchartconfigs.helm.cattle.io" machine # [ 23.453214] k3s[881]: I0925 15:13:18.182241 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 23.461301] k3s[881]: time="2026-09-25T15:13:18Z" level=info msg="Waiting for CRD etcdsnapshotfiles.k3s.cattle.io to become available" machine # [ 23.462051] k3s[881]: I0925 15:13:18.190886 881 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 23.467573] k3s[881]: time="2026-09-25T15:13:18Z" level=info msg="Done waiting for CRD etcdsnapshotfiles.k3s.cattle.io to become available" machine # [ 23.469250] k3s[881]: time="2026-09-25T15:13:18Z" level=info msg="Waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 23.476136] k3s[881]: I0925 15:13:18.204862 881 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 23.480878] k3s[881]: I0925 15:13:18.209893 881 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine: (finished: waiting for unit k3s.service, in 24.58 seconds) machine: waiting for success: kubectl get ns farm machine # [ 23.754588] k3s[881]: I0925 15:13:18.483478 881 shared_informer.go:377] "Caches are synced" machine # [ 23.783870] k3s[881]: time="2026-09-25T15:13:18Z" level=info msg="Imported docker.io/rancher/klipper-helm:v0.13.3-build20260727" machine # [ 23.786269] k3s[881]: time="2026-09-25T15:13:18Z" level=info msg="Tagged docker.io/rancher/klipper-helm@sha256:5425a2b4613d2458dbdff99218e8d487ebb59c20e7a941f061c0777070f0aac1" machine # [ 23.786880] k3s[881]: time="2026-09-25T15:13:18Z" level=info msg="Imported docker.io/rancher/klipper-lb:v0.4.17" machine # [ 23.793594] k3s[881]: time="2026-09-25T15:13:18Z" level=info msg="Tagged docker.io/rancher/klipper-lb@sha256:910944bb0bd94f060a82a56ca1ea1c577d3e49b3473a093a47a985f32e92d94a" machine # [ 23.794391] k3s[881]: time="2026-09-25T15:13:18Z" level=info msg="Imported docker.io/rancher/local-path-provisioner:v0.0.37" machine # [ 23.800758] k3s[881]: time="2026-09-25T15:13:18Z" level=info msg="Tagged docker.io/rancher/local-path-provisioner@sha256:e757967a5ec338f6a9b371c5a9688bedaa8c3578ea3dd4db329ea0084be0a86f" machine # [ 23.801461] k3s[881]: time="2026-09-25T15:13:18Z" level=info msg="Imported docker.io/rancher/mirrored-coredns-coredns:1.14.6" machine # [ 23.807112] k3s[881]: time="2026-09-25T15:13:18Z" level=info msg="Tagged docker.io/rancher/mirrored-coredns-coredns@sha256:900f9c109f7a33545d3c811516e8376df9019147b750f5ce3e254468769176ea" machine # [ 23.809857] k3s[881]: time="2026-09-25T15:13:18Z" level=info msg="Imported docker.io/rancher/mirrored-library-busybox:1.37.0" machine # [ 23.818679] k3s[881]: time="2026-09-25T15:13:18Z" level=info msg="Tagged docker.io/rancher/mirrored-library-busybox@sha256:101b4afd76732482eff9b95cae5f94bcf295e521fbec4e01b69c5421f3f3f3e5" machine # [ 23.820234] k3s[881]: time="2026-09-25T15:13:18Z" level=info msg="Imported docker.io/rancher/mirrored-library-traefik:3.7.8" machine # [ 23.822835] k3s[881]: time="2026-09-25T15:13:18Z" level=info msg="Tagged docker.io/rancher/mirrored-library-traefik@sha256:4299bbed850421258fc5448c2e0e6ad350981d4d335a68de11b92448aedbefe5" machine # [ 23.823485] k3s[881]: time="2026-09-25T15:13:18Z" level=info msg="Imported docker.io/rancher/mirrored-metrics-server:v0.9.0" machine # [ 23.830873] k3s[881]: time="2026-09-25T15:13:18Z" level=info msg="Tagged docker.io/rancher/mirrored-metrics-server@sha256:d9862115e7c7881280d3d75ca26bda8ffc0fc213315979575bf23ce9826205c0" machine # [ 23.831536] k3s[881]: time="2026-09-25T15:13:18Z" level=info msg="Imported docker.io/rancher/mirrored-pause:3.10.2" machine # [ 23.837472] k3s[881]: time="2026-09-25T15:13:18Z" level=info msg="Tagged docker.io/rancher/mirrored-pause@sha256:f548e0e8e3dc1896ca956272154dde3314e8cc4fde0a57577ee9fa1c63f5baf4" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 23.977224] k3s[881]: time="2026-09-25T15:13:18Z" level=info msg="Done waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 23.978080] k3s[881]: time="2026-09-25T15:13:18Z" level=info msg="Waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 23.979568] k3s[881]: time="2026-09-25T15:13:18Z" level=info msg="Done waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 23.980067] k3s[881]: time="2026-09-25T15:13:18Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-40.1.4+up40.1.0.tgz" machine # [ 23.980638] k3s[881]: time="2026-09-25T15:13:18Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-crd-40.1.4+up40.1.0.tgz" machine # [ 23.981210] k3s[881]: time="2026-09-25T15:13:18Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/ccm.yaml" machine # [ 23.981640] k3s[881]: time="2026-09-25T15:13:18Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/coredns.yaml" machine # [ 23.982444] k3s[881]: time="2026-09-25T15:13:18Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/local-storage.yaml" machine # [ 23.982992] k3s[881]: time="2026-09-25T15:13:18Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/rolebindings.yaml" machine # [ 23.983433] k3s[881]: time="2026-09-25T15:13:18Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/runtimes.yaml" machine # [ 23.983973] k3s[881]: time="2026-09-25T15:13:18Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/traefik.yaml" machine # [ 24.047289] k3s[881]: time="2026-09-25T15:13:18Z" level=info msg="Tunnel server egress proxy mode: agent" machine # [ 24.048782] k3s[881]: time="2026-09-25T15:13:18Z" level=info msg="Starting dynamiclistener CN filter node controller with SANs: [127.0.0.1 ::1 localhost machine 10.0.2.15 fec0::f7cb:f594:f394:d938 10.43.0.1 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local]" machine # [ 24.135445] k3s[881]: time="2026-09-25T15:13:18Z" level=info msg="Imported 8 images from /var/lib/rancher/k3s/agent/images/k3s-airgap-images-amd64.tar.zst in 3.824731634s" machine # [ 24.137757] k3s[881]: time="2026-09-25T15:13:18Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-client.tar" machine # [ 24.379507] k3s[881]: I0925 15:13:19.107978 881 controllermanager.go:627] "Warning: controller is disabled" controller="node-route-controller" machine # [ 24.412264] k3s[881]: time="2026-09-25T15:13:19Z" level=info msg="Creating new TLS secret for kube-system/k3s-serving (count: 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__f7cb_f594_f394_d938-ddba68:fec0::f7cb:f594:f394:d938 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=7EFB415A54D93B98E61B14144528A95731A77D40]" machine # [ 24.439485] k3s[881]: time="2026-09-25T15:13:19Z" level=info msg="Active TLS secret kube-system/k3s-serving (ver=236) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__f7cb_f594_f394_d938-ddba68:fec0::f7cb:f594:f394:d938 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=7EFB415A54D93B98E61B14144528A95731A77D40]" machine # [ 24.529790] k3s[881]: W0925 15:13:19.258737 881 probe.go:272] Flexvolume plugin directory at /usr/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating. machine # [ 24.680970] k3s[881]: I0925 15:13:19.409918 881 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="storageversion-garbage-collector-controller" requiredFeatureGates=["APIServerIdentity","StorageVersionAPI"] machine # [ 24.681764] k3s[881]: I0925 15:13:19.409955 881 controllermanager.go:579] "Warning: skipping controller" controller="storageversion-garbage-collector-controller" machine # [ 24.834475] k3s[881]: I0925 15:13:19.563335 881 node_lifecycle_controller.go:419] "Controller will reconcile labels" logger="node-lifecycle-controller" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 25.154595] k3s[881]: time="2026-09-25T15:13:19Z" level=info msg="Starting k3s.cattle.io/v1, Kind=Addon controller" machine # [ 25.155699] k3s[881]: time="2026-09-25T15:13:19Z" level=info msg="Creating deploy event broadcaster" machine # [ 25.162353] k3s[881]: time="2026-09-25T15:13:19Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 25.166056] k3s[881]: time="2026-09-25T15:13:19Z" level=info msg="Creating helm-controller event broadcaster" machine # [ 25.167790] k3s[881]: time="2026-09-25T15:13:19Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 25.175163] k3s[881]: time="2026-09-25T15:13:19Z" level=info msg="Cluster dns configmap has been set successfully" machine # [ 25.630857] k3s[881]: I0925 15:13:20.359136 881 controllermanager.go:579] "Warning: skipping controller" controller="storage-version-migrator-controller" machine # [ 26.080605] k3s[881]: I0925 15:13:20.809510 881 controllermanager.go:627] "Warning: controller is disabled" controller="cloud-node-lifecycle-controller" machine # [ 26.167582] k3s[881]: time="2026-09-25T15:13:20Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 26.232118] k3s[881]: I0925 15:13:20.959607 881 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="device-taint-eviction-controller" requiredFeatureGates=["DynamicResourceAllocation","DRADeviceTaints"] machine # [ 26.232843] k3s[881]: I0925 15:13:20.959669 881 controllermanager.go:579] "Warning: skipping controller" controller="device-taint-eviction-controller" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 26.279579] k3s[881]: time="2026-09-25T15:13:21Z" level=info msg="Starting rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding controller" machine # [ 26.286071] k3s[881]: time="2026-09-25T15:13:21Z" level=info msg="Starting batch/v1, Kind=Job controller" machine # [ 26.286742] k3s[881]: time="2026-09-25T15:13:21Z" level=info msg="Starting /v1, Kind=ServiceAccount controller" machine # [ 26.287561] k3s[881]: time="2026-09-25T15:13:21Z" level=info msg="Starting /v1, Kind=Secret controller" machine # [ 26.288105] k3s[881]: time="2026-09-25T15:13:21Z" level=info msg="Starting /v1, Kind=ConfigMap controller" machine # [ 26.294683] k3s[881]: time="2026-09-25T15:13:21Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChart controller" machine # [ 26.295536] k3s[881]: time="2026-09-25T15:13:21Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChartConfig controller" machine # [ 27.161449] k3s[881]: I0925 15:13:21.889660 881 controller.go:667] quota admission added evaluator for: addons.k3s.cattle.io machine # [ 27.163785] k3s[881]: I0925 15:13:21.892742 881 range_allocator.go:113] "No Secondary Service CIDR provided. Skipping filtering out secondary service addresses" logger="node-ipam-controller" machine # [ 27.168112] k3s[881]: time="2026-09-25T15:13:21Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 27.178934] k3s[881]: time="2026-09-25T15:13:21Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=ApplyingManifest type=Normal machine # Error from server (NotFound): namespaces "farm" not found machine # [ 27.580523] k3s[881]: I0925 15:13:22.309422 881 controllermanager.go:627] "Warning: controller is disabled" controller="service-lb-controller" machine # [ 27.740442] k3s[881]: time="2026-09-25T15:13:22Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=AppliedManifest type=Normal machine # [ 27.759413] k3s[881]: time="2026-09-25T15:13:22Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=ApplyingManifest type=Normal machine # [ 27.882157] k3s[881]: I0925 15:13:22.611022 881 legacy_serviceaccount_token_cleaner.go:103] "Starting legacy service account token cleaner controller" machine # [ 27.882880] k3s[881]: I0925 15:13:22.611101 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.886469] k3s[881]: I0925 15:13:22.615475 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.887167] k3s[881]: I0925 15:13:22.615533 881 gc_controller.go:98] "Starting GC controller" machine # [ 27.887556] k3s[881]: I0925 15:13:22.615547 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.888100] k3s[881]: I0925 15:13:22.615820 881 deployment_controller.go:172] "Starting controller" controller="deployment" machine # [ 27.888545] k3s[881]: I0925 15:13:22.615834 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.890270] k3s[881]: I0925 15:13:22.615912 881 expand_controller.go:328] "Starting expand controller" machine # [ 27.891022] k3s[881]: I0925 15:13:22.615926 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.892253] k3s[881]: I0925 15:13:22.615965 881 pvc_protection_controller.go:166] "Starting PVC protection controller" machine # [ 27.893340] k3s[881]: I0925 15:13:22.615979 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.893780] k3s[881]: I0925 15:13:22.616072 881 endpointslice_controller.go:283] "Starting endpoint slice controller" machine # [ 27.895203] k3s[881]: I0925 15:13:22.616110 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.895568] k3s[881]: I0925 15:13:22.616188 881 replica_set.go:241] "Starting controller" name="replicaset" machine # [ 27.896096] k3s[881]: I0925 15:13:22.616201 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.896697] k3s[881]: I0925 15:13:22.616232 881 pv_protection_controller.go:81] "Starting PV protection controller" machine # [ 27.898828] k3s[881]: I0925 15:13:22.616246 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.899638] k3s[881]: I0925 15:13:22.616299 881 horizontal.go:204] "Starting HPA controller" machine # [ 27.900236] k3s[881]: I0925 15:13:22.616315 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.900685] k3s[881]: I0925 15:13:22.616373 881 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-legacy-unknown" machine # [ 27.901220] k3s[881]: I0925 15:13:22.616387 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.902051] k3s[881]: I0925 15:13:22.616416 881 certificate_controller.go:120] "Starting certificate controller" name="csrapproving" machine # [ 27.902816] k3s[881]: I0925 15:13:22.616428 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.903629] k3s[881]: I0925 15:13:22.616458 881 ttlafterfinished_controller.go:112] "Starting TTL after finished controller" machine # [ 27.904620] k3s[881]: I0925 15:13:22.616472 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.905581] k3s[881]: I0925 15:13:22.616512 881 controller.go:174] "Starting ephemeral volume controller" machine # [ 27.906549] k3s[881]: I0925 15:13:22.616525 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.907058] k3s[881]: I0925 15:13:22.616590 881 endpointslicemirroring_controller.go:226] "Starting EndpointSliceMirroring controller" machine # [ 27.907772] k3s[881]: I0925 15:13:22.616603 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.908555] k3s[881]: I0925 15:13:22.616675 881 replica_set.go:241] "Starting controller" name="replicationcontroller" machine # [ 27.909206] k3s[881]: I0925 15:13:22.616688 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.910051] k3s[881]: I0925 15:13:22.616765 881 job_controller.go:254] "Starting job controller" machine # [ 27.910800] k3s[881]: I0925 15:13:22.616779 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.911599] k3s[881]: I0925 15:13:22.616808 881 cleaner.go:83] "Starting CSR cleaner controller" machine # [ 27.912530] k3s[881]: I0925 15:13:22.616917 881 attach_detach_controller.go:335] "Starting attach detach controller" machine # [ 27.913462] k3s[881]: I0925 15:13:22.616931 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.914375] k3s[881]: I0925 15:13:22.616970 881 vac_protection_controller.go:206] "Starting VAC protection controller" machine # [ 27.915226] k3s[881]: I0925 15:13:22.616981 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.915946] k3s[881]: I0925 15:13:22.617034 881 node_lifecycle_controller.go:453] "Sending events to api server" machine # [ 27.916702] k3s[881]: I0925 15:13:22.617144 881 node_lifecycle_controller.go:460] "Starting node controller" machine # [ 27.917337] k3s[881]: I0925 15:13:22.617154 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.917980] k3s[881]: I0925 15:13:22.617222 881 endpoints_controller.go:193] "Starting endpoint controller" machine # [ 27.918665] k3s[881]: I0925 15:13:22.617237 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.919154] k3s[881]: I0925 15:13:22.617269 881 namespace_controller.go:202] "Starting namespace controller" machine # [ 27.919580] k3s[881]: I0925 15:13:22.617281 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.920114] k3s[881]: I0925 15:13:22.617360 881 stateful_set.go:180] "Starting stateful set controller" machine # [ 27.920520] k3s[881]: I0925 15:13:22.617373 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.921055] k3s[881]: I0925 15:13:22.617404 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.921532] k3s[881]: I0925 15:13:22.617443 881 taint_eviction.go:283] "Starting" controller="taint-eviction-controller" machine # [ 27.922084] k3s[881]: I0925 15:13:22.617511 881 taint_eviction.go:288] "Sending events to API server" machine # [ 27.922503] k3s[881]: I0925 15:13:22.617520 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.922871] k3s[881]: I0925 15:13:22.617555 881 serviceaccounts_controller.go:117] "Starting service account controller" machine # [ 27.923526] k3s[881]: I0925 15:13:22.617568 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.924062] k3s[881]: I0925 15:13:22.617644 881 daemon_controller.go:309] "Starting daemon sets controller" machine # [ 27.924511] k3s[881]: I0925 15:13:22.617656 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.925024] k3s[881]: I0925 15:13:22.617686 881 tokencleaner.go:117] "Starting token cleaner controller" machine # [ 27.925502] k3s[881]: I0925 15:13:22.617698 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.925986] k3s[881]: I0925 15:13:22.617764 881 pv_controller_base.go:307] "Starting persistent volume controller" machine # [ 27.926608] k3s[881]: I0925 15:13:22.617777 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.927123] k3s[881]: I0925 15:13:22.617837 881 servicecidrs_controller.go:136] "Starting" controller="service-cidr-controller" machine # [ 27.927574] k3s[881]: I0925 15:13:22.617848 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.927932] k3s[881]: I0925 15:13:22.618069 881 node_ipam_controller.go:142] "Starting ipam controller" machine # [ 27.928591] k3s[881]: I0925 15:13:22.618107 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.929108] k3s[881]: I0925 15:13:22.618138 881 clusterroleaggregation_controller.go:194] "Starting ClusterRoleAggregator controller" machine # [ 27.929591] k3s[881]: I0925 15:13:22.618151 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.930140] k3s[881]: I0925 15:13:22.618224 881 controller.go:423] "Starting resource claim controller" machine # [ 27.930602] k3s[881]: I0925 15:13:22.618288 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.931134] k3s[881]: I0925 15:13:22.618323 881 disruption.go:458] "Sending events to api server." machine # [ 27.931618] k3s[881]: I0925 15:13:22.618357 881 disruption.go:465] "Starting disruption controller" machine # [ 27.932129] k3s[881]: I0925 15:13:22.618368 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.932567] k3s[881]: I0925 15:13:22.618437 881 cronjob_controllerv2.go:143] "Starting cronjob controller v2" machine # [ 27.933077] k3s[881]: I0925 15:13:22.618449 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.933503] k3s[881]: I0925 15:13:22.618478 881 ttl_controller.go:127] "Starting TTL controller" machine # [ 27.934077] k3s[881]: I0925 15:13:22.618491 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.934513] k3s[881]: I0925 15:13:22.618527 881 publisher.go:107] "Starting root CA cert publisher controller" machine # [ 27.935022] k3s[881]: I0925 15:13:22.618540 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.935461] k3s[881]: I0925 15:13:22.619507 881 resource_quota_controller.go:297] "Starting resource quota controller" machine # [ 27.935938] k3s[881]: I0925 15:13:22.619522 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.936555] k3s[881]: I0925 15:13:22.619607 881 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-serving" machine # [ 27.936883] k3s[881]: I0925 15:13:22.619619 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.937508] k3s[881]: I0925 15:13:22.619648 881 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-client" machine # [ 27.937974] k3s[881]: I0925 15:13:22.619679 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.939100] k3s[881]: I0925 15:13:22.619715 881 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kube-apiserver-client" machine # [ 27.940831] k3s[881]: I0925 15:13:22.619727 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.941992] k3s[881]: I0925 15:13:22.619767 881 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 27.944371] k3s[881]: I0925 15:13:22.620031 881 garbagecollector.go:141] "Starting controller" controller="garbagecollector" machine # [ 27.945604] k3s[881]: I0925 15:13:22.620066 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.985118] k3s[881]: I0925 15:13:22.620837 881 resource_quota_monitor.go:309] "QuotaMonitor running" machine # [ 27.985730] k3s[881]: I0925 15:13:22.620966 881 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 27.986369] k3s[881]: I0925 15:13:22.621048 881 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 27.986862] k3s[881]: I0925 15:13:22.621148 881 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 27.988303] k3s[881]: I0925 15:13:22.621395 881 graph_builder.go:386] "Running" component="GraphBuilder" machine # [ 27.988690] k3s[881]: I0925 15:13:22.643974 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" resource="helmchartconfigs.helm.cattle.io" machine # [ 27.989492] k3s[881]: I0925 15:13:22.644009 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" resource="addons.k3s.cattle.io" machine # [ 27.990469] k3s[881]: I0925 15:13:22.644033 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" resource="helmcharts.helm.cattle.io" machine # [ 27.991020] k3s[881]: I0925 15:13:22.644119 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.991522] k3s[881]: I0925 15:13:22.718826 881 shared_informer.go:377] "Caches are synced" machine # [ 28.009430] k3s[881]: I0925 15:13:22.738446 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.166635] k3s[881]: time="2026-09-25T15:13:22Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 28.381094] k3s[881]: I0925 15:13:23.109372 881 serving.go:392] Generated self-signed cert in-memory machine # [ 28.392992] k3s[881]: time="2026-09-25T15:13:23Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=AppliedManifest type=Normal machine # [ 28.395891] k3s[881]: I0925 15:13:23.124903 881 shared_informer.go:377] "Caches are synced" machine # [ 28.396519] k3s[881]: I0925 15:13:23.125376 881 shared_informer.go:377] "Caches are synced" machine # [ 28.396957] k3s[881]: I0925 15:13:23.125439 881 shared_informer.go:377] "Caches are synced" machine # [ 28.397632] k3s[881]: I0925 15:13:23.125507 881 shared_informer.go:377] "Caches are synced" machine # [ 28.399055] k3s[881]: I0925 15:13:23.125555 881 shared_informer.go:377] "Caches are synced" machine # [ 28.399523] k3s[881]: I0925 15:13:23.125600 881 shared_informer.go:377] "Caches are synced" machine # [ 28.399947] k3s[881]: I0925 15:13:23.125641 881 shared_informer.go:377] "Caches are synced" machine # [ 28.400639] k3s[881]: I0925 15:13:23.125703 881 shared_informer.go:377] "Caches are synced" machine # [ 28.401025] k3s[881]: I0925 15:13:23.125742 881 shared_informer.go:377] "Caches are synced" machine # [ 28.401465] k3s[881]: I0925 15:13:23.125772 881 shared_informer.go:377] "Caches are synced" machine # [ 28.401980] k3s[881]: I0925 15:13:23.125806 881 shared_informer.go:377] "Caches are synced" machine # [ 28.404527] k3s[881]: I0925 15:13:23.125850 881 shared_informer.go:377] "Caches are synced" machine # [ 28.405039] k3s[881]: I0925 15:13:23.125888 881 shared_informer.go:377] "Caches are synced" machine # [ 28.405520] k3s[881]: I0925 15:13:23.125961 881 shared_informer.go:377] "Caches are synced" machine # [ 28.406060] k3s[881]: I0925 15:13:23.126126 881 shared_informer.go:377] "Caches are synced" machine # [ 28.406526] k3s[881]: I0925 15:13:23.126162 881 shared_informer.go:377] "Caches are synced" machine # [ 28.407073] k3s[881]: I0925 15:13:23.126225 881 shared_informer.go:377] "Caches are synced" machine # [ 28.407864] k3s[881]: I0925 15:13:23.126379 881 shared_informer.go:377] "Caches are synced" machine # [ 28.408714] k3s[881]: I0925 15:13:23.126418 881 shared_informer.go:377] "Caches are synced" machine # [ 28.409347] k3s[881]: I0925 15:13:23.126495 881 shared_informer.go:377] "Caches are synced" machine # [ 28.409804] k3s[881]: I0925 15:13:23.126554 881 shared_informer.go:377] "Caches are synced" machine # [ 28.410468] k3s[881]: I0925 15:13:23.126592 881 shared_informer.go:377] "Caches are synced" machine # [ 28.411025] k3s[881]: I0925 15:13:23.126630 881 shared_informer.go:377] "Caches are synced" machine # [ 28.411490] k3s[881]: I0925 15:13:23.126681 881 shared_informer.go:377] "Caches are synced" machine # [ 28.411993] k3s[881]: I0925 15:13:23.126962 881 shared_informer.go:377] "Caches are synced" machine # [ 28.412450] k3s[881]: I0925 15:13:23.127012 881 shared_informer.go:377] "Caches are synced" machine # [ 28.412966] k3s[881]: I0925 15:13:23.127078 881 shared_informer.go:377] "Caches are synced" machine # [ 28.413608] k3s[881]: I0925 15:13:23.127303 881 shared_informer.go:377] "Caches are synced" machine # [ 28.414124] k3s[881]: I0925 15:13:23.127582 881 shared_informer.go:377] "Caches are synced" machine # [ 28.414581] k3s[881]: I0925 15:13:23.127626 881 range_allocator.go:177] "Sending events to api server" machine # [ 28.415085] k3s[881]: I0925 15:13:23.127655 881 range_allocator.go:181] "Starting range CIDR allocator" machine # [ 28.415535] k3s[881]: I0925 15:13:23.127666 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.416029] k3s[881]: I0925 15:13:23.127678 881 shared_informer.go:377] "Caches are synced" machine # [ 28.416463] k3s[881]: I0925 15:13:23.127734 881 shared_informer.go:377] "Caches are synced" machine # [ 28.416988] k3s[881]: I0925 15:13:23.128270 881 shared_informer.go:377] "Caches are synced" machine # [ 28.417583] k3s[881]: I0925 15:13:23.128360 881 shared_informer.go:377] "Caches are synced" machine # [ 28.418096] k3s[881]: I0925 15:13:23.128396 881 shared_informer.go:377] "Caches are synced" machine # [ 28.418533] k3s[881]: I0925 15:13:23.128430 881 shared_informer.go:377] "Caches are synced" machine # [ 28.419145] k3s[881]: I0925 15:13:23.128822 881 shared_informer.go:377] "Caches are synced" machine # [ 28.419502] k3s[881]: I0925 15:13:23.129835 881 shared_informer.go:377] "Caches are synced" machine # [ 28.420017] k3s[881]: I0925 15:13:23.130103 881 shared_informer.go:377] "Caches are synced" machine # [ 28.420472] k3s[881]: I0925 15:13:23.130140 881 shared_informer.go:377] "Caches are synced" machine # [ 28.420950] k3s[881]: I0925 15:13:23.130179 881 shared_informer.go:377] "Caches are synced" machine # [ 28.421555] k3s[881]: I0925 15:13:23.131816 881 shared_informer.go:377] "Caches are synced" machine # [ 28.422098] k3s[881]: I0925 15:13:23.144639 881 shared_informer.go:377] "Caches are synced" machine # [ 28.458737] k3s[881]: time="2026-09-25T15:13:23Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Deferred node password secret validation complete" object=machine reason=NodePasswordValidationComplete type=Normal machine # [ 28.467072] k3s[881]: time="2026-09-25T15:13:23Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=ApplyingManifest type=Normal machine # [ 28.478471] k3s[881]: I0925 15:13:23.207491 881 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 28.493608] k3s[881]: I0925 15:13:23.222584 881 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 28.565662] k3s[881]: I0925 15:13:23.294620 881 serving.go:392] Generated self-signed cert in-memory machine # [ 28.666030] k3s[881]: I0925 15:13:23.394972 881 controllermanager.go:160] Version: v1.35.8+k3s1 machine # [ 28.669940] k3s[881]: I0925 15:13:23.398584 881 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 28.670469] k3s[881]: I0925 15:13:23.398594 881 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 28.670930] k3s[881]: I0925 15:13:23.398615 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.671645] k3s[881]: I0925 15:13:23.398614 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.674096] k3s[881]: I0925 15:13:23.398656 881 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 28.674306] k3s[881]: I0925 15:13:23.398675 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.679812] k3s[881]: I0925 15:13:23.408837 881 secure_serving.go:211] Serving securely on 127.0.0.1:10258 machine # [ 28.680612] k3s[881]: I0925 15:13:23.409580 881 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 28.687543] k3s[881]: time="2026-09-25T15:13:23Z" level=info msg="Creating service-lb-controller event broadcaster" machine: (finished: waiting for success: kubectl get ns farm, in 4.98 seconds) machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key machine # [ 28.869698] k3s[881]: I0925 15:13:23.598671 881 shared_informer.go:377] "Caches are synced" machine # [ 28.870477] k3s[881]: I0925 15:13:23.598718 881 shared_informer.go:377] "Caches are synced" machine # [ 28.870870] k3s[881]: I0925 15:13:23.599128 881 shared_informer.go:377] "Caches are synced" machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key, in 0.17 seconds) machine: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key machine # [ 29.019429] k3s[881]: I0925 15:13:23.747060 881 controller.go:667] quota admission added evaluator for: deployments.apps machine: (finished: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key, in 0.15 seconds) machine: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine # [ 29.036272] k3s[881]: I0925 15:13:23.765264 881 controller.go:667] quota admission added evaluator for: replicasets.apps machine # [ 29.070471] k3s[881]: time="2026-09-25T15:13:23Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 29.075378] k3s[881]: time="2026-09-25T15:13:23Z" level=info msg="Starting /v1, Kind=Pod controller" machine # [ 29.081395] k3s[881]: time="2026-09-25T15:13:23Z" level=info msg="Starting apps/v1, Kind=DaemonSet controller" machine # [ 29.089055] k3s[881]: I0925 15:13:23.817903 881 controllermanager.go:329] Started "cloud-node-controller" machine # [ 29.089687] k3s[881]: I0925 15:13:23.818046 881 controllermanager.go:329] Started "cloud-node-lifecycle-controller" machine # [ 29.090256] k3s[881]: time="2026-09-25T15:13:23Z" level=info msg="Starting discovery.k8s.io/v1, Kind=EndpointSlice controller" machine # [ 29.090661] k3s[881]: I0925 15:13:23.818651 881 node_controller.go:176] Sending events to api server. machine # [ 29.091055] k3s[881]: I0925 15:13:23.818712 881 node_controller.go:185] Waiting for informer caches to sync machine # [ 29.091493] k3s[881]: I0925 15:13:23.818877 881 node_lifecycle_controller.go:112] Sending events to api server machine # [ 29.092479] k3s[881]: I0925 15:13:23.821298 881 shared_informer.go:377] "Caches are synced" machine # [ 29.092978] k3s[881]: I0925 15:13:23.821327 881 garbagecollector.go:166] "Garbage collector: all resource monitors have synced" machine # [ 29.093603] k3s[881]: I0925 15:13:23.821338 881 garbagecollector.go:169] "Proceeding to collect garbage" machine # [ 29.100374] k3s[881]: I0925 15:13:23.829367 881 controllermanager.go:329] Started "service-lb-controller" machine # [ 29.100983] k3s[881]: W0925 15:13:23.829388 881 controllermanager.go:306] "node-route-controller" is disabled machine # [ 29.101972] k3s[881]: I0925 15:13:23.830132 881 controller.go:235] Starting service controller machine # [ 29.102588] k3s[881]: I0925 15:13:23.830167 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.109578] k3s[881]: I0925 15:13:23.838596 881 shared_informer.go:377] "Caches are synced" machine # [ 29.167806] k3s[881]: time="2026-09-25T15:13:23Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 29.201291] k3s[881]: I0925 15:13:23.930237 881 shared_informer.go:377] "Caches are synced" machine: (finished: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.19 seconds) subtest: chart deploys and workers become Ready machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine # [ 29.210439] k3s[881]: I0925 15:13:23.939444 881 alloc.go:329] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.43.0.10"} machine # [ 29.215547] k3s[881]: time="2026-09-25T15:13:23Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=AppliedManifest type=Normal machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 29.661325] k3s[881]: time="2026-09-25T15:13:24Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" object=kube-system/local-storage reason=DeletingManifest type=Normal machine # [ 29.671480] k3s[881]: time="2026-09-25T15:13:24Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=ApplyingManifest type=Normal machine # [ 29.973090] postgres[1203]: [1203] ERROR: relation "goose_db_version" does not exist at character 36 machine # [ 29.973791] postgres[1203]: [1203] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC machine # [ 29.997832] niks3-server[1195]: 2026/09/25 15:13:24 OK 20241026095416_initial_model.sql (11.46ms) machine # [ 30.007181] niks3-server[1195]: 2026/09/25 15:13:24 OK 20251210153512_drop_unused_gin_index.sql (2.36ms) machine # [ 30.011393] niks3-server[1195]: 2026/09/25 15:13:24 OK 20251218171726_add_pins.sql (4.4ms) machine # [ 30.017204] niks3-server[1195]: 2026/09/25 15:13:24 OK 20260628120000_add_object_size_and_stats.sql (4.68ms) machine # [ 30.023221] niks3-server[1195]: 2026/09/25 15:13:24 OK 20260905000000_add_claims.sql (5.97ms) machine # [ 30.027484] niks3-server[1195]: 2026/09/25 15:13:24 OK 20260920000000_drop_claims.sql (3.72ms) machine # [ 30.030856] niks3-server[1195]: 2026/09/25 15:13:24 OK 20260923120000_add_pushes.sql (3.36ms) machine # [ 30.032086] niks3-server[1195]: 2026/09/25 15:13:24 goose: successfully migrated database to version: 20260923120000 machine # [ 30.034676] niks3-server[1195]: 2026/09/25 15:13:24 OK 1_commit_pending_closure.sql (3.69ms) machine # [ 30.037651] niks3-server[1195]: 2026/09/25 15:13:24 OK 2_object_stats_trigger.sql (2.93ms) machine # [ 30.040706] niks3-server[1195]: 2026/09/25 15:13:24 OK 3_commit_push.sql (1.71ms) machine # [ 30.041529] niks3-server[1195]: 2026/09/25 15:13:24 goose: up to current file version: 3 machine # [ 30.045293] niks3-server[1195]: 2026/09/25 15:13:24 INFO OIDC provider initialized name=kubernetes issuer=https://kubernetes.default.svc.cluster.local machine # [ 30.046172] niks3-server[1195]: 2026/09/25 15:13:24 INFO OIDC authentication enabled config=/nix/store/v0b0sqyzhrjsz48x3klf7b7vl89apzs0-niks3-oidc.json machine # [ 30.046872] niks3-server[1195]: 2026/09/25 15:13:24 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key machine # [ 30.074905] niks3-server[1195]: 2026/09/25 15:13:24 INFO Read proxy enabled — serving cache objects from S3 machine # [ 30.075833] niks3-server[1195]: 2026/09/25 15:13:24 INFO Using socket-activated listener address=0.0.0.0:5751 machine # [ 30.076760] niks3-server[1195]: 2026/09/25 15:13:24 INFO systemd watchdog enabled interval=15s machine # [ 30.077900] systemd[1]: Started niks3 server. machine # [ 30.078801] systemd[1]: Reached target Multi-User System. machine # [ 30.079498] niks3-server[1195]: 2026/09/25 15:13:24 INFO Starting HTTP server address=0.0.0.0:5751 machine # [ 30.080523] systemd[1]: Startup finished in 1.217s (kernel) + 3.734s (initrd) + 25.125s (userspace) = 30.077s. machine # [ 30.166469] k3s[881]: time="2026-09-25T15:13:24Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 30.363224] k3s[881]: I0925 15:13:25.091752 881 controller.go:667] quota admission added evaluator for: helmcharts.helm.cattle.io machine # [ 30.368065] k3s[881]: time="2026-09-25T15:13:25Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=AppliedManifest type=Normal machine # [ 30.377546] k3s[881]: time="2026-09-25T15:13:25Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=ApplyingManifest type=Normal machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 31.137501] k3s[881]: time="2026-09-25T15:13:25Z" level=info msg="Imported docker.io/library/nix-grpc-farm-client:0.1.0-beta.4" machine # [ 31.139574] k3s[881]: time="2026-09-25T15:13:25Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-client@sha256:deb8e13781ce517043a4b249f1247364d895c08ca6193c34c5294bfbe5a90dcb" machine # [ 31.166108] k3s[881]: time="2026-09-25T15:13:25Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 31.363640] k3s[881]: time="2026-09-25T15:13:26Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Applying HelmChart from https://%{KUBERNETES_API}%/static/charts/nix-grpc-farm.tgz using Job kube-system/helm-install-nix-grpc-farm " object=kube-system/nix-grpc-farm reason=ApplyJob type=Normal machine # [ 31.391239] k3s[881]: I0925 15:13:26.120121 881 controller.go:667] quota admission added evaluator for: jobs.batch machine # [ 31.433897] k3s[881]: time="2026-09-25T15:13:26Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Resumed synced Job kube-system/helm-install-nix-grpc-farm" object=kube-system/nix-grpc-farm reason=ResumeJob type=Normal machine # [ 31.442606] k3s[881]: time="2026-09-25T15:13:26Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=AppliedManifest type=Normal machine # [ 31.452336] k3s[881]: time="2026-09-25T15:13:26Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=ApplyingManifest type=Normal machine # [ 31.545224] k3s[881]: time="2026-09-25T15:13:26Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-client.tar in 7.409496458s" machine # [ 31.547293] k3s[881]: time="2026-09-25T15:13:26Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-lb.tar" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 32.144445] k3s[881]: time="2026-09-25T15:13:26Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=AppliedManifest type=Normal machine # [ 32.165250] k3s[881]: time="2026-09-25T15:13:26Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 32.356362] k3s[881]: time="2026-09-25T15:13:27Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/traefik.yaml\"" object=kube-system/traefik reason=DeletingManifest type=Normal machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 32.914172] k3s[881]: time="2026-09-25T15:13:27Z" level=info msg="Imported docker.io/library/nix-grpc-farm-lb:0.1.0-beta.4" machine # [ 32.918524] k3s[881]: time="2026-09-25T15:13:27Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-lb@sha256:18ee6724be589622e1aee9d13c5121e7b2c992ca636c935ade90c66423e18f37" machine # [ 32.963432] k3s[881]: time="2026-09-25T15:13:27Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-lb.tar in 1.41797938s" machine # [ 32.965619] k3s[881]: time="2026-09-25T15:13:27Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm.tar" machine # [ 33.168809] k3s[881]: time="2026-09-25T15:13:27Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 33.325926] k3s[881]: time="2026-09-25T15:13:28Z" level=info msg="Running kubelet --cloud-provider=external --config-dir=/var/lib/rancher/k3s/agent/etc/kubelet.conf.d --containerd=/run/k3s/containerd/containerd.sock --eviction-hard=nodefs.available<1%,imagefs.available<1% --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubelet.kubeconfig --node-ip=10.0.2.15,fec0::f7cb:f594:f394:d938 --node-labels= --read-only-port=0" machine # [ 33.338860] k3s[881]: Flag --containerd has been deprecated, This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed. machine # [ 33.358993] k3s[881]: I0925 15:13:28.087859 881 server.go:521] "Kubelet version" kubeletVersion="v1.35.8+k3s1" machine # [ 33.360106] k3s[881]: I0925 15:13:28.087960 881 server.go:523] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 33.361067] k3s[881]: I0925 15:13:28.088024 881 watchdog_linux.go:95] "Systemd watchdog is not enabled" machine # [ 33.361876] k3s[881]: I0925 15:13:28.088074 881 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." machine # [ 33.363237] k3s[881]: I0925 15:13:28.091028 881 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/agent/client-ca.crt" machine # [ 33.380056] k3s[881]: I0925 15:13:28.108875 881 server.go:1414] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" machine # [ 33.391509] k3s[881]: I0925 15:13:28.120469 881 server.go:771] "--cgroups-per-qos enabled, but --cgroup-root was not specified. Defaulting to /" machine # [ 33.394253] k3s[881]: I0925 15:13:28.120528 881 server.go:832] "NoSwap is set due to memorySwapBehavior not specified" memorySwapBehavior="" FailSwapOn=false machine # [ 33.395278] k3s[881]: I0925 15:13:28.120885 881 container_manager_linux.go:272] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] machine # [ 33.396129] k3s[881]: I0925 15:13:28.120927 881 container_manager_linux.go:277] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"machine","RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} machine # [ 33.396892] k3s[881]: I0925 15:13:28.121287 881 topology_manager.go:143] "Creating topology manager with none policy" machine # [ 33.398169] k3s[881]: I0925 15:13:28.121313 881 container_manager_linux.go:308] "Creating device plugin manager" machine # [ 33.398894] k3s[881]: I0925 15:13:28.121439 881 container_manager_linux.go:317] "Creating Dynamic Resource Allocation (DRA) manager" machine # [ 33.399669] k3s[881]: I0925 15:13:28.127032 881 state_mem.go:41] "Initialized" logger="CPUManager state memory" machine # [ 33.403214] k3s[881]: I0925 15:13:28.129911 881 kubelet.go:482] "Attempting to sync node with API server" machine # [ 33.403944] k3s[881]: I0925 15:13:28.129947 881 kubelet.go:383] "Adding static pod path" path="/var/lib/rancher/k3s/agent/pod-manifests" machine # [ 33.404645] k3s[881]: I0925 15:13:28.129998 881 kubelet.go:394] "Adding apiserver pod source" machine # [ 33.406143] k3s[881]: I0925 15:13:28.130028 881 apiserver.go:42] "Waiting for node sync before watching apiserver pods" machine # [ 33.406895] k3s[881]: I0925 15:13:28.132829 881 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="containerd" version="2.2.7-k3s1" apiVersion="v1" machine # [ 33.407728] k3s[881]: I0925 15:13:28.133731 881 kubelet.go:945] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" machine # [ 33.409749] k3s[881]: I0925 15:13:28.133757 881 kubelet.go:972] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" machine # [ 33.410599] k3s[881]: I0925 15:13:28.135879 881 server.go:1252] "Started kubelet" machine # [ 33.411161] k3s[881]: I0925 15:13:28.137275 881 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 machine # [ 33.411563] k3s[881]: I0925 15:13:28.137403 881 server_v1.go:49] "podresources" method="list" useActivePods=true machine # [ 33.412131] k3s[881]: I0925 15:13:28.137703 881 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" machine # [ 33.412571] k3s[881]: I0925 15:13:28.137796 881 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 machine # [ 33.413143] k3s[881]: I0925 15:13:28.138015 881 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" machine # [ 33.414416] k3s[881]: I0925 15:13:28.138651 881 dynamic_serving_content.go:135] "Starting controller" name="kubelet-server-cert-files::/var/lib/rancher/k3s/agent/serving-kubelet.crt::/var/lib/rancher/k3s/agent/serving-kubelet.key" machine # [ 33.415573] k3s[881]: I0925 15:13:28.144577 881 server.go:317] "Adding debug handlers to kubelet server" machine # [ 33.418433] k3s[881]: E0925 15:13:28.147450 881 kubelet_node_status.go:392] "Error getting the current node from lister" err="node \"machine\" not found" machine # [ 33.419224] k3s[881]: I0925 15:13:28.147511 881 volume_manager.go:311] "Starting Kubelet Volume Manager" machine # [ 33.419757] k3s[881]: I0925 15:13:28.147813 881 desired_state_of_world_populator.go:146] "Desired state populator starts to run" machine # [ 33.420818] k3s[881]: I0925 15:13:28.147864 881 reconciler.go:29] "Reconciler: start to sync state" machine # [ 33.424455] k3s[881]: I0925 15:13:28.153447 881 factory.go:223] Registration of the systemd container factory successfully machine # [ 33.425227] k3s[881]: I0925 15:13:28.153571 881 factory.go:221] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory machine # [ 33.432061] k3s[881]: I0925 15:13:28.161032 881 factory.go:223] Registration of the containerd container factory successfully machine # [ 33.432992] k3s[881]: E0925 15:13:28.161994 881 kubelet.go:1661] "Image garbage collection failed once. Stats initialization may not have completed yet" err="invalid capacity 0 on image filesystem" machine # [ 33.440623] k3s[881]: E0925 15:13:28.168945 881 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"machine\" not found" node="machine" machine # [ 33.450021] k3s[881]: I0925 15:13:28.178967 881 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" machine # [ 33.457803] k3s[881]: I0925 15:13:28.186806 881 cpu_manager.go:225] "Starting" policy="none" machine # [ 33.458473] k3s[881]: I0925 15:13:28.186829 881 cpu_manager.go:226] "Reconciling" reconcilePeriod="10s" machine # [ 33.460606] k3s[881]: I0925 15:13:28.186851 881 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" machine # [ 33.464255] k3s[881]: I0925 15:13:28.193269 881 policy_none.go:50] "Start" machine # [ 33.464847] k3s[881]: I0925 15:13:28.193299 881 memory_manager.go:187] "Starting memorymanager" policy="None" machine # [ 33.465550] k3s[881]: I0925 15:13:28.193319 881 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" machine # [ 33.470144] k3s[881]: I0925 15:13:28.199161 881 policy_none.go:44] "Start" machine # [ 33.474516] systemd[1]: Created slice libcontainer container kubepods.slice. machine # [ 33.487984] systemd[1]: Created slice libcontainer container kubepods-besteffort.slice. machine # [ 33.497918] systemd[1]: Created slice libcontainer container kubepods-burstable.slice. machine # [ 33.500253] k3s[881]: E0925 15:13:28.229268 881 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" machine # [ 33.500906] k3s[881]: I0925 15:13:28.229391 881 eviction_manager.go:194] "Eviction manager: starting control loop" machine # [ 33.501527] k3s[881]: I0925 15:13:28.229420 881 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" machine # [ 33.502086] k3s[881]: I0925 15:13:28.230206 881 plugin_manager.go:121] "Starting Kubelet Plugin Manager" machine # [ 33.508451] k3s[881]: E0925 15:13:28.237463 881 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="no imagefs label for configured runtime" machine # [ 33.509111] k3s[881]: E0925 15:13:28.237506 881 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"machine\" not found" machine # [ 33.556094] k3s[881]: I0925 15:13:28.285049 881 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" machine # [ 33.557662] k3s[881]: I0925 15:13:28.285126 881 status_manager.go:249] "Starting to sync pod status with apiserver" machine # [ 33.559117] k3s[881]: I0925 15:13:28.285173 881 kubelet.go:2506] "Starting kubelet main sync loop" machine # [ 33.560327] k3s[881]: E0925 15:13:28.285234 881 kubelet.go:2530] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" machine # [ 33.602964] k3s[881]: I0925 15:13:28.331937 881 kubelet_node_status.go:74] "Attempting to register node" node="machine" machine # [ 33.608051] k3s[881]: I0925 15:13:28.337064 881 kubelet_node_status.go:77] "Successfully registered node" node="machine" machine # [ 33.608659] k3s[881]: E0925 15:13:28.337139 881 kubelet_node_status.go:474] "Error updating node status, will retry" err="error getting node \"machine\": node \"machine\" not found" machine # [ 33.615519] k3s[881]: time="2026-09-25T15:13:28Z" level=info msg="Adding node OwnerReference to node-password secret machine.node-password.k3s" machine # [ 33.616190] k3s[881]: I0925 15:13:28.342606 881 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"machine\" does not exist" machine # [ 33.619094] k3s[881]: I0925 15:13:28.348119 881 node_controller.go:429] Initializing node machine with cloud provider machine # [ 33.619952] k3s[881]: I0925 15:13:28.348975 881 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 33.620510] k3s[881]: E0925 15:13:28.349007 881 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 33.629253] k3s[881]: I0925 15:13:28.358265 881 node_controller.go:429] Initializing node machine with cloud provider machine # [ 33.629939] k3s[881]: I0925 15:13:28.358328 881 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 33.630507] k3s[881]: E0925 15:13:28.358347 881 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 33.635830] k3s[881]: time="2026-09-25T15:13:28Z" level=info msg="Synced coredns NodeHosts entries for machine" machine # [ 33.636470] k3s[881]: I0925 15:13:28.365199 881 node_controller.go:429] Initializing node machine with cloud provider machine # [ 33.636947] k3s[881]: I0925 15:13:28.365245 881 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 33.637562] k3s[881]: E0925 15:13:28.365263 881 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 33.639357] k3s[881]: I0925 15:13:28.368383 881 node_controller.go:429] Initializing node machine with cloud provider machine # [ 33.640074] k3s[881]: I0925 15:13:28.368436 881 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 33.640480] k3s[881]: E0925 15:13:28.368454 881 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 33.650032] k3s[881]: I0925 15:13:28.378980 881 node_controller.go:429] Initializing node machine with cloud provider machine # [ 33.650654] k3s[881]: I0925 15:13:28.379062 881 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 33.651232] k3s[881]: E0925 15:13:28.379113 881 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 33.651664] k3s[881]: I0925 15:13:28.379213 881 range_allocator.go:433] "Set node PodCIDR" node="machine" podCIDRs=["10.42.0.0/24"] machine # [ 33.659478] k3s[881]: I0925 15:13:28.388482 881 node_controller.go:429] Initializing node machine with cloud provider machine # [ 33.660176] k3s[881]: I0925 15:13:28.388536 881 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 33.660698] k3s[881]: E0925 15:13:28.388558 881 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 33.661189] k3s[881]: I0925 15:13:28.388827 881 node_controller.go:429] Initializing node machine with cloud provider machine # [ 33.662144] k3s[881]: time="2026-09-25T15:13:28Z" level=info msg="Annotations and labels have been set successfully on node: machine" machine # [ 33.662964] k3s[881]: time="2026-09-25T15:13:28Z" level=info msg="Starting flannel with backend vxlan" machine # [ 33.672515] k3s[881]: I0925 15:13:28.401370 881 node_controller.go:474] Successfully initialized node machine with cloud provider machine # [ 33.674206] k3s[881]: I0925 15:13:28.403220 881 event.go:389] "Event occurred" object="machine" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="Synced" message="Node synced successfully" machine # [ 33.681182] k3s[881]: I0925 15:13:28.410209 881 server.go:173] "Starting Kubernetes Scheduler" version="v1.35.8+k3s1" machine # [ 33.682687] k3s[881]: I0925 15:13:28.410907 881 server.go:175] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 33.686028] k3s[881]: I0925 15:13:28.415014 881 secure_serving.go:211] Serving securely on 127.0.0.1:10259 machine # [ 33.687411] k3s[881]: I0925 15:13:28.415185 881 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 33.688826] k3s[881]: I0925 15:13:28.415205 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 33.690069] k3s[881]: I0925 15:13:28.415246 881 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 33.692805] k3s[881]: I0925 15:13:28.415399 881 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 33.694162] k3s[881]: I0925 15:13:28.417329 881 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 33.696302] k3s[881]: I0925 15:13:28.417349 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 33.697538] k3s[881]: I0925 15:13:28.417386 881 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 33.699696] k3s[881]: I0925 15:13:28.417402 881 shared_informer.go:370] "Waiting for caches to sync" machine # [ 33.755224] k3s[881]: I0925 15:13:28.483793 881 server.go:218] "Successfully retrieved NodeIPs" NodeIPs=["10.0.2.15","fec0::f7cb:f594:f394:d938"] machine # [ 33.756101] k3s[881]: E0925 15:13:28.483930 881 server.go:255] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`" machine # [ 33.756752] k3s[881]: I0925 15:13:28.485339 881 kuberuntime_manager.go:2095] "Updating runtime config through cri with podcidr" CIDR="10.42.0.0/24" machine # [ 33.757401] k3s[881]: I0925 15:13:28.486050 881 kubelet_network.go:47] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.42.0.0/24" machine # [ 33.776869] k3s[881]: I0925 15:13:28.505348 881 server.go:264] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4" machine # [ 33.777721] k3s[881]: I0925 15:13:28.505410 881 server_linux.go:136] "Using iptables Proxier" machine # [ 33.790924] k3s[881]: time="2026-09-25T15:13:28Z" level=info msg="Flannel found PodCIDR assigned for node machine" machine # [ 33.792481] k3s[881]: time="2026-09-25T15:13:28Z" level=info msg="The interface eth0 with ipv4 address 10.0.2.15 will be used by flannel" machine # [ 33.795025] k3s[881]: I0925 15:13:28.523976 881 kube.go:139] Waiting 10m0s for node controller to sync machine # [ 33.795660] k3s[881]: I0925 15:13:28.524121 881 kube.go:537] Starting kube subnet manager machine # [ 33.805351] k3s[881]: I0925 15:13:28.534340 881 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4" machine # [ 33.817310] k3s[881]: I0925 15:13:28.546315 881 server.go:529] "Version info" version="v1.35.8+k3s1" machine # [ 33.818053] k3s[881]: I0925 15:13:28.546351 881 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 33.819498] k3s[881]: I0925 15:13:28.548384 881 config.go:200] "Starting service config controller" machine # [ 33.820129] k3s[881]: I0925 15:13:28.548409 881 shared_informer.go:349] "Waiting for caches to sync" controller="service config" machine # [ 33.820581] k3s[881]: I0925 15:13:28.548453 881 config.go:106] "Starting endpoint slice config controller" machine # [ 33.821112] k3s[881]: I0925 15:13:28.548465 881 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config" machine # [ 33.821563] k3s[881]: I0925 15:13:28.548494 881 config.go:403] "Starting serviceCIDR config controller" machine # [ 33.822393] k3s[881]: I0925 15:13:28.548508 881 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config" machine # [ 33.822851] k3s[881]: I0925 15:13:28.550964 881 config.go:309] "Starting node config controller" machine # [ 33.823500] k3s[881]: I0925 15:13:28.550992 881 shared_informer.go:349] "Waiting for caches to sync" controller="node config" machine # [ 33.824031] k3s[881]: I0925 15:13:28.551005 881 shared_informer.go:356] "Caches are synced" controller="node config" machine # [ 33.861045] k3s[881]: I0925 15:13:28.590016 881 kubelet_node_status.go:427] "Fast updating node status as it just became ready" machine # [ 33.870724] k3s[881]: I0925 15:13:28.599447 881 topologycache.go:237] "Can't get CPU or zone information for node" node="machine" machine # [ 33.886400] k3s[881]: I0925 15:13:28.615411 881 shared_informer.go:377] "Caches are synced" machine # [ 33.888604] k3s[881]: I0925 15:13:28.617636 881 shared_informer.go:377] "Caches are synced" machine # [ 33.889244] k3s[881]: I0925 15:13:28.617719 881 shared_informer.go:377] "Caches are synced" machine # [ 33.920205] k3s[881]: I0925 15:13:28.648843 881 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config" machine # [ 33.920994] k3s[881]: I0925 15:13:28.649065 881 shared_informer.go:356] "Caches are synced" controller="endpoint slice config" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 34.172918] k3s[881]: time="2026-09-25T15:13:28Z" level=info msg="Labels and annotations have been set successfully on node: machine" machine # [ 34.220525] k3s[881]: I0925 15:13:28.949431 881 shared_informer.go:356] "Caches are synced" controller="service config" machine # [ 34.294511] k3s[881]: time="2026-09-25T15:13:29Z" level=info msg="Tunnel authorizer set Kubelet Port 0.0.0.0:10250" machine # [ 34.402653] k3s[881]: I0925 15:13:29.131631 881 apiserver.go:52] "Watching apiserver" machine # [ 34.502458] systemd[1]: Created slice libcontainer container kubepods-burstable-pod34eb5521_102d_4578_aa01_b48a8be819a7.slice. machine # [ 34.515978] systemd[1]: Created slice libcontainer container kubepods-burstable-poda41ea8ec_74c4_44e2_a098_e597b14db82c.slice. machine # [ 34.519766] k3s[881]: I0925 15:13:29.248778 881 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" machine # [ 34.535723] k3s[881]: I0925 15:13:29.264708 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/34eb5521-102d-4578-aa01-b48a8be819a7-config-volume\") pod \"coredns-c5fdd76cf-7f7r8\" (UID: \"34eb5521-102d-4578-aa01-b48a8be819a7\") " pod="kube-system/coredns-c5fdd76cf-7f7r8" machine # [ 34.536408] k3s[881]: I0925 15:13:29.264771 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-config-volume\" (UniqueName: \"kubernetes.io/configmap/34eb5521-102d-4578-aa01-b48a8be819a7-custom-config-volume\") pod \"coredns-c5fdd76cf-7f7r8\" (UID: \"34eb5521-102d-4578-aa01-b48a8be819a7\") " pod="kube-system/coredns-c5fdd76cf-7f7r8" machine # [ 34.536836] k3s[881]: I0925 15:13:29.264804 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/a41ea8ec-74c4-44e2-a098-e597b14db82c-klipper-config\") pod \"helm-install-nix-grpc-farm-2wp46\" (UID: \"a41ea8ec-74c4-44e2-a098-e597b14db82c\") " pod="kube-system/helm-install-nix-grpc-farm-2wp46" machine # [ 34.537505] k3s[881]: I0925 15:13:29.264929 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"content\" (UniqueName: \"kubernetes.io/configmap/a41ea8ec-74c4-44e2-a098-e597b14db82c-content\") pod \"helm-install-nix-grpc-farm-2wp46\" (UID: \"a41ea8ec-74c4-44e2-a098-e597b14db82c\") " pod="kube-system/helm-install-nix-grpc-farm-2wp46" machine # [ 34.538037] k3s[881]: I0925 15:13:29.264983 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk7rh\" (UniqueName: \"kubernetes.io/projected/a41ea8ec-74c4-44e2-a098-e597b14db82c-kube-api-access-bk7rh\") pod \"helm-install-nix-grpc-farm-2wp46\" (UID: \"a41ea8ec-74c4-44e2-a098-e597b14db82c\") " pod="kube-system/helm-install-nix-grpc-farm-2wp46" machine # [ 34.538544] k3s[881]: I0925 15:13:29.265029 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxtnf\" (UniqueName: \"kubernetes.io/projected/34eb5521-102d-4578-aa01-b48a8be819a7-kube-api-access-fxtnf\") pod \"coredns-c5fdd76cf-7f7r8\" (UID: \"34eb5521-102d-4578-aa01-b48a8be819a7\") " pod="kube-system/coredns-c5fdd76cf-7f7r8" machine # [ 34.539074] k3s[881]: I0925 15:13:29.265103 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/a41ea8ec-74c4-44e2-a098-e597b14db82c-klipper-helm\") pod \"helm-install-nix-grpc-farm-2wp46\" (UID: \"a41ea8ec-74c4-44e2-a098-e597b14db82c\") " pod="kube-system/helm-install-nix-grpc-farm-2wp46" machine # [ 34.539523] k3s[881]: I0925 15:13:29.265132 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/a41ea8ec-74c4-44e2-a098-e597b14db82c-klipper-cache\") pod \"helm-install-nix-grpc-farm-2wp46\" (UID: \"a41ea8ec-74c4-44e2-a098-e597b14db82c\") " pod="kube-system/helm-install-nix-grpc-farm-2wp46" machine # [ 34.540063] k3s[881]: I0925 15:13:29.265162 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a41ea8ec-74c4-44e2-a098-e597b14db82c-tmp\") pod \"helm-install-nix-grpc-farm-2wp46\" (UID: \"a41ea8ec-74c4-44e2-a098-e597b14db82c\") " pod="kube-system/helm-install-nix-grpc-farm-2wp46" machine # [ 34.540487] k3s[881]: I0925 15:13:29.265188 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"values\" (UniqueName: \"kubernetes.io/projected/a41ea8ec-74c4-44e2-a098-e597b14db82c-values\") pod \"helm-install-nix-grpc-farm-2wp46\" (UID: \"a41ea8ec-74c4-44e2-a098-e597b14db82c\") " pod="kube-system/helm-install-nix-grpc-farm-2wp46" machine # [ 34.795582] k3s[881]: I0925 15:13:29.524144 881 kube.go:163] Node controller sync successful machine # [ 34.796030] k3s[881]: I0925 15:13:29.524223 881 vxlan.go:128] VXLAN config: VNI=1 Port=0 GBP=false Learning=false DirectRouting=false machine # [ 34.799223] k3s[881]: I0925 15:13:29.528139 881 kube.go:704] List of node(machine) annotations: map[string]string{"alpha.kubernetes.io/provided-node-ip":"10.0.2.15,fec0::f7cb:f594:f394:d938", "k3s.io/hostname":"machine", "k3s.io/internal-ip":"10.0.2.15,fec0::f7cb:f594:f394:d938", "k3s.io/node-args":"[\"server\",\"--disable\",\"traefik\",\"--disable\",\"metrics-server\",\"--disable\",\"local-storage\",\"--kubelet-arg\",\"eviction-hard=nodefs.available\\u003c1%,imagefs.available\\u003c1%\"]", "k3s.io/node-config-hash":"EFXPOZ7ZWHRCLFNW4X4ZDPFQMSAOP3BLEIN2VE47TDRKQ4UIWKUQ====", "k3s.io/node-env":"{}", "node.alpha.kubernetes.io/ttl":"0", "volumes.kubernetes.io/controller-managed-attach-detach":"true"} machine # [ 34.823659] (udev-worker)[1305]: Network interface NamePolicy= disabled on kernel command line. machine # [ 34.832713] k3s[881]: I0925 15:13:29.561617 881 iptables.go:50] Starting flannel in iptables mode... machine # [ 34.833551] k3s[881]: time="2026-09-25T15:13:29Z" level=warning msg="no subnet found for key: FLANNEL_NETWORK in file: /run/flannel/subnet.env" machine # [ 34.834106] k3s[881]: time="2026-09-25T15:13:29Z" level=warning msg="no subnet found for key: FLANNEL_SUBNET in file: /run/flannel/subnet.env" machine # [ 34.834564] k3s[881]: time="2026-09-25T15:13:29Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_NETWORK in file: /run/flannel/subnet.env" machine # [ 34.835673] k3s[881]: time="2026-09-25T15:13:29Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_SUBNET in file: /run/flannel/subnet.env" machine # [ 34.836496] k3s[881]: I0925 15:13:29.561758 881 iptables.go:101] Current network or subnet (10.42.0.0/16, 10.42.0.0/24) is not equal to previous one (0.0.0.0/0, 0.0.0.0/0), trying to recycle old iptables rules machine # [ 34.837200] k3s[881]: I0925 15:13:29.563382 881 kube.go:558] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.42.0.0/24] machine # [ 34.858464] dhcpcd[691]: flannel.1: IAID 72:31:5e:3f machine # [ 34.859321] dhcpcd[691]: flannel.1: adding address fe80::2878:72ff:fe31:5e3f machine # [ 34.899153] k3s[881]: I0925 15:13:29.628123 881 iptables.go:111] Setting up masking rules machine # [ 34.915471] k3s[881]: I0925 15:13:29.644458 881 iptables.go:212] Changing default FORWARD chain policy to ACCEPT machine # [ 34.925198] k3s[881]: time="2026-09-25T15:13:29Z" level=info msg="Wrote flannel subnet file to /run/flannel/subnet.env" machine # [ 34.925647] k3s[881]: time="2026-09-25T15:13:29Z" level=info msg="Running flannel backend" machine # [ 34.926299] k3s[881]: I0925 15:13:29.653818 881 vxlan_network.go:68] watching for new subnet leases machine # [ 34.926759] k3s[881]: I0925 15:13:29.653888 881 vxlan_network.go:115] starting vxlan device watcher machine # [ 34.967978] k3s[881]: I0925 15:13:29.696961 881 iptables.go:358] bootstrap done machine # [ 34.998351] k3s[881]: I0925 15:13:29.727303 881 iptables.go:358] bootstrap done machine # [ 35.350701] cni0: port 1(veth5953e652) entered blocking state machine # [ 35.351372] cni0: port 1(veth5953e652) entered disabled state machine # [ 35.352527] veth5953e652: entered allmulticast mode machine # [ 35.200609] (udev-worker)[1303]: Network interface NamePolicy= disabled on kernel command line. machine # [ 35.355150] veth5953e652: entered promiscuous mode machine # [ 35.356939] cni0: port 2(veth8e3b4606) entered blocking state machine # [ 35.204541] (udev-worker)[1304]: Network interface NamePolicy= disabled on kernel command line. machine # [ 35.359087] cni0: port 2(veth8e3b4606) entered disabled state machine # [ 35.359900] veth8e3b4606: entered allmulticast mode machine # [ 35.360652] veth8e3b4606: entered promiscuous mode machine # [ 35.373056] cni0: port 2(veth8e3b4606) entered blocking state machine # [ 35.373742] cni0: port 2(veth8e3b4606) entered forwarding state machine # [ 35.378210] cni0: port 1(veth5953e652) entered blocking state machine # [ 35.378867] cni0: port 1(veth5953e652) entered forwarding state machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 35.253165] dhcpcd[691]: veth5953e652: waiting for carrier machine # [ 35.267354] dhcpcd[691]: veth8e3b4606: IAID f0:8f:f2:df machine # [ 35.267987] dhcpcd[691]: veth8e3b4606: adding address fe80::502e:f0ff:fe8f:f2df machine # [ 35.268584] dhcpcd[691]: veth5953e652: carrier acquired machine # [ 35.274209] dhcpcd[691]: veth5953e652: IAID 5f:28:b8:8b machine # [ 35.274871] dhcpcd[691]: veth5953e652: adding address fe80::10d7:5fff:fe28:b88b machine # [ 35.419619] systemd[1]: Started libcontainer container 03dcffc690700e27e5eafb2366793d4960698c8c42a93d613fa84160cf3e2b9e. machine # [ 35.422957] systemd[1]: Started libcontainer container 53b7fd0034fba2118a87d24f55d8fb1faba20b7bf16c3cc6b06ee767dc0b81e5. machine # [ 35.661101] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount1821760.mount: Deactivated successfully. machine # [ 35.953406] dhcpcd[691]: flannel.1: soliciting a DHCP lease machine # [ 36.060578] dhcpcd[691]: veth5953e652: soliciting a DHCP lease machine # [ 36.359326] k3s[881]: time="2026-09-25T15:13:31Z" level=info msg="Started tunnel to 10.0.2.15:6443" machine # [ 36.359717] k3s[881]: time="2026-09-25T15:13:31Z" level=info msg="Stopped tunnel to 127.0.0.1:6443" machine # [ 36.360194] k3s[881]: time="2026-09-25T15:13:31Z" level=info msg="Connecting to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 36.360639] k3s[881]: time="2026-09-25T15:13:31Z" level=info msg="Proxy done" err="context canceled" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 36.362260] k3s[881]: time="2026-09-25T15:13:31Z" level=info msg="error in remotedialer server [400]: websocket: close 1006 (abnormal closure): unexpected EOF" machine # [ 36.364406] k3s[881]: time="2026-09-25T15:13:31Z" level=info msg="Handling backend connection request [machine]" machine # [ 36.365175] k3s[881]: time="2026-09-25T15:13:31Z" level=info msg="Connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 36.365810] k3s[881]: time="2026-09-25T15:13:31Z" level=info msg="Remotedialer connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 36.370453] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount143655377.mount: Deactivated successfully. machine # [ 36.444090] systemd[1]: Started libcontainer container 9eb0bbbe4b6edb5f85c5173b08038733d23410600b4c2291bfe80343cad0b4b7. machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 36.461572] k3s[881]: time="2026-09-25T15:13:31Z" level=info msg="Starting network policy controller version v2.6.3-k3s1, built on 1970-01-01T01:01:01Z, go1.26.7" machine # [ 36.462464] k3s[881]: I0925 15:13:31.190656 881 network_policy_controller.go:164] Starting network policy controller machine # [ 36.638722] k3s[881]: I0925 15:13:31.367678 881 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/coredns-c5fdd76cf-7f7r8" podStartSLOduration=8.367642671 podStartE2EDuration="8.367642671s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-25 15:13:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-25 15:13:31.339711468 +0000 UTC m=+19.436996041" watchObservedRunningTime="2026-09-25 15:13:31.367642671 +0000 UTC m=+19.464926965" machine # [ 36.643804] dhcpcd[691]: flannel.1: soliciting an IPv6 router machine # [ 36.644303] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount550280960.mount: Deactivated successfully. machine # [ 36.686136] systemd[1]: Started libcontainer container 130acce1972bb607e7b1494de023401fc22870de6afc8c87dac315d3b64c6a78. machine # [ 36.781909] k3s[881]: I0925 15:13:31.510848 881 network_policy_controller.go:179] Starting network policy controller full sync goroutine machine # [ 36.945945] dhcpcd[691]: veth8e3b4606: soliciting a DHCP lease machine # [ 37.381471] dhcpcd[691]: veth8e3b4606: soliciting an IPv6 router machine # [ 37.458835] dhcpcd[691]: veth5953e652: soliciting an IPv6 router machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 37.798408] k3s[881]: I0925 15:13:32.526151 881 alloc.go:329] "allocated clusterIPs" service="farm/nix-grpc-farm" clusterIPs={"IPv4":"10.43.111.178"} machine # [ 37.851904] systemd[1]: cri-containerd-130acce1972bb607e7b1494de023401fc22870de6afc8c87dac315d3b64c6a78.scope: Deactivated successfully. machine # [ 37.854104] systemd[1]: cri-containerd-130acce1972bb607e7b1494de023401fc22870de6afc8c87dac315d3b64c6a78.scope: Consumed 589ms CPU time over 1.166s wall clock time, 31.3M memory peak, 2.4M incoming IP traffic, 147.5K outgoing IP traffic. machine # [ 37.895626] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-130acce1972bb607e7b1494de023401fc22870de6afc8c87dac315d3b64c6a78-rootfs.mount: Deactivated successfully. machine # [ 38.055144] k3s[881]: time="2026-09-25T15:13:32Z" level=info msg="Imported docker.io/library/nix-grpc-farm:0.1.0-beta.4" machine # [ 38.059476] k3s[881]: time="2026-09-25T15:13:32Z" level=info msg="Tagged docker.io/library/nix-grpc-farm@sha256:ed9317bad632a43589db49496d5cf8e660b069ae585bb6cc013c98ad9a71d44f" machine # [ 38.373182] k3s[881]: I0925 15:13:33.101890 881 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/helm-install-nix-grpc-farm-2wp46" podStartSLOduration=7.101862244 podStartE2EDuration="7.101862244s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-25 15:13:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-25 15:13:32.357195254 +0000 UTC m=+20.454479827" watchObservedRunningTime="2026-09-25 15:13:33.101862244 +0000 UTC m=+21.199146538" machine # [ 38.399130] k3s[881]: I0925 15:13:33.127651 881 node_lifecycle_controller.go:1234] "Initializing eviction metric for zone" zone="" machine # [ 38.400103] k3s[881]: I0925 15:13:33.127784 881 node_lifecycle_controller.go:886] "Missing timestamp for Node. Assuming now as a timestamp" node="machine" machine # [ 38.400824] k3s[881]: I0925 15:13:33.128150 881 node_lifecycle_controller.go:1080] "Controller detected that zone is now in new state" zone="" newState="Normal" machine # [ 38.549097] systemd[1]: Created slice libcontainer container kubepods-besteffort-poddd86dd1b_ad3c_4f21_8466_0b9afab6519d.slice. machine # [ 38.578462] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod67d3761e_2593_4435_afac_47f5015f05e8.slice. machine # [ 38.583463] k3s[881]: I0925 15:13:33.312342 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dd86dd1b-ad3c-4f21-8466-0b9afab6519d-config\") pod \"nix-grpc-farm-lb-75b44f88dd-8b9nh\" (UID: \"dd86dd1b-ad3c-4f21-8466-0b9afab6519d\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-8b9nh" machine # [ 38.587518] k3s[881]: I0925 15:13:33.312685 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd86dd1b-ad3c-4f21-8466-0b9afab6519d-tmp\") pod \"nix-grpc-farm-lb-75b44f88dd-8b9nh\" (UID: \"dd86dd1b-ad3c-4f21-8466-0b9afab6519d\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-8b9nh" machine # [ 38.591480] k3s[881]: I0925 15:13:33.312892 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/dd86dd1b-ad3c-4f21-8466-0b9afab6519d-tls-lb\") pod \"nix-grpc-farm-lb-75b44f88dd-8b9nh\" (UID: \"dd86dd1b-ad3c-4f21-8466-0b9afab6519d\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-8b9nh" machine # [ 38.596339] k3s[881]: I0925 15:13:33.313003 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/dd86dd1b-ad3c-4f21-8466-0b9afab6519d-tls-ca\") pod \"nix-grpc-farm-lb-75b44f88dd-8b9nh\" (UID: \"dd86dd1b-ad3c-4f21-8466-0b9afab6519d\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-8b9nh" machine # [ 38.609130] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod3acf7d1d_2023_46a1_8594_a29a73ce3628.slice. machine # [ 38.620303] systemd[1]: Created slice libcontainer container kubepods-besteffort-podd3913e95_1230_4650_a125_30e94b66ed8b.slice. machine # [ 38.655033] k3s[881]: time="2026-09-25T15:13:33Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm.tar in 5.691329763s" machine # [ 38.685242] k3s[881]: I0925 15:13:33.413843 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/3acf7d1d-2023-46a1-8594-a29a73ce3628-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-k9g7r\" (UID: \"3acf7d1d-2023-46a1-8594-a29a73ce3628\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-k9g7r" machine # [ 38.686065] k3s[881]: I0925 15:13:33.413895 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/3acf7d1d-2023-46a1-8594-a29a73ce3628-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-k9g7r\" (UID: \"3acf7d1d-2023-46a1-8594-a29a73ce3628\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-k9g7r" machine # [ 38.686606] k3s[881]: I0925 15:13:33.414073 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/d3913e95-1230-4650-a125-30e94b66ed8b-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-s5vbj\" (UID: \"d3913e95-1230-4650-a125-30e94b66ed8b\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-s5vbj" machine # [ 38.687176] k3s[881]: I0925 15:13:33.414544 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d3913e95-1230-4650-a125-30e94b66ed8b-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-s5vbj\" (UID: \"d3913e95-1230-4650-a125-30e94b66ed8b\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-s5vbj" machine # [ 38.687585] k3s[881]: I0925 15:13:33.414659 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/3acf7d1d-2023-46a1-8594-a29a73ce3628-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-k9g7r\" (UID: \"3acf7d1d-2023-46a1-8594-a29a73ce3628\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-k9g7r" machine # [ 38.688185] k3s[881]: I0925 15:13:33.414709 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/67d3761e-2593-4435-afac-47f5015f05e8-niks3-token\") pod \"nix-grpc-farm-scheduler-c5d75967-np7vg\" (UID: \"67d3761e-2593-4435-afac-47f5015f05e8\") " pod="farm/nix-grpc-farm-scheduler-c5d75967-np7vg" machine # [ 38.688626] k3s[881]: I0925 15:13:33.414741 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/3acf7d1d-2023-46a1-8594-a29a73ce3628-build\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-k9g7r\" (UID: \"3acf7d1d-2023-46a1-8594-a29a73ce3628\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-k9g7r" machine # [ 38.689508] k3s[881]: I0925 15:13:33.414769 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/3acf7d1d-2023-46a1-8594-a29a73ce3628-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-k9g7r\" (UID: \"3acf7d1d-2023-46a1-8594-a29a73ce3628\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-k9g7r" machine # [ 38.690092] k3s[881]: I0925 15:13:33.414798 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/3acf7d1d-2023-46a1-8594-a29a73ce3628-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-k9g7r\" (UID: \"3acf7d1d-2023-46a1-8594-a29a73ce3628\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-k9g7r" machine # [ 38.690575] k3s[881]: I0925 15:13:33.414826 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/d3913e95-1230-4650-a125-30e94b66ed8b-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-s5vbj\" (UID: \"d3913e95-1230-4650-a125-30e94b66ed8b\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-s5vbj" machine # [ 38.691135] k3s[881]: I0925 15:13:33.414904 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/3acf7d1d-2023-46a1-8594-a29a73ce3628-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-k9g7r\" (UID: \"3acf7d1d-2023-46a1-8594-a29a73ce3628\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-k9g7r" machine # [ 38.691594] k3s[881]: I0925 15:13:33.414930 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/d3913e95-1230-4650-a125-30e94b66ed8b-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-s5vbj\" (UID: \"d3913e95-1230-4650-a125-30e94b66ed8b\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-s5vbj" machine # [ 38.694991] k3s[881]: I0925 15:13:33.414958 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/67d3761e-2593-4435-afac-47f5015f05e8-ca\") pod \"nix-grpc-farm-scheduler-c5d75967-np7vg\" (UID: \"67d3761e-2593-4435-afac-47f5015f05e8\") " pod="farm/nix-grpc-farm-scheduler-c5d75967-np7vg" machine # [ 38.736518] k3s[881]: I0925 15:13:33.414986 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr2p7\" (UniqueName: \"kubernetes.io/projected/67d3761e-2593-4435-afac-47f5015f05e8-kube-api-access-qr2p7\") pod \"nix-grpc-farm-scheduler-c5d75967-np7vg\" (UID: \"67d3761e-2593-4435-afac-47f5015f05e8\") " pod="farm/nix-grpc-farm-scheduler-c5d75967-np7vg" machine # [ 38.737198] k3s[881]: I0925 15:13:33.415014 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/d3913e95-1230-4650-a125-30e94b66ed8b-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-s5vbj\" (UID: \"d3913e95-1230-4650-a125-30e94b66ed8b\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-s5vbj" machine # [ 38.737817] k3s[881]: I0925 15:13:33.415061 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/67d3761e-2593-4435-afac-47f5015f05e8-tls\") pod \"nix-grpc-farm-scheduler-c5d75967-np7vg\" (UID: \"67d3761e-2593-4435-afac-47f5015f05e8\") " pod="farm/nix-grpc-farm-scheduler-c5d75967-np7vg" machine # [ 38.738489] k3s[881]: I0925 15:13:33.415110 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tbqv\" (UniqueName: \"kubernetes.io/projected/3acf7d1d-2023-46a1-8594-a29a73ce3628-kube-api-access-2tbqv\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-k9g7r\" (UID: \"3acf7d1d-2023-46a1-8594-a29a73ce3628\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-k9g7r" machine # [ 38.738989] k3s[881]: I0925 15:13:33.415138 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/67d3761e-2593-4435-afac-47f5015f05e8-oidc\") pod \"nix-grpc-farm-scheduler-c5d75967-np7vg\" (UID: \"67d3761e-2593-4435-afac-47f5015f05e8\") " pod="farm/nix-grpc-farm-scheduler-c5d75967-np7vg" machine # [ 38.739615] k3s[881]: I0925 15:13:33.415165 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/d3913e95-1230-4650-a125-30e94b66ed8b-build\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-s5vbj\" (UID: \"d3913e95-1230-4650-a125-30e94b66ed8b\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-s5vbj" machine # [ 38.740186] k3s[881]: I0925 15:13:33.415191 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/d3913e95-1230-4650-a125-30e94b66ed8b-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-s5vbj\" (UID: \"d3913e95-1230-4650-a125-30e94b66ed8b\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-s5vbj" machine # [ 38.740594] k3s[881]: I0925 15:13:33.415218 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g95kq\" (UniqueName: \"kubernetes.io/projected/d3913e95-1230-4650-a125-30e94b66ed8b-kube-api-access-g95kq\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-s5vbj\" (UID: \"d3913e95-1230-4650-a125-30e94b66ed8b\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-s5vbj" machine # [ 39.050044] cni0: port 3(veth5e542efe) entered blocking state machine # [ 39.050800] cni0: port 3(veth5e542efe) entered disabled state machine # [ 39.051487] veth5e542efe: entered allmulticast mode machine # [ 39.052107] veth5e542efe: entered promiscuous mode machine # [ 38.901765] (udev-worker)[1870]: Network interface NamePolicy= disabled on kernel command line. machine # [ 39.061520] cni0: port 3(veth5e542efe) entered blocking state machine # [ 39.062247] cni0: port 3(veth5e542efe) entered forwarding state machine # [ 38.935689] dhcpcd[691]: veth5e542efe: IAID e6:bd:97:04 machine # [ 38.936611] dhcpcd[691]: veth5e542efe: adding address fe80::8804:e6ff:febd:9704 machine # [ 39.005729] systemd[1]: Started libcontainer container 209e4e808507f23e282e76fe438afddf0a12a712a2bb7e37c6b5247ce7e84d3b. machine # [ 39.447798] cni0: port 4(veth5d34d336) entered blocking state machine # [ 39.448501] cni0: port 4(veth5d34d336) entered disabled state machine # [ 39.449095] veth5d34d336: entered allmulticast mode machine # [ 39.450503] veth5d34d336: entered promiscuous mode machine # [ 39.459170] cni0: port 4(veth5d34d336) entered blocking state machine # [ 39.459882] cni0: port 4(veth5d34d336) entered forwarding state machine # [ 39.331666] dhcpcd[691]: veth5d34d336: IAID a8:28:e8:7b machine # [ 39.333332] dhcpcd[691]: veth5d34d336: adding address fe80::fc09:a8ff:fe28:e87b machine # [ 39.497607] cni0: port 5(veth03ee7f58) entered blocking state machine # [ 39.498342] cni0: port 5(veth03ee7f58) entered disabled state machine # [ 39.499447] veth03ee7f58: entered allmulticast mode machine # [ 39.500113] veth03ee7f58: entered promiscuous mode machine # [ 39.356175] ([ 39.509683] cni0: port 6(veth30939c8d) entered blocking state machine # udev-worker)[1873]: Network inte[ 39.510806] cni0: port 6(veth30939c8d) entered disabled state machine # rface NamePolicy= disabled on kernel command line. machine # [ 39.512536] veth30939c8d: entered allmulticast mode machine # [ 39.513250] veth30939c8d: entered promiscuous mode machine # [ 39.539554] cni0: port 6(veth30939c8d) entered blocking state machine # [ 39.540331] cni0: port 6(veth30939c8d) entered forwarding state machine # [ 39.542816] cni0: port 5(veth03ee7f58) entered blocking state machine # [ 39.543582] cni0: port 5(veth03ee7f58) entered forwarding state machine # [ 39.418607] dhcpcd[691]: veth03ee7f58: waiting for carrier machine # [ 39.431754] dhcpcd[691]: veth30939c8d: IAID 93:39:33:17 machine # [ 39.433085] dhcpcd[691]: veth30939c8d: adding address fe80::2406:93ff:fe39:3317 machine # [ 39.434159] dhcpcd[691]: veth03ee7f58: carrier acquired machine # [ 39.441300] dhcpcd[691]: veth03ee7f58: IAID 55:a5:e3:0d machine # [ 39.442036] dhcpcd[691]: veth03ee7f58: adding address fe80::e4ba:55ff:fea5:e30d machine # [ 39.476061] dhcpcd[691]: veth5d34d336: soliciting a DHCP lease machine # [ 39.476628] systemd[1]: Started libcontainer container 1b6b03df32535d4eddbe7d456cebb92592946f9c87ed61c7877dd3624c411502. machine # [ 39.573536] systemd[1]: Started libcontainer container c2428ddbd955e2f4ca84a023ca26e08ca3b991e3e76490031404ea0f44f34a1c. machine # [ 39.621326] systemd[1]: Started libcontainer container 894cb3eb454395312610559bf22d933ace54b54fabc3738f75e53b83559240b7. machine # [ 39.646080] systemd[1]: cri-containerd-03dcffc690700e27e5eafb2366793d4960698c8c42a93d613fa84160cf3e2b9e.scope: Deactivated successfully. machine # [ 39.670724] dhcpcd[691]: veth5e542efe: soliciting a DHCP lease machine # [ 39.830818] dhcpcd[691]: veth30939c8d: soliciting a DHCP lease machine # [ 39.912289] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-03dcffc690700e27e5eafb2366793d4960698c8c42a93d613fa84160cf3e2b9e-rootfs.mount: Deactivated successfully. machine # [ 39.913334] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-03dcffc690700e27e5eafb2366793d4960698c8c42a93d613fa84160cf3e2b9e-shm.mount: Deactivated successfully. machine # [ 40.083958] cni0: port 1(veth5953e652) entered disabled state machine # [ 39.931115] dhcpcd[691]: veth5953e652: carrier lost machine # [ 40.085947] veth5953e652 (unregistering): left allmulticast mode machine # [ 40.086954] veth5953e652 (unregistering): left promiscuous mode machine # [ 40.087881] cni0: port 1(veth5953e652) entered disabled state machine # [ 39.950748] systemd[1]: run-netns-cni\x2d61edd8fb\x2d2371\x2dfb06\x2d0917\x2d7da02b474bf1.mount: Deactivated successfully. machine # [ 39.966937] dhcpcd[691]: veth5953e652: deleting address fe80::10d7:5fff:fe28:b88b machine # [ 39.996708] k3s[881]: I0925 15:13:34.725162 881 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a41ea8ec-74c4-44e2-a098-e597b14db82c-content\" (UniqueName: \"kubernetes.io/configmap/a41ea8ec-74c4-44e2-a098-e597b14db82c-content\") pod \"a41ea8ec-74c4-44e2-a098-e597b14db82c\" (UID: \"a41ea8ec-74c4-44e2-a098-e597b14db82c\") " machine # [ 39.997618] k3s[881]: I0925 15:13:34.725235 881 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a41ea8ec-74c4-44e2-a098-e597b14db82c-klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/a41ea8ec-74c4-44e2-a098-e597b14db82c-klipper-cache\") pod \"a41ea8ec-74c4-44e2-a098-e597b14db82c\" (UID: \"a41ea8ec-74c4-44e2-a098-e597b14db82c\") " machine # [ 39.998366] k3s[881]: I0925 15:13:34.725276 881 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a41ea8ec-74c4-44e2-a098-e597b14db82c-tmp\" (UniqueName: \"kubernetes.io/empty-dir/a41ea8ec-74c4-44e2-a098-e597b14db82c-tmp\") pod \"a41ea8ec-74c4-44e2-a098-e597b14db82c\" (UID: \"a41ea8ec-74c4-44e2-a098-e597b14db82c\") " machine # [ 39.998948] k3s[881]: I0925 15:13:34.725307 881 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a41ea8ec-74c4-44e2-a098-e597b14db82c-klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/a41ea8ec-74c4-44e2-a098-e597b14db82c-klipper-config\") pod \"a41ea8ec-74c4-44e2-a098-e597b14db82c\" (UID: \"a41ea8ec-74c4-44e2-a098-e597b14db82c\") " machine # [ 39.999906] k3s[881]: I0925 15:13:34.725342 881 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a41ea8ec-74c4-44e2-a098-e597b14db82c-klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/a41ea8ec-74c4-44e2-a098-e597b14db82c-klipper-helm\") pod \"a41ea8ec-74c4-44e2-a098-e597b14db82c\" (UID: \"a41ea8ec-74c4-44e2-a098-e597b14db82c\") " machine # [ 40.001480] k3s[881]: I0925 15:13:34.725376 881 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a41ea8ec-74c4-44e2-a098-e597b14db82c-kube-api-access-bk7rh\" (UniqueName: \"kubernetes.io/projected/a41ea8ec-74c4-44e2-a098-e597b14db82c-kube-api-access-bk7rh\") pod \"a41ea8ec-74c4-44e2-a098-e597b14db82c\" (UID: \"a41ea8ec-74c4-44e2-a098-e597b14db82c\") " machine # [ 40.002167] k3s[881]: I0925 15:13:34.725406 881 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a41ea8ec-74c4-44e2-a098-e597b14db82c-values\" (UniqueName: \"kubernetes.io/projected/a41ea8ec-74c4-44e2-a098-e597b14db82c-values\") pod \"a41ea8ec-74c4-44e2-a098-e597b14db82c\" (UID: \"a41ea8ec-74c4-44e2-a098-e597b14db82c\") " machine # [ 40.002638] k3s[881]: I0925 15:13:34.725595 881 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a41ea8ec-74c4-44e2-a098-e597b14db82c-content" pod "a41ea8ec-74c4-44e2-a098-e597b14db82c" (UID: "a41ea8ec-74c4-44e2-a098-e597b14db82c"). InnerVolumeSpecName "content". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 40.037516] k3s[881]: I0925 15:13:34.766423 881 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a41ea8ec-74c4-44e2-a098-e597b14db82c-klipper-config" pod "a41ea8ec-74c4-44e2-a098-e597b14db82c" (UID: "a41ea8ec-74c4-44e2-a098-e597b14db82c"). InnerVolumeSpecName "klipper-config". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 40.044076] k3s[881]: I0925 15:13:34.772913 881 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a41ea8ec-74c4-44e2-a098-e597b14db82c-values" pod "a41ea8ec-74c4-44e2-a098-e597b14db82c" (UID: "a41ea8ec-74c4-44e2-a098-e597b14db82c"). InnerVolumeSpecName "values". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 40.048805] k3s[881]: I0925 15:13:34.772896 881 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a41ea8ec-74c4-44e2-a098-e597b14db82c-klipper-helm" pod "a41ea8ec-74c4-44e2-a098-e597b14db82c" (UID: "a41ea8ec-74c4-44e2-a098-e597b14db82c"). InnerVolumeSpecName "klipper-helm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 40.049479] k3s[881]: I0925 15:13:34.774502 881 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a41ea8ec-74c4-44e2-a098-e597b14db82c-tmp" pod "a41ea8ec-74c4-44e2-a098-e597b14db82c" (UID: "a41ea8ec-74c4-44e2-a098-e597b14db82c"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 40.049957] k3s[881]: I0925 15:13:34.774627 881 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a41ea8ec-74c4-44e2-a098-e597b14db82c-klipper-cache" pod "a41ea8ec-74c4-44e2-a098-e597b14db82c" (UID: "a41ea8ec-74c4-44e2-a098-e597b14db82c"). InnerVolumeSpecName "klipper-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 40.051055] dhcpcd[691]: veth03ee7f58: soliciting a DHCP lease machine # [ 40.063445] k3s[881]: I0925 15:13:34.777933 881 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a41ea8ec-74c4-44e2-a098-e597b14db82c-kube-api-access-bk7rh" pod "a41ea8ec-74c4-44e2-a098-e597b14db82c" (UID: "a41ea8ec-74c4-44e2-a098-e597b14db82c"). InnerVolumeSpecName "kube-api-access-bk7rh". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 40.068943] dhcpcd[691]: veth5953e652: removing interface machine # [ 40.079479] systemd[1]: Started libcontainer container 19eef125f75628b2a41004fa8ad1fc1a0ad989d5d2bf8b904ddd475c408d56c9. machine # [ 40.097179] k3s[881]: I0925 15:13:34.826142 881 reconciler_common.go:299] "Volume detached for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/a41ea8ec-74c4-44e2-a098-e597b14db82c-klipper-cache\") on node \"machine\" DevicePath \"\"" machine # [ 40.098330] k3s[881]: I0925 15:13:34.826179 881 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a41ea8ec-74c4-44e2-a098-e597b14db82c-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 40.098931] k3s[881]: I0925 15:13:34.827381 881 reconciler_common.go:299] "Volume detached for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/a41ea8ec-74c4-44e2-a098-e597b14db82c-klipper-config\") on node \"machine\" DevicePath \"\"" machine # [ 40.099834] k3s[881]: I0925 15:13:34.827396 881 reconciler_common.go:299] "Volume detached for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/a41ea8ec-74c4-44e2-a098-e597b14db82c-klipper-helm\") on node \"machine\" DevicePath \"\"" machine # [ 40.100402] k3s[881]: I0925 15:13:34.827412 881 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bk7rh\" (UniqueName: \"kubernetes.io/projected/a41ea8ec-74c4-44e2-a098-e597b14db82c-kube-api-access-bk7rh\") on node \"machine\" DevicePath \"\"" machine # [ 40.100953] k3s[881]: I0925 15:13:34.827428 881 reconciler_common.go:299] "Volume detached for volume \"values\" (UniqueName: \"kubernetes.io/projected/a41ea8ec-74c4-44e2-a098-e597b14db82c-values\") on node \"machine\" DevicePath \"\"" machine # [ 40.101490] k3s[881]: I0925 15:13:34.827440 881 reconciler_common.go:299] "Volume detached for volume \"content\" (UniqueName: \"kubernetes.io/configmap/a41ea8ec-74c4-44e2-a098-e597b14db82c-content\") on node \"machine\" DevicePath \"\"" machine # [ 40.382669] dhcpcd[691]: veth5e542efe: soliciting an IPv6 router machine # [ 40.638112] k3s[881]: I0925 15:13:35.365349 881 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="03dcffc690700e27e5eafb2366793d4960698c8c42a93d613fa84160cf3e2b9e" machine # [ 40.661385] systemd[1]: Removed slice libcontainer container kubepods-burstable-poda41ea8ec_74c4_44e2_a098_e597b14db82c.slice. machine # [ 40.662208] systemd[1]: kubepods-burstable-poda41ea8ec_74c4_44e2_a098_e597b14db82c.slice: Consumed 622ms CPU time over 6.144s wall clock time, 31.5M memory peak, 2.4M incoming IP traffic, 147.5K outgoing IP traffic. machine # [ 40.668876] k3s[881]: I0925 15:13:35.397854 881 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-75b44f88dd-8b9nh" podStartSLOduration=2.397826395 podStartE2EDuration="2.397826395s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-25 15:13:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-25 15:13:35.397453443 +0000 UTC m=+23.494737737" watchObservedRunningTime="2026-09-25 15:13:35.397826395 +0000 UTC m=+23.495110969" machine # [ 40.898143] systemd[1]: var-lib-kubelet-pods-a41ea8ec\x2d74c4\x2d44e2\x2da098\x2de597b14db82c-volumes-kubernetes.io\x7eprojected-values.mount: Deactivated successfully. machine # [ 40.900352] systemd[1]: var-lib-kubelet-pods-a41ea8ec\x2d74c4\x2d44e2\x2da098\x2de597b14db82c-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dbk7rh.mount: Deactivated successfully. machine # [ 40.903194] systemd[1]: var-lib-kubelet-pods-a41ea8ec\x2d74c4\x2d44e2\x2da098\x2de597b14db82c-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dcache.mount: Deactivated successfully. machine # [ 40.905378] systemd[1]: var-lib-kubelet-pods-a41ea8ec\x2d74c4\x2d44e2\x2da098\x2de597b14db82c-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dconfig.mount: Deactivated successfully. machine # [ 40.907930] systemd[1]: var-lib-kubelet-pods-a41ea8ec\x2d74c4\x2d44e2\x2da098\x2de597b14db82c-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 40.910476] systemd[1]: var-lib-kubelet-pods-a41ea8ec\x2d74c4\x2d44e2\x2da098\x2de597b14db82c-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dhelm.mount: Deactivated successfully. machine # [ 40.952639] dhcpcd[691]: flannel.1: probing for an IPv4LL address machine # [ 41.177154] dhcpcd[691]: veth03ee7f58: soliciting an IPv6 router machine # [ 41.693415] dhcpcd[691]: veth30939c8d: soliciting an IPv6 router machine # [ 41.947277] dhcpcd[691]: veth8e3b4606: probing for an IPv4LL address machine # [ 42.074778] dhcpcd[691]: veth5d34d336: soliciting an IPv6 router machine # [ 44.477201] dhcpcd[691]: veth5d34d336: probing for an IPv4LL address machine # [ 44.671196] dhcpcd[691]: veth5e542efe: probing for an IPv4LL address machine # [ 44.832171] dhcpcd[691]: veth30939c8d: probing for an IPv4LL address machine # [ 45.049986] dhcpcd[691]: veth03ee7f58: probing for an IPv4LL address machine # [ 45.324318] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount1926963531.mount: Deactivated successfully. machine # [ 45.391632] systemd[1]: Started libcontainer container 3f1778dcd168ad81052323e8e53e0657ea5b54264ee1f63da54f719b8edafc24. machine # [ 45.450425] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped1878333559.mount: Deactivated successfully. machine # [ 45.572373] systemd[1]: Started libcontainer container 45be92ea688365f2f5a11637aa0297cb2e03b2282108e23759b92efe7631ba34. machine # [ 45.617367] systemd[1]: Started libcontainer container 277324d29d28c65176672fbe8223c1df09c001a334faa7302de3bae990ef90f2. machine # [ 45.669594] niks3-server[1195]: 2026/09/25 15:13:40 INFO lead: acquired remote=10.42.0.5:35784 machine # [ 45.716930] k3s[881]: I0925 15:13:40.443407 881 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-scheduler-c5d75967-np7vg" podStartSLOduration=7.443381347 podStartE2EDuration="7.443381347s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-25 15:13:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-25 15:13:40.439883416 +0000 UTC m=+28.537167710" watchObservedRunningTime="2026-09-25 15:13:40.443381347 +0000 UTC m=+28.540665641" machine # [ 46.364494] dhcpcd[691]: flannel.1: using IPv4LL address 169.254.152.207 machine # [ 46.365553] dhcpcd[691]: flannel.1: adding route to 169.254.0.0/16 machine # [ 46.758383] dhcpcd[691]: veth8e3b4606: using IPv4LL address 169.254.19.163 machine # [ 46.761112] dhcpcd[691]: veth8e3b4606: adding route to 169.254.0.0/16 machine # [ 47.544119] systemd[1]: cri-containerd-45be92ea688365f2f5a11637aa0297cb2e03b2282108e23759b92efe7631ba34.scope: Deactivated successfully. machine # [ 47.547799] systemd[1]: cri-containerd-45be92ea688365f2f5a11637aa0297cb2e03b2282108e23759b92efe7631ba34.scope: Consumed 748ms CPU time over 1.970s wall clock time, 353.3M memory peak, 93.1M read from disk, 224.1M written to disk. machine # [ 47.550127] systemd[1]: cri-containerd-277324d29d28c65176672fbe8223c1df09c001a334faa7302de3bae990ef90f2.scope: Deactivated successfully. machine # [ 47.553102] systemd[1]: cri-containerd-277324d29d28c65176672fbe8223c1df09c001a334faa7302de3bae990ef90f2.scope: Consumed 774ms CPU time over 1.929s wall clock time, 329M memory peak, 63.7M read from disk, 224.1M written to disk. machine # [ 47.605368] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-45be92ea688365f2f5a11637aa0297cb2e03b2282108e23759b92efe7631ba34-rootfs.mount: Deactivated successfully. machine # [ 47.627108] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-277324d29d28c65176672fbe8223c1df09c001a334faa7302de3bae990ef90f2-rootfs.mount: Deactivated successfully. machine # [ 48.648898] dhcpcd[691]: flannel.1: no IPv6 Routers available machine # [ 48.802379] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped1754779537.mount: Deactivated successfully. machine # [ 48.802857] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount427237141.mount: Deactivated successfully. machine # error: timed out waiting for the condition machine # [ 48.887505] systemd[1]: Started libcontainer container d520043dc1611be3e91d56e39b2a5eeff1d73066b775d2da166ceac258a7811a. machine # [ 48.890351] systemd[1]: Started libcontainer container bfb059990a135a64655cb0036628de5fd27cfd1abbf6613082e18e557a2ff9a6. machine # [ 49.050445] systemd[1]: Started libcontainer container 9e431f8baf440b6ba9577073e961545c945579813789028fbadc178a142e892e. machine # [ 49.103322] systemd[1]: Started libcontainer container 2cff373fef0cb4175af0fdb357878a35f477c96181516114550e695d4c7d448a. machine # [ 49.317750] systemd[1]: Started libcontainer container b6a94b85e0a3f4c27c5250da8c39dfb6f743b0b56120f7d357431b6d0a153186. machine # [ 49.336675] systemd[1]: Started libcontainer container 1dcc23b47608476663f0e5b9def3e06c1ec1f5035e7113d93db9117e5ef2ecec. machine # [ 49.384221] dhcpcd[691]: veth8e3b4606: no IPv6 Routers available machine # [ 49.407345] dhcpcd[691]: veth03ee7f58: using IPv4LL address 169.254.241.105 machine # [ 49.408143] dhcpcd[691]: veth03ee7f58: adding route to 169.254.0.0/16 machine # [ 49.801581] k3s[881]: I0925 15:13:44.529199 881 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-k9g7r" podStartSLOduration=9.596071423 podStartE2EDuration="11.529145319s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.933073896s" isStatefulPod=false podCreationTimestamp="2026-09-25 15:13:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-25 15:13:44.528297166 +0000 UTC m=+32.625585092" watchObservedRunningTime="2026-09-25 15:13:44.529145319 +0000 UTC m=+32.626450286" machine # [ 49.803135] k3s[881]: I0925 15:13:44.529381 881 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-s5vbj" podStartSLOduration=9.622485953 podStartE2EDuration="11.529360151s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.906874198s" isStatefulPod=false podCreationTimestamp="2026-09-25 15:13:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-25 15:13:44.502806497 +0000 UTC m=+32.600096098" watchObservedRunningTime="2026-09-25 15:13:44.529360151 +0000 UTC m=+32.626647797" machine # [ 49.924520] dhcpcd[691]: veth30939c8d: using IPv4LL address 169.254.169.3 machine # [ 49.925662] dhcpcd[691]: veth30939c8d: adding route to 169.254.0.0/16 machine # [ 49.950467] dhcpcd[691]: veth5e542efe: using IPv4LL address 169.254.53.53 machine # [ 49.951827] dhcpcd[691]: veth5e542efe: adding route to 169.254.0.0/16 machine # [ 49.981518] dhcpcd[691]: veth5d34d336: using IPv4LL address 169.254.197.115 machine # [ 49.984220] dhcpcd[691]: veth5d34d336: adding route to 169.254.0.0/16 machine # [ 52.428734] dhcpcd[691]: segfault at 5dd13c3eb ip 00005dd11f8cacb3 sp 00007ffdbed27698 error 4 in dhcpcd[38cb3,5dd11f89b000+40000] likely on CPU 3 (core 3, socket 0) machine # [ 52.430761] Code: 45 ae 01 e9 0f fe ff ff 0f 1f 80 00 00 00 00 c6 45 af 01 e9 ff fd ff ff e8 fa 05 fd ff 66 2e 0f 1f 84 00 00 00 00 00 48 8b 07 <48> 8b 80 50 03 00 00 48 85 c0 74 31 90 48 8b 00 48 85 c0 74 1e 48 machine # [ 52.287244] systemd-coredump[3352]: Process 691 (dhcpcd) of user 999 terminated abnormally with signal 11/SEGV, processing... machine # [ 52.292513] systemd[1]: Created slice Slice /system/systemd-coredump. machine # [ 52.294235] systemd[1]: Started Process Core Dump (PID 3352/UID 0). machine # [ 52.482949] systemd-coredump[3353]: Process 691 (dhcpcd) of user 999 dumped core. machine # machine # Module udev.so without build-id. machine # Module dhcpcd without build-id. machine # Stack trace of thread 691: machine # #0 0x00005dd11f8cacb3 ipv6nd_expire (dhcpcd + 0x38cb3) machine # #1 0x00005dd11f8a406a eloop_start (dhcpcd + 0x1206a) machine # #2 0x00005dd11f89c300 main (dhcpcd + 0xa300) machine # #3 0x0000730487e13285 __libc_start_call_main (libc.so.6 + 0x2b285) machine # #4 0x0000730487e13338 __libc_start_main@@GLIBC_2.34 (libc.so.6 + 0x2b338) machine # #5 0x00005dd11f89d365 _start (dhcpcd + 0xb365) machine # ELF object binary architecture: AMD x86-64 machine # machine # [ 52.497986] systemd[1]: systemd-coredump@0-1-3352_3353-0.service: Deactivated successfully. machine # [ 52.582297] systemd[1]: dhcpcd.service: Main process exited, code=dumped, status=11/SEGV machine # [ 52.583155] systemd[1]: dhcpcd.service: Failed with result 'core-dump'. machine # [ 52.583655] systemd[1]: dhcpcd.service: Consumed 477ms CPU time over 44.572s wall clock time, 6.7M memory peak, 8K written to disk, 96B incoming IP traffic, 1.2K outgoing IP traffic. machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 23.56 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s machine # [ 52.886286] systemd[1]: dhcpcd.service: Scheduled restart job, restart counter is at 1. machine # [ 52.889726] systemd[1]: Starting DHCP Client... machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s, in 0.18 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s machine # [ 53.051787] dhcpcd[3386]: dhcpcd-10.3.2 starting machine # [ 53.053612] dhcpcd[3408]: dev: loaded udev machine # [ 53.054344] dhcpcd[3408]: DUID 00:01:00:01:32:49:4b:ff:52:54:00:12:34:56 machine # [ 53.135746] dhcpcd[3408]: eth0: IAID 00:12:34:56 machine # [ 53.136635] dhcpcd[3408]: flannel.1: IAID 72:31:5e:3f machine # [ 53.137382] dhcpcd[3408]: veth8e3b4606: IAID f0:8f:f2:df machine # [ 53.137982] dhcpcd[3408]: veth5e542efe: IAID e6:bd:97:04 machine # [ 53.138648] dhcpcd[3408]: veth5d34d336: IAID a8:28:e8:7b machine # [ 53.139434] dhcpcd[3408]: veth03ee7f58: IAID 55:a5:e3:0d machine # [ 53.139871] dhcpcd[3408]: veth30939c8d: IAID 93:39:33:17 machine # [ 53.304906] dhcpcd[3408]: veth30939c8d: soliciting an IPv6 router machine # [ 53.373474] dhcpcd[3408]: veth5e542efe: soliciting a DHCP lease machine # [ 53.778110] dhcpcd[3408]: veth03ee7f58: soliciting a DHCP lease machine # [ 53.788564] dhcpcd[3408]: veth8e3b4606: soliciting an IPv6 router machine # [ 53.824941] dhcpcd[3408]: veth5e542efe: soliciting an IPv6 router machine # [ 53.898372] dhcpcd[3408]: eth0: soliciting an IPv6 router machine # [ 53.900497] dhcpcd[3408]: eth0: Router Advertisement from fe80::2 machine # [ 53.902057] dhcpcd[3408]: eth0: adding address fec0::5054:ff:fe12:3456/64 machine # [ 53.949462] dhcpcd[3408]: veth03ee7f58: soliciting an IPv6 router machine # [ 53.951095] dhcpcd[3408]: veth5d34d336: soliciting an IPv6 router machine # [ 54.038083] dhcpcd[3408]: eth0: rebinding lease of 10.0.2.15 machine # [ 54.045524] dhcpcd[3408]: eth0: leased 10.0.2.15 for 86400 seconds machine # [ 54.103370] systemd[1]: Started DHCP Client. machine # [ 54.106703] dhcpcd[3408]: flannel.1: soliciting an IPv6 router machine # [ 54.234092] dhcpcd[3408]: flannel.1: soliciting a DHCP lease machine # [ 54.740105] dhcpcd[3408]: veth8e3b4606: soliciting a DHCP lease machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s, in 1.93 seconds) machine: waiting for unit niks3.service machine: (finished: waiting for unit niks3.service, in 0.04 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine # [ 54.951863] dhcpcd[3408]: veth30939c8d: soliciting a DHCP lease machine # [ 55.120392] dhcpcd[3408]: veth5d34d336: soliciting a DHCP lease machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.45 seconds) machine: waiting for success: test $(curl -sf 10.42.0.4:9901/clusters | grep -c 'health_flags::healthy') -ge 3 machine: (finished: waiting for success: test $(curl -sf 10.42.0.4:9901/clusters | grep -c 'health_flags::healthy') -ge 3, in 0.06 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.19 seconds) machine: waiting for success: curl -sf http://10.42.0.5:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2' machine: (finished: waiting for success: curl -sf http://10.42.0.5:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2', in 0.04 seconds) (finished: subtest: chart deploys and workers become Ready, in 26.46 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}', in 0.16 seconds) machine: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt machine: (finished: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt, in 0.14 seconds) subtest: build through the balancer lands in the cache machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1 machine # [ 63.828075] dhcpcd[3408]: veth5e542efe: using IPv4LL address 169.254.53.53 machine # [ 63.830671] dhcpcd[3408]: flannel.1: adding route to 169.254.0.0/16 machine # [ 63.832888] dhcpcd[3408]: veth8e3b4606: adding route to 169.254.0.0/16 machine # [ 63.835199] dhcpcd[3408]: veth5e542efe: adding route to 169.254.0.0/16 machine # [ 63.837371] dhcpcd[3408]: veth5d34d336: adding route to 169.254.0.0/16 machine # [ 63.839542] dhcpcd[3408]: veth03ee7f58: adding route to 169.254.0.0/16 machine # [ 63.841796] dhcpcd[3408]: veth30939c8d: adding route to 169.254.0.0/16 machine # [ 64.015899] dhcpcd[3408]: veth03ee7f58: using IPv4LL address 169.254.241.105 machine # [ 64.157839] dhcpcd[3408]: veth8e3b4606: using IPv4LL address 169.254.19.163 machine # [ 64.208119] dhcpcd[3408]: flannel.1: using IPv4LL address 169.254.152.207 machine # [ 64.475150] dhcpcd[3408]: veth30939c8d: using IPv4LL address 169.254.169.3 machine # [ 64.885815] dhcpcd[3408]: veth5d34d336: using IPv4LL address 169.254.197.115 machine # [ 65.307490] dhcpcd[3408]: veth30939c8d: no IPv6 Routers available machine # [ 65.792554] dhcpcd[3408]: veth8e3b4606: no IPv6 Routers available machine # [ 65.826747] dhcpcd[3408]: veth5e542efe: no IPv6 Routers available machine # [ 65.952836] dhcpcd[3408]: veth03ee7f58: no IPv6 Routers available machine # [ 65.955844] dhcpcd[3408]: veth5d34d336: no IPv6 Routers available machine # [ 66.109889] dhcpcd[3408]: flannel.1: no IPv6 Routers available machine # [ 118.111053] niks3-server[1195]: 2026/09/25 15:14:52 INFO Received push request method=POST path=/api/pushes machine # [ 118.138635] niks3-server[1195]: 2026/09/25 15:14:52 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign machine # [ 118.148583] niks3-server[1195]: 2026/09/25 15:14:52 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.ls machine # [ 118.150872] niks3-server[1195]: 2026/09/25 15:14:52 INFO Registered completed upload object_key=nar/0nzzbas7l8d37mridr7mg162smfjvn7lhs6am4crl4ydaxicigj8.nar.zst machine # [ 118.153230] niks3-server[1195]: 2026/09/25 15:14:52 INFO Signed narinfos id=1 count=1 machine # [ 118.158046] niks3-server[1195]: 2026/09/25 15:14:52 INFO Received complete push request method=POST path=/api/pushes/1/complete machine # [ 118.167984] niks3-server[1195]: 2026/09/25 15:14:52 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.narinfo machine # [ 142.872599] niks3-server[1195]: 2026/09/25 15:15:17 INFO Received push request method=POST path=/api/pushes machine # [ 142.895413] niks3-server[1195]: 2026/09/25 15:15:17 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign machine # [ 142.900470] niks3-server[1195]: 2026/09/25 15:15:17 INFO Signed narinfos id=2 count=1 machine # [ 142.903646] niks3-server[1195]: 2026/09/25 15:15:17 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.ls machine # [ 142.907780] niks3-server[1195]: 2026/09/25 15:15:17 INFO Registered completed upload object_key=nar/1p7jh5nyz9n68k5f18ymmdpgr34mpnnch1njw7ki7b2b97qlfbjk.nar.zst machine # [ 142.912654] niks3-server[1195]: 2026/09/25 15:15:17 INFO Registered completed upload object_key=log/yz1sqzb72i8v6h2ass0v76ba8cncqj9r-k3s-a.drv machine # [ 142.916837] niks3-server[1195]: 2026/09/25 15:15:17 INFO Received complete push request method=POST path=/api/pushes/2/complete machine # [ 142.920786] niks3-server[1195]: 2026/09/25 15:15:17 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.narinfo machine # [ 142.977804] niks3-server[1195]: 2026/09/25 15:15:17 INFO Received push request method=POST path=/api/pushes machine # [ 142.990043] niks3-server[1195]: 2026/09/25 15:15:17 INFO Received sign narinfos request method=POST path=/api/pushes/3/sign machine # [ 142.991229] niks3-server[1195]: 2026/09/25 15:15:17 INFO Signed narinfos id=3 count=1 machine # [ 142.995125] niks3-server[1195]: 2026/09/25 15:15:17 INFO Registered completed upload object_key=nar/03a4ywhyr5knmbc93z4gyml5y8fvgb431xvlmfxrwsm8mrb0qgx2.nar.zst machine # [ 142.997051] niks3-server[1195]: 2026/09/25 15:15:17 INFO Received complete push request method=POST path=/api/pushes/3/complete machine # [ 142.998174] niks3-server[1195]: 2026/09/25 15:15:17 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.ls machine # [ 143.004213] niks3-server[1195]: 2026/09/25 15:15:17 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.narinfo machine # [ 168.110473] niks3-server[1195]: 2026/09/25 15:15:42 INFO Received push request method=POST path=/api/pushes machine # [ 168.127415] niks3-server[1195]: 2026/09/25 15:15:42 INFO Received sign narinfos request method=POST path=/api/pushes/4/sign machine # [ 168.129704] niks3-server[1195]: 2026/09/25 15:15:42 INFO Signed narinfos id=4 count=1 machine # [ 168.136848] niks3-server[1195]: 2026/09/25 15:15:42 INFO Registered completed upload object_key=log/zfq1xw9bmycqh35l0s44lmv65z4xc7br-k3s-b.drv machine # [ 168.138763] niks3-server[1195]: 2026/09/25 15:15:42 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.ls machine # [ 168.144388] niks3-server[1195]: 2026/09/25 15:15:42 INFO Registered completed upload object_key=nar/05qjsj5ff3a6vnxkhb6k5f3m446dcc206p7cd37w4v3mgi95d7kh.nar.zst machine # [ 168.148518] niks3-server[1195]: 2026/09/25 15:15:42 INFO Received complete push request method=POST path=/api/pushes/4/complete machine # [ 168.154684] niks3-server[1195]: 2026/09/25 15:15:42 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.narinfo machine # [ 168.238509] niks3-server[1195]: 2026/09/25 15:15:42 INFO Received push request method=POST path=/api/pushes machine # [ 168.253140] niks3-server[1195]: 2026/09/25 15:15:42 INFO Received sign narinfos request method=POST path=/api/pushes/5/sign machine # [ 168.256421] niks3-server[1195]: 2026/09/25 15:15:42 INFO Signed narinfos id=5 count=1 machine # [ 168.258700] niks3-server[1195]: 2026/09/25 15:15:42 INFO Registered completed upload object_key=nar/0jyw88klkf3nwxpnj5m5lx3i1dv2idf3hcn6im7883hnldm3gvyq.nar.zst machine # [ 168.262282] niks3-server[1195]: 2026/09/25 15:15:42 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.ls machine # [ 168.265457] niks3-server[1195]: 2026/09/25 15:15:42 INFO Received complete push request method=POST path=/api/pushes/5/complete machine # [ 168.268656] niks3-server[1195]: 2026/09/25 15:15:42 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.narinfo machine # [ 192.971099] niks3-server[1195]: 2026/09/25 15:16:07 INFO Received push request method=POST path=/api/pushes machine # [ 192.988235] niks3-server[1195]: 2026/09/25 15:16:07 INFO Received sign narinfos request method=POST path=/api/pushes/6/sign machine # [ 192.990319] niks3-server[1195]: 2026/09/25 15:16:07 INFO Signed narinfos id=6 count=1 machine # [ 192.995413] niks3-server[1195]: 2026/09/25 15:16:07 INFO Registered completed upload object_key=nar/1q8vp5xqws560mpf8rxk8r8jhqrzibivh13x4wxy0cfqlzbk7cr5.nar.zst machine # [ 192.998374] niks3-server[1195]: 2026/09/25 15:16:07 INFO Registered completed upload object_key=log/n40czam6a4ldp1mh5fdmlcy07fv0akbm-k3s-top.drv machine # [ 193.001329] niks3-server[1195]: 2026/09/25 15:16:07 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.ls machine # [ 193.003648] niks3-server[1195]: 2026/09/25 15:16:07 INFO Received complete push request method=POST path=/api/pushes/6/complete machine # [ 193.012935] niks3-server[1195]: 2026/09/25 15:16:07 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1, in 138.11 seconds) machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath, in 0.14 seconds) machine: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine: (finished: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.02 seconds) machine: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine # copying 3 paths... machine # copying path '/nix/store/r95r891injj9ski5c4w89yxjvjy065mx-k3s-a' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/mrqsh0475wxsmnsvkk55g94v6g5nrcra-k3s-b' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top' from 'http://192.168.1.1:5751'... machine: (finished: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.22 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1 machine # [ 194.773770] niks3-server[1195]: 2026/09/25 15:16:09 INFO Received push request method=POST path=/api/pushes machine # [ 194.796807] niks3-server[1195]: 2026/09/25 15:16:09 INFO Received sign narinfos request method=POST path=/api/pushes/7/sign machine # [ 194.798202] niks3-server[1195]: 2026/09/25 15:16:09 INFO Signed narinfos id=7 count=1 machine # [ 194.799611] niks3-server[1195]: 2026/09/25 15:16:09 INFO Registered completed upload object_key=nar/1fr26arhri17j9bj6hyjzmmd74v730biz1gb3kqd194vjx3ccvp9.nar.zst machine # [ 194.805903] niks3-server[1195]: 2026/09/25 15:16:09 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.ls machine # [ 194.808321] niks3-server[1195]: 2026/09/25 15:16:09 INFO Received complete push request method=POST path=/api/pushes/7/complete machine # [ 194.814422] niks3-server[1195]: 2026/09/25 15:16:09 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.narinfo machine # [ 219.336867] niks3-server[1195]: 2026/09/25 15:16:34 INFO Received push request method=POST path=/api/pushes machine # [ 219.360855] niks3-server[1195]: 2026/09/25 15:16:34 INFO Received sign narinfos request method=POST path=/api/pushes/8/sign machine # [ 219.362782] niks3-server[1195]: 2026/09/25 15:16:34 INFO Registered completed upload object_key=nar/1hfc6x4x25k3b0fk091d3nb0k3mympfp05fkslcx19synp3ig0zd.nar.zst machine # [ 219.365380] niks3-server[1195]: 2026/09/25 15:16:34 INFO Registered completed upload object_key=log/pbpqsh50ar10fpasdqqx8xg3lmr5j8iz-k3s-a.drv machine # [ 219.367027] niks3-server[1195]: 2026/09/25 15:16:34 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.ls machine # [ 219.376820] niks3-server[1195]: 2026/09/25 15:16:34 INFO Signed narinfos id=8 count=1 machine # [ 219.384449] niks3-server[1195]: 2026/09/25 15:16:34 INFO Received complete push request method=POST path=/api/pushes/8/complete machine # [ 219.392578] niks3-server[1195]: 2026/09/25 15:16:34 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.narinfo machine # [ 219.463056] niks3-server[1195]: 2026/09/25 15:16:34 INFO Received push request method=POST path=/api/pushes machine # [ 219.473860] niks3-server[1195]: 2026/09/25 15:16:34 INFO Received sign narinfos request method=POST path=/api/pushes/9/sign machine # [ 219.476672] niks3-server[1195]: 2026/09/25 15:16:34 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.ls machine # [ 219.478043] niks3-server[1195]: 2026/09/25 15:16:34 INFO Registered completed upload object_key=nar/0zzq2vgjln4shvh57091n14sam6wh6w06vja6lzb9ppcj4ffyx1n.nar.zst machine # [ 219.483473] niks3-server[1195]: 2026/09/25 15:16:34 INFO Signed narinfos id=9 count=1 machine # [ 219.491524] niks3-server[1195]: 2026/09/25 15:16:34 INFO Received complete push request method=POST path=/api/pushes/9/complete machine # [ 219.494612] niks3-server[1195]: 2026/09/25 15:16:34 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.narinfo machine # [ 244.014278] niks3-server[1195]: 2026/09/25 15:16:58 INFO Received push request method=POST path=/api/pushes machine # [ 244.034063] niks3-server[1195]: 2026/09/25 15:16:58 INFO Received sign narinfos request method=POST path=/api/pushes/10/sign machine # [ 244.038830] niks3-server[1195]: 2026/09/25 15:16:58 INFO Registered completed upload object_key=log/894h6wzw2l4w5f0hikj1k6q57jfnyi87-k3s-b.drv machine # [ 244.043708] niks3-server[1195]: 2026/09/25 15:16:58 INFO Signed narinfos id=10 count=1 machine # [ 244.047271] niks3-server[1195]: 2026/09/25 15:16:58 INFO Registered completed upload object_key=nar/0hh3nqk95r6g32lhdmxw8cxjv694vbpx9876zkhcpg4r4qxni2ch.nar.zst machine # [ 244.052286] niks3-server[1195]: 2026/09/25 15:16:58 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.ls machine # [ 244.057558] niks3-server[1195]: 2026/09/25 15:16:58 INFO Received complete push request method=POST path=/api/pushes/10/complete machine # [ 244.062666] niks3-server[1195]: 2026/09/25 15:16:58 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.narinfo machine # [ 244.128155] niks3-server[1195]: 2026/09/25 15:16:58 INFO Received push request method=POST path=/api/pushes machine # [ 244.140526] niks3-server[1195]: 2026/09/25 15:16:58 INFO Received sign narinfos request method=POST path=/api/pushes/11/sign machine # [ 244.143626] niks3-server[1195]: 2026/09/25 15:16:58 INFO Signed narinfos id=11 count=1 machine # [ 244.145596] niks3-server[1195]: 2026/09/25 15:16:58 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.ls machine # [ 244.148807] niks3-server[1195]: 2026/09/25 15:16:58 INFO Registered completed upload object_key=nar/0ingamx56k31lwiyxmnxmscjj4n3qfx6sr2kpaynsrwhwz1278iw.nar.zst machine # [ 244.150417] niks3-server[1195]: 2026/09/25 15:16:58 INFO Received complete push request method=POST path=/api/pushes/11/complete machine # [ 244.159193] niks3-server[1195]: 2026/09/25 15:16:58 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.narinfo machine # [ 268.889613] niks3-server[1195]: 2026/09/25 15:17:23 INFO Received push request method=POST path=/api/pushes machine # [ 268.918759] niks3-server[1195]: 2026/09/25 15:17:23 INFO Received sign narinfos request method=POST path=/api/pushes/12/sign machine # [ 268.921484] niks3-server[1195]: 2026/09/25 15:17:23 INFO Signed narinfos id=12 count=1 machine # [ 268.925516] niks3-server[1195]: 2026/09/25 15:17:23 INFO Registered completed upload object_key=nar/0v48x4sp58bvfra08axgkz7yl1n9nc4nirskyv1hwann4i7q277i.nar.zst machine # [ 268.926526] niks3-server[1195]: 2026/09/25 15:17:23 INFO Registered completed upload object_key=log/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g-k3s-top.drv machine # [ 268.927693] niks3-server[1195]: 2026/09/25 15:17:23 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.ls machine # [ 268.934620] niks3-server[1195]: 2026/09/25 15:17:23 INFO Received complete push request method=POST path=/api/pushes/12/complete machine # [ 268.941117] niks3-server[1195]: 2026/09/25 15:17:23 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1, in 74.54 seconds) (finished: subtest: build through the balancer lands in the cache, in 213.03 seconds) subtest: a Job with the client image builds through the farm with its service account machine: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine: (finished: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.15 seconds) machine: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix machine: (finished: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix, in 0.14 seconds) machine: must succeed: kubectl apply -f /nix/store/4qg21n7g16x8lyv0fhhdx9dx3lxqkcdn-ci-job.json machine: (finished: must succeed: kubectl apply -f /nix/store/4qg21n7g16x8lyv0fhhdx9dx3lxqkcdn-ci-job.json, in 0.17 seconds) machine: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed' machine # [ 270.402916] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod722884a5_4d6b_4e45_86a3_2577d2d3abf5.slice. machine # [ 270.461465] k3s[881]: I0925 15:17:25.189755 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"job\" (UniqueName: \"kubernetes.io/configmap/722884a5-4d6b-4e45-86a3-2577d2d3abf5-job\") pod \"ci-5gmlg\" (UID: \"722884a5-4d6b-4e45-86a3-2577d2d3abf5\") " pod="ci/ci-5gmlg" machine # [ 270.463445] k3s[881]: I0925 15:17:25.189868 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/722884a5-4d6b-4e45-86a3-2577d2d3abf5-nix-grpc-farm\") pod \"ci-5gmlg\" (UID: \"722884a5-4d6b-4e45-86a3-2577d2d3abf5\") " pod="ci/ci-5gmlg" machine # [ 270.464888] k3s[881]: I0925 15:17:25.189936 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzhvj\" (UniqueName: \"kubernetes.io/projected/722884a5-4d6b-4e45-86a3-2577d2d3abf5-kube-api-access-qzhvj\") pod \"ci-5gmlg\" (UID: \"722884a5-4d6b-4e45-86a3-2577d2d3abf5\") " pod="ci/ci-5gmlg" machine # [ 271.811127] cni0: port 1(veth303a1260) entered blocking state machine # [ 271.820040] cni0: port 1(veth303a1260) entered disabled state machine # [ 271.822852] veth303a1260: entered allmulticast mode machine # [ 271.825204] veth303a1260: entered promiscuous mode machine # [ 271.843214] cni0: port 1(veth303a1260) entered blocking state machine # [ 271.844949] cni0: port 1(veth303a1260) entered forwarding state machine # [ 271.728590] (udev-worker)[4851]: Network interface NamePolicy= disabled on kernel command line. machine # [ 271.762149] dhcpcd[3408]: veth303a1260: IAID fb:8e:23:86 machine # [ 271.762739] dhcpcd[3408]: veth303a1260: adding address fe80::1891:fbff:fe8e:2386 machine # [ 271.795762] systemd[1]: Started libcontainer container 351ce1f499baa8315b2acb05063eed3d183235376c5aaaf1746f69771de68062. machine # [ 272.477197] dhcpcd[3408]: veth303a1260: soliciting a DHCP lease machine # [ 273.802864] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount461558893.mount: Deactivated successfully. machine # [ 273.873465] dhcpcd[3408]: veth303a1260: soliciting an IPv6 router machine # [ 273.879682] systemd[1]: Started libcontainer container da410da5c1cbefab92152fc53f1974a1d28514f95893a0499320b3c54e01a562. machine # [ 274.719164] k3s[881]: I0925 15:17:29.447255 881 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ci/ci-5gmlg" podStartSLOduration=4.447205829 podStartE2EDuration="4.447205829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-25 15:17:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-25 15:17:29.446490654 +0000 UTC m=+257.543779977" watchObservedRunningTime="2026-09-25 15:17:29.447205829 +0000 UTC m=+257.544494593" machine # [ 275.281562] niks3-server[1195]: 2026/09/25 15:17:30 INFO Received push request method=POST path=/api/pushes machine # [ 275.299084] niks3-server[1195]: 2026/09/25 15:17:30 INFO Received sign narinfos request method=POST path=/api/pushes/13/sign machine # [ 275.305135] niks3-server[1195]: 2026/09/25 15:17:30 INFO Signed narinfos id=13 count=1 machine # [ 275.309114] niks3-server[1195]: 2026/09/25 15:17:30 INFO Registered completed upload object_key=nar/111g6dyibwcf2z7jhpn72rgja0qvjgpdiv9nc06g2dp7ih0a6kyq.nar.zst machine # [ 275.310435] niks3-server[1195]: 2026/09/25 15:17:30 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.ls machine # [ 275.315471] niks3-server[1195]: 2026/09/25 15:17:30 INFO Received complete push request method=POST path=/api/pushes/13/complete machine # [ 275.322384] niks3-server[1195]: 2026/09/25 15:17:30 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.narinfo machine # [ 277.479281] dhcpcd[3408]: veth303a1260: probing for an IPv4LL address machine # [ 281.876892] dhcpcd[3408]: veth303a1260: using IPv4LL address 169.254.31.0 machine # [ 281.879590] dhcpcd[3408]: veth303a1260: adding route to 169.254.0.0/16 machine # [ 285.930099] dhcpcd[3408]: veth303a1260: no IPv6 Routers available machine # [ 300.446475] niks3-server[1195]: 2026/09/25 15:17:55 INFO Received push request method=POST path=/api/pushes machine # [ 300.479167] niks3-server[1195]: 2026/09/25 15:17:55 INFO Registered completed upload object_key=nar/058kjd2vfl1r27b4d9ixvwf77d8rkr18a4v894kwx8lg0nwpajnr.nar.zst machine # [ 300.480694] niks3-server[1195]: 2026/09/25 15:17:55 INFO Received sign narinfos request method=POST path=/api/pushes/14/sign machine # [ 300.483481] niks3-server[1195]: 2026/09/25 15:17:55 INFO Signed narinfos id=14 count=1 machine # [ 300.484689] niks3-server[1195]: 2026/09/25 15:17:55 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.ls machine # [ 300.486114] niks3-server[1195]: 2026/09/25 15:17:55 INFO Registered completed upload object_key=log/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # [ 300.492641] niks3-server[1195]: 2026/09/25 15:17:55 INFO Received complete push request method=POST path=/api/pushes/14/complete machine # [ 300.498319] niks3-server[1195]: 2026/09/25 15:17:55 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.narinfo machine # [ 300.567880] niks3-server[1195]: 2026/09/25 15:17:55 INFO Received push request method=POST path=/api/pushes machine # [ 300.581468] niks3-server[1195]: 2026/09/25 15:17:55 INFO Received sign narinfos request method=POST path=/api/pushes/15/sign machine # [ 300.582489] niks3-server[1195]: 2026/09/25 15:17:55 INFO Signed narinfos id=15 count=1 machine # [ 300.585399] niks3-server[1195]: 2026/09/25 15:17:55 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.ls machine # [ 300.587447] niks3-server[1195]: 2026/09/25 15:17:55 INFO Registered completed upload object_key=nar/138ynhcd5wxzz485x9qcq7xsargaklrf2li31ai69m5r46am35q6.nar.zst machine # [ 300.589313] niks3-server[1195]: 2026/09/25 15:17:55 INFO Received complete push request method=POST path=/api/pushes/15/complete machine # [ 300.594140] niks3-server[1195]: 2026/09/25 15:17:55 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.narinfo machine # [ 310.301366] postgres[761]: [761] LOG: checkpoint starting: time machine # [ 325.319269] niks3-server[1195]: 2026/09/25 15:18:20 INFO Received push request method=POST path=/api/pushes machine # [ 325.344444] niks3-server[1195]: 2026/09/25 15:18:20 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.ls machine # [ 325.346415] niks3-server[1195]: 2026/09/25 15:18:20 INFO Received sign narinfos request method=POST path=/api/pushes/16/sign machine # [ 325.347573] niks3-server[1195]: 2026/09/25 15:18:20 INFO Registered completed upload object_key=nar/0n4lbdlp8w72fs3qbavl2lwrzbrn55i2b1vyglc89cc3pi8vbb1m.nar.zst machine # [ 325.350720] niks3-server[1195]: 2026/09/25 15:18:20 INFO Signed narinfos id=16 count=1 machine # [ 325.351747] niks3-server[1195]: 2026/09/25 15:18:20 INFO Registered completed upload object_key=log/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # [ 325.359163] niks3-server[1195]: 2026/09/25 15:18:20 INFO Received complete push request method=POST path=/api/pushes/16/complete machine # [ 325.364653] niks3-server[1195]: 2026/09/25 15:18:20 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo machine # [ 325.440656] niks3-server[1195]: 2026/09/25 15:18:20 INFO Received push request method=POST path=/api/pushes machine # [ 325.451696] niks3-server[1195]: 2026/09/25 15:18:20 INFO Received sign narinfos request method=POST path=/api/pushes/17/sign machine # [ 325.453557] niks3-server[1195]: 2026/09/25 15:18:20 INFO Signed narinfos id=17 count=1 machine # [ 325.456198] niks3-server[1195]: 2026/09/25 15:18:20 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.ls machine # [ 325.458428] niks3-server[1195]: 2026/09/25 15:18:20 INFO Registered completed upload object_key=nar/1f3gvnvqsm2pm3laixkxkg44kvjb251zqhszcfpp0a00h6x66ljs.nar.zst machine # [ 325.460149] niks3-server[1195]: 2026/09/25 15:18:20 INFO Received complete push request method=POST path=/api/pushes/17/complete machine # [ 325.465446] niks3-server[1195]: 2026/09/25 15:18:20 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.narinfo machine # [ 350.797176] niks3-server[1195]: 2026/09/25 15:18:45 INFO Received push request method=POST path=/api/pushes machine # [ 350.819391] niks3-server[1195]: 2026/09/25 15:18:45 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.ls machine # [ 350.823915] niks3-server[1195]: 2026/09/25 15:18:45 INFO Received sign narinfos request method=POST path=/api/pushes/18/sign machine # [ 350.828827] niks3-server[1195]: 2026/09/25 15:18:45 INFO Signed narinfos id=18 count=1 machine # [ 350.832562] niks3-server[1195]: 2026/09/25 15:18:45 INFO Registered completed upload object_key=nar/1zwf0asrdv12q40fmqga5lx5330dvn9y4in4i9ficz9ij5lhvnf5.nar.zst machine # [ 350.835320] niks3-server[1195]: 2026/09/25 15:18:45 INFO Registered completed upload object_key=log/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # [ 350.841284] niks3-server[1195]: 2026/09/25 15:18:45 INFO Received complete push request method=POST path=/api/pushes/18/complete machine # [ 350.845371] niks3-server[1195]: 2026/09/25 15:18:45 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo machine # [ 352.531221] niks3-server[1195]: 2026/09/25 15:18:47 INFO Received push request method=POST path=/api/pushes machine # [ 352.556377] niks3-server[1195]: 2026/09/25 15:18:47 INFO Registered completed upload object_key=nar/0xiyqcsl8db7dnrq2gqnx5izavr51ma3dcdswrriaxfgj3qzk7xf.nar.zst machine # [ 352.558629] niks3-server[1195]: 2026/09/25 15:18:47 INFO Received sign narinfos request method=POST path=/api/pushes/19/sign machine # [ 352.561683] niks3-server[1195]: 2026/09/25 15:18:47 INFO Signed narinfos id=19 count=1 machine # [ 352.564351] niks3-server[1195]: 2026/09/25 15:18:47 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.ls machine # [ 352.571526] niks3-server[1195]: 2026/09/25 15:18:47 INFO Received complete push request method=POST path=/api/pushes/19/complete machine # [ 352.576612] niks3-server[1195]: 2026/09/25 15:18:47 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.narinfo machine # [ 377.909392] niks3-server[1195]: 2026/09/25 15:19:12 INFO Received push request method=POST path=/api/pushes machine # [ 377.933447] niks3-server[1195]: 2026/09/25 15:19:12 INFO Received sign narinfos request method=POST path=/api/pushes/20/sign machine # [ 377.938352] niks3-server[1195]: 2026/09/25 15:19:12 INFO Signed narinfos id=20 count=1 machine # [ 377.943427] niks3-server[1195]: 2026/09/25 15:19:12 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.ls machine # [ 377.948077] niks3-server[1195]: 2026/09/25 15:19:12 INFO Registered completed upload object_key=log/fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # [ 377.952300] niks3-server[1195]: 2026/09/25 15:19:12 INFO Registered completed upload object_key=nar/0p3l2z3riilylr2rxb1aq2blxdfxg55wbgp4gxkns93srbr4bwyq.nar.zst machine # [ 377.958122] niks3-server[1195]: 2026/09/25 15:19:12 INFO Received complete push request method=POST path=/api/pushes/20/complete machine # [ 377.963459] niks3-server[1195]: 2026/09/25 15:19:12 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo machine # [ 378.124768] systemd[1]: cri-containerd-da410da5c1cbefab92152fc53f1974a1d28514f95893a0499320b3c54e01a562.scope: Deactivated successfully. machine # [ 378.127185] systemd[1]: cri-containerd-da410da5c1cbefab92152fc53f1974a1d28514f95893a0499320b3c54e01a562.scope: Consumed 1.062s CPU time over 1min 44.244s wall clock time, 100.6M memory peak, 30.9M read from disk, 428K written to disk, 18.3K incoming IP traffic, 44.8K outgoing IP traffic. machine # [ 378.164044] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-da410da5c1cbefab92152fc53f1974a1d28514f95893a0499320b3c54e01a562-rootfs.mount: Deactivated successfully. machine # [ 379.215418] systemd[1]: cri-containerd-351ce1f499baa8315b2acb05063eed3d183235376c5aaaf1746f69771de68062.scope: Deactivated successfully. machine # [ 379.278377] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-351ce1f499baa8315b2acb05063eed3d183235376c5aaaf1746f69771de68062-rootfs.mount: Deactivated successfully. machine # [ 379.311587] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-351ce1f499baa8315b2acb05063eed3d183235376c5aaaf1746f69771de68062-shm.mount: Deactivated successfully. machine # [ 379.502990] cni0: port 1(veth303a1260) entered disabled state machine # [ 379.351555] dhcpcd[3408]: veth303a1260: carrier lost machine # [ 379.506462] veth303a1260 (unregistering): left allmulticast mode machine # [ 379.507930] veth303a1260 (unregistering): left promiscuous mode machine # [ 379.509336] cni0: port 1(veth303a1260) entered disabled state machine # [ 379.379162] systemd[1]: run-netns-cni\x2d82d4a8d0\x2d73a7\x2da464\x2d1a5b\x2d52113f4c91dc.mount: Deactivated successfully. machine # [ 379.389098] dhcpcd[3408]: veth303a1260: deleting address fe80::1891:fbff:fe8e:2386 machine # [ 379.392266] dhcpcd[3408]: veth303a1260: deleting route to 169.254.0.0/16 machine # [ 379.457459] k3s[881]: I0925 15:19:14.185915 881 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/722884a5-4d6b-4e45-86a3-2577d2d3abf5-kube-api-access-qzhvj\" (UniqueName: \"kubernetes.io/projected/722884a5-4d6b-4e45-86a3-2577d2d3abf5-kube-api-access-qzhvj\") pod \"722884a5-4d6b-4e45-86a3-2577d2d3abf5\" (UID: \"722884a5-4d6b-4e45-86a3-2577d2d3abf5\") " machine # [ 379.457881] k3s[881]: I0925 15:19:14.185977 881 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/722884a5-4d6b-4e45-86a3-2577d2d3abf5-job\" (UniqueName: \"kubernetes.io/configmap/722884a5-4d6b-4e45-86a3-2577d2d3abf5-job\") pod \"722884a5-4d6b-4e45-86a3-2577d2d3abf5\" (UID: \"722884a5-4d6b-4e45-86a3-2577d2d3abf5\") " machine # [ 379.458520] k3s[881]: I0925 15:19:14.186013 881 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/722884a5-4d6b-4e45-86a3-2577d2d3abf5-nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/722884a5-4d6b-4e45-86a3-2577d2d3abf5-nix-grpc-farm\") pod \"722884a5-4d6b-4e45-86a3-2577d2d3abf5\" (UID: \"722884a5-4d6b-4e45-86a3-2577d2d3abf5\") " machine # [ 379.459432] k3s[881]: I0925 15:19:14.186927 881 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/722884a5-4d6b-4e45-86a3-2577d2d3abf5-job" pod "722884a5-4d6b-4e45-86a3-2577d2d3abf5" (UID: "722884a5-4d6b-4e45-86a3-2577d2d3abf5"). InnerVolumeSpecName "job". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 379.462635] systemd[1]: var-lib-kubelet-pods-722884a5\x2d4d6b\x2d4e45\x2d86a3\x2d2577d2d3abf5-volumes-kubernetes.io\x7eprojected-nix\x2dgrpc\x2dfarm.mount: Deactivated successfully. machine # [ 379.463795] systemd[1]: var-lib-kubelet-pods-722884a5\x2d4d6b\x2d4e45\x2d86a3\x2d2577d2d3abf5-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dqzhvj.mount: Deactivated successfully. machine # [ 379.479470] k3s[881]: I0925 15:19:14.208297 881 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/722884a5-4d6b-4e45-86a3-2577d2d3abf5-kube-api-access-qzhvj" pod "722884a5-4d6b-4e45-86a3-2577d2d3abf5" (UID: "722884a5-4d6b-4e45-86a3-2577d2d3abf5"). InnerVolumeSpecName "kube-api-access-qzhvj". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 379.480255] k3s[881]: I0925 15:19:14.208387 881 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/722884a5-4d6b-4e45-86a3-2577d2d3abf5-nix-grpc-farm" pod "722884a5-4d6b-4e45-86a3-2577d2d3abf5" (UID: "722884a5-4d6b-4e45-86a3-2577d2d3abf5"). InnerVolumeSpecName "nix-grpc-farm". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 379.488172] dhcpcd[3408]: veth303a1260: removing interface machine # [ 379.557853] k3s[881]: I0925 15:19:14.286810 881 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzhvj\" (UniqueName: \"kubernetes.io/projected/722884a5-4d6b-4e45-86a3-2577d2d3abf5-kube-api-access-qzhvj\") on node \"machine\" DevicePath \"\"" machine # [ 379.558619] k3s[881]: I0925 15:19:14.286848 881 reconciler_common.go:299] "Volume detached for volume \"job\" (UniqueName: \"kubernetes.io/configmap/722884a5-4d6b-4e45-86a3-2577d2d3abf5-job\") on node \"machine\" DevicePath \"\"" machine # [ 379.559126] k3s[881]: I0925 15:19:14.286865 881 reconciler_common.go:299] "Volume detached for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/722884a5-4d6b-4e45-86a3-2577d2d3abf5-nix-grpc-farm\") on node \"machine\" DevicePath \"\"" machine # [ 379.567300] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod722884a5_4d6b_4e45_86a3_2577d2d3abf5.slice. machine # [ 379.569123] systemd[1]: kubepods-besteffort-pod722884a5_4d6b_4e45_86a3_2577d2d3abf5.slice: Consumed 1.094s CPU time over 1min 49.163s wall clock time, 100.8M memory peak, 30.9M read from disk, 632K written to disk, 18.3K incoming IP traffic, 44.8K outgoing IP traffic. machine # [ 380.200265] k3s[881]: I0925 15:19:14.929178 881 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="351ce1f499baa8315b2acb05063eed3d183235376c5aaaf1746f69771de68062" machine: (finished: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed', in 111.22 seconds) machine: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1 machine: (finished: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1, in 0.17 seconds) machine # don't know how to build these paths: machine # /nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-a> machine/nix-grpc-farm-worker-x86-64-linux-c74f46454-s5vbj: building fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-b> machine/nix-grpc-farm-worker-x86-64-linux-c74f46454-s5vbj: building 1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-top> machine/nix-grpc-farm-worker-x86-64-linux-c74f46454-s5vbj: building rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # INFO:nix_fast_build.processes:run nix-eval-jobs --gc-roots-dir /tmp/tmpp6hyomsn/gcroots --force-recurse --max-memory-size 4096 --workers 4 --flake '.#checks' --check-cache-status machine # INFO:nix_fast_build.workers:builds: 0 machine # warning: Git tree '/tmp' is dirty machine # warning: Git tree '/tmp' is dirty machine # ▶ x86_64-linux.t started machine # INFO:nix_fast_build.workers:builds: 2 machine # ✔ x86_64-linux.t (26s) machine # x86_64-linux.t> machine/nix-grpc-farm-worker-x86-64-linux-c74f46454-k9g7r: building fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # warning: Git tree '/tmp' is dirty machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath, in 0.16 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null, in 0.05 seconds) (finished: subtest: a Job with the client image builds through the farm with its service account, in 112.66 seconds) subtest: a renewed balancer certificate is served without a rollout machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f - machine # Warning: resource secrets/farm-lb-tls is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically. machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f -, in 0.32 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}', in 0.40 seconds) machine: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-75b44f88dd-8b9nh -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine # [ 382.714098] k3s[881]: E0925 15:19:17.442623 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43540: use of closed network connection machine # [ 384.017312] k3s[881]: E0925 15:19:18.745687 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37856: use of closed network connection machine # [ 385.307534] k3s[881]: E0925 15:19:20.035484 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37884: use of closed network connection machine # [ 386.627603] k3s[881]: E0925 15:19:21.356149 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37918: use of closed network connection machine # [ 389.265056] k3s[881]: E0925 15:19:23.993309 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37982: use of closed network connection machine # [ 390.548756] k3s[881]: E0925 15:19:25.277429 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38014: use of closed network connection machine # [ 391.853169] k3s[881]: E0925 15:19:26.581772 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38036: use of closed network connection machine # [ 393.178146] k3s[881]: E0925 15:19:27.905690 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45368: use of closed network connection machine # [ 394.468954] k3s[881]: E0925 15:19:29.197557 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45382: use of closed network connection machine # [ 395.776885] k3s[881]: E0925 15:19:30.505501 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45414: use of closed network connection machine # [ 397.081475] k3s[881]: E0925 15:19:31.809915 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45442: use of closed network connection machine # [ 398.383365] k3s[881]: E0925 15:19:33.111527 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45480: use of closed network connection machine # [ 399.682691] k3s[881]: E0925 15:19:34.411309 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45518: use of closed network connection machine # [ 400.982414] k3s[881]: E0925 15:19:35.710502 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45550: use of closed network connection machine # [ 402.279947] k3s[881]: E0925 15:19:37.008266 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45564: use of closed network connection machine # [ 402.280876] k3s[881]: time="2026-09-25T15:19:37Z" level=warning msg="Proxy error: read failed: read tcp 127.0.0.1:56762->127.0.0.1:10250: read: connection reset by peer" machine # [ 403.626801] k3s[881]: E0925 15:19:38.355208 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:34972: use of closed network connection machine # [ 404.950226] k3s[881]: E0925 15:19:39.678724 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35000: use of closed network connection machine # [ 406.252404] k3s[881]: E0925 15:19:40.980897 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35028: use of closed network connection machine # [ 407.567560] k3s[881]: E0925 15:19:42.295880 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35052: use of closed network connection machine # [ 408.819267] k3s[881]: E0925 15:19:43.547605 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35080: use of closed network connection machine # [ 410.157332] k3s[881]: E0925 15:19:44.885904 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35120: use of closed network connection machine # [ 411.445165] k3s[881]: E0925 15:19:46.173686 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35148: use of closed network connection machine # [ 414.027389] k3s[881]: E0925 15:19:48.755855 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35360: use of closed network connection machine # [ 414.670610] postgres[761]: [761] LOG: checkpoint complete: wrote 1037 buffers (6.3%), wrote 3 SLRU buffers; 1 WAL file(s) added, 0 removed, 0 recycled; write=104.264 s, sync=0.067 s, total=104.370 s; sync files=364, longest=0.005 s, average=0.001 s; distance=4988 kB, estimate=4988 kB; lsn=0/1C72A68, redo lsn=0/1C45220 machine # [ 415.320485] k3s[881]: E0925 15:19:50.048639 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35394: use of closed network connection machine # [ 416.668682] k3s[881]: E0925 15:19:51.397297 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35426: use of closed network connection machine # [ 419.281684] k3s[881]: E0925 15:19:54.010293 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35478: use of closed network connection machine # [ 420.603731] k3s[881]: E0925 15:19:55.332145 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35494: use of closed network connection machine # [ 421.917056] k3s[881]: E0925 15:19:56.645645 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35510: use of closed network connection machine # [ 423.253515] k3s[881]: E0925 15:19:57.981734 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39900: use of closed network connection machine # [ 424.575537] k3s[881]: E0925 15:19:59.303908 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39936: use of closed network connection machine # [ 425.858430] k3s[881]: E0925 15:20:00.587015 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39956: use of closed network connection machine # [ 427.160158] k3s[881]: E0925 15:20:01.888346 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39984: use of closed network connection machine # [ 428.471731] k3s[881]: E0925 15:20:03.200278 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40024: use of closed network connection machine # [ 429.758635] k3s[881]: E0925 15:20:04.487272 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40054: use of closed network connection machine # [ 431.052129] k3s[881]: E0925 15:20:05.780711 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40084: use of closed network connection machine # [ 432.368520] k3s[881]: E0925 15:20:07.097135 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40120: use of closed network connection machine # [ 433.691851] k3s[881]: E0925 15:20:08.420050 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59056: use of closed network connection machine # [ 434.981718] k3s[881]: E0925 15:20:09.709794 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59094: use of closed network connection machine # [ 436.297114] k3s[881]: E0925 15:20:11.025284 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59118: use of closed network connection machine # [ 436.298325] k3s[881]: E0925 15:20:11.025500 881 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:49012->127.0.0.1:10010: write tcp 127.0.0.1:49012->127.0.0.1:10010: write: broken pipe machine # [ 437.606227] k3s[881]: E0925 15:20:12.334563 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59136: use of closed network connection machine # [ 438.854273] k3s[881]: E0925 15:20:13.582688 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59146: use of closed network connection machine # [ 440.199810] k3s[881]: E0925 15:20:14.928218 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59174: use of closed network connection machine # [ 441.501884] k3s[881]: E0925 15:20:16.230388 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59210: use of closed network connection machine # [ 442.809503] k3s[881]: E0925 15:20:17.537445 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59244: use of closed network connection machine # [ 444.120418] k3s[881]: E0925 15:20:18.848827 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43604: use of closed network connection machine # [ 445.408161] k3s[881]: E0925 15:20:20.136722 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43644: use of closed network connection machine # [ 446.707660] k3s[881]: E0925 15:20:21.436157 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43678: use of closed network connection machine # [ 447.995982] k3s[881]: E0925 15:20:22.724443 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43702: use of closed network connection machine # [ 449.362278] k3s[881]: E0925 15:20:24.090466 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43722: use of closed network connection machine # [ 449.367139] k3s[881]: E0925 15:20:24.090721 881 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:51410->127.0.0.1:10010: write tcp 127.0.0.1:51410->127.0.0.1:10010: write: broken pipe machine # [ 450.679701] k3s[881]: E0925 15:20:25.407861 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43750: use of closed network connection machine # [ 451.979414] k3s[881]: E0925 15:20:26.707349 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43766: use of closed network connection machine # [ 453.352628] k3s[881]: E0925 15:20:28.080901 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46710: use of closed network connection machine # [ 454.684811] k3s[881]: E0925 15:20:29.412963 881 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:52176->127.0.0.1:10010: write tcp 127.0.0.1:52176->127.0.0.1:10010: write: broken pipe machine # [ 454.691180] k3s[881]: E0925 15:20:29.413060 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46736: use of closed network connection machine # [ 454.695081] k3s[881]: time="2026-09-25T15:20:29Z" level=warning msg="Proxy error: read failed: read tcp 127.0.0.1:43644->127.0.0.1:10250: read: connection reset by peer" machine # [ 455.943444] k3s[881]: E0925 15:20:30.671940 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46764: use of closed network connection machine # [ 457.226136] k3s[881]: E0925 15:20:31.954708 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46784: use of closed network connection machine # [ 458.528502] k3s[881]: E0925 15:20:33.256598 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46802: use of closed network connection machine # [ 459.792283] k3s[881]: E0925 15:20:34.520781 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46838: use of closed network connection machine: (finished: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-75b44f88dd-8b9nh -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 77.43 seconds) machine: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine: (finished: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 0.04 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1 machine # [ 460.079970] niks3-server[1195]: 2026/09/25 15:20:34 INFO Received push request method=POST path=/api/pushes machine # [ 460.097448] niks3-server[1195]: 2026/09/25 15:20:34 INFO Received sign narinfos request method=POST path=/api/pushes/21/sign machine # [ 460.099177] niks3-server[1195]: 2026/09/25 15:20:34 INFO Signed narinfos id=21 count=1 machine # [ 460.100538] niks3-server[1195]: 2026/09/25 15:20:34 INFO Registered completed upload object_key=nar/0g42hgwa9jp9abmqxz90dkwxpybsznzbpsy35rm921mlk5sw56jq.nar.zst machine # [ 460.104967] niks3-server[1195]: 2026/09/25 15:20:34 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.ls machine # [ 460.108106] niks3-server[1195]: 2026/09/25 15:20:34 INFO Received complete push request method=POST path=/api/pushes/21/complete machine # [ 460.113954] niks3-server[1195]: 2026/09/25 15:20:34 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.narinfo machine # [ 484.832662] niks3-server[1195]: 2026/09/25 15:20:59 INFO Received push request method=POST path=/api/pushes machine # [ 484.851511] niks3-server[1195]: 2026/09/25 15:20:59 INFO Received sign narinfos request method=POST path=/api/pushes/22/sign machine # [ 484.853553] niks3-server[1195]: 2026/09/25 15:20:59 INFO Signed narinfos id=22 count=1 machine # [ 484.855874] niks3-server[1195]: 2026/09/25 15:20:59 INFO Registered completed upload object_key=log/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31-k3s-a.drv machine # [ 484.859339] niks3-server[1195]: 2026/09/25 15:20:59 INFO Registered completed upload object_key=nar/1vxmmzwi16s4iri6dcmi9v62dpq1ys7wz15b497ncik3sd67nfzg.nar.zst machine # [ 484.862167] niks3-server[1195]: 2026/09/25 15:20:59 INFO Received complete push request method=POST path=/api/pushes/22/complete machine # [ 484.868948] niks3-server[1195]: 2026/09/25 15:20:59 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo machine # [ 484.939822] niks3-server[1195]: 2026/09/25 15:20:59 INFO Received push request method=POST path=/api/pushes machine # [ 484.950910] niks3-server[1195]: 2026/09/25 15:20:59 INFO Received sign narinfos request method=POST path=/api/pushes/23/sign machine # [ 484.954893] niks3-server[1195]: 2026/09/25 15:20:59 INFO Signed narinfos id=23 count=1 machine # [ 484.957917] niks3-server[1195]: 2026/09/25 15:20:59 INFO Registered completed upload object_key=nar/0cbxkyxz068xc5mivh2h67kw6y01n1x28cbs11v1a03g8m4c71zm.nar.zst machine # [ 484.960622] niks3-server[1195]: 2026/09/25 15:20:59 INFO Received complete push request method=POST path=/api/pushes/23/complete machine # [ 484.964237] niks3-server[1195]: 2026/09/25 15:20:59 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.narinfo machine # [ 484.967652] niks3-server[1195]: 2026/09/25 15:20:59 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.ls machine # [ 509.690268] niks3-server[1195]: 2026/09/25 15:21:24 INFO Received push request method=POST path=/api/pushes machine # [ 509.706916] niks3-server[1195]: 2026/09/25 15:21:24 INFO Received sign narinfos request method=POST path=/api/pushes/24/sign machine # [ 509.709821] niks3-server[1195]: 2026/09/25 15:21:24 INFO Signed narinfos id=24 count=1 machine # [ 509.713238] niks3-server[1195]: 2026/09/25 15:21:24 INFO Registered completed upload object_key=nar/0khxywxb2r78vhpc5hsmha3ymgp910z0aka7550jmaqzs333rmzp.nar.zst machine # [ 509.719948] niks3-server[1195]: 2026/09/25 15:21:24 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.ls machine # [ 509.724775] niks3-server[1195]: 2026/09/25 15:21:24 INFO Registered completed upload object_key=log/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4-k3s-b.drv machine # [ 509.729539] niks3-server[1195]: 2026/09/25 15:21:24 INFO Received complete push request method=POST path=/api/pushes/24/complete machine # [ 509.735459] niks3-server[1195]: 2026/09/25 15:21:24 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.narinfo machine # [ 509.807885] niks3-server[1195]: 2026/09/25 15:21:24 INFO Received push request method=POST path=/api/pushes machine # [ 509.822764] niks3-server[1195]: 2026/09/25 15:21:24 INFO Received sign narinfos request method=POST path=/api/pushes/25/sign machine # [ 509.823904] niks3-server[1195]: 2026/09/25 15:21:24 INFO Signed narinfos id=25 count=1 machine # [ 509.826552] niks3-server[1195]: 2026/09/25 15:21:24 INFO Registered completed upload object_key=nar/04bim5f8bvjh25xncf5x40kb529khrlzcbc92qxvapgbc0bdfv2h.nar.zst machine # [ 509.829657] niks3-server[1195]: 2026/09/25 15:21:24 INFO Received complete push request method=POST path=/api/pushes/25/complete machine # [ 509.834830] niks3-server[1195]: 2026/09/25 15:21:24 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.narinfo machine # [ 509.842736] niks3-server[1195]: 2026/09/25 15:21:24 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.ls machine # [ 534.556356] niks3-server[1195]: 2026/09/25 15:21:49 INFO Received push request method=POST path=/api/pushes machine # [ 534.570931] niks3-server[1195]: 2026/09/25 15:21:49 INFO Received sign narinfos request method=POST path=/api/pushes/26/sign machine # [ 534.574549] niks3-server[1195]: 2026/09/25 15:21:49 INFO Signed narinfos id=26 count=1 machine # [ 534.577594] niks3-server[1195]: 2026/09/25 15:21:49 INFO Registered completed upload object_key=log/jz7biafi8rj5r3r392blyazw5mdpvy0d-k3s-top.drv machine # [ 534.581414] niks3-server[1195]: 2026/09/25 15:21:49 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.ls machine # [ 534.583972] niks3-server[1195]: 2026/09/25 15:21:49 INFO Registered completed upload object_key=nar/11f7f1hixry25c2yc6np9hs10a2pwwqmymmrxxbswhdjabcyvv0s.nar.zst machine # [ 534.594362] niks3-server[1195]: 2026/09/25 15:21:49 INFO Received complete push request method=POST path=/api/pushes/26/complete machine # [ 534.601990] niks3-server[1195]: 2026/09/25 15:21:49 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1, in 75.81 seconds) (finished: subtest: a renewed balancer certificate is served without a rollout, in 154.00 seconds) subtest: metrics carry build_info machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-c74f46454-k9g7r -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-c74f46454-k9g7r -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.20 seconds) machine: must succeed: curl -sf http://10.42.0.7:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-c74f46454-k9g7r"' machine: (finished: must succeed: curl -sf http://10.42.0.7:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-c74f46454-k9g7r"', in 0.04 seconds) (finished: subtest: metrics carry build_info, in 0.24 seconds) subtest: harmonia-gc frees space and the worker stays Ready machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-c74f46454-k9g7r -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'' machine # [ 536.091379] k3s[881]: E0925 15:21:50.819953 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:50396: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-c74f46454-k9g7r -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'', in 0.20 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-c74f46454-k9g7r -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done' machine # [ 536.377323] k3s[881]: E0925 15:21:51.106054 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:50428: use of closed network connection machine # [ 536.379211] k3s[881]: time="2026-09-25T15:21:51Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:34046->127.0.0.1:10250: write: broken pipe" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-c74f46454-k9g7r -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done', in 0.29 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-c74f46454-k9g7r -c gc -- sh -c 'fallocate -l 11437371392 /nix/fill' machine # [ 536.634242] k3s[881]: E0925 15:21:51.362870 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:50456: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-c74f46454-k9g7r -c gc -- sh -c 'fallocate -l 11437371392 /nix/fill', in 0.25 seconds) machine: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-c74f46454-k9g7r -c gc --since=30s | grep -q 'store paths deleted' machine: (finished: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-c74f46454-k9g7r -c gc --since=30s | grep -q 'store paths deleted', in 3.90 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-c74f46454-k9g7r -c gc -- sh -c 'rm /nix/fill' machine # [ 540.758865] k3s[881]: E0925 15:21:55.487386 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:50510: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-c74f46454-k9g7r -c gc -- sh -c 'rm /nix/fill', in 0.22 seconds) machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-c74f46454-k9g7r -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-c74f46454-k9g7r -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}', in 0.15 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-c74f46454-k9g7r -c gc -- sh -c 'command -v nix-daemon && command -v niks3' machine # [ 541.106716] k3s[881]: E0925 15:21:55.835535 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:50550: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-c74f46454-k9g7r -c gc -- sh -c 'command -v nix-daemon && command -v niks3', in 0.20 seconds) (finished: subtest: harmonia-gc frees space and the worker stays Ready, in 5.22 seconds) subtest: losing the balancer mid-build: the client reconnects and the build succeeds machine: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1 machine # [ 541.136130] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1. machine # Running as unit: vialb.service; invocation ID: 4abd7f853ebe475d8d90236a48a6a455 machine: (finished: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1, in 0.03 seconds) machine: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'" machine # [ 541.274424] nix[11089]: don't know how to build these paths: machine # [ 541.275839] nix[11089]: /nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 541.299236] nix[11089]: copying 1 paths to '127.0.0.1:30051'... machine # [ 541.301387] nix[11089]: copying path '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' to '127.0.0.1:30051'... machine # [ 541.358381] niks3-server[1195]: 2026/09/25 15:21:56 INFO Received push request method=POST path=/api/pushes machine # [ 541.375765] niks3-server[1195]: 2026/09/25 15:21:56 INFO Received sign narinfos request method=POST path=/api/pushes/27/sign machine # [ 541.377614] niks3-server[1195]: 2026/09/25 15:21:56 INFO Signed narinfos id=27 count=1 machine # [ 541.380966] niks3-server[1195]: 2026/09/25 15:21:56 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.ls machine # [ 541.382637] niks3-server[1195]: 2026/09/25 15:21:56 INFO Registered completed upload object_key=nar/0kkr2vb091wkq0cb0f1q92413dsfskh76wydp8mwysv7rawns0ar.nar.zst machine # [ 541.388738] niks3-server[1195]: 2026/09/25 15:21:56 INFO Received complete push request method=POST path=/api/pushes/27/complete machine # [ 541.394398] niks3-server[1195]: 2026/09/25 15:21:56 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.narinfo machine # [ 541.404085] nix[11089]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 541.405616] nix[11089]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-c74f46454-k9g7r: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine: (finished: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'", in 1.06 seconds) machine: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false machine: (finished: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false, in 0.27 seconds) machine: waiting for success: ! systemctl is-active vialb machine # [ 542.488480] nix[11089]: d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv: Stream removed (Socket closed), asking the scheduler again machine # [ 542.490505] nix[11089]: scheduler at 127.0.0.1:30051: Stream removed (Socket closed), reconnecting machine # [ 542.513902] systemd[1]: cri-containerd-19eef125f75628b2a41004fa8ad1fc1a0ad989d5d2bf8b904ddd475c408d56c9.scope: Deactivated successfully. machine # [ 542.516273] systemd[1]: cri-containerd-19eef125f75628b2a41004fa8ad1fc1a0ad989d5d2bf8b904ddd475c408d56c9.scope: Consumed 5.906s CPU time over 8min 22.435s wall clock time, 60.4M memory peak, 38.1M read from disk, 647K incoming IP traffic, 783.4K outgoing IP traffic. machine # [ 542.548812] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-19eef125f75628b2a41004fa8ad1fc1a0ad989d5d2bf8b904ddd475c408d56c9-rootfs.mount: Deactivated successfully. machine # [ 542.579226] systemd[1]: cri-containerd-209e4e808507f23e282e76fe438afddf0a12a712a2bb7e37c6b5247ce7e84d3b.scope: Deactivated successfully. machine # [ 542.612332] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-209e4e808507f23e282e76fe438afddf0a12a712a2bb7e37c6b5247ce7e84d3b-rootfs.mount: Deactivated successfully. machine # [ 542.639941] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-209e4e808507f23e282e76fe438afddf0a12a712a2bb7e37c6b5247ce7e84d3b-shm.mount: Deactivated successfully. machine # [ 542.676351] d[ 542.827327] cni0: port 3(veth5e542efe) entered disabled state machine # hcpcd[3408]: veth5e542efe: carrier lost machine # [ 542.829972] veth5e542efe (unregistering): left allmulticast mode machine # [ 542.831195] veth5e542efe (unregistering): left promiscuous mode machine # [ 542.832488] cni0: port 3(veth5e542efe) entered disabled state machine # [ 542.700674] systemd[1]: run-netns-cni\x2dc69925f6\x2d59cd\x2dda9f\x2d5893\x2d1edae073c055.mount: Deactivated successfully. machine # [ 542.716468] dhcpcd[3408]: veth5e542efe: deleting route to 169.254.0.0/16 machine # [ 542.762878] systemd[1]: Created slice libcontainer container kubepods-besteffort-podca5a8253_9b24_44ca_bb30_78822830991a.slice. machine # [ 542.794420] dhcpcd[3408]: veth5e542efe: removing interface machine # [ 542.833690] k3s[881]: I0925 15:21:57.562319 881 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/dd86dd1b-ad3c-4f21-8466-0b9afab6519d-config\" (UniqueName: \"kubernetes.io/configmap/dd86dd1b-ad3c-4f21-8466-0b9afab6519d-config\") pod \"dd86dd1b-ad3c-4f21-8466-0b9afab6519d\" (UID: \"dd86dd1b-ad3c-4f21-8466-0b9afab6519d\") " machine # [ 542.838306] k3s[881]: I0925 15:21:57.562379 881 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dd86dd1b-ad3c-4f21-8466-0b9afab6519d-tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd86dd1b-ad3c-4f21-8466-0b9afab6519d-tmp\") pod \"dd86dd1b-ad3c-4f21-8466-0b9afab6519d\" (UID: \"dd86dd1b-ad3c-4f21-8466-0b9afab6519d\") " machine # [ 542.842632] k3s[881]: I0925 15:21:57.562410 881 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/dd86dd1b-ad3c-4f21-8466-0b9afab6519d-tls-ca\" (UniqueName: \"kubernetes.io/secret/dd86dd1b-ad3c-4f21-8466-0b9afab6519d-tls-ca\") pod \"dd86dd1b-ad3c-4f21-8466-0b9afab6519d\" (UID: \"dd86dd1b-ad3c-4f21-8466-0b9afab6519d\") " machine # [ 542.846858] k3s[881]: I0925 15:21:57.562445 881 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/dd86dd1b-ad3c-4f21-8466-0b9afab6519d-tls-lb\" (UniqueName: \"kubernetes.io/secret/dd86dd1b-ad3c-4f21-8466-0b9afab6519d-tls-lb\") pod \"dd86dd1b-ad3c-4f21-8466-0b9afab6519d\" (UID: \"dd86dd1b-ad3c-4f21-8466-0b9afab6519d\") " machine # [ 542.851081] k3s[881]: I0925 15:21:57.569020 881 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd86dd1b-ad3c-4f21-8466-0b9afab6519d-tls-lb" pod "dd86dd1b-ad3c-4f21-8466-0b9afab6519d" (UID: "dd86dd1b-ad3c-4f21-8466-0b9afab6519d"). InnerVolumeSpecName "tls-lb". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 542.855196] k3s[881]: I0925 15:21:57.572442 881 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd86dd1b-ad3c-4f21-8466-0b9afab6519d-tmp" pod "dd86dd1b-ad3c-4f21-8466-0b9afab6519d" (UID: "dd86dd1b-ad3c-4f21-8466-0b9afab6519d"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 542.859294] k3s[881]: I0925 15:21:57.572790 881 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd86dd1b-ad3c-4f21-8466-0b9afab6519d-tls-ca" pod "dd86dd1b-ad3c-4f21-8466-0b9afab6519d" (UID: "dd86dd1b-ad3c-4f21-8466-0b9afab6519d"). InnerVolumeSpecName "tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 542.863335] systemd[1]: var-lib-kubelet-pods-dd86dd1b\x2dad3c\x2d4f21\x2d8466\x2d0b9afab6519d-volumes-kubernetes.io\x7esecret-tls\x2dlb.mount: Deactivated successfully. machine # [ 542.865423] k3s[881]: I0925 15:21:57.585425 881 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd86dd1b-ad3c-4f21-8466-0b9afab6519d-config" pod "dd86dd1b-ad3c-4f21-8466-0b9afab6519d" (UID: "dd86dd1b-ad3c-4f21-8466-0b9afab6519d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 542.920589] k3s[881]: I0925 15:21:57.649525 881 scope.go:122] "RemoveContainer" containerID="19eef125f75628b2a41004fa8ad1fc1a0ad989d5d2bf8b904ddd475c408d56c9" machine # [ 542.928908] systemd[1]: Removed slice libcontainer container kubepods-besteffort-poddd86dd1b_ad3c_4f21_8466_0b9afab6519d.slice. machine # [ 542.929814] systemd[1]: kubepods-besteffort-poddd86dd1b_ad3c_4f21_8466_0b9afab6519d.slice: Consumed 5.937s CPU time over 8min 24.379s wall clock time, 60.7M memory peak, 38.1M read from disk, 647K incoming IP traffic, 783.4K outgoing IP traffic. machine # [ 542.934225] k3s[881]: I0925 15:21:57.662838 881 scope.go:122] "RemoveContainer" containerID="19eef125f75628b2a41004fa8ad1fc1a0ad989d5d2bf8b904ddd475c408d56c9" machine # [ 542.934877] k3s[881]: I0925 15:21:57.663145 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/ca5a8253-9b24-44ca-bb30-78822830991a-tls-lb\") pod \"nix-grpc-farm-lb-75b44f88dd-gwqmt\" (UID: \"ca5a8253-9b24-44ca-bb30-78822830991a\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-gwqmt" machine # [ 542.935528] k3s[881]: I0925 15:21:57.663177 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/ca5a8253-9b24-44ca-bb30-78822830991a-tls-ca\") pod \"nix-grpc-farm-lb-75b44f88dd-gwqmt\" (UID: \"ca5a8253-9b24-44ca-bb30-78822830991a\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-gwqmt" machine # [ 542.935865] k3s[881]: I0925 15:21:57.663205 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca5a8253-9b24-44ca-bb30-78822830991a-tmp\") pod \"nix-grpc-farm-lb-75b44f88dd-gwqmt\" (UID: \"ca5a8253-9b24-44ca-bb30-78822830991a\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-gwqmt" machine # [ 542.936588] k3s[881]: I0925 15:21:57.663233 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ca5a8253-9b24-44ca-bb30-78822830991a-config\") pod \"nix-grpc-farm-lb-75b44f88dd-gwqmt\" (UID: \"ca5a8253-9b24-44ca-bb30-78822830991a\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-gwqmt" machine # [ 542.937425] k3s[881]: I0925 15:21:57.663261 881 reconciler_common.go:299] "Volume detached for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/dd86dd1b-ad3c-4f21-8466-0b9afab6519d-tls-lb\") on node \"machine\" DevicePath \"\"" machine # [ 542.938496] k3s[881]: I0925 15:21:57.663279 881 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dd86dd1b-ad3c-4f21-8466-0b9afab6519d-config\") on node \"machine\" DevicePath \"\"" machine # [ 542.939304] k3s[881]: I0925 15:21:57.663294 881 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd86dd1b-ad3c-4f21-8466-0b9afab6519d-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 542.939740] k3s[881]: I0925 15:21:57.663307 881 reconciler_common.go:299] "Volume detached for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/dd86dd1b-ad3c-4f21-8466-0b9afab6519d-tls-ca\") on node \"machine\" DevicePath \"\"" machine # [ 542.940471] k3s[881]: E0925 15:21:57.669251 881 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"19eef125f75628b2a41004fa8ad1fc1a0ad989d5d2bf8b904ddd475c408d56c9\": not found" containerID="19eef125f75628b2a41004fa8ad1fc1a0ad989d5d2bf8b904ddd475c408d56c9" machine # [ 542.940984] k3s[881]: I0925 15:21:57.669294 881 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"19eef125f75628b2a41004fa8ad1fc1a0ad989d5d2bf8b904ddd475c408d56c9"} err="failed to get container status \"19eef125f75628b2a41004fa8ad1fc1a0ad989d5d2bf8b904ddd475c408d56c9\": rpc error: code = NotFound desc = an error occurred when try to find container \"19eef125f75628b2a41004fa8ad1fc1a0ad989d5d2bf8b904ddd475c408d56c9\": not found" machine # [ 543.096091] (udev-worker)[112[ 543.247453] cni0: port 1(vethf8dfa036) entered blocking state machine # 64]: Network interface NamePolicy= disabled on kernel command line. machine # [ 543.249110] cni0: port 1(vethf8dfa036) entered disabled state machine # [ 543.250480] vethf8dfa036: entered allmulticast mode machine # [ 543.251378] vethf8dfa036: entered promiscuous mode machine # [ 543.259787] cni0: port 1(vethf8dfa036) entered blocking state machine # [ 543.261239] cni0: port 1(vethf8dfa036) entered forwarding state machine # [ 543.128140] dhcpcd[3408]: vethf8dfa036: IAID 1e:34:c5:bf machine # [ 543.129128] dhcpcd[3408]: vethf8dfa036: adding address fe80::8832:1eff:fe34:c5bf machine # [ 543.198719] systemd[1]: Started libcontainer container 34dbd29a2fecb13367a5a4505220c6d097bed66fa4e297cf80d3b2d1627b55ab. machine # [ 543.328392] systemd[1]: Started libcontainer container 67e6b6533bf823fb4554e331da43fdfa632c91166171081e7d1a97949e15a3d7. machine # [ 543.562583] k3s[881]: I0925 15:21:58.291470 881 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dd86dd1b-ad3c-4f21-8466-0b9afab6519d" path="/var/lib/kubelet/pods/dd86dd1b-ad3c-4f21-8466-0b9afab6519d/volumes" machine # [ 543.569507] systemd[1]: var-lib-kubelet-pods-dd86dd1b\x2dad3c\x2d4f21\x2d8466\x2d0b9afab6519d-volume\x2dsubpaths-config-envoy-2.mount: Deactivated successfully. machine # [ 543.573954] systemd[1]: var-lib-kubelet-pods-dd86dd1b\x2dad3c\x2d4f21\x2d8466\x2d0b9afab6519d-volume\x2dsubpaths-config-envoy-1.mount: Deactivated successfully. machine # [ 543.578403] systemd[1]: var-lib-kubelet-pods-dd86dd1b\x2dad3c\x2d4f21\x2d8466\x2d0b9afab6519d-volume\x2dsubpaths-config-envoy-0.mount: Deactivated successfully. machine # [ 543.582264] systemd[1]: var-lib-kubelet-pods-dd86dd1b\x2dad3c\x2d4f21\x2d8466\x2d0b9afab6519d-volumes-kubernetes.io\x7esecret-tls\x2dca.mount: Deactivated successfully. machine # [ 543.585780] systemd[1]: var-lib-kubelet-pods-dd86dd1b\x2dad3c\x2d4f21\x2d8466\x2d0b9afab6519d-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 544.841155] dhcpcd[3408]: vethf8dfa036: soliciting a DHCP lease machine # [ 544.991935] nix[11089]: scheduler at 127.0.0.1:30051: failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:30051: tcp handshaker shutdown, reconnecting machine # [ 545.110396] dhcpcd[3408]: vethf8dfa036: soliciting an IPv6 router machine # [ 545.992584] nix[11089]: scheduler at 127.0.0.1:30051: failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:30051: tcp handshaker shutdown, reconnecting machine # [ 547.993299] nix[11089]: scheduler at 127.0.0.1:30051: failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:30051: Failed to connect to remote host: Connection refused, reconnecting machine # [ 548.963674] k3s[881]: I0925 15:22:03.691719 881 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-75b44f88dd-gwqmt" podStartSLOduration=6.691669829 podStartE2EDuration="6.691669829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-25 15:21:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-25 15:21:58.690342565 +0000 UTC m=+526.787631609" watchObservedRunningTime="2026-09-25 15:22:03.691669829 +0000 UTC m=+531.788958592" machine # [ 549.842396] dhcpcd[3408]: vethf8dfa036: probing for an IPv4LL address machine # [ 552.045287] nix[11089]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 552.047710] nix[11089]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-c74f46454-s5vbj: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 555.067921] dhcpcd[3408]: vethf8dfa036: using IPv4LL address 169.254.98.218 machine # [ 555.069655] dhcpcd[3408]: vethf8dfa036: adding route to 169.254.0.0/16 machine # [ 557.117390] dhcpcd[3408]: vethf8dfa036: no IPv6 Routers available machine # [ 596.794233] niks3-server[1195]: 2026/09/25 15:22:51 INFO Received push request method=POST path=/api/pushes machine # [ 596.814546] niks3-server[1195]: 2026/09/25 15:22:51 INFO Received sign narinfos request method=POST path=/api/pushes/28/sign machine # [ 596.816450] niks3-server[1195]: 2026/09/25 15:22:51 INFO Signed narinfos id=28 count=1 machine # [ 596.819314] niks3-server[1195]: 2026/09/25 15:22:51 INFO Registered completed upload object_key=log/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 596.824577] niks3-server[1195]: 2026/09/25 15:22:51 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.ls machine # [ 596.826901] niks3-server[1195]: 2026/09/25 15:22:51 INFO Received complete push request method=POST path=/api/pushes/28/complete machine # [ 596.834117] niks3-server[1195]: 2026/09/25 15:22:51 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.narinfo machine # [ 596.870332] systemd[1]: vialb.service: Deactivated successfully. machine # [ 596.872043] systemd[1]: vialb.service: Consumed 254ms CPU time over 55.734s wall clock time, 40.8M memory peak, 4K written to disk, 8.5K incoming IP traffic, 17.6K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active vialb, in 55.28 seconds) machine: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; }, in 0.04 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 0.32 seconds) (finished: subtest: losing the balancer mid-build: the client reconnects and the build succeeds, in 57.00 seconds) subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes machine: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 machine # [ 598.152181] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1. machine # Running as unit: slow.service; invocation ID: 55a66882d2de4861b597a82dfaaf01c0 machine: (finished: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1, in 0.05 seconds) machine # [ 598.327808] nix[12133]: don't know how to build these paths: machine # [ 598.328758] nix[12133]: /nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 598.350888] nix[12133]: copying 1 paths to '127.0.0.1:30051'... machine # [ 598.351840] nix[12133]: copying path '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' to '127.0.0.1:30051'... machine # command terminated with exit code 1 machine # [ 598.388721] k3s[881]: E0925 15:22:53.116164 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43426: use of closed network connection machine # [ 598.399698] niks3-server[1195]: 2026/09/25 15:22:53 INFO Received push request method=POST path=/api/pushes machine # [ 598.413914] niks3-server[1195]: 2026/09/25 15:22:53 INFO Received sign narinfos request method=POST path=/api/pushes/29/sign machine # [ 598.414923] niks3-server[1195]: 2026/09/25 15:22:53 INFO Signed narinfos id=29 count=1 machine # [ 598.418680] niks3-server[1195]: 2026/09/25 15:22:53 INFO Registered completed upload object_key=nar/0wl2i9xpw0gwrx1xqdgx9ka4n503ky9qhl20pdrdlphn8d6lcx0i.nar.zst machine # [ 598.421687] niks3-server[1195]: 2026/09/25 15:22:53 INFO Received complete push request method=POST path=/api/pushes/29/complete machine # [ 598.422491] niks3-server[1195]: 2026/09/25 15:22:53 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.ls machine # [ 598.429239] niks3-server[1195]: 2026/09/25 15:22:53 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.narinfo machine # [ 598.437810] nix[12133]: building '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' on 127.0.0.1:30051... machine # [ 598.438457] nix[12133]: slow-s1> machine/nix-grpc-farm-worker-x86-64-linux-c74f46454-k9g7r: building zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 598.605867] k3s[881]: E0925 15:22:53.334813 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43466: use of closed network connection machine # command terminated with exit code 1 machine # [ 599.930380] k3s[881]: E0925 15:22:54.658919 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43504: use of closed network connection machine # command terminated with exit code 1 machine # [ 600.138665] k3s[881]: E0925 15:22:54.867528 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43532: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 601.438871] k3s[881]: time="2026-09-25T15:22:56Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:56758->127.0.0.1:10250: write: broken pipe" machine # [ 601.440904] k3s[881]: E0925 15:22:56.167414 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43552: use of closed network connection machine # [ 601.639926] k3s[881]: E0925 15:22:56.368793 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43572: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 602.926238] k3s[881]: E0925 15:22:57.654834 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43612: use of closed network connection machine # [ 603.133655] k3s[881]: E0925 15:22:57.862596 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33036: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 604.444672] k3s[881]: E0925 15:22:59.173289 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33068: use of closed network connection machine # [ 604.658377] k3s[881]: E0925 15:22:59.387236 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33112: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 605.972545] k3s[881]: E0925 15:23:00.701043 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33150: use of closed network connection machine # [ 606.171068] k3s[881]: E0925 15:23:00.899847 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33174: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 607.448926] k3s[881]: E0925 15:23:02.177508 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33202: use of closed network connection machine # [ 607.644049] k3s[881]: E0925 15:23:02.372876 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33226: use of closed network connection machine # command terminated with exit code 1 machine # [ 608.946977] k3s[881]: E0925 15:23:03.675587 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33262: use of closed network connection machine # command terminated with exit code 1 machine # [ 609.160356] k3s[881]: E0925 15:23:03.889312 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33284: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 610.467579] k3s[881]: E0925 15:23:05.196152 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33300: use of closed network connection machine # [ 610.676826] k3s[881]: E0925 15:23:05.405687 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33318: use of closed network connection machine # command terminated with exit code 1 machine # [ 610.766204] postgres[761]: [761] LOG: checkpoint starting: time machine # command terminated with exit code 1 machine # [ 611.981795] k3s[881]: E0925 15:23:06.709976 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33358: use of closed network connection machine # command terminated with exit code 1 machine # [ 612.194484] k3s[881]: E0925 15:23:06.922600 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33384: use of closed network connection machine # [ 613.307807] postgres[761]: [761] LOG: checkpoint complete: wrote 25 buffers (0.2%), wrote 1 SLRU buffers; 0 WAL file(s) added, 0 removed, 0 recycled; write=2.514 s, sync=0.009 s, total=2.543 s; sync files=21, longest=0.004 s, average=0.001 s; distance=224 kB, estimate=4511 kB; lsn=0/1C7D498, redo lsn=0/1C7D440 machine # command terminated with exit code 1 machine # [ 613.516639] k3s[881]: E0925 15:23:08.244932 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38718: use of closed network connection machine # command terminated with exit code 1 machine # [ 613.725214] k3s[881]: E0925 15:23:08.453178 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38754: use of closed network connection machine # [ 615.041672] k3s[881]: E0925 15:23:09.770228 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38780: use of closed network connection machine # command terminated with exit code 1 machine # [ 615.251189] k3s[881]: E0925 15:23:09.980110 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38800: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 616.556321] k3s[881]: E0925 15:23:11.284548 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38824: use of closed network connection machine # [ 616.764664] k3s[881]: time="2026-09-25T15:23:11Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:38518->127.0.0.1:10250: write: broken pipe" machine # command terminated with exit code 1 machine # [ 616.765587] k3s[881]: E0925 15:23:11.493902 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38860: use of closed network connection machine # command terminated with exit code 1 machine # [ 618.073122] k3s[881]: E0925 15:23:12.801633 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38888: use of closed network connection machine # [ 618.271970] k3s[881]: E0925 15:23:13.000908 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38922: use of closed network connection machine # command terminated with exit code 1 machine # [ 619.566722] k3s[881]: E0925 15:23:14.295248 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38946: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 619.772292] k3s[881]: E0925 15:23:14.500948 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38982: use of closed network connection machine # [ 620.047081] k3s[881]: I0925 15:23:14.775160 881 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # command terminated with exit code 1 machine # [ 621.061732] k3s[881]: E0925 15:23:15.788744 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39016: use of closed network connection machine # [ 621.265279] k3s[881]: E0925 15:23:15.994199 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39040: use of closed network connection machine # command terminated with exit code 1 machine # [ 622.550459] k3s[881]: E0925 15:23:17.278803 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39060: use of closed network connection machine # command terminated with exit code 1 machine # [ 622.796602] k3s[881]: E0925 15:23:17.525408 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39096: use of closed network connection machine # command terminated with exit code 1 machine # [ 624.051430] k3s[881]: E0925 15:23:18.779947 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58928: use of closed network connection machine # [ 624.254106] k3s[881]: E0925 15:23:18.979049 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58936: use of closed network connection machine: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-c74f46454-k9g7r --wait=false machine: (finished: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-c74f46454-k9g7r --wait=false, in 0.17 seconds) machine: must succeed: sleep 5.0 machine # [ 624.477407] systemd[1]: cri-containerd-b6a94b85e0a3f4c27c5250da8c39dfb6f743b0b56120f7d357431b6d0a153186.scope: Deactivated successfully. machine # [ 624.480079] systemd[1]: cri-containerd-b6a94b85e0a3f4c27c5250da8c39dfb6f743b0b56120f7d357431b6d0a153186.scope: Consumed 653ms CPU time over 9min 35.157s wall clock time, 13.4M memory peak, 5.3M read from disk. machine # [ 624.514543] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-b6a94b85e0a3f4c27c5250da8c39dfb6f743b0b56120f7d357431b6d0a153186-rootfs.mount: Deactivated successfully. machine # [ 625.385039] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod931d070d_17da_4b63_b771_18fafe789c85.slice. machine # [ 625.463242] k3s[881]: I0925 15:23:20.191787 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/931d070d-17da-4b63-b771-18fafe789c85-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-xpkvd\" (UID: \"931d070d-17da-4b63-b771-18fafe789c85\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-xpkvd" machine # [ 625.468468] k3s[881]: I0925 15:23:20.191840 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/931d070d-17da-4b63-b771-18fafe789c85-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-xpkvd\" (UID: \"931d070d-17da-4b63-b771-18fafe789c85\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-xpkvd" machine # [ 625.472838] k3s[881]: I0925 15:23:20.191878 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/931d070d-17da-4b63-b771-18fafe789c85-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-xpkvd\" (UID: \"931d070d-17da-4b63-b771-18fafe789c85\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-xpkvd" machine # [ 625.477347] k3s[881]: I0925 15:23:20.191911 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/931d070d-17da-4b63-b771-18fafe789c85-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-xpkvd\" (UID: \"931d070d-17da-4b63-b771-18fafe789c85\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-xpkvd" machine # [ 625.481791] k3s[881]: I0925 15:23:20.191942 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/931d070d-17da-4b63-b771-18fafe789c85-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-xpkvd\" (UID: \"931d070d-17da-4b63-b771-18fafe789c85\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-xpkvd" machine # [ 625.486351] k3s[881]: I0925 15:23:20.191974 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qt9v\" (UniqueName: \"kubernetes.io/projected/931d070d-17da-4b63-b771-18fafe789c85-kube-api-access-2qt9v\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-xpkvd\" (UID: \"931d070d-17da-4b63-b771-18fafe789c85\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-xpkvd" machine # [ 625.491260] k3s[881]: I0925 15:23:20.192003 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/931d070d-17da-4b63-b771-18fafe789c85-build\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-xpkvd\" (UID: \"931d070d-17da-4b63-b771-18fafe789c85\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-xpkvd" machine # [ 625.496426] k3s[881]: I0925 15:23:20.192037 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/931d070d-17da-4b63-b771-18fafe789c85-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-xpkvd\" (UID: \"931d070d-17da-4b63-b771-18fafe789c85\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-xpkvd" machine # [ 625.917340] cni0: port 3(veth7b198077) entered blocking state machine # [ 625.919697] cni0: port 3(veth7b198077) entered disabled state machine # [ 625.921744] veth7b198077: entered allmulticast mode machine # [ 625.923639] veth7b198077: entered promiscuous mode machine # [ 625.943635] cni0: port 3(veth7b198077) entered blocking state machine # [ 625.945204] cni0: port 3(veth7b198077) entered forwarding state machine # [ 625.827485] (udev-worker)[13752]: Network interface NamePolicy= disabled on kernel command line. machine # [ 625.860156] dhcpcd[3408]: veth7b198077: IAID cd:7a:e5:e0 machine # [ 625.860714] dhcpcd[3408]: veth7b198077: adding address fe80::87f:cdff:fe7a:e5e0 machine # [ 625.897775] systemd[1]: Started libcontainer container debb92fb4117ed0354128a82338eb9c19176c67ffb239ef58c0313704285520b. machine # [ 626.126447] systemd[1]: Started libcontainer container efe56ff6069029167d6cc5f57a74ec85f600225f576617ec09abf2b51c8891a2. machine # [ 627.182706] dhcpcd[3408]: veth7b198077: soliciting a DHCP lease machine # [ 627.544142] dhcpcd[3408]: veth7b198077: soliciting an IPv6 router machine # [ 628.477981] systemd[1]: cri-containerd-efe56ff6069029167d6cc5f57a74ec85f600225f576617ec09abf2b51c8891a2.scope: Deactivated successfully. machine # [ 628.479397] systemd[1]: cri-containerd-efe56ff6069029167d6cc5f57a74ec85f600225f576617ec09abf2b51c8891a2.scope: Consumed 1.035s CPU time over 2.349s wall clock time, 461.5M memory peak, 183.3M read from disk, 217M written to disk. machine # [ 628.548621] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-efe56ff6069029167d6cc5f57a74ec85f600225f576617ec09abf2b51c8891a2-rootfs.mount: Deactivated successfully. machine # [ 629.398218] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped379997585.mount: Deactivated successfully. machine: (finished: must succeed: sleep 5.0, in 5.02 seconds) machine # [ 629.473349] systemd[1]: Started libcontainer container 11335f78c54b5d958c1ce3b5fdba3528fa0d199303af33e128dc5def8c3717dc. machine # [ 629.549125] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped2541835453.mount: Deactivated successfully. machine # [ 629.596673] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped1000993997.mount: Deactivated successfully. machine # [ 629.695064] k3s[881]: E0925 15:23:24.423232 881 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58966: use of closed network connection machine: waiting for success: ! systemctl is-active slow machine # [ 629.723605] systemd[1]: Started libcontainer container f35ad67a5116e87165f5ef3f7771d62970587e76dd91f32a2446571125b3d0f1. machine # [ 630.003652] systemd[1]: Started libcontainer container 945369788f5c8039c1d14300e9a87a544742a7cc384abd4040d653bee13c19e2. machine # [ 630.366488] k3s[881]: I0925 15:23:25.095035 881 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-xpkvd" podStartSLOduration=2.777706453 podStartE2EDuration="5.095009909s" totalImagesPullingTime="0s" totalInitContainerRuntime="2.317303456s" isStatefulPod=false podCreationTimestamp="2026-09-25 15:23:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-25 15:23:25.093371153 +0000 UTC m=+613.190660196" watchObservedRunningTime="2026-09-25 15:23:25.095009909 +0000 UTC m=+613.192293923" machine # [ 630.551644] systemd[1]: tmp-ovl\x2didmapped1197747683.mount: Deactivated successfully. machine # [ 632.184156] dhcpcd[3408]: veth7b198077: probing for an IPv4LL address machine # [ 636.660188] dhcpcd[3408]: veth7b198077: using IPv4LL address 169.254.27.172 machine # [ 636.662401] dhcpcd[3408]: veth7b198077: adding route to 169.254.0.0/16 machine # [ 639.552764] dhcpcd[3408]: veth7b198077: no IPv6 Routers available machine # [ 643.592891] niks3-server[1195]: 2026/09/25 15:23:38 INFO Received push request method=POST path=/api/pushes machine # [ 643.611211] niks3-server[1195]: 2026/09/25 15:23:38 INFO Received sign narinfos request method=POST path=/api/pushes/30/sign machine # [ 643.616104] niks3-server[1195]: 2026/09/25 15:23:38 INFO Signed narinfos id=30 count=1 machine # [ 643.621869] niks3-server[1195]: 2026/09/25 15:23:38 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.ls machine # [ 643.627976] niks3-server[1195]: 2026/09/25 15:23:38 INFO Received complete push request method=POST path=/api/pushes/30/complete machine # [ 643.631951] niks3-server[1195]: 2026/09/25 15:23:38 INFO Registered completed upload object_key=log/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 643.639486] niks3-server[1195]: 2026/09/25 15:23:38 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo machine # [ 644.697177] systemd[1]: slow.service: Deactivated successfully. machine # [ 644.699539] systemd[1]: slow.service: Consumed 223ms CPU time over 46.545s wall clock time, 38.5M memory peak, 4K written to disk, 5.4K incoming IP traffic, 11.7K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active slow, in 15.63 seconds) machine: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; }, in 0.04 seconds) machine: must fail: journalctl -u slow | grep -q 'asking the scheduler again' machine: (finished: must fail: journalctl -u slow | grep -q 'asking the scheduler again', in 0.03 seconds) machine: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath, in 0.15 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null, in 0.04 seconds) (finished: subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes, in 47.48 seconds) (finished: run the VM test script, in 646.45 seconds) test script finished in 646.50s cleanup kill QemuMachine (pid 45) machine # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) machine # [2026-09-25T15:23:41Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-09-25T15:23:41Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-09-25T15:23:41Z INFO virtiofsd] Client disconnected, shutting down (finished: cleanup, in 1.17 seconds) additionally exposed symbols: machine, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh