tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 1200.0 seconds run the VM test script machine: waiting for unit k3s.service machine: waiting for the VM to finish booting machine: starting vm machine # Disk image does not exist, creating the virtualisation disk image... machine: QEMU running (pid 45) machine # Formatting '/build/vm-state-machine/tmp.Ehwn3m2WDn', fmt=raw size=17179869184 machine # mke2fs 1.47.4 (6-Mar-2025) machine # Discarding device blocks: 0/4194304 done machine # Creating filesystem with 4194304 4k blocks and 1048576 inodes machine # Filesystem UUID: 1119e800-ae66-4619-89c4-86b6ae6f0e68 machine # Superblock backups stored on blocks: machine # 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208, machine # 4096000 machine # machine # Allocating group tables: 0/128 done machine # Writing inode tables: 0/128 done machine # Creating journal (32768 blocks): done machine # Writing superblocks and filesystem accounting information: 0/128 done machine # machine # Virtualisation disk image created. machine # Starting virtiofs daemons... machine # [2026-09-23T16:12:27Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-23T16:12:27Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-23T16:12:27Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-23T16:12:27Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-23T16:12:27Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-23T16:12:27Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-23T16:12:27Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-23T16:12:27Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-23T16:12:27Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-23T16:12:27Z INFO virtiofsd] Client connected, servicing requests machine # [2026-09-23T16:12:27Z INFO virtiofsd] Client connected, servicing requests machine # [2026-09-23T16:12:27Z INFO virtiofsd] Client connected, servicing requests machine # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) machine # machine # machine # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+7EFCC730+7EF2C730 CA00 machine # Press Ctrl-B to configure iPXE (PCI 00:02.0)... machine # machine # machine # machine # machine # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 7EFCC730 7EF2C730 CB00 machine # Press Ctrl-B to configure iPXE (PCI 00:05.0)... machine # machine # machine # Booting from ROM... machine # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 machine # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8yi3g3vyhs25c3m8sicmz3769ly30gw8-nixos-system-machine-test/init regInfo=/nix/store/0bp2zj73xm06bmqaajx283rgvymm1h46-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.000000] BIOS-provided physical RAM map: machine # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007ffd7fff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000007ffd8000-0x000000007fffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000017fffffff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved machine # [ 0.000000] NX (Execute Disable) protection: active machine # [ 0.000000] APIC: Static calls initialized machine # [ 0.000000] SMBIOS 2.8 present. machine # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 machine # [ 0.000000] DMI: Memory slots populated: 1/1 machine # [ 0.000000] Hypervisor detected: KVM machine # [ 0.000000] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 machine # [ 0.000000] kvm-clock: using sched offset of 505073687 cycles machine # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns machine # [ 0.000005] tsc: Detected 2400.012 MHz processor machine # [ 0.000811] last_pfn = 0x180000 max_arch_pfn = 0x10000000000 machine # [ 0.000839] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs machine # [ 0.000841] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT machine # [ 0.000880] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.002727] found SMP MP-table at [mem 0x000f5450-0x000f545f] machine # [ 0.002739] Using GB pages for direct mapping machine # [ 0.002831] RAMDISK: [mem 0x7e371000-0x7ffcffff] machine # [ 0.002840] ACPI: Early table checksum verification disabled machine # [ 0.002843] ACPI: RSDP 0x00000000000F5250 000014 (v00 BOCHS ) machine # [ 0.002847] ACPI: RSDT 0x000000007FFE2539 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002851] ACPI: FACP 0x000000007FFE2319 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002858] ACPI: DSDT 0x000000007FFE0040 0022D9 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002860] ACPI: FACS 0x000000007FFE0000 000040 machine # [ 0.002862] ACPI: APIC 0x000000007FFE240D 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002863] ACPI: HPET 0x000000007FFE249D 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002865] ACPI: MCFG 0x000000007FFE24D5 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002867] ACPI: WAET 0x000000007FFE2511 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002868] ACPI: Reserving FACP table memory at [mem 0x7ffe2319-0x7ffe240c] machine # [ 0.002869] ACPI: Reserving DSDT table memory at [mem 0x7ffe0040-0x7ffe2318] machine # [ 0.002870] ACPI: Reserving FACS table memory at [mem 0x7ffe0000-0x7ffe003f] machine # [ 0.002870] ACPI: Reserving APIC table memory at [mem 0x7ffe240d-0x7ffe249c] machine # [ 0.002871] ACPI: Reserving HPET table memory at [mem 0x7ffe249d-0x7ffe24d4] machine # [ 0.002871] ACPI: Reserving MCFG table memory at [mem 0x7ffe24d5-0x7ffe2510] machine # [ 0.002871] ACPI: Reserving WAET table memory at [mem 0x7ffe2511-0x7ffe2538] machine # [ 0.003116] No NUMA configuration found machine # [ 0.003117] Faking a node at [mem 0x0000000000000000-0x000000017fffffff] machine # [ 0.003119] NODE_DATA(0) allocated [mem 0x17fffa780-0x17ffffcff] machine # [ 0.005485] Zone ranges: machine # [ 0.005486] DMA [mem 0x0000000000001000-0x0000000000ffffff] machine # [ 0.005488] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] machine # [ 0.005489] Normal [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005490] Device empty machine # [ 0.005491] Movable zone start for each node machine # [ 0.005492] Early memory node ranges machine # [ 0.005492] node 0: [mem 0x0000000000001000-0x000000000009efff] machine # [ 0.005493] node 0: [mem 0x0000000000100000-0x000000007ffd7fff] machine # [ 0.005494] node 0: [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005495] Initmem setup node 0 [mem 0x0000000000001000-0x000000017fffffff] machine # [ 0.005515] On node 0, zone DMA: 1 pages in unavailable ranges machine # [ 0.005784] On node 0, zone DMA: 97 pages in unavailable ranges machine # [ 0.088251] On node 0, zone Normal: 40 pages in unavailable ranges machine # [ 0.088737] ACPI: PM-Timer IO Port: 0x608 machine # [ 0.088754] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) machine # [ 0.088790] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 machine # [ 0.088793] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) machine # [ 0.088794] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) machine # [ 0.088796] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) machine # [ 0.088797] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) machine # [ 0.088798] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) machine # [ 0.088800] ACPI: Using ACPI (MADT) for SMP configuration information machine # [ 0.088801] ACPI: HPET id: 0x8086a201 base: 0xfed00000 machine # [ 0.088806] TSC deadline timer available machine # [ 0.088811] CPU topo: Max. logical packages: 1 machine # [ 0.088811] CPU topo: Max. logical dies: 1 machine # [ 0.088812] CPU topo: Max. dies per package: 1 machine # [ 0.088815] CPU topo: Max. threads per core: 1 machine # [ 0.088816] CPU topo: Num. cores per package: 4 machine # [ 0.088816] CPU topo: Num. threads per package: 4 machine # [ 0.088816] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs machine # [ 0.088843] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() machine # [ 0.088860] kvm-guest: KVM setup pv remote TLB flush machine # [ 0.088862] kvm-guest: setup PV sched yield machine # [ 0.088872] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] machine # [ 0.088874] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] machine # [ 0.088875] PM: hibernation: Registered nosave memory: [mem 0x7ffd8000-0xffffffff] machine # [ 0.088876] [mem 0xc0000000-0xfed1bfff] available for PCI devices machine # [ 0.088878] Booting paravirtualized kernel on KVM machine # [ 0.088882] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns machine # [ 0.093384] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 machine # [ 0.095675] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288 machine # [ 0.095731] kvm-guest: PV spinlocks enabled machine # [ 0.095733] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) machine # [ 0.095736] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8yi3g3vyhs25c3m8sicmz3769ly30gw8-nixos-system-machine-test/init regInfo=/nix/store/0bp2zj73xm06bmqaajx283rgvymm1h46-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.095837] Unknown kernel command line parameters "regInfo=/nix/store/0bp2zj73xm06bmqaajx283rgvymm1h46-closure-info/registration", will be passed to user space. machine # [ 0.095850] random: crng init done machine # [ 0.095851] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes machine # [ 0.100548] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) machine # [ 0.102753] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) machine # [ 0.102828] software IO TLB: area num 4. machine # [ 0.180332] Fallback order for Node 0: 0 machine # [ 0.180341] Built 1 zonelists, mobility grouping on. Total pages: 1048438 machine # [ 0.180343] Policy zone: Normal machine # [ 0.183241] mem auto-init: stack:all(zero), heap alloc:on, heap free:off machine # [ 0.190697] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 machine # [ 0.200122] allocated 8388608 bytes of page_ext machine # [ 0.210398] ftrace: allocating 48787 entries in 192 pages machine # [ 0.210401] ftrace: allocated 192 pages with 2 groups machine # [ 0.211338] Dynamic Preempt: lazy machine # [ 0.211547] rcu: Preemptible hierarchical RCU implementation. machine # [ 0.211547] rcu: RCU event tracing is enabled. machine # [ 0.211548] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. machine # [ 0.211550] Trampoline variant of Tasks RCU enabled. machine # [ 0.211550] Rude variant of Tasks RCU enabled. machine # [ 0.211551] Tracing variant of Tasks RCU enabled. machine # [ 0.211551] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. machine # [ 0.211552] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 machine # [ 0.211579] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.211581] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.211582] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.215997] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16 machine # [ 0.216359] rcu: srcu_init: Setting srcu_struct sizes based on contention. machine # [ 0.216369] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns machine # [ 0.216488] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) machine # [ 0.220102] Console: colour VGA+ 80x25 machine # [ 0.220105] printk: legacy console [tty0] enabled machine # [ 0.251740] printk: legacy console [ttyS0] enabled machine # [ 0.363736] ACPI: Core revision 20250807 machine # [ 0.364678] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns machine # [ 0.366277] APIC: Switch to symmetric I/O mode setup machine # [ 0.367350] x2apic enabled machine # [ 0.368106] APIC: Switched APIC routing to: physical x2apic machine # [ 0.369060] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask() machine # [ 0.370384] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself() machine # [ 0.371909] kvm-guest: setup PV IPIs machine # [ 0.373539] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 machine # [ 0.374622] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.378979] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) machine # [ 0.381057] x86/cpu: User Mode Instruction Prevention (UMIP) activated machine # [ 0.382099] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 machine # [ 0.382976] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 machine # [ 0.383980] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto machine # [ 0.385976] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl machine # [ 0.386976] Transient Scheduler Attacks: Vulnerable: No microcode machine # [ 0.387974] Spectre V2 : Mitigation: Enhanced / Automatic IBRS machine # [ 0.388751] Speculative Return Stack Overflow: Mitigation: Safe RET machine # [ 0.389975] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization machine # [ 0.390983] Spectre V2 : Enabling IBPB for BPF machine # [ 0.391976] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier machine # [ 0.392976] active return thunk: srso_alias_return_thunk machine # [ 0.393997] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' machine # [ 0.394975] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' machine # [ 0.395976] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' machine # [ 0.396975] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' machine # [ 0.397975] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' machine # [ 0.399792] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' machine # [ 0.400848] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' machine # [ 0.401974] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 machine # [ 0.402975] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 machine # [ 0.403975] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 machine # [ 0.404975] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 machine # [ 0.405975] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 machine # [ 0.406975] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. machine # [ 0.437847] Freeing SMP alternatives memory: 44K machine # [ 0.438597] pid_max: default: 32768 minimum: 301 machine # [ 0.439106] LSM: initializing lsm=capability,landlock,yama,bpf,ima machine # [ 0.440082] landlock: Up and running. machine # [ 0.441457] Yama: becoming mindful. machine # [ 0.442198] LSM support for eBPF active machine # [ 0.443130] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.444056] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.447260] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) machine # [ 0.448574] Performance Events: Fam17h+ core perfctr, AMD PMU driver. machine # [ 0.448984] ... version: 2 machine # [ 0.449764] ... bit width: 48 machine # [ 0.449978] ... generic counters: 6 machine # [ 0.450762] ... generic bitmap: 000000000000003f machine # [ 0.450982] ... fixed-purpose counters: 0 machine # [ 0.451754] ... fixed-purpose bitmap: 0000000000000000 machine # [ 0.452682] ... value mask: 0000ffffffffffff machine # [ 0.452978] ... max period: 00007fffffffffff machine # [ 0.453978] ... global_ctrl mask: 000000000000003f machine # [ 0.455099] signal: max sigframe size: 3376 machine # [ 0.455920] rcu: Hierarchical SRCU implementation. machine # [ 0.456669] rcu: Max phase no-delay instances is 400. machine # [ 0.457171] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level machine # [ 0.462563] smp: Bringing up secondary CPUs ... machine # [ 0.463405] smpboot: x86: Booting SMP configuration: machine # [ 0.463982] .... node #0, CPUs: #1 #2 #3 machine # [ 0.467125] smp: Brought up 1 node, 4 CPUs machine # [ 0.468979] smpboot: Total of 4 processors activated (19200.09 BogoMIPS) machine # [ 0.470332] Memory: 3957552K/4193752K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 220848K reserved, 0K cma-reserved) machine # [ 0.473035] devtmpfs: initialized machine # [ 0.474213] x86/mm: Memory block size: 128MB machine # [ 0.477052] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.478063] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). machine # [ 0.479068] pinctrl core: initialized pinctrl subsystem machine # [ 0.480306] PM: RTC time: 16:12:28, date: 2026-09-23 machine # [ 0.484315] NET: Registered PF_NETLINK/PF_ROUTE protocol family machine # [ 0.485775] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations machine # [ 0.486965] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations machine # [ 0.488548] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations machine # [ 0.488990] audit: initializing netlink subsys (disabled) machine # [ 0.490047] audit: type=2000 audit(1790179947.960:1): state=initialized audit_enabled=0 res=1 machine # [ 0.490209] thermal_sys: Registered thermal governor 'fair_share' machine # [ 0.491980] thermal_sys: Registered thermal governor 'bang_bang' machine # [ 0.492978] thermal_sys: Registered thermal governor 'step_wise' machine # [ 0.493978] thermal_sys: Registered thermal governor 'user_space' machine # [ 0.494978] thermal_sys: Registered thermal governor 'power_allocator' machine # [ 0.495994] cpuidle: using governor menu machine # [ 0.498245] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 machine # [ 0.499226] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] machine # [ 0.499981] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry machine # [ 0.500991] PCI: Using configuration type 1 for base access machine # [ 0.502186] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. machine # [ 0.505191] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages machine # [ 0.507987] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page machine # [ 0.510984] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages machine # [ 0.512983] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page machine # [ 0.520088] ACPI: Added _OSI(Module Device) machine # [ 0.520887] ACPI: Added _OSI(Processor Device) machine # [ 0.521595] ACPI: Added _OSI(Processor Aggregator Device) machine # [ 0.524692] ACPI: 1 ACPI AML tables successfully acquired and loaded machine # [ 0.529065] ACPI: Interpreter enabled machine # [ 0.530053] ACPI: PM: (supports S0 S3 S4 S5) machine # [ 0.531987] ACPI: Using IOAPIC for interrupt routing machine # [ 0.534222] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug machine # [ 0.537986] PCI: Using E820 reservations for host bridge windows machine # [ 0.541463] ACPI: Enabled 2 GPEs in block 00 to 3F machine # [ 0.553799] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) machine # [ 0.555994] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] machine # [ 0.560232] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] machine # [ 0.563300] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] machine # [ 0.566974] PCI host bridge to bus 0000:00 machine # [ 0.568989] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] machine # [ 0.570983] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] machine # [ 0.572982] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] machine # [ 0.575983] pci_bus 0000:00: root bus resource [mem 0x80000000-0xafffffff window] machine # [ 0.577982] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] machine # [ 0.579982] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.582982] pci_bus 0000:00: root bus resource [bus 00-ff] machine # [ 0.584093] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint machine # [ 0.586509] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint machine # [ 0.609134] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] machine # [ 0.612014] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] machine # [ 0.615050] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] machine # [ 0.617739] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] machine # [ 0.624142] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.635021] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] machine # [ 0.637000] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] machine # [ 0.640039] pci 0000:00:02.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref] machine # [ 0.641993] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] machine # [ 0.645082] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.652023] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] machine # [ 0.653995] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] machine # [ 0.656069] pci 0000:00:03.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref] machine # [ 0.658076] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint machine # [ 0.664019] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] machine # [ 0.664951] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] machine # [ 0.666814] pci 0000:00:04.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref] machine # [ 0.668780] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.674979] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] machine # [ 0.675994] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] machine # [ 0.678025] pci 0000:00:05.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref] machine # [ 0.680993] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] machine # [ 0.684080] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint machine # [ 0.692030] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] machine # [ 0.693001] pci 0000:00:06.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref] machine # [ 0.695568] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.698954] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] machine # [ 0.700000] pci 0000:00:07.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref] machine # [ 0.702560] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.705020] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] machine # [ 0.717832] pci 0000:00:08.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref] machine # [ 0.719586] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.725020] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] machine # [ 0.726003] pci 0000:00:09.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref] machine # [ 0.728773] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint machine # [ 0.734264] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] machine # [ 0.735700] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] machine # [ 0.737027] pci 0000:00:0a.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref] machine # [ 0.738554] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.742017] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] machine # [ 0.742979] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] machine # [ 0.744000] pci 0000:00:0b.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref] machine # [ 0.746582] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.751060] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] machine # [ 0.753365] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.756832] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] machine # [ 0.757904] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.759824] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] machine # [ 0.760883] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint machine # [ 0.764017] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] machine # [ 0.765311] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint machine # [ 0.767297] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO machine # [ 0.769269] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint machine # [ 0.772017] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] machine # [ 0.772929] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] machine # [ 0.774117] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint machine # [ 0.776787] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] machine # [ 0.780785] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 machine # [ 0.782904] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 machine # [ 0.783898] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 machine # [ 0.784896] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 machine # [ 0.785894] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 machine # [ 0.786906] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 machine # [ 0.788089] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 machine # [ 0.790082] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 machine # [ 0.791417] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 machine # [ 0.793017] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 machine # [ 0.795020] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 machine # [ 0.798025] ACPI: PCI: Interrupt link GSID configured for IRQ 19 machine # [ 0.800023] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 machine # [ 0.803021] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 machine # [ 0.805014] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 machine # [ 0.808015] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 machine # [ 0.814247] iommu: Default domain type: Translated machine # [ 0.815984] iommu: DMA domain TLB invalidation policy: lazy mode machine # [ 0.820334] ACPI: bus type USB registered machine # [ 0.822189] usbcore: registered new interface driver usbfs machine # [ 0.824012] usbcore: registered new interface driver hub machine # [ 0.826007] usbcore: registered new device driver usb machine # [ 0.831601] NetLabel: Initializing machine # [ 0.832984] NetLabel: domain hash size = 128 machine # [ 0.834983] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO machine # [ 0.837168] NetLabel: unlabeled traffic allowed by default machine # [ 0.839011] PCI: Using ACPI for IRQ routing machine # [ 0.892283] pci 0000:00:01.0: vgaarb: setting as boot VGA device machine # [ 0.892974] pci 0000:00:01.0: vgaarb: bridge control possible machine # [ 0.892974] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none machine # [ 0.895986] vgaarb: loaded machine # [ 0.896859] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 machine # [ 0.897649] hpet0: 3 comparators, 64-bit 100.000000 MHz counter machine # [ 0.903252] clocksource: Switched to clocksource kvm-clock machine # [ 0.904934] VFS: Disk quotas dquot_6.6.0 machine # [ 0.905719] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) machine # [ 0.907374] pnp: PnP ACPI init machine # [ 0.908203] ACPI: IRQ 4 override to edge(!), high(!) machine # [ 0.909172] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved machine # [ 0.910835] pnp: PnP ACPI: found 5 devices machine # [ 0.920824] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns machine # [ 0.922481] clocksource: Switched to clocksource acpi_pm machine # [ 0.923535] NET: Registered PF_INET protocol family machine # [ 0.925107] IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear) machine # [ 0.943035] tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.944643] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) machine # [ 0.946095] TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear) machine # [ 0.947548] TCP bind hash table entries: 32768 (order: 8, 1048576 bytes, linear) machine # [ 0.948921] TCP: Hash tables configured (established 32768 bind 32768) machine # [ 0.950134] MPTCP token hash table entries: 4096 (order: 5, 98304 bytes, linear) machine # [ 0.951477] UDP hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.952818] UDP-Lite hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.954232] NET: Registered PF_UNIX/PF_LOCAL protocol family machine # [ 0.955313] NET: Registered PF_XDP protocol family machine # [ 0.956198] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] machine # [ 0.957246] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] machine # [ 0.958331] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] machine # [ 0.959506] pci_bus 0000:00: resource 7 [mem 0x80000000-0xafffffff window] machine # [ 0.960708] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] machine # [ 0.961898] pci_bus 0000:00: resource 9 [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.963866] ACPI: \_SB_.GSIA: Enabled at IRQ 16 machine # [ 0.966112] ACPI: \_SB_.GSIB: Enabled at IRQ 17 machine # [ 0.968216] ACPI: \_SB_.GSIC: Enabled at IRQ 18 machine # [ 0.970664] ACPI: \_SB_.GSID: Enabled at IRQ 19 machine # [ 0.972795] PCI: CLS 0 bytes, default 64 machine # [ 0.973697] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) machine # [ 0.974205] Trying to unpack rootfs image as initramfs... machine # [ 0.974824] software IO TLB: mapped [mem 0x000000007a371000-0x000000007e371000] (64MB) machine # [ 0.974948] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.999054] Initialise system trusted keyrings machine # [ 1.000325] workingset: timestamp_bits=40 max_order=20 bucket_order=0 machine # [ 1.012027] Key type asymmetric registered machine # [ 1.012865] Asymmetric key parser 'x509' registered machine # [ 1.013819] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) machine # [ 1.015421] io scheduler mq-deadline registered machine # [ 1.016239] io scheduler kyber registered machine # [ 1.021488] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled machine # [ 1.022907] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A machine # [ 1.025451] Linux agpgart interface v0.103 machine # [ 1.026255] ACPI: bus type drm_connector registered machine # [ 1.029552] usbcore: registered new interface driver usbserial_generic machine # [ 1.030722] usbserial: USB Serial support registered for generic machine # [ 1.031775] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. machine # [ 1.031775] Please enable it if your BIOS has the CPPC option. machine # [ 1.034150] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled machine # [ 1.035593] drop_monitor: Initializing network drop monitor service machine # [ 1.036830] NET: Registered PF_INET6 protocol family machine # [ 1.038684] Segment Routing with IPv6 machine # [ 1.039391] In-situ OAM (IOAM) with IPv6 machine # [ 1.042266] IPI shorthand broadcast: enabled machine # [ 1.046684] sched_clock: Marking stable (893011280, 153606127)->(1067635092, -21017685) machine # [ 1.048553] registered taskstats version 1 machine # [ 1.049598] Loading compiled-in X.509 certificates machine # [ 1.059695] Demotion targets for Node 0: null machine # [ 1.060875] Key type .fscrypt registered machine # [ 1.061625] Key type fscrypt-provisioning registered machine # [ 1.062647] ima: No TPM chip found, activating TPM-bypass! machine # [ 1.063644] ima: Allocated hash algorithm: sha1 machine # [ 1.064480] ima: No architecture policies found machine # [ 1.065572] PM: Magic number: 10:612:237 machine # [ 1.067294] RAS: Correctable Errors collector initialized. machine # [ 1.071845] clk: Disabling unused clocks machine # [ 1.072596] PM: genpd: Disabling unused power domains machine # [ 1.259793] Freeing initrd memory: 29052K machine # [ 1.267310] Freeing unused decrypted memory: 2028K machine # [ 1.273862] Freeing unused kernel image (initmem) memory: 3652K machine # [ 1.276514] Write protecting the kernel read-only data: 32768k machine # [ 1.281454] Freeing unused kernel image (text/rodata gap) memory: 1184K machine # [ 1.285428] Freeing unused kernel image (rodata/data gap) memory: 720K machine # [ 1.352703] x86/mm: Checked W+X mappings: passed, no W+X pages found. machine # [ 1.353907] Run /init as init process machine # [ 1.367204] systemd[1]: Inserted module 'autofs4' machine # [ 1.395889] fuse: init (API version 7.45) machine # [ 1.404731] ACPI: \_SB_.GSIG: Enabled at IRQ 22 machine # [ 1.407683] ACPI: \_SB_.GSIH: Enabled at IRQ 23 machine # [ 1.411322] ACPI: \_SB_.GSIE: Enabled at IRQ 20 machine # [ 1.413672] ACPI: \_SB_.GSIF: Enabled at IRQ 21 machine # [ 1.419152] virtiofs virtio5: discovered new tag: nix-store machine # [ 1.420804] virtiofs virtio5: virtio_fs_setup_dax: No cache capability machine # [ 1.428850] virtiofs virtio6: discovered new tag: shared machine # [ 1.441626] virtiofs virtio6: virtio_fs_setup_dax: No cache capability machine # [ 1.445414] virtiofs virtio7: discovered new tag: xchg machine # [ 1.447022] virtiofs virtio7: virtio_fs_setup_dax: No cache capability machine # [ 1.472911] systemd[1]: Successfully made /usr/ read-only. machine # [ 1.809701] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 1.822195] systemd[1]: Detected virtualization kvm. machine # [ 1.824461] systemd[1]: Detected architecture x86-64. machine # [ 1.826710] systemd[1]: Running in initrd. machine # [ 1.829262] systemd[1]: Initializing machine ID from random generator. machine # [ 1.832232] systemd[1]: Hostname set to . machine # [ 1.953079] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 1.992896] systemd[1]: Queued start job for default target Initrd Default Target. machine # [ 2.007253] systemd[1]: Created slice Slice /system/modprobe. machine # [ 2.008490] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 2.009986] systemd[1]: Expecting device /dev/disk/by-label/nixos... machine # [ 2.011187] systemd[1]: Reached target Path Units. machine # [ 2.012084] systemd[1]: Reached target Slice Units. machine # [ 2.012999] systemd[1]: Reached target Swaps. machine # [ 2.013852] systemd[1]: Reached target Timer Units. machine # [ 2.014912] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 2.016173] systemd[1]: Listening on Journal Socket (/dev/log). machine # [ 2.017328] systemd[1]: Listening on Journal Sockets. machine # [ 2.018343] systemd[1]: Listening on udev Control Socket. machine # [ 2.019395] systemd[1]: Listening on udev Kernel Socket. machine # [ 2.020390] systemd[1]: Reached target Socket Units. machine # [ 2.022346] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 2.024497] systemd[1]: Starting Load Kernel Module configfs... machine # [ 2.027470] systemd[1]: Starting Journal Service... machine # [ 2.029308] systemd[1]: Starting Load Kernel Modules... machine # [ 2.031698] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 2.035492] systemd[1]: Starting Coldplug All udev Devices... machine # [ 2.042961] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 2.048306] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 2.052226] systemd[1]: Finished Load Kernel Module configfs. machine # [ 2.055951] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config machine # [ 2.062865] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 2.067010] systemd-journald[90]: Collecting audit messages is disabled. machine # [ 2.072883] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. machine # [ 2.075131] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev machine # [ 2.078272] systemd[1]: Finished Load Kernel Modules. machine # [ 2.080383] systemd[1]: Starting Apply Kernel Variables... machine # [ 2.090715] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 2.093942] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 2.100418] systemd[1]: Finished Apply Kernel Variables. machine # [ 2.107773] systemd[1]: Started Journal Service. machine # [ 1.954270] systemd-modules-load[91]: Using 4 probe threads machine # [ 1.956938] systemd-modules-load[91]: Inserted module 'virtio_balloon' machine # [ 1.958696] systemd-modules-load[91]: Inserted module 'virtio_gpu' machine # [ 1.960386] systemd-modules-load[91]: Inserted module 'dm_mod' machine # [ 1.962051] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 1.963799] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 1.965654] systemd[1]: Reached target Local File Systems. machine # [ 1.967153] systemd[1]: Starting Create System Files and Directories... machine # [ 1.972218] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 1.976154] systemd[1]: Finished Create System Files and Directories. machine # [ 1.990482] systemd-udevd[103]: Using default interface naming scheme 'v261'. machine # [ 2.000654] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 2.018868] systemd[1]: Finished Coldplug All udev Devices. machine # [ 2.020745] systemd[1]: Reached target System Initialization. machine # [ 2.022505] systemd[1]: Reached target Basic System. machine # [ 2.270968] virtio_blk virtio2: 4/0/0 default/read/poll queues machine # [ 2.285929] uhci_hcd 0000:00:1d.0: UHCI Host Controller machine # [ 2.287497] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 1 machine # [ 2.289114] uhci_hcd 0000:00:1d.0: detected 2 ports machine # [ 2.289382] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 machine # [ 2.290663] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 machine # [ 2.294432] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.295444] serio: i8042 KBD port at 0x60,0x64 irq 1 machine # [ 2.295887] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.296008] serio: i8042 AUX port at 0x60,0x64 irq 12 machine # [ 2.296412] usb usb1: Product: UHCI Host Controller machine # [ 2.299408] usb usb1: Manufacturer: Linux 6.18.52 uhci_hcd machine # [ 2.300196] usb usb1: SerialNumber: 0000:00:1d.0 machine # [ 2.300313] virtio_blk virtio2: [vda] 33554432 512-byte logical blocks (17.2 GB/16.0 GiB) machine # [ 2.310554] hub 1-0:1.0: USB hub found machine # [ 2.311717] hub 1-0:1.0: 2 ports detected machine # [ 2.319671] ehci-pci 0000:00:1d.7: EHCI Host Controller machine # [ 2.320510] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 2 machine # [ 2.321971] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 machine # [ 2.173197] systemd[1]: Starting Virtual Console Setup... machine # [ 2.329642] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 machine # [ 2.331334] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 machine # [ 2.332549] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.333672] usb usb2: Product: EHCI Host Controller machine # [ 2.334384] usb usb2: Manufacturer: Linux 6.18.52 ehci_hcd machine # [ 2.335175] usb usb2: SerialNumber: 0000:00:1d.7 machine # [ 2.336027] hub 2-0:1.0: USB hub found machine # [ 2.336675] hub 2-0:1.0: 6 ports detected machine # [ 2.196728] systemd-vconsole-setup[141]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 2.198431] systemd[1]: Finished Virtual Console Setup. machine # [ 2.358725] hub 1-0:1.0: USB hub found machine # [ 2.359356] hub 1-0:1.0: 2 ports detected machine # [ 2.360273] uhci_hcd 0000:00:1d.1: UHCI Host Controller machine # [ 2.361109] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 machine # [ 2.362316] uhci_hcd 0000:00:1d.1: detected 2 ports machine # [ 2.363211] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 machine # [ 2.211158] (udev-worker)[131]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 2.213747] (udev-worker)[131]: Network interface NamePolicy= disabled on kernel command line. machine # [ 2.368946] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 machine # [ 2.369707] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.218296] (udev-worker)[135]: Network interface NamePolicy= disabled on kernel command line. machine # [ 2.373240] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.374543] usb usb3: Product: UHCI Host Controller machine # [ 2.375571] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd machine # [ 2.376458] usb usb3: SerialNumber: 0000:00:1d.1 machine # [ 2.378444] hub 3-0:1.0: USB hub found machine # [ 2.379380] hub 3-0:1.0: 2 ports detected machine # [ 2.382173] SCSI subsystem initialized machine # [ 2.385126] uhci_hcd 0000:00:1d.2: UHCI Host Controller machine # [ 2.386048] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 machine # [ 2.387490] uhci_hcd 0000:00:1d.2: detected 2 ports machine # [ 2.389948] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 machine # [ 2.391396] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.392809] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.240224] systemd[1]: Found device /dev/dis[ 2.393994] usb usb4: Product: UHCI Host Controller machine # k/by-label/nixos. machine # [ 2.395151] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd machine # [ 2.242069] systemd[1]: Reached target Initrd[ 2.396390] usb usb4: SerialNumber: 0000:00:1d.2 machine # Root Device. machine # [ 2.397865] hub 4-0:1.0: USB hub found machine # [ 2.244509] systemd[1]: Starting File System Check on /dev/di[ 2.398678] hub 4-0:1.0: 2 ports detected machine # sk/by-label/nixos... machine # [ 2.414191] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode machine # [ 2.415989] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) machine # [ 2.417203] ahci 0000:00:1f.2: flags: 64bit ncq only machine # [ 2.420404] scsi host0: ahci machine # [ 2.421494] scsi host1: ahci machine # [ 2.268310] systemd-fsck[150]: nixos: clean, 12/1048576 files, 109865/4194304 blocks machine # [ 2.423252] scsi host2: ahci machine # [ 2.271542] s[ 2.425024] scsi host3: ahci machine # ystemd[1]: Finished File System Check on /dev/disk/by-label/nixos.[ 2.426333] scsi host4: ahci machine # machine # [ 2.427584] scsi host5: ahci machine # [ 2.428870] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 50 lpm-pol 1 machine # [ 2.430266] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 50 lpm-pol 1 machine # [ 2.431686] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 50 lpm-pol 1 machine # [ 2.432961] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 50 lpm-pol 1 machine # [ 2.434407] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 50 lpm-pol 1 machine # [ 2.436261] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 50 lpm-pol 1 machine # [ 2.577871] usb 2-1: new high-speed USB device number 2 using ehci-pci machine # [ 2.715147] usb 2-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 machine # [ 2.718246] usb 2-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 machine # [ 2.720947] usb 2-1: Product: QEMU USB Tablet machine # [ 2.722597] usb 2-1: Manufacturer: QEMU machine # [ 2.724110] usb 2-1: SerialNumber: 28754-0000:00:1d.7-1 machine # [ 2.753109] ata2: SATA link down (SStatus 0 SControl 300) machine # [ 2.755652] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) machine # [ 2.758295] ata5: SATA link down (SStatus 0 SControl 300) machine # [ 2.760644] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 machine # [ 2.761402] hid: raw HID events driver (C) Jiri Kosina machine # [ 2.763573] ata3.00: applying bridge limits machine # [ 2.766231] ata1: SATA link down (SStatus 0 SControl 300) machine # [ 2.768675] ata4: SATA link down (SStatus 0 SControl 300) machine # [ 2.770756] ata3.00: configured for UDMA/100 machine # [ 2.772760] ata6: SATA link down (SStatus 0 SControl 300) machine # [ 2.779246] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 machine # [ 2.813707] usbcore: registered new interface driver usbhid machine # [ 2.815802] usbhid: USB HID core driver machine # [ 2.825808] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb2/2-1/2-1:1.0/0003:0627:0001.0001/input/input2 machine # [ 2.829088] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 machine # [ 2.849130] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray machine # [ 2.877984] cdrom: Uniform CD-ROM driver Revision: 3.20 machine # [ 2.890177] systemd[1]: Mounting /sysroot... machine # [ 3.187773] EXT4-fs (vda): mounted filesystem 1119e800-ae66-4619-89c4-86b6ae6f0e68 r/w with ordered data mode. Quota mode: none. machine # [ 3.039212] systemd[1]: Mounted /sysroot. machine # [ 3.041320] systemd[1]: Reached target Initrd Root File System. machine # [ 3.047096] systemd[1]: Mounting /sysroot/nix/.ro-store... machine # [ 3.061745] systemd[1]: Mounting /sysroot/nix/.rw-store... machine # [ 3.066941] systemd[1]: Mounting /sysroot/run... machine # [ 3.076265] systemd[1]: Mounting /sysroot/tmp/shared... machine # [ 3.078646] systemd[1]: Mounting /sysroot/tmp/xchg... machine # [ 3.080700] systemd[1]: Starting Mountpoints Configured in the Real Root... machine # [ 3.083194] systemd[1]: Mounted /sysroot/nix/.ro-store. machine # [ 3.087168] systemd[1]: Mounted /sysroot/run. machine # [ 3.091565] systemd-sysroot-fstab-check[191]: /sysroot should be mounted in the initrd, will request daemon-reload. machine # [ 3.095615] systemd[1]: Mounted /sysroot/nix/.rw-store. machine # [ 3.099269] systemd[1]: Mounted /sysroot/tmp/xchg. machine # [ 3.101186] systemd[1]: Reload requested from client PID 191 ('systemd-sysroot') (unit initrd-parse-etc.service)... machine # [ 3.105051] systemd[1]: Reloading... machine # [ 3.169255] systemd[1]: Reloading finished in 68 ms. machine # [ 3.189263] systemd-sysroot-fstab-check[191]: Requesting initrd-fs.target/start/replace... machine # [ 3.192193] systemd[1]: Mounted /sysroot/tmp/shared. machine # [ 3.193927] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.195953] systemd-sysroot-fstab-check[191]: Requesting swap.target/start/replace... machine # [ 3.200210] systemd[1]: initrd-parse-etc.service: Deactivated successfully. machine # [ 3.208708] systemd[1]: Finished Mountpoints Configured in the Real Root. machine # [ 3.210904] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. machine # [ 3.219253] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.221642] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.891192] systemd[1]: Mounting /sysroot/nix/store... machine # [ 3.947192] systemd[1]: Mounted /sysroot/nix/store. machine # [ 3.949116] systemd[1]: Reached target Initrd File Systems. machine # [ 3.951087] systemd[1]: Starting Find NixOS closure... machine # [ 3.953215] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... machine # [ 3.977830] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. machine # [ 3.980746] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. machine # [ 3.990705] systemd[1]: Finished Find NixOS closure. machine # [ 3.992740] systemd[1]: Reached target Initrd Default Target. machine # [ 3.994737] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... machine # [ 4.023924] systemd[1]: Stopped target Initrd Default Target. machine # [ 4.026083] systemd[1]: Stopped target Basic System. machine # [ 4.027815] systemd[1]: Stopped target Initrd Root Device. machine # [ 4.029637] systemd[1]: Stopped target Path Units. machine # [ 4.031286] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. machine # [ 4.033774] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. machine # [ 4.036345] systemd[1]: Stopped target Slice Units. machine # [ 4.038132] systemd[1]: Stopped target Socket Units. machine # [ 4.040341] systemd[1]: Stopped target System Initialization. machine # [ 4.042866] systemd[1]: Stopped target Swaps. machine # [ 4.044539] systemd[1]: Stopped target Timer Units. machine # [ 4.046267] systemd[1]: dbus.socket: Deactivated successfully. machine # [ 4.048338] systemd[1]: Closed D-Bus System Message Bus Socket. machine # [ 4.051070] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. machine # [ 4.053542] systemd[1]: Stopped Find NixOS closure. machine # [ 4.055234] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 4.057280] systemd[1]: systemd-sysctl.service: Deactivated successfully. machine # [ 4.059557] systemd[1]: Stopped Apply Kernel Variables. machine # [ 4.061384] systemd[1]: systemd-modules-load.service: Deactivated successfully. machine # [ 4.063659] systemd[1]: Stopped Load Kernel Modules. machine # [ 4.065204] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. machine # [ 4.067314] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. machine # [ 4.069397] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. machine # [ 4.071372] systemd[1]: Stopped Create System Files and Directories. machine # [ 4.073131] systemd[1]: Stopped target Local File Systems. machine # [ 4.074613] systemd[1]: Stopped target Preparation for Local File Systems. machine # [ 4.076435] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. machine # [ 4.078348] systemd[1]: Stopped Coldplug All udev Devices. machine # [ 4.079842] systemd[1]: Stopping Rule-based Manager for Device Events and Files... machine # [ 4.081826] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 4.082935] systemd[1]: Stopped Virtual Console Setup. machine # [ 4.083832] systemd[1]: initrd-cleanup.service: Deactivated successfully. machine # [ 4.084939] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. machine # [ 4.085947] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 4.087106] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 4.088162] systemd[1]: systemd-udevd.service: Deactivated successfully. machine # [ 4.089738] systemd[1]: Stopped Rule-based Manager for Device Events and Files. machine # [ 4.091128] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. machine # [ 4.092297] systemd[1]: Closed udev Control Socket. machine # [ 4.093163] systemd[1]: Starting Cleanup udev Database... machine # [ 4.093994] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. machine # [ 4.095115] systemd[1]: Stopped Create Static Device Nodes in /dev. machine # [ 4.095997] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. machine # [ 4.097132] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. machine # [ 4.098114] systemd[1]: kmod-static-nodes.service: Deactivated successfully. machine # [ 4.099101] systemd[1]: Stopped Create List of Static Device Nodes. machine # [ 4.100047] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. machine # [ 4.101134] systemd[1]: Finished Cleanup udev Database. machine # [ 4.101911] systemd[1]: Reached target Switch Root. machine # [ 4.103000] systemd[1]: Starting NixOS Activation... machine # [ 4.231800] initrd-nixos-activation-start[235]: booting system configuration /nix/store/8yi3g3vyhs25c3m8sicmz3769ly30gw8-nixos-system-machine-test machine # [ 4.284966] initrd-nixos-activation-start[235]: running activation script... machine # [ 4.582495] initrd-nixos-activation-start[258]: setting up /etc... machine # [ 4.750148] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. machine # [ 4.752835] systemd[1]: Finished NixOS Activation. machine # [ 4.754492] systemd[1]: Starting Switch Root... machine # [ 4.773584] systemd[1]: Switching root. machine # [ 4.982531] systemd-journald[90]: Received SIGTERM from PID 1 (systemd). machine # [ 5.095826] NET: Registered PF_VSOCK protocol family machine # [ 5.474962] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 5.513751] systemd[1]: Detected virtualization kvm. machine # [ 5.515659] systemd[1]: Detected architecture x86-64. machine # [ 5.517726] systemd[1]: Detected first boot. machine # [ 5.522071] systemd[1]: Initializing machine ID from random generator. machine # [ 5.672488] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 5.751536] systemd[1]: Applying preset policy. machine # [ 5.942301] systemd[1]: Populated /etc with preset unit settings. machine # [ 6.172578] systemd[1]: initrd-switch-root.service: Deactivated successfully. machine # [ 6.174101] systemd[1]: Stopped initrd-switch-root.service. machine # [ 6.176657] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. machine # [ 6.178876] systemd[1]: Created slice Slice /system/getty. machine # [ 6.180386] systemd[1]: Created slice User and Session Slice. machine # [ 6.181398] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 6.182870] systemd[1]: Started Forward Password Requests to Wall Directory Watch. machine # [ 6.184088] systemd[1]: Expecting device /dev/hvc0... machine # [ 6.184865] systemd[1]: Expecting device /dev/ttyS0... machine # [ 6.185660] systemd[1]: Reached target Local Encrypted Volumes. machine # [ 6.186532] systemd[1]: Stopped target initrd-fs.target. machine # [ 6.187396] systemd[1]: Stopped target initrd-root-fs.target. machine # [ 6.188312] systemd[1]: Stopped target initrd-switch-root.target. machine # [ 6.189371] systemd[1]: Reached target Virtual Machines and Containers. machine # [ 6.190508] systemd[1]: Reached target Path Units. machine # [ 6.191309] systemd[1]: Reached target Remote File Systems. machine # [ 6.192135] systemd[1]: Reached target Slice Units. machine # [ 6.192856] systemd[1]: Reached target Swaps. machine # [ 6.195107] systemd[1]: Listening on Query the User Interactively for a Password. machine # [ 6.197931] systemd[1]: Listening on Process Core Dump Socket. machine # [ 6.200049] systemd[1]: Listening on Credential Encryption/Decryption. machine # [ 6.202110] systemd[1]: Listening on Factory Reset Management. machine # [ 6.203165] systemd[1]: Listening on Hostname Service Socket. machine # [ 6.206259] systemd[1]: Starting Journal Log Access Socket... machine # [ 6.207742] systemd[1]: Listening on Journal Audit Socket. machine # [ 6.210237] systemd[1]: Listening on Console Output Muting Service Socket. machine # [ 6.211551] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. machine # [ 6.212813] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.214204] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki machine # [ 6.219076] systemd[1]: Listening on Disk Repartitioning Service Socket. machine # [ 6.220161] systemd[1]: Listening on udev Control Socket. machine # [ 6.221105] systemd[1]: Listening on udev Varlink Socket. machine # [ 6.223766] systemd[1]: Mounting Huge Pages File System... machine # [ 6.226193] systemd[1]: Mounting POSIX Message Queue File System... machine # [ 6.228886] systemd[1]: Mounting Kernel Debug File System... machine # [ 6.248961] systemd[1]: Mounting Kernel Trace File System... machine # [ 6.251896] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 6.257611] systemd[1]: Starting Load Kernel Module configfs... machine # [ 6.258566] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm machine # [ 6.260074] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.261728] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.266173] systemd[1]: Mounting FUSE Control File System... machine # [ 6.267075] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.278145] systemd[1]: Starting Journal Service... machine # [ 6.280493] systemd[1]: Starting Load Kernel Modules... machine # [ 6.283229] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... machine # [ 6.285673] systemd[1]: Starting Remount Root and Kernel File Systems... machine # [ 6.286707] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.291545] systemd[1]: Starting Coldplug All udev Devices... machine # [ 6.299099] systemd[1]: Listening on Journal Log Access Socket. machine # [ 6.301014] systemd[1]: Mounted Huge Pages File System. machine # [ 6.302876] systemd[1]: Mounted POSIX Message Queue File System. machine # [ 6.304919] systemd[1]: Mounted Kernel Debug File System. machine # [ 6.306946] systemd[1]: Mounted Kernel Trace File System. machine # [ 6.309783] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 6.312216] systemd[1]: Mounted FUSE Control File System. machine # [ 6.317052] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 6.318643] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 6.320095] systemd[1]: Finished Load Kernel Module configfs. machine # [ 6.322885] systemd[1]: Mounting Kernel Configuration File System... machine # [ 6.328664] EXT4-fs (vda): re-mounted 1119e800-ae66-4619-89c4-86b6ae6f0e68. machine # [ 6.332778] systemd[1]: Finished Remount Root and Kernel File Systems. machine # [ 6.334028] systemd[1]: Listening on Disk Image Download Service Socket. machine # [ 6.335212] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.335438] systemd-journald[331]: Collecting audit messages is enabled. machine # [ 6.338912] systemd[1]: Starting Load/Save OS Random Seed... machine # [ 6.339846] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.342210] loop: module loaded machine # [ 6.349819] systemd[1]: Finished Load Kernel Modules. machine # [ 6.355253] systemd[1]: Starting Apply Kernel Variables... machine # [ 6.202434] systemd[1]: Queued start job for default target Multi-User System. machine # [ 6.357220] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. machine # [ 6.358425] systemd[1]: Started Journal Service. machine # [ 6.205136] systemd[1]: systemd-journald.service: Deactivated successfully. machine # [ 6.208099] systemd-modules-load[332]: Using 2 probe threads machine # [ 6.209113] systemd-modules-load[332]: Inserted module 'loop' machine # [ 6.210679] systemd-oomd[333]: No swap; memory pressure usage will be degraded machine # [ 6.212444] systemd[1]: Mounted Kernel Configuration File System. machine # [ 6.215379] systemd[1]: Starting Flush Journal to Persistent Storage... machine # [ 6.228153] systemd[1]: Finished Load/Save OS Random Seed. machine # [ 6.229320] systemd[1]: Reached target First Boot Complete. machine # [ 6.239476] systemd[1]: Finished Apply Kernel Variables. machine # [ 6.398757] systemd-journald[331]: Received client request to flush runtime journal. machine # [ 6.299896] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 6.301364] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 6.302549] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 6.303703] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 6.304689] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 6.305774] systemd[1]: Finished Coldplug All udev Devices. machine # [ 6.306596] systemd[1]: Finished Flush Journal to Persistent Storage. machine # [ 6.313143] systemd-udevd[361]: Using default interface naming scheme 'v261'. machine # [ 6.342741] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 6.415106] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.434245] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. machine # [ 6.446666] (udev-worker)[387]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 6.448802] (udev-worker)[387]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.450346] (udev-worker)[386]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.460741] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. machine # [ 6.475959] systemd[1]: Condition check resulted in Virtio network device being skipped. machine # [ 6.477250] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.478745] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.480849] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.482359] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.483622] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.656004] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 machine # [ 6.657880] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console machine # [ 6.669994] Console: switching to colour dummy device 80x25 machine # [ 6.670825] [drm] Found bochs VGA, ID 0xb0c5. machine # [ 6.670827] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. machine # [ 6.671983] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized machine # [ 6.674441] ACPI: button: Power Button [PWRF] machine # [ 6.676786] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic machine # [ 6.677541] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 machine # [ 6.691809] Console: switching to colour frame buffer device 160x50 machine # [ 6.692602] mousedev: PS/2 mouse device common for all mice machine # [ 6.693428] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device machine # [ 6.700531] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 machine # [ 6.722900] rtc_cmos PNP0B00:00: RTC can wake from S4 machine # [ 6.734365] rtc_cmos PNP0B00:00: registered as rtc0 machine # [ 6.735146] rtc_cmos PNP0B00:00: setting system clock to 2026-09-23T16:12:34 UTC (1790179954) machine # [ 6.736304] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs machine # [ 6.737661] parport_pc 00:02: reported by Plug and Play ACPI machine # [ 6.738413] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] machine # [ 6.778309] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 machine # [ 6.782757] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt machine # [ 6.783524] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD machine # [ 6.785914] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 machine # [ 6.657126] systemd[1]: Starting Virtual Console Setup... machine # [ 6.838486] iTCO_wdt iTCO_wdt.0.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) machine # [ 6.691603] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 6.846267] ppdev: user-space parallel port driver machine # [ 6.692740] systemd[1]: Stopped Virtual Console Setup. machine # [ 6.854672] iTCO_wdt iTCO_wdt.0.auto: initialized. heartbeat=30 sec (nowayout=0) machine # [ 6.705713] systemd[1]: Starting Virtual Console Setup... machine # [ 6.906202] kvm_amd: TSC scaling supported machine # [ 6.906770] kvm_amd: Nested Virtualization enabled machine # [ 6.907281] kvm_amd: Nested Paging enabled machine # [ 6.907754] kvm_amd: LBR virtualization supported machine # [ 6.908256] kvm_amd: Virtual VMLOAD VMSAVE supported machine # [ 6.908848] kvm_amd: Virtual GIF supported machine # [ 6.909304] kvm_amd: Virtual NMI enabled machine # [ 7.005474] EDAC MC: Ver: 3.0.0 machine # [ 6.864635] systemd-vconsole-setup[406]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 6.867672] systemd[1]: Finished Virtual Console Setup. machine # [ 7.022213] systemd[1]: Mounting /run/wrappers... machine # [ 7.060940] systemd[1]: Mounted /run/wrappers. machine # [ 7.062708] systemd[1]: Reached target Local File Systems. machine # [ 7.064580] systemd[1]: Listening on Boot Loader Control Service Socket. machine # [ 7.066840] systemd[1]: Starting register-nix-paths.service... machine # [ 7.069485] systemd[1]: Starting Create SUID/SGID Wrappers... machine # [ 7.071532] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. machine # [ 7.074832] systemd[1]: Starting Save Transient machine-id to Disk... machine # [ 7.077234] systemd[1]: Starting Create System Files and Directories... machine # [ 7.144662] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. machine # [ 7.149215] systemd[1]: Finished Save Transient machine-id to Disk. machine # [ 7.175394] systemd[1]: Finished Create System Files and Directories. machine # [ 7.177806] systemd[1]: Starting Rebuild Journal Catalog... machine # [ 7.179895] systemd[1]: Starting Record System Boot/Shutdown in UTMP... machine # [ 7.209268] systemd[1]: Finished Record System Boot/Shutdown in UTMP. machine # [ 7.218968] systemd[1]: Finished Rebuild Journal Catalog. machine # [ 7.220828] systemd[1]: Starting Update is Completed... machine # [ 7.239942] systemd[1]: Finished Update is Completed. machine # [ 7.353379] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. machine # [ 7.354715] systemd[1]: Finished Create SUID/SGID Wrappers. machine # [ 7.584505] systemd[1]: Finished register-nix-paths.service. machine # [ 7.586841] systemd[1]: Reached target System Initialization. machine # [ 7.589069] systemd[1]: Started Discard unused filesystem blocks once a week. machine # [ 7.591674] systemd[1]: Started niks3 garbage collection timer. machine # [ 7.593865] systemd[1]: Started Daily Cleanup of Temporary Directories. machine # [ 7.596317] systemd[1]: Reached target Timer Units. machine # [ 7.598308] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 7.600672] systemd[1]: Listening on niks3 server socket. machine # [ 7.602720] systemd[1]: Listening on Nix Daemon Socket. machine # [ 7.604814] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. machine # [ 7.607794] systemd[1]: Reached target Socket Units. machine # [ 7.609718] systemd[1]: Reached target Basic System. machine # [ 7.611662] systemd[1]: Started backdoor.service. machine # [ 7.613534] systemd[1]: Starting Import lastlog data into lastlog2 database... machine # [ 7.616187] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 7.618572] systemd[1]: Starting Post-Boot Actions... machine # [ 7.620555] systemd[1]: Started Reset console on configuration changes. machine # [ 7.622636] systemd[1]: Starting resolvconf update... machine # [ 7.629117] systemd[1]: Started rustfs.service. machine # [ 7.631866] systemd[1]: Starting rustfs-bucket.service... machine # [ 7.636804] systemd[1]: Starting D-Bus System Message Bus... machine # [ 7.658731] systemd[1]: Finished Post-Boot Actions. machine # connecting to host... machine # [ 7.694470] nsncd[489]: Sep 23 16:12:35.611 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 7.697070] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 7.698113] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 7.699345] systemd[1]: Reached target User and Group Name Lookups. machine # [ 7.700349] systemd[1]: Starting User Login Management... machine # [ 7.707313] systemd[1]: Finished Import lastlog data into lastlog2 database. machine: Guest shell says: b'Spawning backdoor root shell...\n' machine: connected to guest root shell machine # [ 7.718659] dbus-broker-launch[495]: Looking up NSS user entry for 'systemd-timesync'... machine: (connecting took 8.37 seconds) machine: (finished: waiting for the VM to finish booting, in 8.63 seconds) machine # [ 7.727211] dbus-broker-launch[495]: NSS returned no entry for 'systemd-timesync' machine # [ 7.728484] dbus-broker-launch[495]: Invalid user-name in /nix/store/d3mrkr0v9x5sgbb0rb2pnsl0mysb1m4x-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" machine # [ 7.745786] systemd[1]: Started D-Bus System Message Bus. machine # [ 7.763696] systemd-logind[521]: New seat seat0. machine # [ 7.764746] dbus-broker-launch[495]: Ready machine # [ 7.766307] systemd-logind[521]: Watching system buttons on /dev/input/event2 (Power Button) machine # [ 7.767652] systemd-logind[521]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) machine # [ 7.769058] systemd-logind[521]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) machine # [ 7.770437] systemd[1]: Started User Login Management. machine # [ 7.771263] systemd[1]: Stopped target Host and Network Name Lookups. machine # [ 7.772210] systemd[1]: Stopping Host and Network Name Lookups... machine # [ 7.773144] systemd[1]: Stopped target User and Group Name Lookups. machine # [ 7.774102] systemd[1]: Stopping User and Group Name Lookups... machine # [ 7.774985] systemd[1]: Starting linger-users.service... machine # [ 7.775842] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... machine # [ 7.780473] systemd[1]: nscd.service: Deactivated successfully. machine # [ 7.785083] systemd[1]: Stopped Name Service Cache Daemon (nsncd). machine # [ 7.787987] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 7.802311] systemd[1]: linger-users.service: Deactivated successfully. machine # [ 7.803358] systemd[1]: Finished linger-users.service. machine # [ 7.821041] nsncd[595]: Sep 23 16:12:35.739 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 7.821401] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 7.821889] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 7.822520] systemd[1]: Reached target User and Group Name Lookups. machine # [ 7.837654] systemd[1]: Finished resolvconf update. machine # [ 7.838110] systemd[1]: Reached target Preparation for Network. machine # [ 7.841539] systemd[1]: Starting DHCP Client... machine # [ 7.843361] systemd[1]: Starting Address configuration of eth1... machine # [ 7.845347] systemd[1]: Starting Extra networking commands.... machine # [ 7.901961] network-addresses-eth1-start[625]: adding address 192.168.1.1/24... done machine # [ 7.910341] network-addresses-eth1-start[625]: adding address 2001:db8:1::1/64... done machine # [ 7.920657] systemd[1]: Finished Address configuration of eth1. machine # [ 7.930393] dhcpcd[635]: dhcpcd-10.3.2 starting machine # [ 7.936276] dhcpcd[679]: dev: loaded udev machine # [ 8.101264] 8021q: 802.1Q VLAN Support v1.8 machine # [ 8.102453] 8021q: adding VLAN 0 to HW filter on device eth1 machine # [ 7.967053] systemd[1]: Finished Extra networking commands.. machine # [ 7.969108] systemd[1]: Reached target Network. machine # [ 7.972217] systemd[1]: Starting PostgreSQL Server... machine # [ 7.974952] systemd[1]: Starting Permit User Sessions... machine # [ 7.979068] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. machine # [ 8.002450] systemd[1]: Finished Permit User Sessions. machine # [ 8.005823] systemd[1]: Started Getty on tty1. machine # [ 8.007383] systemd[1]: Reached target Login Prompts. machine # [ 8.201456] cfg80211: Loading compiled-in X.509 certificates for regulatory database machine # [ 8.215375] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' machine # [ 8.216537] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' machine # [ 8.218823] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 machine # [ 8.220162] cfg80211: failed to load regulatory.db machine # [ 8.255632] 8021q: adding VLAN 0 to HW filter on device eth0 machine # [ 8.103811] dhcpcd[679]: eth0: waiting for carrier machine # [ 8.104471] dhcpcd[679]: eth0: carrier acquired machine # [ 8.111897] postgresql-pre-start[711]: The files belonging to this database system will be owned by user "postgres". machine # [ 8.112285] dhcpcd[679]: DUID 00:01:00:01:32:46:b6:f4:52:54:00:12:34:56 machine # [ 8.112838] dhcpcd[679]: eth0: IAID 00:12:34:56 machine # [ 8.113509] postgresql-pre-start[711]: This user must also own the server process. machine # [ 8.114046] dhcpcd[679]: eth0: adding address fe80::5054:ff:fe12:3456 machine # [ 8.117122] postgresql-pre-start[711]: The database cluster will be initialized with locale "en_US.UTF-8". machine # [ 8.117436] postgresql-pre-start[711]: The default database encoding has accordingly been set to "UTF8". machine # [ 8.118082] postgresql-pre-start[711]: The default text search configuration will be set to "english". machine # [ 8.118524] postgresql-pre-start[711]: Data page checksums are enabled. machine # [ 8.119146] postgresql-pre-start[711]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok machine # [ 8.119537] postgresql-pre-start[711]: creating subdirectories ... ok machine # [ 8.120088] postgresql-pre-start[711]: selecting dynamic shared memory implementation ... posix machine # [ 8.153235] dhcpcd[679]: eth0: soliciting a DHCP lease machine # [ 8.317292] NET: Registered PF_PACKET protocol family machine # [ 8.173545] dhcpcd[679]: eth0: offered 10.0.2.15 from 10.0.2.2 machine # [ 8.176714] postgresql-pre-start[711]: selecting default "max_connections" ... 100 machine # [ 8.178213] dhcpcd[679]: eth0: probing address 10.0.2.15/24 machine # [ 8.227239] postgresql-pre-start[711]: selecting default "shared_buffers" ... 128MB machine # [ 8.938550] postgresql-pre-start[711]: selecting default time zone ... UTC machine # [ 8.940339] postgresql-pre-start[711]: creating configuration files ... ok machine # [ 9.144770] postgresql-pre-start[711]: running bootstrap script ... ok machine # [ 9.592181] postgresql-pre-start[711]: performing post-bootstrap initialization ... ok machine # [ 9.759245] postgresql-pre-start[711]: syncing data to disk ... ok machine # [ 9.761729] postgresql-pre-start[711]: initdb: warning: enabling "trust" authentication for local connections machine # [ 9.764861] postgresql-pre-start[711]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. machine # [ 9.769744] postgresql-pre-start[711]: Success. You can now start the database server using: machine # [ 9.772431] postgresql-pre-start[711]: pg_ctl -D /var/lib/postgresql/18 -l logfile start machine # [ 9.892388] postgres[745]: [745] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit machine # [ 9.896402] postgres[745]: [745] LOG: listening on IPv6 address "::1", port 5432 machine # [ 9.896546] postgres[745]: [745] LOG: listening on IPv4 address "127.0.0.1", port 5432 machine # [ 9.899859] postgres[745]: [745] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" machine # [ 9.910448] postgres[763]: [763] LOG: database system was shut down at 2026-09-23 16:12:37 GMT machine # [ 9.915884] dhcpcd[679]: eth0: soliciting an IPv6 router machine # [ 9.916103] dhcpcd[679]: eth0: Router Advertisement from fe80::2 machine # [ 9.916881] dhcpcd[679]: eth0: adding address fec0::5054:ff:fe12:3456/64 machine # [ 9.918094] dhcpcd[679]: eth0: adding route to fec0::/64 machine # [ 9.920372] postgres[745]: [745] LOG: database system is ready to accept connections machine # [ 9.921886] dhcpcd[679]: eth0: adding default route via fe80::2 machine # [ 9.923205] systemd[1]: Started PostgreSQL Server. machine # [ 9.924552] systemd[1]: Starting PostgreSQL Setup Scripts... machine # [ 10.103342] postgresql-setup-start[774]: CREATE DATABASE machine # [ 10.143685] postgresql-setup-start[779]: CREATE ROLE machine # [ 10.165881] postgresql-setup-start[781]: ALTER DATABASE machine # [ 10.172369] systemd[1]: Finished PostgreSQL Setup Scripts. machine # [ 10.175399] systemd[1]: Reached target PostgreSQL. machine # [ 13.034304] dhcpcd[679]: eth0: leased 10.0.2.15 for 86400 seconds machine # [ 13.035262] dhcpcd[679]: eth0: adding route to 10.0.2.0/24 machine # [ 13.036964] dhcpcd[679]: eth0: adding default route via 10.0.2.2 machine # [ 13.180298] systemd[1]: Started DHCP Client. machine # [ 13.180764] systemd[1]: Reached target Network is Online. machine # [ 13.181964] systemd[1]: Starting k3s service... machine # [ 13.231628] k3s[872]: time="2026-09-23T16:12:41Z" level=info msg="Acquiring lock file /var/lib/rancher/k3s/data/.lock" machine # [ 13.231843] k3s[872]: time="2026-09-23T16:12:41Z" level=info msg="Preparing data dir /var/lib/rancher/k3s/data/05fb32d1d5d79ab4bf8f805d07e4a7dfb491001fd5137b587aa471efd4746099" machine # [ 15.433627] k3s[872]: time="2026-09-23T16:12:43Z" level=info msg="Starting k3s 1.35.8+k3s1 (e952d68a)" machine # [ 15.445993] k3s[872]: time="2026-09-23T16:12:43Z" level=info msg="Configuring sqlite3 database connection pooling: maxIdle=20, maxOpen=0, maxLifetime=0s, maxIdleTime=2m0s" machine # [ 15.448273] k3s[872]: time="2026-09-23T16:12:43Z" level=info msg="Kine built with sqlite from github.com/mattn/go-sqlite3 version 3.53.3" machine # [ 15.448867] k3s[872]: time="2026-09-23T16:12:43Z" level=info msg="Configuring database table schema and indexes, this may take a moment..." machine # [ 15.463518] k3s[872]: time="2026-09-23T16:12:43Z" level=info msg="Database tables and indexes are up to date" machine # [ 15.464218] k3s[872]: time="2026-09-23T16:12:43Z" level=info msg="Running startup VACUUM to reclaim disk space, this may take a moment..." machine # [ 15.472331] k3s[872]: time="2026-09-23T16:12:43Z" level=info msg="Startup VACUUM completed successfully" machine # [ 15.476175] k3s[872]: time="2026-09-23T16:12:43Z" level=info msg="Kine available at unix://kine.sock" machine # [ 15.477566] k3s[872]: time="2026-09-23T16:12:43Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 15.479725] k3s[872]: time="2026-09-23T16:12:43Z" level=info msg="Datastore connection validated successfully, proceeding with bootstrap data generation" machine # [ 15.482089] k3s[872]: time="2026-09-23T16:12:43Z" level=info msg="generated self-signed CA certificate CN=k3s-client-ca@1790179963: notBefore=2026-09-23 15:12:43.400174741 +0000 UTC notAfter=2036-09-20 15:12:43.400174741 +0000 UTC" machine # [ 15.485093] k3s[872]: time="2026-09-23T16:12:43Z" level=info msg="certificate CN=system:admin,O=system:masters signed by CN=k3s-client-ca@1790179963: notBefore=2026-09-23 15:12:43 +0000 UTC notAfter=2027-09-23 15:12:43 +0000 UTC" machine # [ 15.487892] k3s[872]: time="2026-09-23T16:12:43Z" level=info msg="certificate CN=system:k3s-supervisor,O=system:masters signed by CN=k3s-client-ca@1790179963: notBefore=2026-09-23 15:12:43 +0000 UTC notAfter=2027-09-23 15:12:43 +0000 UTC" machine # [ 15.490874] k3s[872]: time="2026-09-23T16:12:43Z" level=info msg="certificate CN=system:kube-controller-manager signed by CN=k3s-client-ca@1790179963: notBefore=2026-09-23 15:12:43 +0000 UTC notAfter=2027-09-23 15:12:43 +0000 UTC" machine # [ 15.493750] k3s[872]: time="2026-09-23T16:12:43Z" level=info msg="certificate CN=system:kube-scheduler signed by CN=k3s-client-ca@1790179963: notBefore=2026-09-23 15:12:43 +0000 UTC notAfter=2027-09-23 15:12:43 +0000 UTC" machine # [ 15.496598] k3s[872]: time="2026-09-23T16:12:43Z" level=info msg="certificate CN=system:apiserver,O=system:masters signed by CN=k3s-client-ca@1790179963: notBefore=2026-09-23 15:12:43 +0000 UTC notAfter=2027-09-23 15:12:43 +0000 UTC" machine # [ 15.499756] k3s[872]: time="2026-09-23T16:12:43Z" level=info msg="certificate CN=k3s-cloud-controller-manager signed by CN=k3s-client-ca@1790179963: notBefore=2026-09-23 15:12:43 +0000 UTC notAfter=2027-09-23 15:12:43 +0000 UTC" machine # [ 15.502565] k3s[872]: time="2026-09-23T16:12:43Z" level=info msg="generated self-signed CA certificate CN=k3s-server-ca@1790179963: notBefore=2026-09-23 15:12:43.420739087 +0000 UTC notAfter=2036-09-20 15:12:43.420739087 +0000 UTC" machine # [ 15.505621] k3s[872]: time="2026-09-23T16:12:43Z" level=info msg="certificate CN=kube-apiserver signed by CN=k3s-server-ca@1790179963: notBefore=2026-09-23 15:12:43 +0000 UTC notAfter=2027-09-23 15:12:43 +0000 UTC" machine # [ 15.508421] k3s[872]: time="2026-09-23T16:12:43Z" level=info msg="certificate CN=kube-scheduler signed by CN=k3s-server-ca@1790179963: notBefore=2026-09-23 15:12:43 +0000 UTC notAfter=2027-09-23 15:12:43 +0000 UTC" machine # [ 15.511208] k3s[872]: time="2026-09-23T16:12:43Z" level=info msg="certificate CN=kube-controller-manager signed by CN=k3s-server-ca@1790179963: notBefore=2026-09-23 15:12:43 +0000 UTC notAfter=2027-09-23 15:12:43 +0000 UTC" machine # [ 15.513946] k3s[872]: time="2026-09-23T16:12:43Z" level=info msg="generated self-signed CA certificate CN=k3s-request-header-ca@1790179963: notBefore=2026-09-23 15:12:43.432100866 +0000 UTC notAfter=2036-09-20 15:12:43.432100866 +0000 UTC" machine # [ 15.517049] k3s[872]: time="2026-09-23T16:12:43Z" level=info msg="certificate CN=system:auth-proxy signed by CN=k3s-request-header-ca@1790179963: notBefore=2026-09-23 15:12:43 +0000 UTC notAfter=2027-09-23 15:12:43 +0000 UTC" machine # [ 15.520070] k3s[872]: time="2026-09-23T16:12:43Z" level=info msg="generated self-signed CA certificate CN=etcd-server-ca@1790179963: notBefore=2026-09-23 15:12:43.438211419 +0000 UTC notAfter=2036-09-20 15:12:43.438211419 +0000 UTC" machine # [ 15.523170] k3s[872]: time="2026-09-23T16:12:43Z" level=info msg="certificate CN=etcd-client signed by CN=etcd-server-ca@1790179963: notBefore=2026-09-23 15:12:43 +0000 UTC notAfter=2027-09-23 15:12:43 +0000 UTC" machine # [ 15.525842] k3s[872]: time="2026-09-23T16:12:43Z" level=info msg="generated self-signed CA certificate CN=etcd-peer-ca@1790179963: notBefore=2026-09-23 15:12:43.441663534 +0000 UTC notAfter=2036-09-20 15:12:43.441663534 +0000 UTC" machine # [ 15.528646] k3s[872]: time="2026-09-23T16:12:43Z" level=info msg="certificate CN=etcd-peer signed by CN=etcd-peer-ca@1790179963: notBefore=2026-09-23 15:12:43 +0000 UTC notAfter=2027-09-23 15:12:43 +0000 UTC" machine # [ 15.531955] k3s[872]: time="2026-09-23T16:12:43Z" level=info msg="certificate CN=etcd-server signed by CN=etcd-server-ca@1790179963: notBefore=2026-09-23 15:12:43 +0000 UTC notAfter=2027-09-23 15:12:43 +0000 UTC" machine # [ 15.576538] k3s[872]: time="2026-09-23T16:12:43Z" level=info msg="certificate CN=k3s,O=k3s signed by CN=k3s-server-ca@1790179963: notBefore=2026-09-23 15:12:43 +0000 UTC notAfter=2027-09-23 15:12:43 +0000 UTC" machine # [ 15.577351] k3s[872]: time="2026-09-23T16:12:43Z" level=warning msg="dynamiclistener [::]:6443: no cached certificate available for preload - deferring certificate load until storage initialization or first client request" machine # [ 15.582508] k3s[872]: time="2026-09-23T16:12:43Z" level=info msg="Active TLS secret / (ver=) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__7fba_c9bd_21bc_ded1-4647ff:fec0::7fba:c9bd:21bc:ded1 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=2AE28AECAE9CBDD45E8D86F0EA33B09F5D5CCFA0]" machine # [ 16.528694] k3s[872]: time="2026-09-23T16:12:44Z" level=info msg="Password verified locally for node machine" machine # [ 16.529453] k3s[872]: time="2026-09-23T16:12:44Z" level=info msg="certificate CN=machine signed by CN=k3s-server-ca@1790179963: notBefore=2026-09-23 15:12:44 +0000 UTC notAfter=2027-09-23 15:12:44 +0000 UTC" machine # [ 16.778303] k3s[872]: time="2026-09-23T16:12:44Z" level=info msg="certificate CN=system:node:machine,O=system:nodes signed by CN=k3s-client-ca@1790179963: notBefore=2026-09-23 15:12:44 +0000 UTC notAfter=2027-09-23 15:12:44 +0000 UTC" machine # [ 16.884202] k3s[872]: time="2026-09-23T16:12:44Z" level=info msg="certificate CN=system:kube-proxy signed by CN=k3s-client-ca@1790179963: notBefore=2026-09-23 15:12:44 +0000 UTC notAfter=2027-09-23 15:12:44 +0000 UTC" machine # [ 16.992385] k3s[872]: time="2026-09-23T16:12:44Z" level=info msg="certificate CN=system:k3s-controller signed by CN=k3s-client-ca@1790179963: notBefore=2026-09-23 15:12:44 +0000 UTC notAfter=2027-09-23 15:12:44 +0000 UTC" machine # [ 17.098544] k3s[872]: time="2026-09-23T16:12:45Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:45946: runtime core not ready" machine # [ 17.202167] k3s[872]: time="2026-09-23T16:12:45Z" level=info msg="Module overlay was already loaded" machine # [ 17.458159] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. machine # [ 17.462300] Bridge firewalling registered machine # [ 17.325247] k3s[872]: time="2026-09-23T16:12:45Z" level=warning msg="Failed to load kernel module iptable_nat with modprobe" machine # [ 17.337888] k3s[872]: time="2026-09-23T16:12:45Z" level=warning msg="Failed to load kernel module iptable_filter with modprobe" machine # [ 17.346897] k3s[872]: time="2026-09-23T16:12:45Z" level=warning msg="Failed to load kernel module nft-expr-counter with modprobe" machine # [ 17.409086] k3s[872]: time="2026-09-23T16:12:45Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_max' to 131072" machine # [ 17.412170] k3s[872]: time="2026-09-23T16:12:45Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400" machine # [ 17.416495] k3s[872]: time="2026-09-23T16:12:45Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600" machine # [ 17.419561] k3s[872]: time="2026-09-23T16:12:45Z" level=info msg="Set sysctl 'net/ipv4/conf/all/forwarding' to 1" machine # [ 17.422241] k3s[872]: time="2026-09-23T16:12:45Z" level=info msg="Connecting to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 17.425137] k3s[872]: time="2026-09-23T16:12:45Z" level=info msg="Creating k3s-cert-monitor event broadcaster" machine # [ 17.427602] k3s[872]: time="2026-09-23T16:12:45Z" level=info msg="Saving cluster bootstrap data to datastore" machine # [ 17.430129] k3s[872]: time="2026-09-23T16:12:45Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 17.433081] k3s[872]: time="2026-09-23T16:12:45Z" level=info msg="Connection to etcd is ready" machine # [ 17.435270] k3s[872]: time="2026-09-23T16:12:45Z" level=info msg="ETCD server is now running" machine # [ 17.436575] k3s[872]: time="2026-09-23T16:12:45Z" level=info msg="Polling for API server readiness: GET /readyz failed: the server is currently unable to handle the request" machine # [ 17.438707] k3s[872]: time="2026-09-23T16:12:45Z" level=info msg="Running kube-apiserver --advertise-port=6443 --allow-privileged=true --anonymous-auth=false --api-audiences=https://kubernetes.default.svc.cluster.local,k3s --authorization-mode=Node,RBAC --bind-address=127.0.0.1 --cert-dir=/var/lib/rancher/k3s/server/tls/temporary-certs --client-ca-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --egress-selector-config-file=/var/lib/rancher/k3s/server/etc/egress-selector-config.yaml --enable-admission-plugins=NodeRestriction --enable-aggregator-routing=true --enable-bootstrap-token-auth=true --etcd-servers=unix://kine.sock --kubelet-certificate-authority=/var/lib/rancher/k3s/server/tls/server-ca.crt --kubelet-client-certificate=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.crt --kubelet-client-key=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.key --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --profiling=false --proxy-client-cert-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt --proxy-client-key-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.key --requestheader-allowed-names=system:auth-proxy --requestheader-client-ca-file=/var/lib/rancher/k3s/server/tls/request-header-ca.crt --requestheader-extra-headers-prefix=X-Remote-Extra- --requestheader-group-headers=X-Remote-Group --requestheader-username-headers=X-Remote-User --secure-port=6444 --service-account-issuer=https://kubernetes.default.svc.cluster.local --service-account-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-account-signing-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --storage-backend=etcd3 --tls-cert-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --tls-private-key-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 17.461592] k3s[872]: time="2026-09-23T16:12:45Z" level=info msg="Running kube-scheduler --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --bind-address=127.0.0.1 --kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --leader-elect=false --profiling=false --secure-port=10259 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 17.467784] k3s[872]: time="2026-09-23T16:12:45Z" level=info msg="Running kube-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --bind-address=127.0.0.1 --cluster-cidr=10.42.0.0/16 --cluster-signing-kube-apiserver-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kube-apiserver-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kubelet-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-serving-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-kubelet-serving-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --cluster-signing-legacy-unknown-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-legacy-unknown-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --configure-cloud-routes=false --controllers=*,tokencleaner,-service,-route,-cloud-node-lifecycle --kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --leader-elect=false --profiling=false --root-ca-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --secure-port=10257 --service-account-private-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key --use-service-account-credentials=true" machine # [ 17.485611] k3s[872]: time="2026-09-23T16:12:45Z" level=info msg="Running cloud-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --bind-address=127.0.0.1 --cloud-config=/var/lib/rancher/k3s/server/etc/cloud-config.yaml --cloud-provider=k3s --cluster-cidr=10.42.0.0/16 --configure-cloud-routes=false --controllers=*,-route --kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --leader-elect=false --leader-elect-resource-name=k3s-cloud-controller-manager --node-status-update-frequency=1m0s --profiling=false" machine # [ 17.493032] k3s[872]: time="2026-09-23T16:12:45Z" level=info msg="Server node token is available at /var/lib/rancher/k3s/server/token" machine # [ 17.494582] k3s[872]: time="2026-09-23T16:12:45Z" level=info msg="To join server node to cluster: k3s server -s https://10.0.2.15:6443 -t ${SERVER_NODE_TOKEN}" machine # [ 17.496427] k3s[872]: time="2026-09-23T16:12:45Z" level=info msg="Agent node token is available at /var/lib/rancher/k3s/server/agent-token" machine # [ 17.498093] k3s[872]: time="2026-09-23T16:12:45Z" level=info msg="To join agent node to cluster: k3s agent -s https://10.0.2.15:6443 -t ${AGENT_NODE_TOKEN}" machine # [ 17.499965] k3s[872]: time="2026-09-23T16:12:45Z" level=info msg="Wrote kubeconfig /etc/rancher/k3s/k3s.yaml" machine # [ 17.501262] k3s[872]: time="2026-09-23T16:12:45Z" level=info msg="Run: k3s kubectl" machine # [ 17.502286] k3s[872]: I0923 16:12:45.339686 872 options.go:263] external host was not specified, using 10.0.2.15 machine # [ 17.503664] k3s[872]: I0923 16:12:45.341417 872 server.go:158] Version: v1.35.8+k3s1 machine # [ 17.504741] k3s[872]: I0923 16:12:45.341447 872 server.go:160] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 17.506183] k3s[872]: time="2026-09-23T16:12:45Z" level=info msg="Handling backend connection request [machine]" machine # [ 17.507586] k3s[872]: time="2026-09-23T16:12:45Z" level=info msg="Connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 17.509131] k3s[872]: time="2026-09-23T16:12:45Z" level=info msg="Remotedialer connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 17.510869] k3s[872]: time="2026-09-23T16:12:45Z" level=info msg="Logging containerd to /var/lib/rancher/k3s/agent/containerd/containerd.log" machine # [ 17.512596] k3s[872]: time="2026-09-23T16:12:45Z" level=info msg="Running containerd -c /var/lib/rancher/k3s/agent/etc/containerd/config.toml" machine # [ 17.514328] k3s[872]: time="2026-09-23T16:12:45Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:45994: runtime core not ready" machine # [ 17.607410] k3s[872]: time="2026-09-23T16:12:45Z" level=info msg="Running kube-proxy --cluster-cidr=10.42.0.0/16 --conntrack-max-per-core=0 --conntrack-tcp-timeout-close-wait=0s --conntrack-tcp-timeout-established=0s --healthz-bind-address=127.0.0.1 --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubeproxy.kubeconfig --proxy-mode=iptables" machine # [ 17.611750] k3s[872]: I0923 16:12:45.528223 872 shared_informer.go:349] "Waiting for caches to sync" controller="node_authorizer" machine # [ 17.612069] k3s[872]: I0923 16:12:45.530446 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 17.613724] k3s[872]: I0923 16:12:45.532125 872 plugins.go:157] Loaded 14 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,PodTopologyLabels,MutatingAdmissionPolicy,MutatingAdmissionWebhook. machine # [ 17.614588] k3s[872]: I0923 16:12:45.532150 872 plugins.go:160] Loaded 14 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,NodeDeclaredFeatureValidator,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. machine # [ 17.614751] k3s[872]: I0923 16:12:45.532549 872 instance.go:240] Using reconciler: lease machine # [ 17.620376] k3s[872]: I0923 16:12:45.538761 872 handler.go:304] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager machine # [ 17.621154] k3s[872]: W0923 16:12:45.538794 872 genericapiserver.go:787] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. machine # [ 17.622634] k3s[872]: I0923 16:12:45.541039 872 cidrallocator.go:198] starting ServiceCIDR Allocator Controller machine # [ 17.648101] k3s[872]: I0923 16:12:45.566153 872 handler.go:304] Adding GroupVersion v1 to ResourceManager machine # [ 17.648324] k3s[872]: I0923 16:12:45.566312 872 apis.go:112] API group "internal.apiserver.k8s.io" is not enabled, skipping. machine # [ 17.681181] k3s[872]: I0923 16:12:45.599368 872 apis.go:112] API group "storagemigration.k8s.io" is not enabled, skipping. machine # [ 17.720729] k3s[872]: I0923 16:12:45.639093 872 handler.go:304] Adding GroupVersion authentication.k8s.io v1 to ResourceManager machine # [ 17.720953] k3s[872]: W0923 16:12:45.639128 872 genericapiserver.go:787] Skipping API authentication.k8s.io/v1beta1 because it has no resources. machine # [ 17.721538] k3s[872]: W0923 16:12:45.639140 872 genericapiserver.go:787] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. machine # [ 17.721725] k3s[872]: I0923 16:12:45.639505 872 handler.go:304] Adding GroupVersion authorization.k8s.io v1 to ResourceManager machine # [ 17.723054] k3s[872]: W0923 16:12:45.639521 872 genericapiserver.go:787] Skipping API authorization.k8s.io/v1beta1 because it has no resources. machine # [ 17.723476] k3s[872]: I0923 16:12:45.640096 872 handler.go:304] Adding GroupVersion autoscaling v2 to ResourceManager machine # [ 17.724762] k3s[872]: I0923 16:12:45.640606 872 handler.go:304] Adding GroupVersion autoscaling v1 to ResourceManager machine # [ 17.725358] k3s[872]: W0923 16:12:45.640623 872 genericapiserver.go:787] Skipping API autoscaling/v2beta1 because it has no resources. machine # [ 17.725859] k3s[872]: W0923 16:12:45.640634 872 genericapiserver.go:787] Skipping API autoscaling/v2beta2 because it has no resources. machine # [ 17.726504] k3s[872]: I0923 16:12:45.641589 872 handler.go:304] Adding GroupVersion batch v1 to ResourceManager machine # [ 17.727745] k3s[872]: W0923 16:12:45.641605 872 genericapiserver.go:787] Skipping API batch/v1beta1 because it has no resources. machine # [ 17.728366] k3s[872]: I0923 16:12:45.642135 872 handler.go:304] Adding GroupVersion certificates.k8s.io v1 to ResourceManager machine # [ 17.728882] k3s[872]: W0923 16:12:45.642151 872 genericapiserver.go:787] Skipping API certificates.k8s.io/v1beta1 because it has no resources. machine # [ 17.729584] k3s[872]: W0923 16:12:45.642162 872 genericapiserver.go:787] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. machine # [ 17.730434] k3s[872]: I0923 16:12:45.642530 872 handler.go:304] Adding GroupVersion coordination.k8s.io v1 to ResourceManager machine # [ 17.731217] k3s[872]: W0923 16:12:45.642546 872 genericapiserver.go:787] Skipping API coordination.k8s.io/v1beta1 because it has no resources. machine # [ 17.731674] k3s[872]: W0923 16:12:45.642557 872 genericapiserver.go:787] Skipping API coordination.k8s.io/v1alpha2 because it has no resources. machine # [ 17.732523] k3s[872]: I0923 16:12:45.642893 872 handler.go:304] Adding GroupVersion discovery.k8s.io v1 to ResourceManager machine # [ 17.733067] k3s[872]: W0923 16:12:45.642910 872 genericapiserver.go:787] Skipping API discovery.k8s.io/v1beta1 because it has no resources. machine # [ 17.733589] k3s[872]: I0923 16:12:45.644305 872 handler.go:304] Adding GroupVersion networking.k8s.io v1 to ResourceManager machine # [ 17.734119] k3s[872]: W0923 16:12:45.644323 872 genericapiserver.go:787] Skipping API networking.k8s.io/v1beta1 because it has no resources. machine # [ 17.734754] k3s[872]: I0923 16:12:45.644634 872 handler.go:304] Adding GroupVersion node.k8s.io v1 to ResourceManager machine # [ 17.735408] k3s[872]: W0923 16:12:45.644649 872 genericapiserver.go:787] Skipping API node.k8s.io/v1beta1 because it has no resources. machine # [ 17.735939] k3s[872]: W0923 16:12:45.644661 872 genericapiserver.go:787] Skipping API node.k8s.io/v1alpha1 because it has no resources. machine # [ 17.736795] k3s[872]: I0923 16:12:45.645108 872 handler.go:304] Adding GroupVersion policy v1 to ResourceManager machine # [ 17.737430] k3s[872]: W0923 16:12:45.645123 872 genericapiserver.go:787] Skipping API policy/v1beta1 because it has no resources. machine # [ 17.738432] k3s[872]: I0923 16:12:45.646123 872 handler.go:304] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager machine # [ 17.738995] k3s[872]: W0923 16:12:45.646140 872 genericapiserver.go:787] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. machine # [ 17.739494] k3s[872]: W0923 16:12:45.646151 872 genericapiserver.go:787] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. machine # [ 17.740057] k3s[872]: I0923 16:12:45.646403 872 handler.go:304] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager machine # [ 17.740482] k3s[872]: W0923 16:12:45.646417 872 genericapiserver.go:787] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. machine # [ 17.741063] k3s[872]: W0923 16:12:45.646428 872 genericapiserver.go:787] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. machine # [ 17.741537] k3s[872]: I0923 16:12:45.647903 872 handler.go:304] Adding GroupVersion storage.k8s.io v1 to ResourceManager machine # [ 17.742100] k3s[872]: W0923 16:12:45.647921 872 genericapiserver.go:787] Skipping API storage.k8s.io/v1beta1 because it has no resources. machine # [ 17.742584] k3s[872]: W0923 16:12:45.647933 872 genericapiserver.go:787] Skipping API storage.k8s.io/v1alpha1 because it has no resources. machine # [ 17.743162] k3s[872]: I0923 16:12:45.648651 872 handler.go:304] Adding GroupVersion flowcontrol.apiserver.k8s.io v1 to ResourceManager machine # [ 17.743613] k3s[872]: W0923 16:12:45.648673 872 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta3 because it has no resources. machine # [ 17.744213] k3s[872]: W0923 16:12:45.648685 872 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta2 because it has no resources. machine # [ 17.744741] k3s[872]: W0923 16:12:45.648694 872 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. machine # [ 17.745408] k3s[872]: I0923 16:12:45.651303 872 handler.go:304] Adding GroupVersion apps v1 to ResourceManager machine # [ 17.745990] k3s[872]: W0923 16:12:45.651321 872 genericapiserver.go:787] Skipping API apps/v1beta2 because it has no resources. machine # [ 17.746643] k3s[872]: W0923 16:12:45.651333 872 genericapiserver.go:787] Skipping API apps/v1beta1 because it has no resources. machine # [ 17.747586] k3s[872]: I0923 16:12:45.653617 872 handler.go:304] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager machine # [ 17.748105] k3s[872]: W0923 16:12:45.653636 872 genericapiserver.go:787] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. machine # [ 17.748586] k3s[872]: W0923 16:12:45.653654 872 genericapiserver.go:787] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. machine # [ 17.749465] k3s[872]: I0923 16:12:45.654318 872 handler.go:304] Adding GroupVersion events.k8s.io v1 to ResourceManager machine # [ 17.749688] k3s[872]: W0923 16:12:45.654335 872 genericapiserver.go:787] Skipping API events.k8s.io/v1beta1 because it has no resources. machine # [ 17.750362] k3s[872]: I0923 16:12:45.656650 872 handler.go:304] Adding GroupVersion resource.k8s.io v1 to ResourceManager machine # [ 17.750991] k3s[872]: W0923 16:12:45.656667 872 genericapiserver.go:787] Skipping API resource.k8s.io/v1beta2 because it has no resources. machine # [ 17.752242] k3s[872]: W0923 16:12:45.656678 872 genericapiserver.go:787] Skipping API resource.k8s.io/v1beta1 because it has no resources. machine # [ 17.753723] k3s[872]: W0923 16:12:45.656688 872 genericapiserver.go:787] Skipping API resource.k8s.io/v1alpha3 because it has no resources. machine # [ 17.755431] k3s[872]: I0923 16:12:45.659562 872 handler.go:304] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager machine # [ 17.756755] k3s[872]: W0923 16:12:45.659581 872 genericapiserver.go:787] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. machine # [ 18.102755] k3s[872]: I0923 16:12:46.020998 872 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 18.105350] k3s[872]: I0923 16:12:46.021011 872 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 18.106333] k3s[872]: I0923 16:12:46.021372 872 secure_serving.go:211] Serving securely on 127.0.0.1:6444 machine # [ 18.107213] k3s[872]: I0923 16:12:46.021390 872 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 18.107761] k3s[872]: I0923 16:12:46.021511 872 aggregator.go:185] waiting for initial CRD sync... machine # [ 18.108981] k3s[872]: I0923 16:12:46.021516 872 controller.go:78] Starting OpenAPI AggregationController machine # [ 18.110382] k3s[872]: I0923 16:12:46.021406 872 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 18.111113] k3s[872]: I0923 16:12:46.021605 872 local_available_controller.go:156] Starting LocalAvailability controller machine # [ 18.112302] k3s[872]: I0923 16:12:46.021619 872 cache.go:32] Waiting for caches to sync for LocalAvailability controller machine # [ 18.113470] k3s[872]: I0923 16:12:46.021664 872 remote_available_controller.go:425] Starting RemoteAvailability controller machine # [ 18.114666] k3s[872]: I0923 16:12:46.021674 872 cache.go:32] Waiting for caches to sync for RemoteAvailability controller machine # [ 18.115969] k3s[872]: I0923 16:12:46.021721 872 apiservice_controller.go:100] Starting APIServiceRegistrationController machine # [ 18.117149] k3s[872]: I0923 16:12:46.021731 872 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller machine # [ 18.118065] k3s[872]: I0923 16:12:46.021826 872 customresource_discovery_controller.go:294] Starting DiscoveryController machine # [ 18.118820] k3s[872]: time="2026-09-23T16:12:46Z" level=info msg="Starting apiserver lease garbage collector" logger=k3s machine # [ 18.119513] k3s[872]: time="2026-09-23T16:12:46Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 18.120054] k3s[872]: I0923 16:12:46.021940 872 controller.go:142] Starting OpenAPI controller machine # [ 18.120616] k3s[872]: I0923 16:12:46.022006 872 controller.go:90] Starting OpenAPI V3 controller machine # [ 18.121058] k3s[872]: I0923 16:12:46.022012 872 apf_controller.go:377] Starting API Priority and Fairness config controller machine # [ 18.121519] k3s[872]: I0923 16:12:46.022039 872 naming_controller.go:305] Starting NamingConditionController machine # [ 18.122066] k3s[872]: I0923 16:12:46.022081 872 dynamic_serving_content.go:135] "Starting controller" name="aggregator-proxy-cert::/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt::/var/lib/rancher/k3s/server/tls/client-auth-proxy.key" machine # [ 18.122495] k3s[872]: I0923 16:12:46.022111 872 nonstructuralschema_controller.go:202] Starting NonStructuralSchemaConditionController machine # [ 18.123088] k3s[872]: I0923 16:12:46.022112 872 controller.go:113] "Deleting old lease on startup" lease="kube-system/apiserver-ik4pcwfs7qgdl76byc4pomgvia" machine # [ 18.123563] k3s[872]: I0923 16:12:46.022148 872 apiapproval_controller.go:196] Starting KubernetesAPIApprovalPolicyConformantConditionController machine # [ 18.124075] k3s[872]: I0923 16:12:46.022181 872 crd_finalizer.go:273] Starting CRDFinalizer machine # [ 18.124561] k3s[872]: I0923 16:12:46.022575 872 cluster_authentication_trust_controller.go:459] Starting cluster_authentication_trust_controller controller machine # [ 18.124740] k3s[872]: time="2026-09-23T16:12:46Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 18.125397] k3s[872]: I0923 16:12:46.022596 872 repairip.go:210] Starting ipallocator-repair-controller machine # [ 18.125930] k3s[872]: I0923 16:12:46.022615 872 shared_informer.go:349] "Waiting for caches to sync" controller="ipallocator-repair-controller" machine # [ 18.126580] k3s[872]: I0923 16:12:46.022634 872 controller.go:80] Starting OpenAPI V3 AggregationController machine # [ 18.127124] k3s[872]: I0923 16:12:46.022692 872 system_namespaces_controller.go:66] Starting system namespaces controller machine # [ 18.127588] k3s[872]: time="2026-09-23T16:12:46Z" level=info msg="Starting legacy_token_tracking_controller" logger=k3s machine # [ 18.128133] k3s[872]: time="2026-09-23T16:12:46Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 18.128620] k3s[872]: I0923 16:12:46.022923 872 crdregistration_controller.go:114] Starting crd-autoregister controller machine # [ 18.129182] k3s[872]: I0923 16:12:46.022942 872 shared_informer.go:349] "Waiting for caches to sync" controller="crd-autoregister" machine # [ 18.129647] k3s[872]: I0923 16:12:46.023343 872 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 18.130214] k3s[872]: I0923 16:12:46.028707 872 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 18.167077] k3s[872]: I0923 16:12:46.083605 872 default_servicecidr_controller.go:110] Starting kubernetes-service-cidr-controller machine # [ 18.167416] k3s[872]: I0923 16:12:46.083639 872 shared_informer.go:349] "Waiting for caches to sync" controller="kubernetes-service-cidr-controller" machine # [ 18.203702] k3s[872]: I0923 16:12:46.122067 872 apf_controller.go:382] Running API Priority and Fairness config worker machine # [ 18.203878] k3s[872]: I0923 16:12:46.122098 872 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process machine # [ 18.204680] k3s[872]: I0923 16:12:46.123080 872 shared_informer.go:356] "Caches are synced" controller="ipallocator-repair-controller" machine # [ 18.205179] k3s[872]: I0923 16:12:46.123209 872 shared_informer.go:356] "Caches are synced" controller="crd-autoregister" machine # [ 18.205620] k3s[872]: time="2026-09-23T16:12:46Z" level=info msg="Caches are synced" logger=k3s machine # [ 18.206168] k3s[872]: time="2026-09-23T16:12:46Z" level=info msg="Caches are synced" logger=k3s machine # [ 18.206655] k3s[872]: time="2026-09-23T16:12:46Z" level=info msg="Caches are synced" logger=k3s machine # [ 18.207142] k3s[872]: I0923 16:12:46.123916 872 aggregator.go:187] initial CRD sync complete... machine # [ 18.207594] k3s[872]: I0923 16:12:46.123932 872 autoregister_controller.go:144] Starting autoregister controller machine # [ 18.208125] k3s[872]: I0923 16:12:46.123947 872 cache.go:32] Waiting for caches to sync for autoregister controller machine # [ 18.258787] k3s[872]: E0923 16:12:46.177142 872 controller.go:201] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" machine # [ 18.266278] k3s[872]: I0923 16:12:46.184602 872 shared_informer.go:356] "Caches are synced" controller="kubernetes-service-cidr-controller" machine # [ 18.266759] k3s[872]: I0923 16:12:46.184642 872 default_servicecidr_controller.go:169] Creating default ServiceCIDR with CIDRs: [10.43.0.0/16] machine # [ 18.269516] k3s[872]: E0923 16:12:46.187905 872 controller.go:95] Unable to perform initial Kubernetes service initialization: namespaces "default" not found machine # [ 18.270390] k3s[872]: time="2026-09-23T16:12:46Z" level=error msg="Error while syncing ConfigMap" configmap=kube-system/kube-apiserver-legacy-service-account-token-tracking error="namespaces \"kube-system\" not found" logger=k3s/UnhandledError machine # [ 18.333815] k3s[872]: time="2026-09-23T16:12:46Z" level=error msg="Error while syncing ConfigMap" configmap=kube-system/kube-apiserver-legacy-service-account-token-tracking error="namespaces \"kube-system\" not found" logger=k3s/UnhandledError machine # [ 18.403577] k3s[872]: time="2026-09-23T16:12:46Z" level=error msg="Error while syncing ConfigMap" configmap=kube-system/kube-apiserver-legacy-service-account-token-tracking error="namespaces \"kube-system\" not found" logger=k3s/UnhandledError machine # [ 18.439733] k3s[872]: time="2026-09-23T16:12:46Z" level=info msg="containerd is now running" machine # [ 18.452234] k3s[872]: time="2026-09-23T16:12:46Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/k3s-airgap-images-amd64.tar.zst" machine # [ 18.481605] k3s[872]: time="2026-09-23T16:12:46Z" level=error msg="Error while syncing ConfigMap" configmap=kube-system/kube-apiserver-legacy-service-account-token-tracking error="namespaces \"kube-system\" not found" logger=k3s/UnhandledError machine # [ 18.504556] k3s[872]: I0923 16:12:46.422813 872 cache.go:39] Caches are synced for APIServiceRegistrationController controller machine # [ 18.505425] k3s[872]: I0923 16:12:46.422927 872 cache.go:39] Caches are synced for LocalAvailability controller machine # [ 18.507188] k3s[872]: I0923 16:12:46.422995 872 cache.go:39] Caches are synced for RemoteAvailability controller machine # [ 18.508376] k3s[872]: I0923 16:12:46.422940 872 handler_discovery.go:451] Starting ResourceDiscoveryManager machine # [ 18.510074] k3s[872]: I0923 16:12:46.424406 872 cache.go:39] Caches are synced for autoregister controller machine # [ 18.512352] k3s[872]: I0923 16:12:46.430593 872 shared_informer.go:377] "Caches are synced" machine # [ 18.515254] k3s[872]: I0923 16:12:46.430663 872 policy_source.go:248] refreshing policies machine # [ 18.519557] k3s[872]: I0923 16:12:46.437835 872 controller.go:667] quota admission added evaluator for: namespaces machine # [ 18.533245] k3s[872]: I0923 16:12:46.451557 872 shared_informer.go:356] "Caches are synced" controller="node_authorizer" machine # [ 18.540139] k3s[872]: I0923 16:12:46.458010 872 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io machine # [ 18.572542] k3s[872]: I0923 16:12:46.490871 872 default_servicecidr_controller.go:231] Setting default ServiceCIDR condition Ready to True machine # [ 18.573033] k3s[872]: I0923 16:12:46.490983 872 cidrallocator.go:302] created ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 18.580255] k3s[872]: I0923 16:12:46.498616 872 default_servicecidr_controller.go:231] Setting default ServiceCIDR condition Ready to True machine # [ 18.582321] k3s[872]: I0923 16:12:46.498819 872 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 19.109687] k3s[872]: I0923 16:12:47.027639 872 storage_scheduling.go:123] created PriorityClass system-node-critical with value 2000001000 machine # [ 19.113602] k3s[872]: I0923 16:12:47.032005 872 storage_scheduling.go:123] created PriorityClass system-cluster-critical with value 2000000000 machine # [ 19.115576] k3s[872]: I0923 16:12:47.032028 872 storage_scheduling.go:139] all system priority classes are created successfully or already exist. machine # [ 19.415504] k3s[872]: time="2026-09-23T16:12:47Z" level=info msg="Polling for API server readiness: GET /readyz failed: unknown" machine # [ 19.608860] rustfs-bucket-start[947]: mb s3://farm machine # [ 19.613963] systemd[1]: Finished rustfs-bucket.service. machine # [ 20.096668] k3s[872]: I0923 16:12:48.015014 872 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io machine # [ 20.138641] k3s[872]: I0923 16:12:48.056435 872 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io machine # [ 20.279256] k3s[872]: I0923 16:12:48.197592 872 alloc.go:329] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.43.0.1"} machine # [ 20.285704] k3s[872]: W0923 16:12:48.204081 872 lease.go:265] Resetting endpoints for master service "kubernetes" to [10.0.2.15] machine # [ 20.288627] k3s[872]: I0923 16:12:48.206972 872 controller.go:667] quota admission added evaluator for: endpoints machine # [ 20.294175] k3s[872]: I0923 16:12:48.212559 872 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io machine # [ 21.416685] k3s[872]: time="2026-09-23T16:12:49Z" level=info msg="Waiting for untainted node" machine # [ 21.417697] k3s[872]: time="2026-09-23T16:12:49Z" level=info msg="Creating k3s-supervisor event broadcaster" machine # [ 21.418148] k3s[872]: time="2026-09-23T16:12:49Z" level=info msg="Kube API server is now running" machine # [ 21.418678] k3s[872]: time="2026-09-23T16:12:49Z" level=info msg="k3s is up and running" machine # [ 21.422319] systemd[1]: Started k3s service. machine # [ 21.424083] k3s[872]: time="2026-09-23T16:12:49Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Node and Certificate Authority certificates managed by k3s are OK" object=machine reason=CertificateExpirationOK type=Normal machine # [ 21.428232] systemd[1]: Starting niks3 server... machine # [ 21.436126] k3s[872]: I0923 16:12:49.354521 872 controllermanager.go:189] "Starting" version="v1.35.8+k3s1" machine # [ 21.436422] k3s[872]: I0923 16:12:49.354549 872 controllermanager.go:191] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 21.443670] k3s[872]: I0923 16:12:49.362075 872 secure_serving.go:211] Serving securely on 127.0.0.1:10257 machine # [ 21.444811] k3s[872]: I0923 16:12:49.363225 872 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 21.445340] k3s[872]: I0923 16:12:49.363504 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 21.446517] k3s[872]: I0923 16:12:49.364449 872 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key" machine # [ 21.447451] k3s[872]: I0923 16:12:49.364638 872 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 21.448313] k3s[872]: I0923 16:12:49.364714 872 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 21.449242] k3s[872]: I0923 16:12:49.364731 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 21.450253] k3s[872]: I0923 16:12:49.364759 872 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 21.451416] k3s[872]: I0923 16:12:49.364777 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 21.466063] k3s[872]: I0923 16:12:49.381197 872 controller.go:667] quota admission added evaluator for: serviceaccounts machine # [ 21.479828] k3s[872]: time="2026-09-23T16:12:49Z" level=info msg="Creating embedded CRD addons.k3s.cattle.io" machine # [ 21.490668] k3s[872]: time="2026-09-23T16:12:49Z" level=info msg="Creating embedded CRD etcdsnapshotfiles.k3s.cattle.io" machine # [ 21.497576] k3s[872]: time="2026-09-23T16:12:49Z" level=info msg="Creating embedded CRD helmchartconfigs.helm.cattle.io" machine: (finished: waiting for unit k3s.service, in 22.42 seconds) machine: waiting for success: kubectl get ns farm machine # [ 21.503715] k3s[872]: time="2026-09-23T16:12:49Z" level=info msg="Creating embedded CRD helmcharts.helm.cattle.io" machine # [ 21.505197] k3s[872]: I0923 16:12:49.422117 872 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" requiredFeatureGates=["ClusterTrustBundle"] machine # [ 21.507947] k3s[872]: I0923 16:12:49.422183 872 controllermanager.go:579] "Warning: skipping controller" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" machine # [ 21.510113] k3s[872]: I0923 16:12:49.422199 872 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="storageversion-garbage-collector-controller" requiredFeatureGates=["APIServerIdentity","StorageVersionAPI"] machine # [ 21.512894] k3s[872]: I0923 16:12:49.422211 872 controllermanager.go:579] "Warning: skipping controller" controller="storageversion-garbage-collector-controller" machine # [ 21.514953] k3s[872]: I0923 16:12:49.433057 872 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 21.525094] k3s[872]: time="2026-09-23T16:12:49Z" level=info msg="Waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 21.527125] k3s[872]: I0923 16:12:49.443322 872 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 21.532852] k3s[872]: I0923 16:12:49.451158 872 controllermanager.go:627] "Warning: controller is disabled" controller="bootstrap-signer-controller" machine # [ 21.541059] k3s[872]: I0923 16:12:49.459421 872 node_lifecycle_controller.go:419] "Controller will reconcile labels" logger="node-lifecycle-controller" machine # [ 21.543126] k3s[872]: I0923 16:12:49.461365 872 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 21.546620] k3s[872]: I0923 16:12:49.464923 872 shared_informer.go:377] "Caches are synced" machine # [ 21.547315] k3s[872]: I0923 16:12:49.465120 872 shared_informer.go:377] "Caches are synced" machine # [ 21.548532] k3s[872]: I0923 16:12:49.465200 872 shared_informer.go:377] "Caches are synced" machine # [ 21.560909] k3s[872]: I0923 16:12:49.479297 872 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="device-taint-eviction-controller" requiredFeatureGates=["DynamicResourceAllocation","DRADeviceTaints"] machine # [ 21.561252] k3s[872]: I0923 16:12:49.479323 872 controllermanager.go:579] "Warning: skipping controller" controller="device-taint-eviction-controller" machine # [ 21.570760] k3s[872]: I0923 16:12:49.489148 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 21.574109] k3s[872]: I0923 16:12:49.492507 872 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 21.671673] k3s[872]: I0923 16:12:49.589903 872 shared_informer.go:377] "Caches are synced" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 21.845235] k3s[872]: time="2026-09-23T16:12:49Z" level=info msg="Imported docker.io/rancher/klipper-helm:v0.13.3-build20260727" machine # [ 21.849611] k3s[872]: time="2026-09-23T16:12:49Z" level=info msg="Tagged docker.io/rancher/klipper-helm@sha256:5425a2b4613d2458dbdff99218e8d487ebb59c20e7a941f061c0777070f0aac1" machine # [ 21.852125] k3s[872]: time="2026-09-23T16:12:49Z" level=info msg="Imported docker.io/rancher/klipper-lb:v0.4.17" machine # [ 21.853688] k3s[872]: time="2026-09-23T16:12:49Z" level=info msg="Tagged docker.io/rancher/klipper-lb@sha256:910944bb0bd94f060a82a56ca1ea1c577d3e49b3473a093a47a985f32e92d94a" machine # [ 21.855974] k3s[872]: time="2026-09-23T16:12:49Z" level=info msg="Imported docker.io/rancher/local-path-provisioner:v0.0.37" machine # [ 21.857706] k3s[872]: time="2026-09-23T16:12:49Z" level=info msg="Tagged docker.io/rancher/local-path-provisioner@sha256:e757967a5ec338f6a9b371c5a9688bedaa8c3578ea3dd4db329ea0084be0a86f" machine # [ 21.860137] k3s[872]: time="2026-09-23T16:12:49Z" level=info msg="Imported docker.io/rancher/mirrored-coredns-coredns:1.14.6" machine # [ 21.861895] k3s[872]: I0923 16:12:49.778426 872 controllermanager.go:627] "Warning: controller is disabled" controller="selinux-warning-controller" machine # [ 21.863986] k3s[872]: time="2026-09-23T16:12:49Z" level=info msg="Tagged docker.io/rancher/mirrored-coredns-coredns@sha256:900f9c109f7a33545d3c811516e8376df9019147b750f5ce3e254468769176ea" machine # [ 21.866385] k3s[872]: time="2026-09-23T16:12:49Z" level=info msg="Imported docker.io/rancher/mirrored-library-busybox:1.37.0" machine # [ 21.868051] k3s[872]: time="2026-09-23T16:12:49Z" level=info msg="Tagged docker.io/rancher/mirrored-library-busybox@sha256:101b4afd76732482eff9b95cae5f94bcf295e521fbec4e01b69c5421f3f3f3e5" machine # [ 21.870467] k3s[872]: time="2026-09-23T16:12:49Z" level=info msg="Imported docker.io/rancher/mirrored-library-traefik:3.7.8" machine # [ 21.875378] k3s[872]: time="2026-09-23T16:12:49Z" level=info msg="Tagged docker.io/rancher/mirrored-library-traefik@sha256:4299bbed850421258fc5448c2e0e6ad350981d4d335a68de11b92448aedbefe5" machine # [ 21.878046] k3s[872]: time="2026-09-23T16:12:49Z" level=info msg="Imported docker.io/rancher/mirrored-metrics-server:v0.9.0" machine # [ 21.878538] k3s[872]: time="2026-09-23T16:12:49Z" level=info msg="Tagged docker.io/rancher/mirrored-metrics-server@sha256:d9862115e7c7881280d3d75ca26bda8ffc0fc213315979575bf23ce9826205c0" machine # [ 21.879142] k3s[872]: time="2026-09-23T16:12:49Z" level=info msg="Imported docker.io/rancher/mirrored-pause:3.10.2" machine # [ 21.882433] k3s[872]: time="2026-09-23T16:12:49Z" level=info msg="Tagged docker.io/rancher/mirrored-pause@sha256:f548e0e8e3dc1896ca956272154dde3314e8cc4fde0a57577ee9fa1c63f5baf4" machine # [ 22.038774] k3s[872]: time="2026-09-23T16:12:49Z" level=info msg="Done waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 22.039027] k3s[872]: time="2026-09-23T16:12:49Z" level=info msg="Waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 22.043263] k3s[872]: time="2026-09-23T16:12:49Z" level=info msg="Done waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 22.043784] k3s[872]: time="2026-09-23T16:12:49Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-40.1.4+up40.1.0.tgz" machine # [ 22.044428] k3s[872]: time="2026-09-23T16:12:49Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-crd-40.1.4+up40.1.0.tgz" machine # [ 22.044952] k3s[872]: time="2026-09-23T16:12:49Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/ccm.yaml" machine # [ 22.045583] k3s[872]: time="2026-09-23T16:12:49Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/coredns.yaml" machine # [ 22.046147] k3s[872]: time="2026-09-23T16:12:49Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/local-storage.yaml" machine # [ 22.046586] k3s[872]: time="2026-09-23T16:12:49Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/rolebindings.yaml" machine # [ 22.047135] k3s[872]: time="2026-09-23T16:12:49Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/runtimes.yaml" machine # [ 22.047606] k3s[872]: time="2026-09-23T16:12:49Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/traefik.yaml" machine # [ 22.166076] k3s[872]: time="2026-09-23T16:12:50Z" level=info msg="Imported 8 images from /var/lib/rancher/k3s/agent/images/k3s-airgap-images-amd64.tar.zst in 3.714281283s" machine # [ 22.168463] k3s[872]: time="2026-09-23T16:12:50Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-client.tar" machine # [ 22.481702] k3s[872]: time="2026-09-23T16:12:50Z" level=info msg="Tunnel server egress proxy mode: agent" machine # [ 22.482555] k3s[872]: I0923 16:12:50.400194 872 range_allocator.go:113] "No Secondary Service CIDR provided. Skipping filtering out secondary service addresses" logger="node-ipam-controller" machine # [ 22.484909] k3s[872]: I0923 16:12:50.400304 872 controllermanager.go:627] "Warning: controller is disabled" controller="node-route-controller" machine # [ 22.486510] k3s[872]: time="2026-09-23T16:12:50Z" level=info msg="Starting dynamiclistener CN filter node controller with SANs: [127.0.0.1 ::1 localhost machine 10.0.2.15 fec0::7fba:c9bd:21bc:ded1 10.43.0.1 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local]" machine # [ 22.576704] k3s[872]: time="2026-09-23T16:12:50Z" level=info msg="Creating new TLS secret for kube-system/k3s-serving (count: 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__7fba_c9bd_21bc_ded1-4647ff:fec0::7fba:c9bd:21bc:ded1 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=2AE28AECAE9CBDD45E8D86F0EA33B09F5D5CCFA0]" machine # [ 22.587726] k3s[872]: time="2026-09-23T16:12:50Z" level=info msg="Active TLS secret kube-system/k3s-serving (ver=234) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__7fba_c9bd_21bc_ded1-4647ff:fec0::7fba:c9bd:21bc:ded1 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=2AE28AECAE9CBDD45E8D86F0EA33B09F5D5CCFA0]" machine # [ 22.762310] k3s[872]: I0923 16:12:50.680589 872 controllermanager.go:627] "Warning: controller is disabled" controller="service-lb-controller" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 23.514268] k3s[872]: W0923 16:12:51.431855 872 probe.go:272] Flexvolume plugin directory at /usr/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating. machine # [ 23.514688] k3s[872]: I0923 16:12:51.432910 872 controllermanager.go:579] "Warning: skipping controller" controller="storage-version-migrator-controller" machine # [ 23.713126] k3s[872]: time="2026-09-23T16:12:51Z" level=info msg="Starting k3s.cattle.io/v1, Kind=Addon controller" machine # [ 23.713665] k3s[872]: time="2026-09-23T16:12:51Z" level=info msg="Creating deploy event broadcaster" machine # [ 23.720371] k3s[872]: I0923 16:12:51.638700 872 controller.go:667] quota admission added evaluator for: addons.k3s.cattle.io machine # [ 23.722969] k3s[872]: time="2026-09-23T16:12:51Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 23.724405] k3s[872]: time="2026-09-23T16:12:51Z" level=info msg="Creating helm-controller event broadcaster" machine # [ 23.731856] k3s[872]: time="2026-09-23T16:12:51Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 23.733511] k3s[872]: time="2026-09-23T16:12:51Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=ApplyingManifest type=Normal machine # [ 23.736945] k3s[872]: time="2026-09-23T16:12:51Z" level=info msg="Cluster dns configmap has been set successfully" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 24.423882] k3s[872]: time="2026-09-23T16:12:52Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=AppliedManifest type=Normal machine # [ 24.447132] k3s[872]: time="2026-09-23T16:12:52Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=ApplyingManifest type=Normal machine # [ 24.563961] k3s[872]: time="2026-09-23T16:12:52Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=AppliedManifest type=Normal machine # [ 24.576227] k3s[872]: time="2026-09-23T16:12:52Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=ApplyingManifest type=Normal machine # [ 24.725992] k3s[872]: time="2026-09-23T16:12:52Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 24.868776] k3s[872]: I0923 16:12:52.787099 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpointslices.discovery.k8s.io" machine # [ 24.869047] k3s[872]: I0923 16:12:52.787232 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="replicasets.apps" machine # [ 24.880075] k3s[872]: I0923 16:12:52.797536 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="roles.rbac.authorization.k8s.io" machine # [ 24.880200] k3s[872]: I0923 16:12:52.797652 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmchartconfigs.helm.cattle.io" machine # [ 24.881330] k3s[872]: I0923 16:12:52.797727 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="csistoragecapacities.storage.k8s.io" machine # [ 24.881707] k3s[872]: I0923 16:12:52.797784 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="limitranges" machine # [ 24.882894] k3s[872]: I0923 16:12:52.797913 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="controllerrevisions.apps" machine # [ 24.884036] k3s[872]: I0923 16:12:52.797987 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="jobs.batch" machine # [ 24.885075] k3s[872]: I0923 16:12:52.798047 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="cronjobs.batch" machine # [ 24.885946] k3s[872]: I0923 16:12:52.798103 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="networkpolicies.networking.k8s.io" machine # [ 24.887158] k3s[872]: I0923 16:12:52.798158 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="addons.k3s.cattle.io" machine # [ 24.888088] k3s[872]: I0923 16:12:52.798250 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="deployments.apps" machine # [ 24.888984] k3s[872]: I0923 16:12:52.798303 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="leases.coordination.k8s.io" machine # [ 24.889908] k3s[872]: I0923 16:12:52.798356 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="serviceaccounts" machine # [ 24.891133] k3s[872]: I0923 16:12:52.798416 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="rolebindings.rbac.authorization.k8s.io" machine # [ 24.918375] k3s[872]: I0923 16:12:52.798549 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmcharts.helm.cattle.io" machine # [ 24.920761] k3s[872]: I0923 16:12:52.839159 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpoints" machine # [ 24.921228] k3s[872]: I0923 16:12:52.839200 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="statefulsets.apps" machine # [ 24.925091] k3s[872]: I0923 16:12:52.839240 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="ingresses.networking.k8s.io" machine # [ 24.925669] k3s[872]: I0923 16:12:52.843488 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="poddisruptionbudgets.policy" machine # [ 24.926162] k3s[872]: I0923 16:12:52.843537 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="podtemplates" machine # [ 24.926626] k3s[872]: I0923 16:12:52.843576 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="daemonsets.apps" machine # [ 24.927158] k3s[872]: I0923 16:12:52.843607 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="resourceclaimtemplates.resource.k8s.io" machine # [ 24.935913] k3s[872]: I0923 16:12:52.854317 872 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="horizontalpodautoscalers.autoscaling" machine # [ 25.040776] k3s[872]: time="2026-09-23T16:12:52Z" level=info msg="Starting rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding controller" machine # [ 25.046203] k3s[872]: time="2026-09-23T16:12:52Z" level=info msg="Starting batch/v1, Kind=Job controller" machine # [ 25.046937] k3s[872]: time="2026-09-23T16:12:52Z" level=info msg="Starting /v1, Kind=ServiceAccount controller" machine # [ 25.048696] k3s[872]: time="2026-09-23T16:12:52Z" level=info msg="Starting /v1, Kind=Secret controller" machine # [ 25.049243] k3s[872]: time="2026-09-23T16:12:52Z" level=info msg="Starting /v1, Kind=ConfigMap controller" machine # [ 25.058259] k3s[872]: time="2026-09-23T16:12:52Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChart controller" machine # [ 25.058734] k3s[872]: time="2026-09-23T16:12:52Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChartConfig controller" machine # [ 25.160947] k3s[872]: I0923 16:12:53.079284 872 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="podcertificaterequest-cleaner-controller" requiredFeatureGates=["PodCertificateRequest"] machine # [ 25.161228] k3s[872]: I0923 16:12:53.079315 872 controllermanager.go:579] "Warning: skipping controller" controller="podcertificaterequest-cleaner-controller" machine # [ 25.161821] k3s[872]: I0923 16:12:53.079329 872 controllermanager.go:627] "Warning: controller is disabled" controller="cloud-node-lifecycle-controller" machine: (finished: waiting for success: kubectl get ns farm, in 3.73 seconds) machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key machine # [ 25.365497] k3s[872]: I0923 16:12:53.283743 872 controller.go:667] quota admission added evaluator for: deployments.apps machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key, in 0.14 seconds) machine: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key machine # [ 25.472987] k3s[872]: I0923 16:12:53.391324 872 alloc.go:329] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.43.0.10"} machine # [ 25.474836] k3s[872]: time="2026-09-23T16:12:53Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=AppliedManifest type=Normal machine: (finished: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key, in 0.16 seconds) machine: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine # [ 25.628232] k3s[872]: I0923 16:12:53.546171 872 serving.go:392] Generated self-signed cert in-memory machine: (finished: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.18 seconds) subtest: chart deploys and workers become Ready machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine # [ 25.728457] k3s[872]: time="2026-09-23T16:12:53Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 25.773808] k3s[872]: I0923 16:12:53.691836 872 serving.go:392] Generated self-signed cert in-memory machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 25.893587] k3s[872]: I0923 16:12:53.811882 872 controllermanager.go:160] Version: v1.35.8+k3s1 machine # [ 25.899069] k3s[872]: I0923 16:12:53.815822 872 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 25.899375] k3s[872]: I0923 16:12:53.815840 872 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 25.899865] k3s[872]: I0923 16:12:53.815868 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.900503] k3s[872]: I0923 16:12:53.816053 872 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 25.901069] k3s[872]: I0923 16:12:53.816074 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.901583] k3s[872]: I0923 16:12:53.815860 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.902144] k3s[872]: I0923 16:12:53.816130 872 secure_serving.go:211] Serving securely on 127.0.0.1:10258 machine # [ 25.902653] k3s[872]: I0923 16:12:53.816294 872 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 25.903432] k3s[872]: time="2026-09-23T16:12:53Z" level=info msg="Creating service-lb-controller event broadcaster" machine # [ 26.010445] k3s[872]: time="2026-09-23T16:12:53Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" object=kube-system/local-storage reason=DeletingManifest type=Normal machine # [ 26.020070] k3s[872]: I0923 16:12:53.937489 872 ttl_controller.go:127] "Starting TTL controller" machine # [ 26.020383] k3s[872]: I0923 16:12:53.937521 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.020933] k3s[872]: I0923 16:12:53.938701 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.021557] k3s[872]: I0923 16:12:53.938770 872 expand_controller.go:328] "Starting expand controller" machine # [ 26.022114] k3s[872]: I0923 16:12:53.938784 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.023095] k3s[872]: I0923 16:12:53.938814 872 clusterroleaggregation_controller.go:194] "Starting ClusterRoleAggregator controller" machine # [ 26.023796] k3s[872]: I0923 16:12:53.938826 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.024463] k3s[872]: I0923 16:12:53.938862 872 pv_protection_controller.go:81] "Starting PV protection controller" machine # [ 26.025038] k3s[872]: I0923 16:12:53.938874 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.025541] k3s[872]: I0923 16:12:53.938965 872 endpoints_controller.go:193] "Starting endpoint controller" machine # [ 26.027485] k3s[872]: I0923 16:12:53.938978 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.028161] k3s[872]: I0923 16:12:53.939030 872 serviceaccounts_controller.go:117] "Starting service account controller" machine # [ 26.028650] k3s[872]: I0923 16:12:53.939044 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.029171] k3s[872]: I0923 16:12:53.939099 872 node_lifecycle_controller.go:453] "Sending events to api server" machine # [ 26.029646] k3s[872]: I0923 16:12:53.939131 872 node_lifecycle_controller.go:460] "Starting node controller" machine # [ 26.031319] k3s[872]: I0923 16:12:53.939144 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.031990] k3s[872]: I0923 16:12:53.939186 872 publisher.go:107] "Starting root CA cert publisher controller" machine # [ 26.032671] k3s[872]: I0923 16:12:53.939198 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.033357] k3s[872]: I0923 16:12:53.939269 872 endpointslice_controller.go:283] "Starting endpoint slice controller" machine # [ 26.033877] k3s[872]: I0923 16:12:53.939282 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.034531] k3s[872]: I0923 16:12:53.939312 872 namespace_controller.go:202] "Starting namespace controller" machine # [ 26.034719] k3s[872]: I0923 16:12:53.939326 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.035602] k3s[872]: I0923 16:12:53.939402 872 daemon_controller.go:309] "Starting daemon sets controller" machine # [ 26.036164] k3s[872]: I0923 16:12:53.939415 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.036676] k3s[872]: I0923 16:12:53.939446 872 ttlafterfinished_controller.go:112] "Starting TTL after finished controller" machine # [ 26.037361] k3s[872]: I0923 16:12:53.939497 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.037907] k3s[872]: I0923 16:12:53.939559 872 servicecidrs_controller.go:136] "Starting" controller="service-cidr-controller" machine # [ 26.038574] k3s[872]: I0923 16:12:53.939572 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.039145] k3s[872]: I0923 16:12:53.939610 872 certificate_controller.go:120] "Starting certificate controller" name="csrapproving" machine # [ 26.039640] k3s[872]: I0923 16:12:53.939624 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.040226] k3s[872]: I0923 16:12:53.939703 872 node_ipam_controller.go:142] "Starting ipam controller" machine # [ 26.040694] k3s[872]: I0923 16:12:53.939716 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.041426] k3s[872]: I0923 16:12:53.939775 872 pv_controller_base.go:307] "Starting persistent volume controller" machine # [ 26.041954] k3s[872]: I0923 16:12:53.939787 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.042635] k3s[872]: I0923 16:12:53.939862 872 controller.go:423] "Starting resource claim controller" machine # [ 26.043167] k3s[872]: I0923 16:12:53.939875 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.043669] k3s[872]: I0923 16:12:53.939945 872 replica_set.go:241] "Starting controller" name="replicaset" machine # [ 26.044396] k3s[872]: I0923 16:12:53.939969 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.045030] k3s[872]: I0923 16:12:53.940046 872 endpointslicemirroring_controller.go:226] "Starting EndpointSliceMirroring controller" machine # [ 26.045520] k3s[872]: I0923 16:12:53.940059 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.045700] k3s[872]: I0923 16:12:53.940094 872 controller.go:174] "Starting ephemeral volume controller" machine # [ 26.046194] k3s[872]: I0923 16:12:53.940106 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.046694] k3s[872]: I0923 16:12:53.940136 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.047370] k3s[872]: I0923 16:12:53.940171 872 taint_eviction.go:283] "Starting" controller="taint-eviction-controller" machine # [ 26.047910] k3s[872]: I0923 16:12:53.940218 872 taint_eviction.go:288] "Sending events to API server" machine # [ 26.048620] k3s[872]: I0923 16:12:53.940228 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.049163] k3s[872]: I0923 16:12:53.940258 872 disruption.go:458] "Sending events to api server." machine # [ 26.049689] k3s[872]: I0923 16:12:53.940289 872 disruption.go:465] "Starting disruption controller" machine # [ 26.050405] k3s[872]: I0923 16:12:53.940299 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.050943] k3s[872]: I0923 16:12:53.940386 872 attach_detach_controller.go:335] "Starting attach detach controller" machine # [ 26.051631] k3s[872]: I0923 16:12:53.940398 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.052202] k3s[872]: I0923 16:12:53.940429 872 gc_controller.go:98] "Starting GC controller" machine # [ 26.052758] k3s[872]: I0923 16:12:53.940441 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.053401] k3s[872]: I0923 16:12:53.940531 872 job_controller.go:254] "Starting job controller" machine # [ 26.053942] k3s[872]: I0923 16:12:53.940544 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.054616] k3s[872]: I0923 16:12:53.940590 872 horizontal.go:204] "Starting HPA controller" machine # [ 26.055191] k3s[872]: I0923 16:12:53.940602 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.055701] k3s[872]: I0923 16:12:53.940652 872 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-legacy-unknown" machine # [ 26.056422] k3s[872]: I0923 16:12:53.940664 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.056984] k3s[872]: I0923 16:12:53.940696 872 cleaner.go:83] "Starting CSR cleaner controller" machine # [ 26.057631] k3s[872]: I0923 16:12:53.940741 872 tokencleaner.go:117] "Starting token cleaner controller" machine # [ 26.058228] k3s[872]: I0923 16:12:53.940754 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.058722] k3s[872]: I0923 16:12:53.940788 872 legacy_serviceaccount_token_cleaner.go:103] "Starting legacy service account token cleaner controller" machine # [ 26.059398] k3s[872]: I0923 16:12:53.940801 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.059948] k3s[872]: I0923 16:12:53.940865 872 replica_set.go:241] "Starting controller" name="replicationcontroller" machine # [ 26.060573] k3s[872]: I0923 16:12:53.940878 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.061118] k3s[872]: I0923 16:12:53.941139 872 stateful_set.go:180] "Starting stateful set controller" machine # [ 26.061560] k3s[872]: I0923 16:12:53.941154 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.062074] k3s[872]: I0923 16:12:53.941223 872 cronjob_controllerv2.go:143] "Starting cronjob controller v2" machine # [ 26.062557] k3s[872]: I0923 16:12:53.941240 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.063602] k3s[872]: I0923 16:12:53.941270 872 pvc_protection_controller.go:166] "Starting PVC protection controller" machine # [ 26.065038] k3s[872]: I0923 16:12:53.941284 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.066126] k3s[872]: I0923 16:12:53.941315 872 vac_protection_controller.go:206] "Starting VAC protection controller" machine # [ 26.067654] k3s[872]: I0923 16:12:53.941327 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.068677] k3s[872]: I0923 16:12:53.941605 872 deployment_controller.go:172] "Starting controller" controller="deployment" machine # [ 26.070156] k3s[872]: I0923 16:12:53.941618 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.071766] k3s[872]: I0923 16:12:53.942659 872 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-serving" machine # [ 26.073126] k3s[872]: I0923 16:12:53.942673 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.074691] k3s[872]: I0923 16:12:53.942708 872 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-client" machine # [ 26.075861] k3s[872]: I0923 16:12:53.942720 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.077872] k3s[872]: I0923 16:12:53.942751 872 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kube-apiserver-client" machine # [ 26.078911] k3s[872]: I0923 16:12:53.942767 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.079719] k3s[872]: I0923 16:12:53.942806 872 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 26.082537] k3s[872]: I0923 16:12:53.942929 872 resource_quota_controller.go:297] "Starting resource quota controller" machine # [ 26.083877] k3s[872]: I0923 16:12:53.942942 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.085183] k3s[872]: I0923 16:12:53.943049 872 garbagecollector.go:141] "Starting controller" controller="garbagecollector" machine # [ 26.086220] k3s[872]: I0923 16:12:53.943076 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.087858] k3s[872]: I0923 16:12:53.943115 872 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 26.089770] k3s[872]: I0923 16:12:53.943183 872 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 26.092174] k3s[872]: I0923 16:12:53.943239 872 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 26.094891] k3s[872]: I0923 16:12:53.943453 872 resource_quota_monitor.go:309] "QuotaMonitor running" machine # [ 26.096029] k3s[872]: I0923 16:12:53.943595 872 graph_builder.go:386] "Running" component="GraphBuilder" machine # [ 26.097141] k3s[872]: time="2026-09-23T16:12:53Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=ApplyingManifest type=Normal machine # [ 26.100593] k3s[872]: I0923 16:12:54.016765 872 shared_informer.go:377] "Caches are synced" machine # [ 26.101885] k3s[872]: I0923 16:12:54.016910 872 shared_informer.go:377] "Caches are synced" machine # [ 26.102769] k3s[872]: I0923 16:12:54.017578 872 shared_informer.go:377] "Caches are synced" machine # [ 26.145530] k3s[872]: I0923 16:12:54.063819 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.149050] k3s[872]: I0923 16:12:54.065850 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.492566] k3s[872]: I0923 16:12:54.410834 872 controller.go:667] quota admission added evaluator for: helmcharts.helm.cattle.io machine # [ 26.497463] k3s[872]: time="2026-09-23T16:12:54Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=AppliedManifest type=Normal machine # [ 26.506236] k3s[872]: time="2026-09-23T16:12:54Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=ApplyingManifest type=Normal machine # [ 26.519412] k3s[872]: time="2026-09-23T16:12:54Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 26.519769] k3s[872]: I0923 16:12:54.437824 872 shared_informer.go:377] "Caches are synced" machine # [ 26.520493] k3s[872]: I0923 16:12:54.438917 872 shared_informer.go:377] "Caches are synced" machine # [ 26.520818] k3s[872]: I0923 16:12:54.439243 872 shared_informer.go:377] "Caches are synced" machine # [ 26.521551] k3s[872]: I0923 16:12:54.439974 872 shared_informer.go:377] "Caches are synced" machine # [ 26.522493] k3s[872]: I0923 16:12:54.440917 872 shared_informer.go:377] "Caches are synced" machine # [ 26.523113] k3s[872]: I0923 16:12:54.441536 872 shared_informer.go:377] "Caches are synced" machine # [ 26.523681] k3s[872]: I0923 16:12:54.442095 872 shared_informer.go:377] "Caches are synced" machine # [ 26.524210] k3s[872]: I0923 16:12:54.442325 872 shared_informer.go:377] "Caches are synced" machine # [ 26.524723] k3s[872]: I0923 16:12:54.442358 872 shared_informer.go:377] "Caches are synced" machine # [ 26.525369] k3s[872]: I0923 16:12:54.442399 872 range_allocator.go:177] "Sending events to api server" machine # [ 26.525946] k3s[872]: I0923 16:12:54.442433 872 range_allocator.go:181] "Starting range CIDR allocator" machine # [ 26.527469] k3s[872]: I0923 16:12:54.442444 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.528034] k3s[872]: I0923 16:12:54.442480 872 shared_informer.go:377] "Caches are synced" machine # [ 26.528475] k3s[872]: I0923 16:12:54.442552 872 shared_informer.go:377] "Caches are synced" machine # [ 26.529111] k3s[872]: I0923 16:12:54.441603 872 shared_informer.go:377] "Caches are synced" machine # [ 26.529593] k3s[872]: I0923 16:12:54.441636 872 shared_informer.go:377] "Caches are synced" machine # [ 26.533122] k3s[872]: I0923 16:12:54.441658 872 shared_informer.go:377] "Caches are synced" machine # [ 26.533701] k3s[872]: I0923 16:12:54.441983 872 shared_informer.go:377] "Caches are synced" machine # [ 26.534384] k3s[872]: I0923 16:12:54.442011 872 shared_informer.go:377] "Caches are synced" machine # [ 26.534931] k3s[872]: I0923 16:12:54.442044 872 shared_informer.go:377] "Caches are synced" machine # [ 26.535598] k3s[872]: I0923 16:12:54.442068 872 shared_informer.go:377] "Caches are synced" machine # [ 26.536196] k3s[872]: I0923 16:12:54.444741 872 shared_informer.go:377] "Caches are synced" machine # [ 26.536698] k3s[872]: I0923 16:12:54.444785 872 shared_informer.go:377] "Caches are synced" machine # [ 26.537409] k3s[872]: I0923 16:12:54.444901 872 shared_informer.go:377] "Caches are synced" machine # [ 26.537934] k3s[872]: I0923 16:12:54.444940 872 shared_informer.go:377] "Caches are synced" machine # [ 26.538589] k3s[872]: I0923 16:12:54.444987 872 shared_informer.go:377] "Caches are synced" machine # [ 26.539259] k3s[872]: I0923 16:12:54.445024 872 shared_informer.go:377] "Caches are synced" machine # [ 26.539992] k3s[872]: I0923 16:12:54.445057 872 shared_informer.go:377] "Caches are synced" machine # [ 26.540442] k3s[872]: I0923 16:12:54.445212 872 shared_informer.go:377] "Caches are synced" machine # [ 26.540979] k3s[872]: I0923 16:12:54.445264 872 shared_informer.go:377] "Caches are synced" machine # [ 26.541589] k3s[872]: I0923 16:12:54.445321 872 shared_informer.go:377] "Caches are synced" machine # [ 26.541971] k3s[872]: I0923 16:12:54.445354 872 shared_informer.go:377] "Caches are synced" machine # [ 26.542993] k3s[872]: I0923 16:12:54.445392 872 shared_informer.go:377] "Caches are synced" machine # [ 26.543685] k3s[872]: I0923 16:12:54.445422 872 shared_informer.go:377] "Caches are synced" machine # [ 26.544425] k3s[872]: I0923 16:12:54.448850 872 shared_informer.go:377] "Caches are synced" machine # [ 26.544950] k3s[872]: I0923 16:12:54.448884 872 shared_informer.go:377] "Caches are synced" machine # [ 26.546081] k3s[872]: I0923 16:12:54.448918 872 shared_informer.go:377] "Caches are synced" machine # [ 26.546565] k3s[872]: I0923 16:12:54.441557 872 shared_informer.go:377] "Caches are synced" machine # [ 26.547114] k3s[872]: I0923 16:12:54.449477 872 shared_informer.go:377] "Caches are synced" machine # [ 26.547627] k3s[872]: I0923 16:12:54.450008 872 shared_informer.go:377] "Caches are synced" machine # [ 26.548198] k3s[872]: I0923 16:12:54.450046 872 shared_informer.go:377] "Caches are synced" machine # [ 26.548732] k3s[872]: I0923 16:12:54.450080 872 shared_informer.go:377] "Caches are synced" machine # [ 26.549452] k3s[872]: I0923 16:12:54.450113 872 shared_informer.go:377] "Caches are synced" machine # [ 26.549979] k3s[872]: I0923 16:12:54.450153 872 shared_informer.go:377] "Caches are synced" machine # [ 26.550649] k3s[872]: I0923 16:12:54.450202 872 shared_informer.go:377] "Caches are synced" machine # [ 26.551549] k3s[872]: I0923 16:12:54.464919 872 shared_informer.go:377] "Caches are synced" machine # [ 26.577071] k3s[872]: time="2026-09-23T16:12:54Z" level=info msg="Starting /v1, Kind=Pod controller" machine # [ 26.580280] k3s[872]: time="2026-09-23T16:12:54Z" level=info msg="Starting apps/v1, Kind=DaemonSet controller" machine # [ 26.585059] k3s[872]: time="2026-09-23T16:12:54Z" level=info msg="Starting discovery.k8s.io/v1, Kind=EndpointSlice controller" machine # [ 26.585345] k3s[872]: I0923 16:12:54.503040 872 controllermanager.go:329] Started "cloud-node-lifecycle-controller" machine # [ 26.585873] k3s[872]: I0923 16:12:54.503428 872 controllermanager.go:329] Started "service-lb-controller" machine # [ 26.586549] k3s[872]: W0923 16:12:54.503441 872 controllermanager.go:306] "node-route-controller" is disabled machine # [ 26.591054] k3s[872]: I0923 16:12:54.508851 872 controllermanager.go:329] Started "cloud-node-controller" machine # [ 26.591308] k3s[872]: I0923 16:12:54.509295 872 node_lifecycle_controller.go:112] Sending events to api server machine # [ 26.591874] k3s[872]: I0923 16:12:54.509447 872 node_controller.go:176] Sending events to api server. machine # [ 26.595049] k3s[872]: I0923 16:12:54.513428 872 controller.go:235] Starting service controller machine # [ 26.595460] k3s[872]: I0923 16:12:54.513478 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.598044] k3s[872]: I0923 16:12:54.515826 872 node_controller.go:185] Waiting for informer caches to sync machine # [ 26.603053] k3s[872]: time="2026-09-23T16:12:54Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Applying HelmChart from https://%{KUBERNETES_API}%/static/charts/nix-grpc-farm.tgz using Job kube-system/helm-install-nix-grpc-farm " object=kube-system/nix-grpc-farm reason=ApplyJob type=Normal machine # [ 26.619989] k3s[872]: time="2026-09-23T16:12:54Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Deferred node password secret validation complete" object=machine reason=NodePasswordValidationComplete type=Normal machine # [ 26.629761] k3s[872]: I0923 16:12:54.547841 872 controller.go:667] quota admission added evaluator for: jobs.batch machine # [ 26.662579] k3s[872]: I0923 16:12:54.580975 872 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 26.665870] k3s[872]: I0923 16:12:54.584262 872 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 26.726403] k3s[872]: time="2026-09-23T16:12:54Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 26.773092] k3s[872]: time="2026-09-23T16:12:54Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=AppliedManifest type=Normal machine # [ 26.781615] k3s[872]: time="2026-09-23T16:12:54Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=ApplyingManifest type=Normal machine # [ 26.795432] k3s[872]: I0923 16:12:54.713783 872 shared_informer.go:377] "Caches are synced" machine # [ 26.811378] k3s[872]: I0923 16:12:54.729750 872 controller.go:667] quota admission added evaluator for: replicasets.apps machine # [ 26.983408] k3s[872]: time="2026-09-23T16:12:54Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=AppliedManifest type=Normal machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 27.079944] k3s[872]: time="2026-09-23T16:12:54Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Resumed synced Job kube-system/helm-install-nix-grpc-farm" object=kube-system/nix-grpc-farm reason=ResumeJob type=Normal machine # [ 27.083620] k3s[872]: time="2026-09-23T16:12:55Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/traefik.yaml\"" object=kube-system/traefik reason=DeletingManifest type=Normal machine # [ 27.526124] k3s[872]: I0923 16:12:55.444379 872 shared_informer.go:377] "Caches are synced" machine # [ 27.526328] k3s[872]: I0923 16:12:55.444411 872 garbagecollector.go:166] "Garbage collector: all resource monitors have synced" machine # [ 27.526809] k3s[872]: I0923 16:12:55.444421 872 garbagecollector.go:169] "Proceeding to collect garbage" machine # [ 27.547652] k3s[872]: I0923 16:12:55.466006 872 shared_informer.go:377] "Caches are synced" machine # [ 27.726674] k3s[872]: time="2026-09-23T16:12:55Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 28.097315] postgres[1193]: [1193] ERROR: relation "goose_db_version" does not exist at character 36 machine # [ 28.098684] postgres[1193]: [1193] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC machine # [ 28.119521] niks3-server[1170]: 2026/09/23 16:12:56 OK 20241026095416_initial_model.sql (11.01ms) machine # [ 28.127051] niks3-server[1170]: 2026/09/23 16:12:56 OK 20251210153512_drop_unused_gin_index.sql (4.51ms) machine # [ 28.128977] niks3-server[1170]: 2026/09/23 16:12:56 OK 20251218171726_add_pins.sql (3.37ms) machine # [ 28.130690] niks3-server[1170]: 2026/09/23 16:12:56 OK 20260628120000_add_object_size_and_stats.sql (3.5ms) machine # [ 28.134315] niks3-server[1170]: 2026/09/23 16:12:56 OK 20260905000000_add_claims.sql (3.59ms) machine # [ 28.137758] niks3-server[1170]: 2026/09/23 16:12:56 OK 20260920000000_drop_claims.sql (3.09ms) machine # [ 28.141643] niks3-server[1170]: 2026/09/23 16:12:56 OK 20260923120000_add_pushes.sql (3.26ms) machine # [ 28.141947] niks3-server[1170]: 2026/09/23 16:12:56 goose: successfully migrated database to version: 20260923120000 machine # [ 28.150764] niks3-server[1170]: 2026/09/23 16:12:56 OK 1_commit_pending_closure.sql (5.97ms) machine # [ 28.154115] niks3-server[1170]: 2026/09/23 16:12:56 OK 2_object_stats_trigger.sql (3.39ms) machine # [ 28.157510] niks3-server[1170]: 2026/09/23 16:12:56 OK 3_commit_push.sql (2.19ms) machine # [ 28.158936] niks3-server[1170]: 2026/09/23 16:12:56 goose: up to current file version: 3 machine # [ 28.162172] niks3-server[1170]: 2026/09/23 16:12:56 INFO OIDC provider initialized name=kubernetes issuer=https://kubernetes.default.svc.cluster.local machine # [ 28.162650] niks3-server[1170]: 2026/09/23 16:12:56 INFO OIDC authentication enabled config=/nix/store/v0b0sqyzhrjsz48x3klf7b7vl89apzs0-niks3-oidc.json machine # [ 28.163726] niks3-server[1170]: 2026/09/23 16:12:56 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key machine # [ 28.199081] niks3-server[1170]: 2026/09/23 16:12:56 INFO Read proxy enabled — serving cache objects from S3 machine # [ 28.199638] niks3-server[1170]: 2026/09/23 16:12:56 INFO Using socket-activated listener address=0.0.0.0:5751 machine # [ 28.200253] niks3-server[1170]: 2026/09/23 16:12:56 INFO systemd watchdog enabled interval=15s machine # [ 28.201119] niks3-server[1170]: 2026/09/23 16:12:56 INFO Starting HTTP server address=0.0.0.0:5751 machine # [ 28.205128] systemd[1]: Started niks3 server. machine # [ 28.205962] systemd[1]: Reached target Multi-User System. machine # [ 28.206855] systemd[1]: Startup finished in 1.204s (kernel) + 3.698s (initrd) + 23.302s (userspace) = 28.204s. machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 28.726688] k3s[872]: time="2026-09-23T16:12:56Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 29.044545] k3s[872]: time="2026-09-23T16:12:56Z" level=info msg="Imported docker.io/library/nix-grpc-farm-client:0.1.0-beta.4" machine # [ 29.048300] k3s[872]: time="2026-09-23T16:12:56Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-client@sha256:63a3367de68ed990f563a46f255ca04c327d595cf071c3ca54385b270e42d17a" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 29.509358] k3s[872]: time="2026-09-23T16:12:57Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-client.tar in 7.341000881s" machine # [ 29.509960] k3s[872]: time="2026-09-23T16:12:57Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-lb.tar" machine # [ 29.728459] k3s[872]: time="2026-09-23T16:12:57Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 30.490250] k3s[872]: time="2026-09-23T16:12:58Z" level=info msg="Started tunnel to 10.0.2.15:6443" machine # [ 30.490771] k3s[872]: time="2026-09-23T16:12:58Z" level=info msg="Stopped tunnel to 127.0.0.1:6443" machine # [ 30.491568] k3s[872]: time="2026-09-23T16:12:58Z" level=info msg="Connecting to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 30.492592] k3s[872]: time="2026-09-23T16:12:58Z" level=info msg="Proxy done" err="context canceled" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 30.493290] k3s[872]: time="2026-09-23T16:12:58Z" level=info msg="error in remotedialer server [400]: websocket: close 1006 (abnormal closure): unexpected EOF" machine # [ 30.494023] k3s[872]: time="2026-09-23T16:12:58Z" level=info msg="Handling backend connection request [machine]" machine # [ 30.494795] k3s[872]: time="2026-09-23T16:12:58Z" level=info msg="Connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 30.495716] k3s[872]: time="2026-09-23T16:12:58Z" level=info msg="Remotedialer connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 30.725923] k3s[872]: time="2026-09-23T16:12:58Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 31.084810] k3s[872]: time="2026-09-23T16:12:59Z" level=info msg="Imported docker.io/library/nix-grpc-farm-lb:0.1.0-beta.4" machine # [ 31.087928] k3s[872]: time="2026-09-23T16:12:59Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-lb@sha256:18ee6724be589622e1aee9d13c5121e7b2c992ca636c935ade90c66423e18f37" machine # [ 31.135677] k3s[872]: time="2026-09-23T16:12:59Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-lb.tar in 1.625867533s" machine # [ 31.137801] k3s[872]: time="2026-09-23T16:12:59Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm.tar" machine # [ 31.469548] k3s[872]: time="2026-09-23T16:12:59Z" level=info msg="Running kubelet --cloud-provider=external --config-dir=/var/lib/rancher/k3s/agent/etc/kubelet.conf.d --containerd=/run/k3s/containerd/containerd.sock --eviction-hard=nodefs.available<1%,imagefs.available<1% --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubelet.kubeconfig --node-ip=10.0.2.15,fec0::7fba:c9bd:21bc:ded1 --node-labels= --read-only-port=0" machine # [ 31.482110] k3s[872]: Flag --containerd has been deprecated, This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed. machine # [ 31.488245] k3s[872]: I0923 16:12:59.402202 872 server.go:521] "Kubelet version" kubeletVersion="v1.35.8+k3s1" machine # [ 31.491231] k3s[872]: I0923 16:12:59.402254 872 server.go:523] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 31.494496] k3s[872]: I0923 16:12:59.402316 872 watchdog_linux.go:95] "Systemd watchdog is not enabled" machine # [ 31.497368] k3s[872]: I0923 16:12:59.402343 872 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." machine # [ 31.501672] k3s[872]: I0923 16:12:59.404918 872 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/agent/client-ca.crt" machine # [ 31.505834] k3s[872]: I0923 16:12:59.412375 872 server.go:1414] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" machine # [ 31.507952] k3s[872]: I0923 16:12:59.420516 872 server.go:771] "--cgroups-per-qos enabled, but --cgroup-root was not specified. Defaulting to /" machine # [ 31.509823] k3s[872]: I0923 16:12:59.420575 872 server.go:832] "NoSwap is set due to memorySwapBehavior not specified" memorySwapBehavior="" FailSwapOn=false machine # [ 31.511804] k3s[872]: I0923 16:12:59.421024 872 container_manager_linux.go:272] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] machine # [ 31.513687] k3s[872]: I0923 16:12:59.421065 872 container_manager_linux.go:277] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"machine","RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} machine # [ 31.527632] k3s[872]: I0923 16:12:59.421413 872 topology_manager.go:143] "Creating topology manager with none policy" machine # [ 31.529230] k3s[872]: I0923 16:12:59.421444 872 container_manager_linux.go:308] "Creating device plugin manager" machine # [ 31.530865] k3s[872]: I0923 16:12:59.421637 872 container_manager_linux.go:317] "Creating Dynamic Resource Allocation (DRA) manager" machine # [ 31.532732] k3s[872]: I0923 16:12:59.426924 872 state_mem.go:41] "Initialized" logger="CPUManager state memory" machine # [ 31.534259] k3s[872]: I0923 16:12:59.427333 872 kubelet.go:482] "Attempting to sync node with API server" machine # [ 31.535951] k3s[872]: I0923 16:12:59.427365 872 kubelet.go:383] "Adding static pod path" path="/var/lib/rancher/k3s/agent/pod-manifests" machine # [ 31.537886] k3s[872]: I0923 16:12:59.427423 872 kubelet.go:394] "Adding apiserver pod source" machine # [ 31.544738] k3s[872]: I0923 16:12:59.427505 872 apiserver.go:42] "Waiting for node sync before watching apiserver pods" machine # [ 31.546611] k3s[872]: I0923 16:12:59.430401 872 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="containerd" version="2.2.7-k3s1" apiVersion="v1" machine # [ 31.548852] k3s[872]: I0923 16:12:59.431400 872 kubelet.go:945] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" machine # [ 31.551628] k3s[872]: I0923 16:12:59.431446 872 kubelet.go:972] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" machine # [ 31.554482] k3s[872]: I0923 16:12:59.442896 872 server.go:1252] "Started kubelet" machine # [ 31.555754] k3s[872]: I0923 16:12:59.442980 872 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 machine # [ 31.557402] k3s[872]: I0923 16:12:59.443262 872 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 machine # [ 31.559302] k3s[872]: I0923 16:12:59.443311 872 server_v1.go:49] "podresources" method="list" useActivePods=true machine # [ 31.560980] k3s[872]: I0923 16:12:59.443510 872 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" machine # [ 31.563165] k3s[872]: I0923 16:12:59.444215 872 server.go:317] "Adding debug handlers to kubelet server" machine # [ 31.564691] k3s[872]: I0923 16:12:59.444988 872 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" machine # [ 31.566233] k3s[872]: I0923 16:12:59.445314 872 volume_manager.go:311] "Starting Kubelet Volume Manager" machine # [ 31.567833] k3s[872]: I0923 16:12:59.445390 872 dynamic_serving_content.go:135] "Starting controller" name="kubelet-server-cert-files::/var/lib/rancher/k3s/agent/serving-kubelet.crt::/var/lib/rancher/k3s/agent/serving-kubelet.key" machine # [ 31.570918] k3s[872]: I0923 16:12:59.445524 872 desired_state_of_world_populator.go:146] "Desired state populator starts to run" machine # [ 31.572697] k3s[872]: I0923 16:12:59.445590 872 reconciler.go:29] "Reconciler: start to sync state" machine # [ 31.574207] k3s[872]: E0923 16:12:59.446023 872 kubelet_node_status.go:392] "Error getting the current node from lister" err="node \"machine\" not found" machine # [ 31.576331] k3s[872]: I0923 16:12:59.449145 872 factory.go:223] Registration of the systemd container factory successfully machine # [ 31.578096] k3s[872]: I0923 16:12:59.449251 872 factory.go:221] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory machine # [ 31.580910] k3s[872]: I0923 16:12:59.452781 872 factory.go:223] Registration of the containerd container factory successfully machine # [ 31.582521] k3s[872]: E0923 16:12:59.453568 872 kubelet.go:1661] "Image garbage collection failed once. Stats initialization may not have completed yet" err="invalid capacity 0 on image filesystem" machine # [ 31.585046] k3s[872]: E0923 16:12:59.454220 872 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"machine\" not found" node="machine" machine # [ 31.587278] k3s[872]: I0923 16:12:59.466536 872 cpu_manager.go:225] "Starting" policy="none" machine # [ 31.588507] k3s[872]: I0923 16:12:59.466551 872 cpu_manager.go:226] "Reconciling" reconcilePeriod="10s" machine # [ 31.589916] k3s[872]: I0923 16:12:59.466576 872 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" machine # [ 31.591597] k3s[872]: I0923 16:12:59.471566 872 policy_none.go:50] "Start" machine # [ 31.592671] k3s[872]: I0923 16:12:59.471590 872 memory_manager.go:187] "Starting memorymanager" policy="None" machine # [ 31.594170] k3s[872]: I0923 16:12:59.471670 872 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" machine # [ 31.596076] k3s[872]: I0923 16:12:59.477306 872 policy_none.go:44] "Start" machine # [ 31.597409] systemd[1]: Created slice libcontainer container kubepods.slice. machine # [ 31.604639] systemd[1]: Created slice libcontainer container kubepods-burstable.slice. machine # [ 31.608113] systemd[1]: Created slice libcontainer container kubepods-besteffort.slice. machine # [ 31.615020] k3s[872]: E0923 16:12:59.533377 872 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" machine # [ 31.615868] k3s[872]: I0923 16:12:59.533544 872 eviction_manager.go:194] "Eviction manager: starting control loop" machine # [ 31.616785] k3s[872]: I0923 16:12:59.533572 872 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" machine # [ 31.617745] k3s[872]: I0923 16:12:59.534408 872 plugin_manager.go:121] "Starting Kubelet Plugin Manager" machine # [ 31.619626] k3s[872]: E0923 16:12:59.537819 872 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="no imagefs label for configured runtime" machine # [ 31.620637] k3s[872]: E0923 16:12:59.537860 872 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"machine\" not found" machine # [ 31.655271] k3s[872]: I0923 16:12:59.573643 872 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" machine # [ 31.662336] k3s[872]: I0923 16:12:59.580631 872 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" machine # [ 31.664127] k3s[872]: I0923 16:12:59.580667 872 status_manager.go:249] "Starting to sync pod status with apiserver" machine # [ 31.665699] k3s[872]: I0923 16:12:59.580707 872 kubelet.go:2506] "Starting kubelet main sync loop" machine # [ 31.666979] k3s[872]: E0923 16:12:59.580762 872 kubelet.go:2530] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" machine # [ 31.717738] k3s[872]: I0923 16:12:59.636116 872 kubelet_node_status.go:74] "Attempting to register node" node="machine" machine # [ 31.728908] k3s[872]: I0923 16:12:59.645547 872 kubelet_node_status.go:77] "Successfully registered node" node="machine" machine # [ 31.730475] k3s[872]: E0923 16:12:59.645586 872 kubelet_node_status.go:474] "Error updating node status, will retry" err="error getting node \"machine\": node \"machine\" not found" machine # [ 31.733494] k3s[872]: time="2026-09-23T16:12:59Z" level=info msg="Adding node OwnerReference to node-password secret machine.node-password.k3s" machine # [ 31.739062] k3s[872]: I0923 16:12:59.656092 872 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"machine\" does not exist" machine # [ 31.742551] k3s[872]: I0923 16:12:59.656326 872 node_controller.go:429] Initializing node machine with cloud provider machine # [ 31.744121] k3s[872]: I0923 16:12:59.656382 872 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 31.746530] k3s[872]: E0923 16:12:59.656402 872 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 31.749336] k3s[872]: time="2026-09-23T16:12:59Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 31.751128] k3s[872]: I0923 16:12:59.666801 872 node_controller.go:429] Initializing node machine with cloud provider machine # [ 31.752795] k3s[872]: I0923 16:12:59.666862 872 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 31.755067] k3s[872]: E0923 16:12:59.666884 872 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 31.758036] k3s[872]: I0923 16:12:59.669304 872 node_controller.go:429] Initializing node machine with cloud provider machine # [ 31.759618] k3s[872]: time="2026-09-23T16:12:59Z" level=info msg="Annotations and labels have been set successfully on node: machine" machine # [ 31.761370] k3s[872]: time="2026-09-23T16:12:59Z" level=info msg="Starting flannel with backend vxlan" machine # [ 31.762743] k3s[872]: I0923 16:12:59.678018 872 range_allocator.go:433] "Set node PodCIDR" node="machine" podCIDRs=["10.42.0.0/24"] machine # [ 31.764371] k3s[872]: time="2026-09-23T16:12:59Z" level=info msg="Synced coredns NodeHosts entries for machine" machine # [ 31.779806] k3s[872]: E0923 16:12:59.698186 872 range_allocator.go:438] "Failed to update node PodCIDR after multiple attempts" err="failed to patch node CIDR: Node \"machine\" is invalid: [spec.podCIDRs: Invalid value: [\"10.42.1.0/24\",\"10.42.0.0/24\"]: may specify no more than one CIDR for each IP family, spec.podCIDRs: Forbidden: node updates may not change podCIDR except from \"\" to valid]" node="machine" podCIDRs=["10.42.1.0/24"] machine # [ 31.784927] k3s[872]: E0923 16:12:59.702542 872 range_allocator.go:444] "CIDR assignment for node failed. Releasing allocated CIDR" err="failed to patch node CIDR: Node \"machine\" is invalid: [spec.podCIDRs: Invalid value: [\"10.42.1.0/24\",\"10.42.0.0/24\"]: may specify no more than one CIDR for each IP family, spec.podCIDRs: Forbidden: node updates may not change podCIDR except from \"\" to valid]" node="machine" machine # [ 31.789771] k3s[872]: E0923 16:12:59.702621 872 range_allocator.go:257] "Error processing node work item" err="error syncing 'machine': failed to patch node CIDR: Node \"machine\" is invalid: [spec.podCIDRs: Invalid value: [\"10.42.1.0/24\",\"10.42.0.0/24\"]: may specify no more than one CIDR for each IP family, spec.podCIDRs: Forbidden: node updates may not change podCIDR except from \"\" to valid], requeuing" logger="UnhandledError" machine # [ 31.795030] k3s[872]: time="2026-09-23T16:12:59Z" level=info msg="Flannel found PodCIDR assigned for node machine" machine # [ 31.796576] k3s[872]: time="2026-09-23T16:12:59Z" level=info msg="The interface eth0 with ipv4 address 10.0.2.15 will be used by flannel" machine # [ 31.798186] k3s[872]: I0923 16:12:59.703962 872 kube.go:139] Waiting 10m0s for node controller to sync machine # [ 31.799459] k3s[872]: I0923 16:12:59.704032 872 kube.go:537] Starting kube subnet manager machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 31.833554] k3s[872]: I0923 16:12:59.751919 872 node_controller.go:474] Successfully initialized node machine with cloud provider machine # [ 31.835301] k3s[872]: I0923 16:12:59.752047 872 event.go:389] "Event occurred" object="machine" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="Synced" message="Node synced successfully" machine # [ 31.838892] k3s[872]: I0923 16:12:59.757286 872 server.go:173] "Starting Kubernetes Scheduler" version="v1.35.8+k3s1" machine # [ 31.840479] k3s[872]: I0923 16:12:59.757313 872 server.go:175] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 31.842071] k3s[872]: I0923 16:12:59.760230 872 secure_serving.go:211] Serving securely on 127.0.0.1:10259 machine # [ 31.843528] k3s[872]: I0923 16:12:59.760345 872 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 31.845184] k3s[872]: I0923 16:12:59.760361 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.846589] k3s[872]: I0923 16:12:59.760401 872 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 31.849683] k3s[872]: I0923 16:12:59.760557 872 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 31.851168] k3s[872]: I0923 16:12:59.761348 872 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 31.853553] k3s[872]: I0923 16:12:59.761366 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.854903] k3s[872]: I0923 16:12:59.761393 872 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 31.857324] k3s[872]: I0923 16:12:59.761413 872 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.858993] k3s[872]: I0923 16:12:59.773426 872 kuberuntime_manager.go:2095] "Updating runtime config through cri with podcidr" CIDR="10.42.0.0/24" machine # [ 31.859344] k3s[872]: I0923 16:12:59.774224 872 kubelet_network.go:47] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.42.0.0/24" machine # [ 31.959547] k3s[872]: I0923 16:12:59.877886 872 kubelet_node_status.go:427] "Fast updating node status as it just became ready" machine # [ 31.969174] k3s[872]: I0923 16:12:59.887529 872 topologycache.go:237] "Can't get CPU or zone information for node" node="machine" machine # [ 32.042741] k3s[872]: I0923 16:12:59.960901 872 shared_informer.go:377] "Caches are synced" machine # [ 32.045362] k3s[872]: I0923 16:12:59.961701 872 shared_informer.go:377] "Caches are synced" machine # [ 32.047961] k3s[872]: I0923 16:12:59.961832 872 shared_informer.go:377] "Caches are synced" machine # [ 32.428579] k3s[872]: time="2026-09-23T16:13:00Z" level=info msg="Tunnel authorizer set Kubelet Port 0.0.0.0:10250" machine # [ 32.509947] k3s[872]: I0923 16:13:00.428193 872 apiserver.go:52] "Watching apiserver" machine # [ 32.546432] systemd[1]: Created slice libcontainer container kubepods-burstable-podfab3f1fd_6363_4739_b4f1_a576314de9a2.slice. machine # [ 32.568481] systemd[1]: Created slice libcontainer container kubepods-burstable-pod4ac30177_306b_4491_9fc7_396586bd4ce8.slice. machine # [ 32.628063] k3s[872]: I0923 16:13:00.546372 872 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" machine # [ 32.632394] k3s[872]: I0923 16:13:00.550563 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fab3f1fd-6363-4739-b4f1-a576314de9a2-config-volume\") pod \"coredns-c5fdd76cf-vln95\" (UID: \"fab3f1fd-6363-4739-b4f1-a576314de9a2\") " pod="kube-system/coredns-c5fdd76cf-vln95" machine # [ 32.632708] k3s[872]: I0923 16:13:00.550651 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-config-volume\" (UniqueName: \"kubernetes.io/configmap/fab3f1fd-6363-4739-b4f1-a576314de9a2-custom-config-volume\") pod \"coredns-c5fdd76cf-vln95\" (UID: \"fab3f1fd-6363-4739-b4f1-a576314de9a2\") " pod="kube-system/coredns-c5fdd76cf-vln95" machine # [ 32.633584] k3s[872]: I0923 16:13:00.550711 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"content\" (UniqueName: \"kubernetes.io/configmap/4ac30177-306b-4491-9fc7-396586bd4ce8-content\") pod \"helm-install-nix-grpc-farm-g9cnw\" (UID: \"4ac30177-306b-4491-9fc7-396586bd4ce8\") " pod="kube-system/helm-install-nix-grpc-farm-g9cnw" machine # [ 32.634488] k3s[872]: I0923 16:13:00.550761 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgph7\" (UniqueName: \"kubernetes.io/projected/4ac30177-306b-4491-9fc7-396586bd4ce8-kube-api-access-rgph7\") pod \"helm-install-nix-grpc-farm-g9cnw\" (UID: \"4ac30177-306b-4491-9fc7-396586bd4ce8\") " pod="kube-system/helm-install-nix-grpc-farm-g9cnw" machine # [ 32.651082] k3s[872]: I0923 16:13:00.550880 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hngj4\" (UniqueName: \"kubernetes.io/projected/fab3f1fd-6363-4739-b4f1-a576314de9a2-kube-api-access-hngj4\") pod \"coredns-c5fdd76cf-vln95\" (UID: \"fab3f1fd-6363-4739-b4f1-a576314de9a2\") " pod="kube-system/coredns-c5fdd76cf-vln95" machine # [ 32.651767] k3s[872]: I0923 16:13:00.569427 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/4ac30177-306b-4491-9fc7-396586bd4ce8-klipper-helm\") pod \"helm-install-nix-grpc-farm-g9cnw\" (UID: \"4ac30177-306b-4491-9fc7-396586bd4ce8\") " pod="kube-system/helm-install-nix-grpc-farm-g9cnw" machine # [ 32.652487] k3s[872]: I0923 16:13:00.569494 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ac30177-306b-4491-9fc7-396586bd4ce8-klipper-cache\") pod \"helm-install-nix-grpc-farm-g9cnw\" (UID: \"4ac30177-306b-4491-9fc7-396586bd4ce8\") " pod="kube-system/helm-install-nix-grpc-farm-g9cnw" machine # [ 32.653336] k3s[872]: I0923 16:13:00.569526 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/4ac30177-306b-4491-9fc7-396586bd4ce8-klipper-config\") pod \"helm-install-nix-grpc-farm-g9cnw\" (UID: \"4ac30177-306b-4491-9fc7-396586bd4ce8\") " pod="kube-system/helm-install-nix-grpc-farm-g9cnw" machine # [ 32.654125] k3s[872]: I0923 16:13:00.569611 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ac30177-306b-4491-9fc7-396586bd4ce8-tmp\") pod \"helm-install-nix-grpc-farm-g9cnw\" (UID: \"4ac30177-306b-4491-9fc7-396586bd4ce8\") " pod="kube-system/helm-install-nix-grpc-farm-g9cnw" machine # [ 32.654938] k3s[872]: I0923 16:13:00.569755 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"values\" (UniqueName: \"kubernetes.io/projected/4ac30177-306b-4491-9fc7-396586bd4ce8-values\") pod \"helm-install-nix-grpc-farm-g9cnw\" (UID: \"4ac30177-306b-4491-9fc7-396586bd4ce8\") " pod="kube-system/helm-install-nix-grpc-farm-g9cnw" machine # [ 32.671726] k3s[872]: I0923 16:13:00.590027 872 server.go:218] "Successfully retrieved NodeIPs" NodeIPs=["10.0.2.15","fec0::7fba:c9bd:21bc:ded1"] machine # [ 32.672700] k3s[872]: E0923 16:13:00.590144 872 server.go:255] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`" machine # [ 32.699493] k3s[872]: I0923 16:13:00.617490 872 server.go:264] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4" machine # [ 32.699942] k3s[872]: I0923 16:13:00.617555 872 server_linux.go:136] "Using iptables Proxier" machine # [ 32.718731] k3s[872]: I0923 16:13:00.637081 872 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4" machine # [ 32.729155] k3s[872]: time="2026-09-23T16:13:00Z" level=info msg="Labels and annotations have been set successfully on node: machine" machine # [ 32.735512] k3s[872]: I0923 16:13:00.653852 872 server.go:529] "Version info" version="v1.35.8+k3s1" machine # [ 32.735912] k3s[872]: I0923 16:13:00.653880 872 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 32.736555] k3s[872]: I0923 16:13:00.654938 872 config.go:200] "Starting service config controller" machine # [ 32.737081] k3s[872]: I0923 16:13:00.654964 872 shared_informer.go:349] "Waiting for caches to sync" controller="service config" machine # [ 32.737581] k3s[872]: I0923 16:13:00.655008 872 config.go:106] "Starting endpoint slice config controller" machine # [ 32.741082] k3s[872]: I0923 16:13:00.655021 872 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config" machine # [ 32.741799] k3s[872]: I0923 16:13:00.655052 872 config.go:403] "Starting serviceCIDR config controller" machine # [ 32.742509] k3s[872]: I0923 16:13:00.655064 872 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config" machine # [ 32.743111] k3s[872]: I0923 16:13:00.655789 872 config.go:309] "Starting node config controller" machine # [ 32.743654] k3s[872]: I0923 16:13:00.655804 872 shared_informer.go:349] "Waiting for caches to sync" controller="node config" machine # [ 32.744212] k3s[872]: I0923 16:13:00.655815 872 shared_informer.go:356] "Caches are synced" controller="node config" machine # [ 32.786616] k3s[872]: I0923 16:13:00.704981 872 kube.go:163] Node controller sync successful machine # [ 32.786788] k3s[872]: I0923 16:13:00.705062 872 vxlan.go:128] VXLAN config: VNI=1 Port=0 GBP=false Learning=false DirectRouting=false machine # [ 32.789547] k3s[872]: I0923 16:13:00.707928 872 kube.go:704] List of node(machine) annotations: map[string]string{"alpha.kubernetes.io/provided-node-ip":"10.0.2.15,fec0::7fba:c9bd:21bc:ded1", "k3s.io/hostname":"machine", "k3s.io/internal-ip":"10.0.2.15,fec0::7fba:c9bd:21bc:ded1", "k3s.io/node-args":"[\"server\",\"--disable\",\"traefik\",\"--disable\",\"metrics-server\",\"--disable\",\"local-storage\",\"--kubelet-arg\",\"eviction-hard=nodefs.available\\u003c1%,imagefs.available\\u003c1%\"]", "k3s.io/node-config-hash":"EFXPOZ7ZWHRCLFNW4X4ZDPFQMSAOP3BLEIN2VE47TDRKQ4UIWKUQ====", "k3s.io/node-env":"{}", "node.alpha.kubernetes.io/ttl":"0", "volumes.kubernetes.io/controller-managed-attach-detach":"true"} machine # [ 32.813467] (udev-worker)[1232]: Network interface NamePolicy= disabled on kernel command line. machine # [ 32.819568] k3s[872]: I0923 16:13:00.737914 872 iptables.go:50] Starting flannel in iptables mode... machine # [ 32.821251] k3s[872]: time="2026-09-23T16:13:00Z" level=warning msg="no subnet found for key: FLANNEL_NETWORK in file: /run/flannel/subnet.env" machine # [ 32.823192] k3s[872]: time="2026-09-23T16:13:00Z" level=warning msg="no subnet found for key: FLANNEL_SUBNET in file: /run/flannel/subnet.env" machine # [ 32.823463] k3s[872]: time="2026-09-23T16:13:00Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_NETWORK in file: /run/flannel/subnet.env" machine # [ 32.824074] k3s[872]: time="2026-09-23T16:13:00Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_SUBNET in file: /run/flannel/subnet.env" machine # [ 32.824600] k3s[872]: I0923 16:13:00.738025 872 iptables.go:101] Current network or subnet (10.42.0.0/16, 10.42.0.0/24) is not equal to previous one (0.0.0.0/0, 0.0.0.0/0), trying to recycle old iptables rules machine # [ 32.825185] k3s[872]: I0923 16:13:00.738960 872 kube.go:558] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.42.0.0/24] machine # [ 32.844250] dhcpcd[679]: flannel.1: IAID 47:25:66:80 machine # [ 32.844821] dhcpcd[679]: flannel.1: adding address fe80::1ccb:47ff:fe25:6680 machine # [ 32.884434] k3s[872]: I0923 16:13:00.802803 872 iptables.go:111] Setting up masking rules machine # [ 32.901695] k3s[872]: I0923 16:13:00.820042 872 iptables.go:212] Changing default FORWARD chain policy to ACCEPT machine # [ 32.925187] k3s[872]: time="2026-09-23T16:13:00Z" level=info msg="Wrote flannel subnet file to /run/flannel/subnet.env" machine # [ 32.925512] k3s[872]: time="2026-09-23T16:13:00Z" level=info msg="Running flannel backend" machine # [ 32.926131] k3s[872]: I0923 16:13:00.843624 872 vxlan_network.go:68] watching for new subnet leases machine # [ 32.926558] k3s[872]: I0923 16:13:00.843882 872 vxlan_network.go:115] starting vxlan device watcher machine # [ 32.980136] k3s[872]: E0923 16:13:00.898369 872 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"414282d7ef2a9cd217dea7e9c1da22c98637be4302a81b2e7f11a2d712e68948\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" machine # [ 32.980305] k3s[872]: E0923 16:13:00.898502 872 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"414282d7ef2a9cd217dea7e9c1da22c98637be4302a81b2e7f11a2d712e68948\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-c5fdd76cf-vln95" machine # [ 32.980868] k3s[872]: E0923 16:13:00.898531 872 kuberuntime_manager.go:1568] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"414282d7ef2a9cd217dea7e9c1da22c98637be4302a81b2e7f11a2d712e68948\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-c5fdd76cf-vln95" machine # [ 32.981532] k3s[872]: E0923 16:13:00.898652 872 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-c5fdd76cf-vln95_kube-system(fab3f1fd-6363-4739-b4f1-a576314de9a2)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-c5fdd76cf-vln95_kube-system(fab3f1fd-6363-4739-b4f1-a576314de9a2)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"414282d7ef2a9cd217dea7e9c1da22c98637be4302a81b2e7f11a2d712e68948\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-c5fdd76cf-vln95" podUID="fab3f1fd-6363-4739-b4f1-a576314de9a2" machine # [ 32.991437] k3s[872]: E0923 16:13:00.909739 872 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e38d3c65fcbc2442776d355a9faa0b30099b5e2018874459476b28b77ebdec6d\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" machine # [ 32.992445] k3s[872]: E0923 16:13:00.909777 872 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e38d3c65fcbc2442776d355a9faa0b30099b5e2018874459476b28b77ebdec6d\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/helm-install-nix-grpc-farm-g9cnw" machine # [ 32.993035] k3s[872]: E0923 16:13:00.909796 872 kuberuntime_manager.go:1568] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"e38d3c65fcbc2442776d355a9faa0b30099b5e2018874459476b28b77ebdec6d\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/helm-install-nix-grpc-farm-g9cnw" machine # [ 32.993526] k3s[872]: E0923 16:13:00.909842 872 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"helm-install-nix-grpc-farm-g9cnw_kube-system(4ac30177-306b-4491-9fc7-396586bd4ce8)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"helm-install-nix-grpc-farm-g9cnw_kube-system(4ac30177-306b-4491-9fc7-396586bd4ce8)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"e38d3c65fcbc2442776d355a9faa0b30099b5e2018874459476b28b77ebdec6d\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/helm-install-nix-grpc-farm-g9cnw" podUID="4ac30177-306b-4491-9fc7-396586bd4ce8" machine # [ 33.025689] k3s[872]: I0923 16:13:00.944042 872 iptables.go:358] bootstrap done machine # [ 33.037268] k3s[872]: I0923 16:13:00.955322 872 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config" machine # [ 33.037827] k3s[872]: I0923 16:13:00.955365 872 shared_informer.go:356] "Caches are synced" controller="service config" machine # [ 33.039362] k3s[872]: I0923 16:13:00.955376 872 shared_informer.go:356] "Caches are synced" controller="endpoint slice config" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 33.100926] k3s[872]: I0923 16:13:01.019279 872 iptables.go:358] bootstrap done machine # [ 33.682318] dhcpcd[679]: flannel.1: soliciting a DHCP lease machine # [ 33.761216] systemd[1]: run-netns-cni\x2d458369eb\x2d5a05\x2dcfde\x2d9542\x2deae090711125.mount: Deactivated successfully. machine # [ 33.938161] k3s[872]: time="2026-09-23T16:13:01Z" level=info msg="Starting network policy controller version v2.6.3-k3s1, built on 1970-01-01T01:01:01Z, go1.26.7" machine # [ 33.938324] k3s[872]: I0923 16:13:01.856151 872 network_policy_controller.go:164] Starting network policy controller machine # [ 34.175356] k3s[872]: I0923 16:13:02.093712 872 network_policy_controller.go:179] Starting network policy controller full sync goroutine machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 34.728302] dhcpcd[679]: flannel.1: soliciting an IPv6 router machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 35.834165] k3s[872]: time="2026-09-23T16:13:03Z" level=info msg="Imported docker.io/library/nix-grpc-farm:0.1.0-beta.4" machine # [ 35.840818] k3s[872]: time="2026-09-23T16:13:03Z" level=info msg="Tagged docker.io/library/nix-grpc-farm@sha256:636233dd871457a4decc7f1a2edabb015e8ed5ef0ad8a12f549d639863043947" machine # [ 36.263342] k3s[872]: time="2026-09-23T16:13:04Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm.tar in 5.12710079s" machine # [ 36.525742] k3s[872]: I0923 16:13:04.443845 872 node_lifecycle_controller.go:1234] "Initializing eviction metric for zone" zone="" machine # [ 36.526602] k3s[872]: I0923 16:13:04.444083 872 node_lifecycle_controller.go:886] "Missing timestamp for Node. Assuming now as a timestamp" node="machine" machine # [ 36.533163] k3s[872]: I0923 16:13:04.444300 872 node_lifecycle_controller.go:1080] "Controller detected that zone is now in new state" zone="" newState="Normal" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 38.684851] dhcpcd[679]: flannel.1: probing for an IPv4LL address machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 44.431637] dhcpcd[679]: flannel.1: using IPv4LL address 169.254.167.58 machine # [ 44.431894] dhcpcd[679]: flannel.1: adding route to 169.254.0.0/16 machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 46.731623] dhcpcd[679]: flannel.1: no IPv6 Routers available machine # [ 46.888325] cni0: port 1(veth04e2b959) entered blocking state machine # [ 46.889786] cni0: port 1(veth04e2b959) entered disabled state machine # [ 46.891505] veth04e2b959: entered allmulticast mode machine # [ 46.893988] veth04e2b959: entered promiscuous mode machine # [ 46.907643] cni0: port 1(veth04e2b959) entered blocking state machine # [ 46.909279] cni0: port 1(veth04e2b959) entered forwarding state machine # [ 46.776790] (udev-worker)[1862]: Network interface NamePolicy= disabled on kernel command line. machine # [ 46.779718] (udev-worker)[1864]: Network interface NamePolicy= disabled on kernel command line. machine # [ 46.803163] dhcpcd[679]: veth04e2b959: IAID 57:e3:27:36 machine # [ 46.803613] dhcpcd[679]: veth04e2b959: adding address fe80::f4b8:57ff:fee3:2736 machine # [ 46.823157] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount437429424.mount: Deactivated successfully. machine # [ 46.900449] systemd[1]: Started libcontainer container c2802ad36d170ec4f5e0cfab705520788232fa04fb053d9decd6d16c00a0635f. machine # [ 47.690220] dhcpcd[679]: veth04e2b959: soliciting a DHCP lease machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 47.857459] cni0: port 2(veth18a88a7e) entered blocking state machine # [ 47.858216] cni0: port 2(veth18a88a7e) entered disabled state machine # [ 47.859487] veth18a88a7e: entered allmulticast mode machine # [ 47.860194] veth18a88a7e: entered promiscuous mode machine # [ 47.867146] cni0: port 2(veth18a88a7e) entered blocking state machine # [ 47.867748] cni0: port 2(veth18a88a7e) entered forwarding state machine # [ 47.726650] dhcpcd[679]: veth18a88a7e: IAID dc:0e:9f:6c machine # [ 47.727437] dhcpcd[679]: veth18a88a7e: adding address fe80::a85a:dcff:fe0e:9f6c machine # [ 47.798099] systemd[1]: Started libcontainer container 365ba28430573469c547683121bcbcb115e01b15679f06d884508b3a818e3ad9. machine # [ 47.821260] systemd[1]: Started libcontainer container 46730b4631e76131c89af35490e6f3ea5535035d8f60113fd41fa4fb08c2f8cf. machine # [ 48.529449] systemd[1]: Started libcontainer container 657a5db207bc8ee3509f92457e7dda37ceb2e90112d2ec837ad6da3e20dd47f3. machine # [ 48.717519] dhcpcd[679]: veth18a88a7e: soliciting a DHCP lease machine # [ 48.737509] k3s[872]: I0923 16:13:16.655603 872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/coredns-c5fdd76cf-vln95" podStartSLOduration=21.655576751 podStartE2EDuration="21.655576751s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-23 16:12:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-23 16:13:16.651268103 +0000 UTC m=+33.473394241" watchObservedRunningTime="2026-09-23 16:13:16.655576751 +0000 UTC m=+33.477702610" machine # [ 48.751201] k3s[872]: I0923 16:13:16.669562 872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/helm-install-nix-grpc-farm-g9cnw" podStartSLOduration=21.669540257 podStartE2EDuration="21.669540257s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-23 16:12:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-23 16:13:16.668933476 +0000 UTC m=+33.491059615" watchObservedRunningTime="2026-09-23 16:13:16.669540257 +0000 UTC m=+33.491666116" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 48.927162] k3s[872]: I0923 16:13:16.844338 872 alloc.go:329] "allocated clusterIPs" service="farm/nix-grpc-farm" clusterIPs={"IPv4":"10.43.123.252"} machine # [ 48.982096] systemd[1]: cri-containerd-46730b4631e76131c89af35490e6f3ea5535035d8f60113fd41fa4fb08c2f8cf.scope: Deactivated successfully. machine # [ 48.983581] systemd[1]: cri-containerd-46730b4631e76131c89af35490e6f3ea5535035d8f60113fd41fa4fb08c2f8cf.scope: Consumed 543ms CPU time over 1.160s wall clock time, 30.7M memory peak, 2.4M incoming IP traffic, 145.6K outgoing IP traffic. machine # [ 49.039550] dhcpcd[679]: veth04e2b959: soliciting an IPv6 router machine # [ 49.054736] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-46730b4631e76131c89af35490e6f3ea5535035d8f60113fd41fa4fb08c2f8cf-rootfs.mount: Deactivated successfully. machine # [ 49.271669] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod2c6b7df1_09d7_407a_b72f_c1bfd0f92fbf.slice. machine # [ 49.291073] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod470a7fc3_4f93_404f_b931_b9b26ff79428.slice. machine # [ 49.311412] systemd[1]: Created slice libcontainer container kubepods-besteffort-podee983aec_9469_42ad_809e_1b667c6e664b.slice. machine # [ 49.312733] dhcpcd[679]: veth18a88a7e: soliciting an IPv6 router machine # [ 49.317367] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod245d5805_dcfb_4afd_9c33_c8f8f9647e2a.slice. machine # [ 49.360442] k3s[872]: I0923 16:13:17.278791 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/245d5805-dcfb-4afd-9c33-c8f8f9647e2a-config\") pod \"nix-grpc-farm-lb-75b44f88dd-4gcmd\" (UID: \"245d5805-dcfb-4afd-9c33-c8f8f9647e2a\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-4gcmd" machine # [ 49.360876] k3s[872]: I0923 16:13:17.278842 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/245d5805-dcfb-4afd-9c33-c8f8f9647e2a-tmp\") pod \"nix-grpc-farm-lb-75b44f88dd-4gcmd\" (UID: \"245d5805-dcfb-4afd-9c33-c8f8f9647e2a\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-4gcmd" machine # [ 49.361416] k3s[872]: I0923 16:13:17.278876 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/ee983aec-9469-42ad-809e-1b667c6e664b-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-29n4v\" (UID: \"ee983aec-9469-42ad-809e-1b667c6e664b\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-29n4v" machine # [ 49.362115] k3s[872]: I0923 16:13:17.278908 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/2c6b7df1-09d7-407a-b72f-c1bfd0f92fbf-build\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-t2vtr\" (UID: \"2c6b7df1-09d7-407a-b72f-c1bfd0f92fbf\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-t2vtr" machine # [ 49.362591] k3s[872]: I0923 16:13:17.278935 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2c6b7df1-09d7-407a-b72f-c1bfd0f92fbf-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-t2vtr\" (UID: \"2c6b7df1-09d7-407a-b72f-c1bfd0f92fbf\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-t2vtr" machine # [ 49.381833] k3s[872]: I0923 16:13:17.300222 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/2c6b7df1-09d7-407a-b72f-c1bfd0f92fbf-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-t2vtr\" (UID: \"2c6b7df1-09d7-407a-b72f-c1bfd0f92fbf\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-t2vtr" machine # [ 49.382454] k3s[872]: I0923 16:13:17.300275 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/470a7fc3-4f93-404f-b931-b9b26ff79428-oidc\") pod \"nix-grpc-farm-scheduler-c5d75967-8stcs\" (UID: \"470a7fc3-4f93-404f-b931-b9b26ff79428\") " pod="farm/nix-grpc-farm-scheduler-c5d75967-8stcs" machine # [ 49.390370] k3s[872]: I0923 16:13:17.300315 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ssb4\" (UniqueName: \"kubernetes.io/projected/ee983aec-9469-42ad-809e-1b667c6e664b-kube-api-access-7ssb4\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-29n4v\" (UID: \"ee983aec-9469-42ad-809e-1b667c6e664b\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-29n4v" machine # [ 49.390885] k3s[872]: I0923 16:13:17.308814 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/2c6b7df1-09d7-407a-b72f-c1bfd0f92fbf-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-t2vtr\" (UID: \"2c6b7df1-09d7-407a-b72f-c1bfd0f92fbf\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-t2vtr" machine # [ 49.391467] k3s[872]: I0923 16:13:17.308841 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/470a7fc3-4f93-404f-b931-b9b26ff79428-ca\") pod \"nix-grpc-farm-scheduler-c5d75967-8stcs\" (UID: \"470a7fc3-4f93-404f-b931-b9b26ff79428\") " pod="farm/nix-grpc-farm-scheduler-c5d75967-8stcs" machine # [ 49.391993] k3s[872]: I0923 16:13:17.308934 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/245d5805-dcfb-4afd-9c33-c8f8f9647e2a-tls-lb\") pod \"nix-grpc-farm-lb-75b44f88dd-4gcmd\" (UID: \"245d5805-dcfb-4afd-9c33-c8f8f9647e2a\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-4gcmd" machine # [ 49.392528] k3s[872]: I0923 16:13:17.309050 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/2c6b7df1-09d7-407a-b72f-c1bfd0f92fbf-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-t2vtr\" (UID: \"2c6b7df1-09d7-407a-b72f-c1bfd0f92fbf\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-t2vtr" machine # [ 49.393094] k3s[872]: I0923 16:13:17.309084 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/ee983aec-9469-42ad-809e-1b667c6e664b-build\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-29n4v\" (UID: \"ee983aec-9469-42ad-809e-1b667c6e664b\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-29n4v" machine # [ 49.393589] k3s[872]: I0923 16:13:17.309110 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/ee983aec-9469-42ad-809e-1b667c6e664b-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-29n4v\" (UID: \"ee983aec-9469-42ad-809e-1b667c6e664b\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-29n4v" machine # [ 49.394109] k3s[872]: I0923 16:13:17.309135 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ee983aec-9469-42ad-809e-1b667c6e664b-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-29n4v\" (UID: \"ee983aec-9469-42ad-809e-1b667c6e664b\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-29n4v" machine # [ 49.394597] k3s[872]: I0923 16:13:17.309160 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/2c6b7df1-09d7-407a-b72f-c1bfd0f92fbf-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-t2vtr\" (UID: \"2c6b7df1-09d7-407a-b72f-c1bfd0f92fbf\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-t2vtr" machine # [ 49.395185] k3s[872]: I0923 16:13:17.309186 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd56f\" (UniqueName: \"kubernetes.io/projected/470a7fc3-4f93-404f-b931-b9b26ff79428-kube-api-access-bd56f\") pod \"nix-grpc-farm-scheduler-c5d75967-8stcs\" (UID: \"470a7fc3-4f93-404f-b931-b9b26ff79428\") " pod="farm/nix-grpc-farm-scheduler-c5d75967-8stcs" machine # [ 49.395645] k3s[872]: I0923 16:13:17.309212 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/ee983aec-9469-42ad-809e-1b667c6e664b-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-29n4v\" (UID: \"ee983aec-9469-42ad-809e-1b667c6e664b\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-29n4v" machine # [ 49.396203] k3s[872]: I0923 16:13:17.309242 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/2c6b7df1-09d7-407a-b72f-c1bfd0f92fbf-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-t2vtr\" (UID: \"2c6b7df1-09d7-407a-b72f-c1bfd0f92fbf\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-t2vtr" machine # [ 49.437707] k3s[872]: I0923 16:13:17.309275 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/470a7fc3-4f93-404f-b931-b9b26ff79428-niks3-token\") pod \"nix-grpc-farm-scheduler-c5d75967-8stcs\" (UID: \"470a7fc3-4f93-404f-b931-b9b26ff79428\") " pod="farm/nix-grpc-farm-scheduler-c5d75967-8stcs" machine # [ 49.438444] k3s[872]: I0923 16:13:17.309304 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/470a7fc3-4f93-404f-b931-b9b26ff79428-tls\") pod \"nix-grpc-farm-scheduler-c5d75967-8stcs\" (UID: \"470a7fc3-4f93-404f-b931-b9b26ff79428\") " pod="farm/nix-grpc-farm-scheduler-c5d75967-8stcs" machine # [ 49.439027] k3s[872]: I0923 16:13:17.309332 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/ee983aec-9469-42ad-809e-1b667c6e664b-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-29n4v\" (UID: \"ee983aec-9469-42ad-809e-1b667c6e664b\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-29n4v" machine # [ 49.439483] k3s[872]: I0923 16:13:17.309362 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7fqz\" (UniqueName: \"kubernetes.io/projected/2c6b7df1-09d7-407a-b72f-c1bfd0f92fbf-kube-api-access-b7fqz\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-t2vtr\" (UID: \"2c6b7df1-09d7-407a-b72f-c1bfd0f92fbf\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-t2vtr" machine # [ 49.440067] k3s[872]: I0923 16:13:17.309387 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/245d5805-dcfb-4afd-9c33-c8f8f9647e2a-tls-ca\") pod \"nix-grpc-farm-lb-75b44f88dd-4gcmd\" (UID: \"245d5805-dcfb-4afd-9c33-c8f8f9647e2a\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-4gcmd" machine # [ 49.440540] k3s[872]: I0923 16:13:17.309414 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/ee983aec-9469-42ad-809e-1b667c6e664b-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-29n4v\" (UID: \"ee983aec-9469-42ad-809e-1b667c6e664b\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-29n4v" machine # [ 49.810581] cni0: port 3(vethd4c88387) entered blocking state machine # [ 49.811321] cni0: port 3(vethd4c88387) entered disabled state machine # [ 49.812151] vethd4c88387: entered allmulticast mode machine # [ 49.813079] vethd4c88387: entered promiscuous mode machine # [ 49.661970] (udev-worker)[187[ 49.815721] cni0: port 4(vetha48a54e3) entered blocking state machine # 5]: Network interface NamePolicy[ 49.816671] cni0: port 4(vetha48a54e3) entered disabled state machine # = disabled on kernel command lin[ 49.817644] vetha48a54e3: entered allmulticast mode machine # e. machine # [ 49.818401] vetha48a54e3: entered promiscuous mode machine # [ 49.826551] cni0: port 3(vethd4c88387) entered blocking state machine # [ 49.827212] cni0: port 3(vethd4c88387) entered forwarding state machine # [ 49.840320] cni0: port 4(vetha48a54e3) entered blocking state machine # [ 49.841029] cni0: port 4(vetha48a54e3) entered forwarding state machine # [ 49.848224] cni0: port 5(veth4faf991b) entered blocking state machine # [ 49.849890] cni0: port 5(veth4faf991b) entered disabled state machine # [ 49.852861] veth4faf991b: entered allmulticast mode machine # [ 49.853792] veth4faf991b: entered promiscuous mode machine # [ 49.707228] (udev-worker)[2371]: Network interface NamePolicy= disabled on kernel command line. machine # [ 49.864174] cni0: port 6(veth14ef849d) entered blocking state machine # [ 49.865453] cni0: port 6(veth14ef849d) entered disabled state machine # [ 49.866123] veth14ef849d: entered allmulticast mode machine # [ 49.866853] veth14ef849d: entered promiscuous mode machine # [ 49.869598] cni0: port 5(veth4faf991b) entered blocking state machine # [ 49.870239] cni0: port 5(veth4faf991b) entered forwarding state machine # [ 49.728391] d[ 49.881873] cni0: port 6(veth14ef849d) entered blocking state machine # hcpcd[679]: veth[ 49.882721] cni0: port 6(veth14ef849d) entered forwarding state machine # a48a54e3: waiting for carrier machine # [ 49.747150] dhcpcd[679]: vethd4c88387: IAID d5:fe:6e:52 machine # [ 49.747314] dhcpcd[679]: vethd4c88387: adding address fe80::3063:d5ff:fefe:6e52 machine # [ 49.763072] dhcpcd[679]: veth4faf991b: IAID 67:4b:5b:3b machine # [ 49.763424] dhcpcd[679]: veth4faf991b: adding address fe80::c04:67ff:fe4b:5b3b machine # [ 49.773120] dhcpcd[679]: veth14ef849d: IAID ba:cb:4f:79 machine # [ 49.773491] dhcpcd[679]: veth14ef849d: adding address fe80::2c18:baff:fecb:4f79 machine # [ 49.774167] dhcpcd[679]: vetha48a54e3: carrier acquired machine # [ 49.781691] dhcpcd[679]: vetha48a54e3: IAID dd:5f:1e:41 machine # [ 49.782024] dhcpcd[679]: vetha48a54e3: adding address fe80::6c12:ddff:fe5f:1e41 machine # [ 49.783942] dhcpcd[679]: veth4faf991b: old hardware address: 0e:04:67:4b:5b:3b machine # [ 49.784609] dhcpcd[679]: veth4faf991b: new hardware address: 06:0c:b0:06:f4:71 machine # [ 49.785948] dhcpcd[679]: veth4faf991b: carrier lost machine # [ 49.811723] dhcpcd[679]: veth4faf991b: deleting address fe80::c04:67ff:fe4b:5b3b machine # [ 49.812424] dhcpcd[679]: veth4faf991b: old hardware address: 06:0c:b0:06:f4:71 machine # [ 49.812633] dhcpcd[679]: veth4faf991b: new hardware address: 0e:04:67:4b:5b:3b machine # [ 49.813179] dhcpcd[679]: veth14ef849d: old hardware address: 2e:18:ba:cb:4f:79 machine # [ 49.813763] dhcpcd[679]: veth14ef849d: new hardware address: 92:b5:08:53:5a:2a machine # [ 49.815245] dhcpcd[679]: veth14ef849d: carrier lost machine # [ 49.841944] dhcpcd[679]: veth14ef849d: deleting address fe80::2c18:baff:fecb:4f79 machine # [ 49.842280] dhcpcd[679]: veth14ef849d: old hardware address: 92:b5:08:53:5a:2a machine # [ 49.842806] dhcpcd[679]: veth14ef849d: new hardware address: 2e:18:ba:cb:4f:79 machine # [ 49.843448] dhcpcd[679]: veth4faf991b: carrier acquired machine # [ 49.851245] dhcpcd[679]: veth4faf991b: IAID 67:4b:5b:3b machine # [ 49.851580] dhcpcd[679]: veth4faf991b: adding address fe80::c04:67ff:fe4b:5b3b machine # [ 49.852325] dhcpcd[679]: veth14ef849d: carrier acquired machine # [ 49.859433] dhcpcd[679]: veth14ef849d: IAID ba:cb:4f:79 machine # [ 49.860245] dhcpcd[679]: veth14ef849d: adding address fe80::2c18:baff:fecb:4f79 machine # [ 49.869757] systemd[1]: Started libcontainer container 715ab2653efcfe8711f314731372f9a28b8538ad9558dad7a7323cb4ef415556. machine # [ 49.874050] systemd[1]: Started libcontainer container 54c741c21424f62b01f0b93f2dd105b45fe50b432559c1490bdf3e4095156af8. machine # [ 49.895288] systemd[1]: Started libcontainer container 7382482ce7a4c4ac1f12e5740c14db1f72f90d273a4e97f506ddcb0c92acf68c. machine # [ 49.922330] systemd[1]: Started libcontainer container 4be73270f5458476b6211207f735c612032e6a07d3287e16363b393c14a10fff. machine # [ 50.485632] dhcpcd[679]: vetha48a54e3: soliciting a DHCP lease machine # [ 50.768232] systemd[1]: cri-containerd-c2802ad36d170ec4f5e0cfab705520788232fa04fb053d9decd6d16c00a0635f.scope: Deactivated successfully. machine # [ 50.807433] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-c2802ad36d170ec4f5e0cfab705520788232fa04fb053d9decd6d16c00a0635f-rootfs.mount: Deactivated successfully. machine # [ 51.056378] dhcpcd[679]: veth14ef849d: soliciting a DHCP lease machine # [ 51.086508] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-c2802ad36d170ec4f5e0cfab705520788232fa04fb053d9decd6d16c00a0635f-shm.mount: Deactivated successfully. machine # [ 51.277588] cni0: port 1(veth04e2b959) entered disabled state machine # [ 51.124735] dhcpcd[679]: veth04e2b959: carrier lost machine # [ 51.280071] veth04e2b959 (unregistering): left allmulticast mode machine # [ 51.280995] veth04e2b959 (unregistering): left promiscuous mode machine # [ 51.281836] cni0: port 1(veth04e2b959) entered disabled state machine # [ 51.145164] systemd[1]: run-netns-cni\x2de89754b7\x2d2d0d\x2d99ef\x2d5e21\x2dbbe773bc8cc3.mount: Deactivated successfully. machine # [ 51.153540] dhcpcd[679]: veth04e2b959: deleting address fe80::f4b8:57ff:fee3:2736 machine # [ 51.192240] dhcpcd[679]: veth4faf991b: soliciting a DHCP lease machine # [ 51.196425] dhcpcd[679]: veth04e2b959: removing interface machine # [ 51.206076] k3s[872]: I0923 16:13:19.124151 872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4ac30177-306b-4491-9fc7-396586bd4ce8-tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ac30177-306b-4491-9fc7-396586bd4ce8-tmp\") pod \"4ac30177-306b-4491-9fc7-396586bd4ce8\" (UID: \"4ac30177-306b-4491-9fc7-396586bd4ce8\") " machine # [ 51.214111] k3s[872]: I0923 16:13:19.124201 872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4ac30177-306b-4491-9fc7-396586bd4ce8-content\" (UniqueName: \"kubernetes.io/configmap/4ac30177-306b-4491-9fc7-396586bd4ce8-content\") pod \"4ac30177-306b-4491-9fc7-396586bd4ce8\" (UID: \"4ac30177-306b-4491-9fc7-396586bd4ce8\") " machine # [ 51.219341] k3s[872]: I0923 16:13:19.124233 872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4ac30177-306b-4491-9fc7-396586bd4ce8-klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/4ac30177-306b-4491-9fc7-396586bd4ce8-klipper-helm\") pod \"4ac30177-306b-4491-9fc7-396586bd4ce8\" (UID: \"4ac30177-306b-4491-9fc7-396586bd4ce8\") " machine # [ 51.224375] k3s[872]: I0923 16:13:19.124267 872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4ac30177-306b-4491-9fc7-396586bd4ce8-klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/4ac30177-306b-4491-9fc7-396586bd4ce8-klipper-config\") pod \"4ac30177-306b-4491-9fc7-396586bd4ce8\" (UID: \"4ac30177-306b-4491-9fc7-396586bd4ce8\") " machine # [ 51.229274] k3s[872]: I0923 16:13:19.124303 872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4ac30177-306b-4491-9fc7-396586bd4ce8-kube-api-access-rgph7\" (UniqueName: \"kubernetes.io/projected/4ac30177-306b-4491-9fc7-396586bd4ce8-kube-api-access-rgph7\") pod \"4ac30177-306b-4491-9fc7-396586bd4ce8\" (UID: \"4ac30177-306b-4491-9fc7-396586bd4ce8\") " machine # [ 51.234540] k3s[872]: I0923 16:13:19.124344 872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4ac30177-306b-4491-9fc7-396586bd4ce8-klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ac30177-306b-4491-9fc7-396586bd4ce8-klipper-cache\") pod \"4ac30177-306b-4491-9fc7-396586bd4ce8\" (UID: \"4ac30177-306b-4491-9fc7-396586bd4ce8\") " machine # [ 51.239588] k3s[872]: I0923 16:13:19.124378 872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4ac30177-306b-4491-9fc7-396586bd4ce8-values\" (UniqueName: \"kubernetes.io/projected/4ac30177-306b-4491-9fc7-396586bd4ce8-values\") pod \"4ac30177-306b-4491-9fc7-396586bd4ce8\" (UID: \"4ac30177-306b-4491-9fc7-396586bd4ce8\") " machine # [ 51.244732] k3s[872]: I0923 16:13:19.125266 872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ac30177-306b-4491-9fc7-396586bd4ce8-content" pod "4ac30177-306b-4491-9fc7-396586bd4ce8" (UID: "4ac30177-306b-4491-9fc7-396586bd4ce8"). InnerVolumeSpecName "content". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 51.244902] k3s[872]: I0923 16:13:19.131316 872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ac30177-306b-4491-9fc7-396586bd4ce8-klipper-helm" pod "4ac30177-306b-4491-9fc7-396586bd4ce8" (UID: "4ac30177-306b-4491-9fc7-396586bd4ce8"). InnerVolumeSpecName "klipper-helm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 51.245621] k3s[872]: I0923 16:13:19.132112 872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ac30177-306b-4491-9fc7-396586bd4ce8-klipper-config" pod "4ac30177-306b-4491-9fc7-396586bd4ce8" (UID: "4ac30177-306b-4491-9fc7-396586bd4ce8"). InnerVolumeSpecName "klipper-config". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 51.246318] k3s[872]: I0923 16:13:19.132252 872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ac30177-306b-4491-9fc7-396586bd4ce8-tmp" pod "4ac30177-306b-4491-9fc7-396586bd4ce8" (UID: "4ac30177-306b-4491-9fc7-396586bd4ce8"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 51.246935] systemd[1]: var-lib-kubelet-pods-4ac30177\x2d306b\x2d4491\x2d9fc7\x2d396586bd4ce8-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dconfig.mount: Deactivated successfully. machine # [ 51.247942] k3s[872]: I0923 16:13:19.138190 872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ac30177-306b-4491-9fc7-396586bd4ce8-klipper-cache" pod "4ac30177-306b-4491-9fc7-396586bd4ce8" (UID: "4ac30177-306b-4491-9fc7-396586bd4ce8"). InnerVolumeSpecName "klipper-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 51.248624] k3s[872]: I0923 16:13:19.143484 872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ac30177-306b-4491-9fc7-396586bd4ce8-kube-api-access-rgph7" pod "4ac30177-306b-4491-9fc7-396586bd4ce8" (UID: "4ac30177-306b-4491-9fc7-396586bd4ce8"). InnerVolumeSpecName "kube-api-access-rgph7". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 51.249482] k3s[872]: I0923 16:13:19.143549 872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ac30177-306b-4491-9fc7-396586bd4ce8-values" pod "4ac30177-306b-4491-9fc7-396586bd4ce8" (UID: "4ac30177-306b-4491-9fc7-396586bd4ce8"). InnerVolumeSpecName "values". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 51.306792] k3s[872]: I0923 16:13:19.225021 872 reconciler_common.go:299] "Volume detached for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/4ac30177-306b-4491-9fc7-396586bd4ce8-klipper-config\") on node \"machine\" DevicePath \"\"" machine # [ 51.306996] k3s[872]: I0923 16:13:19.225058 872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rgph7\" (UniqueName: \"kubernetes.io/projected/4ac30177-306b-4491-9fc7-396586bd4ce8-kube-api-access-rgph7\") on node \"machine\" DevicePath \"\"" machine # [ 51.307643] k3s[872]: I0923 16:13:19.225072 872 reconciler_common.go:299] "Volume detached for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ac30177-306b-4491-9fc7-396586bd4ce8-klipper-cache\") on node \"machine\" DevicePath \"\"" machine # [ 51.308524] k3s[872]: I0923 16:13:19.225099 872 reconciler_common.go:299] "Volume detached for volume \"values\" (UniqueName: \"kubernetes.io/projected/4ac30177-306b-4491-9fc7-396586bd4ce8-values\") on node \"machine\" DevicePath \"\"" machine # [ 51.309151] k3s[872]: I0923 16:13:19.225113 872 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ac30177-306b-4491-9fc7-396586bd4ce8-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 51.309718] k3s[872]: I0923 16:13:19.225126 872 reconciler_common.go:299] "Volume detached for volume \"content\" (UniqueName: \"kubernetes.io/configmap/4ac30177-306b-4491-9fc7-396586bd4ce8-content\") on node \"machine\" DevicePath \"\"" machine # [ 51.310188] k3s[872]: I0923 16:13:19.225154 872 reconciler_common.go:299] "Volume detached for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/4ac30177-306b-4491-9fc7-396586bd4ce8-klipper-helm\") on node \"machine\" DevicePath \"\"" machine # [ 51.350453] systemd[1]: Started libcontainer container bfd49909cb7c4a97fc2a733db74784b40d13ee50803c8338a0c9565893c85003. machine # [ 51.524422] dhcpcd[679]: vethd4c88387: soliciting an IPv6 router machine # [ 51.585746] dhcpcd[679]: vetha48a54e3: soliciting an IPv6 router machine # [ 51.631907] dhcpcd[679]: vethd4c88387: soliciting a DHCP lease machine # [ 51.672307] systemd[1]: Removed slice libcontainer container kubepods-burstable-pod4ac30177_306b_4491_9fc7_396586bd4ce8.slice. machine # [ 51.672783] systemd[1]: kubepods-burstable-pod4ac30177_306b_4491_9fc7_396586bd4ce8.slice: Consumed 574ms CPU time over 19.103s wall clock time, 31.2M memory peak, 2.4M incoming IP traffic, 145.7K outgoing IP traffic. machine # [ 51.687375] systemd[1]: var-lib-kubelet-pods-4ac30177\x2d306b\x2d4491\x2d9fc7\x2d396586bd4ce8-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2drgph7.mount: Deactivated successfully. machine # [ 51.688068] systemd[1]: var-lib-kubelet-pods-4ac30177\x2d306b\x2d4491\x2d9fc7\x2d396586bd4ce8-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dhelm.mount: Deactivated successfully. machine # [ 51.688814] systemd[1]: var-lib-kubelet-pods-4ac30177\x2d306b\x2d4491\x2d9fc7\x2d396586bd4ce8-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 51.694339] systemd[1]: var-lib-kubelet-pods-4ac30177\x2d306b\x2d4491\x2d9fc7\x2d396586bd4ce8-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dcache.mount: Deactivated successfully. machine # [ 51.695109] systemd[1]: var-lib-kubelet-pods-4ac30177\x2d306b\x2d4491\x2d9fc7\x2d396586bd4ce8-volumes-kubernetes.io\x7eprojected-values.mount: Deactivated successfully. machine # [ 51.741558] dhcpcd[679]: veth14ef849d: soliciting an IPv6 router machine # [ 51.762084] k3s[872]: I0923 16:13:19.678656 872 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c2802ad36d170ec4f5e0cfab705520788232fa04fb053d9decd6d16c00a0635f" machine # [ 51.772354] k3s[872]: I0923 16:13:19.690716 872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-75b44f88dd-4gcmd" podStartSLOduration=2.690662215 podStartE2EDuration="2.690662215s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-23 16:13:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-23 16:13:19.690110469 +0000 UTC m=+36.512236328" watchObservedRunningTime="2026-09-23 16:13:19.690662215 +0000 UTC m=+36.512789192" machine # [ 52.320218] dhcpcd[679]: veth4faf991b: soliciting an IPv6 router machine # [ 53.718994] dhcpcd[679]: veth18a88a7e: probing for an IPv4LL address machine # [ 55.487316] dhcpcd[679]: vetha48a54e3: probing for an IPv4LL address machine # [ 55.925579] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount3241766193.mount: Deactivated successfully. machine # [ 56.001615] systemd[1]: Started libcontainer container b7ed614d98d9bc699bb235bdbeb7ff27139f7f692a463da900736a4bfdf001a1. machine # [ 56.056309] dhcpcd[679]: veth14ef849d: probing for an IPv4LL address machine # [ 56.101465] systemd[1]: Started libcontainer container fa11266b42a5a718c6ff2da39c2ec1c5c915ad6c66d9d8954b05f1d333a22e68. machine # [ 56.167932] systemd[1]: Started libcontainer container 31e9509c260aef4bb67714bce2296f728c82740f264aff0f90fec6476f920d11. machine # [ 56.192548] dhcpcd[679]: veth4faf991b: probing for an IPv4LL address machine # [ 56.360048] niks3-server[1170]: 2026/09/23 16:13:24 INFO lead: acquired remote=10.42.0.4:59816 machine # [ 56.632405] dhcpcd[679]: vethd4c88387: probing for an IPv4LL address machine # [ 56.847384] k3s[872]: I0923 16:13:24.764386 872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-scheduler-c5d75967-8stcs" podStartSLOduration=7.764361805 podStartE2EDuration="7.764361805s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-23 16:13:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-23 16:13:24.764141665 +0000 UTC m=+41.586267524" watchObservedRunningTime="2026-09-23 16:13:24.764361805 +0000 UTC m=+41.586487385" machine # [ 56.922075] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped59025223.mount: Deactivated successfully. machine # [ 56.923133] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount1840000056.mount: Deactivated successfully. machine # [ 56.924070] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped4212767217.mount: Deactivated successfully. machine # [ 58.146494] systemd[1]: cri-containerd-fa11266b42a5a718c6ff2da39c2ec1c5c915ad6c66d9d8954b05f1d333a22e68.scope: Deactivated successfully. machine # [ 58.154235] systemd[1]: cri-containerd-fa11266b42a5a718c6ff2da39c2ec1c5c915ad6c66d9d8954b05f1d333a22e68.scope: Consumed 821ms CPU time over 2.044s wall clock time, 399.6M memory peak, 87.2M read from disk, 173M written to disk. machine # [ 58.163115] systemd[1]: cri-containerd-31e9509c260aef4bb67714bce2296f728c82740f264aff0f90fec6476f920d11.scope: Deactivated successfully. machine # [ 58.169776] systemd[1]: cri-containerd-31e9509c260aef4bb67714bce2296f728c82740f264aff0f90fec6476f920d11.scope: Consumed 816ms CPU time over 1.995s wall clock time, 387.7M memory peak, 75.5M read from disk, 147.4M written to disk. machine # [ 58.204886] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-fa11266b42a5a718c6ff2da39c2ec1c5c915ad6c66d9d8954b05f1d333a22e68-rootfs.mount: Deactivated successfully. machine # [ 58.209679] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-31e9509c260aef4bb67714bce2296f728c82740f264aff0f90fec6476f920d11-rootfs.mount: Deactivated successfully. machine # [ 58.554651] dhcpcd[679]: veth18a88a7e: using IPv4LL address 169.254.46.15 machine # [ 58.557699] dhcpcd[679]: veth18a88a7e: adding route to 169.254.0.0/16 machine # [ 59.042592] systemd[1]: Started libcontainer container dd6a03a03327ee7cb4455928a2a079ef3db3971c7d2ff30ed6ecf6a24fd8172f. machine # [ 59.130718] systemd[1]: Started libcontainer container 6e896b6f5b7e4cfc43298f27d6adf4145a9e57840dabf6dcbf056dac21fd444e. machine # [ 59.211037] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped1762297230.mount: Deactivated successfully. machine # [ 59.223075] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped3957015826.mount: Deactivated successfully. machine # [ 59.266938] systemd[1]: Started libcontainer container f3f2c199ea28b6f550f267edae76e3e87cb01e584f9645a51e13ad1e174433a0. machine # [ 59.289295] systemd[1]: Started libcontainer container 3d014f5d2cb5af603c89cf57923ea004d47901f3a90731579f462e94db2a1664. machine # [ 59.556530] systemd[1]: Started libcontainer container f7cdb7ebf484fc585871002d37d71119f477c94fead850933ef305802e3414ae. machine # error: timed out waiting for the condition machine # [ 60.221678] systemd[1]: tmp-ovl\x2didmapped3057554405.mount: Deactivated successfully. machine # [ 60.544768] dhcpcd[679]: vetha48a54e3: using IPv4LL address 169.254.72.93 machine # [ 60.545256] dhcpcd[679]: vetha48a54e3: adding route to 169.254.0.0/16 machine # [ 61.042448] dhcpcd[679]: veth14ef849d: using IPv4LL address 169.254.106.91 machine # [ 61.043416] dhcpcd[679]: veth14ef849d: adding route to 169.254.0.0/16 machine # [ 61.264734] dhcpcd[679]: veth4faf991b: using IPv4LL address 169.254.145.67 machine # [ 61.265031] dhcpcd[679]: veth4faf991b: adding route to 169.254.0.0/16 machine # [ 61.316278] dhcpcd[679]: veth18a88a7e: no IPv6 Routers available machine # [ 61.439555] dhcpcd[679]: vethd4c88387: using IPv4LL address 169.254.57.178 machine # [ 61.440132] dhcpcd[679]: vethd4c88387: adding route to 169.254.0.0/16 machine # [ 62.047172] systemd[1]: Started libcontainer container 4ad83233912e78b59cdb933ea87510b28a59de0c9f587f4be607746f5c66eecd. machine # [ 62.900070] k3s[872]: I0923 16:13:30.817421 872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-29n4v" podStartSLOduration=11.876151153 podStartE2EDuration="13.817378319s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.941227166s" isStatefulPod=false podCreationTimestamp="2026-09-23 16:13:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-23 16:13:30.816707284 +0000 UTC m=+47.638839010" watchObservedRunningTime="2026-09-23 16:13:30.817378319 +0000 UTC m=+47.639508648" machine # [ 62.901067] k3s[872]: I0923 16:13:30.817932 872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-t2vtr" podStartSLOduration=11.814346927999999 podStartE2EDuration="13.817903246s" totalImagesPullingTime="0s" totalInitContainerRuntime="2.003556318s" isStatefulPod=false podCreationTimestamp="2026-09-23 16:13:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-23 16:13:27.793587307 +0000 UTC m=+44.615718194" watchObservedRunningTime="2026-09-23 16:13:30.817903246 +0000 UTC m=+47.640033854" machine # [ 63.528145] dhcpcd[679]: vethd4c88387: no IPv6 Routers available machine # [ 63.587982] dhcpcd[679]: vetha48a54e3: no IPv6 Routers available machine # [ 63.744393] dhcpcd[679]: veth14ef849d: no IPv6 Routers available machine # [ 64.323465] dhcpcd[679]: veth4faf991b: no IPv6 Routers available machine # error: timed out waiting for the condition machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 48.16 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s, in 0.22 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s, in 0.19 seconds) machine: waiting for unit niks3.service machine: (finished: waiting for unit niks3.service, in 0.03 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.23 seconds) machine: waiting for success: test $(curl -sf 10.42.0.6:9901/clusters | grep -c 'health_flags::healthy') -ge 3 machine: (finished: waiting for success: test $(curl -sf 10.42.0.6:9901/clusters | grep -c 'health_flags::healthy') -ge 3, in 0.08 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.22 seconds) machine: waiting for success: curl -sf http://10.42.0.4:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2' machine: (finished: waiting for success: curl -sf http://10.42.0.4:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2', in 0.05 seconds) (finished: subtest: chart deploys and workers become Ready, in 49.19 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}', in 0.18 seconds) machine: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt machine: (finished: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt, in 0.17 seconds) subtest: build through the balancer lands in the cache machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1 machine # [ 136.090092] niks3-server[1170]: 2026/09/23 16:14:44 INFO Received push request method=POST path=/api/pushes machine # [ 136.124279] niks3-server[1170]: 2026/09/23 16:14:44 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign machine # [ 136.132530] niks3-server[1170]: 2026/09/23 16:14:44 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.ls machine # [ 136.138726] niks3-server[1170]: 2026/09/23 16:14:44 INFO Signed narinfos id=1 count=1 machine # [ 136.139865] niks3-server[1170]: 2026/09/23 16:14:44 INFO Registered completed upload object_key=nar/0nzzbas7l8d37mridr7mg162smfjvn7lhs6am4crl4ydaxicigj8.nar.zst machine # [ 136.149227] niks3-server[1170]: 2026/09/23 16:14:44 INFO Received complete push request method=POST path=/api/pushes/1/complete machine # [ 136.158325] niks3-server[1170]: 2026/09/23 16:14:44 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.narinfo machine # [ 160.874172] niks3-server[1170]: 2026/09/23 16:15:08 INFO Received push request method=POST path=/api/pushes machine # [ 160.897066] niks3-server[1170]: 2026/09/23 16:15:08 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign machine # [ 160.901182] niks3-server[1170]: 2026/09/23 16:15:08 INFO Signed narinfos id=2 count=1 machine # [ 160.904193] niks3-server[1170]: 2026/09/23 16:15:08 INFO Registered completed upload object_key=nar/1p7jh5nyz9n68k5f18ymmdpgr34mpnnch1njw7ki7b2b97qlfbjk.nar.zst machine # [ 160.909230] niks3-server[1170]: 2026/09/23 16:15:08 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.ls machine # [ 160.913335] niks3-server[1170]: 2026/09/23 16:15:08 INFO Registered completed upload object_key=log/yz1sqzb72i8v6h2ass0v76ba8cncqj9r-k3s-a.drv machine # [ 160.917286] niks3-server[1170]: 2026/09/23 16:15:08 INFO Received complete push request method=POST path=/api/pushes/2/complete machine # [ 160.920334] niks3-server[1170]: 2026/09/23 16:15:08 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.narinfo machine # [ 160.987829] niks3-server[1170]: 2026/09/23 16:15:08 INFO Received push request method=POST path=/api/pushes machine # [ 160.999704] niks3-server[1170]: 2026/09/23 16:15:08 INFO Received sign narinfos request method=POST path=/api/pushes/3/sign machine # [ 161.001849] niks3-server[1170]: 2026/09/23 16:15:08 INFO Signed narinfos id=3 count=1 machine # [ 161.003091] niks3-server[1170]: 2026/09/23 16:15:08 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.ls machine # [ 161.006047] niks3-server[1170]: 2026/09/23 16:15:08 INFO Registered completed upload object_key=nar/03a4ywhyr5knmbc93z4gyml5y8fvgb431xvlmfxrwsm8mrb0qgx2.nar.zst machine # [ 161.009541] niks3-server[1170]: 2026/09/23 16:15:08 INFO Received complete push request method=POST path=/api/pushes/3/complete machine # [ 161.011808] niks3-server[1170]: 2026/09/23 16:15:08 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.narinfo machine # [ 186.125134] niks3-server[1170]: 2026/09/23 16:15:34 INFO Received push request method=POST path=/api/pushes machine # [ 186.142972] niks3-server[1170]: 2026/09/23 16:15:34 INFO Received sign narinfos request method=POST path=/api/pushes/4/sign machine # [ 186.147290] niks3-server[1170]: 2026/09/23 16:15:34 INFO Signed narinfos id=4 count=1 machine # [ 186.150452] niks3-server[1170]: 2026/09/23 16:15:34 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.ls machine # [ 186.154709] niks3-server[1170]: 2026/09/23 16:15:34 INFO Registered completed upload object_key=log/zfq1xw9bmycqh35l0s44lmv65z4xc7br-k3s-b.drv machine # [ 186.158889] niks3-server[1170]: 2026/09/23 16:15:34 INFO Registered completed upload object_key=nar/05qjsj5ff3a6vnxkhb6k5f3m446dcc206p7cd37w4v3mgi95d7kh.nar.zst machine # [ 186.166126] niks3-server[1170]: 2026/09/23 16:15:34 INFO Received complete push request method=POST path=/api/pushes/4/complete machine # [ 186.170485] niks3-server[1170]: 2026/09/23 16:15:34 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.narinfo machine # [ 186.234967] niks3-server[1170]: 2026/09/23 16:15:34 INFO Received push request method=POST path=/api/pushes machine # [ 186.245825] niks3-server[1170]: 2026/09/23 16:15:34 INFO Received sign narinfos request method=POST path=/api/pushes/5/sign machine # [ 186.246325] niks3-server[1170]: 2026/09/23 16:15:34 INFO Signed narinfos id=5 count=1 machine # [ 186.249698] niks3-server[1170]: 2026/09/23 16:15:34 INFO Registered completed upload object_key=nar/0jyw88klkf3nwxpnj5m5lx3i1dv2idf3hcn6im7883hnldm3gvyq.nar.zst machine # [ 186.251820] niks3-server[1170]: 2026/09/23 16:15:34 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.ls machine # [ 186.254397] niks3-server[1170]: 2026/09/23 16:15:34 INFO Received complete push request method=POST path=/api/pushes/5/complete machine # [ 186.261603] niks3-server[1170]: 2026/09/23 16:15:34 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.narinfo machine # [ 211.175225] niks3-server[1170]: 2026/09/23 16:15:59 INFO Received push request method=POST path=/api/pushes machine # [ 211.192785] niks3-server[1170]: 2026/09/23 16:15:59 INFO Received sign narinfos request method=POST path=/api/pushes/6/sign machine # [ 211.193702] niks3-server[1170]: 2026/09/23 16:15:59 INFO Signed narinfos id=6 count=1 machine # [ 211.198787] niks3-server[1170]: 2026/09/23 16:15:59 INFO Registered completed upload object_key=nar/1q8vp5xqws560mpf8rxk8r8jhqrzibivh13x4wxy0cfqlzbk7cr5.nar.zst machine # [ 211.201604] niks3-server[1170]: 2026/09/23 16:15:59 INFO Registered completed upload object_key=log/n40czam6a4ldp1mh5fdmlcy07fv0akbm-k3s-top.drv machine # [ 211.203142] niks3-server[1170]: 2026/09/23 16:15:59 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.ls machine # [ 211.205390] niks3-server[1170]: 2026/09/23 16:15:59 INFO Received complete push request method=POST path=/api/pushes/6/complete machine # [ 211.213056] niks3-server[1170]: 2026/09/23 16:15:59 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1, in 137.02 seconds) machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath, in 0.15 seconds) machine: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine: (finished: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.02 seconds) machine: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine # copying 3 paths... machine # copying path '/nix/store/r95r891injj9ski5c4w89yxjvjy065mx-k3s-a' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/mrqsh0475wxsmnsvkk55g94v6g5nrcra-k3s-b' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top' from 'http://192.168.1.1:5751'... machine: (finished: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.21 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1 machine # [ 212.902142] niks3-server[1170]: 2026/09/23 16:16:00 INFO Received push request method=POST path=/api/pushes machine # [ 212.920322] niks3-server[1170]: 2026/09/23 16:16:00 INFO Registered completed upload object_key=nar/1fr26arhri17j9bj6hyjzmmd74v730biz1gb3kqd194vjx3ccvp9.nar.zst machine # [ 212.921936] niks3-server[1170]: 2026/09/23 16:16:00 INFO Received sign narinfos request method=POST path=/api/pushes/7/sign machine # [ 212.923412] niks3-server[1170]: 2026/09/23 16:16:00 INFO Signed narinfos id=7 count=1 machine # [ 212.928339] niks3-server[1170]: 2026/09/23 16:16:00 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.ls machine # [ 212.932300] niks3-server[1170]: 2026/09/23 16:16:00 INFO Received complete push request method=POST path=/api/pushes/7/complete machine # [ 212.937339] niks3-server[1170]: 2026/09/23 16:16:00 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.narinfo machine # [ 237.654960] niks3-server[1170]: 2026/09/23 16:16:25 INFO Received push request method=POST path=/api/pushes machine # [ 237.680605] niks3-server[1170]: 2026/09/23 16:16:25 INFO Received sign narinfos request method=POST path=/api/pushes/8/sign machine # [ 237.681070] niks3-server[1170]: 2026/09/23 16:16:25 INFO Signed narinfos id=8 count=1 machine # [ 237.684621] niks3-server[1170]: 2026/09/23 16:16:25 INFO Registered completed upload object_key=log/pbpqsh50ar10fpasdqqx8xg3lmr5j8iz-k3s-a.drv machine # [ 237.692804] niks3-server[1170]: 2026/09/23 16:16:25 INFO Registered completed upload object_key=nar/1hfc6x4x25k3b0fk091d3nb0k3mympfp05fkslcx19synp3ig0zd.nar.zst machine # [ 237.694307] niks3-server[1170]: 2026/09/23 16:16:25 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.ls machine # [ 237.701205] niks3-server[1170]: 2026/09/23 16:16:25 INFO Received complete push request method=POST path=/api/pushes/8/complete machine # [ 237.707227] niks3-server[1170]: 2026/09/23 16:16:25 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.narinfo machine # [ 237.768223] niks3-server[1170]: 2026/09/23 16:16:25 INFO Received push request method=POST path=/api/pushes machine # [ 237.780214] niks3-server[1170]: 2026/09/23 16:16:25 INFO Received sign narinfos request method=POST path=/api/pushes/9/sign machine # [ 237.782418] niks3-server[1170]: 2026/09/23 16:16:25 INFO Signed narinfos id=9 count=1 machine # [ 237.783741] niks3-server[1170]: 2026/09/23 16:16:25 INFO Registered completed upload object_key=nar/0zzq2vgjln4shvh57091n14sam6wh6w06vja6lzb9ppcj4ffyx1n.nar.zst machine # [ 237.786217] niks3-server[1170]: 2026/09/23 16:16:25 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.ls machine # [ 237.786576] niks3-server[1170]: 2026/09/23 16:16:25 INFO Received complete push request method=POST path=/api/pushes/9/complete machine # [ 237.791080] niks3-server[1170]: 2026/09/23 16:16:25 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.narinfo machine # [ 262.499180] niks3-server[1170]: 2026/09/23 16:16:50 INFO Received push request method=POST path=/api/pushes machine # [ 262.520298] niks3-server[1170]: 2026/09/23 16:16:50 INFO Received sign narinfos request method=POST path=/api/pushes/10/sign machine # [ 262.522389] niks3-server[1170]: 2026/09/23 16:16:50 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.ls machine # [ 262.524608] niks3-server[1170]: 2026/09/23 16:16:50 INFO Signed narinfos id=10 count=1 machine # [ 262.526904] niks3-server[1170]: 2026/09/23 16:16:50 INFO Registered completed upload object_key=log/894h6wzw2l4w5f0hikj1k6q57jfnyi87-k3s-b.drv machine # [ 262.529023] niks3-server[1170]: 2026/09/23 16:16:50 INFO Registered completed upload object_key=nar/0hh3nqk95r6g32lhdmxw8cxjv694vbpx9876zkhcpg4r4qxni2ch.nar.zst machine # [ 262.536557] niks3-server[1170]: 2026/09/23 16:16:50 INFO Received complete push request method=POST path=/api/pushes/10/complete machine # [ 262.542026] niks3-server[1170]: 2026/09/23 16:16:50 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.narinfo machine # [ 262.609916] niks3-server[1170]: 2026/09/23 16:16:50 INFO Received push request method=POST path=/api/pushes machine # [ 262.623528] niks3-server[1170]: 2026/09/23 16:16:50 INFO Received sign narinfos request method=POST path=/api/pushes/11/sign machine # [ 262.625680] niks3-server[1170]: 2026/09/23 16:16:50 INFO Signed narinfos id=11 count=1 machine # [ 262.628061] niks3-server[1170]: 2026/09/23 16:16:50 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.ls machine # [ 262.630525] niks3-server[1170]: 2026/09/23 16:16:50 INFO Registered completed upload object_key=nar/0ingamx56k31lwiyxmnxmscjj4n3qfx6sr2kpaynsrwhwz1278iw.nar.zst machine # [ 262.633296] niks3-server[1170]: 2026/09/23 16:16:50 INFO Received complete push request method=POST path=/api/pushes/11/complete machine # [ 262.636214] niks3-server[1170]: 2026/09/23 16:16:50 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.narinfo machine # [ 287.151835] niks3-server[1170]: 2026/09/23 16:17:15 INFO Received push request method=POST path=/api/pushes machine # [ 287.172514] niks3-server[1170]: 2026/09/23 16:17:15 INFO Registered completed upload object_key=nar/0v48x4sp58bvfra08axgkz7yl1n9nc4nirskyv1hwann4i7q277i.nar.zst machine # [ 287.174773] niks3-server[1170]: 2026/09/23 16:17:15 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.ls machine # [ 287.176481] niks3-server[1170]: 2026/09/23 16:17:15 INFO Received sign narinfos request method=POST path=/api/pushes/12/sign machine # [ 287.178189] niks3-server[1170]: 2026/09/23 16:17:15 INFO Signed narinfos id=12 count=1 machine # [ 287.182590] niks3-server[1170]: 2026/09/23 16:17:15 INFO Registered completed upload object_key=log/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g-k3s-top.drv machine # [ 287.188112] niks3-server[1170]: 2026/09/23 16:17:15 INFO Received complete push request method=POST path=/api/pushes/12/complete machine # [ 287.194483] niks3-server[1170]: 2026/09/23 16:17:15 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1, in 77.05 seconds) (finished: subtest: build through the balancer lands in the cache, in 214.45 seconds) subtest: a Job with the client image builds through the farm with its service account machine: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine: (finished: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.18 seconds) machine: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix machine: (finished: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix, in 0.12 seconds) machine: must succeed: kubectl apply -f /nix/store/4qg21n7g16x8lyv0fhhdx9dx3lxqkcdn-ci-job.json machine: (finished: must succeed: kubectl apply -f /nix/store/4qg21n7g16x8lyv0fhhdx9dx3lxqkcdn-ci-job.json, in 0.16 seconds) machine: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed' machine # [ 290.320062] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod58a1f329_4a36_43aa_9b4d_2c89cb069e3f.slice. machine # [ 290.378599] k3s[872]: I0923 16:17:18.296510 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"job\" (UniqueName: \"kubernetes.io/configmap/58a1f329-4a36-43aa-9b4d-2c89cb069e3f-job\") pod \"ci-wlwlb\" (UID: \"58a1f329-4a36-43aa-9b4d-2c89cb069e3f\") " pod="ci/ci-wlwlb" machine # [ 290.378814] k3s[872]: I0923 16:17:18.296567 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-856bn\" (UniqueName: \"kubernetes.io/projected/58a1f329-4a36-43aa-9b4d-2c89cb069e3f-kube-api-access-856bn\") pod \"ci-wlwlb\" (UID: \"58a1f329-4a36-43aa-9b4d-2c89cb069e3f\") " pod="ci/ci-wlwlb" machine # [ 290.379404] k3s[872]: I0923 16:17:18.296596 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/58a1f329-4a36-43aa-9b4d-2c89cb069e3f-nix-grpc-farm\") pod \"ci-wlwlb\" (UID: \"58a1f329-4a36-43aa-9b4d-2c89cb069e3f\") " pod="ci/ci-wlwlb" machine # [ 290.820828] cni0: port 1(veth53abafb4) entered blocking state machine # [ 290.822557] cni0: port 1(veth53abafb4) entered disabled state machine # [ 290.825183] veth53abafb4: entered allmulticast mode machine # [ 290.827600] veth53abafb4: entered promiscuous mode machine # [ 290.846212] cni0: port 1(veth53abafb4) entered blocking state machine # [ 290.848671] cni0: port 1(veth53abafb4) entered forwarding state machine # [ 290.740579] (udev-worker)[5046]: Network interface NamePolicy= disabled on kernel command line. machine # [ 290.769628] dhcpcd[679]: veth53abafb4: IAID fc:4a:04:a7 machine # [ 290.769852] dhcpcd[679]: veth53abafb4: adding address fe80::c821:fcff:fe4a:4a7 machine # [ 290.799272] systemd[1]: Started libcontainer container 8c1d0da5af687280de9f562ebf695f8e138fbe268d8c8e5be7a7fefa78c82b10. machine # [ 291.726284] dhcpcd[679]: veth53abafb4: soliciting a DHCP lease machine # [ 292.574057] dhcpcd[679]: veth53abafb4: soliciting an IPv6 router machine # [ 292.719864] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount3865283554.mount: Deactivated successfully. machine # [ 292.721099] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount4291170442.mount: Deactivated successfully. machine # [ 292.773304] systemd[1]: Started libcontainer container d642ad9a70ee08caca23e5b79116eaa754f3f9a58028466484224232566d463b. machine # [ 294.201602] niks3-server[1170]: 2026/09/23 16:17:22 INFO Received push request method=POST path=/api/pushes machine # [ 294.217427] niks3-server[1170]: 2026/09/23 16:17:22 INFO Received sign narinfos request method=POST path=/api/pushes/13/sign machine # [ 294.219297] niks3-server[1170]: 2026/09/23 16:17:22 INFO Signed narinfos id=13 count=1 machine # [ 294.222624] niks3-server[1170]: 2026/09/23 16:17:22 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.ls machine # [ 294.225513] niks3-server[1170]: 2026/09/23 16:17:22 INFO Registered completed upload object_key=nar/111g6dyibwcf2z7jhpn72rgja0qvjgpdiv9nc06g2dp7ih0a6kyq.nar.zst machine # [ 294.231612] niks3-server[1170]: 2026/09/23 16:17:22 INFO Received complete push request method=POST path=/api/pushes/13/complete machine # [ 294.236104] niks3-server[1170]: 2026/09/23 16:17:22 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.narinfo machine # [ 296.727908] dhcpcd[679]: veth53abafb4: probing for an IPv4LL address machine # [ 301.333844] dhcpcd[679]: veth53abafb4: using IPv4LL address 169.254.108.97 machine # [ 301.336946] dhcpcd[679]: veth53abafb4: adding route to 169.254.0.0/16 machine # [ 304.578700] dhcpcd[679]: veth53abafb4: no IPv6 Routers available machine # [ 309.976710] postgres[761]: [761] LOG: checkpoint starting: time machine # [ 318.958661] niks3-server[1170]: 2026/09/23 16:17:46 INFO Received push request method=POST path=/api/pushes machine # [ 318.984599] niks3-server[1170]: 2026/09/23 16:17:46 INFO Registered completed upload object_key=nar/058kjd2vfl1r27b4d9ixvwf77d8rkr18a4v894kwx8lg0nwpajnr.nar.zst machine # [ 318.985979] niks3-server[1170]: 2026/09/23 16:17:46 INFO Received sign narinfos request method=POST path=/api/pushes/14/sign machine # [ 318.987364] niks3-server[1170]: 2026/09/23 16:17:46 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.ls machine # [ 318.988404] niks3-server[1170]: 2026/09/23 16:17:46 INFO Signed narinfos id=14 count=1 machine # [ 318.993747] niks3-server[1170]: 2026/09/23 16:17:46 INFO Registered completed upload object_key=log/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # [ 319.000969] niks3-server[1170]: 2026/09/23 16:17:46 INFO Received complete push request method=POST path=/api/pushes/14/complete machine # [ 319.005100] niks3-server[1170]: 2026/09/23 16:17:46 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.narinfo machine # [ 319.069578] niks3-server[1170]: 2026/09/23 16:17:46 INFO Received push request method=POST path=/api/pushes machine # [ 319.079380] niks3-server[1170]: 2026/09/23 16:17:46 INFO Received sign narinfos request method=POST path=/api/pushes/15/sign machine # [ 319.081356] niks3-server[1170]: 2026/09/23 16:17:46 INFO Signed narinfos id=15 count=1 machine # [ 319.085747] niks3-server[1170]: 2026/09/23 16:17:47 INFO Received complete push request method=POST path=/api/pushes/15/complete machine # [ 319.088385] niks3-server[1170]: 2026/09/23 16:17:47 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.ls machine # [ 319.090391] niks3-server[1170]: 2026/09/23 16:17:47 INFO Registered completed upload object_key=nar/138ynhcd5wxzz485x9qcq7xsargaklrf2li31ai69m5r46am35q6.nar.zst machine # [ 319.092849] niks3-server[1170]: 2026/09/23 16:17:47 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.narinfo machine # [ 344.005877] niks3-server[1170]: 2026/09/23 16:18:11 INFO Received push request method=POST path=/api/pushes machine # [ 344.032087] niks3-server[1170]: 2026/09/23 16:18:11 INFO Received sign narinfos request method=POST path=/api/pushes/16/sign machine # [ 344.033895] niks3-server[1170]: 2026/09/23 16:18:11 INFO Signed narinfos id=16 count=1 machine # [ 344.035429] niks3-server[1170]: 2026/09/23 16:18:11 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.ls machine # [ 344.038574] niks3-server[1170]: 2026/09/23 16:18:11 INFO Registered completed upload object_key=log/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # [ 344.039789] niks3-server[1170]: 2026/09/23 16:18:11 INFO Registered completed upload object_key=nar/0n4lbdlp8w72fs3qbavl2lwrzbrn55i2b1vyglc89cc3pi8vbb1m.nar.zst machine # [ 344.041480] niks3-server[1170]: 2026/09/23 16:18:11 INFO Received complete push request method=POST path=/api/pushes/16/complete machine # [ 344.046191] niks3-server[1170]: 2026/09/23 16:18:11 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo machine # [ 344.105353] niks3-server[1170]: 2026/09/23 16:18:12 INFO Received push request method=POST path=/api/pushes machine # [ 344.118484] niks3-server[1170]: 2026/09/23 16:18:12 INFO Received sign narinfos request method=POST path=/api/pushes/17/sign machine # [ 344.119649] niks3-server[1170]: 2026/09/23 16:18:12 INFO Signed narinfos id=17 count=1 machine # [ 344.123519] niks3-server[1170]: 2026/09/23 16:18:12 INFO Registered completed upload object_key=nar/1f3gvnvqsm2pm3laixkxkg44kvjb251zqhszcfpp0a00h6x66ljs.nar.zst machine # [ 344.124779] niks3-server[1170]: 2026/09/23 16:18:12 INFO Received complete push request method=POST path=/api/pushes/17/complete machine # [ 344.125587] niks3-server[1170]: 2026/09/23 16:18:12 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.ls machine # [ 344.129037] niks3-server[1170]: 2026/09/23 16:18:12 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.narinfo machine # [ 368.834598] niks3-server[1170]: 2026/09/23 16:18:36 INFO Received push request method=POST path=/api/pushes machine # [ 368.853968] niks3-server[1170]: 2026/09/23 16:18:36 INFO Received sign narinfos request method=POST path=/api/pushes/18/sign machine # [ 368.855562] niks3-server[1170]: 2026/09/23 16:18:36 INFO Registered completed upload object_key=log/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # [ 368.857558] niks3-server[1170]: 2026/09/23 16:18:36 INFO Signed narinfos id=18 count=1 machine # [ 368.858845] niks3-server[1170]: 2026/09/23 16:18:36 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.ls machine # [ 368.863620] niks3-server[1170]: 2026/09/23 16:18:36 INFO Received complete push request method=POST path=/api/pushes/18/complete machine # [ 368.865309] niks3-server[1170]: 2026/09/23 16:18:36 INFO Registered completed upload object_key=nar/1zwf0asrdv12q40fmqga5lx5330dvn9y4in4i9ficz9ij5lhvnf5.nar.zst machine # [ 368.867224] niks3-server[1170]: 2026/09/23 16:18:36 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo machine # [ 371.600996] niks3-server[1170]: 2026/09/23 16:18:39 INFO Received push request method=POST path=/api/pushes machine # [ 371.616833] niks3-server[1170]: 2026/09/23 16:18:39 INFO Received sign narinfos request method=POST path=/api/pushes/19/sign machine # [ 371.619202] niks3-server[1170]: 2026/09/23 16:18:39 INFO Signed narinfos id=19 count=1 machine # [ 371.620729] niks3-server[1170]: 2026/09/23 16:18:39 INFO Registered completed upload object_key=nar/0xiyqcsl8db7dnrq2gqnx5izavr51ma3dcdswrriaxfgj3qzk7xf.nar.zst machine # [ 371.623123] niks3-server[1170]: 2026/09/23 16:18:39 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.ls machine # [ 371.628113] niks3-server[1170]: 2026/09/23 16:18:39 INFO Received complete push request method=POST path=/api/pushes/19/complete machine # [ 371.633378] niks3-server[1170]: 2026/09/23 16:18:39 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.narinfo machine # [ 396.366083] niks3-server[1170]: 2026/09/23 16:19:04 INFO Received push request method=POST path=/api/pushes machine # [ 396.391449] niks3-server[1170]: 2026/09/23 16:19:04 INFO Received sign narinfos request method=POST path=/api/pushes/20/sign machine # [ 396.393252] niks3-server[1170]: 2026/09/23 16:19:04 INFO Signed narinfos id=20 count=1 machine # [ 396.394121] niks3-server[1170]: 2026/09/23 16:19:04 INFO Registered completed upload object_key=nar/0p3l2z3riilylr2rxb1aq2blxdfxg55wbgp4gxkns93srbr4bwyq.nar.zst machine # [ 396.396800] niks3-server[1170]: 2026/09/23 16:19:04 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.ls machine # [ 396.398578] niks3-server[1170]: 2026/09/23 16:19:04 INFO Registered completed upload object_key=log/fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # [ 396.409650] niks3-server[1170]: 2026/09/23 16:19:04 INFO Received complete push request method=POST path=/api/pushes/20/complete machine # [ 396.411886] niks3-server[1170]: 2026/09/23 16:19:04 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo machine # [ 397.597245] systemd[1]: cri-containerd-d642ad9a70ee08caca23e5b79116eaa754f3f9a58028466484224232566d463b.scope: Deactivated successfully. machine # [ 397.598870] systemd[1]: cri-containerd-d642ad9a70ee08caca23e5b79116eaa754f3f9a58028466484224232566d463b.scope: Consumed 1.059s CPU time over 1min 44.823s wall clock time, 131.6M memory peak, 62M read from disk, 428K written to disk, 18.3K incoming IP traffic, 44.8K outgoing IP traffic. machine # [ 397.670525] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-d642ad9a70ee08caca23e5b79116eaa754f3f9a58028466484224232566d463b-rootfs.mount: Deactivated successfully. machine # [ 399.344996] systemd[1]: cri-containerd-8c1d0da5af687280de9f562ebf695f8e138fbe268d8c8e5be7a7fefa78c82b10.scope: Deactivated successfully. machine # [ 399.414975] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-8c1d0da5af687280de9f562ebf695f8e138fbe268d8c8e5be7a7fefa78c82b10-rootfs.mount: Deactivated successfully. machine # [ 399.461972] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-8c1d0da5af687280de9f562ebf695f8e138fbe268d8c8e5be7a7fefa78c82b10-shm.mount: Deactivated successfully. machine # [ 399.655480] cni0: port 1(veth53abafb4) entered disabled state machine # [ 399.504551] dhcpcd[679]: veth53abafb4: carrier lost machine # [ 399.658597] veth53abafb4 (unregistering): left allmulticast mode machine # [ 399.660062] veth53abafb4 (unregistering): left promiscuous mode machine # [ 399.661551] cni0: port 1(veth53abafb4) entered disabled state machine # [ 399.534044] systemd[1]: run-netns-cni\x2d362dc3d7\x2dc251\x2dd731\x2db407\x2d363c51957c2c.mount: Deactivated successfully. machine # [ 399.538264] dhcpcd[679]: veth53abafb4: deleting address fe80::c821:fcff:fe4a:4a7 machine # [ 399.542277] dhcpcd[679]: veth53abafb4: deleting route to 169.254.0.0/16 machine # [ 399.606340] dhcpcd[679]: veth53abafb4: removing interface machine # [ 399.746087] k3s[872]: I0923 16:19:07.663810 872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/58a1f329-4a36-43aa-9b4d-2c89cb069e3f-job\" (UniqueName: \"kubernetes.io/configmap/58a1f329-4a36-43aa-9b4d-2c89cb069e3f-job\") pod \"58a1f329-4a36-43aa-9b4d-2c89cb069e3f\" (UID: \"58a1f329-4a36-43aa-9b4d-2c89cb069e3f\") " machine # [ 399.746421] k3s[872]: I0923 16:19:07.663873 872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/58a1f329-4a36-43aa-9b4d-2c89cb069e3f-nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/58a1f329-4a36-43aa-9b4d-2c89cb069e3f-nix-grpc-farm\") pod \"58a1f329-4a36-43aa-9b4d-2c89cb069e3f\" (UID: \"58a1f329-4a36-43aa-9b4d-2c89cb069e3f\") " machine # [ 399.748410] k3s[872]: I0923 16:19:07.663916 872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/58a1f329-4a36-43aa-9b4d-2c89cb069e3f-kube-api-access-856bn\" (UniqueName: \"kubernetes.io/projected/58a1f329-4a36-43aa-9b4d-2c89cb069e3f-kube-api-access-856bn\") pod \"58a1f329-4a36-43aa-9b4d-2c89cb069e3f\" (UID: \"58a1f329-4a36-43aa-9b4d-2c89cb069e3f\") " machine # [ 399.750483] k3s[872]: I0923 16:19:07.664774 872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58a1f329-4a36-43aa-9b4d-2c89cb069e3f-job" pod "58a1f329-4a36-43aa-9b4d-2c89cb069e3f" (UID: "58a1f329-4a36-43aa-9b4d-2c89cb069e3f"). InnerVolumeSpecName "job". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 399.752478] systemd[1]: var-lib-kubelet-pods-58a1f329\x2d4a36\x2d43aa\x2d9b4d\x2d2c89cb069e3f-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2d856bn.mount: Deactivated successfully. machine # [ 399.786063] k3s[872]: I0923 16:19:07.704404 872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58a1f329-4a36-43aa-9b4d-2c89cb069e3f-kube-api-access-856bn" pod "58a1f329-4a36-43aa-9b4d-2c89cb069e3f" (UID: "58a1f329-4a36-43aa-9b4d-2c89cb069e3f"). InnerVolumeSpecName "kube-api-access-856bn". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 399.789698] systemd[1]: var-lib-kubelet-pods-58a1f329\x2d4a36\x2d43aa\x2d9b4d\x2d2c89cb069e3f-volumes-kubernetes.io\x7eprojected-nix\x2dgrpc\x2dfarm.mount: Deactivated successfully. machine # [ 399.793832] k3s[872]: I0923 16:19:07.712199 872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58a1f329-4a36-43aa-9b4d-2c89cb069e3f-nix-grpc-farm" pod "58a1f329-4a36-43aa-9b4d-2c89cb069e3f" (UID: "58a1f329-4a36-43aa-9b4d-2c89cb069e3f"). InnerVolumeSpecName "nix-grpc-farm". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 399.846100] k3s[872]: I0923 16:19:07.764324 872 reconciler_common.go:299] "Volume detached for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/58a1f329-4a36-43aa-9b4d-2c89cb069e3f-nix-grpc-farm\") on node \"machine\" DevicePath \"\"" machine # [ 399.852596] k3s[872]: I0923 16:19:07.764399 872 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-856bn\" (UniqueName: \"kubernetes.io/projected/58a1f329-4a36-43aa-9b4d-2c89cb069e3f-kube-api-access-856bn\") on node \"machine\" DevicePath \"\"" machine # [ 399.853255] k3s[872]: I0923 16:19:07.764438 872 reconciler_common.go:299] "Volume detached for volume \"job\" (UniqueName: \"kubernetes.io/configmap/58a1f329-4a36-43aa-9b4d-2c89cb069e3f-job\") on node \"machine\" DevicePath \"\"" machine # [ 400.327529] k3s[872]: I0923 16:19:08.245852 872 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8c1d0da5af687280de9f562ebf695f8e138fbe268d8c8e5be7a7fefa78c82b10" machine # [ 400.342301] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod58a1f329_4a36_43aa_9b4d_2c89cb069e3f.slice. machine # [ 400.342644] systemd[1]: kubepods-besteffort-pod58a1f329_4a36_43aa_9b4d_2c89cb069e3f.slice: Consumed 1.089s CPU time over 1min 50.020s wall clock time, 131.8M memory peak, 62M read from disk, 632K written to disk, 18.3K incoming IP traffic, 44.8K outgoing IP traffic. machine: (finished: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed', in 111.41 seconds) machine: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1 machine: (finished: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1, in 0.18 seconds) machine # don't know how to build these paths: machine # /nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-a> machine/nix-grpc-farm-worker-x86-64-linux-c74f46454-29n4v: building fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-b> machine/nix-grpc-farm-worker-x86-64-linux-c74f46454-29n4v: building 1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-top> machine/nix-grpc-farm-worker-x86-64-linux-c74f46454-29n4v: building rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # INFO:nix_fast_build.processes:run nix-eval-jobs --gc-roots-dir /tmp/tmprg4r75yw/gcroots --force-recurse --max-memory-size 4096 --workers 4 --flake '.#checks' --check-cache-status machine # INFO:nix_fast_build.workers:builds: 0 machine # warning: Git tree '/tmp' is dirty machine # warning: Git tree '/tmp' is dirty machine # ▶ x86_64-linux.t started machine # INFO:nix_fast_build.workers:builds: 2 machine # ✔ x86_64-linux.t (27s) machine # x86_64-linux.t> machine/nix-grpc-farm-worker-x86-64-linux-c74f46454-t2vtr: building fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # warning: Git tree '/tmp' is dirty machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath, in 0.12 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null, in 0.04 seconds) (finished: subtest: a Job with the client image builds through the farm with its service account, in 112.41 seconds) subtest: a renewed balancer certificate is served without a rollout machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f - machine # Warning: resource secrets/farm-lb-tls is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically. machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f -, in 0.27 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}', in 0.20 seconds) machine: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-75b44f88dd-4gcmd -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine # [ 402.884565] k3s[872]: E0923 16:19:10.801106 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51594: use of closed network connection machine # [ 404.221451] k3s[872]: E0923 16:19:12.138611 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56806: use of closed network connection machine # [ 405.501440] k3s[872]: E0923 16:19:13.419066 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56818: use of closed network connection machine # [ 406.825407] k3s[872]: E0923 16:19:14.743019 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56846: use of closed network connection machine # [ 408.161146] k3s[872]: E0923 16:19:16.078835 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56876: use of closed network connection machine # [ 409.436972] k3s[872]: time="2026-09-23T16:19:17Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:39224->127.0.0.1:10250: write: broken pipe" machine # [ 409.437271] k3s[872]: E0923 16:19:17.355375 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56908: use of closed network connection machine # [ 410.741115] k3s[872]: E0923 16:19:18.658878 872 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:58362->127.0.0.1:10010: write tcp 127.0.0.1:58362->127.0.0.1:10010: write: broken pipe machine # [ 412.028101] k3s[872]: E0923 16:19:19.945752 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56968: use of closed network connection machine # [ 413.330802] k3s[872]: E0923 16:19:21.248763 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55376: use of closed network connection machine # [ 414.007210] postgres[761]: [761] LOG: checkpoint complete: wrote 1037 buffers (6.3%), wrote 3 SLRU buffers; 1 WAL file(s) added, 0 removed, 0 recycled; write=103.922 s, sync=0.067 s, total=104.031 s; sync files=364, longest=0.004 s, average=0.001 s; distance=4978 kB, estimate=4978 kB; lsn=0/1C72DE0, redo lsn=0/1C42B50 machine # [ 414.635758] k3s[872]: E0923 16:19:22.553188 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55406: use of closed network connection machine # [ 415.934905] k3s[872]: E0923 16:19:23.852964 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55432: use of closed network connection machine # [ 418.535156] k3s[872]: E0923 16:19:26.452479 872 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:34268->127.0.0.1:10010: write tcp 127.0.0.1:34268->127.0.0.1:10010: write: broken pipe machine # [ 418.542159] k3s[872]: E0923 16:19:26.452694 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55480: use of closed network connection machine # [ 419.805117] k3s[872]: E0923 16:19:27.722701 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55504: use of closed network connection machine # [ 421.092420] k3s[872]: E0923 16:19:29.009696 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55526: use of closed network connection machine # [ 422.414871] k3s[872]: E0923 16:19:30.332252 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55532: use of closed network connection machine # [ 425.007692] k3s[872]: E0923 16:19:32.925745 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54210: use of closed network connection machine # [ 426.318411] k3s[872]: E0923 16:19:34.235924 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54228: use of closed network connection machine # [ 427.640695] k3s[872]: E0923 16:19:35.558752 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54264: use of closed network connection machine # [ 428.943097] k3s[872]: E0923 16:19:36.860399 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54286: use of closed network connection machine # [ 430.257222] k3s[872]: E0923 16:19:38.175231 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54312: use of closed network connection machine # [ 431.561764] k3s[872]: E0923 16:19:39.479415 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54348: use of closed network connection machine # [ 432.897412] k3s[872]: E0923 16:19:40.814938 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54388: use of closed network connection machine # [ 434.201324] k3s[872]: E0923 16:19:42.119144 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43552: use of closed network connection machine # [ 435.482063] k3s[872]: E0923 16:19:43.399599 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43580: use of closed network connection machine # [ 436.804172] k3s[872]: E0923 16:19:44.722205 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43590: use of closed network connection machine # [ 438.086112] k3s[872]: E0923 16:19:46.004146 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43620: use of closed network connection machine # [ 439.394816] k3s[872]: E0923 16:19:47.312880 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43650: use of closed network connection machine # [ 440.687547] k3s[872]: E0923 16:19:48.605068 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43684: use of closed network connection machine # [ 440.687804] k3s[872]: E0923 16:19:48.605848 872 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:51470->127.0.0.1:10010: write tcp 127.0.0.1:51470->127.0.0.1:10010: write: broken pipe machine # [ 440.688936] k3s[872]: time="2026-09-23T16:19:48Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:40804->127.0.0.1:10250: write: connection reset by peer" machine # [ 441.961578] k3s[872]: E0923 16:19:49.879504 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43714: use of closed network connection machine # [ 441.961899] k3s[872]: E0923 16:19:49.879628 872 upgradeaware.go:441] Error proxying data from backend to client: writeto tcp 127.0.0.1:51476->127.0.0.1:10010: read tcp 127.0.0.1:51476->127.0.0.1:10010: read: connection reset by peer machine # [ 441.962524] k3s[872]: time="2026-09-23T16:19:49Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:40820->127.0.0.1:10250: write: broken pipe" machine # [ 443.254452] k3s[872]: E0923 16:19:51.172084 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37960: use of closed network connection machine # [ 444.532924] k3s[872]: E0923 16:19:52.450966 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37972: use of closed network connection machine # [ 445.789801] k3s[872]: E0923 16:19:53.707753 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37998: use of closed network connection machine # [ 447.085147] k3s[872]: E0923 16:19:55.002838 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38012: use of closed network connection machine # [ 447.085323] k3s[872]: E0923 16:19:55.003116 872 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:41378->127.0.0.1:10010: write tcp 127.0.0.1:41378->127.0.0.1:10010: write: broken pipe machine # [ 448.415723] k3s[872]: E0923 16:19:56.333137 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38054: use of closed network connection machine # [ 449.662773] k3s[872]: E0923 16:19:57.580820 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38082: use of closed network connection machine # [ 450.953568] k3s[872]: E0923 16:19:58.871372 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38106: use of closed network connection machine # [ 452.249459] k3s[872]: E0923 16:20:00.167512 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38126: use of closed network connection machine # [ 453.544512] k3s[872]: E0923 16:20:01.460375 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:42076: use of closed network connection machine # [ 454.809350] k3s[872]: E0923 16:20:02.727271 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:42118: use of closed network connection machine # [ 456.130054] k3s[872]: E0923 16:20:04.047637 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:42142: use of closed network connection machine # [ 457.430878] k3s[872]: E0923 16:20:05.348929 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:42162: use of closed network connection machine # [ 458.714165] k3s[872]: E0923 16:20:06.632177 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:42188: use of closed network connection machine # [ 460.016791] k3s[872]: E0923 16:20:07.934817 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:42216: use of closed network connection machine: (finished: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-75b44f88dd-4gcmd -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 57.44 seconds) machine: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine: (finished: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 0.05 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1 machine # [ 460.270355] niks3-server[1170]: 2026/09/23 16:20:08 INFO Received push request method=POST path=/api/pushes machine # [ 460.291143] niks3-server[1170]: 2026/09/23 16:20:08 INFO Received sign narinfos request method=POST path=/api/pushes/21/sign machine # [ 460.295460] niks3-server[1170]: 2026/09/23 16:20:08 INFO Signed narinfos id=21 count=1 machine # [ 460.298574] niks3-server[1170]: 2026/09/23 16:20:08 INFO Registered completed upload object_key=nar/0g42hgwa9jp9abmqxz90dkwxpybsznzbpsy35rm921mlk5sw56jq.nar.zst machine # [ 460.304306] niks3-server[1170]: 2026/09/23 16:20:08 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.ls machine # [ 460.308776] niks3-server[1170]: 2026/09/23 16:20:08 INFO Received complete push request method=POST path=/api/pushes/21/complete machine # [ 460.312196] niks3-server[1170]: 2026/09/23 16:20:08 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.narinfo machine # [ 485.021832] niks3-server[1170]: 2026/09/23 16:20:32 INFO Received push request method=POST path=/api/pushes machine # [ 485.041837] niks3-server[1170]: 2026/09/23 16:20:32 INFO Received sign narinfos request method=POST path=/api/pushes/22/sign machine # [ 485.046120] niks3-server[1170]: 2026/09/23 16:20:32 INFO Registered completed upload object_key=nar/1vxmmzwi16s4iri6dcmi9v62dpq1ys7wz15b497ncik3sd67nfzg.nar.zst machine # [ 485.050987] niks3-server[1170]: 2026/09/23 16:20:32 INFO Signed narinfos id=22 count=1 machine # [ 485.054085] niks3-server[1170]: 2026/09/23 16:20:32 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.ls machine # [ 485.059949] niks3-server[1170]: 2026/09/23 16:20:32 INFO Registered completed upload object_key=log/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31-k3s-a.drv machine # [ 485.063774] niks3-server[1170]: 2026/09/23 16:20:32 INFO Received complete push request method=POST path=/api/pushes/22/complete machine # [ 485.067775] niks3-server[1170]: 2026/09/23 16:20:32 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo machine # [ 485.131583] niks3-server[1170]: 2026/09/23 16:20:33 INFO Received push request method=POST path=/api/pushes machine # [ 485.142602] niks3-server[1170]: 2026/09/23 16:20:33 INFO Received sign narinfos request method=POST path=/api/pushes/23/sign machine # [ 485.144639] niks3-server[1170]: 2026/09/23 16:20:33 INFO Signed narinfos id=23 count=1 machine # [ 485.148341] niks3-server[1170]: 2026/09/23 16:20:33 INFO Registered completed upload object_key=nar/0cbxkyxz068xc5mivh2h67kw6y01n1x28cbs11v1a03g8m4c71zm.nar.zst machine # [ 485.149675] niks3-server[1170]: 2026/09/23 16:20:33 INFO Received complete push request method=POST path=/api/pushes/23/complete machine # [ 485.153112] niks3-server[1170]: 2026/09/23 16:20:33 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.ls machine # [ 485.154360] niks3-server[1170]: 2026/09/23 16:20:33 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.narinfo machine # [ 509.472268] niks3-server[1170]: 2026/09/23 16:20:57 INFO Received push request method=POST path=/api/pushes machine # [ 509.492315] niks3-server[1170]: 2026/09/23 16:20:57 INFO Received sign narinfos request method=POST path=/api/pushes/24/sign machine # [ 509.494872] niks3-server[1170]: 2026/09/23 16:20:57 INFO Signed narinfos id=24 count=1 machine # [ 509.499475] niks3-server[1170]: 2026/09/23 16:20:57 INFO Registered completed upload object_key=nar/0khxywxb2r78vhpc5hsmha3ymgp910z0aka7550jmaqzs333rmzp.nar.zst machine # [ 509.501448] niks3-server[1170]: 2026/09/23 16:20:57 INFO Registered completed upload object_key=log/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4-k3s-b.drv machine # [ 509.503334] niks3-server[1170]: 2026/09/23 16:20:57 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.ls machine # [ 509.508281] niks3-server[1170]: 2026/09/23 16:20:57 INFO Received complete push request method=POST path=/api/pushes/24/complete machine # [ 509.514889] niks3-server[1170]: 2026/09/23 16:20:57 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.narinfo machine # [ 509.586477] niks3-server[1170]: 2026/09/23 16:20:57 INFO Received push request method=POST path=/api/pushes machine # [ 509.600266] niks3-server[1170]: 2026/09/23 16:20:57 INFO Received sign narinfos request method=POST path=/api/pushes/25/sign machine # [ 509.600803] niks3-server[1170]: 2026/09/23 16:20:57 INFO Signed narinfos id=25 count=1 machine # [ 509.606075] niks3-server[1170]: 2026/09/23 16:20:57 INFO Registered completed upload object_key=nar/04bim5f8bvjh25xncf5x40kb529khrlzcbc92qxvapgbc0bdfv2h.nar.zst machine # [ 509.608518] niks3-server[1170]: 2026/09/23 16:20:57 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.ls machine # [ 509.610469] niks3-server[1170]: 2026/09/23 16:20:57 INFO Received complete push request method=POST path=/api/pushes/25/complete machine # [ 509.614693] niks3-server[1170]: 2026/09/23 16:20:57 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.narinfo machine # [ 534.123654] niks3-server[1170]: 2026/09/23 16:21:22 INFO Received push request method=POST path=/api/pushes machine # [ 534.136156] niks3-server[1170]: 2026/09/23 16:21:22 INFO Received sign narinfos request method=POST path=/api/pushes/26/sign machine # [ 534.140380] niks3-server[1170]: 2026/09/23 16:21:22 INFO Signed narinfos id=26 count=1 machine # [ 534.143619] niks3-server[1170]: 2026/09/23 16:21:22 INFO Registered completed upload object_key=nar/11f7f1hixry25c2yc6np9hs10a2pwwqmymmrxxbswhdjabcyvv0s.nar.zst machine # [ 534.148949] niks3-server[1170]: 2026/09/23 16:21:22 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.ls machine # [ 534.155061] niks3-server[1170]: 2026/09/23 16:21:22 INFO Received complete push request method=POST path=/api/pushes/26/complete machine # [ 534.158158] niks3-server[1170]: 2026/09/23 16:21:22 INFO Registered completed upload object_key=log/jz7biafi8rj5r3r392blyazw5mdpvy0d-k3s-top.drv machine # [ 534.161936] niks3-server[1170]: 2026/09/23 16:21:22 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1, in 74.11 seconds) (finished: subtest: a renewed balancer certificate is served without a rollout, in 132.07 seconds) subtest: metrics carry build_info machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-c74f46454-29n4v -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-c74f46454-29n4v -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.14 seconds) machine: must succeed: curl -sf http://10.42.0.7:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-c74f46454-29n4v"' machine: (finished: must succeed: curl -sf http://10.42.0.7:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-c74f46454-29n4v"', in 0.03 seconds) (finished: subtest: metrics carry build_info, in 0.17 seconds) subtest: harmonia-gc frees space and the worker stays Ready machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-c74f46454-29n4v -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'' machine # [ 534.521974] k3s[872]: E0923 16:21:22.440044 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46226: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-c74f46454-29n4v -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'', in 0.18 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-c74f46454-29n4v -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done' machine # [ 534.771848] k3s[872]: time="2026-09-23T16:21:22Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:46266->127.0.0.1:10250: write: connection reset by peer" machine # [ 534.774063] k3s[872]: E0923 16:21:22.689882 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46250: use of closed network connection machine # [ 534.775948] k3s[872]: E0923 16:21:22.689908 872 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:45568->127.0.0.1:10010: write tcp 127.0.0.1:45568->127.0.0.1:10010: write: broken pipe machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-c74f46454-29n4v -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done', in 0.25 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-c74f46454-29n4v -c gc -- sh -c 'fallocate -l 11443200000 /nix/fill' machine # [ 534.951912] k3s[872]: E0923 16:21:22.870214 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46276: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-c74f46454-29n4v -c gc -- sh -c 'fallocate -l 11443200000 /nix/fill', in 0.18 seconds) machine: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-c74f46454-29n4v -c gc --since=30s | grep -q 'store paths deleted' machine: (finished: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-c74f46454-29n4v -c gc --since=30s | grep -q 'store paths deleted', in 8.68 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-c74f46454-29n4v -c gc -- sh -c 'rm /nix/fill' machine # [ 543.820804] k3s[872]: E0923 16:21:31.738549 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:52820: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-c74f46454-29n4v -c gc -- sh -c 'rm /nix/fill', in 0.19 seconds) machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-c74f46454-29n4v -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-c74f46454-29n4v -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}', in 0.14 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-c74f46454-29n4v -c gc -- sh -c 'command -v nix-daemon && command -v niks3' machine # [ 544.132193] k3s[872]: E0923 16:21:32.050418 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:52862: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-c74f46454-29n4v -c gc -- sh -c 'command -v nix-daemon && command -v niks3', in 0.17 seconds) (finished: subtest: harmonia-gc frees space and the worker stays Ready, in 9.79 seconds) subtest: losing the balancer mid-build: the client reconnects and the build succeeds machine: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1 machine # [ 544.155937] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1. machine # Running as unit: vialb.service; invocation ID: 9360979adab84b5a85b5a8c1970cbf38 machine: (finished: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1, in 0.02 seconds) machine: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'" machine # [ 544.277603] nix[10777]: don't know how to build these paths: machine # [ 544.277893] nix[10777]: /nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 544.300330] nix[10777]: copying 1 paths to '127.0.0.1:30051'... machine # [ 544.301176] nix[10777]: copying path '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' to '127.0.0.1:30051'... machine # [ 544.353362] niks3-server[1170]: 2026/09/23 16:21:32 INFO Received push request method=POST path=/api/pushes machine # [ 544.369069] niks3-server[1170]: 2026/09/23 16:21:32 INFO Received sign narinfos request method=POST path=/api/pushes/27/sign machine # [ 544.369512] niks3-server[1170]: 2026/09/23 16:21:32 INFO Registered completed upload object_key=nar/0kkr2vb091wkq0cb0f1q92413dsfskh76wydp8mwysv7rawns0ar.nar.zst machine # [ 544.370119] niks3-server[1170]: 2026/09/23 16:21:32 INFO Signed narinfos id=27 count=1 machine # [ 544.374821] niks3-server[1170]: 2026/09/23 16:21:32 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.ls machine # [ 544.376893] niks3-server[1170]: 2026/09/23 16:21:32 INFO Received complete push request method=POST path=/api/pushes/27/complete machine # [ 544.381678] niks3-server[1170]: 2026/09/23 16:21:32 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.narinfo machine # [ 544.390202] nix[10777]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 544.390816] nix[10777]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-c74f46454-t2vtr: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine: (finished: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'", in 1.06 seconds) machine: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false machine: (finished: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false, in 0.29 seconds) machine: waiting for success: ! systemctl is-active vialb machine # [ 545.533911] nix[10777]: scheduler at 127.0.0.1:30051: Stream removed (Socket closed), reconnecting machine # [ 545.534490] nix[10777]: d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv: Stream removed (Socket closed), asking the scheduler again machine # [ 545.559524] systemd[1]: cri-containerd-bfd49909cb7c4a97fc2a733db74784b40d13ee50803c8338a0c9565893c85003.scope: Deactivated successfully. machine # [ 545.559730] systemd[1]: cri-containerd-bfd49909cb7c4a97fc2a733db74784b40d13ee50803c8338a0c9565893c85003.scope: Consumed 5.256s CPU time over 8min 14.207s wall clock time, 58.5M memory peak, 36.4M read from disk, 621.2K incoming IP traffic, 759.1K outgoing IP traffic. machine # [ 545.590675] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-bfd49909cb7c4a97fc2a733db74784b40d13ee50803c8338a0c9565893c85003-rootfs.mount: Deactivated successfully. machine # [ 545.622410] systemd[1]: cri-containerd-54c741c21424f62b01f0b93f2dd105b45fe50b432559c1490bdf3e4095156af8.scope: Deactivated successfully. machine # [ 545.654395] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-54c741c21424f62b01f0b93f2dd105b45fe50b432559c1490bdf3e4095156af8-rootfs.mount: Deactivated successfully. machine # [ 545.678671] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-54c741c21424f62b01f0b93f2dd105b45fe50b432559c1490bdf3e4095156af8-shm.mount: Deactivated successfully. machine # [ 545.860824] cni0: port 5(veth4faf991b) entered disabled state machine # [ 545.709788] dhcpcd[679]: veth4faf991b: carrier lost machine # [ 545.863296] veth4faf991b (unregistering): left allmulticast mode machine # [ 545.865091] veth4faf991b (unregistering): left promiscuous mode machine # [ 545.866354] cni0: port 5(veth4faf991b) entered disabled state machine # [ 545.734631] systemd[1]: run-netns-cni\x2dae164c21\x2d4619\x2d78e7\x2d6f4d\x2d40c196e284c1.mount: Deactivated successfully. machine # [ 545.739080] dhcpcd[679]: veth4faf991b: deleting address fe80::c04:67ff:fe4b:5b3b machine # [ 545.742263] dhcpcd[679]: veth4faf991b: deleting route to 169.254.0.0/16 machine # [ 545.783556] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod042c908d_7151_43f7_a273_28ca7510097e.slice. machine # [ 545.813349] dhcpcd[679]: veth4faf991b: removing interface machine # [ 545.872698] k3s[872]: I0923 16:21:33.790690 872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/245d5805-dcfb-4afd-9c33-c8f8f9647e2a-tmp\" (UniqueName: \"kubernetes.io/empty-dir/245d5805-dcfb-4afd-9c33-c8f8f9647e2a-tmp\") pod \"245d5805-dcfb-4afd-9c33-c8f8f9647e2a\" (UID: \"245d5805-dcfb-4afd-9c33-c8f8f9647e2a\") " machine # [ 545.877145] k3s[872]: I0923 16:21:33.790754 872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/245d5805-dcfb-4afd-9c33-c8f8f9647e2a-config\" (UniqueName: \"kubernetes.io/configmap/245d5805-dcfb-4afd-9c33-c8f8f9647e2a-config\") pod \"245d5805-dcfb-4afd-9c33-c8f8f9647e2a\" (UID: \"245d5805-dcfb-4afd-9c33-c8f8f9647e2a\") " machine # [ 545.881505] k3s[872]: I0923 16:21:33.790786 872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/245d5805-dcfb-4afd-9c33-c8f8f9647e2a-tls-lb\" (UniqueName: \"kubernetes.io/secret/245d5805-dcfb-4afd-9c33-c8f8f9647e2a-tls-lb\") pod \"245d5805-dcfb-4afd-9c33-c8f8f9647e2a\" (UID: \"245d5805-dcfb-4afd-9c33-c8f8f9647e2a\") " machine # [ 545.885804] k3s[872]: I0923 16:21:33.790819 872 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/245d5805-dcfb-4afd-9c33-c8f8f9647e2a-tls-ca\" (UniqueName: \"kubernetes.io/secret/245d5805-dcfb-4afd-9c33-c8f8f9647e2a-tls-ca\") pod \"245d5805-dcfb-4afd-9c33-c8f8f9647e2a\" (UID: \"245d5805-dcfb-4afd-9c33-c8f8f9647e2a\") " machine # [ 545.889982] k3s[872]: I0923 16:21:33.790870 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/042c908d-7151-43f7-a273-28ca7510097e-tls-ca\") pod \"nix-grpc-farm-lb-75b44f88dd-2cw29\" (UID: \"042c908d-7151-43f7-a273-28ca7510097e\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-2cw29" machine # [ 545.894315] k3s[872]: I0923 16:21:33.790903 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/042c908d-7151-43f7-a273-28ca7510097e-config\") pod \"nix-grpc-farm-lb-75b44f88dd-2cw29\" (UID: \"042c908d-7151-43f7-a273-28ca7510097e\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-2cw29" machine # [ 545.898403] k3s[872]: I0923 16:21:33.790937 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/042c908d-7151-43f7-a273-28ca7510097e-tmp\") pod \"nix-grpc-farm-lb-75b44f88dd-2cw29\" (UID: \"042c908d-7151-43f7-a273-28ca7510097e\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-2cw29" machine # [ 545.902477] k3s[872]: I0923 16:21:33.790966 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/042c908d-7151-43f7-a273-28ca7510097e-tls-lb\") pod \"nix-grpc-farm-lb-75b44f88dd-2cw29\" (UID: \"042c908d-7151-43f7-a273-28ca7510097e\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-2cw29" machine # [ 545.906598] systemd[1]: var-lib-kubelet-pods-245d5805\x2ddcfb\x2d4afd\x2d9c33\x2dc8f8f9647e2a-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 545.908584] k3s[872]: I0923 16:21:33.799973 872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/245d5805-dcfb-4afd-9c33-c8f8f9647e2a-tmp" pod "245d5805-dcfb-4afd-9c33-c8f8f9647e2a" (UID: "245d5805-dcfb-4afd-9c33-c8f8f9647e2a"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 545.912462] k3s[872]: I0923 16:21:33.801180 872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/245d5805-dcfb-4afd-9c33-c8f8f9647e2a-tls-ca" pod "245d5805-dcfb-4afd-9c33-c8f8f9647e2a" (UID: "245d5805-dcfb-4afd-9c33-c8f8f9647e2a"). InnerVolumeSpecName "tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 545.916268] k3s[872]: I0923 16:21:33.801604 872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/245d5805-dcfb-4afd-9c33-c8f8f9647e2a-tls-lb" pod "245d5805-dcfb-4afd-9c33-c8f8f9647e2a" (UID: "245d5805-dcfb-4afd-9c33-c8f8f9647e2a"). InnerVolumeSpecName "tls-lb". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 545.920133] k3s[872]: I0923 16:21:33.810140 872 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/245d5805-dcfb-4afd-9c33-c8f8f9647e2a-config" pod "245d5805-dcfb-4afd-9c33-c8f8f9647e2a" (UID: "245d5805-dcfb-4afd-9c33-c8f8f9647e2a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 545.924164] systemd[1]: var-lib-kubelet-pods-245d5805\x2ddcfb\x2d4afd\x2d9c33\x2dc8f8f9647e2a-volumes-kubernetes.io\x7esecret-tls\x2dca.mount: Deactivated successfully. machine # [ 545.938765] k3s[872]: I0923 16:21:33.857120 872 scope.go:122] "RemoveContainer" containerID="bfd49909cb7c4a97fc2a733db74784b40d13ee50803c8338a0c9565893c85003" machine # [ 545.947663] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod245d5805_dcfb_4afd_9c33_c8f8f9647e2a.slice. machine # [ 545.949472] systemd[1]: kubepods-besteffort-pod245d5805_dcfb_4afd_9c33_c8f8f9647e2a.slice: Consumed 5.288s CPU time over 8min 16.629s wall clock time, 58.8M memory peak, 36.4M read from disk, 621.2K incoming IP traffic, 759.1K outgoing IP traffic. machine # [ 545.953326] k3s[872]: I0923 16:21:33.871721 872 scope.go:122] "RemoveContainer" containerID="bfd49909cb7c4a97fc2a733db74784b40d13ee50803c8338a0c9565893c85003" machine # [ 545.955285] k3s[872]: E0923 16:21:33.872279 872 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"bfd49909cb7c4a97fc2a733db74784b40d13ee50803c8338a0c9565893c85003\": not found" containerID="bfd49909cb7c4a97fc2a733db74784b40d13ee50803c8338a0c9565893c85003" machine # [ 545.961205] k3s[872]: I0923 16:21:33.872314 872 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"bfd49909cb7c4a97fc2a733db74784b40d13ee50803c8338a0c9565893c85003"} err="failed to get container status \"bfd49909cb7c4a97fc2a733db74784b40d13ee50803c8338a0c9565893c85003\": rpc error: code = NotFound desc = an error occurred when try to find container \"bfd49909cb7c4a97fc2a733db74784b40d13ee50803c8338a0c9565893c85003\": not found" machine # [ 545.973197] k3s[872]: I0923 16:21:33.891556 872 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/245d5805-dcfb-4afd-9c33-c8f8f9647e2a-config\") on node \"machine\" DevicePath \"\"" machine # [ 545.973595] k3s[872]: I0923 16:21:33.891581 872 reconciler_common.go:299] "Volume detached for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/245d5805-dcfb-4afd-9c33-c8f8f9647e2a-tls-lb\") on node \"machine\" DevicePath \"\"" machine # [ 545.974100] k3s[872]: I0923 16:21:33.891712 872 reconciler_common.go:299] "Volume detached for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/245d5805-dcfb-4afd-9c33-c8f8f9647e2a-tls-ca\") on node \"machine\" DevicePath \"\"" machine # [ 545.974547] k3s[872]: I0923 16:21:33.892778 872 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/245d5805-dcfb-4afd-9c33-c8f8f9647e2a-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 546.262754] cni0: port 1(vethfa7f0ef0) entered blocking state machine # [ 546.264039] cni0: port 1(vethfa7f0ef0) entered disabled state machine # [ 546.264942] vethfa7f0ef0: entered allmulticast mode machine # [ 546.265844] vethfa7f0ef0: entered promiscuous mode machine # [ 546.116140] (udev-worker)[10956]: Network interface NamePolicy= disabled on kernel command line. machine # [ 546.273618] cni0: port 1(vethfa7f0ef0) entered blocking state machine # [ 546.274508] cni0: port 1(vethfa7f0ef0) entered forwarding state machine # [ 546.141871] dhcpcd[679]: vethfa7f0ef0: IAID 19:d8:09:8d machine # [ 546.142168] dhcpcd[679]: vethfa7f0ef0: adding address fe80::e8de:19ff:fed8:98d machine # [ 546.202413] systemd[1]: Started libcontainer container 0e004e279d1dd4f491dcc8d7bd70247dd2200e6f73c79732bc7087668201c8ee. machine # [ 546.329456] systemd[1]: Started libcontainer container 6c12f63a78cfe14c828b89520bbfd3f100143867dc6b053b72b2f1e6601c6353. machine # [ 546.388859] dhcpcd[679]: vethfa7f0ef0: soliciting a DHCP lease machine # [ 546.613291] systemd[1]: var-lib-kubelet-pods-245d5805\x2ddcfb\x2d4afd\x2d9c33\x2dc8f8f9647e2a-volume\x2dsubpaths-config-envoy-2.mount: Deactivated successfully. machine # [ 546.614245] systemd[1]: var-lib-kubelet-pods-245d5805\x2ddcfb\x2d4afd\x2d9c33\x2dc8f8f9647e2a-volume\x2dsubpaths-config-envoy-1.mount: Deactivated successfully. machine # [ 546.616112] systemd[1]: var-lib-kubelet-pods-245d5805\x2ddcfb\x2d4afd\x2d9c33\x2dc8f8f9647e2a-volume\x2dsubpaths-config-envoy-0.mount: Deactivated successfully. machine # [ 546.617294] systemd[1]: var-lib-kubelet-pods-245d5805\x2ddcfb\x2d4afd\x2d9c33\x2dc8f8f9647e2a-volumes-kubernetes.io\x7esecret-tls\x2dlb.mount: Deactivated successfully. machine # [ 546.968760] k3s[872]: I0923 16:21:34.885195 872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-75b44f88dd-2cw29" podStartSLOduration=1.88515252 podStartE2EDuration="1.88515252s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-23 16:21:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-23 16:21:34.884865612 +0000 UTC m=+531.706996220" watchObservedRunningTime="2026-09-23 16:21:34.88515252 +0000 UTC m=+531.707282849" machine # [ 547.669099] k3s[872]: I0923 16:21:35.587325 872 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="245d5805-dcfb-4afd-9c33-c8f8f9647e2a" path="/var/lib/kubelet/pods/245d5805-dcfb-4afd-9c33-c8f8f9647e2a/volumes" machine # [ 548.037754] nix[10777]: scheduler at 127.0.0.1:30051: failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:30051: tcp handshaker shutdown, reconnecting machine # [ 548.183651] dhcpcd[679]: vethfa7f0ef0: soliciting an IPv6 router machine # [ 549.079929] nix[10777]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 549.083455] nix[10777]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-c74f46454-29n4v: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 551.390821] dhcpcd[679]: vethfa7f0ef0: probing for an IPv4LL address machine # [ 557.044990] dhcpcd[679]: vethfa7f0ef0: using IPv4LL address 169.254.146.172 machine # [ 557.045545] dhcpcd[679]: vethfa7f0ef0: adding route to 169.254.0.0/16 machine # [ 560.188136] dhcpcd[679]: vethfa7f0ef0: no IPv6 Routers available machine # [ 593.617893] niks3-server[1170]: 2026/09/23 16:22:21 INFO Received push request method=POST path=/api/pushes machine # [ 593.633631] niks3-server[1170]: 2026/09/23 16:22:21 INFO Received sign narinfos request method=POST path=/api/pushes/28/sign machine # [ 593.636879] niks3-server[1170]: 2026/09/23 16:22:21 INFO Signed narinfos id=28 count=1 machine # [ 593.640570] niks3-server[1170]: 2026/09/23 16:22:21 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.ls machine # [ 593.643306] niks3-server[1170]: 2026/09/23 16:22:21 INFO Registered completed upload object_key=log/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 593.645780] niks3-server[1170]: 2026/09/23 16:22:21 INFO Received complete push request method=POST path=/api/pushes/28/complete machine # [ 593.649904] niks3-server[1170]: 2026/09/23 16:22:21 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.narinfo machine # [ 593.682880] systemd[1]: vialb.service: Deactivated successfully. machine # [ 593.684311] systemd[1]: vialb.service: Consumed 213ms CPU time over 49.526s wall clock time, 40.7M memory peak, 4K written to disk, 8.5K incoming IP traffic, 17.3K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active vialb, in 48.84 seconds) machine: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; }, in 0.03 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 0.17 seconds) (finished: subtest: losing the balancer mid-build: the client reconnects and the build succeeds, in 50.41 seconds) subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes machine: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 machine # [ 594.573798] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1. machine # Running as unit: slow.service; invocation ID: efd56f0d8f47416ea7024f71ebe1f72c machine: (finished: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1, in 0.03 seconds) machine # [ 594.695438] nix[11760]: don't know how to build these paths: machine # [ 594.695664] nix[11760]: /nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 594.712459] nix[11760]: copying 1 paths to '127.0.0.1:30051'... machine # [ 594.713167] nix[11760]: copying path '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' to '127.0.0.1:30051'... machine # [ 594.749737] niks3-server[1170]: 2026/09/23 16:22:22 INFO Received push request method=POST path=/api/pushes machine # [ 594.761995] niks3-server[1170]: 2026/09/23 16:22:22 INFO Received sign narinfos request method=POST path=/api/pushes/29/sign machine # [ 594.762167] niks3-server[1170]: 2026/09/23 16:22:22 INFO Signed narinfos id=29 count=1 machine # [ 594.765519] niks3-server[1170]: 2026/09/23 16:22:22 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.ls machine # [ 594.767810] niks3-server[1170]: 2026/09/23 16:22:22 INFO Registered completed upload object_key=nar/0wl2i9xpw0gwrx1xqdgx9ka4n503ky9qhl20pdrdlphn8d6lcx0i.nar.zst machine # [ 594.771922] niks3-server[1170]: 2026/09/23 16:22:22 INFO Received complete push request method=POST path=/api/pushes/29/complete machine # [ 594.776068] niks3-server[1170]: 2026/09/23 16:22:22 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.narinfo machine # [ 594.780229] k3s[872]: E0923 16:22:22.698265 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38888: use of closed network connection machine # command terminated with exit code 1 machine # [ 594.782731] nix[11760]: building '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' on 127.0.0.1:30051... machine # [ 594.783267] nix[11760]: slow-s1> machine/nix-grpc-farm-worker-x86-64-linux-c74f46454-t2vtr: building zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # command terminated with exit code 1 machine # [ 594.955138] k3s[872]: E0923 16:22:22.873501 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38922: use of closed network connection machine # [ 596.211163] k3s[872]: E0923 16:22:24.129183 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38948: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 596.394274] k3s[872]: E0923 16:22:24.311986 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38970: use of closed network connection machine # command terminated with exit code 1 machine # [ 597.630513] k3s[872]: E0923 16:22:25.548488 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39014: use of closed network connection machine # [ 597.804388] k3s[872]: E0923 16:22:25.722743 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39058: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 599.027749] k3s[872]: E0923 16:22:26.945682 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39088: use of closed network connection machine # command terminated with exit code 1 machine # [ 599.232644] k3s[872]: E0923 16:22:27.150605 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39118: use of closed network connection machine # command terminated with exit code 1 machine # [ 600.477885] k3s[872]: E0923 16:22:28.395806 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39142: use of closed network connection machine # [ 600.659061] k3s[872]: E0923 16:22:28.577326 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39158: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 601.903947] k3s[872]: E0923 16:22:29.821412 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39182: use of closed network connection machine # [ 602.072871] k3s[872]: E0923 16:22:29.991208 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39204: use of closed network connection machine # command terminated with exit code 1 machine # [ 603.369363] k3s[872]: E0923 16:22:31.287317 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57218: use of closed network connection machine # [ 603.369585] k3s[872]: time="2026-09-23T16:22:31Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:39422->127.0.0.1:10250: write: broken pipe" machine # command terminated with exit code 1 machine # [ 603.566038] k3s[872]: E0923 16:22:31.484359 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57244: use of closed network connection machine # command terminated with exit code 1 machine # [ 604.850261] k3s[872]: E0923 16:22:32.768285 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57270: use of closed network connection machine # command terminated with exit code 1 machine # [ 605.041950] k3s[872]: E0923 16:22:32.960267 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57294: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 606.387453] k3s[872]: E0923 16:22:34.305249 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57316: use of closed network connection machine # [ 606.582332] k3s[872]: E0923 16:22:34.500527 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57338: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 607.865244] k3s[872]: E0923 16:22:35.783173 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57370: use of closed network connection machine # [ 608.057887] k3s[872]: E0923 16:22:35.976226 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57392: use of closed network connection machine # command terminated with exit code 1 machine # [ 609.358990] k3s[872]: E0923 16:22:37.277043 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57424: use of closed network connection machine # command terminated with exit code 1 machine # [ 609.566554] k3s[872]: E0923 16:22:37.484884 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57442: use of closed network connection machine # command terminated with exit code 1 machine # [ 610.108525] postgres[761]: [761] LOG: checkpoint starting: time machine # command terminated with exit code 1 machine # [ 610.897158] k3s[872]: E0923 16:22:38.814214 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57474: use of closed network connection machine # [ 610.898360] k3s[872]: time="2026-09-23T16:22:38Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:39510->127.0.0.1:10250: write: connection reset by peer" machine # [ 611.123484] k3s[872]: E0923 16:22:39.041847 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57508: use of closed network connection machine # command terminated with exit code 1 machine # [ 611.126157] k3s[872]: time="2026-09-23T16:22:39Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:39516->127.0.0.1:10250: write: broken pipe" machine # command terminated with exit code 1 machine # [ 612.398788] k3s[872]: E0923 16:22:40.316538 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57524: use of closed network connection machine # [ 612.545420] postgres[761]: [761] LOG: checkpoint complete: wrote 24 buffers (0.1%), wrote 1 SLRU buffers; 0 WAL file(s) added, 0 removed, 0 recycled; write=2.412 s, sync=0.009 s, total=2.438 s; sync files=21, longest=0.004 s, average=0.001 s; distance=235 kB, estimate=4504 kB; lsn=0/1C7D9E0, redo lsn=0/1C7D988 machine # [ 612.616815] k3s[872]: E0923 16:22:40.535167 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57560: use of closed network connection machine # command terminated with exit code 1 machine # [ 613.914687] k3s[872]: E0923 16:22:41.832667 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:44428: use of closed network connection machine # command terminated with exit code 1 machine # [ 614.112783] k3s[872]: E0923 16:22:42.031128 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:44472: use of closed network connection machine # command terminated with exit code 1 machine # [ 615.407275] k3s[872]: E0923 16:22:43.325170 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:44500: use of closed network connection machine # command terminated with exit code 1 machine # [ 615.407657] k3s[872]: time="2026-09-23T16:22:43Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:44214->127.0.0.1:10250: write: broken pipe" machine # command terminated with exit code 1 machine # [ 615.591304] k3s[872]: E0923 16:22:43.509402 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:44532: use of closed network connection machine # command terminated with exit code 1 machine # [ 616.923467] k3s[872]: E0923 16:22:44.841528 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:44564: use of closed network connection machine # command terminated with exit code 1 machine # [ 617.117841] k3s[872]: E0923 16:22:45.035929 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:44598: use of closed network connection machine # [ 618.204823] k3s[872]: I0923 16:22:46.120933 872 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 618.374613] k3s[872]: E0923 16:22:46.292940 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:44624: use of closed network connection machine # command terminated with exit code 1 machine # [ 618.557891] k3s[872]: E0923 16:22:46.476205 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:44650: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 619.812478] k3s[872]: E0923 16:22:47.730562 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:44688: use of closed network connection machine # [ 620.003814] k3s[872]: E0923 16:22:47.922165 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:44724: use of closed network connection machine # [ 620.187387] k3s[872]: E0923 16:22:48.105433 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:44754: use of closed network connection machine # command terminated with exit code 1 machine # [ 620.364315] k3s[872]: E0923 16:22:48.282677 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:44790: use of closed network connection machine: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-c74f46454-t2vtr --wait=false machine: (finished: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-c74f46454-t2vtr --wait=false, in 0.14 seconds) machine: must succeed: sleep 5.0 machine # [ 620.547504] systemd[1]: cri-containerd-f7cdb7ebf484fc585871002d37d71119f477c94fead850933ef305802e3414ae.scope: Deactivated successfully. machine # [ 620.548623] systemd[1]: cri-containerd-f7cdb7ebf484fc585871002d37d71119f477c94fead850933ef305802e3414ae.scope: Consumed 537ms CPU time over 9min 20.990s wall clock time, 12.4M memory peak, 5.2M read from disk. machine # [ 620.583335] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-f7cdb7ebf484fc585871002d37d71119f477c94fead850933ef305802e3414ae-rootfs.mount: Deactivated successfully. machine # [ 621.529197] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod106f2ec5_0a76_462c_a7a6_424d1988c655.slice. machine # [ 621.552469] k3s[872]: I0923 16:22:49.470310 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/106f2ec5-0a76-462c-a7a6-424d1988c655-build\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-q8nm7\" (UID: \"106f2ec5-0a76-462c-a7a6-424d1988c655\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-q8nm7" machine # [ 621.562051] k3s[872]: I0923 16:22:49.475973 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/106f2ec5-0a76-462c-a7a6-424d1988c655-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-q8nm7\" (UID: \"106f2ec5-0a76-462c-a7a6-424d1988c655\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-q8nm7" machine # [ 621.567071] k3s[872]: I0923 16:22:49.476014 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/106f2ec5-0a76-462c-a7a6-424d1988c655-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-q8nm7\" (UID: \"106f2ec5-0a76-462c-a7a6-424d1988c655\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-q8nm7" machine # [ 621.571795] k3s[872]: I0923 16:22:49.476039 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/106f2ec5-0a76-462c-a7a6-424d1988c655-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-q8nm7\" (UID: \"106f2ec5-0a76-462c-a7a6-424d1988c655\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-q8nm7" machine # [ 621.576921] k3s[872]: I0923 16:22:49.476069 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfjfh\" (UniqueName: \"kubernetes.io/projected/106f2ec5-0a76-462c-a7a6-424d1988c655-kube-api-access-qfjfh\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-q8nm7\" (UID: \"106f2ec5-0a76-462c-a7a6-424d1988c655\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-q8nm7" machine # [ 621.581806] k3s[872]: I0923 16:22:49.476106 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/106f2ec5-0a76-462c-a7a6-424d1988c655-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-q8nm7\" (UID: \"106f2ec5-0a76-462c-a7a6-424d1988c655\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-q8nm7" machine # [ 621.586230] k3s[872]: I0923 16:22:49.476132 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/106f2ec5-0a76-462c-a7a6-424d1988c655-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-q8nm7\" (UID: \"106f2ec5-0a76-462c-a7a6-424d1988c655\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-q8nm7" machine # [ 621.590562] k3s[872]: I0923 16:22:49.476158 872 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/106f2ec5-0a76-462c-a7a6-424d1988c655-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-q8nm7\" (UID: \"106f2ec5-0a76-462c-a7a6-424d1988c655\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-q8nm7" machine # [ 622.047042] cni0: port 5(veth5f249aa2) entered blocking state machine # [ 622.048877] cni0: port 5(veth5f249aa2) entered disabled state machine # [ 622.051242] veth5f249aa2: entered allmulticast mode machine # [ 622.053794] veth5f249aa2: entered promiscuous mode machine # [ 622.067259] cni0: port 5(veth5f249aa2) entered blocking state machine # [ 622.068972] cni0: port 5(veth5f249aa2) entered forwarding state machine # [ 621.950169] (udev-worker)[13414]: Network interface NamePolicy= disabled on kernel command line. machine # [ 621.976723] dhcpcd[679]: veth5f249aa2: IAID f7:b7:f5:2e machine # [ 621.977642] dhcpcd[679]: veth5f249aa2: adding address fe80::dc04:f7ff:feb7:f52e machine # [ 622.009492] systemd[1]: Started libcontainer container 55cea663b4427d36ba603a4d4509c6857cb83beb6f4f8c3f6fbfa139ff600ac9. machine # [ 622.300549] systemd[1]: Started libcontainer container a81538c3a98e600ec4fdb8533d9d0a1c395e3238b834abc424edf291c6b3ed5c. machine # [ 622.592788] dhcpcd[679]: veth5f249aa2: soliciting a DHCP lease machine # [ 624.288585] dhcpcd[679]: veth5f249aa2: soliciting an IPv6 router machine # [ 624.760908] systemd[1]: cri-containerd-a81538c3a98e600ec4fdb8533d9d0a1c395e3238b834abc424edf291c6b3ed5c.scope: Deactivated successfully. machine # [ 624.765786] systemd[1]: cri-containerd-a81538c3a98e600ec4fdb8533d9d0a1c395e3238b834abc424edf291c6b3ed5c.scope: Consumed 1.121s CPU time over 2.459s wall clock time, 479.2M memory peak, 185.8M read from disk, 148.4M written to disk. machine # [ 624.824236] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-a81538c3a98e600ec4fdb8533d9d0a1c395e3238b834abc424edf291c6b3ed5c-rootfs.mount: Deactivated successfully. machine # [ 625.396887] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped2234392237.mount: Deactivated successfully. machine # [ 625.480374] systemd[1]: Started libcontainer container c5e17b32adb0a35adb4783bcd27f1c82af7f849152783a3039137917aec52803. machine: (finished: must succeed: sleep 5.0, in 5.03 seconds) machine # [ 625.676506] systemd[1]: Started libcontainer container e4335f22d2c4ce54650629daf8f2c5c485ac8e7b329f4408d46e58bf46b6e75d. machine # [ 625.758035] k3s[872]: E0923 16:22:53.676068 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:49548: use of closed network connection machine # command terminated with exit code 1 machine # [ 625.831533] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped3688333951.mount: Deactivated successfully. machine # [ 625.837058] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped499302748.mount: Deactivated successfully. machine # [ 625.841050] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount176048528.mount: Deactivated successfully. machine # [ 625.880701] systemd[1]: tmp-ovl\x2didmapped325673082.mount: Deactivated successfully. machine # [ 625.894304] systemd[1]: Started libcontainer container 88ffeccc687430dd10e278066013d66d57f5bc899d9bd46996001f3b0023132b. machine # [ 625.973994] k3s[872]: E0923 16:22:53.892301 872 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:49582: use of closed network connection machine: waiting for success: ! systemctl is-active slow machine # [ 626.393459] k3s[872]: I0923 16:22:54.311719 872 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-q8nm7" podStartSLOduration=2.896010036 podStartE2EDuration="5.311698343s" totalImagesPullingTime="0s" totalInitContainerRuntime="2.415688307s" isStatefulPod=false podCreationTimestamp="2026-09-23 16:22:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-23 16:22:54.308159625 +0000 UTC m=+611.130285763" watchObservedRunningTime="2026-09-23 16:22:54.311698343 +0000 UTC m=+611.133824202" machine # [ 627.593637] dhcpcd[679]: veth5f249aa2: probing for an IPv4LL address machine # [ 632.449833] dhcpcd[679]: veth5f249aa2: using IPv4LL address 169.254.247.159 machine # [ 632.450364] dhcpcd[679]: veth5f249aa2: adding route to 169.254.0.0/16 machine # [ 636.293828] dhcpcd[679]: veth5f249aa2: no IPv6 Routers available machine # [ 639.108883] niks3-server[1170]: 2026/09/23 16:23:07 INFO Received push request method=POST path=/api/pushes machine # [ 639.129959] niks3-server[1170]: 2026/09/23 16:23:07 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.ls machine # [ 639.134167] niks3-server[1170]: 2026/09/23 16:23:07 INFO Received sign narinfos request method=POST path=/api/pushes/30/sign machine # [ 639.136064] niks3-server[1170]: 2026/09/23 16:23:07 INFO Signed narinfos id=30 count=1 machine # [ 639.141262] niks3-server[1170]: 2026/09/23 16:23:07 INFO Registered completed upload object_key=log/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 639.148955] niks3-server[1170]: 2026/09/23 16:23:07 INFO Received complete push request method=POST path=/api/pushes/30/complete machine # [ 639.157064] niks3-server[1170]: 2026/09/23 16:23:07 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo machine # [ 639.920178] systemd[1]: cri-containerd-f3f2c199ea28b6f550f267edae76e3e87cb01e584f9645a51e13ad1e174433a0.scope: Deactivated successfully. machine # [ 639.924769] systemd[1]: cri-containerd-f3f2c199ea28b6f550f267edae76e3e87cb01e584f9645a51e13ad1e174433a0.scope: Consumed 3.348s CPU time over 9min 40.651s wall clock time, 67.6M memory peak, 33.9M read from disk, 281K incoming IP traffic, 342.8K outgoing IP traffic. machine # [ 639.997413] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-f3f2c199ea28b6f550f267edae76e3e87cb01e584f9645a51e13ad1e174433a0-rootfs.mount: Deactivated successfully. machine # [ 640.204138] systemd[1]: slow.service: Deactivated successfully. machine # [ 640.205747] systemd[1]: slow.service: Consumed 154ms CPU time over 45.630s wall clock time, 38.4M memory peak, 4K written to disk, 5.3K incoming IP traffic, 11.5K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active slow, in 14.57 seconds) machine: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; }, in 0.04 seconds) machine: must fail: journalctl -u slow | grep -q 'asking the scheduler again' machine: (finished: must fail: journalctl -u slow | grep -q 'asking the scheduler again', in 0.03 seconds) machine: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath machine # [ 640.706941] systemd[1]: cri-containerd-dd6a03a03327ee7cb4455928a2a079ef3db3971c7d2ff30ed6ecf6a24fd8172f.scope: Deactivated successfully. machine # [ 640.707348] systemd[1]: cri-containerd-dd6a03a03327ee7cb4455928a2a079ef3db3971c7d2ff30ed6ecf6a24fd8172f.scope: Consumed 22.225s CPU time over 9min 41.664s wall clock time, 52M memory peak, 34.8M read from disk, 1.1M written to disk, 48.9K incoming IP traffic, 33.4K outgoing IP traffic. machine # [ 640.757542] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-dd6a03a03327ee7cb4455928a2a079ef3db3971c7d2ff30ed6ecf6a24fd8172f-rootfs.mount: Deactivated successfully. machine: (finished: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath, in 0.15 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null machine # [ 640.784379] systemd[1]: cri-containerd-7382482ce7a4c4ac1f12e5740c14db1f72f90d273a4e97f506ddcb0c92acf68c.scope: Deactivated successfully. machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null, in 0.03 seconds) (finished: subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes, in 46.24 seconds) (finished: run the VM test script, in 641.71 seconds) machine # [ 640.820627] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-7382482ce7a4c4ac1f12e5740c14db1f72f90d273a4e97f506ddcb0c92acf68c-rootfs.mount: Deactivated successfully. test script finished in 641.74s cleanup kill QemuMachine (pid 45) machine # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) machine # [2026-09-23T16:23:08Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-09-23T16:23:08Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-09-23T16:23:08Z INFO virtiofsd] Client disconnected, shutting down (finished: cleanup, in 0.99 seconds) additionally exposed symbols: machine, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh