tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.01 seconds) Test will time out and terminate in 1200.0 seconds run the VM test script machine: waiting for unit k3s.service machine: waiting for the VM to finish booting machine: starting vm machine # Disk image does not exist, creating the virtualisation disk image... machine: QEMU running (pid 45) machine # Formatting '/build/vm-state-machine/tmp.bxhB8dTGt3', fmt=raw size=17179869184 machine # mke2fs 1.47.4 (6-Mar-2025) machine # Discarding device blocks: 0/4194304 done machine # Creating filesystem with 4194304 4k blocks and 1048576 inodes machine # Filesystem UUID: cc6e5549-2a21-4879-a9a6-012ecd4dcf87 machine # Superblock backups stored on blocks: machine # 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208, machine # 4096000 machine # machine # Allocating group tables: 0/128 done machine # Writing inode tables: 0/128 done machine # Creating journal (32768 blocks): done machine # Writing superblocks and filesystem accounting information: 0/128 done machine # machine # Virtualisation disk image created. machine # Starting virtiofs daemons... machine # [2026-09-30T09:24:48Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-30T09:24:48Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-30T09:24:48Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-30T09:24:48Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-30T09:24:48Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-30T09:24:48Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-30T09:24:48Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-30T09:24:48Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-30T09:24:48Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-30T09:24:48Z INFO virtiofsd] Client connected, servicing requests machine # [2026-09-30T09:24:48Z INFO virtiofsd] Client connected, servicing requests machine # [2026-09-30T09:24:48Z INFO virtiofsd] Client connected, servicing requests machine # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) machine # machine # machine # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+7EFCC730+7EF2C730 CA00 machine # Press Ctrl-B to configure iPXE (PCI 00:02.0)... machine # machine # machine # machine # machine # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 7EFCC730 7EF2C730 CB00 machine # Press Ctrl-B to configure iPXE (PCI 00:05.0)... machine # machine # machine # Booting from ROM... machine # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.53 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 21 13:06:06 UTC 2026 machine # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/9hfg678c0ylz8kvzz290gf2caldfvv7q-nixos-system-machine-test/init regInfo=/nix/.ro-store/v0drrzh015zq2pln7mdy8acwni3jgw2s-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.000000] BIOS-provided physical RAM map: machine # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007ffd7fff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000007ffd8000-0x000000007fffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000017fffffff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved machine # [ 0.000000] NX (Execute Disable) protection: active machine # [ 0.000000] APIC: Static calls initialized machine # [ 0.000000] SMBIOS 2.8 present. machine # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 machine # [ 0.000000] DMI: Memory slots populated: 1/1 machine # [ 0.000000] Hypervisor detected: KVM machine # [ 0.000000] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 machine # [ 0.000000] kvm-clock: using sched offset of 476586288 cycles machine # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns machine # [ 0.000005] tsc: Detected 2400.012 MHz processor machine # [ 0.000816] last_pfn = 0x180000 max_arch_pfn = 0x10000000000 machine # [ 0.000843] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs machine # [ 0.000846] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT machine # [ 0.000884] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.002740] found SMP MP-table at [mem 0x000f5450-0x000f545f] machine # [ 0.002753] Using GB pages for direct mapping machine # [ 0.002916] RAMDISK: [mem 0x7e364000-0x7ffcffff] machine # [ 0.002924] ACPI: Early table checksum verification disabled machine # [ 0.002928] ACPI: RSDP 0x00000000000F5250 000014 (v00 BOCHS ) machine # [ 0.002932] ACPI: RSDT 0x000000007FFE2539 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002936] ACPI: FACP 0x000000007FFE2319 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002944] ACPI: DSDT 0x000000007FFE0040 0022D9 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002946] ACPI: FACS 0x000000007FFE0000 000040 machine # [ 0.002948] ACPI: APIC 0x000000007FFE240D 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002949] ACPI: HPET 0x000000007FFE249D 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002951] ACPI: MCFG 0x000000007FFE24D5 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002952] ACPI: WAET 0x000000007FFE2511 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002954] ACPI: Reserving FACP table memory at [mem 0x7ffe2319-0x7ffe240c] machine # [ 0.002955] ACPI: Reserving DSDT table memory at [mem 0x7ffe0040-0x7ffe2318] machine # [ 0.002955] ACPI: Reserving FACS table memory at [mem 0x7ffe0000-0x7ffe003f] machine # [ 0.002956] ACPI: Reserving APIC table memory at [mem 0x7ffe240d-0x7ffe249c] machine # [ 0.002956] ACPI: Reserving HPET table memory at [mem 0x7ffe249d-0x7ffe24d4] machine # [ 0.002957] ACPI: Reserving MCFG table memory at [mem 0x7ffe24d5-0x7ffe2510] machine # [ 0.002957] ACPI: Reserving WAET table memory at [mem 0x7ffe2511-0x7ffe2538] machine # [ 0.003182] No NUMA configuration found machine # [ 0.003183] Faking a node at [mem 0x0000000000000000-0x000000017fffffff] machine # [ 0.003186] NODE_DATA(0) allocated [mem 0x17fff8780-0x17fffdcff] machine # [ 0.005598] Zone ranges: machine # [ 0.005599] DMA [mem 0x0000000000001000-0x0000000000ffffff] machine # [ 0.005601] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] machine # [ 0.005602] Normal [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005603] Device empty machine # [ 0.005604] Movable zone start for each node machine # [ 0.005605] Early memory node ranges machine # [ 0.005605] node 0: [mem 0x0000000000001000-0x000000000009efff] machine # [ 0.005606] node 0: [mem 0x0000000000100000-0x000000007ffd7fff] machine # [ 0.005607] node 0: [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005608] Initmem setup node 0 [mem 0x0000000000001000-0x000000017fffffff] machine # [ 0.005629] On node 0, zone DMA: 1 pages in unavailable ranges machine # [ 0.005908] On node 0, zone DMA: 97 pages in unavailable ranges machine # [ 0.081179] On node 0, zone Normal: 40 pages in unavailable ranges machine # [ 0.081670] ACPI: PM-Timer IO Port: 0x608 machine # [ 0.081686] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) machine # [ 0.081723] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 machine # [ 0.081726] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) machine # [ 0.081728] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) machine # [ 0.081729] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) machine # [ 0.081730] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) machine # [ 0.081731] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) machine # [ 0.081733] ACPI: Using ACPI (MADT) for SMP configuration information machine # [ 0.081734] ACPI: HPET id: 0x8086a201 base: 0xfed00000 machine # [ 0.081740] TSC deadline timer available machine # [ 0.081744] CPU topo: Max. logical packages: 1 machine # [ 0.081745] CPU topo: Max. logical dies: 1 machine # [ 0.081746] CPU topo: Max. dies per package: 1 machine # [ 0.081749] CPU topo: Max. threads per core: 1 machine # [ 0.081750] CPU topo: Num. cores per package: 4 machine # [ 0.081750] CPU topo: Num. threads per package: 4 machine # [ 0.081751] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs machine # [ 0.081777] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() machine # [ 0.081794] kvm-guest: KVM setup pv remote TLB flush machine # [ 0.081797] kvm-guest: setup PV sched yield machine # [ 0.081807] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] machine # [ 0.081808] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] machine # [ 0.081810] PM: hibernation: Registered nosave memory: [mem 0x7ffd8000-0xffffffff] machine # [ 0.081811] [mem 0xc0000000-0xfed1bfff] available for PCI devices machine # [ 0.081813] Booting paravirtualized kernel on KVM machine # [ 0.081817] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns machine # [ 0.086317] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 machine # [ 0.088623] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288 machine # [ 0.088674] kvm-guest: PV spinlocks enabled machine # [ 0.088676] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) machine # [ 0.088679] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/9hfg678c0ylz8kvzz290gf2caldfvv7q-nixos-system-machine-test/init regInfo=/nix/.ro-store/v0drrzh015zq2pln7mdy8acwni3jgw2s-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.088781] Unknown kernel command line parameters "regInfo=/nix/.ro-store/v0drrzh015zq2pln7mdy8acwni3jgw2s-closure-info/registration", will be passed to user space. machine # [ 0.088794] random: crng init done machine # [ 0.088795] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes machine # [ 0.093713] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) machine # [ 0.095949] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) machine # [ 0.096022] software IO TLB: area num 4. machine # [ 0.174354] Fallback order for Node 0: 0 machine # [ 0.174363] Built 1 zonelists, mobility grouping on. Total pages: 1048438 machine # [ 0.174365] Policy zone: Normal machine # [ 0.177382] mem auto-init: stack:all(zero), heap alloc:on, heap free:off machine # [ 0.184731] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 machine # [ 0.194534] allocated 8388608 bytes of page_ext machine # [ 0.204791] ftrace: allocating 48798 entries in 192 pages machine # [ 0.204793] ftrace: allocated 192 pages with 2 groups machine # [ 0.205693] Dynamic Preempt: lazy machine # [ 0.205840] rcu: Preemptible hierarchical RCU implementation. machine # [ 0.205841] rcu: RCU event tracing is enabled. machine # [ 0.205842] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. machine # [ 0.205843] Trampoline variant of Tasks RCU enabled. machine # [ 0.205844] Rude variant of Tasks RCU enabled. machine # [ 0.205844] Tracing variant of Tasks RCU enabled. machine # [ 0.205845] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. machine # [ 0.205846] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 machine # [ 0.205870] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.205872] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.205873] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.210364] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16 machine # [ 0.210648] rcu: srcu_init: Setting srcu_struct sizes based on contention. machine # [ 0.210657] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns machine # [ 0.210776] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) machine # [ 0.214379] Console: colour VGA+ 80x25 machine # [ 0.214382] printk: legacy console [tty0] enabled machine # [ 0.246016] printk: legacy console [ttyS0] enabled machine # [ 0.359227] ACPI: Core revision 20250807 machine # [ 0.360159] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns machine # [ 0.361759] APIC: Switch to symmetric I/O mode setup machine # [ 0.362786] x2apic enabled machine # [ 0.363536] APIC: Switched APIC routing to: physical x2apic machine # [ 0.364494] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask() machine # [ 0.365795] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself() machine # [ 0.367333] kvm-guest: setup PV IPIs machine # [ 0.368941] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 machine # [ 0.370023] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.374300] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) machine # [ 0.376368] x86/cpu: User Mode Instruction Prevention (UMIP) activated machine # [ 0.377482] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 machine # [ 0.378297] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 machine # [ 0.379301] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto machine # [ 0.380297] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl machine # [ 0.381297] Transient Scheduler Attacks: Vulnerable: No microcode machine # [ 0.383090] Spectre V2 : Mitigation: Enhanced / Automatic IBRS machine # [ 0.384069] Speculative Return Stack Overflow: Mitigation: Safe RET machine # [ 0.385125] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization machine # [ 0.386304] Spectre V2 : Enabling IBPB for BPF machine # [ 0.387297] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier machine # [ 0.388297] active return thunk: srso_alias_return_thunk machine # [ 0.389318] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' machine # [ 0.391297] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' machine # [ 0.392296] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' machine # [ 0.393296] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' machine # [ 0.394295] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' machine # [ 0.395296] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' machine # [ 0.396297] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' machine # [ 0.398297] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 machine # [ 0.399296] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 machine # [ 0.400296] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 machine # [ 0.401297] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 machine # [ 0.402296] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 machine # [ 0.403297] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. machine # [ 0.433297] Freeing SMP alternatives memory: 44K machine # [ 0.434146] pid_max: default: 32768 minimum: 301 machine # [ 0.434999] LSM: initializing lsm=capability,landlock,yama,bpf,ima machine # [ 0.435403] landlock: Up and running. machine # [ 0.436773] Yama: becoming mindful. machine # [ 0.437508] LSM support for eBPF active machine # [ 0.438459] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.439377] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.442588] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) machine # [ 0.443905] Performance Events: Fam17h+ core perfctr, AMD PMU driver. machine # [ 0.444306] ... version: 2 machine # [ 0.445075] ... bit width: 48 machine # [ 0.445299] ... generic counters: 6 machine # [ 0.446042] ... generic bitmap: 000000000000003f machine # [ 0.446299] ... fixed-purpose counters: 0 machine # [ 0.447045] ... fixed-purpose bitmap: 0000000000000000 machine # [ 0.447299] ... value mask: 0000ffffffffffff machine # [ 0.448251] ... max period: 00007fffffffffff machine # [ 0.449052] ... global_ctrl mask: 000000000000003f machine # [ 0.449420] signal: max sigframe size: 3376 machine # [ 0.450303] rcu: Hierarchical SRCU implementation. machine # [ 0.451148] rcu: Max phase no-delay instances is 400. machine # [ 0.452218] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level machine # [ 0.457917] smp: Bringing up secondary CPUs ... machine # [ 0.458703] smpboot: x86: Booting SMP configuration: machine # [ 0.459308] .... node #0, CPUs: #1 #2 #3 machine # [ 0.461375] smp: Brought up 1 node, 4 CPUs machine # [ 0.463044] smpboot: Total of 4 processors activated (19200.09 BogoMIPS) machine # [ 0.463721] Memory: 3957844K/4193752K available (17259K kernel code, 2728K rwdata, 13652K rodata, 3656K init, 2968K bss, 220908K reserved, 0K cma-reserved) machine # [ 0.464802] devtmpfs: initialized machine # [ 0.465967] x86/mm: Memory block size: 128MB machine # [ 0.468351] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.469383] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). machine # [ 0.470387] pinctrl core: initialized pinctrl subsystem machine # [ 0.471593] PM: RTC time: 09:24:48, date: 2026-09-30 machine # [ 0.475664] NET: Registered PF_NETLINK/PF_ROUTE protocol family machine # [ 0.477130] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations machine # [ 0.478291] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations machine # [ 0.479865] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations machine # [ 0.480311] audit: initializing netlink subsys (disabled) machine # [ 0.481406] audit: type=2000 audit(1790760289.064:1): state=initialized audit_enabled=0 res=1 machine # [ 0.481618] thermal_sys: Registered thermal governor 'fair_share' machine # [ 0.482304] thermal_sys: Registered thermal governor 'bang_bang' machine # [ 0.483299] thermal_sys: Registered thermal governor 'step_wise' machine # [ 0.484300] thermal_sys: Registered thermal governor 'user_space' machine # [ 0.485299] thermal_sys: Registered thermal governor 'power_allocator' machine # [ 0.486313] cpuidle: using governor menu machine # [ 0.488487] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 machine # [ 0.489593] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] machine # [ 0.490303] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry machine # [ 0.491314] PCI: Using configuration type 1 for base access machine # [ 0.492445] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. machine # [ 0.494504] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages machine # [ 0.495300] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page machine # [ 0.496300] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages machine # [ 0.497300] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page machine # [ 0.500843] ACPI: Added _OSI(Module Device) machine # [ 0.501301] ACPI: Added _OSI(Processor Device) machine # [ 0.502066] ACPI: Added _OSI(Processor Aggregator Device) machine # [ 0.506023] ACPI: 1 ACPI AML tables successfully acquired and loaded machine # [ 0.509651] ACPI: Interpreter enabled machine # [ 0.510332] ACPI: PM: (supports S0 S3 S4 S5) machine # [ 0.511098] ACPI: Using IOAPIC for interrupt routing machine # [ 0.511394] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug machine # [ 0.512300] PCI: Using E820 reservations for host bridge windows machine # [ 0.513464] ACPI: Enabled 2 GPEs in block 00 to 3F machine # [ 0.518529] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) machine # [ 0.519305] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] machine # [ 0.520379] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] machine # [ 0.521426] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] machine # [ 0.522687] PCI host bridge to bus 0000:00 machine # [ 0.523305] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] machine # [ 0.524300] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] machine # [ 0.525299] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] machine # [ 0.526299] pci_bus 0000:00: root bus resource [mem 0x80000000-0xafffffff window] machine # [ 0.527301] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] machine # [ 0.528300] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.529300] pci_bus 0000:00: root bus resource [bus 00-ff] machine # [ 0.530353] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint machine # [ 0.531787] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint machine # [ 0.534371] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] machine # [ 0.535312] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] machine # [ 0.536339] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] machine # [ 0.537478] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] machine # [ 0.539068] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.542317] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] machine # [ 0.543227] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] machine # [ 0.544114] pci 0000:00:02.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref] machine # [ 0.545319] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] machine # [ 0.546910] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.550349] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] machine # [ 0.551301] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] machine # [ 0.552324] pci 0000:00:03.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref] machine # [ 0.554287] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint machine # [ 0.558343] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] machine # [ 0.559299] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] machine # [ 0.560322] pci 0000:00:04.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref] machine # [ 0.561919] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.564346] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] machine # [ 0.566021] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] machine # [ 0.566322] pci 0000:00:05.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref] machine # [ 0.567337] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] machine # [ 0.568920] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint machine # [ 0.570313] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] machine # [ 0.571323] pci 0000:00:06.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref] machine # [ 0.572991] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.575345] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] machine # [ 0.576322] pci 0000:00:07.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref] machine # [ 0.577863] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.579313] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] machine # [ 0.581326] pci 0000:00:08.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref] machine # [ 0.582918] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.585325] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] machine # [ 0.586322] pci 0000:00:09.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref] machine # [ 0.587897] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint machine # [ 0.590320] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] machine # [ 0.591308] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] machine # [ 0.592321] pci 0000:00:0a.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref] machine # [ 0.593883] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.596319] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] machine # [ 0.597307] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] machine # [ 0.598321] pci 0000:00:0b.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref] machine # [ 0.600749] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.602155] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] machine # [ 0.603230] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.605107] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] machine # [ 0.606260] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.608186] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] machine # [ 0.609588] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint machine # [ 0.611136] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] machine # [ 0.612343] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint machine # [ 0.613596] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO machine # [ 0.614601] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint machine # [ 0.616671] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] machine # [ 0.617307] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] machine # [ 0.618652] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint machine # [ 0.620140] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] machine # [ 0.624266] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 machine # [ 0.625244] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 machine # [ 0.626204] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 machine # [ 0.627253] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 machine # [ 0.628250] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 machine # [ 0.629235] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 machine # [ 0.630244] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 machine # [ 0.631235] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 machine # [ 0.632124] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 machine # [ 0.633096] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 machine # [ 0.634102] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 machine # [ 0.635146] ACPI: PCI: Interrupt link GSID configured for IRQ 19 machine # [ 0.636135] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 machine # [ 0.637154] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 machine # [ 0.638140] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 machine # [ 0.639142] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 machine # [ 0.641756] iommu: Default domain type: Translated machine # [ 0.642302] iommu: DMA domain TLB invalidation policy: lazy mode machine # [ 0.643560] ACPI: bus type USB registered machine # [ 0.644946] usbcore: registered new interface driver usbfs machine # [ 0.645323] usbcore: registered new interface driver hub machine # [ 0.646252] usbcore: registered new device driver usb machine # [ 0.648310] NetLabel: Initializing machine # [ 0.648963] NetLabel: domain hash size = 128 machine # [ 0.649300] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO machine # [ 0.650351] NetLabel: unlabeled traffic allowed by default machine # [ 0.651314] PCI: Using ACPI for IRQ routing machine # [ 0.695341] pci 0000:00:01.0: vgaarb: setting as boot VGA device machine # [ 0.696295] pci 0000:00:01.0: vgaarb: bridge control possible machine # [ 0.696295] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none machine # [ 0.696305] vgaarb: loaded machine # [ 0.697128] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 machine # [ 0.697945] hpet0: 3 comparators, 64-bit 100.000000 MHz counter machine # [ 0.701480] clocksource: Switched to clocksource kvm-clock machine # [ 0.707035] VFS: Disk quotas dquot_6.6.0 machine # [ 0.707834] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) machine # [ 0.709468] pnp: PnP ACPI init machine # [ 0.710355] ACPI: IRQ 4 override to edge(!), high(!) machine # [ 0.711380] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved machine # [ 0.713011] pnp: PnP ACPI: found 5 devices machine # [ 0.723217] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns machine # [ 0.724821] clocksource: Switched to clocksource acpi_pm machine # [ 0.725872] NET: Registered PF_INET protocol family machine # [ 0.727800] IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear) machine # [ 0.745447] tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.747052] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) machine # [ 0.748515] TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear) machine # [ 0.751159] TCP bind hash table entries: 32768 (order: 8, 1048576 bytes, linear) machine # [ 0.752623] TCP: Hash tables configured (established 32768 bind 32768) machine # [ 0.753884] MPTCP token hash table entries: 4096 (order: 5, 98304 bytes, linear) machine # [ 0.755381] UDP hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.756733] UDP-Lite hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.758241] NET: Registered PF_UNIX/PF_LOCAL protocol family machine # [ 0.759272] NET: Registered PF_XDP protocol family machine # [ 0.760195] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] machine # [ 0.761323] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] machine # [ 0.762409] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] machine # [ 0.763544] pci_bus 0000:00: resource 7 [mem 0x80000000-0xafffffff window] machine # [ 0.764706] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] machine # [ 0.765841] pci_bus 0000:00: resource 9 [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.767938] ACPI: \_SB_.GSIA: Enabled at IRQ 16 machine # [ 0.770251] ACPI: \_SB_.GSIB: Enabled at IRQ 17 machine # [ 0.773455] ACPI: \_SB_.GSIC: Enabled at IRQ 18 machine # [ 0.775675] ACPI: \_SB_.GSID: Enabled at IRQ 19 machine # [ 0.777480] PCI: CLS 0 bytes, default 64 machine # [ 0.778284] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) machine # [ 0.778596] Trying to unpack rootfs image as initramfs... machine # [ 0.779464] software IO TLB: mapped [mem 0x000000007a364000-0x000000007e364000] (64MB) machine # [ 0.781998] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.803395] Initialise system trusted keyrings machine # [ 0.804704] workingset: timestamp_bits=40 max_order=20 bucket_order=0 machine # [ 0.816100] Key type asymmetric registered machine # [ 0.816883] Asymmetric key parser 'x509' registered machine # [ 0.817822] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) machine # [ 0.819480] io scheduler mq-deadline registered machine # [ 0.820303] io scheduler kyber registered machine # [ 0.825565] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled machine # [ 0.827139] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A machine # [ 0.829718] Linux agpgart interface v0.103 machine # [ 0.830544] ACPI: bus type drm_connector registered machine # [ 0.833469] usbcore: registered new interface driver usbserial_generic machine # [ 0.834624] usbserial: USB Serial support registered for generic machine # [ 0.835723] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. machine # [ 0.835723] Please enable it if your BIOS has the CPPC option. machine # [ 0.838230] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled machine # [ 0.839760] drop_monitor: Initializing network drop monitor service machine # [ 0.841024] NET: Registered PF_INET6 protocol family machine # [ 0.842855] Segment Routing with IPv6 machine # [ 0.843541] In-situ OAM (IOAM) with IPv6 machine # [ 0.846290] IPI shorthand broadcast: enabled machine # [ 0.850942] sched_clock: Marking stable (696011151, 154638932)->(938824586, -88174503) machine # [ 0.852850] registered taskstats version 1 machine # [ 0.854023] Loading compiled-in X.509 certificates machine # [ 0.864842] Demotion targets for Node 0: null machine # [ 0.866054] Key type .fscrypt registered machine # [ 0.866831] Key type fscrypt-provisioning registered machine # [ 0.867895] ima: No TPM chip found, activating TPM-bypass! machine # [ 0.868889] ima: Allocated hash algorithm: sha1 machine # [ 0.869767] ima: No architecture policies found machine # [ 0.870954] PM: Magic number: 10:601:425 machine # [ 0.872758] RAS: Correctable Errors collector initialized. machine # [ 0.877296] clk: Disabling unused clocks machine # [ 0.878060] PM: genpd: Disabling unused power domains machine # [ 1.043707] Freeing initrd memory: 29104K machine # [ 1.052052] Freeing unused decrypted memory: 2028K machine # [ 1.058748] Freeing unused kernel image (initmem) memory: 3656K machine # [ 1.061507] Write protecting the kernel read-only data: 32768k machine # [ 1.066567] Freeing unused kernel image (text/rodata gap) memory: 1172K machine # [ 1.070499] Freeing unused kernel image (rodata/data gap) memory: 684K machine # [ 1.136524] x86/mm: Checked W+X mappings: passed, no W+X pages found. machine # [ 1.137875] Run /init as init process machine # [ 1.153225] systemd[1]: Inserted module 'autofs4' machine # [ 1.181071] fuse: init (API version 7.45) machine # [ 1.190526] ACPI: \_SB_.GSIG: Enabled at IRQ 22 machine # [ 1.193153] ACPI: \_SB_.GSIH: Enabled at IRQ 23 machine # [ 1.196995] ACPI: \_SB_.GSIE: Enabled at IRQ 20 machine # [ 1.199232] ACPI: \_SB_.GSIF: Enabled at IRQ 21 machine # [ 1.204895] virtiofs virtio5: discovered new tag: nix-store machine # [ 1.206499] virtiofs virtio5: virtio_fs_setup_dax: No cache capability machine # [ 1.213176] virtiofs virtio6: discovered new tag: shared machine # [ 1.226009] virtiofs virtio6: virtio_fs_setup_dax: No cache capability machine # [ 1.229749] virtiofs virtio7: discovered new tag: xchg machine # [ 1.231244] virtiofs virtio7: virtio_fs_setup_dax: No cache capability machine # [ 1.257031] systemd[1]: Successfully made /usr/ read-only. machine # [ 1.592755] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 1.598051] systemd[1]: Detected virtualization kvm. machine # [ 1.598969] systemd[1]: Detected architecture x86-64. machine # [ 1.599882] systemd[1]: Running in initrd. machine # [ 1.600997] systemd[1]: Initializing machine ID from random generator. machine # [ 1.602280] systemd[1]: Hostname set to . machine # [ 1.702233] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 1.744711] systemd[1]: Queued start job for default target Initrd Default Target. machine # [ 1.755315] systemd[1]: Created slice Slice /system/modprobe. machine # [ 1.756540] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 1.758061] systemd[1]: Expecting device /dev/disk/by-label/nixos... machine # [ 1.759222] systemd[1]: Reached target Path Units. machine # [ 1.760131] systemd[1]: Reached target Slice Units. machine # [ 1.761070] systemd[1]: Reached target Swaps. machine # [ 1.761921] systemd[1]: Reached target Timer Units. machine # [ 1.762961] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 1.764231] systemd[1]: Listening on Journal Socket (/dev/log). machine # [ 1.765430] systemd[1]: Listening on Journal Sockets. machine # [ 1.766442] systemd[1]: Listening on udev Control Socket. machine # [ 1.767490] systemd[1]: Listening on udev Kernel Socket. machine # [ 1.768460] systemd[1]: Reached target Socket Units. machine # [ 1.770442] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 1.772828] systemd[1]: Starting Load Kernel Module configfs... machine # [ 1.776057] systemd[1]: Starting Journal Service... machine # [ 1.778092] systemd[1]: Starting Load Kernel Modules... machine # [ 1.780737] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 1.785063] systemd[1]: Starting Coldplug All udev Devices... machine # [ 1.787104] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 1.790835] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 1.794665] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 1.797789] systemd[1]: Finished Load Kernel Module configfs. machine # [ 1.799146] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config machine # [ 1.811203] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 1.815794] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 1.824212] systemd-journald[90]: Collecting audit messages is disabled. machine # [ 1.830181] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. machine # [ 1.832494] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev machine # [ 1.834882] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 1.836852] systemd[1]: Finished Load Kernel Modules. machine # [ 1.838095] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 1.839599] systemd[1]: Reached target Local File Systems. machine # [ 1.842074] systemd[1]: Starting Apply Kernel Variables... machine # [ 1.844151] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 1.864627] systemd[1]: Finished Apply Kernel Variables. machine # [ 1.866570] systemd[1]: Started Journal Service. machine # [ 1.712052] systemd-modules-load[91]: Using 4 probe threads machine # [ 1.714164] systemd-modules-load[91]: Inserted module 'virtio_balloon' machine # [ 1.715251] systemd-modules-load[91]: Inserted module 'virtio_gpu' machine # [ 1.716273] systemd-modules-load[91]: Inserted module 'dm_mod' machine # [ 1.718423] systemd[1]: Starting Create System Files and Directories... machine # [ 1.720051] systemd-udevd[102]: Using default interface naming scheme 'v261'. machine # [ 1.731073] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 1.732895] systemd[1]: Finished Create System Files and Directories. machine # [ 1.739964] systemd[1]: Finished Coldplug All udev Devices. machine # [ 1.740931] systemd[1]: Reached target System Initialization. machine # [ 1.741706] systemd[1]: Reached target Basic System. machine # [ 1.990390] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 machine # [ 1.999249] serio: i8042 KBD port at 0x60,0x64 irq 1 machine # [ 2.000077] serio: i8042 AUX port at 0x60,0x64 irq 12 machine # [ 2.004833] uhci_hcd 0000:00:1d.0: UHCI Host Controller machine # [ 2.004994] virtio_blk virtio2: 4/0/0 default/read/poll queues machine # [ 2.005097] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 1 machine # [ 2.008407] uhci_hcd 0000:00:1d.0: detected 2 ports machine # [ 2.009386] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 machine # [ 2.009613] virtio_blk virtio2: [vda] 33554432 512-byte logical blocks (17.2 GB/16.0 GiB) machine # [ 2.009925] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.014172] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.015349] usb usb1: Product: UHCI Host Controller machine # [ 2.016124] usb usb1: Manufacturer: Linux 6.18.53 uhci_hcd machine # [ 2.016995] usb usb1: SerialNumber: 0000:00:1d.0 machine # [ 2.030657] hub 1-0:1.0: USB hub found machine # [ 2.031903] hub 1-0:1.0: 2 ports detected machine # [ 2.043467] ehci-pci 0000:00:1d.7: EHCI Host Controller machine # [ 2.044730] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 2 machine # [ 2.046188] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 machine # [ 1.896890] (udev-worker)[122]: Network interface NamePolicy= disabled on kernel command line. machine # [ 2.053697] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 machine # [ 2.054623] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 machine # [ 1.901540] systemd[1]: Starting Virtual Console Setup... machine # [ 2.056554] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.058042] usb usb2: Product: EHCI Host Controller machine # [ 2.058820] usb usb2: Manufacturer: Linux 6.18.53 ehci_hcd machine # [ 2.059660] usb usb2: SerialNumber: 0000:00:1d.7 machine # [ 2.060570] hub 2-0:1.0: USB hub found machine # [ 2.061194] hub 2-0:1.0: 6 ports detected machine # [ 1.921473] systemd-vconsole-setup[141]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 1.923240] systemd[1]: Finished Virtual Console Setup. machine # [ 2.082774] hub 1-0:1.0: USB hub found machine # [ 2.083405] hub 1-0:1.0: 2 ports detected machine # [ 2.084277] uhci_hcd 0000:00:1d.1: UHCI Host Controller machine # [ 2.085217] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 machine # [ 2.086534] uhci_hcd 0000:00:1d.1: detected 2 ports machine # [ 1.937129] (udev-worker)[136]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 1.939328] (udev-worker)[136]: Network interface NamePolicy= disabled on kernel command line. machine # [ 2.095324] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 machine # [ 2.096613] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.098294] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 machine # [ 2.098307] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.102682] usb usb3: Product: UHCI Host Controller machine # [ 2.103839] usb usb3: Manufacturer: Linux 6.18.53 uhci_hcd machine # [ 2.104932] usb usb3: SerialNumber: 0000:00:1d.1 machine # [ 2.106414] hub 3-0:1.0: USB hub found machine # [ 2.107181] SCSI subsystem initialized machine # [ 2.107383] hub 3-0:1.0: 2 ports detected machine # [ 2.110305] uhci_hcd 0000:00:1d.2: UHCI Host Controller machine # [ 2.111100] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 machine # [ 1.957373] systemd[1]: Found device /dev/dis[ 2.112346] uhci_hcd 0000:00:1d.2: detected 2 ports machine # k/by-label/nixos. machine # [ 1.959348] s[ 2.113841] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 machine # ystemd[1]: Reached target Initrd Root Device. machine # [ 2.115041] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 1.961152] systemd[1]: Starting File System [ 2.116407] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # Check on /dev/disk/by-label/nixos... machine # [ 2.117779] usb usb4: Product: UHCI Host Controller machine # [ 2.118778] usb usb4: Manufacturer: Linux 6.18.53 uhci_hcd machine # [ 2.119543] usb usb4: SerialNumber: 0000:00:1d.2 machine # [ 2.120465] hub 4-0:1.0: USB hub found machine # [ 2.121179] hub 4-0:1.0: 2 ports detected machine # [ 2.142368] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode machine # [ 1.988816] systemd-fsck[149]: nixos: clean, 12/1048576 files, 109865/4194304 blocks machine # [ 2.143832] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) machine # [ 2.146005] ahci 0000:00:1f.2: flags: 64bit ncq only machine # [ 1.993498] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. machine # [ 2.150379] scsi host0: ahci machine # [ 2.151413] scsi host1: ahci machine # [ 2.152357] scsi host2: ahci machine # [ 2.153278] scsi host3: ahci machine # [ 2.154295] scsi host4: ahci machine # [ 2.155368] scsi host5: ahci machine # [ 2.156261] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 50 lpm-pol 1 machine # [ 2.157846] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 50 lpm-pol 1 machine # [ 2.159182] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 50 lpm-pol 1 machine # [ 2.160575] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 50 lpm-pol 1 machine # [ 2.161778] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 50 lpm-pol 1 machine # [ 2.163052] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 50 lpm-pol 1 machine # [ 2.300884] usb 2-1: new high-speed USB device number 2 using ehci-pci machine # [ 2.433024] usb 2-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 machine # [ 2.436029] usb 2-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 machine # [ 2.438667] usb 2-1: Product: QEMU USB Tablet machine # [ 2.440249] usb 2-1: Manufacturer: QEMU machine # [ 2.441750] usb 2-1: SerialNumber: 28754-0000:00:1d.7-1 machine # [ 2.480233] hid: raw HID events driver (C) Jiri Kosina machine # [ 2.483761] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) machine # [ 2.486374] ata5: SATA link down (SStatus 0 SControl 300) machine # [ 2.488778] ata4: SATA link down (SStatus 0 SControl 300) machine # [ 2.490949] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 machine # [ 2.492986] ata3.00: applying bridge limits machine # [ 2.494829] ata2: SATA link down (SStatus 0 SControl 300) machine # [ 2.497003] ata3.00: configured for UDMA/100 machine # [ 2.499025] ata6: SATA link down (SStatus 0 SControl 300) machine # [ 2.501519] ata1: SATA link down (SStatus 0 SControl 300) machine # [ 2.504181] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 machine # [ 2.537022] usbcore: registered new interface driver usbhid machine # [ 2.539038] usbhid: USB HID core driver machine # [ 2.549343] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb2/2-1/2-1:1.0/0003:0627:0001.0001/input/input2 machine # [ 2.553409] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 machine # [ 2.579232] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray machine # [ 2.612982] cdrom: Uniform CD-ROM driver Revision: 3.20 machine # [ 2.634831] systemd[1]: Mounting /sysroot... machine # [ 2.939937] EXT4-fs (vda): mounted filesystem cc6e5549-2a21-4879-a9a6-012ecd4dcf87 r/w with ordered data mode. Quota mode: none. machine # [ 2.789687] systemd[1]: Mounted /sysroot. machine # [ 2.790795] systemd[1]: Reached target Initrd Root File System. machine # [ 2.794406] systemd[1]: Mounting /sysroot/nix/.ro-store... machine # [ 2.796253] systemd[1]: Mounting /sysroot/nix/.rw-store... machine # [ 2.799529] systemd[1]: Mounting /sysroot/run... machine # [ 2.818174] systemd[1]: Mounting /sysroot/tmp/shared... machine # [ 2.821746] systemd[1]: Mounting /sysroot/tmp/xchg... machine # [ 2.826146] systemd[1]: Starting Mountpoints Configured in the Real Root... machine # [ 2.832734] systemd[1]: Mounted /sysroot/nix/.ro-store. machine # [ 2.833746] systemd[1]: Mounted /sysroot/nix/.rw-store. machine # [ 2.834723] systemd[1]: Mounted /sysroot/run. machine # [ 2.835641] systemd[1]: Mounted /sysroot/tmp/shared. machine # [ 2.837264] systemd-sysroot-fstab-check[189]: /sysroot should be mounted in the initrd, will request daemon-reload. machine # [ 2.842262] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 2.843784] systemd[1]: Mounted /sysroot/tmp/xchg. machine # [ 2.844762] systemd[1]: Reload requested from client PID 189 ('systemd-sysroot') (unit initrd-parse-etc.service)... machine # [ 2.846240] systemd[1]: Reloading... machine # [ 2.907571] systemd[1]: Reloading finished in 60 ms. machine # [ 2.930592] systemd-sysroot-fstab-check[189]: Requesting initrd-fs.target/start/replace... machine # [ 2.933584] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 2.936232] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 2.938479] systemd-sysroot-fstab-check[189]: Requesting swap.target/start/replace... machine # [ 2.941216] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 2.943407] systemd[1]: initrd-parse-etc.service: Deactivated successfully. machine # [ 2.945811] systemd[1]: Finished Mountpoints Configured in the Real Root. machine # [ 2.948245] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. machine # [ 2.961516] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 2.964504] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.634552] systemd[1]: Mounting /sysroot/nix/store... machine # [ 3.663192] systemd[1]: Mounted /sysroot/nix/store. machine # [ 3.664801] systemd[1]: Reached target Initrd File Systems. machine # [ 3.666506] systemd[1]: Starting Find NixOS closure... machine # [ 3.668551] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... machine # [ 3.691181] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. machine # [ 3.693713] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. machine # [ 3.699815] systemd[1]: Finished Find NixOS closure. machine # [ 3.701717] systemd[1]: Reached target Initrd Default Target. machine # [ 3.703802] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... machine # [ 3.732440] systemd[1]: Stopped target Initrd Default Target. machine # [ 3.734557] systemd[1]: Stopped target Basic System. machine # [ 3.736264] systemd[1]: Stopped target Initrd Root Device. machine # [ 3.738141] systemd[1]: Stopped target Path Units. machine # [ 3.739698] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. machine # [ 3.742147] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. machine # [ 3.744640] systemd[1]: Stopped target Slice Units. machine # [ 3.746468] systemd[1]: Stopped target Socket Units. machine # [ 3.748481] systemd[1]: Stopped target System Initialization. machine # [ 3.750610] systemd[1]: Stopped target Swaps. machine # [ 3.752342] systemd[1]: Stopped target Timer Units. machine # [ 3.754240] systemd[1]: dbus.socket: Deactivated successfully. machine # [ 3.756374] systemd[1]: Closed D-Bus System Message Bus Socket. machine # [ 3.758481] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. machine # [ 3.761138] systemd[1]: Stopped Find NixOS closure. machine # [ 3.763066] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.765147] systemd[1]: systemd-sysctl.service: Deactivated successfully. machine # [ 3.766858] systemd[1]: Stopped Apply Kernel Variables. machine # [ 3.768249] systemd[1]: systemd-modules-load.service: Deactivated successfully. machine # [ 3.770247] systemd[1]: Stopped Load Kernel Modules. machine # [ 3.771574] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. machine # [ 3.773546] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. machine # [ 3.775540] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. machine # [ 3.777550] systemd[1]: Stopped Create System Files and Directories. machine # [ 3.779289] systemd[1]: Stopped target Local File Systems. machine # [ 3.780650] systemd[1]: Stopped target Preparation for Local File Systems. machine # [ 3.782331] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. machine # [ 3.784101] systemd[1]: Stopped Coldplug All udev Devices. machine # [ 3.785444] systemd[1]: Stopping Rule-based Manager for Device Events and Files... machine # [ 3.786503] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 3.787694] systemd[1]: Stopped Virtual Console Setup. machine # [ 3.788588] systemd[1]: initrd-cleanup.service: Deactivated successfully. machine # [ 3.789786] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. machine # [ 3.790719] systemd[1]: systemd-udevd.service: Deactivated successfully. machine # [ 3.791608] systemd[1]: Stopped Rule-based Manager for Device Events and Files. machine # [ 3.792609] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. machine # [ 3.793639] systemd[1]: Closed udev Control Socket. machine # [ 3.794363] systemd[1]: Starting Cleanup udev Database... machine # [ 3.795228] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. machine # [ 3.796711] systemd[1]: Stopped Create Static Device Nodes in /dev. machine # [ 3.797819] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. machine # [ 3.799153] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. machine # [ 3.800342] systemd[1]: kmod-static-nodes.service: Deactivated successfully. machine # [ 3.801445] systemd[1]: Stopped Create List of Static Device Nodes. machine # [ 3.802506] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.803690] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.804707] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. machine # [ 3.805965] systemd[1]: Finished Cleanup udev Database. machine # [ 3.806898] systemd[1]: Reached target Switch Root. machine # [ 3.807785] systemd[1]: Starting NixOS Activation... machine # [ 3.892908] initrd-nixos-activation-start[236]: booting system configuration /nix/store/9hfg678c0ylz8kvzz290gf2caldfvv7q-nixos-system-machine-test machine # [ 3.925681] initrd-nixos-activation-start[236]: running activation script... machine # [ 4.172457] initrd-nixos-activation-start[260]: setting up /etc... machine # [ 4.320657] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. machine # [ 4.321852] systemd[1]: Finished NixOS Activation. machine # [ 4.324171] systemd[1]: Starting Switch Root... machine # [ 4.349587] systemd[1]: Switching root. machine # [ 4.565497] systemd-journald[90]: Received SIGTERM from PID 1 (systemd). machine # [ 4.654208] NET: Registered PF_VSOCK protocol family machine # [ 5.026199] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 5.036485] systemd[1]: Detected virtualization kvm. machine # [ 5.038446] systemd[1]: Detected architecture x86-64. machine # [ 5.040499] systemd[1]: Detected first boot. machine # [ 5.044819] systemd[1]: Initializing machine ID from random generator. machine # [ 5.186112] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 5.253119] systemd[1]: Applying preset policy. machine # [ 5.490152] systemd[1]: Populated /etc with preset unit settings. machine # [ 5.727961] systemd[1]: initrd-switch-root.service: Deactivated successfully. machine # [ 5.729428] systemd[1]: Stopped initrd-switch-root.service. machine # [ 5.731842] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. machine # [ 5.734256] systemd[1]: Created slice Slice /system/getty. machine # [ 5.735836] systemd[1]: Created slice User and Session Slice. machine # [ 5.736865] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 5.738160] systemd[1]: Started Forward Password Requests to Wall Directory Watch. machine # [ 5.739315] systemd[1]: Expecting device /dev/hvc0... machine # [ 5.740130] systemd[1]: Expecting device /dev/ttyS0... machine # [ 5.741055] systemd[1]: Reached target Local Encrypted Volumes. machine # [ 5.741994] systemd[1]: Stopped target initrd-fs.target. machine # [ 5.742822] systemd[1]: Stopped target initrd-root-fs.target. machine # [ 5.743716] systemd[1]: Stopped target initrd-switch-root.target. machine # [ 5.744722] systemd[1]: Reached target Virtual Machines and Containers. machine # [ 5.745737] systemd[1]: Reached target Path Units. machine # [ 5.746469] systemd[1]: Reached target Remote File Systems. machine # [ 5.747290] systemd[1]: Reached target Slice Units. machine # [ 5.748084] systemd[1]: Reached target Swaps. machine # [ 5.750177] systemd[1]: Listening on Query the User Interactively for a Password. machine # [ 5.753081] systemd[1]: Listening on Process Core Dump Socket. machine # [ 5.755174] systemd[1]: Listening on Credential Encryption/Decryption. machine # [ 5.757425] systemd[1]: Listening on Factory Reset Management. machine # [ 5.758387] systemd[1]: Listening on Hostname Service Socket. machine # [ 5.761766] systemd[1]: Starting Journal Log Access Socket... machine # [ 5.763121] systemd[1]: Listening on Journal Audit Socket. machine # [ 5.765728] systemd[1]: Listening on Console Output Muting Service Socket. machine # [ 5.766995] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. machine # [ 5.768256] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os machine # [ 5.769717] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki machine # [ 5.774802] systemd[1]: Listening on Disk Repartitioning Service Socket. machine # [ 5.775914] systemd[1]: Listening on udev Control Socket. machine # [ 5.776898] systemd[1]: Listening on udev Varlink Socket. machine # [ 5.779604] systemd[1]: Mounting Huge Pages File System... machine # [ 5.782033] systemd[1]: Mounting POSIX Message Queue File System... machine # [ 5.787545] systemd[1]: Mounting Kernel Debug File System... machine # [ 5.795859] systemd[1]: Mounting Kernel Trace File System... machine # [ 5.801071] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 5.803740] systemd[1]: Starting Load Kernel Module configfs... machine # [ 5.804726] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm machine # [ 5.806255] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 5.807986] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 5.811452] systemd[1]: Mounting FUSE Control File System... machine # [ 5.812483] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 5.820157] systemd[1]: Starting Journal Service... machine # [ 5.822528] systemd[1]: Starting Load Kernel Modules... machine # [ 5.825477] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... machine # [ 5.831502] systemd[1]: Starting Remount Root and Kernel File Systems... machine # [ 5.832912] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 5.835767] systemd[1]: Starting Coldplug All udev Devices... machine # [ 5.838317] systemd[1]: Listening on Journal Log Access Socket. machine # [ 5.839435] systemd[1]: Mounted Huge Pages File System. machine # [ 5.840387] systemd[1]: Mounted POSIX Message Queue File System. machine # [ 5.841430] systemd[1]: Mounted Kernel Debug File System. machine # [ 5.842438] systemd[1]: Mounted Kernel Trace File System. machine # [ 5.843396] systemd[1]: Mounted FUSE Control File System. machine # [ 5.851893] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 5.855524] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 5.858351] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 5.859907] systemd[1]: Finished Load Kernel Module configfs. machine # [ 5.862674] systemd[1]: Mounting Kernel Configuration File System... machine # [ 5.863870] EXT4-fs (vda): re-mounted cc6e5549-2a21-4879-a9a6-012ecd4dcf87. machine # [ 5.865580] systemd-journald[332]: Collecting audit messages is enabled. machine # [ 5.873550] systemd[1]: Finished Remount Root and Kernel File Systems. machine # [ 5.874899] systemd[1]: Listening on Disk Image Download Service Socket. machine # [ 5.876005] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 5.723602] systemd[1]: Queued start job for default target Multi-User System. machine # [ 5.724922] systemd[1]: systemd-journald.service: Deactivated successfully. machine # [ 5.726316] systemd-modules-load[333]: Using 2 probe threads machine # [ 5.883225] systemd[1]: Starting Load/Save OS Random Seed... machine # [ 5.884145] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 5.885811] systemd[1]: Started Journal Service. machine # [ 5.886085] loop: module loaded machine # [ 5.735534] systemd-modules-load[333]: Inserted module 'loop' machine # [ 5.746545] systemd-oomd[334]: No swap; memory pressure usage will be degraded machine # [ 5.757584] systemd[1]: Starting Flush Journal to Persistent Storage... machine # [ 5.758744] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. machine # [ 5.760208] systemd[1]: Finished Load Kernel Modules. machine # [ 5.762952] systemd[1]: Mounted Kernel Configuration File System. machine # [ 5.771163] systemd[1]: Starting Apply Kernel Variables... machine # [ 5.773069] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 5.776970] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 5.782816] systemd[1]: Finished Load/Save OS Random Seed. machine # [ 5.783982] systemd[1]: Reached target First Boot Complete. machine # [ 5.939894] systemd-journald[332]: Received client request to flush runtime journal. machine # [ 5.833076] systemd[1]: Finished Apply Kernel Variables. machine # [ 5.834105] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 5.835141] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 5.836120] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 5.838267] systemd[1]: Finished Flush Journal to Persistent Storage. machine # [ 5.863370] systemd[1]: Finished Coldplug All udev Devices. machine # [ 5.865239] systemd-udevd[364]: Using default interface naming scheme 'v261'. machine # [ 5.901087] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 5.973927] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.004118] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. machine # [ 6.007743] (udev-worker)[369]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 6.011266] (udev-worker)[369]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.013360] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. machine # [ 6.014988] (udev-worker)[374]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.032291] systemd[1]: Condition check resulted in Virtio network device being skipped. machine # [ 6.033664] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.035520] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.037819] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.039534] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.040889] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.215483] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console machine # [ 6.223238] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 machine # [ 6.228292] Console: switching to colour dummy device 80x25 machine # [ 6.230004] ACPI: button: Power Button [PWRF] machine # [ 6.230067] [drm] Found bochs VGA, ID 0xb0c5. machine # [ 6.230069] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. machine # [ 6.235256] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic machine # [ 6.236102] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 machine # [ 6.267311] Console: switching to colour frame buffer device 160x50 machine # [ 6.268838] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device machine # [ 6.279605] rtc_cmos PNP0B00:00: RTC can wake from S4 machine # [ 6.286913] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 machine # [ 6.289591] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized machine # [ 6.300255] parport_pc 00:02: reported by Plug and Play ACPI machine # [ 6.300367] rtc_cmos PNP0B00:00: registered as rtc0 machine # [ 6.302310] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] machine # [ 6.303766] rtc_cmos PNP0B00:00: setting system clock to 2026-09-30T09:24:54 UTC (1790760294) machine # [ 6.305141] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs machine # [ 6.306174] systemd-journald[332]: Time jumped backwards, rotating. machine # [ 6.324145] mousedev: PS/2 mouse device common for all mice machine # [ 6.328192] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt machine # [ 6.333760] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD machine # [ 6.346041] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 machine # [ 6.348052] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 machine # [ 6.247157] systemd[1]: Starting Virtual Console Setup... machine # [ 6.410933] iTCO_wdt iTCO_wdt.0.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) machine # [ 6.414596] ppdev: user-space parallel port driver machine # [ 6.282059] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 6.284239] systemd[1]: Stopped Virtual Console Setup. machine # [ 6.445313] iTCO_wdt iTCO_wdt.0.auto: initialized. heartbeat=30 sec (nowayout=0) machine # [ 6.291898] systemd[1]: Starting Virtual Console Setup... machine # [ 6.520997] kvm_amd: TSC scaling supported machine # [ 6.521479] kvm_amd: Nested Virtualization enabled machine # [ 6.522128] kvm_amd: Nested Paging enabled machine # [ 6.522679] kvm_amd: LBR virtualization supported machine # [ 6.523242] kvm_amd: Virtual VMLOAD VMSAVE supported machine # [ 6.523943] kvm_amd: Virtual GIF supported machine # [ 6.524419] kvm_amd: Virtual NMI enabled machine # [ 6.596651] EDAC MC: Ver: 3.0.0 machine # [ 6.475023] systemd-vconsole-setup[410]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 6.477922] systemd[1]: Finished Virtual Console Setup. machine # [ 6.578405] systemd[1]: Mounting /run/wrappers... machine # [ 6.603180] systemd[1]: Mounted /run/wrappers. machine # [ 6.605189] systemd[1]: Reached target Local File Systems. machine # [ 6.607287] systemd[1]: Listening on Boot Loader Control Service Socket. machine # [ 6.609617] systemd[1]: Starting register-nix-paths.service... machine # [ 6.611724] systemd[1]: Starting Create SUID/SGID Wrappers... machine # [ 6.613761] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. machine # [ 6.616808] systemd[1]: Starting Save Transient machine-id to Disk... machine # [ 6.619290] systemd[1]: Starting Create System Files and Directories... machine # [ 6.702661] systemd[1]: Finished Create System Files and Directories. machine # [ 6.708456] systemd[1]: Starting Rebuild Journal Catalog... machine # [ 6.710060] systemd[1]: Starting Record System Boot/Shutdown in UTMP... machine # [ 6.730829] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. machine # [ 6.731808] systemd[1]: Finished Save Transient machine-id to Disk. machine # [ 6.735170] systemd[1]: Finished Record System Boot/Shutdown in UTMP. machine # [ 6.746517] systemd[1]: Finished Rebuild Journal Catalog. machine # [ 6.748853] systemd[1]: Starting Update is Completed... machine # [ 6.767600] systemd[1]: Finished Update is Completed. machine # [ 6.848319] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. machine # [ 6.849401] systemd[1]: Finished Create SUID/SGID Wrappers. machine # [ 7.090385] systemd[1]: Finished register-nix-paths.service. machine # [ 7.091570] systemd[1]: Reached target System Initialization. machine # [ 7.092702] systemd[1]: Started Discard unused filesystem blocks once a week. machine # [ 7.094663] systemd[1]: Started niks3 garbage collection timer. machine # [ 7.095737] systemd[1]: Started Daily Cleanup of Temporary Directories. machine # [ 7.096912] systemd[1]: Reached target Timer Units. machine # [ 7.097894] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 7.099377] systemd[1]: Listening on niks3 server socket. machine # [ 7.100446] systemd[1]: Listening on Nix Daemon Socket. machine # [ 7.101467] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. machine # [ 7.102818] systemd[1]: Reached target Socket Units. machine # [ 7.103613] systemd[1]: Reached target Basic System. machine # [ 7.104420] systemd[1]: Started backdoor.service. machine # [ 7.105398] systemd[1]: Starting Import lastlog data into lastlog2 database... machine # [ 7.106899] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 7.108149] systemd[1]: Starting Post-Boot Actions... machine # [ 7.112611] systemd[1]: Started Reset console on configuration changes. machine # [ 7.118975] systemd[1]: Starting resolvconf update... machine # [ 7.122158] systemd[1]: Started rustfs.service. machine # [ 7.123045] systemd[1]: Starting rustfs-bucket.service... machine # [ 7.126965] systemd[1]: Starting D-Bus System Message Bus... machine # [ 7.151063] systemd[1]: Finished Post-Boot Actions. machine # [ 7.159639] nsncd[493]: Sep 30 09:24:55.508 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 7.161960] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 7.162938] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 7.163939] systemd[1]: Reached target User and Group Name Lookups. machine # [ 7.164888] systemd[1]: Starting User Login Management... machine # [ 7.180216] systemd[1]: Finished Import lastlog data into lastlog2 database. machine # connecting to host... machine # [ 7.198402] dbus-broker-launch[500]: Looking up NSS user entry for 'systemd-timesync'... machine # [ 7.202626] dbus-broker-launch[500]: NSS returned no entry for 'systemd-timesync' machine # [ 7.203168] dbus-broker-launch[500]: Invalid user-name in /nix/store/g7pg57y182bsrh126xs4av309lnxhndq-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" machine: Guest shell says: b'Spawning backdoor root shell...\n' machine: connected to guest root shell machine # [ 7.217755] systemd[1]: Started D-Bus System Message Bus. machine: (connecting took 7.91 seconds) machine: (finished: waiting for the VM to finish booting, in 8.22 seconds) machine # [ 7.231911] systemd-logind[520]: New seat seat0. machine # [ 7.233452] dbus-broker-launch[500]: Ready machine # [ 7.238402] systemd-logind[520]: Watching system buttons on /dev/input/event2 (Power Button) machine # [ 7.238795] systemd-logind[520]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) machine # [ 7.240060] systemd-logind[520]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) machine # [ 7.240945] systemd[1]: Started User Login Management. machine # [ 7.243875] systemd[1]: Starting linger-users.service... machine # [ 7.282523] systemd[1]: Stopped target Host and Network Name Lookups. machine # [ 7.282935] systemd[1]: Stopping Host and Network Name Lookups... machine # [ 7.283095] systemd[1]: Stopped target User and Group Name Lookups. machine # [ 7.283564] systemd[1]: Stopping User and Group Name Lookups... machine # [ 7.284546] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... machine # [ 7.289253] systemd[1]: linger-users.service: Deactivated successfully. machine # [ 7.290156] systemd[1]: Finished linger-users.service. machine # [ 7.291473] systemd[1]: nscd.service: Deactivated successfully. machine # [ 7.292349] systemd[1]: Stopped Name Service Cache Daemon (nsncd). machine # [ 7.299197] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 7.329135] nsncd[598]: Sep 30 09:24:55.679 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 7.329334] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 7.329793] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 7.330484] systemd[1]: Reached target User and Group Name Lookups. machine # [ 7.340282] systemd[1]: Finished resolvconf update. machine # [ 7.340959] systemd[1]: Reached target Preparation for Network. machine # [ 7.344224] systemd[1]: Starting DHCP Client... machine # [ 7.345899] systemd[1]: Starting Address configuration of eth1... machine # [ 7.347926] systemd[1]: Starting Extra networking commands.... machine # [ 7.407738] network-addresses-eth1-start[627]: adding address 192.168.1.1/24... done machine # [ 7.416900] network-addresses-eth1-start[627]: adding address 2001:db8:1::1/64... done machine # [ 7.430216] systemd[1]: Finished Address configuration of eth1. machine # [ 7.432500] dhcpcd[639]: dhcpcd-10.3.2 starting machine # [ 7.436920] dhcpcd[690]: dev: loaded udev machine # [ 7.603096] 8021q: 802.1Q VLAN Support v1.8 machine # [ 7.604316] 8021q: adding VLAN 0 to HW filter on device eth1 machine # [ 7.454084] systemd[1]: Finished Extra networking commands.. machine # [ 7.454597] systemd[1]: Reached target Network. machine # [ 7.459229] systemd[1]: Starting PostgreSQL Server... machine # [ 7.460546] systemd[1]: Starting Permit User Sessions... machine # [ 7.489266] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. machine # [ 7.508406] systemd[1]: Finished Permit User Sessions. machine # [ 7.529746] systemd[1]: Started Getty on tty1. machine # [ 7.530208] systemd[1]: Reached target Login Prompts. machine # [ 7.701315] cfg80211: Loading compiled-in X.509 certificates for regulatory database machine # [ 7.717150] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' machine # [ 7.718664] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' machine # [ 7.720813] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 machine # [ 7.722276] cfg80211: failed to load regulatory.db machine # [ 7.760794] 8021q: adding VLAN 0 to HW filter on device eth0 machine # [ 7.608248] dhcpcd[690]: eth0: waiting for carrier machine # [ 7.622860] postgresql-pre-start[716]: The files belonging to this database system will be owned by user "postgres". machine # [ 7.624499] postgresql-pre-start[716]: This user must also own the server process. machine # [ 7.626719] postgresql-pre-start[716]: The database cluster will be initialized with locale "en_US.UTF-8". machine # [ 7.627457] postgresql-pre-start[716]: The default database encoding has accordingly been set to "UTF8". machine # [ 7.628532] postgresql-pre-start[716]: The default text search configuration will be set to "english". machine # [ 7.629280] postgresql-pre-start[716]: Data page checksums are enabled. machine # [ 7.629860] postgresql-pre-start[716]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok machine # [ 7.630469] postgresql-pre-start[716]: creating subdirectories ... ok machine # [ 7.630943] postgresql-pre-start[716]: selecting dynamic shared memory implementation ... posix machine # [ 7.686516] postgresql-pre-start[716]: selecting default "max_connections" ... 100 machine # [ 7.739259] postgresql-pre-start[716]: selecting default "shared_buffers" ... 128MB machine # [ 8.375848] postgresql-pre-start[716]: selecting default time zone ... UTC machine # [ 8.377590] postgresql-pre-start[716]: creating configuration files ... ok machine # [ 8.434498] dhcpcd[690]: eth0: carrier acquired machine # [ 8.443805] dhcpcd[690]: DUID 00:01:00:01:32:4f:91:e8:52:54:00:12:34:56 machine # [ 8.446235] dhcpcd[690]: eth0: IAID 00:12:34:56 machine # [ 8.448203] dhcpcd[690]: eth0: adding address fe80::5054:ff:fe12:3456 machine # [ 8.547347] postgresql-pre-start[716]: running bootstrap script ... ok machine # [ 9.038912] postgresql-pre-start[716]: performing post-bootstrap initialization ... ok machine # [ 9.235165] postgresql-pre-start[716]: syncing data to disk ... ok machine # [ 9.236074] postgresql-pre-start[716]: initdb: warning: enabling "trust" authentication for local connections machine # [ 9.237245] postgresql-pre-start[716]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. machine # [ 9.238527] postgresql-pre-start[716]: Success. You can now start the database server using: machine # [ 9.240288] postgresql-pre-start[716]: pg_ctl -D /var/lib/postgresql/18 -l logfile start machine # [ 9.369759] postgres[747]: [747] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit machine # [ 9.373554] postgres[747]: [747] LOG: listening on IPv6 address "::1", port 5432 machine # [ 9.374337] postgres[747]: [747] LOG: listening on IPv4 address "127.0.0.1", port 5432 machine # [ 9.377374] postgres[747]: [747] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" machine # [ 9.400602] postgres[760]: [760] LOG: database system was shut down at 2026-09-30 09:24:57 GMT machine # [ 9.408358] postgres[747]: [747] LOG: database system is ready to accept connections machine # [ 9.414083] systemd[1]: Started PostgreSQL Server. machine # [ 9.417873] systemd[1]: Starting PostgreSQL Setup Scripts... machine # [ 9.617754] postgresql-setup-start[776]: CREATE DATABASE machine # [ 9.662303] postgresql-setup-start[781]: CREATE ROLE machine # [ 9.681751] postgresql-setup-start[783]: ALTER DATABASE machine # [ 9.688651] systemd[1]: Finished PostgreSQL Setup Scripts. machine # [ 9.691516] systemd[1]: Reached target PostgreSQL. machine # [ 10.033538] dhcpcd[690]: eth0: soliciting a DHCP lease machine # [ 10.204963] NET: Registered PF_PACKET protocol family machine # [ 10.063193] dhcpcd[690]: eth0: offered 10.0.2.15 from 10.0.2.2 machine # [ 10.068373] dhcpcd[690]: eth0: probing address 10.0.2.15/24 machine # [ 11.163711] dhcpcd[690]: eth0: soliciting an IPv6 router machine # [ 11.164232] dhcpcd[690]: eth0: Router Advertisement from fe80::2 machine # [ 11.165723] dhcpcd[690]: eth0: adding address fec0::5054:ff:fe12:3456/64 machine # [ 11.167339] dhcpcd[690]: eth0: adding route to fec0::/64 machine # [ 11.168273] dhcpcd[690]: eth0: adding default route via fe80::2 machine # [ 15.223282] dhcpcd[690]: eth0: leased 10.0.2.15 for 86400 seconds machine # [ 15.223669] dhcpcd[690]: eth0: adding route to 10.0.2.0/24 machine # [ 15.225833] dhcpcd[690]: eth0: adding default route via 10.0.2.2 machine # [ 15.369170] systemd[1]: Started DHCP Client. machine # [ 15.372093] systemd[1]: Reached target Network is Online. machine # [ 15.377742] systemd[1]: Starting k3s service... machine # [ 15.440348] rustfs-bucket-start[893]: mb s3://farm machine # [ 15.448964] systemd[1]: Finished rustfs-bucket.service. machine # [ 15.462069] k3s[903]: time="2026-09-30T09:25:03Z" level=info msg="Acquiring lock file /var/lib/rancher/k3s/data/.lock" machine # [ 15.462268] k3s[903]: time="2026-09-30T09:25:03Z" level=info msg="Preparing data dir /var/lib/rancher/k3s/data/53c81a1072dac7aebc0a3715f02f26b7ba95e9416f42c7f7aeed55ccb68af709" machine # [ 17.690373] k3s[903]: time="2026-09-30T09:25:06Z" level=info msg="Starting k3s 1.36.4+k3s1 (4dedb15b)" machine # [ 17.698914] k3s[903]: time="2026-09-30T09:25:06Z" level=info msg="Configuring sqlite3 database connection pooling: maxIdle=20, maxOpen=0, maxLifetime=0s, maxIdleTime=2m0s" machine # [ 17.699794] k3s[903]: time="2026-09-30T09:25:06Z" level=info msg="Kine built with sqlite from github.com/mattn/go-sqlite3 version 3.53.3" machine # [ 17.700705] k3s[903]: time="2026-09-30T09:25:06Z" level=info msg="Configuring database table schema and indexes, this may take a moment..." machine # [ 17.715795] k3s[903]: time="2026-09-30T09:25:06Z" level=info msg="Database tables and indexes are up to date" machine # [ 17.717367] k3s[903]: time="2026-09-30T09:25:06Z" level=info msg="Running startup VACUUM to reclaim disk space, this may take a moment..." machine # [ 17.719164] k3s[903]: time="2026-09-30T09:25:06Z" level=info msg="Startup VACUUM completed successfully" machine # [ 17.721682] k3s[903]: time="2026-09-30T09:25:06Z" level=info msg="Kine available at unix://kine.sock" machine # [ 17.723265] k3s[903]: time="2026-09-30T09:25:06Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 17.726260] k3s[903]: time="2026-09-30T09:25:06Z" level=info msg="Datastore connection validated successfully, proceeding with bootstrap data generation" machine # [ 17.728155] k3s[903]: time="2026-09-30T09:25:06Z" level=info msg="generated self-signed CA certificate CN=k3s-client-ca@1790760306: notBefore=2026-09-30 08:25:06.077459703 +0000 UTC notAfter=2036-09-27 08:25:06.077459703 +0000 UTC" machine # [ 17.730747] k3s[903]: time="2026-09-30T09:25:06Z" level=info msg="certificate CN=system:admin,O=system:masters signed by CN=k3s-client-ca@1790760306: notBefore=2026-09-30 08:25:06 +0000 UTC notAfter=2027-09-30 08:25:06 +0000 UTC" machine # [ 17.733426] k3s[903]: time="2026-09-30T09:25:06Z" level=info msg="certificate CN=system:k3s-supervisor,O=system:masters signed by CN=k3s-client-ca@1790760306: notBefore=2026-09-30 08:25:06 +0000 UTC notAfter=2027-09-30 08:25:06 +0000 UTC" machine # [ 17.736292] k3s[903]: time="2026-09-30T09:25:06Z" level=info msg="certificate CN=system:kube-controller-manager signed by CN=k3s-client-ca@1790760306: notBefore=2026-09-30 08:25:06 +0000 UTC notAfter=2027-09-30 08:25:06 +0000 UTC" machine # [ 17.736986] k3s[903]: time="2026-09-30T09:25:06Z" level=info msg="certificate CN=system:kube-scheduler signed by CN=k3s-client-ca@1790760306: notBefore=2026-09-30 08:25:06 +0000 UTC notAfter=2027-09-30 08:25:06 +0000 UTC" machine # [ 17.737780] k3s[903]: time="2026-09-30T09:25:06Z" level=info msg="certificate CN=system:apiserver,O=system:masters signed by CN=k3s-client-ca@1790760306: notBefore=2026-09-30 08:25:06 +0000 UTC notAfter=2027-09-30 08:25:06 +0000 UTC" machine # [ 17.738479] k3s[903]: time="2026-09-30T09:25:06Z" level=info msg="certificate CN=k3s-cloud-controller-manager signed by CN=k3s-client-ca@1790760306: notBefore=2026-09-30 08:25:06 +0000 UTC notAfter=2027-09-30 08:25:06 +0000 UTC" machine # [ 17.739278] k3s[903]: time="2026-09-30T09:25:06Z" level=info msg="generated self-signed CA certificate CN=k3s-server-ca@1790760306: notBefore=2026-09-30 08:25:06.080502827 +0000 UTC notAfter=2036-09-27 08:25:06.080502827 +0000 UTC" machine # [ 17.739888] k3s[903]: time="2026-09-30T09:25:06Z" level=info msg="certificate CN=kube-apiserver signed by CN=k3s-server-ca@1790760306: notBefore=2026-09-30 08:25:06 +0000 UTC notAfter=2027-09-30 08:25:06 +0000 UTC" machine # [ 17.740813] k3s[903]: time="2026-09-30T09:25:06Z" level=info msg="certificate CN=kube-scheduler signed by CN=k3s-server-ca@1790760306: notBefore=2026-09-30 08:25:06 +0000 UTC notAfter=2027-09-30 08:25:06 +0000 UTC" machine # [ 17.741728] k3s[903]: time="2026-09-30T09:25:06Z" level=info msg="certificate CN=kube-controller-manager signed by CN=k3s-server-ca@1790760306: notBefore=2026-09-30 08:25:06 +0000 UTC notAfter=2027-09-30 08:25:06 +0000 UTC" machine # [ 17.742438] k3s[903]: time="2026-09-30T09:25:06Z" level=info msg="generated self-signed CA certificate CN=k3s-request-header-ca@1790760306: notBefore=2026-09-30 08:25:06.082058053 +0000 UTC notAfter=2036-09-27 08:25:06.082058053 +0000 UTC" machine # [ 17.743186] k3s[903]: time="2026-09-30T09:25:06Z" level=info msg="certificate CN=system:auth-proxy signed by CN=k3s-request-header-ca@1790760306: notBefore=2026-09-30 08:25:06 +0000 UTC notAfter=2027-09-30 08:25:06 +0000 UTC" machine # [ 17.743842] k3s[903]: time="2026-09-30T09:25:06Z" level=info msg="generated self-signed CA certificate CN=etcd-server-ca@1790760306: notBefore=2026-09-30 08:25:06.082738586 +0000 UTC notAfter=2036-09-27 08:25:06.082738586 +0000 UTC" machine # [ 17.744815] k3s[903]: time="2026-09-30T09:25:06Z" level=info msg="certificate CN=etcd-client signed by CN=etcd-server-ca@1790760306: notBefore=2026-09-30 08:25:06 +0000 UTC notAfter=2027-09-30 08:25:06 +0000 UTC" machine # [ 17.745600] k3s[903]: time="2026-09-30T09:25:06Z" level=info msg="generated self-signed CA certificate CN=etcd-peer-ca@1790760306: notBefore=2026-09-30 08:25:06.08340571 +0000 UTC notAfter=2036-09-27 08:25:06.08340571 +0000 UTC" machine # [ 17.746536] k3s[903]: time="2026-09-30T09:25:06Z" level=info msg="certificate CN=etcd-peer signed by CN=etcd-peer-ca@1790760306: notBefore=2026-09-30 08:25:06 +0000 UTC notAfter=2027-09-30 08:25:06 +0000 UTC" machine # [ 17.747278] k3s[903]: time="2026-09-30T09:25:06Z" level=info msg="certificate CN=etcd-server signed by CN=etcd-server-ca@1790760306: notBefore=2026-09-30 08:25:06 +0000 UTC notAfter=2027-09-30 08:25:06 +0000 UTC" machine # [ 17.777687] k3s[903]: time="2026-09-30T09:25:06Z" level=info msg="certificate CN=k3s,O=k3s signed by CN=k3s-server-ca@1790760306: notBefore=2026-09-30 08:25:06 +0000 UTC notAfter=2027-09-30 08:25:06 +0000 UTC" machine # [ 17.780422] k3s[903]: time="2026-09-30T09:25:06Z" level=warning msg="dynamiclistener [::]:6443: no cached certificate available for preload - deferring certificate load until storage initialization or first client request" machine # [ 17.784912] k3s[903]: time="2026-09-30T09:25:06Z" level=info msg="Active TLS secret / (ver=) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__615a_2d6d_32b4_d9cc-86aad8:fec0::615a:2d6d:32b4:d9cc listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=2B917D0AF06727813DBE524F1F867C565CD4F07B]" machine # [ 18.962668] k3s[903]: time="2026-09-30T09:25:07Z" level=info msg="Password verified locally for node machine" machine # [ 18.963421] k3s[903]: time="2026-09-30T09:25:07Z" level=info msg="certificate CN=machine signed by CN=k3s-server-ca@1790760306: notBefore=2026-09-30 08:25:07 +0000 UTC notAfter=2027-09-30 08:25:07 +0000 UTC" machine # [ 19.208575] k3s[903]: time="2026-09-30T09:25:07Z" level=info msg="certificate CN=system:node:machine,O=system:nodes signed by CN=k3s-client-ca@1790760306: notBefore=2026-09-30 08:25:07 +0000 UTC notAfter=2027-09-30 08:25:07 +0000 UTC" machine # [ 19.316520] k3s[903]: time="2026-09-30T09:25:07Z" level=info msg="certificate CN=system:kube-proxy signed by CN=k3s-client-ca@1790760306: notBefore=2026-09-30 08:25:07 +0000 UTC notAfter=2027-09-30 08:25:07 +0000 UTC" machine # [ 19.398986] k3s[903]: time="2026-09-30T09:25:07Z" level=info msg="certificate CN=system:k3s-controller signed by CN=k3s-client-ca@1790760306: notBefore=2026-09-30 08:25:07 +0000 UTC notAfter=2027-09-30 08:25:07 +0000 UTC" machine # [ 19.493083] k3s[903]: time="2026-09-30T09:25:07Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:45864: runtime core not ready" machine # [ 19.600831] k3s[903]: time="2026-09-30T09:25:07Z" level=info msg="Module overlay was already loaded" machine # [ 19.856131] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. machine # [ 19.861421] Bridge firewalling registered machine # [ 19.715335] k3s[903]: time="2026-09-30T09:25:08Z" level=warning msg="Failed to load kernel module iptable_nat with modprobe" machine # [ 19.721193] k3s[903]: time="2026-09-30T09:25:08Z" level=warning msg="Failed to load kernel module iptable_filter with modprobe" machine # [ 19.729607] k3s[903]: time="2026-09-30T09:25:08Z" level=warning msg="Failed to load kernel module nft-expr-counter with modprobe" machine # [ 19.812186] k3s[903]: time="2026-09-30T09:25:08Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_max' to 131072" machine # [ 19.812545] k3s[903]: time="2026-09-30T09:25:08Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400" machine # [ 19.819077] k3s[903]: time="2026-09-30T09:25:08Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600" machine # [ 19.822810] k3s[903]: time="2026-09-30T09:25:08Z" level=info msg="Set sysctl 'net/ipv4/conf/all/forwarding' to 1" machine # [ 19.829895] k3s[903]: time="2026-09-30T09:25:08Z" level=info msg="Connecting to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 19.831856] k3s[903]: time="2026-09-30T09:25:08Z" level=info msg="Creating k3s-cert-monitor event broadcaster" machine # [ 19.835492] k3s[903]: time="2026-09-30T09:25:08Z" level=info msg="Saving cluster bootstrap data to datastore" machine # [ 19.836418] k3s[903]: time="2026-09-30T09:25:08Z" level=info msg="Polling for API server readiness: GET /readyz failed: the server is currently unable to handle the request" machine # [ 19.837313] k3s[903]: time="2026-09-30T09:25:08Z" level=info msg="Handling backend connection request [machine]" machine # [ 19.843685] k3s[903]: time="2026-09-30T09:25:08Z" level=info msg="Connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 19.844143] k3s[903]: time="2026-09-30T09:25:08Z" level=info msg="Remotedialer connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 19.845331] k3s[903]: time="2026-09-30T09:25:08Z" level=info msg="Connection to etcd is ready" machine # [ 19.846229] k3s[903]: time="2026-09-30T09:25:08Z" level=info msg="ETCD server is now running" machine # [ 19.846827] k3s[903]: time="2026-09-30T09:25:08Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 19.849396] k3s[903]: time="2026-09-30T09:25:08Z" level=info msg="Running kube-apiserver --advertise-port=6443 --allow-privileged=true --anonymous-auth=false --api-audiences=https://kubernetes.default.svc.cluster.local,k3s --authorization-mode=Node,RBAC --bind-address=127.0.0.1 --cert-dir=/var/lib/rancher/k3s/server/tls/temporary-certs --client-ca-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --egress-selector-config-file=/var/lib/rancher/k3s/server/etc/egress-selector-config.yaml --enable-admission-plugins=NodeRestriction --enable-aggregator-routing=true --enable-bootstrap-token-auth=true --etcd-servers=unix://kine.sock --kubelet-certificate-authority=/var/lib/rancher/k3s/server/tls/server-ca.crt --kubelet-client-certificate=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.crt --kubelet-client-key=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.key --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --profiling=false --proxy-client-cert-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt --proxy-client-key-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.key --requestheader-allowed-names=system:auth-proxy --requestheader-client-ca-file=/var/lib/rancher/k3s/server/tls/request-header-ca.crt --requestheader-extra-headers-prefix=X-Remote-Extra- --requestheader-group-headers=X-Remote-Group --requestheader-username-headers=X-Remote-User --secure-port=6444 --service-account-issuer=https://kubernetes.default.svc.cluster.local --service-account-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-account-signing-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --storage-backend=etcd3 --tls-cert-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --tls-private-key-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 19.850675] k3s[903]: time="2026-09-30T09:25:08Z" level=info msg="Running kube-scheduler --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --bind-address=127.0.0.1 --kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --leader-elect=false --profiling=false --secure-port=10259 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 19.851387] k3s[903]: time="2026-09-30T09:25:08Z" level=info msg="Running kube-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --bind-address=127.0.0.1 --cluster-cidr=10.42.0.0/16 --cluster-signing-kube-apiserver-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kube-apiserver-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kubelet-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-serving-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-kubelet-serving-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --cluster-signing-legacy-unknown-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-legacy-unknown-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --configure-cloud-routes=false --controllers=*,tokencleaner,-service,-route,-cloud-node-lifecycle --kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --leader-elect=false --profiling=false --root-ca-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --secure-port=10257 --service-account-private-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key --use-service-account-credentials=true" machine # [ 19.857424] k3s[903]: time="2026-09-30T09:25:08Z" level=info msg="Running cloud-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --bind-address=127.0.0.1 --cloud-config=/var/lib/rancher/k3s/server/etc/cloud-config.yaml --cloud-provider=k3s --cluster-cidr=10.42.0.0/16 --configure-cloud-routes=false --controllers=*,-route --kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --leader-elect=false --leader-elect-resource-name=k3s-cloud-controller-manager --node-status-update-frequency=1m0s --profiling=false" machine # [ 19.864261] k3s[903]: time="2026-09-30T09:25:08Z" level=info msg="Server node token is available at /var/lib/rancher/k3s/server/token" machine # [ 19.865603] k3s[903]: time="2026-09-30T09:25:08Z" level=info msg="To join server node to cluster: k3s server -s https://10.0.2.15:6443 -t ${SERVER_NODE_TOKEN}" machine # [ 19.866996] k3s[903]: time="2026-09-30T09:25:08Z" level=info msg="Agent node token is available at /var/lib/rancher/k3s/server/agent-token" machine # [ 19.868411] k3s[903]: time="2026-09-30T09:25:08Z" level=info msg="To join agent node to cluster: k3s agent -s https://10.0.2.15:6443 -t ${AGENT_NODE_TOKEN}" machine # [ 19.905608] k3s[903]: time="2026-09-30T09:25:08Z" level=info msg="Wrote kubeconfig /etc/rancher/k3s/k3s.yaml" machine # [ 19.906428] k3s[903]: time="2026-09-30T09:25:08Z" level=info msg="Run: k3s kubectl" machine # [ 19.906887] k3s[903]: I0930 09:25:08.203756 903 options.go:263] external host was not specified, using 10.0.2.15 machine # [ 19.907514] k3s[903]: I0930 09:25:08.205819 903 server.go:158] Version: v1.36.4+k3s1 machine # [ 19.907973] k3s[903]: I0930 09:25:08.205850 903 server.go:160] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 19.909417] k3s[903]: time="2026-09-30T09:25:08Z" level=info msg="Logging containerd to /var/lib/rancher/k3s/agent/containerd/containerd.log" machine # [ 19.909804] k3s[903]: time="2026-09-30T09:25:08Z" level=info msg="Running containerd -c /var/lib/rancher/k3s/agent/etc/containerd/config.toml" machine # [ 19.945684] k3s[903]: time="2026-09-30T09:25:08Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:45906: runtime core not ready" machine # [ 19.996422] k3s[903]: I0930 09:25:08.346363 903 shared_informer.go:381] "Waiting for caches to sync" controller="node_authorizer" machine # [ 19.996606] k3s[903]: E0930 09:25:08.346531 903 options.go:205] The manifest file is empty, ignoring. machine # [ 20.002314] k3s[903]: I0930 09:25:08.353124 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 20.008228] k3s[903]: I0930 09:25:08.359044 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 20.011517] k3s[903]: I0930 09:25:08.362326 903 plugins.go:157] Loaded 15 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,PodGroupProtection,RuntimeClass,DefaultIngressClass,PodTopologyLabels,MutatingAdmissionPolicy,MutatingAdmissionWebhook. machine # [ 20.011791] k3s[903]: I0930 09:25:08.362352 903 plugins.go:160] Loaded 17 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,PodGroupWorkloadExists,NodeDeclaredFeatureValidator,JobValidation,PodResizeValidator,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. machine # [ 20.012524] k3s[903]: I0930 09:25:08.362678 903 instance.go:240] Using reconciler: lease machine # [ 20.029050] k3s[903]: I0930 09:25:08.379835 903 handler.go:304] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager machine # [ 20.029487] k3s[903]: W0930 09:25:08.380268 903 genericapiserver.go:798] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. machine # [ 20.033670] k3s[903]: I0930 09:25:08.384473 903 cidrallocator.go:198] starting ServiceCIDR Allocator Controller machine # [ 20.074461] k3s[903]: I0930 09:25:08.425014 903 handler.go:304] Adding GroupVersion v1 to ResourceManager machine # [ 20.076078] k3s[903]: I0930 09:25:08.425294 903 apis.go:112] API group "internal.apiserver.k8s.io" is not enabled, skipping. machine # [ 20.099701] k3s[903]: time="2026-09-30T09:25:08Z" level=info msg="Running kube-proxy --cluster-cidr=10.42.0.0/16 --conntrack-max-per-core=0 --conntrack-tcp-timeout-close-wait=0s --conntrack-tcp-timeout-established=0s --healthz-bind-address=127.0.0.1 --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubeproxy.kubeconfig --proxy-mode=iptables" machine # [ 20.106068] k3s[903]: I0930 09:25:08.456590 903 apis.go:112] API group "storagemigration.k8s.io" is not enabled, skipping. machine # [ 20.140162] k3s[903]: I0930 09:25:08.490854 903 handler.go:304] Adding GroupVersion authentication.k8s.io v1 to ResourceManager machine # [ 20.141842] k3s[903]: W0930 09:25:08.490909 903 genericapiserver.go:798] Skipping API authentication.k8s.io/v1beta1 because it has no resources. machine # [ 20.143566] k3s[903]: W0930 09:25:08.490920 903 genericapiserver.go:798] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. machine # [ 20.145258] k3s[903]: I0930 09:25:08.491310 903 handler.go:304] Adding GroupVersion authorization.k8s.io v1 to ResourceManager machine # [ 20.146697] k3s[903]: W0930 09:25:08.491330 903 genericapiserver.go:798] Skipping API authorization.k8s.io/v1beta1 because it has no resources. machine # [ 20.148333] k3s[903]: I0930 09:25:08.492062 903 handler.go:304] Adding GroupVersion autoscaling v2 to ResourceManager machine # [ 20.149679] k3s[903]: I0930 09:25:08.492745 903 handler.go:304] Adding GroupVersion autoscaling v1 to ResourceManager machine # [ 20.151076] k3s[903]: I0930 09:25:08.494134 903 handler.go:304] Adding GroupVersion batch v1 to ResourceManager machine # [ 20.152375] k3s[903]: W0930 09:25:08.494157 903 genericapiserver.go:798] Skipping API batch/v1beta1 because it has no resources. machine # [ 20.153845] k3s[903]: I0930 09:25:08.494839 903 handler.go:304] Adding GroupVersion certificates.k8s.io v1 to ResourceManager machine # [ 20.155305] k3s[903]: W0930 09:25:08.494864 903 genericapiserver.go:798] Skipping API certificates.k8s.io/v1beta1 because it has no resources. machine # [ 20.156893] k3s[903]: W0930 09:25:08.494911 903 genericapiserver.go:798] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. machine # [ 20.158513] k3s[903]: I0930 09:25:08.495414 903 handler.go:304] Adding GroupVersion coordination.k8s.io v1 to ResourceManager machine # [ 20.159935] k3s[903]: W0930 09:25:08.495433 903 genericapiserver.go:798] Skipping API coordination.k8s.io/v1beta1 because it has no resources. machine # [ 20.161532] k3s[903]: W0930 09:25:08.495449 903 genericapiserver.go:798] Skipping API coordination.k8s.io/v1alpha2 because it has no resources. machine # [ 20.163164] k3s[903]: I0930 09:25:08.495915 903 handler.go:304] Adding GroupVersion discovery.k8s.io v1 to ResourceManager machine # [ 20.164574] k3s[903]: W0930 09:25:08.495934 903 genericapiserver.go:798] Skipping API discovery.k8s.io/v1beta1 because it has no resources. machine # [ 20.166245] k3s[903]: I0930 09:25:08.497867 903 handler.go:304] Adding GroupVersion networking.k8s.io v1 to ResourceManager machine # [ 20.167656] k3s[903]: W0930 09:25:08.497918 903 genericapiserver.go:798] Skipping API networking.k8s.io/v1beta1 because it has no resources. machine # [ 20.169271] k3s[903]: I0930 09:25:08.498214 903 handler.go:304] Adding GroupVersion node.k8s.io v1 to ResourceManager machine # [ 20.170613] k3s[903]: W0930 09:25:08.498230 903 genericapiserver.go:798] Skipping API node.k8s.io/v1beta1 because it has no resources. machine # [ 20.172165] k3s[903]: W0930 09:25:08.498240 903 genericapiserver.go:798] Skipping API node.k8s.io/v1alpha1 because it has no resources. machine # [ 20.173664] k3s[903]: I0930 09:25:08.498701 903 handler.go:304] Adding GroupVersion policy v1 to ResourceManager machine # [ 20.175840] k3s[903]: W0930 09:25:08.498717 903 genericapiserver.go:798] Skipping API policy/v1beta1 because it has no resources. machine # [ 20.177349] k3s[903]: I0930 09:25:08.499584 903 handler.go:304] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager machine # [ 20.178828] k3s[903]: W0930 09:25:08.499601 903 genericapiserver.go:798] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. machine # [ 20.180486] k3s[903]: W0930 09:25:08.499611 903 genericapiserver.go:798] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. machine # [ 20.182152] k3s[903]: I0930 09:25:08.499894 903 handler.go:304] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager machine # [ 20.183553] k3s[903]: W0930 09:25:08.499908 903 genericapiserver.go:798] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. machine # [ 20.185154] k3s[903]: W0930 09:25:08.499918 903 genericapiserver.go:798] Skipping API scheduling.k8s.io/v1alpha2 because it has no resources. machine # [ 20.186727] k3s[903]: I0930 09:25:08.501246 903 handler.go:304] Adding GroupVersion storage.k8s.io v1 to ResourceManager machine # [ 20.188169] k3s[903]: W0930 09:25:08.501267 903 genericapiserver.go:798] Skipping API storage.k8s.io/v1beta1 because it has no resources. machine # [ 20.189683] k3s[903]: W0930 09:25:08.501279 903 genericapiserver.go:798] Skipping API storage.k8s.io/v1alpha1 because it has no resources. machine # [ 20.191280] k3s[903]: I0930 09:25:08.501915 903 handler.go:304] Adding GroupVersion flowcontrol.apiserver.k8s.io v1 to ResourceManager machine # [ 20.192778] k3s[903]: W0930 09:25:08.501930 903 genericapiserver.go:798] Skipping API flowcontrol.apiserver.k8s.io/v1beta3 because it has no resources. machine # [ 20.194468] k3s[903]: W0930 09:25:08.501940 903 genericapiserver.go:798] Skipping API flowcontrol.apiserver.k8s.io/v1beta2 because it has no resources. machine # [ 20.196164] k3s[903]: W0930 09:25:08.501949 903 genericapiserver.go:798] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. machine # [ 20.197816] k3s[903]: I0930 09:25:08.503848 903 handler.go:304] Adding GroupVersion apps v1 to ResourceManager machine # [ 20.199179] k3s[903]: W0930 09:25:08.503891 903 genericapiserver.go:798] Skipping API apps/v1beta2 because it has no resources. machine # [ 20.200668] k3s[903]: W0930 09:25:08.503903 903 genericapiserver.go:798] Skipping API apps/v1beta1 because it has no resources. machine # [ 20.202207] k3s[903]: I0930 09:25:08.505447 903 handler.go:304] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager machine # [ 20.203704] k3s[903]: W0930 09:25:08.505468 903 genericapiserver.go:798] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. machine # [ 20.205434] k3s[903]: W0930 09:25:08.505483 903 genericapiserver.go:798] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. machine # [ 20.207156] k3s[903]: I0930 09:25:08.505796 903 handler.go:304] Adding GroupVersion events.k8s.io v1 to ResourceManager machine # [ 20.208529] k3s[903]: W0930 09:25:08.505810 903 genericapiserver.go:798] Skipping API events.k8s.io/v1beta1 because it has no resources. machine # [ 20.210097] k3s[903]: I0930 09:25:08.506769 903 handler.go:304] Adding GroupVersion resource.k8s.io v1 to ResourceManager machine # [ 20.211482] k3s[903]: W0930 09:25:08.506787 903 genericapiserver.go:798] Skipping API resource.k8s.io/v1beta2 because it has no resources. machine # [ 20.213098] k3s[903]: W0930 09:25:08.506798 903 genericapiserver.go:798] Skipping API resource.k8s.io/v1beta1 because it has no resources. machine # [ 20.214651] k3s[903]: W0930 09:25:08.506807 903 genericapiserver.go:798] Skipping API resource.k8s.io/v1alpha3 because it has no resources. machine # [ 20.216260] k3s[903]: I0930 09:25:08.509678 903 handler.go:304] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager machine # [ 20.217716] k3s[903]: W0930 09:25:08.509707 903 genericapiserver.go:798] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. machine # [ 20.474094] k3s[903]: I0930 09:25:08.824720 903 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 20.476249] k3s[903]: I0930 09:25:08.824727 903 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 20.478184] k3s[903]: I0930 09:25:08.825101 903 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 20.480709] k3s[903]: I0930 09:25:08.825122 903 secure_serving.go:214] Serving securely on 127.0.0.1:6444 machine # [ 20.481962] k3s[903]: I0930 09:25:08.825247 903 controller.go:89] "Starting OpenAPI V3 AggregationController" machine # [ 20.483301] k3s[903]: I0930 09:25:08.825319 903 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 20.484601] k3s[903]: I0930 09:25:08.825702 903 customresource_discovery_controller.go:294] Starting DiscoveryController machine # [ 20.485978] k3s[903]: I0930 09:25:08.826025 903 storage_readiness_hook.go:70] Storage is ready for all registered resources machine # [ 20.487460] k3s[903]: I0930 09:25:08.826053 903 remote_available_controller.go:434] Starting RemoteAvailability controller machine # [ 20.488880] k3s[903]: I0930 09:25:08.826066 903 cache.go:32] Waiting for caches to sync for RemoteAvailability controller machine # [ 20.490312] k3s[903]: I0930 09:25:08.826106 903 aggregator.go:185] waiting for initial CRD sync... machine # [ 20.491482] k3s[903]: I0930 09:25:08.826258 903 controller.go:113] "Deleting old lease on startup" lease="kube-system/apiserver-ik4pcwfs7qgdl76byc4pomgvia" machine # [ 20.493234] k3s[903]: time="2026-09-30T09:25:08Z" level=info msg="Starting apiserver lease garbage collector" logger=k3s machine # [ 20.494566] k3s[903]: time="2026-09-30T09:25:08Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 20.495800] k3s[903]: time="2026-09-30T09:25:08Z" level=info msg="Starting legacy_token_tracking_controller" logger=k3s machine # [ 20.497207] k3s[903]: time="2026-09-30T09:25:08Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 20.498421] k3s[903]: I0930 09:25:08.827509 903 controller.go:87] "Starting OpenAPI AggregationController" machine # [ 20.499696] k3s[903]: I0930 09:25:08.827899 903 dynamic_serving_content.go:135] "Starting controller" name="aggregator-proxy-cert::/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt::/var/lib/rancher/k3s/server/tls/client-auth-proxy.key" machine # [ 20.502275] k3s[903]: time="2026-09-30T09:25:08Z" level=info msg="Starting CRDFinalizer" logger=k3s machine # [ 20.503422] k3s[903]: I0930 09:25:08.826578 903 apiservice_controller.go:100] Starting APIServiceRegistrationController machine # [ 20.504791] k3s[903]: I0930 09:25:08.828599 903 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller machine # [ 20.506348] k3s[903]: time="2026-09-30T09:25:08Z" level=info msg=Starting controller=kubernetes-service-cidr-controller logger=k3s machine # [ 20.507804] k3s[903]: time="2026-09-30T09:25:08Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 20.509128] k3s[903]: I0930 09:25:08.829097 903 repairip.go:210] Starting ipallocator-repair-controller machine # [ 20.510355] k3s[903]: I0930 09:25:08.829113 903 shared_informer.go:381] "Waiting for caches to sync" controller="ipallocator-repair-controller" machine # [ 20.511949] k3s[903]: I0930 09:25:08.829441 903 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 20.513811] k3s[903]: I0930 09:25:08.829517 903 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 20.519201] k3s[903]: I0930 09:25:08.826898 903 local_available_controller.go:156] Starting LocalAvailability controller machine # [ 20.520634] k3s[903]: I0930 09:25:08.829948 903 cache.go:32] Waiting for caches to sync for LocalAvailability controller machine # [ 20.522062] k3s[903]: I0930 09:25:08.827230 903 cluster_authentication_trust_controller.go:459] Starting cluster_authentication_trust_controller controller machine # [ 20.523757] k3s[903]: time="2026-09-30T09:25:08Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 20.524938] k3s[903]: I0930 09:25:08.827565 903 system_namespaces_controller.go:66] Starting system namespaces controller machine # [ 20.526319] k3s[903]: I0930 09:25:08.827596 903 apf_controller.go:377] Starting API Priority and Fairness config controller machine # [ 20.527738] k3s[903]: I0930 09:25:08.828084 903 controller.go:142] Starting OpenAPI controller machine # [ 20.528887] k3s[903]: I0930 09:25:08.828135 903 controller.go:90] Starting OpenAPI V3 controller machine # [ 20.530096] k3s[903]: I0930 09:25:08.828155 903 naming_controller.go:305] Starting NamingConditionController machine # [ 20.531362] k3s[903]: I0930 09:25:08.828196 903 nonstructuralschema_controller.go:202] Starting NonStructuralSchemaConditionController machine # [ 20.532855] k3s[903]: I0930 09:25:08.828219 903 apiapproval_controller.go:196] Starting KubernetesAPIApprovalPolicyConformantConditionController machine # [ 20.534499] k3s[903]: I0930 09:25:08.828285 903 crdregistration_controller.go:114] Starting crd-autoregister controller machine # [ 20.535867] k3s[903]: I0930 09:25:08.830895 903 shared_informer.go:381] "Waiting for caches to sync" controller="crd-autoregister" machine # [ 20.537406] k3s[903]: I0930 09:25:08.861240 903 shared_informer.go:409] "Caches are synced" machine # [ 20.538520] k3s[903]: I0930 09:25:08.861276 903 policy_source.go:248] refreshing policies machine # [ 20.568934] k3s[903]: E0930 09:25:08.919715 903 controller.go:201] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" machine # [ 20.576299] k3s[903]: time="2026-09-30T09:25:08Z" level=info msg="Caches are synced" logger=k3s machine # [ 20.576909] k3s[903]: time="2026-09-30T09:25:08Z" level=info msg="Caches are synced" logger=k3s machine # [ 20.577575] k3s[903]: I0930 09:25:08.927418 903 cache.go:39] Caches are synced for RemoteAvailability controller machine # [ 20.578144] k3s[903]: I0930 09:25:08.928678 903 cache.go:39] Caches are synced for APIServiceRegistrationController controller machine # [ 20.578602] k3s[903]: time="2026-09-30T09:25:08Z" level=info msg="Caches are synced" logger=k3s machine # [ 20.579527] k3s[903]: time="2026-09-30T09:25:08Z" level=info msg="Creating default ServiceCIDR" CIDRs="[10.43.0.0/16]" logger=k3s machine # [ 20.580246] k3s[903]: I0930 09:25:08.928904 903 handler_discovery.go:459] Starting ResourceDiscoveryManager machine # [ 20.580906] k3s[903]: I0930 09:25:08.930117 903 cache.go:39] Caches are synced for LocalAvailability controller machine # [ 20.581686] k3s[903]: I0930 09:25:08.930166 903 shared_informer.go:388] "Caches are synced" controller="ipallocator-repair-controller" machine # [ 20.582514] k3s[903]: I0930 09:25:08.931400 903 shared_informer.go:388] "Caches are synced" controller="crd-autoregister" machine # [ 20.583244] k3s[903]: time="2026-09-30T09:25:08Z" level=info msg="Caches are synced" logger=k3s machine # [ 20.583850] k3s[903]: I0930 09:25:08.931517 903 aggregator.go:187] initial CRD sync complete... machine # [ 20.584674] k3s[903]: I0930 09:25:08.931531 903 autoregister_controller.go:144] Starting autoregister controller machine # [ 20.585220] k3s[903]: I0930 09:25:08.931542 903 cache.go:32] Waiting for caches to sync for autoregister controller machine # [ 20.585685] k3s[903]: I0930 09:25:08.931553 903 cache.go:39] Caches are synced for autoregister controller machine # [ 20.586403] k3s[903]: I0930 09:25:08.931830 903 apf_controller.go:382] Running API Priority and Fairness config worker machine # [ 20.586862] k3s[903]: I0930 09:25:08.931866 903 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process machine # [ 20.596238] k3s[903]: I0930 09:25:08.947029 903 shared_informer.go:388] "Caches are synced" controller="node_authorizer" machine # [ 20.603525] k3s[903]: I0930 09:25:08.954275 903 shared_informer.go:409] "Caches are synced" machine # [ 20.605222] k3s[903]: I0930 09:25:08.954357 903 policy_source.go:248] refreshing policies machine # [ 20.653280] k3s[903]: E0930 09:25:09.004053 903 controller.go:95] Unable to perform initial Kubernetes service initialization: Service "kubernetes" is invalid: spec.clusterIPs: Invalid value: ["10.43.0.1"]: failed to allocate IP 10.43.0.1: the provided network does not match the current range machine # [ 20.707786] k3s[903]: time="2026-09-30T09:25:09Z" level=info msg="Setting default ServiceCIDR condition Ready to True" logger=k3s machine # [ 20.709337] k3s[903]: I0930 09:25:09.058543 903 cidrallocator.go:302] created ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 20.713758] k3s[903]: I0930 09:25:09.063853 903 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 20.772076] k3s[903]: I0930 09:25:09.122650 903 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io machine # [ 20.883358] k3s[903]: time="2026-09-30T09:25:09Z" level=info msg="containerd is now running" machine # [ 20.896607] k3s[903]: time="2026-09-30T09:25:09Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/if20jbcicwv9y92klzcxk35m5bcz2ql0-nix-grpc-farm-lb.tar" machine # [ 21.483352] k3s[903]: I0930 09:25:09.833724 903 storage_scheduling.go:137] created PriorityClass system-node-critical with value 2000001000 machine # [ 21.487746] k3s[903]: I0930 09:25:09.838498 903 storage_scheduling.go:137] created PriorityClass system-cluster-critical with value 2000000000 machine # [ 21.488186] k3s[903]: I0930 09:25:09.838528 903 storage_scheduling.go:153] all system priority classes are created successfully or already exist. machine # [ 21.831806] k3s[903]: time="2026-09-30T09:25:10Z" level=info msg="Polling for API server readiness: GET /readyz failed: unknown" machine # [ 22.454625] k3s[903]: I0930 09:25:10.805373 903 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io machine # [ 22.496836] k3s[903]: I0930 09:25:10.847152 903 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io machine # [ 22.559343] k3s[903]: time="2026-09-30T09:25:10Z" level=info msg="Imported docker.io/library/nix-grpc-farm-lb:0.1.0-beta.4" machine # [ 22.563272] k3s[903]: time="2026-09-30T09:25:10Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-lb@sha256:18ee6724be589622e1aee9d13c5121e7b2c992ca636c935ade90c66423e18f37" machine # [ 22.565430] k3s[903]: I0930 09:25:10.916141 903 alloc.go:329] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.43.0.1"} machine # [ 22.570374] k3s[903]: W0930 09:25:10.921183 903 lease.go:265] Resetting endpoints for master service "kubernetes" to [10.0.2.15] machine # [ 22.572277] k3s[903]: I0930 09:25:10.922539 903 controller.go:667] quota admission added evaluator for: endpoints machine # [ 22.576660] k3s[903]: I0930 09:25:10.927470 903 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io machine # [ 22.615040] k3s[903]: time="2026-09-30T09:25:10Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nixos/if20jbcicwv9y92klzcxk35m5bcz2ql0-nix-grpc-farm-lb.tar in 1.718618148s" machine # [ 22.615436] k3s[903]: time="2026-09-30T09:25:10Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/mdr49fkwz88w5c0w9703i3jglsn0j5ci-nix-grpc-farm.tar" machine # [ 23.841711] k3s[903]: time="2026-09-30T09:25:12Z" level=info msg="Waiting for untainted node" machine # [ 23.842530] k3s[903]: time="2026-09-30T09:25:12Z" level=info msg="Kube API server is now running" machine # [ 23.843302] k3s[903]: time="2026-09-30T09:25:12Z" level=info msg="k3s is up and running" machine # [ 23.844554] systemd[1]: Started k3s service. machine # [ 23.845444] k3s[903]: time="2026-09-30T09:25:12Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Node and Certificate Authority certificates managed by k3s are OK" object=machine reason=CertificateExpirationOK type=Normal machine # [ 23.845938] k3s[903]: time="2026-09-30T09:25:12Z" level=info msg="Creating k3s-supervisor event broadcaster" machine # [ 23.851663] systemd[1]: Starting niks3 server... machine # [ 23.867506] k3s[903]: E0930 09:25:12.218315 903 options.go:205] The manifest file is empty, ignoring. machine # [ 23.870222] k3s[903]: I0930 09:25:12.220238 903 controllermanager.go:204] "Starting" version="v1.36.4+k3s1" machine # [ 23.871583] k3s[903]: I0930 09:25:12.220259 903 controllermanager.go:206] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 23.876066] k3s[903]: I0930 09:25:12.226797 903 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 23.876585] k3s[903]: I0930 09:25:12.226823 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 23.877231] k3s[903]: I0930 09:25:12.226906 903 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 23.877908] k3s[903]: I0930 09:25:12.226922 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 23.881238] k3s[903]: I0930 09:25:12.226954 903 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 23.881869] k3s[903]: I0930 09:25:12.226968 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 23.882774] k3s[903]: I0930 09:25:12.229215 903 secure_serving.go:214] Serving securely on 127.0.0.1:10257 machine # [ 23.883404] k3s[903]: I0930 09:25:12.229741 903 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key" machine # [ 23.883860] k3s[903]: I0930 09:25:12.229917 903 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 23.891935] k3s[903]: I0930 09:25:12.242733 903 controller.go:667] quota admission added evaluator for: serviceaccounts machine # [ 23.925619] k3s[903]: I0930 09:25:12.276398 903 controllermanager.go:689] "Warning: controller is disabled" controller="bootstrap-signer-controller" machine # [ 23.933532] k3s[903]: I0930 09:25:12.284306 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 23.951561] k3s[903]: time="2026-09-30T09:25:12Z" level=info msg="Creating embedded CRD addons.k3s.cattle.io" machine # [ 23.957063] k3s[903]: time="2026-09-30T09:25:12Z" level=info msg="Creating embedded CRD etcdsnapshotfiles.k3s.cattle.io" machine # [ 23.962712] k3s[903]: time="2026-09-30T09:25:12Z" level=info msg="Creating embedded CRD helmchartconfigs.helm.cattle.io" machine # [ 23.967203] k3s[903]: I0930 09:25:12.318005 903 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="limitranges" machine # [ 23.969349] k3s[903]: I0930 09:25:12.318045 903 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="horizontalpodautoscalers.autoscaling" machine # [ 23.971923] k3s[903]: I0930 09:25:12.318074 903 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="ingresses.networking.k8s.io" machine # [ 23.974444] k3s[903]: I0930 09:25:12.318109 903 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="leases.coordination.k8s.io" machine # [ 23.976832] k3s[903]: I0930 09:25:12.318134 903 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpointslices.discovery.k8s.io" machine # [ 23.979514] k3s[903]: I0930 09:25:12.318159 903 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpoints" machine # [ 23.981903] k3s[903]: I0930 09:25:12.318184 903 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="cronjobs.batch" machine # [ 23.984288] k3s[903]: I0930 09:25:12.318211 903 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="roles.rbac.authorization.k8s.io" machine # [ 23.987442] k3s[903]: I0930 09:25:12.318239 903 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="csistoragecapacities.storage.k8s.io" machine # [ 23.989780] k3s[903]: I0930 09:25:12.318335 903 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="resourceclaimtemplates.resource.k8s.io" machine # [ 23.992185] k3s[903]: I0930 09:25:12.318367 903 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="statefulsets.apps" machine # [ 23.994335] k3s[903]: I0930 09:25:12.318406 903 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="controllerrevisions.apps" machine # [ 23.996563] k3s[903]: I0930 09:25:12.318458 903 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="networkpolicies.networking.k8s.io" machine # [ 23.999064] k3s[903]: I0930 09:25:12.318483 903 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="poddisruptionbudgets.policy" machine # [ 24.001324] k3s[903]: I0930 09:25:12.318507 903 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="rolebindings.rbac.authorization.k8s.io" machine # [ 24.003747] k3s[903]: I0930 09:25:12.318536 903 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="replicasets.apps" machine # [ 24.005818] k3s[903]: I0930 09:25:12.318561 903 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="daemonsets.apps" machine # [ 24.007867] k3s[903]: I0930 09:25:12.318585 903 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="jobs.batch" machine # [ 24.009851] k3s[903]: I0930 09:25:12.318611 903 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="serviceaccounts" machine # [ 24.012215] k3s[903]: I0930 09:25:12.318657 903 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="podtemplates" machine # [ 24.014967] k3s[903]: I0930 09:25:12.318683 903 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="deployments.apps" machine # [ 24.017181] k3s[903]: I0930 09:25:12.320613 903 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 24.018777] k3s[903]: time="2026-09-30T09:25:12Z" level=info msg="Creating embedded CRD helmcharts.helm.cattle.io" machine # [ 24.020209] k3s[903]: I0930 09:25:12.326922 903 shared_informer.go:409] "Caches are synced" machine # [ 24.021478] k3s[903]: I0930 09:25:12.327020 903 shared_informer.go:409] "Caches are synced" machine # [ 24.022694] k3s[903]: I0930 09:25:12.331733 903 shared_informer.go:409] "Caches are synced" machine # [ 24.024163] k3s[903]: time="2026-09-30T09:25:12Z" level=info msg="Waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 24.025933] k3s[903]: I0930 09:25:12.346939 903 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 24.027479] k3s[903]: I0930 09:25:12.361694 903 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 24.029021] k3s[903]: I0930 09:25:12.378603 903 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 24.033662] k3s[903]: I0930 09:25:12.384459 903 shared_informer.go:409] "Caches are synced" machine: (finished: waiting for unit k3s.service, in 25.11 seconds) machine: waiting for success: kubectl get ns farm machine # [ 24.140563] k3s[903]: I0930 09:25:12.491068 903 node_lifecycle_controller.go:402] "Controller will reconcile labels" logger="node-lifecycle-controller" machine # [ 24.140928] k3s[903]: I0930 09:25:12.491142 903 controllermanager.go:689] "Warning: controller is disabled" controller="service-lb-controller" machine # [ 24.141566] k3s[903]: I0930 09:25:12.491154 903 controllermanager.go:689] "Warning: controller is disabled" controller="cloud-node-lifecycle-controller" machine # [ 24.142110] k3s[903]: I0930 09:25:12.491169 903 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="podgroup-protection-controller" requiredFeatureGates=["GenericWorkload"] machine # [ 24.142532] k3s[903]: I0930 09:25:12.491208 903 controllermanager.go:641] "Warning: skipping controller" controller="podgroup-protection-controller" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 24.502230] k3s[903]: time="2026-09-30T09:25:12Z" level=info msg="Done waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 24.502656] k3s[903]: time="2026-09-30T09:25:12Z" level=info msg="Waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 24.507678] k3s[903]: time="2026-09-30T09:25:12Z" level=info msg="Done waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 24.507971] k3s[903]: time="2026-09-30T09:25:12Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-40.1.4+up40.1.0.tgz" machine # [ 24.511278] k3s[903]: time="2026-09-30T09:25:12Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-crd-40.1.4+up40.1.0.tgz" machine # [ 24.511722] k3s[903]: time="2026-09-30T09:25:12Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/ccm.yaml" machine # [ 24.512248] k3s[903]: time="2026-09-30T09:25:12Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/coredns.yaml" machine # [ 24.512695] k3s[903]: time="2026-09-30T09:25:12Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/local-storage.yaml" machine # [ 24.513210] k3s[903]: time="2026-09-30T09:25:12Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/rolebindings.yaml" machine # [ 24.513643] k3s[903]: time="2026-09-30T09:25:12Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/runtimes.yaml" machine # [ 24.514193] k3s[903]: time="2026-09-30T09:25:12Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/traefik.yaml" machine # [ 24.589044] k3s[903]: time="2026-09-30T09:25:12Z" level=info msg="Tunnel server egress proxy mode: agent" machine # [ 24.589421] k3s[903]: time="2026-09-30T09:25:12Z" level=info msg="Starting dynamiclistener CN filter node controller with SANs: [127.0.0.1 ::1 localhost machine 10.0.2.15 fec0::615a:2d6d:32b4:d9cc 10.43.0.1 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local]" machine # [ 24.776533] k3s[903]: time="2026-09-30T09:25:13Z" level=info msg="Creating new TLS secret for kube-system/k3s-serving (count: 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__615a_2d6d_32b4_d9cc-86aad8:fec0::615a:2d6d:32b4:d9cc listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=2B917D0AF06727813DBE524F1F867C565CD4F07B]" machine # [ 24.799880] k3s[903]: time="2026-09-30T09:25:13Z" level=info msg="Active TLS secret kube-system/k3s-serving (ver=235) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__615a_2d6d_32b4_d9cc-86aad8:fec0::615a:2d6d:32b4:d9cc listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=2B917D0AF06727813DBE524F1F867C565CD4F07B]" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 25.641741] k3s[903]: I0930 09:25:13.992107 903 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="podcertificaterequest-cleaner-controller" requiredFeatureGates=["PodCertificateRequest"] machine # [ 25.641920] k3s[903]: I0930 09:25:13.992144 903 controllermanager.go:641] "Warning: skipping controller" controller="podcertificaterequest-cleaner-controller" machine # [ 25.698113] k3s[903]: time="2026-09-30T09:25:14Z" level=info msg="Starting k3s.cattle.io/v1, Kind=Addon controller" machine # [ 25.698523] k3s[903]: time="2026-09-30T09:25:14Z" level=info msg="Creating deploy event broadcaster" machine # [ 25.698994] k3s[903]: I0930 09:25:14.049372 903 controller.go:667] quota admission added evaluator for: addons.k3s.cattle.io machine # [ 25.701741] k3s[903]: time="2026-09-30T09:25:14Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 25.702732] k3s[903]: time="2026-09-30T09:25:14Z" level=info msg="Creating helm-controller event broadcaster" machine # [ 25.707978] k3s[903]: time="2026-09-30T09:25:14Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=ApplyingManifest type=Normal machine # [ 25.712060] k3s[903]: time="2026-09-30T09:25:14Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 25.716083] k3s[903]: time="2026-09-30T09:25:14Z" level=info msg="Cluster dns configmap has been set successfully" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 26.705404] k3s[903]: time="2026-09-30T09:25:15Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 26.726060] k3s[903]: I0930 09:25:15.076780 903 range_allocator.go:113] "No Secondary Service CIDR provided. Skipping filtering out secondary service addresses" logger="node-ipam-controller" machine # [ 26.769670] k3s[903]: I0930 09:25:15.120280 903 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" requiredFeatureGates=["ClusterTrustBundle"] machine # [ 26.769907] k3s[903]: I0930 09:25:15.120313 903 controllermanager.go:641] "Warning: skipping controller" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" machine # [ 26.778145] k3s[903]: I0930 09:25:15.128397 903 controllermanager.go:689] "Warning: controller is disabled" controller="node-route-controller" machine # [ 26.816952] k3s[903]: time="2026-09-30T09:25:15Z" level=info msg="Starting rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding controller" machine # [ 26.822517] k3s[903]: time="2026-09-30T09:25:15Z" level=info msg="Starting batch/v1, Kind=Job controller" machine # [ 26.822849] k3s[903]: time="2026-09-30T09:25:15Z" level=info msg="Starting /v1, Kind=Secret controller" machine # [ 26.823087] k3s[903]: time="2026-09-30T09:25:15Z" level=info msg="Starting /v1, Kind=ConfigMap controller" machine # [ 26.824428] k3s[903]: time="2026-09-30T09:25:15Z" level=info msg="Starting /v1, Kind=ServiceAccount controller" machine # [ 26.828110] k3s[903]: time="2026-09-30T09:25:15Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChart controller" machine # [ 26.829718] k3s[903]: time="2026-09-30T09:25:15Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChartConfig controller" machine # [ 26.838493] k3s[903]: W0930 09:25:15.189270 903 probe.go:275] Flexvolume plugin directory at /usr/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating. machine # [ 26.901334] k3s[903]: time="2026-09-30T09:25:15Z" level=info msg="Imported docker.io/library/nix-grpc-farm:0.1.0-beta.4" machine # [ 26.903540] k3s[903]: time="2026-09-30T09:25:15Z" level=info msg="Tagged docker.io/library/nix-grpc-farm@sha256:ddf506e9fe4add694e5bfb952451de26a9e2eb21044947ffed3c57911b706db9" machine # [ 26.995270] k3s[903]: time="2026-09-30T09:25:15Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=AppliedManifest type=Normal machine # [ 27.008712] k3s[903]: time="2026-09-30T09:25:15Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=ApplyingManifest type=Normal machine # [ 27.259087] k3s[903]: time="2026-09-30T09:25:15Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nixos/mdr49fkwz88w5c0w9703i3jglsn0j5ci-nix-grpc-farm.tar in 4.643558329s" machine # [ 27.264264] k3s[903]: time="2026-09-30T09:25:15Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/smddpgqzjvlqv3lx57wdzl7kma805fj0-k3s-airgap-images-amd64.tar.zst" machine # [ 27.295350] k3s[903]: I0930 09:25:15.645985 903 controllermanager.go:641] "Warning: skipping controller" controller="storage-version-migrator-controller" machine # [ 27.299930] k3s[903]: time="2026-09-30T09:25:15Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=AppliedManifest type=Normal machine # [ 27.313526] k3s[903]: time="2026-09-30T09:25:15Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=ApplyingManifest type=Normal machine # [ 27.705464] k3s[903]: time="2026-09-30T09:25:16Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine: (finished: waiting for success: kubectl get ns farm, in 3.73 seconds) machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key machine # [ 27.839680] k3s[903]: I0930 09:25:16.190416 903 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="storageversion-garbage-collector-controller" requiredFeatureGates=["APIServerIdentity","StorageVersionAPI"] machine # [ 27.839906] k3s[903]: I0930 09:25:16.190455 903 controllermanager.go:641] "Warning: skipping controller" controller="storageversion-garbage-collector-controller" machine # [ 27.913156] k3s[903]: I0930 09:25:16.263138 903 serving.go:417] Generated self-signed cert in-memory machine # [ 27.997115] k3s[903]: I0930 09:25:16.347708 903 controller.go:667] quota admission added evaluator for: deployments.apps machine # [ 28.007618] k3s[903]: I0930 09:25:16.358422 903 serving.go:417] Generated self-signed cert in-memory machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key, in 0.18 seconds) machine: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key machine # [ 28.089053] k3s[903]: I0930 09:25:16.439797 903 controllermanager.go:689] "Warning: controller is disabled" controller="selinux-warning-controller" machine # [ 28.167627] k3s[903]: I0930 09:25:16.518372 903 controllermanager.go:163] Version: v1.36.4+k3s1 machine # [ 28.170841] k3s[903]: I0930 09:25:16.521648 903 secure_serving.go:214] Serving securely on 127.0.0.1:10258 machine # [ 28.171258] k3s[903]: I0930 09:25:16.522071 903 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 28.172028] k3s[903]: I0930 09:25:16.522098 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.172792] k3s[903]: I0930 09:25:16.522144 903 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 28.173535] k3s[903]: I0930 09:25:16.522162 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.174436] k3s[903]: I0930 09:25:16.522189 903 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 28.174933] k3s[903]: I0930 09:25:16.522186 903 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 28.175684] k3s[903]: I0930 09:25:16.522204 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.176554] k3s[903]: time="2026-09-30T09:25:16Z" level=info msg="Creating service-lb-controller event broadcaster" machine # [ 28.194728] k3s[903]: I0930 09:25:16.545515 903 alloc.go:329] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.43.0.10"} machine # [ 28.198638] k3s[903]: time="2026-09-30T09:25:16Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=AppliedManifest type=Normal machine: (finished: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key, in 0.20 seconds) machine: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine # [ 28.271472] k3s[903]: I0930 09:25:16.622178 903 shared_informer.go:409] "Caches are synced" machine # [ 28.272488] k3s[903]: I0930 09:25:16.622403 903 shared_informer.go:409] "Caches are synced" machine # [ 28.272847] k3s[903]: I0930 09:25:16.622433 903 shared_informer.go:409] "Caches are synced" machine: (finished: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.14 seconds) subtest: chart deploys and workers become Ready machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine # [ 28.409099] k3s[903]: time="2026-09-30T09:25:16Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 28.412545] k3s[903]: time="2026-09-30T09:25:16Z" level=info msg="Starting /v1, Kind=Pod controller" machine # [ 28.416551] k3s[903]: time="2026-09-30T09:25:16Z" level=info msg="Starting apps/v1, Kind=DaemonSet controller" machine # [ 28.424575] k3s[903]: I0930 09:25:16.774548 903 controllermanager.go:338] Started "service-lb-controller" machine # [ 28.424902] k3s[903]: W0930 09:25:16.774572 903 controllermanager.go:315] "node-route-controller" is disabled machine # [ 28.425542] k3s[903]: I0930 09:25:16.774776 903 controllermanager.go:338] Started "cloud-node-controller" machine # [ 28.426077] k3s[903]: I0930 09:25:16.774901 903 controllermanager.go:338] Started "cloud-node-lifecycle-controller" machine # [ 28.426568] k3s[903]: time="2026-09-30T09:25:16Z" level=info msg="Starting discovery.k8s.io/v1, Kind=EndpointSlice controller" machine # [ 28.427188] k3s[903]: I0930 09:25:16.775045 903 controller.go:235] Starting service controller machine # [ 28.427628] k3s[903]: I0930 09:25:16.775089 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.428168] k3s[903]: I0930 09:25:16.775237 903 node_controller.go:179] Sending events to api server. machine # [ 28.428612] k3s[903]: I0930 09:25:16.775274 903 node_lifecycle_controller.go:112] Sending events to api server machine # [ 28.429203] k3s[903]: I0930 09:25:16.775297 903 node_controller.go:188] Waiting for informer caches to sync machine # [ 28.441030] k3s[903]: I0930 09:25:16.790959 903 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="resourcepoolstatusrequest-controller" requiredFeatureGates=["DRAResourcePoolStatus"] machine # [ 28.441331] k3s[903]: I0930 09:25:16.790993 903 controllermanager.go:641] "Warning: skipping controller" controller="resourcepoolstatusrequest-controller" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 28.596980] k3s[903]: I0930 09:25:16.947599 903 gc_controller.go:98] "Starting GC controller" machine # [ 28.600324] k3s[903]: I0930 09:25:16.947644 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.601596] k3s[903]: I0930 09:25:16.949497 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.602662] k3s[903]: I0930 09:25:16.949539 903 namespace_controller.go:202] "Starting namespace controller" machine # [ 28.603052] k3s[903]: I0930 09:25:16.949552 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.603778] k3s[903]: I0930 09:25:16.949601 903 horizontal.go:204] "Starting HPA controller" machine # [ 28.604942] k3s[903]: I0930 09:25:16.949615 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.607820] k3s[903]: I0930 09:25:16.949665 903 ttl_controller.go:127] "Starting TTL controller" machine # [ 28.610095] k3s[903]: I0930 09:25:16.949678 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.610808] k3s[903]: I0930 09:25:16.949762 903 pv_controller_base.go:318] "Starting persistent volume controller" machine # [ 28.612516] k3s[903]: I0930 09:25:16.949777 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.616101] k3s[903]: I0930 09:25:16.949819 903 controller.go:174] "Starting ephemeral volume controller" machine # [ 28.617030] k3s[903]: I0930 09:25:16.949833 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.617916] k3s[903]: I0930 09:25:16.950076 903 serviceaccounts_controller.go:117] "Starting service account controller" machine # [ 28.618838] k3s[903]: I0930 09:25:16.950090 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.619734] k3s[903]: I0930 09:25:16.950154 903 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-legacy-unknown" machine # [ 28.622834] k3s[903]: I0930 09:25:16.950168 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.624346] k3s[903]: I0930 09:25:16.950199 903 certificate_controller.go:120] "Starting certificate controller" name="csrapproving" machine # [ 28.625735] k3s[903]: I0930 09:25:16.950212 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.627083] k3s[903]: I0930 09:25:16.950244 903 cleaner.go:83] "Starting CSR cleaner controller" machine # [ 28.630234] k3s[903]: I0930 09:25:16.950317 903 node_lifecycle_controller.go:436] "Sending events to api server" machine # [ 28.630945] k3s[903]: I0930 09:25:16.950344 903 node_lifecycle_controller.go:443] "Starting node controller" machine # [ 28.631956] k3s[903]: I0930 09:25:16.950355 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.632644] k3s[903]: I0930 09:25:16.950434 903 endpoints_controller.go:193] "Starting endpoint controller" machine # [ 28.633278] k3s[903]: I0930 09:25:16.950447 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.633683] k3s[903]: I0930 09:25:16.950518 903 daemon_controller.go:364] "Starting daemon sets controller" machine # [ 28.634355] k3s[903]: I0930 09:25:16.950530 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.634872] k3s[903]: I0930 09:25:16.950606 903 job_controller.go:336] "Starting job controller" machine # [ 28.636401] k3s[903]: I0930 09:25:16.950620 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.636819] k3s[903]: I0930 09:25:16.950658 903 tokencleaner.go:117] "Starting token cleaner controller" machine # [ 28.637040] k3s[903]: I0930 09:25:16.950674 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.637477] k3s[903]: I0930 09:25:16.950713 903 expand_controller.go:328] "Starting expand controller" machine # [ 28.637935] k3s[903]: I0930 09:25:16.950726 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.638604] k3s[903]: I0930 09:25:16.950757 903 pvc_protection_controller.go:172] "Starting PVC protection controller" machine # [ 28.642115] k3s[903]: I0930 09:25:16.950770 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.642641] k3s[903]: I0930 09:25:16.950805 903 vac_protection_controller.go:206] "Starting VAC protection controller" machine # [ 28.643192] k3s[903]: I0930 09:25:16.950819 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.643643] k3s[903]: I0930 09:25:16.950918 903 endpointslicemirroring_controller.go:226] "Starting EndpointSliceMirroring controller" machine # [ 28.644198] k3s[903]: I0930 09:25:16.950933 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.644641] k3s[903]: I0930 09:25:16.950996 903 stateful_set.go:234] "Starting stateful set controller" machine # [ 28.645159] k3s[903]: I0930 09:25:16.951009 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.645644] k3s[903]: I0930 09:25:16.951072 903 cronjob_controllerv2.go:143] "Starting cronjob controller v2" machine # [ 28.646469] k3s[903]: I0930 09:25:16.951086 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.646992] k3s[903]: I0930 09:25:16.951163 903 node_ipam_controller.go:142] "Starting ipam controller" machine # [ 28.647503] k3s[903]: I0930 09:25:16.951176 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.651054] k3s[903]: I0930 09:25:16.951207 903 ttlafterfinished_controller.go:112] "Starting TTL after finished controller" machine # [ 28.651663] k3s[903]: I0930 09:25:16.951220 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.652213] k3s[903]: I0930 09:25:16.951297 903 controller.go:753] "Starting resource claim controller" machine # [ 28.652640] k3s[903]: I0930 09:25:16.951310 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.653218] k3s[903]: I0930 09:25:16.951343 903 device_taint_eviction.go:783] "Starting" controller="device-taint-eviction-controller" numWorkers=8 machine # [ 28.653657] k3s[903]: I0930 09:25:16.951509 903 endpointslice_controller.go:280] "Starting endpoint slice controller" machine # [ 28.654498] k3s[903]: I0930 09:25:16.951521 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.654929] k3s[903]: I0930 09:25:16.951595 903 replica_set.go:285] "Starting controller" name="replicaset" machine # [ 28.655737] k3s[903]: I0930 09:25:16.951608 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.656436] k3s[903]: I0930 09:25:16.951691 903 servicecidrs_controller.go:137] "Starting" controller="service-cidr-controller" machine # [ 28.656934] k3s[903]: I0930 09:25:16.951704 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.657762] k3s[903]: I0930 09:25:16.951761 903 attach_detach_controller.go:334] "Starting attach detach controller" machine # [ 28.658520] k3s[903]: I0930 09:25:16.951774 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.659177] k3s[903]: I0930 09:25:16.951802 903 pv_protection_controller.go:81] "Starting PV protection controller" machine # [ 28.659600] k3s[903]: I0930 09:25:16.951814 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.660146] k3s[903]: I0930 09:25:16.951845 903 publisher.go:107] "Starting root CA cert publisher controller" machine # [ 28.660591] k3s[903]: I0930 09:25:16.951857 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.661113] k3s[903]: I0930 09:25:16.951915 903 legacy_serviceaccount_token_cleaner.go:103] "Starting legacy service account token cleaner controller" machine # [ 28.661605] k3s[903]: I0930 09:25:16.951928 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.662209] k3s[903]: I0930 09:25:16.951984 903 deployment_controller.go:180] "Starting controller" controller="deployment" machine # [ 28.662634] k3s[903]: I0930 09:25:16.951997 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.663406] k3s[903]: I0930 09:25:16.952152 903 clusterroleaggregation_controller.go:176] "Starting ClusterRoleAggregator controller" machine # [ 28.664116] k3s[903]: I0930 09:25:16.952165 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.664873] k3s[903]: I0930 09:25:16.952194 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.665567] k3s[903]: I0930 09:25:16.952228 903 taint_eviction.go:283] "Starting" controller="taint-eviction-controller" machine # [ 28.666197] k3s[903]: I0930 09:25:16.952287 903 taint_eviction.go:288] "Sending events to API server" machine # [ 28.666578] k3s[903]: I0930 09:25:16.952297 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.667131] k3s[903]: I0930 09:25:16.952356 903 replica_set.go:285] "Starting controller" name="replicationcontroller" machine # [ 28.667612] k3s[903]: I0930 09:25:16.952371 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.668205] k3s[903]: I0930 09:25:16.952401 903 disruption.go:453] "Sending events to api server." machine # [ 28.668668] k3s[903]: I0930 09:25:16.952430 903 disruption.go:460] "Starting disruption controller" machine # [ 28.668848] k3s[903]: I0930 09:25:16.952440 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.669596] k3s[903]: I0930 09:25:16.953142 903 resource_quota_controller.go:297] "Starting resource quota controller" machine # [ 28.670129] k3s[903]: I0930 09:25:16.953157 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.670648] k3s[903]: I0930 09:25:16.953193 903 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-serving" machine # [ 28.715346] k3s[903]: I0930 09:25:16.953205 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.715981] k3s[903]: I0930 09:25:16.953245 903 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-client" machine # [ 28.716802] k3s[903]: I0930 09:25:16.953257 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.717559] k3s[903]: I0930 09:25:16.953291 903 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kube-apiserver-client" machine # [ 28.718142] k3s[903]: I0930 09:25:16.953303 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.718650] k3s[903]: I0930 09:25:16.953341 903 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 28.719195] k3s[903]: I0930 09:25:16.953544 903 device_taint_eviction.go:823] "Sending events to api server" machine # [ 28.719659] k3s[903]: I0930 09:25:16.953624 903 device_taint_eviction.go:1023] "Waiting" for="cache and event handler sync" machine # [ 28.719980] k3s[903]: I0930 09:25:16.953757 903 garbagecollector.go:141] "Starting controller" controller="garbagecollector" machine # [ 28.720516] k3s[903]: I0930 09:25:16.953788 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.721186] k3s[903]: I0930 09:25:16.954553 903 resource_quota_monitor.go:309] "QuotaMonitor running" machine # [ 28.721697] k3s[903]: I0930 09:25:16.954662 903 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 28.722377] k3s[903]: I0930 09:25:16.954734 903 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 28.722878] k3s[903]: I0930 09:25:16.954800 903 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 28.723626] k3s[903]: I0930 09:25:16.955117 903 graph_builder.go:387] "Running" component="GraphBuilder" machine # [ 28.724377] k3s[903]: I0930 09:25:16.975429 903 shared_informer.go:409] "Caches are synced" machine # [ 28.724892] k3s[903]: I0930 09:25:16.991362 903 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" resource="addons.k3s.cattle.io" machine # [ 28.725589] k3s[903]: I0930 09:25:16.991397 903 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" resource="helmchartconfigs.helm.cattle.io" machine # [ 28.726204] k3s[903]: I0930 09:25:16.991426 903 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" resource="helmcharts.helm.cattle.io" machine # [ 28.726721] k3s[903]: I0930 09:25:16.991477 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.727490] k3s[903]: time="2026-09-30T09:25:17Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 28.727939] k3s[903]: I0930 09:25:17.069134 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.755082] k3s[903]: time="2026-09-30T09:25:17Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" object=kube-system/local-storage reason=DeletingManifest type=Normal machine # [ 28.756434] k3s[903]: I0930 09:25:17.107212 903 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceSlice" machine # [ 28.757160] k3s[903]: I0930 09:25:17.107535 903 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceClaim" machine # [ 28.757580] k3s[903]: I0930 09:25:17.107561 903 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceClaim + event handler k8s.io/kubernetes/pkg/controller/devicetainteviction.(*Controller).Run" machine # [ 28.758162] k3s[903]: I0930 09:25:17.107787 903 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceSlice + event handler k8s.io/kubernetes/pkg/controller/devicetainteviction.(*Controller).Run" machine # [ 28.759235] k3s[903]: I0930 09:25:17.110063 903 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.Pod" machine # [ 28.760579] k3s[903]: I0930 09:25:17.110195 903 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.Pod + event handler k8s.io/kubernetes/pkg/controller/devicetainteviction.(*Controller).Run" machine # [ 28.761052] k3s[903]: I0930 09:25:17.110333 903 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.DeviceClass" machine # [ 28.783399] k3s[903]: time="2026-09-30T09:25:17Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=ApplyingManifest type=Normal machine # [ 28.797136] k3s[903]: I0930 09:25:17.147910 903 shared_informer.go:409] "Caches are synced" machine # [ 28.798877] k3s[903]: I0930 09:25:17.149683 903 shared_informer.go:409] "Caches are synced" machine # [ 28.799634] k3s[903]: I0930 09:25:17.149750 903 shared_informer.go:409] "Caches are synced" machine # [ 28.800175] k3s[903]: I0930 09:25:17.149829 903 shared_informer.go:409] "Caches are synced" machine # [ 28.800620] k3s[903]: I0930 09:25:17.149854 903 shared_informer.go:409] "Caches are synced" machine # [ 28.801325] k3s[903]: I0930 09:25:17.150857 903 shared_informer.go:409] "Caches are synced" machine # [ 28.801937] k3s[903]: I0930 09:25:17.150928 903 shared_informer.go:409] "Caches are synced" machine # [ 28.803325] k3s[903]: I0930 09:25:17.150975 903 shared_informer.go:409] "Caches are synced" machine # [ 28.804110] k3s[903]: I0930 09:25:17.151024 903 shared_informer.go:409] "Caches are synced" machine # [ 28.804682] k3s[903]: I0930 09:25:17.151111 903 shared_informer.go:409] "Caches are synced" machine # [ 28.805608] k3s[903]: I0930 09:25:17.151175 903 shared_informer.go:409] "Caches are synced" machine # [ 28.806131] k3s[903]: I0930 09:25:17.151217 903 shared_informer.go:409] "Caches are synced" machine # [ 28.806581] k3s[903]: I0930 09:25:17.151263 903 shared_informer.go:409] "Caches are synced" machine # [ 28.807299] k3s[903]: I0930 09:25:17.151341 903 shared_informer.go:409] "Caches are synced" machine # [ 28.807872] k3s[903]: I0930 09:25:17.151394 903 shared_informer.go:409] "Caches are synced" machine # [ 28.808988] k3s[903]: I0930 09:25:17.151447 903 shared_informer.go:409] "Caches are synced" machine # [ 28.809378] k3s[903]: I0930 09:25:17.151488 903 shared_informer.go:409] "Caches are synced" machine # [ 28.809736] k3s[903]: I0930 09:25:17.153122 903 shared_informer.go:409] "Caches are synced" machine # [ 28.810516] k3s[903]: I0930 09:25:17.153160 903 shared_informer.go:409] "Caches are synced" machine # [ 28.811172] k3s[903]: I0930 09:25:17.153194 903 shared_informer.go:409] "Caches are synced" machine # [ 28.812045] k3s[903]: I0930 09:25:17.153299 903 shared_informer.go:409] "Caches are synced" machine # [ 28.812313] k3s[903]: I0930 09:25:17.153341 903 shared_informer.go:409] "Caches are synced" machine # [ 28.812786] k3s[903]: I0930 09:25:17.153356 903 shared_informer.go:409] "Caches are synced" machine # [ 28.813569] k3s[903]: I0930 09:25:17.153400 903 shared_informer.go:409] "Caches are synced" machine # [ 28.814315] k3s[903]: I0930 09:25:17.153440 903 range_allocator.go:177] "Sending events to api server" machine # [ 28.815086] k3s[903]: I0930 09:25:17.153466 903 shared_informer.go:409] "Caches are synced" machine # [ 28.815668] k3s[903]: I0930 09:25:17.153469 903 range_allocator.go:181] "Starting range CIDR allocator" machine # [ 28.816449] k3s[903]: I0930 09:25:17.153481 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.816909] k3s[903]: I0930 09:25:17.153492 903 shared_informer.go:409] "Caches are synced" machine # [ 28.817586] k3s[903]: I0930 09:25:17.153567 903 shared_informer.go:409] "Caches are synced" machine # [ 28.818289] k3s[903]: I0930 09:25:17.153984 903 shared_informer.go:409] "Caches are synced" machine # [ 28.818784] k3s[903]: I0930 09:25:17.154037 903 shared_informer.go:409] "Caches are synced" machine # [ 28.819650] k3s[903]: I0930 09:25:17.154048 903 shared_informer.go:409] "Caches are synced" machine # [ 28.820364] k3s[903]: I0930 09:25:17.154088 903 shared_informer.go:409] "Caches are synced" machine # [ 28.820833] k3s[903]: I0930 09:25:17.154122 903 shared_informer.go:409] "Caches are synced" machine # [ 28.821547] k3s[903]: I0930 09:25:17.154174 903 shared_informer.go:409] "Caches are synced" machine # [ 28.822104] k3s[903]: I0930 09:25:17.154208 903 shared_informer.go:409] "Caches are synced" machine # [ 28.822533] k3s[903]: I0930 09:25:17.154387 903 shared_informer.go:409] "Caches are synced" machine # [ 28.823035] k3s[903]: I0930 09:25:17.154498 903 shared_informer.go:409] "Caches are synced" machine # [ 28.823516] k3s[903]: I0930 09:25:17.154525 903 shared_informer.go:409] "Caches are synced" machine # [ 28.824022] k3s[903]: I0930 09:25:17.154695 903 shared_informer.go:409] "Caches are synced" machine # [ 28.824829] k3s[903]: I0930 09:25:17.155337 903 shared_informer.go:409] "Caches are synced" machine # [ 28.825376] k3s[903]: I0930 09:25:17.155372 903 shared_informer.go:409] "Caches are synced" machine # [ 28.825872] k3s[903]: I0930 09:25:17.155398 903 shared_informer.go:409] "Caches are synced" machine # [ 29.093950] k3s[903]: time="2026-09-30T09:25:17Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Deferred node password secret validation complete" object=machine reason=NodePasswordValidationComplete type=Normal machine # [ 29.096838] k3s[903]: I0930 09:25:17.447140 903 controller.go:667] quota admission added evaluator for: helmcharts.helm.cattle.io machine # [ 29.099043] k3s[903]: time="2026-09-30T09:25:17Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=AppliedManifest type=Normal machine # [ 29.105889] k3s[903]: I0930 09:25:17.456691 903 shared_informer.go:409] "Caches are synced" machine # [ 29.110736] k3s[903]: time="2026-09-30T09:25:17Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=ApplyingManifest type=Normal machine # [ 29.141263] k3s[903]: I0930 09:25:17.492058 903 shared_informer.go:409] "Caches are synced" machine # [ 29.154313] k3s[903]: time="2026-09-30T09:25:17Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Applying HelmChart from https://%{KUBERNETES_API}%/static/charts/nix-grpc-farm.tgz using Job kube-system/helm-install-nix-grpc-farm " object=kube-system/nix-grpc-farm reason=ApplyJob type=Normal machine # [ 29.175990] k3s[903]: I0930 09:25:17.526788 903 controller.go:667] quota admission added evaluator for: jobs.batch machine # [ 29.242592] k3s[903]: I0930 09:25:17.593350 903 controller.go:667] quota admission added evaluator for: replicasets.apps machine # [ 29.306102] k3s[903]: time="2026-09-30T09:25:17Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=AppliedManifest type=Normal machine # [ 29.321623] k3s[903]: time="2026-09-30T09:25:17Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=ApplyingManifest type=Normal machine # [ 29.343093] k3s[903]: I0930 09:25:17.693898 903 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 29.347233] k3s[903]: I0930 09:25:17.698008 903 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 29.443137] k3s[903]: time="2026-09-30T09:25:17Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=AppliedManifest type=Normal machine # [ 29.496609] k3s[903]: time="2026-09-30T09:25:17Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/traefik.yaml\"" object=kube-system/traefik reason=DeletingManifest type=Normal machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 29.699076] k3s[903]: time="2026-09-30T09:25:18Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Resumed synced Job kube-system/helm-install-nix-grpc-farm" object=kube-system/nix-grpc-farm reason=ResumeJob type=Normal machine # [ 29.708477] k3s[903]: time="2026-09-30T09:25:18Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 29.803549] k3s[903]: I0930 09:25:18.153950 903 shared_informer.go:409] "Caches are synced" machine # [ 29.803741] k3s[903]: I0930 09:25:18.153986 903 garbagecollector.go:166] "Garbage collector: all resource monitors have synced" machine # [ 29.804382] k3s[903]: I0930 09:25:18.153997 903 garbagecollector.go:169] "Proceeding to collect garbage" machine # [ 29.818871] k3s[903]: I0930 09:25:18.169386 903 shared_informer.go:409] "Caches are synced" machine # [ 30.519352] postgres[1205]: [1205] ERROR: relation "goose_db_version" does not exist at character 36 machine # [ 30.519773] postgres[1205]: [1205] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC machine # [ 30.543194] niks3-server[1197]: 2026/09/30 09:25:18 OK 20241026095416_initial_model.sql (9.52ms) machine # [ 30.546719] niks3-server[1197]: 2026/09/30 09:25:18 OK 20251210153512_drop_unused_gin_index.sql (3.53ms) machine # [ 30.552228] niks3-server[1197]: 2026/09/30 09:25:18 OK 20251218171726_add_pins.sql (5.42ms) machine # [ 30.557599] niks3-server[1197]: 2026/09/30 09:25:18 OK 20260628120000_add_object_size_and_stats.sql (4.49ms) machine # [ 30.561796] niks3-server[1197]: 2026/09/30 09:25:18 OK 20260905000000_add_claims.sql (4.99ms) machine # [ 30.565634] niks3-server[1197]: 2026/09/30 09:25:18 OK 20260920000000_drop_claims.sql (3.78ms) machine # [ 30.568512] niks3-server[1197]: 2026/09/30 09:25:18 OK 20260923120000_add_pushes.sql (2.8ms) machine # [ 30.569091] niks3-server[1197]: 2026/09/30 09:25:18 goose: successfully migrated database to version: 20260923120000 machine # [ 30.572120] niks3-server[1197]: 2026/09/30 09:25:18 OK 1_commit_pending_closure.sql (3.55ms) machine # [ 30.574143] k3s[903]: time="2026-09-30T09:25:18Z" level=info msg="Imported docker.io/rancher/klipper-helm:v0.13.3-build20260727" machine # [ 30.575319] niks3-server[1197]: 2026/09/30 09:25:18 OK 2_object_stats_trigger.sql (2.94ms) machine # [ 30.577441] niks3-server[1197]: 2026/09/30 09:25:18 OK 3_commit_push.sql (1.76ms) machine # [ 30.577943] niks3-server[1197]: 2026/09/30 09:25:18 goose: up to current file version: 3 machine # [ 30.578705] k3s[903]: time="2026-09-30T09:25:18Z" level=info msg="Tagged docker.io/rancher/klipper-helm@sha256:5425a2b4613d2458dbdff99218e8d487ebb59c20e7a941f061c0777070f0aac1" machine # [ 30.579626] k3s[903]: time="2026-09-30T09:25:18Z" level=info msg="Imported docker.io/rancher/klipper-lb:v0.4.17" machine # [ 30.583540] niks3-server[1197]: 2026/09/30 09:25:18 INFO OIDC provider initialized name=kubernetes issuer=https://kubernetes.default.svc.cluster.local machine # [ 30.584032] niks3-server[1197]: 2026/09/30 09:25:18 INFO OIDC authentication enabled config=/nix/store/v0b0sqyzhrjsz48x3klf7b7vl89apzs0-niks3-oidc.json machine # [ 30.584969] niks3-server[1197]: 2026/09/30 09:25:18 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key machine # [ 30.586671] k3s[903]: time="2026-09-30T09:25:18Z" level=info msg="Tagged docker.io/rancher/klipper-lb@sha256:910944bb0bd94f060a82a56ca1ea1c577d3e49b3473a093a47a985f32e92d94a" machine # [ 30.587818] k3s[903]: time="2026-09-30T09:25:18Z" level=info msg="Imported docker.io/rancher/local-path-provisioner:v0.0.37" machine # [ 30.592573] k3s[903]: time="2026-09-30T09:25:18Z" level=info msg="Tagged docker.io/rancher/local-path-provisioner@sha256:e757967a5ec338f6a9b371c5a9688bedaa8c3578ea3dd4db329ea0084be0a86f" machine # [ 30.592915] k3s[903]: time="2026-09-30T09:25:18Z" level=info msg="Imported docker.io/rancher/mirrored-coredns-coredns:1.14.6" machine # [ 30.597784] k3s[903]: time="2026-09-30T09:25:18Z" level=info msg="Tagged docker.io/rancher/mirrored-coredns-coredns@sha256:900f9c109f7a33545d3c811516e8376df9019147b750f5ce3e254468769176ea" machine # [ 30.598299] k3s[903]: time="2026-09-30T09:25:18Z" level=info msg="Imported docker.io/rancher/mirrored-library-busybox:1.37.0" machine # [ 30.607031] k3s[903]: time="2026-09-30T09:25:18Z" level=info msg="Tagged docker.io/rancher/mirrored-library-busybox@sha256:101b4afd76732482eff9b95cae5f94bcf295e521fbec4e01b69c5421f3f3f3e5" machine # [ 30.607342] k3s[903]: time="2026-09-30T09:25:18Z" level=info msg="Imported docker.io/rancher/mirrored-library-traefik:3.7.8" machine # [ 30.609383] k3s[903]: time="2026-09-30T09:25:18Z" level=info msg="Tagged docker.io/rancher/mirrored-library-traefik@sha256:4299bbed850421258fc5448c2e0e6ad350981d4d335a68de11b92448aedbefe5" machine # [ 30.609854] k3s[903]: time="2026-09-30T09:25:18Z" level=info msg="Imported docker.io/rancher/mirrored-metrics-server:v0.9.0" machine # [ 30.611626] k3s[903]: time="2026-09-30T09:25:18Z" level=info msg="Tagged docker.io/rancher/mirrored-metrics-server@sha256:d9862115e7c7881280d3d75ca26bda8ffc0fc213315979575bf23ce9826205c0" machine # [ 30.612219] k3s[903]: time="2026-09-30T09:25:18Z" level=info msg="Imported docker.io/rancher/mirrored-pause:3.10.2" machine # [ 30.617436] niks3-server[1197]: 2026/09/30 09:25:18 INFO Read proxy enabled — serving cache objects from S3 machine # [ 30.618734] niks3-server[1197]: 2026/09/30 09:25:18 INFO Using socket-activated listener address=0.0.0.0:5751 machine # [ 30.620499] niks3-server[1197]: 2026/09/30 09:25:18 INFO systemd watchdog enabled interval=15s machine # [ 30.621211] niks3-server[1197]: 2026/09/30 09:25:18 INFO Starting HTTP server address=0.0.0.0:5751 machine # [ 30.622046] systemd[1]: Started niks3 server. machine # [ 30.622587] k3s[903]: time="2026-09-30T09:25:18Z" level=info msg="Tagged docker.io/rancher/mirrored-pause@sha256:f548e0e8e3dc1896ca956272154dde3314e8cc4fde0a57577ee9fa1c63f5baf4" machine # [ 30.623173] systemd[1]: Reached target Multi-User System. machine # [ 30.623791] systemd[1]: Startup finished in 988ms (kernel) + 3.489s (initrd) + 26.142s (userspace) = 30.620s. machine # [ 30.705359] k3s[903]: time="2026-09-30T09:25:19Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 30.923547] k3s[903]: time="2026-09-30T09:25:19Z" level=info msg="Imported 8 images from /var/lib/rancher/k3s/agent/images/nixos/smddpgqzjvlqv3lx57wdzl7kma805fj0-k3s-airgap-images-amd64.tar.zst in 3.66392181s" machine # [ 30.926381] k3s[903]: time="2026-09-30T09:25:19Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/xp60q8nsn5afbj78sv3hn9lkmdi2cl2n-nix-grpc-farm-client.tar" machine # [ 31.405063] k3s[903]: time="2026-09-30T09:25:19Z" level=info msg="Running kubelet --cloud-provider=external --config-dir=/var/lib/rancher/k3s/agent/etc/kubelet.conf.d --containerd=/run/k3s/containerd/containerd.sock --eviction-hard=nodefs.available<1%,imagefs.available<1% --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubelet.kubeconfig --node-ip=10.0.2.15,fec0::615a:2d6d:32b4:d9cc --node-labels= --read-only-port=0" machine # [ 31.410221] k3s[903]: Flag --containerd has been deprecated, This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed. machine # [ 31.412811] k3s[903]: I0930 09:25:19.763586 903 server.go:541] "Kubelet version" kubeletVersion="v1.36.4+k3s1" machine # [ 31.414230] k3s[903]: I0930 09:25:19.763606 903 server.go:543] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 31.415679] k3s[903]: I0930 09:25:19.763643 903 watchdog_linux.go:94] "Systemd watchdog is not enabled" machine # [ 31.417042] k3s[903]: I0930 09:25:19.763655 903 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." machine # [ 31.419180] k3s[903]: I0930 09:25:19.765106 903 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/agent/client-ca.crt" machine # [ 31.421151] k3s[903]: I0930 09:25:19.769361 903 server.go:1444] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" machine # [ 31.423529] k3s[903]: I0930 09:25:19.774285 903 server.go:804] "--cgroups-per-qos enabled, but --cgroup-root was not specified. Defaulting to /" machine # [ 31.423926] k3s[903]: I0930 09:25:19.774322 903 server.go:865] "NoSwap is set due to memorySwapBehavior not specified" memorySwapBehavior="" FailSwapOn=false machine # [ 31.424533] k3s[903]: I0930 09:25:19.774564 903 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] machine # [ 31.425995] k3s[903]: I0930 09:25:19.774593 903 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"machine","RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"MemoryReservationPolicy":"None","PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} machine # [ 31.426721] k3s[903]: I0930 09:25:19.774830 903 topology_manager.go:172] "Creating topology manager with none policy" machine # [ 31.427252] k3s[903]: I0930 09:25:19.774848 903 container_manager_linux.go:309] "Creating device plugin manager" machine # [ 31.427697] k3s[903]: I0930 09:25:19.774949 903 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" machine # [ 31.429340] k3s[903]: I0930 09:25:19.780086 903 state_mem.go:45] "Initialized" logger="CPUManager state memory" machine # [ 31.430114] k3s[903]: I0930 09:25:19.780371 903 kubelet.go:485] "Attempting to sync node with API server" machine # [ 31.430624] k3s[903]: I0930 09:25:19.780393 903 kubelet.go:386] "Adding static pod path" path="/var/lib/rancher/k3s/agent/pod-manifests" machine # [ 31.431203] k3s[903]: I0930 09:25:19.780429 903 kubelet.go:397] "Adding apiserver pod source" machine # [ 31.431647] k3s[903]: I0930 09:25:19.780450 903 apiserver.go:41] "Waiting for node sync before watching apiserver pods" machine # [ 31.432415] k3s[903]: I0930 09:25:19.783232 903 kuberuntime_manager.go:308] "Container runtime initialized" containerRuntime="containerd" version="2.3.4-k3s1.36" apiVersion="v1" machine # [ 31.433147] k3s[903]: I0930 09:25:19.783962 903 kubelet.go:1002] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" machine # [ 31.433525] k3s[903]: I0930 09:25:19.783988 903 kubelet.go:1029] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" machine # [ 31.439060] k3s[903]: I0930 09:25:19.786976 903 server.go:1280] "Started kubelet" machine # [ 31.439810] k3s[903]: I0930 09:25:19.787019 903 server.go:193] "Starting to listen" address="0.0.0.0" port=10250 machine # [ 31.440449] k3s[903]: I0930 09:25:19.787090 903 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 machine # [ 31.440932] k3s[903]: I0930 09:25:19.787174 903 server_v1.go:49] "podresources" method="list" useActivePods=true machine # [ 31.441592] k3s[903]: I0930 09:25:19.787356 903 server.go:264] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" machine # [ 31.442094] k3s[903]: I0930 09:25:19.787927 903 server.go:354] "Adding debug handlers to kubelet server" machine # [ 31.442664] k3s[903]: I0930 09:25:19.793493 903 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" machine # [ 31.444199] k3s[903]: I0930 09:25:19.795012 903 volume_manager.go:310] "Starting Kubelet Volume Manager" machine # [ 31.444807] k3s[903]: I0930 09:25:19.795186 903 desired_state_of_world_populator.go:146] "Desired state populator starts to run" machine # [ 31.445415] k3s[903]: I0930 09:25:19.795245 903 reconciler.go:29] "Reconciler: start to sync state" machine # [ 31.446500] k3s[903]: E0930 09:25:19.797293 903 kubelet_node_status.go:396] "Error getting the current node from lister" err="node \"machine\" not found" machine # [ 31.447217] k3s[903]: E0930 09:25:19.798006 903 kubelet.go:3516] "Unable to register mirror pod because node is not registered yet" err="node \"machine\" not found" node="machine" machine # [ 31.447611] k3s[903]: I0930 09:25:19.798052 903 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 31.448046] k3s[903]: I0930 09:25:19.798184 903 dynamic_serving_content.go:135] "Starting controller" name="kubelet-server-cert-files::/var/lib/rancher/k3s/agent/serving-kubelet.crt::/var/lib/rancher/k3s/agent/serving-kubelet.key" machine # [ 31.454655] k3s[903]: E0930 09:25:19.805459 903 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"machine\" not found" node="machine" machine # [ 31.459407] k3s[903]: I0930 09:25:19.810202 903 factory.go:222] Registration of the systemd container factory successfully machine # [ 31.460052] k3s[903]: I0930 09:25:19.810323 903 factory.go:220] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory machine # [ 31.485190] k3s[903]: I0930 09:25:19.835983 903 factory.go:222] Registration of the containerd container factory successfully machine # [ 31.495246] k3s[903]: E0930 09:25:19.845394 903 kubelet.go:1725] "Image garbage collection failed once. Stats initialization may not have completed yet" err="invalid capacity 0 on image filesystem" machine # [ 31.502339] k3s[903]: I0930 09:25:19.853055 903 cpu_manager.go:235] "Starting" policy="none" machine # [ 31.502631] k3s[903]: I0930 09:25:19.853076 903 cpu_manager.go:236] "Reconciling" reconcilePeriod="10s" machine # [ 31.503165] k3s[903]: I0930 09:25:19.853101 903 state_mem.go:45] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" machine # [ 31.511511] k3s[903]: I0930 09:25:19.862321 903 policy_none.go:50] "Start" machine # [ 31.511970] k3s[903]: I0930 09:25:19.862369 903 memory_manager.go:190] "Starting memorymanager" policy="None" machine # [ 31.512630] k3s[903]: I0930 09:25:19.862394 903 state_mem.go:40] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" machine # [ 31.519923] k3s[903]: I0930 09:25:19.870083 903 policy_none.go:44] "Start" machine # [ 31.524697] systemd[1]: Created slice libcontainer container kubepods.slice. machine # [ 31.538388] systemd[1]: Created slice libcontainer container kubepods-burstable.slice. machine # [ 31.541301] systemd[1]: Created slice libcontainer container kubepods-besteffort.slice. machine # [ 31.546690] k3s[903]: E0930 09:25:19.897454 903 kubelet_node_status.go:396] "Error getting the current node from lister" err="node \"machine\" not found" machine # [ 31.548844] k3s[903]: E0930 09:25:19.898524 903 kubelet.go:3516] "Unable to register mirror pod because node is not registered yet" err="node \"machine\" not found" node="machine" machine # [ 31.551047] k3s[903]: E0930 09:25:19.901799 903 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" machine # [ 31.551338] k3s[903]: I0930 09:25:19.901967 903 eviction_manager.go:194] "Eviction manager: starting control loop" machine # [ 31.551789] k3s[903]: I0930 09:25:19.902008 903 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" machine # [ 31.553210] k3s[903]: E0930 09:25:19.903283 903 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="no imagefs label for configured runtime" machine # [ 31.553784] k3s[903]: E0930 09:25:19.903761 903 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"machine\" not found" machine # [ 31.554889] k3s[903]: I0930 09:25:19.903933 903 plugin_manager.go:121] "Starting Kubelet Plugin Manager" machine # [ 31.567875] k3s[903]: I0930 09:25:19.918649 903 kubelet_network_linux.go:53] "Initialized iptables rules." protocol="IPv4" machine # [ 31.573453] k3s[903]: I0930 09:25:19.924252 903 kubelet_network_linux.go:53] "Initialized iptables rules." protocol="IPv6" machine # [ 31.573735] k3s[903]: I0930 09:25:19.924294 903 status_manager.go:277] "Starting to sync pod status with apiserver" machine # [ 31.576538] k3s[903]: I0930 09:25:19.927080 903 kubelet.go:2622] "Starting kubelet main sync loop" machine # [ 31.577092] k3s[903]: E0930 09:25:19.927244 903 kubelet.go:2646] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" machine # [ 31.647393] k3s[903]: E0930 09:25:19.998144 903 kubelet.go:3516] "Unable to register mirror pod because node is not registered yet" err="node \"machine\" not found" node="machine" machine # [ 31.654638] k3s[903]: I0930 09:25:20.005366 903 kubelet_node_status.go:75] "Attempting to register node" node="machine" machine # [ 31.660141] k3s[903]: I0930 09:25:20.010802 903 kubelet_node_status.go:78] "Successfully registered node" node="machine" machine # [ 31.660710] k3s[903]: E0930 09:25:20.010844 903 kubelet_node_status.go:479] "Error updating node status, will retry" err="error getting node \"machine\": node \"machine\" not found" machine # [ 31.665065] k3s[903]: time="2026-09-30T09:25:20Z" level=info msg="Adding node OwnerReference to node-password secret machine.node-password.k3s" machine # [ 31.665490] k3s[903]: I0930 09:25:20.013245 903 node_controller.go:432] Initializing node machine with cloud provider machine # [ 31.666024] k3s[903]: I0930 09:25:20.013297 903 node_controller.go:236] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 31.666543] k3s[903]: E0930 09:25:20.013319 903 node_controller.go:247] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 31.667097] k3s[903]: I0930 09:25:20.015604 903 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"machine\" does not exist" machine # [ 31.670459] k3s[903]: I0930 09:25:20.021266 903 node_controller.go:432] Initializing node machine with cloud provider machine # [ 31.671086] k3s[903]: I0930 09:25:20.021331 903 node_controller.go:236] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 31.671566] k3s[903]: E0930 09:25:20.021351 903 node_controller.go:247] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 31.672973] k3s[903]: I0930 09:25:20.023785 903 range_allocator.go:433] "Set node PodCIDR" node="machine" podCIDRs=["10.42.0.0/24"] machine # [ 31.677923] k3s[903]: I0930 09:25:20.028721 903 node_controller.go:432] Initializing node machine with cloud provider machine # [ 31.678284] k3s[903]: I0930 09:25:20.028783 903 node_controller.go:236] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 31.678851] k3s[903]: E0930 09:25:20.028807 903 node_controller.go:247] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 31.680518] k3s[903]: time="2026-09-30T09:25:20Z" level=info msg="Synced coredns NodeHosts entries for machine" machine # [ 31.681441] k3s[903]: I0930 09:25:20.031630 903 node_controller.go:432] Initializing node machine with cloud provider machine # [ 31.681933] k3s[903]: I0930 09:25:20.031686 903 node_controller.go:236] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 31.683524] k3s[903]: E0930 09:25:20.031703 903 node_controller.go:247] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 31.684855] k3s[903]: I0930 09:25:20.035281 903 node_controller.go:432] Initializing node machine with cloud provider machine # [ 31.699540] k3s[903]: time="2026-09-30T09:25:20Z" level=info msg="Annotations and labels have been set successfully on node: machine" machine # [ 31.699889] k3s[903]: time="2026-09-30T09:25:20Z" level=info msg="Starting flannel with backend vxlan" machine # [ 31.700555] k3s[903]: I0930 09:25:20.040040 903 kuberuntime_manager.go:2172] "Updating runtime config through cri with podcidr" CIDR="10.42.0.0/24" machine # [ 31.701098] k3s[903]: I0930 09:25:20.040674 903 kubelet_network.go:48] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.42.0.0/24" machine # [ 31.704903] k3s[903]: E0930 09:25:20.055718 903 options.go:205] The manifest file is empty, ignoring. machine # [ 31.706863] k3s[903]: I0930 09:25:20.055949 903 node_controller.go:477] Successfully initialized node machine with cloud provider machine # [ 31.710154] k3s[903]: I0930 09:25:20.060943 903 event.go:389] "Event occurred" object="machine" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="Synced" message="Node synced successfully" machine # [ 31.716251] k3s[903]: I0930 09:25:20.067059 903 server.go:176] "Starting Kubernetes Scheduler" version="v1.36.4+k3s1" machine # [ 31.716541] k3s[903]: I0930 09:25:20.067086 903 server.go:178] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 31.718102] k3s[903]: time="2026-09-30T09:25:20Z" level=info msg="Labels and annotations have been set successfully on node: machine" machine # [ 31.719905] k3s[903]: I0930 09:25:20.070716 903 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 31.720665] k3s[903]: I0930 09:25:20.070742 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 31.721233] k3s[903]: I0930 09:25:20.070786 903 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 31.721646] k3s[903]: I0930 09:25:20.070807 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 31.722482] k3s[903]: I0930 09:25:20.070838 903 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 31.723019] k3s[903]: I0930 09:25:20.070852 903 shared_informer.go:402] "Waiting for caches to sync" machine # [ 31.723499] k3s[903]: I0930 09:25:20.071525 903 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 31.724171] k3s[903]: I0930 09:25:20.075002 903 secure_serving.go:214] Serving securely on 127.0.0.1:10259 machine # [ 31.724872] k3s[903]: I0930 09:25:20.075684 903 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 31.737226] k3s[903]: time="2026-09-30T09:25:20Z" level=info msg="Flannel found PodCIDR assigned for node machine" machine # [ 31.741069] k3s[903]: time="2026-09-30T09:25:20Z" level=info msg="The interface eth0 with ipv4 address 10.0.2.15 will be used by flannel" machine # [ 31.741943] k3s[903]: I0930 09:25:20.092765 903 kube.go:139] Waiting 10m0s for node controller to sync machine # [ 31.742759] k3s[903]: I0930 09:25:20.092860 903 kube.go:537] Starting kube subnet manager machine # [ 31.798857] k3s[903]: I0930 09:25:20.149610 903 kubelet_node_status.go:431] "Fast updating node status as it just became ready" machine # [ 31.820541] k3s[903]: I0930 09:25:20.171283 903 shared_informer.go:409] "Caches are synced" machine # [ 31.820988] k3s[903]: I0930 09:25:20.171316 903 shared_informer.go:409] "Caches are synced" machine # [ 31.821717] k3s[903]: I0930 09:25:20.171377 903 shared_informer.go:409] "Caches are synced" machine # [ 31.845788] k3s[903]: time="2026-09-30T09:25:20Z" level=info msg="Tunnel authorizer set Kubelet Port 0.0.0.0:10250" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 32.034371] k3s[903]: I0930 09:25:20.384604 903 server.go:228] "Successfully retrieved NodeIPs" NodeIPs=["10.0.2.15","fec0::615a:2d6d:32b4:d9cc"] machine # [ 32.036556] k3s[903]: E0930 09:25:20.386810 903 server.go:265] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`" machine # [ 32.054927] k3s[903]: I0930 09:25:20.405699 903 server.go:274] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4" machine # [ 32.056525] k3s[903]: I0930 09:25:20.405758 903 server_linux.go:137] "Using iptables Proxier" machine # [ 32.071591] k3s[903]: I0930 09:25:20.422301 903 proxier.go:241] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4" machine # [ 32.081070] k3s[903]: I0930 09:25:20.431831 903 server.go:539] "Version info" version="v1.36.4+k3s1" machine # [ 32.082824] k3s[903]: I0930 09:25:20.431893 903 server.go:541] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 32.084522] k3s[903]: I0930 09:25:20.433768 903 config.go:403] "Starting serviceCIDR config controller" machine # [ 32.086024] k3s[903]: I0930 09:25:20.433801 903 shared_informer.go:381] "Waiting for caches to sync" controller="serviceCIDR config" machine # [ 32.087704] k3s[903]: I0930 09:25:20.433917 903 config.go:200] "Starting service config controller" machine # [ 32.089129] k3s[903]: I0930 09:25:20.433934 903 shared_informer.go:381] "Waiting for caches to sync" controller="service config" machine # [ 32.090937] k3s[903]: I0930 09:25:20.433968 903 config.go:106] "Starting endpoint slice config controller" machine # [ 32.092529] k3s[903]: I0930 09:25:20.434038 903 shared_informer.go:381] "Waiting for caches to sync" controller="endpoint slice config" machine # [ 32.094438] k3s[903]: I0930 09:25:20.434262 903 config.go:309] "Starting node config controller" machine # [ 32.095913] k3s[903]: I0930 09:25:20.434288 903 shared_informer.go:381] "Waiting for caches to sync" controller="node config" machine # [ 32.183842] k3s[903]: I0930 09:25:20.534573 903 shared_informer.go:388] "Caches are synced" controller="service config" machine # [ 32.185685] k3s[903]: I0930 09:25:20.534606 903 shared_informer.go:388] "Caches are synced" controller="node config" machine # [ 32.431076] k3s[903]: I0930 09:25:20.781677 903 apiserver.go:51] "Watching apiserver" machine # [ 32.583211] k3s[903]: I0930 09:25:20.933929 903 shared_informer.go:388] "Caches are synced" controller="serviceCIDR config" machine # [ 32.588266] k3s[903]: I0930 09:25:20.935608 903 shared_informer.go:388] "Caches are synced" controller="endpoint slice config" machine # [ 32.590083] systemd[1]: Created slice libcontainer container kubepods-burstable-podeca52b4e_3699_44d0_8ded_2c49d6833b23.slice. machine # [ 32.604559] systemd[1]: Created slice libcontainer container kubepods-burstable-pod4f0c1fe6_021a_4874_8b9d_63da81ccfa99.slice. machine # [ 32.644831] k3s[903]: I0930 09:25:20.995614 903 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" machine # [ 32.651174] k3s[903]: I0930 09:25:21.001926 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/4f0c1fe6-021a-4874-8b9d-63da81ccfa99-klipper-config\") pod \"helm-install-nix-grpc-farm-fpnp9\" (UID: \"4f0c1fe6-021a-4874-8b9d-63da81ccfa99\") " pod="kube-system/helm-install-nix-grpc-farm-fpnp9" machine # [ 32.651735] k3s[903]: I0930 09:25:21.001972 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"content\" (UniqueName: \"kubernetes.io/configmap/4f0c1fe6-021a-4874-8b9d-63da81ccfa99-content\") pod \"helm-install-nix-grpc-farm-fpnp9\" (UID: \"4f0c1fe6-021a-4874-8b9d-63da81ccfa99\") " pod="kube-system/helm-install-nix-grpc-farm-fpnp9" machine # [ 32.651985] k3s[903]: I0930 09:25:21.002007 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kz2f\" (UniqueName: \"kubernetes.io/projected/4f0c1fe6-021a-4874-8b9d-63da81ccfa99-kube-api-access-4kz2f\") pod \"helm-install-nix-grpc-farm-fpnp9\" (UID: \"4f0c1fe6-021a-4874-8b9d-63da81ccfa99\") " pod="kube-system/helm-install-nix-grpc-farm-fpnp9" machine # [ 32.652732] k3s[903]: I0930 09:25:21.002036 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-config-volume\" (UniqueName: \"kubernetes.io/configmap/eca52b4e-3699-44d0-8ded-2c49d6833b23-custom-config-volume\") pod \"coredns-54996dc9b4-rfwqg\" (UID: \"eca52b4e-3699-44d0-8ded-2c49d6833b23\") " pod="kube-system/coredns-54996dc9b4-rfwqg" machine # [ 32.653432] k3s[903]: I0930 09:25:21.002062 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/4f0c1fe6-021a-4874-8b9d-63da81ccfa99-klipper-helm\") pod \"helm-install-nix-grpc-farm-fpnp9\" (UID: \"4f0c1fe6-021a-4874-8b9d-63da81ccfa99\") " pod="kube-system/helm-install-nix-grpc-farm-fpnp9" machine # [ 32.653977] k3s[903]: I0930 09:25:21.002088 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f0c1fe6-021a-4874-8b9d-63da81ccfa99-klipper-cache\") pod \"helm-install-nix-grpc-farm-fpnp9\" (UID: \"4f0c1fe6-021a-4874-8b9d-63da81ccfa99\") " pod="kube-system/helm-install-nix-grpc-farm-fpnp9" machine # [ 32.654879] k3s[903]: I0930 09:25:21.002213 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f0c1fe6-021a-4874-8b9d-63da81ccfa99-tmp\") pod \"helm-install-nix-grpc-farm-fpnp9\" (UID: \"4f0c1fe6-021a-4874-8b9d-63da81ccfa99\") " pod="kube-system/helm-install-nix-grpc-farm-fpnp9" machine # [ 32.655853] k3s[903]: I0930 09:25:21.002314 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"values\" (UniqueName: \"kubernetes.io/projected/4f0c1fe6-021a-4874-8b9d-63da81ccfa99-values\") pod \"helm-install-nix-grpc-farm-fpnp9\" (UID: \"4f0c1fe6-021a-4874-8b9d-63da81ccfa99\") " pod="kube-system/helm-install-nix-grpc-farm-fpnp9" machine # [ 32.656646] k3s[903]: I0930 09:25:21.002341 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/eca52b4e-3699-44d0-8ded-2c49d6833b23-config-volume\") pod \"coredns-54996dc9b4-rfwqg\" (UID: \"eca52b4e-3699-44d0-8ded-2c49d6833b23\") " pod="kube-system/coredns-54996dc9b4-rfwqg" machine # [ 32.657542] k3s[903]: I0930 09:25:21.002381 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlckm\" (UniqueName: \"kubernetes.io/projected/eca52b4e-3699-44d0-8ded-2c49d6833b23-kube-api-access-hlckm\") pod \"coredns-54996dc9b4-rfwqg\" (UID: \"eca52b4e-3699-44d0-8ded-2c49d6833b23\") " pod="kube-system/coredns-54996dc9b4-rfwqg" machine # [ 32.743582] k3s[903]: I0930 09:25:21.094273 903 kube.go:163] Node controller sync successful machine # [ 32.744909] k3s[903]: I0930 09:25:21.094362 903 vxlan.go:128] VXLAN config: VNI=1 Port=0 GBP=false Learning=false DirectRouting=false machine # [ 32.747179] k3s[903]: I0930 09:25:21.097960 903 kube.go:704] List of node(machine) annotations: map[string]string{"alpha.kubernetes.io/provided-node-ip":"10.0.2.15,fec0::615a:2d6d:32b4:d9cc", "k3s.io/hostname":"machine", "k3s.io/internal-ip":"10.0.2.15,fec0::615a:2d6d:32b4:d9cc", "k3s.io/node-args":"[\"server\",\"--disable\",\"traefik\",\"--disable\",\"metrics-server\",\"--disable\",\"local-storage\",\"--kubelet-arg\",\"eviction-hard=nodefs.available\\u003c1%,imagefs.available\\u003c1%\"]", "k3s.io/node-config-hash":"EFXPOZ7ZWHRCLFNW4X4ZDPFQMSAOP3BLEIN2VE47TDRKQ4UIWKUQ====", "k3s.io/node-env":"{}", "node.alpha.kubernetes.io/ttl":"0", "volumes.kubernetes.io/controller-managed-attach-detach":"true"} machine # [ 32.780114] (udev-worker)[1188]: Network interface NamePolicy= disabled on kernel command line. machine # [ 32.790629] k3s[903]: I0930 09:25:21.141308 903 iptables.go:50] Starting flannel in iptables mode... machine # [ 32.791184] k3s[903]: time="2026-09-30T09:25:21Z" level=warning msg="no subnet found for key: FLANNEL_NETWORK in file: /run/flannel/subnet.env" machine # [ 32.792385] k3s[903]: time="2026-09-30T09:25:21Z" level=warning msg="no subnet found for key: FLANNEL_SUBNET in file: /run/flannel/subnet.env" machine # [ 32.794131] k3s[903]: time="2026-09-30T09:25:21Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_NETWORK in file: /run/flannel/subnet.env" machine # [ 32.794630] k3s[903]: time="2026-09-30T09:25:21Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_SUBNET in file: /run/flannel/subnet.env" machine # [ 32.795428] k3s[903]: I0930 09:25:21.141414 903 iptables.go:101] Current network or subnet (10.42.0.0/16, 10.42.0.0/24) is not equal to previous one (0.0.0.0/0, 0.0.0.0/0), trying to recycle old iptables rules machine # [ 32.795594] k3s[903]: I0930 09:25:21.144687 903 kube.go:558] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.42.0.0/24] machine # [ 32.813961] dhcpcd[690]: flannel.1: IAID 79:35:d9:b4 machine # [ 32.815070] dhcpcd[690]: flannel.1: adding address fe80::d8be:79ff:fe35:d9b4 machine # [ 32.846413] k3s[903]: I0930 09:25:21.197204 903 iptables.go:111] Setting up masking rules machine # [ 32.859196] k3s[903]: I0930 09:25:21.209997 903 iptables.go:212] Changing default FORWARD chain policy to ACCEPT machine # [ 32.868735] k3s[903]: time="2026-09-30T09:25:21Z" level=info msg="Wrote flannel subnet file to /run/flannel/subnet.env" machine # [ 32.869120] k3s[903]: time="2026-09-30T09:25:21Z" level=info msg="Running flannel backend" machine # [ 32.869611] k3s[903]: I0930 09:25:21.218426 903 vxlan_network.go:68] watching for new subnet leases machine # [ 32.870260] k3s[903]: I0930 09:25:21.218476 903 vxlan_network.go:115] starting vxlan device watcher machine # [ 32.933862] k3s[903]: I0930 09:25:21.284624 903 iptables.go:358] bootstrap done machine # [ 33.135452] cni0: port 1(vethc0c07380) entered blocking state machine # [ 33.136368] cni0: port 1(vethc0c07380) entered disabled state machine # [ 33.137202] vethc0c07380: entered allmulticast mode machine # [ 33.138089] vethc0c07380: entered promiscuous mode machine # [ 33.139913] cni0: port 2(veth63ec9c49) entered blocking state machine # [ 33.140814] cni0: port 2(veth63ec9c49) entered disabled state machine # [ 33.141771] veth63ec9c49: entered allmulticast mode machine # [ 33.142851] veth63ec9c49: entered promiscuous mode machine # [ 33.158809] cni0: port 2(veth63ec9c49) entered blocking state machine # [ 33.159568] cni0: port 2(veth63ec9c49) entered forwarding state machine # [ 33.006436] dhcpcd[690]: flannel.1: soliciting a DHCP lease machine # [ 33.008581] (udev-worker)[1457]: Network interface NamePolicy= disabled on kernel command line. machine # [ 33.009191] (udev-worker)[1455]: Network [ 33.164534] cni0: port 1(vethc0c07380) entered blocking state machine # interface NamePo[ 33.165189] cni0: port 1(vethc0c07380) entered forwarding state machine # licy= disabled on kernel command line. machine # [ 33.013167] (udev-worker)[1458]: Network interface NamePolicy= disabled on kernel command line. machine # [ 33.044965] k3s[903]: I0930 09:25:21.395319 903 iptables.go:358] bootstrap done machine # [ 33.048377] dhcpcd[690]: vethc0c07380: IAID 11:4f:a8:ae machine # [ 33.048945] dhcpcd[690]: vethc0c07380: adding address fe80::c4f7:11ff:fe4f:a8ae machine # [ 33.062608] dhcpcd[690]: veth63ec9c49: IAID bc:8a:ff:da machine # [ 33.062939] dhcpcd[690]: veth63ec9c49: adding address fe80::98af:bcff:fe8a:ffda machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 33.253845] systemd[1]: Started libcontainer container 3e8948526bc42596314be73cc027257901754e69a125c140446ba8a2fc433074. machine # [ 33.259939] systemd[1]: Started libcontainer container b1efa84bd228439f4b14e7d4bb6bea87d5dd476fcdcdefe81ef4a15bded985e1. machine # [ 33.362740] dhcpcd[690]: veth63ec9c49: soliciting a DHCP lease machine # [ 33.728654] k3s[903]: time="2026-09-30T09:25:22Z" level=info msg="Started tunnel to 10.0.2.15:6443" machine # [ 33.728906] k3s[903]: time="2026-09-30T09:25:22Z" level=info msg="Stopped tunnel to 127.0.0.1:6443" machine # [ 33.729397] k3s[903]: time="2026-09-30T09:25:22Z" level=info msg="Connecting to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 33.729905] k3s[903]: time="2026-09-30T09:25:22Z" level=info msg="Proxy done" err="context canceled" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 33.730533] k3s[903]: time="2026-09-30T09:25:22Z" level=info msg="error in remotedialer server [400]: websocket: close 1006 (abnormal closure): unexpected EOF" machine # [ 33.733103] k3s[903]: time="2026-09-30T09:25:22Z" level=info msg="Handling backend connection request [machine]" machine # [ 33.733906] k3s[903]: time="2026-09-30T09:25:22Z" level=info msg="Connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 33.734870] k3s[903]: time="2026-09-30T09:25:22Z" level=info msg="Remotedialer connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 33.801477] k3s[903]: I0930 09:25:22.152228 903 node_lifecycle_controller.go:1217] "Initializing eviction metric for zone" zone="" machine # [ 33.802273] k3s[903]: I0930 09:25:22.153067 903 node_lifecycle_controller.go:869] "Missing timestamp for Node. Assuming now as a timestamp" node="machine" machine # [ 33.802968] k3s[903]: I0930 09:25:22.153190 903 node_lifecycle_controller.go:1063] "Controller detected that zone is now in new state" zone="" newState="Normal" machine # [ 34.293827] k3s[903]: time="2026-09-30T09:25:22Z" level=info msg="Starting network policy controller version v2.6.3-k3s1, built on 1970-01-01T01:01:01Z, go1.26.7" machine # [ 34.294057] k3s[903]: I0930 09:25:22.643963 903 network_policy_controller.go:164] Starting network policy controller machine # [ 34.322035] systemd[1]: Started libcontainer container 1a3fbeabe359665842e11c1ac40a585d234166388b0d73385c13df936e47d3c4. machine # [ 34.356921] dhcpcd[690]: vethc0c07380: soliciting an IPv6 router machine # [ 34.389632] dhcpcd[690]: flannel.1: soliciting an IPv6 router machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 34.527455] systemd[1]: Started libcontainer container 0a40799aa294cc6e33de4592648599556607e10bad979de0a9bb9c0dd71caa68. machine # [ 34.610354] k3s[903]: I0930 09:25:22.960575 903 network_policy_controller.go:179] Starting network policy controller full sync goroutine machine # [ 34.633964] k3s[903]: I0930 09:25:22.984740 903 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/coredns-54996dc9b4-rfwqg" podStartSLOduration=4.984712718 podStartE2EDuration="4.984712718s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-30 09:25:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 09:25:22.818784926 +0000 UTC m=+16.903356990" watchObservedRunningTime="2026-09-30 09:25:22.984712718 +0000 UTC m=+17.069284503" machine # [ 34.635102] k3s[903]: I0930 09:25:22.985831 903 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/helm-install-nix-grpc-farm-fpnp9" podStartSLOduration=4.9858176069999995 podStartE2EDuration="4.985817607s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-30 09:25:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 09:25:22.984590356 +0000 UTC m=+17.069162141" watchObservedRunningTime="2026-09-30 09:25:22.985817607 +0000 UTC m=+17.070389392" machine # [ 34.944191] dhcpcd[690]: vethc0c07380: soliciting a DHCP lease machine # [ 35.208336] k3s[903]: I0930 09:25:23.559034 903 alloc.go:329] "allocated clusterIPs" service="farm/nix-grpc-farm" clusterIPs={"IPv4":"10.43.200.207"} machine # [ 35.249829] systemd[1]: cri-containerd-0a40799aa294cc6e33de4592648599556607e10bad979de0a9bb9c0dd71caa68.scope: Deactivated successfully. machine # [ 35.251744] systemd[1]: cri-containerd-0a40799aa294cc6e33de4592648599556607e10bad979de0a9bb9c0dd71caa68.scope: Consumed 594ms CPU time over 723ms wall clock time, 37.7M memory peak, 2.6M incoming IP traffic, 149.5K outgoing IP traffic. machine # [ 35.304360] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-0a40799aa294cc6e33de4592648599556607e10bad979de0a9bb9c0dd71caa68-rootfs.mount: Deactivated successfully. machine # [ 35.339246] dhcpcd[690]: veth63ec9c49: soliciting an IPv6 router machine # [ 35.648152] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod0008920b_ae92_44b7_be15_eea10cf649da.slice. machine # [ 35.648656] k3s[903]: E0930 09:25:23.998794 903 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7\" failed with read version: 462 is not as new as written version: 467 for group resource replicasets.apps" logger="UnhandledError" machine # [ 35.659832] k3s[903]: E0930 09:25:24.010619 903 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7\" failed with read version: 462 is not as new as written version: 467 for group resource replicasets.apps" logger="UnhandledError" machine # [ 35.664164] k3s[903]: E0930 09:25:24.014978 903 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7\" failed with read version: 462 is not as new as written version: 467 for group resource replicasets.apps" logger="UnhandledError" machine # [ 35.666383] k3s[903]: E0930 09:25:24.017200 903 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-scheduler-55cccf6d96\" failed with read version: 462 is not as new as written version: 468 for group resource replicasets.apps" logger="UnhandledError" machine # [ 35.670294] k3s[903]: E0930 09:25:24.021116 903 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-lb-5877cc8b4f\" failed with read version: 462 is not as new as written version: 472 for group resource replicasets.apps" logger="UnhandledError" machine # [ 35.676398] k3s[903]: E0930 09:25:24.027210 903 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-lb-5877cc8b4f\" failed with read version: 462 is not as new as written version: 472 for group resource replicasets.apps" logger="UnhandledError" machine # [ 35.676872] k3s[903]: E0930 09:25:24.027653 903 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7\" failed with read version: 462 is not as new as written version: 467 for group resource replicasets.apps" logger="UnhandledError" machine # [ 35.677619] k3s[903]: E0930 09:25:24.028450 903 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-scheduler-55cccf6d96\" failed with read version: 462 is not as new as written version: 468 for group resource replicasets.apps" logger="UnhandledError" machine # [ 35.685055] k3s[903]: I0930 09:25:24.035838 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/c2de11cf-d9d5-45ee-8d51-c412dcc1afa2-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-g9qwc\" (UID: \"c2de11cf-d9d5-45ee-8d51-c412dcc1afa2\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-g9qwc" machine # [ 35.685538] k3s[903]: I0930 09:25:24.036014 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/c2de11cf-d9d5-45ee-8d51-c412dcc1afa2-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-g9qwc\" (UID: \"c2de11cf-d9d5-45ee-8d51-c412dcc1afa2\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-g9qwc" machine # [ 35.685991] k3s[903]: I0930 09:25:24.036063 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgtmr\" (UniqueName: \"kubernetes.io/projected/c2de11cf-d9d5-45ee-8d51-c412dcc1afa2-kube-api-access-qgtmr\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-g9qwc\" (UID: \"c2de11cf-d9d5-45ee-8d51-c412dcc1afa2\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-g9qwc" machine # [ 35.686660] k3s[903]: I0930 09:25:24.036091 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/0008920b-ae92-44b7-be15-eea10cf649da-tls\") pod \"nix-grpc-farm-scheduler-55cccf6d96-dgtzg\" (UID: \"0008920b-ae92-44b7-be15-eea10cf649da\") " pod="farm/nix-grpc-farm-scheduler-55cccf6d96-dgtzg" machine # [ 35.687196] k3s[903]: I0930 09:25:24.036125 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0008920b-ae92-44b7-be15-eea10cf649da-ca\") pod \"nix-grpc-farm-scheduler-55cccf6d96-dgtzg\" (UID: \"0008920b-ae92-44b7-be15-eea10cf649da\") " pod="farm/nix-grpc-farm-scheduler-55cccf6d96-dgtzg" machine # [ 35.707075] k3s[903]: E0930 09:25:24.057119 903 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-lb-5877cc8b4f\" failed with read version: 462 is not as new as written version: 472 for group resource replicasets.apps" logger="UnhandledError" machine # [ 35.710915] k3s[903]: I0930 09:25:24.061737 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/c2de11cf-d9d5-45ee-8d51-c412dcc1afa2-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-g9qwc\" (UID: \"c2de11cf-d9d5-45ee-8d51-c412dcc1afa2\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-g9qwc" machine # [ 35.711596] k3s[903]: I0930 09:25:24.062224 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c2de11cf-d9d5-45ee-8d51-c412dcc1afa2-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-g9qwc\" (UID: \"c2de11cf-d9d5-45ee-8d51-c412dcc1afa2\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-g9qwc" machine # [ 35.712512] k3s[903]: I0930 09:25:24.062261 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/102fc9c0-d6fa-4ec8-8690-d0f409c9bcc6-tmp\") pod \"nix-grpc-farm-lb-5877cc8b4f-bgnqh\" (UID: \"102fc9c0-d6fa-4ec8-8690-d0f409c9bcc6\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-bgnqh" machine # [ 35.713101] k3s[903]: I0930 09:25:24.062294 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/102fc9c0-d6fa-4ec8-8690-d0f409c9bcc6-tls-lb\") pod \"nix-grpc-farm-lb-5877cc8b4f-bgnqh\" (UID: \"102fc9c0-d6fa-4ec8-8690-d0f409c9bcc6\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-bgnqh" machine # [ 35.713560] k3s[903]: I0930 09:25:24.062331 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/c2de11cf-d9d5-45ee-8d51-c412dcc1afa2-build\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-g9qwc\" (UID: \"c2de11cf-d9d5-45ee-8d51-c412dcc1afa2\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-g9qwc" machine # [ 35.731293] k3s[903]: I0930 09:25:24.062361 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/c2de11cf-d9d5-45ee-8d51-c412dcc1afa2-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-g9qwc\" (UID: \"c2de11cf-d9d5-45ee-8d51-c412dcc1afa2\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-g9qwc" machine # [ 35.731762] k3s[903]: I0930 09:25:24.065015 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dxqd\" (UniqueName: \"kubernetes.io/projected/0008920b-ae92-44b7-be15-eea10cf649da-kube-api-access-8dxqd\") pod \"nix-grpc-farm-scheduler-55cccf6d96-dgtzg\" (UID: \"0008920b-ae92-44b7-be15-eea10cf649da\") " pod="farm/nix-grpc-farm-scheduler-55cccf6d96-dgtzg" machine # [ 35.732429] k3s[903]: I0930 09:25:24.065069 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/c2de11cf-d9d5-45ee-8d51-c412dcc1afa2-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-g9qwc\" (UID: \"c2de11cf-d9d5-45ee-8d51-c412dcc1afa2\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-g9qwc" machine # [ 35.732909] k3s[903]: I0930 09:25:24.065131 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/c2de11cf-d9d5-45ee-8d51-c412dcc1afa2-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-g9qwc\" (UID: \"c2de11cf-d9d5-45ee-8d51-c412dcc1afa2\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-g9qwc" machine # [ 35.733601] k3s[903]: I0930 09:25:24.065163 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/0008920b-ae92-44b7-be15-eea10cf649da-niks3-token\") pod \"nix-grpc-farm-scheduler-55cccf6d96-dgtzg\" (UID: \"0008920b-ae92-44b7-be15-eea10cf649da\") " pod="farm/nix-grpc-farm-scheduler-55cccf6d96-dgtzg" machine # [ 35.734152] k3s[903]: I0930 09:25:24.065192 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/0008920b-ae92-44b7-be15-eea10cf649da-oidc\") pod \"nix-grpc-farm-scheduler-55cccf6d96-dgtzg\" (UID: \"0008920b-ae92-44b7-be15-eea10cf649da\") " pod="farm/nix-grpc-farm-scheduler-55cccf6d96-dgtzg" machine # [ 35.734623] k3s[903]: I0930 09:25:24.065221 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/102fc9c0-d6fa-4ec8-8690-d0f409c9bcc6-config\") pod \"nix-grpc-farm-lb-5877cc8b4f-bgnqh\" (UID: \"102fc9c0-d6fa-4ec8-8690-d0f409c9bcc6\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-bgnqh" machine # [ 35.735301] k3s[903]: I0930 09:25:24.086098 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/102fc9c0-d6fa-4ec8-8690-d0f409c9bcc6-tls-ca\") pod \"nix-grpc-farm-lb-5877cc8b4f-bgnqh\" (UID: \"102fc9c0-d6fa-4ec8-8690-d0f409c9bcc6\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-bgnqh" machine # [ 35.765410] k3s[903]: E0930 09:25:24.116156 903 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-lb-5877cc8b4f\" failed with read version: 468 is not as new as written version: 472 for group resource replicasets.apps" logger="UnhandledError" machine # [ 35.780633] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod102fc9c0_d6fa_4ec8_8690_d0f409c9bcc6.slice. machine # [ 35.805984] k3s[903]: E0930 09:25:24.156760 903 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7\" failed with read version: 472 is not as new as written version: 477 for group resource replicasets.apps" logger="UnhandledError" machine # [ 35.811670] systemd[1]: Created slice libcontainer container kubepods-besteffort-podc2de11cf_d9d5_45ee_8d51_c412dcc1afa2.slice. machine # [ 35.827157] systemd[1]: Created slice libcontainer container kubepods-besteffort-poda432995f_c5e3_4964_9130_5a037fc30d90.slice. machine # [ 35.938696] k3s[903]: I0930 09:25:24.289377 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/a432995f-c5e3-4964-9130-5a037fc30d90-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-5x7gj\" (UID: \"a432995f-c5e3-4964-9130-5a037fc30d90\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-5x7gj" machine # [ 35.938959] k3s[903]: I0930 09:25:24.289591 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a432995f-c5e3-4964-9130-5a037fc30d90-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-5x7gj\" (UID: \"a432995f-c5e3-4964-9130-5a037fc30d90\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-5x7gj" machine # [ 35.939805] k3s[903]: I0930 09:25:24.289669 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/a432995f-c5e3-4964-9130-5a037fc30d90-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-5x7gj\" (UID: \"a432995f-c5e3-4964-9130-5a037fc30d90\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-5x7gj" machine # [ 35.940531] k3s[903]: I0930 09:25:24.289726 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/a432995f-c5e3-4964-9130-5a037fc30d90-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-5x7gj\" (UID: \"a432995f-c5e3-4964-9130-5a037fc30d90\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-5x7gj" machine # [ 35.941299] k3s[903]: I0930 09:25:24.289765 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/a432995f-c5e3-4964-9130-5a037fc30d90-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-5x7gj\" (UID: \"a432995f-c5e3-4964-9130-5a037fc30d90\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-5x7gj" machine # [ 35.941951] k3s[903]: I0930 09:25:24.289798 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/a432995f-c5e3-4964-9130-5a037fc30d90-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-5x7gj\" (UID: \"a432995f-c5e3-4964-9130-5a037fc30d90\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-5x7gj" machine # [ 35.942725] k3s[903]: I0930 09:25:24.289826 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/a432995f-c5e3-4964-9130-5a037fc30d90-build\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-5x7gj\" (UID: \"a432995f-c5e3-4964-9130-5a037fc30d90\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-5x7gj" machine # [ 35.943423] k3s[903]: I0930 09:25:24.289943 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/a432995f-c5e3-4964-9130-5a037fc30d90-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-5x7gj\" (UID: \"a432995f-c5e3-4964-9130-5a037fc30d90\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-5x7gj" machine # [ 35.944131] k3s[903]: I0930 09:25:24.290189 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2wj8\" (UniqueName: \"kubernetes.io/projected/a432995f-c5e3-4964-9130-5a037fc30d90-kube-api-access-w2wj8\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-5x7gj\" (UID: \"a432995f-c5e3-4964-9130-5a037fc30d90\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-5x7gj" machine # [ 36.214449] cni0: port 3(vethc436e78f) entered blocking state machine # [ 36.215188] cni0: port 3(vethc436e78f) entered disabled state machine # [ 36.216787] vethc436e78f: entered allmulticast mode machine # [ 36.217774] vethc436e78f: entered promiscuous mode machine # [ 36.231642] cni0: port 3(vethc436e78f) entered blocking state machine # [ 36.232329] cni0: port 3(vethc436e78f) entered forwarding state machine # [ 36.114654] (udev-worker)[2003]: Network interface NamePolicy= disabled on kernel command line. machine # [ 36.296698] cni0: port 4(vethcd97be52) entered blocking state machine # [ 36.297357] cni0: port 4(vethcd97be52) entered disabled state machine # [ 36.298215] vethcd97be52: entered allmulticast mode machine # [ 36.299693] vethcd97be52: entered promiscuous mode machine # [ 36.148958] dhcpcd[690]: vethc436e78f: IAID 7a:25:26:19 machine # [ 36.149330] dhcpcd[690]: vethc436e78f: adding address fe80::a0ab:7aff:fe25:2619 machine # [ 36.149989] (udev-worker)[2030]: Network interface NamePolicy= disabled on kernel command line. machine # [ 36.318333] cni0: port 4(vethcd97be52) entered blocking state machine # [ 36.319048] cni0: port 4(vethcd97be52) entered forwarding state machine # [ 36.190100] dhcpcd[690]: vethcd97be52: IAID 6d:87:e8:95 machine # [ 36.190588] dhcpcd[690]: vethcd97be52: adding address fe80::61:6dff:fe87:e895 machine # [ 36.224507] systemd[1]: Started libcontainer container b00c47725760155cc9720cdc300a0da65e7a3a845699ec09505f93d5dd07c225. machine # [ 36.390075] cni0: port 5(vethbd98f1f1) entered blocking state machine # [ 36.391081] cni0: port 5(vethbd98f1f1) entered disabled state machine # [ 36.391973] vethbd98f1f1: entered allmulticast mode machine # [ 36.392751] vethbd98f1f1: entered promiscuous mode machine # [ 36.250136] (udev-worker)[2034]: Network interface NamePolicy= disabled on kernel command line. machine # [ 36.409964] cni0: port 5(vethbd98f1f1) entered blocking state machine # [ 36.410751] cni0: port 5(vethbd98f1f1) entered forwarding state machine # [ 36.413940] cni0: port 6(vethf8f32bc9) entered blocking state machine # [ 36.416153] cni0: port 6(vethf8f32bc9) entered disabled state machine # [ 36.417226] vethf8f32bc9: entered allmulticast mode machine # [ 36.418149] vethf8f32bc9: entered promiscuous mode machine # [ 36.431111] cni0: port 6(vethf8f32bc9) entered blocking state machine # [ 36.431837] cni0: port 6(vethf8f32bc9) entered forwarding state machine # [ 36.302068] dhcpcd[690]: vethbd98f1f1: waiting for carrier machine # [ 36.319040] dhcpcd[690]: vethf8f32bc9: IAID d4:66:23:72 machine # [ 36.322539] dhcpcd[690]: vethf8f32bc9: adding address fe80::8c29:d4ff:fe66:2372 machine # [ 36.323130] dhcpcd[690]: vethbd98f1f1: carrier acquired machine # [ 36.332560] dhcpcd[690]: vethbd98f1f1: IAID 7d:d7:a0:45 machine # [ 36.334119] dhcpcd[690]: vethbd98f1f1: adding address fe80::b4f9:7dff:fed7:a045 machine # [ 36.334457] dhcpcd[690]: vethf8f32bc9: carrier lost machine # [ 36.365822] systemd[1]: Started libcontainer container 89bf36f360ca8c897693787dcf339d6928d0784639e926f8a17f1fcc66b6ce7a. machine # [ 36.381265] dhcpcd[690]: vethf8f32bc9: deleting address fe80::8c29:d4ff:fe66:2372 machine # [ 36.382098] dhcpcd[690]: vethf8f32bc9: carrier acquired machine # [ 36.389159] dhcpcd[690]: vethf8f32bc9: IAID d4:66:23:72 machine # [ 36.389549] dhcpcd[690]: vethf8f32bc9: adding address fe80::8c29:d4ff:fe66:2372 machine # [ 36.479429] systemd[1]: Started libcontainer container daca312fd08223926bcd5c0418041242d1cb5c9d540e1320963f705c94566edb. machine # [ 36.484072] systemd[1]: Started libcontainer container 4d0b291396b4be4722b80273b2cacba130818131e78e6e65c60b1d8a6ef0c17d. machine # [ 36.645615] systemd[1]: cri-containerd-b1efa84bd228439f4b14e7d4bb6bea87d5dd476fcdcdefe81ef4a15bded985e1.scope: Deactivated successfully. machine # [ 36.721443] dhcpcd[690]: vethf8f32bc9: soliciting a DHCP lease machine # [ 37.003795] cni0: port 1(vethc0c07380) entered disabled state machine # [ 36.849518] dhcpcd[690]: vethc0c07380: carrier lost machine # [ 37.007354] vethc0c07380 (unregistering): left allmulticast mode machine # [ 37.009392] vethc0c07380 (unregistering): left promiscuous mode machine # [ 37.010409] cni0: port 1(vethc0c07380) entered disabled state machine # [ 36.899677] dhcpcd[690]: vethc0c07380: deleting address fe80::c4f7:11ff:fe4f:a8ae machine # [ 36.958501] dhcpcd[690]: vethc0c07380: removing interface machine # [ 37.050023] k3s[903]: I0930 09:25:25.399902 903 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4f0c1fe6-021a-4874-8b9d-63da81ccfa99-content\" (UniqueName: \"kubernetes.io/configmap/4f0c1fe6-021a-4874-8b9d-63da81ccfa99-content\") pod \"4f0c1fe6-021a-4874-8b9d-63da81ccfa99\" (UID: \"4f0c1fe6-021a-4874-8b9d-63da81ccfa99\") " machine # [ 37.055100] k3s[903]: I0930 09:25:25.405925 903 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4f0c1fe6-021a-4874-8b9d-63da81ccfa99-kube-api-access-4kz2f\" (UniqueName: \"kubernetes.io/projected/4f0c1fe6-021a-4874-8b9d-63da81ccfa99-kube-api-access-4kz2f\") pod \"4f0c1fe6-021a-4874-8b9d-63da81ccfa99\" (UID: \"4f0c1fe6-021a-4874-8b9d-63da81ccfa99\") " machine # [ 37.063510] k3s[903]: I0930 09:25:25.411231 903 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4f0c1fe6-021a-4874-8b9d-63da81ccfa99-klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/4f0c1fe6-021a-4874-8b9d-63da81ccfa99-klipper-config\") pod \"4f0c1fe6-021a-4874-8b9d-63da81ccfa99\" (UID: \"4f0c1fe6-021a-4874-8b9d-63da81ccfa99\") " machine # [ 37.069834] k3s[903]: I0930 09:25:25.411254 903 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f0c1fe6-021a-4874-8b9d-63da81ccfa99-content" pod "4f0c1fe6-021a-4874-8b9d-63da81ccfa99" (UID: "4f0c1fe6-021a-4874-8b9d-63da81ccfa99"). InnerVolumeSpecName "content". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 37.074264] k3s[903]: I0930 09:25:25.411288 903 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4f0c1fe6-021a-4874-8b9d-63da81ccfa99-tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f0c1fe6-021a-4874-8b9d-63da81ccfa99-tmp\") pod \"4f0c1fe6-021a-4874-8b9d-63da81ccfa99\" (UID: \"4f0c1fe6-021a-4874-8b9d-63da81ccfa99\") " machine # [ 37.080595] k3s[903]: I0930 09:25:25.411317 903 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4f0c1fe6-021a-4874-8b9d-63da81ccfa99-klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/4f0c1fe6-021a-4874-8b9d-63da81ccfa99-klipper-helm\") pod \"4f0c1fe6-021a-4874-8b9d-63da81ccfa99\" (UID: \"4f0c1fe6-021a-4874-8b9d-63da81ccfa99\") " machine # [ 37.085528] k3s[903]: I0930 09:25:25.411370 903 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4f0c1fe6-021a-4874-8b9d-63da81ccfa99-klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f0c1fe6-021a-4874-8b9d-63da81ccfa99-klipper-cache\") pod \"4f0c1fe6-021a-4874-8b9d-63da81ccfa99\" (UID: \"4f0c1fe6-021a-4874-8b9d-63da81ccfa99\") " machine # [ 37.090311] k3s[903]: I0930 09:25:25.411415 903 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4f0c1fe6-021a-4874-8b9d-63da81ccfa99-values\" (UniqueName: \"kubernetes.io/projected/4f0c1fe6-021a-4874-8b9d-63da81ccfa99-values\") pod \"4f0c1fe6-021a-4874-8b9d-63da81ccfa99\" (UID: \"4f0c1fe6-021a-4874-8b9d-63da81ccfa99\") " machine # [ 37.094672] k3s[903]: I0930 09:25:25.411508 903 reconciler_common.go:299] "Volume detached for volume \"content\" (UniqueName: \"kubernetes.io/configmap/4f0c1fe6-021a-4874-8b9d-63da81ccfa99-content\") on node \"machine\" DevicePath \"\"" machine # [ 37.098284] k3s[903]: I0930 09:25:25.425369 903 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f0c1fe6-021a-4874-8b9d-63da81ccfa99-values" pod "4f0c1fe6-021a-4874-8b9d-63da81ccfa99" (UID: "4f0c1fe6-021a-4874-8b9d-63da81ccfa99"). InnerVolumeSpecName "values". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 37.102993] k3s[903]: I0930 09:25:25.427657 903 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f0c1fe6-021a-4874-8b9d-63da81ccfa99-klipper-helm" pod "4f0c1fe6-021a-4874-8b9d-63da81ccfa99" (UID: "4f0c1fe6-021a-4874-8b9d-63da81ccfa99"). InnerVolumeSpecName "klipper-helm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 37.108661] k3s[903]: I0930 09:25:25.431287 903 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f0c1fe6-021a-4874-8b9d-63da81ccfa99-klipper-config" pod "4f0c1fe6-021a-4874-8b9d-63da81ccfa99" (UID: "4f0c1fe6-021a-4874-8b9d-63da81ccfa99"). InnerVolumeSpecName "klipper-config". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 37.109201] k3s[903]: I0930 09:25:25.434102 903 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f0c1fe6-021a-4874-8b9d-63da81ccfa99-kube-api-access-4kz2f" pod "4f0c1fe6-021a-4874-8b9d-63da81ccfa99" (UID: "4f0c1fe6-021a-4874-8b9d-63da81ccfa99"). InnerVolumeSpecName "kube-api-access-4kz2f". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 37.110968] k3s[903]: I0930 09:25:25.439537 903 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f0c1fe6-021a-4874-8b9d-63da81ccfa99-klipper-cache" pod "4f0c1fe6-021a-4874-8b9d-63da81ccfa99" (UID: "4f0c1fe6-021a-4874-8b9d-63da81ccfa99"). InnerVolumeSpecName "klipper-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 37.113104] k3s[903]: I0930 09:25:25.446319 903 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f0c1fe6-021a-4874-8b9d-63da81ccfa99-tmp" pod "4f0c1fe6-021a-4874-8b9d-63da81ccfa99" (UID: "4f0c1fe6-021a-4874-8b9d-63da81ccfa99"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 37.152351] dhcpcd[690]: vethbd98f1f1: soliciting a DHCP lease machine # [ 37.161835] k3s[903]: I0930 09:25:25.512588 903 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kz2f\" (UniqueName: \"kubernetes.io/projected/4f0c1fe6-021a-4874-8b9d-63da81ccfa99-kube-api-access-4kz2f\") on node \"machine\" DevicePath \"\"" machine # [ 37.162280] k3s[903]: I0930 09:25:25.512630 903 reconciler_common.go:299] "Volume detached for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/4f0c1fe6-021a-4874-8b9d-63da81ccfa99-klipper-config\") on node \"machine\" DevicePath \"\"" machine # [ 37.162539] k3s[903]: I0930 09:25:25.512654 903 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f0c1fe6-021a-4874-8b9d-63da81ccfa99-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 37.163159] k3s[903]: I0930 09:25:25.512667 903 reconciler_common.go:299] "Volume detached for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/4f0c1fe6-021a-4874-8b9d-63da81ccfa99-klipper-helm\") on node \"machine\" DevicePath \"\"" machine # [ 37.163665] k3s[903]: I0930 09:25:25.512680 903 reconciler_common.go:299] "Volume detached for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f0c1fe6-021a-4874-8b9d-63da81ccfa99-klipper-cache\") on node \"machine\" DevicePath \"\"" machine # [ 37.164455] k3s[903]: I0930 09:25:25.512694 903 reconciler_common.go:299] "Volume detached for volume \"values\" (UniqueName: \"kubernetes.io/projected/4f0c1fe6-021a-4874-8b9d-63da81ccfa99-values\") on node \"machine\" DevicePath \"\"" machine # [ 37.202528] dhcpcd[690]: vethcd97be52: soliciting a DHCP lease machine # [ 37.317665] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-b1efa84bd228439f4b14e7d4bb6bea87d5dd476fcdcdefe81ef4a15bded985e1-rootfs.mount: Deactivated successfully. machine # [ 37.318203] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-b1efa84bd228439f4b14e7d4bb6bea87d5dd476fcdcdefe81ef4a15bded985e1-shm.mount: Deactivated successfully. machine # [ 37.319593] systemd[1]: run-netns-cni\x2db748273b\x2df04b\x2d518d\x2dcf1d\x2d97e54bb84deb.mount: Deactivated successfully. machine # [ 37.320487] systemd[1]: var-lib-kubelet-pods-4f0c1fe6\x2d021a\x2d4874\x2d8b9d\x2d63da81ccfa99-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2d4kz2f.mount: Deactivated successfully. machine # [ 37.326347] systemd[1]: var-lib-kubelet-pods-4f0c1fe6\x2d021a\x2d4874\x2d8b9d\x2d63da81ccfa99-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dconfig.mount: Deactivated successfully. machine # [ 37.326712] systemd[1]: var-lib-kubelet-pods-4f0c1fe6\x2d021a\x2d4874\x2d8b9d\x2d63da81ccfa99-volumes-kubernetes.io\x7eprojected-values.mount: Deactivated successfully. machine # [ 37.327574] systemd[1]: var-lib-kubelet-pods-4f0c1fe6\x2d021a\x2d4874\x2d8b9d\x2d63da81ccfa99-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 37.328283] systemd[1]: var-lib-kubelet-pods-4f0c1fe6\x2d021a\x2d4874\x2d8b9d\x2d63da81ccfa99-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dcache.mount: Deactivated successfully. machine # [ 37.328620] systemd[1]: var-lib-kubelet-pods-4f0c1fe6\x2d021a\x2d4874\x2d8b9d\x2d63da81ccfa99-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dhelm.mount: Deactivated successfully. machine # [ 37.528040] dhcpcd[690]: vethc436e78f: soliciting a DHCP lease machine # [ 37.600380] systemd[1]: Removed slice libcontainer container kubepods-burstable-pod4f0c1fe6_021a_4874_8b9d_63da81ccfa99.slice. machine # [ 37.600694] systemd[1]: kubepods-burstable-pod4f0c1fe6_021a_4874_8b9d_63da81ccfa99.slice: Consumed 629ms CPU time over 4.992s wall clock time, 38.2M memory peak, 2.6M incoming IP traffic, 149.5K outgoing IP traffic. machine # [ 37.612572] k3s[903]: I0930 09:25:25.963365 903 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b1efa84bd228439f4b14e7d4bb6bea87d5dd476fcdcdefe81ef4a15bded985e1" machine # [ 37.615447] k3s[903]: E0930 09:25:25.966238 903 kubelet_pods.go:2193] "failed to read memory cgroup config for the pod" err="failed to read memory.max for cgroup /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f0c1fe6_021a_4874_8b9d_63da81ccfa99.slice: openat2 /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f0c1fe6_021a_4874_8b9d_63da81ccfa99.slice/memory.max: no such file or directory" podName="helm-install-nix-grpc-farm-fpnp9" machine # [ 37.615931] k3s[903]: E0930 09:25:25.966301 903 kubelet_pods.go:2198] "failed to read memory cgroup limits for the pod" err="failed to read cpu.max file for cgroup /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f0c1fe6_021a_4874_8b9d_63da81ccfa99.slice: openat2 /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f0c1fe6_021a_4874_8b9d_63da81ccfa99.slice/cpu.max: no such file or directory" podName="helm-install-nix-grpc-farm-fpnp9" machine # [ 37.912402] dhcpcd[690]: vethcd97be52: soliciting an IPv6 router machine # [ 37.927564] systemd[1]: Started libcontainer container 3d281720b74b25af47212a78eaa36f7e78a8e15594faf5738da521e09c750699. machine # [ 38.006795] dhcpcd[690]: flannel.1: probing for an IPv4LL address machine # [ 38.045183] dhcpcd[690]: vethc436e78f: soliciting an IPv6 router machine # [ 38.364091] dhcpcd[690]: veth63ec9c49: probing for an IPv4LL address machine # [ 38.443622] dhcpcd[690]: vethbd98f1f1: soliciting an IPv6 router machine # [ 38.449697] dhcpcd[690]: vethf8f32bc9: soliciting an IPv6 router machine # [ 39.650890] k3s[903]: time="2026-09-30T09:25:28Z" level=info msg="Imported docker.io/library/nix-grpc-farm-client:0.1.0-beta.4" machine # [ 39.662919] k3s[903]: time="2026-09-30T09:25:28Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-client@sha256:97127cdb4ef26abfae3ae6da1c5c5e70351def7cad9d07b1779f06f050bc535b" machine # [ 41.083187] k3s[903]: time="2026-09-30T09:25:29Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nixos/xp60q8nsn5afbj78sv3hn9lkmdi2cl2n-nix-grpc-farm-client.tar in 10.158753696s" machine # [ 41.722914] dhcpcd[690]: vethf8f32bc9: probing for an IPv4LL address machine # [ 42.152810] dhcpcd[690]: vethbd98f1f1: probing for an IPv4LL address machine # [ 42.203818] dhcpcd[690]: vethcd97be52: probing for an IPv4LL address machine # [ 42.440146] systemd[1]: Started libcontainer container 2db0973a2763e89eb166de4207adb6a366b1b4aff8b83bdc860e6214702f6630. machine # [ 42.529359] k3s[903]: I0930 09:25:30.879538 903 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-5877cc8b4f-bgnqh" podStartSLOduration=7.879509682 podStartE2EDuration="7.879509682s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-30 09:25:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 09:25:26.371051205 +0000 UTC m=+20.455623269" watchObservedRunningTime="2026-09-30 09:25:30.879509682 +0000 UTC m=+24.964081467" machine # [ 42.529947] dhcpcd[690]: vethc436e78f: probing for an IPv4LL address machine # [ 42.626344] niks3-server[1197]: 2026/09/30 09:25:30 INFO lead: acquired remote=10.42.0.4:58726 machine # [ 42.646385] k3s[903]: I0930 09:25:30.997158 903 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-scheduler-55cccf6d96-dgtzg" podStartSLOduration=7.997129658 podStartE2EDuration="7.997129658s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-30 09:25:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 09:25:30.879866431 +0000 UTC m=+24.964461962" watchObservedRunningTime="2026-09-30 09:25:30.997129658 +0000 UTC m=+25.081701443" machine # [ 42.726912] systemd[1]: tmp-ovl\x2didmapped3172063024.mount: Deactivated successfully. machine # [ 42.740288] systemd[1]: Started libcontainer container f8f2fbf76fd71eec954864708a773de762af8b4147af56a4db80a6dc5f200131. machine # [ 42.771835] systemd[1]: tmp-ovl\x2didmapped2813514160.mount: Deactivated successfully. machine # [ 42.792547] systemd[1]: Started libcontainer container 323ba65d5bfbaf0a048bcc9122b99ff81c5b16d19ce8369e0101daf9b35db6f0. machine # [ 43.048658] dhcpcd[690]: flannel.1: using IPv4LL address 169.254.179.247 machine # [ 43.048900] dhcpcd[690]: flannel.1: adding route to 169.254.0.0/16 machine # [ 43.561337] dhcpcd[690]: veth63ec9c49: using IPv4LL address 169.254.133.175 machine # [ 43.561990] dhcpcd[690]: veth63ec9c49: adding route to 169.254.0.0/16 machine # [ 43.688030] systemd[1]: cri-containerd-f8f2fbf76fd71eec954864708a773de762af8b4147af56a4db80a6dc5f200131.scope: Deactivated successfully. machine # [ 43.690403] systemd[1]: cri-containerd-f8f2fbf76fd71eec954864708a773de762af8b4147af56a4db80a6dc5f200131.scope: Consumed 610ms CPU time over 947ms wall clock time, 317.5M memory peak, 41.3M read from disk, 265M written to disk. machine # [ 43.693821] systemd[1]: cri-containerd-323ba65d5bfbaf0a048bcc9122b99ff81c5b16d19ce8369e0101daf9b35db6f0.scope: Deactivated successfully. machine # [ 43.695820] systemd[1]: cri-containerd-323ba65d5bfbaf0a048bcc9122b99ff81c5b16d19ce8369e0101daf9b35db6f0.scope: Consumed 586ms CPU time over 897ms wall clock time, 304M memory peak, 20.6M read from disk, 265.1M written to disk. machine # [ 43.733934] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-f8f2fbf76fd71eec954864708a773de762af8b4147af56a4db80a6dc5f200131-rootfs.mount: Deactivated successfully. machine # [ 43.743121] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-323ba65d5bfbaf0a048bcc9122b99ff81c5b16d19ce8369e0101daf9b35db6f0-rootfs.mount: Deactivated successfully. machine # [ 44.837107] systemd[1]: tmp-ovl\x2didmapped1770043985.mount: Deactivated successfully. machine # [ 44.861364] systemd[1]: Started libcontainer container 9a007c4ee3a61b9a2bb75106f1012c69c4e4959a1b961ab0fa571ee3456416cc. machine # [ 44.890423] systemd[1]: Started libcontainer container ae50eb0c394e72df9476e3641a72d53243b9d7a14cac4696b5588ea4884f326d. machine # [ 45.086367] systemd[1]: Started libcontainer container 413423361e3e86b402886865bbc13d19442d388d3be7a419bd8a353e8dbbc6a9. machine # [ 45.088114] systemd[1]: Started libcontainer container 8b85e4d94f25023bf1fe322eab3729d308826f0461db630d6e653a14a5d0dd66. machine # [ 45.332404] systemd[1]: Started libcontainer container 7fa20ef41f152532d9b7e9ea8552648eaeb40cfd64269c8ab9350625e7be8370. machine # [ 45.334713] systemd[1]: Started libcontainer container 3536a237113510fddedb145f78700b3b2d61d344842963a493e8dc43225f36b9. machine # [ 45.429335] k3s[903]: I0930 09:25:33.779672 903 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-g9qwc" podStartSLOduration=9.862825717 podStartE2EDuration="10.77964671s" totalImagesPullingTime="0s" totalInitContainerRuntime="916.820993ms" isStatefulPod=false podCreationTimestamp="2026-09-30 09:25:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 09:25:33.778674519 +0000 UTC m=+27.863246863" watchObservedRunningTime="2026-09-30 09:25:33.77964671 +0000 UTC m=+27.864218774" machine # [ 45.436759] k3s[903]: I0930 09:25:33.779787 903 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-5x7gj" podStartSLOduration=9.931167644 podStartE2EDuration="10.779777732s" totalImagesPullingTime="0s" totalInitContainerRuntime="848.610088ms" isStatefulPod=false podCreationTimestamp="2026-09-30 09:25:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 09:25:33.768925236 +0000 UTC m=+27.853497300" watchObservedRunningTime="2026-09-30 09:25:33.779777732 +0000 UTC m=+27.864349797" machine # error: timed out waiting for the condition machine # [ 45.841341] systemd[1]: tmp-ovl\x2didmapped2236833023.mount: Deactivated successfully. machine # [ 46.393498] dhcpcd[690]: flannel.1: no IPv6 Routers available machine # [ 46.522893] dhcpcd[690]: vethf8f32bc9: using IPv4LL address 169.254.208.57 machine # [ 46.524264] dhcpcd[690]: vethf8f32bc9: adding route to 169.254.0.0/16 machine # [ 46.807671] dhcpcd[690]: vethcd97be52: using IPv4LL address 169.254.94.88 machine # [ 46.808454] dhcpcd[690]: vethcd97be52: adding route to 169.254.0.0/16 machine # [ 46.987400] dhcpcd[690]: vethbd98f1f1: using IPv4LL address 169.254.217.154 machine # [ 46.987906] dhcpcd[690]: vethbd98f1f1: adding route to 169.254.0.0/16 machine # [ 47.343281] dhcpcd[690]: veth63ec9c49: no IPv6 Routers available machine # [ 47.494267] dhcpcd[690]: vethc436e78f: using IPv4LL address 169.254.174.14 machine # [ 47.494696] dhcpcd[690]: vethc436e78f: adding route to 169.254.0.0/16 machine # [ 49.917081] dhcpcd[690]: vethcd97be52: no IPv6 Routers available machine # [ 50.047877] dhcpcd[690]: vethc436e78f: no IPv6 Routers available machine # [ 50.446793] dhcpcd[690]: vethbd98f1f1: no IPv6 Routers available machine # [ 50.451928] dhcpcd[690]: vethf8f32bc9: no IPv6 Routers available machine # error: timed out waiting for the condition machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 31.36 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s, in 0.21 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s, in 0.20 seconds) machine: waiting for unit niks3.service machine: (finished: waiting for unit niks3.service, in 0.05 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.21 seconds) machine: waiting for success: test $(curl -sf 10.42.0.5:9901/clusters | grep -c 'health_flags::healthy') -ge 3 machine: (finished: waiting for success: test $(curl -sf 10.42.0.5:9901/clusters | grep -c 'health_flags::healthy') -ge 3, in 0.08 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.19 seconds) machine: waiting for success: curl -sf http://10.42.0.4:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2' machine: (finished: waiting for success: curl -sf http://10.42.0.4:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2', in 0.03 seconds) (finished: subtest: chart deploys and workers become Ready, in 32.34 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}', in 0.16 seconds) machine: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt machine: (finished: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt, in 0.17 seconds) subtest: build through the balancer lands in the cache machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1 machine # [ 123.535573] niks3-server[1197]: 2026/09/30 09:26:51 INFO Received push request method=POST path=/api/pushes machine # [ 123.559160] niks3-server[1197]: 2026/09/30 09:26:51 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign machine # [ 123.566700] niks3-server[1197]: 2026/09/30 09:26:51 INFO Signed narinfos id=1 count=1 machine # [ 123.568391] niks3-server[1197]: 2026/09/30 09:26:51 INFO Registered completed upload object_key=nar/0nzzbas7l8d37mridr7mg162smfjvn7lhs6am4crl4ydaxicigj8.nar.zst machine # [ 123.577235] niks3-server[1197]: 2026/09/30 09:26:51 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.ls machine # [ 123.580353] niks3-server[1197]: 2026/09/30 09:26:51 INFO Received complete push request method=POST path=/api/pushes/1/complete machine # [ 123.587205] niks3-server[1197]: 2026/09/30 09:26:51 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.narinfo machine # [ 147.907220] niks3-server[1197]: 2026/09/30 09:27:16 INFO Received push request method=POST path=/api/pushes machine # [ 147.934058] niks3-server[1197]: 2026/09/30 09:27:16 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign machine # [ 147.937045] niks3-server[1197]: 2026/09/30 09:27:16 INFO Registered completed upload object_key=nar/1p7jh5nyz9n68k5f18ymmdpgr34mpnnch1njw7ki7b2b97qlfbjk.nar.zst machine # [ 147.939440] niks3-server[1197]: 2026/09/30 09:27:16 INFO Signed narinfos id=2 count=1 machine # [ 147.940130] niks3-server[1197]: 2026/09/30 09:27:16 INFO Registered completed upload object_key=log/yz1sqzb72i8v6h2ass0v76ba8cncqj9r-k3s-a.drv machine # [ 147.941076] niks3-server[1197]: 2026/09/30 09:27:16 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.ls machine # [ 147.949067] niks3-server[1197]: 2026/09/30 09:27:16 INFO Received complete push request method=POST path=/api/pushes/2/complete machine # [ 147.954255] niks3-server[1197]: 2026/09/30 09:27:16 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.narinfo machine # [ 148.023427] niks3-server[1197]: 2026/09/30 09:27:16 INFO Received push request method=POST path=/api/pushes machine # [ 148.036107] niks3-server[1197]: 2026/09/30 09:27:16 INFO Received sign narinfos request method=POST path=/api/pushes/3/sign machine # [ 148.036810] niks3-server[1197]: 2026/09/30 09:27:16 INFO Signed narinfos id=3 count=1 machine # [ 148.039000] niks3-server[1197]: 2026/09/30 09:27:16 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.ls machine # [ 148.042598] niks3-server[1197]: 2026/09/30 09:27:16 INFO Registered completed upload object_key=nar/03a4ywhyr5knmbc93z4gyml5y8fvgb431xvlmfxrwsm8mrb0qgx2.nar.zst machine # [ 148.046192] niks3-server[1197]: 2026/09/30 09:27:16 INFO Received complete push request method=POST path=/api/pushes/3/complete machine # [ 148.050431] niks3-server[1197]: 2026/09/30 09:27:16 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.narinfo machine # [ 172.560027] niks3-server[1197]: 2026/09/30 09:27:40 INFO Received push request method=POST path=/api/pushes machine # [ 172.578841] niks3-server[1197]: 2026/09/30 09:27:40 INFO Received sign narinfos request method=POST path=/api/pushes/4/sign machine # [ 172.581361] niks3-server[1197]: 2026/09/30 09:27:40 INFO Signed narinfos id=4 count=1 machine # [ 172.584828] niks3-server[1197]: 2026/09/30 09:27:40 INFO Registered completed upload object_key=nar/05qjsj5ff3a6vnxkhb6k5f3m446dcc206p7cd37w4v3mgi95d7kh.nar.zst machine # [ 172.587639] niks3-server[1197]: 2026/09/30 09:27:40 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.ls machine # [ 172.589743] niks3-server[1197]: 2026/09/30 09:27:40 INFO Registered completed upload object_key=log/zfq1xw9bmycqh35l0s44lmv65z4xc7br-k3s-b.drv machine # [ 172.593126] niks3-server[1197]: 2026/09/30 09:27:40 INFO Received complete push request method=POST path=/api/pushes/4/complete machine # [ 172.598790] niks3-server[1197]: 2026/09/30 09:27:40 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.narinfo machine # [ 172.661398] niks3-server[1197]: 2026/09/30 09:27:41 INFO Received push request method=POST path=/api/pushes machine # [ 172.673492] niks3-server[1197]: 2026/09/30 09:27:41 INFO Received sign narinfos request method=POST path=/api/pushes/5/sign machine # [ 172.675396] niks3-server[1197]: 2026/09/30 09:27:41 INFO Signed narinfos id=5 count=1 machine # [ 172.677875] niks3-server[1197]: 2026/09/30 09:27:41 INFO Registered completed upload object_key=nar/0jyw88klkf3nwxpnj5m5lx3i1dv2idf3hcn6im7883hnldm3gvyq.nar.zst machine # [ 172.680132] niks3-server[1197]: 2026/09/30 09:27:41 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.ls machine # [ 172.681752] niks3-server[1197]: 2026/09/30 09:27:41 INFO Received complete push request method=POST path=/api/pushes/5/complete machine # [ 172.687028] niks3-server[1197]: 2026/09/30 09:27:41 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.narinfo machine # [ 197.802605] niks3-server[1197]: 2026/09/30 09:28:06 INFO Received push request method=POST path=/api/pushes machine # [ 197.828588] niks3-server[1197]: 2026/09/30 09:28:06 INFO Received sign narinfos request method=POST path=/api/pushes/6/sign machine # [ 197.830985] niks3-server[1197]: 2026/09/30 09:28:06 INFO Signed narinfos id=6 count=1 machine # [ 197.834059] niks3-server[1197]: 2026/09/30 09:28:06 INFO Registered completed upload object_key=nar/1q8vp5xqws560mpf8rxk8r8jhqrzibivh13x4wxy0cfqlzbk7cr5.nar.zst machine # [ 197.835182] niks3-server[1197]: 2026/09/30 09:28:06 INFO Registered completed upload object_key=log/n40czam6a4ldp1mh5fdmlcy07fv0akbm-k3s-top.drv machine # [ 197.837289] niks3-server[1197]: 2026/09/30 09:28:06 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.ls machine # [ 197.842256] niks3-server[1197]: 2026/09/30 09:28:06 INFO Received complete push request method=POST path=/api/pushes/6/complete machine # [ 197.846231] niks3-server[1197]: 2026/09/30 09:28:06 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1, in 137.87 seconds) machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath, in 0.14 seconds) machine: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine: (finished: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.01 seconds) machine: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine # copying 3 paths... machine # copying path '/nix/store/r95r891injj9ski5c4w89yxjvjy065mx-k3s-a' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/mrqsh0475wxsmnsvkk55g94v6g5nrcra-k3s-b' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top' from 'http://192.168.1.1:5751'... machine: (finished: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.19 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1 machine # [ 199.492932] niks3-server[1197]: 2026/09/30 09:28:07 INFO Received push request method=POST path=/api/pushes machine # [ 199.512260] niks3-server[1197]: 2026/09/30 09:28:07 INFO Received sign narinfos request method=POST path=/api/pushes/7/sign machine # [ 199.513624] niks3-server[1197]: 2026/09/30 09:28:07 INFO Signed narinfos id=7 count=1 machine # [ 199.517269] niks3-server[1197]: 2026/09/30 09:28:07 INFO Registered completed upload object_key=nar/1fr26arhri17j9bj6hyjzmmd74v730biz1gb3kqd194vjx3ccvp9.nar.zst machine # [ 199.520689] niks3-server[1197]: 2026/09/30 09:28:07 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.ls machine # [ 199.525195] niks3-server[1197]: 2026/09/30 09:28:07 INFO Received complete push request method=POST path=/api/pushes/7/complete machine # [ 199.528698] niks3-server[1197]: 2026/09/30 09:28:07 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.narinfo machine # [ 224.647569] niks3-server[1197]: 2026/09/30 09:28:32 INFO Received push request method=POST path=/api/pushes machine # [ 224.668207] niks3-server[1197]: 2026/09/30 09:28:33 INFO Received sign narinfos request method=POST path=/api/pushes/8/sign machine # [ 224.669434] niks3-server[1197]: 2026/09/30 09:28:33 INFO Registered completed upload object_key=nar/1hfc6x4x25k3b0fk091d3nb0k3mympfp05fkslcx19synp3ig0zd.nar.zst machine # [ 224.670352] niks3-server[1197]: 2026/09/30 09:28:33 INFO Signed narinfos id=8 count=1 machine # [ 224.671602] niks3-server[1197]: 2026/09/30 09:28:33 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.ls machine # [ 224.673295] niks3-server[1197]: 2026/09/30 09:28:33 INFO Registered completed upload object_key=log/pbpqsh50ar10fpasdqqx8xg3lmr5j8iz-k3s-a.drv machine # [ 224.675160] niks3-server[1197]: 2026/09/30 09:28:33 INFO Received complete push request method=POST path=/api/pushes/8/complete machine # [ 224.677458] niks3-server[1197]: 2026/09/30 09:28:33 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.narinfo machine # [ 224.752514] niks3-server[1197]: 2026/09/30 09:28:33 INFO Received push request method=POST path=/api/pushes machine # [ 224.763821] niks3-server[1197]: 2026/09/30 09:28:33 INFO Received sign narinfos request method=POST path=/api/pushes/9/sign machine # [ 224.767307] niks3-server[1197]: 2026/09/30 09:28:33 INFO Signed narinfos id=9 count=1 machine # [ 224.767734] niks3-server[1197]: 2026/09/30 09:28:33 INFO Registered completed upload object_key=nar/0zzq2vgjln4shvh57091n14sam6wh6w06vja6lzb9ppcj4ffyx1n.nar.zst machine # [ 224.768560] niks3-server[1197]: 2026/09/30 09:28:33 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.ls machine # [ 224.772689] niks3-server[1197]: 2026/09/30 09:28:33 INFO Received complete push request method=POST path=/api/pushes/9/complete machine # [ 224.777655] niks3-server[1197]: 2026/09/30 09:28:33 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.narinfo machine # [ 249.687910] niks3-server[1197]: 2026/09/30 09:28:58 INFO Received push request method=POST path=/api/pushes machine # [ 249.706181] niks3-server[1197]: 2026/09/30 09:28:58 INFO Received sign narinfos request method=POST path=/api/pushes/10/sign machine # [ 249.707841] niks3-server[1197]: 2026/09/30 09:28:58 INFO Signed narinfos id=10 count=1 machine # [ 249.712316] niks3-server[1197]: 2026/09/30 09:28:58 INFO Registered completed upload object_key=log/894h6wzw2l4w5f0hikj1k6q57jfnyi87-k3s-b.drv machine # [ 249.714352] niks3-server[1197]: 2026/09/30 09:28:58 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.ls machine # [ 249.716103] niks3-server[1197]: 2026/09/30 09:28:58 INFO Registered completed upload object_key=nar/0hh3nqk95r6g32lhdmxw8cxjv694vbpx9876zkhcpg4r4qxni2ch.nar.zst machine # [ 249.720021] niks3-server[1197]: 2026/09/30 09:28:58 INFO Received complete push request method=POST path=/api/pushes/10/complete machine # [ 249.723964] niks3-server[1197]: 2026/09/30 09:28:58 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.narinfo machine # [ 249.802234] niks3-server[1197]: 2026/09/30 09:28:58 INFO Received push request method=POST path=/api/pushes machine # [ 249.816723] niks3-server[1197]: 2026/09/30 09:28:58 INFO Received sign narinfos request method=POST path=/api/pushes/11/sign machine # [ 249.817242] niks3-server[1197]: 2026/09/30 09:28:58 INFO Signed narinfos id=11 count=1 machine # [ 249.821147] niks3-server[1197]: 2026/09/30 09:28:58 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.ls machine # [ 249.824134] niks3-server[1197]: 2026/09/30 09:28:58 INFO Received complete push request method=POST path=/api/pushes/11/complete machine # [ 249.829294] niks3-server[1197]: 2026/09/30 09:28:58 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.narinfo machine # [ 249.835053] niks3-server[1197]: 2026/09/30 09:28:58 INFO Registered completed upload object_key=nar/0ingamx56k31lwiyxmnxmscjj4n3qfx6sr2kpaynsrwhwz1278iw.nar.zst machine # [ 274.342180] niks3-server[1197]: 2026/09/30 09:29:22 INFO Received push request method=POST path=/api/pushes machine # [ 274.358756] niks3-server[1197]: 2026/09/30 09:29:22 INFO Received sign narinfos request method=POST path=/api/pushes/12/sign machine # [ 274.364306] niks3-server[1197]: 2026/09/30 09:29:22 INFO Signed narinfos id=12 count=1 machine # [ 274.367579] niks3-server[1197]: 2026/09/30 09:29:22 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.ls machine # [ 274.371673] niks3-server[1197]: 2026/09/30 09:29:22 INFO Registered completed upload object_key=log/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g-k3s-top.drv machine # [ 274.376235] niks3-server[1197]: 2026/09/30 09:29:22 INFO Registered completed upload object_key=nar/0v48x4sp58bvfra08axgkz7yl1n9nc4nirskyv1hwann4i7q277i.nar.zst machine # [ 274.377622] niks3-server[1197]: 2026/09/30 09:29:22 INFO Received complete push request method=POST path=/api/pushes/12/complete machine # [ 274.381246] niks3-server[1197]: 2026/09/30 09:29:22 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1, in 76.19 seconds) (finished: subtest: build through the balancer lands in the cache, in 214.40 seconds) subtest: a Job with the client image builds through the farm with its service account machine: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine: (finished: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.19 seconds) machine: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix machine: (finished: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix, in 0.13 seconds) machine: must succeed: kubectl apply -f /nix/store/4qg21n7g16x8lyv0fhhdx9dx3lxqkcdn-ci-job.json machine: (finished: must succeed: kubectl apply -f /nix/store/4qg21n7g16x8lyv0fhhdx9dx3lxqkcdn-ci-job.json, in 0.18 seconds) machine: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed' machine # [ 276.182308] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod260d615d_226e_4ea3_ac6f_64e46f2d1780.slice. machine # [ 276.228375] k3s[903]: I0930 09:29:24.578690 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"job\" (UniqueName: \"kubernetes.io/configmap/260d615d-226e-4ea3-ac6f-64e46f2d1780-job\") pod \"ci-vzm6k\" (UID: \"260d615d-226e-4ea3-ac6f-64e46f2d1780\") " pod="ci/ci-vzm6k" machine # [ 276.228610] k3s[903]: I0930 09:29:24.578757 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl8ff\" (UniqueName: \"kubernetes.io/projected/260d615d-226e-4ea3-ac6f-64e46f2d1780-kube-api-access-pl8ff\") pod \"ci-vzm6k\" (UID: \"260d615d-226e-4ea3-ac6f-64e46f2d1780\") " pod="ci/ci-vzm6k" machine # [ 276.229501] k3s[903]: I0930 09:29:24.578791 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/260d615d-226e-4ea3-ac6f-64e46f2d1780-nix-grpc-farm\") pod \"ci-vzm6k\" (UID: \"260d615d-226e-4ea3-ac6f-64e46f2d1780\") " pod="ci/ci-vzm6k" machine # [ 276.686316] cni0: port 1(veth401f4178) entered blocking state machine # [ 276.687921] cni0: port 1(veth401f4178) entered disabled state machine # [ 276.690819] veth401f4178: entered allmulticast mode machine # [ 276.693222] veth401f4178: entered promiscuous mode machine # [ 276.707560] cni0: port 1(veth401f4178) entered blocking state machine # [ 276.709833] cni0: port 1(veth401f4178) entered forwarding state machine # [ 276.592831] (udev-worker)[4790]: Network interface NamePolicy= disabled on kernel command line. machine # [ 276.617414] dhcpcd[690]: veth401f4178: IAID 56:34:93:43 machine # [ 276.618325] dhcpcd[690]: veth401f4178: adding address fe80::2c8b:56ff:fe34:9343 machine # [ 276.649279] systemd[1]: Started libcontainer container b0e7d63b4a7b08439c5873b0e076e05521e41a197325344a36ff191c3caedde9. machine # [ 278.301540] dhcpcd[690]: veth401f4178: soliciting a DHCP lease machine # [ 278.394268] dhcpcd[690]: veth401f4178: soliciting an IPv6 router machine # [ 278.776713] systemd[1]: Started libcontainer container 9c7b109e382d0652d94a5739d9471fcf5c154c6383dc92420a04109b9486d083. machine # [ 278.841906] k3s[903]: I0930 09:29:27.192282 903 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ci/ci-vzm6k" podStartSLOduration=3.19225024 podStartE2EDuration="3.19225024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-30 09:29:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 09:29:27.191671116 +0000 UTC m=+261.276243460" watchObservedRunningTime="2026-09-30 09:29:27.19225024 +0000 UTC m=+261.276822584" machine # [ 280.175207] niks3-server[1197]: 2026/09/30 09:29:28 INFO Received push request method=POST path=/api/pushes machine # [ 280.192914] niks3-server[1197]: 2026/09/30 09:29:28 INFO Received sign narinfos request method=POST path=/api/pushes/13/sign machine # [ 280.193884] niks3-server[1197]: 2026/09/30 09:29:28 INFO Signed narinfos id=13 count=1 machine # [ 280.197289] niks3-server[1197]: 2026/09/30 09:29:28 INFO Registered completed upload object_key=nar/111g6dyibwcf2z7jhpn72rgja0qvjgpdiv9nc06g2dp7ih0a6kyq.nar.zst machine # [ 280.207979] niks3-server[1197]: 2026/09/30 09:29:28 INFO Received complete push request method=POST path=/api/pushes/13/complete machine # [ 280.211450] niks3-server[1197]: 2026/09/30 09:29:28 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.ls machine # [ 280.222245] niks3-server[1197]: 2026/09/30 09:29:28 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.narinfo machine # [ 283.302789] dhcpcd[690]: veth401f4178: probing for an IPv4LL address machine # [ 288.300675] dhcpcd[690]: veth401f4178: using IPv4LL address 169.254.80.167 machine # [ 288.301534] dhcpcd[690]: veth401f4178: adding route to 169.254.0.0/16 machine # [ 290.397564] dhcpcd[690]: veth401f4178: no IPv6 Routers available machine # [ 304.725320] niks3-server[1197]: 2026/09/30 09:29:53 INFO Received push request method=POST path=/api/pushes machine # [ 304.742203] niks3-server[1197]: 2026/09/30 09:29:53 INFO Registered completed upload object_key=nar/058kjd2vfl1r27b4d9ixvwf77d8rkr18a4v894kwx8lg0nwpajnr.nar.zst machine # [ 304.746245] niks3-server[1197]: 2026/09/30 09:29:53 INFO Received sign narinfos request method=POST path=/api/pushes/14/sign machine # [ 304.746903] niks3-server[1197]: 2026/09/30 09:29:53 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.ls machine # [ 304.747690] niks3-server[1197]: 2026/09/30 09:29:53 INFO Signed narinfos id=14 count=1 machine # [ 304.751802] niks3-server[1197]: 2026/09/30 09:29:53 INFO Registered completed upload object_key=log/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # [ 304.754868] niks3-server[1197]: 2026/09/30 09:29:53 INFO Received complete push request method=POST path=/api/pushes/14/complete machine # [ 304.759875] niks3-server[1197]: 2026/09/30 09:29:53 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.narinfo machine # [ 304.822448] niks3-server[1197]: 2026/09/30 09:29:53 INFO Received push request method=POST path=/api/pushes machine # [ 304.833692] niks3-server[1197]: 2026/09/30 09:29:53 INFO Received sign narinfos request method=POST path=/api/pushes/15/sign machine # [ 304.836468] niks3-server[1197]: 2026/09/30 09:29:53 INFO Signed narinfos id=15 count=1 machine # [ 304.839058] niks3-server[1197]: 2026/09/30 09:29:53 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.ls machine # [ 304.840255] niks3-server[1197]: 2026/09/30 09:29:53 INFO Registered completed upload object_key=nar/138ynhcd5wxzz485x9qcq7xsargaklrf2li31ai69m5r46am35q6.nar.zst machine # [ 304.848387] niks3-server[1197]: 2026/09/30 09:29:53 INFO Received complete push request method=POST path=/api/pushes/15/complete machine # [ 304.852892] niks3-server[1197]: 2026/09/30 09:29:53 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.narinfo machine # [ 309.423783] postgres[758]: [758] LOG: checkpoint starting: time machine # [ 329.543785] niks3-server[1197]: 2026/09/30 09:30:17 INFO Received push request method=POST path=/api/pushes machine # [ 329.558329] niks3-server[1197]: 2026/09/30 09:30:17 INFO Received sign narinfos request method=POST path=/api/pushes/16/sign machine # [ 329.561188] niks3-server[1197]: 2026/09/30 09:30:17 INFO Signed narinfos id=16 count=1 machine # [ 329.564209] niks3-server[1197]: 2026/09/30 09:30:17 INFO Registered completed upload object_key=log/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # [ 329.566325] niks3-server[1197]: 2026/09/30 09:30:17 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.ls machine # [ 329.568209] niks3-server[1197]: 2026/09/30 09:30:17 INFO Registered completed upload object_key=nar/0n4lbdlp8w72fs3qbavl2lwrzbrn55i2b1vyglc89cc3pi8vbb1m.nar.zst machine # [ 329.570478] niks3-server[1197]: 2026/09/30 09:30:17 INFO Received complete push request method=POST path=/api/pushes/16/complete machine # [ 329.575374] niks3-server[1197]: 2026/09/30 09:30:17 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo machine # [ 329.637162] niks3-server[1197]: 2026/09/30 09:30:17 INFO Received push request method=POST path=/api/pushes machine # [ 329.647670] niks3-server[1197]: 2026/09/30 09:30:17 INFO Received sign narinfos request method=POST path=/api/pushes/17/sign machine # [ 329.649798] niks3-server[1197]: 2026/09/30 09:30:17 INFO Signed narinfos id=17 count=1 machine # [ 329.651340] niks3-server[1197]: 2026/09/30 09:30:18 INFO Registered completed upload object_key=nar/1f3gvnvqsm2pm3laixkxkg44kvjb251zqhszcfpp0a00h6x66ljs.nar.zst machine # [ 329.653527] niks3-server[1197]: 2026/09/30 09:30:18 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.ls machine # [ 329.656269] niks3-server[1197]: 2026/09/30 09:30:18 INFO Received complete push request method=POST path=/api/pushes/17/complete machine # [ 329.659206] niks3-server[1197]: 2026/09/30 09:30:18 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.narinfo machine # [ 354.573405] niks3-server[1197]: 2026/09/30 09:30:42 INFO Received push request method=POST path=/api/pushes machine # [ 354.593902] niks3-server[1197]: 2026/09/30 09:30:42 INFO Received sign narinfos request method=POST path=/api/pushes/18/sign machine # [ 354.597057] niks3-server[1197]: 2026/09/30 09:30:42 INFO Signed narinfos id=18 count=1 machine # [ 354.600253] niks3-server[1197]: 2026/09/30 09:30:42 INFO Registered completed upload object_key=nar/1zwf0asrdv12q40fmqga5lx5330dvn9y4in4i9ficz9ij5lhvnf5.nar.zst machine # [ 354.600900] niks3-server[1197]: 2026/09/30 09:30:42 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.ls machine # [ 354.605131] niks3-server[1197]: 2026/09/30 09:30:42 INFO Registered completed upload object_key=log/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # [ 354.609152] niks3-server[1197]: 2026/09/30 09:30:42 INFO Received complete push request method=POST path=/api/pushes/18/complete machine # [ 354.616639] niks3-server[1197]: 2026/09/30 09:30:42 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo machine # [ 356.377242] niks3-server[1197]: 2026/09/30 09:30:44 INFO Received push request method=POST path=/api/pushes machine # [ 356.389467] niks3-server[1197]: 2026/09/30 09:30:44 INFO Received sign narinfos request method=POST path=/api/pushes/19/sign machine # [ 356.390969] niks3-server[1197]: 2026/09/30 09:30:44 INFO Signed narinfos id=19 count=1 machine # [ 356.397065] niks3-server[1197]: 2026/09/30 09:30:44 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.ls machine # [ 356.398487] niks3-server[1197]: 2026/09/30 09:30:44 INFO Received complete push request method=POST path=/api/pushes/19/complete machine # [ 356.398777] niks3-server[1197]: 2026/09/30 09:30:44 INFO Registered completed upload object_key=nar/0xiyqcsl8db7dnrq2gqnx5izavr51ma3dcdswrriaxfgj3qzk7xf.nar.zst machine # [ 356.407200] niks3-server[1197]: 2026/09/30 09:30:44 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.narinfo machine # [ 380.905534] niks3-server[1197]: 2026/09/30 09:31:09 INFO Received push request method=POST path=/api/pushes machine # [ 380.924352] niks3-server[1197]: 2026/09/30 09:31:09 INFO Received sign narinfos request method=POST path=/api/pushes/20/sign machine # [ 380.925555] niks3-server[1197]: 2026/09/30 09:31:09 INFO Signed narinfos id=20 count=1 machine # [ 380.926611] niks3-server[1197]: 2026/09/30 09:31:09 INFO Registered completed upload object_key=log/fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # [ 380.935940] niks3-server[1197]: 2026/09/30 09:31:09 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.ls machine # [ 380.939487] niks3-server[1197]: 2026/09/30 09:31:09 INFO Registered completed upload object_key=nar/0p3l2z3riilylr2rxb1aq2blxdfxg55wbgp4gxkns93srbr4bwyq.nar.zst machine # [ 380.943805] niks3-server[1197]: 2026/09/30 09:31:09 INFO Received complete push request method=POST path=/api/pushes/20/complete machine # [ 380.947279] niks3-server[1197]: 2026/09/30 09:31:09 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo machine # [ 382.101253] systemd[1]: cri-containerd-9c7b109e382d0652d94a5739d9471fcf5c154c6383dc92420a04109b9486d083.scope: Deactivated successfully. machine # [ 382.103240] systemd[1]: cri-containerd-9c7b109e382d0652d94a5739d9471fcf5c154c6383dc92420a04109b9486d083.scope: Consumed 1.092s CPU time over 1min 43.324s wall clock time, 154.7M memory peak, 85.6M read from disk, 428K written to disk, 18.3K incoming IP traffic, 44.8K outgoing IP traffic. machine # [ 382.145441] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-9c7b109e382d0652d94a5739d9471fcf5c154c6383dc92420a04109b9486d083-rootfs.mount: Deactivated successfully. machine # [ 384.073889] systemd[1]: cri-containerd-b0e7d63b4a7b08439c5873b0e076e05521e41a197325344a36ff191c3caedde9.scope: Deactivated successfully. machine # [ 384.138984] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-b0e7d63b4a7b08439c5873b0e076e05521e41a197325344a36ff191c3caedde9-rootfs.mount: Deactivated successfully. machine # [ 384.186088] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-b0e7d63b4a7b08439c5873b0e076e05521e41a197325344a36ff191c3caedde9-shm.mount: Deactivated successfully. machine # [ 384.381809] cni0: port 1(veth401f4178) entered disabled state machine # [ 384.229617] dhcpcd[690]: veth401f4178: carrier lost machine # [ 384.386501] veth401f4178 (unregistering): left allmulticast mode machine # [ 384.387861] veth401f4178 (unregistering): left promiscuous mode machine # [ 384.389055] cni0: port 1(veth401f4178) entered disabled state machine # [ 384.254099] systemd[1]: run-netns-cni\x2d5ec16c91\x2db088\x2db28e\x2dd8ff\x2da0eb136b8826.mount: Deactivated successfully. machine # [ 384.256273] dhcpcd[690]: veth401f4178: deleting address fe80::2c8b:56ff:fe34:9343 machine # [ 384.260199] dhcpcd[690]: veth401f4178: deleting route to 169.254.0.0/16 machine # [ 384.333417] dhcpcd[690]: veth401f4178: removing interface machine # [ 384.393604] k3s[903]: I0930 09:31:12.743981 903 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/260d615d-226e-4ea3-ac6f-64e46f2d1780-kube-api-access-pl8ff\" (UniqueName: \"kubernetes.io/projected/260d615d-226e-4ea3-ac6f-64e46f2d1780-kube-api-access-pl8ff\") pod \"260d615d-226e-4ea3-ac6f-64e46f2d1780\" (UID: \"260d615d-226e-4ea3-ac6f-64e46f2d1780\") " machine # [ 384.394024] k3s[903]: I0930 09:31:12.744167 903 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/260d615d-226e-4ea3-ac6f-64e46f2d1780-nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/260d615d-226e-4ea3-ac6f-64e46f2d1780-nix-grpc-farm\") pod \"260d615d-226e-4ea3-ac6f-64e46f2d1780\" (UID: \"260d615d-226e-4ea3-ac6f-64e46f2d1780\") " machine # [ 384.394478] k3s[903]: I0930 09:31:12.744250 903 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/260d615d-226e-4ea3-ac6f-64e46f2d1780-job\" (UniqueName: \"kubernetes.io/configmap/260d615d-226e-4ea3-ac6f-64e46f2d1780-job\") pod \"260d615d-226e-4ea3-ac6f-64e46f2d1780\" (UID: \"260d615d-226e-4ea3-ac6f-64e46f2d1780\") " machine # [ 384.395195] k3s[903]: I0930 09:31:12.745107 903 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/260d615d-226e-4ea3-ac6f-64e46f2d1780-job" pod "260d615d-226e-4ea3-ac6f-64e46f2d1780" (UID: "260d615d-226e-4ea3-ac6f-64e46f2d1780"). InnerVolumeSpecName "job". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 384.399967] systemd[1]: var-lib-kubelet-pods-260d615d\x2d226e\x2d4ea3\x2dac6f\x2d64e46f2d1780-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dpl8ff.mount: Deactivated successfully. machine # [ 384.402205] systemd[1]: var-lib-kubelet-pods-260d615d\x2d226e\x2d4ea3\x2dac6f\x2d64e46f2d1780-volumes-kubernetes.io\x7eprojected-nix\x2dgrpc\x2dfarm.mount: Deactivated successfully. machine # [ 384.417110] k3s[903]: I0930 09:31:12.767784 903 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/260d615d-226e-4ea3-ac6f-64e46f2d1780-kube-api-access-pl8ff" pod "260d615d-226e-4ea3-ac6f-64e46f2d1780" (UID: "260d615d-226e-4ea3-ac6f-64e46f2d1780"). InnerVolumeSpecName "kube-api-access-pl8ff". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 384.417613] k3s[903]: I0930 09:31:12.768313 903 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/260d615d-226e-4ea3-ac6f-64e46f2d1780-nix-grpc-farm" pod "260d615d-226e-4ea3-ac6f-64e46f2d1780" (UID: "260d615d-226e-4ea3-ac6f-64e46f2d1780"). InnerVolumeSpecName "nix-grpc-farm". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 384.494753] k3s[903]: I0930 09:31:12.845497 903 reconciler_common.go:299] "Volume detached for volume \"job\" (UniqueName: \"kubernetes.io/configmap/260d615d-226e-4ea3-ac6f-64e46f2d1780-job\") on node \"machine\" DevicePath \"\"" machine # [ 384.495048] k3s[903]: I0930 09:31:12.845533 903 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pl8ff\" (UniqueName: \"kubernetes.io/projected/260d615d-226e-4ea3-ac6f-64e46f2d1780-kube-api-access-pl8ff\") on node \"machine\" DevicePath \"\"" machine # [ 384.496448] k3s[903]: I0930 09:31:12.845548 903 reconciler_common.go:299] "Volume detached for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/260d615d-226e-4ea3-ac6f-64e46f2d1780-nix-grpc-farm\") on node \"machine\" DevicePath \"\"" machine # [ 385.057641] k3s[903]: I0930 09:31:13.408320 903 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b0e7d63b4a7b08439c5873b0e076e05521e41a197325344a36ff191c3caedde9" machine # [ 385.074533] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod260d615d_226e_4ea3_ac6f_64e46f2d1780.slice. machine # [ 385.075544] systemd[1]: kubepods-besteffort-pod260d615d_226e_4ea3_ac6f_64e46f2d1780.slice: Consumed 1.123s CPU time over 1min 48.891s wall clock time, 155M memory peak, 85.6M read from disk, 632K written to disk, 18.3K incoming IP traffic, 44.8K outgoing IP traffic. machine: (finished: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed', in 109.76 seconds) machine: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1 machine: (finished: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1, in 0.19 seconds) machine # don't know how to build these paths: machine # /nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-a> machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-g9qwc: building fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-b> machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-g9qwc: building 1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-top> machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-g9qwc: building rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # INFO:nix_fast_build.processes:run nix-eval-jobs --gc-roots-dir /tmp/tmpy6lxn1dx/gcroots --force-recurse --max-memory-size 4096 --workers 4 --flake '.#checks' --check-cache-status machine # INFO:nix_fast_build.workers:builds: 0 machine # warning: Git tree '/tmp' is dirty machine # warning: Git tree '/tmp' is dirty machine # ▶ x86_64-linux.t started machine # INFO:nix_fast_build.workers:builds: 2 machine # ✔ x86_64-linux.t (26s) machine # x86_64-linux.t> machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-5x7gj: building fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # warning: Git tree '/tmp' is dirty machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath, in 0.14 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null, in 0.03 seconds) (finished: subtest: a Job with the client image builds through the farm with its service account, in 110.90 seconds) subtest: a renewed balancer certificate is served without a rollout machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f - machine # Warning: resource secrets/farm-lb-tls is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically. machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f -, in 0.29 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}', in 0.18 seconds) machine: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-5877cc8b4f-bgnqh -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine # [ 387.017927] k3s[903]: E0930 09:31:15.368264 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:49418: use of closed network connection" machine # [ 388.308832] k3s[903]: E0930 09:31:16.659063 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:49422: use of closed network connection" machine # [ 389.630948] k3s[903]: E0930 09:31:17.981317 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:49428: use of closed network connection" machine # [ 390.918743] k3s[903]: E0930 09:31:19.269150 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:49440: use of closed network connection" machine # [ 392.230151] k3s[903]: E0930 09:31:20.580513 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:49442: use of closed network connection" machine # [ 393.528833] k3s[903]: E0930 09:31:21.878862 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51152: use of closed network connection" machine # [ 394.851089] k3s[903]: E0930 09:31:23.201488 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51158: use of closed network connection" machine # [ 396.119390] k3s[903]: E0930 09:31:24.469748 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51160: use of closed network connection" machine # [ 397.414971] k3s[903]: E0930 09:31:25.765161 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51166: use of closed network connection" machine # [ 398.694064] k3s[903]: E0930 09:31:27.044459 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51168: use of closed network connection" machine # [ 399.972463] k3s[903]: E0930 09:31:28.322496 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51178: use of closed network connection" machine # [ 401.280169] k3s[903]: E0930 09:31:29.630528 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51184: use of closed network connection" machine # [ 402.598447] k3s[903]: E0930 09:31:30.948822 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51196: use of closed network connection" machine # [ 403.891982] k3s[903]: E0930 09:31:32.242362 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:40048: use of closed network connection" machine # [ 405.198113] k3s[903]: E0930 09:31:33.548457 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:40064: use of closed network connection" machine # [ 406.493617] k3s[903]: E0930 09:31:34.843574 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:40074: use of closed network connection" machine # [ 407.787257] k3s[903]: E0930 09:31:36.136279 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:40078: use of closed network connection" machine # [ 409.050944] k3s[903]: E0930 09:31:37.400986 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:40080: use of closed network connection" machine # [ 410.337599] k3s[903]: E0930 09:31:38.688002 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:40092: use of closed network connection" machine # [ 411.600852] k3s[903]: E0930 09:31:39.951265 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:40094: use of closed network connection" machine # [ 412.877638] k3s[903]: E0930 09:31:41.227971 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:40104: use of closed network connection" machine # [ 413.476880] postgres[758]: [758] LOG: checkpoint complete: wrote 1037 buffers (6.3%), wrote 3 SLRU buffers; 1 WAL file(s) added, 0 removed, 0 recycled; write=103.935 s, sync=0.067 s, total=104.054 s; sync files=364, longest=0.006 s, average=0.001 s; distance=4987 kB, estimate=4987 kB; lsn=0/1C70518, redo lsn=0/1C44F40 machine # [ 414.154347] k3s[903]: E0930 09:31:42.504755 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:60812: use of closed network connection" machine # [ 415.416068] k3s[903]: E0930 09:31:43.766367 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:60828: use of closed network connection" machine # [ 416.703391] k3s[903]: E0930 09:31:45.053797 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:60836: use of closed network connection" machine # [ 418.032528] k3s[903]: E0930 09:31:46.382920 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:60850: use of closed network connection" machine # [ 419.311356] k3s[903]: E0930 09:31:47.661247 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:60852: use of closed network connection" machine # [ 420.590693] k3s[903]: E0930 09:31:48.940969 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:60868: use of closed network connection" machine # [ 421.866586] k3s[903]: E0930 09:31:50.216553 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:60870: use of closed network connection" machine: (finished: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-5877cc8b4f-bgnqh -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 35.08 seconds) machine: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine: (finished: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 0.04 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1 machine # [ 422.137166] niks3-server[1197]: 2026/09/30 09:31:50 INFO Received push request method=POST path=/api/pushes machine # [ 422.151714] niks3-server[1197]: 2026/09/30 09:31:50 INFO Received sign narinfos request method=POST path=/api/pushes/21/sign machine # [ 422.153568] niks3-server[1197]: 2026/09/30 09:31:50 INFO Signed narinfos id=21 count=1 machine # [ 422.155465] niks3-server[1197]: 2026/09/30 09:31:50 INFO Registered completed upload object_key=nar/0g42hgwa9jp9abmqxz90dkwxpybsznzbpsy35rm921mlk5sw56jq.nar.zst machine # [ 422.159208] niks3-server[1197]: 2026/09/30 09:31:50 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.ls machine # [ 422.163829] niks3-server[1197]: 2026/09/30 09:31:50 INFO Received complete push request method=POST path=/api/pushes/21/complete machine # [ 422.168636] niks3-server[1197]: 2026/09/30 09:31:50 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.narinfo machine # [ 447.085650] niks3-server[1197]: 2026/09/30 09:32:15 INFO Received push request method=POST path=/api/pushes machine # [ 447.102390] niks3-server[1197]: 2026/09/30 09:32:15 INFO Received sign narinfos request method=POST path=/api/pushes/22/sign machine # [ 447.103866] niks3-server[1197]: 2026/09/30 09:32:15 INFO Signed narinfos id=22 count=1 machine # [ 447.107744] niks3-server[1197]: 2026/09/30 09:32:15 INFO Registered completed upload object_key=log/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31-k3s-a.drv machine # [ 447.109424] niks3-server[1197]: 2026/09/30 09:32:15 INFO Registered completed upload object_key=nar/1vxmmzwi16s4iri6dcmi9v62dpq1ys7wz15b497ncik3sd67nfzg.nar.zst machine # [ 447.111114] niks3-server[1197]: 2026/09/30 09:32:15 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.ls machine # [ 447.113588] niks3-server[1197]: 2026/09/30 09:32:15 INFO Received complete push request method=POST path=/api/pushes/22/complete machine # [ 447.117340] niks3-server[1197]: 2026/09/30 09:32:15 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo machine # [ 447.194184] niks3-server[1197]: 2026/09/30 09:32:15 INFO Received push request method=POST path=/api/pushes machine # [ 447.208653] niks3-server[1197]: 2026/09/30 09:32:15 INFO Received sign narinfos request method=POST path=/api/pushes/23/sign machine # [ 447.209752] niks3-server[1197]: 2026/09/30 09:32:15 INFO Signed narinfos id=23 count=1 machine # [ 447.212159] niks3-server[1197]: 2026/09/30 09:32:15 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.ls machine # [ 447.214303] niks3-server[1197]: 2026/09/30 09:32:15 INFO Registered completed upload object_key=nar/0cbxkyxz068xc5mivh2h67kw6y01n1x28cbs11v1a03g8m4c71zm.nar.zst machine # [ 447.216283] niks3-server[1197]: 2026/09/30 09:32:15 INFO Received complete push request method=POST path=/api/pushes/23/complete machine # [ 447.219042] niks3-server[1197]: 2026/09/30 09:32:15 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.narinfo machine # [ 472.137362] niks3-server[1197]: 2026/09/30 09:32:40 INFO Received push request method=POST path=/api/pushes machine # [ 472.155632] niks3-server[1197]: 2026/09/30 09:32:40 INFO Received sign narinfos request method=POST path=/api/pushes/24/sign machine # [ 472.157989] niks3-server[1197]: 2026/09/30 09:32:40 INFO Signed narinfos id=24 count=1 machine # [ 472.160328] niks3-server[1197]: 2026/09/30 09:32:40 INFO Registered completed upload object_key=nar/0khxywxb2r78vhpc5hsmha3ymgp910z0aka7550jmaqzs333rmzp.nar.zst machine # [ 472.162973] niks3-server[1197]: 2026/09/30 09:32:40 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.ls machine # [ 472.164574] niks3-server[1197]: 2026/09/30 09:32:40 INFO Registered completed upload object_key=log/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4-k3s-b.drv machine # [ 472.168967] niks3-server[1197]: 2026/09/30 09:32:40 INFO Received complete push request method=POST path=/api/pushes/24/complete machine # [ 472.177726] niks3-server[1197]: 2026/09/30 09:32:40 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.narinfo machine # [ 472.252498] niks3-server[1197]: 2026/09/30 09:32:40 INFO Received push request method=POST path=/api/pushes machine # [ 472.264592] niks3-server[1197]: 2026/09/30 09:32:40 INFO Received sign narinfos request method=POST path=/api/pushes/25/sign machine # [ 472.268060] niks3-server[1197]: 2026/09/30 09:32:40 INFO Signed narinfos id=25 count=1 machine # [ 472.270467] niks3-server[1197]: 2026/09/30 09:32:40 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.ls machine # [ 472.273182] niks3-server[1197]: 2026/09/30 09:32:40 INFO Registered completed upload object_key=nar/04bim5f8bvjh25xncf5x40kb529khrlzcbc92qxvapgbc0bdfv2h.nar.zst machine # [ 472.275418] niks3-server[1197]: 2026/09/30 09:32:40 INFO Received complete push request method=POST path=/api/pushes/25/complete machine # [ 472.277107] niks3-server[1197]: 2026/09/30 09:32:40 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.narinfo machine # [ 497.190505] niks3-server[1197]: 2026/09/30 09:33:05 INFO Received push request method=POST path=/api/pushes machine # [ 497.208213] niks3-server[1197]: 2026/09/30 09:33:05 INFO Received sign narinfos request method=POST path=/api/pushes/26/sign machine # [ 497.211250] niks3-server[1197]: 2026/09/30 09:33:05 INFO Signed narinfos id=26 count=1 machine # [ 497.215107] niks3-server[1197]: 2026/09/30 09:33:05 INFO Registered completed upload object_key=nar/11f7f1hixry25c2yc6np9hs10a2pwwqmymmrxxbswhdjabcyvv0s.nar.zst machine # [ 497.218661] niks3-server[1197]: 2026/09/30 09:33:05 INFO Registered completed upload object_key=log/jz7biafi8rj5r3r392blyazw5mdpvy0d-k3s-top.drv machine # [ 497.219575] niks3-server[1197]: 2026/09/30 09:33:05 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.ls machine # [ 497.225121] niks3-server[1197]: 2026/09/30 09:33:05 INFO Received complete push request method=POST path=/api/pushes/26/complete machine # [ 497.229331] niks3-server[1197]: 2026/09/30 09:33:05 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1, in 75.34 seconds) (finished: subtest: a renewed balancer certificate is served without a rollout, in 110.93 seconds) subtest: metrics carry build_info machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-5x7gj -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-5x7gj -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.14 seconds) machine: must succeed: curl -sf http://10.42.0.7:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-5x7gj"' machine: (finished: must succeed: curl -sf http://10.42.0.7:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-5x7gj"', in 0.03 seconds) (finished: subtest: metrics carry build_info, in 0.17 seconds) subtest: harmonia-gc frees space and the worker stays Ready machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-5x7gj -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'' machine # [ 497.606483] k3s[903]: E0930 09:33:05.956952 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:43118: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-5x7gj -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'', in 0.18 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-5x7gj -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done' machine # [ 497.844916] k3s[903]: E0930 09:33:06.195623 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:43134: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-5x7gj -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done', in 0.24 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-5x7gj -c gc -- sh -c 'fallocate -l 11443855360 /nix/fill' machine # [ 498.021160] k3s[903]: E0930 09:33:06.371747 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:43140: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-5x7gj -c gc -- sh -c 'fallocate -l 11443855360 /nix/fill', in 0.18 seconds) machine: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-5x7gj -c gc --since=30s | grep -q 'store paths deleted' machine: (finished: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-5x7gj -c gc --since=30s | grep -q 'store paths deleted', in 8.79 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-5x7gj -c gc -- sh -c 'rm /nix/fill' machine # [ 507.074793] k3s[903]: E0930 09:33:15.425162 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:53410: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-5x7gj -c gc -- sh -c 'rm /nix/fill', in 0.26 seconds) machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-5x7gj -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-5x7gj -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}', in 0.16 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-5x7gj -c gc -- sh -c 'command -v nix-daemon && command -v niks3' machine # [ 507.459719] k3s[903]: E0930 09:33:15.810357 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:53418: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-5x7gj -c gc -- sh -c 'command -v nix-daemon && command -v niks3', in 0.22 seconds) (finished: subtest: harmonia-gc frees space and the worker stays Ready, in 10.04 seconds) subtest: losing the balancer mid-build: the client reconnects and the build succeeds machine: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1 machine # [ 507.489642] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1. machine # Running as unit: vialb.service; invocation ID: 3d701f89eedd4e37a9acbd13188e7b87 machine: (finished: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1, in 0.03 seconds) machine: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'" machine # [ 507.643645] nix[9673]: don't know how to build these paths: machine # [ 507.644225] nix[9673]: /nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 507.671642] nix[9673]: copying 1 paths to '127.0.0.1:30051'... machine # [ 507.674941] nix[9673]: copying path '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' to '127.0.0.1:30051'... machine # [ 507.732382] niks3-server[1197]: 2026/09/30 09:33:16 INFO Received push request method=POST path=/api/pushes machine # [ 507.747484] niks3-server[1197]: 2026/09/30 09:33:16 INFO Received sign narinfos request method=POST path=/api/pushes/27/sign machine # [ 507.748991] niks3-server[1197]: 2026/09/30 09:33:16 INFO Signed narinfos id=27 count=1 machine # [ 507.753135] niks3-server[1197]: 2026/09/30 09:33:16 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.ls machine # [ 507.755081] niks3-server[1197]: 2026/09/30 09:33:16 INFO Registered completed upload object_key=nar/0kkr2vb091wkq0cb0f1q92413dsfskh76wydp8mwysv7rawns0ar.nar.zst machine # [ 507.760969] niks3-server[1197]: 2026/09/30 09:33:16 INFO Received complete push request method=POST path=/api/pushes/27/complete machine # [ 507.767646] niks3-server[1197]: 2026/09/30 09:33:16 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.narinfo machine # [ 507.778388] nix[9673]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 507.781690] nix[9673]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-5x7gj: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine: (finished: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'", in 1.06 seconds) machine: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false machine: (finished: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false, in 0.23 seconds) machine: waiting for success: ! systemctl is-active vialb machine # [ 508.813758] nix[9673]: d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv: Stream removed (Socket closed), asking the scheduler again machine # [ 508.814291] nix[9673]: scheduler at 127.0.0.1:30051: Stream removed (Socket closed), reconnecting machine # [ 508.825911] k3s[903]: E0930 09:33:17.173215 903 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-lb-5877cc8b4f\" failed with read version: 762 is not as new as written version: 794 for group resource replicasets.apps" logger="UnhandledError" machine # [ 508.827309] systemd[1]: cri-containerd-3d281720b74b25af47212a78eaa36f7e78a8e15594faf5738da521e09c750699.scope: Deactivated successfully. machine # [ 508.827875] systemd[1]: cri-containerd-3d281720b74b25af47212a78eaa36f7e78a8e15594faf5738da521e09c750699.scope: Consumed 4.439s CPU time over 7min 50.898s wall clock time, 44.2M memory peak, 22M read from disk, 601.8K incoming IP traffic, 737.5K outgoing IP traffic. machine # [ 508.843432] systemd[1]: Created slice libcontainer container kubepods-besteffort-podf96b64d7_2859_45c8_9603_ef415bb585a9.slice. machine # [ 508.879618] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-3d281720b74b25af47212a78eaa36f7e78a8e15594faf5738da521e09c750699-rootfs.mount: Deactivated successfully. machine # [ 508.907303] k3s[903]: I0930 09:33:17.258039 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f96b64d7-2859-45c8-9603-ef415bb585a9-tmp\") pod \"nix-grpc-farm-lb-5877cc8b4f-bh8gh\" (UID: \"f96b64d7-2859-45c8-9603-ef415bb585a9\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-bh8gh" machine # [ 508.907614] k3s[903]: I0930 09:33:17.258088 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/f96b64d7-2859-45c8-9603-ef415bb585a9-tls-lb\") pod \"nix-grpc-farm-lb-5877cc8b4f-bh8gh\" (UID: \"f96b64d7-2859-45c8-9603-ef415bb585a9\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-bh8gh" machine # [ 508.908497] k3s[903]: I0930 09:33:17.258130 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f96b64d7-2859-45c8-9603-ef415bb585a9-config\") pod \"nix-grpc-farm-lb-5877cc8b4f-bh8gh\" (UID: \"f96b64d7-2859-45c8-9603-ef415bb585a9\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-bh8gh" machine # [ 508.909141] k3s[903]: I0930 09:33:17.258159 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/f96b64d7-2859-45c8-9603-ef415bb585a9-tls-ca\") pod \"nix-grpc-farm-lb-5877cc8b4f-bh8gh\" (UID: \"f96b64d7-2859-45c8-9603-ef415bb585a9\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-bh8gh" machine # [ 508.924680] systemd[1]: cri-containerd-89bf36f360ca8c897693787dcf339d6928d0784639e926f8a17f1fcc66b6ce7a.scope: Deactivated successfully. machine # [ 508.958306] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-89bf36f360ca8c897693787dcf339d6928d0784639e926f8a17f1fcc66b6ce7a-rootfs.mount: Deactivated successfully. machine # [ 508.986525] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-89bf36f360ca8c897693787dcf339d6928d0784639e926f8a17f1fcc66b6ce7a-shm.mount: Deactivated successfully. machine # [ 509.179750] cni0: port 4(vethcd97be52) entered disabled state machine # [ 509.028855] dhcpcd[690]: vethcd97be52: carrier lost machine # [ 509.183990] vethcd97be52 (unregistering): left allmulticast mode machine # [ 509.185626] vethcd97be52 (unregistering): left promiscuous mode machine # [ 509.187253] cni0: port 4(vethcd97be52) entered disabled state machine # [ 509.058271] dhcpcd[690]: vethcd97be52: deleting address fe80::61:6dff:fe87:e895 machine # [ 509.061681] dhcpcd[690]: vethcd97be52: deleting route to 169.254.0.0/16 machine # [ 509.108791] k3s[903]: I0930 09:33:17.459450 903 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/102fc9c0-d6fa-4ec8-8690-d0f409c9bcc6-tls-ca\" (UniqueName: \"kubernetes.io/secret/102fc9c0-d6fa-4ec8-8690-d0f409c9bcc6-tls-ca\") pod \"102fc9c0-d6fa-4ec8-8690-d0f409c9bcc6\" (UID: \"102fc9c0-d6fa-4ec8-8690-d0f409c9bcc6\") " machine # [ 509.109068] k3s[903]: I0930 09:33:17.459521 903 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/102fc9c0-d6fa-4ec8-8690-d0f409c9bcc6-tmp\" (UniqueName: \"kubernetes.io/empty-dir/102fc9c0-d6fa-4ec8-8690-d0f409c9bcc6-tmp\") pod \"102fc9c0-d6fa-4ec8-8690-d0f409c9bcc6\" (UID: \"102fc9c0-d6fa-4ec8-8690-d0f409c9bcc6\") " machine # [ 509.109513] k3s[903]: I0930 09:33:17.459559 903 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/102fc9c0-d6fa-4ec8-8690-d0f409c9bcc6-config\" (UniqueName: \"kubernetes.io/configmap/102fc9c0-d6fa-4ec8-8690-d0f409c9bcc6-config\") pod \"102fc9c0-d6fa-4ec8-8690-d0f409c9bcc6\" (UID: \"102fc9c0-d6fa-4ec8-8690-d0f409c9bcc6\") " machine # [ 509.110022] k3s[903]: I0930 09:33:17.459592 903 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/102fc9c0-d6fa-4ec8-8690-d0f409c9bcc6-tls-lb\" (UniqueName: \"kubernetes.io/secret/102fc9c0-d6fa-4ec8-8690-d0f409c9bcc6-tls-lb\") pod \"102fc9c0-d6fa-4ec8-8690-d0f409c9bcc6\" (UID: \"102fc9c0-d6fa-4ec8-8690-d0f409c9bcc6\") " machine # [ 509.128877] k3s[903]: I0930 09:33:17.479604 903 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/102fc9c0-d6fa-4ec8-8690-d0f409c9bcc6-tmp" pod "102fc9c0-d6fa-4ec8-8690-d0f409c9bcc6" (UID: "102fc9c0-d6fa-4ec8-8690-d0f409c9bcc6"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 509.134411] k3s[903]: I0930 09:33:17.485173 903 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/102fc9c0-d6fa-4ec8-8690-d0f409c9bcc6-tls-lb" pod "102fc9c0-d6fa-4ec8-8690-d0f409c9bcc6" (UID: "102fc9c0-d6fa-4ec8-8690-d0f409c9bcc6"). InnerVolumeSpecName "tls-lb". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 509.135345] k3s[903]: I0930 09:33:17.485235 903 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/102fc9c0-d6fa-4ec8-8690-d0f409c9bcc6-tls-ca" pod "102fc9c0-d6fa-4ec8-8690-d0f409c9bcc6" (UID: "102fc9c0-d6fa-4ec8-8690-d0f409c9bcc6"). InnerVolumeSpecName "tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 509.147327] k3s[903]: I0930 09:33:17.498062 903 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/102fc9c0-d6fa-4ec8-8690-d0f409c9bcc6-config" pod "102fc9c0-d6fa-4ec8-8690-d0f409c9bcc6" (UID: "102fc9c0-d6fa-4ec8-8690-d0f409c9bcc6"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 509.157485] dhcpcd[690]: vethcd97be52: removing interface machine # [ 509.185399] (udev-worker)[987[ 509.337548] cni0: port 1(veth78ce9ad8) entered blocking state machine # 5]: Network interface NamePolicy= disabled on kernel command line. machine # [ 509.339558] cni0: port 1(veth78ce9ad8) entered disabled state machine # [ 509.340838] veth78ce9ad8: entered allmulticast mode machine # [ 509.342011] veth78ce9ad8: entered promiscuous mode machine # [ 509.352420] cni0: port 1(veth78ce9ad8) entered blocking state machine # [ 509.353626] cni0: port 1(veth78ce9ad8) entered forwarding state machine # [ 509.209950] k3s[903]: I0930 09:33:17.560739 903 reconciler_common.go:299] "Volume detached for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/102fc9c0-d6fa-4ec8-8690-d0f409c9bcc6-tls-ca\") on node \"machine\" DevicePath \"\"" machine # [ 509.210597] k3s[903]: I0930 09:33:17.560775 903 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/102fc9c0-d6fa-4ec8-8690-d0f409c9bcc6-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 509.211319] k3s[903]: I0930 09:33:17.560790 903 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/102fc9c0-d6fa-4ec8-8690-d0f409c9bcc6-config\") on node \"machine\" DevicePath \"\"" machine # [ 509.212357] k3s[903]: I0930 09:33:17.560803 903 reconciler_common.go:299] "Volume detached for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/102fc9c0-d6fa-4ec8-8690-d0f409c9bcc6-tls-lb\") on node \"machine\" DevicePath \"\"" machine # [ 509.243948] dhcpcd[690]: veth78ce9ad8: waiting for carrier machine # [ 509.244914] dhcpcd[690]: veth78ce9ad8: carrier acquired machine # [ 509.251574] dhcpcd[690]: veth78ce9ad8: IAID 42:8b:63:e5 machine # [ 509.251811] dhcpcd[690]: veth78ce9ad8: adding address fe80::14f3:42ff:fe8b:63e5 machine # [ 509.265027] dhcpcd[690]: veth78ce9ad8: soliciting a DHCP lease machine # [ 509.310575] systemd[1]: Started libcontainer container 23f7bd0cbdb5e70e68b3359f6f7eebb6ed9a1af9eafba5c1d6863d488990eda5. machine # [ 509.444483] systemd[1]: Started libcontainer container a266484bcc5c5265eca82a639b1ccaee46347a394136585877cd8b91b6d09720. machine # [ 509.517741] k3s[903]: I0930 09:33:17.868271 903 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-5877cc8b4f-bh8gh" podStartSLOduration=0.868243113 podStartE2EDuration="868.243113ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-30 09:33:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 09:33:17.867054135 +0000 UTC m=+491.951626199" watchObservedRunningTime="2026-09-30 09:33:17.868243113 +0000 UTC m=+491.952814898" machine # [ 509.586687] k3s[903]: I0930 09:33:17.937381 903 scope.go:122] "RemoveContainer" containerID="3d281720b74b25af47212a78eaa36f7e78a8e15594faf5738da521e09c750699" machine # [ 509.589305] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod102fc9c0_d6fa_4ec8_8690_d0f409c9bcc6.slice. machine # [ 509.591722] systemd[1]: kubepods-besteffort-pod102fc9c0_d6fa_4ec8_8690_d0f409c9bcc6.slice: Consumed 4.475s CPU time over 7min 53.807s wall clock time, 44.5M memory peak, 22M read from disk, 601.8K incoming IP traffic, 737.5K outgoing IP traffic. machine # [ 509.600964] k3s[903]: I0930 09:33:17.951711 903 scope.go:122] "RemoveContainer" containerID="3d281720b74b25af47212a78eaa36f7e78a8e15594faf5738da521e09c750699" machine # [ 509.602973] k3s[903]: E0930 09:33:17.952479 903 remote_runtime.go:569] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"3d281720b74b25af47212a78eaa36f7e78a8e15594faf5738da521e09c750699\": not found" containerID="3d281720b74b25af47212a78eaa36f7e78a8e15594faf5738da521e09c750699" machine # [ 509.606979] k3s[903]: I0930 09:33:17.952527 903 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"3d281720b74b25af47212a78eaa36f7e78a8e15594faf5738da521e09c750699"} err="failed to get container status \"3d281720b74b25af47212a78eaa36f7e78a8e15594faf5738da521e09c750699\": rpc error: code = NotFound desc = an error occurred when try to find container \"3d281720b74b25af47212a78eaa36f7e78a8e15594faf5738da521e09c750699\": not found" machine # [ 509.623435] k3s[903]: E0930 09:33:17.974229 903 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-lb-5877cc8b4f\" failed with read version: 804 is not as new as written version: 818 for group resource replicasets.apps" logger="UnhandledError" machine # [ 509.885984] systemd[1]: var-lib-kubelet-pods-102fc9c0\x2dd6fa\x2d4ec8\x2d8690\x2dd0f409c9bcc6-volume\x2dsubpaths-config-envoy-2.mount: Deactivated successfully. machine # [ 509.888057] systemd[1]: var-lib-kubelet-pods-102fc9c0\x2dd6fa\x2d4ec8\x2d8690\x2dd0f409c9bcc6-volume\x2dsubpaths-config-envoy-1.mount: Deactivated successfully. machine # [ 509.889972] systemd[1]: var-lib-kubelet-pods-102fc9c0\x2dd6fa\x2d4ec8\x2d8690\x2dd0f409c9bcc6-volume\x2dsubpaths-config-envoy-0.mount: Deactivated successfully. machine # [ 509.891870] systemd[1]: run-netns-cni\x2d12215d87\x2daa4f\x2d860f\x2d26c1\x2dc0be0b078cac.mount: Deactivated successfully. machine # [ 509.893485] systemd[1]: var-lib-kubelet-pods-102fc9c0\x2dd6fa\x2d4ec8\x2d8690\x2dd0f409c9bcc6-volumes-kubernetes.io\x7esecret-tls\x2dlb.mount: Deactivated successfully. machine # [ 509.895521] systemd[1]: var-lib-kubelet-pods-102fc9c0\x2dd6fa\x2d4ec8\x2d8690\x2dd0f409c9bcc6-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 509.897510] systemd[1]: var-lib-kubelet-pods-102fc9c0\x2dd6fa\x2d4ec8\x2d8690\x2dd0f409c9bcc6-volumes-kubernetes.io\x7esecret-tls\x2dca.mount: Deactivated successfully. machine # [ 511.316926] nix[9673]: scheduler at 127.0.0.1:30051: failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:30051: tcp handshaker shutdown, reconnecting machine # [ 511.365799] dhcpcd[690]: veth78ce9ad8: soliciting an IPv6 router machine # [ 511.586755] k3s[903]: I0930 09:33:19.936696 903 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="102fc9c0-d6fa-4ec8-8690-d0f409c9bcc6" path="/var/lib/kubelet/pods/102fc9c0-d6fa-4ec8-8690-d0f409c9bcc6/volumes" machine # [ 512.359922] nix[9673]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 512.363460] nix[9673]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-g9qwc: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 514.266556] dhcpcd[690]: veth78ce9ad8: probing for an IPv4LL address machine # [ 519.793093] dhcpcd[690]: veth78ce9ad8: using IPv4LL address 169.254.36.73 machine # [ 519.795843] dhcpcd[690]: veth78ce9ad8: adding route to 169.254.0.0/16 machine # [ 523.370228] dhcpcd[690]: veth78ce9ad8: no IPv6 Routers available machine # [ 556.896777] niks3-server[1197]: 2026/09/30 09:34:05 INFO Received push request method=POST path=/api/pushes machine # [ 556.915295] niks3-server[1197]: 2026/09/30 09:34:05 INFO Received sign narinfos request method=POST path=/api/pushes/28/sign machine # [ 556.919112] niks3-server[1197]: 2026/09/30 09:34:05 INFO Signed narinfos id=28 count=1 machine # [ 556.921065] niks3-server[1197]: 2026/09/30 09:34:05 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.ls machine # [ 556.922318] niks3-server[1197]: 2026/09/30 09:34:05 INFO Registered completed upload object_key=log/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 556.932664] niks3-server[1197]: 2026/09/30 09:34:05 INFO Received complete push request method=POST path=/api/pushes/28/complete machine # [ 556.937181] niks3-server[1197]: 2026/09/30 09:34:05 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.narinfo machine # [ 556.974297] systemd[1]: vialb.service: Deactivated successfully. machine # [ 556.975721] systemd[1]: vialb.service: Consumed 213ms CPU time over 49.484s wall clock time, 44.2M memory peak, 4K written to disk, 8.5K incoming IP traffic, 17.3K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active vialb, in 48.64 seconds) machine: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; }, in 0.03 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 0.20 seconds) (finished: subtest: losing the balancer mid-build: the client reconnects and the build succeeds, in 50.20 seconds) subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes machine: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 machine # Running as unit: slow.service; invocation ID: 6f022d20c8d6467aac64f8ea3edd99bf machine # [ 557.685351] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1. machine: (finished: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1, in 0.02 seconds) machine # [ 557.804927] nix[10657]: don't know how to build these paths: machine # [ 557.805515] nix[10657]: /nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 557.823739] nix[10657]: copying 1 paths to '127.0.0.1:30051'... machine # [ 557.824711] nix[10657]: copying path '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' to '127.0.0.1:30051'... machine # [ 557.861503] niks3-server[1197]: 2026/09/30 09:34:06 INFO Received push request method=POST path=/api/pushes machine # [ 557.872456] niks3-server[1197]: 2026/09/30 09:34:06 INFO Received sign narinfos request method=POST path=/api/pushes/29/sign machine # [ 557.873428] niks3-server[1197]: 2026/09/30 09:34:06 INFO Signed narinfos id=29 count=1 machine # [ 557.875941] niks3-server[1197]: 2026/09/30 09:34:06 INFO Registered completed upload object_key=nar/0wl2i9xpw0gwrx1xqdgx9ka4n503ky9qhl20pdrdlphn8d6lcx0i.nar.zst machine # [ 557.878154] niks3-server[1197]: 2026/09/30 09:34:06 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.ls machine # [ 557.880157] niks3-server[1197]: 2026/09/30 09:34:06 INFO Received complete push request method=POST path=/api/pushes/29/complete machine # [ 557.884569] niks3-server[1197]: 2026/09/30 09:34:06 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.narinfo machine # [ 557.893100] nix[10657]: building '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' on 127.0.0.1:30051... machine # [ 557.895097] nix[10657]: slow-s1> machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-5x7gj: building zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 557.904519] k3s[903]: E0930 09:34:06.255031 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51754: use of closed network connection" machine # command terminated with exit code 1 machine # [ 558.069581] k3s[903]: E0930 09:34:06.420332 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51758: use of closed network connection" machine # command terminated with exit code 1 machine # [ 559.315894] k3s[903]: E0930 09:34:07.666359 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51764: use of closed network connection" machine # command terminated with exit code 1 machine # [ 559.482384] k3s[903]: E0930 09:34:07.833020 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51774: use of closed network connection" machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 560.752118] k3s[903]: E0930 09:34:09.102028 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51780: use of closed network connection" machine # [ 560.955652] k3s[903]: E0930 09:34:09.306406 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51790: use of closed network connection" machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 562.247883] k3s[903]: E0930 09:34:10.598068 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51792: use of closed network connection" machine # command terminated with exit code 1 machine # [ 562.423226] k3s[903]: E0930 09:34:10.773585 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51806: use of closed network connection" machine # command terminated with exit code 1 machine # [ 563.713202] k3s[903]: E0930 09:34:12.063306 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:55364: use of closed network connection" machine # [ 563.875600] k3s[903]: E0930 09:34:12.226350 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:55370: use of closed network connection" machine # command terminated with exit code 1 machine # [ 565.152530] k3s[903]: E0930 09:34:13.502740 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:55384: use of closed network connection" machine # command terminated with exit code 1 machine # [ 565.347861] k3s[903]: E0930 09:34:13.698611 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:55390: use of closed network connection" machine # command terminated with exit code 1 machine # [ 566.663034] k3s[903]: E0930 09:34:15.013461 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:55396: use of closed network connection" machine # command terminated with exit code 1 machine # [ 566.854868] k3s[903]: E0930 09:34:15.205574 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:55406: use of closed network connection" machine # command terminated with exit code 1 machine # [ 568.134204] k3s[903]: E0930 09:34:16.484618 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:55420: use of closed network connection" machine # command terminated with exit code 1 machine # [ 568.330495] k3s[903]: E0930 09:34:16.681232 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:55428: use of closed network connection" machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 569.613969] k3s[903]: E0930 09:34:17.964103 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:55434: use of closed network connection" machine # [ 569.851397] k3s[903]: E0930 09:34:18.202125 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:55450: use of closed network connection" machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 571.148651] k3s[903]: E0930 09:34:19.498758 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:55460: use of closed network connection" machine # [ 571.352369] k3s[903]: E0930 09:34:19.703067 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:55462: use of closed network connection" machine # command terminated with exit code 1 machine # [ 572.626557] k3s[903]: E0930 09:34:20.976816 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:55464: use of closed network connection" machine # command terminated with exit code 1 machine # [ 572.816826] k3s[903]: E0930 09:34:21.167404 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:55480: use of closed network connection" machine # command terminated with exit code 1 machine # [ 574.072752] k3s[903]: E0930 09:34:22.423232 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51668: use of closed network connection" machine # command terminated with exit code 1 machine # [ 574.250800] k3s[903]: E0930 09:34:22.601533 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51672: use of closed network connection" machine # command terminated with exit code 1 machine # [ 575.496600] k3s[903]: E0930 09:34:23.846995 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51674: use of closed network connection" machine # command terminated with exit code 1 machine # [ 575.673381] k3s[903]: E0930 09:34:24.024136 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51688: use of closed network connection" machine # command terminated with exit code 1 machine # [ 576.959575] k3s[903]: E0930 09:34:25.310041 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51694: use of closed network connection" machine # command terminated with exit code 1 machine # [ 577.181687] k3s[903]: E0930 09:34:25.532384 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51700: use of closed network connection" machine # command terminated with exit code 1 machine # [ 578.500572] k3s[903]: E0930 09:34:26.850524 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51710: use of closed network connection" machine # command terminated with exit code 1 machine # [ 578.710385] k3s[903]: E0930 09:34:27.061106 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51722: use of closed network connection" machine # command terminated with exit code 1 machine # [ 580.010057] k3s[903]: E0930 09:34:28.360188 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51730: use of closed network connection" machine # command terminated with exit code 1 machine # [ 580.214268] k3s[903]: E0930 09:34:28.564974 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51732: use of closed network connection" machine # command terminated with exit code 1 machine # [ 581.456835] k3s[903]: E0930 09:34:29.807281 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51736: use of closed network connection" machine # command terminated with exit code 1 machine # [ 581.645049] k3s[903]: E0930 09:34:29.995767 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51750: use of closed network connection" machine # command terminated with exit code 1 machine # [ 582.902785] k3s[903]: E0930 09:34:31.252838 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51754: use of closed network connection" machine: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-5x7gj --wait=false machine: (finished: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-5x7gj --wait=false, in 0.14 seconds) machine: must succeed: sleep 5.0 machine # [ 583.265866] systemd[1]: cri-containerd-7fa20ef41f152532d9b7e9ea8552648eaeb40cfd64269c8ab9350625e7be8370.scope: Deactivated successfully. machine # [ 583.266273] systemd[1]: cri-containerd-7fa20ef41f152532d9b7e9ea8552648eaeb40cfd64269c8ab9350625e7be8370.scope: Consumed 594ms CPU time over 8min 57.933s wall clock time, 13.9M memory peak, 5.9M read from disk. machine # [ 583.294905] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-7fa20ef41f152532d9b7e9ea8552648eaeb40cfd64269c8ab9350625e7be8370-rootfs.mount: Deactivated successfully. machine # [ 583.756028] k3s[903]: E0930 09:34:32.106760 903 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7\" failed with read version: 836 is not as new as written version: 863 for group resource replicasets.apps" logger="UnhandledError" machine # [ 583.773513] systemd[1]: Created slice libcontainer container kubepods-besteffort-podff4d143b_869b_4f3d_9aad_564a3b27085c.slice. machine # [ 583.775302] k3s[903]: E0930 09:34:32.125198 903 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7\" failed with read version: 863 is not as new as written version: 865 for group resource replicasets.apps" logger="UnhandledError" machine # [ 583.881421] k3s[903]: I0930 09:34:32.232180 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/ff4d143b-869b-4f3d-9aad-564a3b27085c-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-7pndl\" (UID: \"ff4d143b-869b-4f3d-9aad-564a3b27085c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-7pndl" machine # [ 583.881794] k3s[903]: I0930 09:34:32.232221 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/ff4d143b-869b-4f3d-9aad-564a3b27085c-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-7pndl\" (UID: \"ff4d143b-869b-4f3d-9aad-564a3b27085c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-7pndl" machine # [ 583.882446] k3s[903]: I0930 09:34:32.232253 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmq8j\" (UniqueName: \"kubernetes.io/projected/ff4d143b-869b-4f3d-9aad-564a3b27085c-kube-api-access-dmq8j\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-7pndl\" (UID: \"ff4d143b-869b-4f3d-9aad-564a3b27085c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-7pndl" machine # [ 583.882958] k3s[903]: I0930 09:34:32.232280 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/ff4d143b-869b-4f3d-9aad-564a3b27085c-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-7pndl\" (UID: \"ff4d143b-869b-4f3d-9aad-564a3b27085c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-7pndl" machine # [ 583.883858] k3s[903]: I0930 09:34:32.232310 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/ff4d143b-869b-4f3d-9aad-564a3b27085c-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-7pndl\" (UID: \"ff4d143b-869b-4f3d-9aad-564a3b27085c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-7pndl" machine # [ 583.884787] k3s[903]: I0930 09:34:32.232341 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/ff4d143b-869b-4f3d-9aad-564a3b27085c-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-7pndl\" (UID: \"ff4d143b-869b-4f3d-9aad-564a3b27085c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-7pndl" machine # [ 583.910824] k3s[903]: I0930 09:34:32.261035 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/ff4d143b-869b-4f3d-9aad-564a3b27085c-build\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-7pndl\" (UID: \"ff4d143b-869b-4f3d-9aad-564a3b27085c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-7pndl" machine # [ 583.911522] k3s[903]: I0930 09:34:32.261074 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/ff4d143b-869b-4f3d-9aad-564a3b27085c-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-7pndl\" (UID: \"ff4d143b-869b-4f3d-9aad-564a3b27085c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-7pndl" machine # [ 583.912451] k3s[903]: I0930 09:34:32.261152 903 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ff4d143b-869b-4f3d-9aad-564a3b27085c-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-7pndl\" (UID: \"ff4d143b-869b-4f3d-9aad-564a3b27085c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-7pndl" machine # [ 584.310313] cni0: port 4(vethd488b117) entered blocking state machine # [ 584.312525] cni0: port 4(vethd488b117) entered disabled state machine # [ 584.315241] vethd488b117: entered allmulticast mode machine # [ 584.317360] vethd488b117: entered promiscuous mode machine # [ 584.335217] cni0: port 4(vethd488b117) entered blocking state machine # [ 584.337145] cni0: port 4(vethd488b117) entered forwarding state machine # [ 584.221829] (udev-worker)[12286]: Network interface NamePolicy= disabled on kernel command line. machine # [ 584.246344] dhcpcd[690]: vethd488b117: IAID 95:aa:af:04 machine # [ 584.246639] dhcpcd[690]: vethd488b117: adding address fe80::5c81:95ff:feaa:af04 machine # [ 584.282494] systemd[1]: Started libcontainer container c5b186e969ab5c55d5e6092738677112a35d3775fa5db6d9e5274772c6a4c79c. machine # [ 584.464082] systemd[1]: tmp-ovl\x2didmapped1928315887.mount: Deactivated successfully. machine # [ 584.482339] systemd[1]: Started libcontainer container ebc80a8d843df300890c55c59f42d23e25027973627fbadf65da0b76e67b9e4b. machine # [ 584.560227] dhcpcd[690]: vethd488b117: soliciting a DHCP lease machine # [ 586.284834] systemd[1]: cri-containerd-ebc80a8d843df300890c55c59f42d23e25027973627fbadf65da0b76e67b9e4b.scope: Deactivated successfully. machine # [ 586.291431] systemd[1]: cri-containerd-ebc80a8d843df300890c55c59f42d23e25027973627fbadf65da0b76e67b9e4b.scope: Consumed 822ms CPU time over 1.801s wall clock time, 473.9M memory peak, 181M read from disk, 160.6M written to disk. machine # [ 586.337879] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-ebc80a8d843df300890c55c59f42d23e25027973627fbadf65da0b76e67b9e4b-rootfs.mount: Deactivated successfully. machine # [ 586.367415] dhcpcd[690]: vethd488b117: soliciting an IPv6 router machine # [ 587.092196] systemd[1]: tmp-ovl\x2didmapped2139563389.mount: Deactivated successfully. machine # [ 587.113512] systemd[1]: Started libcontainer container 16da4ea99c2d301ff72d2e35de65c717ee7fd59447ffdc9b459bc7489e80cfe0. machine # [ 587.314589] systemd[1]: Started libcontainer container 4029a0ce9f978d216d525b4b2ea23cf12680e39199c6f8dac071429aca723869. machine # [ 587.511652] systemd[1]: tmp-ovl\x2didmapped683101382.mount: Deactivated successfully. machine # [ 587.528372] systemd[1]: Started libcontainer container 50b7829982a4d2531ef0b9390f78c319a1f5e9fd239a186afc6c9caa9fdb3716. machine: (finished: must succeed: sleep 5.0, in 5.03 seconds) machine # [ 588.493780] k3s[903]: E0930 09:34:36.844187 903 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:60644: use of closed network connection" machine: waiting for success: ! systemctl is-active slow machine # [ 589.127165] k3s[903]: I0930 09:34:37.477126 903 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-7pndl" podStartSLOduration=3.703907693 podStartE2EDuration="5.477076908s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.773169215s" isStatefulPod=false podCreationTimestamp="2026-09-30 09:34:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 09:34:35.950151838 +0000 UTC m=+570.034723902" watchObservedRunningTime="2026-09-30 09:34:37.477076908 +0000 UTC m=+571.561653442" machine # [ 589.561824] dhcpcd[690]: vethd488b117: probing for an IPv4LL address machine # [ 594.218128] dhcpcd[690]: vethd488b117: using IPv4LL address 169.254.249.47 machine # [ 594.221367] dhcpcd[690]: vethd488b117: adding route to 169.254.0.0/16 machine # [ 598.371300] dhcpcd[690]: vethd488b117: no IPv6 Routers available machine # [ 602.833131] niks3-server[1197]: 2026/09/30 09:34:51 INFO Received push request method=POST path=/api/pushes machine # [ 602.855503] niks3-server[1197]: 2026/09/30 09:34:51 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.ls machine # [ 602.857152] niks3-server[1197]: 2026/09/30 09:34:51 INFO Received sign narinfos request method=POST path=/api/pushes/30/sign machine # [ 602.859225] niks3-server[1197]: 2026/09/30 09:34:51 INFO Signed narinfos id=30 count=1 machine # [ 602.865826] niks3-server[1197]: 2026/09/30 09:34:51 INFO Registered completed upload object_key=log/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 602.871697] niks3-server[1197]: 2026/09/30 09:34:51 INFO Received complete push request method=POST path=/api/pushes/30/complete machine # [ 602.881552] niks3-server[1197]: 2026/09/30 09:34:51 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo machine # [ 603.538971] systemd[1]: cri-containerd-8b85e4d94f25023bf1fe322eab3729d308826f0461db630d6e653a14a5d0dd66.scope: Deactivated successfully. machine # [ 603.540946] systemd[1]: cri-containerd-8b85e4d94f25023bf1fe322eab3729d308826f0461db630d6e653a14a5d0dd66.scope: Consumed 3.219s CPU time over 9min 18.451s wall clock time, 71.1M memory peak, 33.7M read from disk, 8K written to disk, 275.7K incoming IP traffic, 354.7K outgoing IP traffic. machine # [ 603.620586] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-8b85e4d94f25023bf1fe322eab3729d308826f0461db630d6e653a14a5d0dd66-rootfs.mount: Deactivated successfully. machine # [ 603.932502] systemd[1]: slow.service: Deactivated successfully. machine # [ 603.935080] systemd[1]: slow.service: Consumed 159ms CPU time over 46.247s wall clock time, 38.3M memory peak, 4K written to disk, 5.3K incoming IP traffic, 11.5K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active slow, in 15.60 seconds) machine: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; }, in 0.04 seconds) machine: must fail: journalctl -u slow | grep -q 'asking the scheduler again' machine: (finished: must fail: journalctl -u slow | grep -q 'asking the scheduler again', in 0.03 seconds) machine: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath, in 0.16 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null, in 0.04 seconds) (finished: subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes, in 46.71 seconds) (finished: run the VM test script, in 605.38 seconds) test script finished in 605.42s cleanup kill QemuMachine (pid 45) machine # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) machine # [2026-09-30T09:34:53Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-09-30T09:34:53Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-09-30T09:34:53Z INFO virtiofsd] Client disconnected, shutting down (finished: cleanup, in 1.17 seconds) additionally exposed symbols: machine, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh