tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 1200.0 seconds run the VM test script machine: waiting for unit k3s.service machine: waiting for the VM to finish booting machine: starting vm machine # Disk image does not exist, creating the virtualisation disk image... machine: QEMU running (pid 45) machine # Formatting '/build/vm-state-machine/tmp.1jymGZPnli', fmt=raw size=17179869184 machine # mke2fs 1.47.4 (6-Mar-2025) machine # Discarding device blocks: 0/4194304 done machine # Creating filesystem with 4194304 4k blocks and 1048576 inodes machine # Filesystem UUID: 0f5c4563-6dad-4166-a723-bc27e23a4d5b machine # Superblock backups stored on blocks: machine # 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208, machine # 4096000 machine # machine # Allocating group tables: 0/128 done machine # Writing inode tables: 0/128 done machine # Creating journal (32768 blocks): done machine # Writing superblocks and filesystem accounting information: 0/128 done machine # machine # Virtualisation disk image created. machine # Starting virtiofs daemons... machine # [2026-09-30T09:25:32Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-30T09:25:32Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-30T09:25:32Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-30T09:25:32Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-30T09:25:32Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-30T09:25:32Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-30T09:25:32Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-30T09:25:32Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-30T09:25:32Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-30T09:25:32Z INFO virtiofsd] Client connected, servicing requests machine # [2026-09-30T09:25:32Z INFO virtiofsd] Client connected, servicing requests machine # [2026-09-30T09:25:32Z INFO virtiofsd] Client connected, servicing requests machine # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) machine # machine # machine # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+7EFCC730+7EF2C730 CA00 machine # Press Ctrl-B to configure iPXE (PCI 00:02.0)... machine # machine # machine # machine # machine # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 7EFCC730 7EF2C730 CB00 machine # Press Ctrl-B to configure iPXE (PCI 00:05.0)... machine # machine # machine # Booting from ROM... machine # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.53 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 21 13:06:06 UTC 2026 machine # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/p2q3gdri518935bkr6vg9w5dxjklcrss-nixos-system-machine-test/init regInfo=/nix/.ro-store/8jy35ymiymxhvchs54zqnjkixvmqig4i-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.000000] BIOS-provided physical RAM map: machine # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007ffd7fff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000007ffd8000-0x000000007fffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000017fffffff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved machine # [ 0.000000] NX (Execute Disable) protection: active machine # [ 0.000000] APIC: Static calls initialized machine # [ 0.000000] SMBIOS 2.8 present. machine # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 machine # [ 0.000000] DMI: Memory slots populated: 1/1 machine # [ 0.000000] Hypervisor detected: KVM machine # [ 0.000000] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 machine # [ 0.000000] kvm-clock: using sched offset of 468059472 cycles machine # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns machine # [ 0.000005] tsc: Detected 2400.012 MHz processor machine # [ 0.000812] last_pfn = 0x180000 max_arch_pfn = 0x10000000000 machine # [ 0.000840] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs machine # [ 0.000843] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT machine # [ 0.000883] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.002740] found SMP MP-table at [mem 0x000f5450-0x000f545f] machine # [ 0.002751] Using GB pages for direct mapping machine # [ 0.002898] RAMDISK: [mem 0x7e364000-0x7ffcffff] machine # [ 0.002907] ACPI: Early table checksum verification disabled machine # [ 0.002909] ACPI: RSDP 0x00000000000F5250 000014 (v00 BOCHS ) machine # [ 0.002913] ACPI: RSDT 0x000000007FFE2539 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002918] ACPI: FACP 0x000000007FFE2319 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002924] ACPI: DSDT 0x000000007FFE0040 0022D9 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002926] ACPI: FACS 0x000000007FFE0000 000040 machine # [ 0.002928] ACPI: APIC 0x000000007FFE240D 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002929] ACPI: HPET 0x000000007FFE249D 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002931] ACPI: MCFG 0x000000007FFE24D5 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002933] ACPI: WAET 0x000000007FFE2511 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002934] ACPI: Reserving FACP table memory at [mem 0x7ffe2319-0x7ffe240c] machine # [ 0.002935] ACPI: Reserving DSDT table memory at [mem 0x7ffe0040-0x7ffe2318] machine # [ 0.002936] ACPI: Reserving FACS table memory at [mem 0x7ffe0000-0x7ffe003f] machine # [ 0.002936] ACPI: Reserving APIC table memory at [mem 0x7ffe240d-0x7ffe249c] machine # [ 0.002937] ACPI: Reserving HPET table memory at [mem 0x7ffe249d-0x7ffe24d4] machine # [ 0.002937] ACPI: Reserving MCFG table memory at [mem 0x7ffe24d5-0x7ffe2510] machine # [ 0.002938] ACPI: Reserving WAET table memory at [mem 0x7ffe2511-0x7ffe2538] machine # [ 0.003159] No NUMA configuration found machine # [ 0.003160] Faking a node at [mem 0x0000000000000000-0x000000017fffffff] machine # [ 0.003162] NODE_DATA(0) allocated [mem 0x17fff8780-0x17fffdcff] machine # [ 0.005336] Zone ranges: machine # [ 0.005336] DMA [mem 0x0000000000001000-0x0000000000ffffff] machine # [ 0.005338] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] machine # [ 0.005339] Normal [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005340] Device empty machine # [ 0.005340] Movable zone start for each node machine # [ 0.005341] Early memory node ranges machine # [ 0.005341] node 0: [mem 0x0000000000001000-0x000000000009efff] machine # [ 0.005342] node 0: [mem 0x0000000000100000-0x000000007ffd7fff] machine # [ 0.005343] node 0: [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005344] Initmem setup node 0 [mem 0x0000000000001000-0x000000017fffffff] machine # [ 0.005363] On node 0, zone DMA: 1 pages in unavailable ranges machine # [ 0.005623] On node 0, zone DMA: 97 pages in unavailable ranges machine # [ 0.074311] On node 0, zone Normal: 40 pages in unavailable ranges machine # [ 0.074797] ACPI: PM-Timer IO Port: 0x608 machine # [ 0.074813] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) machine # [ 0.074849] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 machine # [ 0.074852] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) machine # [ 0.074853] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) machine # [ 0.074855] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) machine # [ 0.074856] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) machine # [ 0.074856] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) machine # [ 0.074859] ACPI: Using ACPI (MADT) for SMP configuration information machine # [ 0.074860] ACPI: HPET id: 0x8086a201 base: 0xfed00000 machine # [ 0.074866] TSC deadline timer available machine # [ 0.074870] CPU topo: Max. logical packages: 1 machine # [ 0.074871] CPU topo: Max. logical dies: 1 machine # [ 0.074871] CPU topo: Max. dies per package: 1 machine # [ 0.074875] CPU topo: Max. threads per core: 1 machine # [ 0.074876] CPU topo: Num. cores per package: 4 machine # [ 0.074876] CPU topo: Num. threads per package: 4 machine # [ 0.074876] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs machine # [ 0.074902] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() machine # [ 0.074918] kvm-guest: KVM setup pv remote TLB flush machine # [ 0.074921] kvm-guest: setup PV sched yield machine # [ 0.074931] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] machine # [ 0.074933] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] machine # [ 0.074933] PM: hibernation: Registered nosave memory: [mem 0x7ffd8000-0xffffffff] machine # [ 0.074935] [mem 0xc0000000-0xfed1bfff] available for PCI devices machine # [ 0.074936] Booting paravirtualized kernel on KVM machine # [ 0.074940] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns machine # [ 0.079446] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 machine # [ 0.081544] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288 machine # [ 0.081590] kvm-guest: PV spinlocks enabled machine # [ 0.081591] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) machine # [ 0.081594] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/p2q3gdri518935bkr6vg9w5dxjklcrss-nixos-system-machine-test/init regInfo=/nix/.ro-store/8jy35ymiymxhvchs54zqnjkixvmqig4i-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.081691] Unknown kernel command line parameters "regInfo=/nix/.ro-store/8jy35ymiymxhvchs54zqnjkixvmqig4i-closure-info/registration", will be passed to user space. machine # [ 0.081704] random: crng init done machine # [ 0.081705] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes machine # [ 0.085998] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) machine # [ 0.088081] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) machine # [ 0.088151] software IO TLB: area num 4. machine # [ 0.159830] Fallback order for Node 0: 0 machine # [ 0.159838] Built 1 zonelists, mobility grouping on. Total pages: 1048438 machine # [ 0.159840] Policy zone: Normal machine # [ 0.162551] mem auto-init: stack:all(zero), heap alloc:on, heap free:off machine # [ 0.169120] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 machine # [ 0.177978] allocated 8388608 bytes of page_ext machine # [ 0.187774] ftrace: allocating 48798 entries in 192 pages machine # [ 0.187776] ftrace: allocated 192 pages with 2 groups machine # [ 0.188641] Dynamic Preempt: lazy machine # [ 0.188831] rcu: Preemptible hierarchical RCU implementation. machine # [ 0.188831] rcu: RCU event tracing is enabled. machine # [ 0.188832] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. machine # [ 0.188834] Trampoline variant of Tasks RCU enabled. machine # [ 0.188834] Rude variant of Tasks RCU enabled. machine # [ 0.188834] Tracing variant of Tasks RCU enabled. machine # [ 0.188835] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. machine # [ 0.188836] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 machine # [ 0.188863] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.188864] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.188865] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.193346] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16 machine # [ 0.193690] rcu: srcu_init: Setting srcu_struct sizes based on contention. machine # [ 0.193697] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns machine # [ 0.193809] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) machine # [ 0.197449] Console: colour VGA+ 80x25 machine # [ 0.197451] printk: legacy console [tty0] enabled machine # [ 0.229454] printk: legacy console [ttyS0] enabled machine # [ 0.342085] ACPI: Core revision 20250807 machine # [ 0.342961] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns machine # [ 0.344558] APIC: Switch to symmetric I/O mode setup machine # [ 0.345634] x2apic enabled machine # [ 0.346400] APIC: Switched APIC routing to: physical x2apic machine # [ 0.347343] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask() machine # [ 0.348630] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself() machine # [ 0.350228] kvm-guest: setup PV IPIs machine # [ 0.351859] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 machine # [ 0.352928] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.357310] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) machine # [ 0.359390] x86/cpu: User Mode Instruction Prevention (UMIP) activated machine # [ 0.360456] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 machine # [ 0.361308] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 machine # [ 0.362311] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto machine # [ 0.364307] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl machine # [ 0.365308] Transient Scheduler Attacks: Vulnerable: No microcode machine # [ 0.366307] Spectre V2 : Mitigation: Enhanced / Automatic IBRS machine # [ 0.367308] Speculative Return Stack Overflow: Mitigation: Safe RET machine # [ 0.368307] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization machine # [ 0.369315] Spectre V2 : Enabling IBPB for BPF machine # [ 0.370308] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier machine # [ 0.371308] active return thunk: srso_alias_return_thunk machine # [ 0.372226] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' machine # [ 0.373306] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' machine # [ 0.374307] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' machine # [ 0.375307] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' machine # [ 0.376308] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' machine # [ 0.377307] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' machine # [ 0.378307] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' machine # [ 0.380308] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 machine # [ 0.381307] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 machine # [ 0.382307] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 machine # [ 0.383307] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 machine # [ 0.384307] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 machine # [ 0.385307] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. machine # [ 0.414540] Freeing SMP alternatives memory: 44K machine # [ 0.415310] pid_max: default: 32768 minimum: 301 machine # [ 0.416331] LSM: initializing lsm=capability,landlock,yama,bpf,ima machine # [ 0.417407] landlock: Up and running. machine # [ 0.418073] Yama: becoming mindful. machine # [ 0.418974] LSM support for eBPF active machine # [ 0.419453] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.420380] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.423869] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) machine # [ 0.424819] Performance Events: Fam17h+ core perfctr, AMD PMU driver. machine # [ 0.425313] ... version: 2 machine # [ 0.426082] ... bit width: 48 machine # [ 0.426310] ... generic counters: 6 machine # [ 0.427103] ... generic bitmap: 000000000000003f machine # [ 0.428133] ... fixed-purpose counters: 0 machine # [ 0.428907] ... fixed-purpose bitmap: 0000000000000000 machine # [ 0.429310] ... value mask: 0000ffffffffffff machine # [ 0.430263] ... max period: 00007fffffffffff machine # [ 0.431030] ... global_ctrl mask: 000000000000003f machine # [ 0.431430] signal: max sigframe size: 3376 machine # [ 0.432215] rcu: Hierarchical SRCU implementation. machine # [ 0.432966] rcu: Max phase no-delay instances is 400. machine # [ 0.433486] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level machine # [ 0.438802] smp: Bringing up secondary CPUs ... machine # [ 0.439702] smpboot: x86: Booting SMP configuration: machine # [ 0.440326] .... node #0, CPUs: #1 #2 #3 machine # [ 0.443452] smp: Brought up 1 node, 4 CPUs machine # [ 0.445045] smpboot: Total of 4 processors activated (19200.09 BogoMIPS) machine # [ 0.445644] Memory: 3957752K/4193752K available (17259K kernel code, 2728K rwdata, 13652K rodata, 3656K init, 2968K bss, 220908K reserved, 0K cma-reserved) machine # [ 0.448310] devtmpfs: initialized machine # [ 0.449511] x86/mm: Memory block size: 128MB machine # [ 0.452381] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.453387] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). machine # [ 0.454401] pinctrl core: initialized pinctrl subsystem machine # [ 0.455630] PM: RTC time: 09:25:32, date: 2026-09-30 machine # [ 0.459279] NET: Registered PF_NETLINK/PF_ROUTE protocol family machine # [ 0.460871] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations machine # [ 0.461347] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations machine # [ 0.462842] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations machine # [ 0.463321] audit: initializing netlink subsys (disabled) machine # [ 0.464337] audit: type=2000 audit(1790760333.002:1): state=initialized audit_enabled=0 res=1 machine # [ 0.464587] thermal_sys: Registered thermal governor 'fair_share' machine # [ 0.466310] thermal_sys: Registered thermal governor 'bang_bang' machine # [ 0.467310] thermal_sys: Registered thermal governor 'step_wise' machine # [ 0.468309] thermal_sys: Registered thermal governor 'user_space' machine # [ 0.469309] thermal_sys: Registered thermal governor 'power_allocator' machine # [ 0.470324] cpuidle: using governor menu machine # [ 0.472518] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 machine # [ 0.473557] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] machine # [ 0.474313] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry machine # [ 0.475324] PCI: Using configuration type 1 for base access machine # [ 0.476468] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. machine # [ 0.478782] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages machine # [ 0.480226] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page machine # [ 0.481201] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages machine # [ 0.482235] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page machine # [ 0.487040] ACPI: Added _OSI(Module Device) machine # [ 0.489317] ACPI: Added _OSI(Processor Device) machine # [ 0.491319] ACPI: Added _OSI(Processor Aggregator Device) machine # [ 0.500115] ACPI: 1 ACPI AML tables successfully acquired and loaded machine # [ 0.506632] ACPI: Interpreter enabled machine # [ 0.507329] ACPI: PM: (supports S0 S3 S4 S5) machine # [ 0.508110] ACPI: Using IOAPIC for interrupt routing machine # [ 0.509066] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug machine # [ 0.510316] PCI: Using E820 reservations for host bridge windows machine # [ 0.512773] ACPI: Enabled 2 GPEs in block 00 to 3F machine # [ 0.525197] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) machine # [ 0.528325] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] machine # [ 0.531597] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] machine # [ 0.535636] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] machine # [ 0.539233] PCI host bridge to bus 0000:00 machine # [ 0.541324] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] machine # [ 0.543314] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] machine # [ 0.545313] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] machine # [ 0.548313] pci_bus 0000:00: root bus resource [mem 0x80000000-0xafffffff window] machine # [ 0.550314] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] machine # [ 0.553315] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.556343] pci_bus 0000:00: root bus resource [bus 00-ff] machine # [ 0.557707] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint machine # [ 0.562126] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint machine # [ 0.573414] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] machine # [ 0.574382] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] machine # [ 0.576351] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] machine # [ 0.578098] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] machine # [ 0.583430] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.595352] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] machine # [ 0.597331] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] machine # [ 0.600372] pci 0000:00:02.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref] machine # [ 0.603330] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] machine # [ 0.606684] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.617350] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] machine # [ 0.619329] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] machine # [ 0.621357] pci 0000:00:03.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref] machine # [ 0.625398] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint machine # [ 0.632361] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] machine # [ 0.634346] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] machine # [ 0.635339] pci 0000:00:04.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref] machine # [ 0.638459] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.647355] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] machine # [ 0.650333] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] machine # [ 0.652405] pci 0000:00:05.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref] machine # [ 0.656332] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] machine # [ 0.659732] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint machine # [ 0.666347] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] machine # [ 0.669370] pci 0000:00:06.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref] machine # [ 0.673677] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.678326] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] machine # [ 0.680356] pci 0000:00:07.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref] machine # [ 0.684396] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.690364] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] machine # [ 0.704334] pci 0000:00:08.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref] machine # [ 0.706915] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.713369] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] machine # [ 0.716372] pci 0000:00:09.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref] machine # [ 0.721826] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint machine # [ 0.732365] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] machine # [ 0.734331] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] machine # [ 0.737370] pci 0000:00:0a.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref] machine # [ 0.741784] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.750348] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] machine # [ 0.752331] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] machine # [ 0.754396] pci 0000:00:0b.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref] machine # [ 0.759045] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.764947] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] machine # [ 0.766739] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.771368] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] machine # [ 0.773681] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.775775] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] machine # [ 0.777544] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint machine # [ 0.780228] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] machine # [ 0.781326] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint machine # [ 0.783604] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO machine # [ 0.784586] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint machine # [ 0.788197] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] machine # [ 0.788984] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] machine # [ 0.790477] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint machine # [ 0.793142] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] machine # [ 0.797320] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 machine # [ 0.798428] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 machine # [ 0.799414] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 machine # [ 0.801421] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 machine # [ 0.802409] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 machine # [ 0.803412] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 machine # [ 0.804409] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 machine # [ 0.805414] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 machine # [ 0.806348] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 machine # [ 0.807323] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 machine # [ 0.809327] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 machine # [ 0.810323] ACPI: PCI: Interrupt link GSID configured for IRQ 19 machine # [ 0.811323] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 machine # [ 0.812322] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 machine # [ 0.813322] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 machine # [ 0.814322] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 machine # [ 0.817343] iommu: Default domain type: Translated machine # [ 0.817947] iommu: DMA domain TLB invalidation policy: lazy mode machine # [ 0.819550] ACPI: bus type USB registered machine # [ 0.820404] usbcore: registered new interface driver usbfs machine # [ 0.821323] usbcore: registered new interface driver hub machine # [ 0.822311] usbcore: registered new device driver usb machine # [ 0.824568] NetLabel: Initializing machine # [ 0.825237] NetLabel: domain hash size = 128 machine # [ 0.825892] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO machine # [ 0.827744] NetLabel: unlabeled traffic allowed by default machine # [ 0.829327] PCI: Using ACPI for IRQ routing machine # [ 0.873563] pci 0000:00:01.0: vgaarb: setting as boot VGA device machine # [ 0.874306] pci 0000:00:01.0: vgaarb: bridge control possible machine # [ 0.874306] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none machine # [ 0.877317] vgaarb: loaded machine # [ 0.878149] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 machine # [ 0.878983] hpet0: 3 comparators, 64-bit 100.000000 MHz counter machine # [ 0.884428] clocksource: Switched to clocksource kvm-clock machine # [ 0.887815] VFS: Disk quotas dquot_6.6.0 machine # [ 0.888539] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) machine # [ 0.890037] pnp: PnP ACPI init machine # [ 0.890915] ACPI: IRQ 4 override to edge(!), high(!) machine # [ 0.891935] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved machine # [ 0.893602] pnp: PnP ACPI: found 5 devices machine # [ 0.904322] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns machine # [ 0.908131] clocksource: Switched to clocksource acpi_pm machine # [ 0.910954] NET: Registered PF_INET protocol family machine # [ 0.914768] IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear) machine # [ 0.951866] tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.953531] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) machine # [ 0.955025] TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear) machine # [ 0.956590] TCP bind hash table entries: 32768 (order: 8, 1048576 bytes, linear) machine # [ 0.958027] TCP: Hash tables configured (established 32768 bind 32768) machine # [ 0.959461] MPTCP token hash table entries: 4096 (order: 5, 98304 bytes, linear) machine # [ 0.961010] UDP hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.962400] UDP-Lite hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.963842] NET: Registered PF_UNIX/PF_LOCAL protocol family machine # [ 0.964890] NET: Registered PF_XDP protocol family machine # [ 0.965809] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] machine # [ 0.966922] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] machine # [ 0.968042] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] machine # [ 0.969223] pci_bus 0000:00: resource 7 [mem 0x80000000-0xafffffff window] machine # [ 0.970404] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] machine # [ 0.971543] pci_bus 0000:00: resource 9 [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.973589] ACPI: \_SB_.GSIA: Enabled at IRQ 16 machine # [ 0.975878] ACPI: \_SB_.GSIB: Enabled at IRQ 17 machine # [ 0.978033] ACPI: \_SB_.GSIC: Enabled at IRQ 18 machine # [ 0.980158] ACPI: \_SB_.GSID: Enabled at IRQ 19 machine # [ 0.982010] PCI: CLS 0 bytes, default 64 machine # [ 0.982894] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) machine # [ 0.983308] Trying to unpack rootfs image as initramfs... machine # [ 0.984014] software IO TLB: mapped [mem 0x000000007a364000-0x000000007e364000] (64MB) machine # [ 0.984147] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 1.007825] Initialise system trusted keyrings machine # [ 1.009184] workingset: timestamp_bits=40 max_order=20 bucket_order=0 machine # [ 1.020396] Key type asymmetric registered machine # [ 1.021183] Asymmetric key parser 'x509' registered machine # [ 1.022187] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) machine # [ 1.023878] io scheduler mq-deadline registered machine # [ 1.024719] io scheduler kyber registered machine # [ 1.030099] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled machine # [ 1.031451] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A machine # [ 1.034042] Linux agpgart interface v0.103 machine # [ 1.034868] ACPI: bus type drm_connector registered machine # [ 1.038037] usbcore: registered new interface driver usbserial_generic machine # [ 1.039218] usbserial: USB Serial support registered for generic machine # [ 1.040289] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. machine # [ 1.040289] Please enable it if your BIOS has the CPPC option. machine # [ 1.042695] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled machine # [ 1.044148] drop_monitor: Initializing network drop monitor service machine # [ 1.045425] NET: Registered PF_INET6 protocol family machine # [ 1.047491] Segment Routing with IPv6 machine # [ 1.048191] In-situ OAM (IOAM) with IPv6 machine # [ 1.050942] IPI shorthand broadcast: enabled machine # [ 1.055328] sched_clock: Marking stable (900014582, 154609901)->(1077613242, -22988759) machine # [ 1.057180] registered taskstats version 1 machine # [ 1.058291] Loading compiled-in X.509 certificates machine # [ 1.068114] Demotion targets for Node 0: null machine # [ 1.069263] Key type .fscrypt registered machine # [ 1.070016] Key type fscrypt-provisioning registered machine # [ 1.071090] ima: No TPM chip found, activating TPM-bypass! machine # [ 1.072077] ima: Allocated hash algorithm: sha1 machine # [ 1.072949] ima: No architecture policies found machine # [ 1.074037] PM: Magic number: 10:601:425 machine # [ 1.075678] RAS: Correctable Errors collector initialized. machine # [ 1.080136] clk: Disabling unused clocks machine # [ 1.080904] PM: genpd: Disabling unused power domains machine # [ 1.261728] Freeing initrd memory: 29104K machine # [ 1.265353] Freeing unused decrypted memory: 2028K machine # [ 1.268119] Freeing unused kernel image (initmem) memory: 3656K machine # [ 1.269259] Write protecting the kernel read-only data: 32768k machine # [ 1.271471] Freeing unused kernel image (text/rodata gap) memory: 1172K machine # [ 1.273103] Freeing unused kernel image (rodata/data gap) memory: 684K machine # [ 1.323876] x86/mm: Checked W+X mappings: passed, no W+X pages found. machine # [ 1.325028] Run /init as init process machine # [ 1.338899] systemd[1]: Inserted module 'autofs4' machine # [ 1.365301] fuse: init (API version 7.45) machine # [ 1.374384] ACPI: \_SB_.GSIG: Enabled at IRQ 22 machine # [ 1.376803] ACPI: \_SB_.GSIH: Enabled at IRQ 23 machine # [ 1.380362] ACPI: \_SB_.GSIE: Enabled at IRQ 20 machine # [ 1.382550] ACPI: \_SB_.GSIF: Enabled at IRQ 21 machine # [ 1.387810] virtiofs virtio5: discovered new tag: nix-store machine # [ 1.389395] virtiofs virtio5: virtio_fs_setup_dax: No cache capability machine # [ 1.396107] virtiofs virtio6: discovered new tag: shared machine # [ 1.409220] virtiofs virtio6: virtio_fs_setup_dax: No cache capability machine # [ 1.412663] virtiofs virtio7: discovered new tag: xchg machine # [ 1.414128] virtiofs virtio7: virtio_fs_setup_dax: No cache capability machine # [ 1.445049] systemd[1]: Successfully made /usr/ read-only. machine # [ 1.781200] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 1.787764] systemd[1]: Detected virtualization kvm. machine # [ 1.789963] systemd[1]: Detected architecture x86-64. machine # [ 1.792166] systemd[1]: Running in initrd. machine # [ 1.794762] systemd[1]: Initializing machine ID from random generator. machine # [ 1.797685] systemd[1]: Hostname set to . machine # [ 1.916987] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 1.954651] systemd[1]: Queued start job for default target Initrd Default Target. machine # [ 1.970188] systemd[1]: Created slice Slice /system/modprobe. machine # [ 1.971421] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 1.972912] systemd[1]: Expecting device /dev/disk/by-label/nixos... machine # [ 1.974084] systemd[1]: Reached target Path Units. machine # [ 1.975002] systemd[1]: Reached target Slice Units. machine # [ 1.975934] systemd[1]: Reached target Swaps. machine # [ 1.976816] systemd[1]: Reached target Timer Units. machine # [ 1.977820] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 1.979068] systemd[1]: Listening on Journal Socket (/dev/log). machine # [ 1.980271] systemd[1]: Listening on Journal Sockets. machine # [ 1.981358] systemd[1]: Listening on udev Control Socket. machine # [ 1.982431] systemd[1]: Listening on udev Kernel Socket. machine # [ 1.983426] systemd[1]: Reached target Socket Units. machine # [ 1.985410] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 1.987541] systemd[1]: Starting Load Kernel Module configfs... machine # [ 1.990507] systemd[1]: Starting Journal Service... machine # [ 1.993889] systemd[1]: Starting Load Kernel Modules... machine # [ 1.996428] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 2.005821] systemd[1]: Starting Coldplug All udev Devices... machine # [ 2.023000] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 2.027405] systemd[1]: Finished Load Kernel Module configfs. machine # [ 2.032500] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 2.037180] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config machine # [ 2.037721] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. machine # [ 2.041776] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 2.043645] systemd-journald[90]: Collecting audit messages is disabled. machine # [ 2.044236] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev machine # [ 2.063436] systemd[1]: Finished Load Kernel Modules. machine # [ 2.067227] systemd[1]: Starting Apply Kernel Variables... machine # [ 2.074964] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 1.929535] systemd-modules-load[91]: Using 4 probe threads machine # [ 1.930835] systemd-modules-load[91]: Inserted module 'virtio_balloon' machine # [ 2.085232] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 1.932062] systemd-modules-load[91]: Inserted module 'virtio_gpu' machine # [ 1.934154] systemd-modules-load[91]: Inserted module 'dm_mod' machine # [ 2.089743] systemd[1]: Started Journal Service. machine # [ 1.936757] systemd[1]: Finished Apply Kernel Variables. machine # [ 1.949243] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 1.950290] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 1.951269] systemd[1]: Reached target Local File Systems. machine # [ 1.951983] systemd[1]: Starting Create System Files and Directories... machine # [ 1.953401] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 1.968541] systemd[1]: Finished Create System Files and Directories. machine # [ 1.975498] systemd-udevd[111]: Using default interface naming scheme 'v261'. machine # [ 1.986885] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 1.993443] systemd[1]: Finished Coldplug All udev Devices. machine # [ 1.994376] systemd[1]: Reached target System Initialization. machine # [ 1.995210] systemd[1]: Reached target Basic System. machine # [ 2.244674] uhci_hcd 0000:00:1d.0: UHCI Host Controller machine # [ 2.245516] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 1 machine # [ 2.246715] uhci_hcd 0000:00:1d.0: detected 2 ports machine # [ 2.247578] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 machine # [ 2.249148] virtio_blk virtio2: 4/0/0 default/read/poll queues machine # [ 2.251414] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.252775] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.254856] usb usb1: Product: UHCI Host Controller machine # [ 2.255592] usb usb1: Manufacturer: Linux 6.18.53 uhci_hcd machine # [ 2.256824] usb usb1: SerialNumber: 0000:00:1d.0 machine # [ 2.257821] virtio_blk virtio2: [vda] 33554432 512-byte logical blocks (17.2 GB/16.0 GiB) machine # [ 2.258214] hub 1-0:1.0: USB hub found machine # [ 2.260956] hub 1-0:1.0: 2 ports detected machine # [ 2.264290] uhci_hcd 0000:00:1d.1: UHCI Host Controller machine # [ 2.265781] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 2 machine # [ 2.266911] uhci_hcd 0000:00:1d.1: detected 2 ports machine # [ 2.269909] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 machine # [ 2.270904] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.272118] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.273213] usb usb2: Product: UHCI Host Controller machine # [ 2.274064] usb usb2: Manufacturer: Linux 6.18.53 uhci_hcd machine # [ 2.275086] usb usb2: SerialNumber: 0000:00:1d.1 machine # [ 2.279495] hub 2-0:1.0: USB hub found machine # [ 2.280129] hub 2-0:1.0: 2 ports detected machine # [ 2.280222] SCSI subsystem initialized machine # [ 2.306251] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 machine # [ 2.158852] systemd[1]: Starting Virtual Console Setup... machine # [ 2.314347] serio: i8042 KBD port at 0x60,0x64 irq 1 machine # [ 2.315213] serio: i8042 AUX port at 0x60,0x64 irq 12 machine # [ 2.187075] systemd-vconsole-setup[141]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 2.343423] ehci-pci 0000:00:1d.7: EHCI Host Controller machine # [ 2.189782] systemd[1]: Finished Virtual Console Setup. machine # [ 2.344231] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 3 machine # [ 2.346420] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 machine # [ 2.352643] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 machine # [ 2.353588] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 machine # [ 2.354876] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.355938] usb usb3: Product: EHCI Host Controller machine # [ 2.356685] usb usb3: Manufacturer: Linux 6.18.53 ehci_hcd machine # [ 2.357436] usb usb3: SerialNumber: 0000:00:1d.7 machine # [ 2.358265] hub 3-0:1.0: USB hub found machine # [ 2.359009] hub 3-0:1.0: 6 ports detected machine # [ 2.380793] hub 1-0:1.0: USB hub found machine # [ 2.381459] hub 1-0:1.0: 2 ports detected machine # [ 2.402899] hub 2-0:1.0: USB hub found machine # [ 2.403524] hub 2-0:1.0: 2 ports detected machine # [ 2.404568] uhci_hcd 0000:00:1d.2: UHCI Host Controller machine # [ 2.406698] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 machine # [ 2.260695] (udev-worker)[127]: Network interface NamePolicy= disabled on kernel command line. machine # [ 2.263780] (udev-worker)[122[ 2.418015] uhci_hcd 0000:00:1d.2: detected 2 ports machine # ]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 2.269527] (udev-worker)[122[ 2.423822] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 machine # ]: Network interface NamePolicy= disabled on kernel command line. machine # [ 2.426982] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.435907] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.437129] usb usb4: Product: UHCI Host Controller machine # [ 2.437978] usb usb4: Manufacturer: Linux 6.18.53 uhci_hcd machine # [ 2.438854] usb usb4: SerialNumber: 0000:00:1d.2 machine # [ 2.440792] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 machine # [ 2.441884] hub 4-0:1.0: USB hub found machine # [ 2.443700] hub 4-0:1.0: 2 ports detected machine # [ 2.295086] systemd[1]: Found device /dev/disk/by-label/nixos. machine # [ 2.296047] systemd[1]: Reached target Initrd Root Device. machine # [ 2.298255] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... machine # [ 2.459697] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode machine # [ 2.460974] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) machine # [ 2.462019] ahci 0000:00:1f.2: flags: 64bit ncq only machine # [ 2.465589] scsi host0: ahci machine # [ 2.467353] scsi host1: ahci machine # [ 2.468463] scsi host2: ahci machine # [ 2.469585] scsi host3: ahci machine # [ 2.470452] scsi host4: ahci machine # [ 2.471270] scsi host5: ahci machine # [ 2.472021] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 50 lpm-pol 1 machine # [ 2.473275] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 50 lpm-pol 1 machine # [ 2.474546] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 50 lpm-pol 1 machine # [ 2.476093] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 50 lpm-pol 1 machine # [ 2.477712] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 50 lpm-pol 1 machine # [ 2.479378] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 50 lpm-pol 1 machine # [ 2.329391] systemd-fsck[163]: nixos: clean, 12/1048576 files, 109865/4194304 blocks machine # [ 2.333170] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. machine # [ 2.597812] usb 3-1: new high-speed USB device number 2 using ehci-pci machine # [ 2.729299] usb 3-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 machine # [ 2.732328] usb 3-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 machine # [ 2.735085] usb 3-1: Product: QEMU USB Tablet machine # [ 2.736835] usb 3-1: Manufacturer: QEMU machine # [ 2.738358] usb 3-1: SerialNumber: 28754-0000:00:1d.7-1 machine # [ 2.775395] hid: raw HID events driver (C) Jiri Kosina machine # [ 2.796730] ata4: SATA link down (SStatus 0 SControl 300) machine # [ 2.799061] ata6: SATA link down (SStatus 0 SControl 300) machine # [ 2.801427] ata1: SATA link down (SStatus 0 SControl 300) machine # [ 2.803767] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) machine # [ 2.806303] ata5: SATA link down (SStatus 0 SControl 300) machine # [ 2.808459] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 machine # [ 2.810537] ata3.00: applying bridge limits machine # [ 2.812460] ata2: SATA link down (SStatus 0 SControl 300) machine # [ 2.814743] ata3.00: configured for UDMA/100 machine # [ 2.825340] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 machine # [ 2.855988] usbcore: registered new interface driver usbhid machine # [ 2.858159] usbhid: USB HID core driver machine # [ 2.870431] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb3/3-1/3-1:1.0/0003:0627:0001.0001/input/input2 machine # [ 2.874713] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 machine # [ 2.898198] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray machine # [ 2.927080] cdrom: Uniform CD-ROM driver Revision: 3.20 machine # [ 2.863611] systemd[1]: Mounting /sysroot... machine # [ 3.160112] EXT4-fs (vda): mounted filesystem 0f5c4563-6dad-4166-a723-bc27e23a4d5b r/w with ordered data mode. Quota mode: none. machine # [ 3.013901] systemd[1]: Mounted /sysroot. machine # [ 3.015491] systemd[1]: Reached target Initrd Root File System. machine # [ 3.019691] systemd[1]: Mounting /sysroot/nix/.ro-store... machine # [ 3.021879] systemd[1]: Mounting /sysroot/nix/.rw-store... machine # [ 3.033548] systemd[1]: Mounting /sysroot/run... machine # [ 3.035900] systemd[1]: Mounting /sysroot/tmp/shared... machine # [ 3.041133] systemd[1]: Mounting /sysroot/tmp/xchg... machine # [ 3.045057] systemd[1]: Starting Mountpoints Configured in the Real Root... machine # [ 3.048110] systemd[1]: Mounted /sysroot/nix/.ro-store. machine # [ 3.051626] systemd[1]: Mounted /sysroot/nix/.rw-store. machine # [ 3.055867] systemd[1]: Mounted /sysroot/tmp/xchg. machine # [ 3.057721] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.064480] systemd-sysroot-fstab-check[194]: /sysroot should be mounted in the initrd, will request daemon-reload. machine # [ 3.067337] systemd[1]: Mounted /sysroot/run. machine # [ 3.068717] systemd[1]: Mounted /sysroot/tmp/shared. machine # [ 3.070160] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.072151] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.073775] systemd[1]: Reload requested from client PID 194 ('systemd-sysroot') (unit initrd-parse-etc.service)... machine # [ 3.076751] systemd[1]: Reloading... machine # [ 3.126445] systemd[1]: Reloading finished in 57 ms. machine # [ 3.145983] systemd-sysroot-fstab-check[194]: Requesting initrd-fs.target/start/replace... machine # [ 3.148871] systemd-sysroot-fstab-check[194]: Requesting swap.target/start/replace... machine # [ 3.151611] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.153643] systemd[1]: initrd-parse-etc.service: Deactivated successfully. machine # [ 3.155933] systemd[1]: Finished Mountpoints Configured in the Real Root. machine # [ 3.158298] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. machine # [ 3.191099] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.193576] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.864525] systemd[1]: Mounting /sysroot/nix/store... machine # [ 3.915992] systemd[1]: Mounted /sysroot/nix/store. machine # [ 3.917942] systemd[1]: Reached target Initrd File Systems. machine # [ 3.919935] systemd[1]: Starting Find NixOS closure... machine # [ 3.921880] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... machine # [ 3.946868] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. machine # [ 3.949704] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. machine # [ 3.959261] systemd[1]: Finished Find NixOS closure. machine # [ 3.961153] systemd[1]: Reached target Initrd Default Target. machine # [ 3.963259] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... machine # [ 3.990466] systemd[1]: Stopped target Initrd Default Target. machine # [ 3.992495] systemd[1]: Stopped target Basic System. machine # [ 3.994275] systemd[1]: Stopped target Initrd Root Device. machine # [ 3.996157] systemd[1]: Stopped target Path Units. machine # [ 3.997772] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. machine # [ 4.000307] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. machine # [ 4.002808] systemd[1]: Stopped target Slice Units. machine # [ 4.004504] systemd[1]: Stopped target Socket Units. machine # [ 4.006226] systemd[1]: Stopped target System Initialization. machine # [ 4.009094] systemd[1]: Stopped target Swaps. machine # [ 4.011469] systemd[1]: Stopped target Timer Units. machine # [ 4.013350] systemd[1]: dbus.socket: Deactivated successfully. machine # [ 4.015735] systemd[1]: Closed D-Bus System Message Bus Socket. machine # [ 4.017751] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. machine # [ 4.020251] systemd[1]: Stopped Find NixOS closure. machine # [ 4.022073] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 4.024109] systemd[1]: systemd-sysctl.service: Deactivated successfully. machine # [ 4.026285] systemd[1]: Stopped Apply Kernel Variables. machine # [ 4.028058] systemd[1]: systemd-modules-load.service: Deactivated successfully. machine # [ 4.030195] systemd[1]: Stopped Load Kernel Modules. machine # [ 4.031757] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. machine # [ 4.033930] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. machine # [ 4.036044] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. machine # [ 4.037887] systemd[1]: Stopped Create System Files and Directories. machine # [ 4.039505] systemd[1]: Stopped target Local File Systems. machine # [ 4.040966] systemd[1]: Stopped target Preparation for Local File Systems. machine # [ 4.042697] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. machine # [ 4.044550] systemd[1]: Stopped Coldplug All udev Devices. machine # [ 4.045973] systemd[1]: Stopping Rule-based Manager for Device Events and Files... machine # [ 4.047948] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 4.049452] systemd[1]: Stopped Virtual Console Setup. machine # [ 4.050470] systemd[1]: initrd-cleanup.service: Deactivated successfully. machine # [ 4.051750] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. machine # [ 4.053151] systemd[1]: systemd-udevd.service: Deactivated successfully. machine # [ 4.054316] systemd[1]: Stopped Rule-based Manager for Device Events and Files. machine # [ 4.055453] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. machine # [ 4.056420] systemd[1]: Closed udev Control Socket. machine # [ 4.057157] systemd[1]: Starting Cleanup udev Database... machine # [ 4.057892] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. machine # [ 4.058880] systemd[1]: Stopped Create Static Device Nodes in /dev. machine # [ 4.059708] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. machine # [ 4.060775] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. machine # [ 4.061727] systemd[1]: kmod-static-nodes.service: Deactivated successfully. machine # [ 4.062716] systemd[1]: Stopped Create List of Static Device Nodes. machine # [ 4.063597] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 4.064592] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 4.067744] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. machine # [ 4.068797] systemd[1]: Finished Cleanup udev Database. machine # [ 4.069524] systemd[1]: Reached target Switch Root. machine # [ 4.070285] systemd[1]: Starting NixOS Activation... machine # [ 4.194938] initrd-nixos-activation-start[239]: booting system configuration /nix/store/p2q3gdri518935bkr6vg9w5dxjklcrss-nixos-system-machine-test machine # [ 4.253707] initrd-nixos-activation-start[239]: running activation script... machine # [ 4.548715] initrd-nixos-activation-start[263]: setting up /etc... machine # [ 4.700847] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. machine # [ 4.702279] systemd[1]: Finished NixOS Activation. machine # [ 4.704319] systemd[1]: Starting Switch Root... machine # [ 4.736320] systemd[1]: Switching root. machine # [ 4.939545] systemd-journald[90]: Received SIGTERM from PID 1 (systemd). machine # [ 5.059320] NET: Registered PF_VSOCK protocol family machine # [ 5.455699] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 5.465910] systemd[1]: Detected virtualization kvm. machine # [ 5.467835] systemd[1]: Detected architecture x86-64. machine # [ 5.469834] systemd[1]: Detected first boot. machine # [ 5.473973] systemd[1]: Initializing machine ID from random generator. machine # [ 5.619414] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 5.704880] systemd[1]: Applying preset policy. machine # [ 5.886646] systemd[1]: Populated /etc with preset unit settings. machine # [ 6.118088] systemd[1]: initrd-switch-root.service: Deactivated successfully. machine # [ 6.119527] systemd[1]: Stopped initrd-switch-root.service. machine # [ 6.121852] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. machine # [ 6.124187] systemd[1]: Created slice Slice /system/getty. machine # [ 6.125752] systemd[1]: Created slice User and Session Slice. machine # [ 6.126735] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 6.127997] systemd[1]: Started Forward Password Requests to Wall Directory Watch. machine # [ 6.129181] systemd[1]: Expecting device /dev/hvc0... machine # [ 6.129987] systemd[1]: Expecting device /dev/ttyS0... machine # [ 6.130801] systemd[1]: Reached target Local Encrypted Volumes. machine # [ 6.131711] systemd[1]: Stopped target initrd-fs.target. machine # [ 6.132490] systemd[1]: Stopped target initrd-root-fs.target. machine # [ 6.133338] systemd[1]: Stopped target initrd-switch-root.target. machine # [ 6.134264] systemd[1]: Reached target Virtual Machines and Containers. machine # [ 6.135252] systemd[1]: Reached target Path Units. machine # [ 6.136037] systemd[1]: Reached target Remote File Systems. machine # [ 6.136905] systemd[1]: Reached target Slice Units. machine # [ 6.137694] systemd[1]: Reached target Swaps. machine # [ 6.140492] systemd[1]: Listening on Query the User Interactively for a Password. machine # [ 6.147212] systemd[1]: Listening on Process Core Dump Socket. machine # [ 6.152068] systemd[1]: Listening on Credential Encryption/Decryption. machine # [ 6.157464] systemd[1]: Listening on Factory Reset Management. machine # [ 6.160207] systemd[1]: Listening on Hostname Service Socket. machine # [ 6.167577] systemd[1]: Starting Journal Log Access Socket... machine # [ 6.170861] systemd[1]: Listening on Journal Audit Socket. machine # [ 6.176054] systemd[1]: Listening on Console Output Muting Service Socket. machine # [ 6.179156] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. machine # [ 6.182318] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.186056] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki machine # [ 6.196460] systemd[1]: Listening on Disk Repartitioning Service Socket. machine # [ 6.198677] systemd[1]: Listening on udev Control Socket. machine # [ 6.200485] systemd[1]: Listening on udev Varlink Socket. machine # [ 6.204808] systemd[1]: Mounting Huge Pages File System... machine # [ 6.208946] systemd[1]: Mounting POSIX Message Queue File System... machine # [ 6.220428] systemd[1]: Mounting Kernel Debug File System... machine # [ 6.226944] systemd[1]: Mounting Kernel Trace File System... machine # [ 6.233842] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 6.241832] systemd[1]: Starting Load Kernel Module configfs... machine # [ 6.244524] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm machine # [ 6.248289] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.252271] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.259771] systemd[1]: Mounting FUSE Control File System... machine # [ 6.262029] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.271092] systemd[1]: Starting Journal Service... machine # [ 6.274922] systemd[1]: Starting Load Kernel Modules... machine # [ 6.283711] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... machine # [ 6.287822] systemd[1]: Starting Remount Root and Kernel File Systems... machine # [ 6.288952] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.292328] systemd[1]: Starting Coldplug All udev Devices... machine # [ 6.295134] systemd[1]: Listening on Journal Log Access Socket. machine # [ 6.296200] systemd[1]: Mounted Huge Pages File System. machine # [ 6.297185] systemd[1]: Mounted POSIX Message Queue File System. machine # [ 6.298238] systemd[1]: Mounted Kernel Debug File System. machine # [ 6.299237] systemd[1]: Mounted Kernel Trace File System. machine # [ 6.300826] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 6.301829] systemd-journald[334]: Collecting audit messages is enabled. machine # [ 6.302154] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 6.304329] systemd[1]: Finished Load Kernel Module configfs. machine # [ 6.305564] systemd[1]: Mounted FUSE Control File System. machine # [ 6.310885] systemd[1]: Mounting Kernel Configuration File System... machine # [ 6.314784] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 6.316967] loop: module loaded machine # [ 6.166485] systemd[1]: Queued start job for default target Multi-User System. machine # [ 6.167819] systemd[1]: systemd-journald.service: Deactivated successfully. machine # [ 6.322421] systemd[1]: Finished Load Kernel Modules. machine # [ 6.169887] systemd-modules-load[335]: Using 2 probe threads machine # [ 6.171078] systemd-modules-load[335]: Inserted module 'loop'[ 6.325766] systemd[1]: Started Journal Service. machine # machine # [ 6.181181] systemd[1]: Starting Apply Kernel Variables... machine # [ 6.335897] EXT4-fs (vda): re-mounted 0f5c4563-6dad-4166-a723-bc27e23a4d5b. machine # [ 6.186495] systemd[1]: Mounted Kernel Configuration File System. machine # [ 6.190102] systemd-oomd[337]: No swap; memory pressure usage will be degraded machine # [ 6.191565] systemd[1]: Finished Remount Root and Kernel File Systems. machine # [ 6.192497] systemd[1]: Listening on Disk Image Download Service Socket. machine # [ 6.193579] systemd[1]: Starting Flush Journal to Persistent Storage... machine # [ 6.194552] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.196782] systemd[1]: Starting Load/Save OS Random Seed... machine # [ 6.197726] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.199381] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. machine # [ 6.367881] systemd-journald[334]: Received client request to flush runtime journal. machine # [ 6.265283] systemd[1]: Finished Apply Kernel Variables. machine # [ 6.266683] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 6.268202] systemd[1]: Finished Load/Save OS Random Seed. machine # [ 6.269045] systemd[1]: Reached target First Boot Complete. machine # [ 6.269837] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 6.270807] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 6.271747] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 6.272749] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 6.273853] systemd[1]: Finished Flush Journal to Persistent Storage. machine # [ 6.294433] systemd-udevd[363]: Using default interface naming scheme 'v261'. machine # [ 6.308793] systemd[1]: Finished Coldplug All udev Devices. machine # [ 6.328359] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 6.400496] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.423728] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. machine # [ 6.432194] (udev-worker)[386]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.436737] (udev-worker)[382]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 6.439105] (udev-worker)[382]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.441829] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. machine # [ 6.468435] systemd[1]: Condition check resulted in Virtio network device being skipped. machine # [ 6.469639] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.471986] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.475310] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.476815] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.478153] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.638992] mousedev: PS/2 mouse device common for all mice machine # [ 6.648526] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 machine # [ 6.665698] ACPI: button: Power Button [PWRF] machine # [ 6.677187] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console machine # [ 6.684176] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized machine # [ 6.688257] rtc_cmos PNP0B00:00: RTC can wake from S4 machine # [ 6.690339] Console: switching to colour dummy device 80x25 machine # [ 6.692300] [drm] Found bochs VGA, ID 0xb0c5. machine # [ 6.692302] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. machine # [ 6.695256] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic machine # [ 6.697334] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 machine # [ 6.697634] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 machine # [ 6.698751] rtc_cmos PNP0B00:00: registered as rtc0 machine # [ 6.699984] rtc_cmos PNP0B00:00: setting system clock to 2026-09-30T09:25:39 UTC (1790760339) machine # [ 6.702903] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs machine # [ 6.704167] parport_pc 00:02: reported by Plug and Play ACPI machine # [ 6.710090] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] machine # [ 6.712264] Console: switching to colour frame buffer device 160x50 machine # [ 6.714886] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device machine # [ 6.748551] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 machine # [ 6.750527] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 machine # [ 6.763195] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt machine # [ 6.775559] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD machine # [ 6.624591] systemd[1]: Starting Virtual Console Setup... machine # [ 6.651072] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 6.655163] systemd[1]: Stopped Virtual Console Setup. machine # [ 6.665562] systemd[1]: Starting Virtual Console Setup... machine # [ 6.683538] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 6.684772] systemd[1]: Stopped Virtual Console Setup. machine # [ 6.688292] systemd[1]: Starting Virtual Console Setup... machine # [ 6.844978] ppdev: user-space parallel port driver machine # [ 6.847393] iTCO_wdt iTCO_wdt.0.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) machine # [ 6.848981] iTCO_wdt iTCO_wdt.0.auto: initialized. heartbeat=30 sec (nowayout=0) machine # [ 6.872263] kvm_amd: TSC scaling supported machine # [ 6.872841] kvm_amd: Nested Virtualization enabled machine # [ 6.873307] kvm_amd: Nested Paging enabled machine # [ 6.873890] kvm_amd: LBR virtualization supported machine # [ 6.874433] kvm_amd: Virtual VMLOAD VMSAVE supported machine # [ 6.875074] kvm_amd: Virtual GIF supported machine # [ 6.875488] kvm_amd: Virtual NMI enabled machine # [ 6.943342] EDAC MC: Ver: 3.0.0 machine # [ 6.840054] systemd-vconsole-setup[408]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 6.845696] systemd[1]: Finished Virtual Console Setup. machine # [ 6.966412] systemd[1]: Mounting /run/wrappers... machine # [ 6.994997] systemd[1]: Mounted /run/wrappers. machine # [ 6.996882] systemd[1]: Reached target Local File Systems. machine # [ 6.998990] systemd[1]: Listening on Boot Loader Control Service Socket. machine # [ 7.002065] systemd[1]: Starting register-nix-paths.service... machine # [ 7.005194] systemd[1]: Starting Create SUID/SGID Wrappers... machine # [ 7.007412] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. machine # [ 7.010436] systemd[1]: Starting Save Transient machine-id to Disk... machine # [ 7.017955] systemd[1]: Starting Create System Files and Directories... machine # [ 7.074164] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. machine # [ 7.078376] systemd[1]: Finished Save Transient machine-id to Disk. machine # [ 7.118288] systemd[1]: Finished Create System Files and Directories. machine # [ 7.120952] systemd[1]: Starting Rebuild Journal Catalog... machine # [ 7.124236] systemd[1]: Starting Record System Boot/Shutdown in UTMP... machine # [ 7.152580] systemd[1]: Finished Record System Boot/Shutdown in UTMP. machine # [ 7.168401] systemd[1]: Finished Rebuild Journal Catalog. machine # [ 7.170074] systemd[1]: Starting Update is Completed... machine # [ 7.195670] systemd[1]: Finished Update is Completed. machine # [ 7.304753] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. machine # [ 7.306343] systemd[1]: Finished Create SUID/SGID Wrappers. machine # [ 7.532738] systemd[1]: Finished register-nix-paths.service. machine # [ 7.535364] systemd[1]: Reached target System Initialization. machine # [ 7.538176] systemd[1]: Started Discard unused filesystem blocks once a week. machine # [ 7.540717] systemd[1]: Started niks3 garbage collection timer. machine # [ 7.542833] systemd[1]: Started Daily Cleanup of Temporary Directories. machine # [ 7.545176] systemd[1]: Reached target Timer Units. machine # [ 7.546920] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 7.563529] systemd[1]: Listening on niks3 server socket. machine # [ 7.565579] systemd[1]: Listening on Nix Daemon Socket. machine # [ 7.567520] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. machine # [ 7.570409] systemd[1]: Reached target Socket Units. machine # [ 7.572217] systemd[1]: Reached target Basic System. machine # [ 7.573991] systemd[1]: Started backdoor.service. machine # [ 7.575785] systemd[1]: Starting Import lastlog data into lastlog2 database... machine # [ 7.578335] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 7.588095] systemd[1]: Starting Post-Boot Actions... machine # [ 7.591939] systemd[1]: Started Reset console on configuration changes. machine # [ 7.595664] systemd[1]: Starting resolvconf update... machine # [ 7.601212] systemd[1]: Started rustfs.service. machine # [ 7.607698] systemd[1]: Starting rustfs-bucket.service... machine # [ 7.620588] systemd[1]: Starting D-Bus System Message Bus... machine # [ 7.642236] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 7.645643] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 7.647747] nsncd[491]: Sep 30 09:25:40.593 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 7.649964] systemd[1]: Reached target User and Group Name Lookups. machine # [ 7.651097] systemd[1]: Starting User Login Management... machine # [ 7.652478] systemd[1]: Finished Post-Boot Actions. machine # connecting to host... machine # [ 7.661289] systemd[1]: Finished Import lastlog data into lastlog2 database. machine: Guest shell says: b'Spawning backdoor root shell...\n' machine: connected to guest root shell machine: (connecting took 8.31 seconds) machine: (finished: waiting for the VM to finish booting, in 8.66 seconds) machine # [ 7.715524] systemd-logind[514]: New seat seat0. machine # [ 7.717479] systemd-logind[514]: Watching system buttons on /dev/input/event2 (Power Button) machine # [ 7.719132] systemd-logind[514]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) machine # [ 7.720402] systemd-logind[514]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) machine # [ 7.721886] systemd[1]: Started User Login Management. machine # [ 7.722715] systemd[1]: Starting linger-users.service... machine # [ 7.724322] dbus-broker-launch[498]: Looking up NSS user entry for 'systemd-timesync'... machine # [ 7.732325] dbus-broker-launch[498]: NSS returned no entry for 'systemd-timesync' machine # [ 7.733455] dbus-broker-launch[498]: Invalid user-name in /nix/store/g7pg57y182bsrh126xs4av309lnxhndq-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" machine # [ 7.749385] systemd[1]: Started D-Bus System Message Bus. machine # [ 7.752493] systemd[1]: Stopped target Host and Network Name Lookups. machine # [ 7.754110] systemd[1]: Stopping Host and Network Name Lookups... machine # [ 7.754926] systemd[1]: Stopped target User and Group Name Lookups. machine # [ 7.755819] systemd[1]: Stopping User and Group Name Lookups... machine # [ 7.757108] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... machine # [ 7.758615] systemd[1]: nscd.service: Deactivated successfully. machine # [ 7.759686] systemd[1]: Stopped Name Service Cache Daemon (nsncd). machine # [ 7.761951] systemd[1]: linger-users.service: Deactivated successfully. machine # [ 7.762963] systemd[1]: Finished linger-users.service. machine # [ 7.763994] dbus-broker-launch[498]: Ready machine # [ 7.767626] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 7.800549] nsncd[596]: Sep 30 09:25:40.754 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 7.802629] systemd[1]: Finished resolvconf update. machine # [ 7.804282] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 7.805727] systemd[1]: Reached target Preparation for Network. machine # [ 7.808247] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 7.808896] systemd[1]: Reached target User and Group Name Lookups. machine # [ 7.810949] systemd[1]: Starting DHCP Client... machine # [ 7.813141] systemd[1]: Starting Address configuration of eth1... machine # [ 7.815547] systemd[1]: Starting Extra networking commands.... machine # [ 7.883501] network-addresses-eth1-start[624]: adding address 192.168.1.1/24... done machine # [ 7.892493] network-addresses-eth1-start[624]: adding address 2001:db8:1::1/64... done machine # [ 7.902570] systemd[1]: Finished Address configuration of eth1. machine # [ 7.913655] dhcpcd[635]: dhcpcd-10.3.2 starting machine # [ 7.918057] dhcpcd[693]: dev: loaded udev machine # [ 8.082622] 8021q: 802.1Q VLAN Support v1.8 machine # [ 8.083087] 8021q: adding VLAN 0 to HW filter on device eth1 machine # [ 7.928987] systemd[1]: Finished Extra networking commands.. machine # [ 7.930333] systemd[1]: Reached target Network. machine # [ 7.932992] systemd[1]: Starting PostgreSQL Server... machine # [ 7.934781] systemd[1]: Starting Permit User Sessions... machine # [ 7.947425] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. machine # [ 7.960637] systemd[1]: Finished Permit User Sessions. machine # [ 7.963749] systemd[1]: Started Getty on tty1. machine # [ 7.964990] systemd[1]: Reached target Login Prompts. machine # [ 8.175217] cfg80211: Loading compiled-in X.509 certificates for regulatory database machine # [ 8.187246] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' machine # [ 8.188102] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' machine # [ 8.189850] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 machine # [ 8.190778] cfg80211: failed to load regulatory.db machine # [ 8.048757] postgresql-pre-start[712]: The files belonging to this database system will be owned by user "postgres". machine # [ 8.050389] postgresql-pre-start[712]: This user must also own the server process. machine # [ 8.052298] postgresql-pre-start[712]: The database cluster will be initialized with locale "en_US.UTF-8". machine # [ 8.053639] postgresql-pre-start[712]: The default database encoding has accordingly been set to "UTF8". machine # [ 8.055126] postgresql-pre-start[712]: The default text search configuration will be set to "english". machine # [ 8.055714] postgresql-pre-start[712]: Data page checksums are enabled. machine # [ 8.056452] postgresql-pre-start[712]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok machine # [ 8.056876] postgresql-pre-start[712]: creating subdirectories ... ok machine # [ 8.057501] postgresql-pre-start[712]: selecting dynamic shared memory implementation ... posix machine # [ 8.238202] 8021q: adding VLAN 0 to HW filter on device eth0 machine # [ 8.085746] dhcpcd[693]: eth0: waiting for carrier machine # [ 8.086597] dhcpcd[693]: eth0: carrier acquired machine # [ 8.094292] dhcpcd[693]: DUID 00:01:00:01:32:4f:92:15:52:54:00:12:34:56 machine # [ 8.094991] dhcpcd[693]: eth0: IAID 00:12:34:56 machine # [ 8.095529] dhcpcd[693]: eth0: adding address fe80::5054:ff:fe12:3456 machine # [ 8.115653] postgresql-pre-start[712]: selecting default "max_connections" ... 100 machine # [ 8.172971] postgresql-pre-start[712]: selecting default "shared_buffers" ... 128MB machine # [ 8.798183] postgresql-pre-start[712]: selecting default time zone ... UTC machine # [ 8.801278] postgresql-pre-start[712]: creating configuration files ... ok machine # [ 8.998266] postgresql-pre-start[712]: running bootstrap script ... ok machine # [ 9.421807] postgresql-pre-start[712]: performing post-bootstrap initialization ... ok machine # [ 9.598168] postgresql-pre-start[712]: syncing data to disk ... ok machine # [ 9.600236] postgresql-pre-start[712]: initdb: warning: enabling "trust" authentication for local connections machine # [ 9.601952] postgresql-pre-start[712]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. machine # [ 9.603904] postgresql-pre-start[712]: Success. You can now start the database server using: machine # [ 9.605880] postgresql-pre-start[712]: pg_ctl -D /var/lib/postgresql/18 -l logfile start machine # [ 9.713498] postgres[747]: [747] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit machine # [ 9.718059] postgres[747]: [747] LOG: listening on IPv6 address "::1", port 5432 machine # [ 9.719531] postgres[747]: [747] LOG: listening on IPv4 address "127.0.0.1", port 5432 machine # [ 9.727329] postgres[747]: [747] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" machine # [ 9.742332] postgres[756]: [756] LOG: database system was shut down at 2026-09-30 09:25:42 GMT machine # [ 9.749136] postgres[747]: [747] LOG: database system is ready to accept connections machine # [ 9.753864] systemd[1]: Started PostgreSQL Server. machine # [ 9.757982] systemd[1]: Starting PostgreSQL Setup Scripts... machine # [ 9.849432] dhcpcd[693]: eth0: soliciting a DHCP lease machine # [ 10.024243] NET: Registered PF_PACKET protocol family machine # [ 9.876976] dhcpcd[693]: eth0: offered 10.0.2.15 from 10.0.2.2 machine # [ 9.884587] dhcpcd[693]: eth0: probing address 10.0.2.15/24 machine # [ 9.937992] postgresql-setup-start[769]: CREATE DATABASE machine # [ 9.949417] dhcpcd[693]: eth0: soliciting an IPv6 router machine # [ 9.950342] dhcpcd[693]: eth0: Router Advertisement from fe80::2 machine # [ 9.950908] dhcpcd[693]: eth0: adding address fec0::5054:ff:fe12:3456/64 machine # [ 9.951679] dhcpcd[693]: eth0: adding route to fec0::/64 machine # [ 9.952277] dhcpcd[693]: eth0: adding default route via fe80::2 machine # [ 9.971406] postgresql-setup-start[783]: CREATE ROLE machine # [ 9.984278] postgresql-setup-start[785]: ALTER DATABASE machine # [ 9.986982] systemd[1]: Finished PostgreSQL Setup Scripts. machine # [ 9.987751] systemd[1]: Reached target PostgreSQL. machine # [ 15.672319] dhcpcd[693]: eth0: leased 10.0.2.15 for 86400 seconds machine # [ 15.674717] dhcpcd[693]: eth0: adding route to 10.0.2.0/24 machine # [ 15.676736] dhcpcd[693]: eth0: adding default route via 10.0.2.2 machine # [ 15.802207] systemd[1]: Started DHCP Client. machine # [ 15.803656] systemd[1]: Reached target Network is Online. machine # [ 15.806821] systemd[1]: Starting k3s service... machine # [ 15.866143] k3s[894]: time="2026-09-30T09:25:48Z" level=info msg="Acquiring lock file /var/lib/rancher/k3s/data/.lock" machine # [ 15.866861] k3s[894]: time="2026-09-30T09:25:48Z" level=info msg="Preparing data dir /var/lib/rancher/k3s/data/53c81a1072dac7aebc0a3715f02f26b7ba95e9416f42c7f7aeed55ccb68af709" machine # [ 17.928305] k3s[894]: time="2026-09-30T09:25:50Z" level=info msg="Starting k3s 1.36.4+k3s1 (4dedb15b)" machine # [ 17.939106] k3s[894]: time="2026-09-30T09:25:50Z" level=info msg="Configuring sqlite3 database connection pooling: maxIdle=20, maxOpen=0, maxLifetime=0s, maxIdleTime=2m0s" machine # [ 17.941449] k3s[894]: time="2026-09-30T09:25:50Z" level=info msg="Kine built with sqlite from github.com/mattn/go-sqlite3 version 3.53.3" machine # [ 17.942242] k3s[894]: time="2026-09-30T09:25:50Z" level=info msg="Configuring database table schema and indexes, this may take a moment..." machine # [ 17.955614] k3s[894]: time="2026-09-30T09:25:50Z" level=info msg="Database tables and indexes are up to date" machine # [ 17.956170] k3s[894]: time="2026-09-30T09:25:50Z" level=info msg="Running startup VACUUM to reclaim disk space, this may take a moment..." machine # [ 17.962849] k3s[894]: time="2026-09-30T09:25:50Z" level=info msg="Startup VACUUM completed successfully" machine # [ 17.965551] k3s[894]: time="2026-09-30T09:25:50Z" level=info msg="Kine available at unix://kine.sock" machine # [ 17.966657] k3s[894]: time="2026-09-30T09:25:50Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 17.970978] k3s[894]: time="2026-09-30T09:25:50Z" level=info msg="Datastore connection validated successfully, proceeding with bootstrap data generation" machine # [ 17.972132] k3s[894]: time="2026-09-30T09:25:50Z" level=info msg="generated self-signed CA certificate CN=k3s-client-ca@1790760350: notBefore=2026-09-30 08:25:50.925984306 +0000 UTC notAfter=2036-09-27 08:25:50.925984306 +0000 UTC" machine # [ 17.972859] k3s[894]: time="2026-09-30T09:25:50Z" level=info msg="certificate CN=system:admin,O=system:masters signed by CN=k3s-client-ca@1790760350: notBefore=2026-09-30 08:25:50 +0000 UTC notAfter=2027-09-30 08:25:50 +0000 UTC" machine # [ 17.973857] k3s[894]: time="2026-09-30T09:25:50Z" level=info msg="certificate CN=system:k3s-supervisor,O=system:masters signed by CN=k3s-client-ca@1790760350: notBefore=2026-09-30 08:25:50 +0000 UTC notAfter=2027-09-30 08:25:50 +0000 UTC" machine # [ 17.974711] k3s[894]: time="2026-09-30T09:25:50Z" level=info msg="certificate CN=system:kube-controller-manager signed by CN=k3s-client-ca@1790760350: notBefore=2026-09-30 08:25:50 +0000 UTC notAfter=2027-09-30 08:25:50 +0000 UTC" machine # [ 17.975608] k3s[894]: time="2026-09-30T09:25:50Z" level=info msg="certificate CN=system:kube-scheduler signed by CN=k3s-client-ca@1790760350: notBefore=2026-09-30 08:25:50 +0000 UTC notAfter=2027-09-30 08:25:50 +0000 UTC" machine # [ 17.976129] k3s[894]: time="2026-09-30T09:25:50Z" level=info msg="certificate CN=system:apiserver,O=system:masters signed by CN=k3s-client-ca@1790760350: notBefore=2026-09-30 08:25:50 +0000 UTC notAfter=2027-09-30 08:25:50 +0000 UTC" machine # [ 17.976948] k3s[894]: time="2026-09-30T09:25:50Z" level=info msg="certificate CN=k3s-cloud-controller-manager signed by CN=k3s-client-ca@1790760350: notBefore=2026-09-30 08:25:50 +0000 UTC notAfter=2027-09-30 08:25:50 +0000 UTC" machine # [ 17.977757] k3s[894]: time="2026-09-30T09:25:50Z" level=info msg="generated self-signed CA certificate CN=k3s-server-ca@1790760350: notBefore=2026-09-30 08:25:50.929094199 +0000 UTC notAfter=2036-09-27 08:25:50.929094199 +0000 UTC" machine # [ 17.978429] k3s[894]: time="2026-09-30T09:25:50Z" level=info msg="certificate CN=kube-apiserver signed by CN=k3s-server-ca@1790760350: notBefore=2026-09-30 08:25:50 +0000 UTC notAfter=2027-09-30 08:25:50 +0000 UTC" machine # [ 17.979197] k3s[894]: time="2026-09-30T09:25:50Z" level=info msg="certificate CN=kube-scheduler signed by CN=k3s-server-ca@1790760350: notBefore=2026-09-30 08:25:50 +0000 UTC notAfter=2027-09-30 08:25:50 +0000 UTC" machine # [ 17.979843] k3s[894]: time="2026-09-30T09:25:50Z" level=info msg="certificate CN=kube-controller-manager signed by CN=k3s-server-ca@1790760350: notBefore=2026-09-30 08:25:50 +0000 UTC notAfter=2027-09-30 08:25:50 +0000 UTC" machine # [ 17.980741] k3s[894]: time="2026-09-30T09:25:50Z" level=info msg="generated self-signed CA certificate CN=k3s-request-header-ca@1790760350: notBefore=2026-09-30 08:25:50.930715354 +0000 UTC notAfter=2036-09-27 08:25:50.930715354 +0000 UTC" machine # [ 17.981575] k3s[894]: time="2026-09-30T09:25:50Z" level=info msg="certificate CN=system:auth-proxy signed by CN=k3s-request-header-ca@1790760350: notBefore=2026-09-30 08:25:50 +0000 UTC notAfter=2027-09-30 08:25:50 +0000 UTC" machine # [ 17.982260] k3s[894]: time="2026-09-30T09:25:50Z" level=info msg="generated self-signed CA certificate CN=etcd-server-ca@1790760350: notBefore=2026-09-30 08:25:50.931396167 +0000 UTC notAfter=2036-09-27 08:25:50.931396167 +0000 UTC" machine # [ 17.983062] k3s[894]: time="2026-09-30T09:25:50Z" level=info msg="certificate CN=etcd-client signed by CN=etcd-server-ca@1790760350: notBefore=2026-09-30 08:25:50 +0000 UTC notAfter=2027-09-30 08:25:50 +0000 UTC" machine # [ 17.983656] k3s[894]: time="2026-09-30T09:25:50Z" level=info msg="generated self-signed CA certificate CN=etcd-peer-ca@1790760350: notBefore=2026-09-30 08:25:50.932151012 +0000 UTC notAfter=2036-09-27 08:25:50.932151012 +0000 UTC" machine # [ 17.984519] k3s[894]: time="2026-09-30T09:25:50Z" level=info msg="certificate CN=etcd-peer signed by CN=etcd-peer-ca@1790760350: notBefore=2026-09-30 08:25:50 +0000 UTC notAfter=2027-09-30 08:25:50 +0000 UTC" machine # [ 17.985312] k3s[894]: time="2026-09-30T09:25:50Z" level=info msg="certificate CN=etcd-server signed by CN=etcd-server-ca@1790760350: notBefore=2026-09-30 08:25:50 +0000 UTC notAfter=2027-09-30 08:25:50 +0000 UTC" machine # [ 18.064701] k3s[894]: time="2026-09-30T09:25:51Z" level=info msg="certificate CN=k3s,O=k3s signed by CN=k3s-server-ca@1790760350: notBefore=2026-09-30 08:25:51 +0000 UTC notAfter=2027-09-30 08:25:51 +0000 UTC" machine # [ 18.067956] k3s[894]: time="2026-09-30T09:25:51Z" level=warning msg="dynamiclistener [::]:6443: no cached certificate available for preload - deferring certificate load until storage initialization or first client request" machine # [ 18.071406] k3s[894]: time="2026-09-30T09:25:51Z" level=info msg="Active TLS secret / (ver=) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__e0ea_959f_beb6_97cd-42ad81:fec0::e0ea:959f:beb6:97cd listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=38A2A32C15C605DC0C3D4A06FBD2801794179A0A]" machine # [ 18.865547] rustfs-bucket-start[923]: mb s3://farm machine # [ 18.875288] systemd[1]: Finished rustfs-bucket.service. machine # [ 19.053201] k3s[894]: time="2026-09-30T09:25:52Z" level=info msg="Password verified locally for node machine" machine # [ 19.054455] k3s[894]: time="2026-09-30T09:25:52Z" level=info msg="certificate CN=machine signed by CN=k3s-server-ca@1790760350: notBefore=2026-09-30 08:25:52 +0000 UTC notAfter=2027-09-30 08:25:52 +0000 UTC" machine # [ 19.294503] k3s[894]: time="2026-09-30T09:25:52Z" level=info msg="certificate CN=system:node:machine,O=system:nodes signed by CN=k3s-client-ca@1790760350: notBefore=2026-09-30 08:25:52 +0000 UTC notAfter=2027-09-30 08:25:52 +0000 UTC" machine # [ 19.403302] k3s[894]: time="2026-09-30T09:25:52Z" level=info msg="certificate CN=system:kube-proxy signed by CN=k3s-client-ca@1790760350: notBefore=2026-09-30 08:25:52 +0000 UTC notAfter=2027-09-30 08:25:52 +0000 UTC" machine # [ 19.490090] k3s[894]: time="2026-09-30T09:25:52Z" level=info msg="certificate CN=system:k3s-controller signed by CN=k3s-client-ca@1790760350: notBefore=2026-09-30 08:25:52 +0000 UTC notAfter=2027-09-30 08:25:52 +0000 UTC" machine # [ 19.579281] k3s[894]: time="2026-09-30T09:25:52Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:34620: runtime core not ready" machine # [ 19.661180] k3s[894]: time="2026-09-30T09:25:52Z" level=info msg="Module overlay was already loaded" machine # [ 19.922746] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. machine # [ 19.927506] Bridge firewalling registered machine # [ 19.782639] k3s[894]: time="2026-09-30T09:25:52Z" level=warning msg="Failed to load kernel module iptable_nat with modprobe" machine # [ 19.792354] k3s[894]: time="2026-09-30T09:25:52Z" level=warning msg="Failed to load kernel module iptable_filter with modprobe" machine # [ 19.804496] k3s[894]: time="2026-09-30T09:25:52Z" level=warning msg="Failed to load kernel module nft-expr-counter with modprobe" machine # [ 19.886426] k3s[894]: time="2026-09-30T09:25:52Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400" machine # [ 19.887701] k3s[894]: time="2026-09-30T09:25:52Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600" machine # [ 19.889039] k3s[894]: time="2026-09-30T09:25:52Z" level=info msg="Set sysctl 'net/ipv4/conf/all/forwarding' to 1" machine # [ 19.889871] k3s[894]: time="2026-09-30T09:25:52Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_max' to 131072" machine # [ 19.891910] k3s[894]: time="2026-09-30T09:25:52Z" level=info msg="Creating k3s-cert-monitor event broadcaster" machine # [ 19.892991] k3s[894]: time="2026-09-30T09:25:52Z" level=info msg="Connecting to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 19.893869] k3s[894]: time="2026-09-30T09:25:52Z" level=info msg="Saving cluster bootstrap data to datastore" machine # [ 19.897595] k3s[894]: time="2026-09-30T09:25:52Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 19.900404] k3s[894]: time="2026-09-30T09:25:52Z" level=info msg="Connection to etcd is ready" machine # [ 19.902073] k3s[894]: time="2026-09-30T09:25:52Z" level=info msg="ETCD server is now running" machine # [ 19.904344] k3s[894]: time="2026-09-30T09:25:52Z" level=info msg="Polling for API server readiness: GET /readyz failed: the server is currently unable to handle the request" machine # [ 19.906174] k3s[894]: time="2026-09-30T09:25:52Z" level=info msg="Handling backend connection request [machine]" machine # [ 19.908346] k3s[894]: time="2026-09-30T09:25:52Z" level=info msg="Connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 19.909849] k3s[894]: time="2026-09-30T09:25:52Z" level=info msg="Remotedialer connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 19.911394] k3s[894]: time="2026-09-30T09:25:52Z" level=info msg="Running kube-apiserver --advertise-port=6443 --allow-privileged=true --anonymous-auth=false --api-audiences=https://kubernetes.default.svc.cluster.local,k3s --authorization-mode=Node,RBAC --bind-address=127.0.0.1 --cert-dir=/var/lib/rancher/k3s/server/tls/temporary-certs --client-ca-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --egress-selector-config-file=/var/lib/rancher/k3s/server/etc/egress-selector-config.yaml --enable-admission-plugins=NodeRestriction --enable-aggregator-routing=true --enable-bootstrap-token-auth=true --etcd-servers=unix://kine.sock --kubelet-certificate-authority=/var/lib/rancher/k3s/server/tls/server-ca.crt --kubelet-client-certificate=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.crt --kubelet-client-key=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.key --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --profiling=false --proxy-client-cert-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt --proxy-client-key-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.key --requestheader-allowed-names=system:auth-proxy --requestheader-client-ca-file=/var/lib/rancher/k3s/server/tls/request-header-ca.crt --requestheader-extra-headers-prefix=X-Remote-Extra- --requestheader-group-headers=X-Remote-Group --requestheader-username-headers=X-Remote-User --secure-port=6444 --service-account-issuer=https://kubernetes.default.svc.cluster.local --service-account-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-account-signing-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --storage-backend=etcd3 --tls-cert-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --tls-private-key-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 19.913929] k3s[894]: time="2026-09-30T09:25:52Z" level=info msg="Running kube-scheduler --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --bind-address=127.0.0.1 --kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --leader-elect=false --profiling=false --secure-port=10259 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 19.915303] k3s[894]: time="2026-09-30T09:25:52Z" level=info msg="Running kube-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --bind-address=127.0.0.1 --cluster-cidr=10.42.0.0/16 --cluster-signing-kube-apiserver-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kube-apiserver-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kubelet-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-serving-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-kubelet-serving-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --cluster-signing-legacy-unknown-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-legacy-unknown-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --configure-cloud-routes=false --controllers=*,tokencleaner,-service,-route,-cloud-node-lifecycle --kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --leader-elect=false --profiling=false --root-ca-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --secure-port=10257 --service-account-private-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key --use-service-account-credentials=true" machine # [ 19.966825] k3s[894]: time="2026-09-30T09:25:52Z" level=info msg="Running cloud-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --bind-address=127.0.0.1 --cloud-config=/var/lib/rancher/k3s/server/etc/cloud-config.yaml --cloud-provider=k3s --cluster-cidr=10.42.0.0/16 --configure-cloud-routes=false --controllers=*,-route --kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --leader-elect=false --leader-elect-resource-name=k3s-cloud-controller-manager --node-status-update-frequency=1m0s --profiling=false" machine # [ 19.967889] k3s[894]: time="2026-09-30T09:25:52Z" level=info msg="Server node token is available at /var/lib/rancher/k3s/server/token" machine # [ 19.968791] k3s[894]: time="2026-09-30T09:25:52Z" level=info msg="To join server node to cluster: k3s server -s https://10.0.2.15:6443 -t ${SERVER_NODE_TOKEN}" machine # [ 19.969667] k3s[894]: time="2026-09-30T09:25:52Z" level=info msg="Agent node token is available at /var/lib/rancher/k3s/server/agent-token" machine # [ 19.970787] k3s[894]: time="2026-09-30T09:25:52Z" level=info msg="To join agent node to cluster: k3s agent -s https://10.0.2.15:6443 -t ${AGENT_NODE_TOKEN}" machine # [ 19.971640] k3s[894]: time="2026-09-30T09:25:52Z" level=info msg="Wrote kubeconfig /etc/rancher/k3s/k3s.yaml" machine # [ 19.972578] k3s[894]: time="2026-09-30T09:25:52Z" level=info msg="Run: k3s kubectl" machine # [ 19.973290] k3s[894]: I0930 09:25:52.862801 894 options.go:263] external host was not specified, using 10.0.2.15 machine # [ 19.973810] k3s[894]: I0930 09:25:52.867501 894 server.go:158] Version: v1.36.4+k3s1 machine # [ 19.974734] k3s[894]: I0930 09:25:52.867575 894 server.go:160] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 19.975713] k3s[894]: time="2026-09-30T09:25:52Z" level=info msg="Logging containerd to /var/lib/rancher/k3s/agent/containerd/containerd.log" machine # [ 19.976558] k3s[894]: time="2026-09-30T09:25:52Z" level=info msg="Running containerd -c /var/lib/rancher/k3s/agent/etc/containerd/config.toml" machine # [ 19.978737] k3s[894]: time="2026-09-30T09:25:52Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:34678: runtime core not ready" machine # [ 20.044090] k3s[894]: I0930 09:25:52.998178 894 shared_informer.go:381] "Waiting for caches to sync" controller="node_authorizer" machine # [ 20.044636] k3s[894]: E0930 09:25:52.998285 894 options.go:205] The manifest file is empty, ignoring. machine # [ 20.050836] k3s[894]: I0930 09:25:53.005413 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 20.055390] k3s[894]: I0930 09:25:53.009392 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 20.058530] k3s[894]: I0930 09:25:53.013094 894 plugins.go:157] Loaded 15 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,PodGroupProtection,RuntimeClass,DefaultIngressClass,PodTopologyLabels,MutatingAdmissionPolicy,MutatingAdmissionWebhook. machine # [ 20.060066] k3s[894]: I0930 09:25:53.013849 894 plugins.go:160] Loaded 17 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,PodGroupWorkloadExists,NodeDeclaredFeatureValidator,JobValidation,PodResizeValidator,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. machine # [ 20.060711] k3s[894]: I0930 09:25:53.014193 894 instance.go:240] Using reconciler: lease machine # [ 20.067836] k3s[894]: I0930 09:25:53.022408 894 handler.go:304] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager machine # [ 20.068630] k3s[894]: W0930 09:25:53.023220 894 genericapiserver.go:798] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. machine # [ 20.073424] k3s[894]: I0930 09:25:53.027979 894 cidrallocator.go:198] starting ServiceCIDR Allocator Controller machine # [ 20.113281] k3s[894]: I0930 09:25:53.067810 894 handler.go:304] Adding GroupVersion v1 to ResourceManager machine # [ 20.114700] k3s[894]: I0930 09:25:53.069282 894 apis.go:112] API group "internal.apiserver.k8s.io" is not enabled, skipping. machine # [ 20.146811] k3s[894]: time="2026-09-30T09:25:53Z" level=info msg="Running kube-proxy --cluster-cidr=10.42.0.0/16 --conntrack-max-per-core=0 --conntrack-tcp-timeout-close-wait=0s --conntrack-tcp-timeout-established=0s --healthz-bind-address=127.0.0.1 --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubeproxy.kubeconfig --proxy-mode=iptables" machine # [ 20.147589] k3s[894]: I0930 09:25:53.101502 894 apis.go:112] API group "storagemigration.k8s.io" is not enabled, skipping. machine # [ 20.186440] k3s[894]: I0930 09:25:53.140854 894 handler.go:304] Adding GroupVersion authentication.k8s.io v1 to ResourceManager machine # [ 20.186972] k3s[894]: W0930 09:25:53.140887 894 genericapiserver.go:798] Skipping API authentication.k8s.io/v1beta1 because it has no resources. machine # [ 20.187641] k3s[894]: W0930 09:25:53.140897 894 genericapiserver.go:798] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. machine # [ 20.188611] k3s[894]: I0930 09:25:53.143182 894 handler.go:304] Adding GroupVersion authorization.k8s.io v1 to ResourceManager machine # [ 20.189530] k3s[894]: W0930 09:25:53.143213 894 genericapiserver.go:798] Skipping API authorization.k8s.io/v1beta1 because it has no resources. machine # [ 20.190029] k3s[894]: I0930 09:25:53.143919 894 handler.go:304] Adding GroupVersion autoscaling v2 to ResourceManager machine # [ 20.190476] k3s[894]: I0930 09:25:53.144380 894 handler.go:304] Adding GroupVersion autoscaling v1 to ResourceManager machine # [ 20.190982] k3s[894]: I0930 09:25:53.145227 894 handler.go:304] Adding GroupVersion batch v1 to ResourceManager machine # [ 20.191666] k3s[894]: W0930 09:25:53.145244 894 genericapiserver.go:798] Skipping API batch/v1beta1 because it has no resources. machine # [ 20.192206] k3s[894]: I0930 09:25:53.145853 894 handler.go:304] Adding GroupVersion certificates.k8s.io v1 to ResourceManager machine # [ 20.192617] k3s[894]: W0930 09:25:53.145870 894 genericapiserver.go:798] Skipping API certificates.k8s.io/v1beta1 because it has no resources. machine # [ 20.193177] k3s[894]: W0930 09:25:53.145881 894 genericapiserver.go:798] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. machine # [ 20.193770] k3s[894]: I0930 09:25:53.146202 894 handler.go:304] Adding GroupVersion coordination.k8s.io v1 to ResourceManager machine # [ 20.194594] k3s[894]: W0930 09:25:53.146216 894 genericapiserver.go:798] Skipping API coordination.k8s.io/v1beta1 because it has no resources. machine # [ 20.195628] k3s[894]: W0930 09:25:53.146226 894 genericapiserver.go:798] Skipping API coordination.k8s.io/v1alpha2 because it has no resources. machine # [ 20.196351] k3s[894]: I0930 09:25:53.146570 894 handler.go:304] Adding GroupVersion discovery.k8s.io v1 to ResourceManager machine # [ 20.196829] k3s[894]: W0930 09:25:53.146586 894 genericapiserver.go:798] Skipping API discovery.k8s.io/v1beta1 because it has no resources. machine # [ 20.197495] k3s[894]: I0930 09:25:53.148427 894 handler.go:304] Adding GroupVersion networking.k8s.io v1 to ResourceManager machine # [ 20.197925] k3s[894]: W0930 09:25:53.148448 894 genericapiserver.go:798] Skipping API networking.k8s.io/v1beta1 because it has no resources. machine # [ 20.198938] k3s[894]: I0930 09:25:53.149029 894 handler.go:304] Adding GroupVersion node.k8s.io v1 to ResourceManager machine # [ 20.200139] k3s[894]: W0930 09:25:53.149044 894 genericapiserver.go:798] Skipping API node.k8s.io/v1beta1 because it has no resources. machine # [ 20.200555] k3s[894]: W0930 09:25:53.149055 894 genericapiserver.go:798] Skipping API node.k8s.io/v1alpha1 because it has no resources. machine # [ 20.201076] k3s[894]: I0930 09:25:53.149488 894 handler.go:304] Adding GroupVersion policy v1 to ResourceManager machine # [ 20.201544] k3s[894]: W0930 09:25:53.149504 894 genericapiserver.go:798] Skipping API policy/v1beta1 because it has no resources. machine # [ 20.202129] k3s[894]: I0930 09:25:53.150532 894 handler.go:304] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager machine # [ 20.203154] k3s[894]: W0930 09:25:53.150550 894 genericapiserver.go:798] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. machine # [ 20.203647] k3s[894]: W0930 09:25:53.150561 894 genericapiserver.go:798] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. machine # [ 20.204198] k3s[894]: I0930 09:25:53.150925 894 handler.go:304] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager machine # [ 20.204689] k3s[894]: W0930 09:25:53.150941 894 genericapiserver.go:798] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. machine # [ 20.205183] k3s[894]: W0930 09:25:53.150951 894 genericapiserver.go:798] Skipping API scheduling.k8s.io/v1alpha2 because it has no resources. machine # [ 20.205679] k3s[894]: I0930 09:25:53.152376 894 handler.go:304] Adding GroupVersion storage.k8s.io v1 to ResourceManager machine # [ 20.206215] k3s[894]: W0930 09:25:53.152404 894 genericapiserver.go:798] Skipping API storage.k8s.io/v1beta1 because it has no resources. machine # [ 20.206676] k3s[894]: W0930 09:25:53.152414 894 genericapiserver.go:798] Skipping API storage.k8s.io/v1alpha1 because it has no resources. machine # [ 20.207229] k3s[894]: I0930 09:25:53.153035 894 handler.go:304] Adding GroupVersion flowcontrol.apiserver.k8s.io v1 to ResourceManager machine # [ 20.207647] k3s[894]: W0930 09:25:53.153051 894 genericapiserver.go:798] Skipping API flowcontrol.apiserver.k8s.io/v1beta3 because it has no resources. machine # [ 20.208216] k3s[894]: W0930 09:25:53.153062 894 genericapiserver.go:798] Skipping API flowcontrol.apiserver.k8s.io/v1beta2 because it has no resources. machine # [ 20.208661] k3s[894]: W0930 09:25:53.153072 894 genericapiserver.go:798] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. machine # [ 20.209334] k3s[894]: I0930 09:25:53.155102 894 handler.go:304] Adding GroupVersion apps v1 to ResourceManager machine # [ 20.209825] k3s[894]: W0930 09:25:53.155121 894 genericapiserver.go:798] Skipping API apps/v1beta2 because it has no resources. machine # [ 20.210468] k3s[894]: W0930 09:25:53.155133 894 genericapiserver.go:798] Skipping API apps/v1beta1 because it has no resources. machine # [ 20.210928] k3s[894]: I0930 09:25:53.156530 894 handler.go:304] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager machine # [ 20.211613] k3s[894]: W0930 09:25:53.156547 894 genericapiserver.go:798] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. machine # [ 20.212186] k3s[894]: W0930 09:25:53.156558 894 genericapiserver.go:798] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. machine # [ 20.212642] k3s[894]: I0930 09:25:53.156930 894 handler.go:304] Adding GroupVersion events.k8s.io v1 to ResourceManager machine # [ 20.213229] k3s[894]: W0930 09:25:53.156946 894 genericapiserver.go:798] Skipping API events.k8s.io/v1beta1 because it has no resources. machine # [ 20.213671] k3s[894]: I0930 09:25:53.157993 894 handler.go:304] Adding GroupVersion resource.k8s.io v1 to ResourceManager machine # [ 20.214033] k3s[894]: W0930 09:25:53.158013 894 genericapiserver.go:798] Skipping API resource.k8s.io/v1beta2 because it has no resources. machine # [ 20.214525] k3s[894]: W0930 09:25:53.158024 894 genericapiserver.go:798] Skipping API resource.k8s.io/v1beta1 because it has no resources. machine # [ 20.215509] k3s[894]: W0930 09:25:53.158033 894 genericapiserver.go:798] Skipping API resource.k8s.io/v1alpha3 because it has no resources. machine # [ 20.254795] k3s[894]: I0930 09:25:53.160846 894 handler.go:304] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager machine # [ 20.255055] k3s[894]: W0930 09:25:53.160864 894 genericapiserver.go:798] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. machine # [ 20.557576] k3s[894]: I0930 09:25:53.512005 894 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 20.558566] k3s[894]: I0930 09:25:53.512168 894 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 20.558970] k3s[894]: I0930 09:25:53.512259 894 secure_serving.go:214] Serving securely on 127.0.0.1:6444 machine # [ 20.559629] k3s[894]: I0930 09:25:53.512007 894 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 20.560151] k3s[894]: I0930 09:25:53.512616 894 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 20.560568] k3s[894]: I0930 09:25:53.512972 894 apf_controller.go:377] Starting API Priority and Fairness config controller machine # [ 20.569692] k3s[894]: I0930 09:25:53.522426 894 local_available_controller.go:156] Starting LocalAvailability controller machine # [ 20.570477] k3s[894]: I0930 09:25:53.522463 894 cache.go:32] Waiting for caches to sync for LocalAvailability controller machine # [ 20.570996] k3s[894]: time="2026-09-30T09:25:53Z" level=info msg=Starting controller=kubernetes-service-cidr-controller logger=k3s machine # [ 20.571506] k3s[894]: time="2026-09-30T09:25:53Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 20.571968] k3s[894]: time="2026-09-30T09:25:53Z" level=info msg="Starting apiserver lease garbage collector" logger=k3s machine # [ 20.572603] k3s[894]: time="2026-09-30T09:25:53Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 20.574081] k3s[894]: I0930 09:25:53.522689 894 aggregator.go:185] waiting for initial CRD sync... machine # [ 20.574714] k3s[894]: I0930 09:25:53.523235 894 crdregistration_controller.go:114] Starting crd-autoregister controller machine # [ 20.575221] k3s[894]: I0930 09:25:53.523251 894 storage_readiness_hook.go:70] Storage is ready for all registered resources machine # [ 20.575672] k3s[894]: I0930 09:25:53.523253 894 shared_informer.go:381] "Waiting for caches to sync" controller="crd-autoregister" machine # [ 20.582378] k3s[894]: I0930 09:25:53.523313 894 dynamic_serving_content.go:135] "Starting controller" name="aggregator-proxy-cert::/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt::/var/lib/rancher/k3s/server/tls/client-auth-proxy.key" machine # [ 20.582968] k3s[894]: I0930 09:25:53.523454 894 repairip.go:210] Starting ipallocator-repair-controller machine # [ 20.583642] k3s[894]: I0930 09:25:53.523481 894 shared_informer.go:381] "Waiting for caches to sync" controller="ipallocator-repair-controller" machine # [ 20.584189] k3s[894]: I0930 09:25:53.523544 894 controller.go:113] "Deleting old lease on startup" lease="kube-system/apiserver-ik4pcwfs7qgdl76byc4pomgvia" machine # [ 20.584637] k3s[894]: I0930 09:25:53.523848 894 cluster_authentication_trust_controller.go:459] Starting cluster_authentication_trust_controller controller machine # [ 20.585155] k3s[894]: time="2026-09-30T09:25:53Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 20.585589] k3s[894]: I0930 09:25:53.523975 894 apiservice_controller.go:100] Starting APIServiceRegistrationController machine # [ 20.586114] k3s[894]: I0930 09:25:53.523987 894 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller machine # [ 20.586549] k3s[894]: I0930 09:25:53.524027 894 controller.go:87] "Starting OpenAPI AggregationController" machine # [ 20.587117] k3s[894]: I0930 09:25:53.524186 894 system_namespaces_controller.go:66] Starting system namespaces controller machine # [ 20.587593] k3s[894]: time="2026-09-30T09:25:53Z" level=info msg="Starting legacy_token_tracking_controller" logger=k3s machine # [ 20.588072] k3s[894]: time="2026-09-30T09:25:53Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 20.588499] k3s[894]: I0930 09:25:53.525305 894 remote_available_controller.go:434] Starting RemoteAvailability controller machine # [ 20.589046] k3s[894]: I0930 09:25:53.525329 894 cache.go:32] Waiting for caches to sync for RemoteAvailability controller machine # [ 20.589493] k3s[894]: I0930 09:25:53.525424 894 controller.go:89] "Starting OpenAPI V3 AggregationController" machine # [ 20.589948] k3s[894]: I0930 09:25:53.525895 894 customresource_discovery_controller.go:294] Starting DiscoveryController machine # [ 20.590637] k3s[894]: I0930 09:25:53.526989 894 controller.go:142] Starting OpenAPI controller machine # [ 20.591216] k3s[894]: I0930 09:25:53.527145 894 controller.go:90] Starting OpenAPI V3 controller machine # [ 20.591653] k3s[894]: I0930 09:25:53.527200 894 naming_controller.go:305] Starting NamingConditionController machine # [ 20.592196] k3s[894]: I0930 09:25:53.527337 894 nonstructuralschema_controller.go:202] Starting NonStructuralSchemaConditionController machine # [ 20.592672] k3s[894]: I0930 09:25:53.527414 894 apiapproval_controller.go:196] Starting KubernetesAPIApprovalPolicyConformantConditionController machine # [ 20.593035] k3s[894]: time="2026-09-30T09:25:53Z" level=info msg="Starting CRDFinalizer" logger=k3s machine # [ 20.593717] k3s[894]: I0930 09:25:53.527952 894 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 20.594417] k3s[894]: I0930 09:25:53.528156 894 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 20.646085] k3s[894]: I0930 09:25:53.599782 894 shared_informer.go:388] "Caches are synced" controller="node_authorizer" machine # [ 20.656815] k3s[894]: I0930 09:25:53.611336 894 shared_informer.go:409] "Caches are synced" machine # [ 20.657526] k3s[894]: I0930 09:25:53.611344 894 shared_informer.go:409] "Caches are synced" machine # [ 20.657973] k3s[894]: I0930 09:25:53.611383 894 policy_source.go:248] refreshing policies machine # [ 20.658611] k3s[894]: I0930 09:25:53.611463 894 policy_source.go:248] refreshing policies machine # [ 20.661180] k3s[894]: I0930 09:25:53.615730 894 apf_controller.go:382] Running API Priority and Fairness config worker machine # [ 20.661824] k3s[894]: I0930 09:25:53.616191 894 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process machine # [ 20.668321] k3s[894]: time="2026-09-30T09:25:53Z" level=info msg="Caches are synced" logger=k3s machine # [ 20.668940] k3s[894]: time="2026-09-30T09:25:53Z" level=info msg="Caches are synced" logger=k3s machine # [ 20.669552] k3s[894]: time="2026-09-30T09:25:53Z" level=info msg="Creating default ServiceCIDR" CIDRs="[10.43.0.0/16]" logger=k3s machine # [ 20.671843] k3s[894]: I0930 09:25:53.623014 894 cache.go:39] Caches are synced for LocalAvailability controller machine # [ 20.672506] k3s[894]: I0930 09:25:53.624162 894 shared_informer.go:388] "Caches are synced" controller="ipallocator-repair-controller" machine # [ 20.673031] k3s[894]: I0930 09:25:53.624191 894 shared_informer.go:388] "Caches are synced" controller="crd-autoregister" machine # [ 20.673477] k3s[894]: I0930 09:25:53.624547 894 cache.go:39] Caches are synced for APIServiceRegistrationController controller machine # [ 20.673933] k3s[894]: I0930 09:25:53.626573 894 aggregator.go:187] initial CRD sync complete... machine # [ 20.674605] k3s[894]: I0930 09:25:53.626587 894 autoregister_controller.go:144] Starting autoregister controller machine # [ 20.675135] k3s[894]: I0930 09:25:53.626599 894 cache.go:32] Waiting for caches to sync for autoregister controller machine # [ 20.675569] k3s[894]: I0930 09:25:53.626611 894 cache.go:39] Caches are synced for autoregister controller machine # [ 20.676095] k3s[894]: I0930 09:25:53.625999 894 cache.go:39] Caches are synced for RemoteAvailability controller machine # [ 20.676565] k3s[894]: I0930 09:25:53.627042 894 handler_discovery.go:459] Starting ResourceDiscoveryManager machine # [ 20.682064] k3s[894]: time="2026-09-30T09:25:53Z" level=info msg="Caches are synced" logger=k3s machine # [ 20.682671] k3s[894]: time="2026-09-30T09:25:53Z" level=info msg="Caches are synced" logger=k3s machine # [ 20.690759] k3s[894]: I0930 09:25:53.645314 894 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io machine # [ 20.697069] k3s[894]: I0930 09:25:53.650350 894 cidrallocator.go:302] created ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 20.698062] k3s[894]: time="2026-09-30T09:25:53Z" level=info msg="Setting default ServiceCIDR condition Ready to True" logger=k3s machine # [ 20.707051] k3s[894]: I0930 09:25:53.661602 894 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 20.725270] k3s[894]: I0930 09:25:53.679816 894 alloc.go:329] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.43.0.1"} machine # [ 20.731825] k3s[894]: W0930 09:25:53.686373 894 lease.go:265] Resetting endpoints for master service "kubernetes" to [10.0.2.15] machine # [ 20.735081] k3s[894]: I0930 09:25:53.689579 894 controller.go:667] quota admission added evaluator for: endpoints machine # [ 20.741460] k3s[894]: I0930 09:25:53.696015 894 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io machine # [ 20.748825] k3s[894]: E0930 09:25:53.702802 894 controller.go:102] Error removing old endpoints from kubernetes service: no API server IP addresses were listed in storage, refusing to erase all endpoints for the kubernetes Service machine # [ 20.932085] k3s[894]: time="2026-09-30T09:25:53Z" level=info msg="containerd is now running" machine # [ 20.944351] k3s[894]: time="2026-09-30T09:25:53Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/cwy4fa9w9cazmgb02cj0h80rfh3y6nb7-nix-grpc-farm-client.tar" machine # [ 21.576075] k3s[894]: I0930 09:25:54.530228 894 storage_scheduling.go:137] created PriorityClass system-node-critical with value 2000001000 machine # [ 21.580493] k3s[894]: I0930 09:25:54.535006 894 storage_scheduling.go:137] created PriorityClass system-cluster-critical with value 2000000000 machine # [ 21.581263] k3s[894]: I0930 09:25:54.535027 894 storage_scheduling.go:153] all system priority classes are created successfully or already exist. machine # [ 21.897703] k3s[894]: time="2026-09-30T09:25:54Z" level=info msg="Polling for API server readiness: GET /readyz failed: unknown" machine # [ 22.527626] k3s[894]: I0930 09:25:55.482136 894 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io machine # [ 22.569897] k3s[894]: I0930 09:25:55.524324 894 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io machine # [ 23.903079] k3s[894]: time="2026-09-30T09:25:56Z" level=info msg="Kube API server is now running" machine # [ 23.906685] k3s[894]: time="2026-09-30T09:25:56Z" level=info msg="k3s is up and running" machine # [ 23.909443] k3s[894]: time="2026-09-30T09:25:56Z" level=info msg="Waiting for untainted node" machine # [ 23.912167] k3s[894]: time="2026-09-30T09:25:56Z" level=info msg="Creating k3s-supervisor event broadcaster" machine # [ 23.915385] systemd[1]: Started k3s service. machine # [ 23.916702] systemd[1]: Starting niks3 server... machine # [ 23.922157] k3s[894]: time="2026-09-30T09:25:56Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Node and Certificate Authority certificates managed by k3s are OK" object=machine reason=CertificateExpirationOK type=Normal machine # [ 23.934316] k3s[894]: E0930 09:25:56.888801 894 options.go:205] The manifest file is empty, ignoring. machine # [ 23.937624] k3s[894]: I0930 09:25:56.891915 894 controllermanager.go:204] "Starting" version="v1.36.4+k3s1" machine # [ 23.938133] k3s[894]: I0930 09:25:56.891946 894 controllermanager.go:206] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 23.943070] k3s[894]: I0930 09:25:56.896901 894 secure_serving.go:214] Serving securely on 127.0.0.1:10257 machine # [ 23.943674] k3s[894]: I0930 09:25:56.897535 894 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 23.944198] k3s[894]: I0930 09:25:56.897558 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 23.944633] k3s[894]: I0930 09:25:56.897605 894 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key" machine # [ 23.949816] k3s[894]: I0930 09:25:56.900812 894 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 23.950427] k3s[894]: I0930 09:25:56.900854 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 23.950880] k3s[894]: I0930 09:25:56.900893 894 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 23.954537] k3s[894]: I0930 09:25:56.909112 894 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 23.955197] k3s[894]: I0930 09:25:56.909138 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 23.979071] k3s[894]: I0930 09:25:56.933594 894 controller.go:667] quota admission added evaluator for: serviceaccounts machine # [ 24.025438] k3s[894]: time="2026-09-30T09:25:56Z" level=info msg="Creating embedded CRD addons.k3s.cattle.io" machine # [ 24.030339] k3s[894]: time="2026-09-30T09:25:56Z" level=info msg="Creating embedded CRD etcdsnapshotfiles.k3s.cattle.io" machine # [ 24.033170] k3s[894]: I0930 09:25:56.987744 894 node_lifecycle_controller.go:402] "Controller will reconcile labels" logger="node-lifecycle-controller" machine # [ 24.037052] k3s[894]: I0930 09:25:56.991577 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 24.038760] k3s[894]: time="2026-09-30T09:25:56Z" level=info msg="Creating embedded CRD helmchartconfigs.helm.cattle.io" machine # [ 24.044113] k3s[894]: I0930 09:25:56.997959 894 shared_informer.go:409] "Caches are synced" machine # [ 24.046337] k3s[894]: I0930 09:25:57.000902 894 shared_informer.go:409] "Caches are synced" machine # [ 24.051542] k3s[894]: I0930 09:25:57.005436 894 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 24.054171] k3s[894]: time="2026-09-30T09:25:57Z" level=info msg="Creating embedded CRD helmcharts.helm.cattle.io" machine # [ 24.055051] k3s[894]: I0930 09:25:57.009563 894 shared_informer.go:409] "Caches are synced" machine # [ 24.068170] k3s[894]: I0930 09:25:57.022728 894 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 24.073959] k3s[894]: I0930 09:25:57.028387 894 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="resourcepoolstatusrequest-controller" requiredFeatureGates=["DRAResourcePoolStatus"] machine # [ 24.076089] k3s[894]: I0930 09:25:57.029213 894 controllermanager.go:641] "Warning: skipping controller" controller="resourcepoolstatusrequest-controller" machine # [ 24.077479] k3s[894]: I0930 09:25:57.031946 894 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 24.084267] k3s[894]: time="2026-09-30T09:25:57Z" level=info msg="Waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 24.099334] k3s[894]: I0930 09:25:57.053864 894 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 24.101612] k3s[894]: I0930 09:25:57.056182 894 controllermanager.go:641] "Warning: skipping controller" controller="storage-version-migrator-controller" machine # [ 24.237447] k3s[894]: I0930 09:25:57.191911 894 shared_informer.go:409] "Caches are synced" machine: (finished: waiting for unit k3s.service, in 25.55 seconds) machine: waiting for success: kubectl get ns farm machine # [ 24.596984] k3s[894]: time="2026-09-30T09:25:57Z" level=info msg="Done waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 24.597699] k3s[894]: time="2026-09-30T09:25:57Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-40.1.4+up40.1.0.tgz" machine # [ 24.600544] k3s[894]: time="2026-09-30T09:25:57Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-crd-40.1.4+up40.1.0.tgz" machine # [ 24.602942] k3s[894]: time="2026-09-30T09:25:57Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/ccm.yaml" machine # [ 24.603731] k3s[894]: time="2026-09-30T09:25:57Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/coredns.yaml" machine # [ 24.605958] k3s[894]: time="2026-09-30T09:25:57Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/local-storage.yaml" machine # [ 24.606759] k3s[894]: time="2026-09-30T09:25:57Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/rolebindings.yaml" machine # [ 24.609131] k3s[894]: time="2026-09-30T09:25:57Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/runtimes.yaml" machine # [ 24.610704] k3s[894]: time="2026-09-30T09:25:57Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/traefik.yaml" machine # [ 24.673786] k3s[894]: time="2026-09-30T09:25:57Z" level=info msg="Starting dynamiclistener CN filter node controller with SANs: [127.0.0.1 ::1 localhost machine 10.0.2.15 fec0::e0ea:959f:beb6:97cd 10.43.0.1 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local]" machine # [ 24.674551] k3s[894]: time="2026-09-30T09:25:57Z" level=info msg="Tunnel server egress proxy mode: agent" machine # [ 24.675199] k3s[894]: I0930 09:25:57.629453 894 controllermanager.go:689] "Warning: controller is disabled" controller="bootstrap-signer-controller" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 24.970055] k3s[894]: I0930 09:25:57.924103 894 range_allocator.go:113] "No Secondary Service CIDR provided. Skipping filtering out secondary service addresses" logger="node-ipam-controller" machine # [ 25.065607] k3s[894]: time="2026-09-30T09:25:58Z" level=info msg="Creating new TLS secret for kube-system/k3s-serving (count: 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__e0ea_959f_beb6_97cd-42ad81:fec0::e0ea:959f:beb6:97cd listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=38A2A32C15C605DC0C3D4A06FBD2801794179A0A]" machine # [ 25.074502] k3s[894]: time="2026-09-30T09:25:58Z" level=info msg="Active TLS secret kube-system/k3s-serving (ver=239) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__e0ea_959f_beb6_97cd-42ad81:fec0::e0ea:959f:beb6:97cd listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=38A2A32C15C605DC0C3D4A06FBD2801794179A0A]" machine # [ 25.122478] k3s[894]: I0930 09:25:58.076964 894 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="storageversion-garbage-collector-controller" requiredFeatureGates=["APIServerIdentity","StorageVersionAPI"] machine # [ 25.123085] k3s[894]: I0930 09:25:58.076994 894 controllermanager.go:641] "Warning: skipping controller" controller="storageversion-garbage-collector-controller" machine # [ 25.423733] k3s[894]: I0930 09:25:58.378217 894 controllermanager.go:689] "Warning: controller is disabled" controller="node-route-controller" machine # [ 25.424578] k3s[894]: I0930 09:25:58.378240 894 controllermanager.go:689] "Warning: controller is disabled" controller="cloud-node-lifecycle-controller" machine # [ 25.783175] k3s[894]: time="2026-09-30T09:25:58Z" level=info msg="Starting k3s.cattle.io/v1, Kind=Addon controller" machine # [ 25.783584] k3s[894]: time="2026-09-30T09:25:58Z" level=info msg="Creating deploy event broadcaster" machine # [ 25.786378] k3s[894]: I0930 09:25:58.740894 894 controller.go:667] quota admission added evaluator for: addons.k3s.cattle.io machine # [ 25.788033] k3s[894]: time="2026-09-30T09:25:58Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 25.789254] k3s[894]: time="2026-09-30T09:25:58Z" level=info msg="Creating helm-controller event broadcaster" machine # [ 25.797607] k3s[894]: time="2026-09-30T09:25:58Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=ApplyingManifest type=Normal machine # [ 25.802794] k3s[894]: time="2026-09-30T09:25:58Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 25.804469] k3s[894]: time="2026-09-30T09:25:58Z" level=info msg="Cluster dns configmap has been set successfully" machine # [ 25.878105] k3s[894]: I0930 09:25:58.832350 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="networkpolicies.networking.k8s.io" machine # [ 25.880822] k3s[894]: I0930 09:25:58.832439 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="jobs.batch" machine # [ 25.882963] k3s[894]: I0930 09:25:58.832479 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmchartconfigs.helm.cattle.io" machine # [ 25.885373] k3s[894]: I0930 09:25:58.832504 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="rolebindings.rbac.authorization.k8s.io" machine # [ 25.887930] k3s[894]: I0930 09:25:58.832529 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="limitranges" machine # [ 25.890385] k3s[894]: I0930 09:25:58.832570 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="statefulsets.apps" machine # [ 25.892819] k3s[894]: I0930 09:25:58.832609 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="daemonsets.apps" machine # [ 25.895152] k3s[894]: I0930 09:25:58.832674 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmcharts.helm.cattle.io" machine # [ 25.897367] k3s[894]: I0930 09:25:58.832727 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="controllerrevisions.apps" machine # [ 25.899552] k3s[894]: I0930 09:25:58.832756 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="cronjobs.batch" machine # [ 25.901662] k3s[894]: I0930 09:25:58.832780 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="roles.rbac.authorization.k8s.io" machine # [ 25.903874] k3s[894]: I0930 09:25:58.832807 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="resourceclaimtemplates.resource.k8s.io" machine # [ 25.906341] k3s[894]: I0930 09:25:58.832846 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="deployments.apps" machine # [ 25.908427] k3s[894]: I0930 09:25:58.832895 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="leases.coordination.k8s.io" machine # [ 25.910833] k3s[894]: I0930 09:25:58.832941 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="podtemplates" machine # [ 25.912903] k3s[894]: I0930 09:25:58.832981 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="ingresses.networking.k8s.io" machine # [ 25.915217] k3s[894]: I0930 09:25:58.833004 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="poddisruptionbudgets.policy" machine # [ 25.917453] k3s[894]: I0930 09:25:58.833031 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="csistoragecapacities.storage.k8s.io" machine # [ 25.919757] k3s[894]: I0930 09:25:58.833055 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpoints" machine # [ 25.921878] k3s[894]: I0930 09:25:58.833076 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="serviceaccounts" machine # [ 25.924795] k3s[894]: I0930 09:25:58.833098 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="replicasets.apps" machine # [ 25.927854] k3s[894]: I0930 09:25:58.833124 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="addons.k3s.cattle.io" machine # [ 25.929983] k3s[894]: I0930 09:25:58.833165 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpointslices.discovery.k8s.io" machine # [ 25.932255] k3s[894]: I0930 09:25:58.833189 894 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="horizontalpodautoscalers.autoscaling" machine # [ 25.934659] k3s[894]: I0930 09:25:58.833211 894 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="podgroup-protection-controller" requiredFeatureGates=["GenericWorkload"] machine # [ 25.937058] k3s[894]: I0930 09:25:58.833227 894 controllermanager.go:641] "Warning: skipping controller" controller="podgroup-protection-controller" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 26.021983] k3s[894]: I0930 09:25:58.976167 894 controllermanager.go:689] "Warning: controller is disabled" controller="service-lb-controller" machine # [ 26.177310] k3s[894]: time="2026-09-30T09:25:59Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=AppliedManifest type=Normal machine # [ 26.187594] k3s[894]: time="2026-09-30T09:25:59Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=ApplyingManifest type=Normal machine # [ 26.576542] k3s[894]: time="2026-09-30T09:25:59Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=AppliedManifest type=Normal machine # [ 26.587557] k3s[894]: time="2026-09-30T09:25:59Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=ApplyingManifest type=Normal machine # [ 26.790086] k3s[894]: time="2026-09-30T09:25:59Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 26.923074] k3s[894]: W0930 09:25:59.876847 894 probe.go:275] Flexvolume plugin directory at /usr/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating. machine # [ 27.009371] k3s[894]: time="2026-09-30T09:25:59Z" level=info msg="Starting rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding controller" machine # [ 27.014653] k3s[894]: time="2026-09-30T09:25:59Z" level=info msg="Starting batch/v1, Kind=Job controller" machine # [ 27.018255] k3s[894]: time="2026-09-30T09:25:59Z" level=info msg="Starting /v1, Kind=Secret controller" machine # [ 27.019126] k3s[894]: time="2026-09-30T09:25:59Z" level=info msg="Starting /v1, Kind=ConfigMap controller" machine # [ 27.022308] k3s[894]: time="2026-09-30T09:25:59Z" level=info msg="Starting /v1, Kind=ServiceAccount controller" machine # [ 27.027934] k3s[894]: time="2026-09-30T09:25:59Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChart controller" machine # [ 27.029465] k3s[894]: time="2026-09-30T09:25:59Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChartConfig controller" machine # [ 27.092941] k3s[894]: I0930 09:26:00.047455 894 serving.go:417] Generated self-signed cert in-memory machine # [ 27.167340] k3s[894]: I0930 09:26:00.121854 894 serving.go:417] Generated self-signed cert in-memory machine: (finished: waiting for success: kubectl get ns farm, in 2.60 seconds) machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key machine # [ 27.225697] k3s[894]: I0930 09:26:00.179200 894 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" requiredFeatureGates=["ClusterTrustBundle"] machine # [ 27.226618] k3s[894]: I0930 09:26:00.180994 894 controllermanager.go:641] "Warning: skipping controller" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" machine # [ 27.235057] k3s[894]: I0930 09:26:00.189456 894 controller.go:667] quota admission added evaluator for: deployments.apps machine # [ 27.246539] k3s[894]: I0930 09:26:00.201107 894 controllermanager.go:163] Version: v1.36.4+k3s1 machine # [ 27.251916] k3s[894]: I0930 09:26:00.205083 894 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 27.252587] k3s[894]: I0930 09:26:00.205110 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.253080] k3s[894]: I0930 09:26:00.205150 894 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 27.253505] k3s[894]: I0930 09:26:00.205164 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.253970] k3s[894]: I0930 09:26:00.205189 894 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 27.254726] k3s[894]: I0930 09:26:00.205206 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.257055] k3s[894]: I0930 09:26:00.210832 894 secure_serving.go:214] Serving securely on 127.0.0.1:10258 machine # [ 27.264253] k3s[894]: I0930 09:26:00.218367 894 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 27.267444] k3s[894]: time="2026-09-30T09:26:00Z" level=info msg="Creating service-lb-controller event broadcaster" machine # [ 27.288758] k3s[894]: I0930 09:26:00.241883 894 alloc.go:329] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.43.0.10"} machine # [ 27.291278] k3s[894]: time="2026-09-30T09:26:00Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=AppliedManifest type=Normal machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key, in 0.16 seconds) machine: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key machine # [ 27.352455] k3s[894]: I0930 09:26:00.306984 894 shared_informer.go:409] "Caches are synced" machine # [ 27.352850] k3s[894]: I0930 09:26:00.307087 894 shared_informer.go:409] "Caches are synced" machine # [ 27.422068] k3s[894]: I0930 09:26:00.376490 894 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="podcertificaterequest-cleaner-controller" requiredFeatureGates=["PodCertificateRequest"] machine # [ 27.422479] k3s[894]: I0930 09:26:00.376529 894 controllermanager.go:641] "Warning: skipping controller" controller="podcertificaterequest-cleaner-controller" machine: (finished: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key, in 0.14 seconds) machine: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine # [ 27.497357] k3s[894]: time="2026-09-30T09:26:00Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 27.502959] k3s[894]: time="2026-09-30T09:26:00Z" level=info msg="Starting /v1, Kind=Pod controller" machine # [ 27.509229] k3s[894]: time="2026-09-30T09:26:00Z" level=info msg="Starting apps/v1, Kind=DaemonSet controller" machine # [ 27.518787] k3s[894]: I0930 09:26:00.472760 894 controllermanager.go:338] Started "cloud-node-lifecycle-controller" machine # [ 27.519460] k3s[894]: I0930 09:26:00.473114 894 controllermanager.go:338] Started "service-lb-controller" machine # [ 27.519920] k3s[894]: W0930 09:26:00.473127 894 controllermanager.go:315] "node-route-controller" is disabled machine # [ 27.520577] k3s[894]: time="2026-09-30T09:26:00Z" level=info msg="Starting discovery.k8s.io/v1, Kind=EndpointSlice controller" machine # [ 27.521168] k3s[894]: I0930 09:26:00.473296 894 controllermanager.go:338] Started "cloud-node-controller" machine # [ 27.521732] k3s[894]: I0930 09:26:00.474455 894 node_lifecycle_controller.go:112] Sending events to api server machine # [ 27.522577] k3s[894]: I0930 09:26:00.474569 894 controller.go:235] Starting service controller machine # [ 27.523248] k3s[894]: I0930 09:26:00.474587 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.529067] k3s[894]: I0930 09:26:00.483002 894 node_controller.go:179] Sending events to api server. machine # [ 27.529533] k3s[894]: I0930 09:26:00.483090 894 node_controller.go:188] Waiting for informer caches to sync machine # [ 27.552249] k3s[894]: I0930 09:26:00.506157 894 shared_informer.go:409] "Caches are synced" machine: (finished: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.16 seconds) subtest: chart deploys and workers become Ready machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine # [ 27.720935] k3s[894]: I0930 09:26:00.674743 894 shared_informer.go:409] "Caches are synced" machine # [ 27.771694] k3s[894]: I0930 09:26:00.726158 894 controllermanager.go:689] "Warning: controller is disabled" controller="selinux-warning-controller" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 27.790049] k3s[894]: time="2026-09-30T09:26:00Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 27.885348] k3s[894]: time="2026-09-30T09:26:00Z" level=info msg="Imported docker.io/library/nix-grpc-farm-client:0.1.0-beta.4" machine # [ 27.887485] k3s[894]: time="2026-09-30T09:26:00Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-client@sha256:e62d3e966b4294d6153d75aa279799f248084314010d477b0ce06ab87d9a3de9" machine # [ 28.227671] k3s[894]: time="2026-09-30T09:26:01Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" object=kube-system/local-storage reason=DeletingManifest type=Normal machine # [ 28.245776] k3s[894]: time="2026-09-30T09:26:01Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=ApplyingManifest type=Normal machine # [ 28.322275] k3s[894]: time="2026-09-30T09:26:01Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nixos/cwy4fa9w9cazmgb02cj0h80rfh3y6nb7-nix-grpc-farm-client.tar in 7.378098892s" machine # [ 28.324188] k3s[894]: time="2026-09-30T09:26:01Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/da6p81qgajffg82flxg6pv07ldyl63v7-nix-grpc-farm.tar" machine # [ 28.478569] k3s[894]: I0930 09:26:01.432931 894 controller.go:667] quota admission added evaluator for: helmcharts.helm.cattle.io machine # [ 28.485879] k3s[894]: time="2026-09-30T09:26:01Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=AppliedManifest type=Normal machine # [ 28.495582] k3s[894]: time="2026-09-30T09:26:01Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=ApplyingManifest type=Normal machine # [ 28.630171] k3s[894]: time="2026-09-30T09:26:01Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Applying HelmChart from https://%{KUBERNETES_API}%/static/charts/nix-grpc-farm.tgz using Job kube-system/helm-install-nix-grpc-farm " object=kube-system/nix-grpc-farm reason=ApplyJob type=Normal machine # [ 28.663302] k3s[894]: I0930 09:26:01.617796 894 controller.go:667] quota admission added evaluator for: jobs.batch machine # [ 28.676210] k3s[894]: I0930 09:26:01.630760 894 horizontal.go:204] "Starting HPA controller" machine # [ 28.679025] k3s[894]: I0930 09:26:01.631472 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.679629] k3s[894]: I0930 09:26:01.632201 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.680136] k3s[894]: I0930 09:26:01.632268 894 disruption.go:453] "Sending events to api server." machine # [ 28.680632] k3s[894]: I0930 09:26:01.632312 894 disruption.go:460] "Starting disruption controller" machine # [ 28.681186] k3s[894]: I0930 09:26:01.632329 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.681635] k3s[894]: I0930 09:26:01.632371 894 certificate_controller.go:120] "Starting certificate controller" name="csrapproving" machine # [ 28.682222] k3s[894]: I0930 09:26:01.632400 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.682718] k3s[894]: I0930 09:26:01.632495 894 endpoints_controller.go:193] "Starting endpoint controller" machine # [ 28.683434] k3s[894]: I0930 09:26:01.632520 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.683916] k3s[894]: I0930 09:26:01.632585 894 job_controller.go:336] "Starting job controller" machine # [ 28.685611] k3s[894]: I0930 09:26:01.632601 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.686132] k3s[894]: I0930 09:26:01.632679 894 node_lifecycle_controller.go:436] "Sending events to api server" machine # [ 28.686570] k3s[894]: I0930 09:26:01.632721 894 node_lifecycle_controller.go:443] "Starting node controller" machine # [ 28.687141] k3s[894]: I0930 09:26:01.632731 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.687576] k3s[894]: I0930 09:26:01.632789 894 controller.go:174] "Starting ephemeral volume controller" machine # [ 28.690075] k3s[894]: I0930 09:26:01.632804 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.690693] k3s[894]: I0930 09:26:01.632882 894 controller.go:753] "Starting resource claim controller" machine # [ 28.691358] k3s[894]: I0930 09:26:01.632899 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.691845] k3s[894]: I0930 09:26:01.632934 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.692336] k3s[894]: I0930 09:26:01.633027 894 endpointslice_controller.go:280] "Starting endpoint slice controller" machine # [ 28.692830] k3s[894]: I0930 09:26:01.633050 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.693531] k3s[894]: I0930 09:26:01.633139 894 stateful_set.go:234] "Starting stateful set controller" machine # [ 28.694028] k3s[894]: I0930 09:26:01.633155 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.694498] k3s[894]: I0930 09:26:01.633228 894 pv_controller_base.go:318] "Starting persistent volume controller" machine # [ 28.695064] k3s[894]: I0930 09:26:01.633244 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.695493] k3s[894]: I0930 09:26:01.633278 894 legacy_serviceaccount_token_cleaner.go:103] "Starting legacy service account token cleaner controller" machine # [ 28.695950] k3s[894]: I0930 09:26:01.633292 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.699544] k3s[894]: I0930 09:26:01.633325 894 serviceaccounts_controller.go:117] "Starting service account controller" machine # [ 28.699984] k3s[894]: I0930 09:26:01.633344 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.700644] k3s[894]: I0930 09:26:01.633441 894 cronjob_controllerv2.go:143] "Starting cronjob controller v2" machine # [ 28.701182] k3s[894]: I0930 09:26:01.633455 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.701631] k3s[894]: I0930 09:26:01.633546 894 node_ipam_controller.go:142] "Starting ipam controller" machine # [ 28.702173] k3s[894]: I0930 09:26:01.633570 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.702705] k3s[894]: I0930 09:26:01.638832 894 vac_protection_controller.go:206] "Starting VAC protection controller" machine # [ 28.703181] k3s[894]: I0930 09:26:01.638855 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.703619] k3s[894]: I0930 09:26:01.638888 894 ttlafterfinished_controller.go:112] "Starting TTL after finished controller" machine # [ 28.704191] k3s[894]: I0930 09:26:01.638905 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.704630] k3s[894]: I0930 09:26:01.638941 894 device_taint_eviction.go:783] "Starting" controller="device-taint-eviction-controller" numWorkers=8 machine # [ 28.705213] k3s[894]: I0930 09:26:01.639071 894 tokencleaner.go:117] "Starting token cleaner controller" machine # [ 28.705689] k3s[894]: I0930 09:26:01.639096 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.706342] k3s[894]: I0930 09:26:01.639165 894 servicecidrs_controller.go:137] "Starting" controller="service-cidr-controller" machine # [ 28.706815] k3s[894]: I0930 09:26:01.639179 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.707485] k3s[894]: I0930 09:26:01.639468 894 deployment_controller.go:180] "Starting controller" controller="deployment" machine # [ 28.707962] k3s[894]: I0930 09:26:01.639483 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.708679] k3s[894]: I0930 09:26:01.639518 894 pvc_protection_controller.go:172] "Starting PVC protection controller" machine # [ 28.712096] k3s[894]: I0930 09:26:01.639533 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.712748] k3s[894]: I0930 09:26:01.639785 894 replica_set.go:285] "Starting controller" name="replicaset" machine # [ 28.713393] k3s[894]: I0930 09:26:01.639798 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.713910] k3s[894]: I0930 09:26:01.640326 894 cleaner.go:83] "Starting CSR cleaner controller" machine # [ 28.714573] k3s[894]: I0930 09:26:01.640409 894 ttl_controller.go:127] "Starting TTL controller" machine # [ 28.715114] k3s[894]: I0930 09:26:01.640433 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.715549] k3s[894]: I0930 09:26:01.640542 894 attach_detach_controller.go:334] "Starting attach detach controller" machine # [ 28.716081] k3s[894]: I0930 09:26:01.640560 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.716532] k3s[894]: I0930 09:26:01.640592 894 expand_controller.go:328] "Starting expand controller" machine # [ 28.717079] k3s[894]: I0930 09:26:01.640656 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.717568] k3s[894]: I0930 09:26:01.640690 894 clusterroleaggregation_controller.go:176] "Starting ClusterRoleAggregator controller" machine # [ 28.718095] k3s[894]: I0930 09:26:01.640709 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.718555] k3s[894]: I0930 09:26:01.640750 894 gc_controller.go:98] "Starting GC controller" machine # [ 28.719079] k3s[894]: I0930 09:26:01.640769 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.719541] k3s[894]: I0930 09:26:01.640818 894 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-legacy-unknown" machine # [ 28.720073] k3s[894]: I0930 09:26:01.640837 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.720509] k3s[894]: I0930 09:26:01.640866 894 pv_protection_controller.go:81] "Starting PV protection controller" machine # [ 28.720965] k3s[894]: I0930 09:26:01.640913 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.722670] k3s[894]: I0930 09:26:01.640942 894 publisher.go:107] "Starting root CA cert publisher controller" machine # [ 28.723189] k3s[894]: I0930 09:26:01.640961 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.723615] k3s[894]: I0930 09:26:01.640993 894 taint_eviction.go:283] "Starting" controller="taint-eviction-controller" machine # [ 28.724172] k3s[894]: I0930 09:26:01.641049 894 taint_eviction.go:288] "Sending events to API server" machine # [ 28.724665] k3s[894]: I0930 09:26:01.641059 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.725180] k3s[894]: I0930 09:26:01.641170 894 endpointslicemirroring_controller.go:226] "Starting EndpointSliceMirroring controller" machine # [ 28.725609] k3s[894]: I0930 09:26:01.641188 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.726177] k3s[894]: I0930 09:26:01.641329 894 replica_set.go:285] "Starting controller" name="replicationcontroller" machine # [ 28.726614] k3s[894]: I0930 09:26:01.641372 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.727189] k3s[894]: I0930 09:26:01.641409 894 namespace_controller.go:202] "Starting namespace controller" machine # [ 28.727690] k3s[894]: I0930 09:26:01.641428 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.728360] k3s[894]: I0930 09:26:01.641504 894 daemon_controller.go:364] "Starting daemon sets controller" machine # [ 28.728873] k3s[894]: I0930 09:26:01.641525 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.729564] k3s[894]: I0930 09:26:01.641684 894 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-serving" machine # [ 28.730110] k3s[894]: I0930 09:26:01.641702 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.731380] k3s[894]: I0930 09:26:01.641732 894 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-client" machine # [ 28.770987] k3s[894]: I0930 09:26:01.641780 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.771594] k3s[894]: I0930 09:26:01.641831 894 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kube-apiserver-client" machine # [ 28.772156] k3s[894]: I0930 09:26:01.641852 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.772636] k3s[894]: I0930 09:26:01.641891 894 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 28.773188] k3s[894]: I0930 09:26:01.642201 894 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 28.773637] k3s[894]: I0930 09:26:01.642386 894 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 28.774179] k3s[894]: I0930 09:26:01.642706 894 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 28.774624] k3s[894]: I0930 09:26:01.642915 894 device_taint_eviction.go:823] "Sending events to api server" machine # [ 28.775271] k3s[894]: I0930 09:26:01.643035 894 device_taint_eviction.go:1023] "Waiting" for="cache and event handler sync" machine # [ 28.775653] k3s[894]: I0930 09:26:01.643115 894 resource_quota_controller.go:297] "Starting resource quota controller" machine # [ 28.776193] k3s[894]: I0930 09:26:01.643131 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.776650] k3s[894]: I0930 09:26:01.643211 894 garbagecollector.go:141] "Starting controller" controller="garbagecollector" machine # [ 28.777190] k3s[894]: I0930 09:26:01.643251 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.777644] k3s[894]: I0930 09:26:01.643411 894 resource_quota_monitor.go:309] "QuotaMonitor running" machine # [ 28.778184] k3s[894]: I0930 09:26:01.643575 894 graph_builder.go:387] "Running" component="GraphBuilder" machine # [ 28.778625] k3s[894]: I0930 09:26:01.671531 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.792067] k3s[894]: I0930 09:26:01.744200 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.797251] k3s[894]: time="2026-09-30T09:26:01Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 28.980302] k3s[894]: I0930 09:26:01.934842 894 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceSlice + event handler k8s.io/kubernetes/pkg/controller/devicetainteviction.(*Controller).Run" machine # [ 28.981364] k3s[894]: I0930 09:26:01.935951 894 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceSlice" machine # [ 28.986962] k3s[894]: I0930 09:26:01.941519 894 shared_informer.go:409] "Caches are synced" machine # [ 28.987596] k3s[894]: I0930 09:26:01.941784 894 shared_informer.go:409] "Caches are synced" machine # [ 28.989485] k3s[894]: I0930 09:26:01.944069 894 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.DeviceClass" machine # [ 28.994486] k3s[894]: I0930 09:26:01.949046 894 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.Pod" machine # [ 28.995122] k3s[894]: I0930 09:26:01.949093 894 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.Pod + event handler k8s.io/kubernetes/pkg/controller/devicetainteviction.(*Controller).Run" machine # [ 28.999589] k3s[894]: I0930 09:26:01.954163 894 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceClaim" machine # [ 29.000239] k3s[894]: I0930 09:26:01.954194 894 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceClaim + event handler k8s.io/kubernetes/pkg/controller/devicetainteviction.(*Controller).Run" machine # [ 29.011241] k3s[894]: time="2026-09-30T09:26:01Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=AppliedManifest type=Normal machine # [ 29.019083] k3s[894]: I0930 09:26:01.973651 894 shared_informer.go:409] "Caches are synced" machine # [ 29.023161] k3s[894]: time="2026-09-30T09:26:01Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=ApplyingManifest type=Normal machine # [ 29.078139] k3s[894]: I0930 09:26:02.032558 894 shared_informer.go:409] "Caches are synced" machine # [ 29.078498] k3s[894]: I0930 09:26:02.032646 894 shared_informer.go:409] "Caches are synced" machine # [ 29.079187] k3s[894]: I0930 09:26:02.032692 894 shared_informer.go:409] "Caches are synced" machine # [ 29.079625] k3s[894]: I0930 09:26:02.032794 894 shared_informer.go:409] "Caches are synced" machine # [ 29.082203] k3s[894]: I0930 09:26:02.032992 894 shared_informer.go:409] "Caches are synced" machine # [ 29.085283] k3s[894]: I0930 09:26:02.039794 894 shared_informer.go:409] "Caches are synced" machine # [ 29.085907] k3s[894]: I0930 09:26:02.039895 894 shared_informer.go:409] "Caches are synced" machine # [ 29.087510] k3s[894]: I0930 09:26:02.042092 894 shared_informer.go:409] "Caches are synced" machine # [ 29.088279] k3s[894]: I0930 09:26:02.042863 894 shared_informer.go:409] "Caches are synced" machine # [ 29.090087] k3s[894]: I0930 09:26:02.044659 894 shared_informer.go:409] "Caches are synced" machine # [ 29.092503] k3s[894]: I0930 09:26:02.047063 894 shared_informer.go:409] "Caches are synced" machine # [ 29.093188] k3s[894]: I0930 09:26:02.047146 894 shared_informer.go:409] "Caches are synced" machine # [ 29.094780] k3s[894]: I0930 09:26:02.049308 894 shared_informer.go:409] "Caches are synced" machine # [ 29.096109] k3s[894]: I0930 09:26:02.050688 894 shared_informer.go:409] "Caches are synced" machine # [ 29.097527] k3s[894]: I0930 09:26:02.052088 894 shared_informer.go:409] "Caches are synced" machine # [ 29.098744] k3s[894]: I0930 09:26:02.053324 894 shared_informer.go:409] "Caches are synced" machine # [ 29.100050] k3s[894]: I0930 09:26:02.054513 894 range_allocator.go:177] "Sending events to api server" machine # [ 29.100599] k3s[894]: I0930 09:26:02.054571 894 range_allocator.go:181] "Starting range CIDR allocator" machine # [ 29.103078] k3s[894]: I0930 09:26:02.054582 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 29.103641] k3s[894]: I0930 09:26:02.054593 894 shared_informer.go:409] "Caches are synced" machine # [ 29.106108] k3s[894]: I0930 09:26:02.060685 894 shared_informer.go:409] "Caches are synced" machine # [ 29.106685] k3s[894]: I0930 09:26:02.060726 894 shared_informer.go:409] "Caches are synced" machine # [ 29.108305] k3s[894]: I0930 09:26:02.062888 894 shared_informer.go:409] "Caches are synced" machine # [ 29.108917] k3s[894]: I0930 09:26:02.062923 894 shared_informer.go:409] "Caches are synced" machine # [ 29.110781] k3s[894]: I0930 09:26:02.065353 894 shared_informer.go:409] "Caches are synced" machine # [ 29.113934] k3s[894]: I0930 09:26:02.068513 894 shared_informer.go:409] "Caches are synced" machine # [ 29.114566] k3s[894]: I0930 09:26:02.068552 894 shared_informer.go:409] "Caches are synced" machine # [ 29.116363] k3s[894]: I0930 09:26:02.070935 894 shared_informer.go:409] "Caches are synced" machine # [ 29.121500] k3s[894]: I0930 09:26:02.075991 894 shared_informer.go:409] "Caches are synced" machine # [ 29.122167] k3s[894]: I0930 09:26:02.076098 894 shared_informer.go:409] "Caches are synced" machine # [ 29.124030] k3s[894]: I0930 09:26:02.078309 894 shared_informer.go:409] "Caches are synced" machine # [ 29.124675] k3s[894]: I0930 09:26:02.079065 894 shared_informer.go:409] "Caches are synced" machine # [ 29.125484] k3s[894]: I0930 09:26:02.079115 894 shared_informer.go:409] "Caches are synced" machine # [ 29.125946] k3s[894]: I0930 09:26:02.079175 894 shared_informer.go:409] "Caches are synced" machine # [ 29.126602] k3s[894]: I0930 09:26:02.079204 894 shared_informer.go:409] "Caches are synced" machine # [ 29.129026] k3s[894]: I0930 09:26:02.079444 894 shared_informer.go:409] "Caches are synced" machine # [ 29.129597] k3s[894]: I0930 09:26:02.079517 894 shared_informer.go:409] "Caches are synced" machine # [ 29.130079] k3s[894]: I0930 09:26:02.079610 894 shared_informer.go:409] "Caches are synced" machine # [ 29.130590] k3s[894]: I0930 09:26:02.079676 894 shared_informer.go:409] "Caches are synced" machine # [ 29.131141] k3s[894]: I0930 09:26:02.079739 894 shared_informer.go:409] "Caches are synced" machine # [ 29.131720] k3s[894]: I0930 09:26:02.079788 894 shared_informer.go:409] "Caches are synced" machine # [ 29.132394] k3s[894]: I0930 09:26:02.079837 894 shared_informer.go:409] "Caches are synced" machine # [ 29.133100] k3s[894]: I0930 09:26:02.079879 894 shared_informer.go:409] "Caches are synced" machine # [ 29.165477] k3s[894]: time="2026-09-30T09:26:02Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Resumed synced Job kube-system/helm-install-nix-grpc-farm" object=kube-system/nix-grpc-farm reason=ResumeJob type=Normal machine # [ 29.185065] k3s[894]: time="2026-09-30T09:26:02Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Deferred node password secret validation complete" object=machine reason=NodePasswordValidationComplete type=Normal machine # [ 29.197709] k3s[894]: time="2026-09-30T09:26:02Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=AppliedManifest type=Normal machine # [ 29.387754] k3s[894]: time="2026-09-30T09:26:02Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/traefik.yaml\"" object=kube-system/traefik reason=DeletingManifest type=Normal machine # [ 29.389926] k3s[894]: I0930 09:26:02.344068 894 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 29.395412] k3s[894]: I0930 09:26:02.349935 894 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 29.424520] k3s[894]: I0930 09:26:02.379011 894 controller.go:667] quota admission added evaluator for: replicasets.apps machine # [ 29.791151] k3s[894]: time="2026-09-30T09:26:02Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 29.989687] k3s[894]: I0930 09:26:02.944076 894 shared_informer.go:409] "Caches are synced" machine # [ 29.991045] k3s[894]: I0930 09:26:02.944176 894 garbagecollector.go:166] "Garbage collector: all resource monitors have synced" machine # [ 29.991868] k3s[894]: I0930 09:26:02.944196 894 garbagecollector.go:169] "Proceeding to collect garbage" machine # [ 29.994118] k3s[894]: I0930 09:26:02.946087 894 shared_informer.go:409] "Caches are synced" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 30.593377] postgres[1206]: [1206] ERROR: relation "goose_db_version" does not exist at character 36 machine # [ 30.594259] postgres[1206]: [1206] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC machine # [ 30.618110] niks3-server[1198]: 2026/09/30 09:26:03 OK 20241026095416_initial_model.sql (11.88ms) machine # [ 30.624115] niks3-server[1198]: 2026/09/30 09:26:03 OK 20251210153512_drop_unused_gin_index.sql (2.35ms) machine # [ 30.631171] niks3-server[1198]: 2026/09/30 09:26:03 OK 20251218171726_add_pins.sql (6.99ms) machine # [ 30.636098] niks3-server[1198]: 2026/09/30 09:26:03 OK 20260628120000_add_object_size_and_stats.sql (4.88ms) machine # [ 30.642455] niks3-server[1198]: 2026/09/30 09:26:03 OK 20260905000000_add_claims.sql (6.25ms) machine # [ 30.646965] niks3-server[1198]: 2026/09/30 09:26:03 OK 20260920000000_drop_claims.sql (4.51ms) machine # [ 30.648548] niks3-server[1198]: 2026/09/30 09:26:03 OK 20260923120000_add_pushes.sql (1.55ms) machine # [ 30.649432] niks3-server[1198]: 2026/09/30 09:26:03 goose: successfully migrated database to version: 20260923120000 machine # [ 30.652570] niks3-server[1198]: 2026/09/30 09:26:03 OK 1_commit_pending_closure.sql (3.18ms) machine # [ 30.654707] niks3-server[1198]: 2026/09/30 09:26:03 OK 2_object_stats_trigger.sql (2.05ms) machine # [ 30.657588] niks3-server[1198]: 2026/09/30 09:26:03 OK 3_commit_push.sql (1.64ms) machine # [ 30.658043] niks3-server[1198]: 2026/09/30 09:26:03 goose: up to current file version: 3 machine # [ 30.663103] niks3-server[1198]: 2026/09/30 09:26:03 INFO OIDC provider initialized name=kubernetes issuer=https://kubernetes.default.svc.cluster.local machine # [ 30.664056] niks3-server[1198]: 2026/09/30 09:26:03 INFO OIDC authentication enabled config=/nix/store/v0b0sqyzhrjsz48x3klf7b7vl89apzs0-niks3-oidc.json machine # [ 30.664975] niks3-server[1198]: 2026/09/30 09:26:03 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key machine # [ 30.696946] niks3-server[1198]: 2026/09/30 09:26:03 INFO Read proxy enabled — serving cache objects from S3 machine # [ 30.698683] niks3-server[1198]: 2026/09/30 09:26:03 INFO Using socket-activated listener address=0.0.0.0:5751 machine # [ 30.699498] niks3-server[1198]: 2026/09/30 09:26:03 INFO Starting HTTP server address=0.0.0.0:5751 machine # [ 30.700109] niks3-server[1198]: 2026/09/30 09:26:03 INFO systemd watchdog enabled interval=15s machine # [ 30.700887] systemd[1]: Started niks3 server. machine # [ 30.701663] systemd[1]: Reached target Multi-User System. machine # [ 30.702284] systemd[1]: Startup finished in 1.174s (kernel) + 3.700s (initrd) + 25.823s (userspace) = 30.698s. machine # [ 30.791459] k3s[894]: time="2026-09-30T09:26:03Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 31.790602] k3s[894]: time="2026-09-30T09:26:04Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 32.791398] k3s[894]: time="2026-09-30T09:26:05Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 32.965251] k3s[894]: time="2026-09-30T09:26:05Z" level=info msg="Imported docker.io/library/nix-grpc-farm:0.1.0-beta.4" machine # [ 32.969550] k3s[894]: time="2026-09-30T09:26:05Z" level=info msg="Tagged docker.io/library/nix-grpc-farm@sha256:5bb721a08d8e45c607ece2fdbf456d83a9a5405ae01e65644e156ad4f9f95305" machine # [ 32.981333] k3s[894]: time="2026-09-30T09:26:05Z" level=info msg="Started tunnel to 10.0.2.15:6443" machine # [ 32.982167] k3s[894]: time="2026-09-30T09:26:05Z" level=info msg="Stopped tunnel to 127.0.0.1:6443" machine # [ 32.982693] k3s[894]: time="2026-09-30T09:26:05Z" level=info msg="Connecting to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 32.982847] k3s[894]: time="2026-09-30T09:26:05Z" level=info msg="Proxy done" err="context canceled" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 32.983356] k3s[894]: time="2026-09-30T09:26:05Z" level=info msg="error in remotedialer server [400]: websocket: close 1006 (abnormal closure): unexpected EOF" machine # [ 32.991649] k3s[894]: time="2026-09-30T09:26:05Z" level=info msg="Handling backend connection request [machine]" machine # [ 32.992514] k3s[894]: time="2026-09-30T09:26:05Z" level=info msg="Connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 32.992876] k3s[894]: time="2026-09-30T09:26:05Z" level=info msg="Remotedialer connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 33.341551] k3s[894]: time="2026-09-30T09:26:06Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nixos/da6p81qgajffg82flxg6pv07ldyl63v7-nix-grpc-farm.tar in 5.018800433s" machine # [ 33.347471] k3s[894]: time="2026-09-30T09:26:06Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/if20jbcicwv9y92klzcxk35m5bcz2ql0-nix-grpc-farm-lb.tar" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 33.790769] k3s[894]: time="2026-09-30T09:26:06Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 34.791757] k3s[894]: time="2026-09-30T09:26:07Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 34.853752] k3s[894]: time="2026-09-30T09:26:07Z" level=info msg="Imported docker.io/library/nix-grpc-farm-lb:0.1.0-beta.4" machine # [ 34.857389] k3s[894]: time="2026-09-30T09:26:07Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-lb@sha256:18ee6724be589622e1aee9d13c5121e7b2c992ca636c935ade90c66423e18f37" machine # [ 34.896263] k3s[894]: time="2026-09-30T09:26:07Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nixos/if20jbcicwv9y92klzcxk35m5bcz2ql0-nix-grpc-farm-lb.tar in 1.549407257s" machine # [ 34.897492] k3s[894]: time="2026-09-30T09:26:07Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/smddpgqzjvlqv3lx57wdzl7kma805fj0-k3s-airgap-images-amd64.tar.zst" machine # [ 34.960207] k3s[894]: time="2026-09-30T09:26:07Z" level=info msg="Running kubelet --cloud-provider=external --config-dir=/var/lib/rancher/k3s/agent/etc/kubelet.conf.d --containerd=/run/k3s/containerd/containerd.sock --eviction-hard=nodefs.available<1%,imagefs.available<1% --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubelet.kubeconfig --node-ip=10.0.2.15,fec0::e0ea:959f:beb6:97cd --node-labels= --read-only-port=0" machine # [ 34.961504] k3s[894]: Flag --containerd has been deprecated, This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed. machine # [ 34.972885] k3s[894]: I0930 09:26:07.927386 894 server.go:541] "Kubelet version" kubeletVersion="v1.36.4+k3s1" machine # [ 34.974827] k3s[894]: I0930 09:26:07.927440 894 server.go:543] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 34.975756] k3s[894]: I0930 09:26:07.927490 894 watchdog_linux.go:94] "Systemd watchdog is not enabled" machine # [ 34.976947] k3s[894]: I0930 09:26:07.927511 894 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." machine # [ 34.978264] k3s[894]: I0930 09:26:07.929770 894 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/agent/client-ca.crt" machine # [ 34.984182] k3s[894]: I0930 09:26:07.938585 894 server.go:1444] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" machine # [ 34.988838] k3s[894]: I0930 09:26:07.943305 894 server.go:804] "--cgroups-per-qos enabled, but --cgroup-root was not specified. Defaulting to /" machine # [ 34.989743] k3s[894]: I0930 09:26:07.943341 894 server.go:865] "NoSwap is set due to memorySwapBehavior not specified" memorySwapBehavior="" FailSwapOn=false machine # [ 34.990797] k3s[894]: I0930 09:26:07.943548 894 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] machine # [ 34.991682] k3s[894]: I0930 09:26:07.943597 894 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"machine","RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"MemoryReservationPolicy":"None","PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} machine # [ 34.992714] k3s[894]: I0930 09:26:07.943854 894 topology_manager.go:172] "Creating topology manager with none policy" machine # [ 34.993783] k3s[894]: I0930 09:26:07.943870 894 container_manager_linux.go:309] "Creating device plugin manager" machine # [ 34.994683] k3s[894]: I0930 09:26:07.943937 894 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" machine # [ 34.995804] k3s[894]: I0930 09:26:07.948543 894 state_mem.go:45] "Initialized" logger="CPUManager state memory" machine # [ 34.996508] k3s[894]: I0930 09:26:07.948801 894 kubelet.go:485] "Attempting to sync node with API server" machine # [ 34.997024] k3s[894]: I0930 09:26:07.948818 894 kubelet.go:386] "Adding static pod path" path="/var/lib/rancher/k3s/agent/pod-manifests" machine # [ 34.997560] k3s[894]: I0930 09:26:07.948858 894 kubelet.go:397] "Adding apiserver pod source" machine # [ 34.998118] k3s[894]: I0930 09:26:07.948874 894 apiserver.go:41] "Waiting for node sync before watching apiserver pods" machine # [ 34.998604] k3s[894]: I0930 09:26:07.952325 894 kuberuntime_manager.go:308] "Container runtime initialized" containerRuntime="containerd" version="2.3.4-k3s1.36" apiVersion="v1" machine # [ 34.999133] k3s[894]: I0930 09:26:07.953008 894 kubelet.go:1002] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" machine # [ 34.999591] k3s[894]: I0930 09:26:07.953031 894 kubelet.go:1029] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" machine # [ 35.002567] k3s[894]: I0930 09:26:07.956196 894 server.go:1280] "Started kubelet" machine # [ 35.003282] k3s[894]: I0930 09:26:07.956236 894 server.go:193] "Starting to listen" address="0.0.0.0" port=10250 machine # [ 35.003710] k3s[894]: I0930 09:26:07.956299 894 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 machine # [ 35.004416] k3s[894]: I0930 09:26:07.956379 894 server_v1.go:49] "podresources" method="list" useActivePods=true machine # [ 35.004879] k3s[894]: I0930 09:26:07.956552 894 server.go:264] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" machine # [ 35.029995] k3s[894]: I0930 09:26:07.957116 894 server.go:354] "Adding debug handlers to kubelet server" machine # [ 35.030495] k3s[894]: I0930 09:26:07.958257 894 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" machine # [ 35.030947] k3s[894]: I0930 09:26:07.959706 894 dynamic_serving_content.go:135] "Starting controller" name="kubelet-server-cert-files::/var/lib/rancher/k3s/agent/serving-kubelet.crt::/var/lib/rancher/k3s/agent/serving-kubelet.key" machine # [ 35.031664] k3s[894]: I0930 09:26:07.960256 894 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 35.032417] k3s[894]: E0930 09:26:07.963621 894 kubelet_node_status.go:396] "Error getting the current node from lister" err="node \"machine\" not found" machine # [ 35.032863] k3s[894]: I0930 09:26:07.963922 894 volume_manager.go:310] "Starting Kubelet Volume Manager" machine # [ 35.033556] k3s[894]: I0930 09:26:07.964679 894 desired_state_of_world_populator.go:146] "Desired state populator starts to run" machine # [ 35.034148] k3s[894]: I0930 09:26:07.964928 894 reconciler.go:29] "Reconciler: start to sync state" machine # [ 35.034586] k3s[894]: E0930 09:26:07.968133 894 kubelet.go:3516] "Unable to register mirror pod because node is not registered yet" err="node \"machine\" not found" node="machine" machine # [ 35.035170] k3s[894]: E0930 09:26:07.973523 894 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"machine\" not found" node="machine" machine # [ 35.035607] k3s[894]: I0930 09:26:07.984329 894 factory.go:222] Registration of the systemd container factory successfully machine # [ 35.036188] k3s[894]: I0930 09:26:07.985323 894 factory.go:220] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory machine # [ 35.037333] k3s[894]: E0930 09:26:07.991901 894 kubelet.go:1725] "Image garbage collection failed once. Stats initialization may not have completed yet" err="invalid capacity 0 on image filesystem" machine # [ 35.053310] k3s[894]: I0930 09:26:08.007780 894 factory.go:222] Registration of the containerd container factory successfully machine # [ 35.065617] k3s[894]: I0930 09:26:08.020175 894 cpu_manager.go:235] "Starting" policy="none" machine # [ 35.067167] k3s[894]: I0930 09:26:08.020198 894 cpu_manager.go:236] "Reconciling" reconcilePeriod="10s" machine # [ 35.067702] k3s[894]: I0930 09:26:08.020221 894 state_mem.go:45] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" machine # [ 35.072730] k3s[894]: I0930 09:26:08.027294 894 policy_none.go:50] "Start" machine # [ 35.073989] k3s[894]: I0930 09:26:08.027321 894 memory_manager.go:190] "Starting memorymanager" policy="None" machine # [ 35.075542] k3s[894]: I0930 09:26:08.027337 894 state_mem.go:40] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" machine # [ 35.078750] k3s[894]: I0930 09:26:08.033302 894 policy_none.go:44] "Start" machine # [ 35.085513] systemd[1]: Created slice libcontainer container kubepods.slice. machine # [ 35.095371] systemd[1]: Created slice libcontainer container kubepods-burstable.slice. machine # [ 35.098866] systemd[1]: Created slice libcontainer container kubepods-besteffort.slice. machine # [ 35.103449] k3s[894]: I0930 09:26:08.058002 894 kubelet_network_linux.go:53] "Initialized iptables rules." protocol="IPv4" machine # [ 35.107728] k3s[894]: E0930 09:26:08.062302 894 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" machine # [ 35.108558] k3s[894]: I0930 09:26:08.062432 894 eviction_manager.go:194] "Eviction manager: starting control loop" machine # [ 35.109251] k3s[894]: I0930 09:26:08.062451 894 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" machine # [ 35.109733] k3s[894]: I0930 09:26:08.063207 894 plugin_manager.go:121] "Starting Kubelet Plugin Manager" machine # [ 35.110987] k3s[894]: I0930 09:26:08.065247 894 kubelet_network_linux.go:53] "Initialized iptables rules." protocol="IPv6" machine # [ 35.111700] k3s[894]: I0930 09:26:08.065291 894 status_manager.go:277] "Starting to sync pod status with apiserver" machine # [ 35.112373] k3s[894]: I0930 09:26:08.065333 894 kubelet.go:2622] "Starting kubelet main sync loop" machine # [ 35.112841] k3s[894]: E0930 09:26:08.065384 894 kubelet.go:2646] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" machine # [ 35.113569] k3s[894]: E0930 09:26:08.068155 894 kubelet.go:3516] "Unable to register mirror pod because node is not registered yet" err="node \"machine\" not found" node="machine" machine # [ 35.115422] k3s[894]: E0930 09:26:08.069978 894 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="no imagefs label for configured runtime" machine # [ 35.116086] k3s[894]: E0930 09:26:08.070018 894 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"machine\" not found" machine # [ 35.210225] k3s[894]: I0930 09:26:08.164746 894 kubelet_node_status.go:75] "Attempting to register node" node="machine" machine # [ 35.213673] k3s[894]: E0930 09:26:08.168194 894 kubelet.go:3516] "Unable to register mirror pod because node is not registered yet" err="node \"machine\" not found" node="machine" machine # [ 35.218979] k3s[894]: I0930 09:26:08.173521 894 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"machine\" does not exist" machine # [ 35.219758] k3s[894]: time="2026-09-30T09:26:08Z" level=info msg="Adding node OwnerReference to node-password secret machine.node-password.k3s" machine # [ 35.220656] k3s[894]: I0930 09:26:08.175029 894 node_controller.go:432] Initializing node machine with cloud provider machine # [ 35.221364] k3s[894]: I0930 09:26:08.175082 894 node_controller.go:236] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 35.222618] k3s[894]: E0930 09:26:08.175104 894 node_controller.go:247] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 35.223795] k3s[894]: I0930 09:26:08.175905 894 kubelet_node_status.go:78] "Successfully registered node" node="machine" machine # [ 35.226061] k3s[894]: I0930 09:26:08.180141 894 node_controller.go:432] Initializing node machine with cloud provider machine # [ 35.226679] k3s[894]: I0930 09:26:08.180190 894 node_controller.go:236] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 35.227220] k3s[894]: E0930 09:26:08.180208 894 node_controller.go:247] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 35.231570] k3s[894]: I0930 09:26:08.186143 894 node_controller.go:432] Initializing node machine with cloud provider machine # [ 35.235059] k3s[894]: time="2026-09-30T09:26:08Z" level=info msg="Annotations and labels have been set successfully on node: machine" machine # [ 35.235841] k3s[894]: time="2026-09-30T09:26:08Z" level=info msg="Starting flannel with backend vxlan" machine # [ 35.237665] k3s[894]: I0930 09:26:08.192211 894 server.go:228] "Successfully retrieved NodeIPs" NodeIPs=["10.0.2.15","fec0::e0ea:959f:beb6:97cd"] machine # [ 35.238751] k3s[894]: time="2026-09-30T09:26:08Z" level=info msg="Synced coredns NodeHosts entries for machine" machine # [ 35.240037] k3s[894]: E0930 09:26:08.194347 894 server.go:265] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`" machine # [ 35.241870] k3s[894]: I0930 09:26:08.196383 894 range_allocator.go:433] "Set node PodCIDR" node="machine" podCIDRs=["10.42.0.0/24"] machine # [ 35.256638] k3s[894]: I0930 09:26:08.211119 894 server.go:274] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4" machine # [ 35.257475] k3s[894]: I0930 09:26:08.211183 894 server_linux.go:137] "Using iptables Proxier" machine # [ 35.262261] k3s[894]: I0930 09:26:08.216559 894 kuberuntime_manager.go:2172] "Updating runtime config through cri with podcidr" CIDR="10.42.0.0/24" machine # [ 35.268174] k3s[894]: I0930 09:26:08.222748 894 kubelet_network.go:48] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.42.0.0/24" machine # [ 35.272138] k3s[894]: E0930 09:26:08.226606 894 range_allocator.go:438] "Failed to update node PodCIDR after multiple attempts" err="failed to patch node CIDR: Node \"machine\" is invalid: [spec.podCIDRs: Invalid value: [\"10.42.1.0/24\",\"10.42.0.0/24\"]: may specify no more than one CIDR for each IP family, spec.podCIDRs: Forbidden: node updates may not change podCIDR except from \"\" to valid]" node="machine" podCIDRs=["10.42.1.0/24"] machine # [ 35.273202] k3s[894]: E0930 09:26:08.226777 894 range_allocator.go:444] "CIDR assignment for node failed. Releasing allocated CIDR" err="failed to patch node CIDR: Node \"machine\" is invalid: [spec.podCIDRs: Invalid value: [\"10.42.1.0/24\",\"10.42.0.0/24\"]: may specify no more than one CIDR for each IP family, spec.podCIDRs: Forbidden: node updates may not change podCIDR except from \"\" to valid]" node="machine" machine # [ 35.280487] k3s[894]: I0930 09:26:08.235046 894 proxier.go:241] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4" machine # [ 35.286071] k3s[894]: E0930 09:26:08.240598 894 range_allocator.go:257] "Error processing node work item" err="error syncing 'machine': failed to patch node CIDR: Node \"machine\" is invalid: [spec.podCIDRs: Invalid value: [\"10.42.1.0/24\",\"10.42.0.0/24\"]: may specify no more than one CIDR for each IP family, spec.podCIDRs: Forbidden: node updates may not change podCIDR except from \"\" to valid], requeuing" logger="UnhandledError" machine # [ 35.295565] k3s[894]: I0930 09:26:08.250096 894 server.go:539] "Version info" version="v1.36.4+k3s1" machine # [ 35.296361] k3s[894]: I0930 09:26:08.250141 894 server.go:541] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 35.297178] k3s[894]: I0930 09:26:08.251736 894 config.go:200] "Starting service config controller" machine # [ 35.297648] k3s[894]: I0930 09:26:08.251772 894 shared_informer.go:381] "Waiting for caches to sync" controller="service config" machine # [ 35.298557] k3s[894]: I0930 09:26:08.251811 894 config.go:106] "Starting endpoint slice config controller" machine # [ 35.299265] k3s[894]: I0930 09:26:08.251824 894 shared_informer.go:381] "Waiting for caches to sync" controller="endpoint slice config" machine # [ 35.299773] k3s[894]: I0930 09:26:08.251852 894 config.go:403] "Starting serviceCIDR config controller" machine # [ 35.300474] k3s[894]: I0930 09:26:08.251864 894 shared_informer.go:381] "Waiting for caches to sync" controller="serviceCIDR config" machine # [ 35.301136] k3s[894]: I0930 09:26:08.252407 894 config.go:309] "Starting node config controller" machine # [ 35.301672] k3s[894]: I0930 09:26:08.252422 894 shared_informer.go:381] "Waiting for caches to sync" controller="node config" machine # [ 35.302399] k3s[894]: I0930 09:26:08.252459 894 shared_informer.go:388] "Caches are synced" controller="node config" machine # [ 35.321448] k3s[894]: time="2026-09-30T09:26:08Z" level=info msg="Flannel found PodCIDR assigned for node machine" machine # [ 35.324892] k3s[894]: time="2026-09-30T09:26:08Z" level=info msg="The interface eth0 with ipv4 address 10.0.2.15 will be used by flannel" machine # [ 35.331246] k3s[894]: I0930 09:26:08.280247 894 kube.go:139] Waiting 10m0s for node controller to sync machine # [ 35.332588] k3s[894]: I0930 09:26:08.280334 894 kube.go:537] Starting kube subnet manager machine # [ 35.333840] k3s[894]: I0930 09:26:08.281496 894 node_controller.go:477] Successfully initialized node machine with cloud provider machine # [ 35.336227] k3s[894]: I0930 09:26:08.281823 894 event.go:389] "Event occurred" object="machine" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="Synced" message="Node synced successfully" machine # [ 35.336932] k3s[894]: E0930 09:26:08.282474 894 options.go:205] The manifest file is empty, ignoring. machine # [ 35.340901] k3s[894]: I0930 09:26:08.295441 894 server.go:176] "Starting Kubernetes Scheduler" version="v1.36.4+k3s1" machine # [ 35.342414] k3s[894]: I0930 09:26:08.295472 894 server.go:178] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 35.349694] k3s[894]: I0930 09:26:08.304260 894 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 35.350546] k3s[894]: I0930 09:26:08.304291 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 35.351027] k3s[894]: I0930 09:26:08.304329 894 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 35.351507] k3s[894]: I0930 09:26:08.304351 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 35.355739] k3s[894]: I0930 09:26:08.304277 894 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 35.356488] k3s[894]: I0930 09:26:08.306713 894 shared_informer.go:402] "Waiting for caches to sync" machine # [ 35.358654] k3s[894]: I0930 09:26:08.313219 894 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 35.362400] k3s[894]: I0930 09:26:08.316775 894 secure_serving.go:214] Serving securely on 127.0.0.1:10259 machine # [ 35.363070] k3s[894]: I0930 09:26:08.317227 894 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 35.375733] k3s[894]: I0930 09:26:08.330306 894 kubelet_node_status.go:431] "Fast updating node status as it just became ready" machine # [ 35.383839] k3s[894]: I0930 09:26:08.337764 894 topologycache.go:237] "Can't get CPU or zone information for node" node="machine" machine # [ 35.397389] k3s[894]: I0930 09:26:08.351910 894 shared_informer.go:388] "Caches are synced" controller="endpoint slice config" machine # [ 35.399336] k3s[894]: I0930 09:26:08.351962 894 shared_informer.go:388] "Caches are synced" controller="serviceCIDR config" machine # [ 35.795425] k3s[894]: time="2026-09-30T09:26:08Z" level=info msg="Labels and annotations have been set successfully on node: machine" machine # [ 35.850987] k3s[894]: I0930 09:26:08.805545 894 shared_informer.go:409] "Caches are synced" machine # [ 35.851639] k3s[894]: I0930 09:26:08.805560 894 shared_informer.go:409] "Caches are synced" machine # [ 35.857557] k3s[894]: I0930 09:26:08.812130 894 shared_informer.go:409] "Caches are synced" machine # [ 35.897606] k3s[894]: I0930 09:26:08.852143 894 shared_informer.go:388] "Caches are synced" controller="service config" machine # [ 35.917061] k3s[894]: time="2026-09-30T09:26:08Z" level=info msg="Tunnel authorizer set Kubelet Port 0.0.0.0:10250" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 35.994948] k3s[894]: I0930 09:26:08.949480 894 apiserver.go:51] "Watching apiserver" machine # [ 36.110066] systemd[1]: Created slice libcontainer container kubepods-burstable-pod22044f36_5646_4ea7_aab4_2ee306d09313.slice. machine # [ 36.112113] k3s[894]: I0930 09:26:09.066684 894 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" machine # [ 36.116932] systemd[1]: Created slice libcontainer container kubepods-burstable-pod3103f2c9_0022_4689_a6fe_262fd07af0b9.slice. machine # [ 36.117634] k3s[894]: I0930 09:26:09.071157 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-config-volume\" (UniqueName: \"kubernetes.io/configmap/22044f36-5646-4ea7-aab4-2ee306d09313-custom-config-volume\") pod \"coredns-54996dc9b4-8k9kh\" (UID: \"22044f36-5646-4ea7-aab4-2ee306d09313\") " pod="kube-system/coredns-54996dc9b4-8k9kh" machine # [ 36.118162] k3s[894]: I0930 09:26:09.071207 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/3103f2c9-0022-4689-a6fe-262fd07af0b9-klipper-helm\") pod \"helm-install-nix-grpc-farm-5l9xz\" (UID: \"3103f2c9-0022-4689-a6fe-262fd07af0b9\") " pod="kube-system/helm-install-nix-grpc-farm-5l9xz" machine # [ 36.118584] k3s[894]: I0930 09:26:09.071232 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/3103f2c9-0022-4689-a6fe-262fd07af0b9-klipper-cache\") pod \"helm-install-nix-grpc-farm-5l9xz\" (UID: \"3103f2c9-0022-4689-a6fe-262fd07af0b9\") " pod="kube-system/helm-install-nix-grpc-farm-5l9xz" machine # [ 36.119118] k3s[894]: I0930 09:26:09.071255 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/3103f2c9-0022-4689-a6fe-262fd07af0b9-klipper-config\") pod \"helm-install-nix-grpc-farm-5l9xz\" (UID: \"3103f2c9-0022-4689-a6fe-262fd07af0b9\") " pod="kube-system/helm-install-nix-grpc-farm-5l9xz" machine # [ 36.119612] k3s[894]: I0930 09:26:09.071296 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"values\" (UniqueName: \"kubernetes.io/projected/3103f2c9-0022-4689-a6fe-262fd07af0b9-values\") pod \"helm-install-nix-grpc-farm-5l9xz\" (UID: \"3103f2c9-0022-4689-a6fe-262fd07af0b9\") " pod="kube-system/helm-install-nix-grpc-farm-5l9xz" machine # [ 36.120200] k3s[894]: I0930 09:26:09.071323 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gfrg\" (UniqueName: \"kubernetes.io/projected/3103f2c9-0022-4689-a6fe-262fd07af0b9-kube-api-access-8gfrg\") pod \"helm-install-nix-grpc-farm-5l9xz\" (UID: \"3103f2c9-0022-4689-a6fe-262fd07af0b9\") " pod="kube-system/helm-install-nix-grpc-farm-5l9xz" machine # [ 36.120637] k3s[894]: I0930 09:26:09.071361 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/22044f36-5646-4ea7-aab4-2ee306d09313-config-volume\") pod \"coredns-54996dc9b4-8k9kh\" (UID: \"22044f36-5646-4ea7-aab4-2ee306d09313\") " pod="kube-system/coredns-54996dc9b4-8k9kh" machine # [ 36.121189] k3s[894]: I0930 09:26:09.071383 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7bj5\" (UniqueName: \"kubernetes.io/projected/22044f36-5646-4ea7-aab4-2ee306d09313-kube-api-access-z7bj5\") pod \"coredns-54996dc9b4-8k9kh\" (UID: \"22044f36-5646-4ea7-aab4-2ee306d09313\") " pod="kube-system/coredns-54996dc9b4-8k9kh" machine # [ 36.121677] k3s[894]: I0930 09:26:09.071456 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3103f2c9-0022-4689-a6fe-262fd07af0b9-tmp\") pod \"helm-install-nix-grpc-farm-5l9xz\" (UID: \"3103f2c9-0022-4689-a6fe-262fd07af0b9\") " pod="kube-system/helm-install-nix-grpc-farm-5l9xz" machine # [ 36.122385] k3s[894]: I0930 09:26:09.071564 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"content\" (UniqueName: \"kubernetes.io/configmap/3103f2c9-0022-4689-a6fe-262fd07af0b9-content\") pod \"helm-install-nix-grpc-farm-5l9xz\" (UID: \"3103f2c9-0022-4689-a6fe-262fd07af0b9\") " pod="kube-system/helm-install-nix-grpc-farm-5l9xz" machine # [ 36.326193] k3s[894]: I0930 09:26:09.280700 894 kube.go:163] Node controller sync successful machine # [ 36.327648] k3s[894]: I0930 09:26:09.280787 894 vxlan.go:128] VXLAN config: VNI=1 Port=0 GBP=false Learning=false DirectRouting=false machine # [ 36.329440] k3s[894]: I0930 09:26:09.284004 894 kube.go:704] List of node(machine) annotations: map[string]string{"alpha.kubernetes.io/provided-node-ip":"10.0.2.15,fec0::e0ea:959f:beb6:97cd", "k3s.io/hostname":"machine", "k3s.io/internal-ip":"10.0.2.15,fec0::e0ea:959f:beb6:97cd", "k3s.io/node-args":"[\"server\",\"--disable\",\"traefik\",\"--disable\",\"metrics-server\",\"--disable\",\"local-storage\",\"--kubelet-arg\",\"eviction-hard=nodefs.available\\u003c1%,imagefs.available\\u003c1%\"]", "k3s.io/node-config-hash":"EFXPOZ7ZWHRCLFNW4X4ZDPFQMSAOP3BLEIN2VE47TDRKQ4UIWKUQ====", "k3s.io/node-env":"{}", "node.alpha.kubernetes.io/ttl":"0", "volumes.kubernetes.io/controller-managed-attach-detach":"true"} machine # [ 36.354105] (udev-worker)[1265]: Network interface NamePolicy= disabled on kernel command line. machine # [ 36.360082] k3s[894]: I0930 09:26:09.314555 894 kube.go:558] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.42.0.0/24] machine # [ 36.363787] k3s[894]: I0930 09:26:09.318317 894 iptables.go:50] Starting flannel in iptables mode... machine # [ 36.364685] k3s[894]: time="2026-09-30T09:26:09Z" level=warning msg="no subnet found for key: FLANNEL_NETWORK in file: /run/flannel/subnet.env" machine # [ 36.365254] k3s[894]: time="2026-09-30T09:26:09Z" level=warning msg="no subnet found for key: FLANNEL_SUBNET in file: /run/flannel/subnet.env" machine # [ 36.365822] k3s[894]: time="2026-09-30T09:26:09Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_NETWORK in file: /run/flannel/subnet.env" machine # [ 36.366721] k3s[894]: time="2026-09-30T09:26:09Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_SUBNET in file: /run/flannel/subnet.env" machine # [ 36.367496] k3s[894]: I0930 09:26:09.318432 894 iptables.go:101] Current network or subnet (10.42.0.0/16, 10.42.0.0/24) is not equal to previous one (0.0.0.0/0, 0.0.0.0/0), trying to recycle old iptables rules machine # [ 36.388970] dhcpcd[693]: flannel.1: IAID e2:d9:04:59 machine # [ 36.389856] dhcpcd[693]: flannel.1: adding address fe80::80a0:e2ff:fed9:459 machine # [ 36.410358] k3s[894]: I0930 09:26:09.364912 894 iptables.go:111] Setting up masking rules machine # [ 36.421190] k3s[894]: I0930 09:26:09.375759 894 iptables.go:212] Changing default FORWARD chain policy to ACCEPT machine # [ 36.430421] k3s[894]: time="2026-09-30T09:26:09Z" level=info msg="Wrote flannel subnet file to /run/flannel/subnet.env" machine # [ 36.431099] k3s[894]: time="2026-09-30T09:26:09Z" level=info msg="Running flannel backend" machine # [ 36.431694] k3s[894]: I0930 09:26:09.385025 894 vxlan_network.go:68] watching for new subnet leases machine # [ 36.432482] k3s[894]: I0930 09:26:09.385066 894 vxlan_network.go:115] starting vxlan device watcher machine # [ 36.480912] k3s[894]: I0930 09:26:09.435408 894 iptables.go:358] bootstrap done machine # [ 36.531555] k3s[894]: I0930 09:26:09.486068 894 iptables.go:358] bootstrap done machine # [ 36.695782] cni0: port 1(vethfca33372) entered blocking state machine # [ 36.542242] (udev-worker)[1538]: Network interface NamePolicy= disabled on ke[ 36.697541] cni0: port 1(vethfca33372) entered disabled state machine # rnel command lin[ 36.698273] vethfca33372: entered allmulticast mode machine # e. machine # [ 36.699095] vethfca33372: entered promiscuous mode machine # [ 36.699861] cni0: port 2(veth7c870e46) entered blocking state machine # [ 36.700635] cni0: port 2(veth7c870e46) entered disabled state machine # [ 36.701229] veth7c870e46: entered allmulticast mode machine # [ 36.701883] veth7c870e46: entered promiscuous mode machine # [ 36.714832] cni0: port 2(veth7c870e46) entered blocking state machine # [ 36.715533] cni0: port 2(veth7c870e46) entered forwarding state machine # [ 36.719927] cni0: port 1(vethfca33372) entered blocking state machine # [ 36.720616] cni0: port 1(vethfca33372) entered forwarding state machine # [ 36.599643] dhcpcd[693]: vethfca33372: waiting for carrier machine # [ 36.615161] dhcpcd[693]: veth7c870e46: IAID 21:be:48:fa machine # [ 36.615875] dhcpcd[693]: veth7c870e46: adding address fe80::b83c:21ff:febe:48fa machine # [ 36.616777] dhcpcd[693]: vethfca33372: carrier acquired machine # [ 36.621967] dhcpcd[693]: vethfca33372: IAID 2b:a3:bb:9b machine # [ 36.622508] dhcpcd[693]: vethfca33372: adding address fe80::8c3a:2bff:fea3:bb9b machine # [ 36.817543] cni0: port 1(vethfca33372) entered disabled state machine # [ 36.663387] dhcpcd[693]: veth[ 36.818722] vethfca33372 (unregistering): left allmulticast mode machine # fca33372: carrier lost machine # [ 36.819837] vethfca33372 (unregistering): left promiscuous mode machine # [ 36.820667] cni0: port 1(vethfca33372) entered disabled state machine # [ 36.825189] cni0: port 2(veth7c870e46) entered disabled state machine # [ 36.826430] veth7c870e46 (unregistering): left allmulticast mode machine # [ 36.827461] veth7c870e46 (unregistering): left promiscuous mode machine # [ 36.828176] cni0: port 2(veth7c870e46) entered disabled state machine # [ 36.694366] dhcpcd[693]: vethfca33372: deleting address fe80::8c3a:2bff:fea3:bb9b machine # [ 36.695917] dhcpcd[693]: veth7c870e46: carrier lost machine # [ 36.699050] k3s[894]: E0930 09:26:09.653572 894 remote_runtime.go:237] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to pull image \"rancher/mirrored-pause:3.10.2\": failed to pull and unpack image \"docker.io/rancher/mirrored-pause:3.10.2\": failed to resolve reference \"docker.io/rancher/mirrored-pause:3.10.2\": failed to do request: Head \"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\": dial tcp: lookup registry-1.docker.io: no such host" machine # [ 36.704818] k3s[894]: E0930 09:26:09.653724 894 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to pull image \"rancher/mirrored-pause:3.10.2\": failed to pull and unpack image \"docker.io/rancher/mirrored-pause:3.10.2\": failed to resolve reference \"docker.io/rancher/mirrored-pause:3.10.2\": failed to do request: Head \"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\": dial tcp: lookup registry-1.docker.io: no such host" pod="kube-system/helm-install-nix-grpc-farm-5l9xz" machine # [ 36.711904] k3s[894]: E0930 09:26:09.653756 894 kuberuntime_manager.go:1640] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to pull image \"rancher/mirrored-pause:3.10.2\": failed to pull and unpack image \"docker.io/rancher/mirrored-pause:3.10.2\": failed to resolve reference \"docker.io/rancher/mirrored-pause:3.10.2\": failed to do request: Head \"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\": dial tcp: lookup registry-1.docker.io: no such host" pod="kube-system/helm-install-nix-grpc-farm-5l9xz" machine # [ 36.718702] k3s[894]: E0930 09:26:09.653846 894 pod_workers.go:1338] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"helm-install-nix-grpc-farm-5l9xz_kube-system(3103f2c9-0022-4689-a6fe-262fd07af0b9)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"helm-install-nix-grpc-farm-5l9xz_kube-system(3103f2c9-0022-4689-a6fe-262fd07af0b9)\\\": rpc error: code = Unknown desc = failed to pull image \\\"rancher/mirrored-pause:3.10.2\\\": failed to pull and unpack image \\\"docker.io/rancher/mirrored-pause:3.10.2\\\": failed to resolve reference \\\"docker.io/rancher/mirrored-pause:3.10.2\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="kube-system/helm-install-nix-grpc-farm-5l9xz" podUID="3103f2c9-0022-4689-a6fe-262fd07af0b9" machine # [ 36.729247] k3s[894]: E0930 09:26:09.662081 894 remote_runtime.go:237] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to pull image \"rancher/mirrored-pause:3.10.2\": failed to pull and unpack image \"docker.io/rancher/mirrored-pause:3.10.2\": failed to resolve reference \"docker.io/rancher/mirrored-pause:3.10.2\": failed to do request: Head \"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\": dial tcp: lookup registry-1.docker.io: no such host" machine # [ 36.735591] k3s[894]: E0930 09:26:09.662210 894 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to pull image \"rancher/mirrored-pause:3.10.2\": failed to pull and unpack image \"docker.io/rancher/mirrored-pause:3.10.2\": failed to resolve reference \"docker.io/rancher/mirrored-pause:3.10.2\": failed to do request: Head \"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\": dial tcp: lookup registry-1.docker.io: no such host" pod="kube-system/coredns-54996dc9b4-8k9kh" machine # [ 36.742339] k3s[894]: E0930 09:26:09.662233 894 kuberuntime_manager.go:1640] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to pull image \"rancher/mirrored-pause:3.10.2\": failed to pull and unpack image \"docker.io/rancher/mirrored-pause:3.10.2\": failed to resolve reference \"docker.io/rancher/mirrored-pause:3.10.2\": failed to do request: Head \"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\": dial tcp: lookup registry-1.docker.io: no such host" pod="kube-system/coredns-54996dc9b4-8k9kh" machine # [ 36.749176] k3s[894]: E0930 09:26:09.662296 894 pod_workers.go:1338] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-54996dc9b4-8k9kh_kube-system(22044f36-5646-4ea7-aab4-2ee306d09313)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-54996dc9b4-8k9kh_kube-system(22044f36-5646-4ea7-aab4-2ee306d09313)\\\": rpc error: code = Unknown desc = failed to pull image \\\"rancher/mirrored-pause:3.10.2\\\": failed to pull and unpack image \\\"docker.io/rancher/mirrored-pause:3.10.2\\\": failed to resolve reference \\\"docker.io/rancher/mirrored-pause:3.10.2\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="kube-system/coredns-54996dc9b4-8k9kh" podUID="22044f36-5646-4ea7-aab4-2ee306d09313" machine # [ 36.759460] dhcpcd[693]: veth7c870e46: deleting address fe80::b83c:21ff:febe:48fa machine # [ 36.760834] dhcpcd[693]: vethfca33372: removing interface machine # [ 36.761546] dhcpcd[693]: veth7c870e46: removing interface machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 37.436484] k3s[894]: time="2026-09-30T09:26:10Z" level=info msg="Starting network policy controller version v2.6.3-k3s1, built on 1970-01-01T01:01:01Z, go1.26.7" machine # [ 37.438410] k3s[894]: I0930 09:26:10.390767 894 network_policy_controller.go:164] Starting network policy controller machine # [ 37.603072] k3s[894]: I0930 09:26:10.557568 894 network_policy_controller.go:179] Starting network policy controller full sync goroutine machine # [ 38.201655] dhcpcd[693]: flannel.1: soliciting a DHCP lease machine # [ 38.244533] k3s[894]: time="2026-09-30T09:26:11Z" level=info msg="Imported docker.io/rancher/klipper-helm:v0.13.3-build20260727" machine # [ 38.249528] k3s[894]: time="2026-09-30T09:26:11Z" level=info msg="Tagged docker.io/rancher/klipper-helm@sha256:5425a2b4613d2458dbdff99218e8d487ebb59c20e7a941f061c0777070f0aac1" machine # [ 38.250183] k3s[894]: time="2026-09-30T09:26:11Z" level=info msg="Imported docker.io/rancher/klipper-lb:v0.4.17" machine # [ 38.256947] k3s[894]: time="2026-09-30T09:26:11Z" level=info msg="Tagged docker.io/rancher/klipper-lb@sha256:910944bb0bd94f060a82a56ca1ea1c577d3e49b3473a093a47a985f32e92d94a" machine # [ 38.257602] k3s[894]: time="2026-09-30T09:26:11Z" level=info msg="Imported docker.io/rancher/local-path-provisioner:v0.0.37" machine # [ 38.259281] k3s[894]: time="2026-09-30T09:26:11Z" level=info msg="Tagged docker.io/rancher/local-path-provisioner@sha256:e757967a5ec338f6a9b371c5a9688bedaa8c3578ea3dd4db329ea0084be0a86f" machine # [ 38.259520] k3s[894]: time="2026-09-30T09:26:11Z" level=info msg="Imported docker.io/rancher/mirrored-coredns-coredns:1.14.6" machine # [ 38.265187] k3s[894]: time="2026-09-30T09:26:11Z" level=info msg="Tagged docker.io/rancher/mirrored-coredns-coredns@sha256:900f9c109f7a33545d3c811516e8376df9019147b750f5ce3e254468769176ea" machine # [ 38.265690] k3s[894]: time="2026-09-30T09:26:11Z" level=info msg="Imported docker.io/rancher/mirrored-library-busybox:1.37.0" machine # [ 38.267508] k3s[894]: time="2026-09-30T09:26:11Z" level=info msg="Tagged docker.io/rancher/mirrored-library-busybox@sha256:101b4afd76732482eff9b95cae5f94bcf295e521fbec4e01b69c5421f3f3f3e5" machine # [ 38.268642] k3s[894]: time="2026-09-30T09:26:11Z" level=info msg="Imported docker.io/rancher/mirrored-library-traefik:3.7.8" machine # [ 38.275471] k3s[894]: time="2026-09-30T09:26:11Z" level=info msg="Tagged docker.io/rancher/mirrored-library-traefik@sha256:4299bbed850421258fc5448c2e0e6ad350981d4d335a68de11b92448aedbefe5" machine # [ 38.277832] k3s[894]: time="2026-09-30T09:26:11Z" level=info msg="Imported docker.io/rancher/mirrored-metrics-server:v0.9.0" machine # [ 38.281746] k3s[894]: time="2026-09-30T09:26:11Z" level=info msg="Tagged docker.io/rancher/mirrored-metrics-server@sha256:d9862115e7c7881280d3d75ca26bda8ffc0fc213315979575bf23ce9826205c0" machine # [ 38.282657] k3s[894]: time="2026-09-30T09:26:11Z" level=info msg="Imported docker.io/rancher/mirrored-pause:3.10.2" machine # [ 38.288853] k3s[894]: time="2026-09-30T09:26:11Z" level=info msg="Tagged docker.io/rancher/mirrored-pause@sha256:f548e0e8e3dc1896ca956272154dde3314e8cc4fde0a57577ee9fa1c63f5baf4" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 38.547145] k3s[894]: time="2026-09-30T09:26:11Z" level=info msg="Imported 8 images from /var/lib/rancher/k3s/agent/images/nixos/smddpgqzjvlqv3lx57wdzl7kma805fj0-k3s-airgap-images-amd64.tar.zst in 3.649417732s" machine # [ 39.092981] k3s[894]: I0930 09:26:12.047236 894 node_lifecycle_controller.go:1217] "Initializing eviction metric for zone" zone="" machine # [ 39.094996] k3s[894]: I0930 09:26:12.047524 894 node_lifecycle_controller.go:869] "Missing timestamp for Node. Assuming now as a timestamp" node="machine" machine # [ 39.096240] k3s[894]: I0930 09:26:12.047777 894 node_lifecycle_controller.go:1063] "Controller detected that zone is now in new state" zone="" newState="Normal" machine # [ 39.140642] dhcpcd[693]: flannel.1: soliciting an IPv6 router machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 43.202837] dhcpcd[693]: flannel.1: probing for an IPv4LL address machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 47.905112] dhcpcd[693]: flannel.1: using IPv4LL address 169.254.162.140 machine # [ 47.906272] dhcpcd[693]: flannel.1: adding route to 169.254.0.0/16 machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 48.382468] cni0: port 1(vethc8e52e83) entered blocking state machine # [ 48.383125] cni0: port 1(vethc8e52e83) entered disabled state machine # [ 48.383958] vethc8e52e83: entered allmulticast mode machine # [ 48.384684] vethc8e52e83: entered promiscuous mode machine # [ 48.395311] cni0: port 1(vethc8e52e83) entered blocking state machine # [ 48.396912] cni0: port 1(vethc8e52e83) entered forwarding state machine # [ 48.286660] (udev-worker)[2002]: Network interface NamePolicy= disabled on kernel command line. machine # [ 48.309533] dhcpcd[693]: vethc8e52e83: IAID 55:ac:5a:2d machine # [ 48.310325] dhcpcd[693]: vethc8e52e83: adding address fe80::e0c7:55ff:feac:5a2d machine # [ 48.325893] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount3188508770.mount: Deactivated successfully. machine # [ 48.344938] dhcpcd[693]: vethc8e52e83: soliciting a DHCP lease machine # [ 48.489970] systemd[1]: Started libcontainer container 114745d52dcd96bdc7746d13efcfc60c6d5c60dc5a8797cac51c687f5a5cfd7f. machine # [ 49.263097] systemd[1]: Started libcontainer container ffbc3c3ce3d29c543ae5a9e4f83ecae90d44c142460de43334dfb3de5cd0067b. machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 49.825538] dhcpcd[693]: vethc8e52e83: soliciting an IPv6 router machine # [ 50.180757] k3s[894]: I0930 09:26:23.133945 894 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/coredns-54996dc9b4-8k9kh" podStartSLOduration=21.133898437 podStartE2EDuration="21.133898437s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-30 09:26:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 09:26:22.29384586 +0000 UTC m=+31.547696423" watchObservedRunningTime="2026-09-30 09:26:23.133898437 +0000 UTC m=+32.387753469" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 51.145875] dhcpcd[693]: flannel.1: no IPv6 Routers available machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 52.307870] cni0: port 2(veth9158bfc7) entered blocking state machine # [ 52.309630] cni0: port 2(veth9158bfc7) entered disabled state machine # [ 52.311731] veth9158bfc7: entered allmulticast mode machine # [ 52.314649] veth9158bfc7: entered promiscuous mode machine # [ 52.335624] cni0: port 2(veth9158bfc7) entered blocking state machine # [ 52.336860] cni0: port 2(veth9158bfc7) entered forwarding state machine # [ 52.220265] (udev-worker)[2241]: Network interface NamePolicy= disabled on kernel command line. machine # [ 52.242609] dhcpcd[693]: veth9158bfc7: IAID 4c:68:c5:7c machine # [ 52.243450] dhcpcd[693]: veth9158bfc7: adding address fe80::9cec:4cff:fe68:c57c machine # [ 52.269567] systemd[1]: Started libcontainer container 70aab5f7054da01976f9319f9e20fb54db8d12be53e505585be0722f5e847eb0. machine # [ 52.514130] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount2835469974.mount: Deactivated successfully. machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 53.186640] systemd[1]: Started libcontainer container a819f2af98d94a4bf5ab51371829ff1c976e411561f9986a7f6ed27c117aac0f. machine # [ 53.301313] k3s[894]: I0930 09:26:26.255220 894 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/helm-install-nix-grpc-farm-5l9xz" podStartSLOduration=24.255196534 podStartE2EDuration="24.255196534s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-30 09:26:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 09:26:26.254278541 +0000 UTC m=+35.508129103" watchObservedRunningTime="2026-09-30 09:26:26.255196534 +0000 UTC m=+35.509047376" machine # [ 53.346465] dhcpcd[693]: vethc8e52e83: probing for an IPv4LL address machine # [ 53.601127] dhcpcd[693]: veth9158bfc7: soliciting a DHCP lease machine # [ 53.836353] dhcpcd[693]: veth9158bfc7: soliciting an IPv6 router machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 54.390179] k3s[894]: I0930 09:26:27.342684 894 alloc.go:329] "allocated clusterIPs" service="farm/nix-grpc-farm" clusterIPs={"IPv4":"10.43.24.202"} machine # [ 54.434668] systemd[1]: cri-containerd-a819f2af98d94a4bf5ab51371829ff1c976e411561f9986a7f6ed27c117aac0f.scope: Deactivated successfully. machine # [ 54.436450] systemd[1]: cri-containerd-a819f2af98d94a4bf5ab51371829ff1c976e411561f9986a7f6ed27c117aac0f.scope: Consumed 604ms CPU time over 1.247s wall clock time, 34.2M memory peak, 2.6M incoming IP traffic, 154K outgoing IP traffic. machine # [ 54.471323] k3s[894]: E0930 09:26:27.425866 894 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-lb-5877cc8b4f\" failed with read version: 463 is not as new as written version: 480 for group resource replicasets.apps" logger="UnhandledError" machine # [ 54.476725] k3s[894]: E0930 09:26:27.431280 894 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7\" failed with read version: 482 is not as new as written version: 486 for group resource replicasets.apps" logger="UnhandledError" machine # [ 54.488653] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-a819f2af98d94a4bf5ab51371829ff1c976e411561f9986a7f6ed27c117aac0f-rootfs.mount: Deactivated successfully. machine # [ 54.503094] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod0a51ae1d_19cc_404d_939e_9d7891ee9dda.slice. machine # [ 54.521546] systemd[1]: Created slice libcontainer container kubepods-besteffort-poddbcb6597_4acc_4a5f_b836_085ed6b78024.slice. machine # [ 54.542848] systemd[1]: Created slice libcontainer container kubepods-besteffort-podaf02f6f9_d4e9_4705_8151_bd3e6403d8c1.slice. machine # [ 54.552400] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod17261a2c_8f8a_4858_8971_9bcb5ca62d2d.slice. machine # [ 54.646234] k3s[894]: I0930 09:26:27.600690 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/0a51ae1d-19cc-404d-939e-9d7891ee9dda-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-krnnq\" (UID: \"0a51ae1d-19cc-404d-939e-9d7891ee9dda\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-krnnq" machine # [ 54.646637] k3s[894]: I0930 09:26:27.600740 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/0a51ae1d-19cc-404d-939e-9d7891ee9dda-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-krnnq\" (UID: \"0a51ae1d-19cc-404d-939e-9d7891ee9dda\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-krnnq" machine # [ 54.647102] k3s[894]: I0930 09:26:27.600773 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tkvs\" (UniqueName: \"kubernetes.io/projected/0a51ae1d-19cc-404d-939e-9d7891ee9dda-kube-api-access-2tkvs\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-krnnq\" (UID: \"0a51ae1d-19cc-404d-939e-9d7891ee9dda\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-krnnq" machine # [ 54.647589] k3s[894]: I0930 09:26:27.600802 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/17261a2c-8f8a-4858-8971-9bcb5ca62d2d-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-n8p2g\" (UID: \"17261a2c-8f8a-4858-8971-9bcb5ca62d2d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-n8p2g" machine # [ 54.648204] k3s[894]: I0930 09:26:27.600920 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/17261a2c-8f8a-4858-8971-9bcb5ca62d2d-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-n8p2g\" (UID: \"17261a2c-8f8a-4858-8971-9bcb5ca62d2d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-n8p2g" machine # [ 54.648731] k3s[894]: I0930 09:26:27.600973 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/af02f6f9-d4e9-4705-8151-bd3e6403d8c1-tls-lb\") pod \"nix-grpc-farm-lb-5877cc8b4f-hwskl\" (UID: \"af02f6f9-d4e9-4705-8151-bd3e6403d8c1\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-hwskl" machine # [ 54.649536] k3s[894]: I0930 09:26:27.601089 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/dbcb6597-4acc-4a5f-b836-085ed6b78024-niks3-token\") pod \"nix-grpc-farm-scheduler-55cccf6d96-skztj\" (UID: \"dbcb6597-4acc-4a5f-b836-085ed6b78024\") " pod="farm/nix-grpc-farm-scheduler-55cccf6d96-skztj" machine # [ 54.650099] k3s[894]: I0930 09:26:27.601137 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/dbcb6597-4acc-4a5f-b836-085ed6b78024-oidc\") pod \"nix-grpc-farm-scheduler-55cccf6d96-skztj\" (UID: \"dbcb6597-4acc-4a5f-b836-085ed6b78024\") " pod="farm/nix-grpc-farm-scheduler-55cccf6d96-skztj" machine # [ 54.650558] k3s[894]: I0930 09:26:27.601170 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/17261a2c-8f8a-4858-8971-9bcb5ca62d2d-build\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-n8p2g\" (UID: \"17261a2c-8f8a-4858-8971-9bcb5ca62d2d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-n8p2g" machine # [ 54.651470] k3s[894]: I0930 09:26:27.601196 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/17261a2c-8f8a-4858-8971-9bcb5ca62d2d-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-n8p2g\" (UID: \"17261a2c-8f8a-4858-8971-9bcb5ca62d2d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-n8p2g" machine # [ 54.651988] k3s[894]: I0930 09:26:27.601239 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/0a51ae1d-19cc-404d-939e-9d7891ee9dda-build\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-krnnq\" (UID: \"0a51ae1d-19cc-404d-939e-9d7891ee9dda\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-krnnq" machine # [ 54.652689] k3s[894]: I0930 09:26:27.601347 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/af02f6f9-d4e9-4705-8151-bd3e6403d8c1-config\") pod \"nix-grpc-farm-lb-5877cc8b4f-hwskl\" (UID: \"af02f6f9-d4e9-4705-8151-bd3e6403d8c1\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-hwskl" machine # [ 54.696300] k3s[894]: I0930 09:26:27.601374 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/17261a2c-8f8a-4858-8971-9bcb5ca62d2d-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-n8p2g\" (UID: \"17261a2c-8f8a-4858-8971-9bcb5ca62d2d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-n8p2g" machine # [ 54.696928] k3s[894]: I0930 09:26:27.601432 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/17261a2c-8f8a-4858-8971-9bcb5ca62d2d-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-n8p2g\" (UID: \"17261a2c-8f8a-4858-8971-9bcb5ca62d2d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-n8p2g" machine # [ 54.697808] k3s[894]: I0930 09:26:27.601458 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjjqp\" (UniqueName: \"kubernetes.io/projected/17261a2c-8f8a-4858-8971-9bcb5ca62d2d-kube-api-access-pjjqp\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-n8p2g\" (UID: \"17261a2c-8f8a-4858-8971-9bcb5ca62d2d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-n8p2g" machine # [ 54.698553] k3s[894]: I0930 09:26:27.601489 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/0a51ae1d-19cc-404d-939e-9d7891ee9dda-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-krnnq\" (UID: \"0a51ae1d-19cc-404d-939e-9d7891ee9dda\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-krnnq" machine # [ 54.699206] k3s[894]: I0930 09:26:27.601513 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/dbcb6597-4acc-4a5f-b836-085ed6b78024-ca\") pod \"nix-grpc-farm-scheduler-55cccf6d96-skztj\" (UID: \"dbcb6597-4acc-4a5f-b836-085ed6b78024\") " pod="farm/nix-grpc-farm-scheduler-55cccf6d96-skztj" machine # [ 54.699724] k3s[894]: I0930 09:26:27.601541 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/0a51ae1d-19cc-404d-939e-9d7891ee9dda-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-krnnq\" (UID: \"0a51ae1d-19cc-404d-939e-9d7891ee9dda\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-krnnq" machine # [ 54.700196] k3s[894]: I0930 09:26:27.601586 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/dbcb6597-4acc-4a5f-b836-085ed6b78024-tls\") pod \"nix-grpc-farm-scheduler-55cccf6d96-skztj\" (UID: \"dbcb6597-4acc-4a5f-b836-085ed6b78024\") " pod="farm/nix-grpc-farm-scheduler-55cccf6d96-skztj" machine # [ 54.700518] k3s[894]: I0930 09:26:27.601737 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/17261a2c-8f8a-4858-8971-9bcb5ca62d2d-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-n8p2g\" (UID: \"17261a2c-8f8a-4858-8971-9bcb5ca62d2d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-n8p2g" machine # [ 54.700893] k3s[894]: I0930 09:26:27.601768 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzn7c\" (UniqueName: \"kubernetes.io/projected/dbcb6597-4acc-4a5f-b836-085ed6b78024-kube-api-access-zzn7c\") pod \"nix-grpc-farm-scheduler-55cccf6d96-skztj\" (UID: \"dbcb6597-4acc-4a5f-b836-085ed6b78024\") " pod="farm/nix-grpc-farm-scheduler-55cccf6d96-skztj" machine # [ 54.701588] k3s[894]: I0930 09:26:27.601797 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0a51ae1d-19cc-404d-939e-9d7891ee9dda-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-krnnq\" (UID: \"0a51ae1d-19cc-404d-939e-9d7891ee9dda\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-krnnq" machine # [ 54.702233] k3s[894]: I0930 09:26:27.601819 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/0a51ae1d-19cc-404d-939e-9d7891ee9dda-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-krnnq\" (UID: \"0a51ae1d-19cc-404d-939e-9d7891ee9dda\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-krnnq" machine # [ 54.744723] k3s[894]: I0930 09:26:27.601844 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/0a51ae1d-19cc-404d-939e-9d7891ee9dda-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-krnnq\" (UID: \"0a51ae1d-19cc-404d-939e-9d7891ee9dda\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-krnnq" machine # [ 54.745458] k3s[894]: I0930 09:26:27.601868 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af02f6f9-d4e9-4705-8151-bd3e6403d8c1-tmp\") pod \"nix-grpc-farm-lb-5877cc8b4f-hwskl\" (UID: \"af02f6f9-d4e9-4705-8151-bd3e6403d8c1\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-hwskl" machine # [ 54.745948] k3s[894]: I0930 09:26:27.601894 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/17261a2c-8f8a-4858-8971-9bcb5ca62d2d-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-n8p2g\" (UID: \"17261a2c-8f8a-4858-8971-9bcb5ca62d2d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-n8p2g" machine # [ 54.746637] k3s[894]: I0930 09:26:27.601916 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/af02f6f9-d4e9-4705-8151-bd3e6403d8c1-tls-ca\") pod \"nix-grpc-farm-lb-5877cc8b4f-hwskl\" (UID: \"af02f6f9-d4e9-4705-8151-bd3e6403d8c1\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-hwskl" machine # [ 55.038247] (udev-worker)[2251]: Network interface NamePolicy= disabled on kernel command line. machine # [ 55.197076] cni0: port 3(vethb238dd68) entered blocking state machine # [ 55.198203] cni0: port 3(vethb238dd68) entered disabled state machine # [ 55.199092] vethb238dd68: entered allmulticast mode machine # [ 55.200077] vethb238dd68: entered promiscuous mode machine # [ 55.215341] cni0: port 3(vethb238dd68) entered blocking state machine # [ 55.216052] cni0: port 3(vethb238dd68) entered forwarding state machine # [ 55.226632] cni0: port 4(veth0cd56366) entered blocking state machine # [ 55.227312] cni0: port 4(veth0cd56366) entered disabled state machine # [ 55.228061] veth0cd56366: entered allmulticast mode machine # [ 55.228738] veth0cd56366: entered promiscuous mode machine # [ 55.241060] cni0: port 5(vethd31124c9) entered blocking state machine # [ 55.243191] cni0: port 5(vethd31124c9) entered disabled state machine # [ 55.246246] vethd31124c9: entered allmulticast mode machine # [ 55.249167] vethd31124c9: entered promiscuous mode machine # [ 55.251917] cni0: port 4(veth0cd56366) entered blocking state machine # [ 55.098256] dhcpcd[693]: veth[ 55.253181] cni0: port 4(veth0cd56366) entered forwarding state machine # b238dd68: waiting for carrier machine # [ 55.113526] dhcpcd[693]: veth0cd56366: IAID 00:68:1f:09[ 55.268134] cni0: port 5(vethd31124c9) entered blocking state machine # machine # [ 55.115181] d[ 55.269377] cni0: port 5(vethd31124c9) entered forwarding state machine # hcpcd[693]: veth0cd56366: adding address fe80::fc17:ff:fe68:1f09 machine # [ 55.148168] dhcpcd[693]: vethd31124c9: waiting for carrier machine # [ 55.148949] dhcpcd[693]: vethb238dd68: carrier acquired machine # [ 55.156828] dhcpcd[693]: vethb238dd68: IAID 0a:59:0b:fe machine # [ 55.158228] dhcpcd[693]: vethb238dd68: adding address fe80::7c48:aff:fe59:bfe machine # [ 55.159077] dhcpcd[693]: veth0cd56366: old hardware address: fe:17:00:68:1f:09 machine # [ 55.159831] dhcpcd[693]: veth0cd56366: new hardware address: d2:e9:b6:45:bb:7a machine # [ 55.160867] dhcpcd[693]: veth0cd56366: carrier lost machine # [ 55.182849] dhcpcd[693]: veth0cd56366: deleting address fe80::fc17:ff:fe68:1f09 machine # [ 55.183982] dhcpcd[693]: veth0cd56366: old hardware address: d2:e9:b6:45:bb:7a machine # [ 55.184440] dhcpcd[693]: veth0cd56366: new hardware address: fe:17:00:68:1f:09 machine # [ 55.186189] dhcpcd[693]: vethd31124c9: old hardware address: aa:86:80:bb:a6:b0 machine # [ 55.186799] dhcpcd[693]: vethd31124c9: new hardware address: 86:ea:8c:18:7e:eb machine # [ 55.187504] dhcpcd[693]: vethd31124c9: carrier lost machine # [ 55.189558] systemd[1]: Started libcontainer container c3b63e73ed3fc4149ea733f988745e051a7b6931ef615d8cbb13a0c8cbf93b68. machine # [ 55.216403] dhcpcd[693]: vethd31124c9: old hardware address: 86:ea:8c:18:7e:eb machine # [ 55.216948] dhcpcd[693]: vethd31124c9: new hardware address: aa:86:80:bb:a6:b0 machine # [ 55.217592] dhcpcd[693]: veth0cd56366: carrier acquired machine # [ 55.226289] dhcpcd[693]: veth0cd56366: IAID 00:68:1f:09 machine # [ 55.228174] dhcpcd[693]: veth0cd56366: adding address fe80::fc17:ff:fe68:1f09 machine # [ 55.228685] dhcpcd[693]: veth0cd56366: soliciting a DHCP lease machine # [ 55.232350] dhcpcd[693]: vethd31124c9: carrier acquired machine # [ 55.238433] dhcpcd[693]: vethd31124c9: IAID 80:bb:a6:b0 machine # [ 55.239754] dhcpcd[693]: vethd31124c9: adding address fe80::a886:80ff:febb:a6b0 machine # [ 55.254128] systemd[1]: Started libcontainer container 712d4757fb78f60b057d5558f92bf7c9600ce9a4cfca3e7bad01b97d1b87b7da. machine # [ 55.276612] systemd[1]: Started libcontainer container 82da7acdb98a058b97c06f3ea2dd07a64e282923e99c557f684e445a3dac0661. machine # [ 55.502498] cni0: port 6(veth88c6b10c) entered blocking state machine # [ 55.503916] cni0: port 6(veth88c6b10c) entered disabled state machine # [ 55.505269] veth88c6b10c: entered allmulticast mode machine # [ 55.506656] veth88c6b10c: entered promiscuous mode machine # [ 55.522920] cni0: port 6(veth88c6b10c) entered blocking state machine # [ 55.524284] cni0: port 6(veth88c6b10c) entered forwarding state machine # [ 55.412245] (udev-worker)[2891]: Network interface NamePolicy= disabled on kernel command line. machine # [ 55.437693] dhcpcd[693]: veth88c6b10c: IAID 82:b2:be:78 machine # [ 55.438648] dhcpcd[693]: veth88c6b10c: adding address fe80::1004:82ff:feb2:be78 machine # [ 55.505830] dhcpcd[693]: vethb238dd68: soliciting a DHCP lease machine # [ 55.557744] systemd[1]: Started libcontainer container 615ccb9c830b3b72bcdce13abf273191e85eddd5f29bb7d03fe68c19eec4d015. machine # [ 55.719445] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount1072692999.mount: Deactivated successfully. machine # [ 56.207388] systemd[1]: cri-containerd-70aab5f7054da01976f9319f9e20fb54db8d12be53e505585be0722f5e847eb0.scope: Deactivated successfully. machine # [ 56.490573] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-70aab5f7054da01976f9319f9e20fb54db8d12be53e505585be0722f5e847eb0-rootfs.mount: Deactivated successfully. machine # [ 56.567576] systemd[1]: Started libcontainer container 03a8c026748bae6769646eb669db245059b50f85eaf01c8acead72df48157019. machine # [ 56.646660] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-70aab5f7054da01976f9319f9e20fb54db8d12be53e505585be0722f5e847eb0-shm.mount: Deactivated successfully. machine # [ 56.659214] k3s[894]: I0930 09:26:29.611859 894 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-5877cc8b4f-hwskl" podStartSLOduration=2.611833481 podStartE2EDuration="2.611833481s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-30 09:26:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 09:26:29.610403132 +0000 UTC m=+38.864253973" watchObservedRunningTime="2026-09-30 09:26:29.611833481 +0000 UTC m=+38.865684043" machine # [ 56.846674] cni0: port 2(veth9158bfc7) entered disabled state machine # [ 56.693407] dhcpcd[693]: veth9158bfc7: carrier lost machine # [ 56.848970] veth9158bfc7 (unregistering): left allmulticast mode machine # [ 56.850191] veth9158bfc7 (unregistering): left promiscuous mode machine # [ 56.851983] cni0: port 2(veth9158bfc7) entered disabled state machine # [ 56.713717] systemd[1]: run-netns-cni\x2d93ed49c7\x2d2351\x2d7bc6\x2d0b18\x2d406d870f9d63.mount: Deactivated successfully. machine # [ 56.720595] dhcpcd[693]: veth9158bfc7: deleting address fe80::9cec:4cff:fe68:c57c machine # [ 56.760356] dhcpcd[693]: veth9158bfc7: removing interface machine # [ 56.797431] dhcpcd[693]: vethd31124c9: soliciting a DHCP lease machine # [ 56.884536] k3s[894]: I0930 09:26:29.839029 894 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3103f2c9-0022-4689-a6fe-262fd07af0b9-klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/3103f2c9-0022-4689-a6fe-262fd07af0b9-klipper-config\") pod \"3103f2c9-0022-4689-a6fe-262fd07af0b9\" (UID: \"3103f2c9-0022-4689-a6fe-262fd07af0b9\") " machine # [ 56.884949] k3s[894]: I0930 09:26:29.839103 894 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3103f2c9-0022-4689-a6fe-262fd07af0b9-values\" (UniqueName: \"kubernetes.io/projected/3103f2c9-0022-4689-a6fe-262fd07af0b9-values\") pod \"3103f2c9-0022-4689-a6fe-262fd07af0b9\" (UID: \"3103f2c9-0022-4689-a6fe-262fd07af0b9\") " machine # [ 56.885570] k3s[894]: I0930 09:26:29.839136 894 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3103f2c9-0022-4689-a6fe-262fd07af0b9-klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/3103f2c9-0022-4689-a6fe-262fd07af0b9-klipper-helm\") pod \"3103f2c9-0022-4689-a6fe-262fd07af0b9\" (UID: \"3103f2c9-0022-4689-a6fe-262fd07af0b9\") " machine # [ 56.886132] k3s[894]: I0930 09:26:29.839182 894 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3103f2c9-0022-4689-a6fe-262fd07af0b9-klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/3103f2c9-0022-4689-a6fe-262fd07af0b9-klipper-cache\") pod \"3103f2c9-0022-4689-a6fe-262fd07af0b9\" (UID: \"3103f2c9-0022-4689-a6fe-262fd07af0b9\") " machine # [ 56.886549] k3s[894]: I0930 09:26:29.839212 894 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3103f2c9-0022-4689-a6fe-262fd07af0b9-content\" (UniqueName: \"kubernetes.io/configmap/3103f2c9-0022-4689-a6fe-262fd07af0b9-content\") pod \"3103f2c9-0022-4689-a6fe-262fd07af0b9\" (UID: \"3103f2c9-0022-4689-a6fe-262fd07af0b9\") " machine # [ 56.887140] k3s[894]: I0930 09:26:29.839239 894 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3103f2c9-0022-4689-a6fe-262fd07af0b9-kube-api-access-8gfrg\" (UniqueName: \"kubernetes.io/projected/3103f2c9-0022-4689-a6fe-262fd07af0b9-kube-api-access-8gfrg\") pod \"3103f2c9-0022-4689-a6fe-262fd07af0b9\" (UID: \"3103f2c9-0022-4689-a6fe-262fd07af0b9\") " machine # [ 56.887727] k3s[894]: I0930 09:26:29.839285 894 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3103f2c9-0022-4689-a6fe-262fd07af0b9-tmp\" (UniqueName: \"kubernetes.io/empty-dir/3103f2c9-0022-4689-a6fe-262fd07af0b9-tmp\") pod \"3103f2c9-0022-4689-a6fe-262fd07af0b9\" (UID: \"3103f2c9-0022-4689-a6fe-262fd07af0b9\") " machine # [ 56.892385] k3s[894]: I0930 09:26:29.845766 894 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3103f2c9-0022-4689-a6fe-262fd07af0b9-content" pod "3103f2c9-0022-4689-a6fe-262fd07af0b9" (UID: "3103f2c9-0022-4689-a6fe-262fd07af0b9"). InnerVolumeSpecName "content". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 56.893059] systemd[1]: var-lib-kubelet-pods-3103f2c9\x2d0022\x2d4689\x2da6fe\x2d262fd07af0b9-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dcache.mount: Deactivated successfully. machine # [ 56.893560] systemd[1]: var-lib-kubelet-pods-3103f2c9\x2d0022\x2d4689\x2da6fe\x2d262fd07af0b9-volumes-kubernetes.io\x7eprojected-values.mount: Deactivated successfully. machine # [ 56.894120] systemd[1]: var-lib-kubelet-pods-3103f2c9\x2d0022\x2d4689\x2da6fe\x2d262fd07af0b9-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 56.922859] k3s[894]: I0930 09:26:29.877404 894 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3103f2c9-0022-4689-a6fe-262fd07af0b9-tmp" pod "3103f2c9-0022-4689-a6fe-262fd07af0b9" (UID: "3103f2c9-0022-4689-a6fe-262fd07af0b9"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 56.924444] k3s[894]: I0930 09:26:29.879007 894 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3103f2c9-0022-4689-a6fe-262fd07af0b9-values" pod "3103f2c9-0022-4689-a6fe-262fd07af0b9" (UID: "3103f2c9-0022-4689-a6fe-262fd07af0b9"). InnerVolumeSpecName "values". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 56.925655] k3s[894]: I0930 09:26:29.880048 894 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3103f2c9-0022-4689-a6fe-262fd07af0b9-klipper-cache" pod "3103f2c9-0022-4689-a6fe-262fd07af0b9" (UID: "3103f2c9-0022-4689-a6fe-262fd07af0b9"). InnerVolumeSpecName "klipper-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 56.926425] k3s[894]: I0930 09:26:29.879989 894 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3103f2c9-0022-4689-a6fe-262fd07af0b9-klipper-helm" pod "3103f2c9-0022-4689-a6fe-262fd07af0b9" (UID: "3103f2c9-0022-4689-a6fe-262fd07af0b9"). InnerVolumeSpecName "klipper-helm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 56.926902] k3s[894]: I0930 09:26:29.880094 894 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3103f2c9-0022-4689-a6fe-262fd07af0b9-kube-api-access-8gfrg" pod "3103f2c9-0022-4689-a6fe-262fd07af0b9" (UID: "3103f2c9-0022-4689-a6fe-262fd07af0b9"). InnerVolumeSpecName "kube-api-access-8gfrg". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 56.946821] k3s[894]: I0930 09:26:29.901337 894 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3103f2c9-0022-4689-a6fe-262fd07af0b9-klipper-config" pod "3103f2c9-0022-4689-a6fe-262fd07af0b9" (UID: "3103f2c9-0022-4689-a6fe-262fd07af0b9"). InnerVolumeSpecName "klipper-config". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 56.962586] dhcpcd[693]: vethd31124c9: soliciting an IPv6 router machine # [ 56.985277] k3s[894]: I0930 09:26:29.939611 894 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gfrg\" (UniqueName: \"kubernetes.io/projected/3103f2c9-0022-4689-a6fe-262fd07af0b9-kube-api-access-8gfrg\") on node \"machine\" DevicePath \"\"" machine # [ 56.986138] k3s[894]: I0930 09:26:29.939667 894 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3103f2c9-0022-4689-a6fe-262fd07af0b9-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 56.987268] k3s[894]: I0930 09:26:29.939681 894 reconciler_common.go:299] "Volume detached for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/3103f2c9-0022-4689-a6fe-262fd07af0b9-klipper-config\") on node \"machine\" DevicePath \"\"" machine # [ 56.987379] k3s[894]: I0930 09:26:29.939694 894 reconciler_common.go:299] "Volume detached for volume \"values\" (UniqueName: \"kubernetes.io/projected/3103f2c9-0022-4689-a6fe-262fd07af0b9-values\") on node \"machine\" DevicePath \"\"" machine # [ 56.989065] k3s[894]: I0930 09:26:29.939707 894 reconciler_common.go:299] "Volume detached for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/3103f2c9-0022-4689-a6fe-262fd07af0b9-klipper-helm\") on node \"machine\" DevicePath \"\"" machine # [ 56.989790] k3s[894]: I0930 09:26:29.939719 894 reconciler_common.go:299] "Volume detached for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/3103f2c9-0022-4689-a6fe-262fd07af0b9-klipper-cache\") on node \"machine\" DevicePath \"\"" machine # [ 56.990505] k3s[894]: I0930 09:26:29.939731 894 reconciler_common.go:299] "Volume detached for volume \"content\" (UniqueName: \"kubernetes.io/configmap/3103f2c9-0022-4689-a6fe-262fd07af0b9-content\") on node \"machine\" DevicePath \"\"" machine # [ 57.122652] systemd[1]: Removed slice libcontainer container kubepods-burstable-pod3103f2c9_0022_4689_a6fe_262fd07af0b9.slice. machine # [ 57.123170] systemd[1]: kubepods-burstable-pod3103f2c9_0022_4689_a6fe_262fd07af0b9.slice: Consumed 631ms CPU time over 21.005s wall clock time, 34.4M memory peak, 2.6M incoming IP traffic, 154K outgoing IP traffic. machine # [ 57.196717] k3s[894]: I0930 09:26:30.151225 894 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="70aab5f7054da01976f9319f9e20fb54db8d12be53e505585be0722f5e847eb0" machine # [ 57.201754] k3s[894]: E0930 09:26:30.151347 894 kubelet_pods.go:2193] "failed to read memory cgroup config for the pod" err="failed to read memory.max for cgroup /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3103f2c9_0022_4689_a6fe_262fd07af0b9.slice: openat2 /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3103f2c9_0022_4689_a6fe_262fd07af0b9.slice/memory.max: no such file or directory" podName="helm-install-nix-grpc-farm-5l9xz" machine # [ 57.208150] k3s[894]: E0930 09:26:30.151449 894 kubelet_pods.go:2198] "failed to read memory cgroup limits for the pod" err="failed to read cpu.max file for cgroup /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3103f2c9_0022_4689_a6fe_262fd07af0b9.slice: openat2 /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3103f2c9_0022_4689_a6fe_262fd07af0b9.slice/cpu.max: no such file or directory" podName="helm-install-nix-grpc-farm-5l9xz" machine # [ 57.285520] dhcpcd[693]: veth88c6b10c: soliciting an IPv6 router machine # [ 57.316651] dhcpcd[693]: vethb238dd68: soliciting an IPv6 router machine # [ 57.354888] dhcpcd[693]: veth88c6b10c: soliciting a DHCP lease machine # [ 57.489485] systemd[1]: var-lib-kubelet-pods-3103f2c9\x2d0022\x2d4689\x2da6fe\x2d262fd07af0b9-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2d8gfrg.mount: Deactivated successfully. machine # [ 57.495524] systemd[1]: var-lib-kubelet-pods-3103f2c9\x2d0022\x2d4689\x2da6fe\x2d262fd07af0b9-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dconfig.mount: Deactivated successfully. machine # [ 57.501567] systemd[1]: var-lib-kubelet-pods-3103f2c9\x2d0022\x2d4689\x2da6fe\x2d262fd07af0b9-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dhelm.mount: Deactivated successfully. machine # [ 57.933620] dhcpcd[693]: veth0cd56366: soliciting an IPv6 router machine # [ 58.209666] dhcpcd[693]: vethc8e52e83: using IPv4LL address 169.254.214.243 machine # [ 58.210860] dhcpcd[693]: vethc8e52e83: adding route to 169.254.0.0/16 machine # [ 60.229738] dhcpcd[693]: veth0cd56366: probing for an IPv4LL address machine # [ 60.506843] dhcpcd[693]: vethb238dd68: probing for an IPv4LL address machine # [ 61.798474] dhcpcd[693]: vethd31124c9: probing for an IPv4LL address machine # [ 61.827351] dhcpcd[693]: vethc8e52e83: no IPv6 Routers available machine # [ 61.861981] systemd[1]: tmp-ovl\x2didmapped3106909363.mount: Deactivated successfully. machine # [ 61.869557] systemd[1]: tmp-ovl\x2didmapped872758732.mount: Deactivated successfully. machine # [ 61.879256] systemd[1]: Started libcontainer container 2d72b7ef2e61788a884470fd4abb3f06322d830b3f93d3983a408fc769c21abb. machine # [ 61.882215] systemd[1]: Started libcontainer container 072957bcbfd86a26868e977e2b1cb181513a7f8157508774215557990471db60. machine # [ 61.894369] systemd[1]: Started libcontainer container 871cf9086655ab08f8dcfac1c1781653113a6d1b2143f18ce68e45831e5ec14c. machine # [ 62.192977] niks3-server[1198]: 2026/09/30 09:26:35 INFO lead: acquired remote=10.42.0.9:59254 machine # [ 62.233329] k3s[894]: I0930 09:26:35.186847 894 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-scheduler-55cccf6d96-skztj" podStartSLOduration=8.186820804 podStartE2EDuration="8.186820804s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-30 09:26:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 09:26:34.98454314 +0000 UTC m=+44.238393982" watchObservedRunningTime="2026-09-30 09:26:35.186820804 +0000 UTC m=+44.440671366" machine # [ 62.355448] dhcpcd[693]: veth88c6b10c: probing for an IPv4LL address machine # [ 63.833032] systemd[1]: cri-containerd-072957bcbfd86a26868e977e2b1cb181513a7f8157508774215557990471db60.scope: Deactivated successfully. machine # [ 63.834970] systemd[1]: cri-containerd-072957bcbfd86a26868e977e2b1cb181513a7f8157508774215557990471db60.scope: Consumed 801ms CPU time over 1.949s wall clock time, 334M memory peak, 65.3M read from disk, 191.5M written to disk. machine # [ 63.841481] systemd[1]: cri-containerd-2d72b7ef2e61788a884470fd4abb3f06322d830b3f93d3983a408fc769c21abb.scope: Deactivated successfully. machine # [ 63.844200] systemd[1]: cri-containerd-2d72b7ef2e61788a884470fd4abb3f06322d830b3f93d3983a408fc769c21abb.scope: Consumed 793ms CPU time over 1.963s wall clock time, 366.4M memory peak, 103.5M read from disk, 191.5M written to disk. machine # [ 63.892106] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-072957bcbfd86a26868e977e2b1cb181513a7f8157508774215557990471db60-rootfs.mount: Deactivated successfully. machine # [ 63.898831] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-2d72b7ef2e61788a884470fd4abb3f06322d830b3f93d3983a408fc769c21abb-rootfs.mount: Deactivated successfully. machine # [ 64.418489] systemd[1]: Started libcontainer container 5f7442dcfadbc3ecce091781795cc8670058283c6a9da477e717f521f50a3a41. machine # [ 64.422168] systemd[1]: Started libcontainer container 41f3c7c02067d31a24c357514ced2a14befbe6f81d6ed03993398fcc08bda6f3. machine # [ 64.592301] systemd[1]: Started libcontainer container 3cef7431f3c58f45ce51d79fb907c01be2fd0fbd5dcdf2dbf9bafdec360f2222. machine # [ 64.645364] systemd[1]: Started libcontainer container 68acb45a805329cbbcc66ed81718e8ebc32b8acae032579f28f620c33e4f7186. machine # [ 64.792434] systemd[1]: Started libcontainer container 66a6b1736f4cbd3c8a012e5215cedf76520bd3ff1faccdee3348d6dfc2bd3404. machine # [ 64.844827] systemd[1]: Started libcontainer container c4d646410108ad3c3a2ef7d286553994bf03d7bf6664a52d079518e35d10c5ed. machine # [ 64.868254] k3s[894]: I0930 09:26:37.821718 894 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-n8p2g" podStartSLOduration=8.909070699 podStartE2EDuration="10.821691996s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.912621297s" isStatefulPod=false podCreationTimestamp="2026-09-30 09:26:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 09:26:37.820446027 +0000 UTC m=+47.074297427" watchObservedRunningTime="2026-09-30 09:26:37.821691996 +0000 UTC m=+47.075542837" machine # [ 64.906702] systemd[1]: tmp-ovl\x2didmapped3682304220.mount: Deactivated successfully. machine # [ 64.924346] k3s[894]: I0930 09:26:37.878835 894 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-krnnq" podStartSLOduration=8.95567299 podStartE2EDuration="10.878809031s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.923136041s" isStatefulPod=false podCreationTimestamp="2026-09-30 09:26:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 09:26:37.878440269 +0000 UTC m=+47.132291390" watchObservedRunningTime="2026-09-30 09:26:37.878809031 +0000 UTC m=+47.132659873" machine # [ 65.010807] dhcpcd[693]: vethb238dd68: using IPv4LL address 169.254.171.171 machine # [ 65.012117] dhcpcd[693]: vethb238dd68: adding route to 169.254.0.0/16 machine # error: timed out waiting for the condition machine # [ 65.830760] dhcpcd[693]: veth0cd56366: using IPv4LL address 169.254.157.25 machine # [ 65.832189] dhcpcd[693]: veth0cd56366: adding route to 169.254.0.0/16 machine # [ 66.794952] dhcpcd[693]: vethd31124c9: using IPv4LL address 169.254.110.121 machine # [ 66.796714] dhcpcd[693]: vethd31124c9: adding route to 169.254.0.0/16 machine # [ 67.682908] dhcpcd[693]: veth88c6b10c: using IPv4LL address 169.254.82.223 machine # [ 67.685189] dhcpcd[693]: veth88c6b10c: adding route to 169.254.0.0/16 machine # [ 68.965517] dhcpcd[693]: vethd31124c9: no IPv6 Routers available machine # [ 69.288813] dhcpcd[693]: veth88c6b10c: no IPv6 Routers available machine # [ 69.318973] dhcpcd[693]: vethb238dd68: no IPv6 Routers available machine # [ 69.935133] dhcpcd[693]: veth0cd56366: no IPv6 Routers available machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 45.66 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s, in 0.19 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s, in 0.16 seconds) machine: waiting for unit niks3.service machine: (finished: waiting for unit niks3.service, in 0.04 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.30 seconds) machine: waiting for success: test $(curl -sf 10.42.0.6:9901/clusters | grep -c 'health_flags::healthy') -ge 3 machine: (finished: waiting for success: test $(curl -sf 10.42.0.6:9901/clusters | grep -c 'health_flags::healthy') -ge 3, in 0.08 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.22 seconds) machine: waiting for success: curl -sf http://10.42.0.9:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2' machine: (finished: waiting for success: curl -sf http://10.42.0.9:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2', in 0.05 seconds) (finished: subtest: chart deploys and workers become Ready, in 46.69 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}', in 0.14 seconds) machine: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt machine: (finished: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt, in 0.15 seconds) subtest: build through the balancer lands in the cache machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1 machine # [ 107.614570] niks3-server[1198]: 2026/09/30 09:27:20 INFO Received push request method=POST path=/api/pushes machine # [ 107.640194] niks3-server[1198]: 2026/09/30 09:27:20 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign machine # [ 107.646936] niks3-server[1198]: 2026/09/30 09:27:20 INFO Signed narinfos id=1 count=1 machine # [ 107.654876] niks3-server[1198]: 2026/09/30 09:27:20 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.ls machine # [ 107.657052] niks3-server[1198]: 2026/09/30 09:27:20 INFO Received complete push request method=POST path=/api/pushes/1/complete machine # [ 107.664615] niks3-server[1198]: 2026/09/30 09:27:20 INFO Registered completed upload object_key=nar/0nzzbas7l8d37mridr7mg162smfjvn7lhs6am4crl4ydaxicigj8.nar.zst machine # [ 107.667523] niks3-server[1198]: 2026/09/30 09:27:20 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.narinfo machine # [ 132.193210] niks3-server[1198]: 2026/09/30 09:27:45 INFO Received push request method=POST path=/api/pushes machine # [ 132.212851] niks3-server[1198]: 2026/09/30 09:27:45 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign machine # [ 132.216312] niks3-server[1198]: 2026/09/30 09:27:45 INFO Signed narinfos id=2 count=1 machine # [ 132.218917] niks3-server[1198]: 2026/09/30 09:27:45 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.ls machine # [ 132.223454] niks3-server[1198]: 2026/09/30 09:27:45 INFO Registered completed upload object_key=log/yz1sqzb72i8v6h2ass0v76ba8cncqj9r-k3s-a.drv machine # [ 132.229634] niks3-server[1198]: 2026/09/30 09:27:45 INFO Received complete push request method=POST path=/api/pushes/2/complete machine # [ 132.233542] niks3-server[1198]: 2026/09/30 09:27:45 INFO Registered completed upload object_key=nar/1p7jh5nyz9n68k5f18ymmdpgr34mpnnch1njw7ki7b2b97qlfbjk.nar.zst machine # [ 132.236869] niks3-server[1198]: 2026/09/30 09:27:45 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.narinfo machine # [ 132.307862] niks3-server[1198]: 2026/09/30 09:27:45 INFO Received push request method=POST path=/api/pushes machine # [ 132.318440] niks3-server[1198]: 2026/09/30 09:27:45 INFO Received sign narinfos request method=POST path=/api/pushes/3/sign machine # [ 132.319229] niks3-server[1198]: 2026/09/30 09:27:45 INFO Signed narinfos id=3 count=1 machine # [ 132.320913] niks3-server[1198]: 2026/09/30 09:27:45 INFO Registered completed upload object_key=nar/03a4ywhyr5knmbc93z4gyml5y8fvgb431xvlmfxrwsm8mrb0qgx2.nar.zst machine # [ 132.324060] niks3-server[1198]: 2026/09/30 09:27:45 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.ls machine # [ 132.327489] niks3-server[1198]: 2026/09/30 09:27:45 INFO Received complete push request method=POST path=/api/pushes/3/complete machine # [ 132.333122] niks3-server[1198]: 2026/09/30 09:27:45 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.narinfo machine # [ 157.041677] niks3-server[1198]: 2026/09/30 09:28:09 INFO Received push request method=POST path=/api/pushes machine # [ 157.054919] niks3-server[1198]: 2026/09/30 09:28:10 INFO Received sign narinfos request method=POST path=/api/pushes/4/sign machine # [ 157.056750] niks3-server[1198]: 2026/09/30 09:28:10 INFO Signed narinfos id=4 count=1 machine # [ 157.062297] niks3-server[1198]: 2026/09/30 09:28:10 INFO Registered completed upload object_key=log/zfq1xw9bmycqh35l0s44lmv65z4xc7br-k3s-b.drv machine # [ 157.067459] niks3-server[1198]: 2026/09/30 09:28:10 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.ls machine # [ 157.068758] niks3-server[1198]: 2026/09/30 09:28:10 INFO Received complete push request method=POST path=/api/pushes/4/complete machine # [ 157.069065] niks3-server[1198]: 2026/09/30 09:28:10 INFO Registered completed upload object_key=nar/05qjsj5ff3a6vnxkhb6k5f3m446dcc206p7cd37w4v3mgi95d7kh.nar.zst machine # [ 157.073570] niks3-server[1198]: 2026/09/30 09:28:10 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.narinfo machine # [ 157.151341] niks3-server[1198]: 2026/09/30 09:28:10 INFO Received push request method=POST path=/api/pushes machine # [ 157.161187] niks3-server[1198]: 2026/09/30 09:28:10 INFO Received sign narinfos request method=POST path=/api/pushes/5/sign machine # [ 157.163197] niks3-server[1198]: 2026/09/30 09:28:10 INFO Signed narinfos id=5 count=1 machine # [ 157.166598] niks3-server[1198]: 2026/09/30 09:28:10 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.ls machine # [ 157.170729] niks3-server[1198]: 2026/09/30 09:28:10 INFO Registered completed upload object_key=nar/0jyw88klkf3nwxpnj5m5lx3i1dv2idf3hcn6im7883hnldm3gvyq.nar.zst machine # [ 157.175859] niks3-server[1198]: 2026/09/30 09:28:10 INFO Received complete push request method=POST path=/api/pushes/5/complete machine # [ 157.182945] niks3-server[1198]: 2026/09/30 09:28:10 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.narinfo machine # [ 182.293337] niks3-server[1198]: 2026/09/30 09:28:35 INFO Received push request method=POST path=/api/pushes machine # [ 182.322518] niks3-server[1198]: 2026/09/30 09:28:35 INFO Received sign narinfos request method=POST path=/api/pushes/6/sign machine # [ 182.324689] niks3-server[1198]: 2026/09/30 09:28:35 INFO Signed narinfos id=6 count=1 machine # [ 182.327131] niks3-server[1198]: 2026/09/30 09:28:35 INFO Registered completed upload object_key=log/n40czam6a4ldp1mh5fdmlcy07fv0akbm-k3s-top.drv machine # [ 182.328402] niks3-server[1198]: 2026/09/30 09:28:35 INFO Registered completed upload object_key=nar/1q8vp5xqws560mpf8rxk8r8jhqrzibivh13x4wxy0cfqlzbk7cr5.nar.zst machine # [ 182.332779] niks3-server[1198]: 2026/09/30 09:28:35 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.ls machine # [ 182.337628] niks3-server[1198]: 2026/09/30 09:28:35 INFO Received complete push request method=POST path=/api/pushes/6/complete machine # [ 182.342329] niks3-server[1198]: 2026/09/30 09:28:35 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1, in 107.74 seconds) machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath, in 0.14 seconds) machine: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine: (finished: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.01 seconds) machine: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine # copying 3 paths... machine # copying path '/nix/store/r95r891injj9ski5c4w89yxjvjy065mx-k3s-a' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/mrqsh0475wxsmnsvkk55g94v6g5nrcra-k3s-b' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top' from 'http://192.168.1.1:5751'... machine: (finished: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.17 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1 machine # [ 211.494261] niks3-server[1198]: 2026/09/30 09:29:04 INFO Received push request method=POST path=/api/pushes machine # [ 211.518969] niks3-server[1198]: 2026/09/30 09:29:04 INFO Received sign narinfos request method=POST path=/api/pushes/7/sign machine # [ 211.521670] niks3-server[1198]: 2026/09/30 09:29:04 INFO Signed narinfos id=7 count=1 machine # [ 211.525058] niks3-server[1198]: 2026/09/30 09:29:04 INFO Registered completed upload object_key=nar/1fr26arhri17j9bj6hyjzmmd74v730biz1gb3kqd194vjx3ccvp9.nar.zst machine # [ 211.527122] niks3-server[1198]: 2026/09/30 09:29:04 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.ls machine # [ 211.529741] niks3-server[1198]: 2026/09/30 09:29:04 INFO Received complete push request method=POST path=/api/pushes/7/complete machine # [ 211.536916] niks3-server[1198]: 2026/09/30 09:29:04 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.narinfo machine # [ 235.836639] niks3-server[1198]: 2026/09/30 09:29:28 INFO Received push request method=POST path=/api/pushes machine # [ 235.852342] niks3-server[1198]: 2026/09/30 09:29:28 INFO Received sign narinfos request method=POST path=/api/pushes/8/sign machine # [ 235.854170] niks3-server[1198]: 2026/09/30 09:29:28 INFO Registered completed upload object_key=log/pbpqsh50ar10fpasdqqx8xg3lmr5j8iz-k3s-a.drv machine # [ 235.854777] niks3-server[1198]: 2026/09/30 09:29:28 INFO Signed narinfos id=8 count=1 machine # [ 235.857435] niks3-server[1198]: 2026/09/30 09:29:28 INFO Registered completed upload object_key=nar/1hfc6x4x25k3b0fk091d3nb0k3mympfp05fkslcx19synp3ig0zd.nar.zst machine # [ 235.860310] niks3-server[1198]: 2026/09/30 09:29:28 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.ls machine # [ 235.862671] niks3-server[1198]: 2026/09/30 09:29:28 INFO Received complete push request method=POST path=/api/pushes/8/complete machine # [ 235.867264] niks3-server[1198]: 2026/09/30 09:29:28 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.narinfo machine # [ 235.922405] niks3-server[1198]: 2026/09/30 09:29:28 INFO Received push request method=POST path=/api/pushes machine # [ 235.931421] niks3-server[1198]: 2026/09/30 09:29:28 INFO Received sign narinfos request method=POST path=/api/pushes/9/sign machine # [ 235.933274] niks3-server[1198]: 2026/09/30 09:29:28 INFO Signed narinfos id=9 count=1 machine # [ 235.934523] niks3-server[1198]: 2026/09/30 09:29:28 INFO Registered completed upload object_key=nar/0zzq2vgjln4shvh57091n14sam6wh6w06vja6lzb9ppcj4ffyx1n.nar.zst machine # [ 235.936746] niks3-server[1198]: 2026/09/30 09:29:28 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.ls machine # [ 235.938545] niks3-server[1198]: 2026/09/30 09:29:28 INFO Received complete push request method=POST path=/api/pushes/9/complete machine # [ 235.940873] niks3-server[1198]: 2026/09/30 09:29:28 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.narinfo machine # [ 260.244907] niks3-server[1198]: 2026/09/30 09:29:53 INFO Received push request method=POST path=/api/pushes machine # [ 260.258871] niks3-server[1198]: 2026/09/30 09:29:53 INFO Received sign narinfos request method=POST path=/api/pushes/10/sign machine # [ 260.262268] niks3-server[1198]: 2026/09/30 09:29:53 INFO Signed narinfos id=10 count=1 machine # [ 260.264568] niks3-server[1198]: 2026/09/30 09:29:53 INFO Registered completed upload object_key=nar/0hh3nqk95r6g32lhdmxw8cxjv694vbpx9876zkhcpg4r4qxni2ch.nar.zst machine # [ 260.266239] niks3-server[1198]: 2026/09/30 09:29:53 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.ls machine # [ 260.268324] niks3-server[1198]: 2026/09/30 09:29:53 INFO Registered completed upload object_key=log/894h6wzw2l4w5f0hikj1k6q57jfnyi87-k3s-b.drv machine # [ 260.279455] niks3-server[1198]: 2026/09/30 09:29:53 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.narinfo machine # [ 260.281509] niks3-server[1198]: 2026/09/30 09:29:53 INFO Received complete push request method=POST path=/api/pushes/10/complete machine # [ 260.348492] niks3-server[1198]: 2026/09/30 09:29:53 INFO Received push request method=POST path=/api/pushes machine # [ 260.357351] niks3-server[1198]: 2026/09/30 09:29:53 INFO Received sign narinfos request method=POST path=/api/pushes/11/sign machine # [ 260.358235] niks3-server[1198]: 2026/09/30 09:29:53 INFO Signed narinfos id=11 count=1 machine # [ 260.361143] niks3-server[1198]: 2026/09/30 09:29:53 INFO Registered completed upload object_key=nar/0ingamx56k31lwiyxmnxmscjj4n3qfx6sr2kpaynsrwhwz1278iw.nar.zst machine # [ 260.365168] niks3-server[1198]: 2026/09/30 09:29:53 INFO Received complete push request method=POST path=/api/pushes/11/complete machine # [ 260.366287] niks3-server[1198]: 2026/09/30 09:29:53 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.ls machine # [ 260.370800] niks3-server[1198]: 2026/09/30 09:29:53 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.narinfo machine # [ 284.879338] niks3-server[1198]: 2026/09/30 09:30:17 INFO Received push request method=POST path=/api/pushes machine # [ 284.897432] niks3-server[1198]: 2026/09/30 09:30:17 INFO Received sign narinfos request method=POST path=/api/pushes/12/sign machine # [ 284.899926] niks3-server[1198]: 2026/09/30 09:30:17 INFO Signed narinfos id=12 count=1 machine # [ 284.901609] niks3-server[1198]: 2026/09/30 09:30:17 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.ls machine # [ 284.904803] niks3-server[1198]: 2026/09/30 09:30:17 INFO Registered completed upload object_key=nar/0v48x4sp58bvfra08axgkz7yl1n9nc4nirskyv1hwann4i7q277i.nar.zst machine # [ 284.906977] niks3-server[1198]: 2026/09/30 09:30:17 INFO Registered completed upload object_key=log/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g-k3s-top.drv machine # [ 284.912094] niks3-server[1198]: 2026/09/30 09:30:17 INFO Received complete push request method=POST path=/api/pushes/12/complete machine # [ 284.916054] niks3-server[1198]: 2026/09/30 09:30:17 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1, in 102.26 seconds) (finished: subtest: build through the balancer lands in the cache, in 210.32 seconds) subtest: a Job with the client image builds through the farm with its service account machine: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine: (finished: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.15 seconds) machine: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix machine: (finished: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix, in 0.12 seconds) machine: must succeed: kubectl apply -f /nix/store/4qg21n7g16x8lyv0fhhdx9dx3lxqkcdn-ci-job.json machine: (finished: must succeed: kubectl apply -f /nix/store/4qg21n7g16x8lyv0fhhdx9dx3lxqkcdn-ci-job.json, in 0.14 seconds) machine: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed' machine # [ 286.010992] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod26962cd7_a430_4db2_8443_02ee9667c0d9.slice. machine # [ 286.077136] k3s[894]: I0930 09:30:19.031366 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkc89\" (UniqueName: \"kubernetes.io/projected/26962cd7-a430-4db2-8443-02ee9667c0d9-kube-api-access-nkc89\") pod \"ci-5kztd\" (UID: \"26962cd7-a430-4db2-8443-02ee9667c0d9\") " pod="ci/ci-5kztd" machine # [ 286.077841] k3s[894]: I0930 09:30:19.031418 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/26962cd7-a430-4db2-8443-02ee9667c0d9-nix-grpc-farm\") pod \"ci-5kztd\" (UID: \"26962cd7-a430-4db2-8443-02ee9667c0d9\") " pod="ci/ci-5kztd" machine # [ 286.079411] k3s[894]: I0930 09:30:19.031446 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"job\" (UniqueName: \"kubernetes.io/configmap/26962cd7-a430-4db2-8443-02ee9667c0d9-job\") pod \"ci-5kztd\" (UID: \"26962cd7-a430-4db2-8443-02ee9667c0d9\") " pod="ci/ci-5kztd" machine # [ 287.112606] cni0: port 2(vethced40a96) entered blocking state machine # [ 287.115128] cni0: port 2(vethced40a96) entered disabled state machine # [ 287.117460] vethced40a96: entered allmulticast mode machine # [ 287.119645] vethced40a96: entered promiscuous mode machine # [ 287.135781] cni0: port 2(vethced40a96) entered blocking state machine # [ 287.137807] cni0: port 2(vethced40a96) entered forwarding state machine # [ 287.038530] (udev-worker)[5260]: Network interface NamePolicy= disabled on kernel command line. machine # [ 287.061740] dhcpcd[693]: vethced40a96: IAID 2a:65:86:69 machine # [ 287.062569] dhcpcd[693]: vethced40a96: adding address fe80::581e:2aff:fe65:8669 machine # [ 287.077414] systemd[1]: Started libcontainer container 4cd3d9949440ccd6084400f9dff21447a7cfcab8027b69d815e9df8864b240a1. machine # [ 288.478250] dhcpcd[693]: vethced40a96: soliciting a DHCP lease machine # [ 288.511555] dhcpcd[693]: vethced40a96: soliciting an IPv6 router machine # [ 289.044489] systemd[1]: Started libcontainer container 33e3ef0826ec097b63c1b53e10337759d10121a53054c8511a3731fda85a68b7. machine # [ 289.097748] k3s[894]: I0930 09:30:22.051975 894 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ci/ci-5kztd" podStartSLOduration=4.05194805 podStartE2EDuration="4.05194805s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-30 09:30:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 09:30:22.051146272 +0000 UTC m=+271.304996834" watchObservedRunningTime="2026-09-30 09:30:22.05194805 +0000 UTC m=+271.305798612" machine # [ 290.310839] niks3-server[1198]: 2026/09/30 09:30:23 INFO Received push request method=POST path=/api/pushes machine # [ 290.321169] niks3-server[1198]: 2026/09/30 09:30:23 INFO Received sign narinfos request method=POST path=/api/pushes/13/sign machine # [ 290.321885] niks3-server[1198]: 2026/09/30 09:30:23 INFO Signed narinfos id=13 count=1 machine # [ 290.324589] niks3-server[1198]: 2026/09/30 09:30:23 INFO Registered completed upload object_key=nar/111g6dyibwcf2z7jhpn72rgja0qvjgpdiv9nc06g2dp7ih0a6kyq.nar.zst machine # [ 290.327115] niks3-server[1198]: 2026/09/30 09:30:23 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.ls machine # [ 290.329820] niks3-server[1198]: 2026/09/30 09:30:23 INFO Received complete push request method=POST path=/api/pushes/13/complete machine # [ 290.335337] niks3-server[1198]: 2026/09/30 09:30:23 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.narinfo machine # [ 293.479451] dhcpcd[693]: vethced40a96: probing for an IPv4LL address machine # [ 298.778090] dhcpcd[693]: vethced40a96: using IPv4LL address 169.254.17.233 machine # [ 298.780730] dhcpcd[693]: vethced40a96: adding route to 169.254.0.0/16 machine # [ 300.516620] dhcpcd[693]: vethced40a96: no IPv6 Routers available machine # [ 309.839391] postgres[754]: [754] LOG: checkpoint starting: time machine # [ 314.644047] niks3-server[1198]: 2026/09/30 09:30:47 INFO Received push request method=POST path=/api/pushes machine # [ 314.661469] niks3-server[1198]: 2026/09/30 09:30:47 INFO Registered completed upload object_key=nar/058kjd2vfl1r27b4d9ixvwf77d8rkr18a4v894kwx8lg0nwpajnr.nar.zst machine # [ 314.664189] niks3-server[1198]: 2026/09/30 09:30:47 INFO Received sign narinfos request method=POST path=/api/pushes/14/sign machine # [ 314.666936] niks3-server[1198]: 2026/09/30 09:30:47 INFO Signed narinfos id=14 count=1 machine # [ 314.669095] niks3-server[1198]: 2026/09/30 09:30:47 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.ls machine # [ 314.680686] niks3-server[1198]: 2026/09/30 09:30:47 INFO Registered completed upload object_key=log/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # [ 314.685988] niks3-server[1198]: 2026/09/30 09:30:47 INFO Received complete push request method=POST path=/api/pushes/14/complete machine # [ 314.690164] niks3-server[1198]: 2026/09/30 09:30:47 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.narinfo machine # [ 314.757828] niks3-server[1198]: 2026/09/30 09:30:47 INFO Received push request method=POST path=/api/pushes machine # [ 314.770529] niks3-server[1198]: 2026/09/30 09:30:47 INFO Received sign narinfos request method=POST path=/api/pushes/15/sign machine # [ 314.772046] niks3-server[1198]: 2026/09/30 09:30:47 INFO Signed narinfos id=15 count=1 machine # [ 314.776062] niks3-server[1198]: 2026/09/30 09:30:47 INFO Registered completed upload object_key=nar/138ynhcd5wxzz485x9qcq7xsargaklrf2li31ai69m5r46am35q6.nar.zst machine # [ 314.779083] niks3-server[1198]: 2026/09/30 09:30:47 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.ls machine # [ 314.781297] niks3-server[1198]: 2026/09/30 09:30:47 INFO Received complete push request method=POST path=/api/pushes/15/complete machine # [ 314.785910] niks3-server[1198]: 2026/09/30 09:30:47 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.narinfo machine # [ 339.270611] niks3-server[1198]: 2026/09/30 09:31:12 INFO Received push request method=POST path=/api/pushes machine # [ 339.287919] niks3-server[1198]: 2026/09/30 09:31:12 INFO Received sign narinfos request method=POST path=/api/pushes/16/sign machine # [ 339.290463] niks3-server[1198]: 2026/09/30 09:31:12 INFO Signed narinfos id=16 count=1 machine # [ 339.291640] niks3-server[1198]: 2026/09/30 09:31:12 INFO Registered completed upload object_key=log/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # [ 339.293922] niks3-server[1198]: 2026/09/30 09:31:12 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.ls machine # [ 339.296421] niks3-server[1198]: 2026/09/30 09:31:12 INFO Registered completed upload object_key=nar/0n4lbdlp8w72fs3qbavl2lwrzbrn55i2b1vyglc89cc3pi8vbb1m.nar.zst machine # [ 339.304088] niks3-server[1198]: 2026/09/30 09:31:12 INFO Received complete push request method=POST path=/api/pushes/16/complete machine # [ 339.311809] niks3-server[1198]: 2026/09/30 09:31:12 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo machine # [ 339.371042] niks3-server[1198]: 2026/09/30 09:31:12 INFO Received push request method=POST path=/api/pushes machine # [ 339.381402] niks3-server[1198]: 2026/09/30 09:31:12 INFO Received sign narinfos request method=POST path=/api/pushes/17/sign machine # [ 339.383694] niks3-server[1198]: 2026/09/30 09:31:12 INFO Signed narinfos id=17 count=1 machine # [ 339.385456] niks3-server[1198]: 2026/09/30 09:31:12 INFO Registered completed upload object_key=nar/1f3gvnvqsm2pm3laixkxkg44kvjb251zqhszcfpp0a00h6x66ljs.nar.zst machine # [ 339.387822] niks3-server[1198]: 2026/09/30 09:31:12 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.ls machine # [ 339.392346] niks3-server[1198]: 2026/09/30 09:31:12 INFO Received complete push request method=POST path=/api/pushes/17/complete machine # [ 339.395302] niks3-server[1198]: 2026/09/30 09:31:12 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.narinfo machine # [ 364.081106] niks3-server[1198]: 2026/09/30 09:31:37 INFO Received push request method=POST path=/api/pushes machine # [ 364.101189] niks3-server[1198]: 2026/09/30 09:31:37 INFO Received sign narinfos request method=POST path=/api/pushes/18/sign machine # [ 364.103683] niks3-server[1198]: 2026/09/30 09:31:37 INFO Signed narinfos id=18 count=1 machine # [ 364.108549] niks3-server[1198]: 2026/09/30 09:31:37 INFO Registered completed upload object_key=log/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # [ 364.110690] niks3-server[1198]: 2026/09/30 09:31:37 INFO Registered completed upload object_key=nar/1zwf0asrdv12q40fmqga5lx5330dvn9y4in4i9ficz9ij5lhvnf5.nar.zst machine # [ 364.112275] niks3-server[1198]: 2026/09/30 09:31:37 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.ls machine # [ 364.125112] niks3-server[1198]: 2026/09/30 09:31:37 INFO Received complete push request method=POST path=/api/pushes/18/complete machine # [ 364.128792] niks3-server[1198]: 2026/09/30 09:31:37 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo machine # [ 365.739624] niks3-server[1198]: 2026/09/30 09:31:38 INFO Received push request method=POST path=/api/pushes machine # [ 365.753523] niks3-server[1198]: 2026/09/30 09:31:38 INFO Received sign narinfos request method=POST path=/api/pushes/19/sign machine # [ 365.754795] niks3-server[1198]: 2026/09/30 09:31:38 INFO Signed narinfos id=19 count=1 machine # [ 365.756888] niks3-server[1198]: 2026/09/30 09:31:38 INFO Registered completed upload object_key=nar/0xiyqcsl8db7dnrq2gqnx5izavr51ma3dcdswrriaxfgj3qzk7xf.nar.zst machine # [ 365.763962] niks3-server[1198]: 2026/09/30 09:31:38 INFO Received complete push request method=POST path=/api/pushes/19/complete machine # [ 365.774421] niks3-server[1198]: 2026/09/30 09:31:38 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.ls machine # [ 390.459873] niks3-server[1198]: 2026/09/30 09:32:03 INFO Received push request method=POST path=/api/pushes machine # [ 390.480579] niks3-server[1198]: 2026/09/30 09:32:03 INFO Registered completed upload object_key=log/fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # [ 390.482570] niks3-server[1198]: 2026/09/30 09:32:03 INFO Received sign narinfos request method=POST path=/api/pushes/20/sign machine # [ 390.484213] niks3-server[1198]: 2026/09/30 09:32:03 INFO Signed narinfos id=20 count=1 machine # [ 390.491879] niks3-server[1198]: 2026/09/30 09:32:03 INFO Registered completed upload object_key=nar/0p3l2z3riilylr2rxb1aq2blxdfxg55wbgp4gxkns93srbr4bwyq.nar.zst machine # [ 390.495502] niks3-server[1198]: 2026/09/30 09:32:03 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.ls machine # [ 390.497656] niks3-server[1198]: 2026/09/30 09:32:03 INFO Received complete push request method=POST path=/api/pushes/20/complete machine # [ 390.503452] niks3-server[1198]: 2026/09/30 09:32:03 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo machine # [ 391.666894] systemd[1]: cri-containerd-33e3ef0826ec097b63c1b53e10337759d10121a53054c8511a3731fda85a68b7.scope: Deactivated successfully. machine # [ 391.668231] systemd[1]: cri-containerd-33e3ef0826ec097b63c1b53e10337759d10121a53054c8511a3731fda85a68b7.scope: Consumed 923ms CPU time over 1min 42.622s wall clock time, 118.4M memory peak, 49M read from disk, 428K written to disk, 18.4K incoming IP traffic, 44.8K outgoing IP traffic. machine # [ 391.717809] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-33e3ef0826ec097b63c1b53e10337759d10121a53054c8511a3731fda85a68b7-rootfs.mount: Deactivated successfully. machine # [ 393.547972] systemd[1]: cri-containerd-4cd3d9949440ccd6084400f9dff21447a7cfcab8027b69d815e9df8864b240a1.scope: Deactivated successfully. machine # [ 393.603120] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-4cd3d9949440ccd6084400f9dff21447a7cfcab8027b69d815e9df8864b240a1-rootfs.mount: Deactivated successfully. machine # [ 393.646556] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-4cd3d9949440ccd6084400f9dff21447a7cfcab8027b69d815e9df8864b240a1-shm.mount: Deactivated successfully. machine # [ 393.842338] cni0: port 2(vethced40a96) entered disabled state machine # [ 393.689878] dhcpcd[693]: vethced40a96: carrier lost machine # [ 393.844887] vethced40a96 (unregistering): left allmulticast mode machine # [ 393.845673] vethced40a96 (unregistering): left promiscuous mode machine # [ 393.846528] cni0: port 2(vethced40a96) entered disabled state machine # [ 393.715204] systemd[1]: run-netns-cni\x2d5ca1aae6\x2db43c\x2d9bb7\x2d0e7b\x2d1278863c6c95.mount: Deactivated successfully. machine # [ 393.727880] dhcpcd[693]: vethced40a96: deleting address fe80::581e:2aff:fe65:8669 machine # [ 393.730308] dhcpcd[693]: vethced40a96: deleting route to 169.254.0.0/16 machine # [ 393.785272] dhcpcd[693]: vethced40a96: removing interface machine # [ 393.870911] k3s[894]: I0930 09:32:06.825104 894 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/26962cd7-a430-4db2-8443-02ee9667c0d9-job\" (UniqueName: \"kubernetes.io/configmap/26962cd7-a430-4db2-8443-02ee9667c0d9-job\") pod \"26962cd7-a430-4db2-8443-02ee9667c0d9\" (UID: \"26962cd7-a430-4db2-8443-02ee9667c0d9\") " machine # [ 393.871646] k3s[894]: I0930 09:32:06.825149 894 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/26962cd7-a430-4db2-8443-02ee9667c0d9-nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/26962cd7-a430-4db2-8443-02ee9667c0d9-nix-grpc-farm\") pod \"26962cd7-a430-4db2-8443-02ee9667c0d9\" (UID: \"26962cd7-a430-4db2-8443-02ee9667c0d9\") " machine # [ 393.872101] k3s[894]: I0930 09:32:06.825185 894 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/26962cd7-a430-4db2-8443-02ee9667c0d9-kube-api-access-nkc89\" (UniqueName: \"kubernetes.io/projected/26962cd7-a430-4db2-8443-02ee9667c0d9-kube-api-access-nkc89\") pod \"26962cd7-a430-4db2-8443-02ee9667c0d9\" (UID: \"26962cd7-a430-4db2-8443-02ee9667c0d9\") " machine # [ 393.872561] k3s[894]: I0930 09:32:06.825554 894 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26962cd7-a430-4db2-8443-02ee9667c0d9-job" pod "26962cd7-a430-4db2-8443-02ee9667c0d9" (UID: "26962cd7-a430-4db2-8443-02ee9667c0d9"). InnerVolumeSpecName "job". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 393.874479] systemd[1]: var-lib-kubelet-pods-26962cd7\x2da430\x2d4db2\x2d8443\x2d02ee9667c0d9-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dnkc89.mount: Deactivated successfully. machine # [ 393.888757] k3s[894]: I0930 09:32:06.843312 894 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26962cd7-a430-4db2-8443-02ee9667c0d9-kube-api-access-nkc89" pod "26962cd7-a430-4db2-8443-02ee9667c0d9" (UID: "26962cd7-a430-4db2-8443-02ee9667c0d9"). InnerVolumeSpecName "kube-api-access-nkc89". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 393.895258] k3s[894]: I0930 09:32:06.849772 894 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26962cd7-a430-4db2-8443-02ee9667c0d9-nix-grpc-farm" pod "26962cd7-a430-4db2-8443-02ee9667c0d9" (UID: "26962cd7-a430-4db2-8443-02ee9667c0d9"). InnerVolumeSpecName "nix-grpc-farm". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 393.899337] systemd[1]: var-lib-kubelet-pods-26962cd7\x2da430\x2d4db2\x2d8443\x2d02ee9667c0d9-volumes-kubernetes.io\x7eprojected-nix\x2dgrpc\x2dfarm.mount: Deactivated successfully. machine # [ 393.971325] k3s[894]: I0930 09:32:06.925796 894 reconciler_common.go:299] "Volume detached for volume \"job\" (UniqueName: \"kubernetes.io/configmap/26962cd7-a430-4db2-8443-02ee9667c0d9-job\") on node \"machine\" DevicePath \"\"" machine # [ 393.973315] k3s[894]: I0930 09:32:06.925847 894 reconciler_common.go:299] "Volume detached for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/26962cd7-a430-4db2-8443-02ee9667c0d9-nix-grpc-farm\") on node \"machine\" DevicePath \"\"" machine # [ 393.974442] k3s[894]: I0930 09:32:06.925884 894 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkc89\" (UniqueName: \"kubernetes.io/projected/26962cd7-a430-4db2-8443-02ee9667c0d9-kube-api-access-nkc89\") on node \"machine\" DevicePath \"\"" machine # [ 394.531353] k3s[894]: I0930 09:32:07.485817 894 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4cd3d9949440ccd6084400f9dff21447a7cfcab8027b69d815e9df8864b240a1" machine # [ 394.546712] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod26962cd7_a430_4db2_8443_02ee9667c0d9.slice. machine # [ 394.548905] systemd[1]: kubepods-besteffort-pod26962cd7_a430_4db2_8443_02ee9667c0d9.slice: Consumed 952ms CPU time over 1min 48.534s wall clock time, 118.6M memory peak, 49M read from disk, 632K written to disk, 18.4K incoming IP traffic, 44.8K outgoing IP traffic. machine: (finished: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed', in 109.70 seconds) machine: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1 machine: (finished: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1, in 0.14 seconds) machine # don't know how to build these paths: machine # /nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-a> machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-n8p2g: building fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-b> machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-n8p2g: building 1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-top> machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-n8p2g: building rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # INFO:nix_fast_build.processes:run nix-eval-jobs --gc-roots-dir /tmp/tmp_p70bgeb/gcroots --force-recurse --max-memory-size 4096 --workers 4 --flake '.#checks' --check-cache-status machine # INFO:nix_fast_build.workers:builds: 0 machine # warning: Git tree '/tmp' is dirty machine # warning: Git tree '/tmp' is dirty machine # ▶ x86_64-linux.t started machine # INFO:nix_fast_build.workers:builds: 2 machine # ✔ x86_64-linux.t (26s) machine # x86_64-linux.t> machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-krnnq: building fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # warning: Git tree '/tmp' is dirty machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath, in 0.15 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null, in 0.03 seconds) (finished: subtest: a Job with the client image builds through the farm with its service account, in 110.67 seconds) subtest: a renewed balancer certificate is served without a rollout machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f - machine # Warning: resource secrets/farm-lb-tls is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically. machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f -, in 0.26 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}', in 0.23 seconds) machine: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-5877cc8b4f-hwskl -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine # [ 396.365827] k3s[894]: E0930 09:32:09.319567 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52016: use of closed network connection" machine # [ 397.650424] k3s[894]: E0930 09:32:10.604576 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52018: use of closed network connection" machine # [ 398.951429] k3s[894]: E0930 09:32:11.905379 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52034: use of closed network connection" machine # [ 400.250081] k3s[894]: E0930 09:32:13.203439 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52050: use of closed network connection" machine # [ 401.512800] k3s[894]: E0930 09:32:14.466459 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52052: use of closed network connection" machine # [ 402.824992] k3s[894]: E0930 09:32:15.779188 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52062: use of closed network connection" machine # [ 404.119714] k3s[894]: E0930 09:32:17.073779 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:58996: use of closed network connection" machine # [ 405.381832] k3s[894]: E0930 09:32:18.335978 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59010: use of closed network connection" machine # [ 406.637977] k3s[894]: E0930 09:32:19.588353 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59014: use of closed network connection" machine # [ 407.953774] k3s[894]: E0930 09:32:20.906496 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59018: use of closed network connection" machine # [ 409.287858] k3s[894]: E0930 09:32:22.241974 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59024: use of closed network connection" machine # [ 410.568926] k3s[894]: E0930 09:32:23.522860 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59038: use of closed network connection" machine # [ 411.894167] k3s[894]: E0930 09:32:24.847941 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59046: use of closed network connection" machine # [ 413.172864] k3s[894]: E0930 09:32:26.126953 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:50054: use of closed network connection" machine # [ 413.807365] postgres[754]: [754] LOG: checkpoint complete: wrote 1037 buffers (6.3%), wrote 3 SLRU buffers; 1 WAL file(s) added, 0 removed, 0 recycled; write=103.866 s, sync=0.064 s, total=103.968 s; sync files=364, longest=0.004 s, average=0.001 s; distance=4978 kB, estimate=4978 kB; lsn=0/1C72A20, redo lsn=0/1C42AB8 machine # [ 414.445706] k3s[894]: E0930 09:32:27.399725 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:50070: use of closed network connection" machine # [ 415.720334] k3s[894]: E0930 09:32:28.674516 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:50078: use of closed network connection" machine # [ 417.009908] k3s[894]: E0930 09:32:29.964072 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:50080: use of closed network connection" machine # [ 418.268701] k3s[894]: E0930 09:32:31.222736 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:50088: use of closed network connection" machine # [ 419.572755] k3s[894]: E0930 09:32:32.526982 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:50104: use of closed network connection" machine # [ 420.850663] k3s[894]: E0930 09:32:33.804293 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:50120: use of closed network connection" machine # [ 422.147386] k3s[894]: E0930 09:32:35.100961 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:50132: use of closed network connection" machine # [ 423.416448] k3s[894]: E0930 09:32:36.370567 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39276: use of closed network connection" machine # [ 424.720110] k3s[894]: E0930 09:32:37.674304 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39290: use of closed network connection" machine # [ 425.995698] k3s[894]: E0930 09:32:38.949897 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39304: use of closed network connection" machine # [ 427.298249] k3s[894]: E0930 09:32:40.252306 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39312: use of closed network connection" machine # [ 428.603460] k3s[894]: E0930 09:32:41.557598 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39324: use of closed network connection" machine # [ 429.894037] k3s[894]: E0930 09:32:42.848100 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39326: use of closed network connection" machine # [ 431.181910] k3s[894]: E0930 09:32:44.136013 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39342: use of closed network connection" machine # [ 432.456882] k3s[894]: E0930 09:32:45.411097 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39344: use of closed network connection" machine # [ 433.754218] k3s[894]: E0930 09:32:46.707978 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:42208: use of closed network connection" machine # [ 435.059064] k3s[894]: E0930 09:32:48.013189 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:42210: use of closed network connection" machine # [ 436.365669] k3s[894]: E0930 09:32:49.319695 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:42224: use of closed network connection" machine # [ 437.638171] k3s[894]: E0930 09:32:50.592007 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:42226: use of closed network connection" machine # [ 438.929181] k3s[894]: E0930 09:32:51.883017 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:42238: use of closed network connection" machine # [ 440.204529] k3s[894]: E0930 09:32:53.158749 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:42254: use of closed network connection" machine # [ 441.478300] k3s[894]: E0930 09:32:54.431570 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:42260: use of closed network connection" machine # [ 442.733600] k3s[894]: E0930 09:32:55.687587 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:42274: use of closed network connection" machine # [ 444.019046] k3s[894]: E0930 09:32:56.973221 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:36462: use of closed network connection" machine # [ 445.251412] k3s[894]: E0930 09:32:58.205595 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:36476: use of closed network connection" machine # [ 446.529346] k3s[894]: E0930 09:32:59.483424 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:36488: use of closed network connection" machine # [ 447.854601] k3s[894]: E0930 09:33:00.808333 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:36502: use of closed network connection" machine # [ 449.122243] k3s[894]: E0930 09:33:02.076418 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:36508: use of closed network connection" machine # [ 450.389184] k3s[894]: E0930 09:33:03.343304 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:36510: use of closed network connection" machine # [ 451.690458] k3s[894]: E0930 09:33:04.644088 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:36516: use of closed network connection" machine # [ 453.006272] k3s[894]: E0930 09:33:05.960033 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:48584: use of closed network connection" machine # [ 454.322772] k3s[894]: E0930 09:33:07.276529 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:48586: use of closed network connection" machine # [ 455.578849] k3s[894]: E0930 09:33:08.532590 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:48596: use of closed network connection" machine # [ 456.835079] k3s[894]: E0930 09:33:09.789173 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:48608: use of closed network connection" machine # [ 458.108598] k3s[894]: E0930 09:33:11.062503 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:48610: use of closed network connection" machine # [ 459.382117] k3s[894]: E0930 09:33:12.336008 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:48626: use of closed network connection" machine # [ 460.633063] k3s[894]: E0930 09:33:13.587116 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:48634: use of closed network connection" machine: (finished: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-5877cc8b4f-hwskl -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 64.54 seconds) machine: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine: (finished: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 0.05 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1 machine # [ 460.864079] niks3-server[1198]: 2026/09/30 09:33:13 INFO Received push request method=POST path=/api/pushes machine # [ 460.876393] niks3-server[1198]: 2026/09/30 09:33:13 INFO Received sign narinfos request method=POST path=/api/pushes/21/sign machine # [ 460.880812] niks3-server[1198]: 2026/09/30 09:33:13 INFO Signed narinfos id=21 count=1 machine # [ 460.884059] niks3-server[1198]: 2026/09/30 09:33:13 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.ls machine # [ 460.888158] niks3-server[1198]: 2026/09/30 09:33:13 INFO Registered completed upload object_key=nar/0g42hgwa9jp9abmqxz90dkwxpybsznzbpsy35rm921mlk5sw56jq.nar.zst machine # [ 460.893378] niks3-server[1198]: 2026/09/30 09:33:13 INFO Received complete push request method=POST path=/api/pushes/21/complete machine # [ 460.897525] niks3-server[1198]: 2026/09/30 09:33:13 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.narinfo machine # [ 486.000094] niks3-server[1198]: 2026/09/30 09:33:38 INFO Received push request method=POST path=/api/pushes machine # [ 486.016410] niks3-server[1198]: 2026/09/30 09:33:38 INFO Received sign narinfos request method=POST path=/api/pushes/22/sign machine # [ 486.018327] niks3-server[1198]: 2026/09/30 09:33:38 INFO Signed narinfos id=22 count=1 machine # [ 486.020156] niks3-server[1198]: 2026/09/30 09:33:38 INFO Registered completed upload object_key=nar/1vxmmzwi16s4iri6dcmi9v62dpq1ys7wz15b497ncik3sd67nfzg.nar.zst machine # [ 486.020857] niks3-server[1198]: 2026/09/30 09:33:38 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.ls machine # [ 486.025376] niks3-server[1198]: 2026/09/30 09:33:38 INFO Registered completed upload object_key=log/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31-k3s-a.drv machine # [ 486.028657] niks3-server[1198]: 2026/09/30 09:33:38 INFO Received complete push request method=POST path=/api/pushes/22/complete machine # [ 486.033743] niks3-server[1198]: 2026/09/30 09:33:38 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo machine # [ 486.103561] niks3-server[1198]: 2026/09/30 09:33:39 INFO Received push request method=POST path=/api/pushes machine # [ 486.113483] niks3-server[1198]: 2026/09/30 09:33:39 INFO Received sign narinfos request method=POST path=/api/pushes/23/sign machine # [ 486.114300] niks3-server[1198]: 2026/09/30 09:33:39 INFO Signed narinfos id=23 count=1 machine # [ 486.118683] niks3-server[1198]: 2026/09/30 09:33:39 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.ls machine # [ 486.120206] niks3-server[1198]: 2026/09/30 09:33:39 INFO Registered completed upload object_key=nar/0cbxkyxz068xc5mivh2h67kw6y01n1x28cbs11v1a03g8m4c71zm.nar.zst machine # [ 486.123165] niks3-server[1198]: 2026/09/30 09:33:39 INFO Received complete push request method=POST path=/api/pushes/23/complete machine # [ 486.128245] niks3-server[1198]: 2026/09/30 09:33:39 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.narinfo machine # [ 511.028772] niks3-server[1198]: 2026/09/30 09:34:03 INFO Received push request method=POST path=/api/pushes machine # [ 511.042118] niks3-server[1198]: 2026/09/30 09:34:03 INFO Received sign narinfos request method=POST path=/api/pushes/24/sign machine # [ 511.045979] niks3-server[1198]: 2026/09/30 09:34:04 INFO Signed narinfos id=24 count=1 machine # [ 511.050166] niks3-server[1198]: 2026/09/30 09:34:04 INFO Registered completed upload object_key=nar/0khxywxb2r78vhpc5hsmha3ymgp910z0aka7550jmaqzs333rmzp.nar.zst machine # [ 511.053201] niks3-server[1198]: 2026/09/30 09:34:04 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.ls machine # [ 511.054446] niks3-server[1198]: 2026/09/30 09:34:04 INFO Registered completed upload object_key=log/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4-k3s-b.drv machine # [ 511.066604] niks3-server[1198]: 2026/09/30 09:34:04 INFO Received complete push request method=POST path=/api/pushes/24/complete machine # [ 511.073706] niks3-server[1198]: 2026/09/30 09:34:04 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.narinfo machine # [ 511.133523] niks3-server[1198]: 2026/09/30 09:34:04 INFO Received push request method=POST path=/api/pushes machine # [ 511.142591] niks3-server[1198]: 2026/09/30 09:34:04 INFO Received sign narinfos request method=POST path=/api/pushes/25/sign machine # [ 511.143692] niks3-server[1198]: 2026/09/30 09:34:04 INFO Signed narinfos id=25 count=1 machine # [ 511.146490] niks3-server[1198]: 2026/09/30 09:34:04 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.ls machine # [ 511.149078] niks3-server[1198]: 2026/09/30 09:34:04 INFO Registered completed upload object_key=nar/04bim5f8bvjh25xncf5x40kb529khrlzcbc92qxvapgbc0bdfv2h.nar.zst machine # [ 511.151228] niks3-server[1198]: 2026/09/30 09:34:04 INFO Received complete push request method=POST path=/api/pushes/25/complete machine # [ 511.153482] niks3-server[1198]: 2026/09/30 09:34:04 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.narinfo machine # [ 535.464525] niks3-server[1198]: 2026/09/30 09:34:28 INFO Received push request method=POST path=/api/pushes machine # [ 535.487451] niks3-server[1198]: 2026/09/30 09:34:28 INFO Received sign narinfos request method=POST path=/api/pushes/26/sign machine # [ 535.489501] niks3-server[1198]: 2026/09/30 09:34:28 INFO Signed narinfos id=26 count=1 machine # [ 535.492039] niks3-server[1198]: 2026/09/30 09:34:28 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.ls machine # [ 535.494348] niks3-server[1198]: 2026/09/30 09:34:28 INFO Registered completed upload object_key=nar/11f7f1hixry25c2yc6np9hs10a2pwwqmymmrxxbswhdjabcyvv0s.nar.zst machine # [ 535.496536] niks3-server[1198]: 2026/09/30 09:34:28 INFO Registered completed upload object_key=log/jz7biafi8rj5r3r392blyazw5mdpvy0d-k3s-top.drv machine # [ 535.500068] niks3-server[1198]: 2026/09/30 09:34:28 INFO Received complete push request method=POST path=/api/pushes/26/complete machine # [ 535.507858] niks3-server[1198]: 2026/09/30 09:34:28 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1, in 75.87 seconds) (finished: subtest: a renewed balancer certificate is served without a rollout, in 140.94 seconds) subtest: metrics carry build_info machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-krnnq -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-krnnq -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.19 seconds) machine: must succeed: curl -sf http://10.42.0.7:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-krnnq"' machine: (finished: must succeed: curl -sf http://10.42.0.7:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-krnnq"', in 0.04 seconds) (finished: subtest: metrics carry build_info, in 0.23 seconds) subtest: harmonia-gc frees space and the worker stays Ready machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-krnnq -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'' machine # [ 536.995332] k3s[894]: E0930 09:34:29.949485 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:58606: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-krnnq -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'', in 0.21 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-krnnq -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done' machine # [ 537.284336] k3s[894]: E0930 09:34:30.238663 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:58612: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-krnnq -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done', in 0.29 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-krnnq -c gc -- sh -c 'fallocate -l 11437584384 /nix/fill' machine # [ 537.484988] k3s[894]: E0930 09:34:30.439493 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:58626: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-krnnq -c gc -- sh -c 'fallocate -l 11437584384 /nix/fill', in 0.20 seconds) machine: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-krnnq -c gc --since=30s | grep -q 'store paths deleted' machine: (finished: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-krnnq -c gc --since=30s | grep -q 'store paths deleted', in 8.82 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-krnnq -c gc -- sh -c 'rm /nix/fill' machine # [ 546.516964] k3s[894]: E0930 09:34:39.471075 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39110: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-krnnq -c gc -- sh -c 'rm /nix/fill', in 0.21 seconds) machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-krnnq -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-krnnq -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}', in 0.14 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-krnnq -c gc -- sh -c 'command -v nix-daemon && command -v niks3' machine # [ 546.853938] k3s[894]: E0930 09:34:39.808383 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39122: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-krnnq -c gc -- sh -c 'command -v nix-daemon && command -v niks3', in 0.20 seconds) (finished: subtest: harmonia-gc frees space and the worker stays Ready, in 10.07 seconds) subtest: losing the balancer mid-build: the client reconnects and the build succeeds machine: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1 machine # [ 546.879172] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1. machine # Running as unit: vialb.service; invocation ID: 36a9c82d68d94b13a0e58f9c7af90e98 machine: (finished: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1, in 0.02 seconds) machine: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'" machine # [ 547.000792] nix[11201]: don't know how to build these paths: machine # [ 547.001628] nix[11201]: /nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 547.022561] nix[11201]: copying 1 paths to '127.0.0.1:30051'... machine # [ 547.024699] nix[11201]: copying path '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' to '127.0.0.1:30051'... machine # [ 547.079732] niks3-server[1198]: 2026/09/30 09:34:40 INFO Received push request method=POST path=/api/pushes machine # [ 547.092031] niks3-server[1198]: 2026/09/30 09:34:40 INFO Received sign narinfos request method=POST path=/api/pushes/27/sign machine # [ 547.094056] niks3-server[1198]: 2026/09/30 09:34:40 INFO Signed narinfos id=27 count=1 machine # [ 547.096957] niks3-server[1198]: 2026/09/30 09:34:40 INFO Registered completed upload object_key=nar/0kkr2vb091wkq0cb0f1q92413dsfskh76wydp8mwysv7rawns0ar.nar.zst machine # [ 547.099458] niks3-server[1198]: 2026/09/30 09:34:40 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.ls machine # [ 547.102387] niks3-server[1198]: 2026/09/30 09:34:40 INFO Received complete push request method=POST path=/api/pushes/27/complete machine # [ 547.107109] niks3-server[1198]: 2026/09/30 09:34:40 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.narinfo machine # [ 547.115188] nix[11201]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 547.116082] nix[11201]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-krnnq: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine: (finished: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'", in 1.06 seconds) machine: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false machine: (finished: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false, in 0.23 seconds) machine: waiting for success: ! systemctl is-active vialb machine # [ 548.183635] nix[11201]: scheduler at 127.0.0.1:30051: Stream removed (Socket closed), reconnecting machine # [ 548.189397] nix[11201]: d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv: Stream removed (Socket closed), asking the scheduler again machine # [ 548.207108] systemd[1]: cri-containerd-03a8c026748bae6769646eb669db245059b50f85eaf01c8acead72df48157019.scope: Deactivated successfully. machine # [ 548.211142] systemd[1]: cri-containerd-03a8c026748bae6769646eb669db245059b50f85eaf01c8acead72df48157019.scope: Consumed 4.914s CPU time over 8min 11.641s wall clock time, 60M memory peak, 38.1M read from disk, 620.3K incoming IP traffic, 757.2K outgoing IP traffic. machine # [ 548.241872] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-03a8c026748bae6769646eb669db245059b50f85eaf01c8acead72df48157019-rootfs.mount: Deactivated successfully. machine # [ 548.272576] systemd[1]: cri-containerd-c3b63e73ed3fc4149ea733f988745e051a7b6931ef615d8cbb13a0c8cbf93b68.scope: Deactivated successfully. machine # [ 548.301716] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-c3b63e73ed3fc4149ea733f988745e051a7b6931ef615d8cbb13a0c8cbf93b68-rootfs.mount: Deactivated successfully. machine # [ 548.330032] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-c3b63e73ed3fc4149ea733f988745e051a7b6931ef615d8cbb13a0c8cbf93b68-shm.mount: Deactivated successfully. machine # [ 548.515779] cni0: port 3(vethb238dd68) entered disabled state machine # [ 548.365629] d[ 548.517782] vethb238dd68 (unregistering): left allmulticast mode machine # hcpcd[693]: vethb238dd68: carrier lost machine # [ 548.519031] vethb238dd68 (unregistering): left promiscuous mode machine # [ 548.520035] cni0: port 3(vethb238dd68) entered disabled state machine # [ 548.386143] systemd[1]: run-netns-cni\x2d4ee0ebdb\x2dcb5b\x2df1b6\x2d532b\x2dffc0e0913f1e.mount: Deactivated successfully. machine # [ 548.392412] dhcpcd[693]: vethb238dd68: deleting address fe80::7c48:aff:fe59:bfe machine # [ 548.396188] dhcpcd[693]: vethb238dd68: deleting route to 169.254.0.0/16 machine # [ 548.426302] k3s[894]: E0930 09:34:41.380471 894 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-lb-5877cc8b4f\" failed with read version: 791 is not as new as written version: 818 for group resource replicasets.apps" logger="UnhandledError" machine # [ 548.436875] systemd[1]: Created slice libcontainer container kubepods-besteffort-podbfc68737_7a17_42d1_9a49_0a1d2287d032.slice. machine # [ 548.477342] dhcpcd[693]: vethb238dd68: removing interface machine # [ 548.542774] k3s[894]: I0930 09:34:41.497247 894 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/af02f6f9-d4e9-4705-8151-bd3e6403d8c1-tmp\" (UniqueName: \"kubernetes.io/empty-dir/af02f6f9-d4e9-4705-8151-bd3e6403d8c1-tmp\") pod \"af02f6f9-d4e9-4705-8151-bd3e6403d8c1\" (UID: \"af02f6f9-d4e9-4705-8151-bd3e6403d8c1\") " machine # [ 548.543761] k3s[894]: I0930 09:34:41.497314 894 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/af02f6f9-d4e9-4705-8151-bd3e6403d8c1-tls-lb\" (UniqueName: \"kubernetes.io/secret/af02f6f9-d4e9-4705-8151-bd3e6403d8c1-tls-lb\") pod \"af02f6f9-d4e9-4705-8151-bd3e6403d8c1\" (UID: \"af02f6f9-d4e9-4705-8151-bd3e6403d8c1\") " machine # [ 548.543856] k3s[894]: I0930 09:34:41.497346 894 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/af02f6f9-d4e9-4705-8151-bd3e6403d8c1-config\" (UniqueName: \"kubernetes.io/configmap/af02f6f9-d4e9-4705-8151-bd3e6403d8c1-config\") pod \"af02f6f9-d4e9-4705-8151-bd3e6403d8c1\" (UID: \"af02f6f9-d4e9-4705-8151-bd3e6403d8c1\") " machine # [ 548.544559] k3s[894]: I0930 09:34:41.497374 894 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/af02f6f9-d4e9-4705-8151-bd3e6403d8c1-tls-ca\" (UniqueName: \"kubernetes.io/secret/af02f6f9-d4e9-4705-8151-bd3e6403d8c1-tls-ca\") pod \"af02f6f9-d4e9-4705-8151-bd3e6403d8c1\" (UID: \"af02f6f9-d4e9-4705-8151-bd3e6403d8c1\") " machine # [ 548.545096] k3s[894]: I0930 09:34:41.497437 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/bfc68737-7a17-42d1-9a49-0a1d2287d032-tls-lb\") pod \"nix-grpc-farm-lb-5877cc8b4f-ch8sj\" (UID: \"bfc68737-7a17-42d1-9a49-0a1d2287d032\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-ch8sj" machine # [ 548.545543] k3s[894]: I0930 09:34:41.497465 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bfc68737-7a17-42d1-9a49-0a1d2287d032-config\") pod \"nix-grpc-farm-lb-5877cc8b4f-ch8sj\" (UID: \"bfc68737-7a17-42d1-9a49-0a1d2287d032\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-ch8sj" machine # [ 548.546098] k3s[894]: I0930 09:34:41.497492 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/bfc68737-7a17-42d1-9a49-0a1d2287d032-tls-ca\") pod \"nix-grpc-farm-lb-5877cc8b4f-ch8sj\" (UID: \"bfc68737-7a17-42d1-9a49-0a1d2287d032\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-ch8sj" machine # [ 548.546546] k3s[894]: I0930 09:34:41.497519 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bfc68737-7a17-42d1-9a49-0a1d2287d032-tmp\") pod \"nix-grpc-farm-lb-5877cc8b4f-ch8sj\" (UID: \"bfc68737-7a17-42d1-9a49-0a1d2287d032\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-ch8sj" machine # [ 548.575979] systemd[1]: var-lib-kubelet-pods-af02f6f9\x2dd4e9\x2d4705\x2d8151\x2dbd3e6403d8c1-volume\x2dsubpaths-config-envoy-0.mount: Deactivated successfully. machine # [ 548.576709] systemd[1]: var-lib-kubelet-pods-af02f6f9\x2dd4e9\x2d4705\x2d8151\x2dbd3e6403d8c1-volumes-kubernetes.io\x7esecret-tls\x2dlb.mount: Deactivated successfully. machine # [ 548.581546] k3s[894]: I0930 09:34:41.535834 894 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af02f6f9-d4e9-4705-8151-bd3e6403d8c1-tls-lb" pod "af02f6f9-d4e9-4705-8151-bd3e6403d8c1" (UID: "af02f6f9-d4e9-4705-8151-bd3e6403d8c1"). InnerVolumeSpecName "tls-lb". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 548.587089] k3s[894]: I0930 09:34:41.541592 894 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af02f6f9-d4e9-4705-8151-bd3e6403d8c1-tls-ca" pod "af02f6f9-d4e9-4705-8151-bd3e6403d8c1" (UID: "af02f6f9-d4e9-4705-8151-bd3e6403d8c1"). InnerVolumeSpecName "tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 548.591387] k3s[894]: I0930 09:34:41.543875 894 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af02f6f9-d4e9-4705-8151-bd3e6403d8c1-tmp" pod "af02f6f9-d4e9-4705-8151-bd3e6403d8c1" (UID: "af02f6f9-d4e9-4705-8151-bd3e6403d8c1"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 548.597379] k3s[894]: I0930 09:34:41.551925 894 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af02f6f9-d4e9-4705-8151-bd3e6403d8c1-config" pod "af02f6f9-d4e9-4705-8151-bd3e6403d8c1" (UID: "af02f6f9-d4e9-4705-8151-bd3e6403d8c1"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 548.647485] k3s[894]: I0930 09:34:41.602014 894 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af02f6f9-d4e9-4705-8151-bd3e6403d8c1-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 548.648283] k3s[894]: I0930 09:34:41.602041 894 reconciler_common.go:299] "Volume detached for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/af02f6f9-d4e9-4705-8151-bd3e6403d8c1-tls-lb\") on node \"machine\" DevicePath \"\"" machine # [ 548.648864] k3s[894]: I0930 09:34:41.602053 894 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/af02f6f9-d4e9-4705-8151-bd3e6403d8c1-config\") on node \"machine\" DevicePath \"\"" machine # [ 548.649581] k3s[894]: I0930 09:34:41.602065 894 reconciler_common.go:299] "Volume detached for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/af02f6f9-d4e9-4705-8151-bd3e6403d8c1-tls-ca\") on node \"machine\" DevicePath \"\"" machine # [ 548.922711] cni0: port 2(veth991a78a2) entered blocking state machine # [ 548.923963] cni0: port 2(veth991a78a2) entered disabled state machine # [ 548.924989] veth991a78a2: entered allmulticast mode machine # [ 548.925903] veth991a78a2: entered promiscuous mode machine # [ 548.775780] (udev-worker)[11378]: Network interface NamePolicy= disabled on kernel command line. machine # [ 548.934085] cni0: port 2(veth991a78a2) entered blocking state machine # [ 548.935340] cni0: port 2(veth991a78a2) entered forwarding state machine # [ 548.802775] dhcpcd[693]: veth991a78a2: IAID dc:22:30:ec machine # [ 548.803611] dhcpcd[693]: veth991a78a2: adding address fe80::400:dcff:fe22:30ec machine # [ 548.859422] systemd[1]: Started libcontainer container a62e94828c0f3d13f88f1cba85a651f283ba04d3ede130572fe813d495e84a14. machine # [ 548.978337] systemd[1]: Started libcontainer container 26a6f163c8df68ff37148a44b249e8b856b3e541c0c96f06cdb42dca8d31d7d3. machine # [ 549.049126] k3s[894]: I0930 09:34:42.002530 894 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-5877cc8b4f-ch8sj" podStartSLOduration=1.00250682 podStartE2EDuration="1.00250682s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-30 09:34:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 09:34:42.001254427 +0000 UTC m=+531.255104989" watchObservedRunningTime="2026-09-30 09:34:42.00250682 +0000 UTC m=+531.256357382" machine # [ 549.121655] systemd[1]: Removed slice libcontainer container kubepods-besteffort-podaf02f6f9_d4e9_4705_8151_bd3e6403d8c1.slice. machine # [ 549.122155] systemd[1]: kubepods-besteffort-podaf02f6f9_d4e9_4705_8151_bd3e6403d8c1.slice: Consumed 4.947s CPU time over 8min 14.581s wall clock time, 60.3M memory peak, 38.1M read from disk, 620.3K incoming IP traffic, 757.2K outgoing IP traffic. machine # [ 549.139170] k3s[894]: E0930 09:34:42.093717 894 kubelet_pods.go:2193] "failed to read memory cgroup config for the pod" err="failed to read memory.max for cgroup /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf02f6f9_d4e9_4705_8151_bd3e6403d8c1.slice: openat2 /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf02f6f9_d4e9_4705_8151_bd3e6403d8c1.slice/memory.max: no such file or directory" podName="nix-grpc-farm-lb-5877cc8b4f-hwskl" machine # [ 549.139506] k3s[894]: E0930 09:34:42.093786 894 kubelet_pods.go:2198] "failed to read memory cgroup limits for the pod" err="failed to read cpu.max file for cgroup /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf02f6f9_d4e9_4705_8151_bd3e6403d8c1.slice: openat2 /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf02f6f9_d4e9_4705_8151_bd3e6403d8c1.slice/cpu.max: no such file or directory" podName="nix-grpc-farm-lb-5877cc8b4f-hwskl" machine # [ 549.139998] k3s[894]: I0930 09:34:42.094384 894 scope.go:122] "RemoveContainer" containerID="03a8c026748bae6769646eb669db245059b50f85eaf01c8acead72df48157019" machine # [ 549.152543] k3s[894]: I0930 09:34:42.106223 894 scope.go:122] "RemoveContainer" containerID="03a8c026748bae6769646eb669db245059b50f85eaf01c8acead72df48157019" machine # [ 549.153315] k3s[894]: E0930 09:34:42.107766 894 remote_runtime.go:569] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"03a8c026748bae6769646eb669db245059b50f85eaf01c8acead72df48157019\": not found" containerID="03a8c026748bae6769646eb669db245059b50f85eaf01c8acead72df48157019" machine # [ 549.154030] k3s[894]: I0930 09:34:42.107796 894 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"03a8c026748bae6769646eb669db245059b50f85eaf01c8acead72df48157019"} err="failed to get container status \"03a8c026748bae6769646eb669db245059b50f85eaf01c8acead72df48157019\": rpc error: code = NotFound desc = an error occurred when try to find container \"03a8c026748bae6769646eb669db245059b50f85eaf01c8acead72df48157019\": not found" machine # [ 549.249863] systemd[1]: var-lib-kubelet-pods-af02f6f9\x2dd4e9\x2d4705\x2d8151\x2dbd3e6403d8c1-volume\x2dsubpaths-config-envoy-2.mount: Deactivated successfully. machine # [ 549.250831] systemd[1]: var-lib-kubelet-pods-af02f6f9\x2dd4e9\x2d4705\x2d8151\x2dbd3e6403d8c1-volume\x2dsubpaths-config-envoy-1.mount: Deactivated successfully. machine # [ 549.251465] systemd[1]: var-lib-kubelet-pods-af02f6f9\x2dd4e9\x2d4705\x2d8151\x2dbd3e6403d8c1-volumes-kubernetes.io\x7esecret-tls\x2dca.mount: Deactivated successfully. machine # [ 549.251943] systemd[1]: var-lib-kubelet-pods-af02f6f9\x2dd4e9\x2d4705\x2d8151\x2dbd3e6403d8c1-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 550.210880] dhcpcd[693]: veth991a78a2: soliciting a DHCP lease machine # [ 550.686354] nix[11201]: scheduler at 127.0.0.1:30051: failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:30051: tcp handshaker shutdown, reconnecting machine # [ 551.119934] k3s[894]: I0930 09:34:44.073588 894 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="af02f6f9-d4e9-4705-8151-bd3e6403d8c1" path="/var/lib/kubelet/pods/af02f6f9-d4e9-4705-8151-bd3e6403d8c1/volumes" machine # [ 551.730986] nix[11201]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 551.732605] nix[11201]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-n8p2g: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 551.832841] dhcpcd[693]: veth991a78a2: soliciting an IPv6 router machine # [ 555.211716] dhcpcd[693]: veth991a78a2: probing for an IPv4LL address machine # [ 559.862182] dhcpcd[693]: veth991a78a2: using IPv4LL address 169.254.26.229 machine # [ 559.864709] dhcpcd[693]: veth991a78a2: adding route to 169.254.0.0/16 machine # [ 563.838161] dhcpcd[693]: veth991a78a2: no IPv6 Routers available machine # [ 596.269909] niks3-server[1198]: 2026/09/30 09:35:29 INFO Received push request method=POST path=/api/pushes machine # [ 596.289544] niks3-server[1198]: 2026/09/30 09:35:29 INFO Received sign narinfos request method=POST path=/api/pushes/28/sign machine # [ 596.291145] niks3-server[1198]: 2026/09/30 09:35:29 INFO Signed narinfos id=28 count=1 machine # [ 596.292592] niks3-server[1198]: 2026/09/30 09:35:29 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.ls machine # [ 596.298395] niks3-server[1198]: 2026/09/30 09:35:29 INFO Registered completed upload object_key=log/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 596.301923] niks3-server[1198]: 2026/09/30 09:35:29 INFO Received complete push request method=POST path=/api/pushes/28/complete machine # [ 596.307483] niks3-server[1198]: 2026/09/30 09:35:29 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.narinfo machine # [ 597.377049] systemd[1]: vialb.service: Deactivated successfully. machine # [ 597.379576] systemd[1]: vialb.service: Consumed 207ms CPU time over 50.497s wall clock time, 38.4M memory peak, 4K written to disk, 8.6K incoming IP traffic, 17.4K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active vialb, in 49.81 seconds) machine: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; }, in 0.03 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 0.24 seconds) (finished: subtest: losing the balancer mid-build: the client reconnects and the build succeeds, in 51.39 seconds) subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes machine: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 machine # [ 598.281220] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1. machine # Running as unit: slow.service; invocation ID: 88fb2017dc0a477092aeeba3593f104a machine: (finished: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1, in 0.03 seconds) machine # [ 598.402726] nix[12223]: don't know how to build these paths: machine # [ 598.403544] nix[12223]: /nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 598.418945] nix[12223]: copying 1 paths to '127.0.0.1:30051'... machine # [ 598.420211] nix[12223]: copying path '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' to '127.0.0.1:30051'... machine # [ 598.458568] niks3-server[1198]: 2026/09/30 09:35:31 INFO Received push request method=POST path=/api/pushes machine # [ 598.465025] k3s[894]: E0930 09:35:31.419077 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:44140: use of closed network connection" machine # command terminated with exit code 1 machine # [ 598.474054] niks3-server[1198]: 2026/09/30 09:35:31 INFO Received sign narinfos request method=POST path=/api/pushes/29/sign machine # [ 598.476543] niks3-server[1198]: 2026/09/30 09:35:31 INFO Signed narinfos id=29 count=1 machine # [ 598.477503] niks3-server[1198]: 2026/09/30 09:35:31 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.ls machine # [ 598.478951] niks3-server[1198]: 2026/09/30 09:35:31 INFO Registered completed upload object_key=nar/0wl2i9xpw0gwrx1xqdgx9ka4n503ky9qhl20pdrdlphn8d6lcx0i.nar.zst machine # [ 598.481235] niks3-server[1198]: 2026/09/30 09:35:31 INFO Received complete push request method=POST path=/api/pushes/29/complete machine # [ 598.483606] niks3-server[1198]: 2026/09/30 09:35:31 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.narinfo machine # [ 598.494605] nix[12223]: building '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' on 127.0.0.1:30051... machine # [ 598.494937] nix[12223]: slow-s1> machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-krnnq: building zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 598.652316] k3s[894]: E0930 09:35:31.606867 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:44152: use of closed network connection" machine # command terminated with exit code 1 machine # [ 599.918977] k3s[894]: E0930 09:35:32.873186 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:44154: use of closed network connection" machine # command terminated with exit code 1 machine # [ 600.127604] k3s[894]: E0930 09:35:33.082114 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:44162: use of closed network connection" machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 601.389834] k3s[894]: E0930 09:35:34.343818 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:44172: use of closed network connection" machine # [ 601.569188] k3s[894]: E0930 09:35:34.523683 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:44176: use of closed network connection" machine # command terminated with exit code 1 machine # [ 602.828752] k3s[894]: E0930 09:35:35.782972 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:44180: use of closed network connection" machine # command terminated with exit code 1 machine # [ 603.005320] k3s[894]: E0930 09:35:35.959805 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47092: use of closed network connection" machine # command terminated with exit code 1 machine # [ 604.332819] k3s[894]: E0930 09:35:37.287036 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47108: use of closed network connection" machine # command terminated with exit code 1 machine # [ 604.498395] k3s[894]: E0930 09:35:37.452900 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47110: use of closed network connection" machine # command terminated with exit code 1 machine # [ 605.794128] k3s[894]: E0930 09:35:38.748039 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47112: use of closed network connection" machine # command terminated with exit code 1 machine # [ 605.982459] k3s[894]: E0930 09:35:38.936783 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47128: use of closed network connection" machine # command terminated with exit code 1 machine # [ 607.239366] k3s[894]: E0930 09:35:40.193587 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47136: use of closed network connection" machine # command terminated with exit code 1 machine # [ 607.405539] k3s[894]: E0930 09:35:40.360050 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47148: use of closed network connection" machine # command terminated with exit code 1 machine # [ 608.707592] k3s[894]: E0930 09:35:41.661795 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47158: use of closed network connection" machine # command terminated with exit code 1 machine # [ 608.919632] k3s[894]: E0930 09:35:41.874151 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47174: use of closed network connection" machine # command terminated with exit code 1 machine # [ 609.838232] postgres[754]: [754] LOG: checkpoint starting: time machine # command terminated with exit code 1 machine # [ 610.207502] k3s[894]: E0930 09:35:43.161472 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47178: use of closed network connection" machine # [ 610.397111] k3s[894]: E0930 09:35:43.351445 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47184: use of closed network connection" machine # command terminated with exit code 1 machine # [ 611.678840] k3s[894]: E0930 09:35:44.633079 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47186: use of closed network connection" machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 611.878333] k3s[894]: E0930 09:35:44.832594 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47190: use of closed network connection" machine # [ 612.270981] postgres[754]: [754] LOG: checkpoint complete: wrote 24 buffers (0.1%), wrote 1 SLRU buffers; 0 WAL file(s) added, 0 removed, 0 recycled; write=2.412 s, sync=0.008 s, total=2.433 s; sync files=21, longest=0.003 s, average=0.001 s; distance=234 kB, estimate=4504 kB; lsn=0/1C7D518, redo lsn=0/1C7D4C0 machine # [ 613.162179] k3s[894]: E0930 09:35:46.116106 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59304: use of closed network connection" machine # command terminated with exit code 1 machine # [ 613.334731] k3s[894]: E0930 09:35:46.289250 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59320: use of closed network connection" machine # command terminated with exit code 1 machine # [ 614.615869] k3s[894]: E0930 09:35:47.570075 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59330: use of closed network connection" machine # command terminated with exit code 1 machine # [ 614.807707] k3s[894]: E0930 09:35:47.762189 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59346: use of closed network connection" machine # command terminated with exit code 1 machine # [ 616.114513] k3s[894]: E0930 09:35:49.068431 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59362: use of closed network connection" machine # command terminated with exit code 1 machine # [ 616.333236] k3s[894]: E0930 09:35:49.287740 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59366: use of closed network connection" machine # command terminated with exit code 1 machine # [ 617.602343] k3s[894]: E0930 09:35:50.556557 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59372: use of closed network connection" machine # command terminated with exit code 1 machine # [ 617.790429] k3s[894]: E0930 09:35:50.744934 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59382: use of closed network connection" machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 619.085739] k3s[894]: E0930 09:35:52.038988 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59388: use of closed network connection" machine # [ 619.270839] k3s[894]: E0930 09:35:52.225339 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59404: use of closed network connection" machine # command terminated with exit code 1 machine # [ 620.569786] k3s[894]: E0930 09:35:53.523881 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59420: use of closed network connection" machine # command terminated with exit code 1 machine # [ 620.632109] k3s[894]: I0930 09:35:53.586654 894 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 620.768130] k3s[894]: E0930 09:35:53.722556 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59434: use of closed network connection" machine # command terminated with exit code 1 machine # [ 622.054508] k3s[894]: E0930 09:35:55.008725 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59444: use of closed network connection" machine # command terminated with exit code 1 machine # [ 622.273328] k3s[894]: E0930 09:35:55.227777 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59456: use of closed network connection" machine # command terminated with exit code 1 machine # [ 623.514728] k3s[894]: E0930 09:35:56.468951 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:42026: use of closed network connection" machine # [ 623.672823] k3s[894]: E0930 09:35:56.627349 894 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:42032: use of closed network connection" machine: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-krnnq --wait=false machine: (finished: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-krnnq --wait=false, in 0.12 seconds) machine: must succeed: sleep 5.0 machine # [ 623.830212] systemd[1]: cri-containerd-c4d646410108ad3c3a2ef7d286553994bf03d7bf6664a52d079518e35d10c5ed.scope: Deactivated successfully. machine # [ 623.831685] systemd[1]: cri-containerd-c4d646410108ad3c3a2ef7d286553994bf03d7bf6664a52d079518e35d10c5ed.scope: Consumed 523ms CPU time over 9min 18.986s wall clock time, 13.7M memory peak, 5.3M read from disk. machine # [ 623.860488] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-c4d646410108ad3c3a2ef7d286553994bf03d7bf6664a52d079518e35d10c5ed-rootfs.mount: Deactivated successfully. machine # [ 624.013804] systemd[1]: Created slice libcontainer container kubepods-besteffort-pode5a35d6c_ce6a_4ece_afc5_ebc63cdda91b.slice. machine # [ 624.139495] k3s[894]: I0930 09:35:57.093843 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/e5a35d6c-ce6a-4ece-afc5-ebc63cdda91b-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-8tqjg\" (UID: \"e5a35d6c-ce6a-4ece-afc5-ebc63cdda91b\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-8tqjg" machine # [ 624.140305] k3s[894]: I0930 09:35:57.093893 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h8zc\" (UniqueName: \"kubernetes.io/projected/e5a35d6c-ce6a-4ece-afc5-ebc63cdda91b-kube-api-access-7h8zc\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-8tqjg\" (UID: \"e5a35d6c-ce6a-4ece-afc5-ebc63cdda91b\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-8tqjg" machine # [ 624.140846] k3s[894]: I0930 09:35:57.093920 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e5a35d6c-ce6a-4ece-afc5-ebc63cdda91b-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-8tqjg\" (UID: \"e5a35d6c-ce6a-4ece-afc5-ebc63cdda91b\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-8tqjg" machine # [ 624.141592] k3s[894]: I0930 09:35:57.093946 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/e5a35d6c-ce6a-4ece-afc5-ebc63cdda91b-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-8tqjg\" (UID: \"e5a35d6c-ce6a-4ece-afc5-ebc63cdda91b\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-8tqjg" machine # [ 624.142267] k3s[894]: I0930 09:35:57.094134 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/e5a35d6c-ce6a-4ece-afc5-ebc63cdda91b-build\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-8tqjg\" (UID: \"e5a35d6c-ce6a-4ece-afc5-ebc63cdda91b\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-8tqjg" machine # [ 624.143437] k3s[894]: I0930 09:35:57.094160 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/e5a35d6c-ce6a-4ece-afc5-ebc63cdda91b-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-8tqjg\" (UID: \"e5a35d6c-ce6a-4ece-afc5-ebc63cdda91b\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-8tqjg" machine # [ 624.144189] k3s[894]: I0930 09:35:57.094187 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/e5a35d6c-ce6a-4ece-afc5-ebc63cdda91b-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-8tqjg\" (UID: \"e5a35d6c-ce6a-4ece-afc5-ebc63cdda91b\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-8tqjg" machine # [ 624.144812] k3s[894]: I0930 09:35:57.094212 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/e5a35d6c-ce6a-4ece-afc5-ebc63cdda91b-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-8tqjg\" (UID: \"e5a35d6c-ce6a-4ece-afc5-ebc63cdda91b\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-8tqjg" machine # [ 624.145607] k3s[894]: I0930 09:35:57.094239 894 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/e5a35d6c-ce6a-4ece-afc5-ebc63cdda91b-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-8tqjg\" (UID: \"e5a35d6c-ce6a-4ece-afc5-ebc63cdda91b\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-8tqjg" machine # [ 624.528212] cni0: port 3(veth9b78a87a) entered blocking state machine # [ 624.529160] cni0: port 3(veth9b78a87a) entered disabled state machine # [ 624.530010] veth9b78a87a: entered allmulticast mode machine # [ 624.530724] veth9b78a87a: entered promiscuous mode machine # [ 624.542090] cni0: port 3(veth9b78a87a) entered blocking state machine # [ 624.543002] cni0: port 3(veth9b78a87a) entered forwarding state machine # [ 624.426230] (udev-worker)[13783]: Network interface NamePolicy= disabled on kernel command line. machine # [ 624.450359] dhcpcd[693]: veth9b78a87a: IAID 21:1e:ee:5e machine # [ 624.451102] dhcpcd[693]: veth9b78a87a: adding address fe80::2cde:21ff:fe1e:ee5e machine # [ 624.483233] systemd[1]: Started libcontainer container 9503afc3e0fb2f236612528124be879a8e095976f13c0ec004a649ade81ac337. machine # [ 624.662302] systemd[1]: Started libcontainer container b8a084583a85138802263fecad6a08528530e16448753df1bd5aa835857395cc. machine # [ 625.003525] dhcpcd[693]: veth9b78a87a: soliciting a DHCP lease machine # [ 626.247793] dhcpcd[693]: veth9b78a87a: soliciting an IPv6 router machine # [ 627.574170] systemd[1]: cri-containerd-b8a084583a85138802263fecad6a08528530e16448753df1bd5aa835857395cc.scope: Deactivated successfully. machine # [ 627.577555] systemd[1]: cri-containerd-b8a084583a85138802263fecad6a08528530e16448753df1bd5aa835857395cc.scope: Consumed 1.217s CPU time over 2.911s wall clock time, 455.5M memory peak, 166.1M read from disk, 71.4M written to disk. machine # [ 627.633429] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-b8a084583a85138802263fecad6a08528530e16448753df1bd5aa835857395cc-rootfs.mount: Deactivated successfully. machine # [ 628.647933] systemd[1]: tmp-ovl\x2didmapped1375926092.mount: Deactivated successfully. machine # [ 628.662866] systemd[1]: Started libcontainer container ac3383d4d1a4d457752c06f7e500727833ca965080c382272d1c7eb09c5fd01a. machine: (finished: must succeed: sleep 5.0, in 5.03 seconds) machine # [ 628.849297] systemd[1]: Started libcontainer container c5546b7279efdf72223990222306bddb3e0dfe156a48ea96f94b46d4c530f65e. machine: waiting for success: ! systemctl is-active slow machine # [ 629.076272] systemd[1]: Started libcontainer container c721e6beab8f341f989ece79aa8b9179ee56f0b09d6b922f4e53398537af5e1b. machine # [ 629.143115] k3s[894]: I0930 09:36:02.097277 894 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-8tqjg" podStartSLOduration=3.200317986 podStartE2EDuration="6.097248461s" totalImagesPullingTime="0s" totalInitContainerRuntime="2.896930475s" isStatefulPod=false podCreationTimestamp="2026-09-30 09:35:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 09:36:02.096902328 +0000 UTC m=+611.350753169" watchObservedRunningTime="2026-09-30 09:36:02.097248461 +0000 UTC m=+611.351099023" machine # [ 630.004616] dhcpcd[693]: veth9b78a87a: probing for an IPv4LL address machine # [ 634.921420] dhcpcd[693]: veth9b78a87a: using IPv4LL address 169.254.187.165 machine # [ 634.922888] dhcpcd[693]: veth9b78a87a: adding route to 169.254.0.0/16 machine # [ 638.251076] dhcpcd[693]: veth9b78a87a: no IPv6 Routers available machine # [ 643.035372] niks3-server[1198]: 2026/09/30 09:36:15 INFO Received push request method=POST path=/api/pushes machine # [ 643.049048] niks3-server[1198]: 2026/09/30 09:36:16 INFO Received sign narinfos request method=POST path=/api/pushes/30/sign machine # [ 643.051187] niks3-server[1198]: 2026/09/30 09:36:16 INFO Signed narinfos id=30 count=1 machine # [ 643.052642] niks3-server[1198]: 2026/09/30 09:36:16 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.ls machine # [ 643.054442] niks3-server[1198]: 2026/09/30 09:36:16 INFO Registered completed upload object_key=log/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 643.063142] niks3-server[1198]: 2026/09/30 09:36:16 INFO Received complete push request method=POST path=/api/pushes/30/complete machine # [ 643.071888] niks3-server[1198]: 2026/09/30 09:36:16 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo machine # [ 643.104536] systemd[1]: slow.service: Deactivated successfully. machine # [ 643.105505] systemd[1]: slow.service: Consumed 156ms CPU time over 44.823s wall clock time, 42.3M memory peak, 4K written to disk, 5.3K incoming IP traffic, 11.5K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active slow, in 14.57 seconds) machine: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; }, in 0.03 seconds) machine: must fail: journalctl -u slow | grep -q 'asking the scheduler again' machine: (finished: must fail: journalctl -u slow | grep -q 'asking the scheduler again', in 0.02 seconds) machine: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath, in 0.14 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null, in 0.03 seconds) (finished: subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes, in 45.59 seconds) (finished: run the VM test script, in 644.81 seconds) test script finished in 644.86s cleanup kill QemuMachine (pid 45) machine # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) machine # [2026-09-30T09:36:16Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-09-30T09:36:16Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-09-30T09:36:16Z INFO virtiofsd] Client disconnected, shutting down (finished: cleanup, in 0.95 seconds) additionally exposed symbols: machine, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh