tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 1200.0 seconds run the VM test script machine: waiting for unit k3s.service machine: waiting for the VM to finish booting machine: starting vm machine: QEMU running (pid 45) machine # Disk image does not exist, creating the virtualisation disk image... machine # Formatting '/build/vm-state-machine/tmp.dtn9zZhxJl', fmt=raw size=17179869184 machine # mke2fs 1.47.4 (6-Mar-2025) machine # Discarding device blocks: 0/4194304 done machine # Creating filesystem with 4194304 4k blocks and 1048576 inodes machine # Filesystem UUID: 2312905f-eea0-4f35-9ebd-c5c61ec3ddc0 machine # Superblock backups stored on blocks: machine # 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208, machine # 4096000 machine # machine # Allocating group tables: 0/128 done machine # Writing inode tables: 0/128 done machine # Creating journal (32768 blocks): done machine # Writing superblocks and filesystem accounting information: 0/128 done machine # machine # Virtualisation disk image created. machine # Starting virtiofs daemons... machine # [2026-09-30T08:30:58Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-30T08:30:58Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-30T08:30:58Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-30T08:30:58Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-30T08:30:58Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-30T08:30:58Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-30T08:30:58Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-30T08:30:58Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-30T08:30:58Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-30T08:30:58Z INFO virtiofsd] Client connected, servicing requests machine # [2026-09-30T08:30:58Z INFO virtiofsd] Client connected, servicing requests machine # [2026-09-30T08:30:58Z INFO virtiofsd] Client connected, servicing requests machine # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) machine # machine # machine # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+7EFCC730+7EF2C730 CA00 machine # Press Ctrl-B to configure iPXE (PCI 00:02.0)... machine # machine # machine # machine # machine # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 7EFCC730 7EF2C730 CB00 machine # Press Ctrl-B to configure iPXE (PCI 00:05.0)... machine # machine # machine # Booting from ROM... machine # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.53 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 21 13:06:06 UTC 2026 machine # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/wkk9pmimqrawmwh7m0zhpbn4qdkch5j0-nixos-system-machine-test/init regInfo=/nix/.ro-store/h9kq3l1vaqj7jwqvw4nyrk9by94cciqc-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.000000] BIOS-provided physical RAM map: machine # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007ffd7fff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000007ffd8000-0x000000007fffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000017fffffff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved machine # [ 0.000000] NX (Execute Disable) protection: active machine # [ 0.000000] APIC: Static calls initialized machine # [ 0.000000] SMBIOS 2.8 present. machine # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 machine # [ 0.000000] DMI: Memory slots populated: 1/1 machine # [ 0.000000] Hypervisor detected: KVM machine # [ 0.000000] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 machine # [ 0.000000] kvm-clock: using sched offset of 464200541 cycles machine # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns machine # [ 0.000004] tsc: Detected 2400.012 MHz processor machine # [ 0.000803] last_pfn = 0x180000 max_arch_pfn = 0x10000000000 machine # [ 0.000830] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs machine # [ 0.000833] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT machine # [ 0.000870] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.002723] found SMP MP-table at [mem 0x000f5450-0x000f545f] machine # [ 0.002733] Using GB pages for direct mapping machine # [ 0.002886] RAMDISK: [mem 0x7e364000-0x7ffcffff] machine # [ 0.002894] ACPI: Early table checksum verification disabled machine # [ 0.002897] ACPI: RSDP 0x00000000000F5250 000014 (v00 BOCHS ) machine # [ 0.002901] ACPI: RSDT 0x000000007FFE2539 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002905] ACPI: FACP 0x000000007FFE2319 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002911] ACPI: DSDT 0x000000007FFE0040 0022D9 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002913] ACPI: FACS 0x000000007FFE0000 000040 machine # [ 0.002915] ACPI: APIC 0x000000007FFE240D 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002916] ACPI: HPET 0x000000007FFE249D 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002918] ACPI: MCFG 0x000000007FFE24D5 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002919] ACPI: WAET 0x000000007FFE2511 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002921] ACPI: Reserving FACP table memory at [mem 0x7ffe2319-0x7ffe240c] machine # [ 0.002922] ACPI: Reserving DSDT table memory at [mem 0x7ffe0040-0x7ffe2318] machine # [ 0.002922] ACPI: Reserving FACS table memory at [mem 0x7ffe0000-0x7ffe003f] machine # [ 0.002923] ACPI: Reserving APIC table memory at [mem 0x7ffe240d-0x7ffe249c] machine # [ 0.002923] ACPI: Reserving HPET table memory at [mem 0x7ffe249d-0x7ffe24d4] machine # [ 0.002924] ACPI: Reserving MCFG table memory at [mem 0x7ffe24d5-0x7ffe2510] machine # [ 0.002924] ACPI: Reserving WAET table memory at [mem 0x7ffe2511-0x7ffe2538] machine # [ 0.003151] No NUMA configuration found machine # [ 0.003152] Faking a node at [mem 0x0000000000000000-0x000000017fffffff] machine # [ 0.003154] NODE_DATA(0) allocated [mem 0x17fff8780-0x17fffdcff] machine # [ 0.005263] Zone ranges: machine # [ 0.005264] DMA [mem 0x0000000000001000-0x0000000000ffffff] machine # [ 0.005265] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] machine # [ 0.005266] Normal [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005267] Device empty machine # [ 0.005268] Movable zone start for each node machine # [ 0.005269] Early memory node ranges machine # [ 0.005269] node 0: [mem 0x0000000000001000-0x000000000009efff] machine # [ 0.005270] node 0: [mem 0x0000000000100000-0x000000007ffd7fff] machine # [ 0.005271] node 0: [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005272] Initmem setup node 0 [mem 0x0000000000001000-0x000000017fffffff] machine # [ 0.005289] On node 0, zone DMA: 1 pages in unavailable ranges machine # [ 0.005537] On node 0, zone DMA: 97 pages in unavailable ranges machine # [ 0.072658] On node 0, zone Normal: 40 pages in unavailable ranges machine # [ 0.073146] ACPI: PM-Timer IO Port: 0x608 machine # [ 0.073162] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) machine # [ 0.073196] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 machine # [ 0.073199] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) machine # [ 0.073201] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) machine # [ 0.073202] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) machine # [ 0.073203] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) machine # [ 0.073204] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) machine # [ 0.073206] ACPI: Using ACPI (MADT) for SMP configuration information machine # [ 0.073208] ACPI: HPET id: 0x8086a201 base: 0xfed00000 machine # [ 0.073212] TSC deadline timer available machine # [ 0.073216] CPU topo: Max. logical packages: 1 machine # [ 0.073217] CPU topo: Max. logical dies: 1 machine # [ 0.073217] CPU topo: Max. dies per package: 1 machine # [ 0.073221] CPU topo: Max. threads per core: 1 machine # [ 0.073222] CPU topo: Num. cores per package: 4 machine # [ 0.073222] CPU topo: Num. threads per package: 4 machine # [ 0.073222] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs machine # [ 0.073247] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() machine # [ 0.073262] kvm-guest: KVM setup pv remote TLB flush machine # [ 0.073265] kvm-guest: setup PV sched yield machine # [ 0.073274] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] machine # [ 0.073276] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] machine # [ 0.073277] PM: hibernation: Registered nosave memory: [mem 0x7ffd8000-0xffffffff] machine # [ 0.073278] [mem 0xc0000000-0xfed1bfff] available for PCI devices machine # [ 0.073280] Booting paravirtualized kernel on KVM machine # [ 0.073283] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns machine # [ 0.077746] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 machine # [ 0.079815] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288 machine # [ 0.079865] kvm-guest: PV spinlocks enabled machine # [ 0.079867] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) machine # [ 0.079870] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/wkk9pmimqrawmwh7m0zhpbn4qdkch5j0-nixos-system-machine-test/init regInfo=/nix/.ro-store/h9kq3l1vaqj7jwqvw4nyrk9by94cciqc-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.079967] Unknown kernel command line parameters "regInfo=/nix/.ro-store/h9kq3l1vaqj7jwqvw4nyrk9by94cciqc-closure-info/registration", will be passed to user space. machine # [ 0.079987] random: crng init done machine # [ 0.079987] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes machine # [ 0.084008] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) machine # [ 0.086206] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) machine # [ 0.086276] software IO TLB: area num 4. machine # [ 0.155311] Fallback order for Node 0: 0 machine # [ 0.155320] Built 1 zonelists, mobility grouping on. Total pages: 1048438 machine # [ 0.155322] Policy zone: Normal machine # [ 0.157671] mem auto-init: stack:all(zero), heap alloc:on, heap free:off machine # [ 0.164106] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 machine # [ 0.172493] allocated 8388608 bytes of page_ext machine # [ 0.182198] ftrace: allocating 48798 entries in 192 pages machine # [ 0.182200] ftrace: allocated 192 pages with 2 groups machine # [ 0.183007] Dynamic Preempt: lazy machine # [ 0.183167] rcu: Preemptible hierarchical RCU implementation. machine # [ 0.183168] rcu: RCU event tracing is enabled. machine # [ 0.183168] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. machine # [ 0.183170] Trampoline variant of Tasks RCU enabled. machine # [ 0.183170] Rude variant of Tasks RCU enabled. machine # [ 0.183170] Tracing variant of Tasks RCU enabled. machine # [ 0.183171] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. machine # [ 0.183172] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 machine # [ 0.183191] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.183193] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.183194] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.187521] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16 machine # [ 0.187804] rcu: srcu_init: Setting srcu_struct sizes based on contention. machine # [ 0.187814] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns machine # [ 0.187927] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) machine # [ 0.191518] Console: colour VGA+ 80x25 machine # [ 0.191521] printk: legacy console [tty0] enabled machine # [ 0.223177] printk: legacy console [ttyS0] enabled machine # [ 0.326990] ACPI: Core revision 20250807 machine # [ 0.327905] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns machine # [ 0.329447] APIC: Switch to symmetric I/O mode setup machine # [ 0.330443] x2apic enabled machine # [ 0.331225] APIC: Switched APIC routing to: physical x2apic machine # [ 0.332106] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask() machine # [ 0.333265] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself() machine # [ 0.334722] kvm-guest: setup PV IPIs machine # [ 0.336272] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 machine # [ 0.337267] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.341610] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) machine # [ 0.342696] x86/cpu: User Mode Instruction Prevention (UMIP) activated machine # [ 0.343737] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 machine # [ 0.345329] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 machine # [ 0.346403] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto machine # [ 0.347608] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl machine # [ 0.348608] Transient Scheduler Attacks: Vulnerable: No microcode machine # [ 0.349607] Spectre V2 : Mitigation: Enhanced / Automatic IBRS machine # [ 0.350559] Speculative Return Stack Overflow: Mitigation: Safe RET machine # [ 0.351607] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization machine # [ 0.352614] Spectre V2 : Enabling IBPB for BPF machine # [ 0.353608] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier machine # [ 0.354608] active return thunk: srso_alias_return_thunk machine # [ 0.356285] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' machine # [ 0.357607] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' machine # [ 0.358607] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' machine # [ 0.359607] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' machine # [ 0.360607] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' machine # [ 0.361607] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' machine # [ 0.362607] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' machine # [ 0.363607] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 machine # [ 0.364607] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 machine # [ 0.365607] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 machine # [ 0.366607] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 machine # [ 0.367607] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 machine # [ 0.368607] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. machine # [ 0.397843] Freeing SMP alternatives memory: 44K machine # [ 0.398611] pid_max: default: 32768 minimum: 301 machine # [ 0.399476] LSM: initializing lsm=capability,landlock,yama,bpf,ima machine # [ 0.400705] landlock: Up and running. machine # [ 0.401334] Yama: becoming mindful. machine # [ 0.401828] LSM support for eBPF active machine # [ 0.402769] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.403674] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.407013] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) machine # [ 0.408156] Performance Events: Fam17h+ core perfctr, AMD PMU driver. machine # [ 0.408616] ... version: 2 machine # [ 0.409358] ... bit width: 48 machine # [ 0.409610] ... generic counters: 6 machine # [ 0.410322] ... generic bitmap: 000000000000003f machine # [ 0.410609] ... fixed-purpose counters: 0 machine # [ 0.411348] ... fixed-purpose bitmap: 0000000000000000 machine # [ 0.411609] ... value mask: 0000ffffffffffff machine # [ 0.412535] ... max period: 00007fffffffffff machine # [ 0.413317] ... global_ctrl mask: 000000000000003f machine # [ 0.413712] signal: max sigframe size: 3376 machine # [ 0.414522] rcu: Hierarchical SRCU implementation. machine # [ 0.415200] rcu: Max phase no-delay instances is 400. machine # [ 0.415784] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level machine # [ 0.421019] smp: Bringing up secondary CPUs ... machine # [ 0.422022] smpboot: x86: Booting SMP configuration: machine # [ 0.422618] .... node #0, CPUs: #1 #2 #3 machine # [ 0.425772] smp: Brought up 1 node, 4 CPUs machine # [ 0.427611] smpboot: Total of 4 processors activated (19200.09 BogoMIPS) machine # [ 0.428958] Memory: 3957880K/4193752K available (17259K kernel code, 2728K rwdata, 13652K rodata, 3656K init, 2968K bss, 220908K reserved, 0K cma-reserved) machine # [ 0.431609] devtmpfs: initialized machine # [ 0.432743] x86/mm: Memory block size: 128MB machine # [ 0.436753] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.439787] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). machine # [ 0.444447] pinctrl core: initialized pinctrl subsystem machine # [ 0.447788] PM: RTC time: 08:30:58, date: 2026-09-30 machine # [ 0.456647] NET: Registered PF_NETLINK/PF_ROUTE protocol family machine # [ 0.461649] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations machine # [ 0.464680] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations machine # [ 0.468858] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations machine # [ 0.472657] audit: initializing netlink subsys (disabled) machine # [ 0.474836] audit: type=2000 audit(1790757058.970:1): state=initialized audit_enabled=0 res=1 machine # [ 0.475198] thermal_sys: Registered thermal governor 'fair_share' machine # [ 0.478618] thermal_sys: Registered thermal governor 'bang_bang' machine # [ 0.480616] thermal_sys: Registered thermal governor 'step_wise' machine # [ 0.483616] thermal_sys: Registered thermal governor 'user_space' machine # [ 0.485615] thermal_sys: Registered thermal governor 'power_allocator' machine # [ 0.488672] cpuidle: using governor menu machine # [ 0.494000] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 machine # [ 0.496176] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] machine # [ 0.498620] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry machine # [ 0.501657] PCI: Using configuration type 1 for base access machine # [ 0.503723] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. machine # [ 0.508732] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages machine # [ 0.511617] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page machine # [ 0.514618] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages machine # [ 0.517615] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page machine # [ 0.524140] ACPI: Added _OSI(Module Device) machine # [ 0.525616] ACPI: Added _OSI(Processor Device) machine # [ 0.527619] ACPI: Added _OSI(Processor Aggregator Device) machine # [ 0.537333] ACPI: 1 ACPI AML tables successfully acquired and loaded machine # [ 0.542964] ACPI: Interpreter enabled machine # [ 0.543685] ACPI: PM: (supports S0 S3 S4 S5) machine # [ 0.545617] ACPI: Using IOAPIC for interrupt routing machine # [ 0.547784] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug machine # [ 0.550616] PCI: Using E820 reservations for host bridge windows machine # [ 0.554215] ACPI: Enabled 2 GPEs in block 00 to 3F machine # [ 0.566031] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) machine # [ 0.567628] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] machine # [ 0.570771] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] machine # [ 0.572876] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] machine # [ 0.576522] PCI host bridge to bus 0000:00 machine # [ 0.577621] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] machine # [ 0.579616] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] machine # [ 0.581611] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] machine # [ 0.582610] pci_bus 0000:00: root bus resource [mem 0x80000000-0xafffffff window] machine # [ 0.583611] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] machine # [ 0.585611] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.586611] pci_bus 0000:00: root bus resource [bus 00-ff] machine # [ 0.587658] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint machine # [ 0.590122] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint machine # [ 0.601717] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] machine # [ 0.603650] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] machine # [ 0.604666] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] machine # [ 0.605811] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] machine # [ 0.607840] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.618692] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] machine # [ 0.620633] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] machine # [ 0.623672] pci 0000:00:02.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref] machine # [ 0.626633] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] machine # [ 0.632265] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.639654] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] machine # [ 0.641632] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] machine # [ 0.644669] pci 0000:00:03.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref] machine # [ 0.649386] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint machine # [ 0.658819] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] machine # [ 0.660627] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] machine # [ 0.662657] pci 0000:00:04.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref] machine # [ 0.666726] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.673672] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] machine # [ 0.674628] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] machine # [ 0.675627] pci 0000:00:05.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref] machine # [ 0.676618] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] machine # [ 0.678529] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint machine # [ 0.682623] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] machine # [ 0.683633] pci 0000:00:06.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref] machine # [ 0.686171] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.688659] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] machine # [ 0.689626] pci 0000:00:07.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref] machine # [ 0.692160] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.695657] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] machine # [ 0.707371] pci 0000:00:08.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref] machine # [ 0.710117] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.712655] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] machine # [ 0.713632] pci 0000:00:09.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref] machine # [ 0.716161] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint machine # [ 0.719672] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] machine # [ 0.720565] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] machine # [ 0.721387] pci 0000:00:0a.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref] machine # [ 0.723200] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.728504] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] machine # [ 0.729298] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] machine # [ 0.729632] pci 0000:00:0b.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref] machine # [ 0.732242] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.734359] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] machine # [ 0.734824] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.737517] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] machine # [ 0.739492] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.741481] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] machine # [ 0.742899] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint machine # [ 0.745652] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] machine # [ 0.746851] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint machine # [ 0.749591] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO machine # [ 0.750893] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint machine # [ 0.754672] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] machine # [ 0.755602] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] machine # [ 0.756769] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint machine # [ 0.760135] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] machine # [ 0.764463] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 machine # [ 0.765532] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 machine # [ 0.766546] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 machine # [ 0.767531] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 machine # [ 0.768569] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 machine # [ 0.770565] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 machine # [ 0.771612] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 machine # [ 0.772782] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 machine # [ 0.773649] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 machine # [ 0.775624] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 machine # [ 0.776628] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 machine # [ 0.777626] ACPI: PCI: Interrupt link GSID configured for IRQ 19 machine # [ 0.778623] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 machine # [ 0.779625] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 machine # [ 0.780623] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 machine # [ 0.781622] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 machine # [ 0.784007] iommu: Default domain type: Translated machine # [ 0.784613] iommu: DMA domain TLB invalidation policy: lazy mode machine # [ 0.786898] ACPI: bus type USB registered machine # [ 0.787692] usbcore: registered new interface driver usbfs machine # [ 0.788624] usbcore: registered new interface driver hub machine # [ 0.789572] usbcore: registered new device driver usb machine # [ 0.791511] NetLabel: Initializing machine # [ 0.792070] NetLabel: domain hash size = 128 machine # [ 0.792610] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO machine # [ 0.793635] NetLabel: unlabeled traffic allowed by default machine # [ 0.794621] PCI: Using ACPI for IRQ routing machine # [ 0.839068] pci 0000:00:01.0: vgaarb: setting as boot VGA device machine # [ 0.839606] pci 0000:00:01.0: vgaarb: bridge control possible machine # [ 0.839606] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none machine # [ 0.842615] vgaarb: loaded machine # [ 0.843444] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 machine # [ 0.844283] hpet0: 3 comparators, 64-bit 100.000000 MHz counter machine # [ 0.848764] clocksource: Switched to clocksource kvm-clock machine # [ 0.852687] VFS: Disk quotas dquot_6.6.0 machine # [ 0.853478] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) machine # [ 0.855074] pnp: PnP ACPI init machine # [ 0.855908] ACPI: IRQ 4 override to edge(!), high(!) machine # [ 0.856896] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved machine # [ 0.858530] pnp: PnP ACPI: found 5 devices machine # [ 0.868871] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns machine # [ 0.870514] clocksource: Switched to clocksource acpi_pm machine # [ 0.871611] NET: Registered PF_INET protocol family machine # [ 0.873177] IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear) machine # [ 0.889987] tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.891584] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) machine # [ 0.893066] TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear) machine # [ 0.895658] TCP bind hash table entries: 32768 (order: 8, 1048576 bytes, linear) machine # [ 0.897038] TCP: Hash tables configured (established 32768 bind 32768) machine # [ 0.898270] MPTCP token hash table entries: 4096 (order: 5, 98304 bytes, linear) machine # [ 0.899635] UDP hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.900844] UDP-Lite hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.902268] NET: Registered PF_UNIX/PF_LOCAL protocol family machine # [ 0.903288] NET: Registered PF_XDP protocol family machine # [ 0.904178] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] machine # [ 0.905243] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] machine # [ 0.906305] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] machine # [ 0.907475] pci_bus 0000:00: resource 7 [mem 0x80000000-0xafffffff window] machine # [ 0.908627] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] machine # [ 0.909781] pci_bus 0000:00: resource 9 [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.911705] ACPI: \_SB_.GSIA: Enabled at IRQ 16 machine # [ 0.913910] ACPI: \_SB_.GSIB: Enabled at IRQ 17 machine # [ 0.916014] ACPI: \_SB_.GSIC: Enabled at IRQ 18 machine # [ 0.918091] ACPI: \_SB_.GSID: Enabled at IRQ 19 machine # [ 0.919873] PCI: CLS 0 bytes, default 64 machine # [ 0.920734] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) machine # [ 0.921521] Trying to unpack rootfs image as initramfs... machine # [ 0.921865] software IO TLB: mapped [mem 0x000000007a364000-0x000000007e364000] (64MB) machine # [ 0.921999] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.945464] Initialise system trusted keyrings machine # [ 0.946874] workingset: timestamp_bits=40 max_order=20 bucket_order=0 machine # [ 0.958082] Key type asymmetric registered machine # [ 0.958850] Asymmetric key parser 'x509' registered machine # [ 0.959743] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) machine # [ 0.961531] io scheduler mq-deadline registered machine # [ 0.962407] io scheduler kyber registered machine # [ 0.969393] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled machine # [ 0.970864] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A machine # [ 0.973518] Linux agpgart interface v0.103 machine # [ 0.974384] ACPI: bus type drm_connector registered machine # [ 0.977235] usbcore: registered new interface driver usbserial_generic machine # [ 0.978405] usbserial: USB Serial support registered for generic machine # [ 0.979529] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. machine # [ 0.979529] Please enable it if your BIOS has the CPPC option. machine # [ 0.981981] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled machine # [ 0.983508] drop_monitor: Initializing network drop monitor service machine # [ 0.984841] NET: Registered PF_INET6 protocol family machine # [ 0.986721] Segment Routing with IPv6 machine # [ 0.987419] In-situ OAM (IOAM) with IPv6 machine # [ 0.990114] IPI shorthand broadcast: enabled machine # [ 0.994594] sched_clock: Marking stable (848011518, 145792741)->(1007398073, -13593814) machine # [ 0.996544] registered taskstats version 1 machine # [ 0.997652] Loading compiled-in X.509 certificates machine # [ 1.007773] Demotion targets for Node 0: null machine # [ 1.008905] Key type .fscrypt registered machine # [ 1.009606] Key type fscrypt-provisioning registered machine # [ 1.010648] ima: No TPM chip found, activating TPM-bypass! machine # [ 1.011639] ima: Allocated hash algorithm: sha1 machine # [ 1.012493] ima: No architecture policies found machine # [ 1.013672] PM: Magic number: 10:598:524 machine # [ 1.015399] RAS: Correctable Errors collector initialized. machine # [ 1.019954] clk: Disabling unused clocks machine # [ 1.020654] PM: genpd: Disabling unused power domains machine # [ 1.200020] Freeing initrd memory: 29104K machine # [ 1.203999] Freeing unused decrypted memory: 2028K machine # [ 1.207014] Freeing unused kernel image (initmem) memory: 3656K machine # [ 1.208182] Write protecting the kernel read-only data: 32768k machine # [ 1.210459] Freeing unused kernel image (text/rodata gap) memory: 1172K machine # [ 1.212191] Freeing unused kernel image (rodata/data gap) memory: 684K machine # [ 1.273897] x86/mm: Checked W+X mappings: passed, no W+X pages found. machine # [ 1.275106] Run /init as init process machine # [ 1.289286] systemd[1]: Inserted module 'autofs4' machine # [ 1.315722] fuse: init (API version 7.45) machine # [ 1.324863] ACPI: \_SB_.GSIG: Enabled at IRQ 22 machine # [ 1.327208] ACPI: \_SB_.GSIH: Enabled at IRQ 23 machine # [ 1.330551] ACPI: \_SB_.GSIE: Enabled at IRQ 20 machine # [ 1.332758] ACPI: \_SB_.GSIF: Enabled at IRQ 21 machine # [ 1.337882] virtiofs virtio5: discovered new tag: nix-store machine # [ 1.339448] virtiofs virtio5: virtio_fs_setup_dax: No cache capability machine # [ 1.346372] virtiofs virtio6: discovered new tag: shared machine # [ 1.360148] virtiofs virtio6: virtio_fs_setup_dax: No cache capability machine # [ 1.364475] virtiofs virtio7: discovered new tag: xchg machine # [ 1.366073] virtiofs virtio7: virtio_fs_setup_dax: No cache capability machine # [ 1.391394] systemd[1]: Successfully made /usr/ read-only. machine # [ 1.727962] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 1.741952] systemd[1]: Detected virtualization kvm. machine # [ 1.744573] systemd[1]: Detected architecture x86-64. machine # [ 1.747087] systemd[1]: Running in initrd. machine # [ 1.749937] systemd[1]: Initializing machine ID from random generator. machine # [ 1.753279] systemd[1]: Hostname set to . machine # [ 1.873377] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 1.917986] systemd[1]: Queued start job for default target Initrd Default Target. machine # [ 1.937447] systemd[1]: Created slice Slice /system/modprobe. machine # [ 1.938757] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 1.940273] systemd[1]: Expecting device /dev/disk/by-label/nixos... machine # [ 1.941453] systemd[1]: Reached target Path Units. machine # [ 1.942402] systemd[1]: Reached target Slice Units. machine # [ 1.943320] systemd[1]: Reached target Swaps. machine # [ 1.944201] systemd[1]: Reached target Timer Units. machine # [ 1.945261] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 1.946524] systemd[1]: Listening on Journal Socket (/dev/log). machine # [ 1.947727] systemd[1]: Listening on Journal Sockets. machine # [ 1.948732] systemd[1]: Listening on udev Control Socket. machine # [ 1.949777] systemd[1]: Listening on udev Kernel Socket. machine # [ 1.950750] systemd[1]: Reached target Socket Units. machine # [ 1.952888] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 1.955242] systemd[1]: Starting Load Kernel Module configfs... machine # [ 1.958424] systemd[1]: Starting Journal Service... machine # [ 1.962879] systemd[1]: Starting Load Kernel Modules... machine # [ 1.963890] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 1.971015] systemd[1]: Starting Coldplug All udev Devices... machine # [ 1.987603] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 1.994069] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 1.997772] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. machine # [ 2.004443] systemd[1]: Finished Load Kernel Module configfs. machine # [ 2.005059] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev machine # [ 2.005564] systemd-journald[92]: Collecting audit messages is disabled. machine # [ 2.008268] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config machine # [ 2.016695] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 2.021469] systemd[1]: Finished Load Kernel Modules. machine # [ 2.025044] systemd[1]: Starting Apply Kernel Variables... machine # [ 2.034962] systemd[1]: Finished Apply Kernel Variables. machine # [ 2.037521] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 2.040177] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 2.045193] systemd[1]: Started Journal Service. machine # [ 1.899352] systemd-modules-load[93]: Using 4 probe threads machine # [ 1.902454] systemd-modules-load[93]: Inserted module 'virtio_balloon' machine # [ 1.903677] systemd-modules-load[93]: Inserted module 'virtio_gpu' machine # [ 1.904758] systemd-modules-load[93]: Inserted module 'dm_mod' machine # [ 1.909215] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 1.910310] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 1.911357] systemd[1]: Reached target Local File Systems. machine # [ 1.912227] systemd[1]: Starting Create System Files and Directories... machine # [ 1.913186] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 1.925858] systemd[1]: Finished Create System Files and Directories. machine # [ 1.935534] systemd-udevd[112]: Using default interface naming scheme 'v261'. machine # [ 1.945833] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 1.958095] systemd[1]: Finished Coldplug All udev Devices. machine # [ 1.959535] systemd[1]: Reached target System Initialization. machine # [ 1.960400] systemd[1]: Reached target Basic System. machine # [ 2.191555] virtio_blk virtio2: 4/0/0 default/read/poll queues machine # [ 2.210182] virtio_blk virtio2: [vda] 33554432 512-byte logical blocks (17.2 GB/16.0 GiB) machine # [ 2.214922] SCSI subsystem initialized machine # [ 2.220193] uhci_hcd 0000:00:1d.0: UHCI Host Controller machine # [ 2.221074] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 1 machine # [ 2.222856] uhci_hcd 0000:00:1d.0: detected 2 ports machine # [ 2.223778] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 machine # [ 2.224967] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.226929] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.228809] usb usb1: Product: UHCI Host Controller machine # [ 2.229558] usb usb1: Manufacturer: Linux 6.18.53 uhci_hcd machine # [ 2.232349] usb usb1: SerialNumber: 0000:00:1d.0 machine # [ 2.262913] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 machine # [ 2.263983] hub 1-0:1.0: USB hub found machine # [ 2.264813] hub 1-0:1.0: 2 ports detected machine # [ 2.275086] serio: i8042 KBD port at 0x60,0x64 irq 1 machine # [ 2.275917] serio: i8042 AUX port at 0x60,0x64 irq 12 machine # [ 2.132883] systemd[1]: Starting Virtual Console Setup... machine # [ 2.139667] (udev-worker)[137]: Network interface NamePolicy= disabled on kernel command line. machine # [ 2.286728] ehci-pci 0000:00:1d.7: EHCI Host Controller machine # [ 2.287629] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 2 machine # [ 2.289123] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 machine # [ 2.144563] (udev-worker)[134]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 2.147164] (udev-worker)[134]: Network interface NamePolicy= disabled on kernel command line. machine # [ 2.300843] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 machine # [ 2.301757] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 machine # [ 2.303381] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.304561] usb usb2: Product: EHCI Host Controller machine # [ 2.305425] usb usb2: Manufacturer: Linux 6.18.53 ehci_hcd machine # [ 2.160181] systemd-vconsole-setup[143]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 2.305427] usb usb2: SerialNumber: 0000:00:1d.7 machine # [ 2.305636] hub 2-0:1.0: USB hub found machine # [ 2.309125] hub 2-0:1.0: 6 ports detected machine # [ 2.163655] systemd[1]: Finished Virtual Console Setup. machine # [ 2.330970] hub 1-0:1.0: USB hub found machine # [ 2.331608] hub 1-0:1.0: 2 ports detected machine # [ 2.332492] uhci_hcd 0000:00:1d.1: UHCI Host Controller machine # [ 2.334009] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 machine # [ 2.335215] uhci_hcd 0000:00:1d.1: detected 2 ports machine # [ 2.337100] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 machine # [ 2.339141] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.340588] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.342070] usb usb3: Product: UHCI Host Controller machine # [ 2.342847] usb usb3: Manufacturer: Linux 6.18.53 uhci_hcd machine # [ 2.343909] usb usb3: SerialNumber: 0000:00:1d.1 machine # [ 2.345528] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 machine # [ 2.346255] hub 3-0:1.0: USB hub found machine # [ 2.347609] hub 3-0:1.0: 2 ports detected machine # [ 2.207481] systemd[1]: Found device /dev/disk/by-label/nixos. machine # [ 2.352328] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode machine # [ 2.208733] systemd[1]: Reached target Initrd Root Device. machine # [ 2.210700] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... machine # [ 2.353232] uhci_hcd 0000:00:1d.2: UHCI Host Controller machine # [ 2.354412] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) machine # [ 2.355307] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 machine # [ 2.355508] uhci_hcd 0000:00:1d.2: detected 2 ports machine # [ 2.356374] ahci 0000:00:1f.2: flags: 64bit ncq only machine # [ 2.357407] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 machine # [ 2.357708] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.360845] scsi host0: ahci machine # [ 2.361157] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.361869] scsi host1: ahci machine # [ 2.362212] usb usb4: Product: UHCI Host Controller machine # [ 2.364007] scsi host2: ahci machine # [ 2.364779] usb usb4: Manufacturer: Linux 6.18.53 uhci_hcd machine # [ 2.365665] scsi host3: ahci machine # [ 2.366290] usb usb4: SerialNumber: 0000:00:1d.2 machine # [ 2.366520] hub 4-0:1.0: USB hub found machine # [ 2.369897] hub 4-0:1.0: 2 ports detected machine # [ 2.370026] scsi host4: ahci machine # [ 2.371876] scsi host5: ahci machine # [ 2.372476] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 50 lpm-pol 1 machine # [ 2.373940] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 50 lpm-pol 1 machine # [ 2.373947] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 50 lpm-pol 1 machine # [ 2.373952] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 50 lpm-pol 1 machine # [ 2.373957] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 50 lpm-pol 1 machine # [ 2.373963] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 50 lpm-pol 1 machine # [ 2.244733] systemd-fsck[172]: nixos: clean, 12/1048576 files, 109865/4194304 blocks machine # [ 2.248805] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. machine # [ 2.548988] usb 2-1: new high-speed USB device number 2 using ehci-pci machine # [ 2.680420] usb 2-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 machine # [ 2.683596] usb 2-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 machine # [ 2.686403] usb 2-1: Product: QEMU USB Tablet machine # [ 2.688202] usb 2-1: Manufacturer: QEMU machine # [ 2.689726] usb 2-1: SerialNumber: 28754-0000:00:1d.7-1 machine # [ 2.692381] ata5: SATA link down (SStatus 0 SControl 300) machine # [ 2.694997] ata1: SATA link down (SStatus 0 SControl 300) machine # [ 2.697555] ata2: SATA link down (SStatus 0 SControl 300) machine # [ 2.699986] ata4: SATA link down (SStatus 0 SControl 300) machine # [ 2.702459] ata6: SATA link down (SStatus 0 SControl 300) machine # [ 2.704756] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) machine # [ 2.707350] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 machine # [ 2.709755] ata3.00: applying bridge limits machine # [ 2.711657] ata3.00: configured for UDMA/100 machine # [ 2.714191] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 machine # [ 2.727339] hid: raw HID events driver (C) Jiri Kosina machine # [ 2.753290] usbcore: registered new interface driver usbhid machine # [ 2.755568] usbhid: USB HID core driver machine # [ 2.766203] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb2/2-1/2-1:1.0/0003:0627:0001.0001/input/input2 machine # [ 2.770349] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 machine # [ 2.785347] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray machine # [ 2.817270] cdrom: Uniform CD-ROM driver Revision: 3.20 machine # [ 2.837602] systemd[1]: Mounting /sysroot... machine # [ 3.125019] EXT4-fs (vda): mounted filesystem 2312905f-eea0-4f35-9ebd-c5c61ec3ddc0 r/w with ordered data mode. Quota mode: none. machine # [ 2.985611] systemd[1]: Mounted /sysroot. machine # [ 2.987505] systemd[1]: Reached target Initrd Root File System. machine # [ 2.989897] systemd[1]: Mounting /sysroot/nix/.ro-store... machine # [ 2.991962] systemd[1]: Mounting /sysroot/nix/.rw-store... machine # [ 2.993940] systemd[1]: Mounting /sysroot/run... machine # [ 2.998188] systemd[1]: Mounting /sysroot/tmp/shared... machine # [ 3.008066] systemd[1]: Mounting /sysroot/tmp/xchg... machine # [ 3.013145] systemd[1]: Starting Mountpoints Configured in the Real Root... machine # [ 3.023565] systemd[1]: Mounted /sysroot/nix/.ro-store. machine # [ 3.025552] systemd[1]: Mounted /sysroot/nix/.rw-store. machine # [ 3.026811] systemd[1]: Mounted /sysroot/run. machine # [ 3.027925] systemd[1]: Mounted /sysroot/tmp/shared. machine # [ 3.032277] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.035367] systemd-sysroot-fstab-check[191]: /sysroot should be mounted in the initrd, will request daemon-reload. machine # [ 3.039793] systemd[1]: Mounted /sysroot/tmp/xchg. machine # [ 3.041487] systemd[1]: Reload requested from client PID 191 ('systemd-sysroot') (unit initrd-parse-etc.service)... machine # [ 3.044222] systemd[1]: Reloading... machine # [ 3.101924] systemd[1]: Reloading finished in 59 ms. machine # [ 3.125503] systemd-sysroot-fstab-check[191]: Requesting initrd-fs.target/start/replace... machine # [ 3.128384] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.130877] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.132899] systemd-sysroot-fstab-check[191]: Requesting swap.target/start/replace... machine # [ 3.135460] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.138861] systemd[1]: initrd-parse-etc.service: Deactivated successfully. machine # [ 3.143211] systemd[1]: Finished Mountpoints Configured in the Real Root. machine # [ 3.145728] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. machine # [ 3.148897] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.151537] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.838458] systemd[1]: Mounting /sysroot/nix/store... machine # [ 3.881459] systemd[1]: Mounted /sysroot/nix/store. machine # [ 3.883730] systemd[1]: Reached target Initrd File Systems. machine # [ 3.885801] systemd[1]: Starting Find NixOS closure... machine # [ 3.887989] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... machine # [ 3.914809] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. machine # [ 3.917648] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. machine # [ 3.936095] systemd[1]: Finished Find NixOS closure. machine # [ 3.937853] systemd[1]: Reached target Initrd Default Target. machine # [ 3.939830] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... machine # [ 3.979674] systemd[1]: Stopped target Initrd Default Target. machine # [ 3.981725] systemd[1]: Stopped target Basic System. machine # [ 3.983501] systemd[1]: Stopped target Initrd Root Device. machine # [ 3.985802] systemd[1]: Stopped target Path Units. machine # [ 3.987447] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. machine # [ 3.989870] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. machine # [ 3.992413] systemd[1]: Stopped target Slice Units. machine # [ 3.995371] systemd[1]: Stopped target Socket Units. machine # [ 3.998076] systemd[1]: Stopped target System Initialization. machine # [ 4.000979] systemd[1]: Stopped target Swaps. machine # [ 4.003240] systemd[1]: Stopped target Timer Units. machine # [ 4.005747] systemd[1]: dbus.socket: Deactivated successfully. machine # [ 4.008675] systemd[1]: Closed D-Bus System Message Bus Socket. machine # [ 4.011432] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. machine # [ 4.013882] systemd[1]: Stopped Find NixOS closure. machine # [ 4.015434] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 4.017330] systemd[1]: systemd-sysctl.service: Deactivated successfully. machine # [ 4.019415] systemd[1]: Stopped Apply Kernel Variables. machine # [ 4.021129] systemd[1]: systemd-modules-load.service: Deactivated successfully. machine # [ 4.023430] systemd[1]: Stopped Load Kernel Modules. machine # [ 4.024844] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. machine # [ 4.026920] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. machine # [ 4.028976] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. machine # [ 4.030911] systemd[1]: Stopped Create System Files and Directories. machine # [ 4.032561] systemd[1]: Stopped target Local File Systems. machine # [ 4.034071] systemd[1]: Stopped target Preparation for Local File Systems. machine # [ 4.035922] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. machine # [ 4.037854] systemd[1]: Stopped Coldplug All udev Devices. machine # [ 4.039396] systemd[1]: Stopping Rule-based Manager for Device Events and Files... machine # [ 4.041355] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 4.042799] systemd[1]: Stopped Virtual Console Setup. machine # [ 4.043702] systemd[1]: initrd-cleanup.service: Deactivated successfully. machine # [ 4.044658] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. machine # [ 4.045570] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 4.046613] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 4.047481] systemd[1]: systemd-udevd.service: Deactivated successfully. machine # [ 4.048410] systemd[1]: Stopped Rule-based Manager for Device Events and Files. machine # [ 4.049420] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. machine # [ 4.050450] systemd[1]: Closed udev Control Socket. machine # [ 4.051212] systemd[1]: Starting Cleanup udev Database... machine # [ 4.051982] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. machine # [ 4.053071] systemd[1]: Stopped Create Static Device Nodes in /dev. machine # [ 4.053945] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. machine # [ 4.055045] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. machine # [ 4.056041] systemd[1]: kmod-static-nodes.service: Deactivated successfully. machine # [ 4.056998] systemd[1]: Stopped Create List of Static Device Nodes. machine # [ 4.061101] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. machine # [ 4.062173] systemd[1]: Finished Cleanup udev Database. machine # [ 4.063328] systemd[1]: Reached target Switch Root. machine # [ 4.065357] systemd[1]: Starting NixOS Activation... machine # [ 4.218992] initrd-nixos-activation-start[237]: booting system configuration /nix/store/wkk9pmimqrawmwh7m0zhpbn4qdkch5j0-nixos-system-machine-test machine # [ 4.276162] initrd-nixos-activation-start[237]: running activation script... machine # [ 4.585129] initrd-nixos-activation-start[260]: setting up /etc... machine # [ 4.752201] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. machine # [ 4.755205] systemd[1]: Finished NixOS Activation. machine # [ 4.758923] systemd[1]: Starting Switch Root... machine # [ 4.779825] systemd[1]: Switching root. machine # [ 4.984554] systemd-journald[92]: Received SIGTERM from PID 1 (systemd). machine # [ 5.092878] NET: Registered PF_VSOCK protocol family machine # [ 5.480961] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 5.519556] systemd[1]: Detected virtualization kvm. machine # [ 5.521443] systemd[1]: Detected architecture x86-64. machine # [ 5.523433] systemd[1]: Detected first boot. machine # [ 5.528261] systemd[1]: Initializing machine ID from random generator. machine # [ 5.682896] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 5.773635] systemd[1]: Applying preset policy. machine # [ 6.002087] systemd[1]: Populated /etc with preset unit settings. machine # [ 6.260687] systemd[1]: initrd-switch-root.service: Deactivated successfully. machine # [ 6.262130] systemd[1]: Stopped initrd-switch-root.service. machine # [ 6.264672] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. machine # [ 6.267283] systemd[1]: Created slice Slice /system/getty. machine # [ 6.268731] systemd[1]: Created slice User and Session Slice. machine # [ 6.269802] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 6.271121] systemd[1]: Started Forward Password Requests to Wall Directory Watch. machine # [ 6.272290] systemd[1]: Expecting device /dev/hvc0... machine # [ 6.273058] systemd[1]: Expecting device /dev/ttyS0... machine # [ 6.273910] systemd[1]: Reached target Local Encrypted Volumes. machine # [ 6.274916] systemd[1]: Stopped target initrd-fs.target. machine # [ 6.275665] systemd[1]: Stopped target initrd-root-fs.target. machine # [ 6.276567] systemd[1]: Stopped target initrd-switch-root.target. machine # [ 6.277494] systemd[1]: Reached target Virtual Machines and Containers. machine # [ 6.278578] systemd[1]: Reached target Path Units. machine # [ 6.279408] systemd[1]: Reached target Remote File Systems. machine # [ 6.280317] systemd[1]: Reached target Slice Units. machine # [ 6.281159] systemd[1]: Reached target Swaps. machine # [ 6.283506] systemd[1]: Listening on Query the User Interactively for a Password. machine # [ 6.286410] systemd[1]: Listening on Process Core Dump Socket. machine # [ 6.288596] systemd[1]: Listening on Credential Encryption/Decryption. machine # [ 6.290868] systemd[1]: Listening on Factory Reset Management. machine # [ 6.291964] systemd[1]: Listening on Hostname Service Socket. machine # [ 6.295409] systemd[1]: Starting Journal Log Access Socket... machine # [ 6.296933] systemd[1]: Listening on Journal Audit Socket. machine # [ 6.299331] systemd[1]: Listening on Console Output Muting Service Socket. machine # [ 6.300598] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. machine # [ 6.301741] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.303227] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki machine # [ 6.308559] systemd[1]: Listening on Disk Repartitioning Service Socket. machine # [ 6.309656] systemd[1]: Listening on udev Control Socket. machine # [ 6.310564] systemd[1]: Listening on udev Varlink Socket. machine # [ 6.313430] systemd[1]: Mounting Huge Pages File System... machine # [ 6.315818] systemd[1]: Mounting POSIX Message Queue File System... machine # [ 6.318495] systemd[1]: Mounting Kernel Debug File System... machine # [ 6.331325] systemd[1]: Mounting Kernel Trace File System... machine # [ 6.336933] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 6.341319] systemd[1]: Starting Load Kernel Module configfs... machine # [ 6.343191] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm machine # [ 6.346196] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.349523] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.353954] systemd[1]: Mounting FUSE Control File System... machine # [ 6.356302] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.371193] systemd[1]: Starting Journal Service... machine # [ 6.377985] systemd[1]: Starting Load Kernel Modules... machine # [ 6.387072] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... machine # [ 6.392662] systemd[1]: Starting Remount Root and Kernel File Systems... machine # [ 6.395267] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.401660] systemd[1]: Starting Coldplug All udev Devices... machine # [ 6.406904] systemd[1]: Listening on Journal Log Access Socket. machine # [ 6.408919] systemd[1]: Mounted Huge Pages File System. machine # [ 6.410883] systemd[1]: Mounted POSIX Message Queue File System. machine # [ 6.413010] systemd[1]: Mounted Kernel Debug File System. machine # [ 6.414995] systemd[1]: Mounted Kernel Trace File System. machine # [ 6.417754] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 6.420471] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 6.422128] systemd[1]: Finished Load Kernel Module configfs. machine # [ 6.423524] systemd[1]: Mounted FUSE Control File System. machine # [ 6.426706] systemd[1]: Mounting Kernel Configuration File System... machine # [ 6.428718] systemd-journald[330]: Collecting audit messages is enabled. machine # [ 6.429065] loop: module loaded machine # [ 6.431663] EXT4-fs (vda): re-mounted 2312905f-eea0-4f35-9ebd-c5c61ec3ddc0. machine # [ 6.432960] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 6.440449] systemd[1]: Finished Load Kernel Modules. machine # [ 6.441999] systemd[1]: Finished Remount Root and Kernel File Systems. machine # [ 6.443309] systemd[1]: Listening on Disk Image Download Service Socket. machine # [ 6.298406] systemd[1]: Queued start job for default target Multi-User System. machine # [ 6.299861] systemd[1]: systemd-journald.service: Deactivated successfully. machine # [ 6.445363] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.301179] systemd-modules-load[331]: Using 2 probe threads machine # [ 6.303244] systemd-modules-load[331]: Inserted module 'loop' machine # [ 6.316561] systemd-oomd[332]: No swap; memory pressure usage will be degraded machine # [ 6.462754] systemd[1]: Starting Load/Save OS Random Seed... machine # [ 6.466323] systemd[1]: Starting Apply Kernel Variables... machine # [ 6.467248] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.469481] systemd[1]: Started Journal Service. machine # [ 6.328166] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. machine # [ 6.331236] systemd[1]: Mounted Kernel Configuration File System. machine # [ 6.335984] systemd[1]: Starting Flush Journal to Persistent Storage... machine # [ 6.350075] systemd[1]: Finished Load/Save OS Random Seed. machine # [ 6.351195] systemd[1]: Reached target First Boot Complete. machine # [ 6.354461] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 6.357728] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 6.504883] systemd-journald[330]: Received client request to flush runtime journal. machine # [ 6.413110] systemd[1]: Finished Apply Kernel Variables. machine # [ 6.414098] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 6.415186] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 6.416413] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 6.417564] systemd[1]: Finished Flush Journal to Persistent Storage. machine # [ 6.427774] systemd-udevd[359]: Using default interface naming scheme 'v261'. machine # [ 6.431834] systemd[1]: Finished Coldplug All udev Devices. machine # [ 6.455860] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 6.529118] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.547517] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. machine # [ 6.553733] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. machine # [ 6.560147] (udev-worker)[375]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 6.562546] (udev-worker)[375]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.570499] (udev-worker)[368]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.588837] systemd[1]: Condition check resulted in Virtio network device being skipped. machine # [ 6.590169] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.592203] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.594457] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.596101] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.597509] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.769546] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized machine # [ 6.777043] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input3 machine # [ 6.779593] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console machine # [ 6.795381] Console: switching to colour dummy device 80x25 machine # [ 6.796259] [drm] Found bochs VGA, ID 0xb0c5. machine # [ 6.796262] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. machine # [ 6.797727] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input4 machine # [ 6.818755] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic machine # [ 6.819430] mousedev: PS/2 mouse device common for all mice machine # [ 6.819620] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 machine # [ 6.825367] ACPI: button: Power Button [PWRF] machine # [ 6.834018] Console: switching to colour frame buffer device 160x50 machine # [ 6.835432] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device machine # [ 6.838255] rtc_cmos PNP0B00:00: RTC can wake from S4 machine # [ 6.848009] parport_pc 00:02: reported by Plug and Play ACPI machine # [ 6.848752] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] machine # [ 6.850425] rtc_cmos PNP0B00:00: registered as rtc0 machine # [ 6.851280] rtc_cmos PNP0B00:00: setting system clock to 2026-09-30T08:31:05 UTC (1790757065) machine # [ 6.852909] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs machine # [ 6.855336] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 machine # [ 6.857084] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 machine # [ 6.866179] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt machine # [ 6.867097] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD machine # [ 6.765490] systemd[1]: Starting Virtual Console Setup... machine # [ 6.788231] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 6.790170] systemd[1]: Stopped Virtual Console Setup. machine # [ 6.792143] systemd[1]: Starting Virtual Console Setup... machine # [ 6.800383] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 6.802254] systemd[1]: Stopped Virtual Console Setup. machine # [ 6.806894] systemd[1]: Starting Virtual Console Setup... machine # [ 6.960675] ppdev: user-space parallel port driver machine # [ 6.963402] iTCO_wdt iTCO_wdt.0.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) machine # [ 6.965691] iTCO_wdt iTCO_wdt.0.auto: initialized. heartbeat=30 sec (nowayout=0) machine # [ 6.990806] kvm_amd: TSC scaling supported machine # [ 6.991271] kvm_amd: Nested Virtualization enabled machine # [ 6.991861] kvm_amd: Nested Paging enabled machine # [ 6.992306] kvm_amd: LBR virtualization supported machine # [ 6.992925] kvm_amd: Virtual VMLOAD VMSAVE supported machine # [ 6.993455] kvm_amd: Virtual GIF supported machine # [ 6.993999] kvm_amd: Virtual NMI enabled machine # [ 7.060646] EDAC MC: Ver: 3.0.0 machine # [ 6.956751] systemd-vconsole-setup[405]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 6.959835] systemd[1]: Finished Virtual Console Setup. machine # [ 7.119348] systemd[1]: Mounting /run/wrappers... machine # [ 7.153758] systemd[1]: Mounted /run/wrappers. machine # [ 7.156772] systemd[1]: Reached target Local File Systems. machine # [ 7.161106] systemd[1]: Listening on Boot Loader Control Service Socket. machine # [ 7.166487] systemd[1]: Starting register-nix-paths.service... machine # [ 7.171455] systemd[1]: Starting Create SUID/SGID Wrappers... machine # [ 7.173685] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. machine # [ 7.183059] systemd[1]: Starting Save Transient machine-id to Disk... machine # [ 7.185944] systemd[1]: Starting Create System Files and Directories... machine # [ 7.274264] systemd[1]: Finished Create System Files and Directories. machine # [ 7.276574] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. machine # [ 7.278557] systemd[1]: Finished Save Transient machine-id to Disk. machine # [ 7.280540] systemd[1]: Starting Rebuild Journal Catalog... machine # [ 7.285388] systemd[1]: Starting Record System Boot/Shutdown in UTMP... machine # [ 7.308811] systemd[1]: Finished Record System Boot/Shutdown in UTMP. machine # [ 7.319965] systemd[1]: Finished Rebuild Journal Catalog. machine # [ 7.321568] systemd[1]: Starting Update is Completed... machine # [ 7.339385] systemd[1]: Finished Update is Completed. machine # [ 7.423378] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. machine # [ 7.424636] systemd[1]: Finished Create SUID/SGID Wrappers. machine # [ 7.609135] systemd[1]: Finished register-nix-paths.service. machine # [ 7.610136] systemd[1]: Reached target System Initialization. machine # [ 7.610944] systemd[1]: Started Discard unused filesystem blocks once a week. machine # [ 7.612024] systemd[1]: Started niks3 garbage collection timer. machine # [ 7.612899] systemd[1]: Started Daily Cleanup of Temporary Directories. machine # [ 7.613878] systemd[1]: Reached target Timer Units. machine # [ 7.614709] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 7.617594] systemd[1]: Listening on niks3 server socket. machine # [ 7.618458] systemd[1]: Listening on Nix Daemon Socket. machine # [ 7.619285] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. machine # [ 7.620489] systemd[1]: Reached target Socket Units. machine # [ 7.621288] systemd[1]: Reached target Basic System. machine # [ 7.622040] systemd[1]: Started backdoor.service. machine # [ 7.622757] systemd[1]: Starting Import lastlog data into lastlog2 database... machine # [ 7.623815] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 7.624791] systemd[1]: Starting Post-Boot Actions... machine # [ 7.626851] systemd[1]: Started Reset console on configuration changes. machine # [ 7.631641] systemd[1]: Starting resolvconf update... machine # [ 7.633339] systemd[1]: Started rustfs.service. machine # [ 7.639106] systemd[1]: Starting rustfs-bucket.service... machine # [ 7.644048] systemd[1]: Starting D-Bus System Message Bus... machine # [ 7.654659] systemd[1]: Finished Post-Boot Actions. machine # [ 7.666656] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 7.669524] nsncd[488]: Sep 30 08:31:06.459 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 7.671763] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 7.672778] systemd[1]: Reached target User and Group Name Lookups. machine # [ 7.673773] systemd[1]: Starting User Login Management... machine # connecting to host... machine: Guest shell says: b'Spawning backdoor root shell...\n' machine # [ 7.696195] systemd[1]: Finished Import lastlog data into lastlog2 database. machine: connected to guest root shell machine: (connecting took 8.30 seconds) machine: (finished: waiting for the VM to finish booting, in 8.53 seconds) machine # [ 7.710784] dbus-broker-launch[495]: Looking up NSS user entry for 'systemd-timesync'... machine # [ 7.715601] dbus-broker-launch[495]: NSS returned no entry for 'systemd-timesync' machine # [ 7.716848] dbus-broker-launch[495]: Invalid user-name in /nix/store/g7pg57y182bsrh126xs4av309lnxhndq-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" machine # [ 7.734403] systemd[1]: Started D-Bus System Message Bus. machine # [ 7.736236] systemd-logind[516]: New seat seat0. machine # [ 7.741965] systemd-logind[516]: Watching system buttons on /dev/input/event3 (Power Button) machine # [ 7.742809] systemd-logind[516]: Watching system buttons on /dev/input/event2 (QEMU Virtio Keyboard) machine # [ 7.743532] systemd-logind[516]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) machine # [ 7.748366] systemd[1]: Started User Login Management. machine # [ 7.749053] systemd[1]: Starting linger-users.service... machine # [ 7.759054] systemd[1]: Stopped target Host and Network Name Lookups. machine # [ 7.761713] systemd[1]: Stopping Host and Network Name Lookups... machine # [ 7.762522] systemd[1]: Stopped target User and Group Name Lookups. machine # [ 7.763172] systemd[1]: Stopping User and Group Name Lookups... machine # [ 7.763773] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... machine # [ 7.764325] dbus-broker-launch[495]: Ready machine # [ 7.768342] systemd[1]: nscd.service: Deactivated successfully. machine # [ 7.769101] systemd[1]: Stopped Name Service Cache Daemon (nsncd). machine # [ 7.777356] systemd[1]: linger-users.service: Deactivated successfully. machine # [ 7.778442] systemd[1]: Finished linger-users.service. machine # [ 7.780574] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 7.805441] nsncd[592]: Sep 30 08:31:06.599 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 7.806178] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 7.806812] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 7.807560] systemd[1]: Reached target User and Group Name Lookups. machine # [ 7.819436] systemd[1]: Finished resolvconf update. machine # [ 7.820425] systemd[1]: Reached target Preparation for Network. machine # [ 7.823205] systemd[1]: Starting DHCP Client... machine # [ 7.824404] systemd[1]: Starting Address configuration of eth1... machine # [ 7.826806] systemd[1]: Starting Extra networking commands.... machine # [ 7.873268] network-addresses-eth1-start[623]: adding address 192.168.1.1/24... done machine # [ 7.882146] network-addresses-eth1-start[623]: adding address 2001:db8:1::1/64... done machine # [ 7.891462] systemd[1]: Finished Address configuration of eth1. machine # [ 7.912108] dhcpcd[637]: dhcpcd-10.3.2 starting machine # [ 7.915808] dhcpcd[695]: dev: loaded udev machine # [ 7.925034] systemd[1]: Finished Extra networking commands.. machine # [ 7.925730] systemd[1]: Reached target Network. machine # [ 7.927699] systemd[1]: Starting PostgreSQL Server... machine # [ 8.074424] 8021q: 802.1Q VLAN Support v1.8 machine # [ 8.075138] 8021q: adding VLAN 0 to HW filter on device eth1 machine # [ 7.929627] systemd[1]: Starting Permit User Sessions... machine # [ 7.943197] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. machine # [ 7.963250] systemd[1]: Finished Permit User Sessions. machine # [ 7.966067] systemd[1]: Started Getty on tty1. machine # [ 7.966769] systemd[1]: Reached target Login Prompts. machine # [ 8.169301] cfg80211: Loading compiled-in X.509 certificates for regulatory database machine # [ 8.181797] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' machine # [ 8.183128] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' machine # [ 8.185167] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 machine # [ 8.186565] cfg80211: failed to load regulatory.db machine # [ 8.051633] postgresql-pre-start[710]: The files belonging to this database system will be owned by user "postgres". machine # [ 8.052242] postgresql-pre-start[710]: This user must also own the server process. machine # [ 8.055924] postgresql-pre-start[710]: The database cluster will be initialized with locale "en_US.UTF-8". machine # [ 8.057383] postgresql-pre-start[710]: The default database encoding has accordingly been set to "UTF8". machine # [ 8.058699] postgresql-pre-start[710]: The default text search configuration will be set to "english". machine # [ 8.059929] postgresql-pre-start[710]: Data page checksums are enabled. machine # [ 8.060946] postgresql-pre-start[710]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok machine # [ 8.062313] postgresql-pre-start[710]: creating subdirectories ... ok machine # [ 8.064045] postgresql-pre-start[710]: selecting dynamic shared memory implementation ... posix machine # [ 8.223922] 8021q: adding VLAN 0 to HW filter on device eth0 machine # [ 8.080520] dhcpcd[695]: eth0: waiting for carrier machine # [ 8.081616] dhcpcd[695]: eth0: carrier acquired machine # [ 8.089028] dhcpcd[695]: DUID 00:01:00:01:32:4f:85:4a:52:54:00:12:34:56 machine # [ 8.089706] dhcpcd[695]: eth0: IAID 00:12:34:56 machine # [ 8.090237] dhcpcd[695]: eth0: adding address fe80::5054:ff:fe12:3456 machine # [ 8.111592] postgresql-pre-start[710]: selecting default "max_connections" ... 100 machine # [ 8.156601] postgresql-pre-start[710]: selecting default "shared_buffers" ... 128MB machine # [ 8.741182] postgresql-pre-start[710]: selecting default time zone ... UTC machine # [ 8.743344] postgresql-pre-start[710]: creating configuration files ... ok machine # [ 8.922843] postgresql-pre-start[710]: running bootstrap script ... ok machine # [ 9.316615] postgresql-pre-start[710]: performing post-bootstrap initialization ... ok machine # [ 9.393790] dhcpcd[695]: eth0: soliciting a DHCP lease machine # [ 9.549350] NET: Registered PF_PACKET protocol family machine # [ 9.419678] dhcpcd[695]: eth0: offered 10.0.2.15 from 10.0.2.2 machine # [ 9.422228] dhcpcd[695]: eth0: probing address 10.0.2.15/24 machine # [ 9.469354] postgresql-pre-start[710]: syncing data to disk ... ok machine # [ 9.470574] postgresql-pre-start[710]: initdb: warning: enabling "trust" authentication for local connections machine # [ 9.471665] postgresql-pre-start[710]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. machine # [ 9.472818] postgresql-pre-start[710]: Success. You can now start the database server using: machine # [ 9.473962] postgresql-pre-start[710]: pg_ctl -D /var/lib/postgresql/18 -l logfile start machine # [ 9.586095] postgres[745]: [745] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit machine # [ 9.591985] postgres[745]: [745] LOG: listening on IPv6 address "::1", port 5432 machine # [ 9.593601] postgres[745]: [745] LOG: listening on IPv4 address "127.0.0.1", port 5432 machine # [ 9.600499] postgres[745]: [745] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" machine # [ 9.612250] postgres[754]: [754] LOG: database system was shut down at 2026-09-30 08:31:08 GMT machine # [ 9.619917] postgres[745]: [745] LOG: database system is ready to accept connections machine # [ 9.625653] systemd[1]: Started PostgreSQL Server. machine # [ 9.628236] systemd[1]: Starting PostgreSQL Setup Scripts... machine # [ 9.853207] postgresql-setup-start[765]: CREATE DATABASE machine # [ 9.900535] postgresql-setup-start[774]: CREATE ROLE machine # [ 9.923219] postgresql-setup-start[776]: ALTER DATABASE machine # [ 9.929223] systemd[1]: Finished PostgreSQL Setup Scripts. machine # [ 9.930203] systemd[1]: Reached target PostgreSQL. machine # [ 10.495521] dhcpcd[695]: eth0: soliciting an IPv6 router machine # [ 10.496787] dhcpcd[695]: eth0: Router Advertisement from fe80::2 machine # [ 10.497984] dhcpcd[695]: eth0: adding address fec0::5054:ff:fe12:3456/64 machine # [ 10.499095] dhcpcd[695]: eth0: adding route to fec0::/64 machine # [ 10.500244] dhcpcd[695]: eth0: adding default route via fe80::2 machine # [ 14.179866] dhcpcd[695]: eth0: leased 10.0.2.15 for 86400 seconds machine # [ 14.181647] dhcpcd[695]: eth0: adding route to 10.0.2.0/24 machine # [ 14.183649] dhcpcd[695]: eth0: adding default route via 10.0.2.2 machine # [ 14.318422] systemd[1]: Started DHCP Client. machine # [ 14.320248] systemd[1]: Reached target Network is Online. machine # [ 14.325612] systemd[1]: Starting k3s service... machine # [ 14.414075] k3s[881]: time="2026-09-30T08:31:13Z" level=info msg="Acquiring lock file /var/lib/rancher/k3s/data/.lock" machine # [ 14.416273] k3s[881]: time="2026-09-30T08:31:13Z" level=info msg="Preparing data dir /var/lib/rancher/k3s/data/53c81a1072dac7aebc0a3715f02f26b7ba95e9416f42c7f7aeed55ccb68af709" machine # [ 16.395313] rustfs-bucket-start[896]: mb s3://farm machine # [ 16.401244] systemd[1]: Finished rustfs-bucket.service. machine # [ 16.868051] k3s[881]: time="2026-09-30T08:31:15Z" level=info msg="Starting k3s 1.36.4+k3s1 (4dedb15b)" machine # [ 16.878535] k3s[881]: time="2026-09-30T08:31:15Z" level=info msg="Configuring sqlite3 database connection pooling: maxIdle=20, maxOpen=0, maxLifetime=0s, maxIdleTime=2m0s" machine # [ 16.880801] k3s[881]: time="2026-09-30T08:31:15Z" level=info msg="Kine built with sqlite from github.com/mattn/go-sqlite3 version 3.53.3" machine # [ 16.881666] k3s[881]: time="2026-09-30T08:31:15Z" level=info msg="Configuring database table schema and indexes, this may take a moment..." machine # [ 16.897725] k3s[881]: time="2026-09-30T08:31:15Z" level=info msg="Database tables and indexes are up to date" machine # [ 16.898282] k3s[881]: time="2026-09-30T08:31:15Z" level=info msg="Running startup VACUUM to reclaim disk space, this may take a moment..." machine # [ 16.902924] k3s[881]: time="2026-09-30T08:31:15Z" level=info msg="Startup VACUUM completed successfully" machine # [ 16.905728] k3s[881]: time="2026-09-30T08:31:15Z" level=info msg="Kine available at unix://kine.sock" machine # [ 16.907266] k3s[881]: time="2026-09-30T08:31:15Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 16.912696] k3s[881]: time="2026-09-30T08:31:15Z" level=info msg="Datastore connection validated successfully, proceeding with bootstrap data generation" machine # [ 16.913438] k3s[881]: time="2026-09-30T08:31:15Z" level=info msg="generated self-signed CA certificate CN=k3s-client-ca@1790757075: notBefore=2026-09-30 07:31:15.707696787 +0000 UTC notAfter=2036-09-27 07:31:15.707696787 +0000 UTC" machine # [ 16.914122] k3s[881]: time="2026-09-30T08:31:15Z" level=info msg="certificate CN=system:admin,O=system:masters signed by CN=k3s-client-ca@1790757075: notBefore=2026-09-30 07:31:15 +0000 UTC notAfter=2027-09-30 07:31:15 +0000 UTC" machine # [ 16.914775] k3s[881]: time="2026-09-30T08:31:15Z" level=info msg="certificate CN=system:k3s-supervisor,O=system:masters signed by CN=k3s-client-ca@1790757075: notBefore=2026-09-30 07:31:15 +0000 UTC notAfter=2027-09-30 07:31:15 +0000 UTC" machine # [ 16.915298] k3s[881]: time="2026-09-30T08:31:15Z" level=info msg="certificate CN=system:kube-controller-manager signed by CN=k3s-client-ca@1790757075: notBefore=2026-09-30 07:31:15 +0000 UTC notAfter=2027-09-30 07:31:15 +0000 UTC" machine # [ 16.915752] k3s[881]: time="2026-09-30T08:31:15Z" level=info msg="certificate CN=system:kube-scheduler signed by CN=k3s-client-ca@1790757075: notBefore=2026-09-30 07:31:15 +0000 UTC notAfter=2027-09-30 07:31:15 +0000 UTC" machine # [ 16.916269] k3s[881]: time="2026-09-30T08:31:15Z" level=info msg="certificate CN=system:apiserver,O=system:masters signed by CN=k3s-client-ca@1790757075: notBefore=2026-09-30 07:31:15 +0000 UTC notAfter=2027-09-30 07:31:15 +0000 UTC" machine # [ 16.916751] k3s[881]: time="2026-09-30T08:31:15Z" level=info msg="certificate CN=k3s-cloud-controller-manager signed by CN=k3s-client-ca@1790757075: notBefore=2026-09-30 07:31:15 +0000 UTC notAfter=2027-09-30 07:31:15 +0000 UTC" machine # [ 16.917254] k3s[881]: time="2026-09-30T08:31:15Z" level=info msg="generated self-signed CA certificate CN=k3s-server-ca@1790757075: notBefore=2026-09-30 07:31:15.71098212 +0000 UTC notAfter=2036-09-27 07:31:15.71098212 +0000 UTC" machine # [ 16.917727] k3s[881]: time="2026-09-30T08:31:15Z" level=info msg="certificate CN=kube-apiserver signed by CN=k3s-server-ca@1790757075: notBefore=2026-09-30 07:31:15 +0000 UTC notAfter=2027-09-30 07:31:15 +0000 UTC" machine # [ 16.918231] k3s[881]: time="2026-09-30T08:31:15Z" level=info msg="certificate CN=kube-scheduler signed by CN=k3s-server-ca@1790757075: notBefore=2026-09-30 07:31:15 +0000 UTC notAfter=2027-09-30 07:31:15 +0000 UTC" machine # [ 16.918697] k3s[881]: time="2026-09-30T08:31:15Z" level=info msg="certificate CN=kube-controller-manager signed by CN=k3s-server-ca@1790757075: notBefore=2026-09-30 07:31:15 +0000 UTC notAfter=2027-09-30 07:31:15 +0000 UTC" machine # [ 16.919213] k3s[881]: time="2026-09-30T08:31:15Z" level=info msg="generated self-signed CA certificate CN=k3s-request-header-ca@1790757075: notBefore=2026-09-30 07:31:15.71274687 +0000 UTC notAfter=2036-09-27 07:31:15.71274687 +0000 UTC" machine # [ 16.919684] k3s[881]: time="2026-09-30T08:31:15Z" level=info msg="certificate CN=system:auth-proxy signed by CN=k3s-request-header-ca@1790757075: notBefore=2026-09-30 07:31:15 +0000 UTC notAfter=2027-09-30 07:31:15 +0000 UTC" machine # [ 16.920218] k3s[881]: time="2026-09-30T08:31:15Z" level=info msg="generated self-signed CA certificate CN=etcd-server-ca@1790757075: notBefore=2026-09-30 07:31:15.71363581 +0000 UTC notAfter=2036-09-27 07:31:15.71363581 +0000 UTC" machine # [ 16.920674] k3s[881]: time="2026-09-30T08:31:15Z" level=info msg="certificate CN=etcd-client signed by CN=etcd-server-ca@1790757075: notBefore=2026-09-30 07:31:15 +0000 UTC notAfter=2027-09-30 07:31:15 +0000 UTC" machine # [ 16.921201] k3s[881]: time="2026-09-30T08:31:15Z" level=info msg="generated self-signed CA certificate CN=etcd-peer-ca@1790757075: notBefore=2026-09-30 07:31:15.71430908 +0000 UTC notAfter=2036-09-27 07:31:15.71430908 +0000 UTC" machine # [ 16.921643] k3s[881]: time="2026-09-30T08:31:15Z" level=info msg="certificate CN=etcd-peer signed by CN=etcd-peer-ca@1790757075: notBefore=2026-09-30 07:31:15 +0000 UTC notAfter=2027-09-30 07:31:15 +0000 UTC" machine # [ 16.922110] k3s[881]: time="2026-09-30T08:31:15Z" level=info msg="certificate CN=etcd-server signed by CN=etcd-server-ca@1790757075: notBefore=2026-09-30 07:31:15 +0000 UTC notAfter=2027-09-30 07:31:15 +0000 UTC" machine # [ 16.958463] k3s[881]: time="2026-09-30T08:31:15Z" level=info msg="certificate CN=k3s,O=k3s signed by CN=k3s-server-ca@1790757075: notBefore=2026-09-30 07:31:15 +0000 UTC notAfter=2027-09-30 07:31:15 +0000 UTC" machine # [ 16.961347] k3s[881]: time="2026-09-30T08:31:15Z" level=warning msg="dynamiclistener [::]:6443: no cached certificate available for preload - deferring certificate load until storage initialization or first client request" machine # [ 16.963833] k3s[881]: time="2026-09-30T08:31:15Z" level=info msg="Active TLS secret / (ver=) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__6173_482b_9d22_a7f2-368e0b:fec0::6173:482b:9d22:a7f2 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=CB35489C91FA8D5F00C1137AEA7285FD0D337DC1]" machine # [ 17.907918] k3s[881]: time="2026-09-30T08:31:16Z" level=info msg="Password verified locally for node machine" machine # [ 17.910285] k3s[881]: time="2026-09-30T08:31:16Z" level=info msg="certificate CN=machine signed by CN=k3s-server-ca@1790757075: notBefore=2026-09-30 07:31:16 +0000 UTC notAfter=2027-09-30 07:31:16 +0000 UTC" machine # [ 18.152732] k3s[881]: time="2026-09-30T08:31:16Z" level=info msg="certificate CN=system:node:machine,O=system:nodes signed by CN=k3s-client-ca@1790757075: notBefore=2026-09-30 07:31:16 +0000 UTC notAfter=2027-09-30 07:31:16 +0000 UTC" machine # [ 18.258364] k3s[881]: time="2026-09-30T08:31:17Z" level=info msg="certificate CN=system:kube-proxy signed by CN=k3s-client-ca@1790757075: notBefore=2026-09-30 07:31:17 +0000 UTC notAfter=2027-09-30 07:31:17 +0000 UTC" machine # [ 18.337471] k3s[881]: time="2026-09-30T08:31:17Z" level=info msg="certificate CN=system:k3s-controller signed by CN=k3s-client-ca@1790757075: notBefore=2026-09-30 07:31:17 +0000 UTC notAfter=2027-09-30 07:31:17 +0000 UTC" machine # [ 18.429427] k3s[881]: time="2026-09-30T08:31:17Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:48066: runtime core not ready" machine # [ 18.532957] k3s[881]: time="2026-09-30T08:31:17Z" level=info msg="Module overlay was already loaded" machine # [ 18.765610] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. machine # [ 18.773338] Bridge firewalling registered machine # [ 18.642488] k3s[881]: time="2026-09-30T08:31:17Z" level=warning msg="Failed to load kernel module iptable_nat with modprobe" machine # [ 18.651235] k3s[881]: time="2026-09-30T08:31:17Z" level=warning msg="Failed to load kernel module iptable_filter with modprobe" machine # [ 18.659425] k3s[881]: time="2026-09-30T08:31:17Z" level=warning msg="Failed to load kernel module nft-expr-counter with modprobe" machine # [ 18.733664] k3s[881]: time="2026-09-30T08:31:17Z" level=info msg="Set sysctl 'net/ipv4/conf/all/forwarding' to 1" machine # [ 18.735126] k3s[881]: time="2026-09-30T08:31:17Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_max' to 131072" machine # [ 18.736140] k3s[881]: time="2026-09-30T08:31:17Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400" machine # [ 18.736664] k3s[881]: time="2026-09-30T08:31:17Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600" machine # [ 18.737973] k3s[881]: time="2026-09-30T08:31:17Z" level=info msg="Creating k3s-cert-monitor event broadcaster" machine # [ 18.738605] k3s[881]: time="2026-09-30T08:31:17Z" level=info msg="Connecting to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 18.739634] k3s[881]: time="2026-09-30T08:31:17Z" level=info msg="Polling for API server readiness: GET /readyz failed: the server is currently unable to handle the request" machine # [ 18.740599] k3s[881]: time="2026-09-30T08:31:17Z" level=info msg="Saving cluster bootstrap data to datastore" machine # [ 18.741532] k3s[881]: time="2026-09-30T08:31:17Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 18.742675] k3s[881]: time="2026-09-30T08:31:17Z" level=info msg="Connection to etcd is ready" machine # [ 18.743572] k3s[881]: time="2026-09-30T08:31:17Z" level=info msg="ETCD server is now running" machine # [ 18.744357] k3s[881]: time="2026-09-30T08:31:17Z" level=info msg="Handling backend connection request [machine]" machine # [ 18.745214] k3s[881]: time="2026-09-30T08:31:17Z" level=info msg="Connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 18.745978] k3s[881]: time="2026-09-30T08:31:17Z" level=info msg="Remotedialer connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 18.746957] k3s[881]: time="2026-09-30T08:31:17Z" level=info msg="Running kube-apiserver --advertise-port=6443 --allow-privileged=true --anonymous-auth=false --api-audiences=https://kubernetes.default.svc.cluster.local,k3s --authorization-mode=Node,RBAC --bind-address=127.0.0.1 --cert-dir=/var/lib/rancher/k3s/server/tls/temporary-certs --client-ca-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --egress-selector-config-file=/var/lib/rancher/k3s/server/etc/egress-selector-config.yaml --enable-admission-plugins=NodeRestriction --enable-aggregator-routing=true --enable-bootstrap-token-auth=true --etcd-servers=unix://kine.sock --kubelet-certificate-authority=/var/lib/rancher/k3s/server/tls/server-ca.crt --kubelet-client-certificate=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.crt --kubelet-client-key=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.key --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --profiling=false --proxy-client-cert-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt --proxy-client-key-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.key --requestheader-allowed-names=system:auth-proxy --requestheader-client-ca-file=/var/lib/rancher/k3s/server/tls/request-header-ca.crt --requestheader-extra-headers-prefix=X-Remote-Extra- --requestheader-group-headers=X-Remote-Group --requestheader-username-headers=X-Remote-User --secure-port=6444 --service-account-issuer=https://kubernetes.default.svc.cluster.local --service-account-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-account-signing-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --storage-backend=etcd3 --tls-cert-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --tls-private-key-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 18.748505] k3s[881]: time="2026-09-30T08:31:17Z" level=info msg="Running kube-scheduler --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --bind-address=127.0.0.1 --kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --leader-elect=false --profiling=false --secure-port=10259 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 18.749368] k3s[881]: time="2026-09-30T08:31:17Z" level=info msg="Running kube-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --bind-address=127.0.0.1 --cluster-cidr=10.42.0.0/16 --cluster-signing-kube-apiserver-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kube-apiserver-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kubelet-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-serving-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-kubelet-serving-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --cluster-signing-legacy-unknown-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-legacy-unknown-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --configure-cloud-routes=false --controllers=*,tokencleaner,-service,-route,-cloud-node-lifecycle --kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --leader-elect=false --profiling=false --root-ca-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --secure-port=10257 --service-account-private-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key --use-service-account-credentials=true" machine # [ 18.758173] k3s[881]: time="2026-09-30T08:31:17Z" level=info msg="Running cloud-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --bind-address=127.0.0.1 --cloud-config=/var/lib/rancher/k3s/server/etc/cloud-config.yaml --cloud-provider=k3s --cluster-cidr=10.42.0.0/16 --configure-cloud-routes=false --controllers=*,-route --kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --leader-elect=false --leader-elect-resource-name=k3s-cloud-controller-manager --node-status-update-frequency=1m0s --profiling=false" machine # [ 18.800128] k3s[881]: time="2026-09-30T08:31:17Z" level=info msg="Server node token is available at /var/lib/rancher/k3s/server/token" machine # [ 18.801077] k3s[881]: time="2026-09-30T08:31:17Z" level=info msg="To join server node to cluster: k3s server -s https://10.0.2.15:6443 -t ${SERVER_NODE_TOKEN}" machine # [ 18.801512] k3s[881]: time="2026-09-30T08:31:17Z" level=info msg="Agent node token is available at /var/lib/rancher/k3s/server/agent-token" machine # [ 18.802538] k3s[881]: time="2026-09-30T08:31:17Z" level=info msg="To join agent node to cluster: k3s agent -s https://10.0.2.15:6443 -t ${AGENT_NODE_TOKEN}" machine # [ 18.803601] k3s[881]: time="2026-09-30T08:31:17Z" level=info msg="Wrote kubeconfig /etc/rancher/k3s/k3s.yaml" machine # [ 18.804574] k3s[881]: time="2026-09-30T08:31:17Z" level=info msg="Run: k3s kubectl" machine # [ 18.805644] k3s[881]: I0930 08:31:17.545369 881 options.go:263] external host was not specified, using 10.0.2.15 machine # [ 18.806655] k3s[881]: I0930 08:31:17.547633 881 server.go:158] Version: v1.36.4+k3s1 machine # [ 18.807646] k3s[881]: I0930 08:31:17.547662 881 server.go:160] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 18.808707] k3s[881]: time="2026-09-30T08:31:17Z" level=info msg="Logging containerd to /var/lib/rancher/k3s/agent/containerd/containerd.log" machine # [ 18.809725] k3s[881]: time="2026-09-30T08:31:17Z" level=info msg="Running containerd -c /var/lib/rancher/k3s/agent/etc/containerd/config.toml" machine # [ 18.832289] k3s[881]: time="2026-09-30T08:31:17Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:48132: runtime core not ready" machine # [ 18.938870] k3s[881]: time="2026-09-30T08:31:17Z" level=info msg="Running kube-proxy --cluster-cidr=10.42.0.0/16 --conntrack-max-per-core=0 --conntrack-tcp-timeout-close-wait=0s --conntrack-tcp-timeout-established=0s --healthz-bind-address=127.0.0.1 --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubeproxy.kubeconfig --proxy-mode=iptables" machine # [ 18.960755] k3s[881]: I0930 08:31:17.755093 881 shared_informer.go:381] "Waiting for caches to sync" controller="node_authorizer" machine # [ 18.961693] k3s[881]: E0930 08:31:17.755148 881 options.go:205] The manifest file is empty, ignoring. machine # [ 18.967130] k3s[881]: I0930 08:31:17.761559 881 plugins.go:157] Loaded 15 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,PodGroupProtection,RuntimeClass,DefaultIngressClass,PodTopologyLabels,MutatingAdmissionPolicy,MutatingAdmissionWebhook. machine # [ 18.968056] k3s[881]: I0930 08:31:17.761588 881 plugins.go:160] Loaded 17 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,PodGroupWorkloadExists,NodeDeclaredFeatureValidator,JobValidation,PodResizeValidator,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. machine # [ 18.969251] k3s[881]: I0930 08:31:17.761675 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 18.970958] k3s[881]: I0930 08:31:17.761850 881 instance.go:240] Using reconciler: lease machine # [ 18.972933] k3s[881]: I0930 08:31:17.762404 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 18.983630] k3s[881]: I0930 08:31:17.778055 881 handler.go:304] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager machine # [ 18.984141] k3s[881]: W0930 08:31:17.778089 881 genericapiserver.go:798] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. machine # [ 18.985951] k3s[881]: I0930 08:31:17.780411 881 cidrallocator.go:198] starting ServiceCIDR Allocator Controller machine # [ 19.017350] k3s[881]: I0930 08:31:17.811739 881 handler.go:304] Adding GroupVersion v1 to ResourceManager machine # [ 19.017841] k3s[881]: I0930 08:31:17.811944 881 apis.go:112] API group "internal.apiserver.k8s.io" is not enabled, skipping. machine # [ 19.047769] k3s[881]: I0930 08:31:17.841398 881 apis.go:112] API group "storagemigration.k8s.io" is not enabled, skipping. machine # [ 19.096166] k3s[881]: I0930 08:31:17.890473 881 handler.go:304] Adding GroupVersion authentication.k8s.io v1 to ResourceManager machine # [ 19.096933] k3s[881]: W0930 08:31:17.890541 881 genericapiserver.go:798] Skipping API authentication.k8s.io/v1beta1 because it has no resources. machine # [ 19.097704] k3s[881]: W0930 08:31:17.890554 881 genericapiserver.go:798] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. machine # [ 19.098543] k3s[881]: I0930 08:31:17.890922 881 handler.go:304] Adding GroupVersion authorization.k8s.io v1 to ResourceManager machine # [ 19.100631] k3s[881]: W0930 08:31:17.890939 881 genericapiserver.go:798] Skipping API authorization.k8s.io/v1beta1 because it has no resources. machine # [ 19.101204] k3s[881]: I0930 08:31:17.891551 881 handler.go:304] Adding GroupVersion autoscaling v2 to ResourceManager machine # [ 19.101725] k3s[881]: I0930 08:31:17.892090 881 handler.go:304] Adding GroupVersion autoscaling v1 to ResourceManager machine # [ 19.102474] k3s[881]: I0930 08:31:17.893092 881 handler.go:304] Adding GroupVersion batch v1 to ResourceManager machine # [ 19.103151] k3s[881]: W0930 08:31:17.893119 881 genericapiserver.go:798] Skipping API batch/v1beta1 because it has no resources. machine # [ 19.103608] k3s[881]: I0930 08:31:17.893699 881 handler.go:304] Adding GroupVersion certificates.k8s.io v1 to ResourceManager machine # [ 19.104438] k3s[881]: W0930 08:31:17.893715 881 genericapiserver.go:798] Skipping API certificates.k8s.io/v1beta1 because it has no resources. machine # [ 19.104946] k3s[881]: W0930 08:31:17.893726 881 genericapiserver.go:798] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. machine # [ 19.105645] k3s[881]: I0930 08:31:17.894133 881 handler.go:304] Adding GroupVersion coordination.k8s.io v1 to ResourceManager machine # [ 19.106168] k3s[881]: W0930 08:31:17.894150 881 genericapiserver.go:798] Skipping API coordination.k8s.io/v1beta1 because it has no resources. machine # [ 19.106663] k3s[881]: W0930 08:31:17.894160 881 genericapiserver.go:798] Skipping API coordination.k8s.io/v1alpha2 because it has no resources. machine # [ 19.107641] k3s[881]: I0930 08:31:17.894589 881 handler.go:304] Adding GroupVersion discovery.k8s.io v1 to ResourceManager machine # [ 19.108402] k3s[881]: W0930 08:31:17.894605 881 genericapiserver.go:798] Skipping API discovery.k8s.io/v1beta1 because it has no resources. machine # [ 19.109076] k3s[881]: I0930 08:31:17.896023 881 handler.go:304] Adding GroupVersion networking.k8s.io v1 to ResourceManager machine # [ 19.109548] k3s[881]: W0930 08:31:17.896041 881 genericapiserver.go:798] Skipping API networking.k8s.io/v1beta1 because it has no resources. machine # [ 19.110062] k3s[881]: I0930 08:31:17.896355 881 handler.go:304] Adding GroupVersion node.k8s.io v1 to ResourceManager machine # [ 19.110530] k3s[881]: W0930 08:31:17.896370 881 genericapiserver.go:798] Skipping API node.k8s.io/v1beta1 because it has no resources. machine # [ 19.111715] k3s[881]: W0930 08:31:17.896381 881 genericapiserver.go:798] Skipping API node.k8s.io/v1alpha1 because it has no resources. machine # [ 19.112785] k3s[881]: I0930 08:31:17.896914 881 handler.go:304] Adding GroupVersion policy v1 to ResourceManager machine # [ 19.113252] k3s[881]: W0930 08:31:17.896930 881 genericapiserver.go:798] Skipping API policy/v1beta1 because it has no resources. machine # [ 19.113808] k3s[881]: I0930 08:31:17.898039 881 handler.go:304] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager machine # [ 19.114397] k3s[881]: W0930 08:31:17.898057 881 genericapiserver.go:798] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. machine # [ 19.114872] k3s[881]: W0930 08:31:17.898068 881 genericapiserver.go:798] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. machine # [ 19.115681] k3s[881]: I0930 08:31:17.898354 881 handler.go:304] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager machine # [ 19.116429] k3s[881]: W0930 08:31:17.898368 881 genericapiserver.go:798] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. machine # [ 19.116897] k3s[881]: W0930 08:31:17.898379 881 genericapiserver.go:798] Skipping API scheduling.k8s.io/v1alpha2 because it has no resources. machine # [ 19.117510] k3s[881]: I0930 08:31:17.899888 881 handler.go:304] Adding GroupVersion storage.k8s.io v1 to ResourceManager machine # [ 19.118191] k3s[881]: W0930 08:31:17.899905 881 genericapiserver.go:798] Skipping API storage.k8s.io/v1beta1 because it has no resources. machine # [ 19.118602] k3s[881]: W0930 08:31:17.899917 881 genericapiserver.go:798] Skipping API storage.k8s.io/v1alpha1 because it has no resources. machine # [ 19.119396] k3s[881]: I0930 08:31:17.900668 881 handler.go:304] Adding GroupVersion flowcontrol.apiserver.k8s.io v1 to ResourceManager machine # [ 19.119839] k3s[881]: W0930 08:31:17.900684 881 genericapiserver.go:798] Skipping API flowcontrol.apiserver.k8s.io/v1beta3 because it has no resources. machine # [ 19.120480] k3s[881]: W0930 08:31:17.900694 881 genericapiserver.go:798] Skipping API flowcontrol.apiserver.k8s.io/v1beta2 because it has no resources. machine # [ 19.121118] k3s[881]: W0930 08:31:17.900704 881 genericapiserver.go:798] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. machine # [ 19.121568] k3s[881]: I0930 08:31:17.903668 881 handler.go:304] Adding GroupVersion apps v1 to ResourceManager machine # [ 19.122222] k3s[881]: W0930 08:31:17.903687 881 genericapiserver.go:798] Skipping API apps/v1beta2 because it has no resources. machine # [ 19.122687] k3s[881]: W0930 08:31:17.903698 881 genericapiserver.go:798] Skipping API apps/v1beta1 because it has no resources. machine # [ 19.123453] k3s[881]: I0930 08:31:17.906704 881 handler.go:304] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager machine # [ 19.123918] k3s[881]: W0930 08:31:17.906725 881 genericapiserver.go:798] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. machine # [ 19.124561] k3s[881]: W0930 08:31:17.906736 881 genericapiserver.go:798] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. machine # [ 19.125211] k3s[881]: I0930 08:31:17.907344 881 handler.go:304] Adding GroupVersion events.k8s.io v1 to ResourceManager machine # [ 19.125682] k3s[881]: W0930 08:31:17.907360 881 genericapiserver.go:798] Skipping API events.k8s.io/v1beta1 because it has no resources. machine # [ 19.126194] k3s[881]: I0930 08:31:17.909542 881 handler.go:304] Adding GroupVersion resource.k8s.io v1 to ResourceManager machine # [ 19.126637] k3s[881]: W0930 08:31:17.909560 881 genericapiserver.go:798] Skipping API resource.k8s.io/v1beta2 because it has no resources. machine # [ 19.127402] k3s[881]: W0930 08:31:17.909571 881 genericapiserver.go:798] Skipping API resource.k8s.io/v1beta1 because it has no resources. machine # [ 19.127880] k3s[881]: W0930 08:31:17.909581 881 genericapiserver.go:798] Skipping API resource.k8s.io/v1alpha3 because it has no resources. machine # [ 19.168885] k3s[881]: I0930 08:31:17.963295 881 handler.go:304] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager machine # [ 19.170315] k3s[881]: W0930 08:31:17.964492 881 genericapiserver.go:798] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. machine # [ 19.547980] k3s[881]: I0930 08:31:18.341996 881 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 19.548447] k3s[881]: I0930 08:31:18.342001 881 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 19.548858] k3s[881]: I0930 08:31:18.342423 881 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 19.549593] k3s[881]: I0930 08:31:18.342470 881 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 19.552082] k3s[881]: I0930 08:31:18.342433 881 secure_serving.go:214] Serving securely on 127.0.0.1:6444 machine # [ 19.552784] k3s[881]: I0930 08:31:18.345073 881 apiservice_controller.go:100] Starting APIServiceRegistrationController machine # [ 19.553424] k3s[881]: I0930 08:31:18.345093 881 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller machine # [ 19.553910] k3s[881]: I0930 08:31:18.345175 881 aggregator.go:185] waiting for initial CRD sync... machine # [ 19.554567] k3s[881]: I0930 08:31:18.345207 881 controller.go:87] "Starting OpenAPI AggregationController" machine # [ 19.555056] k3s[881]: I0930 08:31:18.345302 881 remote_available_controller.go:434] Starting RemoteAvailability controller machine # [ 19.555234] k3s[881]: I0930 08:31:18.345313 881 cache.go:32] Waiting for caches to sync for RemoteAvailability controller machine # [ 19.555864] k3s[881]: time="2026-09-30T08:31:18Z" level=info msg="Starting legacy_token_tracking_controller" logger=k3s machine # [ 19.556566] k3s[881]: time="2026-09-30T08:31:18Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 19.557061] k3s[881]: I0930 08:31:18.345762 881 cluster_authentication_trust_controller.go:459] Starting cluster_authentication_trust_controller controller machine # [ 19.557544] k3s[881]: time="2026-09-30T08:31:18Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 19.558051] k3s[881]: I0930 08:31:18.346358 881 storage_readiness_hook.go:70] Storage is ready for all registered resources machine # [ 19.558516] k3s[881]: I0930 08:31:18.346387 881 local_available_controller.go:156] Starting LocalAvailability controller machine # [ 19.558981] k3s[881]: I0930 08:31:18.346398 881 cache.go:32] Waiting for caches to sync for LocalAvailability controller machine # [ 19.559520] k3s[881]: I0930 08:31:18.351871 881 dynamic_serving_content.go:135] "Starting controller" name="aggregator-proxy-cert::/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt::/var/lib/rancher/k3s/server/tls/client-auth-proxy.key" machine # [ 19.559958] k3s[881]: I0930 08:31:18.352015 881 system_namespaces_controller.go:66] Starting system namespaces controller machine # [ 19.560611] k3s[881]: I0930 08:31:18.352083 881 apf_controller.go:377] Starting API Priority and Fairness config controller machine # [ 19.561126] k3s[881]: I0930 08:31:18.352200 881 controller.go:89] "Starting OpenAPI V3 AggregationController" machine # [ 19.561569] k3s[881]: time="2026-09-30T08:31:18Z" level=info msg="Starting apiserver lease garbage collector" logger=k3s machine # [ 19.562067] k3s[881]: time="2026-09-30T08:31:18Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 19.562550] k3s[881]: I0930 08:31:18.352357 881 controller.go:113] "Deleting old lease on startup" lease="kube-system/apiserver-ik4pcwfs7qgdl76byc4pomgvia" machine # [ 19.563101] k3s[881]: I0930 08:31:18.355981 881 customresource_discovery_controller.go:294] Starting DiscoveryController machine # [ 19.563568] k3s[881]: I0930 08:31:18.356337 881 crdregistration_controller.go:114] Starting crd-autoregister controller machine # [ 19.564073] k3s[881]: I0930 08:31:18.356350 881 shared_informer.go:381] "Waiting for caches to sync" controller="crd-autoregister" machine # [ 19.564542] k3s[881]: I0930 08:31:18.356640 881 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 19.565024] k3s[881]: I0930 08:31:18.356715 881 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 19.565537] k3s[881]: I0930 08:31:18.356942 881 repairip.go:210] Starting ipallocator-repair-controller machine # [ 19.565993] k3s[881]: I0930 08:31:18.356954 881 shared_informer.go:381] "Waiting for caches to sync" controller="ipallocator-repair-controller" machine # [ 19.566513] k3s[881]: time="2026-09-30T08:31:18Z" level=info msg=Starting controller=kubernetes-service-cidr-controller logger=k3s machine # [ 19.566973] k3s[881]: time="2026-09-30T08:31:18Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 19.567613] k3s[881]: I0930 08:31:18.357753 881 controller.go:142] Starting OpenAPI controller machine # [ 19.568159] k3s[881]: I0930 08:31:18.357809 881 controller.go:90] Starting OpenAPI V3 controller machine # [ 19.568599] k3s[881]: I0930 08:31:18.357839 881 naming_controller.go:305] Starting NamingConditionController machine # [ 19.569081] k3s[881]: I0930 08:31:18.357893 881 nonstructuralschema_controller.go:202] Starting NonStructuralSchemaConditionController machine # [ 19.569618] k3s[881]: I0930 08:31:18.357923 881 apiapproval_controller.go:196] Starting KubernetesAPIApprovalPolicyConformantConditionController machine # [ 19.570162] k3s[881]: time="2026-09-30T08:31:18Z" level=info msg="Starting CRDFinalizer" logger=k3s machine # [ 19.651896] k3s[881]: time="2026-09-30T08:31:18Z" level=info msg="Caches are synced" logger=k3s machine # [ 19.652707] k3s[881]: I0930 08:31:18.446072 881 cache.go:39] Caches are synced for APIServiceRegistrationController controller machine # [ 19.653244] k3s[881]: I0930 08:31:18.446154 881 handler_discovery.go:459] Starting ResourceDiscoveryManager machine # [ 19.653717] k3s[881]: time="2026-09-30T08:31:18Z" level=info msg="Caches are synced" logger=k3s machine # [ 19.654255] k3s[881]: I0930 08:31:18.446457 881 cache.go:39] Caches are synced for LocalAvailability controller machine # [ 19.658050] k3s[881]: time="2026-09-30T08:31:18Z" level=info msg="Caches are synced" logger=k3s machine # [ 19.663987] k3s[881]: time="2026-09-30T08:31:18Z" level=info msg="Caches are synced" logger=k3s machine # [ 19.664458] k3s[881]: time="2026-09-30T08:31:18Z" level=info msg="Creating default ServiceCIDR" CIDRs="[10.43.0.0/16]" logger=k3s machine # [ 19.668420] k3s[881]: I0930 08:31:18.462853 881 shared_informer.go:409] "Caches are synced" machine # [ 19.668842] k3s[881]: I0930 08:31:18.462898 881 policy_source.go:248] refreshing policies machine # [ 19.680684] k3s[881]: E0930 08:31:18.475071 881 controller.go:201] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" machine # [ 19.709660] k3s[881]: time="2026-09-30T08:31:18Z" level=error msg="Error while syncing ConfigMap" configmap=kube-system/kube-apiserver-legacy-service-account-token-tracking error="namespaces \"kube-system\" not found" logger=k3s/UnhandledError machine # [ 19.772134] k3s[881]: time="2026-09-30T08:31:18Z" level=error msg="Error while syncing ConfigMap" configmap=kube-system/kube-apiserver-legacy-service-account-token-tracking error="namespaces \"kube-system\" not found" logger=k3s/UnhandledError machine # [ 19.783680] k3s[881]: time="2026-09-30T08:31:18Z" level=info msg="containerd is now running" machine # [ 19.798625] k3s[881]: time="2026-09-30T08:31:18Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/3yy0akcdc603vhkdhb6y36qgxvk4zpw8-nix-grpc-farm.tar" machine # [ 19.839228] k3s[881]: time="2026-09-30T08:31:18Z" level=error msg="Error while syncing ConfigMap" configmap=kube-system/kube-apiserver-legacy-service-account-token-tracking error="namespaces \"kube-system\" not found" logger=k3s/UnhandledError machine # [ 19.920468] k3s[881]: time="2026-09-30T08:31:18Z" level=error msg="Error while syncing ConfigMap" configmap=kube-system/kube-apiserver-legacy-service-account-token-tracking error="namespaces \"kube-system\" not found" logger=k3s/UnhandledError machine # [ 19.943132] k3s[881]: E0930 08:31:18.736929 881 controller.go:201] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="400ms" machine # [ 19.951412] k3s[881]: I0930 08:31:18.745779 881 cache.go:39] Caches are synced for RemoteAvailability controller machine # [ 19.957918] k3s[881]: I0930 08:31:18.752263 881 apf_controller.go:382] Running API Priority and Fairness config worker machine # [ 19.961145] k3s[881]: I0930 08:31:18.752317 881 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process machine # [ 19.962934] k3s[881]: I0930 08:31:18.755617 881 shared_informer.go:388] "Caches are synced" controller="node_authorizer" machine # [ 19.964216] k3s[881]: I0930 08:31:18.756972 881 shared_informer.go:388] "Caches are synced" controller="crd-autoregister" machine # [ 19.965099] k3s[881]: I0930 08:31:18.757031 881 aggregator.go:187] initial CRD sync complete... machine # [ 19.965990] k3s[881]: I0930 08:31:18.757047 881 autoregister_controller.go:144] Starting autoregister controller machine # [ 19.966939] k3s[881]: I0930 08:31:18.757060 881 cache.go:32] Waiting for caches to sync for autoregister controller machine # [ 19.968257] k3s[881]: I0930 08:31:18.757072 881 cache.go:39] Caches are synced for autoregister controller machine # [ 19.969189] k3s[881]: I0930 08:31:18.757875 881 shared_informer.go:388] "Caches are synced" controller="ipallocator-repair-controller" machine # [ 19.982138] k3s[881]: I0930 08:31:18.774045 881 shared_informer.go:409] "Caches are synced" machine # [ 19.983068] k3s[881]: I0930 08:31:18.774115 881 policy_source.go:248] refreshing policies machine # [ 20.009363] k3s[881]: E0930 08:31:18.803803 881 controller.go:95] Unable to perform initial Kubernetes service initialization: namespaces "default" not found machine # [ 20.017060] k3s[881]: time="2026-09-30T08:31:18Z" level=error msg="Error while syncing ConfigMap" configmap=kube-system/kube-apiserver-legacy-service-account-token-tracking error="namespaces \"kube-system\" not found" logger=k3s/UnhandledError machine # [ 20.081742] k3s[881]: time="2026-09-30T08:31:18Z" level=info msg="Setting default ServiceCIDR condition Ready to True" logger=k3s machine # [ 20.082361] k3s[881]: I0930 08:31:18.876186 881 cidrallocator.go:302] created ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 20.085157] k3s[881]: I0930 08:31:18.879603 881 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 20.346957] k3s[881]: I0930 08:31:19.141285 881 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io machine # [ 20.568825] k3s[881]: I0930 08:31:19.363187 881 storage_scheduling.go:137] created PriorityClass system-node-critical with value 2000001000 machine # [ 20.574185] k3s[881]: I0930 08:31:19.368622 881 storage_scheduling.go:137] created PriorityClass system-cluster-critical with value 2000000000 machine # [ 20.574648] k3s[881]: I0930 08:31:19.368645 881 storage_scheduling.go:153] all system priority classes are created successfully or already exist. machine # [ 20.744776] k3s[881]: time="2026-09-30T08:31:19Z" level=info msg="Polling for API server readiness: GET /readyz failed: unknown" machine # [ 21.562637] k3s[881]: I0930 08:31:20.356644 881 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io machine # [ 21.618503] k3s[881]: I0930 08:31:20.412897 881 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io machine # [ 21.722091] k3s[881]: I0930 08:31:20.516416 881 alloc.go:329] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.43.0.1"} machine # [ 21.727337] k3s[881]: W0930 08:31:20.521722 881 lease.go:265] Resetting endpoints for master service "kubernetes" to [10.0.2.15] machine # [ 21.728739] k3s[881]: I0930 08:31:20.523172 881 controller.go:667] quota admission added evaluator for: endpoints machine # [ 21.734678] k3s[881]: I0930 08:31:20.529117 881 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io machine # [ 22.749970] k3s[881]: time="2026-09-30T08:31:21Z" level=info msg="Waiting for untainted node" machine # [ 22.752951] k3s[881]: time="2026-09-30T08:31:21Z" level=info msg="Creating k3s-supervisor event broadcaster" machine # [ 22.755231] k3s[881]: time="2026-09-30T08:31:21Z" level=info msg="Kube API server is now running" machine # [ 22.760844] k3s[881]: time="2026-09-30T08:31:21Z" level=info msg="k3s is up and running" machine # [ 22.765152] systemd[1]: Started k3s service. machine # [ 22.770225] systemd[1]: Starting niks3 server... machine # [ 22.771509] k3s[881]: time="2026-09-30T08:31:21Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Node and Certificate Authority certificates managed by k3s are OK" object=machine reason=CertificateExpirationOK type=Normal machine # [ 22.785685] k3s[881]: E0930 08:31:21.580030 881 options.go:205] The manifest file is empty, ignoring. machine # [ 22.786627] k3s[881]: I0930 08:31:21.580328 881 controllermanager.go:204] "Starting" version="v1.36.4+k3s1" machine # [ 22.787651] k3s[881]: I0930 08:31:21.580346 881 controllermanager.go:206] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 22.793660] k3s[881]: I0930 08:31:21.588092 881 secure_serving.go:214] Serving securely on 127.0.0.1:10257 machine # [ 22.796098] k3s[881]: I0930 08:31:21.588695 881 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 22.796747] k3s[881]: I0930 08:31:21.588785 881 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 22.797248] k3s[881]: I0930 08:31:21.588801 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 22.797714] k3s[881]: I0930 08:31:21.588836 881 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key" machine # [ 22.798387] k3s[881]: I0930 08:31:21.588945 881 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 22.800306] k3s[881]: I0930 08:31:21.588963 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 22.800945] k3s[881]: I0930 08:31:21.588990 881 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 22.801623] k3s[881]: I0930 08:31:21.589011 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 22.802216] k3s[881]: I0930 08:31:21.594479 881 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" requiredFeatureGates=["ClusterTrustBundle"] machine # [ 22.802649] k3s[881]: I0930 08:31:21.594544 881 controllermanager.go:641] "Warning: skipping controller" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" machine # [ 22.805943] k3s[881]: I0930 08:31:21.600387 881 controller.go:667] quota admission added evaluator for: serviceaccounts machine # [ 22.808519] k3s[881]: I0930 08:31:21.602966 881 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="resourcepoolstatusrequest-controller" requiredFeatureGates=["DRAResourcePoolStatus"] machine # [ 22.809207] k3s[881]: I0930 08:31:21.602992 881 controllermanager.go:641] "Warning: skipping controller" controller="resourcepoolstatusrequest-controller" machine # [ 22.833806] k3s[881]: time="2026-09-30T08:31:21Z" level=info msg="Creating embedded CRD addons.k3s.cattle.io" machine # [ 22.840264] k3s[881]: time="2026-09-30T08:31:21Z" level=info msg="Creating embedded CRD etcdsnapshotfiles.k3s.cattle.io" machine # [ 22.848686] k3s[881]: time="2026-09-30T08:31:21Z" level=info msg="Creating embedded CRD helmcharts.helm.cattle.io" machine # [ 22.850782] k3s[881]: I0930 08:31:21.645229 881 controllermanager.go:689] "Warning: controller is disabled" controller="selinux-warning-controller" machine # [ 22.851540] k3s[881]: I0930 08:31:21.645259 881 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="podgroup-protection-controller" requiredFeatureGates=["GenericWorkload"] machine # [ 22.852244] k3s[881]: I0930 08:31:21.645275 881 controllermanager.go:641] "Warning: skipping controller" controller="podgroup-protection-controller" machine # [ 22.867767] k3s[881]: I0930 08:31:21.661981 881 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 22.874194] k3s[881]: time="2026-09-30T08:31:21Z" level=info msg="Creating embedded CRD helmchartconfigs.helm.cattle.io" machine # [ 22.882094] k3s[881]: I0930 08:31:21.676394 881 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 22.895070] k3s[881]: I0930 08:31:21.688882 881 shared_informer.go:409] "Caches are synced" machine # [ 22.895825] k3s[881]: I0930 08:31:21.689079 881 shared_informer.go:409] "Caches are synced" machine # [ 22.896506] k3s[881]: I0930 08:31:21.689149 881 shared_informer.go:409] "Caches are synced" machine # [ 22.905382] k3s[881]: time="2026-09-30T08:31:21Z" level=info msg="Waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 22.906263] k3s[881]: I0930 08:31:21.699888 881 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 22.911275] k3s[881]: I0930 08:31:21.705736 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 22.912634] k3s[881]: I0930 08:31:21.707013 881 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 23.416584] k3s[881]: time="2026-09-30T08:31:22Z" level=info msg="Done waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 23.418422] k3s[881]: time="2026-09-30T08:31:22Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-40.1.4+up40.1.0.tgz" machine # [ 23.420221] k3s[881]: time="2026-09-30T08:31:22Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-crd-40.1.4+up40.1.0.tgz" machine # [ 23.422040] k3s[881]: time="2026-09-30T08:31:22Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/ccm.yaml" machine # [ 23.423546] k3s[881]: time="2026-09-30T08:31:22Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/coredns.yaml" machine # [ 23.425094] k3s[881]: time="2026-09-30T08:31:22Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/local-storage.yaml" machine # [ 23.426710] k3s[881]: time="2026-09-30T08:31:22Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/rolebindings.yaml" machine # [ 23.428335] k3s[881]: time="2026-09-30T08:31:22Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/runtimes.yaml" machine # [ 23.429919] k3s[881]: time="2026-09-30T08:31:22Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/traefik.yaml" machine: (finished: waiting for unit k3s.service, in 24.36 seconds) machine: waiting for success: kubectl get ns farm machine # Error from server (NotFound): namespaces "farm" not found machine # [ 23.912515] k3s[881]: time="2026-09-30T08:31:22Z" level=info msg="Starting dynamiclistener CN filter node controller with SANs: [127.0.0.1 ::1 localhost machine 10.0.2.15 fec0::6173:482b:9d22:a7f2 10.43.0.1 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local]" machine # [ 23.915969] k3s[881]: time="2026-09-30T08:31:22Z" level=info msg="Tunnel server egress proxy mode: agent" machine # [ 23.917306] k3s[881]: I0930 08:31:22.705993 881 range_allocator.go:113] "No Secondary Service CIDR provided. Skipping filtering out secondary service addresses" logger="node-ipam-controller" machine # [ 23.919770] k3s[881]: I0930 08:31:22.706043 881 controllermanager.go:689] "Warning: controller is disabled" controller="node-route-controller" machine # [ 23.921511] k3s[881]: I0930 08:31:22.707127 881 shared_informer.go:409] "Caches are synced" machine # [ 23.952468] k3s[881]: time="2026-09-30T08:31:22Z" level=info msg="Creating new TLS secret for kube-system/k3s-serving (count: 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__6173_482b_9d22_a7f2-368e0b:fec0::6173:482b:9d22:a7f2 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=CB35489C91FA8D5F00C1137AEA7285FD0D337DC1]" machine # [ 23.961475] k3s[881]: time="2026-09-30T08:31:22Z" level=info msg="Active TLS secret kube-system/k3s-serving (ver=231) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__6173_482b_9d22_a7f2-368e0b:fec0::6173:482b:9d22:a7f2 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=CB35489C91FA8D5F00C1137AEA7285FD0D337DC1]" machine # [ 24.165761] k3s[881]: I0930 08:31:22.960085 881 controllermanager.go:641] "Warning: skipping controller" controller="storage-version-migrator-controller" machine # [ 24.666166] k3s[881]: I0930 08:31:23.460159 881 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="podcertificaterequest-cleaner-controller" requiredFeatureGates=["PodCertificateRequest"] machine # [ 24.668767] k3s[881]: I0930 08:31:23.460195 881 controllermanager.go:641] "Warning: skipping controller" controller="podcertificaterequest-cleaner-controller" machine # [ 24.670569] k3s[881]: I0930 08:31:23.460209 881 controllermanager.go:689] "Warning: controller is disabled" controller="service-lb-controller" machine # [ 24.672252] k3s[881]: I0930 08:31:23.460220 881 controllermanager.go:689] "Warning: controller is disabled" controller="cloud-node-lifecycle-controller" machine # [ 24.826369] k3s[881]: time="2026-09-30T08:31:23Z" level=info msg="Imported docker.io/library/nix-grpc-farm:0.1.0-beta.4" machine # [ 24.828880] k3s[881]: time="2026-09-30T08:31:23Z" level=info msg="Tagged docker.io/library/nix-grpc-farm@sha256:da43c27044be94bf5c229f1f6e73f6494eaaf6db8df4ef029be3b2694bec1ad5" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 25.228942] k3s[881]: time="2026-09-30T08:31:24Z" level=info msg="Starting k3s.cattle.io/v1, Kind=Addon controller" machine # [ 25.232372] k3s[881]: time="2026-09-30T08:31:24Z" level=info msg="Creating deploy event broadcaster" machine # [ 25.235417] k3s[881]: I0930 08:31:24.024684 881 controller.go:667] quota admission added evaluator for: addons.k3s.cattle.io machine # [ 25.239436] k3s[881]: time="2026-09-30T08:31:24Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 25.242146] k3s[881]: time="2026-09-30T08:31:24Z" level=info msg="Creating helm-controller event broadcaster" machine # [ 25.245078] k3s[881]: time="2026-09-30T08:31:24Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 25.248452] k3s[881]: time="2026-09-30T08:31:24Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=ApplyingManifest type=Normal machine # [ 25.260813] k3s[881]: time="2026-09-30T08:31:24Z" level=info msg="Cluster dns configmap has been set successfully" machine # [ 25.310195] k3s[881]: time="2026-09-30T08:31:24Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nixos/3yy0akcdc603vhkdhb6y36qgxvk4zpw8-nix-grpc-farm.tar in 5.512855124s" machine # [ 25.312906] k3s[881]: time="2026-09-30T08:31:24Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/if20jbcicwv9y92klzcxk35m5bcz2ql0-nix-grpc-farm-lb.tar" machine # [ 25.666538] k3s[881]: I0930 08:31:24.460854 881 controllermanager.go:689] "Warning: controller is disabled" controller="bootstrap-signer-controller" machine # [ 25.821933] k3s[881]: time="2026-09-30T08:31:24Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=AppliedManifest type=Normal machine # [ 25.832468] k3s[881]: time="2026-09-30T08:31:24Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=ApplyingManifest type=Normal machine # [ 25.977158] k3s[881]: time="2026-09-30T08:31:24Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=AppliedManifest type=Normal machine # [ 25.989356] k3s[881]: time="2026-09-30T08:31:24Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=ApplyingManifest type=Normal machine: (finished: waiting for success: kubectl get ns farm, in 2.53 seconds) machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key, in 0.17 seconds) machine: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key machine # [ 26.242449] k3s[881]: time="2026-09-30T08:31:25Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine: (finished: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key, in 0.17 seconds) machine: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine # [ 26.417743] k3s[881]: I0930 08:31:25.212134 881 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="storageversion-garbage-collector-controller" requiredFeatureGates=["APIServerIdentity","StorageVersionAPI"] machine # [ 26.421418] k3s[881]: I0930 08:31:25.212181 881 controllermanager.go:641] "Warning: skipping controller" controller="storageversion-garbage-collector-controller" machine # [ 26.462611] k3s[881]: time="2026-09-30T08:31:25Z" level=info msg="Starting rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding controller" machine # [ 26.467069] k3s[881]: time="2026-09-30T08:31:25Z" level=info msg="Starting batch/v1, Kind=Job controller" machine # [ 26.468347] k3s[881]: time="2026-09-30T08:31:25Z" level=info msg="Starting /v1, Kind=Secret controller" machine # [ 26.469570] k3s[881]: time="2026-09-30T08:31:25Z" level=info msg="Starting /v1, Kind=ConfigMap controller" machine # [ 26.470864] k3s[881]: time="2026-09-30T08:31:25Z" level=info msg="Starting /v1, Kind=ServiceAccount controller" machine # [ 26.474205] k3s[881]: time="2026-09-30T08:31:25Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChart controller" machine # [ 26.474930] k3s[881]: time="2026-09-30T08:31:25Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChartConfig controller" machine # [ 26.570459] k3s[881]: I0930 08:31:25.364781 881 controller.go:667] quota admission added evaluator for: deployments.apps machine: (finished: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.18 seconds) subtest: chart deploys and workers become Ready machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine # [ 26.725859] k3s[881]: I0930 08:31:25.519666 881 alloc.go:329] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.43.0.10"} machine # [ 26.727874] k3s[881]: time="2026-09-30T08:31:25Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=AppliedManifest type=Normal machine # [ 26.767498] k3s[881]: I0930 08:31:25.561892 881 node_lifecycle_controller.go:402] "Controller will reconcile labels" logger="node-lifecycle-controller" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 26.852647] k3s[881]: I0930 08:31:25.646945 881 serving.go:417] Generated self-signed cert in-memory machine # [ 26.910895] k3s[881]: I0930 08:31:25.705278 881 serving.go:417] Generated self-signed cert in-memory machine # [ 27.025895] k3s[881]: I0930 08:31:25.820269 881 controllermanager.go:163] Version: v1.36.4+k3s1 machine # [ 27.030838] k3s[881]: I0930 08:31:25.825166 881 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 27.032294] k3s[881]: I0930 08:31:25.825183 881 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 27.033187] k3s[881]: I0930 08:31:25.825220 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.034119] k3s[881]: I0930 08:31:25.825241 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.035061] k3s[881]: I0930 08:31:25.825297 881 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 27.036435] k3s[881]: I0930 08:31:25.825329 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.037399] k3s[881]: I0930 08:31:25.825420 881 secure_serving.go:214] Serving securely on 127.0.0.1:10258 machine # [ 27.038315] k3s[881]: I0930 08:31:25.825850 881 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 27.040674] k3s[881]: time="2026-09-30T08:31:25Z" level=info msg="Creating service-lb-controller event broadcaster" machine # [ 27.150966] k3s[881]: time="2026-09-30T08:31:25Z" level=info msg="Imported docker.io/library/nix-grpc-farm-lb:0.1.0-beta.4" machine # [ 27.154518] k3s[881]: time="2026-09-30T08:31:25Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-lb@sha256:18ee6724be589622e1aee9d13c5121e7b2c992ca636c935ade90c66423e18f37" machine # [ 27.194413] k3s[881]: time="2026-09-30T08:31:25Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nixos/if20jbcicwv9y92klzcxk35m5bcz2ql0-nix-grpc-farm-lb.tar in 1.883803388s" machine # [ 27.195562] k3s[881]: time="2026-09-30T08:31:25Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/lpsar7bdbpa0p5if0qgd3shj4ilyv7y2-nix-grpc-farm-client.tar" machine # [ 27.232182] k3s[881]: I0930 08:31:26.026054 881 shared_informer.go:409] "Caches are synced" machine # [ 27.233601] k3s[881]: I0930 08:31:26.026077 881 shared_informer.go:409] "Caches are synced" machine # [ 27.234900] k3s[881]: I0930 08:31:26.026111 881 shared_informer.go:409] "Caches are synced" machine # [ 27.240144] k3s[881]: time="2026-09-30T08:31:26Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 27.372489] k3s[881]: I0930 08:31:26.166501 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="serviceaccounts" machine # [ 27.374764] k3s[881]: I0930 08:31:26.166595 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="deployments.apps" machine # [ 27.376940] k3s[881]: I0930 08:31:26.166622 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="daemonsets.apps" machine # [ 27.379224] k3s[881]: I0930 08:31:26.166652 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="jobs.batch" machine # [ 27.381328] k3s[881]: I0930 08:31:26.166677 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpoints" machine # [ 27.383334] k3s[881]: I0930 08:31:26.166712 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="rolebindings.rbac.authorization.k8s.io" machine # [ 27.385640] k3s[881]: I0930 08:31:26.166767 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="addons.k3s.cattle.io" machine # [ 27.387797] k3s[881]: I0930 08:31:26.166835 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="cronjobs.batch" machine # [ 27.389951] k3s[881]: I0930 08:31:26.166858 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="leases.coordination.k8s.io" machine # [ 27.392413] k3s[881]: I0930 08:31:26.166883 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmcharts.helm.cattle.io" machine # [ 27.394781] k3s[881]: I0930 08:31:26.166908 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="poddisruptionbudgets.policy" machine # [ 27.397375] k3s[881]: I0930 08:31:26.166957 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="replicasets.apps" machine # [ 27.399805] k3s[881]: I0930 08:31:26.167000 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="ingresses.networking.k8s.io" machine # [ 27.402257] k3s[881]: I0930 08:31:26.167025 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="limitranges" machine # [ 27.404613] k3s[881]: I0930 08:31:26.167052 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="podtemplates" machine # [ 27.407036] k3s[881]: I0930 08:31:26.167094 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="networkpolicies.networking.k8s.io" machine # [ 27.409662] k3s[881]: I0930 08:31:26.167127 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="roles.rbac.authorization.k8s.io" machine # [ 27.411928] k3s[881]: I0930 08:31:26.167154 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="csistoragecapacities.storage.k8s.io" machine # [ 27.415097] k3s[881]: I0930 08:31:26.167179 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="statefulsets.apps" machine # [ 27.417473] k3s[881]: I0930 08:31:26.167204 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="horizontalpodautoscalers.autoscaling" machine # [ 27.420276] k3s[881]: I0930 08:31:26.167243 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpointslices.discovery.k8s.io" machine # [ 27.422889] k3s[881]: I0930 08:31:26.167267 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="resourceclaimtemplates.resource.k8s.io" machine # [ 27.425665] k3s[881]: I0930 08:31:26.167306 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="controllerrevisions.apps" machine # [ 27.428262] k3s[881]: I0930 08:31:26.167330 881 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmchartconfigs.helm.cattle.io" machine # [ 27.567150] k3s[881]: W0930 08:31:26.360792 881 probe.go:275] Flexvolume plugin directory at /usr/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating. machine # [ 27.624758] k3s[881]: time="2026-09-30T08:31:26Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 27.630432] k3s[881]: time="2026-09-30T08:31:26Z" level=info msg="Starting /v1, Kind=Pod controller" machine # [ 27.635186] k3s[881]: time="2026-09-30T08:31:26Z" level=info msg="Starting apps/v1, Kind=DaemonSet controller" machine # [ 27.639252] k3s[881]: I0930 08:31:26.433645 881 controllermanager.go:338] Started "cloud-node-lifecycle-controller" machine # [ 27.640033] k3s[881]: time="2026-09-30T08:31:26Z" level=info msg="Starting discovery.k8s.io/v1, Kind=EndpointSlice controller" machine # [ 27.640547] k3s[881]: I0930 08:31:26.433833 881 node_lifecycle_controller.go:112] Sending events to api server machine # [ 27.643593] k3s[881]: I0930 08:31:26.438015 881 controllermanager.go:338] Started "service-lb-controller" machine # [ 27.644482] k3s[881]: W0930 08:31:26.438038 881 controllermanager.go:315] "node-route-controller" is disabled machine # [ 27.645115] k3s[881]: I0930 08:31:26.438230 881 controller.go:235] Starting service controller machine # [ 27.645604] k3s[881]: I0930 08:31:26.438261 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.648534] k3s[881]: I0930 08:31:26.442967 881 controllermanager.go:338] Started "cloud-node-controller" machine # [ 27.649280] k3s[881]: I0930 08:31:26.443223 881 node_controller.go:179] Sending events to api server. machine # [ 27.649702] k3s[881]: I0930 08:31:26.443299 881 node_controller.go:188] Waiting for informer caches to sync machine # [ 27.718158] k3s[881]: time="2026-09-30T08:31:26Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" object=kube-system/local-storage reason=DeletingManifest type=Normal machine # [ 27.723070] k3s[881]: I0930 08:31:26.514877 881 clusterroleaggregation_controller.go:176] "Starting ClusterRoleAggregator controller" machine # [ 27.723725] k3s[881]: I0930 08:31:26.514915 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.725759] k3s[881]: I0930 08:31:26.520156 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.726525] k3s[881]: I0930 08:31:26.520211 881 gc_controller.go:98] "Starting GC controller" machine # [ 27.727274] k3s[881]: I0930 08:31:26.520224 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.727844] k3s[881]: I0930 08:31:26.520256 881 legacy_serviceaccount_token_cleaner.go:103] "Starting legacy service account token cleaner controller" machine # [ 27.728483] k3s[881]: I0930 08:31:26.520271 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.728939] k3s[881]: I0930 08:31:26.520302 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.729648] k3s[881]: I0930 08:31:26.520406 881 cronjob_controllerv2.go:143] "Starting cronjob controller v2" machine # [ 27.734381] k3s[881]: I0930 08:31:26.520419 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.734930] k3s[881]: I0930 08:31:26.520621 881 node_ipam_controller.go:142] "Starting ipam controller" machine # [ 27.735627] k3s[881]: I0930 08:31:26.520637 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.736196] k3s[881]: I0930 08:31:26.520690 881 expand_controller.go:328] "Starting expand controller" machine # [ 27.736664] k3s[881]: I0930 08:31:26.520757 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.737237] k3s[881]: I0930 08:31:26.520790 881 vac_protection_controller.go:206] "Starting VAC protection controller" machine # [ 27.737693] k3s[881]: I0930 08:31:26.520808 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.738237] k3s[881]: I0930 08:31:26.520844 881 publisher.go:107] "Starting root CA cert publisher controller" machine # [ 27.738713] k3s[881]: I0930 08:31:26.520860 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.739249] k3s[881]: I0930 08:31:26.520930 881 servicecidrs_controller.go:137] "Starting" controller="service-cidr-controller" machine # [ 27.739689] k3s[881]: I0930 08:31:26.520951 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.740219] k3s[881]: I0930 08:31:26.520982 881 namespace_controller.go:202] "Starting namespace controller" machine # [ 27.740849] k3s[881]: I0930 08:31:26.520995 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.741537] k3s[881]: I0930 08:31:26.521214 881 deployment_controller.go:180] "Starting controller" controller="deployment" machine # [ 27.742017] k3s[881]: I0930 08:31:26.521228 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.742529] k3s[881]: I0930 08:31:26.521261 881 certificate_controller.go:120] "Starting certificate controller" name="csrapproving" machine # [ 27.742989] k3s[881]: I0930 08:31:26.521275 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.743655] k3s[881]: I0930 08:31:26.521304 881 tokencleaner.go:117] "Starting token cleaner controller" machine # [ 27.744233] k3s[881]: I0930 08:31:26.521316 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.744840] k3s[881]: I0930 08:31:26.521347 881 device_taint_eviction.go:783] "Starting" controller="device-taint-eviction-controller" numWorkers=8 machine # [ 27.745551] k3s[881]: I0930 08:31:26.521472 881 taint_eviction.go:283] "Starting" controller="taint-eviction-controller" machine # [ 27.746059] k3s[881]: I0930 08:31:26.521579 881 taint_eviction.go:288] "Sending events to API server" machine # [ 27.746563] k3s[881]: I0930 08:31:26.521589 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.747094] k3s[881]: I0930 08:31:26.521618 881 serviceaccounts_controller.go:117] "Starting service account controller" machine # [ 27.747618] k3s[881]: I0930 08:31:26.521631 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.748123] k3s[881]: I0930 08:31:26.521694 881 job_controller.go:336] "Starting job controller" machine # [ 27.748842] k3s[881]: I0930 08:31:26.521738 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.749686] k3s[881]: I0930 08:31:26.521802 881 stateful_set.go:234] "Starting stateful set controller" machine # [ 27.750258] k3s[881]: I0930 08:31:26.521815 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.750742] k3s[881]: I0930 08:31:26.521887 881 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-legacy-unknown" machine # [ 27.751416] k3s[881]: I0930 08:31:26.521899 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.751876] k3s[881]: I0930 08:31:26.521971 881 pv_controller_base.go:318] "Starting persistent volume controller" machine # [ 27.752406] k3s[881]: I0930 08:31:26.521984 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.752866] k3s[881]: I0930 08:31:26.522091 881 endpoints_controller.go:193] "Starting endpoint controller" machine # [ 27.753412] k3s[881]: I0930 08:31:26.522112 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.753895] k3s[881]: I0930 08:31:26.522174 881 daemon_controller.go:364] "Starting daemon sets controller" machine # [ 27.754616] k3s[881]: I0930 08:31:26.522187 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.755197] k3s[881]: I0930 08:31:26.522256 881 replica_set.go:285] "Starting controller" name="replicaset" machine # [ 27.755671] k3s[881]: I0930 08:31:26.522269 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.756531] k3s[881]: I0930 08:31:26.522305 881 horizontal.go:204] "Starting HPA controller" machine # [ 27.757026] k3s[881]: I0930 08:31:26.522317 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.757609] k3s[881]: I0930 08:31:26.522348 881 disruption.go:453] "Sending events to api server." machine # [ 27.757982] k3s[881]: I0930 08:31:26.522377 881 disruption.go:460] "Starting disruption controller" machine # [ 27.758661] k3s[881]: I0930 08:31:26.522387 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.759204] k3s[881]: I0930 08:31:26.522419 881 pvc_protection_controller.go:172] "Starting PVC protection controller" machine # [ 27.759646] k3s[881]: I0930 08:31:26.522431 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.760180] k3s[881]: I0930 08:31:26.522466 881 ttlafterfinished_controller.go:112] "Starting TTL after finished controller" machine # [ 27.760648] k3s[881]: I0930 08:31:26.522479 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.761174] k3s[881]: I0930 08:31:26.522578 881 endpointslice_controller.go:280] "Starting endpoint slice controller" machine # [ 27.761621] k3s[881]: I0930 08:31:26.522590 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.762175] k3s[881]: I0930 08:31:26.522627 881 ttl_controller.go:127] "Starting TTL controller" machine # [ 27.762672] k3s[881]: I0930 08:31:26.522641 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.763194] k3s[881]: I0930 08:31:26.522677 881 controller.go:174] "Starting ephemeral volume controller" machine # [ 27.763666] k3s[881]: I0930 08:31:26.522691 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.764174] k3s[881]: I0930 08:31:26.528832 881 controller.go:753] "Starting resource claim controller" machine # [ 27.764717] k3s[881]: I0930 08:31:26.528852 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.765197] k3s[881]: I0930 08:31:26.528921 881 pv_protection_controller.go:81] "Starting PV protection controller" machine # [ 27.765645] k3s[881]: I0930 08:31:26.528974 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.766190] k3s[881]: I0930 08:31:26.529040 881 node_lifecycle_controller.go:436] "Sending events to api server" machine # [ 27.766644] k3s[881]: I0930 08:31:26.529077 881 node_lifecycle_controller.go:443] "Starting node controller" machine # [ 27.767471] k3s[881]: I0930 08:31:26.529087 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.767955] k3s[881]: I0930 08:31:26.529169 881 endpointslicemirroring_controller.go:226] "Starting EndpointSliceMirroring controller" machine # [ 27.768632] k3s[881]: I0930 08:31:26.529187 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.769210] k3s[881]: I0930 08:31:26.529265 881 replica_set.go:285] "Starting controller" name="replicationcontroller" machine # [ 27.769653] k3s[881]: I0930 08:31:26.529283 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.770811] k3s[881]: I0930 08:31:26.529670 881 cleaner.go:83] "Starting CSR cleaner controller" machine # [ 27.810206] k3s[881]: I0930 08:31:26.529813 881 attach_detach_controller.go:334] "Starting attach detach controller" machine # [ 27.810776] k3s[881]: I0930 08:31:26.529837 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.811470] k3s[881]: I0930 08:31:26.531415 881 resource_quota_controller.go:297] "Starting resource quota controller" machine # [ 27.811960] k3s[881]: I0930 08:31:26.531440 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.812338] k3s[881]: I0930 08:31:26.532193 881 resource_quota_monitor.go:309] "QuotaMonitor running" machine # [ 27.812799] k3s[881]: I0930 08:31:26.533116 881 garbagecollector.go:141] "Starting controller" controller="garbagecollector" machine # [ 27.813485] k3s[881]: I0930 08:31:26.533151 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.813951] k3s[881]: I0930 08:31:26.533204 881 device_taint_eviction.go:823] "Sending events to api server" machine # [ 27.814142] k3s[881]: I0930 08:31:26.533345 881 device_taint_eviction.go:1023] "Waiting" for="cache and event handler sync" machine # [ 27.814602] k3s[881]: I0930 08:31:26.533430 881 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-serving" machine # [ 27.815096] k3s[881]: I0930 08:31:26.533443 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.815613] k3s[881]: I0930 08:31:26.533474 881 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-client" machine # [ 27.816115] k3s[881]: I0930 08:31:26.533552 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.816620] k3s[881]: I0930 08:31:26.533646 881 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kube-apiserver-client" machine # [ 27.817091] k3s[881]: I0930 08:31:26.533665 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.817632] k3s[881]: I0930 08:31:26.533698 881 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 27.818172] k3s[881]: I0930 08:31:26.534662 881 graph_builder.go:387] "Running" component="GraphBuilder" machine # [ 27.818611] k3s[881]: I0930 08:31:26.534761 881 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 27.818953] k3s[881]: I0930 08:31:26.534966 881 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 27.819044] k3s[881]: I0930 08:31:26.535150 881 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 27.819554] k3s[881]: I0930 08:31:26.536775 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.820108] k3s[881]: time="2026-09-30T08:31:26Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=ApplyingManifest type=Normal machine # [ 27.845136] k3s[881]: I0930 08:31:26.638458 881 shared_informer.go:409] "Caches are synced" machine # [ 27.887713] k3s[881]: I0930 08:31:26.682015 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.926472] k3s[881]: I0930 08:31:26.720911 881 shared_informer.go:409] "Caches are synced" machine # [ 27.926938] k3s[881]: I0930 08:31:26.721416 881 shared_informer.go:409] "Caches are synced" machine # [ 27.929193] k3s[881]: I0930 08:31:26.723651 881 controller.go:667] quota admission added evaluator for: helmcharts.helm.cattle.io machine # [ 27.930020] k3s[881]: I0930 08:31:26.724475 881 shared_informer.go:409] "Caches are synced" machine # [ 27.937720] k3s[881]: I0930 08:31:26.731727 881 shared_informer.go:409] "Caches are synced" machine # [ 27.939777] k3s[881]: time="2026-09-30T08:31:26Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=AppliedManifest type=Normal machine # [ 27.966396] k3s[881]: time="2026-09-30T08:31:26Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=ApplyingManifest type=Normal machine # [ 28.002557] k3s[881]: I0930 08:31:26.796903 881 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.DeviceClass" machine # [ 28.005645] k3s[881]: I0930 08:31:26.800094 881 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.Pod" machine # [ 28.006555] k3s[881]: I0930 08:31:26.801026 881 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.Pod + event handler k8s.io/kubernetes/pkg/controller/devicetainteviction.(*Controller).Run" machine # [ 28.013464] k3s[881]: I0930 08:31:26.807907 881 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceSlice + event handler k8s.io/kubernetes/pkg/controller/devicetainteviction.(*Controller).Run" machine # [ 28.014150] k3s[881]: I0930 08:31:26.807983 881 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceClaim" machine # [ 28.018445] k3s[881]: I0930 08:31:26.812838 881 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceClaim + event handler k8s.io/kubernetes/pkg/controller/devicetainteviction.(*Controller).Run" machine # [ 28.020349] k3s[881]: I0930 08:31:26.814795 881 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceSlice" machine # [ 28.026060] k3s[881]: I0930 08:31:26.818905 881 shared_informer.go:409] "Caches are synced" machine # [ 28.026662] k3s[881]: I0930 08:31:26.820216 881 shared_informer.go:409] "Caches are synced" machine # [ 28.027472] k3s[881]: I0930 08:31:26.820261 881 shared_informer.go:409] "Caches are synced" machine # [ 28.027930] k3s[881]: I0930 08:31:26.820316 881 shared_informer.go:409] "Caches are synced" machine # [ 28.028935] k3s[881]: I0930 08:31:26.823408 881 shared_informer.go:409] "Caches are synced" machine # [ 28.030303] k3s[881]: I0930 08:31:26.824721 881 shared_informer.go:409] "Caches are synced" machine # [ 28.032376] k3s[881]: I0930 08:31:26.826847 881 shared_informer.go:409] "Caches are synced" machine # [ 28.033387] k3s[881]: I0930 08:31:26.827864 881 shared_informer.go:409] "Caches are synced" machine # [ 28.035117] k3s[881]: I0930 08:31:26.828674 881 range_allocator.go:177] "Sending events to api server" machine # [ 28.035704] k3s[881]: I0930 08:31:26.828770 881 range_allocator.go:181] "Starting range CIDR allocator" machine # [ 28.036250] k3s[881]: I0930 08:31:26.828781 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.036741] k3s[881]: I0930 08:31:26.828792 881 shared_informer.go:409] "Caches are synced" machine # [ 28.037979] k3s[881]: I0930 08:31:26.828941 881 shared_informer.go:409] "Caches are synced" machine # [ 28.038907] k3s[881]: I0930 08:31:26.828982 881 shared_informer.go:409] "Caches are synced" machine # [ 28.040193] k3s[881]: I0930 08:31:26.829031 881 shared_informer.go:409] "Caches are synced" machine # [ 28.040620] k3s[881]: I0930 08:31:26.829151 881 shared_informer.go:409] "Caches are synced" machine # [ 28.041177] k3s[881]: I0930 08:31:26.829279 881 shared_informer.go:409] "Caches are synced" machine # [ 28.041642] k3s[881]: I0930 08:31:26.829387 881 shared_informer.go:409] "Caches are synced" machine # [ 28.046130] k3s[881]: I0930 08:31:26.829428 881 shared_informer.go:409] "Caches are synced" machine # [ 28.046767] k3s[881]: I0930 08:31:26.829933 881 shared_informer.go:409] "Caches are synced" machine # [ 28.047273] k3s[881]: I0930 08:31:26.831500 881 shared_informer.go:409] "Caches are synced" machine # [ 28.047720] k3s[881]: I0930 08:31:26.832009 881 shared_informer.go:409] "Caches are synced" machine # [ 28.048421] k3s[881]: I0930 08:31:26.833686 881 shared_informer.go:409] "Caches are synced" machine # [ 28.048950] k3s[881]: I0930 08:31:26.833732 881 shared_informer.go:409] "Caches are synced" machine # [ 28.049617] k3s[881]: I0930 08:31:26.833773 881 shared_informer.go:409] "Caches are synced" machine # [ 28.050132] k3s[881]: I0930 08:31:26.834056 881 shared_informer.go:409] "Caches are synced" machine # [ 28.050624] k3s[881]: I0930 08:31:26.836674 881 shared_informer.go:409] "Caches are synced" machine # [ 28.051206] k3s[881]: I0930 08:31:26.836802 881 shared_informer.go:409] "Caches are synced" machine # [ 28.051716] k3s[881]: I0930 08:31:26.836828 881 shared_informer.go:409] "Caches are synced" machine # [ 28.052246] k3s[881]: I0930 08:31:26.836838 881 shared_informer.go:409] "Caches are synced" machine # [ 28.052725] k3s[881]: I0930 08:31:26.836878 881 shared_informer.go:409] "Caches are synced" machine # [ 28.053459] k3s[881]: I0930 08:31:26.847931 881 shared_informer.go:409] "Caches are synced" machine # [ 28.053982] k3s[881]: I0930 08:31:26.848458 881 shared_informer.go:409] "Caches are synced" machine # [ 28.054838] k3s[881]: I0930 08:31:26.849315 881 shared_informer.go:409] "Caches are synced" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 28.058067] k3s[881]: I0930 08:31:26.850217 881 shared_informer.go:409] "Caches are synced" machine # [ 28.058786] k3s[881]: I0930 08:31:26.850262 881 shared_informer.go:409] "Caches are synced" machine # [ 28.059139] k3s[881]: I0930 08:31:26.850290 881 shared_informer.go:409] "Caches are synced" machine # [ 28.059643] k3s[881]: I0930 08:31:26.850323 881 shared_informer.go:409] "Caches are synced" machine # [ 28.060137] k3s[881]: I0930 08:31:26.850371 881 shared_informer.go:409] "Caches are synced" machine # [ 28.060653] k3s[881]: I0930 08:31:26.850460 881 shared_informer.go:409] "Caches are synced" machine # [ 28.061177] k3s[881]: I0930 08:31:26.852083 881 shared_informer.go:409] "Caches are synced" machine # [ 28.091947] k3s[881]: time="2026-09-30T08:31:26Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Deferred node password secret validation complete" object=machine reason=NodePasswordValidationComplete type=Normal machine # [ 28.097963] k3s[881]: time="2026-09-30T08:31:26Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Applying HelmChart from https://%{KUBERNETES_API}%/static/charts/nix-grpc-farm.tgz using Job kube-system/helm-install-nix-grpc-farm " object=kube-system/nix-grpc-farm reason=ApplyJob type=Normal machine # [ 28.118613] k3s[881]: I0930 08:31:26.913026 881 controller.go:667] quota admission added evaluator for: jobs.batch machine # [ 28.127321] k3s[881]: I0930 08:31:26.921426 881 shared_informer.go:409] "Caches are synced" machine # [ 28.235727] k3s[881]: time="2026-09-30T08:31:27Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=AppliedManifest type=Normal machine # [ 28.240109] k3s[881]: time="2026-09-30T08:31:27Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 28.246034] k3s[881]: time="2026-09-30T08:31:27Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=ApplyingManifest type=Normal machine # [ 28.357210] k3s[881]: time="2026-09-30T08:31:27Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=AppliedManifest type=Normal machine # [ 28.367898] k3s[881]: I0930 08:31:27.162272 881 controller.go:667] quota admission added evaluator for: replicasets.apps machine # [ 28.424600] k3s[881]: time="2026-09-30T08:31:27Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/traefik.yaml\"" object=kube-system/traefik reason=DeletingManifest type=Normal machine # [ 28.739573] k3s[881]: time="2026-09-30T08:31:27Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Resumed synced Job kube-system/helm-install-nix-grpc-farm" object=kube-system/nix-grpc-farm reason=ResumeJob type=Normal machine # [ 28.770109] k3s[881]: I0930 08:31:27.564338 881 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 28.773299] k3s[881]: I0930 08:31:27.567605 881 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 28.939541] k3s[881]: I0930 08:31:27.733793 881 shared_informer.go:409] "Caches are synced" machine # [ 28.940862] k3s[881]: I0930 08:31:27.733825 881 garbagecollector.go:166] "Garbage collector: all resource monitors have synced" machine # [ 28.942451] k3s[881]: I0930 08:31:27.733836 881 garbagecollector.go:169] "Proceeding to collect garbage" machine # [ 28.988790] k3s[881]: I0930 08:31:27.783159 881 shared_informer.go:409] "Caches are synced" machine # [ 29.241771] k3s[881]: time="2026-09-30T08:31:28Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 29.551378] postgres[1193]: [1193] ERROR: relation "goose_db_version" does not exist at character 36 machine # [ 29.552182] postgres[1193]: [1193] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC machine # [ 29.579498] niks3-server[1185]: 2026/09/30 08:31:28 OK 20241026095416_initial_model.sql (9.87ms) machine # [ 29.582616] niks3-server[1185]: 2026/09/30 08:31:28 OK 20251210153512_drop_unused_gin_index.sql (3.02ms) machine # [ 29.588882] niks3-server[1185]: 2026/09/30 08:31:28 OK 20251218171726_add_pins.sql (6.21ms) machine # [ 29.593830] niks3-server[1185]: 2026/09/30 08:31:28 OK 20260628120000_add_object_size_and_stats.sql (4.03ms) machine # [ 29.597709] niks3-server[1185]: 2026/09/30 08:31:28 OK 20260905000000_add_claims.sql (3.55ms) machine # [ 29.601366] niks3-server[1185]: 2026/09/30 08:31:28 OK 20260920000000_drop_claims.sql (3.77ms) machine # [ 29.604433] niks3-server[1185]: 2026/09/30 08:31:28 OK 20260923120000_add_pushes.sql (3ms) machine # [ 29.605084] niks3-server[1185]: 2026/09/30 08:31:28 goose: successfully migrated database to version: 20260923120000 machine # [ 29.610472] niks3-server[1185]: 2026/09/30 08:31:28 OK 1_commit_pending_closure.sql (3.63ms) machine # [ 29.613267] niks3-server[1185]: 2026/09/30 08:31:28 OK 2_object_stats_trigger.sql (2.76ms) machine # [ 29.615931] niks3-server[1185]: 2026/09/30 08:31:28 OK 3_commit_push.sql (1.9ms) machine # [ 29.616636] niks3-server[1185]: 2026/09/30 08:31:28 goose: up to current file version: 3 machine # [ 29.619985] niks3-server[1185]: 2026/09/30 08:31:28 INFO OIDC provider initialized name=kubernetes issuer=https://kubernetes.default.svc.cluster.local machine # [ 29.620699] niks3-server[1185]: 2026/09/30 08:31:28 INFO OIDC authentication enabled config=/nix/store/v0b0sqyzhrjsz48x3klf7b7vl89apzs0-niks3-oidc.json machine # [ 29.623779] niks3-server[1185]: 2026/09/30 08:31:28 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key machine # [ 29.654377] niks3-server[1185]: 2026/09/30 08:31:28 INFO Read proxy enabled — serving cache objects from S3 machine # [ 29.656127] niks3-server[1185]: 2026/09/30 08:31:28 INFO Using socket-activated listener address=0.0.0.0:5751 machine # [ 29.657673] niks3-server[1185]: 2026/09/30 08:31:28 INFO systemd watchdog enabled interval=15s machine # [ 29.659603] niks3-server[1185]: 2026/09/30 08:31:28 INFO Starting HTTP server address=0.0.0.0:5751 machine # [ 29.661079] systemd[1]: Started niks3 server. machine # [ 29.661683] systemd[1]: Reached target Multi-User System. machine # [ 29.662515] systemd[1]: Startup finished in 1.133s (kernel) + 3.782s (initrd) + 24.739s (userspace) = 29.656s. machine # [ 30.242730] k3s[881]: time="2026-09-30T08:31:29Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 31.241385] k3s[881]: time="2026-09-30T08:31:30Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 31.912457] k3s[881]: time="2026-09-30T08:31:30Z" level=info msg="Started tunnel to 10.0.2.15:6443" machine # [ 31.913441] k3s[881]: time="2026-09-30T08:31:30Z" level=info msg="Stopped tunnel to 127.0.0.1:6443" machine # [ 31.913852] k3s[881]: time="2026-09-30T08:31:30Z" level=info msg="Connecting to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 31.914511] k3s[881]: time="2026-09-30T08:31:30Z" level=info msg="Proxy done" err="context canceled" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 31.915220] k3s[881]: time="2026-09-30T08:31:30Z" level=info msg="error in remotedialer server [400]: websocket: close 1006 (abnormal closure): unexpected EOF" machine # [ 31.921340] k3s[881]: time="2026-09-30T08:31:30Z" level=info msg="Handling backend connection request [machine]" machine # [ 31.921983] k3s[881]: time="2026-09-30T08:31:30Z" level=info msg="Connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 31.922484] k3s[881]: time="2026-09-30T08:31:30Z" level=info msg="Remotedialer connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 32.241364] k3s[881]: time="2026-09-30T08:31:31Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 33.240965] k3s[881]: time="2026-09-30T08:31:32Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 34.155663] k3s[881]: time="2026-09-30T08:31:32Z" level=info msg="Imported docker.io/library/nix-grpc-farm-client:0.1.0-beta.4" machine # [ 34.157952] k3s[881]: time="2026-09-30T08:31:32Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-client@sha256:a4187b7457f0803e3e5e9ebfd1c80f3b7bac97bcf7cb18e54f3176e12987fe43" machine # [ 34.241217] k3s[881]: time="2026-09-30T08:31:33Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 34.491208] k3s[881]: time="2026-09-30T08:31:33Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nixos/lpsar7bdbpa0p5if0qgd3shj4ilyv7y2-nix-grpc-farm-client.tar in 7.29549817s" machine # [ 34.496950] k3s[881]: time="2026-09-30T08:31:33Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/smddpgqzjvlqv3lx57wdzl7kma805fj0-k3s-airgap-images-amd64.tar.zst" machine # [ 34.818750] k3s[881]: time="2026-09-30T08:31:33Z" level=info msg="Running kubelet --cloud-provider=external --config-dir=/var/lib/rancher/k3s/agent/etc/kubelet.conf.d --containerd=/run/k3s/containerd/containerd.sock --eviction-hard=nodefs.available<1%,imagefs.available<1% --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubelet.kubeconfig --node-ip=10.0.2.15,fec0::6173:482b:9d22:a7f2 --node-labels= --read-only-port=0" machine # [ 34.820751] k3s[881]: Flag --containerd has been deprecated, This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed. machine # [ 34.837547] k3s[881]: I0930 08:31:33.631908 881 server.go:541] "Kubelet version" kubeletVersion="v1.36.4+k3s1" machine # [ 34.838979] k3s[881]: I0930 08:31:33.631950 881 server.go:543] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 34.840770] k3s[881]: I0930 08:31:33.631994 881 watchdog_linux.go:94] "Systemd watchdog is not enabled" machine # [ 34.842064] k3s[881]: I0930 08:31:33.632015 881 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." machine # [ 34.843441] k3s[881]: I0930 08:31:33.635447 881 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/agent/client-ca.crt" machine # [ 34.848697] k3s[881]: I0930 08:31:33.643110 881 server.go:1444] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" machine # [ 34.855782] k3s[881]: I0930 08:31:33.650183 881 server.go:804] "--cgroups-per-qos enabled, but --cgroup-root was not specified. Defaulting to /" machine # [ 34.856705] k3s[881]: I0930 08:31:33.650219 881 server.go:865] "NoSwap is set due to memorySwapBehavior not specified" memorySwapBehavior="" FailSwapOn=false machine # [ 34.857763] k3s[881]: I0930 08:31:33.650421 881 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] machine # [ 34.858698] k3s[881]: I0930 08:31:33.650442 881 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"machine","RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"MemoryReservationPolicy":"None","PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} machine # [ 34.859831] k3s[881]: I0930 08:31:33.650748 881 topology_manager.go:172] "Creating topology manager with none policy" machine # [ 34.860713] k3s[881]: I0930 08:31:33.650764 881 container_manager_linux.go:309] "Creating device plugin manager" machine # [ 34.861729] k3s[881]: I0930 08:31:33.650839 881 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" machine # [ 34.862851] k3s[881]: I0930 08:31:33.657166 881 state_mem.go:45] "Initialized" logger="CPUManager state memory" machine # [ 34.863775] k3s[881]: I0930 08:31:33.657451 881 kubelet.go:485] "Attempting to sync node with API server" machine # [ 34.864607] k3s[881]: I0930 08:31:33.657476 881 kubelet.go:386] "Adding static pod path" path="/var/lib/rancher/k3s/agent/pod-manifests" machine # [ 34.865484] k3s[881]: I0930 08:31:33.657540 881 kubelet.go:397] "Adding apiserver pod source" machine # [ 34.866275] k3s[881]: I0930 08:31:33.657554 881 apiserver.go:41] "Waiting for node sync before watching apiserver pods" machine # [ 34.866885] k3s[881]: I0930 08:31:33.661056 881 kuberuntime_manager.go:308] "Container runtime initialized" containerRuntime="containerd" version="2.3.4-k3s1.36" apiVersion="v1" machine # [ 34.868618] k3s[881]: I0930 08:31:33.662991 881 kubelet.go:1002] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" machine # [ 34.869602] k3s[881]: I0930 08:31:33.663069 881 kubelet.go:1029] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" machine # [ 34.874272] k3s[881]: I0930 08:31:33.668710 881 server.go:1280] "Started kubelet" machine # [ 34.877371] k3s[881]: I0930 08:31:33.671683 881 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" machine # [ 34.880956] k3s[881]: I0930 08:31:33.675131 881 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 34.881727] k3s[881]: I0930 08:31:33.675206 881 volume_manager.go:310] "Starting Kubelet Volume Manager" machine # [ 34.882268] k3s[881]: I0930 08:31:33.675289 881 server.go:193] "Starting to listen" address="0.0.0.0" port=10250 machine # [ 34.882730] k3s[881]: I0930 08:31:33.676108 881 desired_state_of_world_populator.go:146] "Desired state populator starts to run" machine # [ 34.883678] k3s[881]: I0930 08:31:33.676169 881 reconciler.go:29] "Reconciler: start to sync state" machine # [ 34.884608] k3s[881]: I0930 08:31:33.677188 881 server.go:354] "Adding debug handlers to kubelet server" machine # [ 34.885212] k3s[881]: I0930 08:31:33.679038 881 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 machine # [ 34.885912] k3s[881]: I0930 08:31:33.679177 881 server_v1.go:49] "podresources" method="list" useActivePods=true machine # [ 34.887025] k3s[881]: I0930 08:31:33.679391 881 server.go:264] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" machine # [ 34.887496] k3s[881]: I0930 08:31:33.680377 881 dynamic_serving_content.go:135] "Starting controller" name="kubelet-server-cert-files::/var/lib/rancher/k3s/agent/serving-kubelet.crt::/var/lib/rancher/k3s/agent/serving-kubelet.key" machine # [ 34.887944] k3s[881]: E0930 08:31:33.681917 881 kubelet.go:1725] "Image garbage collection failed once. Stats initialization may not have completed yet" err="invalid capacity 0 on image filesystem" machine # [ 34.890836] k3s[881]: E0930 08:31:33.685277 881 kubelet_node_status.go:396] "Error getting the current node from lister" err="node \"machine\" not found" machine # [ 34.891780] k3s[881]: E0930 08:31:33.686222 881 kubelet.go:3516] "Unable to register mirror pod because node is not registered yet" err="node \"machine\" not found" node="machine" machine # [ 34.893318] k3s[881]: I0930 08:31:33.687761 881 factory.go:222] Registration of the systemd container factory successfully machine # [ 34.894045] k3s[881]: I0930 08:31:33.687924 881 factory.go:220] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory machine # [ 34.894969] k3s[881]: I0930 08:31:33.689403 881 factory.go:222] Registration of the containerd container factory successfully machine # [ 34.896104] k3s[881]: E0930 08:31:33.690555 881 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"machine\" not found" node="machine" machine # [ 34.927359] k3s[881]: I0930 08:31:33.721730 881 cpu_manager.go:235] "Starting" policy="none" machine # [ 34.928213] k3s[881]: I0930 08:31:33.721754 881 cpu_manager.go:236] "Reconciling" reconcilePeriod="10s" machine # [ 34.928866] k3s[881]: I0930 08:31:33.721826 881 state_mem.go:45] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" machine # [ 34.935612] k3s[881]: I0930 08:31:33.729662 881 policy_none.go:50] "Start" machine # [ 34.936514] k3s[881]: I0930 08:31:33.729714 881 memory_manager.go:190] "Starting memorymanager" policy="None" machine # [ 34.937388] k3s[881]: I0930 08:31:33.729741 881 state_mem.go:40] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" machine # [ 34.943290] k3s[881]: I0930 08:31:33.737730 881 policy_none.go:44] "Start" machine # [ 34.950949] systemd[1]: Created slice libcontainer container kubepods.slice. machine # [ 34.961474] systemd[1]: Created slice libcontainer container kubepods-besteffort.slice. machine # [ 34.972633] systemd[1]: Created slice libcontainer container kubepods-burstable.slice. machine # [ 34.975056] k3s[881]: E0930 08:31:33.769428 881 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" machine # [ 34.975535] k3s[881]: I0930 08:31:33.769577 881 eviction_manager.go:194] "Eviction manager: starting control loop" machine # [ 34.975985] k3s[881]: I0930 08:31:33.769595 881 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" machine # [ 34.976681] k3s[881]: I0930 08:31:33.769906 881 plugin_manager.go:121] "Starting Kubelet Plugin Manager" machine # [ 34.984498] k3s[881]: E0930 08:31:33.778899 881 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="no imagefs label for configured runtime" machine # [ 34.984966] k3s[881]: E0930 08:31:33.778954 881 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"machine\" not found" machine # [ 34.992554] k3s[881]: E0930 08:31:33.786980 881 kubelet.go:3516] "Unable to register mirror pod because node is not registered yet" err="node \"machine\" not found" node="machine" machine # [ 35.059300] k3s[881]: I0930 08:31:33.853708 881 kubelet_network_linux.go:53] "Initialized iptables rules." protocol="IPv4" machine # [ 35.067841] k3s[881]: I0930 08:31:33.862255 881 kubelet_network_linux.go:53] "Initialized iptables rules." protocol="IPv6" machine # [ 35.068545] k3s[881]: I0930 08:31:33.862327 881 status_manager.go:277] "Starting to sync pod status with apiserver" machine # [ 35.070238] k3s[881]: I0930 08:31:33.864622 881 kubelet.go:2622] "Starting kubelet main sync loop" machine # [ 35.071238] k3s[881]: E0930 08:31:33.865402 881 kubelet.go:2646] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" machine # [ 35.078533] k3s[881]: I0930 08:31:33.872967 881 kubelet_node_status.go:75] "Attempting to register node" node="machine" machine # [ 35.088043] k3s[881]: I0930 08:31:33.882404 881 kubelet_node_status.go:78] "Successfully registered node" node="machine" machine # [ 35.088492] k3s[881]: E0930 08:31:33.882437 881 kubelet_node_status.go:479] "Error updating node status, will retry" err="error getting node \"machine\": node \"machine\" not found" machine # [ 35.091969] k3s[881]: E0930 08:31:33.886421 881 kubelet.go:3516] "Unable to register mirror pod because node is not registered yet" err="node \"machine\" not found" node="machine" machine # [ 35.094911] k3s[881]: time="2026-09-30T08:31:33Z" level=info msg="Adding node OwnerReference to node-password secret machine.node-password.k3s" machine # [ 35.096891] k3s[881]: I0930 08:31:33.891350 881 node_controller.go:432] Initializing node machine with cloud provider machine # [ 35.097557] k3s[881]: I0930 08:31:33.891409 881 node_controller.go:236] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 35.100292] k3s[881]: I0930 08:31:33.894716 881 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"machine\" does not exist" machine # [ 35.110090] k3s[881]: E0930 08:31:33.903542 881 node_controller.go:247] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 35.110699] k3s[881]: I0930 08:31:33.904021 881 node_controller.go:432] Initializing node machine with cloud provider machine # [ 35.111267] k3s[881]: I0930 08:31:33.904070 881 node_controller.go:236] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 35.111748] k3s[881]: E0930 08:31:33.904086 881 node_controller.go:247] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 35.121071] k3s[881]: I0930 08:31:33.914143 881 node_controller.go:432] Initializing node machine with cloud provider machine # [ 35.121685] k3s[881]: I0930 08:31:33.914240 881 node_controller.go:236] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 35.122234] k3s[881]: E0930 08:31:33.914262 881 node_controller.go:247] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 35.128092] k3s[881]: I0930 08:31:33.922542 881 node_controller.go:432] Initializing node machine with cloud provider machine # [ 35.135529] k3s[881]: time="2026-09-30T08:31:33Z" level=info msg="Annotations and labels have been set successfully on node: machine" machine # [ 35.136252] k3s[881]: time="2026-09-30T08:31:33Z" level=info msg="Starting flannel with backend vxlan" machine # [ 35.142613] k3s[881]: I0930 08:31:33.936810 881 range_allocator.go:433] "Set node PodCIDR" node="machine" podCIDRs=["10.42.0.0/24"] machine # [ 35.158119] k3s[881]: time="2026-09-30T08:31:33Z" level=info msg="Synced coredns NodeHosts entries for machine" machine # [ 35.175611] k3s[881]: time="2026-09-30T08:31:33Z" level=info msg="Flannel found PodCIDR assigned for node machine" machine # [ 35.178764] k3s[881]: time="2026-09-30T08:31:33Z" level=info msg="The interface eth0 with ipv4 address 10.0.2.15 will be used by flannel" machine # [ 35.179824] k3s[881]: I0930 08:31:33.974249 881 kube.go:139] Waiting 10m0s for node controller to sync machine # [ 35.180868] k3s[881]: I0930 08:31:33.974322 881 kube.go:537] Starting kube subnet manager machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 35.236883] k3s[881]: I0930 08:31:34.031298 881 node_controller.go:477] Successfully initialized node machine with cloud provider machine # [ 35.239100] k3s[881]: I0930 08:31:34.031394 881 event.go:389] "Event occurred" object="machine" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="Synced" message="Node synced successfully" machine # [ 35.241650] k3s[881]: E0930 08:31:34.034733 881 options.go:205] The manifest file is empty, ignoring. machine # [ 35.243051] k3s[881]: time="2026-09-30T08:31:34Z" level=info msg="Labels and annotations have been set successfully on node: machine" machine # [ 35.248469] k3s[881]: I0930 08:31:34.042912 881 kuberuntime_manager.go:2172] "Updating runtime config through cri with podcidr" CIDR="10.42.0.0/24" machine # [ 35.250327] k3s[881]: I0930 08:31:34.044613 881 server.go:176] "Starting Kubernetes Scheduler" version="v1.36.4+k3s1" machine # [ 35.251874] k3s[881]: I0930 08:31:34.044633 881 server.go:178] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 35.253731] k3s[881]: I0930 08:31:34.045636 881 kubelet_network.go:48] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.42.0.0/24" machine # [ 35.255368] k3s[881]: I0930 08:31:34.047179 881 kubelet_node_status.go:431] "Fast updating node status as it just became ready" machine # [ 35.256890] k3s[881]: I0930 08:31:34.048935 881 secure_serving.go:214] Serving securely on 127.0.0.1:10259 machine # [ 35.258213] k3s[881]: I0930 08:31:34.049060 881 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 35.259704] k3s[881]: I0930 08:31:34.049076 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 35.260939] k3s[881]: I0930 08:31:34.049121 881 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 35.263806] k3s[881]: I0930 08:31:34.049249 881 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 35.265254] k3s[881]: I0930 08:31:34.052039 881 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 35.267301] k3s[881]: I0930 08:31:34.052068 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 35.268521] k3s[881]: I0930 08:31:34.052107 881 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 35.270719] k3s[881]: I0930 08:31:34.052128 881 shared_informer.go:402] "Waiting for caches to sync" machine # [ 35.759268] k3s[881]: time="2026-09-30T08:31:34Z" level=info msg="Tunnel authorizer set Kubelet Port 0.0.0.0:10250" machine # [ 35.864076] k3s[881]: I0930 08:31:34.658375 881 apiserver.go:51] "Watching apiserver" machine # [ 35.913067] k3s[881]: I0930 08:31:34.707297 881 server.go:228] "Successfully retrieved NodeIPs" NodeIPs=["10.0.2.15","fec0::6173:482b:9d22:a7f2"] machine # [ 35.919423] k3s[881]: E0930 08:31:34.713701 881 server.go:265] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`" machine # [ 35.949867] k3s[881]: I0930 08:31:34.744207 881 server.go:274] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4" machine # [ 35.951131] k3s[881]: I0930 08:31:34.744258 881 server_linux.go:137] "Using iptables Proxier" machine # [ 35.955422] k3s[881]: I0930 08:31:34.749796 881 shared_informer.go:409] "Caches are synced" machine # [ 35.958730] k3s[881]: I0930 08:31:34.753145 881 shared_informer.go:409] "Caches are synced" machine # [ 35.959365] k3s[881]: I0930 08:31:34.753167 881 shared_informer.go:409] "Caches are synced" machine # [ 35.972470] k3s[881]: I0930 08:31:34.766872 881 proxier.go:241] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4" machine # [ 35.982648] k3s[881]: I0930 08:31:34.777067 881 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" machine # [ 35.988800] k3s[881]: I0930 08:31:34.782991 881 server.go:539] "Version info" version="v1.36.4+k3s1" machine # [ 35.989489] k3s[881]: I0930 08:31:34.783029 881 server.go:541] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 35.990967] k3s[881]: I0930 08:31:34.785412 881 config.go:200] "Starting service config controller" machine # [ 35.991826] k3s[881]: I0930 08:31:34.785445 881 shared_informer.go:381] "Waiting for caches to sync" controller="service config" machine # [ 35.994129] k3s[881]: I0930 08:31:34.785876 881 config.go:106] "Starting endpoint slice config controller" machine # [ 35.994880] k3s[881]: I0930 08:31:34.785892 881 shared_informer.go:381] "Waiting for caches to sync" controller="endpoint slice config" machine # [ 35.995543] k3s[881]: I0930 08:31:34.785922 881 config.go:403] "Starting serviceCIDR config controller" machine # [ 35.998412] k3s[881]: I0930 08:31:34.785934 881 shared_informer.go:381] "Waiting for caches to sync" controller="serviceCIDR config" machine # [ 35.999105] k3s[881]: I0930 08:31:34.787683 881 config.go:309] "Starting node config controller" machine # [ 35.999657] k3s[881]: I0930 08:31:34.787703 881 shared_informer.go:381] "Waiting for caches to sync" controller="node config" machine # [ 36.000211] k3s[881]: I0930 08:31:34.787716 881 shared_informer.go:388] "Caches are synced" controller="node config" machine # [ 36.047741] systemd[1]: Created slice libcontainer container kubepods-burstable-pod64829696_2932_4e5b_8982_6f7910b88961.slice. machine # [ 36.065750] systemd[1]: Created slice libcontainer container kubepods-burstable-pod95ccc75d_d182_4d81_9172_e51b5e7f92e7.slice. machine # [ 36.088753] k3s[881]: I0930 08:31:34.881211 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/95ccc75d-d182-4d81-9172-e51b5e7f92e7-klipper-helm\") pod \"helm-install-nix-grpc-farm-mvlk4\" (UID: \"95ccc75d-d182-4d81-9172-e51b5e7f92e7\") " pod="kube-system/helm-install-nix-grpc-farm-mvlk4" machine # [ 36.089482] k3s[881]: I0930 08:31:34.881251 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"values\" (UniqueName: \"kubernetes.io/projected/95ccc75d-d182-4d81-9172-e51b5e7f92e7-values\") pod \"helm-install-nix-grpc-farm-mvlk4\" (UID: \"95ccc75d-d182-4d81-9172-e51b5e7f92e7\") " pod="kube-system/helm-install-nix-grpc-farm-mvlk4" machine # [ 36.089931] k3s[881]: I0930 08:31:34.881285 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxr8m\" (UniqueName: \"kubernetes.io/projected/64829696-2932-4e5b-8982-6f7910b88961-kube-api-access-lxr8m\") pod \"coredns-54996dc9b4-qzpcm\" (UID: \"64829696-2932-4e5b-8982-6f7910b88961\") " pod="kube-system/coredns-54996dc9b4-qzpcm" machine # [ 36.090573] k3s[881]: I0930 08:31:34.881367 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/95ccc75d-d182-4d81-9172-e51b5e7f92e7-klipper-cache\") pod \"helm-install-nix-grpc-farm-mvlk4\" (UID: \"95ccc75d-d182-4d81-9172-e51b5e7f92e7\") " pod="kube-system/helm-install-nix-grpc-farm-mvlk4" machine # [ 36.091042] k3s[881]: I0930 08:31:34.881483 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/95ccc75d-d182-4d81-9172-e51b5e7f92e7-klipper-config\") pod \"helm-install-nix-grpc-farm-mvlk4\" (UID: \"95ccc75d-d182-4d81-9172-e51b5e7f92e7\") " pod="kube-system/helm-install-nix-grpc-farm-mvlk4" machine # [ 36.091576] k3s[881]: I0930 08:31:34.881568 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95ccc75d-d182-4d81-9172-e51b5e7f92e7-tmp\") pod \"helm-install-nix-grpc-farm-mvlk4\" (UID: \"95ccc75d-d182-4d81-9172-e51b5e7f92e7\") " pod="kube-system/helm-install-nix-grpc-farm-mvlk4" machine # [ 36.092180] k3s[881]: I0930 08:31:34.881599 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"content\" (UniqueName: \"kubernetes.io/configmap/95ccc75d-d182-4d81-9172-e51b5e7f92e7-content\") pod \"helm-install-nix-grpc-farm-mvlk4\" (UID: \"95ccc75d-d182-4d81-9172-e51b5e7f92e7\") " pod="kube-system/helm-install-nix-grpc-farm-mvlk4" machine # [ 36.092560] k3s[881]: I0930 08:31:34.881659 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f48fb\" (UniqueName: \"kubernetes.io/projected/95ccc75d-d182-4d81-9172-e51b5e7f92e7-kube-api-access-f48fb\") pod \"helm-install-nix-grpc-farm-mvlk4\" (UID: \"95ccc75d-d182-4d81-9172-e51b5e7f92e7\") " pod="kube-system/helm-install-nix-grpc-farm-mvlk4" machine # [ 36.093053] k3s[881]: I0930 08:31:34.881689 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/64829696-2932-4e5b-8982-6f7910b88961-config-volume\") pod \"coredns-54996dc9b4-qzpcm\" (UID: \"64829696-2932-4e5b-8982-6f7910b88961\") " pod="kube-system/coredns-54996dc9b4-qzpcm" machine # [ 36.093513] k3s[881]: I0930 08:31:34.881713 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-config-volume\" (UniqueName: \"kubernetes.io/configmap/64829696-2932-4e5b-8982-6f7910b88961-custom-config-volume\") pod \"coredns-54996dc9b4-qzpcm\" (UID: \"64829696-2932-4e5b-8982-6f7910b88961\") " pod="kube-system/coredns-54996dc9b4-qzpcm" machine # [ 36.094160] k3s[881]: I0930 08:31:34.885743 881 shared_informer.go:388] "Caches are synced" controller="service config" machine # [ 36.094849] k3s[881]: I0930 08:31:34.886679 881 shared_informer.go:388] "Caches are synced" controller="endpoint slice config" machine # [ 36.095488] k3s[881]: I0930 08:31:34.888575 881 shared_informer.go:388] "Caches are synced" controller="serviceCIDR config" machine # [ 36.180136] k3s[881]: I0930 08:31:34.974542 881 kube.go:163] Node controller sync successful machine # [ 36.181057] k3s[881]: I0930 08:31:34.974632 881 vxlan.go:128] VXLAN config: VNI=1 Port=0 GBP=false Learning=false DirectRouting=false machine # [ 36.183809] k3s[881]: I0930 08:31:34.978161 881 kube.go:704] List of node(machine) annotations: map[string]string{"alpha.kubernetes.io/provided-node-ip":"10.0.2.15,fec0::6173:482b:9d22:a7f2", "k3s.io/hostname":"machine", "k3s.io/internal-ip":"10.0.2.15,fec0::6173:482b:9d22:a7f2", "k3s.io/node-args":"[\"server\",\"--disable\",\"traefik\",\"--disable\",\"metrics-server\",\"--disable\",\"local-storage\",\"--kubelet-arg\",\"eviction-hard=nodefs.available\\u003c1%,imagefs.available\\u003c1%\"]", "k3s.io/node-config-hash":"EFXPOZ7ZWHRCLFNW4X4ZDPFQMSAOP3BLEIN2VE47TDRKQ4UIWKUQ====", "k3s.io/node-env":"{}", "node.alpha.kubernetes.io/ttl":"0", "volumes.kubernetes.io/controller-managed-attach-detach":"true"} machine # [ 36.211464] (udev-worker)[1252]: Network interface NamePolicy= disabled on kernel command line. machine # [ 36.220728] k3s[881]: I0930 08:31:35.015173 881 kube.go:558] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.42.0.0/24] machine # [ 36.224833] k3s[881]: I0930 08:31:35.019267 881 iptables.go:50] Starting flannel in iptables mode... machine # [ 36.225657] k3s[881]: time="2026-09-30T08:31:35Z" level=warning msg="no subnet found for key: FLANNEL_NETWORK in file: /run/flannel/subnet.env" machine # [ 36.226241] k3s[881]: time="2026-09-30T08:31:35Z" level=warning msg="no subnet found for key: FLANNEL_SUBNET in file: /run/flannel/subnet.env" machine # [ 36.226770] k3s[881]: time="2026-09-30T08:31:35Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_NETWORK in file: /run/flannel/subnet.env" machine # [ 36.231154] k3s[881]: time="2026-09-30T08:31:35Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_SUBNET in file: /run/flannel/subnet.env" machine # [ 36.231699] k3s[881]: I0930 08:31:35.019603 881 iptables.go:101] Current network or subnet (10.42.0.0/16, 10.42.0.0/24) is not equal to previous one (0.0.0.0/0, 0.0.0.0/0), trying to recycle old iptables rules machine # [ 36.246717] dhcpcd[695]: flannel.1: IAID 79:6e:be:92 machine # [ 36.247799] dhcpcd[695]: flannel.1: adding address fe80::c44e:79ff:fe6e:be92 machine # [ 36.266905] dhcpcd[695]: flannel.1: soliciting a DHCP lease machine # [ 36.295498] k3s[881]: I0930 08:31:35.089448 881 iptables.go:111] Setting up masking rules machine # [ 36.310187] k3s[881]: I0930 08:31:35.104544 881 iptables.go:212] Changing default FORWARD chain policy to ACCEPT machine # [ 36.331981] k3s[881]: time="2026-09-30T08:31:35Z" level=info msg="Wrote flannel subnet file to /run/flannel/subnet.env" machine # [ 36.332711] k3s[881]: time="2026-09-30T08:31:35Z" level=info msg="Running flannel backend" machine # [ 36.333222] k3s[881]: I0930 08:31:35.126463 881 vxlan_network.go:68] watching for new subnet leases machine # [ 36.333714] k3s[881]: I0930 08:31:35.126503 881 vxlan_network.go:115] starting vxlan device watcher machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 36.415355] k3s[881]: I0930 08:31:35.209666 881 iptables.go:358] bootstrap done machine # [ 36.441478] (udev-worker)[1374]: Network interface NamePolicy= disabled on kernel command line. machine # [ 36.609070] cni0: port 1(veth91d2d931) entered blocking state machine # [ 36.610083] cni0: port 1(veth91d2d931) entered disabled state machine # [ 36.611202] veth91d2d931: entered allmulticast mode machine # [ 36.612078] veth91d2d931: entered promiscuous mode machine # [ 36.614849] cni0: port 2(vethf53e7d3b) entered blocking state machine # [ 36.615487] cni0: port 2(vethf53e7d3b) entered disabled state machine # [ 36.616665] vethf53e7d3b: entered allmulticast mode machine # [ 36.617312] vethf53e7d3b: entered promiscuous mode machine # [ 36.473120] (udev-worker)[1501]: Network interface NamePolicy= disabled on kernel command line. machine # [ 36.473976] (udev-worker)[1502]: Network interface NamePolicy= disabled on kernel command line. machine # [ 36.635030] cni0: port 2(vethf53e7d3b) entered blocking state machine # [ 36.635804] cni0: port 2(vethf53e7d3b) entered forwarding state machine # [ 36.639623] cni0: port 1(veth91d2d931) entered blocking state machine # [ 36.640298] cni0: port 1(veth91d2d931) entered forwarding state machine # [ 36.514859] k3s[881]: I0930 08:31:35.309306 881 iptables.go:358] bootstrap done machine # [ 36.530072] dhcpcd[695]: veth91d2d931: waiting for carrier machine # [ 36.541371] dhcpcd[695]: vethf53e7d3b: IAID cc:96:e2:0e machine # [ 36.542085] dhcpcd[695]: vethf53e7d3b: adding address fe80::f049:ccff:fe96:e20e machine # [ 36.542978] dhcpcd[695]: veth91d2d931: carrier acquired machine # [ 36.549164] dhcpcd[695]: veth91d2d931: IAID 91:dd:93:ec machine # [ 36.549951] dhcpcd[695]: veth91d2d931: adding address fe80::5cf7:91ff:fedd:93ec machine # [ 36.767435] cni0: port 1(veth91d2d931) entered disabled state machine # [ 36.621934] dhcpcd[695]: veth91d2d931: carrier lost machine # [ 36.769411] veth91d2d931 (unregistering): left allmulticast mode machine # [ 36.771245] veth91d2d931 (unregistering): left promiscuous mode machine # [ 36.772350] cni0: port 1(veth91d2d931) entered disabled state machine # [ 36.774938] cni0: port 2(vethf53e7d3b) entered disabled state machine # [ 36.776590] vethf53e7d3b (unregistering): left allmulticast mode machine # [ 36.777467] vethf53e7d3b (unregistering): left promiscuous mode machine # [ 36.778411] cni0: port 2(vethf53e7d3b) entered disabled state machine # [ 36.659619] dhcpcd[695]: veth91d2d931: deleting address fe80::5cf7:91ff:fedd:93ec machine # [ 36.660509] k3s[881]: E0930 08:31:35.453863 881 remote_runtime.go:237] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to pull image \"rancher/mirrored-pause:3.10.2\": failed to pull and unpack image \"docker.io/rancher/mirrored-pause:3.10.2\": failed to resolve reference \"docker.io/rancher/mirrored-pause:3.10.2\": failed to do request: Head \"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\": dial tcp: lookup registry-1.docker.io: no such host" machine # [ 36.661227] k3s[881]: E0930 08:31:35.454013 881 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to pull image \"rancher/mirrored-pause:3.10.2\": failed to pull and unpack image \"docker.io/rancher/mirrored-pause:3.10.2\": failed to resolve reference \"docker.io/rancher/mirrored-pause:3.10.2\": failed to do request: Head \"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\": dial tcp: lookup registry-1.docker.io: no such host" pod="kube-system/coredns-54996dc9b4-qzpcm" machine # [ 36.661803] k3s[881]: E0930 08:31:35.454043 881 kuberuntime_manager.go:1640] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to pull image \"rancher/mirrored-pause:3.10.2\": failed to pull and unpack image \"docker.io/rancher/mirrored-pause:3.10.2\": failed to resolve reference \"docker.io/rancher/mirrored-pause:3.10.2\": failed to do request: Head \"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\": dial tcp: lookup registry-1.docker.io: no such host" pod="kube-system/coredns-54996dc9b4-qzpcm" machine # [ 36.662788] dhcpcd[695]: vethf53e7d3b: carrier lost machine # [ 36.678569] k3s[881]: E0930 08:31:35.472923 881 pod_workers.go:1338] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-54996dc9b4-qzpcm_kube-system(64829696-2932-4e5b-8982-6f7910b88961)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-54996dc9b4-qzpcm_kube-system(64829696-2932-4e5b-8982-6f7910b88961)\\\": rpc error: code = Unknown desc = failed to pull image \\\"rancher/mirrored-pause:3.10.2\\\": failed to pull and unpack image \\\"docker.io/rancher/mirrored-pause:3.10.2\\\": failed to resolve reference \\\"docker.io/rancher/mirrored-pause:3.10.2\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="kube-system/coredns-54996dc9b4-qzpcm" podUID="64829696-2932-4e5b-8982-6f7910b88961" machine # [ 36.693152] k3s[881]: E0930 08:31:35.487121 881 remote_runtime.go:237] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to pull image \"rancher/mirrored-pause:3.10.2\": failed to pull and unpack image \"docker.io/rancher/mirrored-pause:3.10.2\": failed to resolve reference \"docker.io/rancher/mirrored-pause:3.10.2\": failed to do request: Head \"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\": dial tcp: lookup registry-1.docker.io: no such host" machine # [ 36.693636] k3s[881]: E0930 08:31:35.487186 881 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to pull image \"rancher/mirrored-pause:3.10.2\": failed to pull and unpack image \"docker.io/rancher/mirrored-pause:3.10.2\": failed to resolve reference \"docker.io/rancher/mirrored-pause:3.10.2\": failed to do request: Head \"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\": dial tcp: lookup registry-1.docker.io: no such host" pod="kube-system/helm-install-nix-grpc-farm-mvlk4" machine # [ 36.694434] k3s[881]: E0930 08:31:35.487212 881 kuberuntime_manager.go:1640] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to pull image \"rancher/mirrored-pause:3.10.2\": failed to pull and unpack image \"docker.io/rancher/mirrored-pause:3.10.2\": failed to resolve reference \"docker.io/rancher/mirrored-pause:3.10.2\": failed to do request: Head \"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\": dial tcp: lookup registry-1.docker.io: no such host" pod="kube-system/helm-install-nix-grpc-farm-mvlk4" machine # [ 36.694916] k3s[881]: E0930 08:31:35.487294 881 pod_workers.go:1338] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"helm-install-nix-grpc-farm-mvlk4_kube-system(95ccc75d-d182-4d81-9172-e51b5e7f92e7)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"helm-install-nix-grpc-farm-mvlk4_kube-system(95ccc75d-d182-4d81-9172-e51b5e7f92e7)\\\": rpc error: code = Unknown desc = failed to pull image \\\"rancher/mirrored-pause:3.10.2\\\": failed to pull and unpack image \\\"docker.io/rancher/mirrored-pause:3.10.2\\\": failed to resolve reference \\\"docker.io/rancher/mirrored-pause:3.10.2\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="kube-system/helm-install-nix-grpc-farm-mvlk4" podUID="95ccc75d-d182-4d81-9172-e51b5e7f92e7" machine # [ 36.734103] dhcpcd[695]: vethf53e7d3b: deleting address fe80::f049:ccff:fe96:e20e machine # [ 36.739986] dhcpcd[695]: veth91d2d931: removing interface machine # [ 36.761164] dhcpcd[695]: vethf53e7d3b: removing interface machine # [ 37.257397] k3s[881]: time="2026-09-30T08:31:36Z" level=info msg="Starting network policy controller version v2.6.3-k3s1, built on 1970-01-01T01:01:01Z, go1.26.7" machine # [ 37.258430] k3s[881]: I0930 08:31:36.051858 881 network_policy_controller.go:164] Starting network policy controller machine # [ 37.530363] k3s[881]: I0930 08:31:36.324129 881 network_policy_controller.go:179] Starting network policy controller full sync goroutine machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 38.036886] k3s[881]: I0930 08:31:36.831139 881 node_lifecycle_controller.go:1217] "Initializing eviction metric for zone" zone="" machine # [ 38.038084] k3s[881]: I0930 08:31:36.831380 881 node_lifecycle_controller.go:869] "Missing timestamp for Node. Assuming now as a timestamp" node="machine" machine # [ 38.038866] k3s[881]: I0930 08:31:36.831591 881 node_lifecycle_controller.go:1063] "Controller detected that zone is now in new state" zone="" newState="Normal" machine # [ 38.516316] dhcpcd[695]: flannel.1: soliciting an IPv6 router machine # [ 38.668220] k3s[881]: time="2026-09-30T08:31:37Z" level=info msg="Imported docker.io/rancher/klipper-helm:v0.13.3-build20260727" machine # [ 38.677433] k3s[881]: time="2026-09-30T08:31:37Z" level=info msg="Tagged docker.io/rancher/klipper-helm@sha256:5425a2b4613d2458dbdff99218e8d487ebb59c20e7a941f061c0777070f0aac1" machine # [ 38.679877] k3s[881]: time="2026-09-30T08:31:37Z" level=info msg="Imported docker.io/rancher/klipper-lb:v0.4.17" machine # [ 38.692309] k3s[881]: time="2026-09-30T08:31:37Z" level=info msg="Tagged docker.io/rancher/klipper-lb@sha256:910944bb0bd94f060a82a56ca1ea1c577d3e49b3473a093a47a985f32e92d94a" machine # [ 38.693608] k3s[881]: time="2026-09-30T08:31:37Z" level=info msg="Imported docker.io/rancher/local-path-provisioner:v0.0.37" machine # [ 38.698844] k3s[881]: time="2026-09-30T08:31:37Z" level=info msg="Tagged docker.io/rancher/local-path-provisioner@sha256:e757967a5ec338f6a9b371c5a9688bedaa8c3578ea3dd4db329ea0084be0a86f" machine # [ 38.699990] k3s[881]: time="2026-09-30T08:31:37Z" level=info msg="Imported docker.io/rancher/mirrored-coredns-coredns:1.14.6" machine # [ 38.708069] k3s[881]: time="2026-09-30T08:31:37Z" level=info msg="Tagged docker.io/rancher/mirrored-coredns-coredns@sha256:900f9c109f7a33545d3c811516e8376df9019147b750f5ce3e254468769176ea" machine # [ 38.708981] k3s[881]: time="2026-09-30T08:31:37Z" level=info msg="Imported docker.io/rancher/mirrored-library-busybox:1.37.0" machine # [ 38.714980] k3s[881]: time="2026-09-30T08:31:37Z" level=info msg="Tagged docker.io/rancher/mirrored-library-busybox@sha256:101b4afd76732482eff9b95cae5f94bcf295e521fbec4e01b69c5421f3f3f3e5" machine # [ 38.718494] k3s[881]: time="2026-09-30T08:31:37Z" level=info msg="Imported docker.io/rancher/mirrored-library-traefik:3.7.8" machine # [ 38.734481] k3s[881]: time="2026-09-30T08:31:37Z" level=info msg="Tagged docker.io/rancher/mirrored-library-traefik@sha256:4299bbed850421258fc5448c2e0e6ad350981d4d335a68de11b92448aedbefe5" machine # [ 38.736037] k3s[881]: time="2026-09-30T08:31:37Z" level=info msg="Imported docker.io/rancher/mirrored-metrics-server:v0.9.0" machine # [ 38.750621] k3s[881]: time="2026-09-30T08:31:37Z" level=info msg="Tagged docker.io/rancher/mirrored-metrics-server@sha256:d9862115e7c7881280d3d75ca26bda8ffc0fc213315979575bf23ce9826205c0" machine # [ 38.751969] k3s[881]: time="2026-09-30T08:31:37Z" level=info msg="Imported docker.io/rancher/mirrored-pause:3.10.2" machine # [ 38.762447] k3s[881]: time="2026-09-30T08:31:37Z" level=info msg="Tagged docker.io/rancher/mirrored-pause@sha256:f548e0e8e3dc1896ca956272154dde3314e8cc4fde0a57577ee9fa1c63f5baf4" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 39.234168] k3s[881]: time="2026-09-30T08:31:38Z" level=info msg="Imported 8 images from /var/lib/rancher/k3s/agent/images/nixos/smddpgqzjvlqv3lx57wdzl7kma805fj0-k3s-airgap-images-amd64.tar.zst in 4.740123396s" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 41.271384] dhcpcd[695]: flannel.1: probing for an IPv4LL address machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 46.694314] dhcpcd[695]: flannel.1: using IPv4LL address 169.254.32.140 machine # [ 46.696725] dhcpcd[695]: flannel.1: adding route to 169.254.0.0/16 machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 48.261859] cni0: port 1(veth0dbc4ca9) entered blocking state machine # [ 48.263484] cni0: port 1(veth0dbc4ca9) entered disabled state machine # [ 48.265058] veth0dbc4ca9: entered allmulticast mode machine # [ 48.266741] veth0dbc4ca9: entered promiscuous mode machine # [ 48.283838] cni0: port 1(veth0dbc4ca9) entered blocking state machine # [ 48.285422] cni0: port 1(veth0dbc4ca9) entered forwarding state machine # [ 48.179177] (udev-worker)[1994]: Network interface NamePolicy= disabled on kernel command line. machine # [ 48.206079] dhcpcd[695]: veth0dbc4ca9: IAID 89:0c:df:01 machine # [ 48.206880] dhcpcd[695]: veth0dbc4ca9: adding address fe80::3ca7:89ff:fe0c:df01 machine # [ 48.215868] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount3155670117.mount: Deactivated successfully. machine # [ 48.294363] systemd[1]: Started libcontainer container 53f320f9a80a63190c4ea58ad5ea2ebad9c79b97a5d68d774bf16af49b07e55d. machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 49.037556] systemd[1]: Started libcontainer container 620f3c29c7bac9dafb6679c02e4fcd166ef96694e1c1314e0134dba05ef35634. machine # [ 49.528418] dhcpcd[695]: veth0dbc4ca9: soliciting an IPv6 router machine # [ 49.595219] dhcpcd[695]: veth0dbc4ca9: soliciting a DHCP lease machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 50.152117] k3s[881]: I0930 08:31:48.944881 881 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/coredns-54996dc9b4-qzpcm" podStartSLOduration=21.944844521 podStartE2EDuration="21.944844521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-30 08:31:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 08:31:47.930067224 +0000 UTC m=+32.413659555" watchObservedRunningTime="2026-09-30 08:31:48.944844521 +0000 UTC m=+33.428439646" machine # [ 50.322471] cni0: port 2(vethf3c91996) entered blocking state machine # [ 50.323187] cni0: port 2(vethf3c91996) entered disabled state machine # [ 50.323935] vethf3c91996: entered allmulticast mode machine # [ 50.324601] vethf3c91996: entered promiscuous mode machine # [ 50.180603] (udev-worker)[2002]: Network interface NamePolicy= disabled on kernel command line. machine # [ 50.333223] cni0: port 2(vethf3c91996) entered blocking state machine # [ 50.333961] cni0: port 2(vethf3c91996) entered forwarding state machine # [ 50.210141] dhcpcd[695]: vethf3c91996: IAID 2a:7d:df:5d machine # [ 50.210679] dhcpcd[695]: vethf3c91996: adding address fe80::1c22:2aff:fe7d:df5d machine # [ 50.287771] systemd[1]: Started libcontainer container b69ac72168f53f54238040b8d33fdd57e10439c047a2773eb8137179303d9fb9. machine # [ 50.462232] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount2198264664.mount: Deactivated successfully. machine # [ 50.522310] dhcpcd[695]: flannel.1: no IPv6 Routers available machine # [ 51.038737] dhcpcd[695]: vethf3c91996: soliciting a DHCP lease machine # [ 51.153078] systemd[1]: Started libcontainer container 080d504dc46465a83a5a5669bd809a266a7a7f02906838b47ff158e3ec3460b0. machine # [ 51.239689] k3s[881]: I0930 08:31:50.032485 881 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/helm-install-nix-grpc-farm-mvlk4" podStartSLOduration=23.032461243 podStartE2EDuration="23.032461243s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-30 08:31:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 08:31:50.032002246 +0000 UTC m=+34.515594577" watchObservedRunningTime="2026-09-30 08:31:50.032461243 +0000 UTC m=+34.516053853" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 51.306651] dhcpcd[695]: vethf3c91996: soliciting an IPv6 router machine # [ 52.168871] k3s[881]: I0930 08:31:50.963050 881 alloc.go:329] "allocated clusterIPs" service="farm/nix-grpc-farm" clusterIPs={"IPv4":"10.43.140.152"} machine # [ 52.218431] systemd[1]: cri-containerd-080d504dc46465a83a5a5669bd809a266a7a7f02906838b47ff158e3ec3460b0.scope: Deactivated successfully. machine # [ 52.218860] systemd[1]: cri-containerd-080d504dc46465a83a5a5669bd809a266a7a7f02906838b47ff158e3ec3460b0.scope: Consumed 720ms CPU time over 1.064s wall clock time, 32.6M memory peak, 2.6M incoming IP traffic, 149.7K outgoing IP traffic. machine # [ 52.249563] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-080d504dc46465a83a5a5669bd809a266a7a7f02906838b47ff158e3ec3460b0-rootfs.mount: Deactivated successfully. machine # [ 52.934885] k3s[881]: E0930 08:31:51.727239 881 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-lb-5877cc8b4f\" failed with read version: 458 is not as new as written version: 473 for group resource replicasets.apps" logger="UnhandledError" machine # [ 52.970314] k3s[881]: E0930 08:31:51.764713 881 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-scheduler-55cccf6d96\" failed with read version: 479 is not as new as written version: 484 for group resource replicasets.apps" logger="UnhandledError" machine # [ 52.975992] systemd[1]: Created slice libcontainer container kubepods-besteffort-podea03eb01_fba5_4cbc_babf_46830c7e6d43.slice. machine # [ 52.992642] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod6315a5d7_1875_4d91_943e_163838002ade.slice. machine # [ 53.013191] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod51de9a4c_e128_4482_b44b_c73846442c73.slice. machine # [ 53.025083] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod2f4d5f91_7773_4aa5_98da_275188d09e88.slice. machine # [ 53.110464] k3s[881]: I0930 08:31:51.904822 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/2f4d5f91-7773-4aa5-98da-275188d09e88-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-wp7qx\" (UID: \"2f4d5f91-7773-4aa5-98da-275188d09e88\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-wp7qx" machine # [ 53.115186] k3s[881]: I0930 08:31:51.904885 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2f4d5f91-7773-4aa5-98da-275188d09e88-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-wp7qx\" (UID: \"2f4d5f91-7773-4aa5-98da-275188d09e88\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-wp7qx" machine # [ 53.119537] k3s[881]: I0930 08:31:51.904934 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/6315a5d7-1875-4d91-943e-163838002ade-tls\") pod \"nix-grpc-farm-scheduler-55cccf6d96-wwgf5\" (UID: \"6315a5d7-1875-4d91-943e-163838002ade\") " pod="farm/nix-grpc-farm-scheduler-55cccf6d96-wwgf5" machine # [ 53.123844] k3s[881]: I0930 08:31:51.905090 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/51de9a4c-e128-4482-b44b-c73846442c73-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-hmcxr\" (UID: \"51de9a4c-e128-4482-b44b-c73846442c73\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-hmcxr" machine # [ 53.128463] k3s[881]: I0930 08:31:51.905161 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/2f4d5f91-7773-4aa5-98da-275188d09e88-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-wp7qx\" (UID: \"2f4d5f91-7773-4aa5-98da-275188d09e88\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-wp7qx" machine # [ 53.132874] k3s[881]: I0930 08:31:51.905267 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/6315a5d7-1875-4d91-943e-163838002ade-niks3-token\") pod \"nix-grpc-farm-scheduler-55cccf6d96-wwgf5\" (UID: \"6315a5d7-1875-4d91-943e-163838002ade\") " pod="farm/nix-grpc-farm-scheduler-55cccf6d96-wwgf5" machine # [ 53.137404] k3s[881]: I0930 08:31:51.905387 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/2f4d5f91-7773-4aa5-98da-275188d09e88-build\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-wp7qx\" (UID: \"2f4d5f91-7773-4aa5-98da-275188d09e88\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-wp7qx" machine # [ 53.141913] k3s[881]: I0930 08:31:51.905562 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/51de9a4c-e128-4482-b44b-c73846442c73-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-hmcxr\" (UID: \"51de9a4c-e128-4482-b44b-c73846442c73\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-hmcxr" machine # [ 53.146356] k3s[881]: I0930 08:31:51.905625 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/51de9a4c-e128-4482-b44b-c73846442c73-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-hmcxr\" (UID: \"51de9a4c-e128-4482-b44b-c73846442c73\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-hmcxr" machine # [ 53.150654] k3s[881]: I0930 08:31:51.905688 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/2f4d5f91-7773-4aa5-98da-275188d09e88-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-wp7qx\" (UID: \"2f4d5f91-7773-4aa5-98da-275188d09e88\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-wp7qx" machine # [ 53.155166] k3s[881]: I0930 08:31:51.905736 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/51de9a4c-e128-4482-b44b-c73846442c73-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-hmcxr\" (UID: \"51de9a4c-e128-4482-b44b-c73846442c73\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-hmcxr" machine # [ 53.159455] k3s[881]: I0930 08:31:51.905762 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q25kz\" (UniqueName: \"kubernetes.io/projected/2f4d5f91-7773-4aa5-98da-275188d09e88-kube-api-access-q25kz\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-wp7qx\" (UID: \"2f4d5f91-7773-4aa5-98da-275188d09e88\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-wp7qx" machine # [ 53.163958] k3s[881]: I0930 08:31:51.905821 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/ea03eb01-fba5-4cbc-babf-46830c7e6d43-tls-ca\") pod \"nix-grpc-farm-lb-5877cc8b4f-rwk8f\" (UID: \"ea03eb01-fba5-4cbc-babf-46830c7e6d43\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-rwk8f" machine # [ 53.167929] k3s[881]: I0930 08:31:51.905852 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28n58\" (UniqueName: \"kubernetes.io/projected/6315a5d7-1875-4d91-943e-163838002ade-kube-api-access-28n58\") pod \"nix-grpc-farm-scheduler-55cccf6d96-wwgf5\" (UID: \"6315a5d7-1875-4d91-943e-163838002ade\") " pod="farm/nix-grpc-farm-scheduler-55cccf6d96-wwgf5" machine # [ 53.172455] k3s[881]: I0930 08:31:51.905890 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/51de9a4c-e128-4482-b44b-c73846442c73-build\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-hmcxr\" (UID: \"51de9a4c-e128-4482-b44b-c73846442c73\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-hmcxr" machine # [ 53.176805] k3s[881]: I0930 08:31:51.905925 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/51de9a4c-e128-4482-b44b-c73846442c73-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-hmcxr\" (UID: \"51de9a4c-e128-4482-b44b-c73846442c73\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-hmcxr" machine # [ 53.181316] k3s[881]: I0930 08:31:51.906015 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/ea03eb01-fba5-4cbc-babf-46830c7e6d43-tls-lb\") pod \"nix-grpc-farm-lb-5877cc8b4f-rwk8f\" (UID: \"ea03eb01-fba5-4cbc-babf-46830c7e6d43\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-rwk8f" machine # [ 53.185285] k3s[881]: I0930 08:31:51.906049 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/51de9a4c-e128-4482-b44b-c73846442c73-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-hmcxr\" (UID: \"51de9a4c-e128-4482-b44b-c73846442c73\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-hmcxr" machine # [ 53.189604] k3s[881]: I0930 08:31:51.906084 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97v8f\" (UniqueName: \"kubernetes.io/projected/51de9a4c-e128-4482-b44b-c73846442c73-kube-api-access-97v8f\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-hmcxr\" (UID: \"51de9a4c-e128-4482-b44b-c73846442c73\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-hmcxr" machine # [ 53.194198] k3s[881]: I0930 08:31:51.906186 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/2f4d5f91-7773-4aa5-98da-275188d09e88-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-wp7qx\" (UID: \"2f4d5f91-7773-4aa5-98da-275188d09e88\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-wp7qx" machine # [ 53.198594] k3s[881]: I0930 08:31:51.906213 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/2f4d5f91-7773-4aa5-98da-275188d09e88-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-wp7qx\" (UID: \"2f4d5f91-7773-4aa5-98da-275188d09e88\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-wp7qx" machine # [ 53.202821] k3s[881]: I0930 08:31:51.906239 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/51de9a4c-e128-4482-b44b-c73846442c73-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-hmcxr\" (UID: \"51de9a4c-e128-4482-b44b-c73846442c73\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-hmcxr" machine # [ 53.207181] k3s[881]: I0930 08:31:51.906263 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/2f4d5f91-7773-4aa5-98da-275188d09e88-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-wp7qx\" (UID: \"2f4d5f91-7773-4aa5-98da-275188d09e88\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-wp7qx" machine # [ 53.211493] k3s[881]: I0930 08:31:51.906298 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ea03eb01-fba5-4cbc-babf-46830c7e6d43-config\") pod \"nix-grpc-farm-lb-5877cc8b4f-rwk8f\" (UID: \"ea03eb01-fba5-4cbc-babf-46830c7e6d43\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-rwk8f" machine # [ 53.215543] k3s[881]: I0930 08:31:51.906327 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea03eb01-fba5-4cbc-babf-46830c7e6d43-tmp\") pod \"nix-grpc-farm-lb-5877cc8b4f-rwk8f\" (UID: \"ea03eb01-fba5-4cbc-babf-46830c7e6d43\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-rwk8f" machine # [ 53.219625] k3s[881]: I0930 08:31:51.906380 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6315a5d7-1875-4d91-943e-163838002ade-ca\") pod \"nix-grpc-farm-scheduler-55cccf6d96-wwgf5\" (UID: \"6315a5d7-1875-4d91-943e-163838002ade\") " pod="farm/nix-grpc-farm-scheduler-55cccf6d96-wwgf5" machine # [ 53.223774] k3s[881]: I0930 08:31:51.906406 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/6315a5d7-1875-4d91-943e-163838002ade-oidc\") pod \"nix-grpc-farm-scheduler-55cccf6d96-wwgf5\" (UID: \"6315a5d7-1875-4d91-943e-163838002ade\") " pod="farm/nix-grpc-farm-scheduler-55cccf6d96-wwgf5" machine # [ 53.466214] cni0: port 3(veth7e9f2a6e) entered blocking state machine # [ 53.467081] cni0: port 3(veth7e9f2a6e) entered disabled state machine # [ 53.467959] veth7e9f2a6e: entered allmulticast mode machine # [ 53.468724] veth7e9f2a6e: entered promiscuous mode machine # [ 53.477662] cni0: port 3(veth7e9f2a6e) entered blocking state machine # [ 53.478335] cni0: port 3(veth7e9f2a6e) entered forwarding state machine # [ 53.483409] cni0: port 4(veth31d36151) entered blocking state machine # [ 53.484770] cni0: port 4(veth31d36151) entered disabled state machine # [ 53.486023] veth31d36151: entered allmulticast mode machine # [ 53.487274] veth31d36151: entered promiscuous mode machine # [ 53.499183] cni0: port 4(veth31d36151) entered blocking state machine # [ 53.500880] cni0: port 4(veth31d36151) entered forwarding state machine # [ 53.388429] (udev-worker)[2555]: Network interface NamePolicy= disabled on kernel command line. machine # [ 53.391229] (udev-worker)[2556]: Network interface NamePolicy= disabled on kernel command line. machine # [ 53.423609] dhcpcd[695]: veth7e9f2a6e: IAID 04:20:9a:e0 machine # [ 53.424977] dhcpcd[695]: veth7e9f2a6e: adding address fe80::50cd:4ff:fe20:9ae0 machine # [ 53.441040] (udev-worker)[2600]: Network interface NamePolicy= disabled on kernel command line. machine # [ 53.449444] dhcpcd[695]: veth31d36151: IAID 30:83:b2:f0 machine # [ 53.450194] dhcpcd[695]: veth31d36151: adding address fe80::581d:30ff:fe83:b2f0 machine # [ 53.598229] cni0: port 5(veth9d5f407b) entered blocking state machine # [ 53.456340] dhcpcd[695]: veth31d36151: soliciting a DHCP lease machine # [ 53.602392] cni0: port 5(veth9d5f407b) entered disabled state machine # [ 53.607603] veth9d5f407b: entered allmulticast mode machine # [ 53.608451] veth9d5f407b: entered promiscuous mode machine # [ 53.469859] (udev-worker)[2597]: Network interface NamePolicy= disabled on kernel command line. machine # [ 53.620789] cni0: port 6(veth32a98dd6) entered blocking state machine # [ 53.625342] cni0: port 6(veth32a98dd6) entered disabled state machine # [ 53.489048] systemd[1]: Started libcontainer container c707ef9bdd91835f731d5af8c22245aa3028b40cef76b1cb1f4b85[ 53.635307] veth32a98dd6: entered allmulticast mode machine # 3b6f5e0872. machine # [ 53.643468] veth32a98dd6: entered promiscuous mode machine # [ 53.678924] cni0: port 6(veth32a98dd6) entered blocking state machine # [ 53.680137] cni0: port 6(veth32a98dd6) entered forwarding state machine # [ 53.687903] cni0: port 5(veth9d5f407b) entered blocking state machine # [ 53.688885] cni0: port 5(veth9d5f407b) entered forwarding state machine # [ 53.546842] dhcpcd[695]: veth9d5f407b: waiting for carrier machine # [ 53.557261] systemd[1]: Started libcontainer container 770629de883392efd3800c7338725b02eece8d7322f633b2e12752f79b7f49da. machine # [ 53.572353] dhcpcd[695]: veth32a98dd6: IAID e4:f7:86:00 machine # [ 53.573242] dhcpcd[695]: veth32a98dd6: adding address fe80::c86:e4ff:fef7:8600 machine # [ 53.574768] dhcpcd[695]: veth32a98dd6: carrier lost machine # [ 53.611069] dhcpcd[695]: veth32a98dd6: deleting address fe80::c86:e4ff:fef7:8600 machine # [ 53.611747] dhcpcd[695]: veth32a98dd6: carrier acquired machine # [ 53.618270] dhcpcd[695]: veth32a98dd6: IAID e4:f7:86:00 machine # [ 53.619180] dhcpcd[695]: veth32a98dd6: adding address fe80::c86:e4ff:fef7:8600 machine # [ 53.620262] dhcpcd[695]: veth9d5f407b: carrier acquired machine # [ 53.628066] dhcpcd[695]: veth9d5f407b: IAID 3b:05:cb:01 machine # [ 53.628903] dhcpcd[695]: veth9d5f407b: adding address fe80::58c5:3bff:fe05:cb01 machine # [ 53.704969] systemd[1]: Started libcontainer container 615f103269c41eae27c9a4631cfc91fc39151ba9edeb00552e5621e59b9ece52. machine # [ 53.709846] systemd[1]: Started libcontainer container 42465efcf238583e3916e0637a515e14a21de6ca4a5c2a38f58d36b3ac009178. machine # [ 53.871797] dhcpcd[695]: veth32a98dd6: soliciting a DHCP lease machine # [ 54.174388] systemd[1]: cri-containerd-b69ac72168f53f54238040b8d33fdd57e10439c047a2773eb8137179303d9fb9.scope: Deactivated successfully. machine # [ 54.263478] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-b69ac72168f53f54238040b8d33fdd57e10439c047a2773eb8137179303d9fb9-rootfs.mount: Deactivated successfully. machine # [ 54.431150] dhcpcd[695]: veth9d5f407b: soliciting a DHCP lease machine # [ 54.475262] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-b69ac72168f53f54238040b8d33fdd57e10439c047a2773eb8137179303d9fb9-shm.mount: Deactivated successfully. machine # [ 54.548211] d[ 54.693522] cni0: port 2(vethf3c91996) entered disabled state machine # hcpcd[695]: vethf3c91996: carrier lost machine # [ 54.695796] vethf3c91996 (unregistering): left allmulticast mode machine # [ 54.697054] vethf3c91996 (unregistering): left promiscuous mode machine # [ 54.698344] cni0: port 2(vethf3c91996) entered disabled state machine # [ 54.584531] systemd[1]: run-netns-cni\x2d0d349d18\x2d2f90\x2d717e\x2d1d49\x2de68f16f41e24.mount: Deactivated successfully. machine # [ 54.589083] dhcpcd[695]: vethf3c91996: deleting address fe80::1c22:2aff:fe7d:df5d machine # [ 54.645250] dhcpcd[695]: veth0dbc4ca9: probing for an IPv4LL address machine # [ 54.651356] dhcpcd[695]: vethf3c91996: removing interface machine # [ 54.726790] k3s[881]: I0930 08:31:53.520739 881 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/95ccc75d-d182-4d81-9172-e51b5e7f92e7-values\" (UniqueName: \"kubernetes.io/projected/95ccc75d-d182-4d81-9172-e51b5e7f92e7-values\") pod \"95ccc75d-d182-4d81-9172-e51b5e7f92e7\" (UID: \"95ccc75d-d182-4d81-9172-e51b5e7f92e7\") " machine # [ 54.727627] k3s[881]: I0930 08:31:53.520815 881 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/95ccc75d-d182-4d81-9172-e51b5e7f92e7-klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/95ccc75d-d182-4d81-9172-e51b5e7f92e7-klipper-config\") pod \"95ccc75d-d182-4d81-9172-e51b5e7f92e7\" (UID: \"95ccc75d-d182-4d81-9172-e51b5e7f92e7\") " machine # [ 54.728532] k3s[881]: I0930 08:31:53.520852 881 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/95ccc75d-d182-4d81-9172-e51b5e7f92e7-klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/95ccc75d-d182-4d81-9172-e51b5e7f92e7-klipper-helm\") pod \"95ccc75d-d182-4d81-9172-e51b5e7f92e7\" (UID: \"95ccc75d-d182-4d81-9172-e51b5e7f92e7\") " machine # [ 54.729218] k3s[881]: I0930 08:31:53.520879 881 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/95ccc75d-d182-4d81-9172-e51b5e7f92e7-klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/95ccc75d-d182-4d81-9172-e51b5e7f92e7-klipper-cache\") pod \"95ccc75d-d182-4d81-9172-e51b5e7f92e7\" (UID: \"95ccc75d-d182-4d81-9172-e51b5e7f92e7\") " machine # [ 54.730042] k3s[881]: I0930 08:31:53.520910 881 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/95ccc75d-d182-4d81-9172-e51b5e7f92e7-tmp\" (UniqueName: \"kubernetes.io/empty-dir/95ccc75d-d182-4d81-9172-e51b5e7f92e7-tmp\") pod \"95ccc75d-d182-4d81-9172-e51b5e7f92e7\" (UID: \"95ccc75d-d182-4d81-9172-e51b5e7f92e7\") " machine # [ 54.730901] k3s[881]: I0930 08:31:53.520942 881 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/95ccc75d-d182-4d81-9172-e51b5e7f92e7-kube-api-access-f48fb\" (UniqueName: \"kubernetes.io/projected/95ccc75d-d182-4d81-9172-e51b5e7f92e7-kube-api-access-f48fb\") pod \"95ccc75d-d182-4d81-9172-e51b5e7f92e7\" (UID: \"95ccc75d-d182-4d81-9172-e51b5e7f92e7\") " machine # [ 54.731653] k3s[881]: I0930 08:31:53.520978 881 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/95ccc75d-d182-4d81-9172-e51b5e7f92e7-content\" (UniqueName: \"kubernetes.io/configmap/95ccc75d-d182-4d81-9172-e51b5e7f92e7-content\") pod \"95ccc75d-d182-4d81-9172-e51b5e7f92e7\" (UID: \"95ccc75d-d182-4d81-9172-e51b5e7f92e7\") " machine # [ 54.733678] k3s[881]: I0930 08:31:53.521327 881 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95ccc75d-d182-4d81-9172-e51b5e7f92e7-content" pod "95ccc75d-d182-4d81-9172-e51b5e7f92e7" (UID: "95ccc75d-d182-4d81-9172-e51b5e7f92e7"). InnerVolumeSpecName "content". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 54.735824] systemd[1]: var-lib-kubelet-pods-95ccc75d\x2dd182\x2d4d81\x2d9172\x2de51b5e7f92e7-volumes-kubernetes.io\x7eprojected-values.mount: Deactivated successfully. machine # [ 54.736799] systemd[1]: var-lib-kubelet-pods-95ccc75d\x2dd182\x2d4d81\x2d9172\x2de51b5e7f92e7-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dcache.mount: Deactivated successfully. machine # [ 54.740220] systemd[1]: var-lib-kubelet-pods-95ccc75d\x2dd182\x2d4d81\x2d9172\x2de51b5e7f92e7-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dhelm.mount: Deactivated successfully. machine # [ 54.769074] k3s[881]: I0930 08:31:53.563401 881 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95ccc75d-d182-4d81-9172-e51b5e7f92e7-klipper-helm" pod "95ccc75d-d182-4d81-9172-e51b5e7f92e7" (UID: "95ccc75d-d182-4d81-9172-e51b5e7f92e7"). InnerVolumeSpecName "klipper-helm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 54.770101] k3s[881]: I0930 08:31:53.563431 881 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95ccc75d-d182-4d81-9172-e51b5e7f92e7-klipper-cache" pod "95ccc75d-d182-4d81-9172-e51b5e7f92e7" (UID: "95ccc75d-d182-4d81-9172-e51b5e7f92e7"). InnerVolumeSpecName "klipper-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 54.770745] k3s[881]: I0930 08:31:53.563728 881 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95ccc75d-d182-4d81-9172-e51b5e7f92e7-values" pod "95ccc75d-d182-4d81-9172-e51b5e7f92e7" (UID: "95ccc75d-d182-4d81-9172-e51b5e7f92e7"). InnerVolumeSpecName "values". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 54.783994] k3s[881]: I0930 08:31:53.578429 881 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95ccc75d-d182-4d81-9172-e51b5e7f92e7-tmp" pod "95ccc75d-d182-4d81-9172-e51b5e7f92e7" (UID: "95ccc75d-d182-4d81-9172-e51b5e7f92e7"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 54.785263] k3s[881]: I0930 08:31:53.578442 881 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95ccc75d-d182-4d81-9172-e51b5e7f92e7-kube-api-access-f48fb" pod "95ccc75d-d182-4d81-9172-e51b5e7f92e7" (UID: "95ccc75d-d182-4d81-9172-e51b5e7f92e7"). InnerVolumeSpecName "kube-api-access-f48fb". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 54.804510] k3s[881]: I0930 08:31:53.598944 881 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95ccc75d-d182-4d81-9172-e51b5e7f92e7-klipper-config" pod "95ccc75d-d182-4d81-9172-e51b5e7f92e7" (UID: "95ccc75d-d182-4d81-9172-e51b5e7f92e7"). InnerVolumeSpecName "klipper-config". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 54.810487] systemd[1]: Started libcontainer container 4f000c734baeaf0a48ee47cded1ef43f7a46f470aff4aab00c83c2a6e0bd56b9. machine # [ 54.827223] k3s[881]: I0930 08:31:53.621645 881 reconciler_common.go:299] "Volume detached for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/95ccc75d-d182-4d81-9172-e51b5e7f92e7-klipper-config\") on node \"machine\" DevicePath \"\"" machine # [ 54.827967] k3s[881]: I0930 08:31:53.621677 881 reconciler_common.go:299] "Volume detached for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/95ccc75d-d182-4d81-9172-e51b5e7f92e7-klipper-helm\") on node \"machine\" DevicePath \"\"" machine # [ 54.828313] k3s[881]: I0930 08:31:53.621693 881 reconciler_common.go:299] "Volume detached for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/95ccc75d-d182-4d81-9172-e51b5e7f92e7-klipper-cache\") on node \"machine\" DevicePath \"\"" machine # [ 54.828993] k3s[881]: I0930 08:31:53.621706 881 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95ccc75d-d182-4d81-9172-e51b5e7f92e7-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 54.829775] k3s[881]: I0930 08:31:53.621721 881 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f48fb\" (UniqueName: \"kubernetes.io/projected/95ccc75d-d182-4d81-9172-e51b5e7f92e7-kube-api-access-f48fb\") on node \"machine\" DevicePath \"\"" machine # [ 54.830512] k3s[881]: I0930 08:31:53.621737 881 reconciler_common.go:299] "Volume detached for volume \"content\" (UniqueName: \"kubernetes.io/configmap/95ccc75d-d182-4d81-9172-e51b5e7f92e7-content\") on node \"machine\" DevicePath \"\"" machine # [ 54.831240] k3s[881]: I0930 08:31:53.621750 881 reconciler_common.go:299] "Volume detached for volume \"values\" (UniqueName: \"kubernetes.io/projected/95ccc75d-d182-4d81-9172-e51b5e7f92e7-values\") on node \"machine\" DevicePath \"\"" machine # [ 54.918978] k3s[881]: I0930 08:31:53.712826 881 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-5877cc8b4f-rwk8f" podStartSLOduration=2.712803018 podStartE2EDuration="2.712803018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-30 08:31:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 08:31:53.712632046 +0000 UTC m=+38.196224377" watchObservedRunningTime="2026-09-30 08:31:53.712803018 +0000 UTC m=+38.196395908" machine # [ 54.952076] dhcpcd[695]: veth7e9f2a6e: soliciting a DHCP lease machine # [ 55.081193] systemd[1]: Removed slice libcontainer container kubepods-burstable-pod95ccc75d_d182_4d81_9172_e51b5e7f92e7.slice. machine # [ 55.082208] systemd[1]: kubepods-burstable-pod95ccc75d_d182_4d81_9172_e51b5e7f92e7.slice: Consumed 751ms CPU time over 19.014s wall clock time, 32.9M memory peak, 2.6M incoming IP traffic, 149.7K outgoing IP traffic. machine # [ 55.152186] k3s[881]: I0930 08:31:53.946589 881 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b69ac72168f53f54238040b8d33fdd57e10439c047a2773eb8137179303d9fb9" machine # [ 55.153053] k3s[881]: E0930 08:31:53.946936 881 kubelet_pods.go:2193] "failed to read memory cgroup config for the pod" err="failed to read memory.max for cgroup /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95ccc75d_d182_4d81_9172_e51b5e7f92e7.slice: openat2 /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95ccc75d_d182_4d81_9172_e51b5e7f92e7.slice/memory.max: no such file or directory" podName="helm-install-nix-grpc-farm-mvlk4" machine # [ 55.153759] k3s[881]: E0930 08:31:53.946990 881 kubelet_pods.go:2198] "failed to read memory cgroup limits for the pod" err="failed to read cpu.max file for cgroup /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95ccc75d_d182_4d81_9172_e51b5e7f92e7.slice: openat2 /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95ccc75d_d182_4d81_9172_e51b5e7f92e7.slice/cpu.max: no such file or directory" podName="helm-install-nix-grpc-farm-mvlk4" machine # [ 55.189602] dhcpcd[695]: veth31d36151: soliciting an IPv6 router machine # [ 55.252115] systemd[1]: var-lib-kubelet-pods-95ccc75d\x2dd182\x2d4d81\x2d9172\x2de51b5e7f92e7-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2df48fb.mount: Deactivated successfully. machine # [ 55.252541] systemd[1]: var-lib-kubelet-pods-95ccc75d\x2dd182\x2d4d81\x2d9172\x2de51b5e7f92e7-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 55.253398] systemd[1]: var-lib-kubelet-pods-95ccc75d\x2dd182\x2d4d81\x2d9172\x2de51b5e7f92e7-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dconfig.mount: Deactivated successfully. machine # [ 55.300476] dhcpcd[695]: veth7e9f2a6e: soliciting an IPv6 router machine # [ 56.166583] dhcpcd[695]: veth9d5f407b: soliciting an IPv6 router machine # [ 56.206414] dhcpcd[695]: veth32a98dd6: soliciting an IPv6 router machine # [ 58.457456] dhcpcd[695]: veth31d36151: probing for an IPv4LL address machine # [ 58.873226] dhcpcd[695]: veth32a98dd6: probing for an IPv4LL address machine # [ 58.964877] dhcpcd[695]: veth0dbc4ca9: using IPv4LL address 169.254.65.159 machine # [ 58.970905] dhcpcd[695]: veth0dbc4ca9: adding route to 169.254.0.0/16 machine # [ 59.431433] dhcpcd[695]: veth9d5f407b: probing for an IPv4LL address machine # [ 59.766742] systemd[1]: Started libcontainer container b9426b0b7f8762f90238d787df13e0cd533512afae2f2ed86478a1329d00e5a4. machine # [ 59.837421] k3s[881]: I0930 08:31:58.630990 881 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-scheduler-55cccf6d96-wwgf5" podStartSLOduration=7.630965242 podStartE2EDuration="7.630965242s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-30 08:31:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 08:31:58.629794143 +0000 UTC m=+43.113386474" watchObservedRunningTime="2026-09-30 08:31:58.630965242 +0000 UTC m=+43.114557573" machine # [ 59.886038] systemd[1]: tmp-ovl\x2didmapped960627963.mount: Deactivated successfully. machine # [ 59.903407] systemd[1]: Started libcontainer container 4273d01bb6aa70b80482a39506d76fd02dd185ed19267145c16d002ea68f2b56. machine # [ 59.933192] systemd[1]: tmp-ovl\x2didmapped4101872256.mount: Deactivated successfully. machine # [ 59.953462] dhcpcd[695]: veth7e9f2a6e: probing for an IPv4LL address machine # [ 59.955884] systemd[1]: Started libcontainer container a7e7600eb426f04b7d33ee6e80520e9ee16974a98f65d25890608af7663765d7. machine # [ 60.099781] niks3-server[1185]: 2026/09/30 08:31:58 INFO lead: acquired remote=10.42.0.7:45288 machine # [ 61.550667] dhcpcd[695]: veth0dbc4ca9: no IPv6 Routers available machine # [ 61.763898] systemd[1]: cri-containerd-a7e7600eb426f04b7d33ee6e80520e9ee16974a98f65d25890608af7663765d7.scope: Deactivated successfully. machine # [ 61.764698] systemd[1]: cri-containerd-a7e7600eb426f04b7d33ee6e80520e9ee16974a98f65d25890608af7663765d7.scope: Consumed 765ms CPU time over 1.808s wall clock time, 376.8M memory peak, 64.9M read from disk, 129.4M written to disk. machine # [ 61.765724] systemd[1]: cri-containerd-4273d01bb6aa70b80482a39506d76fd02dd185ed19267145c16d002ea68f2b56.scope: Deactivated successfully. machine # [ 61.766714] systemd[1]: cri-containerd-4273d01bb6aa70b80482a39506d76fd02dd185ed19267145c16d002ea68f2b56.scope: Consumed 780ms CPU time over 1.862s wall clock time, 397.3M memory peak, 85M read from disk, 236M written to disk. machine # [ 61.824280] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-4273d01bb6aa70b80482a39506d76fd02dd185ed19267145c16d002ea68f2b56-rootfs.mount: Deactivated successfully. machine # [ 61.834880] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-a7e7600eb426f04b7d33ee6e80520e9ee16974a98f65d25890608af7663765d7-rootfs.mount: Deactivated successfully. machine # [ 62.416423] systemd[1]: Started libcontainer container 84714c002c2510705a8ee6b0df381b4d23685893f7539c83c1b1c6bb60cf46c6. machine # [ 62.447481] systemd[1]: Started libcontainer container 9e594abadf36b7db9970c4c30c837eb028c6f53b045492d834d6ea121fe4da44. machine # error: timed out waiting for the condition machine # [ 62.625514] systemd[1]: Started libcontainer container e2730276c69773562df36679e05e65e4f82a14835c3360e3639f13e30122fc3f. machine # [ 62.657363] systemd[1]: Started libcontainer container 13bc85b53ca1d6528ee655a45f361ae85ec69688257c576a845970d85a05441e. machine # [ 62.832926] systemd[1]: tmp-ovl\x2didmapped4179135933.mount: Deactivated successfully. machine # [ 62.919868] systemd[1]: tmp-ovl\x2didmapped3230988402.mount: Deactivated successfully. machine # [ 62.934273] systemd[1]: Started libcontainer container 6af9d25b9dd7ad2d1365df076d50bb1b6b196f6b609978d244a1e92a9fd440da. machine # [ 62.936839] systemd[1]: Started libcontainer container 8d28891da9adefec747c8f42cfa6a603a89772454d9e403d2a66eb5aad557502. machine # [ 63.014230] k3s[881]: I0930 08:32:01.808221 881 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-hmcxr" podStartSLOduration=9.082335178 podStartE2EDuration="10.80819447s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.725859292s" isStatefulPod=false podCreationTimestamp="2026-09-30 08:31:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 08:32:01.807359448 +0000 UTC m=+46.290951779" watchObservedRunningTime="2026-09-30 08:32:01.80819447 +0000 UTC m=+46.291787360" machine # [ 63.032973] k3s[881]: I0930 08:32:01.826996 881 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-wp7qx" podStartSLOduration=9.005019206 podStartE2EDuration="10.82697032s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.821951114s" isStatefulPod=false podCreationTimestamp="2026-09-30 08:31:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 08:32:01.825335755 +0000 UTC m=+46.308928086" watchObservedRunningTime="2026-09-30 08:32:01.82697032 +0000 UTC m=+46.310562931" machine # [ 63.465995] dhcpcd[695]: veth31d36151: using IPv4LL address 169.254.236.249 machine # [ 63.467378] dhcpcd[695]: veth31d36151: adding route to 169.254.0.0/16 machine # [ 63.774797] dhcpcd[695]: veth32a98dd6: using IPv4LL address 169.254.82.198 machine # [ 63.776098] dhcpcd[695]: veth32a98dd6: adding route to 169.254.0.0/16 machine # [ 63.939637] dhcpcd[695]: veth9d5f407b: using IPv4LL address 169.254.218.202 machine # [ 63.940895] dhcpcd[695]: veth9d5f407b: adding route to 169.254.0.0/16 machine # [ 65.160954] dhcpcd[695]: veth7e9f2a6e: using IPv4LL address 169.254.17.105 machine # [ 65.162256] dhcpcd[695]: veth7e9f2a6e: adding route to 169.254.0.0/16 machine # [ 67.193882] dhcpcd[695]: veth31d36151: no IPv6 Routers available machine # [ 67.302768] dhcpcd[695]: veth7e9f2a6e: no IPv6 Routers available machine # [ 68.169135] dhcpcd[695]: veth9d5f407b: no IPv6 Routers available machine # [ 68.210378] dhcpcd[695]: veth32a98dd6: no IPv6 Routers available machine # error: timed out waiting for the condition machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 49.66 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s, in 0.21 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s, in 0.18 seconds) machine: waiting for unit niks3.service machine: (finished: waiting for unit niks3.service, in 0.03 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.26 seconds) machine: waiting for success: test $(curl -sf 10.42.0.6:9901/clusters | grep -c 'health_flags::healthy') -ge 3 machine: (finished: waiting for success: test $(curl -sf 10.42.0.6:9901/clusters | grep -c 'health_flags::healthy') -ge 3, in 0.08 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.19 seconds) machine: waiting for success: curl -sf http://10.42.0.7:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2' machine: (finished: waiting for success: curl -sf http://10.42.0.7:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2', in 0.04 seconds) (finished: subtest: chart deploys and workers become Ready, in 50.66 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}', in 0.14 seconds) machine: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt machine: (finished: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt, in 0.16 seconds) subtest: build through the balancer lands in the cache machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1 machine # [ 139.004274] niks3-server[1185]: 2026/09/30 08:33:17 INFO Received push request method=POST path=/api/pushes machine # [ 139.030247] niks3-server[1185]: 2026/09/30 08:33:17 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign machine # [ 139.035751] niks3-server[1185]: 2026/09/30 08:33:17 INFO Signed narinfos id=1 count=1 machine # [ 139.040630] niks3-server[1185]: 2026/09/30 08:33:17 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.ls machine # [ 139.043791] niks3-server[1185]: 2026/09/30 08:33:17 INFO Registered completed upload object_key=nar/0nzzbas7l8d37mridr7mg162smfjvn7lhs6am4crl4ydaxicigj8.nar.zst machine # [ 139.046799] niks3-server[1185]: 2026/09/30 08:33:17 INFO Received complete push request method=POST path=/api/pushes/1/complete machine # [ 139.050699] niks3-server[1185]: 2026/09/30 08:33:17 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.narinfo machine # [ 163.355852] niks3-server[1185]: 2026/09/30 08:33:42 INFO Received push request method=POST path=/api/pushes machine # [ 163.375428] niks3-server[1185]: 2026/09/30 08:33:42 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign machine # [ 163.377682] niks3-server[1185]: 2026/09/30 08:33:42 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.ls machine # [ 163.382720] niks3-server[1185]: 2026/09/30 08:33:42 INFO Registered completed upload object_key=log/yz1sqzb72i8v6h2ass0v76ba8cncqj9r-k3s-a.drv machine # [ 163.389928] niks3-server[1185]: 2026/09/30 08:33:42 INFO Signed narinfos id=2 count=1 machine # [ 163.390883] niks3-server[1185]: 2026/09/30 08:33:42 INFO Registered completed upload object_key=nar/1p7jh5nyz9n68k5f18ymmdpgr34mpnnch1njw7ki7b2b97qlfbjk.nar.zst machine # [ 163.396750] niks3-server[1185]: 2026/09/30 08:33:42 INFO Received complete push request method=POST path=/api/pushes/2/complete machine # [ 163.408367] niks3-server[1185]: 2026/09/30 08:33:42 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.narinfo machine # [ 163.476312] niks3-server[1185]: 2026/09/30 08:33:42 INFO Received push request method=POST path=/api/pushes machine # [ 163.489280] niks3-server[1185]: 2026/09/30 08:33:42 INFO Received sign narinfos request method=POST path=/api/pushes/3/sign machine # [ 163.491208] niks3-server[1185]: 2026/09/30 08:33:42 INFO Signed narinfos id=3 count=1 machine # [ 163.493584] niks3-server[1185]: 2026/09/30 08:33:42 INFO Registered completed upload object_key=nar/03a4ywhyr5knmbc93z4gyml5y8fvgb431xvlmfxrwsm8mrb0qgx2.nar.zst machine # [ 163.495313] niks3-server[1185]: 2026/09/30 08:33:42 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.ls machine # [ 163.502227] niks3-server[1185]: 2026/09/30 08:33:42 INFO Received complete push request method=POST path=/api/pushes/3/complete machine # [ 163.506401] niks3-server[1185]: 2026/09/30 08:33:42 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.narinfo machine # [ 188.616361] niks3-server[1185]: 2026/09/30 08:34:07 INFO Received push request method=POST path=/api/pushes machine # [ 188.637956] niks3-server[1185]: 2026/09/30 08:34:07 INFO Received sign narinfos request method=POST path=/api/pushes/4/sign machine # [ 188.638785] niks3-server[1185]: 2026/09/30 08:34:07 INFO Registered completed upload object_key=log/zfq1xw9bmycqh35l0s44lmv65z4xc7br-k3s-b.drv machine # [ 188.642133] niks3-server[1185]: 2026/09/30 08:34:07 INFO Signed narinfos id=4 count=1 machine # [ 188.644833] niks3-server[1185]: 2026/09/30 08:34:07 INFO Registered completed upload object_key=nar/05qjsj5ff3a6vnxkhb6k5f3m446dcc206p7cd37w4v3mgi95d7kh.nar.zst machine # [ 188.646376] niks3-server[1185]: 2026/09/30 08:34:07 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.ls machine # [ 188.654257] niks3-server[1185]: 2026/09/30 08:34:07 INFO Received complete push request method=POST path=/api/pushes/4/complete machine # [ 188.660295] niks3-server[1185]: 2026/09/30 08:34:07 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.narinfo machine # [ 188.728895] niks3-server[1185]: 2026/09/30 08:34:07 INFO Received push request method=POST path=/api/pushes machine # [ 188.747181] niks3-server[1185]: 2026/09/30 08:34:07 INFO Received sign narinfos request method=POST path=/api/pushes/5/sign machine # [ 188.750407] niks3-server[1185]: 2026/09/30 08:34:07 INFO Registered completed upload object_key=nar/0jyw88klkf3nwxpnj5m5lx3i1dv2idf3hcn6im7883hnldm3gvyq.nar.zst machine # [ 188.752933] niks3-server[1185]: 2026/09/30 08:34:07 INFO Signed narinfos id=5 count=1 machine # [ 188.754306] niks3-server[1185]: 2026/09/30 08:34:07 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.ls machine # [ 188.756701] niks3-server[1185]: 2026/09/30 08:34:07 INFO Received complete push request method=POST path=/api/pushes/5/complete machine # [ 188.762739] niks3-server[1185]: 2026/09/30 08:34:07 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.narinfo machine # [ 213.676779] niks3-server[1185]: 2026/09/30 08:34:32 INFO Received push request method=POST path=/api/pushes machine # [ 213.696268] niks3-server[1185]: 2026/09/30 08:34:32 INFO Received sign narinfos request method=POST path=/api/pushes/6/sign machine # [ 213.703115] niks3-server[1185]: 2026/09/30 08:34:32 INFO Signed narinfos id=6 count=1 machine # [ 213.705852] niks3-server[1185]: 2026/09/30 08:34:32 INFO Registered completed upload object_key=log/n40czam6a4ldp1mh5fdmlcy07fv0akbm-k3s-top.drv machine # [ 213.710239] niks3-server[1185]: 2026/09/30 08:34:32 INFO Registered completed upload object_key=nar/1q8vp5xqws560mpf8rxk8r8jhqrzibivh13x4wxy0cfqlzbk7cr5.nar.zst machine # [ 213.714182] niks3-server[1185]: 2026/09/30 08:34:32 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.ls machine # [ 213.717502] niks3-server[1185]: 2026/09/30 08:34:32 INFO Received complete push request method=POST path=/api/pushes/6/complete machine # [ 213.722235] niks3-server[1185]: 2026/09/30 08:34:32 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1, in 136.19 seconds) machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath, in 0.14 seconds) machine: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine: (finished: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.01 seconds) machine: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine # copying 3 paths... machine # copying path '/nix/store/r95r891injj9ski5c4w89yxjvjy065mx-k3s-a' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/mrqsh0475wxsmnsvkk55g94v6g5nrcra-k3s-b' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top' from 'http://192.168.1.1:5751'... machine: (finished: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.20 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1 machine # [ 214.397515] niks3-server[1185]: 2026/09/30 08:34:33 INFO Received push request method=POST path=/api/pushes machine # [ 214.419311] niks3-server[1185]: 2026/09/30 08:34:33 INFO Received sign narinfos request method=POST path=/api/pushes/7/sign machine # [ 214.422620] niks3-server[1185]: 2026/09/30 08:34:33 INFO Signed narinfos id=7 count=1 machine # [ 214.424697] niks3-server[1185]: 2026/09/30 08:34:33 INFO Registered completed upload object_key=nar/1fr26arhri17j9bj6hyjzmmd74v730biz1gb3kqd194vjx3ccvp9.nar.zst machine # [ 214.427227] niks3-server[1185]: 2026/09/30 08:34:33 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.ls machine # [ 214.428188] niks3-server[1185]: 2026/09/30 08:34:33 INFO Received complete push request method=POST path=/api/pushes/7/complete machine # [ 214.433789] niks3-server[1185]: 2026/09/30 08:34:33 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.narinfo machine # [ 238.959762] niks3-server[1185]: 2026/09/30 08:34:57 INFO Received push request method=POST path=/api/pushes machine # [ 239.021643] niks3-server[1185]: 2026/09/30 08:34:57 INFO Received sign narinfos request method=POST path=/api/pushes/8/sign machine # [ 239.023038] niks3-server[1185]: 2026/09/30 08:34:57 INFO Registered completed upload object_key=nar/1hfc6x4x25k3b0fk091d3nb0k3mympfp05fkslcx19synp3ig0zd.nar.zst machine # [ 239.026245] niks3-server[1185]: 2026/09/30 08:34:57 INFO Registered completed upload object_key=log/pbpqsh50ar10fpasdqqx8xg3lmr5j8iz-k3s-a.drv machine # [ 239.031987] niks3-server[1185]: 2026/09/30 08:34:57 INFO Signed narinfos id=8 count=1 machine # [ 239.043263] niks3-server[1185]: 2026/09/30 08:34:57 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.ls machine # [ 239.057989] niks3-server[1185]: 2026/09/30 08:34:57 INFO Received complete push request method=POST path=/api/pushes/8/complete machine # [ 239.071565] niks3-server[1185]: 2026/09/30 08:34:57 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.narinfo machine # [ 239.210489] niks3-server[1185]: 2026/09/30 08:34:58 INFO Received push request method=POST path=/api/pushes machine # [ 239.230820] niks3-server[1185]: 2026/09/30 08:34:58 INFO Received sign narinfos request method=POST path=/api/pushes/9/sign machine # [ 239.237281] niks3-server[1185]: 2026/09/30 08:34:58 INFO Signed narinfos id=9 count=1 machine # [ 239.241319] niks3-server[1185]: 2026/09/30 08:34:58 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.ls machine # [ 239.244649] niks3-server[1185]: 2026/09/30 08:34:58 INFO Registered completed upload object_key=nar/0zzq2vgjln4shvh57091n14sam6wh6w06vja6lzb9ppcj4ffyx1n.nar.zst machine # [ 239.252274] niks3-server[1185]: 2026/09/30 08:34:58 INFO Received complete push request method=POST path=/api/pushes/9/complete machine # [ 239.259796] niks3-server[1185]: 2026/09/30 08:34:58 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.narinfo machine # [ 264.388819] niks3-server[1185]: 2026/09/30 08:35:23 INFO Received push request method=POST path=/api/pushes machine # [ 264.405512] niks3-server[1185]: 2026/09/30 08:35:23 INFO Received sign narinfos request method=POST path=/api/pushes/10/sign machine # [ 264.407537] niks3-server[1185]: 2026/09/30 08:35:23 INFO Signed narinfos id=10 count=1 machine # [ 264.411599] niks3-server[1185]: 2026/09/30 08:35:23 INFO Registered completed upload object_key=nar/0hh3nqk95r6g32lhdmxw8cxjv694vbpx9876zkhcpg4r4qxni2ch.nar.zst machine # [ 264.414651] niks3-server[1185]: 2026/09/30 08:35:23 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.ls machine # [ 264.416624] niks3-server[1185]: 2026/09/30 08:35:23 INFO Registered completed upload object_key=log/894h6wzw2l4w5f0hikj1k6q57jfnyi87-k3s-b.drv machine # [ 264.419741] niks3-server[1185]: 2026/09/30 08:35:23 INFO Received complete push request method=POST path=/api/pushes/10/complete machine # [ 264.423412] niks3-server[1185]: 2026/09/30 08:35:23 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.narinfo machine # [ 264.491736] niks3-server[1185]: 2026/09/30 08:35:23 INFO Received push request method=POST path=/api/pushes machine # [ 264.502100] niks3-server[1185]: 2026/09/30 08:35:23 INFO Received sign narinfos request method=POST path=/api/pushes/11/sign machine # [ 264.502971] niks3-server[1185]: 2026/09/30 08:35:23 INFO Signed narinfos id=11 count=1 machine # [ 264.507816] niks3-server[1185]: 2026/09/30 08:35:23 INFO Received complete push request method=POST path=/api/pushes/11/complete machine # [ 264.508781] niks3-server[1185]: 2026/09/30 08:35:23 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.ls machine # [ 264.511139] niks3-server[1185]: 2026/09/30 08:35:23 INFO Registered completed upload object_key=nar/0ingamx56k31lwiyxmnxmscjj4n3qfx6sr2kpaynsrwhwz1278iw.nar.zst machine # [ 289.639842] niks3-server[1185]: 2026/09/30 08:35:48 INFO Received push request method=POST path=/api/pushes machine # [ 289.659451] niks3-server[1185]: 2026/09/30 08:35:48 INFO Received sign narinfos request method=POST path=/api/pushes/12/sign machine # [ 289.661563] niks3-server[1185]: 2026/09/30 08:35:48 INFO Signed narinfos id=12 count=1 machine # [ 289.666820] niks3-server[1185]: 2026/09/30 08:35:48 INFO Registered completed upload object_key=nar/0v48x4sp58bvfra08axgkz7yl1n9nc4nirskyv1hwann4i7q277i.nar.zst machine # [ 289.673191] niks3-server[1185]: 2026/09/30 08:35:48 INFO Received complete push request method=POST path=/api/pushes/12/complete machine # [ 289.674916] niks3-server[1185]: 2026/09/30 08:35:48 INFO Registered completed upload object_key=log/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g-k3s-top.drv machine # [ 289.675865] niks3-server[1185]: 2026/09/30 08:35:48 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.ls machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1, in 75.60 seconds) (finished: subtest: build through the balancer lands in the cache, in 212.15 seconds) subtest: a Job with the client image builds through the farm with its service account machine: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine: (finished: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.16 seconds) machine: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix machine: (finished: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix, in 0.14 seconds) machine: must succeed: kubectl apply -f /nix/store/4qg21n7g16x8lyv0fhhdx9dx3lxqkcdn-ci-job.json machine: (finished: must succeed: kubectl apply -f /nix/store/4qg21n7g16x8lyv0fhhdx9dx3lxqkcdn-ci-job.json, in 0.17 seconds) machine: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed' machine # [ 290.682352] systemd[1]: Created slice libcontainer container kubepods-besteffort-pode2aab4f3_6292_4ebb_92a7_d61172d88447.slice. machine # [ 290.765124] k3s[881]: I0930 08:35:49.559157 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mskp\" (UniqueName: \"kubernetes.io/projected/e2aab4f3-6292-4ebb-92a7-d61172d88447-kube-api-access-4mskp\") pod \"ci-cp9zf\" (UID: \"e2aab4f3-6292-4ebb-92a7-d61172d88447\") " pod="ci/ci-cp9zf" machine # [ 290.765887] k3s[881]: I0930 08:35:49.559213 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/e2aab4f3-6292-4ebb-92a7-d61172d88447-nix-grpc-farm\") pod \"ci-cp9zf\" (UID: \"e2aab4f3-6292-4ebb-92a7-d61172d88447\") " pod="ci/ci-cp9zf" machine # [ 290.766473] k3s[881]: I0930 08:35:49.559245 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"job\" (UniqueName: \"kubernetes.io/configmap/e2aab4f3-6292-4ebb-92a7-d61172d88447-job\") pod \"ci-cp9zf\" (UID: \"e2aab4f3-6292-4ebb-92a7-d61172d88447\") " pod="ci/ci-cp9zf" machine # [ 291.169210] cni0: port 2(veth70320e50) entered blocking state machine # [ 291.172003] cni0: port 2(veth70320e50) entered disabled state machine # [ 291.174465] veth70320e50: entered allmulticast mode machine # [ 291.176834] veth70320e50: entered promiscuous mode machine # [ 291.193025] cni0: port 2(veth70320e50) entered blocking state machine # [ 291.195626] cni0: port 2(veth70320e50) entered forwarding state machine # [ 291.101756] (udev-worker)[5208]: Network interface NamePolicy= disabled on kernel command line. machine # [ 291.126740] dhcpcd[695]: veth70320e50: IAID db:87:e4:60 machine # [ 291.127705] dhcpcd[695]: veth70320e50: adding address fe80::84c7:dbff:fe87:e460 machine # [ 291.154314] systemd[1]: Started libcontainer container fa99976658aaab14aad68f502c230aaebd07590e6f67ade141f172ba6cb5e72e. machine # [ 291.707291] dhcpcd[695]: veth70320e50: soliciting a DHCP lease machine # [ 292.702174] dhcpcd[695]: veth70320e50: soliciting an IPv6 router machine # [ 293.469732] systemd[1]: Started libcontainer container 4d6eb93ebc8f9b6c361edf8116a3acd68743fd8cd805459465538aa88d3b2195. machine # [ 293.567268] k3s[881]: I0930 08:35:52.361251 881 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ci/ci-cp9zf" podStartSLOduration=3.361227301 podStartE2EDuration="3.361227301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-30 08:35:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 08:35:52.36022466 +0000 UTC m=+276.843817270" watchObservedRunningTime="2026-09-30 08:35:52.361227301 +0000 UTC m=+276.844819912" machine # [ 294.831832] niks3-server[1185]: 2026/09/30 08:35:53 INFO Received push request method=POST path=/api/pushes machine # [ 294.848657] niks3-server[1185]: 2026/09/30 08:35:53 INFO Received sign narinfos request method=POST path=/api/pushes/13/sign machine # [ 294.849958] niks3-server[1185]: 2026/09/30 08:35:53 INFO Signed narinfos id=13 count=1 machine # [ 294.855352] niks3-server[1185]: 2026/09/30 08:35:53 INFO Registered completed upload object_key=nar/111g6dyibwcf2z7jhpn72rgja0qvjgpdiv9nc06g2dp7ih0a6kyq.nar.zst machine # [ 294.857892] niks3-server[1185]: 2026/09/30 08:35:53 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.ls machine # [ 294.863808] niks3-server[1185]: 2026/09/30 08:35:53 INFO Received complete push request method=POST path=/api/pushes/13/complete machine # [ 294.868751] niks3-server[1185]: 2026/09/30 08:35:53 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.narinfo machine # [ 296.708513] dhcpcd[695]: veth70320e50: probing for an IPv4LL address machine # [ 301.223204] dhcpcd[695]: veth70320e50: using IPv4LL address 169.254.206.139 machine # [ 301.225913] dhcpcd[695]: veth70320e50: adding route to 169.254.0.0/16 machine # [ 304.709576] dhcpcd[695]: veth70320e50: no IPv6 Routers available machine # [ 309.690302] postgres[752]: [752] LOG: checkpoint starting: time machine # [ 319.198117] niks3-server[1185]: 2026/09/30 08:36:17 INFO Received push request method=POST path=/api/pushes machine # [ 319.218619] niks3-server[1185]: 2026/09/30 08:36:18 INFO Received sign narinfos request method=POST path=/api/pushes/14/sign machine # [ 319.221678] niks3-server[1185]: 2026/09/30 08:36:18 INFO Registered completed upload object_key=nar/058kjd2vfl1r27b4d9ixvwf77d8rkr18a4v894kwx8lg0nwpajnr.nar.zst machine # [ 319.229666] niks3-server[1185]: 2026/09/30 08:36:18 INFO Signed narinfos id=14 count=1 machine # [ 319.232154] niks3-server[1185]: 2026/09/30 08:36:18 INFO Registered completed upload object_key=log/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # [ 319.239389] niks3-server[1185]: 2026/09/30 08:36:18 INFO Received complete push request method=POST path=/api/pushes/14/complete machine # [ 319.243341] niks3-server[1185]: 2026/09/30 08:36:18 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.ls machine # [ 319.247579] niks3-server[1185]: 2026/09/30 08:36:18 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.narinfo machine # [ 319.313302] niks3-server[1185]: 2026/09/30 08:36:18 INFO Received push request method=POST path=/api/pushes machine # [ 319.329488] niks3-server[1185]: 2026/09/30 08:36:18 INFO Received sign narinfos request method=POST path=/api/pushes/15/sign machine # [ 319.330195] niks3-server[1185]: 2026/09/30 08:36:18 INFO Registered completed upload object_key=nar/138ynhcd5wxzz485x9qcq7xsargaklrf2li31ai69m5r46am35q6.nar.zst machine # [ 319.330714] niks3-server[1185]: 2026/09/30 08:36:18 INFO Signed narinfos id=15 count=1 machine # [ 319.334237] niks3-server[1185]: 2026/09/30 08:36:18 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.ls machine # [ 319.339690] niks3-server[1185]: 2026/09/30 08:36:18 INFO Received complete push request method=POST path=/api/pushes/15/complete machine # [ 319.345350] niks3-server[1185]: 2026/09/30 08:36:18 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.narinfo machine # [ 343.862133] niks3-server[1185]: 2026/09/30 08:36:42 INFO Received push request method=POST path=/api/pushes machine # [ 343.892369] niks3-server[1185]: 2026/09/30 08:36:42 INFO Received sign narinfos request method=POST path=/api/pushes/16/sign machine # [ 343.896209] niks3-server[1185]: 2026/09/30 08:36:42 INFO Signed narinfos id=16 count=1 machine # [ 343.897369] niks3-server[1185]: 2026/09/30 08:36:42 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.ls machine # [ 343.902692] niks3-server[1185]: 2026/09/30 08:36:42 INFO Registered completed upload object_key=nar/0n4lbdlp8w72fs3qbavl2lwrzbrn55i2b1vyglc89cc3pi8vbb1m.nar.zst machine # [ 343.910890] niks3-server[1185]: 2026/09/30 08:36:42 INFO Registered completed upload object_key=log/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # [ 343.917696] niks3-server[1185]: 2026/09/30 08:36:42 INFO Received complete push request method=POST path=/api/pushes/16/complete machine # [ 343.931120] niks3-server[1185]: 2026/09/30 08:36:42 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo machine # [ 343.998972] niks3-server[1185]: 2026/09/30 08:36:42 INFO Received push request method=POST path=/api/pushes machine # [ 344.011091] niks3-server[1185]: 2026/09/30 08:36:42 INFO Received sign narinfos request method=POST path=/api/pushes/17/sign machine # [ 344.013232] niks3-server[1185]: 2026/09/30 08:36:42 INFO Signed narinfos id=17 count=1 machine # [ 344.017876] niks3-server[1185]: 2026/09/30 08:36:42 INFO Registered completed upload object_key=nar/1f3gvnvqsm2pm3laixkxkg44kvjb251zqhszcfpp0a00h6x66ljs.nar.zst machine # [ 344.020085] niks3-server[1185]: 2026/09/30 08:36:42 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.ls machine # [ 344.022947] niks3-server[1185]: 2026/09/30 08:36:42 INFO Received complete push request method=POST path=/api/pushes/17/complete machine # [ 344.030378] niks3-server[1185]: 2026/09/30 08:36:42 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.narinfo machine # [ 368.532453] niks3-server[1185]: 2026/09/30 08:37:07 INFO Received push request method=POST path=/api/pushes machine # [ 368.547757] niks3-server[1185]: 2026/09/30 08:37:07 INFO Received sign narinfos request method=POST path=/api/pushes/18/sign machine # [ 368.550933] niks3-server[1185]: 2026/09/30 08:37:07 INFO Signed narinfos id=18 count=1 machine # [ 368.553441] niks3-server[1185]: 2026/09/30 08:37:07 INFO Registered completed upload object_key=log/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # [ 368.555428] niks3-server[1185]: 2026/09/30 08:37:07 INFO Registered completed upload object_key=nar/1zwf0asrdv12q40fmqga5lx5330dvn9y4in4i9ficz9ij5lhvnf5.nar.zst machine # [ 368.556656] niks3-server[1185]: 2026/09/30 08:37:07 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.ls machine # [ 368.564379] niks3-server[1185]: 2026/09/30 08:37:07 INFO Received complete push request method=POST path=/api/pushes/18/complete machine # [ 368.568342] niks3-server[1185]: 2026/09/30 08:37:07 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo machine # [ 370.173504] niks3-server[1185]: 2026/09/30 08:37:08 INFO Received push request method=POST path=/api/pushes machine # [ 370.185081] niks3-server[1185]: 2026/09/30 08:37:08 INFO Received sign narinfos request method=POST path=/api/pushes/19/sign machine # [ 370.186918] niks3-server[1185]: 2026/09/30 08:37:08 INFO Signed narinfos id=19 count=1 machine # [ 370.188894] niks3-server[1185]: 2026/09/30 08:37:08 INFO Registered completed upload object_key=nar/0xiyqcsl8db7dnrq2gqnx5izavr51ma3dcdswrriaxfgj3qzk7xf.nar.zst machine # [ 370.191448] niks3-server[1185]: 2026/09/30 08:37:08 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.ls machine # [ 370.194351] niks3-server[1185]: 2026/09/30 08:37:08 INFO Received complete push request method=POST path=/api/pushes/19/complete machine # [ 370.197058] niks3-server[1185]: 2026/09/30 08:37:08 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.narinfo machine # [ 394.716391] niks3-server[1185]: 2026/09/30 08:37:33 INFO Received push request method=POST path=/api/pushes machine # [ 394.737770] niks3-server[1185]: 2026/09/30 08:37:33 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.ls machine # [ 394.740454] niks3-server[1185]: 2026/09/30 08:37:33 INFO Registered completed upload object_key=nar/0p3l2z3riilylr2rxb1aq2blxdfxg55wbgp4gxkns93srbr4bwyq.nar.zst machine # [ 394.742582] niks3-server[1185]: 2026/09/30 08:37:33 INFO Received sign narinfos request method=POST path=/api/pushes/20/sign machine # [ 394.744469] niks3-server[1185]: 2026/09/30 08:37:33 INFO Signed narinfos id=20 count=1 machine # [ 394.749854] niks3-server[1185]: 2026/09/30 08:37:33 INFO Registered completed upload object_key=log/fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # [ 394.752293] niks3-server[1185]: 2026/09/30 08:37:33 INFO Received complete push request method=POST path=/api/pushes/20/complete machine # [ 394.758927] niks3-server[1185]: 2026/09/30 08:37:33 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo machine # [ 395.953388] systemd[1]: cri-containerd-4d6eb93ebc8f9b6c361edf8116a3acd68743fd8cd805459465538aa88d3b2195.scope: Deactivated successfully. machine # [ 395.955304] systemd[1]: cri-containerd-4d6eb93ebc8f9b6c361edf8116a3acd68743fd8cd805459465538aa88d3b2195.scope: Consumed 1.057s CPU time over 1min 42.485s wall clock time, 99.4M memory peak, 30.2M read from disk, 428K written to disk, 18.2K incoming IP traffic, 44.7K outgoing IP traffic. machine # [ 396.005469] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-4d6eb93ebc8f9b6c361edf8116a3acd68743fd8cd805459465538aa88d3b2195-rootfs.mount: Deactivated successfully. machine # [ 397.797120] systemd[1]: cri-containerd-fa99976658aaab14aad68f502c230aaebd07590e6f67ade141f172ba6cb5e72e.scope: Deactivated successfully. machine # [ 397.871948] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-fa99976658aaab14aad68f502c230aaebd07590e6f67ade141f172ba6cb5e72e-rootfs.mount: Deactivated successfully. machine # [ 397.909972] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-fa99976658aaab14aad68f502c230aaebd07590e6f67ade141f172ba6cb5e72e-shm.mount: Deactivated successfully. machine # [ 398.097889] cni0: port 2(veth70320e50) entered disabled state machine # [ 397.954458] dhcpcd[695]: veth70320e50: carrier lost machine # [ 398.100920] veth70320e50 (unregistering): left allmulticast mode machine # [ 398.102055] veth70320e50 (unregistering): left promiscuous mode machine # [ 398.103158] cni0: port 2(veth70320e50) entered disabled state machine # [ 397.980684] systemd[1]: run-netns-cni\x2df3f6a1ad\x2d110a\x2dc586\x2d085a\x2dc6a5f933fc22.mount: Deactivated successfully. machine # [ 397.991600] dhcpcd[695]: veth70320e50: deleting address fe80::84c7:dbff:fe87:e460 machine # [ 397.995194] dhcpcd[695]: veth70320e50: deleting route to 169.254.0.0/16 machine # [ 398.052369] dhcpcd[695]: veth70320e50: removing interface machine # [ 398.053938] k3s[881]: I0930 08:37:36.847561 881 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e2aab4f3-6292-4ebb-92a7-d61172d88447-job\" (UniqueName: \"kubernetes.io/configmap/e2aab4f3-6292-4ebb-92a7-d61172d88447-job\") pod \"e2aab4f3-6292-4ebb-92a7-d61172d88447\" (UID: \"e2aab4f3-6292-4ebb-92a7-d61172d88447\") " machine # [ 398.054852] k3s[881]: I0930 08:37:36.847624 881 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e2aab4f3-6292-4ebb-92a7-d61172d88447-kube-api-access-4mskp\" (UniqueName: \"kubernetes.io/projected/e2aab4f3-6292-4ebb-92a7-d61172d88447-kube-api-access-4mskp\") pod \"e2aab4f3-6292-4ebb-92a7-d61172d88447\" (UID: \"e2aab4f3-6292-4ebb-92a7-d61172d88447\") " machine # [ 398.055707] k3s[881]: I0930 08:37:36.847656 881 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e2aab4f3-6292-4ebb-92a7-d61172d88447-nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/e2aab4f3-6292-4ebb-92a7-d61172d88447-nix-grpc-farm\") pod \"e2aab4f3-6292-4ebb-92a7-d61172d88447\" (UID: \"e2aab4f3-6292-4ebb-92a7-d61172d88447\") " machine # [ 398.056629] k3s[881]: I0930 08:37:36.848148 881 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2aab4f3-6292-4ebb-92a7-d61172d88447-job" pod "e2aab4f3-6292-4ebb-92a7-d61172d88447" (UID: "e2aab4f3-6292-4ebb-92a7-d61172d88447"). InnerVolumeSpecName "job". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 398.061075] systemd[1]: var-lib-kubelet-pods-e2aab4f3\x2d6292\x2d4ebb\x2d92a7\x2dd61172d88447-volumes-kubernetes.io\x7eprojected-nix\x2dgrpc\x2dfarm.mount: Deactivated successfully. machine # [ 398.063136] systemd[1]: var-lib-kubelet-pods-e2aab4f3\x2d6292\x2d4ebb\x2d92a7\x2dd61172d88447-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2d4mskp.mount: Deactivated successfully. machine # [ 398.077738] k3s[881]: I0930 08:37:36.871831 881 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2aab4f3-6292-4ebb-92a7-d61172d88447-nix-grpc-farm" pod "e2aab4f3-6292-4ebb-92a7-d61172d88447" (UID: "e2aab4f3-6292-4ebb-92a7-d61172d88447"). InnerVolumeSpecName "nix-grpc-farm". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 398.078596] k3s[881]: I0930 08:37:36.872045 881 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2aab4f3-6292-4ebb-92a7-d61172d88447-kube-api-access-4mskp" pod "e2aab4f3-6292-4ebb-92a7-d61172d88447" (UID: "e2aab4f3-6292-4ebb-92a7-d61172d88447"). InnerVolumeSpecName "kube-api-access-4mskp". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 398.153603] k3s[881]: I0930 08:37:36.947977 881 reconciler_common.go:299] "Volume detached for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/e2aab4f3-6292-4ebb-92a7-d61172d88447-nix-grpc-farm\") on node \"machine\" DevicePath \"\"" machine # [ 398.154566] k3s[881]: I0930 08:37:36.948011 881 reconciler_common.go:299] "Volume detached for volume \"job\" (UniqueName: \"kubernetes.io/configmap/e2aab4f3-6292-4ebb-92a7-d61172d88447-job\") on node \"machine\" DevicePath \"\"" machine # [ 398.155021] k3s[881]: I0930 08:37:36.948028 881 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mskp\" (UniqueName: \"kubernetes.io/projected/e2aab4f3-6292-4ebb-92a7-d61172d88447-kube-api-access-4mskp\") on node \"machine\" DevicePath \"\"" machine # [ 398.777960] k3s[881]: I0930 08:37:37.572274 881 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fa99976658aaab14aad68f502c230aaebd07590e6f67ade141f172ba6cb5e72e" machine # [ 398.795383] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pode2aab4f3_6292_4ebb_92a7_d61172d88447.slice. machine # [ 398.798520] systemd[1]: kubepods-besteffort-pode2aab4f3_6292_4ebb_92a7_d61172d88447.slice: Consumed 1.087s CPU time over 1min 48.111s wall clock time, 99.6M memory peak, 30.2M read from disk, 632K written to disk, 18.2K incoming IP traffic, 44.7K outgoing IP traffic. machine: (finished: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed', in 109.53 seconds) machine: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1 machine: (finished: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1, in 0.18 seconds) machine # don't know how to build these paths: machine # /nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-a> machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-hmcxr: building fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-b> machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-hmcxr: building 1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-top> machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-hmcxr: building rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # INFO:nix_fast_build.processes:run nix-eval-jobs --gc-roots-dir /tmp/tmp4xlze92u/gcroots --force-recurse --max-memory-size 4096 --workers 4 --flake '.#checks' --check-cache-status machine # INFO:nix_fast_build.workers:builds: 0 machine # warning: Git tree '/tmp' is dirty machine # warning: Git tree '/tmp' is dirty machine # ▶ x86_64-linux.t started machine # INFO:nix_fast_build.workers:builds: 2 machine # ✔ x86_64-linux.t (26s) machine # x86_64-linux.t> machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-wp7qx: building fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # warning: Git tree '/tmp' is dirty machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath, in 0.13 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null, in 0.05 seconds) (finished: subtest: a Job with the client image builds through the farm with its service account, in 110.63 seconds) subtest: a renewed balancer certificate is served without a rollout machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f - machine # Warning: resource secrets/farm-lb-tls is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically. machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f -, in 0.30 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}', in 0.28 seconds) machine: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-5877cc8b4f-rwk8f -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine # [ 401.186719] k3s[881]: E0930 08:37:39.980226 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:36680: use of closed network connection" machine # [ 402.531928] k3s[881]: E0930 08:37:41.325844 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:36688: use of closed network connection" machine # [ 403.848461] k3s[881]: E0930 08:37:42.642457 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45676: use of closed network connection" machine # [ 405.158281] k3s[881]: E0930 08:37:43.952301 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45686: use of closed network connection" machine # [ 406.496099] k3s[881]: E0930 08:37:45.290022 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45692: use of closed network connection" machine # [ 407.903452] k3s[881]: E0930 08:37:46.696037 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45696: use of closed network connection" machine # [ 409.377788] k3s[881]: E0930 08:37:48.170069 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45708: use of closed network connection" machine # [ 410.904318] k3s[881]: E0930 08:37:49.695892 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45712: use of closed network connection" machine # [ 412.463908] k3s[881]: E0930 08:37:51.256499 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45716: use of closed network connection" machine # [ 413.943960] k3s[881]: E0930 08:37:52.737666 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:55690: use of closed network connection" machine # [ 414.012468] postgres[752]: [752] LOG: checkpoint complete: wrote 1037 buffers (6.3%), wrote 3 SLRU buffers; 1 WAL file(s) added, 0 removed, 0 recycled; write=104.175 s, sync=0.092 s, total=104.323 s; sync files=364, longest=0.010 s, average=0.001 s; distance=4977 kB, estimate=4977 kB; lsn=0/1C72C08, redo lsn=0/1C42868 machine # [ 415.378236] k3s[881]: E0930 08:37:54.171933 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:55706: use of closed network connection" machine # [ 416.865409] k3s[881]: E0930 08:37:55.657312 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:55708: use of closed network connection" machine # [ 418.463140] k3s[881]: E0930 08:37:57.256810 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:55716: use of closed network connection" machine # [ 421.570481] k3s[881]: E0930 08:38:00.359999 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:55722: use of closed network connection" machine # [ 423.079931] k3s[881]: E0930 08:38:01.873671 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47340: use of closed network connection" machine # [ 424.619333] k3s[881]: E0930 08:38:03.413057 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47352: use of closed network connection" machine # [ 425.850705] k3s[881]: E0930 08:38:04.644754 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47362: use of closed network connection" machine # [ 427.109614] k3s[881]: E0930 08:38:05.903328 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47370: use of closed network connection" machine # [ 428.375698] k3s[881]: E0930 08:38:07.169696 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47374: use of closed network connection" machine # [ 429.648299] k3s[881]: E0930 08:38:08.442294 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47380: use of closed network connection" machine # [ 430.936965] k3s[881]: E0930 08:38:09.731016 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47394: use of closed network connection" machine # [ 432.211501] k3s[881]: E0930 08:38:11.005596 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47398: use of closed network connection" machine # [ 433.476978] k3s[881]: E0930 08:38:12.269941 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:44312: use of closed network connection" machine # [ 434.782112] k3s[881]: E0930 08:38:13.575453 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:44314: use of closed network connection" machine: (finished: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-5877cc8b4f-rwk8f -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 33.87 seconds) machine: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine: (finished: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 0.05 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1 machine # [ 435.052616] niks3-server[1185]: 2026/09/30 08:38:13 INFO Received push request method=POST path=/api/pushes machine # [ 435.071540] niks3-server[1185]: 2026/09/30 08:38:13 INFO Received sign narinfos request method=POST path=/api/pushes/21/sign machine # [ 435.073458] niks3-server[1185]: 2026/09/30 08:38:13 INFO Signed narinfos id=21 count=1 machine # [ 435.078858] niks3-server[1185]: 2026/09/30 08:38:13 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.ls machine # [ 435.081194] niks3-server[1185]: 2026/09/30 08:38:13 INFO Registered completed upload object_key=nar/0g42hgwa9jp9abmqxz90dkwxpybsznzbpsy35rm921mlk5sw56jq.nar.zst machine # [ 435.092098] niks3-server[1185]: 2026/09/30 08:38:13 INFO Received complete push request method=POST path=/api/pushes/21/complete machine # [ 435.096113] niks3-server[1185]: 2026/09/30 08:38:13 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.narinfo machine # [ 460.227409] niks3-server[1185]: 2026/09/30 08:38:39 INFO Received push request method=POST path=/api/pushes machine # [ 460.250751] niks3-server[1185]: 2026/09/30 08:38:39 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.ls machine # [ 460.252743] niks3-server[1185]: 2026/09/30 08:38:39 INFO Received sign narinfos request method=POST path=/api/pushes/22/sign machine # [ 460.255201] niks3-server[1185]: 2026/09/30 08:38:39 INFO Signed narinfos id=22 count=1 machine # [ 460.257736] niks3-server[1185]: 2026/09/30 08:38:39 INFO Registered completed upload object_key=nar/1vxmmzwi16s4iri6dcmi9v62dpq1ys7wz15b497ncik3sd67nfzg.nar.zst machine # [ 460.266119] niks3-server[1185]: 2026/09/30 08:38:39 INFO Received complete push request method=POST path=/api/pushes/22/complete machine # [ 460.273492] niks3-server[1185]: 2026/09/30 08:38:39 INFO Registered completed upload object_key=log/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31-k3s-a.drv machine # [ 460.275517] niks3-server[1185]: 2026/09/30 08:38:39 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo machine # [ 460.339479] niks3-server[1185]: 2026/09/30 08:38:39 INFO Received push request method=POST path=/api/pushes machine # [ 460.349187] niks3-server[1185]: 2026/09/30 08:38:39 INFO Received sign narinfos request method=POST path=/api/pushes/23/sign machine # [ 460.350294] niks3-server[1185]: 2026/09/30 08:38:39 INFO Signed narinfos id=23 count=1 machine # [ 460.353281] niks3-server[1185]: 2026/09/30 08:38:39 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.ls machine # [ 460.356921] niks3-server[1185]: 2026/09/30 08:38:39 INFO Received complete push request method=POST path=/api/pushes/23/complete machine # [ 460.365904] niks3-server[1185]: 2026/09/30 08:38:39 INFO Registered completed upload object_key=nar/0cbxkyxz068xc5mivh2h67kw6y01n1x28cbs11v1a03g8m4c71zm.nar.zst machine # [ 460.367215] niks3-server[1185]: 2026/09/30 08:38:39 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.narinfo machine # [ 485.273916] niks3-server[1185]: 2026/09/30 08:39:04 INFO Received push request method=POST path=/api/pushes machine # [ 485.293122] niks3-server[1185]: 2026/09/30 08:39:04 INFO Received sign narinfos request method=POST path=/api/pushes/24/sign machine # [ 485.296288] niks3-server[1185]: 2026/09/30 08:39:04 INFO Signed narinfos id=24 count=1 machine # [ 485.304525] niks3-server[1185]: 2026/09/30 08:39:04 INFO Registered completed upload object_key=nar/0khxywxb2r78vhpc5hsmha3ymgp910z0aka7550jmaqzs333rmzp.nar.zst machine # [ 485.306419] niks3-server[1185]: 2026/09/30 08:39:04 INFO Received complete push request method=POST path=/api/pushes/24/complete machine # [ 485.308835] niks3-server[1185]: 2026/09/30 08:39:04 INFO Registered completed upload object_key=log/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4-k3s-b.drv machine # [ 485.310459] niks3-server[1185]: 2026/09/30 08:39:04 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.ls machine # [ 485.381992] niks3-server[1185]: 2026/09/30 08:39:04 INFO Received push request method=POST path=/api/pushes machine # [ 485.391802] niks3-server[1185]: 2026/09/30 08:39:04 INFO Received sign narinfos request method=POST path=/api/pushes/25/sign machine # [ 485.393513] niks3-server[1185]: 2026/09/30 08:39:04 INFO Signed narinfos id=25 count=1 machine # [ 485.396890] niks3-server[1185]: 2026/09/30 08:39:04 INFO Registered completed upload object_key=nar/04bim5f8bvjh25xncf5x40kb529khrlzcbc92qxvapgbc0bdfv2h.nar.zst machine # [ 485.399102] niks3-server[1185]: 2026/09/30 08:39:04 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.ls machine # [ 485.401656] niks3-server[1185]: 2026/09/30 08:39:04 INFO Received complete push request method=POST path=/api/pushes/25/complete machine # [ 485.407366] niks3-server[1185]: 2026/09/30 08:39:04 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.narinfo machine # [ 510.326965] niks3-server[1185]: 2026/09/30 08:39:29 INFO Received push request method=POST path=/api/pushes machine # [ 510.343515] niks3-server[1185]: 2026/09/30 08:39:29 INFO Received sign narinfos request method=POST path=/api/pushes/26/sign machine # [ 510.347988] niks3-server[1185]: 2026/09/30 08:39:29 INFO Signed narinfos id=26 count=1 machine # [ 510.351600] niks3-server[1185]: 2026/09/30 08:39:29 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.ls machine # [ 510.353775] niks3-server[1185]: 2026/09/30 08:39:29 INFO Registered completed upload object_key=log/jz7biafi8rj5r3r392blyazw5mdpvy0d-k3s-top.drv machine # [ 510.357584] niks3-server[1185]: 2026/09/30 08:39:29 INFO Registered completed upload object_key=nar/11f7f1hixry25c2yc6np9hs10a2pwwqmymmrxxbswhdjabcyvv0s.nar.zst machine # [ 510.363815] niks3-server[1185]: 2026/09/30 08:39:29 INFO Received complete push request method=POST path=/api/pushes/26/complete machine # [ 510.373500] niks3-server[1185]: 2026/09/30 08:39:29 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1, in 75.57 seconds) (finished: subtest: a renewed balancer certificate is served without a rollout, in 110.07 seconds) subtest: metrics carry build_info machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-hmcxr -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-hmcxr -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.18 seconds) machine: must succeed: curl -sf http://10.42.0.9:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-hmcxr"' machine: (finished: must succeed: curl -sf http://10.42.0.9:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-hmcxr"', in 0.03 seconds) (finished: subtest: metrics carry build_info, in 0.21 seconds) subtest: harmonia-gc frees space and the worker stays Ready machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-hmcxr -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'' machine # [ 510.810701] k3s[881]: E0930 08:39:29.604700 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:49696: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-hmcxr -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'', in 0.20 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-hmcxr -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done' machine # [ 511.094324] k3s[881]: E0930 08:39:29.888621 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:49708: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-hmcxr -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done', in 0.29 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-hmcxr -c gc -- sh -c 'fallocate -l 11437498368 /nix/fill' machine # [ 511.316541] k3s[881]: E0930 08:39:30.110891 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:49712: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-hmcxr -c gc -- sh -c 'fallocate -l 11437498368 /nix/fill', in 0.22 seconds) machine: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-hmcxr -c gc --since=30s | grep -q 'store paths deleted' machine: (finished: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-hmcxr -c gc --since=30s | grep -q 'store paths deleted', in 2.70 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-hmcxr -c gc -- sh -c 'rm /nix/fill' machine # [ 514.231912] k3s[881]: E0930 08:39:33.025937 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:54098: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-hmcxr -c gc -- sh -c 'rm /nix/fill', in 0.21 seconds) machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-hmcxr -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-hmcxr -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}', in 0.14 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-hmcxr -c gc -- sh -c 'command -v nix-daemon && command -v niks3' machine # [ 514.574180] k3s[881]: E0930 08:39:33.368597 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:54108: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-hmcxr -c gc -- sh -c 'command -v nix-daemon && command -v niks3', in 0.20 seconds) (finished: subtest: harmonia-gc frees space and the worker stays Ready, in 3.96 seconds) subtest: losing the balancer mid-build: the client reconnects and the build succeeds machine: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1 machine # [ 514.600789] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1. machine # Running as unit: vialb.service; invocation ID: 1c8f385857d049909361ef44acf22708 machine: (finished: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1, in 0.02 seconds) machine: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'" machine # [ 514.734325] nix[9849]: don't know how to build these paths: machine # [ 514.737552] nix[9849]: /nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 514.763477] nix[9849]: copying 1 paths to '127.0.0.1:30051'... machine # [ 514.766416] nix[9849]: copying path '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' to '127.0.0.1:30051'... machine # [ 514.843031] niks3-server[1185]: 2026/09/30 08:39:33 INFO Received push request method=POST path=/api/pushes machine # [ 514.861291] niks3-server[1185]: 2026/09/30 08:39:33 INFO Received sign narinfos request method=POST path=/api/pushes/27/sign machine # [ 514.865617] niks3-server[1185]: 2026/09/30 08:39:33 INFO Signed narinfos id=27 count=1 machine # [ 514.868478] niks3-server[1185]: 2026/09/30 08:39:33 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.ls machine # [ 514.872617] niks3-server[1185]: 2026/09/30 08:39:33 INFO Registered completed upload object_key=nar/0kkr2vb091wkq0cb0f1q92413dsfskh76wydp8mwysv7rawns0ar.nar.zst machine # [ 514.877376] niks3-server[1185]: 2026/09/30 08:39:33 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.narinfo machine # [ 514.881244] niks3-server[1185]: 2026/09/30 08:39:33 INFO Received complete push request method=POST path=/api/pushes/27/complete machine # [ 514.895401] nix[9849]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 514.897110] nix[9849]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-wp7qx: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine: (finished: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'", in 1.06 seconds) machine: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false machine: (finished: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false, in 0.27 seconds) machine: waiting for success: ! systemctl is-active vialb machine # [ 515.954872] nix[9849]: d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv: Stream removed (Socket closed), asking the scheduler again machine # [ 515.958978] nix[9849]: scheduler at 127.0.0.1:30051: Stream removed (Socket closed), reconnecting machine # [ 515.980704] systemd[1]: cri-containerd-4f000c734baeaf0a48ee47cded1ef43f7a46f470aff4aab00c83c2a6e0bd56b9.scope: Deactivated successfully. machine # [ 515.981965] systemd[1]: cri-containerd-4f000c734baeaf0a48ee47cded1ef43f7a46f470aff4aab00c83c2a6e0bd56b9.scope: Consumed 4.812s CPU time over 7min 41.169s wall clock time, 48.6M memory peak, 26.9M read from disk, 589.5K incoming IP traffic, 723.5K outgoing IP traffic. machine # [ 516.017681] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-4f000c734baeaf0a48ee47cded1ef43f7a46f470aff4aab00c83c2a6e0bd56b9-rootfs.mount: Deactivated successfully. machine # [ 516.050084] systemd[1]: cri-containerd-c707ef9bdd91835f731d5af8c22245aa3028b40cef76b1cb1f4b853b6f5e0872.scope: Deactivated successfully. machine # [ 516.085611] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-c707ef9bdd91835f731d5af8c22245aa3028b40cef76b1cb1f4b853b6f5e0872-rootfs.mount: Deactivated successfully. machine # [ 516.111444] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-c707ef9bdd91835f731d5af8c22245aa3028b40cef76b1cb1f4b853b6f5e0872-shm.mount: Deactivated successfully. machine # [ 516.289051] cni0: port 3(veth7e9f2a6e) entered disabled state machine # [ 516.147314] dhcpcd[695]: veth7e9f2a6e: carrier lost machine # [ 516.294701] veth7e9f2a6e (unregistering): left allmulticast mode machine # [ 516.295857] veth7e9f2a6e (unregistering): left promiscuous mode machine # [ 516.297382] cni0: port 3(veth7e9f2a6e) entered disabled state machine # [ 516.175447] dhcpcd[695]: veth7e9f2a6e: deleting address fe80::50cd:4ff:fe20:9ae0 machine # [ 516.179936] systemd[1]: run-netns-cni\x2d941f8e36\x2d6491\x2de8a7\x2dc7cf\x2d2f2c97220083.mount: Deactivated successfully. machine # [ 516.181929] dhcpcd[695]: veth7e9f2a6e: deleting route to 169.254.0.0/16 machine # [ 516.226778] k3s[881]: I0930 08:39:35.020626 881 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ea03eb01-fba5-4cbc-babf-46830c7e6d43-config\" (UniqueName: \"kubernetes.io/configmap/ea03eb01-fba5-4cbc-babf-46830c7e6d43-config\") pod \"ea03eb01-fba5-4cbc-babf-46830c7e6d43\" (UID: \"ea03eb01-fba5-4cbc-babf-46830c7e6d43\") " machine # [ 516.231893] k3s[881]: I0930 08:39:35.020691 881 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ea03eb01-fba5-4cbc-babf-46830c7e6d43-tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea03eb01-fba5-4cbc-babf-46830c7e6d43-tmp\") pod \"ea03eb01-fba5-4cbc-babf-46830c7e6d43\" (UID: \"ea03eb01-fba5-4cbc-babf-46830c7e6d43\") " machine # [ 516.236178] k3s[881]: I0930 08:39:35.020735 881 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ea03eb01-fba5-4cbc-babf-46830c7e6d43-tls-lb\" (UniqueName: \"kubernetes.io/secret/ea03eb01-fba5-4cbc-babf-46830c7e6d43-tls-lb\") pod \"ea03eb01-fba5-4cbc-babf-46830c7e6d43\" (UID: \"ea03eb01-fba5-4cbc-babf-46830c7e6d43\") " machine # [ 516.240838] k3s[881]: I0930 08:39:35.020764 881 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ea03eb01-fba5-4cbc-babf-46830c7e6d43-tls-ca\" (UniqueName: \"kubernetes.io/secret/ea03eb01-fba5-4cbc-babf-46830c7e6d43-tls-ca\") pod \"ea03eb01-fba5-4cbc-babf-46830c7e6d43\" (UID: \"ea03eb01-fba5-4cbc-babf-46830c7e6d43\") " machine # [ 516.245850] systemd[1]: var-lib-kubelet-pods-ea03eb01\x2dfba5\x2d4cbc\x2dbabf\x2d46830c7e6d43-volumes-kubernetes.io\x7esecret-tls\x2dca.mount: Deactivated successfully. machine # [ 516.249728] k3s[881]: E0930 08:39:35.040013 881 status_manager.go:1164] "Failed to get status for pod" err="pods \"nix-grpc-farm-lb-5877cc8b4f-4vbmw\" is forbidden: User \"system:node:machine\" cannot get resource \"pods\" in API group \"\" in the namespace \"farm\": no relationship found between node 'machine' and this object" podUID="266421fa-5886-4351-9ca4-de39f84851e0" pod="farm/nix-grpc-farm-lb-5877cc8b4f-4vbmw" machine # [ 516.256201] k3s[881]: I0930 08:39:35.050160 881 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea03eb01-fba5-4cbc-babf-46830c7e6d43-tls-lb" pod "ea03eb01-fba5-4cbc-babf-46830c7e6d43" (UID: "ea03eb01-fba5-4cbc-babf-46830c7e6d43"). InnerVolumeSpecName "tls-lb". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 516.260447] k3s[881]: I0930 08:39:35.050672 881 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea03eb01-fba5-4cbc-babf-46830c7e6d43-tls-ca" pod "ea03eb01-fba5-4cbc-babf-46830c7e6d43" (UID: "ea03eb01-fba5-4cbc-babf-46830c7e6d43"). InnerVolumeSpecName "tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 516.264901] k3s[881]: I0930 08:39:35.050837 881 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea03eb01-fba5-4cbc-babf-46830c7e6d43-tmp" pod "ea03eb01-fba5-4cbc-babf-46830c7e6d43" (UID: "ea03eb01-fba5-4cbc-babf-46830c7e6d43"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 516.269368] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod266421fa_5886_4351_9ca4_de39f84851e0.slice. machine # [ 516.272419] dhcpcd[695]: veth7e9f2a6e: removing interface machine # [ 516.276239] k3s[881]: I0930 08:39:35.070624 881 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea03eb01-fba5-4cbc-babf-46830c7e6d43-config" pod "ea03eb01-fba5-4cbc-babf-46830c7e6d43" (UID: "ea03eb01-fba5-4cbc-babf-46830c7e6d43"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 516.326928] k3s[881]: I0930 08:39:35.121190 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/266421fa-5886-4351-9ca4-de39f84851e0-tls-ca\") pod \"nix-grpc-farm-lb-5877cc8b4f-4vbmw\" (UID: \"266421fa-5886-4351-9ca4-de39f84851e0\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-4vbmw" machine # [ 516.327705] k3s[881]: I0930 08:39:35.121252 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/266421fa-5886-4351-9ca4-de39f84851e0-config\") pod \"nix-grpc-farm-lb-5877cc8b4f-4vbmw\" (UID: \"266421fa-5886-4351-9ca4-de39f84851e0\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-4vbmw" machine # [ 516.328545] k3s[881]: I0930 08:39:35.121278 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/266421fa-5886-4351-9ca4-de39f84851e0-tls-lb\") pod \"nix-grpc-farm-lb-5877cc8b4f-4vbmw\" (UID: \"266421fa-5886-4351-9ca4-de39f84851e0\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-4vbmw" machine # [ 516.329002] k3s[881]: I0930 08:39:35.121307 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/266421fa-5886-4351-9ca4-de39f84851e0-tmp\") pod \"nix-grpc-farm-lb-5877cc8b4f-4vbmw\" (UID: \"266421fa-5886-4351-9ca4-de39f84851e0\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-4vbmw" machine # [ 516.329512] k3s[881]: I0930 08:39:35.121347 881 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea03eb01-fba5-4cbc-babf-46830c7e6d43-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 516.330057] k3s[881]: I0930 08:39:35.121609 881 reconciler_common.go:299] "Volume detached for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/ea03eb01-fba5-4cbc-babf-46830c7e6d43-tls-lb\") on node \"machine\" DevicePath \"\"" machine # [ 516.330562] k3s[881]: I0930 08:39:35.121641 881 reconciler_common.go:299] "Volume detached for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/ea03eb01-fba5-4cbc-babf-46830c7e6d43-tls-ca\") on node \"machine\" DevicePath \"\"" machine # [ 516.331074] k3s[881]: I0930 08:39:35.121656 881 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ea03eb01-fba5-4cbc-babf-46830c7e6d43-config\") on node \"machine\" DevicePath \"\"" machine # [ 516.357591] k3s[881]: I0930 08:39:35.151953 881 scope.go:122] "RemoveContainer" containerID="4f000c734baeaf0a48ee47cded1ef43f7a46f470aff4aab00c83c2a6e0bd56b9" machine # [ 516.368909] systemd[1]: Removed slice libcontainer container kubepods-besteffort-podea03eb01_fba5_4cbc_babf_46830c7e6d43.slice. machine # [ 516.370427] systemd[1]: kubepods-besteffort-podea03eb01_fba5_4cbc_babf_46830c7e6d43.slice: Consumed 4.847s CPU time over 7min 43.394s wall clock time, 48.9M memory peak, 26.9M read from disk, 589.5K incoming IP traffic, 723.5K outgoing IP traffic. machine # [ 516.371355] k3s[881]: I0930 08:39:35.164446 881 scope.go:122] "RemoveContainer" containerID="4f000c734baeaf0a48ee47cded1ef43f7a46f470aff4aab00c83c2a6e0bd56b9" machine # [ 516.372252] k3s[881]: E0930 08:39:35.165190 881 remote_runtime.go:569] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"4f000c734baeaf0a48ee47cded1ef43f7a46f470aff4aab00c83c2a6e0bd56b9\": not found" containerID="4f000c734baeaf0a48ee47cded1ef43f7a46f470aff4aab00c83c2a6e0bd56b9" machine # [ 516.372691] k3s[881]: I0930 08:39:35.165232 881 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"4f000c734baeaf0a48ee47cded1ef43f7a46f470aff4aab00c83c2a6e0bd56b9"} err="failed to get container status \"4f000c734baeaf0a48ee47cded1ef43f7a46f470aff4aab00c83c2a6e0bd56b9\": rpc error: code = NotFound desc = an error occurred when try to find container \"4f000c734baeaf0a48ee47cded1ef43f7a46f470aff4aab00c83c2a6e0bd56b9\": not found" machine # [ 516.735610] cni0: port 2(vethb4afe842) entered blocking state machine # [ 516.737431] cni0: port 2(vethb4afe842) entered disabled state machine # [ 516.739228] vethb4afe842: entered allmulticast mode machine # [ 516.740435] vethb4afe842: entered promiscuous mode machine # [ 516.599963] (udev-worker)[10029]: Network interface NamePolicy= disabled on kernel command line. machine # [ 516.750349] cni0: port 2(vethb4afe842) entered blocking state machine # [ 516.751501] cni0: port 2(vethb4afe842) entered forwarding state machine # [ 516.628547] dhcpcd[695]: vethb4afe842: IAID e2:6a:43:cf machine # [ 516.629372] dhcpcd[695]: vethb4afe842: adding address fe80::470:e2ff:fe6a:43cf machine # [ 516.697336] systemd[1]: Started libcontainer container 9ab17399ea4095d4cd7a4bbd2c9a45046b7d8a91d20cf5e68d591d261bf46bc1. machine # [ 516.822334] systemd[1]: Started libcontainer container fdab5d826c6a79b84dd5d828827422ce649982bd6e91b7d2da53fcc2ee0198ca. machine # [ 517.023988] dhcpcd[695]: vethb4afe842: soliciting a DHCP lease machine # [ 517.027409] systemd[1]: var-lib-kubelet-pods-ea03eb01\x2dfba5\x2d4cbc\x2dbabf\x2d46830c7e6d43-volume\x2dsubpaths-config-envoy-2.mount: Deactivated successfully. machine # [ 517.030847] systemd[1]: var-lib-kubelet-pods-ea03eb01\x2dfba5\x2d4cbc\x2dbabf\x2d46830c7e6d43-volume\x2dsubpaths-config-envoy-1.mount: Deactivated successfully. machine # [ 517.032910] systemd[1]: var-lib-kubelet-pods-ea03eb01\x2dfba5\x2d4cbc\x2dbabf\x2d46830c7e6d43-volume\x2dsubpaths-config-envoy-0.mount: Deactivated successfully. machine # [ 517.035348] systemd[1]: var-lib-kubelet-pods-ea03eb01\x2dfba5\x2d4cbc\x2dbabf\x2d46830c7e6d43-volumes-kubernetes.io\x7esecret-tls\x2dlb.mount: Deactivated successfully. machine # [ 517.037616] systemd[1]: var-lib-kubelet-pods-ea03eb01\x2dfba5\x2d4cbc\x2dbabf\x2d46830c7e6d43-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 517.075785] k3s[881]: I0930 08:39:35.870166 881 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ea03eb01-fba5-4cbc-babf-46830c7e6d43" path="/var/lib/kubelet/pods/ea03eb01-fba5-4cbc-babf-46830c7e6d43/volumes" machine # [ 517.391324] k3s[881]: I0930 08:39:36.183655 881 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-5877cc8b4f-4vbmw" podStartSLOduration=1.18360973 podStartE2EDuration="1.18360973s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-30 08:39:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 08:39:35.700119509 +0000 UTC m=+500.183712679" watchObservedRunningTime="2026-09-30 08:39:36.18360973 +0000 UTC m=+500.667206530" machine # [ 518.457228] nix[9849]: scheduler at 127.0.0.1:30051: failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:30051: tcp handshaker shutdown, reconnecting machine # [ 519.349533] dhcpcd[695]: vethb4afe842: soliciting an IPv6 router machine # [ 519.514230] nix[9849]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 519.516222] nix[9849]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-hmcxr: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 522.025839] dhcpcd[695]: vethb4afe842: probing for an IPv4LL address machine # [ 526.632571] dhcpcd[695]: vethb4afe842: using IPv4LL address 169.254.193.34 machine # [ 526.634818] dhcpcd[695]: vethb4afe842: adding route to 169.254.0.0/16 machine # [ 531.354885] dhcpcd[695]: vethb4afe842: no IPv6 Routers available machine # [ 563.880780] niks3-server[1185]: 2026/09/30 08:40:22 INFO Received push request method=POST path=/api/pushes machine # [ 563.897699] niks3-server[1185]: 2026/09/30 08:40:22 INFO Received sign narinfos request method=POST path=/api/pushes/28/sign machine # [ 563.900622] niks3-server[1185]: 2026/09/30 08:40:22 INFO Signed narinfos id=28 count=1 machine # [ 563.904215] niks3-server[1185]: 2026/09/30 08:40:22 INFO Registered completed upload object_key=log/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 563.906865] niks3-server[1185]: 2026/09/30 08:40:22 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.ls machine # [ 563.908378] niks3-server[1185]: 2026/09/30 08:40:22 INFO Received complete push request method=POST path=/api/pushes/28/complete machine # [ 563.913517] niks3-server[1185]: 2026/09/30 08:40:22 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.narinfo machine # [ 563.967755] systemd[1]: vialb.service: Deactivated successfully. machine # [ 563.968928] systemd[1]: vialb.service: Consumed 219ms CPU time over 49.367s wall clock time, 38.4M memory peak, 4K written to disk, 8.6K incoming IP traffic, 17.5K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active vialb, in 48.96 seconds) machine: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; }, in 0.04 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 0.33 seconds) (finished: subtest: losing the balancer mid-build: the client reconnects and the build succeeds, in 50.68 seconds) subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes machine: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 machine # Running as unit: slow.service; invocation ID: 9fc22722bf0947cc95cf9f18ba61cb84 machine # [ 565.293733] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1. machine: (finished: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1, in 0.05 seconds) machine # [ 565.440403] nix[10778]: don't know how to build these paths: machine # [ 565.441163] nix[10778]: /nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 565.459852] nix[10778]: copying 1 paths to '127.0.0.1:30051'... machine # [ 565.460921] nix[10778]: copying path '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' to '127.0.0.1:30051'... machine # [ 565.505080] niks3-server[1185]: 2026/09/30 08:40:24 INFO Received push request method=POST path=/api/pushes machine # [ 565.520259] niks3-server[1185]: 2026/09/30 08:40:24 INFO Received sign narinfos request method=POST path=/api/pushes/29/sign machine # [ 565.521021] niks3-server[1185]: 2026/09/30 08:40:24 INFO Signed narinfos id=29 count=1 machine # [ 565.525693] niks3-server[1185]: 2026/09/30 08:40:24 INFO Registered completed upload object_key=nar/0wl2i9xpw0gwrx1xqdgx9ka4n503ky9qhl20pdrdlphn8d6lcx0i.nar.zst machine # [ 565.527252] niks3-server[1185]: 2026/09/30 08:40:24 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.ls machine # [ 565.531760] niks3-server[1185]: 2026/09/30 08:40:24 INFO Received complete push request method=POST path=/api/pushes/29/complete machine # [ 565.536136] niks3-server[1185]: 2026/09/30 08:40:24 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.narinfo machine # [ 565.543335] nix[10778]: building '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' on 127.0.0.1:30051... machine # [ 565.544625] nix[10778]: slow-s1> machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-wp7qx: building zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 565.553909] k3s[881]: E0930 08:40:24.347836 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45890: use of closed network connection" machine # command terminated with exit code 1 machine # [ 565.745646] k3s[881]: E0930 08:40:24.539951 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45902: use of closed network connection" machine # command terminated with exit code 1 machine # [ 567.009625] k3s[881]: E0930 08:40:25.803491 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45914: use of closed network connection" machine # command terminated with exit code 1 machine # [ 567.205475] k3s[881]: E0930 08:40:25.999857 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45916: use of closed network connection" machine # command terminated with exit code 1 machine # [ 568.493687] k3s[881]: E0930 08:40:27.286739 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45926: use of closed network connection" machine # command terminated with exit code 1 machine # [ 568.693828] k3s[881]: E0930 08:40:27.488208 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45938: use of closed network connection" machine # command terminated with exit code 1 machine # [ 569.932423] k3s[881]: E0930 08:40:28.726454 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45944: use of closed network connection" machine # command terminated with exit code 1 machine # [ 570.129690] k3s[881]: E0930 08:40:28.924062 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45946: use of closed network connection" machine # command terminated with exit code 1 machine # [ 571.429141] k3s[881]: E0930 08:40:30.222864 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45960: use of closed network connection" machine # command terminated with exit code 1 machine # [ 571.667084] k3s[881]: E0930 08:40:30.461357 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45972: use of closed network connection" machine # command terminated with exit code 1 machine # [ 572.941209] k3s[881]: E0930 08:40:31.734961 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45976: use of closed network connection" machine # command terminated with exit code 1 machine # [ 573.144491] k3s[881]: E0930 08:40:31.938866 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:37782: use of closed network connection" machine # command terminated with exit code 1 machine # [ 574.409702] k3s[881]: E0930 08:40:33.203728 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:37786: use of closed network connection" machine # command terminated with exit code 1 machine # [ 574.610472] k3s[881]: E0930 08:40:33.404805 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:37798: use of closed network connection" machine # command terminated with exit code 1 machine # [ 575.900668] k3s[881]: E0930 08:40:34.694438 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:37806: use of closed network connection" machine # command terminated with exit code 1 machine # [ 576.106676] k3s[881]: E0930 08:40:34.901043 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:37818: use of closed network connection" machine # command terminated with exit code 1 machine # [ 577.371071] k3s[881]: E0930 08:40:36.164989 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:37828: use of closed network connection" machine # command terminated with exit code 1 machine # [ 577.573600] k3s[881]: E0930 08:40:36.367939 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:37844: use of closed network connection" machine # command terminated with exit code 1 machine # [ 578.828321] k3s[881]: E0930 08:40:37.622237 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:37856: use of closed network connection" machine # command terminated with exit code 1 machine # [ 579.014469] k3s[881]: E0930 08:40:37.808487 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:37866: use of closed network connection" machine # command terminated with exit code 1 machine # [ 580.311529] k3s[881]: E0930 08:40:39.105479 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:37872: use of closed network connection" machine # command terminated with exit code 1 machine # [ 580.521325] k3s[881]: E0930 08:40:39.315714 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:37878: use of closed network connection" machine # command terminated with exit code 1 machine # [ 581.777460] k3s[881]: E0930 08:40:40.571496 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:37890: use of closed network connection" machine # command terminated with exit code 1 machine # [ 581.969188] k3s[881]: E0930 08:40:40.763470 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:37904: use of closed network connection" machine # command terminated with exit code 1 machine # [ 583.251761] k3s[881]: E0930 08:40:42.045587 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:46724: use of closed network connection" machine # command terminated with exit code 1 machine # [ 583.563248] k3s[881]: E0930 08:40:42.357413 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:46734: use of closed network connection" machine # command terminated with exit code 1 machine # [ 585.022288] k3s[881]: E0930 08:40:43.815571 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:46748: use of closed network connection" machine # command terminated with exit code 1 machine # [ 585.565373] k3s[881]: E0930 08:40:44.359687 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:46750: use of closed network connection" machine # command terminated with exit code 1 machine # [ 587.100244] k3s[881]: E0930 08:40:45.892904 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:46754: use of closed network connection" machine # command terminated with exit code 1 machine # [ 587.746472] k3s[881]: E0930 08:40:46.540781 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:46756: use of closed network connection" machine # command terminated with exit code 1 machine # [ 589.283235] k3s[881]: E0930 08:40:48.076922 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:46772: use of closed network connection" machine # command terminated with exit code 1 machine # [ 589.701197] k3s[881]: E0930 08:40:48.495499 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:46782: use of closed network connection" machine # command terminated with exit code 1 machine # [ 591.269957] k3s[881]: E0930 08:40:50.063788 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:46796: use of closed network connection" machine # command terminated with exit code 1 machine # [ 591.689912] k3s[881]: E0930 08:40:50.483664 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:46810: use of closed network connection" machine # [ 592.218935] k3s[881]: E0930 08:40:51.011877 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:46824: use of closed network connection" machine # command terminated with exit code 1 machine # [ 592.700502] k3s[881]: E0930 08:40:51.494304 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:46840: use of closed network connection" machine: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-wp7qx --wait=false machine: (finished: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-wp7qx --wait=false, in 0.29 seconds) machine: must succeed: sleep 5.0 machine # [ 593.133308] systemd[1]: cri-containerd-8d28891da9adefec747c8f42cfa6a603a89772454d9e403d2a66eb5aad557502.scope: Deactivated successfully. machine # [ 593.134876] systemd[1]: cri-containerd-8d28891da9adefec747c8f42cfa6a603a89772454d9e403d2a66eb5aad557502.scope: Consumed 509ms CPU time over 8min 50.194s wall clock time, 12.5M memory peak, 5.2M read from disk. machine # [ 593.231296] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-8d28891da9adefec747c8f42cfa6a603a89772454d9e403d2a66eb5aad557502-rootfs.mount: Deactivated successfully. machine # [ 593.965395] systemd[1]: Created slice libcontainer container kubepods-besteffort-podec6e0404_a828_454d_938a_e5bb6def9754.slice. machine # [ 594.101782] k3s[881]: I0930 08:40:52.895627 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcpgl\" (UniqueName: \"kubernetes.io/projected/ec6e0404-a828-454d-938a-e5bb6def9754-kube-api-access-tcpgl\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bdhz7\" (UID: \"ec6e0404-a828-454d-938a-e5bb6def9754\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bdhz7" machine # [ 594.116338] k3s[881]: I0930 08:40:52.910170 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/ec6e0404-a828-454d-938a-e5bb6def9754-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bdhz7\" (UID: \"ec6e0404-a828-454d-938a-e5bb6def9754\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bdhz7" machine # [ 594.125680] k3s[881]: I0930 08:40:52.910255 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/ec6e0404-a828-454d-938a-e5bb6def9754-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bdhz7\" (UID: \"ec6e0404-a828-454d-938a-e5bb6def9754\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bdhz7" machine # [ 594.134403] k3s[881]: I0930 08:40:52.910308 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/ec6e0404-a828-454d-938a-e5bb6def9754-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bdhz7\" (UID: \"ec6e0404-a828-454d-938a-e5bb6def9754\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bdhz7" machine # [ 594.143416] k3s[881]: I0930 08:40:52.910373 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/ec6e0404-a828-454d-938a-e5bb6def9754-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bdhz7\" (UID: \"ec6e0404-a828-454d-938a-e5bb6def9754\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bdhz7" machine # [ 594.151717] k3s[881]: I0930 08:40:52.910820 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/ec6e0404-a828-454d-938a-e5bb6def9754-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bdhz7\" (UID: \"ec6e0404-a828-454d-938a-e5bb6def9754\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bdhz7" machine # [ 594.159925] k3s[881]: I0930 08:40:52.910898 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/ec6e0404-a828-454d-938a-e5bb6def9754-build\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bdhz7\" (UID: \"ec6e0404-a828-454d-938a-e5bb6def9754\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bdhz7" machine # [ 594.168574] k3s[881]: I0930 08:40:52.910959 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ec6e0404-a828-454d-938a-e5bb6def9754-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bdhz7\" (UID: \"ec6e0404-a828-454d-938a-e5bb6def9754\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bdhz7" machine # [ 594.177066] k3s[881]: I0930 08:40:52.911018 881 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/ec6e0404-a828-454d-938a-e5bb6def9754-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bdhz7\" (UID: \"ec6e0404-a828-454d-938a-e5bb6def9754\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bdhz7" machine # [ 594.516878] cni0: port 3(veth89f0941a) entered blocking state machine # [ 594.522198] cni0: port 3(veth89f0941a) entered disabled state machine # [ 594.524426] veth89f0941a: entered allmulticast mode machine # [ 594.526536] veth89f0941a: entered promiscuous mode machine # [ 594.558938] cni0: port 3(veth89f0941a) entered blocking state machine # [ 594.561608] cni0: port 3(veth89f0941a) entered forwarding state machine # [ 594.541233] (udev-worker)[12464]: Network interface NamePolicy= disabled on kernel command line. machine # [ 594.602069] dhcpcd[695]: veth89f0941a: IAID f7:f2:45:cf machine # [ 594.604477] dhcpcd[695]: veth89f0941a: adding address fe80::890:f7ff:fef2:45cf machine # [ 594.634532] systemd[1]: Started libcontainer container ee5508f0a6d1430791ba87e07d2c20c9cb062656d18dc68a56cd8947c0e65c68. machine # [ 595.055150] dhcpcd[695]: veth89f0941a: soliciting a DHCP lease machine # [ 595.181435] systemd[1]: Started libcontainer container ac81b3a1486657df028932c74787291e4d8afb7a9c0b043e27b5e5680aa57bf7. machine # [ 596.734645] dhcpcd[695]: veth89f0941a: soliciting an IPv6 router machine # [ 597.642130] systemd[1]: cri-containerd-ac81b3a1486657df028932c74787291e4d8afb7a9c0b043e27b5e5680aa57bf7.scope: Deactivated successfully. machine # [ 597.643354] systemd[1]: cri-containerd-ac81b3a1486657df028932c74787291e4d8afb7a9c0b043e27b5e5680aa57bf7.scope: Consumed 1.159s CPU time over 2.460s wall clock time, 449.5M memory peak, 150.5M read from disk, 88.5M written to disk. machine # [ 597.729551] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-ac81b3a1486657df028932c74787291e4d8afb7a9c0b043e27b5e5680aa57bf7-rootfs.mount: Deactivated successfully. machine: (finished: must succeed: sleep 5.0, in 5.09 seconds) machine # [ 598.665103] k3s[881]: E0930 08:40:57.458847 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:50482: use of closed network connection" machine # command terminated with exit code 1 machine # [ 599.054678] systemd[1]: tmp-ovl\x2didmapped4083254693.mount: Deactivated successfully. machine # [ 599.086639] systemd[1]: Started libcontainer container a57be048fb03e138e67bf4fb01baff3ad29a808d722c794ca9ae927135775132. machine # [ 599.129079] k3s[881]: E0930 08:40:57.923383 881 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:50486: use of closed network connection" machine: waiting for success: ! systemctl is-active slow machine # [ 599.427495] systemd[1]: Started libcontainer container bfc920eaf1b5c4dbb4554b002fe90701ca75f4ea8ccc7183dfa2c0a4ac191bba. machine # [ 599.820149] systemd[1]: tmp-ovl\x2didmapped3844324634.mount: Deactivated successfully. machine # [ 599.855470] systemd[1]: Started libcontainer container 1d09069f982ef5d17515c523040037d176b6b87de2b10089e04265555b774e33. machine # [ 600.056154] dhcpcd[695]: veth89f0941a: probing for an IPv4LL address machine # [ 604.315832] k3s[881]: I0930 08:41:03.108426 881 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bdhz7" podStartSLOduration=8.771734746 podStartE2EDuration="11.10840044s" totalImagesPullingTime="0s" totalInitContainerRuntime="2.336665694s" isStatefulPod=false podCreationTimestamp="2026-09-30 08:40:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 08:40:58.777888881 +0000 UTC m=+583.261504400" watchObservedRunningTime="2026-09-30 08:41:03.10840044 +0000 UTC m=+587.591992771" machine # [ 605.309734] dhcpcd[695]: veth89f0941a: using IPv4LL address 169.254.83.118 machine # [ 605.311228] dhcpcd[695]: veth89f0941a: adding route to 169.254.0.0/16 machine # [ 608.739884] dhcpcd[695]: veth89f0941a: no IPv6 Routers available machine # [ 610.104765] postgres[752]: [752] LOG: checkpoint starting: time machine # [ 610.342079] niks3-server[1185]: 2026/09/30 08:41:09 INFO Received push request method=POST path=/api/pushes machine # [ 610.360442] niks3-server[1185]: 2026/09/30 08:41:09 INFO Received sign narinfos request method=POST path=/api/pushes/30/sign machine # [ 610.362708] niks3-server[1185]: 2026/09/30 08:41:09 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.ls machine # [ 610.365180] niks3-server[1185]: 2026/09/30 08:41:09 INFO Signed narinfos id=30 count=1 machine # [ 610.366823] niks3-server[1185]: 2026/09/30 08:41:09 INFO Registered completed upload object_key=log/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 610.373729] niks3-server[1185]: 2026/09/30 08:41:09 INFO Received complete push request method=POST path=/api/pushes/30/complete machine # [ 610.378630] niks3-server[1185]: 2026/09/30 08:41:09 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo machine # [ 610.413767] systemd[1]: slow.service: Deactivated successfully. machine # [ 610.414916] systemd[1]: slow.service: Consumed 198ms CPU time over 45.121s wall clock time, 38.3M memory peak, 4K written to disk, 5.4K incoming IP traffic, 11.7K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active slow, in 11.59 seconds) machine: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; }, in 0.04 seconds) machine: must fail: journalctl -u slow | grep -q 'asking the scheduler again' machine: (finished: must fail: journalctl -u slow | grep -q 'asking the scheduler again', in 0.02 seconds) machine: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath, in 0.14 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null, in 0.03 seconds) (finished: subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes, in 45.72 seconds) (finished: run the VM test script, in 611.80 seconds) test script finished in 611.83s cleanup kill QemuMachine (pid 45) machine # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) machine # [2026-09-30T08:41:09Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-09-30T08:41:09Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-09-30T08:41:09Z INFO virtiofsd] Client disconnected, shutting down (finished: cleanup, in 0.91 seconds) additionally exposed symbols: machine, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh