tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 1200.0 seconds run the VM test script machine: waiting for unit k3s.service machine: waiting for the VM to finish booting machine: starting vm machine # Disk image does not exist, creating the virtualisation disk image... machine: QEMU running (pid 45) machine # Formatting '/build/vm-state-machine/tmp.CsuvuzmeJ9', fmt=raw size=17179869184 machine # mke2fs 1.47.4 (6-Mar-2025) machine # Discarding device blocks: 0/4194304 done machine # Creating filesystem with 4194304 4k blocks and 1048576 inodes machine # Filesystem UUID: d490e557-fa34-4fcc-9c49-66ff8d01bb4a machine # Superblock backups stored on blocks: machine # 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208, machine # 4096000 machine # machine # Allocating group tables: 0/128 done machine # Writing inode tables: 0/128 done machine # Creating journal (32768 blocks): done machine # Writing superblocks and filesystem accounting information: 0/128 done machine # machine # Virtualisation disk image created. machine # Starting virtiofs daemons... machine # [2026-09-30T09:11:04Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-30T09:11:04Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-30T09:11:04Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-30T09:11:04Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-30T09:11:04Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-30T09:11:04Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-30T09:11:04Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-30T09:11:04Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-30T09:11:04Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-30T09:11:04Z INFO virtiofsd] Client connected, servicing requests machine # [2026-09-30T09:11:04Z INFO virtiofsd] Client connected, servicing requests machine # [2026-09-30T09:11:04Z INFO virtiofsd] Client connected, servicing requests machine # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) machine # machine # machine # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+7EFCC730+7EF2C730 CA00 machine # Press Ctrl-B to configure iPXE (PCI 00:02.0)... machine # machine # machine # machine # machine # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 7EFCC730 7EF2C730 CB00 machine # Press Ctrl-B to configure iPXE (PCI 00:05.0)... machine # machine # machine # Booting from ROM... machine # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.53 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 21 13:06:06 UTC 2026 machine # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/5bsx4hvqc97rw93i1q9fb6qqxsjlv6ip-nixos-system-machine-test/init regInfo=/nix/.ro-store/3blrjbmd7b7gl2w0b6j5bn93vp8d9qfm-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.000000] BIOS-provided physical RAM map: machine # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007ffd7fff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000007ffd8000-0x000000007fffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000017fffffff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved machine # [ 0.000000] NX (Execute Disable) protection: active machine # [ 0.000000] APIC: Static calls initialized machine # [ 0.000000] SMBIOS 2.8 present. machine # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 machine # [ 0.000000] DMI: Memory slots populated: 1/1 machine # [ 0.000000] Hypervisor detected: KVM machine # [ 0.000000] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 machine # [ 0.000000] kvm-clock: using sched offset of 491913593 cycles machine # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns machine # [ 0.000005] tsc: Detected 2400.012 MHz processor machine # [ 0.000813] last_pfn = 0x180000 max_arch_pfn = 0x10000000000 machine # [ 0.000840] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs machine # [ 0.000843] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT machine # [ 0.000883] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.002738] found SMP MP-table at [mem 0x000f5450-0x000f545f] machine # [ 0.002751] Using GB pages for direct mapping machine # [ 0.002906] RAMDISK: [mem 0x7e364000-0x7ffcffff] machine # [ 0.002914] ACPI: Early table checksum verification disabled machine # [ 0.002918] ACPI: RSDP 0x00000000000F5250 000014 (v00 BOCHS ) machine # [ 0.002922] ACPI: RSDT 0x000000007FFE2539 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002926] ACPI: FACP 0x000000007FFE2319 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002933] ACPI: DSDT 0x000000007FFE0040 0022D9 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002935] ACPI: FACS 0x000000007FFE0000 000040 machine # [ 0.002937] ACPI: APIC 0x000000007FFE240D 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002938] ACPI: HPET 0x000000007FFE249D 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002940] ACPI: MCFG 0x000000007FFE24D5 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002942] ACPI: WAET 0x000000007FFE2511 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002943] ACPI: Reserving FACP table memory at [mem 0x7ffe2319-0x7ffe240c] machine # [ 0.002944] ACPI: Reserving DSDT table memory at [mem 0x7ffe0040-0x7ffe2318] machine # [ 0.002944] ACPI: Reserving FACS table memory at [mem 0x7ffe0000-0x7ffe003f] machine # [ 0.002945] ACPI: Reserving APIC table memory at [mem 0x7ffe240d-0x7ffe249c] machine # [ 0.002945] ACPI: Reserving HPET table memory at [mem 0x7ffe249d-0x7ffe24d4] machine # [ 0.002946] ACPI: Reserving MCFG table memory at [mem 0x7ffe24d5-0x7ffe2510] machine # [ 0.002946] ACPI: Reserving WAET table memory at [mem 0x7ffe2511-0x7ffe2538] machine # [ 0.003177] No NUMA configuration found machine # [ 0.003178] Faking a node at [mem 0x0000000000000000-0x000000017fffffff] machine # [ 0.003180] NODE_DATA(0) allocated [mem 0x17fff8780-0x17fffdcff] machine # [ 0.005549] Zone ranges: machine # [ 0.005550] DMA [mem 0x0000000000001000-0x0000000000ffffff] machine # [ 0.005552] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] machine # [ 0.005553] Normal [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005554] Device empty machine # [ 0.005555] Movable zone start for each node machine # [ 0.005556] Early memory node ranges machine # [ 0.005556] node 0: [mem 0x0000000000001000-0x000000000009efff] machine # [ 0.005557] node 0: [mem 0x0000000000100000-0x000000007ffd7fff] machine # [ 0.005558] node 0: [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005559] Initmem setup node 0 [mem 0x0000000000001000-0x000000017fffffff] machine # [ 0.005580] On node 0, zone DMA: 1 pages in unavailable ranges machine # [ 0.005850] On node 0, zone DMA: 97 pages in unavailable ranges machine # [ 0.080776] On node 0, zone Normal: 40 pages in unavailable ranges machine # [ 0.081259] ACPI: PM-Timer IO Port: 0x608 machine # [ 0.081274] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) machine # [ 0.081308] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 machine # [ 0.081311] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) machine # [ 0.081313] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) machine # [ 0.081315] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) machine # [ 0.081316] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) machine # [ 0.081316] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) machine # [ 0.081319] ACPI: Using ACPI (MADT) for SMP configuration information machine # [ 0.081320] ACPI: HPET id: 0x8086a201 base: 0xfed00000 machine # [ 0.081324] TSC deadline timer available machine # [ 0.081329] CPU topo: Max. logical packages: 1 machine # [ 0.081330] CPU topo: Max. logical dies: 1 machine # [ 0.081330] CPU topo: Max. dies per package: 1 machine # [ 0.081333] CPU topo: Max. threads per core: 1 machine # [ 0.081334] CPU topo: Num. cores per package: 4 machine # [ 0.081334] CPU topo: Num. threads per package: 4 machine # [ 0.081335] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs machine # [ 0.081362] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() machine # [ 0.081378] kvm-guest: KVM setup pv remote TLB flush machine # [ 0.081381] kvm-guest: setup PV sched yield machine # [ 0.081391] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] machine # [ 0.081392] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] machine # [ 0.081393] PM: hibernation: Registered nosave memory: [mem 0x7ffd8000-0xffffffff] machine # [ 0.081395] [mem 0xc0000000-0xfed1bfff] available for PCI devices machine # [ 0.081397] Booting paravirtualized kernel on KVM machine # [ 0.081401] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns machine # [ 0.085894] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 machine # [ 0.088208] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288 machine # [ 0.088259] kvm-guest: PV spinlocks enabled machine # [ 0.088261] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) machine # [ 0.088265] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/5bsx4hvqc97rw93i1q9fb6qqxsjlv6ip-nixos-system-machine-test/init regInfo=/nix/.ro-store/3blrjbmd7b7gl2w0b6j5bn93vp8d9qfm-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.088367] Unknown kernel command line parameters "regInfo=/nix/.ro-store/3blrjbmd7b7gl2w0b6j5bn93vp8d9qfm-closure-info/registration", will be passed to user space. machine # [ 0.088381] random: crng init done machine # [ 0.088382] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes machine # [ 0.093172] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) machine # [ 0.095398] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) machine # [ 0.095486] software IO TLB: area num 4. machine # [ 0.173335] Fallback order for Node 0: 0 machine # [ 0.173344] Built 1 zonelists, mobility grouping on. Total pages: 1048438 machine # [ 0.173346] Policy zone: Normal machine # [ 0.176283] mem auto-init: stack:all(zero), heap alloc:on, heap free:off machine # [ 0.183658] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 machine # [ 0.193118] allocated 8388608 bytes of page_ext machine # [ 0.203297] ftrace: allocating 48798 entries in 192 pages machine # [ 0.203299] ftrace: allocated 192 pages with 2 groups machine # [ 0.204198] Dynamic Preempt: lazy machine # [ 0.204391] rcu: Preemptible hierarchical RCU implementation. machine # [ 0.204391] rcu: RCU event tracing is enabled. machine # [ 0.204392] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. machine # [ 0.204393] Trampoline variant of Tasks RCU enabled. machine # [ 0.204394] Rude variant of Tasks RCU enabled. machine # [ 0.204394] Tracing variant of Tasks RCU enabled. machine # [ 0.204395] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. machine # [ 0.204396] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 machine # [ 0.204423] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.204425] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.204426] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.208874] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16 machine # [ 0.209204] rcu: srcu_init: Setting srcu_struct sizes based on contention. machine # [ 0.209211] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns machine # [ 0.209332] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) machine # [ 0.212893] Console: colour VGA+ 80x25 machine # [ 0.212896] printk: legacy console [tty0] enabled machine # [ 0.244599] printk: legacy console [ttyS0] enabled machine # [ 0.357375] ACPI: Core revision 20250807 machine # [ 0.358300] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns machine # [ 0.359903] APIC: Switch to symmetric I/O mode setup machine # [ 0.360960] x2apic enabled machine # [ 0.361714] APIC: Switched APIC routing to: physical x2apic machine # [ 0.362700] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask() machine # [ 0.364000] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself() machine # [ 0.365518] kvm-guest: setup PV IPIs machine # [ 0.367123] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 machine # [ 0.368194] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.372497] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) machine # [ 0.373584] x86/cpu: User Mode Instruction Prevention (UMIP) activated machine # [ 0.374617] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 machine # [ 0.375494] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 machine # [ 0.376498] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto machine # [ 0.378494] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl machine # [ 0.379494] Transient Scheduler Attacks: Vulnerable: No microcode machine # [ 0.381493] Spectre V2 : Mitigation: Enhanced / Automatic IBRS machine # [ 0.382494] Speculative Return Stack Overflow: Mitigation: Safe RET machine # [ 0.383494] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization machine # [ 0.384501] Spectre V2 : Enabling IBPB for BPF machine # [ 0.385495] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier machine # [ 0.386494] active return thunk: srso_alias_return_thunk machine # [ 0.388461] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' machine # [ 0.389494] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' machine # [ 0.390494] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' machine # [ 0.391494] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' machine # [ 0.392494] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' machine # [ 0.393494] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' machine # [ 0.395363] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' machine # [ 0.396494] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 machine # [ 0.397494] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 machine # [ 0.398494] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 machine # [ 0.399494] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 machine # [ 0.400494] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 machine # [ 0.401494] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. machine # [ 0.431562] Freeing SMP alternatives memory: 44K machine # [ 0.432415] pid_max: default: 32768 minimum: 301 machine # [ 0.433186] LSM: initializing lsm=capability,landlock,yama,bpf,ima machine # [ 0.434409] landlock: Up and running. machine # [ 0.434966] Yama: becoming mindful. machine # [ 0.435707] LSM support for eBPF active machine # [ 0.436683] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.437571] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.440979] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) machine # [ 0.442096] Performance Events: Fam17h+ core perfctr, AMD PMU driver. machine # [ 0.442503] ... version: 2 machine # [ 0.443291] ... bit width: 48 machine # [ 0.443497] ... generic counters: 6 machine # [ 0.444306] ... generic bitmap: 000000000000003f machine # [ 0.445255] ... fixed-purpose counters: 0 machine # [ 0.445496] ... fixed-purpose bitmap: 0000000000000000 machine # [ 0.446430] ... value mask: 0000ffffffffffff machine # [ 0.447215] ... max period: 00007fffffffffff machine # [ 0.447496] ... global_ctrl mask: 000000000000003f machine # [ 0.448561] signal: max sigframe size: 3376 machine # [ 0.449388] rcu: Hierarchical SRCU implementation. machine # [ 0.450188] rcu: Max phase no-delay instances is 400. machine # [ 0.450680] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level machine # [ 0.456104] smp: Bringing up secondary CPUs ... machine # [ 0.456903] smpboot: x86: Booting SMP configuration: machine # [ 0.457499] .... node #0, CPUs: #1 #2 #3 machine # [ 0.460644] smp: Brought up 1 node, 4 CPUs machine # [ 0.462497] smpboot: Total of 4 processors activated (19200.09 BogoMIPS) machine # [ 0.463828] Memory: 3957768K/4193752K available (17259K kernel code, 2728K rwdata, 13652K rodata, 3656K init, 2968K bss, 220916K reserved, 0K cma-reserved) machine # [ 0.465496] devtmpfs: initialized machine # [ 0.466804] x86/mm: Memory block size: 128MB machine # [ 0.469563] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.470580] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). machine # [ 0.471576] pinctrl core: initialized pinctrl subsystem machine # [ 0.472769] PM: RTC time: 09:11:04, date: 2026-09-30 machine # [ 0.476800] NET: Registered PF_NETLINK/PF_ROUTE protocol family machine # [ 0.478343] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations machine # [ 0.479534] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations machine # [ 0.481074] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations machine # [ 0.481508] audit: initializing netlink subsys (disabled) machine # [ 0.482559] audit: type=2000 audit(1790759465.540:1): state=initialized audit_enabled=0 res=1 machine # [ 0.482845] thermal_sys: Registered thermal governor 'fair_share' machine # [ 0.484497] thermal_sys: Registered thermal governor 'bang_bang' machine # [ 0.485497] thermal_sys: Registered thermal governor 'step_wise' machine # [ 0.486496] thermal_sys: Registered thermal governor 'user_space' machine # [ 0.487496] thermal_sys: Registered thermal governor 'power_allocator' machine # [ 0.488510] cpuidle: using governor menu machine # [ 0.490740] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 machine # [ 0.491748] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] machine # [ 0.492501] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry machine # [ 0.493511] PCI: Using configuration type 1 for base access machine # [ 0.494653] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. machine # [ 0.497909] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages machine # [ 0.499370] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page machine # [ 0.500375] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages machine # [ 0.501407] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page machine # [ 0.505982] ACPI: Added _OSI(Module Device) machine # [ 0.508506] ACPI: Added _OSI(Processor Device) machine # [ 0.510503] ACPI: Added _OSI(Processor Aggregator Device) machine # [ 0.519000] ACPI: 1 ACPI AML tables successfully acquired and loaded machine # [ 0.525832] ACPI: Interpreter enabled machine # [ 0.526528] ACPI: PM: (supports S0 S3 S4 S5) machine # [ 0.527282] ACPI: Using IOAPIC for interrupt routing machine # [ 0.527553] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug machine # [ 0.528498] PCI: Using E820 reservations for host bridge windows machine # [ 0.529994] ACPI: Enabled 2 GPEs in block 00 to 3F machine # [ 0.542392] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) machine # [ 0.545512] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] machine # [ 0.548799] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] machine # [ 0.552825] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] machine # [ 0.556575] PCI host bridge to bus 0000:00 machine # [ 0.557511] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] machine # [ 0.560504] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] machine # [ 0.562500] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] machine # [ 0.565501] pci_bus 0000:00: root bus resource [mem 0x80000000-0xafffffff window] machine # [ 0.567500] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] machine # [ 0.570500] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.572501] pci_bus 0000:00: root bus resource [bus 00-ff] machine # [ 0.574799] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint machine # [ 0.578043] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint machine # [ 0.591588] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] machine # [ 0.592509] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] machine # [ 0.593518] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] machine # [ 0.594675] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] machine # [ 0.598412] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.610542] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] machine # [ 0.612519] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] machine # [ 0.615594] pci 0000:00:02.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref] machine # [ 0.618518] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] machine # [ 0.623211] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.632541] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] machine # [ 0.634518] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] machine # [ 0.637567] pci 0000:00:03.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref] machine # [ 0.641865] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint machine # [ 0.649544] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] machine # [ 0.651513] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] machine # [ 0.653543] pci 0000:00:04.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref] machine # [ 0.656908] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.663559] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] machine # [ 0.664507] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] machine # [ 0.665519] pci 0000:00:05.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref] machine # [ 0.666503] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] machine # [ 0.668695] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint machine # [ 0.673537] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] machine # [ 0.674519] pci 0000:00:06.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref] machine # [ 0.676054] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.679510] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] machine # [ 0.681519] pci 0000:00:07.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref] machine # [ 0.683048] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.686542] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] machine # [ 0.699310] pci 0000:00:08.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref] machine # [ 0.701027] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.704543] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] machine # [ 0.705519] pci 0000:00:09.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref] machine # [ 0.708078] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint machine # [ 0.711545] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] machine # [ 0.712443] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] machine # [ 0.714299] pci 0000:00:0a.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref] machine # [ 0.716575] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.719504] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] machine # [ 0.720358] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] machine # [ 0.721275] pci 0000:00:0b.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref] machine # [ 0.722999] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.726318] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] machine # [ 0.727412] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.730233] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] machine # [ 0.730731] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.733559] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] machine # [ 0.734888] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint machine # [ 0.738381] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] machine # [ 0.741078] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint machine # [ 0.745256] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO machine # [ 0.750146] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint machine # [ 0.759118] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] machine # [ 0.761519] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] machine # [ 0.764482] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint machine # [ 0.770375] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] machine # [ 0.779483] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 machine # [ 0.781706] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 machine # [ 0.783701] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 machine # [ 0.785696] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 machine # [ 0.787699] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 machine # [ 0.789714] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 machine # [ 0.791724] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 machine # [ 0.793700] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 machine # [ 0.795539] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 machine # [ 0.796513] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 machine # [ 0.797780] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 machine # [ 0.799545] ACPI: PCI: Interrupt link GSID configured for IRQ 19 machine # [ 0.801538] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 machine # [ 0.803526] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 machine # [ 0.805525] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 machine # [ 0.807524] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 machine # [ 0.813514] iommu: Default domain type: Translated machine # [ 0.814502] iommu: DMA domain TLB invalidation policy: lazy mode machine # [ 0.817063] ACPI: bus type USB registered machine # [ 0.818720] usbcore: registered new interface driver usbfs machine # [ 0.820525] usbcore: registered new interface driver hub machine # [ 0.822519] usbcore: registered new device driver usb machine # [ 0.826840] NetLabel: Initializing machine # [ 0.827503] NetLabel: domain hash size = 128 machine # [ 0.829502] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO machine # [ 0.831585] NetLabel: unlabeled traffic allowed by default machine # [ 0.833527] PCI: Using ACPI for IRQ routing machine # [ 0.886532] pci 0000:00:01.0: vgaarb: setting as boot VGA device machine # [ 0.887493] pci 0000:00:01.0: vgaarb: bridge control possible machine # [ 0.887493] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none machine # [ 0.889504] vgaarb: loaded machine # [ 0.890285] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 machine # [ 0.891497] hpet0: 3 comparators, 64-bit 100.000000 MHz counter machine # [ 0.896613] clocksource: Switched to clocksource kvm-clock machine # [ 0.898460] VFS: Disk quotas dquot_6.6.0 machine # [ 0.899190] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) machine # [ 0.900794] pnp: PnP ACPI init machine # [ 0.901670] ACPI: IRQ 4 override to edge(!), high(!) machine # [ 0.902689] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved machine # [ 0.904348] pnp: PnP ACPI: found 5 devices machine # [ 0.913542] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns machine # [ 0.915155] clocksource: Switched to clocksource acpi_pm machine # [ 0.916199] NET: Registered PF_INET protocol family machine # [ 0.917834] IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear) machine # [ 0.936251] tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.937845] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) machine # [ 0.939309] TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear) machine # [ 0.940818] TCP bind hash table entries: 32768 (order: 8, 1048576 bytes, linear) machine # [ 0.942185] TCP: Hash tables configured (established 32768 bind 32768) machine # [ 0.943444] MPTCP token hash table entries: 4096 (order: 5, 98304 bytes, linear) machine # [ 0.944822] UDP hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.946175] UDP-Lite hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.947579] NET: Registered PF_UNIX/PF_LOCAL protocol family machine # [ 0.948648] NET: Registered PF_XDP protocol family machine # [ 0.949560] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] machine # [ 0.950637] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] machine # [ 0.951711] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] machine # [ 0.952889] pci_bus 0000:00: resource 7 [mem 0x80000000-0xafffffff window] machine # [ 0.954061] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] machine # [ 0.955234] pci_bus 0000:00: resource 9 [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.957193] ACPI: \_SB_.GSIA: Enabled at IRQ 16 machine # [ 0.959410] ACPI: \_SB_.GSIB: Enabled at IRQ 17 machine # [ 0.961523] ACPI: \_SB_.GSIC: Enabled at IRQ 18 machine # [ 0.963693] ACPI: \_SB_.GSID: Enabled at IRQ 19 machine # [ 0.965471] PCI: CLS 0 bytes, default 64 machine # [ 0.966244] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) machine # [ 0.966758] Trying to unpack rootfs image as initramfs... machine # [ 0.967434] software IO TLB: mapped [mem 0x000000007a364000-0x000000007e364000] (64MB) machine # [ 0.967563] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.991145] Initialise system trusted keyrings machine # [ 0.992547] workingset: timestamp_bits=40 max_order=20 bucket_order=0 machine # [ 1.003813] Key type asymmetric registered machine # [ 1.004615] Asymmetric key parser 'x509' registered machine # [ 1.005554] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) machine # [ 1.007402] io scheduler mq-deadline registered machine # [ 1.008191] io scheduler kyber registered machine # [ 1.011035] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled machine # [ 1.012428] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A machine # [ 1.014812] Linux agpgart interface v0.103 machine # [ 1.015636] ACPI: bus type drm_connector registered machine # [ 1.018586] usbcore: registered new interface driver usbserial_generic machine # [ 1.019737] usbserial: USB Serial support registered for generic machine # [ 1.020795] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. machine # [ 1.020795] Please enable it if your BIOS has the CPPC option. machine # [ 1.023177] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled machine # [ 1.024715] drop_monitor: Initializing network drop monitor service machine # [ 1.025996] NET: Registered PF_INET6 protocol family machine # [ 1.027961] Segment Routing with IPv6 machine # [ 1.028706] In-situ OAM (IOAM) with IPv6 machine # [ 1.030927] IPI shorthand broadcast: enabled machine # [ 1.035470] sched_clock: Marking stable (881011471, 154281993)->(1057931290, -22637826) machine # [ 1.037403] registered taskstats version 1 machine # [ 1.038460] Loading compiled-in X.509 certificates machine # [ 1.048705] Demotion targets for Node 0: null machine # [ 1.050070] Key type .fscrypt registered machine # [ 1.050832] Key type fscrypt-provisioning registered machine # [ 1.051865] ima: No TPM chip found, activating TPM-bypass! machine # [ 1.052843] ima: Allocated hash algorithm: sha1 machine # [ 1.053712] ima: No architecture policies found machine # [ 1.054873] PM: Magic number: 10:842:172 machine # [ 1.056595] RAS: Correctable Errors collector initialized. machine # [ 1.061067] clk: Disabling unused clocks machine # [ 1.061944] PM: genpd: Disabling unused power domains machine # [ 1.255235] Freeing initrd memory: 29104K machine # [ 1.259605] Freeing unused decrypted memory: 2028K machine # [ 1.262600] Freeing unused kernel image (initmem) memory: 3656K machine # [ 1.263787] Write protecting the kernel read-only data: 32768k machine # [ 1.266835] Freeing unused kernel image (text/rodata gap) memory: 1172K machine # [ 1.269959] Freeing unused kernel image (rodata/data gap) memory: 684K machine # [ 1.333063] x86/mm: Checked W+X mappings: passed, no W+X pages found. machine # [ 1.334337] Run /init as init process machine # [ 1.349027] systemd[1]: Inserted module 'autofs4' machine # [ 1.375823] fuse: init (API version 7.45) machine # [ 1.384970] ACPI: \_SB_.GSIG: Enabled at IRQ 22 machine # [ 1.387411] ACPI: \_SB_.GSIH: Enabled at IRQ 23 machine # [ 1.390733] ACPI: \_SB_.GSIE: Enabled at IRQ 20 machine # [ 1.392928] ACPI: \_SB_.GSIF: Enabled at IRQ 21 machine # [ 1.397984] virtiofs virtio5: discovered new tag: nix-store machine # [ 1.399645] virtiofs virtio5: virtio_fs_setup_dax: No cache capability machine # [ 1.406687] virtiofs virtio6: discovered new tag: shared machine # [ 1.419722] virtiofs virtio6: virtio_fs_setup_dax: No cache capability machine # [ 1.424171] virtiofs virtio7: discovered new tag: xchg machine # [ 1.425771] virtiofs virtio7: virtio_fs_setup_dax: No cache capability machine # [ 1.453351] systemd[1]: Successfully made /usr/ read-only. machine # [ 1.790003] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 1.801727] systemd[1]: Detected virtualization kvm. machine # [ 1.803957] systemd[1]: Detected architecture x86-64. machine # [ 1.806192] systemd[1]: Running in initrd. machine # [ 1.808800] systemd[1]: Initializing machine ID from random generator. machine # [ 1.811730] systemd[1]: Hostname set to . machine # [ 1.930733] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 1.974459] systemd[1]: Queued start job for default target Initrd Default Target. machine # [ 1.982823] systemd[1]: Created slice Slice /system/modprobe. machine # [ 1.984072] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 1.985560] systemd[1]: Expecting device /dev/disk/by-label/nixos... machine # [ 1.986736] systemd[1]: Reached target Path Units. machine # [ 1.987682] systemd[1]: Reached target Slice Units. machine # [ 1.988627] systemd[1]: Reached target Swaps. machine # [ 1.989487] systemd[1]: Reached target Timer Units. machine # [ 1.990532] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 1.991830] systemd[1]: Listening on Journal Socket (/dev/log). machine # [ 1.993028] systemd[1]: Listening on Journal Sockets. machine # [ 1.994074] systemd[1]: Listening on udev Control Socket. machine # [ 1.995137] systemd[1]: Listening on udev Kernel Socket. machine # [ 1.996116] systemd[1]: Reached target Socket Units. machine # [ 1.998119] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 2.000328] systemd[1]: Starting Load Kernel Module configfs... machine # [ 2.003505] systemd[1]: Starting Journal Service... machine # [ 2.005346] systemd[1]: Starting Load Kernel Modules... machine # [ 2.007394] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 2.022508] systemd[1]: Starting Coldplug All udev Devices... machine # [ 2.029492] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 2.033938] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 2.038076] systemd[1]: Finished Load Kernel Module configfs. machine # [ 2.041529] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config machine # [ 2.048706] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 2.052436] systemd-journald[89]: Collecting audit messages is disabled. machine # [ 2.063141] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. machine # [ 2.065456] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev machine # [ 2.072489] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 2.074986] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 2.076745] systemd[1]: Finished Load Kernel Modules. machine # [ 2.081014] systemd[1]: Starting Apply Kernel Variables... machine # [ 2.086664] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 2.088077] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 2.089486] systemd[1]: Reached target Local File Systems. machine # [ 2.091591] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 2.093588] systemd[1]: Finished Apply Kernel Variables. machine # [ 2.100583] systemd[1]: Started Journal Service. machine # [ 1.946396] systemd-modules-load[90]: Using 4 probe threads machine # [ 1.949142] systemd-modules-load[90]: Inserted module 'virtio_balloon' machine # [ 1.950351] systemd-modules-load[90]: Inserted module 'dm_mod' machine # [ 1.951470] systemd-modules-load[90]: Inserted module 'virtio_gpu' machine # [ 1.952536] systemd[1]: Starting Create System Files and Directories... machine # [ 1.957932] systemd[1]: Finished Create System Files and Directories. machine # [ 1.962838] systemd-udevd[104]: Using default interface naming scheme 'v261'. machine # [ 1.972981] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 1.979651] systemd[1]: Finished Coldplug All udev Devices. machine # [ 1.980665] systemd[1]: Reached target System Initialization. machine # [ 1.981549] systemd[1]: Reached target Basic System. machine # [ 2.238253] virtio_blk virtio2: 4/0/0 default/read/poll queues machine # [ 2.242460] uhci_hcd 0000:00:1d.0: UHCI Host Controller machine # [ 2.245327] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 1 machine # [ 2.246465] uhci_hcd 0000:00:1d.0: detected 2 ports machine # [ 2.246999] SCSI subsystem initialized machine # [ 2.247271] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 machine # [ 2.249151] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.250388] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.251467] usb usb1: Product: UHCI Host Controller machine # [ 2.252173] usb usb1: Manufacturer: Linux 6.18.53 uhci_hcd machine # [ 2.253100] usb usb1: SerialNumber: 0000:00:1d.0 machine # [ 2.260219] virtio_blk virtio2: [vda] 33554432 512-byte logical blocks (17.2 GB/16.0 GiB) machine # [ 2.262572] hub 1-0:1.0: USB hub found machine # [ 2.263643] hub 1-0:1.0: 2 ports detected machine # [ 2.289977] ehci-pci 0000:00:1d.7: EHCI Host Controller machine # [ 2.290837] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 2 machine # [ 2.292443] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 machine # [ 2.299412] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 machine # [ 2.300535] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 machine # [ 2.303854] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.304988] usb usb2: Product: EHCI Host Controller machine # [ 2.305796] usb usb2: Manufacturer: Linux 6.18.53 ehci_hcd machine # [ 2.306649] usb usb2: SerialNumber: 0000:00:1d.7 machine # [ 2.152733] systemd[1]: Starting Virtual Console Setup... machine # [ 2.307515] hub 2-0:1.0: USB hub found machine # [ 2.308598] hub 2-0:1.0: 6 ports detected machine # [ 2.330430] hub 1-0:1.0: USB hub found machine # [ 2.331038] hub 1-0:1.0: 2 ports detected machine # [ 2.332324] uhci_hcd 0000:00:1d.1: UHCI Host Controller machine # [ 2.333157] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 machine # [ 2.334328] uhci_hcd 0000:00:1d.1: detected 2 ports machine # [ 2.335246] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 machine # [ 2.336629] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 machine # [ 2.338685] serio: i8042 KBD port at 0x60,0x64 irq 1 machine # [ 2.339480] serio: i8042 AUX port at 0x60,0x64 irq 12 machine # [ 2.187556] (udev-worker)[116]: Network interface NamePolicy= disabled on kernel command line. machine # [ 2.343663] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.345041] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.191118] (udev-worker)[117]: eth1:[ 2.346220] usb usb3: Product: UHCI Host Controller machine # Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.[ 2.347905] usb usb3: Manufacturer: Linux 6.18.53 uhci_hcd machine # [ 2.349642] usb usb3: SerialNumber: 0000:00:1d.1 machine # [ 2.354424] hub 3-0:1.0: USB hub found machine # machine # [ 2.201157] (udev-worker)[117]: Network interface NamePolicy= disabled on kernel command line. machine # [ 2.356229] hub 3-0:1.0: 2 ports detected machine # [ 2.202967] systemd-vconsole-setup[142]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 2.359781] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 machine # [ 2.208210] systemd[1]: Finished Virtual Console Setup. machine # [ 2.364009] uhci_hcd 0000:00:1d.2: UHCI Host Controller machine # [ 2.365398] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 machine # [ 2.366777] uhci_hcd 0000:00:1d.2: detected 2 ports machine # [ 2.367684] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 machine # [ 2.213884] systemd[1]: Found device /dev/disk/by-label/nixos. machine # [ 2.215272] systemd[1]: Reached target Initrd Root Device. machine # [ 2.370008] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.216901] systemd[1]: Starting File System Check on /dev/disk/by-label/nixo[ 2.371758] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # s... machine # [ 2.373605] usb usb4: Product: UHCI Host Controller machine # [ 2.374457] usb usb4: Manufacturer: Linux 6.18.53 uhci_hcd machine # [ 2.375231] usb usb4: SerialNumber: 0000:00:1d.2 machine # [ 2.376153] hub 4-0:1.0: USB hub found machine # [ 2.376878] hub 4-0:1.0: 2 ports detected machine # [ 2.377978] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode machine # [ 2.379350] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) machine # [ 2.380658] ahci 0000:00:1f.2: flags: 64bit ncq only machine # [ 2.388607] scsi host0: ahci machine # [ 2.389581] scsi host1: ahci machine # [ 2.390682] scsi host2: ahci machine # [ 2.391820] scsi host3: ahci machine # [ 2.392670] scsi host4: ahci machine # [ 2.393980] scsi host5: ahci machine # [ 2.395096] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 50 lpm-pol 1 machine # [ 2.396731] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 50 lpm-pol 1 machine # [ 2.398186] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 50 lpm-pol 1 machine # [ 2.399426] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 50 lpm-pol 1 machine # [ 2.400649] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 50 lpm-pol 1 machine # [ 2.402127] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 50 lpm-pol 1 machine # [ 2.248850] systemd-fsck[162]: nixos: clean, 12/1048576 files, 109865/4194304 blocks machine # [ 2.253221] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. machine # [ 2.547528] usb 2-1: new high-speed USB device number 2 using ehci-pci machine # [ 2.678967] usb 2-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 machine # [ 2.682089] usb 2-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 machine # [ 2.684828] usb 2-1: Product: QEMU USB Tablet machine # [ 2.686578] usb 2-1: Manufacturer: QEMU machine # [ 2.688086] usb 2-1: SerialNumber: 28754-0000:00:1d.7-1 machine # [ 2.715667] ata6: SATA link down (SStatus 0 SControl 300) machine # [ 2.717985] ata1: SATA link down (SStatus 0 SControl 300) machine # [ 2.720498] ata5: SATA link down (SStatus 0 SControl 300) machine # [ 2.722969] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) machine # [ 2.725497] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 machine # [ 2.727589] ata3.00: applying bridge limits machine # [ 2.729442] hid: raw HID events driver (C) Jiri Kosina machine # [ 2.729544] ata2: SATA link down (SStatus 0 SControl 300) machine # [ 2.733711] ata4: SATA link down (SStatus 0 SControl 300) machine # [ 2.736029] ata3.00: configured for UDMA/100 machine # [ 2.738447] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 machine # [ 2.774413] usbcore: registered new interface driver usbhid machine # [ 2.776533] usbhid: USB HID core driver machine # [ 2.786533] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb2/2-1/2-1:1.0/0003:0627:0001.0001/input/input2 machine # [ 2.790927] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 machine # [ 2.807764] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray machine # [ 2.837632] cdrom: Uniform CD-ROM driver Revision: 3.20 machine # [ 2.874653] systemd[1]: Mounting /sysroot... machine # [ 3.180512] EXT4-fs (vda): mounted filesystem d490e557-fa34-4fcc-9c49-66ff8d01bb4a r/w with ordered data mode. Quota mode: none. machine # [ 3.032491] systemd[1]: Mounted /sysroot. machine # [ 3.034542] systemd[1]: Reached target Initrd Root File System. machine # [ 3.036857] systemd[1]: Mounting /sysroot/nix/.ro-store... machine # [ 3.039069] systemd[1]: Mounting /sysroot/nix/.rw-store... machine # [ 3.041172] systemd[1]: Mounting /sysroot/run... machine # [ 3.042972] systemd[1]: Mounting /sysroot/tmp/shared... machine # [ 3.055234] systemd[1]: Mounting /sysroot/tmp/xchg... machine # [ 3.060395] systemd[1]: Starting Mountpoints Configured in the Real Root... machine # [ 3.071173] systemd[1]: Mounted /sysroot/nix/.ro-store. machine # [ 3.073494] systemd[1]: Mounted /sysroot/run. machine # [ 3.075221] systemd[1]: Mounted /sysroot/tmp/shared. machine # [ 3.076802] systemd[1]: Mounted /sysroot/tmp/xchg. machine # [ 3.078543] systemd-sysroot-fstab-check[192]: /sysroot should be mounted in the initrd, will request daemon-reload. machine # [ 3.082069] systemd[1]: Mounted /sysroot/nix/.rw-store. machine # [ 3.083742] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.085444] systemd[1]: Reload requested from client PID 192 ('systemd-sysroot') (unit initrd-parse-etc.service)... machine # [ 3.088417] systemd[1]: Reloading... machine # [ 3.137496] systemd[1]: Reloading finished in 55 ms. machine # [ 3.166070] systemd-sysroot-fstab-check[192]: Requesting initrd-fs.target/start/replace... machine # [ 3.168970] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.171499] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.173505] systemd-sysroot-fstab-check[192]: Requesting swap.target/start/replace... machine # [ 3.176102] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.179280] systemd[1]: initrd-parse-etc.service: Deactivated successfully. machine # [ 3.185587] systemd[1]: Finished Mountpoints Configured in the Real Root. machine # [ 3.187846] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. machine # [ 3.195285] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.197675] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.875411] systemd[1]: Mounting /sysroot/nix/store... machine # [ 3.928728] systemd[1]: Mounted /sysroot/nix/store. machine # [ 3.930689] systemd[1]: Reached target Initrd File Systems. machine # [ 3.932648] systemd[1]: Starting Find NixOS closure... machine # [ 3.934842] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... machine # [ 3.958677] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. machine # [ 3.960999] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. machine # [ 3.978321] systemd[1]: Finished Find NixOS closure. machine # [ 3.979835] systemd[1]: Reached target Initrd Default Target. machine # [ 3.981665] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... machine # [ 4.009772] systemd[1]: Stopped target Initrd Default Target. machine # [ 4.011875] systemd[1]: Stopped target Basic System. machine # [ 4.013627] systemd[1]: Stopped target Initrd Root Device. machine # [ 4.015593] systemd[1]: Stopped target Path Units. machine # [ 4.017350] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. machine # [ 4.019826] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. machine # [ 4.023762] systemd[1]: Stopped target Slice Units. machine # [ 4.025480] systemd[1]: Stopped target Socket Units. machine # [ 4.029199] systemd[1]: Stopped target System Initialization. machine # [ 4.031290] systemd[1]: Stopped target Swaps. machine # [ 4.033320] systemd[1]: Stopped target Timer Units. machine # [ 4.035204] systemd[1]: dbus.socket: Deactivated successfully. machine # [ 4.037229] systemd[1]: Closed D-Bus System Message Bus Socket. machine # [ 4.039315] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. machine # [ 4.041419] systemd[1]: Stopped Find NixOS closure. machine # [ 4.042800] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 4.044479] systemd[1]: systemd-sysctl.service: Deactivated successfully. machine # [ 4.046348] systemd[1]: Stopped Apply Kernel Variables. machine # [ 4.047893] systemd[1]: systemd-modules-load.service: Deactivated successfully. machine # [ 4.050588] systemd[1]: Stopped Load Kernel Modules. machine # [ 4.052630] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. machine # [ 4.054831] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. machine # [ 4.056912] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. machine # [ 4.058839] systemd[1]: Stopped Create System Files and Directories. machine # [ 4.060580] systemd[1]: Stopped target Local File Systems. machine # [ 4.062104] systemd[1]: Stopped target Preparation for Local File Systems. machine # [ 4.063434] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. machine # [ 4.064575] systemd[1]: Stopped Coldplug All udev Devices. machine # [ 4.065489] systemd[1]: Stopping Rule-based Manager for Device Events and Files... machine # [ 4.066700] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 4.067840] systemd[1]: Stopped Virtual Console Setup. machine # [ 4.071213] systemd[1]: initrd-cleanup.service: Deactivated successfully. machine # [ 4.072344] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. machine # [ 4.073363] systemd[1]: systemd-udevd.service: Deactivated successfully. machine # [ 4.074356] systemd[1]: Stopped Rule-based Manager for Device Events and Files. machine # [ 4.075401] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 4.076443] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 4.077328] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. machine # [ 4.078367] systemd[1]: Closed udev Control Socket. machine # [ 4.079167] systemd[1]: Starting Cleanup udev Database... machine # [ 4.079932] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. machine # [ 4.081043] systemd[1]: Stopped Create Static Device Nodes in /dev. machine # [ 4.081915] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. machine # [ 4.083463] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. machine # [ 4.084746] systemd[1]: kmod-static-nodes.service: Deactivated successfully. machine # [ 4.085927] systemd[1]: Stopped Create List of Static Device Nodes. machine # [ 4.097264] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. machine # [ 4.098590] systemd[1]: Finished Cleanup udev Database. machine # [ 4.099849] systemd[1]: Reached target Switch Root. machine # [ 4.101857] systemd[1]: Starting NixOS Activation... machine # [ 4.251730] initrd-nixos-activation-start[237]: booting system configuration /nix/store/5bsx4hvqc97rw93i1q9fb6qqxsjlv6ip-nixos-system-machine-test machine # [ 4.309139] initrd-nixos-activation-start[237]: running activation script... machine # [ 4.601802] initrd-nixos-activation-start[260]: setting up /etc... machine # [ 4.731165] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. machine # [ 4.733829] systemd[1]: Finished NixOS Activation. machine # [ 4.735564] systemd[1]: Starting Switch Root... machine # [ 4.753838] systemd[1]: Switching root. machine # [ 4.972050] systemd-journald[89]: Received SIGTERM from PID 1 (systemd). machine # [ 5.087060] NET: Registered PF_VSOCK protocol family machine # [ 5.472155] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 5.482531] systemd[1]: Detected virtualization kvm. machine # [ 5.484421] systemd[1]: Detected architecture x86-64. machine # [ 5.486420] systemd[1]: Detected first boot. machine # [ 5.491185] systemd[1]: Initializing machine ID from random generator. machine # [ 5.634475] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 5.727619] systemd[1]: Applying preset policy. machine # [ 5.951036] systemd[1]: Populated /etc with preset unit settings. machine # [ 6.208686] systemd[1]: initrd-switch-root.service: Deactivated successfully. machine # [ 6.210125] systemd[1]: Stopped initrd-switch-root.service. machine # [ 6.212717] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. machine # [ 6.214914] systemd[1]: Created slice Slice /system/getty. machine # [ 6.216428] systemd[1]: Created slice User and Session Slice. machine # [ 6.217416] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 6.218844] systemd[1]: Started Forward Password Requests to Wall Directory Watch. machine # [ 6.220018] systemd[1]: Expecting device /dev/hvc0... machine # [ 6.220817] systemd[1]: Expecting device /dev/ttyS0... machine # [ 6.221640] systemd[1]: Reached target Local Encrypted Volumes. machine # [ 6.222594] systemd[1]: Stopped target initrd-fs.target. machine # [ 6.223422] systemd[1]: Stopped target initrd-root-fs.target. machine # [ 6.224229] systemd[1]: Stopped target initrd-switch-root.target. machine # [ 6.225176] systemd[1]: Reached target Virtual Machines and Containers. machine # [ 6.226150] systemd[1]: Reached target Path Units. machine # [ 6.226930] systemd[1]: Reached target Remote File Systems. machine # [ 6.227804] systemd[1]: Reached target Slice Units. machine # [ 6.228605] systemd[1]: Reached target Swaps. machine # [ 6.230909] systemd[1]: Listening on Query the User Interactively for a Password. machine # [ 6.233599] systemd[1]: Listening on Process Core Dump Socket. machine # [ 6.235648] systemd[1]: Listening on Credential Encryption/Decryption. machine # [ 6.237782] systemd[1]: Listening on Factory Reset Management. machine # [ 6.238851] systemd[1]: Listening on Hostname Service Socket. machine # [ 6.242199] systemd[1]: Starting Journal Log Access Socket... machine # [ 6.243681] systemd[1]: Listening on Journal Audit Socket. machine # [ 6.246139] systemd[1]: Listening on Console Output Muting Service Socket. machine # [ 6.247376] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. machine # [ 6.248589] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.250001] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki machine # [ 6.254999] systemd[1]: Listening on Disk Repartitioning Service Socket. machine # [ 6.256114] systemd[1]: Listening on udev Control Socket. machine # [ 6.257030] systemd[1]: Listening on udev Varlink Socket. machine # [ 6.259831] systemd[1]: Mounting Huge Pages File System... machine # [ 6.262357] systemd[1]: Mounting POSIX Message Queue File System... machine # [ 6.265092] systemd[1]: Mounting Kernel Debug File System... machine # [ 6.267418] systemd[1]: Mounting Kernel Trace File System... machine # [ 6.276033] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 6.279250] systemd[1]: Starting Load Kernel Module configfs... machine # [ 6.280180] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm machine # [ 6.281708] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.283381] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.286582] systemd[1]: Mounting FUSE Control File System... machine # [ 6.287539] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.294723] systemd[1]: Starting Journal Service... machine # [ 6.299456] systemd[1]: Starting Load Kernel Modules... machine # [ 6.304350] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... machine # [ 6.311353] systemd[1]: Starting Remount Root and Kernel File Systems... machine # [ 6.312406] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.315542] systemd[1]: Starting Coldplug All udev Devices... machine # [ 6.320768] systemd[1]: Listening on Journal Log Access Socket. machine # [ 6.322049] systemd[1]: Mounted Huge Pages File System. machine # [ 6.323051] systemd[1]: Mounted POSIX Message Queue File System. machine # [ 6.324086] systemd[1]: Mounted Kernel Debug File System. machine # [ 6.325139] systemd[1]: Mounted Kernel Trace File System. machine # [ 6.332327] systemd[1]: Mounted FUSE Control File System. machine # [ 6.335965] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 6.343066] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 6.346202] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 6.349085] systemd[1]: Finished Load Kernel Module configfs. machine # [ 6.355019] systemd[1]: Mounting Kernel Configuration File System... machine # [ 6.360360] EXT4-fs (vda): re-mounted d490e557-fa34-4fcc-9c49-66ff8d01bb4a. machine # [ 6.361415] systemd-journald[330]: Collecting audit messages is enabled. machine # [ 6.365208] systemd[1]: Finished Remount Root and Kernel File Systems. machine # [ 6.368172] systemd[1]: Listening on Disk Image Download Service Socket. machine # [ 6.369458] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.371639] loop: module loaded machine # [ 6.374576] systemd[1]: Starting Load/Save OS Random Seed... machine # [ 6.221214] systemd[1]: Queued start job for default target Multi-User System.[ 6.375541] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # machine # [ 6.377749] systemd[1]: Started Journal Service. machine # [ 6.223692] systemd[1]: systemd-journald.service: Deactivated successfully. machine # [ 6.225620] systemd-modules-load[331]: Using 2 probe threads machine # [ 6.227610] systemd-modules-load[331]: Inserted module 'loop' machine # [ 6.228664] systemd[1]: Finished Load Kernel Modules. machine # [ 6.229859] systemd-oomd[332]: No swap; memory pressure usage will be degraded machine # [ 6.231480] systemd[1]: Starting Flush Journal to Persistent Storage... machine # [ 6.233877] systemd[1]: Starting Apply Kernel Variables... machine # [ 6.234948] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. machine # [ 6.236183] systemd[1]: Mounted Kernel Configuration File System. machine # [ 6.257977] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 6.413572] systemd-journald[330]: Received client request to flush runtime journal. machine # [ 6.320298] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 6.321725] systemd[1]: Finished Load/Save OS Random Seed. machine # [ 6.322828] systemd[1]: Reached target First Boot Complete. machine # [ 6.324261] systemd[1]: Finished Apply Kernel Variables. machine # [ 6.325144] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 6.326146] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 6.327206] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 6.328335] systemd[1]: Finished Flush Journal to Persistent Storage. machine # [ 6.336994] systemd[1]: Finished Coldplug All udev Devices. machine # [ 6.347494] systemd-udevd[358]: Using default interface naming scheme 'v261'. machine # [ 6.380470] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 6.454205] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.475874] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. machine # [ 6.491260] (udev-worker)[379]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.498147] (udev-worker)[375]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 6.500403] (udev-worker)[375]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.503459] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. machine # [ 6.525337] systemd[1]: Condition check resulted in Virtio network device being skipped. machine # [ 6.526503] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.527983] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.530162] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.531679] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.533199] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.694172] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console machine # [ 6.707181] Console: switching to colour dummy device 80x25 machine # [ 6.708297] [drm] Found bochs VGA, ID 0xb0c5. machine # [ 6.708758] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. machine # [ 6.711447] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic machine # [ 6.712294] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized machine # [ 6.712491] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 machine # [ 6.715036] mousedev: PS/2 mouse device common for all mice machine # [ 6.729117] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 machine # [ 6.731816] Console: switching to colour frame buffer device 160x50 machine # [ 6.732892] ACPI: button: Power Button [PWRF] machine # [ 6.733724] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device machine # [ 6.744301] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 machine # [ 6.768276] rtc_cmos PNP0B00:00: RTC can wake from S4 machine # [ 6.769565] rtc_cmos PNP0B00:00: registered as rtc0 machine # [ 6.770160] rtc_cmos PNP0B00:00: setting system clock to 2026-09-30T09:11:11 UTC (1790759471) machine # [ 6.772496] systemd-journald[330]: Time jumped backwards, rotating. machine # [ 6.773961] parport_pc 00:02: reported by Plug and Play ACPI machine # [ 6.773966] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs machine # [ 6.775138] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] machine # [ 6.808493] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt machine # [ 6.809772] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD machine # [ 6.815120] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 machine # [ 6.844040] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 machine # [ 6.697694] systemd[1]: Starting Virtual Console Setup... machine # [ 6.707048] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 6.712430] systemd[1]: Stopped Virtual Console Setup. machine # [ 6.717947] systemd[1]: Starting Virtual Console Setup... machine # [ 6.873309] ppdev: user-space parallel port driver machine # [ 6.880537] iTCO_wdt iTCO_wdt.0.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) machine # [ 6.896150] iTCO_wdt iTCO_wdt.0.auto: initialized. heartbeat=30 sec (nowayout=0) machine # [ 6.963212] kvm_amd: TSC scaling supported machine # [ 6.963795] kvm_amd: Nested Virtualization enabled machine # [ 6.964384] kvm_amd: Nested Paging enabled machine # [ 6.964818] kvm_amd: LBR virtualization supported machine # [ 6.965405] kvm_amd: Virtual VMLOAD VMSAVE supported machine # [ 6.965929] kvm_amd: Virtual GIF supported machine # [ 6.966455] kvm_amd: Virtual NMI enabled machine # [ 6.879868] systemd-vconsole-setup[403]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 6.882645] systemd[1]: Finished Virtual Console Setup. machine # [ 7.048013] EDAC MC: Ver: 3.0.0 machine # [ 7.057786] systemd[1]: Mounting /run/wrappers... machine # [ 7.097310] systemd[1]: Mounted /run/wrappers. machine # [ 7.098148] systemd[1]: Reached target Local File Systems. machine # [ 7.100133] systemd[1]: Listening on Boot Loader Control Service Socket. machine # [ 7.103057] systemd[1]: Starting register-nix-paths.service... machine # [ 7.105921] systemd[1]: Starting Create SUID/SGID Wrappers... machine # [ 7.106803] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. machine # [ 7.108866] systemd[1]: Starting Save Transient machine-id to Disk... machine # [ 7.111974] systemd[1]: Starting Create System Files and Directories... machine # [ 7.187152] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. machine # [ 7.191694] systemd[1]: Finished Save Transient machine-id to Disk. machine # [ 7.210199] systemd[1]: Finished Create System Files and Directories. machine # [ 7.212682] systemd[1]: Starting Rebuild Journal Catalog... machine # [ 7.214302] systemd[1]: Starting Record System Boot/Shutdown in UTMP... machine # [ 7.239375] systemd[1]: Finished Record System Boot/Shutdown in UTMP. machine # [ 7.254130] systemd[1]: Finished Rebuild Journal Catalog. machine # [ 7.256118] systemd[1]: Starting Update is Completed... machine # [ 7.276855] systemd[1]: Finished Update is Completed. machine # [ 7.396454] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. machine # [ 7.397646] systemd[1]: Finished Create SUID/SGID Wrappers. machine # [ 7.641054] systemd[1]: Finished register-nix-paths.service. machine # [ 7.643049] systemd[1]: Reached target System Initialization. machine # [ 7.645251] systemd[1]: Started Discard unused filesystem blocks once a week. machine # [ 7.647763] systemd[1]: Started niks3 garbage collection timer. machine # [ 7.649860] systemd[1]: Started Daily Cleanup of Temporary Directories. machine # [ 7.652276] systemd[1]: Reached target Timer Units. machine # [ 7.654108] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 7.659369] systemd[1]: Listening on niks3 server socket. machine # [ 7.661354] systemd[1]: Listening on Nix Daemon Socket. machine # [ 7.663266] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. machine # [ 7.666466] systemd[1]: Reached target Socket Units. machine # [ 7.668422] systemd[1]: Reached target Basic System. machine # [ 7.670253] systemd[1]: Started backdoor.service. machine # [ 7.672072] systemd[1]: Starting Import lastlog data into lastlog2 database... machine # [ 7.674605] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 7.684192] systemd[1]: Starting Post-Boot Actions... machine # [ 7.688216] systemd[1]: Started Reset console on configuration changes. machine # [ 7.693355] systemd[1]: Starting resolvconf update... machine # [ 7.696305] systemd[1]: Started rustfs.service. machine # [ 7.700301] systemd[1]: Starting rustfs-bucket.service... machine # [ 7.704953] systemd[1]: Starting D-Bus System Message Bus... machine # [ 7.728078] systemd[1]: Finished Post-Boot Actions. machine # connecting to host... machine # [ 7.735408] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 7.735959] nsncd[486]: Sep 30 09:11:12.618 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 7.738948] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 7.739704] systemd[1]: Reached target User and Group Name Lookups. machine # [ 7.740625] systemd[1]: Starting User Login Management... machine # [ 7.747519] systemd[1]: Finished Import lastlog data into lastlog2 database. machine: Guest shell says: b'Spawning backdoor root shell...\n' machine: connected to guest root shell machine: (connecting took 8.42 seconds) machine: (finished: waiting for the VM to finish booting, in 8.68 seconds) machine # [ 7.806764] dbus-broker-launch[493]: Looking up NSS user entry for 'systemd-timesync'... machine # [ 7.813405] systemd-logind[516]: New seat seat0. machine # [ 7.816796] systemd-logind[516]: Watching system buttons on /dev/input/event2 (Power Button) machine # [ 7.818218] systemd-logind[516]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) machine # [ 7.818711] systemd-logind[516]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) machine # [ 7.819572] systemd[1]: Started User Login Management. machine # [ 7.821974] dbus-broker-launch[493]: NSS returned no entry for 'systemd-timesync' machine # [ 7.822942] dbus-broker-launch[493]: Invalid user-name in /nix/store/g7pg57y182bsrh126xs4av309lnxhndq-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" machine # [ 7.826674] systemd[1]: Starting linger-users.service... machine # [ 7.835323] systemd[1]: Started D-Bus System Message Bus. machine # [ 7.841139] systemd[1]: Stopped target Host and Network Name Lookups. machine # [ 7.843452] systemd[1]: Stopping Host and Network Name Lookups... machine # [ 7.844399] systemd[1]: Stopped target User and Group Name Lookups. machine # [ 7.847210] systemd[1]: Stopping User and Group Name Lookups... machine # [ 7.848122] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... machine # [ 7.850346] dbus-broker-launch[493]: Ready machine # [ 7.851058] systemd[1]: nscd.service: Deactivated successfully. machine # [ 7.851892] systemd[1]: Stopped Name Service Cache Daemon (nsncd). machine # [ 7.855560] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 7.863838] systemd[1]: linger-users.service: Deactivated successfully. machine # [ 7.867618] systemd[1]: Finished linger-users.service. machine # [ 7.885347] nsncd[589]: Sep 30 09:11:12.769 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 7.887406] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 7.889140] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 7.889441] systemd[1]: Reached target User and Group Name Lookups. machine # [ 7.904136] systemd[1]: Finished resolvconf update. machine # [ 7.904833] systemd[1]: Reached target Preparation for Network. machine # [ 7.907348] systemd[1]: Starting DHCP Client... machine # [ 7.908940] systemd[1]: Starting Address configuration of eth1... machine # [ 7.911381] systemd[1]: Starting Extra networking commands.... machine # [ 7.966827] network-addresses-eth1-start[618]: adding address 192.168.1.1/24... done machine # [ 7.974315] network-addresses-eth1-start[618]: adding address 2001:db8:1::1/64... done machine # [ 7.982787] systemd[1]: Finished Address configuration of eth1. machine # [ 8.001787] dhcpcd[629]: dhcpcd-10.3.2 starting machine # [ 8.007340] dhcpcd[680]: dev: loaded udev machine # [ 8.174948] 8021q: 802.1Q VLAN Support v1.8 machine # [ 8.176121] 8021q: adding VLAN 0 to HW filter on device eth1 machine # [ 8.029147] systemd[1]: Finished Extra networking commands.. machine # [ 8.030482] systemd[1]: Reached target Network. machine # [ 8.033430] systemd[1]: Starting PostgreSQL Server... machine # [ 8.036863] systemd[1]: Starting Permit User Sessions... machine # [ 8.040646] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. machine # [ 8.061546] systemd[1]: Finished Permit User Sessions. machine # [ 8.064354] systemd[1]: Started Getty on tty1. machine # [ 8.065189] systemd[1]: Reached target Login Prompts. machine # [ 8.275346] cfg80211: Loading compiled-in X.509 certificates for regulatory database machine # [ 8.298149] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' machine # [ 8.299717] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' machine # [ 8.301988] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 machine # [ 8.303170] cfg80211: failed to load regulatory.db machine # [ 8.157706] postgresql-pre-start[707]: The files belonging to this database system will be owned by user "postgres". machine # [ 8.157938] postgresql-pre-start[707]: This user must also own the server process. machine # [ 8.161717] postgresql-pre-start[707]: The database cluster will be initialized with locale "en_US.UTF-8". machine # [ 8.162101] postgresql-pre-start[707]: The default database encoding has accordingly been set to "UTF8". machine # [ 8.162524] postgresql-pre-start[707]: The default text search configuration will be set to "english". machine # [ 8.162988] postgresql-pre-start[707]: Data page checksums are enabled. machine # [ 8.163719] postgresql-pre-start[707]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok machine # [ 8.168621] postgresql-pre-start[707]: creating subdirectories ... ok machine # [ 8.169580] postgresql-pre-start[707]: selecting dynamic shared memory implementation ... posix machine # [ 8.342184] 8021q: adding VLAN 0 to HW filter on device eth0 machine # [ 8.189168] dhcpcd[680]: eth0: waiting for carrier machine # [ 8.190044] dhcpcd[680]: eth0: carrier acquired machine # [ 8.195230] dhcpcd[680]: DUID 00:01:00:01:32:4f:8e:b1:52:54:00:12:34:56 machine # [ 8.195712] dhcpcd[680]: eth0: IAID 00:12:34:56 machine # [ 8.196304] dhcpcd[680]: eth0: adding address fe80::5054:ff:fe12:3456 machine # [ 8.237297] postgresql-pre-start[707]: selecting default "max_connections" ... 100 machine # [ 8.238582] dhcpcd[680]: eth0: soliciting a DHCP lease machine # [ 8.406944] NET: Registered PF_PACKET protocol family machine # [ 8.260734] dhcpcd[680]: eth0: offered 10.0.2.15 from 10.0.2.2 machine # [ 8.265201] dhcpcd[680]: eth0: probing address 10.0.2.15/24 machine # [ 8.301813] postgresql-pre-start[707]: selecting default "shared_buffers" ... 128MB machine # [ 8.973407] postgresql-pre-start[707]: selecting default time zone ... UTC machine # [ 8.975107] postgresql-pre-start[707]: creating configuration files ... ok machine # [ 9.172260] postgresql-pre-start[707]: running bootstrap script ... ok machine # [ 9.639990] postgresql-pre-start[707]: performing post-bootstrap initialization ... ok machine # [ 9.845574] postgresql-pre-start[707]: syncing data to disk ... ok machine # [ 9.845969] postgresql-pre-start[707]: initdb: warning: enabling "trust" authentication for local connections machine # [ 9.847467] postgresql-pre-start[707]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. machine # [ 9.848916] postgresql-pre-start[707]: Success. You can now start the database server using: machine # [ 9.850521] postgresql-pre-start[707]: pg_ctl -D /var/lib/postgresql/18 -l logfile start machine # [ 9.982500] postgres[743]: [743] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit machine # [ 9.986936] postgres[743]: [743] LOG: listening on IPv6 address "::1", port 5432 machine # [ 9.988340] postgres[743]: [743] LOG: listening on IPv4 address "127.0.0.1", port 5432 machine # [ 9.990997] postgres[743]: [743] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" machine # [ 10.001394] postgres[761]: [761] LOG: database system was shut down at 2026-09-30 09:11:14 GMT machine # [ 10.012305] postgres[743]: [743] LOG: database system is ready to accept connections machine # [ 10.020280] systemd[1]: Started PostgreSQL Server. machine # [ 10.023802] systemd[1]: Starting PostgreSQL Setup Scripts... machine # [ 10.290784] postgresql-setup-start[772]: CREATE DATABASE machine # [ 10.323712] postgresql-setup-start[777]: CREATE ROLE machine # [ 10.338905] postgresql-setup-start[779]: ALTER DATABASE machine # [ 10.343471] systemd[1]: Finished PostgreSQL Setup Scripts. machine # [ 10.345528] systemd[1]: Reached target PostgreSQL. machine # [ 11.116130] dhcpcd[680]: eth0: soliciting an IPv6 router machine # [ 11.116560] dhcpcd[680]: eth0: Router Advertisement from fe80::2 machine # [ 11.118453] dhcpcd[680]: eth0: adding address fec0::5054:ff:fe12:3456/64 machine # [ 11.120064] dhcpcd[680]: eth0: adding route to fec0::/64 machine # [ 11.121485] dhcpcd[680]: eth0: adding default route via fe80::2 machine # [ 13.257500] dhcpcd[680]: eth0: leased 10.0.2.15 for 86400 seconds machine # [ 13.259895] dhcpcd[680]: eth0: adding route to 10.0.2.0/24 machine # [ 13.261871] dhcpcd[680]: eth0: adding default route via 10.0.2.2 machine # [ 13.394122] systemd[1]: Started DHCP Client. machine # [ 13.397110] systemd[1]: Reached target Network is Online. machine # [ 13.401877] systemd[1]: Starting k3s service... machine # [ 13.484283] k3s[870]: time="2026-09-30T09:11:18Z" level=info msg="Acquiring lock file /var/lib/rancher/k3s/data/.lock" machine # [ 13.484508] k3s[870]: time="2026-09-30T09:11:18Z" level=info msg="Preparing data dir /var/lib/rancher/k3s/data/53c81a1072dac7aebc0a3715f02f26b7ba95e9416f42c7f7aeed55ccb68af709" machine # [ 15.181712] rustfs-bucket-start[881]: mb s3://farm machine # [ 15.188513] systemd[1]: Finished rustfs-bucket.service. machine # [ 15.564928] k3s[870]: time="2026-09-30T09:11:20Z" level=info msg="Starting k3s 1.36.4+k3s1 (4dedb15b)" machine # [ 15.574686] k3s[870]: time="2026-09-30T09:11:20Z" level=info msg="Configuring sqlite3 database connection pooling: maxIdle=20, maxOpen=0, maxLifetime=0s, maxIdleTime=2m0s" machine # [ 15.577681] k3s[870]: time="2026-09-30T09:11:20Z" level=info msg="Kine built with sqlite from github.com/mattn/go-sqlite3 version 3.53.3" machine # [ 15.578846] k3s[870]: time="2026-09-30T09:11:20Z" level=info msg="Configuring database table schema and indexes, this may take a moment..." machine # [ 15.598279] k3s[870]: time="2026-09-30T09:11:20Z" level=info msg="Database tables and indexes are up to date" machine # [ 15.598855] k3s[870]: time="2026-09-30T09:11:20Z" level=info msg="Running startup VACUUM to reclaim disk space, this may take a moment..." machine # [ 15.602386] k3s[870]: time="2026-09-30T09:11:20Z" level=info msg="Startup VACUUM completed successfully" machine # [ 15.605947] k3s[870]: time="2026-09-30T09:11:20Z" level=info msg="Kine available at unix://kine.sock" machine # [ 15.607326] k3s[870]: time="2026-09-30T09:11:20Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 15.614072] k3s[870]: time="2026-09-30T09:11:20Z" level=info msg="Datastore connection validated successfully, proceeding with bootstrap data generation" machine # [ 15.615846] k3s[870]: time="2026-09-30T09:11:20Z" level=info msg="generated self-signed CA certificate CN=k3s-client-ca@1790759480: notBefore=2026-09-30 08:11:20.496865243 +0000 UTC notAfter=2036-09-27 08:11:20.496865243 +0000 UTC" machine # [ 15.618619] k3s[870]: time="2026-09-30T09:11:20Z" level=info msg="certificate CN=system:admin,O=system:masters signed by CN=k3s-client-ca@1790759480: notBefore=2026-09-30 08:11:20 +0000 UTC notAfter=2027-09-30 08:11:20 +0000 UTC" machine # [ 15.619345] k3s[870]: time="2026-09-30T09:11:20Z" level=info msg="certificate CN=system:k3s-supervisor,O=system:masters signed by CN=k3s-client-ca@1790759480: notBefore=2026-09-30 08:11:20 +0000 UTC notAfter=2027-09-30 08:11:20 +0000 UTC" machine # [ 15.619972] k3s[870]: time="2026-09-30T09:11:20Z" level=info msg="certificate CN=system:kube-controller-manager signed by CN=k3s-client-ca@1790759480: notBefore=2026-09-30 08:11:20 +0000 UTC notAfter=2027-09-30 08:11:20 +0000 UTC" machine # [ 15.620741] k3s[870]: time="2026-09-30T09:11:20Z" level=info msg="certificate CN=system:kube-scheduler signed by CN=k3s-client-ca@1790759480: notBefore=2026-09-30 08:11:20 +0000 UTC notAfter=2027-09-30 08:11:20 +0000 UTC" machine # [ 15.621732] k3s[870]: time="2026-09-30T09:11:20Z" level=info msg="certificate CN=system:apiserver,O=system:masters signed by CN=k3s-client-ca@1790759480: notBefore=2026-09-30 08:11:20 +0000 UTC notAfter=2027-09-30 08:11:20 +0000 UTC" machine # [ 15.622675] k3s[870]: time="2026-09-30T09:11:20Z" level=info msg="certificate CN=k3s-cloud-controller-manager signed by CN=k3s-client-ca@1790759480: notBefore=2026-09-30 08:11:20 +0000 UTC notAfter=2027-09-30 08:11:20 +0000 UTC" machine # [ 15.623588] k3s[870]: time="2026-09-30T09:11:20Z" level=info msg="generated self-signed CA certificate CN=k3s-server-ca@1790759480: notBefore=2026-09-30 08:11:20.505870856 +0000 UTC notAfter=2036-09-27 08:11:20.505870856 +0000 UTC" machine # [ 15.624526] k3s[870]: time="2026-09-30T09:11:20Z" level=info msg="certificate CN=kube-apiserver signed by CN=k3s-server-ca@1790759480: notBefore=2026-09-30 08:11:20 +0000 UTC notAfter=2027-09-30 08:11:20 +0000 UTC" machine # [ 15.625332] k3s[870]: time="2026-09-30T09:11:20Z" level=info msg="certificate CN=kube-scheduler signed by CN=k3s-server-ca@1790759480: notBefore=2026-09-30 08:11:20 +0000 UTC notAfter=2027-09-30 08:11:20 +0000 UTC" machine # [ 15.626133] k3s[870]: time="2026-09-30T09:11:20Z" level=info msg="certificate CN=kube-controller-manager signed by CN=k3s-server-ca@1790759480: notBefore=2026-09-30 08:11:20 +0000 UTC notAfter=2027-09-30 08:11:20 +0000 UTC" machine # [ 15.626799] k3s[870]: time="2026-09-30T09:11:20Z" level=info msg="generated self-signed CA certificate CN=k3s-request-header-ca@1790759480: notBefore=2026-09-30 08:11:20.509659047 +0000 UTC notAfter=2036-09-27 08:11:20.509659047 +0000 UTC" machine # [ 15.627745] k3s[870]: time="2026-09-30T09:11:20Z" level=info msg="certificate CN=system:auth-proxy signed by CN=k3s-request-header-ca@1790759480: notBefore=2026-09-30 08:11:20 +0000 UTC notAfter=2027-09-30 08:11:20 +0000 UTC" machine # [ 15.628624] k3s[870]: time="2026-09-30T09:11:20Z" level=info msg="generated self-signed CA certificate CN=etcd-server-ca@1790759480: notBefore=2026-09-30 08:11:20.511025981 +0000 UTC notAfter=2036-09-27 08:11:20.511025981 +0000 UTC" machine # [ 15.629563] k3s[870]: time="2026-09-30T09:11:20Z" level=info msg="certificate CN=etcd-client signed by CN=etcd-server-ca@1790759480: notBefore=2026-09-30 08:11:20 +0000 UTC notAfter=2027-09-30 08:11:20 +0000 UTC" machine # [ 15.630294] k3s[870]: time="2026-09-30T09:11:20Z" level=info msg="generated self-signed CA certificate CN=etcd-peer-ca@1790759480: notBefore=2026-09-30 08:11:20.512406044 +0000 UTC notAfter=2036-09-27 08:11:20.512406044 +0000 UTC" machine # [ 15.630942] k3s[870]: time="2026-09-30T09:11:20Z" level=info msg="certificate CN=etcd-peer signed by CN=etcd-peer-ca@1790759480: notBefore=2026-09-30 08:11:20 +0000 UTC notAfter=2027-09-30 08:11:20 +0000 UTC" machine # [ 15.631716] k3s[870]: time="2026-09-30T09:11:20Z" level=info msg="certificate CN=etcd-server signed by CN=etcd-server-ca@1790759480: notBefore=2026-09-30 08:11:20 +0000 UTC notAfter=2027-09-30 08:11:20 +0000 UTC" machine # [ 15.666180] k3s[870]: time="2026-09-30T09:11:20Z" level=info msg="certificate CN=k3s,O=k3s signed by CN=k3s-server-ca@1790759480: notBefore=2026-09-30 08:11:20 +0000 UTC notAfter=2027-09-30 08:11:20 +0000 UTC" machine # [ 15.668957] k3s[870]: time="2026-09-30T09:11:20Z" level=warning msg="dynamiclistener [::]:6443: no cached certificate available for preload - deferring certificate load until storage initialization or first client request" machine # [ 15.672526] k3s[870]: time="2026-09-30T09:11:20Z" level=info msg="Active TLS secret / (ver=) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__1873_b5ec_892e_bb88-3d2320:fec0::1873:b5ec:892e:bb88 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=584B51703DEFA62DFC2649273AB9B1C79A2BB89C]" machine # [ 16.639921] k3s[870]: time="2026-09-30T09:11:21Z" level=info msg="Password verified locally for node machine" machine # [ 16.640856] k3s[870]: time="2026-09-30T09:11:21Z" level=info msg="certificate CN=machine signed by CN=k3s-server-ca@1790759480: notBefore=2026-09-30 08:11:21 +0000 UTC notAfter=2027-09-30 08:11:21 +0000 UTC" machine # [ 16.889403] k3s[870]: time="2026-09-30T09:11:21Z" level=info msg="certificate CN=system:node:machine,O=system:nodes signed by CN=k3s-client-ca@1790759480: notBefore=2026-09-30 08:11:21 +0000 UTC notAfter=2027-09-30 08:11:21 +0000 UTC" machine # [ 16.990387] k3s[870]: time="2026-09-30T09:11:21Z" level=info msg="certificate CN=system:kube-proxy signed by CN=k3s-client-ca@1790759480: notBefore=2026-09-30 08:11:21 +0000 UTC notAfter=2027-09-30 08:11:21 +0000 UTC" machine # [ 17.093716] k3s[870]: time="2026-09-30T09:11:21Z" level=info msg="certificate CN=system:k3s-controller signed by CN=k3s-client-ca@1790759480: notBefore=2026-09-30 08:11:21 +0000 UTC notAfter=2027-09-30 08:11:21 +0000 UTC" machine # [ 17.206286] k3s[870]: time="2026-09-30T09:11:22Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:37060: runtime core not ready" machine # [ 17.303695] k3s[870]: time="2026-09-30T09:11:22Z" level=info msg="Module overlay was already loaded" machine # [ 17.546366] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. machine # [ 17.550913] Bridge firewalling registered machine # [ 17.406945] k3s[870]: time="2026-09-30T09:11:22Z" level=warning msg="Failed to load kernel module iptable_nat with modprobe" machine # [ 17.413863] k3s[870]: time="2026-09-30T09:11:22Z" level=warning msg="Failed to load kernel module iptable_filter with modprobe" machine # [ 17.422359] k3s[870]: time="2026-09-30T09:11:22Z" level=warning msg="Failed to load kernel module nft-expr-counter with modprobe" machine # [ 17.479169] k3s[870]: time="2026-09-30T09:11:22Z" level=info msg="Set sysctl 'net/ipv4/conf/all/forwarding' to 1" machine # [ 17.480887] k3s[870]: time="2026-09-30T09:11:22Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_max' to 131072" machine # [ 17.482641] k3s[870]: time="2026-09-30T09:11:22Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400" machine # [ 17.484640] k3s[870]: time="2026-09-30T09:11:22Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600" machine # [ 17.486663] k3s[870]: time="2026-09-30T09:11:22Z" level=info msg="Connecting to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 17.488533] k3s[870]: time="2026-09-30T09:11:22Z" level=info msg="Creating k3s-cert-monitor event broadcaster" machine # [ 17.490341] k3s[870]: time="2026-09-30T09:11:22Z" level=info msg="Saving cluster bootstrap data to datastore" machine # [ 17.491953] k3s[870]: time="2026-09-30T09:11:22Z" level=info msg="Connection to etcd is ready" machine # [ 17.493394] k3s[870]: time="2026-09-30T09:11:22Z" level=info msg="ETCD server is now running" machine # [ 17.494843] k3s[870]: time="2026-09-30T09:11:22Z" level=info msg="Polling for API server readiness: GET /readyz failed: the server is currently unable to handle the request" machine # [ 17.497258] k3s[870]: time="2026-09-30T09:11:22Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 17.499150] k3s[870]: time="2026-09-30T09:11:22Z" level=info msg="Handling backend connection request [machine]" machine # [ 17.500796] k3s[870]: time="2026-09-30T09:11:22Z" level=info msg="Connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 17.502601] k3s[870]: time="2026-09-30T09:11:22Z" level=info msg="Remotedialer connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 17.504597] k3s[870]: time="2026-09-30T09:11:22Z" level=info msg="Running kube-apiserver --advertise-port=6443 --allow-privileged=true --anonymous-auth=false --api-audiences=https://kubernetes.default.svc.cluster.local,k3s --authorization-mode=Node,RBAC --bind-address=127.0.0.1 --cert-dir=/var/lib/rancher/k3s/server/tls/temporary-certs --client-ca-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --egress-selector-config-file=/var/lib/rancher/k3s/server/etc/egress-selector-config.yaml --enable-admission-plugins=NodeRestriction --enable-aggregator-routing=true --enable-bootstrap-token-auth=true --etcd-servers=unix://kine.sock --kubelet-certificate-authority=/var/lib/rancher/k3s/server/tls/server-ca.crt --kubelet-client-certificate=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.crt --kubelet-client-key=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.key --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --profiling=false --proxy-client-cert-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt --proxy-client-key-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.key --requestheader-allowed-names=system:auth-proxy --requestheader-client-ca-file=/var/lib/rancher/k3s/server/tls/request-header-ca.crt --requestheader-extra-headers-prefix=X-Remote-Extra- --requestheader-group-headers=X-Remote-Group --requestheader-username-headers=X-Remote-User --secure-port=6444 --service-account-issuer=https://kubernetes.default.svc.cluster.local --service-account-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-account-signing-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --storage-backend=etcd3 --tls-cert-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --tls-private-key-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 17.531122] k3s[870]: time="2026-09-30T09:11:22Z" level=info msg="Running kube-scheduler --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --bind-address=127.0.0.1 --kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --leader-elect=false --profiling=false --secure-port=10259 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 17.538339] k3s[870]: time="2026-09-30T09:11:22Z" level=info msg="Running kube-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --bind-address=127.0.0.1 --cluster-cidr=10.42.0.0/16 --cluster-signing-kube-apiserver-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kube-apiserver-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kubelet-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-serving-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-kubelet-serving-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --cluster-signing-legacy-unknown-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-legacy-unknown-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --configure-cloud-routes=false --controllers=*,tokencleaner,-service,-route,-cloud-node-lifecycle --kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --leader-elect=false --profiling=false --root-ca-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --secure-port=10257 --service-account-private-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key --use-service-account-credentials=true" machine # [ 17.557866] k3s[870]: time="2026-09-30T09:11:22Z" level=info msg="Running cloud-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --bind-address=127.0.0.1 --cloud-config=/var/lib/rancher/k3s/server/etc/cloud-config.yaml --cloud-provider=k3s --cluster-cidr=10.42.0.0/16 --configure-cloud-routes=false --controllers=*,-route --kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --leader-elect=false --leader-elect-resource-name=k3s-cloud-controller-manager --node-status-update-frequency=1m0s --profiling=false" machine # [ 17.565117] k3s[870]: time="2026-09-30T09:11:22Z" level=info msg="Server node token is available at /var/lib/rancher/k3s/server/token" machine # [ 17.566628] k3s[870]: I0930 09:11:22.376707 870 options.go:263] external host was not specified, using 10.0.2.15 machine # [ 17.567961] k3s[870]: time="2026-09-30T09:11:22Z" level=info msg="To join server node to cluster: k3s server -s https://10.0.2.15:6443 -t ${SERVER_NODE_TOKEN}" machine # [ 17.569760] k3s[870]: time="2026-09-30T09:11:22Z" level=info msg="Agent node token is available at /var/lib/rancher/k3s/server/agent-token" machine # [ 17.571365] k3s[870]: time="2026-09-30T09:11:22Z" level=info msg="To join agent node to cluster: k3s agent -s https://10.0.2.15:6443 -t ${AGENT_NODE_TOKEN}" machine # [ 17.573167] k3s[870]: time="2026-09-30T09:11:22Z" level=info msg="Wrote kubeconfig /etc/rancher/k3s/k3s.yaml" machine # [ 17.574460] k3s[870]: time="2026-09-30T09:11:22Z" level=info msg="Run: k3s kubectl" machine # [ 17.575481] k3s[870]: I0930 09:11:22.378546 870 server.go:158] Version: v1.36.4+k3s1 machine # [ 17.576549] k3s[870]: I0930 09:11:22.378570 870 server.go:160] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 17.577925] k3s[870]: time="2026-09-30T09:11:22Z" level=info msg="Logging containerd to /var/lib/rancher/k3s/agent/containerd/containerd.log" machine # [ 17.579530] k3s[870]: time="2026-09-30T09:11:22Z" level=info msg="Running containerd -c /var/lib/rancher/k3s/agent/etc/containerd/config.toml" machine # [ 17.581178] k3s[870]: E0930 09:11:22.460530 870 options.go:205] The manifest file is empty, ignoring. machine # [ 17.582417] k3s[870]: I0930 09:11:22.460857 870 shared_informer.go:381] "Waiting for caches to sync" controller="node_authorizer" machine # [ 17.583926] k3s[870]: I0930 09:11:22.467800 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 17.589363] k3s[870]: I0930 09:11:22.470743 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 17.590655] k3s[870]: I0930 09:11:22.471191 870 plugins.go:157] Loaded 15 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,PodGroupProtection,RuntimeClass,DefaultIngressClass,PodTopologyLabels,MutatingAdmissionPolicy,MutatingAdmissionWebhook. machine # [ 17.595172] k3s[870]: I0930 09:11:22.471279 870 plugins.go:160] Loaded 17 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,PodGroupWorkloadExists,NodeDeclaredFeatureValidator,JobValidation,PodResizeValidator,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. machine # [ 17.600158] k3s[870]: I0930 09:11:22.471597 870 instance.go:240] Using reconciler: lease machine # [ 17.601303] k3s[870]: time="2026-09-30T09:11:22Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:37110: runtime core not ready" machine # [ 17.602879] k3s[870]: I0930 09:11:22.477631 870 handler.go:304] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager machine # [ 17.604393] k3s[870]: W0930 09:11:22.477650 870 genericapiserver.go:798] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. machine # [ 17.606076] k3s[870]: I0930 09:11:22.480153 870 cidrallocator.go:198] starting ServiceCIDR Allocator Controller machine # [ 17.641265] k3s[870]: I0930 09:11:22.524964 870 handler.go:304] Adding GroupVersion v1 to ResourceManager machine # [ 17.642840] k3s[870]: I0930 09:11:22.525163 870 apis.go:112] API group "internal.apiserver.k8s.io" is not enabled, skipping. machine # [ 17.670418] k3s[870]: I0930 09:11:22.554415 870 apis.go:112] API group "storagemigration.k8s.io" is not enabled, skipping. machine # [ 17.696100] k3s[870]: time="2026-09-30T09:11:22Z" level=info msg="Running kube-proxy --cluster-cidr=10.42.0.0/16 --conntrack-max-per-core=0 --conntrack-tcp-timeout-close-wait=0s --conntrack-tcp-timeout-established=0s --healthz-bind-address=127.0.0.1 --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubeproxy.kubeconfig --proxy-mode=iptables" machine # [ 17.700556] k3s[870]: I0930 09:11:22.584614 870 handler.go:304] Adding GroupVersion authentication.k8s.io v1 to ResourceManager machine # [ 17.700878] k3s[870]: W0930 09:11:22.584960 870 genericapiserver.go:798] Skipping API authentication.k8s.io/v1beta1 because it has no resources. machine # [ 17.701529] k3s[870]: W0930 09:11:22.585613 870 genericapiserver.go:798] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. machine # [ 17.702300] k3s[870]: I0930 09:11:22.586374 870 handler.go:304] Adding GroupVersion authorization.k8s.io v1 to ResourceManager machine # [ 17.702934] k3s[870]: W0930 09:11:22.586945 870 genericapiserver.go:798] Skipping API authorization.k8s.io/v1beta1 because it has no resources. machine # [ 17.703510] k3s[870]: I0930 09:11:22.587569 870 handler.go:304] Adding GroupVersion autoscaling v2 to ResourceManager machine # [ 17.703896] k3s[870]: I0930 09:11:22.587944 870 handler.go:304] Adding GroupVersion autoscaling v1 to ResourceManager machine # [ 17.704570] k3s[870]: I0930 09:11:22.588633 870 handler.go:304] Adding GroupVersion batch v1 to ResourceManager machine # [ 17.704995] k3s[870]: W0930 09:11:22.588655 870 genericapiserver.go:798] Skipping API batch/v1beta1 because it has no resources. machine # [ 17.705678] k3s[870]: I0930 09:11:22.589049 870 handler.go:304] Adding GroupVersion certificates.k8s.io v1 to ResourceManager machine # [ 17.706188] k3s[870]: W0930 09:11:22.589064 870 genericapiserver.go:798] Skipping API certificates.k8s.io/v1beta1 because it has no resources. machine # [ 17.706632] k3s[870]: W0930 09:11:22.589075 870 genericapiserver.go:798] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. machine # [ 17.707192] k3s[870]: I0930 09:11:22.589366 870 handler.go:304] Adding GroupVersion coordination.k8s.io v1 to ResourceManager machine # [ 17.707617] k3s[870]: W0930 09:11:22.589382 870 genericapiserver.go:798] Skipping API coordination.k8s.io/v1beta1 because it has no resources. machine # [ 17.708132] k3s[870]: W0930 09:11:22.589392 870 genericapiserver.go:798] Skipping API coordination.k8s.io/v1alpha2 because it has no resources. machine # [ 17.708580] k3s[870]: I0930 09:11:22.589681 870 handler.go:304] Adding GroupVersion discovery.k8s.io v1 to ResourceManager machine # [ 17.709155] k3s[870]: W0930 09:11:22.589696 870 genericapiserver.go:798] Skipping API discovery.k8s.io/v1beta1 because it has no resources. machine # [ 17.709579] k3s[870]: I0930 09:11:22.590804 870 handler.go:304] Adding GroupVersion networking.k8s.io v1 to ResourceManager machine # [ 17.710048] k3s[870]: W0930 09:11:22.590822 870 genericapiserver.go:798] Skipping API networking.k8s.io/v1beta1 because it has no resources. machine # [ 17.710525] k3s[870]: I0930 09:11:22.591072 870 handler.go:304] Adding GroupVersion node.k8s.io v1 to ResourceManager machine # [ 17.710987] k3s[870]: W0930 09:11:22.591087 870 genericapiserver.go:798] Skipping API node.k8s.io/v1beta1 because it has no resources. machine # [ 17.711646] k3s[870]: W0930 09:11:22.591097 870 genericapiserver.go:798] Skipping API node.k8s.io/v1alpha1 because it has no resources. machine # [ 17.712166] k3s[870]: I0930 09:11:22.592363 870 handler.go:304] Adding GroupVersion policy v1 to ResourceManager machine # [ 17.712629] k3s[870]: W0930 09:11:22.592381 870 genericapiserver.go:798] Skipping API policy/v1beta1 because it has no resources. machine # [ 17.713187] k3s[870]: I0930 09:11:22.593956 870 handler.go:304] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager machine # [ 17.713616] k3s[870]: W0930 09:11:22.593976 870 genericapiserver.go:798] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. machine # [ 17.714143] k3s[870]: W0930 09:11:22.593987 870 genericapiserver.go:798] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. machine # [ 17.714592] k3s[870]: I0930 09:11:22.594242 870 handler.go:304] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager machine # [ 17.715114] k3s[870]: W0930 09:11:22.594257 870 genericapiserver.go:798] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. machine # [ 17.715711] k3s[870]: W0930 09:11:22.594267 870 genericapiserver.go:798] Skipping API scheduling.k8s.io/v1alpha2 because it has no resources. machine # [ 17.716368] k3s[870]: I0930 09:11:22.596922 870 handler.go:304] Adding GroupVersion storage.k8s.io v1 to ResourceManager machine # [ 17.716859] k3s[870]: W0930 09:11:22.596969 870 genericapiserver.go:798] Skipping API storage.k8s.io/v1beta1 because it has no resources. machine # [ 17.717525] k3s[870]: W0930 09:11:22.596981 870 genericapiserver.go:798] Skipping API storage.k8s.io/v1alpha1 because it has no resources. machine # [ 17.717993] k3s[870]: I0930 09:11:22.601104 870 handler.go:304] Adding GroupVersion flowcontrol.apiserver.k8s.io v1 to ResourceManager machine # [ 17.718484] k3s[870]: W0930 09:11:22.601146 870 genericapiserver.go:798] Skipping API flowcontrol.apiserver.k8s.io/v1beta3 because it has no resources. machine # [ 17.718947] k3s[870]: W0930 09:11:22.601157 870 genericapiserver.go:798] Skipping API flowcontrol.apiserver.k8s.io/v1beta2 because it has no resources. machine # [ 17.719609] k3s[870]: W0930 09:11:22.601167 870 genericapiserver.go:798] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. machine # [ 17.723738] k3s[870]: I0930 09:11:22.607796 870 handler.go:304] Adding GroupVersion apps v1 to ResourceManager machine # [ 17.724545] k3s[870]: W0930 09:11:22.608567 870 genericapiserver.go:798] Skipping API apps/v1beta2 because it has no resources. machine # [ 17.724968] k3s[870]: W0930 09:11:22.608613 870 genericapiserver.go:798] Skipping API apps/v1beta1 because it has no resources. machine # [ 17.732575] k3s[870]: I0930 09:11:22.616584 870 handler.go:304] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager machine # [ 17.733180] k3s[870]: W0930 09:11:22.616611 870 genericapiserver.go:798] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. machine # [ 17.733606] k3s[870]: W0930 09:11:22.616623 870 genericapiserver.go:798] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. machine # [ 17.734137] k3s[870]: I0930 09:11:22.617476 870 handler.go:304] Adding GroupVersion events.k8s.io v1 to ResourceManager machine # [ 17.734588] k3s[870]: W0930 09:11:22.617492 870 genericapiserver.go:798] Skipping API events.k8s.io/v1beta1 because it has no resources. machine # [ 17.736078] k3s[870]: I0930 09:11:22.620144 870 handler.go:304] Adding GroupVersion resource.k8s.io v1 to ResourceManager machine # [ 17.736534] k3s[870]: W0930 09:11:22.620166 870 genericapiserver.go:798] Skipping API resource.k8s.io/v1beta2 because it has no resources. machine # [ 17.737024] k3s[870]: W0930 09:11:22.620177 870 genericapiserver.go:798] Skipping API resource.k8s.io/v1beta1 because it has no resources. machine # [ 17.737532] k3s[870]: W0930 09:11:22.620187 870 genericapiserver.go:798] Skipping API resource.k8s.io/v1alpha3 because it has no resources. machine # [ 17.739497] k3s[870]: I0930 09:11:22.623552 870 handler.go:304] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager machine # [ 17.739903] k3s[870]: W0930 09:11:22.623577 870 genericapiserver.go:798] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. machine # [ 18.090648] k3s[870]: I0930 09:11:22.974574 870 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 18.090869] k3s[870]: I0930 09:11:22.974619 870 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 18.091508] k3s[870]: I0930 09:11:22.974759 870 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 18.096909] k3s[870]: I0930 09:11:22.974836 870 secure_serving.go:214] Serving securely on 127.0.0.1:6444 machine # [ 18.097530] k3s[870]: I0930 09:11:22.974957 870 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 18.097957] k3s[870]: I0930 09:11:22.981239 870 apiservice_controller.go:100] Starting APIServiceRegistrationController machine # [ 18.098606] k3s[870]: I0930 09:11:22.981259 870 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller machine # [ 18.099143] k3s[870]: I0930 09:11:22.981339 870 remote_available_controller.go:434] Starting RemoteAvailability controller machine # [ 18.099572] k3s[870]: I0930 09:11:22.981351 870 cache.go:32] Waiting for caches to sync for RemoteAvailability controller machine # [ 18.100117] k3s[870]: I0930 09:11:22.981667 870 storage_readiness_hook.go:70] Storage is ready for all registered resources machine # [ 18.100552] k3s[870]: I0930 09:11:22.981728 870 local_available_controller.go:156] Starting LocalAvailability controller machine # [ 18.101064] k3s[870]: I0930 09:11:22.981738 870 cache.go:32] Waiting for caches to sync for LocalAvailability controller machine # [ 18.101521] k3s[870]: I0930 09:11:22.981846 870 aggregator.go:185] waiting for initial CRD sync... machine # [ 18.101985] k3s[870]: I0930 09:11:22.982310 870 crdregistration_controller.go:114] Starting crd-autoregister controller machine # [ 18.102646] k3s[870]: I0930 09:11:22.982325 870 shared_informer.go:381] "Waiting for caches to sync" controller="crd-autoregister" machine # [ 18.113202] k3s[870]: I0930 09:11:22.997256 870 system_namespaces_controller.go:66] Starting system namespaces controller machine # [ 18.113492] k3s[870]: I0930 09:11:22.997318 870 controller.go:87] "Starting OpenAPI AggregationController" machine # [ 18.115801] k3s[870]: I0930 09:11:22.999863 870 controller.go:89] "Starting OpenAPI V3 AggregationController" machine # [ 18.117347] k3s[870]: I0930 09:11:23.001402 870 customresource_discovery_controller.go:294] Starting DiscoveryController machine # [ 18.118885] k3s[870]: time="2026-09-30T09:11:23Z" level=info msg="Starting apiserver lease garbage collector" logger=k3s machine # [ 18.119490] k3s[870]: time="2026-09-30T09:11:23Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 18.121390] k3s[870]: I0930 09:11:23.005439 870 dynamic_serving_content.go:135] "Starting controller" name="aggregator-proxy-cert::/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt::/var/lib/rancher/k3s/server/tls/client-auth-proxy.key" machine # [ 18.126860] k3s[870]: I0930 09:11:23.008418 870 cluster_authentication_trust_controller.go:459] Starting cluster_authentication_trust_controller controller machine # [ 18.127190] k3s[870]: time="2026-09-30T09:11:23Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 18.127645] k3s[870]: I0930 09:11:23.008498 870 controller.go:113] "Deleting old lease on startup" lease="kube-system/apiserver-ik4pcwfs7qgdl76byc4pomgvia" machine # [ 18.128181] k3s[870]: time="2026-09-30T09:11:23Z" level=info msg="Starting legacy_token_tracking_controller" logger=k3s machine # [ 18.128630] k3s[870]: time="2026-09-30T09:11:23Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 18.129193] k3s[870]: I0930 09:11:23.009016 870 apf_controller.go:377] Starting API Priority and Fairness config controller machine # [ 18.129614] k3s[870]: I0930 09:11:23.009161 870 controller.go:142] Starting OpenAPI controller machine # [ 18.130132] k3s[870]: I0930 09:11:23.009242 870 controller.go:90] Starting OpenAPI V3 controller machine # [ 18.130588] k3s[870]: I0930 09:11:23.009270 870 naming_controller.go:305] Starting NamingConditionController machine # [ 18.131131] k3s[870]: I0930 09:11:23.009320 870 nonstructuralschema_controller.go:202] Starting NonStructuralSchemaConditionController machine # [ 18.131555] k3s[870]: I0930 09:11:23.009349 870 apiapproval_controller.go:196] Starting KubernetesAPIApprovalPolicyConformantConditionController machine # [ 18.137038] k3s[870]: time="2026-09-30T09:11:23Z" level=info msg="Starting CRDFinalizer" logger=k3s machine # [ 18.137698] k3s[870]: I0930 09:11:23.009824 870 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 18.138203] k3s[870]: I0930 09:11:23.009897 870 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 18.138652] k3s[870]: I0930 09:11:23.010380 870 repairip.go:210] Starting ipallocator-repair-controller machine # [ 18.139188] k3s[870]: I0930 09:11:23.010394 870 shared_informer.go:381] "Waiting for caches to sync" controller="ipallocator-repair-controller" machine # [ 18.139642] k3s[870]: time="2026-09-30T09:11:23Z" level=info msg=Starting controller=kubernetes-service-cidr-controller logger=k3s machine # [ 18.140154] k3s[870]: time="2026-09-30T09:11:23Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 18.177188] k3s[870]: I0930 09:11:23.061202 870 shared_informer.go:388] "Caches are synced" controller="node_authorizer" machine # [ 18.184487] k3s[870]: I0930 09:11:23.068537 870 shared_informer.go:409] "Caches are synced" machine # [ 18.184891] k3s[870]: I0930 09:11:23.068571 870 policy_source.go:248] refreshing policies machine # [ 18.187843] k3s[870]: I0930 09:11:23.071893 870 shared_informer.go:409] "Caches are synced" machine # [ 18.188435] k3s[870]: I0930 09:11:23.071921 870 policy_source.go:248] refreshing policies machine # [ 18.197722] k3s[870]: I0930 09:11:23.081722 870 cache.go:39] Caches are synced for RemoteAvailability controller machine # [ 18.197937] k3s[870]: I0930 09:11:23.081808 870 cache.go:39] Caches are synced for LocalAvailability controller machine # [ 18.198547] k3s[870]: I0930 09:11:23.081888 870 cache.go:39] Caches are synced for APIServiceRegistrationController controller machine # [ 18.198983] k3s[870]: I0930 09:11:23.081938 870 handler_discovery.go:459] Starting ResourceDiscoveryManager machine # [ 18.199665] k3s[870]: I0930 09:11:23.083039 870 shared_informer.go:388] "Caches are synced" controller="crd-autoregister" machine # [ 18.200183] k3s[870]: I0930 09:11:23.083137 870 aggregator.go:187] initial CRD sync complete... machine # [ 18.200630] k3s[870]: I0930 09:11:23.083151 870 autoregister_controller.go:144] Starting autoregister controller machine # [ 18.201165] k3s[870]: I0930 09:11:23.083162 870 cache.go:32] Waiting for caches to sync for autoregister controller machine # [ 18.201620] k3s[870]: I0930 09:11:23.083173 870 cache.go:39] Caches are synced for autoregister controller machine # [ 18.219022] k3s[870]: time="2026-09-30T09:11:23Z" level=info msg="Caches are synced" logger=k3s machine # [ 18.224454] k3s[870]: time="2026-09-30T09:11:23Z" level=info msg="Caches are synced" logger=k3s machine # [ 18.224872] k3s[870]: time="2026-09-30T09:11:23Z" level=info msg="Caches are synced" logger=k3s machine # [ 18.225549] k3s[870]: I0930 09:11:23.109074 870 apf_controller.go:382] Running API Priority and Fairness config worker machine # [ 18.226026] k3s[870]: I0930 09:11:23.109087 870 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process machine # [ 18.226703] k3s[870]: I0930 09:11:23.110767 870 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io machine # [ 18.227218] k3s[870]: time="2026-09-30T09:11:23Z" level=info msg="Caches are synced" logger=k3s machine # [ 18.227663] k3s[870]: time="2026-09-30T09:11:23Z" level=info msg="Creating default ServiceCIDR" CIDRs="[10.43.0.0/16]" logger=k3s machine # [ 18.228215] k3s[870]: I0930 09:11:23.111481 870 shared_informer.go:388] "Caches are synced" controller="ipallocator-repair-controller" machine # [ 18.238544] k3s[870]: I0930 09:11:23.122596 870 cidrallocator.go:302] created ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 18.239629] k3s[870]: time="2026-09-30T09:11:23Z" level=info msg="Setting default ServiceCIDR condition Ready to True" logger=k3s machine # [ 18.243993] k3s[870]: time="2026-09-30T09:11:23Z" level=info msg="Setting default ServiceCIDR condition Ready to True" logger=k3s machine # [ 18.246464] k3s[870]: I0930 09:11:23.130533 870 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 18.278054] k3s[870]: I0930 09:11:23.162038 870 alloc.go:329] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.43.0.1"} machine # [ 18.285652] k3s[870]: W0930 09:11:23.169704 870 lease.go:265] Resetting endpoints for master service "kubernetes" to [10.0.2.15] machine # [ 18.290060] k3s[870]: I0930 09:11:23.172566 870 controller.go:667] quota admission added evaluator for: endpoints machine # [ 18.292873] k3s[870]: I0930 09:11:23.176924 870 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io machine # [ 18.299114] k3s[870]: E0930 09:11:23.183101 870 controller.go:102] Error removing old endpoints from kubernetes service: no API server IP addresses were listed in storage, refusing to erase all endpoints for the kubernetes Service machine # [ 18.510621] k3s[870]: time="2026-09-30T09:11:23Z" level=info msg="containerd is now running" machine # [ 18.522282] k3s[870]: time="2026-09-30T09:11:23Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/8clys13yd1km13hrr4mr8gfrg2jykx08-nix-grpc-farm.tar" machine # [ 19.110274] k3s[870]: I0930 09:11:23.993908 870 storage_scheduling.go:137] created PriorityClass system-node-critical with value 2000001000 machine # [ 19.118251] k3s[870]: I0930 09:11:24.002278 870 storage_scheduling.go:137] created PriorityClass system-cluster-critical with value 2000000000 machine # [ 19.119991] k3s[870]: I0930 09:11:24.002326 870 storage_scheduling.go:153] all system priority classes are created successfully or already exist. machine # [ 19.488935] k3s[870]: time="2026-09-30T09:11:24Z" level=info msg="Polling for API server readiness: GET /readyz failed: unknown" machine # [ 20.231141] k3s[870]: I0930 09:11:25.114792 870 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io machine # [ 20.272878] k3s[870]: I0930 09:11:25.156913 870 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io machine # [ 21.494309] k3s[870]: time="2026-09-30T09:11:26Z" level=info msg="Kube API server is now running" machine # [ 21.494502] k3s[870]: time="2026-09-30T09:11:26Z" level=info msg="k3s is up and running" machine # [ 21.495659] k3s[870]: time="2026-09-30T09:11:26Z" level=info msg="Waiting for untainted node" machine # [ 21.497100] k3s[870]: time="2026-09-30T09:11:26Z" level=info msg="Creating k3s-supervisor event broadcaster" machine # [ 21.497948] systemd[1]: Started k3s service. machine # [ 21.504832] systemd[1]: Starting niks3 server... machine # [ 21.506765] k3s[870]: time="2026-09-30T09:11:26Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Node and Certificate Authority certificates managed by k3s are OK" object=machine reason=CertificateExpirationOK type=Normal machine # [ 21.514491] k3s[870]: E0930 09:11:26.398541 870 options.go:205] The manifest file is empty, ignoring. machine # [ 21.514736] k3s[870]: I0930 09:11:26.398797 870 controllermanager.go:204] "Starting" version="v1.36.4+k3s1" machine # [ 21.516494] k3s[870]: I0930 09:11:26.398817 870 controllermanager.go:206] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 21.519986] k3s[870]: I0930 09:11:26.404040 870 secure_serving.go:214] Serving securely on 127.0.0.1:10257 machine # [ 21.520695] k3s[870]: I0930 09:11:26.404082 870 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 21.521209] k3s[870]: I0930 09:11:26.404147 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 21.521653] k3s[870]: I0930 09:11:26.404190 870 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 21.523076] k3s[870]: I0930 09:11:26.404243 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 21.523628] k3s[870]: I0930 09:11:26.404271 870 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 21.524165] k3s[870]: I0930 09:11:26.404284 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 21.524647] k3s[870]: I0930 09:11:26.406502 870 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 21.525593] k3s[870]: I0930 09:11:26.406680 870 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key" machine # [ 21.538201] k3s[870]: I0930 09:11:26.422244 870 controller.go:667] quota admission added evaluator for: serviceaccounts machine # [ 21.540731] k3s[870]: I0930 09:11:26.424647 870 controllermanager.go:689] "Warning: controller is disabled" controller="node-route-controller" machine # [ 21.585023] k3s[870]: I0930 09:11:26.468917 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 21.589317] k3s[870]: I0930 09:11:26.473343 870 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="limitranges" machine # [ 21.590042] k3s[870]: I0930 09:11:26.473419 870 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="cronjobs.batch" machine # [ 21.590598] k3s[870]: I0930 09:11:26.473445 870 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="leases.coordination.k8s.io" machine # [ 21.591598] k3s[870]: I0930 09:11:26.473519 870 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="statefulsets.apps" machine # [ 21.592339] k3s[870]: I0930 09:11:26.473549 870 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="podtemplates" machine # [ 21.592968] k3s[870]: I0930 09:11:26.473574 870 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="daemonsets.apps" machine # [ 21.593835] k3s[870]: I0930 09:11:26.473607 870 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="csistoragecapacities.storage.k8s.io" machine # [ 21.594684] k3s[870]: I0930 09:11:26.473634 870 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="resourceclaimtemplates.resource.k8s.io" machine # [ 21.595238] k3s[870]: I0930 09:11:26.473670 870 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="rolebindings.rbac.authorization.k8s.io" machine # [ 21.595687] k3s[870]: I0930 09:11:26.473708 870 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpointslices.discovery.k8s.io" machine # [ 21.596226] k3s[870]: I0930 09:11:26.473755 870 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpoints" machine # [ 21.596675] k3s[870]: I0930 09:11:26.473781 870 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="deployments.apps" machine # [ 21.597214] k3s[870]: I0930 09:11:26.473806 870 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="horizontalpodautoscalers.autoscaling" machine # [ 21.597646] k3s[870]: I0930 09:11:26.473832 870 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="ingresses.networking.k8s.io" machine # [ 21.598181] k3s[870]: I0930 09:11:26.473868 870 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="serviceaccounts" machine # [ 21.598628] k3s[870]: I0930 09:11:26.473891 870 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="replicasets.apps" machine # [ 21.599137] k3s[870]: I0930 09:11:26.473915 870 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="controllerrevisions.apps" machine # [ 21.599637] k3s[870]: I0930 09:11:26.473939 870 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="networkpolicies.networking.k8s.io" machine # [ 21.600164] k3s[870]: I0930 09:11:26.473969 870 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="poddisruptionbudgets.policy" machine # [ 21.600657] k3s[870]: I0930 09:11:26.473993 870 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="roles.rbac.authorization.k8s.io" machine # [ 21.601178] k3s[870]: I0930 09:11:26.474051 870 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="jobs.batch" machine # [ 21.614069] k3s[870]: time="2026-09-30T09:11:26Z" level=info msg="Creating embedded CRD addons.k3s.cattle.io" machine # [ 21.618312] k3s[870]: time="2026-09-30T09:11:26Z" level=info msg="Creating embedded CRD etcdsnapshotfiles.k3s.cattle.io" machine # [ 21.620628] k3s[870]: I0930 09:11:26.504695 870 shared_informer.go:409] "Caches are synced" machine # [ 21.621573] k3s[870]: I0930 09:11:26.505657 870 shared_informer.go:409] "Caches are synced" machine # [ 21.622099] k3s[870]: I0930 09:11:26.506175 870 shared_informer.go:409] "Caches are synced" machine # [ 21.626055] k3s[870]: time="2026-09-30T09:11:26Z" level=info msg="Creating embedded CRD helmchartconfigs.helm.cattle.io" machine # [ 21.630722] k3s[870]: time="2026-09-30T09:11:26Z" level=info msg="Creating embedded CRD helmcharts.helm.cattle.io" machine # [ 21.634717] k3s[870]: I0930 09:11:26.518737 870 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 21.649895] k3s[870]: I0930 09:11:26.533948 870 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 21.653794] k3s[870]: I0930 09:11:26.537691 870 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="storageversion-garbage-collector-controller" requiredFeatureGates=["APIServerIdentity","StorageVersionAPI"] machine # [ 21.654141] k3s[870]: I0930 09:11:26.537877 870 controllermanager.go:641] "Warning: skipping controller" controller="storageversion-garbage-collector-controller" machine # [ 21.660248] k3s[870]: time="2026-09-30T09:11:26Z" level=info msg="Waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 21.670306] k3s[870]: I0930 09:11:26.554354 870 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 21.687457] k3s[870]: I0930 09:11:26.571516 870 shared_informer.go:409] "Caches are synced" machine # [ 21.714700] k3s[870]: I0930 09:11:26.598734 870 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 21.784121] k3s[870]: I0930 09:11:26.668058 870 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="podgroup-protection-controller" requiredFeatureGates=["GenericWorkload"] machine # [ 21.784322] k3s[870]: I0930 09:11:26.668094 870 controllermanager.go:641] "Warning: skipping controller" controller="podgroup-protection-controller" machine # [ 22.084253] k3s[870]: I0930 09:11:26.968198 870 controllermanager.go:689] "Warning: controller is disabled" controller="bootstrap-signer-controller" machine # [ 22.168775] k3s[870]: time="2026-09-30T09:11:27Z" level=info msg="Done waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 22.168986] k3s[870]: time="2026-09-30T09:11:27Z" level=info msg="Waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 22.172596] k3s[870]: time="2026-09-30T09:11:27Z" level=info msg="Done waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 22.172870] k3s[870]: time="2026-09-30T09:11:27Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-40.1.4+up40.1.0.tgz" machine # [ 22.173524] k3s[870]: time="2026-09-30T09:11:27Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-crd-40.1.4+up40.1.0.tgz" machine # [ 22.174176] k3s[870]: time="2026-09-30T09:11:27Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/ccm.yaml" machine # [ 22.174615] k3s[870]: time="2026-09-30T09:11:27Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/coredns.yaml" machine # [ 22.175176] k3s[870]: time="2026-09-30T09:11:27Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/local-storage.yaml" machine # [ 22.175617] k3s[870]: time="2026-09-30T09:11:27Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/rolebindings.yaml" machine # [ 22.176138] k3s[870]: time="2026-09-30T09:11:27Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/runtimes.yaml" machine # [ 22.176590] k3s[870]: time="2026-09-30T09:11:27Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/traefik.yaml" machine # [ 22.236578] k3s[870]: time="2026-09-30T09:11:27Z" level=info msg="Starting dynamiclistener CN filter node controller with SANs: [127.0.0.1 ::1 localhost machine 10.0.2.15 fec0::1873:b5ec:892e:bb88 10.43.0.1 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local]" machine # [ 22.236968] k3s[870]: time="2026-09-30T09:11:27Z" level=info msg="Tunnel server egress proxy mode: agent" machine: (finished: waiting for unit k3s.service, in 23.41 seconds) machine: waiting for success: kubectl get ns farm machine # [ 22.665041] k3s[870]: time="2026-09-30T09:11:27Z" level=info msg="Creating new TLS secret for kube-system/k3s-serving (count: 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__1873_b5ec_892e_bb88-3d2320:fec0::1873:b5ec:892e:bb88 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=584B51703DEFA62DFC2649273AB9B1C79A2BB89C]" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 22.687988] k3s[870]: time="2026-09-30T09:11:27Z" level=info msg="Active TLS secret kube-system/k3s-serving (ver=239) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__1873_b5ec_892e_bb88-3d2320:fec0::1873:b5ec:892e:bb88 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=584B51703DEFA62DFC2649273AB9B1C79A2BB89C]" machine # [ 23.134402] k3s[870]: I0930 09:11:28.018421 870 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="resourcepoolstatusrequest-controller" requiredFeatureGates=["DRAResourcePoolStatus"] machine # [ 23.134628] k3s[870]: I0930 09:11:28.018455 870 controllermanager.go:641] "Warning: skipping controller" controller="resourcepoolstatusrequest-controller" machine # [ 23.344460] k3s[870]: time="2026-09-30T09:11:28Z" level=info msg="Starting k3s.cattle.io/v1, Kind=Addon controller" machine # [ 23.344721] k3s[870]: time="2026-09-30T09:11:28Z" level=info msg="Creating deploy event broadcaster" machine # [ 23.347475] k3s[870]: I0930 09:11:28.231479 870 controller.go:667] quota admission added evaluator for: addons.k3s.cattle.io machine # [ 23.352635] k3s[870]: time="2026-09-30T09:11:28Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=ApplyingManifest type=Normal machine # [ 23.358722] k3s[870]: time="2026-09-30T09:11:28Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 23.360564] k3s[870]: time="2026-09-30T09:11:28Z" level=info msg="Creating helm-controller event broadcaster" machine # [ 23.363146] k3s[870]: time="2026-09-30T09:11:28Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 23.368067] k3s[870]: time="2026-09-30T09:11:28Z" level=info msg="Cluster dns configmap has been set successfully" machine # [ 23.551658] k3s[870]: time="2026-09-30T09:11:28Z" level=info msg="Imported docker.io/library/nix-grpc-farm:0.1.0-beta.4" machine # [ 23.557227] k3s[870]: time="2026-09-30T09:11:28Z" level=info msg="Tagged docker.io/library/nix-grpc-farm@sha256:1768fd77a195af867e50b9919b340e6b7d3a2817dfa11fe409454b71a1f504b6" machine # [ 23.613928] k3s[870]: time="2026-09-30T09:11:28Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=AppliedManifest type=Normal machine # [ 23.623628] k3s[870]: time="2026-09-30T09:11:28Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=ApplyingManifest type=Normal machine # Error from server (NotFound): namespaces "farm" not found machine # [ 23.977543] k3s[870]: time="2026-09-30T09:11:28Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nixos/8clys13yd1km13hrr4mr8gfrg2jykx08-nix-grpc-farm.tar in 5.454777352s" machine # [ 23.978342] k3s[870]: time="2026-09-30T09:11:28Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/if20jbcicwv9y92klzcxk35m5bcz2ql0-nix-grpc-farm-lb.tar" machine # [ 24.363076] k3s[870]: time="2026-09-30T09:11:29Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 24.611164] k3s[870]: I0930 09:11:29.494951 870 range_allocator.go:113] "No Secondary Service CIDR provided. Skipping filtering out secondary service addresses" logger="node-ipam-controller" machine # [ 24.617357] k3s[870]: I0930 09:11:29.501199 870 node_lifecycle_controller.go:402] "Controller will reconcile labels" logger="node-lifecycle-controller" machine # [ 24.617620] k3s[870]: I0930 09:11:29.501297 870 controllermanager.go:689] "Warning: controller is disabled" controller="cloud-node-lifecycle-controller" machine # [ 24.635059] k3s[870]: time="2026-09-30T09:11:29Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=AppliedManifest type=Normal machine # [ 24.647315] k3s[870]: I0930 09:11:29.531368 870 serving.go:417] Generated self-signed cert in-memory machine # [ 24.648945] k3s[870]: time="2026-09-30T09:11:29Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=ApplyingManifest type=Normal machine # [ 24.673063] k3s[870]: I0930 09:11:29.557020 870 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="podcertificaterequest-cleaner-controller" requiredFeatureGates=["PodCertificateRequest"] machine # [ 24.673373] k3s[870]: I0930 09:11:29.557048 870 controllermanager.go:641] "Warning: skipping controller" controller="podcertificaterequest-cleaner-controller" machine # [ 24.673822] k3s[870]: time="2026-09-30T09:11:29Z" level=info msg="Starting rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding controller" machine # [ 24.682052] k3s[870]: time="2026-09-30T09:11:29Z" level=info msg="Starting batch/v1, Kind=Job controller" machine # [ 24.682340] k3s[870]: time="2026-09-30T09:11:29Z" level=info msg="Starting /v1, Kind=ServiceAccount controller" machine # [ 24.683043] k3s[870]: time="2026-09-30T09:11:29Z" level=info msg="Starting /v1, Kind=Secret controller" machine # [ 24.683453] k3s[870]: time="2026-09-30T09:11:29Z" level=info msg="Starting /v1, Kind=ConfigMap controller" machine # [ 24.687046] k3s[870]: time="2026-09-30T09:11:29Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChartConfig controller" machine # [ 24.687443] k3s[870]: time="2026-09-30T09:11:29Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChart controller" machine # [ 24.691049] k3s[870]: I0930 09:11:29.574614 870 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" requiredFeatureGates=["ClusterTrustBundle"] machine # [ 24.691304] k3s[870]: I0930 09:11:29.574651 870 controllermanager.go:641] "Warning: skipping controller" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" machine # [ 24.750594] k3s[870]: I0930 09:11:29.634582 870 serving.go:417] Generated self-signed cert in-memory machine # [ 24.907389] k3s[870]: I0930 09:11:29.791388 870 controllermanager.go:163] Version: v1.36.4+k3s1 machine # [ 24.909979] k3s[870]: I0930 09:11:29.794022 870 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 24.910425] k3s[870]: I0930 09:11:29.794051 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 24.910907] k3s[870]: I0930 09:11:29.794096 870 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 24.911546] k3s[870]: I0930 09:11:29.794112 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 24.912069] k3s[870]: I0930 09:11:29.794164 870 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 24.912546] k3s[870]: I0930 09:11:29.794179 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 24.913307] k3s[870]: I0930 09:11:29.795737 870 secure_serving.go:214] Serving securely on 127.0.0.1:10258 machine # [ 24.913699] k3s[870]: I0930 09:11:29.796422 870 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 24.922068] k3s[870]: time="2026-09-30T09:11:29Z" level=info msg="Creating service-lb-controller event broadcaster" machine # [ 24.933606] k3s[870]: I0930 09:11:29.817668 870 controllermanager.go:689] "Warning: controller is disabled" controller="service-lb-controller" machine: (finished: waiting for success: kubectl get ns farm, in 2.53 seconds) machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key machine # [ 25.086203] k3s[870]: W0930 09:11:29.969866 870 probe.go:275] Flexvolume plugin directory at /usr/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating. machine # [ 25.110985] k3s[870]: I0930 09:11:29.995015 870 shared_informer.go:409] "Caches are synced" machine # [ 25.111339] k3s[870]: I0930 09:11:29.995040 870 shared_informer.go:409] "Caches are synced" machine # [ 25.113196] k3s[870]: I0930 09:11:29.995160 870 shared_informer.go:409] "Caches are synced" machine # [ 25.222695] k3s[870]: I0930 09:11:30.106660 870 controller.go:667] quota admission added evaluator for: deployments.apps machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key, in 0.19 seconds) machine: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key machine # [ 25.283647] k3s[870]: I0930 09:11:30.167560 870 controllermanager.go:641] "Warning: skipping controller" controller="storage-version-migrator-controller" machine # [ 25.302774] k3s[870]: time="2026-09-30T09:11:30Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 25.308939] k3s[870]: time="2026-09-30T09:11:30Z" level=info msg="Starting /v1, Kind=Pod controller" machine # [ 25.315096] k3s[870]: time="2026-09-30T09:11:30Z" level=info msg="Starting apps/v1, Kind=DaemonSet controller" machine # [ 25.319060] k3s[870]: W0930 09:11:30.203083 870 controllermanager.go:315] "node-route-controller" is disabled machine # [ 25.320497] k3s[870]: I0930 09:11:30.203385 870 controllermanager.go:338] Started "cloud-node-controller" machine # [ 25.321735] k3s[870]: I0930 09:11:30.203496 870 controllermanager.go:338] Started "cloud-node-lifecycle-controller" machine # [ 25.323156] k3s[870]: I0930 09:11:30.203788 870 controllermanager.go:338] Started "service-lb-controller" machine # [ 25.324456] k3s[870]: I0930 09:11:30.204186 870 node_controller.go:179] Sending events to api server. machine # [ 25.325723] k3s[870]: time="2026-09-30T09:11:30Z" level=info msg="Starting discovery.k8s.io/v1, Kind=EndpointSlice controller" machine # [ 25.327218] k3s[870]: I0930 09:11:30.204545 870 node_controller.go:188] Waiting for informer caches to sync machine # [ 25.328544] k3s[870]: I0930 09:11:30.204644 870 node_lifecycle_controller.go:112] Sending events to api server machine # [ 25.329931] k3s[870]: I0930 09:11:30.204808 870 controller.go:235] Starting service controller machine # [ 25.331247] k3s[870]: I0930 09:11:30.204827 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 25.363246] k3s[870]: time="2026-09-30T09:11:30Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 25.385963] k3s[870]: I0930 09:11:30.269979 870 alloc.go:329] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.43.0.10"} machine: (finished: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key, in 0.16 seconds) machine: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine # [ 25.390295] k3s[870]: time="2026-09-30T09:11:30Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=AppliedManifest type=Normal machine # [ 25.521124] k3s[870]: I0930 09:11:30.405013 870 shared_informer.go:409] "Caches are synced" machine: (finished: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.16 seconds) subtest: chart deploys and workers become Ready machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine # [ 25.607459] k3s[870]: time="2026-09-30T09:11:30Z" level=info msg="Imported docker.io/library/nix-grpc-farm-lb:0.1.0-beta.4" machine # [ 25.609539] k3s[870]: time="2026-09-30T09:11:30Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-lb@sha256:18ee6724be589622e1aee9d13c5121e7b2c992ca636c935ade90c66423e18f37" machine # [ 25.658530] k3s[870]: time="2026-09-30T09:11:30Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nixos/if20jbcicwv9y92klzcxk35m5bcz2ql0-nix-grpc-farm-lb.tar in 1.681262563s" machine # [ 25.661107] k3s[870]: time="2026-09-30T09:11:30Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/n3ppj7wdvzdvrjd8m52s9w0s6wigwsj9-nix-grpc-farm-client.tar" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 26.086325] k3s[870]: I0930 09:11:30.969334 870 controllermanager.go:689] "Warning: controller is disabled" controller="selinux-warning-controller" machine # [ 26.086574] k3s[870]: time="2026-09-30T09:11:30Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" object=kube-system/local-storage reason=DeletingManifest type=Normal machine # [ 26.094329] k3s[870]: time="2026-09-30T09:11:30Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=ApplyingManifest type=Normal machine # [ 26.236761] k3s[870]: I0930 09:11:31.120698 870 gc_controller.go:98] "Starting GC controller" machine # [ 26.237312] k3s[870]: I0930 09:11:31.120733 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.240437] k3s[870]: I0930 09:11:31.124455 870 controller.go:667] quota admission added evaluator for: helmcharts.helm.cattle.io machine # [ 26.245580] k3s[870]: I0930 09:11:31.129622 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.246381] k3s[870]: I0930 09:11:31.129685 870 cleaner.go:83] "Starting CSR cleaner controller" machine # [ 26.248034] k3s[870]: I0930 09:11:31.132073 870 publisher.go:107] "Starting root CA cert publisher controller" machine # [ 26.248479] k3s[870]: I0930 09:11:31.132094 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.248976] k3s[870]: I0930 09:11:31.132161 870 controller.go:174] "Starting ephemeral volume controller" machine # [ 26.251774] k3s[870]: I0930 09:11:31.135834 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.253251] k3s[870]: I0930 09:11:31.137317 870 job_controller.go:336] "Starting job controller" machine # [ 26.253535] k3s[870]: I0930 09:11:31.137341 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.255773] k3s[870]: I0930 09:11:31.139833 870 replica_set.go:285] "Starting controller" name="replicaset" machine # [ 26.256056] k3s[870]: I0930 09:11:31.139854 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.257454] k3s[870]: time="2026-09-30T09:11:31Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=AppliedManifest type=Normal machine # [ 26.261549] k3s[870]: I0930 09:11:31.139913 870 horizontal.go:204] "Starting HPA controller" machine # [ 26.261939] k3s[870]: I0930 09:11:31.145628 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.262675] k3s[870]: I0930 09:11:31.145667 870 expand_controller.go:328] "Starting expand controller" machine # [ 26.263194] k3s[870]: I0930 09:11:31.145683 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.269121] k3s[870]: I0930 09:11:31.150347 870 clusterroleaggregation_controller.go:176] "Starting ClusterRoleAggregator controller" machine # [ 26.269406] k3s[870]: I0930 09:11:31.150367 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.269939] k3s[870]: I0930 09:11:31.150399 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.270190] k3s[870]: I0930 09:11:31.150485 870 stateful_set.go:234] "Starting stateful set controller" machine # [ 26.270770] k3s[870]: I0930 09:11:31.150500 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.271540] k3s[870]: I0930 09:11:31.150534 870 ttl_controller.go:127] "Starting TTL controller" machine # [ 26.272437] k3s[870]: I0930 09:11:31.150546 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.272955] k3s[870]: I0930 09:11:31.150590 870 pv_protection_controller.go:81] "Starting PV protection controller" machine # [ 26.273754] k3s[870]: I0930 09:11:31.150603 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.274300] k3s[870]: I0930 09:11:31.150682 870 replica_set.go:285] "Starting controller" name="replicationcontroller" machine # [ 26.274876] k3s[870]: I0930 09:11:31.150697 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.275601] k3s[870]: I0930 09:11:31.150728 870 namespace_controller.go:202] "Starting namespace controller" machine # [ 26.276233] k3s[870]: I0930 09:11:31.150741 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.276791] k3s[870]: I0930 09:11:31.150778 870 serviceaccounts_controller.go:117] "Starting service account controller" machine # [ 26.280106] k3s[870]: I0930 09:11:31.150792 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.280766] k3s[870]: I0930 09:11:31.150882 870 daemon_controller.go:364] "Starting daemon sets controller" machine # [ 26.281454] k3s[870]: I0930 09:11:31.150894 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.281929] k3s[870]: I0930 09:11:31.150926 870 disruption.go:453] "Sending events to api server." machine # [ 26.282639] k3s[870]: I0930 09:11:31.150969 870 disruption.go:460] "Starting disruption controller" machine # [ 26.283215] k3s[870]: I0930 09:11:31.150979 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.283761] k3s[870]: I0930 09:11:31.151051 870 endpoints_controller.go:193] "Starting endpoint controller" machine # [ 26.284487] k3s[870]: I0930 09:11:31.151065 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.284970] k3s[870]: I0930 09:11:31.151159 870 cronjob_controllerv2.go:143] "Starting cronjob controller v2" machine # [ 26.285707] k3s[870]: I0930 09:11:31.151171 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.286398] k3s[870]: I0930 09:11:31.151261 870 node_ipam_controller.go:142] "Starting ipam controller" machine # [ 26.286895] k3s[870]: I0930 09:11:31.151273 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.287625] k3s[870]: I0930 09:11:31.151329 870 node_lifecycle_controller.go:436] "Sending events to api server" machine # [ 26.288165] k3s[870]: I0930 09:11:31.151363 870 node_lifecycle_controller.go:443] "Starting node controller" machine # [ 26.288654] k3s[870]: I0930 09:11:31.151373 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.289199] k3s[870]: I0930 09:11:31.151443 870 pv_controller_base.go:318] "Starting persistent volume controller" machine # [ 26.289673] k3s[870]: I0930 09:11:31.151455 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.290045] k3s[870]: I0930 09:11:31.151538 870 controller.go:753] "Starting resource claim controller" machine # [ 26.290404] k3s[870]: I0930 09:11:31.151553 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.290937] k3s[870]: I0930 09:11:31.151628 870 deployment_controller.go:180] "Starting controller" controller="deployment" machine # [ 26.291752] k3s[870]: I0930 09:11:31.151644 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.292452] k3s[870]: I0930 09:11:31.151824 870 vac_protection_controller.go:206] "Starting VAC protection controller" machine # [ 26.292985] k3s[870]: I0930 09:11:31.151838 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.293792] k3s[870]: I0930 09:11:31.151869 870 legacy_serviceaccount_token_cleaner.go:103] "Starting legacy service account token cleaner controller" machine # [ 26.294618] k3s[870]: I0930 09:11:31.151881 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.295218] k3s[870]: I0930 09:11:31.151949 870 endpointslice_controller.go:280] "Starting endpoint slice controller" machine # [ 26.295727] k3s[870]: I0930 09:11:31.151962 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.296475] k3s[870]: I0930 09:11:31.152009 870 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-legacy-unknown" machine # [ 26.297118] k3s[870]: I0930 09:11:31.152021 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.297684] k3s[870]: I0930 09:11:31.152092 870 attach_detach_controller.go:334] "Starting attach detach controller" machine # [ 26.298553] k3s[870]: I0930 09:11:31.152104 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.299256] k3s[870]: I0930 09:11:31.152163 870 device_taint_eviction.go:783] "Starting" controller="device-taint-eviction-controller" numWorkers=8 machine # [ 26.299788] k3s[870]: I0930 09:11:31.152308 870 taint_eviction.go:283] "Starting" controller="taint-eviction-controller" machine # [ 26.300553] k3s[870]: I0930 09:11:31.152370 870 taint_eviction.go:288] "Sending events to API server" machine # [ 26.301136] k3s[870]: I0930 09:11:31.152380 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.301640] k3s[870]: I0930 09:11:31.152442 870 endpointslicemirroring_controller.go:226] "Starting EndpointSliceMirroring controller" machine # [ 26.302465] k3s[870]: I0930 09:11:31.152458 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.303099] k3s[870]: I0930 09:11:31.152486 870 certificate_controller.go:120] "Starting certificate controller" name="csrapproving" machine # [ 26.303629] k3s[870]: I0930 09:11:31.152498 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.304199] k3s[870]: I0930 09:11:31.152531 870 tokencleaner.go:117] "Starting token cleaner controller" machine # [ 26.304749] k3s[870]: I0930 09:11:31.152543 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.305344] k3s[870]: I0930 09:11:31.152574 870 pvc_protection_controller.go:172] "Starting PVC protection controller" machine # [ 26.305923] k3s[870]: I0930 09:11:31.152587 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.306690] k3s[870]: I0930 09:11:31.152622 870 ttlafterfinished_controller.go:112] "Starting TTL after finished controller" machine # [ 26.307443] k3s[870]: I0930 09:11:31.152636 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.307968] k3s[870]: I0930 09:11:31.152701 870 servicecidrs_controller.go:137] "Starting" controller="service-cidr-controller" machine # [ 26.308710] k3s[870]: I0930 09:11:31.152714 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.309526] k3s[870]: I0930 09:11:31.152980 870 resource_quota_controller.go:297] "Starting resource quota controller" machine # [ 26.310148] k3s[870]: I0930 09:11:31.152993 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.310654] k3s[870]: I0930 09:11:31.153223 870 garbagecollector.go:141] "Starting controller" controller="garbagecollector" machine # [ 26.311283] k3s[870]: I0930 09:11:31.153252 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.311846] k3s[870]: I0930 09:11:31.161294 870 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-serving" machine # [ 26.313539] k3s[870]: I0930 09:11:31.161318 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.314233] k3s[870]: I0930 09:11:31.161356 870 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-client" machine # [ 26.316041] k3s[870]: I0930 09:11:31.161369 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.317592] k3s[870]: I0930 09:11:31.161401 870 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kube-apiserver-client" machine # [ 26.319265] k3s[870]: I0930 09:11:31.161416 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.320750] k3s[870]: I0930 09:11:31.161452 870 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 26.368169] k3s[870]: I0930 09:11:31.161615 870 device_taint_eviction.go:823] "Sending events to api server" machine # [ 26.368570] k3s[870]: I0930 09:11:31.161722 870 device_taint_eviction.go:1023] "Waiting" for="cache and event handler sync" machine # [ 26.369500] k3s[870]: I0930 09:11:31.161957 870 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 26.370036] k3s[870]: I0930 09:11:31.162024 870 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 26.370677] k3s[870]: I0930 09:11:31.162083 870 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 26.371071] k3s[870]: I0930 09:11:31.163659 870 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" resource="helmchartconfigs.helm.cattle.io" machine # [ 26.371624] k3s[870]: I0930 09:11:31.163699 870 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" resource="helmcharts.helm.cattle.io" machine # [ 26.372234] k3s[870]: I0930 09:11:31.163735 870 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" resource="addons.k3s.cattle.io" machine # [ 26.372717] k3s[870]: I0930 09:11:31.163763 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.373574] k3s[870]: I0930 09:11:31.165481 870 resource_quota_monitor.go:309] "QuotaMonitor running" machine # [ 26.374375] k3s[870]: I0930 09:11:31.169750 870 graph_builder.go:387] "Running" component="GraphBuilder" machine # [ 26.374842] k3s[870]: time="2026-09-30T09:11:31Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=ApplyingManifest type=Normal machine # [ 26.375636] k3s[870]: I0930 09:11:31.228236 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.376191] k3s[870]: time="2026-09-30T09:11:31Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 26.376894] k3s[870]: I0930 09:11:31.251674 870 shared_informer.go:409] "Caches are synced" machine # [ 26.377688] k3s[870]: I0930 09:11:31.251750 870 shared_informer.go:409] "Caches are synced" machine # [ 26.628160] k3s[870]: I0930 09:11:31.511743 870 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceSlice + event handler k8s.io/kubernetes/pkg/controller/devicetainteviction.(*Controller).Run" machine # [ 26.628553] k3s[870]: I0930 09:11:31.512604 870 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.DeviceClass" machine # [ 26.633072] k3s[870]: I0930 09:11:31.517031 870 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceClaim" machine # [ 26.634036] k3s[870]: I0930 09:11:31.517068 870 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceClaim + event handler k8s.io/kubernetes/pkg/controller/devicetainteviction.(*Controller).Run" machine # [ 26.636849] k3s[870]: I0930 09:11:31.520457 870 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.Pod" machine # [ 26.637524] k3s[870]: I0930 09:11:31.520495 870 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.Pod + event handler k8s.io/kubernetes/pkg/controller/devicetainteviction.(*Controller).Run" machine # [ 26.638021] k3s[870]: I0930 09:11:31.520781 870 shared_informer.go:409] "Caches are synced" machine # [ 26.640240] k3s[870]: time="2026-09-30T09:11:31Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Applying HelmChart from https://%{KUBERNETES_API}%/static/charts/nix-grpc-farm.tgz using Job kube-system/helm-install-nix-grpc-farm " object=kube-system/nix-grpc-farm reason=ApplyJob type=Normal machine # [ 26.644603] k3s[870]: I0930 09:11:31.528662 870 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceSlice" machine # [ 26.645715] k3s[870]: I0930 09:11:31.529774 870 shared_informer.go:409] "Caches are synced" machine # [ 26.648222] k3s[870]: I0930 09:11:31.532288 870 shared_informer.go:409] "Caches are synced" machine # [ 26.652314] k3s[870]: I0930 09:11:31.536344 870 shared_informer.go:409] "Caches are synced" machine # [ 26.656945] k3s[870]: I0930 09:11:31.538608 870 shared_informer.go:409] "Caches are synced" machine # [ 26.657417] k3s[870]: I0930 09:11:31.539931 870 shared_informer.go:409] "Caches are synced" machine # [ 26.661724] k3s[870]: I0930 09:11:31.545784 870 shared_informer.go:409] "Caches are synced" machine # [ 26.666344] k3s[870]: I0930 09:11:31.550401 870 controller.go:667] quota admission added evaluator for: jobs.batch machine # [ 26.666638] k3s[870]: I0930 09:11:31.550480 870 shared_informer.go:409] "Caches are synced" machine # [ 26.667179] k3s[870]: I0930 09:11:31.550852 870 shared_informer.go:409] "Caches are synced" machine # [ 26.667671] k3s[870]: I0930 09:11:31.550975 870 shared_informer.go:409] "Caches are synced" machine # [ 26.668267] k3s[870]: I0930 09:11:31.551048 870 shared_informer.go:409] "Caches are synced" machine # [ 26.668830] k3s[870]: I0930 09:11:31.551274 870 shared_informer.go:409] "Caches are synced" machine # [ 26.670598] k3s[870]: I0930 09:11:31.551314 870 shared_informer.go:409] "Caches are synced" machine # [ 26.671236] k3s[870]: I0930 09:11:31.551354 870 range_allocator.go:177] "Sending events to api server" machine # [ 26.671657] k3s[870]: I0930 09:11:31.551379 870 range_allocator.go:181] "Starting range CIDR allocator" machine # [ 26.672214] k3s[870]: I0930 09:11:31.551390 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.672702] k3s[870]: I0930 09:11:31.551401 870 shared_informer.go:409] "Caches are synced" machine # [ 26.673401] k3s[870]: I0930 09:11:31.551480 870 shared_informer.go:409] "Caches are synced" machine # [ 26.673968] k3s[870]: I0930 09:11:31.551537 870 shared_informer.go:409] "Caches are synced" machine # [ 26.674790] k3s[870]: I0930 09:11:31.551592 870 shared_informer.go:409] "Caches are synced" machine # [ 26.675497] k3s[870]: I0930 09:11:31.551676 870 shared_informer.go:409] "Caches are synced" machine # [ 26.675991] k3s[870]: I0930 09:11:31.552103 870 shared_informer.go:409] "Caches are synced" machine # [ 26.677165] k3s[870]: I0930 09:11:31.552182 870 shared_informer.go:409] "Caches are synced" machine # [ 26.677691] k3s[870]: I0930 09:11:31.552370 870 shared_informer.go:409] "Caches are synced" machine # [ 26.678169] k3s[870]: I0930 09:11:31.552413 870 shared_informer.go:409] "Caches are synced" machine # [ 26.678872] k3s[870]: I0930 09:11:31.552448 870 shared_informer.go:409] "Caches are synced" machine # [ 26.679583] k3s[870]: I0930 09:11:31.552499 870 shared_informer.go:409] "Caches are synced" machine # [ 26.680674] k3s[870]: I0930 09:11:31.552599 870 shared_informer.go:409] "Caches are synced" machine # [ 26.680896] k3s[870]: I0930 09:11:31.552629 870 shared_informer.go:409] "Caches are synced" machine # [ 26.681633] k3s[870]: I0930 09:11:31.552673 870 shared_informer.go:409] "Caches are synced" machine # [ 26.682040] k3s[870]: I0930 09:11:31.552702 870 shared_informer.go:409] "Caches are synced" machine # [ 26.682578] k3s[870]: I0930 09:11:31.552751 870 shared_informer.go:409] "Caches are synced" machine # [ 26.683379] k3s[870]: I0930 09:11:31.553003 870 shared_informer.go:409] "Caches are synced" machine # [ 26.683949] k3s[870]: I0930 09:11:31.553060 870 shared_informer.go:409] "Caches are synced" machine # [ 26.685281] k3s[870]: I0930 09:11:31.553168 870 shared_informer.go:409] "Caches are synced" machine # [ 26.685965] k3s[870]: I0930 09:11:31.553909 870 shared_informer.go:409] "Caches are synced" machine # [ 26.686685] k3s[870]: I0930 09:11:31.553936 870 shared_informer.go:409] "Caches are synced" machine # [ 26.687031] k3s[870]: I0930 09:11:31.554079 870 shared_informer.go:409] "Caches are synced" machine # [ 26.687749] k3s[870]: I0930 09:11:31.554354 870 shared_informer.go:409] "Caches are synced" machine # [ 26.688902] k3s[870]: I0930 09:11:31.554412 870 shared_informer.go:409] "Caches are synced" machine # [ 26.689632] k3s[870]: I0930 09:11:31.562654 870 shared_informer.go:409] "Caches are synced" machine # [ 26.690180] k3s[870]: I0930 09:11:31.562836 870 shared_informer.go:409] "Caches are synced" machine # [ 26.690760] k3s[870]: I0930 09:11:31.562873 870 shared_informer.go:409] "Caches are synced" machine # [ 26.691568] k3s[870]: I0930 09:11:31.568776 870 shared_informer.go:409] "Caches are synced" machine # [ 26.804068] k3s[870]: time="2026-09-30T09:11:31Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Deferred node password secret validation complete" object=machine reason=NodePasswordValidationComplete type=Normal machine # [ 26.814693] k3s[870]: time="2026-09-30T09:11:31Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=AppliedManifest type=Normal machine # [ 26.828075] k3s[870]: time="2026-09-30T09:11:31Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=ApplyingManifest type=Normal machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 26.939620] k3s[870]: I0930 09:11:31.823447 870 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 26.943934] k3s[870]: I0930 09:11:31.827998 870 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 26.973377] k3s[870]: time="2026-09-30T09:11:31Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=AppliedManifest type=Normal machine # [ 27.015603] k3s[870]: time="2026-09-30T09:11:31Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/traefik.yaml\"" object=kube-system/traefik reason=DeletingManifest type=Normal machine # [ 27.037281] k3s[870]: I0930 09:11:31.921309 870 controller.go:667] quota admission added evaluator for: replicasets.apps machine # [ 27.256754] k3s[870]: time="2026-09-30T09:11:32Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Resumed synced Job kube-system/helm-install-nix-grpc-farm" object=kube-system/nix-grpc-farm reason=ResumeJob type=Normal machine # [ 27.361766] k3s[870]: time="2026-09-30T09:11:32Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 27.644718] k3s[870]: I0930 09:11:32.528721 870 shared_informer.go:409] "Caches are synced" machine # [ 27.669913] k3s[870]: I0930 09:11:32.553953 870 shared_informer.go:409] "Caches are synced" machine # [ 27.670453] k3s[870]: I0930 09:11:32.553981 870 garbagecollector.go:166] "Garbage collector: all resource monitors have synced" machine # [ 27.670962] k3s[870]: I0930 09:11:32.553992 870 garbagecollector.go:169] "Proceeding to collect garbage" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 28.161524] postgres[1183]: [1183] ERROR: relation "goose_db_version" does not exist at character 36 machine # [ 28.161733] postgres[1183]: [1183] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC machine # [ 28.183630] niks3-server[1175]: 2026/09/30 09:11:33 OK 20241026095416_initial_model.sql (9.81ms) machine # [ 28.185530] niks3-server[1175]: 2026/09/30 09:11:33 OK 20251210153512_drop_unused_gin_index.sql (2.34ms) machine # [ 28.191619] niks3-server[1175]: 2026/09/30 09:11:33 OK 20251218171726_add_pins.sql (6.01ms) machine # [ 28.196613] niks3-server[1175]: 2026/09/30 09:11:33 OK 20260628120000_add_object_size_and_stats.sql (4.95ms) machine # [ 28.201718] niks3-server[1175]: 2026/09/30 09:11:33 OK 20260905000000_add_claims.sql (5.07ms) machine # [ 28.206623] niks3-server[1175]: 2026/09/30 09:11:33 OK 20260920000000_drop_claims.sql (4.66ms) machine # [ 28.208667] niks3-server[1175]: 2026/09/30 09:11:33 OK 20260923120000_add_pushes.sql (2.01ms) machine # [ 28.209963] niks3-server[1175]: 2026/09/30 09:11:33 goose: successfully migrated database to version: 20260923120000 machine # [ 28.213686] niks3-server[1175]: 2026/09/30 09:11:33 OK 1_commit_pending_closure.sql (4.93ms) machine # [ 28.215360] niks3-server[1175]: 2026/09/30 09:11:33 OK 2_object_stats_trigger.sql (1.61ms) machine # [ 28.217419] niks3-server[1175]: 2026/09/30 09:11:33 OK 3_commit_push.sql (2ms) machine # [ 28.217719] niks3-server[1175]: 2026/09/30 09:11:33 goose: up to current file version: 3 machine # [ 28.223132] niks3-server[1175]: 2026/09/30 09:11:33 INFO OIDC provider initialized name=kubernetes issuer=https://kubernetes.default.svc.cluster.local machine # [ 28.223432] niks3-server[1175]: 2026/09/30 09:11:33 INFO OIDC authentication enabled config=/nix/store/v0b0sqyzhrjsz48x3klf7b7vl89apzs0-niks3-oidc.json machine # [ 28.223961] niks3-server[1175]: 2026/09/30 09:11:33 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key machine # [ 28.252717] niks3-server[1175]: 2026/09/30 09:11:33 INFO Read proxy enabled — serving cache objects from S3 machine # [ 28.253290] niks3-server[1175]: 2026/09/30 09:11:33 INFO Using socket-activated listener address=0.0.0.0:5751 machine # [ 28.255652] niks3-server[1175]: 2026/09/30 09:11:33 INFO systemd watchdog enabled interval=15s machine # [ 28.256155] niks3-server[1175]: 2026/09/30 09:11:33 INFO Starting HTTP server address=0.0.0.0:5751 machine # [ 28.258280] systemd[1]: Started niks3 server. machine # [ 28.259172] systemd[1]: Reached target Multi-User System. machine # [ 28.259457] systemd[1]: Startup finished in 1.184s (kernel) + 3.703s (initrd) + 23.370s (userspace) = 28.259s. machine # [ 28.362556] k3s[870]: time="2026-09-30T09:11:33Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 29.363212] k3s[870]: time="2026-09-30T09:11:34Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 30.361783] k3s[870]: time="2026-09-30T09:11:35Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 30.611878] k3s[870]: time="2026-09-30T09:11:35Z" level=info msg="Started tunnel to 10.0.2.15:6443" machine # [ 30.612066] k3s[870]: time="2026-09-30T09:11:35Z" level=info msg="Connecting to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 30.612603] k3s[870]: time="2026-09-30T09:11:35Z" level=info msg="Stopped tunnel to 127.0.0.1:6443" machine # [ 30.613069] k3s[870]: time="2026-09-30T09:11:35Z" level=info msg="Proxy done" err="context canceled" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 30.613563] k3s[870]: time="2026-09-30T09:11:35Z" level=info msg="error in remotedialer server [400]: websocket: close 1006 (abnormal closure): unexpected EOF" machine # [ 30.621410] k3s[870]: time="2026-09-30T09:11:35Z" level=info msg="Handling backend connection request [machine]" machine # [ 30.621712] k3s[870]: time="2026-09-30T09:11:35Z" level=info msg="Connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 30.622479] k3s[870]: time="2026-09-30T09:11:35Z" level=info msg="Remotedialer connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 31.362069] k3s[870]: time="2026-09-30T09:11:36Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 31.885401] k3s[870]: time="2026-09-30T09:11:36Z" level=info msg="Imported docker.io/library/nix-grpc-farm-client:0.1.0-beta.4" machine # [ 31.887339] k3s[870]: time="2026-09-30T09:11:36Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-client@sha256:68aecedc185f66a287344369ba81d8898cbe547cbd77dea2140f49a354611191" machine # [ 32.280658] k3s[870]: time="2026-09-30T09:11:37Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nixos/n3ppj7wdvzdvrjd8m52s9w0s6wigwsj9-nix-grpc-farm-client.tar in 6.619525106s" machine # [ 32.287126] k3s[870]: time="2026-09-30T09:11:37Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/smddpgqzjvlqv3lx57wdzl7kma805fj0-k3s-airgap-images-amd64.tar.zst" machine # [ 32.365271] k3s[870]: time="2026-09-30T09:11:37Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 32.541580] k3s[870]: time="2026-09-30T09:11:37Z" level=info msg="Running kubelet --cloud-provider=external --config-dir=/var/lib/rancher/k3s/agent/etc/kubelet.conf.d --containerd=/run/k3s/containerd/containerd.sock --eviction-hard=nodefs.available<1%,imagefs.available<1% --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubelet.kubeconfig --node-ip=10.0.2.15,fec0::1873:b5ec:892e:bb88 --node-labels= --read-only-port=0" machine # [ 32.542761] k3s[870]: Flag --containerd has been deprecated, This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed. machine # [ 32.558704] k3s[870]: I0930 09:11:37.442554 870 server.go:541] "Kubelet version" kubeletVersion="v1.36.4+k3s1" machine # [ 32.559743] k3s[870]: I0930 09:11:37.442615 870 server.go:543] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 32.561690] k3s[870]: I0930 09:11:37.443430 870 watchdog_linux.go:94] "Systemd watchdog is not enabled" machine # [ 32.563161] k3s[870]: I0930 09:11:37.443493 870 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." machine # [ 32.563782] k3s[870]: I0930 09:11:37.446411 870 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/agent/client-ca.crt" machine # [ 32.572133] k3s[870]: I0930 09:11:37.456082 870 server.go:1444] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" machine # [ 32.583422] k3s[870]: I0930 09:11:37.467421 870 server.go:804] "--cgroups-per-qos enabled, but --cgroup-root was not specified. Defaulting to /" machine # [ 32.583949] k3s[870]: I0930 09:11:37.467492 870 server.go:865] "NoSwap is set due to memorySwapBehavior not specified" memorySwapBehavior="" FailSwapOn=false machine # [ 32.584859] k3s[870]: I0930 09:11:37.467888 870 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] machine # [ 32.585954] k3s[870]: I0930 09:11:37.467928 870 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"machine","RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"MemoryReservationPolicy":"None","PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} machine # [ 32.586656] k3s[870]: I0930 09:11:37.468302 870 topology_manager.go:172] "Creating topology manager with none policy" machine # [ 32.587914] k3s[870]: I0930 09:11:37.468330 870 container_manager_linux.go:309] "Creating device plugin manager" machine # [ 32.589179] k3s[870]: I0930 09:11:37.468445 870 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" machine # [ 32.589871] k3s[870]: I0930 09:11:37.471997 870 state_mem.go:45] "Initialized" logger="CPUManager state memory" machine # [ 32.590178] k3s[870]: I0930 09:11:37.472240 870 kubelet.go:485] "Attempting to sync node with API server" machine # [ 32.590655] k3s[870]: I0930 09:11:37.472258 870 kubelet.go:386] "Adding static pod path" path="/var/lib/rancher/k3s/agent/pod-manifests" machine # [ 32.591238] k3s[870]: I0930 09:11:37.472285 870 kubelet.go:397] "Adding apiserver pod source" machine # [ 32.591701] k3s[870]: I0930 09:11:37.472300 870 apiserver.go:41] "Waiting for node sync before watching apiserver pods" machine # [ 32.614678] k3s[870]: I0930 09:11:37.498720 870 kuberuntime_manager.go:308] "Container runtime initialized" containerRuntime="containerd" version="2.3.4-k3s1.36" apiVersion="v1" machine # [ 32.617625] k3s[870]: I0930 09:11:37.501684 870 kubelet.go:1002] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" machine # [ 32.617897] k3s[870]: I0930 09:11:37.501716 870 kubelet.go:1029] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" machine # [ 32.626054] k3s[870]: I0930 09:11:37.510081 870 server.go:1280] "Started kubelet" machine # [ 32.626732] k3s[870]: I0930 09:11:37.510761 870 server.go:193] "Starting to listen" address="0.0.0.0" port=10250 machine # [ 32.628295] k3s[870]: I0930 09:11:37.512323 870 server.go:354] "Adding debug handlers to kubelet server" machine # [ 32.629671] k3s[870]: I0930 09:11:37.513243 870 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 machine # [ 32.629823] k3s[870]: I0930 09:11:37.513319 870 server_v1.go:49] "podresources" method="list" useActivePods=true machine # [ 32.630533] k3s[870]: I0930 09:11:37.513508 870 server.go:264] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" machine # [ 32.634817] k3s[870]: E0930 09:11:37.518833 870 kubelet.go:1725] "Image garbage collection failed once. Stats initialization may not have completed yet" err="invalid capacity 0 on image filesystem" machine # [ 32.637575] k3s[870]: I0930 09:11:37.521550 870 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" machine # [ 32.638630] k3s[870]: I0930 09:11:37.522627 870 dynamic_serving_content.go:135] "Starting controller" name="kubelet-server-cert-files::/var/lib/rancher/k3s/agent/serving-kubelet.crt::/var/lib/rancher/k3s/agent/serving-kubelet.key" machine # [ 32.639512] k3s[870]: I0930 09:11:37.522751 870 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 32.643413] k3s[870]: I0930 09:11:37.527481 870 volume_manager.go:310] "Starting Kubelet Volume Manager" machine # [ 32.644563] k3s[870]: I0930 09:11:37.528536 870 desired_state_of_world_populator.go:146] "Desired state populator starts to run" machine # [ 32.645573] k3s[870]: E0930 09:11:37.528035 870 kubelet_node_status.go:396] "Error getting the current node from lister" err="node \"machine\" not found" machine # [ 32.646592] k3s[870]: I0930 09:11:37.529292 870 reconciler.go:29] "Reconciler: start to sync state" machine # [ 32.647420] k3s[870]: E0930 09:11:37.529621 870 kubelet.go:3516] "Unable to register mirror pod because node is not registered yet" err="node \"machine\" not found" node="machine" machine # [ 32.648657] k3s[870]: I0930 09:11:37.531006 870 factory.go:222] Registration of the containerd container factory successfully machine # [ 32.649831] k3s[870]: I0930 09:11:37.531023 870 factory.go:222] Registration of the systemd container factory successfully machine # [ 32.651191] k3s[870]: I0930 09:11:37.531112 870 factory.go:220] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory machine # [ 32.654792] k3s[870]: E0930 09:11:37.538738 870 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"machine\" not found" node="machine" machine # [ 32.672591] k3s[870]: I0930 09:11:37.556451 870 cpu_manager.go:235] "Starting" policy="none" machine # [ 32.672950] k3s[870]: I0930 09:11:37.556468 870 cpu_manager.go:236] "Reconciling" reconcilePeriod="10s" machine # [ 32.676102] k3s[870]: I0930 09:11:37.556494 870 state_mem.go:45] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" machine # [ 32.679350] k3s[870]: I0930 09:11:37.563422 870 policy_none.go:50] "Start" machine # [ 32.679697] k3s[870]: I0930 09:11:37.563781 870 memory_manager.go:190] "Starting memorymanager" policy="None" machine # [ 32.680151] k3s[870]: I0930 09:11:37.564233 870 state_mem.go:40] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" machine # [ 32.685810] k3s[870]: I0930 09:11:37.569866 870 policy_none.go:44] "Start" machine # [ 32.689880] systemd[1]: Created slice libcontainer container kubepods.slice. machine # [ 32.704202] systemd[1]: Created slice libcontainer container kubepods-burstable.slice. machine # [ 32.709178] systemd[1]: Created slice libcontainer container kubepods-besteffort.slice. machine # [ 32.718073] k3s[870]: E0930 09:11:37.601580 870 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" machine # [ 32.718355] k3s[870]: I0930 09:11:37.601691 870 eviction_manager.go:194] "Eviction manager: starting control loop" machine # [ 32.718875] k3s[870]: I0930 09:11:37.601709 870 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" machine # [ 32.719874] k3s[870]: I0930 09:11:37.603945 870 plugin_manager.go:121] "Starting Kubelet Plugin Manager" machine # [ 32.723885] k3s[870]: E0930 09:11:37.607958 870 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="no imagefs label for configured runtime" machine # [ 32.724904] k3s[870]: E0930 09:11:37.608262 870 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"machine\" not found" machine # [ 32.746698] k3s[870]: E0930 09:11:37.630498 870 kubelet.go:3516] "Unable to register mirror pod because node is not registered yet" err="node \"machine\" not found" node="machine" machine # [ 32.767704] k3s[870]: I0930 09:11:37.651675 870 kubelet_network_linux.go:53] "Initialized iptables rules." protocol="IPv4" machine # [ 32.772224] k3s[870]: I0930 09:11:37.656230 870 kubelet_network_linux.go:53] "Initialized iptables rules." protocol="IPv6" machine # [ 32.772814] k3s[870]: I0930 09:11:37.656276 870 status_manager.go:277] "Starting to sync pod status with apiserver" machine # [ 32.773598] k3s[870]: I0930 09:11:37.656328 870 kubelet.go:2622] "Starting kubelet main sync loop" machine # [ 32.774097] k3s[870]: E0930 09:11:37.656382 870 kubelet.go:2646] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 32.820267] k3s[870]: I0930 09:11:37.703945 870 kubelet_node_status.go:75] "Attempting to register node" node="machine" machine # [ 32.826196] k3s[870]: I0930 09:11:37.710150 870 kubelet_node_status.go:78] "Successfully registered node" node="machine" machine # [ 32.827757] k3s[870]: E0930 09:11:37.710210 870 kubelet_node_status.go:479] "Error updating node status, will retry" err="error getting node \"machine\": node \"machine\" not found" machine # [ 32.829904] k3s[870]: I0930 09:11:37.710641 870 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"machine\" does not exist" machine # [ 32.835057] k3s[870]: time="2026-09-30T09:11:37Z" level=info msg="Adding node OwnerReference to node-password secret machine.node-password.k3s" machine # [ 32.836895] k3s[870]: I0930 09:11:37.719762 870 node_controller.go:432] Initializing node machine with cloud provider machine # [ 32.838374] k3s[870]: I0930 09:11:37.719826 870 node_controller.go:236] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 32.840689] k3s[870]: E0930 09:11:37.719848 870 node_controller.go:247] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 32.843436] k3s[870]: I0930 09:11:37.720800 870 node_controller.go:432] Initializing node machine with cloud provider machine # [ 32.844968] k3s[870]: time="2026-09-30T09:11:37Z" level=info msg="Annotations and labels have been set successfully on node: machine" machine # [ 32.846632] k3s[870]: time="2026-09-30T09:11:37Z" level=info msg="Starting flannel with backend vxlan" machine # [ 32.854384] k3s[870]: E0930 09:11:37.738392 870 options.go:205] The manifest file is empty, ignoring. machine # [ 32.858889] k3s[870]: time="2026-09-30T09:11:37Z" level=info msg="Synced coredns NodeHosts entries for machine" machine # [ 32.863237] k3s[870]: I0930 09:11:37.747231 870 range_allocator.go:433] "Set node PodCIDR" node="machine" podCIDRs=["10.42.0.0/24"] machine # [ 32.864863] k3s[870]: I0930 09:11:37.747669 870 node_controller.go:477] Successfully initialized node machine with cloud provider machine # [ 32.866481] k3s[870]: I0930 09:11:37.748109 870 event.go:389] "Event occurred" object="machine" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="Synced" message="Node synced successfully" machine # [ 32.868875] k3s[870]: I0930 09:11:37.749925 870 server.go:176] "Starting Kubernetes Scheduler" version="v1.36.4+k3s1" machine # [ 32.870424] k3s[870]: I0930 09:11:37.749946 870 server.go:178] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 32.872017] k3s[870]: I0930 09:11:37.750188 870 kuberuntime_manager.go:2172] "Updating runtime config through cri with podcidr" CIDR="10.42.0.0/24" machine # [ 32.873878] k3s[870]: I0930 09:11:37.752285 870 kubelet_network.go:48] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.42.0.0/24" machine # [ 32.875646] k3s[870]: I0930 09:11:37.759557 870 secure_serving.go:214] Serving securely on 127.0.0.1:10259 machine # [ 32.877179] k3s[870]: I0930 09:11:37.760342 870 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 32.878707] k3s[870]: I0930 09:11:37.760365 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 32.880154] k3s[870]: I0930 09:11:37.760413 870 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 32.883190] k3s[870]: I0930 09:11:37.760514 870 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 32.884667] k3s[870]: I0930 09:11:37.762222 870 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 32.887475] k3s[870]: I0930 09:11:37.762246 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 32.888816] k3s[870]: I0930 09:11:37.762274 870 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 32.891280] k3s[870]: I0930 09:11:37.762291 870 shared_informer.go:402] "Waiting for caches to sync" machine # [ 32.892654] k3s[870]: time="2026-09-30T09:11:37Z" level=info msg="Flannel found PodCIDR assigned for node machine" machine # [ 32.894166] k3s[870]: time="2026-09-30T09:11:37Z" level=info msg="The interface eth0 with ipv4 address 10.0.2.15 will be used by flannel" machine # [ 32.895792] k3s[870]: I0930 09:11:37.772001 870 kube.go:139] Waiting 10m0s for node controller to sync machine # [ 32.897242] k3s[870]: I0930 09:11:37.772103 870 kube.go:537] Starting kube subnet manager machine # [ 33.077570] k3s[870]: I0930 09:11:37.961517 870 shared_informer.go:409] "Caches are synced" machine # [ 33.078632] k3s[870]: I0930 09:11:37.962380 870 shared_informer.go:409] "Caches are synced" machine # [ 33.078863] k3s[870]: I0930 09:11:37.962423 870 shared_informer.go:409] "Caches are synced" machine # [ 33.080252] k3s[870]: I0930 09:11:37.964314 870 kubelet_node_status.go:431] "Fast updating node status as it just became ready" machine # [ 33.087441] k3s[870]: I0930 09:11:37.971471 870 topologycache.go:237] "Can't get CPU or zone information for node" node="machine" machine # [ 33.368874] k3s[870]: time="2026-09-30T09:11:38Z" level=info msg="Labels and annotations have been set successfully on node: machine" machine # [ 33.505192] k3s[870]: time="2026-09-30T09:11:38Z" level=info msg="Tunnel authorizer set Kubelet Port 0.0.0.0:10250" machine # [ 33.589797] k3s[870]: I0930 09:11:38.473699 870 apiserver.go:51] "Watching apiserver" machine # [ 33.630518] systemd[1]: Created slice libcontainer container kubepods-burstable-podd467dcf4_6850_4868_b03d_5303497938e3.slice. machine # [ 33.643543] systemd[1]: Created slice libcontainer container kubepods-burstable-pod7a2664cc_cab4_4163_9d3c_2d72faf56539.slice. machine # [ 33.646736] k3s[870]: I0930 09:11:38.530777 870 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" machine # [ 33.650488] k3s[870]: I0930 09:11:38.534543 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"content\" (UniqueName: \"kubernetes.io/configmap/7a2664cc-cab4-4163-9d3c-2d72faf56539-content\") pod \"helm-install-nix-grpc-farm-5mtbd\" (UID: \"7a2664cc-cab4-4163-9d3c-2d72faf56539\") " pod="kube-system/helm-install-nix-grpc-farm-5mtbd" machine # [ 33.650819] k3s[870]: I0930 09:11:38.534589 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-config-volume\" (UniqueName: \"kubernetes.io/configmap/d467dcf4-6850-4868-b03d-5303497938e3-custom-config-volume\") pod \"coredns-54996dc9b4-fhw9c\" (UID: \"d467dcf4-6850-4868-b03d-5303497938e3\") " pod="kube-system/coredns-54996dc9b4-fhw9c" machine # [ 33.651478] k3s[870]: I0930 09:11:38.534623 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56n4m\" (UniqueName: \"kubernetes.io/projected/d467dcf4-6850-4868-b03d-5303497938e3-kube-api-access-56n4m\") pod \"coredns-54996dc9b4-fhw9c\" (UID: \"d467dcf4-6850-4868-b03d-5303497938e3\") " pod="kube-system/coredns-54996dc9b4-fhw9c" machine # [ 33.664054] k3s[870]: I0930 09:11:38.547393 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/7a2664cc-cab4-4163-9d3c-2d72faf56539-klipper-helm\") pod \"helm-install-nix-grpc-farm-5mtbd\" (UID: \"7a2664cc-cab4-4163-9d3c-2d72faf56539\") " pod="kube-system/helm-install-nix-grpc-farm-5mtbd" machine # [ 33.664378] k3s[870]: I0930 09:11:38.547439 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"values\" (UniqueName: \"kubernetes.io/projected/7a2664cc-cab4-4163-9d3c-2d72faf56539-values\") pod \"helm-install-nix-grpc-farm-5mtbd\" (UID: \"7a2664cc-cab4-4163-9d3c-2d72faf56539\") " pod="kube-system/helm-install-nix-grpc-farm-5mtbd" machine # [ 33.664823] k3s[870]: I0930 09:11:38.547470 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-247kk\" (UniqueName: \"kubernetes.io/projected/7a2664cc-cab4-4163-9d3c-2d72faf56539-kube-api-access-247kk\") pod \"helm-install-nix-grpc-farm-5mtbd\" (UID: \"7a2664cc-cab4-4163-9d3c-2d72faf56539\") " pod="kube-system/helm-install-nix-grpc-farm-5mtbd" machine # [ 33.665759] k3s[870]: I0930 09:11:38.547499 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d467dcf4-6850-4868-b03d-5303497938e3-config-volume\") pod \"coredns-54996dc9b4-fhw9c\" (UID: \"d467dcf4-6850-4868-b03d-5303497938e3\") " pod="kube-system/coredns-54996dc9b4-fhw9c" machine # [ 33.666248] k3s[870]: I0930 09:11:38.547549 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a2664cc-cab4-4163-9d3c-2d72faf56539-klipper-cache\") pod \"helm-install-nix-grpc-farm-5mtbd\" (UID: \"7a2664cc-cab4-4163-9d3c-2d72faf56539\") " pod="kube-system/helm-install-nix-grpc-farm-5mtbd" machine # [ 33.666680] k3s[870]: I0930 09:11:38.547706 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/7a2664cc-cab4-4163-9d3c-2d72faf56539-klipper-config\") pod \"helm-install-nix-grpc-farm-5mtbd\" (UID: \"7a2664cc-cab4-4163-9d3c-2d72faf56539\") " pod="kube-system/helm-install-nix-grpc-farm-5mtbd" machine # [ 33.667409] k3s[870]: I0930 09:11:38.547985 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a2664cc-cab4-4163-9d3c-2d72faf56539-tmp\") pod \"helm-install-nix-grpc-farm-5mtbd\" (UID: \"7a2664cc-cab4-4163-9d3c-2d72faf56539\") " pod="kube-system/helm-install-nix-grpc-farm-5mtbd" machine # [ 33.687769] k3s[870]: I0930 09:11:38.571646 870 server.go:228] "Successfully retrieved NodeIPs" NodeIPs=["10.0.2.15","fec0::1873:b5ec:892e:bb88"] machine # [ 33.689792] k3s[870]: E0930 09:11:38.573825 870 server.go:265] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`" machine # [ 33.710671] k3s[870]: I0930 09:11:38.594599 870 server.go:274] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4" machine # [ 33.710830] k3s[870]: I0930 09:11:38.594674 870 server_linux.go:137] "Using iptables Proxier" machine # [ 33.730641] k3s[870]: I0930 09:11:38.614679 870 proxier.go:241] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4" machine # [ 33.743728] k3s[870]: I0930 09:11:38.627742 870 server.go:539] "Version info" version="v1.36.4+k3s1" machine # [ 33.744060] k3s[870]: I0930 09:11:38.627806 870 server.go:541] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 33.745445] k3s[870]: I0930 09:11:38.629508 870 config.go:200] "Starting service config controller" machine # [ 33.746079] k3s[870]: I0930 09:11:38.629530 870 shared_informer.go:381] "Waiting for caches to sync" controller="service config" machine # [ 33.746609] k3s[870]: I0930 09:11:38.629574 870 config.go:106] "Starting endpoint slice config controller" machine # [ 33.747136] k3s[870]: I0930 09:11:38.629586 870 shared_informer.go:381] "Waiting for caches to sync" controller="endpoint slice config" machine # [ 33.747593] k3s[870]: I0930 09:11:38.629616 870 config.go:403] "Starting serviceCIDR config controller" machine # [ 33.748210] k3s[870]: I0930 09:11:38.629629 870 shared_informer.go:381] "Waiting for caches to sync" controller="serviceCIDR config" machine # [ 33.748890] k3s[870]: I0930 09:11:38.629983 870 config.go:309] "Starting node config controller" machine # [ 33.749685] k3s[870]: I0930 09:11:38.630000 870 shared_informer.go:381] "Waiting for caches to sync" controller="node config" machine # [ 33.845971] k3s[870]: I0930 09:11:38.729985 870 shared_informer.go:388] "Caches are synced" controller="endpoint slice config" machine # [ 33.846209] k3s[870]: I0930 09:11:38.730052 870 shared_informer.go:388] "Caches are synced" controller="node config" machine # [ 33.846704] k3s[870]: I0930 09:11:38.730076 870 shared_informer.go:388] "Caches are synced" controller="serviceCIDR config" machine # [ 33.889247] k3s[870]: I0930 09:11:38.772859 870 kube.go:163] Node controller sync successful machine # [ 33.889539] k3s[870]: I0930 09:11:38.772927 870 vxlan.go:128] VXLAN config: VNI=1 Port=0 GBP=false Learning=false DirectRouting=false machine # [ 33.892257] k3s[870]: I0930 09:11:38.776176 870 kube.go:704] List of node(machine) annotations: map[string]string{"alpha.kubernetes.io/provided-node-ip":"10.0.2.15,fec0::1873:b5ec:892e:bb88", "k3s.io/hostname":"machine", "k3s.io/internal-ip":"10.0.2.15,fec0::1873:b5ec:892e:bb88", "k3s.io/node-args":"[\"server\",\"--disable\",\"traefik\",\"--disable\",\"metrics-server\",\"--disable\",\"local-storage\",\"--kubelet-arg\",\"eviction-hard=nodefs.available\\u003c1%,imagefs.available\\u003c1%\"]", "k3s.io/node-config-hash":"EFXPOZ7ZWHRCLFNW4X4ZDPFQMSAOP3BLEIN2VE47TDRKQ4UIWKUQ====", "k3s.io/node-env":"{}", "node.alpha.kubernetes.io/ttl":"0", "volumes.kubernetes.io/controller-managed-attach-detach":"true"} machine # [ 33.917361] (udev-worker)[1308]: Network interface NamePolicy= disabled on kernel command line. machine # [ 33.924667] k3s[870]: I0930 09:11:38.808712 870 kube.go:558] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.42.0.0/24] machine # [ 33.927047] k3s[870]: I0930 09:11:38.811074 870 iptables.go:50] Starting flannel in iptables mode... machine # [ 33.928380] k3s[870]: time="2026-09-30T09:11:38Z" level=warning msg="no subnet found for key: FLANNEL_NETWORK in file: /run/flannel/subnet.env" machine # [ 33.930162] k3s[870]: time="2026-09-30T09:11:38Z" level=warning msg="no subnet found for key: FLANNEL_SUBNET in file: /run/flannel/subnet.env" machine # [ 33.931828] k3s[870]: time="2026-09-30T09:11:38Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_NETWORK in file: /run/flannel/subnet.env" machine # [ 33.933656] k3s[870]: time="2026-09-30T09:11:38Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_SUBNET in file: /run/flannel/subnet.env" machine # [ 33.935379] k3s[870]: I0930 09:11:38.811801 870 iptables.go:101] Current network or subnet (10.42.0.0/16, 10.42.0.0/24) is not equal to previous one (0.0.0.0/0, 0.0.0.0/0), trying to recycle old iptables rules machine # [ 33.946389] k3s[870]: I0930 09:11:38.830440 870 shared_informer.go:388] "Caches are synced" controller="service config" machine # [ 33.957334] dhcpcd[680]: flannel.1: IAID ab:74:91:38 machine # [ 33.958395] dhcpcd[680]: flannel.1: adding address fe80::9c49:abff:fe74:9138 machine # [ 33.987041] dhcpcd[680]: flannel.1: soliciting a DHCP lease machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 34.019620] k3s[870]: I0930 09:11:38.903625 870 iptables.go:111] Setting up masking rules machine # [ 34.041868] k3s[870]: I0930 09:11:38.925921 870 iptables.go:212] Changing default FORWARD chain policy to ACCEPT machine # [ 34.052915] k3s[870]: E0930 09:11:38.936966 870 remote_runtime.go:237] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"4e938d8c4ca8fb72ec9f294c909fd48c9188e21469828238a452a29922c491e0\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" machine # [ 34.058919] k3s[870]: E0930 09:11:38.941970 870 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"4e938d8c4ca8fb72ec9f294c909fd48c9188e21469828238a452a29922c491e0\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/helm-install-nix-grpc-farm-5mtbd" machine # [ 34.063675] k3s[870]: E0930 09:11:38.942000 870 kuberuntime_manager.go:1640] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"4e938d8c4ca8fb72ec9f294c909fd48c9188e21469828238a452a29922c491e0\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/helm-install-nix-grpc-farm-5mtbd" machine # [ 34.068931] k3s[870]: E0930 09:11:38.942083 870 pod_workers.go:1338] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"helm-install-nix-grpc-farm-5mtbd_kube-system(7a2664cc-cab4-4163-9d3c-2d72faf56539)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"helm-install-nix-grpc-farm-5mtbd_kube-system(7a2664cc-cab4-4163-9d3c-2d72faf56539)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"4e938d8c4ca8fb72ec9f294c909fd48c9188e21469828238a452a29922c491e0\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/helm-install-nix-grpc-farm-5mtbd" podUID="7a2664cc-cab4-4163-9d3c-2d72faf56539" machine # [ 34.077120] k3s[870]: time="2026-09-30T09:11:38Z" level=info msg="Wrote flannel subnet file to /run/flannel/subnet.env" machine # [ 34.078864] k3s[870]: time="2026-09-30T09:11:38Z" level=info msg="Running flannel backend" machine # [ 34.080216] k3s[870]: I0930 09:11:38.942512 870 vxlan_network.go:68] watching for new subnet leases machine # [ 34.081644] k3s[870]: I0930 09:11:38.942600 870 vxlan_network.go:115] starting vxlan device watcher machine # [ 34.082947] k3s[870]: E0930 09:11:38.966108 870 remote_runtime.go:237] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"cd3c08d479e98740b1d2974ba0e33a9e37d9ef7ff2f06aeee37ff76b9214219e\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" machine # [ 34.087178] k3s[870]: E0930 09:11:38.966213 870 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"cd3c08d479e98740b1d2974ba0e33a9e37d9ef7ff2f06aeee37ff76b9214219e\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-54996dc9b4-fhw9c" machine # [ 34.091779] k3s[870]: E0930 09:11:38.966238 870 kuberuntime_manager.go:1640] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"cd3c08d479e98740b1d2974ba0e33a9e37d9ef7ff2f06aeee37ff76b9214219e\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-54996dc9b4-fhw9c" machine # [ 34.096455] k3s[870]: E0930 09:11:38.966328 870 pod_workers.go:1338] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-54996dc9b4-fhw9c_kube-system(d467dcf4-6850-4868-b03d-5303497938e3)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-54996dc9b4-fhw9c_kube-system(d467dcf4-6850-4868-b03d-5303497938e3)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"cd3c08d479e98740b1d2974ba0e33a9e37d9ef7ff2f06aeee37ff76b9214219e\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-54996dc9b4-fhw9c" podUID="d467dcf4-6850-4868-b03d-5303497938e3" machine # [ 34.137691] k3s[870]: I0930 09:11:39.021453 870 iptables.go:358] bootstrap done machine # [ 34.177513] k3s[870]: I0930 09:11:39.061431 870 iptables.go:358] bootstrap done machine # [ 34.992736] k3s[870]: time="2026-09-30T09:11:39Z" level=info msg="Starting network policy controller version v2.6.3-k3s1, built on 1970-01-01T01:01:01Z, go1.26.7" machine # [ 34.992894] k3s[870]: I0930 09:11:39.876440 870 network_policy_controller.go:164] Starting network policy controller machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 35.195682] k3s[870]: I0930 09:11:40.079689 870 network_policy_controller.go:179] Starting network policy controller full sync goroutine machine # [ 35.687274] k3s[870]: time="2026-09-30T09:11:40Z" level=info msg="Imported docker.io/rancher/klipper-helm:v0.13.3-build20260727" machine # [ 35.692920] k3s[870]: time="2026-09-30T09:11:40Z" level=info msg="Tagged docker.io/rancher/klipper-helm@sha256:5425a2b4613d2458dbdff99218e8d487ebb59c20e7a941f061c0777070f0aac1" machine # [ 35.697197] k3s[870]: time="2026-09-30T09:11:40Z" level=info msg="Imported docker.io/rancher/klipper-lb:v0.4.17" machine # [ 35.698676] k3s[870]: time="2026-09-30T09:11:40Z" level=info msg="Tagged docker.io/rancher/klipper-lb@sha256:910944bb0bd94f060a82a56ca1ea1c577d3e49b3473a093a47a985f32e92d94a" machine # [ 35.701019] k3s[870]: time="2026-09-30T09:11:40Z" level=info msg="Imported docker.io/rancher/local-path-provisioner:v0.0.37" machine # [ 35.702740] k3s[870]: time="2026-09-30T09:11:40Z" level=info msg="Tagged docker.io/rancher/local-path-provisioner@sha256:e757967a5ec338f6a9b371c5a9688bedaa8c3578ea3dd4db329ea0084be0a86f" machine # [ 35.705157] k3s[870]: time="2026-09-30T09:11:40Z" level=info msg="Imported docker.io/rancher/mirrored-coredns-coredns:1.14.6" machine # [ 35.709604] k3s[870]: time="2026-09-30T09:11:40Z" level=info msg="Tagged docker.io/rancher/mirrored-coredns-coredns@sha256:900f9c109f7a33545d3c811516e8376df9019147b750f5ce3e254468769176ea" machine # [ 35.712232] k3s[870]: time="2026-09-30T09:11:40Z" level=info msg="Imported docker.io/rancher/mirrored-library-busybox:1.37.0" machine # [ 35.713105] k3s[870]: time="2026-09-30T09:11:40Z" level=info msg="Tagged docker.io/rancher/mirrored-library-busybox@sha256:101b4afd76732482eff9b95cae5f94bcf295e521fbec4e01b69c5421f3f3f3e5" machine # [ 35.713953] k3s[870]: time="2026-09-30T09:11:40Z" level=info msg="Imported docker.io/rancher/mirrored-library-traefik:3.7.8" machine # [ 35.718040] k3s[870]: time="2026-09-30T09:11:40Z" level=info msg="Tagged docker.io/rancher/mirrored-library-traefik@sha256:4299bbed850421258fc5448c2e0e6ad350981d4d335a68de11b92448aedbefe5" machine # [ 35.718416] k3s[870]: time="2026-09-30T09:11:40Z" level=info msg="Imported docker.io/rancher/mirrored-metrics-server:v0.9.0" machine # [ 35.723276] k3s[870]: time="2026-09-30T09:11:40Z" level=info msg="Tagged docker.io/rancher/mirrored-metrics-server@sha256:d9862115e7c7881280d3d75ca26bda8ffc0fc213315979575bf23ce9826205c0" machine # [ 35.723545] k3s[870]: time="2026-09-30T09:11:40Z" level=info msg="Imported docker.io/rancher/mirrored-pause:3.10.2" machine # [ 35.731262] k3s[870]: time="2026-09-30T09:11:40Z" level=info msg="Tagged docker.io/rancher/mirrored-pause@sha256:f548e0e8e3dc1896ca956272154dde3314e8cc4fde0a57577ee9fa1c63f5baf4" machine # [ 35.997918] dhcpcd[680]: flannel.1: soliciting an IPv6 router machine # [ 36.062728] k3s[870]: time="2026-09-30T09:11:40Z" level=info msg="Imported 8 images from /var/lib/rancher/k3s/agent/images/nixos/smddpgqzjvlqv3lx57wdzl7kma805fj0-k3s-airgap-images-amd64.tar.zst in 3.776050028s" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 36.670452] k3s[870]: I0930 09:11:41.554283 870 node_lifecycle_controller.go:1217] "Initializing eviction metric for zone" zone="" machine # [ 36.671480] k3s[870]: I0930 09:11:41.554513 870 node_lifecycle_controller.go:869] "Missing timestamp for Node. Assuming now as a timestamp" node="machine" machine # [ 36.673182] k3s[870]: I0930 09:11:41.554702 870 node_lifecycle_controller.go:1063] "Controller detected that zone is now in new state" zone="" newState="Normal" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 38.988125] dhcpcd[680]: flannel.1: probing for an IPv4LL address machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 44.520085] dhcpcd[680]: flannel.1: using IPv4LL address 169.254.229.196 machine # [ 44.520522] dhcpcd[680]: flannel.1: adding route to 169.254.0.0/16 machine # [ 44.985318] cni0: port 1(veth8a65c347) entered blocking state machine # [ 44.985919] cni0: port 1(veth8a65c347) entered disabled state machine # [ 44.986656] veth8a65c347: entered allmulticast mode machine # [ 44.987417] veth8a65c347: entered promiscuous mode machine # [ 45.007299] cni0: port 1(veth8a65c347) entered blocking state machine # [ 45.008577] cni0: port 1(veth8a65c347) entered forwarding state machine # [ 44.864220] (udev-worker)[1809]: Network interface NamePolicy= disabled on kernel command line. machine # [ 44.868253] (udev-worker)[1812]: Network interface NamePolicy= disabled on kernel command line. machine # [ 44.895827] dhcpcd[680]: veth8a65c347: IAID e9:5e:81:1d machine # [ 44.896942] dhcpcd[680]: veth8a65c347: adding address fe80::2466:e9ff:fe5e:811d machine # [ 44.920240] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount470369639.mount: Deactivated successfully. machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 44.998369] systemd[1]: Started libcontainer container fdf2e0ad4ebd2208d19c5721c5ee3beedcd3ddf67ced2de17b85276db7423ba3. machine # [ 45.133268] dhcpcd[680]: veth8a65c347: soliciting a DHCP lease machine # [ 45.744605] systemd[1]: Started libcontainer container 83d83309aec05fdf4c96f76ee3ffb482645dced9d3aed83f6bee0163748ae7f3. machine # [ 45.971430] cni0: port 2(veth090a6d55) entered blocking state machine # [ 45.972216] cni0: port 2(veth090a6d55) entered disabled state machine # [ 45.972824] veth090a6d55: entered allmulticast mode machine # [ 45.973720] veth090a6d55: entered promiscuous mode machine # [ 45.987430] cni0: port 2(veth090a6d55) entered blocking state machine # [ 45.988138] cni0: port 2(veth090a6d55) entered forwarding state machine # [ 45.860126] k3s[870]: I0930 09:11:50.743822 870 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/coredns-54996dc9b4-fhw9c" podStartSLOduration=18.743796064 podStartE2EDuration="18.743796064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-30 09:11:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 09:11:50.742829461 +0000 UTC m=+30.444052803" watchObservedRunningTime="2026-09-30 09:11:50.743796064 +0000 UTC m=+30.445019406" machine # [ 45.872255] dhcpcd[680]: veth090a6d55: waiting for carrier machine # [ 45.873239] dhcpcd[680]: veth090a6d55: carrier acquired machine # [ 45.879067] dhcpcd[680]: veth090a6d55: IAID 7d:8b:57:b0 machine # [ 45.879410] dhcpcd[680]: veth090a6d55: adding address fe80::a01b:7dff:fe8b:57b0 machine # [ 45.942562] systemd[1]: Started libcontainer container aab9c86d4f686195d237de3d6f53a73cd375114208f2ac33897c2813558e4ff5. machine # [ 46.163427] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount726790160.mount: Deactivated successfully. machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 46.564473] dhcpcd[680]: veth8a65c347: soliciting an IPv6 router machine # [ 46.881988] systemd[1]: Started libcontainer container 939ae91a0a8a3c3c11ac12eb7ee7d3a964efb349b27019db662544813f0b1c5a. machine # [ 47.383958] dhcpcd[680]: veth090a6d55: soliciting a DHCP lease machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 47.855537] k3s[870]: I0930 09:11:52.738814 870 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/helm-install-nix-grpc-farm-5mtbd" podStartSLOduration=20.738774476 podStartE2EDuration="20.738774476s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-30 09:11:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 09:11:51.851540484 +0000 UTC m=+31.552764105" watchObservedRunningTime="2026-09-30 09:11:52.738774476 +0000 UTC m=+32.440000891" machine # [ 48.002581] dhcpcd[680]: flannel.1: no IPv6 Routers available machine # [ 48.084934] k3s[870]: I0930 09:11:52.968926 870 alloc.go:329] "allocated clusterIPs" service="farm/nix-grpc-farm" clusterIPs={"IPv4":"10.43.97.210"} machine # [ 48.132148] systemd[1]: cri-containerd-939ae91a0a8a3c3c11ac12eb7ee7d3a964efb349b27019db662544813f0b1c5a.scope: Deactivated successfully. machine # [ 48.133871] systemd[1]: cri-containerd-939ae91a0a8a3c3c11ac12eb7ee7d3a964efb349b27019db662544813f0b1c5a.scope: Consumed 688ms CPU time over 1.250s wall clock time, 35.1M memory peak, 2.6M incoming IP traffic, 147.7K outgoing IP traffic. machine # [ 48.164558] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-939ae91a0a8a3c3c11ac12eb7ee7d3a964efb349b27019db662544813f0b1c5a-rootfs.mount: Deactivated successfully. machine # [ 48.645053] k3s[870]: E0930 09:11:53.529067 870 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-scheduler-55cccf6d96\" failed with read version: 473 is not as new as written version: 480 for group resource replicasets.apps" logger="UnhandledError" machine # [ 48.650211] k3s[870]: E0930 09:11:53.534264 870 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-scheduler-55cccf6d96\" failed with read version: 473 is not as new as written version: 480 for group resource replicasets.apps" logger="UnhandledError" machine # [ 48.653988] k3s[870]: E0930 09:11:53.538054 870 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7\" failed with read version: 473 is not as new as written version: 483 for group resource replicasets.apps" logger="UnhandledError" machine # [ 48.660085] k3s[870]: E0930 09:11:53.541411 870 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7\" failed with read version: 473 is not as new as written version: 483 for group resource replicasets.apps" logger="UnhandledError" machine # [ 48.663377] k3s[870]: E0930 09:11:53.541881 870 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-lb-5877cc8b4f\" failed with read version: 473 is not as new as written version: 481 for group resource replicasets.apps" logger="UnhandledError" machine # [ 48.666604] k3s[870]: E0930 09:11:53.542322 870 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-scheduler-55cccf6d96\" failed with read version: 473 is not as new as written version: 480 for group resource replicasets.apps" logger="UnhandledError" machine # [ 48.669819] k3s[870]: E0930 09:11:53.543073 870 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-lb-5877cc8b4f\" failed with read version: 473 is not as new as written version: 481 for group resource replicasets.apps" logger="UnhandledError" machine # [ 48.676065] k3s[870]: E0930 09:11:53.543497 870 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7\" failed with read version: 473 is not as new as written version: 483 for group resource replicasets.apps" logger="UnhandledError" machine # [ 48.694590] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod305fb344_15d9_4cbf_9bb2_c613009928d8.slice. machine # [ 48.696667] k3s[870]: E0930 09:11:53.579495 870 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7\" failed with read version: 483 is not as new as written version: 492 for group resource replicasets.apps" logger="UnhandledError" machine # [ 48.711691] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod03fa7db5_0d03_4adf_81a0_53d4f977873a.slice. machine # [ 48.722742] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod07e2e77d_25d6_4897_844a_c54cca7ad934.slice. machine # [ 48.732411] systemd[1]: Created slice libcontainer container kubepods-besteffort-podd0449804_2b9e_40ed_95ea_86a1bb9ac837.slice. machine # [ 48.768826] k3s[870]: I0930 09:11:53.652826 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/07e2e77d-25d6-4897-844a-c54cca7ad934-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-v5ns4\" (UID: \"07e2e77d-25d6-4897-844a-c54cca7ad934\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-v5ns4" machine # [ 48.769270] k3s[870]: I0930 09:11:53.652874 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/07e2e77d-25d6-4897-844a-c54cca7ad934-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-v5ns4\" (UID: \"07e2e77d-25d6-4897-844a-c54cca7ad934\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-v5ns4" machine # [ 48.769695] k3s[870]: I0930 09:11:53.652983 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/d0449804-2b9e-40ed-95ea-86a1bb9ac837-build\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-k8556\" (UID: \"d0449804-2b9e-40ed-95ea-86a1bb9ac837\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-k8556" machine # [ 48.781676] k3s[870]: I0930 09:11:53.665715 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d0449804-2b9e-40ed-95ea-86a1bb9ac837-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-k8556\" (UID: \"d0449804-2b9e-40ed-95ea-86a1bb9ac837\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-k8556" machine # [ 48.782184] k3s[870]: I0930 09:11:53.665767 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/07e2e77d-25d6-4897-844a-c54cca7ad934-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-v5ns4\" (UID: \"07e2e77d-25d6-4897-844a-c54cca7ad934\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-v5ns4" machine # [ 48.782770] k3s[870]: I0930 09:11:53.665792 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/07e2e77d-25d6-4897-844a-c54cca7ad934-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-v5ns4\" (UID: \"07e2e77d-25d6-4897-844a-c54cca7ad934\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-v5ns4" machine # [ 48.794371] k3s[870]: I0930 09:11:53.665816 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/d0449804-2b9e-40ed-95ea-86a1bb9ac837-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-k8556\" (UID: \"d0449804-2b9e-40ed-95ea-86a1bb9ac837\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-k8556" machine # [ 48.794818] k3s[870]: I0930 09:11:53.678154 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82vht\" (UniqueName: \"kubernetes.io/projected/d0449804-2b9e-40ed-95ea-86a1bb9ac837-kube-api-access-82vht\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-k8556\" (UID: \"d0449804-2b9e-40ed-95ea-86a1bb9ac837\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-k8556" machine # [ 48.795479] k3s[870]: I0930 09:11:53.678263 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/03fa7db5-0d03-4adf-81a0-53d4f977873a-config\") pod \"nix-grpc-farm-lb-5877cc8b4f-rrkbq\" (UID: \"03fa7db5-0d03-4adf-81a0-53d4f977873a\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-rrkbq" machine # [ 48.795947] k3s[870]: I0930 09:11:53.678288 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/d0449804-2b9e-40ed-95ea-86a1bb9ac837-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-k8556\" (UID: \"d0449804-2b9e-40ed-95ea-86a1bb9ac837\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-k8556" machine # [ 48.796674] k3s[870]: I0930 09:11:53.678324 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/305fb344-15d9-4cbf-9bb2-c613009928d8-ca\") pod \"nix-grpc-farm-scheduler-55cccf6d96-kdsmc\" (UID: \"305fb344-15d9-4cbf-9bb2-c613009928d8\") " pod="farm/nix-grpc-farm-scheduler-55cccf6d96-kdsmc" machine # [ 48.797301] k3s[870]: I0930 09:11:53.678354 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/03fa7db5-0d03-4adf-81a0-53d4f977873a-tls-lb\") pod \"nix-grpc-farm-lb-5877cc8b4f-rrkbq\" (UID: \"03fa7db5-0d03-4adf-81a0-53d4f977873a\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-rrkbq" machine # [ 48.797674] k3s[870]: I0930 09:11:53.678381 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/07e2e77d-25d6-4897-844a-c54cca7ad934-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-v5ns4\" (UID: \"07e2e77d-25d6-4897-844a-c54cca7ad934\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-v5ns4" machine # [ 48.798245] k3s[870]: I0930 09:11:53.678405 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/d0449804-2b9e-40ed-95ea-86a1bb9ac837-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-k8556\" (UID: \"d0449804-2b9e-40ed-95ea-86a1bb9ac837\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-k8556" machine # [ 48.798673] k3s[870]: I0930 09:11:53.678429 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bq7l\" (UniqueName: \"kubernetes.io/projected/305fb344-15d9-4cbf-9bb2-c613009928d8-kube-api-access-7bq7l\") pod \"nix-grpc-farm-scheduler-55cccf6d96-kdsmc\" (UID: \"305fb344-15d9-4cbf-9bb2-c613009928d8\") " pod="farm/nix-grpc-farm-scheduler-55cccf6d96-kdsmc" machine # [ 48.799213] k3s[870]: I0930 09:11:53.678459 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03fa7db5-0d03-4adf-81a0-53d4f977873a-tmp\") pod \"nix-grpc-farm-lb-5877cc8b4f-rrkbq\" (UID: \"03fa7db5-0d03-4adf-81a0-53d4f977873a\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-rrkbq" machine # [ 48.799669] k3s[870]: I0930 09:11:53.678496 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/07e2e77d-25d6-4897-844a-c54cca7ad934-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-v5ns4\" (UID: \"07e2e77d-25d6-4897-844a-c54cca7ad934\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-v5ns4" machine # [ 48.839390] k3s[870]: I0930 09:11:53.723372 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/07e2e77d-25d6-4897-844a-c54cca7ad934-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-v5ns4\" (UID: \"07e2e77d-25d6-4897-844a-c54cca7ad934\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-v5ns4" machine # [ 48.839958] k3s[870]: I0930 09:11:53.723458 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/305fb344-15d9-4cbf-9bb2-c613009928d8-niks3-token\") pod \"nix-grpc-farm-scheduler-55cccf6d96-kdsmc\" (UID: \"305fb344-15d9-4cbf-9bb2-c613009928d8\") " pod="farm/nix-grpc-farm-scheduler-55cccf6d96-kdsmc" machine # [ 48.840609] k3s[870]: I0930 09:11:53.723489 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/305fb344-15d9-4cbf-9bb2-c613009928d8-oidc\") pod \"nix-grpc-farm-scheduler-55cccf6d96-kdsmc\" (UID: \"305fb344-15d9-4cbf-9bb2-c613009928d8\") " pod="farm/nix-grpc-farm-scheduler-55cccf6d96-kdsmc" machine # [ 48.841233] k3s[870]: I0930 09:11:53.723514 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7qvt\" (UniqueName: \"kubernetes.io/projected/07e2e77d-25d6-4897-844a-c54cca7ad934-kube-api-access-n7qvt\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-v5ns4\" (UID: \"07e2e77d-25d6-4897-844a-c54cca7ad934\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-v5ns4" machine # [ 48.841661] k3s[870]: I0930 09:11:53.723539 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/d0449804-2b9e-40ed-95ea-86a1bb9ac837-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-k8556\" (UID: \"d0449804-2b9e-40ed-95ea-86a1bb9ac837\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-k8556" machine # [ 48.842215] k3s[870]: I0930 09:11:53.723629 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/d0449804-2b9e-40ed-95ea-86a1bb9ac837-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-k8556\" (UID: \"d0449804-2b9e-40ed-95ea-86a1bb9ac837\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-k8556" machine # [ 48.842865] dhcpcd[680]: veth090a6d55: soliciting an IPv6 router machine # [ 48.865603] k3s[870]: I0930 09:11:53.749214 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/d0449804-2b9e-40ed-95ea-86a1bb9ac837-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-k8556\" (UID: \"d0449804-2b9e-40ed-95ea-86a1bb9ac837\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-k8556" machine # [ 48.865886] k3s[870]: I0930 09:11:53.749261 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/03fa7db5-0d03-4adf-81a0-53d4f977873a-tls-ca\") pod \"nix-grpc-farm-lb-5877cc8b4f-rrkbq\" (UID: \"03fa7db5-0d03-4adf-81a0-53d4f977873a\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-rrkbq" machine # [ 48.866574] k3s[870]: I0930 09:11:53.749285 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/07e2e77d-25d6-4897-844a-c54cca7ad934-build\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-v5ns4\" (UID: \"07e2e77d-25d6-4897-844a-c54cca7ad934\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-v5ns4" machine # [ 48.867139] k3s[870]: I0930 09:11:53.749378 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/305fb344-15d9-4cbf-9bb2-c613009928d8-tls\") pod \"nix-grpc-farm-scheduler-55cccf6d96-kdsmc\" (UID: \"305fb344-15d9-4cbf-9bb2-c613009928d8\") " pod="farm/nix-grpc-farm-scheduler-55cccf6d96-kdsmc" machine # [ 49.194739] cni0: port 3(vethdb6c57f6) entered blocking state machine # [ 49.195586] cni0: port 3(vethdb6c57f6) entered disabled state machine # [ 49.196895] vethdb6c57f6: entered allmulticast mode machine # [ 49.197902] vethdb6c57f6: entered promiscuous mode machine # [ 49.206717] cni0: port 4(vethb1cab76c) entered blocking state machine # [ 49.207554] cni0: port 4(vethb1cab76c) entered disabled state machine # [ 49.208299] vethb1cab76c: entered allmulticast mode machine # [ 49.208905] vethb1cab76c: entered promiscuous mode machine # [ 49.211444] cni0: port 3(vethdb6c57f6) entered blocking state machine # [ 49.212154] cni0: port 3(vethdb6c57f6) entered forwarding state machine # [ 49.215099] cni0: port 4(vethb1cab76c) entered blocking state machine # [ 49.215827] cni0: port 4(vethb1cab76c) entered forwarding state machine # [ 49.088553] (udev-worker)[2384]: Network interface NamePolicy= disabled on kernel command line. machine # [ 49.093508] (udev-worker)[2392]: Network interface NamePolicy= disabled on kernel command line. machine # [ 49.120216] dhcpcd[680]: vethdb6c57f6: IAID fa:dd:9a:56 machine # [ 49.120588] dhcpcd[680]: vethdb6c57f6: adding address fe80::3431:faff:fedd:9a56 machine # [ 49.281155] cni0: port 5(vethd6ac9baa) entered blocking state machine # [ 49.281887] cni0: port 5(vethd6ac9baa) entered disabled state machine # [ 49.284030] vethd6ac9baa: entered allmulticast mode machine # [ 49.284771] vethd6ac9baa: entered promiscuous mode machine # [ 49.132822] (udev-worker)[2440]: Network interface NamePolicy= disabled on kernel command line. machine # [ 49.292012] cni0: port 6(vethaac681c9) entered blocking state machine # [ 49.292824] cni0: port 6(vethaac681c9) entered disabled state machine # [ 49.293737] vethaac681c9: entered allmulticast mode machine # [ 49.294605] vethaac681c9: entered promiscuous mode machine # [ 49.299238] cni0: port 5(vethd6ac9baa) entered blocking state machine # [ 49.299971] cni0: port 5(vethd6ac9baa) entered forwarding state machine # [ 49.145503] dhcpcd[680]: vethb1cab76c: IAID c0:ed:3a:88 machine # [ 49.147111] dhcpcd[680]: vethb1cab76c: adding address fe80::5895:c0ff:feed:3a88 machine # [ 49.161585] dhcpcd[680]: vethd6ac9baa: IAID b8:5b:09:43 machine # [ 49.162202] dhcpcd[680]: vethd6ac9baa: adding address fe80::6019:b8ff:fe5b:943 machine # [ 49.318862] cni0: port 6(vethaac681c9) entered blocking state machine # [ 49.319542] cni0: port 6(vethaac681c9) entered forwarding state machine # [ 49.202295] dhcpcd[680]: vethaac681c9: waiting for carrier machine # [ 49.202682] systemd[1]: Started libcontainer container 6ba6c26e150ab077b8deedcb55035db1b43df9a48b135ba6915a015ddf6f33b6. machine # [ 49.203350] dhcpcd[680]: vethaac681c9: carrier acquired machine # [ 49.210121] dhcpcd[680]: vethaac681c9: IAID 65:9c:73:0b machine # [ 49.210493] dhcpcd[680]: vethaac681c9: adding address fe80::801a:65ff:fe9c:730b machine # [ 49.226286] systemd[1]: Started libcontainer container 4749f655f79a1c0b9d3df6c33989a4da274aba86029d0f17a2fb3b8ed5b3f362. machine # [ 49.265571] systemd[1]: Started libcontainer container c06781e6ceb58daf586159515a27dbee215a246a6037efec7fc622b3820f8c7b. machine # [ 49.293484] systemd[1]: Started libcontainer container dcc1fed157ee00633f12251d303fb16baea271eedd8564f1832a05e3c9a1c3c2. machine # [ 49.557824] dhcpcd[680]: vethdb6c57f6: soliciting a DHCP lease machine # [ 49.749730] dhcpcd[680]: vethb1cab76c: soliciting a DHCP lease machine # [ 49.924799] systemd[1]: cri-containerd-aab9c86d4f686195d237de3d6f53a73cd375114208f2ac33897c2813558e4ff5.scope: Deactivated successfully. machine # [ 50.134143] dhcpcd[680]: veth8a65c347: probing for an IPv4LL address machine # [ 50.175160] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-aab9c86d4f686195d237de3d6f53a73cd375114208f2ac33897c2813558e4ff5-rootfs.mount: Deactivated successfully. machine # [ 50.219922] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-aab9c86d4f686195d237de3d6f53a73cd375114208f2ac33897c2813558e4ff5-shm.mount: Deactivated successfully. machine # [ 50.405221] cni0: port 2(veth090a6d55) entered disabled state machine # [ 50.251252] dhcpcd[680]: veth090a6d55: carrier lost machine # [ 50.407292] veth090a6d55 (unregistering): left allmulticast mode machine # [ 50.408238] veth090a6d55 (unregistering): left promiscuous mode machine # [ 50.409198] cni0: port 2(veth090a6d55) entered disabled state machine # [ 50.271648] systemd[1]: run-netns-cni\x2d8d5f2abe\x2d3113\x2dfc37\x2d6b8e\x2d894939636b40.mount: Deactivated successfully. machine # [ 50.281256] dhcpcd[680]: veth090a6d55: deleting address fe80::a01b:7dff:fe8b:57b0 machine # [ 50.316359] dhcpcd[680]: veth090a6d55: removing interface machine # [ 50.376324] k3s[870]: I0930 09:11:55.259933 870 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7a2664cc-cab4-4163-9d3c-2d72faf56539-tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a2664cc-cab4-4163-9d3c-2d72faf56539-tmp\") pod \"7a2664cc-cab4-4163-9d3c-2d72faf56539\" (UID: \"7a2664cc-cab4-4163-9d3c-2d72faf56539\") " machine # [ 50.380930] k3s[870]: I0930 09:11:55.260004 870 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7a2664cc-cab4-4163-9d3c-2d72faf56539-kube-api-access-247kk\" (UniqueName: \"kubernetes.io/projected/7a2664cc-cab4-4163-9d3c-2d72faf56539-kube-api-access-247kk\") pod \"7a2664cc-cab4-4163-9d3c-2d72faf56539\" (UID: \"7a2664cc-cab4-4163-9d3c-2d72faf56539\") " machine # [ 50.386592] k3s[870]: I0930 09:11:55.260059 870 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7a2664cc-cab4-4163-9d3c-2d72faf56539-klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/7a2664cc-cab4-4163-9d3c-2d72faf56539-klipper-config\") pod \"7a2664cc-cab4-4163-9d3c-2d72faf56539\" (UID: \"7a2664cc-cab4-4163-9d3c-2d72faf56539\") " machine # [ 50.391131] k3s[870]: I0930 09:11:55.260165 870 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7a2664cc-cab4-4163-9d3c-2d72faf56539-content\" (UniqueName: \"kubernetes.io/configmap/7a2664cc-cab4-4163-9d3c-2d72faf56539-content\") pod \"7a2664cc-cab4-4163-9d3c-2d72faf56539\" (UID: \"7a2664cc-cab4-4163-9d3c-2d72faf56539\") " machine # [ 50.396574] k3s[870]: I0930 09:11:55.260217 870 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7a2664cc-cab4-4163-9d3c-2d72faf56539-klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/7a2664cc-cab4-4163-9d3c-2d72faf56539-klipper-helm\") pod \"7a2664cc-cab4-4163-9d3c-2d72faf56539\" (UID: \"7a2664cc-cab4-4163-9d3c-2d72faf56539\") " machine # [ 50.401469] k3s[870]: I0930 09:11:55.260249 870 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7a2664cc-cab4-4163-9d3c-2d72faf56539-values\" (UniqueName: \"kubernetes.io/projected/7a2664cc-cab4-4163-9d3c-2d72faf56539-values\") pod \"7a2664cc-cab4-4163-9d3c-2d72faf56539\" (UID: \"7a2664cc-cab4-4163-9d3c-2d72faf56539\") " machine # [ 50.406535] k3s[870]: I0930 09:11:55.260290 870 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7a2664cc-cab4-4163-9d3c-2d72faf56539-klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a2664cc-cab4-4163-9d3c-2d72faf56539-klipper-cache\") pod \"7a2664cc-cab4-4163-9d3c-2d72faf56539\" (UID: \"7a2664cc-cab4-4163-9d3c-2d72faf56539\") " machine # [ 50.406876] k3s[870]: I0930 09:11:55.265880 870 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a2664cc-cab4-4163-9d3c-2d72faf56539-tmp" pod "7a2664cc-cab4-4163-9d3c-2d72faf56539" (UID: "7a2664cc-cab4-4163-9d3c-2d72faf56539"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 50.407582] k3s[870]: I0930 09:11:55.266092 870 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a2664cc-cab4-4163-9d3c-2d72faf56539-kube-api-access-247kk" pod "7a2664cc-cab4-4163-9d3c-2d72faf56539" (UID: "7a2664cc-cab4-4163-9d3c-2d72faf56539"). InnerVolumeSpecName "kube-api-access-247kk". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 50.408189] k3s[870]: I0930 09:11:55.267697 870 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a2664cc-cab4-4163-9d3c-2d72faf56539-content" pod "7a2664cc-cab4-4163-9d3c-2d72faf56539" (UID: "7a2664cc-cab4-4163-9d3c-2d72faf56539"). InnerVolumeSpecName "content". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 50.408813] systemd[1]: var-lib-kubelet-pods-7a2664cc\x2dcab4\x2d4163\x2d9d3c\x2d2d72faf56539-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2d247kk.mount: Deactivated successfully. machine # [ 50.409618] k3s[870]: I0930 09:11:55.271103 870 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a2664cc-cab4-4163-9d3c-2d72faf56539-klipper-helm" pod "7a2664cc-cab4-4163-9d3c-2d72faf56539" (UID: "7a2664cc-cab4-4163-9d3c-2d72faf56539"). InnerVolumeSpecName "klipper-helm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 50.409990] k3s[870]: I0930 09:11:55.271265 870 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a2664cc-cab4-4163-9d3c-2d72faf56539-klipper-cache" pod "7a2664cc-cab4-4163-9d3c-2d72faf56539" (UID: "7a2664cc-cab4-4163-9d3c-2d72faf56539"). InnerVolumeSpecName "klipper-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 50.410518] k3s[870]: I0930 09:11:55.271567 870 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a2664cc-cab4-4163-9d3c-2d72faf56539-klipper-config" pod "7a2664cc-cab4-4163-9d3c-2d72faf56539" (UID: "7a2664cc-cab4-4163-9d3c-2d72faf56539"). InnerVolumeSpecName "klipper-config". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 50.410984] k3s[870]: I0930 09:11:55.275713 870 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a2664cc-cab4-4163-9d3c-2d72faf56539-values" pod "7a2664cc-cab4-4163-9d3c-2d72faf56539" (UID: "7a2664cc-cab4-4163-9d3c-2d72faf56539"). InnerVolumeSpecName "values". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 50.411754] systemd[1]: var-lib-kubelet-pods-7a2664cc\x2dcab4\x2d4163\x2d9d3c\x2d2d72faf56539-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dcache.mount: Deactivated successfully. machine # [ 50.412581] systemd[1]: var-lib-kubelet-pods-7a2664cc\x2dcab4\x2d4163\x2d9d3c\x2d2d72faf56539-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 50.477593] k3s[870]: I0930 09:11:55.361523 870 reconciler_common.go:299] "Volume detached for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/7a2664cc-cab4-4163-9d3c-2d72faf56539-klipper-config\") on node \"machine\" DevicePath \"\"" machine # [ 50.477817] k3s[870]: I0930 09:11:55.361557 870 reconciler_common.go:299] "Volume detached for volume \"content\" (UniqueName: \"kubernetes.io/configmap/7a2664cc-cab4-4163-9d3c-2d72faf56539-content\") on node \"machine\" DevicePath \"\"" machine # [ 50.478506] k3s[870]: I0930 09:11:55.361570 870 reconciler_common.go:299] "Volume detached for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/7a2664cc-cab4-4163-9d3c-2d72faf56539-klipper-helm\") on node \"machine\" DevicePath \"\"" machine # [ 50.479155] k3s[870]: I0930 09:11:55.361583 870 reconciler_common.go:299] "Volume detached for volume \"values\" (UniqueName: \"kubernetes.io/projected/7a2664cc-cab4-4163-9d3c-2d72faf56539-values\") on node \"machine\" DevicePath \"\"" machine # [ 50.479665] k3s[870]: I0930 09:11:55.361595 870 reconciler_common.go:299] "Volume detached for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a2664cc-cab4-4163-9d3c-2d72faf56539-klipper-cache\") on node \"machine\" DevicePath \"\"" machine # [ 50.480234] k3s[870]: I0930 09:11:55.361608 870 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a2664cc-cab4-4163-9d3c-2d72faf56539-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 50.480668] k3s[870]: I0930 09:11:55.361624 870 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-247kk\" (UniqueName: \"kubernetes.io/projected/7a2664cc-cab4-4163-9d3c-2d72faf56539-kube-api-access-247kk\") on node \"machine\" DevicePath \"\"" machine # [ 50.481262] dhcpcd[680]: vethd6ac9baa: soliciting a DHCP lease machine # [ 50.560346] systemd[1]: Started libcontainer container 8637c9f7ad1fc5408ab10cbb5bb501b5004d3596795cbad7e8536822898d2861. machine # [ 50.637685] k3s[870]: I0930 09:11:55.521593 870 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-5877cc8b4f-rrkbq" podStartSLOduration=2.521568378 podStartE2EDuration="2.521568378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-30 09:11:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 09:11:55.521145699 +0000 UTC m=+35.222369320" watchObservedRunningTime="2026-09-30 09:11:55.521568378 +0000 UTC m=+35.222792000" machine # [ 50.780509] dhcpcd[680]: vethdb6c57f6: soliciting an IPv6 router machine # [ 50.784134] systemd[1]: Removed slice libcontainer container kubepods-burstable-pod7a2664cc_cab4_4163_9d3c_2d72faf56539.slice. machine # [ 50.785394] systemd[1]: kubepods-burstable-pod7a2664cc_cab4_4163_9d3c_2d72faf56539.slice: Consumed 717ms CPU time over 17.139s wall clock time, 35.6M memory peak, 2.6M incoming IP traffic, 147.7K outgoing IP traffic. machine # [ 50.828183] dhcpcd[680]: vethaac681c9: soliciting an IPv6 router machine # [ 50.889520] dhcpcd[680]: vethaac681c9: soliciting a DHCP lease machine # [ 50.905490] k3s[870]: I0930 09:11:55.789492 870 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aab9c86d4f686195d237de3d6f53a73cd375114208f2ac33897c2813558e4ff5" machine # [ 50.905810] k3s[870]: E0930 09:11:55.789554 870 kubelet_pods.go:2193] "failed to read memory cgroup config for the pod" err="failed to read memory.max for cgroup /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a2664cc_cab4_4163_9d3c_2d72faf56539.slice: openat2 /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a2664cc_cab4_4163_9d3c_2d72faf56539.slice/memory.max: no such file or directory" podName="helm-install-nix-grpc-farm-5mtbd" machine # [ 50.906535] k3s[870]: E0930 09:11:55.789611 870 kubelet_pods.go:2198] "failed to read memory cgroup limits for the pod" err="failed to read cpu.max file for cgroup /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a2664cc_cab4_4163_9d3c_2d72faf56539.slice: openat2 /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a2664cc_cab4_4163_9d3c_2d72faf56539.slice/cpu.max: no such file or directory" podName="helm-install-nix-grpc-farm-5mtbd" machine # [ 50.987549] dhcpcd[680]: vethd6ac9baa: soliciting an IPv6 router machine # [ 51.167122] systemd[1]: var-lib-kubelet-pods-7a2664cc\x2dcab4\x2d4163\x2d9d3c\x2d2d72faf56539-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dhelm.mount: Deactivated successfully. machine # [ 51.167381] systemd[1]: var-lib-kubelet-pods-7a2664cc\x2dcab4\x2d4163\x2d9d3c\x2d2d72faf56539-volumes-kubernetes.io\x7eprojected-values.mount: Deactivated successfully. machine # [ 51.168794] systemd[1]: var-lib-kubelet-pods-7a2664cc\x2dcab4\x2d4163\x2d9d3c\x2d2d72faf56539-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dconfig.mount: Deactivated successfully. machine # [ 51.739846] dhcpcd[680]: vethb1cab76c: soliciting an IPv6 router machine # [ 54.559225] dhcpcd[680]: vethdb6c57f6: probing for an IPv4LL address machine # [ 54.750187] dhcpcd[680]: vethb1cab76c: probing for an IPv4LL address machine # [ 55.161061] dhcpcd[680]: veth8a65c347: using IPv4LL address 169.254.194.51 machine # [ 55.162276] dhcpcd[680]: veth8a65c347: adding route to 169.254.0.0/16 machine # [ 55.478961] dhcpcd[680]: vethd6ac9baa: probing for an IPv4LL address machine # [ 55.637814] systemd[1]: Started libcontainer container 72c798b1bf5ab39b658f5e9bd81439d21d994a592d7875f915f5cdd5beb3cc5c. machine # [ 55.675231] systemd[1]: tmp-ovl\x2didmapped3711811345.mount: Deactivated successfully. machine # [ 55.694275] systemd[1]: Started libcontainer container d8c54922de1589f3232841af7c2856c214eef70707b11c840daf481483e50b46. machine # [ 55.704331] systemd[1]: Started libcontainer container ae5b1b8374995e7a429e220bb2bb846df5d06302cc3fc3bf18dbcc7564b9b322. machine # [ 55.741135] k3s[870]: I0930 09:12:00.624717 870 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-scheduler-55cccf6d96-kdsmc" podStartSLOduration=7.624692937 podStartE2EDuration="7.624692937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-30 09:11:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 09:12:00.623762372 +0000 UTC m=+40.324986272" watchObservedRunningTime="2026-09-30 09:12:00.624692937 +0000 UTC m=+40.325916279" machine # [ 55.893712] dhcpcd[680]: vethaac681c9: probing for an IPv4LL address machine # [ 56.040029] niks3-server[1175]: 2026/09/30 09:12:00 INFO lead: acquired remote=10.42.0.4:55082 machine # [ 56.622383] systemd[1]: tmp-ovl\x2didmapped206360165.mount: Deactivated successfully. machine # [ 58.085180] systemd[1]: cri-containerd-d8c54922de1589f3232841af7c2856c214eef70707b11c840daf481483e50b46.scope: Deactivated successfully. machine # [ 58.086874] systemd[1]: cri-containerd-d8c54922de1589f3232841af7c2856c214eef70707b11c840daf481483e50b46.scope: Consumed 962ms CPU time over 2.390s wall clock time, 343.1M memory peak, 92.4M read from disk, 193.4M written to disk. machine # [ 58.088566] systemd[1]: cri-containerd-ae5b1b8374995e7a429e220bb2bb846df5d06302cc3fc3bf18dbcc7564b9b322.scope: Deactivated successfully. machine # [ 58.090043] systemd[1]: cri-containerd-ae5b1b8374995e7a429e220bb2bb846df5d06302cc3fc3bf18dbcc7564b9b322.scope: Consumed 953ms CPU time over 2.384s wall clock time, 330.7M memory peak, 72.1M read from disk, 202.4M written to disk. machine # [ 58.149871] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-ae5b1b8374995e7a429e220bb2bb846df5d06302cc3fc3bf18dbcc7564b9b322-rootfs.mount: Deactivated successfully. machine # [ 58.164849] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-d8c54922de1589f3232841af7c2856c214eef70707b11c840daf481483e50b46-rootfs.mount: Deactivated successfully. machine # [ 58.568191] dhcpcd[680]: veth8a65c347: no IPv6 Routers available machine # error: timed out waiting for the condition machine # [ 59.124234] systemd[1]: tmp-ovl\x2didmapped3387403447.mount: Deactivated successfully. machine # [ 59.141427] systemd[1]: Started libcontainer container d39e367ebf40ed2d8fb9be50b1a5e01a26d8af4cace02a95d50df3ba9f0e5bfc. machine # [ 59.144861] systemd[1]: Started libcontainer container 4a9b639d40997eb8ae431571b2425c06e739e08aaee660fb8c330d2bf92fca1a. machine # [ 59.304207] systemd[1]: tmp-ovl\x2didmapped2531080159.mount: Deactivated successfully. machine # [ 59.321327] systemd[1]: Started libcontainer container 5fa97dacd74cc19ff25ebce1031ee384c7d0747f952782731e8ab3ecf45dde6a. machine # [ 59.384393] systemd[1]: Started libcontainer container e4a0609d6ae3ee498d9bf1abb0afafe661c292087bb7b4820b37f5ef72256294. machine # [ 59.564308] systemd[1]: Started libcontainer container a6a5aea25001c6163525e5dab7ca57e4f5e4a67749a919df27f35e0b4b2e44ba. machine # [ 59.579362] systemd[1]: Started libcontainer container 736f0b8bf9fc1a6137adc5488f4ac8065bdc46422f5cc48af9c38774d3406873. machine # [ 59.658626] k3s[870]: I0930 09:12:04.542254 870 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-v5ns4" podStartSLOduration=9.200316375 podStartE2EDuration="11.542231059s" totalImagesPullingTime="0s" totalInitContainerRuntime="2.341914684s" isStatefulPod=false podCreationTimestamp="2026-09-30 09:11:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 09:12:04.542022932 +0000 UTC m=+44.243246553" watchObservedRunningTime="2026-09-30 09:12:04.542231059 +0000 UTC m=+44.243454680" machine # [ 59.665279] k3s[870]: I0930 09:12:04.542355 870 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-k8556" podStartSLOduration=9.201503118 podStartE2EDuration="11.542344202s" totalImagesPullingTime="0s" totalInitContainerRuntime="2.340841084s" isStatefulPod=false podCreationTimestamp="2026-09-30 09:11:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 09:12:04.526741102 +0000 UTC m=+44.227964723" watchObservedRunningTime="2026-09-30 09:12:04.542344202 +0000 UTC m=+44.243567823" machine # [ 59.874250] dhcpcd[680]: vethb1cab76c: using IPv4LL address 169.254.134.110 machine # [ 59.874491] dhcpcd[680]: vethb1cab76c: adding route to 169.254.0.0/16 machine # [ 60.334860] dhcpcd[680]: vethdb6c57f6: using IPv4LL address 169.254.243.248 machine # [ 60.336647] dhcpcd[680]: vethdb6c57f6: adding route to 169.254.0.0/16 machine # [ 60.913252] dhcpcd[680]: vethd6ac9baa: using IPv4LL address 169.254.59.195 machine # [ 60.913695] dhcpcd[680]: vethd6ac9baa: adding route to 169.254.0.0/16 machine # [ 61.016885] dhcpcd[680]: vethaac681c9: using IPv4LL address 169.254.77.4 machine # [ 61.018593] dhcpcd[680]: vethaac681c9: adding route to 169.254.0.0/16 machine # [ 62.783389] dhcpcd[680]: vethdb6c57f6: no IPv6 Routers available machine # [ 62.830193] dhcpcd[680]: vethaac681c9: no IPv6 Routers available machine # [ 63.033645] dhcpcd[680]: segfault at 575ebb71c ip 0000575eabed0cb3 sp 00007fffb7200188 error 4 in dhcpcd[38cb3,575eabea1000+40000] likely on CPU 3 (core 3, socket 0) machine # [ 63.038164] Code: 45 ae 01 e9 0f fe ff ff 0f 1f 80 00 00 00 00 c6 45 af 01 e9 ff fd ff ff e8 fa 05 fd ff 66 2e 0f 1f 84 00 00 00 00 00 48 8b 07 <48> 8b 80 50 03 00 00 48 85 c0 74 31 90 48 8b 00 48 85 c0 74 1e 48 machine # [ 62.899995] systemd-coredump[3586]: Process 680 (dhcpcd) of user 999 terminated abnormally with signal 11/SEGV, processing... machine # [ 62.910561] systemd[1]: Created slice Slice /system/systemd-coredump. machine # [ 62.914596] systemd[1]: Started Process Core Dump (PID 3586/UID 0). machine # [ 63.160707] systemd-coredump[3587]: Process 680 (dhcpcd) of user 999 dumped core. machine # machine # Module udev.so without build-id. machine # Module dhcpcd without build-id. machine # Stack trace of thread 680: machine # #0 0x0000575eabed0cb3 ipv6nd_expire (dhcpcd + 0x38cb3) machine # #1 0x0000575eabeaa06a eloop_start (dhcpcd + 0x1206a) machine # #2 0x0000575eabea2300 main (dhcpcd + 0xa300) machine # #3 0x000077f74d588285 __libc_start_call_main (libc.so.6 + 0x2b285) machine # #4 0x000077f74d588338 __libc_start_main@@GLIBC_2.34 (libc.so.6 + 0x2b338) machine # #5 0x0000575eabea3365 _start (dhcpcd + 0xb365) machine # ELF object binary architecture: AMD x86-64 machine # machine # [ 63.171309] systemd[1]: systemd-coredump@0-1-3586_3587-0.service: Deactivated successfully. machine # [ 63.258979] systemd[1]: dhcpcd.service: Main process exited, code=dumped, status=11/SEGV machine # [ 63.259648] systemd[1]: dhcpcd.service: Failed with result 'core-dump'. machine # [ 63.261481] systemd[1]: dhcpcd.service: Consumed 545ms CPU time over 55.352s wall clock time, 6.5M memory peak, 8K written to disk, 396B incoming IP traffic, 1.3K outgoing IP traffic. machine # [ 63.369121] systemd[1]: dhcpcd.service: Scheduled restart job, restart counter is at 1. machine # [ 63.375134] systemd[1]: Starting DHCP Client... machine # [ 63.586527] dhcpcd[3599]: dhcpcd-10.3.2 starting machine # [ 63.589350] dhcpcd[3603]: dev: loaded udev machine # [ 63.590225] dhcpcd[3603]: DUID 00:01:00:01:32:4f:8e:b1:52:54:00:12:34:56 machine # [ 63.714705] dhcpcd[3603]: eth0: IAID 00:12:34:56 machine # [ 63.715118] dhcpcd[3603]: flannel.1: IAID ab:74:91:38 machine # [ 63.716393] dhcpcd[3603]: veth8a65c347: IAID e9:5e:81:1d machine # [ 63.717652] dhcpcd[3603]: vethdb6c57f6: IAID fa:dd:9a:56 machine # [ 63.719452] dhcpcd[3603]: vethb1cab76c: IAID c0:ed:3a:88 machine # [ 63.723085] dhcpcd[3603]: vethaac681c9: IAID 65:9c:73:0b machine # [ 63.723731] dhcpcd[3603]: vethd6ac9baa: IAID b8:5b:09:43 machine # [ 63.990733] dhcpcd[3603]: eth0: soliciting an IPv6 router machine # [ 63.993176] dhcpcd[3603]: eth0: Router Advertisement from fe80::2 machine # [ 63.994162] dhcpcd[3603]: eth0: adding address fec0::5054:ff:fe12:3456/64 machine # [ 64.040932] dhcpcd[3603]: flannel.1: soliciting a DHCP lease machine # [ 64.052375] dhcpcd[3603]: vethaac681c9: soliciting an IPv6 router machine # [ 64.057281] dhcpcd[3603]: veth8a65c347: soliciting a DHCP lease machine # [ 64.126660] dhcpcd[3603]: vethd6ac9baa: soliciting an IPv6 router machine # [ 64.353105] dhcpcd[3603]: vethb1cab76c: soliciting an IPv6 router machine # [ 64.371124] dhcpcd[3603]: veth8a65c347: soliciting an IPv6 router machine # [ 64.400504] dhcpcd[3603]: vethaac681c9: soliciting a DHCP lease machine # [ 64.419643] dhcpcd[3603]: flannel.1: soliciting an IPv6 router machine # [ 64.472866] dhcpcd[3603]: vethdb6c57f6: soliciting an IPv6 router machine # [ 64.889868] dhcpcd[3603]: eth0: rebinding lease of 10.0.2.15 machine # [ 64.900591] dhcpcd[3603]: eth0: leased 10.0.2.15 for 86400 seconds machine # [ 64.956181] systemd[1]: Started DHCP Client. machine # [ 65.292118] dhcpcd[3603]: vethd6ac9baa: soliciting a DHCP lease machine # [ 65.519182] dhcpcd[3603]: vethb1cab76c: soliciting a DHCP lease machine # [ 65.594979] dhcpcd[3603]: vethdb6c57f6: soliciting a DHCP lease machine # error: timed out waiting for the condition machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 46.46 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s, in 0.24 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s, in 0.18 seconds) machine: waiting for unit niks3.service machine: (finished: waiting for unit niks3.service, in 0.04 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.27 seconds) machine: waiting for success: test $(curl -sf 10.42.0.5:9901/clusters | grep -c 'health_flags::healthy') -ge 3 machine # [ 73.955758] dhcpcd[3603]: veth8a65c347: using IPv4LL address 169.254.194.51 machine # [ 73.956341] dhcpcd[3603]: flannel.1: adding route to 169.254.0.0/16 machine # [ 73.957434] dhcpcd[3603]: veth8a65c347: adding route to 169.254.0.0/16 machine # [ 73.958885] dhcpcd[3603]: vethdb6c57f6: adding route to 169.254.0.0/16 machine # [ 73.960523] dhcpcd[3603]: vethb1cab76c: adding route to 169.254.0.0/16 machine # [ 73.962070] dhcpcd[3603]: vethaac681c9: adding route to 169.254.0.0/16 machine # [ 73.963301] dhcpcd[3603]: vethd6ac9baa: adding route to 169.254.0.0/16 machine # [ 74.476512] dhcpcd[3603]: flannel.1: using IPv4LL address 169.254.229.196 machine # [ 74.707237] dhcpcd[3603]: vethd6ac9baa: using IPv4LL address 169.254.59.195 machine # [ 74.776203] dhcpcd[3603]: vethdb6c57f6: using IPv4LL address 169.254.243.248 machine # [ 74.948781] dhcpcd[3603]: vethaac681c9: using IPv4LL address 169.254.77.4 machine # [ 75.381889] dhcpcd[3603]: vethb1cab76c: using IPv4LL address 169.254.134.110 machine # [ 76.054621] dhcpcd[3603]: vethaac681c9: no IPv6 Routers available machine # [ 76.128981] dhcpcd[3603]: vethd6ac9baa: no IPv6 Routers available machine # [ 76.355998] dhcpcd[3603]: vethb1cab76c: no IPv6 Routers available machine # [ 76.374311] dhcpcd[3603]: veth8a65c347: no IPv6 Routers available machine # [ 76.422427] dhcpcd[3603]: flannel.1: no IPv6 Routers available machine # [ 76.475245] dhcpcd[3603]: vethdb6c57f6: no IPv6 Routers available machine: (finished: waiting for success: test $(curl -sf 10.42.0.5:9901/clusters | grep -c 'health_flags::healthy') -ge 3, in 18.09 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.32 seconds) machine: waiting for success: curl -sf http://10.42.0.4:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2' machine: (finished: waiting for success: curl -sf http://10.42.0.4:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2', in 0.06 seconds) (finished: subtest: chart deploys and workers become Ready, in 65.66 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}', in 0.19 seconds) machine: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt machine: (finished: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt, in 0.18 seconds) subtest: build through the balancer lands in the cache machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1 machine # [ 129.012335] niks3-server[1175]: 2026/09/30 09:13:13 INFO Received push request method=POST path=/api/pushes machine # [ 129.040526] niks3-server[1175]: 2026/09/30 09:13:13 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign machine # [ 129.045746] niks3-server[1175]: 2026/09/30 09:13:13 INFO Signed narinfos id=1 count=1 machine # [ 129.058930] niks3-server[1175]: 2026/09/30 09:13:13 INFO Received complete push request method=POST path=/api/pushes/1/complete machine # [ 129.060292] niks3-server[1175]: 2026/09/30 09:13:13 INFO Registered completed upload object_key=nar/0nzzbas7l8d37mridr7mg162smfjvn7lhs6am4crl4ydaxicigj8.nar.zst machine # [ 129.068346] niks3-server[1175]: 2026/09/30 09:13:13 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.ls machine # [ 129.069665] niks3-server[1175]: 2026/09/30 09:13:13 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.narinfo machine # [ 153.389825] niks3-server[1175]: 2026/09/30 09:13:38 INFO Received push request method=POST path=/api/pushes machine # [ 153.411256] niks3-server[1175]: 2026/09/30 09:13:38 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign machine # [ 153.415360] niks3-server[1175]: 2026/09/30 09:13:38 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.ls machine # [ 153.415514] niks3-server[1175]: 2026/09/30 09:13:38 INFO Registered completed upload object_key=nar/1p7jh5nyz9n68k5f18ymmdpgr34mpnnch1njw7ki7b2b97qlfbjk.nar.zst machine # [ 153.418246] niks3-server[1175]: 2026/09/30 09:13:38 INFO Signed narinfos id=2 count=1 machine # [ 153.424189] niks3-server[1175]: 2026/09/30 09:13:38 INFO Registered completed upload object_key=log/yz1sqzb72i8v6h2ass0v76ba8cncqj9r-k3s-a.drv machine # [ 153.428232] niks3-server[1175]: 2026/09/30 09:13:38 INFO Received complete push request method=POST path=/api/pushes/2/complete machine # [ 153.433049] niks3-server[1175]: 2026/09/30 09:13:38 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.narinfo machine # [ 153.498258] niks3-server[1175]: 2026/09/30 09:13:38 INFO Received push request method=POST path=/api/pushes machine # [ 153.507463] niks3-server[1175]: 2026/09/30 09:13:38 INFO Received sign narinfos request method=POST path=/api/pushes/3/sign machine # [ 153.508529] niks3-server[1175]: 2026/09/30 09:13:38 INFO Signed narinfos id=3 count=1 machine # [ 153.512740] niks3-server[1175]: 2026/09/30 09:13:38 INFO Registered completed upload object_key=nar/03a4ywhyr5knmbc93z4gyml5y8fvgb431xvlmfxrwsm8mrb0qgx2.nar.zst machine # [ 153.514834] niks3-server[1175]: 2026/09/30 09:13:38 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.ls machine # [ 153.517397] niks3-server[1175]: 2026/09/30 09:13:38 INFO Received complete push request method=POST path=/api/pushes/3/complete machine # [ 153.520061] niks3-server[1175]: 2026/09/30 09:13:38 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.narinfo machine # [ 178.034634] niks3-server[1175]: 2026/09/30 09:14:02 INFO Received push request method=POST path=/api/pushes machine # [ 178.051153] niks3-server[1175]: 2026/09/30 09:14:02 INFO Received sign narinfos request method=POST path=/api/pushes/4/sign machine # [ 178.052879] niks3-server[1175]: 2026/09/30 09:14:02 INFO Signed narinfos id=4 count=1 machine # [ 178.055437] niks3-server[1175]: 2026/09/30 09:14:02 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.ls machine # [ 178.056637] niks3-server[1175]: 2026/09/30 09:14:02 INFO Registered completed upload object_key=nar/05qjsj5ff3a6vnxkhb6k5f3m446dcc206p7cd37w4v3mgi95d7kh.nar.zst machine # [ 178.062791] niks3-server[1175]: 2026/09/30 09:14:02 INFO Received complete push request method=POST path=/api/pushes/4/complete machine # [ 178.070052] niks3-server[1175]: 2026/09/30 09:14:02 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.narinfo machine # [ 178.075799] niks3-server[1175]: 2026/09/30 09:14:02 INFO Registered completed upload object_key=log/zfq1xw9bmycqh35l0s44lmv65z4xc7br-k3s-b.drv machine # [ 178.143030] niks3-server[1175]: 2026/09/30 09:14:03 INFO Received push request method=POST path=/api/pushes machine # [ 178.154445] niks3-server[1175]: 2026/09/30 09:14:03 INFO Received sign narinfos request method=POST path=/api/pushes/5/sign machine # [ 178.156303] niks3-server[1175]: 2026/09/30 09:14:03 INFO Signed narinfos id=5 count=1 machine # [ 178.159433] niks3-server[1175]: 2026/09/30 09:14:03 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.ls machine # [ 178.160757] niks3-server[1175]: 2026/09/30 09:14:03 INFO Registered completed upload object_key=nar/0jyw88klkf3nwxpnj5m5lx3i1dv2idf3hcn6im7883hnldm3gvyq.nar.zst machine # [ 178.165866] niks3-server[1175]: 2026/09/30 09:14:03 INFO Received complete push request method=POST path=/api/pushes/5/complete machine # [ 178.170968] niks3-server[1175]: 2026/09/30 09:14:03 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.narinfo machine # [ 202.876900] niks3-server[1175]: 2026/09/30 09:14:27 INFO Received push request method=POST path=/api/pushes machine # [ 202.890688] niks3-server[1175]: 2026/09/30 09:14:27 INFO Received sign narinfos request method=POST path=/api/pushes/6/sign machine # [ 202.892511] niks3-server[1175]: 2026/09/30 09:14:27 INFO Signed narinfos id=6 count=1 machine # [ 202.897197] niks3-server[1175]: 2026/09/30 09:14:27 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.ls machine # [ 202.897896] niks3-server[1175]: 2026/09/30 09:14:27 INFO Registered completed upload object_key=nar/1q8vp5xqws560mpf8rxk8r8jhqrzibivh13x4wxy0cfqlzbk7cr5.nar.zst machine # [ 202.899794] niks3-server[1175]: 2026/09/30 09:14:27 INFO Registered completed upload object_key=log/n40czam6a4ldp1mh5fdmlcy07fv0akbm-k3s-top.drv machine # [ 202.905492] niks3-server[1175]: 2026/09/30 09:14:27 INFO Received complete push request method=POST path=/api/pushes/6/complete machine # [ 202.916566] niks3-server[1175]: 2026/09/30 09:14:27 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1, in 112.92 seconds) machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath, in 0.17 seconds) machine: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine: (finished: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.02 seconds) machine: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine # copying 3 paths... machine # copying path '/nix/store/r95r891injj9ski5c4w89yxjvjy065mx-k3s-a' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/mrqsh0475wxsmnsvkk55g94v6g5nrcra-k3s-b' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top' from 'http://192.168.1.1:5751'... machine: (finished: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.20 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1 machine # [ 229.713149] niks3-server[1175]: 2026/09/30 09:14:54 INFO Received push request method=POST path=/api/pushes machine # [ 229.733567] niks3-server[1175]: 2026/09/30 09:14:54 INFO Received sign narinfos request method=POST path=/api/pushes/7/sign machine # [ 229.737972] niks3-server[1175]: 2026/09/30 09:14:54 INFO Signed narinfos id=7 count=1 machine # [ 229.741143] niks3-server[1175]: 2026/09/30 09:14:54 INFO Registered completed upload object_key=nar/1fr26arhri17j9bj6hyjzmmd74v730biz1gb3kqd194vjx3ccvp9.nar.zst machine # [ 229.746961] niks3-server[1175]: 2026/09/30 09:14:54 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.ls machine # [ 229.750804] niks3-server[1175]: 2026/09/30 09:14:54 INFO Received complete push request method=POST path=/api/pushes/7/complete machine # [ 229.758105] niks3-server[1175]: 2026/09/30 09:14:54 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.narinfo machine # [ 254.069240] niks3-server[1175]: 2026/09/30 09:15:18 INFO Received push request method=POST path=/api/pushes machine # [ 254.085561] niks3-server[1175]: 2026/09/30 09:15:18 INFO Received sign narinfos request method=POST path=/api/pushes/8/sign machine # [ 254.088029] niks3-server[1175]: 2026/09/30 09:15:18 INFO Signed narinfos id=8 count=1 machine # [ 254.089117] niks3-server[1175]: 2026/09/30 09:15:18 INFO Registered completed upload object_key=log/pbpqsh50ar10fpasdqqx8xg3lmr5j8iz-k3s-a.drv machine # [ 254.090900] niks3-server[1175]: 2026/09/30 09:15:18 INFO Registered completed upload object_key=nar/1hfc6x4x25k3b0fk091d3nb0k3mympfp05fkslcx19synp3ig0zd.nar.zst machine # [ 254.092354] niks3-server[1175]: 2026/09/30 09:15:18 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.ls machine # [ 254.095192] niks3-server[1175]: 2026/09/30 09:15:18 INFO Received complete push request method=POST path=/api/pushes/8/complete machine # [ 254.099328] niks3-server[1175]: 2026/09/30 09:15:18 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.narinfo machine # [ 254.183367] niks3-server[1175]: 2026/09/30 09:15:19 INFO Received push request method=POST path=/api/pushes machine # [ 254.196705] niks3-server[1175]: 2026/09/30 09:15:19 INFO Received sign narinfos request method=POST path=/api/pushes/9/sign machine # [ 254.197282] niks3-server[1175]: 2026/09/30 09:15:19 INFO Signed narinfos id=9 count=1 machine # [ 254.201548] niks3-server[1175]: 2026/09/30 09:15:19 INFO Received complete push request method=POST path=/api/pushes/9/complete machine # [ 254.208532] niks3-server[1175]: 2026/09/30 09:15:19 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.narinfo machine # [ 254.213699] niks3-server[1175]: 2026/09/30 09:15:19 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.ls machine # [ 254.213855] niks3-server[1175]: 2026/09/30 09:15:19 INFO Registered completed upload object_key=nar/0zzq2vgjln4shvh57091n14sam6wh6w06vja6lzb9ppcj4ffyx1n.nar.zst machine # [ 278.723793] niks3-server[1175]: 2026/09/30 09:15:43 INFO Received push request method=POST path=/api/pushes machine # [ 278.747416] niks3-server[1175]: 2026/09/30 09:15:43 INFO Received sign narinfos request method=POST path=/api/pushes/10/sign machine # [ 278.748765] niks3-server[1175]: 2026/09/30 09:15:43 INFO Signed narinfos id=10 count=1 machine # [ 278.757347] niks3-server[1175]: 2026/09/30 09:15:43 INFO Registered completed upload object_key=log/894h6wzw2l4w5f0hikj1k6q57jfnyi87-k3s-b.drv machine # [ 278.762286] niks3-server[1175]: 2026/09/30 09:15:43 INFO Received complete push request method=POST path=/api/pushes/10/complete machine # [ 278.767264] niks3-server[1175]: 2026/09/30 09:15:43 INFO Registered completed upload object_key=nar/0hh3nqk95r6g32lhdmxw8cxjv694vbpx9876zkhcpg4r4qxni2ch.nar.zst machine # [ 278.771254] niks3-server[1175]: 2026/09/30 09:15:43 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.ls machine # [ 278.774318] niks3-server[1175]: 2026/09/30 09:15:43 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.narinfo machine # [ 278.841540] niks3-server[1175]: 2026/09/30 09:15:43 INFO Received push request method=POST path=/api/pushes machine # [ 278.851161] niks3-server[1175]: 2026/09/30 09:15:43 INFO Received sign narinfos request method=POST path=/api/pushes/11/sign machine # [ 278.855414] niks3-server[1175]: 2026/09/30 09:15:43 INFO Signed narinfos id=11 count=1 machine # [ 278.855517] niks3-server[1175]: 2026/09/30 09:15:43 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.ls machine # [ 278.856852] niks3-server[1175]: 2026/09/30 09:15:43 INFO Registered completed upload object_key=nar/0ingamx56k31lwiyxmnxmscjj4n3qfx6sr2kpaynsrwhwz1278iw.nar.zst machine # [ 278.858637] niks3-server[1175]: 2026/09/30 09:15:43 INFO Received complete push request method=POST path=/api/pushes/11/complete machine # [ 278.862630] niks3-server[1175]: 2026/09/30 09:15:43 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.narinfo machine # [ 303.582281] niks3-server[1175]: 2026/09/30 09:16:08 INFO Received push request method=POST path=/api/pushes machine # [ 303.600275] niks3-server[1175]: 2026/09/30 09:16:08 INFO Received sign narinfos request method=POST path=/api/pushes/12/sign machine # [ 303.604106] niks3-server[1175]: 2026/09/30 09:16:08 INFO Signed narinfos id=12 count=1 machine # [ 303.605337] niks3-server[1175]: 2026/09/30 09:16:08 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.ls machine # [ 303.606606] niks3-server[1175]: 2026/09/30 09:16:08 INFO Registered completed upload object_key=nar/0v48x4sp58bvfra08axgkz7yl1n9nc4nirskyv1hwann4i7q277i.nar.zst machine # [ 303.608876] niks3-server[1175]: 2026/09/30 09:16:08 INFO Registered completed upload object_key=log/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g-k3s-top.drv machine # [ 303.613250] niks3-server[1175]: 2026/09/30 09:16:08 INFO Received complete push request method=POST path=/api/pushes/12/complete machine # [ 303.619351] niks3-server[1175]: 2026/09/30 09:16:08 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1, in 99.77 seconds) (finished: subtest: build through the balancer lands in the cache, in 213.09 seconds) subtest: a Job with the client image builds through the farm with its service account machine: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine: (finished: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.19 seconds) machine: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix machine: (finished: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix, in 0.16 seconds) machine: must succeed: kubectl apply -f /nix/store/4qg21n7g16x8lyv0fhhdx9dx3lxqkcdn-ci-job.json machine: (finished: must succeed: kubectl apply -f /nix/store/4qg21n7g16x8lyv0fhhdx9dx3lxqkcdn-ci-job.json, in 0.19 seconds) machine: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed' machine # [ 305.280895] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod2c0e5470_691a_4661_9168_381badba9327.slice. machine # [ 305.339138] k3s[870]: I0930 09:16:10.222798 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/2c0e5470-691a-4661-9168-381badba9327-nix-grpc-farm\") pod \"ci-lnk8g\" (UID: \"2c0e5470-691a-4661-9168-381badba9327\") " pod="ci/ci-lnk8g" machine # [ 305.339324] k3s[870]: I0930 09:16:10.222905 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"job\" (UniqueName: \"kubernetes.io/configmap/2c0e5470-691a-4661-9168-381badba9327-job\") pod \"ci-lnk8g\" (UID: \"2c0e5470-691a-4661-9168-381badba9327\") " pod="ci/ci-lnk8g" machine # [ 305.339800] k3s[870]: I0930 09:16:10.222950 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnvt4\" (UniqueName: \"kubernetes.io/projected/2c0e5470-691a-4661-9168-381badba9327-kube-api-access-cnvt4\") pod \"ci-lnk8g\" (UID: \"2c0e5470-691a-4661-9168-381badba9327\") " pod="ci/ci-lnk8g" machine # [ 306.085060] cni0: port 2(veth0fd5fa12) entered blocking state machine # [ 306.088142] cni0: port 2(veth0fd5fa12) entered disabled state machine # [ 306.090597] veth0fd5fa12: entered allmulticast mode machine # [ 306.093060] veth0fd5fa12: entered promiscuous mode machine # [ 306.111345] cni0: port 2(veth0fd5fa12) entered blocking state machine # [ 306.113451] cni0: port 2(veth0fd5fa12) entered forwarding state machine # [ 306.008513] (udev-worker)[5323]: Network interface NamePolicy= disabled on kernel command line. machine # [ 306.036641] dhcpcd[3603]: veth0fd5fa12: IAID a4:95:6d:71 machine # [ 306.037041] dhcpcd[3603]: veth0fd5fa12: adding address fe80::3456:a4ff:fe95:6d71 machine # [ 306.069308] systemd[1]: Started libcontainer container a0c12903e361564c456fac6112affe00375e07394875fcf0d8390dc34279ffc9. machine # [ 307.177308] dhcpcd[3603]: veth0fd5fa12: soliciting a DHCP lease machine # [ 307.905076] dhcpcd[3603]: veth0fd5fa12: soliciting an IPv6 router machine # [ 308.093120] systemd[1]: Started libcontainer container b461afcffaf07db8ce52f3d4f1bb2b5a5853e138728366503f70d543a233ed89. machine # [ 308.181084] k3s[870]: I0930 09:16:13.064657 870 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ci/ci-lnk8g" podStartSLOduration=3.064631503 podStartE2EDuration="3.064631503s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-30 09:16:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 09:16:13.064142056 +0000 UTC m=+292.765365677" watchObservedRunningTime="2026-09-30 09:16:13.064631503 +0000 UTC m=+292.765855404" machine # [ 309.391500] niks3-server[1175]: 2026/09/30 09:16:14 INFO Received push request method=POST path=/api/pushes machine # [ 309.405556] niks3-server[1175]: 2026/09/30 09:16:14 INFO Received sign narinfos request method=POST path=/api/pushes/13/sign machine # [ 309.406892] niks3-server[1175]: 2026/09/30 09:16:14 INFO Signed narinfos id=13 count=1 machine # [ 309.414773] niks3-server[1175]: 2026/09/30 09:16:14 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.ls machine # [ 309.416383] niks3-server[1175]: 2026/09/30 09:16:14 INFO Registered completed upload object_key=nar/111g6dyibwcf2z7jhpn72rgja0qvjgpdiv9nc06g2dp7ih0a6kyq.nar.zst machine # [ 309.424926] niks3-server[1175]: 2026/09/30 09:16:14 INFO Received complete push request method=POST path=/api/pushes/13/complete machine # [ 310.101424] postgres[759]: [759] LOG: checkpoint starting: time machine # [ 312.178070] dhcpcd[3603]: veth0fd5fa12: probing for an IPv4LL address machine # [ 316.864316] dhcpcd[3603]: veth0fd5fa12: using IPv4LL address 169.254.152.14 machine # [ 316.867080] dhcpcd[3603]: veth0fd5fa12: adding route to 169.254.0.0/16 machine # [ 319.910892] dhcpcd[3603]: veth0fd5fa12: no IPv6 Routers available machine # [ 334.344684] niks3-server[1175]: 2026/09/30 09:16:39 INFO Received push request method=POST path=/api/pushes machine # [ 334.370991] niks3-server[1175]: 2026/09/30 09:16:39 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.ls machine # [ 334.373862] niks3-server[1175]: 2026/09/30 09:16:39 INFO Registered completed upload object_key=nar/058kjd2vfl1r27b4d9ixvwf77d8rkr18a4v894kwx8lg0nwpajnr.nar.zst machine # [ 334.375689] niks3-server[1175]: 2026/09/30 09:16:39 INFO Received sign narinfos request method=POST path=/api/pushes/14/sign machine # [ 334.376689] niks3-server[1175]: 2026/09/30 09:16:39 INFO Signed narinfos id=14 count=1 machine # [ 334.382200] niks3-server[1175]: 2026/09/30 09:16:39 INFO Registered completed upload object_key=log/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # [ 334.388725] niks3-server[1175]: 2026/09/30 09:16:39 INFO Received complete push request method=POST path=/api/pushes/14/complete machine # [ 334.394305] niks3-server[1175]: 2026/09/30 09:16:39 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.narinfo machine # [ 334.456512] niks3-server[1175]: 2026/09/30 09:16:39 INFO Received push request method=POST path=/api/pushes machine # [ 334.466275] niks3-server[1175]: 2026/09/30 09:16:39 INFO Received sign narinfos request method=POST path=/api/pushes/15/sign machine # [ 334.468490] niks3-server[1175]: 2026/09/30 09:16:39 INFO Signed narinfos id=15 count=1 machine # [ 334.472069] niks3-server[1175]: 2026/09/30 09:16:39 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.ls machine # [ 334.474023] niks3-server[1175]: 2026/09/30 09:16:39 INFO Registered completed upload object_key=nar/138ynhcd5wxzz485x9qcq7xsargaklrf2li31ai69m5r46am35q6.nar.zst machine # [ 334.477107] niks3-server[1175]: 2026/09/30 09:16:39 INFO Received complete push request method=POST path=/api/pushes/15/complete machine # [ 334.482692] niks3-server[1175]: 2026/09/30 09:16:39 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.narinfo machine # [ 359.395273] niks3-server[1175]: 2026/09/30 09:17:04 INFO Received push request method=POST path=/api/pushes machine # [ 359.416211] niks3-server[1175]: 2026/09/30 09:17:04 INFO Registered completed upload object_key=nar/0n4lbdlp8w72fs3qbavl2lwrzbrn55i2b1vyglc89cc3pi8vbb1m.nar.zst machine # [ 359.417408] niks3-server[1175]: 2026/09/30 09:17:04 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.ls machine # [ 359.425518] niks3-server[1175]: 2026/09/30 09:17:04 INFO Received sign narinfos request method=POST path=/api/pushes/16/sign machine # [ 359.426419] niks3-server[1175]: 2026/09/30 09:17:04 INFO Signed narinfos id=16 count=1 machine # [ 359.429844] niks3-server[1175]: 2026/09/30 09:17:04 INFO Registered completed upload object_key=log/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # [ 359.438897] niks3-server[1175]: 2026/09/30 09:17:04 INFO Received complete push request method=POST path=/api/pushes/16/complete machine # [ 359.447234] niks3-server[1175]: 2026/09/30 09:17:04 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo machine # [ 359.522460] niks3-server[1175]: 2026/09/30 09:17:04 INFO Received push request method=POST path=/api/pushes machine # [ 359.533816] niks3-server[1175]: 2026/09/30 09:17:04 INFO Received sign narinfos request method=POST path=/api/pushes/17/sign machine # [ 359.534472] niks3-server[1175]: 2026/09/30 09:17:04 INFO Signed narinfos id=17 count=1 machine # [ 359.540068] niks3-server[1175]: 2026/09/30 09:17:04 INFO Registered completed upload object_key=nar/1f3gvnvqsm2pm3laixkxkg44kvjb251zqhszcfpp0a00h6x66ljs.nar.zst machine # [ 359.543727] niks3-server[1175]: 2026/09/30 09:17:04 INFO Received complete push request method=POST path=/api/pushes/17/complete machine # [ 359.547935] niks3-server[1175]: 2026/09/30 09:17:04 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.ls machine # [ 359.552179] niks3-server[1175]: 2026/09/30 09:17:04 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.narinfo machine # [ 384.271148] niks3-server[1175]: 2026/09/30 09:17:29 INFO Received push request method=POST path=/api/pushes machine # [ 384.290450] niks3-server[1175]: 2026/09/30 09:17:29 INFO Received sign narinfos request method=POST path=/api/pushes/18/sign machine # [ 384.291770] niks3-server[1175]: 2026/09/30 09:17:29 INFO Signed narinfos id=18 count=1 machine # [ 384.296292] niks3-server[1175]: 2026/09/30 09:17:29 INFO Registered completed upload object_key=nar/1zwf0asrdv12q40fmqga5lx5330dvn9y4in4i9ficz9ij5lhvnf5.nar.zst machine # [ 384.298699] niks3-server[1175]: 2026/09/30 09:17:29 INFO Registered completed upload object_key=log/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # [ 384.300678] niks3-server[1175]: 2026/09/30 09:17:29 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.ls machine # [ 384.304679] niks3-server[1175]: 2026/09/30 09:17:29 INFO Received complete push request method=POST path=/api/pushes/18/complete machine # [ 384.310490] niks3-server[1175]: 2026/09/30 09:17:29 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo machine # [ 385.893585] niks3-server[1175]: 2026/09/30 09:17:30 INFO Received push request method=POST path=/api/pushes machine # [ 385.906585] niks3-server[1175]: 2026/09/30 09:17:30 INFO Received sign narinfos request method=POST path=/api/pushes/19/sign machine # [ 385.907825] niks3-server[1175]: 2026/09/30 09:17:30 INFO Signed narinfos id=19 count=1 machine # [ 385.910866] niks3-server[1175]: 2026/09/30 09:17:30 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.ls machine # [ 385.913207] niks3-server[1175]: 2026/09/30 09:17:30 INFO Registered completed upload object_key=nar/0xiyqcsl8db7dnrq2gqnx5izavr51ma3dcdswrriaxfgj3qzk7xf.nar.zst machine # [ 385.915812] niks3-server[1175]: 2026/09/30 09:17:30 INFO Received complete push request method=POST path=/api/pushes/19/complete machine # [ 385.919906] niks3-server[1175]: 2026/09/30 09:17:30 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.narinfo machine # [ 410.608982] niks3-server[1175]: 2026/09/30 09:17:55 INFO Received push request method=POST path=/api/pushes machine # [ 410.630235] niks3-server[1175]: 2026/09/30 09:17:55 INFO Received sign narinfos request method=POST path=/api/pushes/20/sign machine # [ 410.632473] niks3-server[1175]: 2026/09/30 09:17:55 INFO Registered completed upload object_key=nar/0p3l2z3riilylr2rxb1aq2blxdfxg55wbgp4gxkns93srbr4bwyq.nar.zst machine # [ 410.633771] niks3-server[1175]: 2026/09/30 09:17:55 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.ls machine # [ 410.636160] niks3-server[1175]: 2026/09/30 09:17:55 INFO Signed narinfos id=20 count=1 machine # [ 410.636604] niks3-server[1175]: 2026/09/30 09:17:55 INFO Registered completed upload object_key=log/fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # [ 410.643838] niks3-server[1175]: 2026/09/30 09:17:55 INFO Received complete push request method=POST path=/api/pushes/20/complete machine # [ 410.650101] niks3-server[1175]: 2026/09/30 09:17:55 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo machine # [ 410.776304] systemd[1]: cri-containerd-b461afcffaf07db8ce52f3d4f1bb2b5a5853e138728366503f70d543a233ed89.scope: Deactivated successfully. machine # [ 410.781477] systemd[1]: cri-containerd-b461afcffaf07db8ce52f3d4f1bb2b5a5853e138728366503f70d543a233ed89.scope: Consumed 896ms CPU time over 1min 42.683s wall clock time, 79.6M memory peak, 10M read from disk, 428K written to disk, 18.1K incoming IP traffic, 44.8K outgoing IP traffic. machine # [ 410.815133] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-b461afcffaf07db8ce52f3d4f1bb2b5a5853e138728366503f70d543a233ed89-rootfs.mount: Deactivated successfully. machine # [ 412.466141] systemd[1]: cri-containerd-a0c12903e361564c456fac6112affe00375e07394875fcf0d8390dc34279ffc9.scope: Deactivated successfully. machine # [ 412.513217] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-a0c12903e361564c456fac6112affe00375e07394875fcf0d8390dc34279ffc9-rootfs.mount: Deactivated successfully. machine # [ 412.545688] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-a0c12903e361564c456fac6112affe00375e07394875fcf0d8390dc34279ffc9-shm.mount: Deactivated successfully. machine # [ 412.733436] cni0: port 2(veth0fd5fa12) entered disabled state machine # [ 412.581716] dhcpcd[3603]: veth0fd5fa12: carrier lost machine # [ 412.735812] veth0fd5fa12 (unregistering): left allmulticast mode machine # [ 412.737037] veth0fd5fa12 (unregistering): left promiscuous mode machine # [ 412.738244] cni0: port 2(veth0fd5fa12) entered disabled state machine # [ 412.603413] systemd[1]: run-netns-cni\x2df1804cfe\x2dea2f\x2dae59\x2d68be\x2dc66349ec33be.mount: Deactivated successfully. machine # [ 412.611582] dhcpcd[3603]: veth0fd5fa12: deleting address fe80::3456:a4ff:fe95:6d71 machine # [ 412.615251] dhcpcd[3603]: veth0fd5fa12: deleting route to 169.254.0.0/16 machine # [ 412.673283] dhcpcd[3603]: veth0fd5fa12: removing interface machine # [ 412.687516] k3s[870]: I0930 09:17:57.570763 870 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2c0e5470-691a-4661-9168-381badba9327-job\" (UniqueName: \"kubernetes.io/configmap/2c0e5470-691a-4661-9168-381badba9327-job\") pod \"2c0e5470-691a-4661-9168-381badba9327\" (UID: \"2c0e5470-691a-4661-9168-381badba9327\") " machine # [ 412.687882] k3s[870]: I0930 09:17:57.570830 870 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2c0e5470-691a-4661-9168-381badba9327-kube-api-access-cnvt4\" (UniqueName: \"kubernetes.io/projected/2c0e5470-691a-4661-9168-381badba9327-kube-api-access-cnvt4\") pod \"2c0e5470-691a-4661-9168-381badba9327\" (UID: \"2c0e5470-691a-4661-9168-381badba9327\") " machine # [ 412.688535] k3s[870]: I0930 09:17:57.570867 870 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2c0e5470-691a-4661-9168-381badba9327-nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/2c0e5470-691a-4661-9168-381badba9327-nix-grpc-farm\") pod \"2c0e5470-691a-4661-9168-381badba9327\" (UID: \"2c0e5470-691a-4661-9168-381badba9327\") " machine # [ 412.688983] k3s[870]: I0930 09:17:57.571234 870 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c0e5470-691a-4661-9168-381badba9327-job" pod "2c0e5470-691a-4661-9168-381badba9327" (UID: "2c0e5470-691a-4661-9168-381badba9327"). InnerVolumeSpecName "job". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 412.690885] systemd[1]: var-lib-kubelet-pods-2c0e5470\x2d691a\x2d4661\x2d9168\x2d381badba9327-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dcnvt4.mount: Deactivated successfully. machine # [ 412.692451] systemd[1]: var-lib-kubelet-pods-2c0e5470\x2d691a\x2d4661\x2d9168\x2d381badba9327-volumes-kubernetes.io\x7eprojected-nix\x2dgrpc\x2dfarm.mount: Deactivated successfully. machine # [ 412.708807] k3s[870]: I0930 09:17:57.592820 870 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c0e5470-691a-4661-9168-381badba9327-kube-api-access-cnvt4" pod "2c0e5470-691a-4661-9168-381badba9327" (UID: "2c0e5470-691a-4661-9168-381badba9327"). InnerVolumeSpecName "kube-api-access-cnvt4". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 412.713402] k3s[870]: I0930 09:17:57.597451 870 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c0e5470-691a-4661-9168-381badba9327-nix-grpc-farm" pod "2c0e5470-691a-4661-9168-381badba9327" (UID: "2c0e5470-691a-4661-9168-381badba9327"). InnerVolumeSpecName "nix-grpc-farm". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 412.783407] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod2c0e5470_691a_4661_9168_381badba9327.slice. machine # [ 412.783654] systemd[1]: kubepods-besteffort-pod2c0e5470_691a_4661_9168_381badba9327.slice: Consumed 926ms CPU time over 1min 47.501s wall clock time, 79.8M memory peak, 10M read from disk, 632K written to disk, 18.1K incoming IP traffic, 44.8K outgoing IP traffic. machine # [ 412.787341] k3s[870]: I0930 09:17:57.671382 870 reconciler_common.go:299] "Volume detached for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/2c0e5470-691a-4661-9168-381badba9327-nix-grpc-farm\") on node \"machine\" DevicePath \"\"" machine # [ 412.788052] k3s[870]: I0930 09:17:57.671416 870 reconciler_common.go:299] "Volume detached for volume \"job\" (UniqueName: \"kubernetes.io/configmap/2c0e5470-691a-4661-9168-381badba9327-job\") on node \"machine\" DevicePath \"\"" machine # [ 412.788585] k3s[870]: I0930 09:17:57.671433 870 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cnvt4\" (UniqueName: \"kubernetes.io/projected/2c0e5470-691a-4661-9168-381badba9327-kube-api-access-cnvt4\") on node \"machine\" DevicePath \"\"" machine # [ 413.458162] k3s[870]: I0930 09:17:58.342056 870 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a0c12903e361564c456fac6112affe00375e07394875fcf0d8390dc34279ffc9" machine # [ 413.458626] k3s[870]: E0930 09:17:58.342321 870 kubelet_pods.go:2193] "failed to read memory cgroup config for the pod" err="failed to read memory.max for cgroup /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c0e5470_691a_4661_9168_381badba9327.slice: openat2 /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c0e5470_691a_4661_9168_381badba9327.slice/memory.max: no such file or directory" podName="ci-lnk8g" machine # [ 413.475366] k3s[870]: E0930 09:17:58.359304 870 kubelet_pods.go:2198] "failed to read memory cgroup limits for the pod" err="failed to read cpu.max file for cgroup /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c0e5470_691a_4661_9168_381badba9327.slice: openat2 /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c0e5470_691a_4661_9168_381badba9327.slice/cpu.max: no such file or directory" podName="ci-lnk8g" machine: (finished: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed', in 108.59 seconds) machine: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1 machine: (finished: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1, in 0.16 seconds) machine # [ 414.093456] postgres[759]: [759] LOG: checkpoint complete: wrote 1037 buffers (6.3%), wrote 3 SLRU buffers; 1 WAL file(s) added, 0 removed, 0 recycled; write=103.915 s, sync=0.041 s, total=103.992 s; sync files=364, longest=0.003 s, average=0.001 s; distance=4978 kB, estimate=4978 kB; lsn=0/1C76B98, redo lsn=0/1C42A88 machine # don't know how to build these paths: machine # /nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-a> machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-k8556: building fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-b> machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-k8556: building 1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-top> machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-k8556: building rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # INFO:nix_fast_build.processes:run nix-eval-jobs --gc-roots-dir /tmp/tmp47ih9dt6/gcroots --force-recurse --max-memory-size 4096 --workers 4 --flake '.#checks' --check-cache-status machine # INFO:nix_fast_build.workers:builds: 0 machine # warning: Git tree '/tmp' is dirty machine # warning: Git tree '/tmp' is dirty machine # ▶ x86_64-linux.t started machine # INFO:nix_fast_build.workers:builds: 2 machine # ✔ x86_64-linux.t (25s) machine # x86_64-linux.t> machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-v5ns4: building fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # warning: Git tree '/tmp' is dirty machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath, in 0.13 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null, in 0.03 seconds) (finished: subtest: a Job with the client image builds through the farm with its service account, in 109.76 seconds) subtest: a renewed balancer certificate is served without a rollout machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f - machine # Warning: resource secrets/farm-lb-tls is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically. machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f -, in 0.27 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}', in 0.93 seconds) machine: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-5877cc8b4f-rrkbq -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine # [ 415.883596] k3s[870]: E0930 09:18:00.767292 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:49886: use of closed network connection" machine # [ 417.201967] k3s[870]: E0930 09:18:02.085298 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:49894: use of closed network connection" machine # [ 418.482140] k3s[870]: E0930 09:18:03.365561 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:49908: use of closed network connection" machine # [ 419.792900] k3s[870]: E0930 09:18:04.676611 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:49924: use of closed network connection" machine # [ 421.114375] k3s[870]: E0930 09:18:05.997974 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:49932: use of closed network connection" machine # [ 422.453907] k3s[870]: E0930 09:18:07.337247 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:49948: use of closed network connection" machine # [ 423.756459] k3s[870]: E0930 09:18:08.639493 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:42284: use of closed network connection" machine # [ 425.081156] k3s[870]: E0930 09:18:09.964836 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:42298: use of closed network connection" machine # [ 426.422543] k3s[870]: E0930 09:18:11.305765 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:42310: use of closed network connection" machine # [ 427.731509] k3s[870]: E0930 09:18:12.615221 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:42322: use of closed network connection" machine # [ 429.021746] k3s[870]: E0930 09:18:13.905425 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:42334: use of closed network connection" machine # [ 430.292686] k3s[870]: E0930 09:18:15.176399 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:42336: use of closed network connection" machine # [ 431.603677] k3s[870]: E0930 09:18:16.486619 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:42346: use of closed network connection" machine # [ 432.881430] k3s[870]: E0930 09:18:17.764542 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:42358: use of closed network connection" machine # [ 434.161775] k3s[870]: E0930 09:18:19.045493 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:35534: use of closed network connection" machine: (finished: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-5877cc8b4f-rrkbq -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 18.54 seconds) machine: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine: (finished: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 0.04 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1 machine # [ 434.421333] niks3-server[1175]: 2026/09/30 09:18:19 INFO Received push request method=POST path=/api/pushes machine # [ 434.433741] niks3-server[1175]: 2026/09/30 09:18:19 INFO Received sign narinfos request method=POST path=/api/pushes/21/sign machine # [ 434.434824] niks3-server[1175]: 2026/09/30 09:18:19 INFO Signed narinfos id=21 count=1 machine # [ 434.438210] niks3-server[1175]: 2026/09/30 09:18:19 INFO Registered completed upload object_key=nar/0g42hgwa9jp9abmqxz90dkwxpybsznzbpsy35rm921mlk5sw56jq.nar.zst machine # [ 434.440574] niks3-server[1175]: 2026/09/30 09:18:19 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.ls machine # [ 434.443573] niks3-server[1175]: 2026/09/30 09:18:19 INFO Received complete push request method=POST path=/api/pushes/21/complete machine # [ 459.360677] niks3-server[1175]: 2026/09/30 09:18:44 INFO Received push request method=POST path=/api/pushes machine # [ 459.373980] niks3-server[1175]: 2026/09/30 09:18:44 INFO Received sign narinfos request method=POST path=/api/pushes/22/sign machine # [ 459.376844] niks3-server[1175]: 2026/09/30 09:18:44 INFO Signed narinfos id=22 count=1 machine # [ 459.380632] niks3-server[1175]: 2026/09/30 09:18:44 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.ls machine # [ 459.385623] niks3-server[1175]: 2026/09/30 09:18:44 INFO Registered completed upload object_key=log/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31-k3s-a.drv machine # [ 459.385868] niks3-server[1175]: 2026/09/30 09:18:44 INFO Registered completed upload object_key=nar/1vxmmzwi16s4iri6dcmi9v62dpq1ys7wz15b497ncik3sd67nfzg.nar.zst machine # [ 459.387987] niks3-server[1175]: 2026/09/30 09:18:44 INFO Received complete push request method=POST path=/api/pushes/22/complete machine # [ 459.394124] niks3-server[1175]: 2026/09/30 09:18:44 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo machine # [ 459.463983] niks3-server[1175]: 2026/09/30 09:18:44 INFO Received push request method=POST path=/api/pushes machine # [ 459.474127] niks3-server[1175]: 2026/09/30 09:18:44 INFO Received sign narinfos request method=POST path=/api/pushes/23/sign machine # [ 459.474605] niks3-server[1175]: 2026/09/30 09:18:44 INFO Signed narinfos id=23 count=1 machine # [ 459.479428] niks3-server[1175]: 2026/09/30 09:18:44 INFO Registered completed upload object_key=nar/0cbxkyxz068xc5mivh2h67kw6y01n1x28cbs11v1a03g8m4c71zm.nar.zst machine # [ 459.480060] niks3-server[1175]: 2026/09/30 09:18:44 INFO Received complete push request method=POST path=/api/pushes/23/complete machine # [ 459.482575] niks3-server[1175]: 2026/09/30 09:18:44 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.ls machine # [ 459.485683] niks3-server[1175]: 2026/09/30 09:18:44 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.narinfo machine # [ 484.802257] niks3-server[1175]: 2026/09/30 09:19:09 INFO Received push request method=POST path=/api/pushes machine # [ 484.819928] niks3-server[1175]: 2026/09/30 09:19:09 INFO Received sign narinfos request method=POST path=/api/pushes/24/sign machine # [ 484.821190] niks3-server[1175]: 2026/09/30 09:19:09 INFO Registered completed upload object_key=log/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4-k3s-b.drv machine # [ 484.822926] niks3-server[1175]: 2026/09/30 09:19:09 INFO Signed narinfos id=24 count=1 machine # [ 484.824622] niks3-server[1175]: 2026/09/30 09:19:09 INFO Registered completed upload object_key=nar/0khxywxb2r78vhpc5hsmha3ymgp910z0aka7550jmaqzs333rmzp.nar.zst machine # [ 484.828896] niks3-server[1175]: 2026/09/30 09:19:09 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.ls machine # [ 484.842938] niks3-server[1175]: 2026/09/30 09:19:09 INFO Received complete push request method=POST path=/api/pushes/24/complete machine # [ 484.849073] niks3-server[1175]: 2026/09/30 09:19:09 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.narinfo machine # [ 484.904689] niks3-server[1175]: 2026/09/30 09:19:09 INFO Received push request method=POST path=/api/pushes machine # [ 484.912897] niks3-server[1175]: 2026/09/30 09:19:09 INFO Received sign narinfos request method=POST path=/api/pushes/25/sign machine # [ 484.916412] niks3-server[1175]: 2026/09/30 09:19:09 INFO Signed narinfos id=25 count=1 machine # [ 484.918398] niks3-server[1175]: 2026/09/30 09:19:09 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.ls machine # [ 484.918710] niks3-server[1175]: 2026/09/30 09:19:09 INFO Registered completed upload object_key=nar/04bim5f8bvjh25xncf5x40kb529khrlzcbc92qxvapgbc0bdfv2h.nar.zst machine # [ 484.922281] niks3-server[1175]: 2026/09/30 09:19:09 INFO Received complete push request method=POST path=/api/pushes/25/complete machine # [ 484.926169] niks3-server[1175]: 2026/09/30 09:19:09 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.narinfo machine # [ 509.638730] niks3-server[1175]: 2026/09/30 09:19:34 INFO Received push request method=POST path=/api/pushes machine # [ 509.657577] niks3-server[1175]: 2026/09/30 09:19:34 INFO Registered completed upload object_key=nar/11f7f1hixry25c2yc6np9hs10a2pwwqmymmrxxbswhdjabcyvv0s.nar.zst machine # [ 509.660517] niks3-server[1175]: 2026/09/30 09:19:34 INFO Received sign narinfos request method=POST path=/api/pushes/26/sign machine # [ 509.662678] niks3-server[1175]: 2026/09/30 09:19:34 INFO Signed narinfos id=26 count=1 machine # [ 509.664462] niks3-server[1175]: 2026/09/30 09:19:34 INFO Registered completed upload object_key=log/jz7biafi8rj5r3r392blyazw5mdpvy0d-k3s-top.drv machine # [ 509.664897] niks3-server[1175]: 2026/09/30 09:19:34 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.ls machine # [ 509.670317] niks3-server[1175]: 2026/09/30 09:19:34 INFO Received complete push request method=POST path=/api/pushes/26/complete machine # [ 509.674596] niks3-server[1175]: 2026/09/30 09:19:34 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1, in 75.50 seconds) (finished: subtest: a renewed balancer certificate is served without a rollout, in 95.29 seconds) subtest: metrics carry build_info machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-k8556 -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-k8556 -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.14 seconds) machine: must succeed: curl -sf http://10.42.0.6:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-k8556"' machine: (finished: must succeed: curl -sf http://10.42.0.6:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-k8556"', in 0.03 seconds) (finished: subtest: metrics carry build_info, in 0.17 seconds) subtest: harmonia-gc frees space and the worker stays Ready machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-k8556 -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'' machine # [ 510.038581] k3s[870]: E0930 09:19:34.922180 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:36600: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-k8556 -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'', in 0.16 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-k8556 -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done' machine # [ 510.277085] k3s[870]: E0930 09:19:35.161062 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:36610: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-k8556 -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done', in 0.24 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-k8556 -c gc -- sh -c 'fallocate -l 11430436864 /nix/fill' machine # [ 510.455954] k3s[870]: E0930 09:19:35.339819 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:36622: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-k8556 -c gc -- sh -c 'fallocate -l 11430436864 /nix/fill', in 0.18 seconds) machine: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-k8556 -c gc --since=30s | grep -q 'store paths deleted' machine: (finished: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-k8556 -c gc --since=30s | grep -q 'store paths deleted', in 10.03 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-k8556 -c gc -- sh -c 'rm /nix/fill' machine # [ 520.705315] k3s[870]: E0930 09:19:45.588976 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:36358: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-k8556 -c gc -- sh -c 'rm /nix/fill', in 0.22 seconds) machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-k8556 -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-k8556 -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}', in 0.13 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-k8556 -c gc -- sh -c 'command -v nix-daemon && command -v niks3' machine # [ 521.002600] k3s[870]: E0930 09:19:45.886519 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:36374: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-k8556 -c gc -- sh -c 'command -v nix-daemon && command -v niks3', in 0.17 seconds) (finished: subtest: harmonia-gc frees space and the worker stays Ready, in 11.13 seconds) subtest: losing the balancer mid-build: the client reconnects and the build succeeds machine: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1 machine # [ 521.026862] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1. machine # Running as unit: vialb.service; invocation ID: 16f6f1c7b3d44b24859bc975c5d11505 machine: (finished: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1, in 0.02 seconds) machine: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'" machine # [ 521.141078] nix[9669]: don't know how to build these paths: machine # [ 521.141315] nix[9669]: /nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 521.159122] nix[9669]: copying 1 paths to '127.0.0.1:30051'... machine # [ 521.159903] nix[9669]: copying path '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' to '127.0.0.1:30051'... machine # [ 521.211500] niks3-server[1175]: 2026/09/30 09:19:46 INFO Received push request method=POST path=/api/pushes machine # [ 521.222714] niks3-server[1175]: 2026/09/30 09:19:46 INFO Received sign narinfos request method=POST path=/api/pushes/27/sign machine # [ 521.223578] niks3-server[1175]: 2026/09/30 09:19:46 INFO Signed narinfos id=27 count=1 machine # [ 521.225816] niks3-server[1175]: 2026/09/30 09:19:46 INFO Registered completed upload object_key=nar/0kkr2vb091wkq0cb0f1q92413dsfskh76wydp8mwysv7rawns0ar.nar.zst machine # [ 521.227180] niks3-server[1175]: 2026/09/30 09:19:46 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.ls machine # [ 521.241647] niks3-server[1175]: 2026/09/30 09:19:46 INFO Received complete push request method=POST path=/api/pushes/27/complete machine # [ 521.245441] niks3-server[1175]: 2026/09/30 09:19:46 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.narinfo machine # [ 521.251593] nix[9669]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 521.251741] nix[9669]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-v5ns4: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine: (finished: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'", in 1.06 seconds) machine: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false machine: (finished: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false, in 0.26 seconds) machine: waiting for success: ! systemctl is-active vialb machine # [ 522.373662] nix[9669]: d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv: Stream removed (Socket closed), asking the scheduler again machine # [ 522.375583] nix[9669]: scheduler at 127.0.0.1:30051: Stream removed (Socket closed), reconnecting machine # [ 522.395878] systemd[1]: cri-containerd-8637c9f7ad1fc5408ab10cbb5bb501b5004d3596795cbad7e8536822898d2861.scope: Deactivated successfully. machine # [ 522.396760] systemd[1]: cri-containerd-8637c9f7ad1fc5408ab10cbb5bb501b5004d3596795cbad7e8536822898d2861.scope: Consumed 4.057s CPU time over 7min 51.834s wall clock time, 58.1M memory peak, 36.1M read from disk, 610.9K incoming IP traffic, 772.5K outgoing IP traffic. machine # [ 522.428768] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-8637c9f7ad1fc5408ab10cbb5bb501b5004d3596795cbad7e8536822898d2861-rootfs.mount: Deactivated successfully. machine # [ 522.461112] systemd[1]: cri-containerd-4749f655f79a1c0b9d3df6c33989a4da274aba86029d0f17a2fb3b8ed5b3f362.scope: Deactivated successfully. machine # [ 522.488104] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-4749f655f79a1c0b9d3df6c33989a4da274aba86029d0f17a2fb3b8ed5b3f362-rootfs.mount: Deactivated successfully. machine # [ 522.510339] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-4749f655f79a1c0b9d3df6c33989a4da274aba86029d0f17a2fb3b8ed5b3f362-shm.mount: Deactivated successfully. machine # [ 522.539188] k3s[870]: E0930 09:19:47.422832 870 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-lb-5877cc8b4f\" failed with read version: 776 is not as new as written version: 810 for group resource replicasets.apps" logger="UnhandledError" machine # [ 522.545947] k3s[870]: E0930 09:19:47.428386 870 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-lb-5877cc8b4f\" failed with read version: 810 is not as new as written version: 812 for group resource replicasets.apps" logger="UnhandledError" machine # [ 522.552072] systemd[1]: Created slice libcontainer container kubepods-besteffort-podf61fbdbf_2330_4241_a499_737a46d89a8d.slice. machine # [ 522.706985] cni0: port 4(vethb1cab76c) entered disabled state machine # [ 522.555577] dhcpcd[3603]: vethb1cab76c: carrier lost machine # [ 522.709553] vethb1cab76c (unregistering): left allmulticast mode machine # [ 522.711023] vethb1cab76c (unregistering): left promiscuous mode machine # [ 522.712255] cni0: port 4(vethb1cab76c) entered disabled state machine # [ 522.578500] systemd[1]: run-netns-cni\x2d7a86bd8d\x2df635\x2de2c5\x2ddab3\x2dbec2779d8c41.mount: Deactivated successfully. machine # [ 522.585370] dhcpcd[3603]: vethb1cab76c: deleting route to 169.254.0.0/16 machine # [ 522.651364] dhcpcd[3603]: vethb1cab76c: removing interface machine # [ 522.652523] k3s[870]: I0930 09:19:47.535923 870 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/03fa7db5-0d03-4adf-81a0-53d4f977873a-tls-lb\" (UniqueName: \"kubernetes.io/secret/03fa7db5-0d03-4adf-81a0-53d4f977873a-tls-lb\") pod \"03fa7db5-0d03-4adf-81a0-53d4f977873a\" (UID: \"03fa7db5-0d03-4adf-81a0-53d4f977873a\") " machine # [ 522.657076] k3s[870]: I0930 09:19:47.535963 870 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/03fa7db5-0d03-4adf-81a0-53d4f977873a-tls-ca\" (UniqueName: \"kubernetes.io/secret/03fa7db5-0d03-4adf-81a0-53d4f977873a-tls-ca\") pod \"03fa7db5-0d03-4adf-81a0-53d4f977873a\" (UID: \"03fa7db5-0d03-4adf-81a0-53d4f977873a\") " machine # [ 522.661436] k3s[870]: I0930 09:19:47.535995 870 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/03fa7db5-0d03-4adf-81a0-53d4f977873a-config\" (UniqueName: \"kubernetes.io/configmap/03fa7db5-0d03-4adf-81a0-53d4f977873a-config\") pod \"03fa7db5-0d03-4adf-81a0-53d4f977873a\" (UID: \"03fa7db5-0d03-4adf-81a0-53d4f977873a\") " machine # [ 522.665706] k3s[870]: I0930 09:19:47.536048 870 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/03fa7db5-0d03-4adf-81a0-53d4f977873a-tmp\" (UniqueName: \"kubernetes.io/empty-dir/03fa7db5-0d03-4adf-81a0-53d4f977873a-tmp\") pod \"03fa7db5-0d03-4adf-81a0-53d4f977873a\" (UID: \"03fa7db5-0d03-4adf-81a0-53d4f977873a\") " machine # [ 522.670099] k3s[870]: I0930 09:19:47.536087 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f61fbdbf-2330-4241-a499-737a46d89a8d-tmp\") pod \"nix-grpc-farm-lb-5877cc8b4f-psv25\" (UID: \"f61fbdbf-2330-4241-a499-737a46d89a8d\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-psv25" machine # [ 522.674411] k3s[870]: I0930 09:19:47.536148 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f61fbdbf-2330-4241-a499-737a46d89a8d-config\") pod \"nix-grpc-farm-lb-5877cc8b4f-psv25\" (UID: \"f61fbdbf-2330-4241-a499-737a46d89a8d\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-psv25" machine # [ 522.678587] k3s[870]: I0930 09:19:47.536174 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/f61fbdbf-2330-4241-a499-737a46d89a8d-tls-lb\") pod \"nix-grpc-farm-lb-5877cc8b4f-psv25\" (UID: \"f61fbdbf-2330-4241-a499-737a46d89a8d\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-psv25" machine # [ 522.682699] k3s[870]: I0930 09:19:47.536199 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/f61fbdbf-2330-4241-a499-737a46d89a8d-tls-ca\") pod \"nix-grpc-farm-lb-5877cc8b4f-psv25\" (UID: \"f61fbdbf-2330-4241-a499-737a46d89a8d\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-psv25" machine # [ 522.686853] k3s[870]: I0930 09:19:47.546953 870 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03fa7db5-0d03-4adf-81a0-53d4f977873a-tls-ca" pod "03fa7db5-0d03-4adf-81a0-53d4f977873a" (UID: "03fa7db5-0d03-4adf-81a0-53d4f977873a"). InnerVolumeSpecName "tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 522.690902] k3s[870]: I0930 09:19:47.551089 870 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03fa7db5-0d03-4adf-81a0-53d4f977873a-tls-lb" pod "03fa7db5-0d03-4adf-81a0-53d4f977873a" (UID: "03fa7db5-0d03-4adf-81a0-53d4f977873a"). InnerVolumeSpecName "tls-lb". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 522.694863] k3s[870]: I0930 09:19:47.551200 870 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03fa7db5-0d03-4adf-81a0-53d4f977873a-tmp" pod "03fa7db5-0d03-4adf-81a0-53d4f977873a" (UID: "03fa7db5-0d03-4adf-81a0-53d4f977873a"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 522.698830] k3s[870]: I0930 09:19:47.556164 870 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03fa7db5-0d03-4adf-81a0-53d4f977873a-config" pod "03fa7db5-0d03-4adf-81a0-53d4f977873a" (UID: "03fa7db5-0d03-4adf-81a0-53d4f977873a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 522.702984] systemd[1]: var-lib-kubelet-pods-03fa7db5\x2d0d03\x2d4adf\x2d81a0\x2d53d4f977873a-volume\x2dsubpaths-config-envoy-0.mount: Deactivated successfully. machine # [ 522.753063] k3s[870]: I0930 09:19:47.637066 870 reconciler_common.go:299] "Volume detached for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/03fa7db5-0d03-4adf-81a0-53d4f977873a-tls-ca\") on node \"machine\" DevicePath \"\"" machine # [ 522.756042] k3s[870]: I0930 09:19:47.637094 870 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/03fa7db5-0d03-4adf-81a0-53d4f977873a-config\") on node \"machine\" DevicePath \"\"" machine # [ 522.756318] k3s[870]: I0930 09:19:47.637106 870 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03fa7db5-0d03-4adf-81a0-53d4f977873a-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 522.756810] k3s[870]: I0930 09:19:47.637145 870 reconciler_common.go:299] "Volume detached for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/03fa7db5-0d03-4adf-81a0-53d4f977873a-tls-lb\") on node \"machine\" DevicePath \"\"" machine # [ 522.782669] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod03fa7db5_0d03_4adf_81a0_53d4f977873a.slice. machine # [ 522.783115] systemd[1]: kubepods-besteffort-pod03fa7db5_0d03_4adf_81a0_53d4f977873a.slice: Consumed 4.088s CPU time over 7min 54.070s wall clock time, 58.4M memory peak, 36.1M read from disk, 610.9K incoming IP traffic, 772.5K outgoing IP traffic. machine # [ 523.039393] cni0: port 2(veth02536499) entered blocking state machine # [ 523.040679] cni0: port 2(veth02536499) entered disabled state machine # [ 523.041607] veth02536499: entered allmulticast mode machine # [ 523.042534] veth02536499: entered promiscuous mode machine # [ 522.892356] (udev-worker)[9856]: Network interface NamePolicy= disabled on kernel command line. machine # [ 523.050182] cni0: port 2(veth02536499) entered blocking state machine # [ 523.051558] cni0: port 2(veth02536499) entered forwarding state machine # [ 522.921181] dhcpcd[3603]: veth02536499: IAID 9a:67:1b:02 machine # [ 522.923103] dhcpcd[3603]: veth02536499: adding address fe80::8c71:9aff:fe67:1b02 machine # [ 522.927687] k3s[870]: E0930 09:19:47.811728 870 kubelet_pods.go:2193] "failed to read memory cgroup config for the pod" err="failed to read memory.max for cgroup /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod03fa7db5_0d03_4adf_81a0_53d4f977873a.slice: openat2 /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod03fa7db5_0d03_4adf_81a0_53d4f977873a.slice/memory.max: no such file or directory" podName="nix-grpc-farm-lb-5877cc8b4f-rrkbq" machine # [ 522.928038] k3s[870]: I0930 09:19:47.811745 870 scope.go:122] "RemoveContainer" containerID="8637c9f7ad1fc5408ab10cbb5bb501b5004d3596795cbad7e8536822898d2861" machine # [ 522.928510] k3s[870]: E0930 09:19:47.811780 870 kubelet_pods.go:2198] "failed to read memory cgroup limits for the pod" err="failed to read cpu.max file for cgroup /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod03fa7db5_0d03_4adf_81a0_53d4f977873a.slice: openat2 /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod03fa7db5_0d03_4adf_81a0_53d4f977873a.slice/cpu.max: no such file or directory" podName="nix-grpc-farm-lb-5877cc8b4f-rrkbq" machine # [ 522.940254] k3s[870]: I0930 09:19:47.824316 870 scope.go:122] "RemoveContainer" containerID="8637c9f7ad1fc5408ab10cbb5bb501b5004d3596795cbad7e8536822898d2861" machine # [ 522.941673] k3s[870]: E0930 09:19:47.825677 870 remote_runtime.go:569] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"8637c9f7ad1fc5408ab10cbb5bb501b5004d3596795cbad7e8536822898d2861\": not found" containerID="8637c9f7ad1fc5408ab10cbb5bb501b5004d3596795cbad7e8536822898d2861" machine # [ 522.942235] k3s[870]: I0930 09:19:47.825718 870 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"8637c9f7ad1fc5408ab10cbb5bb501b5004d3596795cbad7e8536822898d2861"} err="failed to get container status \"8637c9f7ad1fc5408ab10cbb5bb501b5004d3596795cbad7e8536822898d2861\": rpc error: code = NotFound desc = an error occurred when try to find container \"8637c9f7ad1fc5408ab10cbb5bb501b5004d3596795cbad7e8536822898d2861\": not found" machine # [ 522.979927] dhcpcd[3603]: veth02536499: soliciting a DHCP lease machine # [ 523.007418] systemd[1]: Started libcontainer container 40b44864cd7ab2089f85a2a8357adbe4f2592abf170f877713eaef1812443726. machine # [ 523.134427] systemd[1]: Started libcontainer container 786407c137542490b9d7db4dee5c9da30475abf454b4f392ee5787081bfc4cc4. machine # [ 523.207671] k3s[870]: I0930 09:19:48.091584 870 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-5877cc8b4f-psv25" podStartSLOduration=1.091559203 podStartE2EDuration="1.091559203s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-30 09:19:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 09:19:48.090782009 +0000 UTC m=+507.792005351" watchObservedRunningTime="2026-09-30 09:19:48.091559203 +0000 UTC m=+507.792782545" machine # [ 523.437723] systemd[1]: var-lib-kubelet-pods-03fa7db5\x2d0d03\x2d4adf\x2d81a0\x2d53d4f977873a-volume\x2dsubpaths-config-envoy-2.mount: Deactivated successfully. machine # [ 523.438442] systemd[1]: var-lib-kubelet-pods-03fa7db5\x2d0d03\x2d4adf\x2d81a0\x2d53d4f977873a-volume\x2dsubpaths-config-envoy-1.mount: Deactivated successfully. machine # [ 523.439429] systemd[1]: var-lib-kubelet-pods-03fa7db5\x2d0d03\x2d4adf\x2d81a0\x2d53d4f977873a-volumes-kubernetes.io\x7esecret-tls\x2dca.mount: Deactivated successfully. machine # [ 523.440387] systemd[1]: var-lib-kubelet-pods-03fa7db5\x2d0d03\x2d4adf\x2d81a0\x2d53d4f977873a-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 523.441242] systemd[1]: var-lib-kubelet-pods-03fa7db5\x2d0d03\x2d4adf\x2d81a0\x2d53d4f977873a-volumes-kubernetes.io\x7esecret-tls\x2dlb.mount: Deactivated successfully. machine # [ 524.461521] dhcpcd[3603]: veth02536499: soliciting an IPv6 router machine # [ 524.781615] k3s[870]: I0930 09:19:49.664710 870 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="03fa7db5-0d03-4adf-81a0-53d4f977873a" path="/var/lib/kubelet/pods/03fa7db5-0d03-4adf-81a0-53d4f977873a/volumes" machine # [ 524.877126] nix[9669]: scheduler at 127.0.0.1:30051: failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:30051: tcp handshaker shutdown, reconnecting machine # [ 525.923777] nix[9669]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 525.927366] nix[9669]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-k8556: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 527.981930] dhcpcd[3603]: veth02536499: probing for an IPv4LL address machine # [ 533.038766] dhcpcd[3603]: veth02536499: using IPv4LL address 169.254.15.210 machine # [ 533.039344] dhcpcd[3603]: veth02536499: adding route to 169.254.0.0/16 machine # [ 536.466736] dhcpcd[3603]: veth02536499: no IPv6 Routers available machine # [ 570.845682] niks3-server[1175]: 2026/09/30 09:20:35 INFO Received push request method=POST path=/api/pushes machine # [ 570.859981] niks3-server[1175]: 2026/09/30 09:20:35 INFO Received sign narinfos request method=POST path=/api/pushes/28/sign machine # [ 570.865959] niks3-server[1175]: 2026/09/30 09:20:35 INFO Signed narinfos id=28 count=1 machine # [ 570.869506] niks3-server[1175]: 2026/09/30 09:20:35 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.ls machine # [ 570.873967] niks3-server[1175]: 2026/09/30 09:20:35 INFO Registered completed upload object_key=log/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 570.879792] niks3-server[1175]: 2026/09/30 09:20:35 INFO Received complete push request method=POST path=/api/pushes/28/complete machine # [ 570.883163] niks3-server[1175]: 2026/09/30 09:20:35 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.narinfo machine # [ 570.906326] systemd[1]: vialb.service: Deactivated successfully. machine # [ 570.908209] systemd[1]: vialb.service: Consumed 186ms CPU time over 49.879s wall clock time, 38.7M memory peak, 4K written to disk, 8.6K incoming IP traffic, 17.4K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active vialb, in 48.89 seconds) machine: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; }, in 0.04 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 0.37 seconds) (finished: subtest: losing the balancer mid-build: the client reconnects and the build succeeds, in 50.64 seconds) subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes machine: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 machine # [ 571.678647] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1. machine # Running as unit: slow.service; invocation ID: 6547212d409749dbbbcb95a949caa7ac machine: (finished: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1, in 0.04 seconds) machine # [ 571.814881] nix[10602]: don't know how to build these paths: machine # [ 571.816503] nix[10602]: /nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 571.832315] nix[10602]: copying 1 paths to '127.0.0.1:30051'... machine # [ 571.833710] nix[10602]: copying path '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' to '127.0.0.1:30051'... machine # [ 571.872881] niks3-server[1175]: 2026/09/30 09:20:36 INFO Received push request method=POST path=/api/pushes machine # [ 571.885567] niks3-server[1175]: 2026/09/30 09:20:36 INFO Received sign narinfos request method=POST path=/api/pushes/29/sign machine # [ 571.887804] niks3-server[1175]: 2026/09/30 09:20:36 INFO Signed narinfos id=29 count=1 machine # [ 571.889475] niks3-server[1175]: 2026/09/30 09:20:36 INFO Registered completed upload object_key=nar/0wl2i9xpw0gwrx1xqdgx9ka4n503ky9qhl20pdrdlphn8d6lcx0i.nar.zst machine # [ 571.891682] niks3-server[1175]: 2026/09/30 09:20:36 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.ls machine # [ 571.895063] niks3-server[1175]: 2026/09/30 09:20:36 INFO Received complete push request method=POST path=/api/pushes/29/complete machine # [ 571.901066] niks3-server[1175]: 2026/09/30 09:20:36 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.narinfo machine # [ 571.906063] k3s[870]: E0930 09:20:36.789562 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:43644: use of closed network connection" machine # [ 571.908967] nix[10602]: building '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' on 127.0.0.1:30051... machine # command terminated with exit code 1 machine # [ 571.909476] nix[10602]: slow-s1> machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-v5ns4: building zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 572.084597] k3s[870]: E0930 09:20:36.968538 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:43656: use of closed network connection" machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 573.361589] k3s[870]: E0930 09:20:38.244915 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:57266: use of closed network connection" machine # command terminated with exit code 1 machine # [ 573.554201] k3s[870]: E0930 09:20:38.437513 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:57270: use of closed network connection" machine # command terminated with exit code 1 machine # [ 574.844968] k3s[870]: E0930 09:20:39.728282 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:57274: use of closed network connection" machine # [ 575.021229] k3s[870]: E0930 09:20:39.905217 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:57288: use of closed network connection" machine # command terminated with exit code 1 machine # [ 576.278822] k3s[870]: E0930 09:20:41.162355 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:57296: use of closed network connection" machine # command terminated with exit code 1 machine # [ 576.456882] k3s[870]: E0930 09:20:41.340848 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:57298: use of closed network connection" machine # command terminated with exit code 1 machine # [ 577.750032] k3s[870]: E0930 09:20:42.633590 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:57310: use of closed network connection" machine # command terminated with exit code 1 machine # [ 577.930325] k3s[870]: E0930 09:20:42.814315 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:57318: use of closed network connection" machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 579.197118] k3s[870]: E0930 09:20:44.080670 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:57330: use of closed network connection" machine # command terminated with exit code 1 machine # [ 579.397824] k3s[870]: E0930 09:20:44.281527 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:57340: use of closed network connection" machine # [ 580.690457] k3s[870]: E0930 09:20:45.574095 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:57348: use of closed network connection" machine # command terminated with exit code 1 machine # [ 580.869320] k3s[870]: E0930 09:20:45.753313 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:57356: use of closed network connection" machine # command terminated with exit code 1 machine # [ 582.161268] k3s[870]: E0930 09:20:47.044915 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:57362: use of closed network connection" machine # command terminated with exit code 1 machine # [ 582.375654] k3s[870]: E0930 09:20:47.259634 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:57376: use of closed network connection" machine # command terminated with exit code 1 machine # [ 583.686381] k3s[870]: E0930 09:20:48.570058 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:53030: use of closed network connection" machine # command terminated with exit code 1 machine # [ 583.881874] k3s[870]: E0930 09:20:48.765850 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:53034: use of closed network connection" machine # command terminated with exit code 1 machine # [ 585.148688] k3s[870]: E0930 09:20:50.032369 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:53044: use of closed network connection" machine # command terminated with exit code 1 machine # [ 585.325514] k3s[870]: E0930 09:20:50.209361 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:53052: use of closed network connection" machine # command terminated with exit code 1 machine # [ 586.644541] k3s[870]: E0930 09:20:51.528239 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:53066: use of closed network connection" machine # command terminated with exit code 1 machine # [ 586.827323] k3s[870]: E0930 09:20:51.711309 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:53072: use of closed network connection" machine # command terminated with exit code 1 machine # [ 588.103475] k3s[870]: E0930 09:20:52.987185 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:53082: use of closed network connection" machine # command terminated with exit code 1 machine # [ 588.280747] k3s[870]: E0930 09:20:53.164726 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:53094: use of closed network connection" machine # command terminated with exit code 1 machine # [ 589.544393] k3s[870]: E0930 09:20:54.428016 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:53106: use of closed network connection" machine # command terminated with exit code 1 machine # [ 589.714819] k3s[870]: E0930 09:20:54.598830 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:53116: use of closed network connection" machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 590.984147] k3s[870]: E0930 09:20:55.867284 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:53120: use of closed network connection" machine # [ 591.176845] k3s[870]: E0930 09:20:56.060812 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:53134: use of closed network connection" machine # command terminated with exit code 1 machine # [ 592.521269] k3s[870]: E0930 09:20:57.404950 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:53136: use of closed network connection" machine # command terminated with exit code 1 machine # [ 592.699352] k3s[870]: E0930 09:20:57.583346 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:53146: use of closed network connection" machine # command terminated with exit code 1 machine # [ 593.970784] k3s[870]: E0930 09:20:58.854486 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:37440: use of closed network connection" machine # command terminated with exit code 1 machine # [ 594.171633] k3s[870]: E0930 09:20:59.055625 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:37442: use of closed network connection" machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 595.410975] k3s[870]: E0930 09:21:00.294607 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:37458: use of closed network connection" machine # [ 595.580518] k3s[870]: E0930 09:21:00.464528 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:37464: use of closed network connection" machine # command terminated with exit code 1 machine # [ 596.862135] k3s[870]: E0930 09:21:01.745799 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:37478: use of closed network connection" machine # command terminated with exit code 1 machine # [ 597.219624] k3s[870]: E0930 09:21:02.103631 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:37498: use of closed network connection" machine # command terminated with exit code 1 machine # [ 597.400521] k3s[870]: E0930 09:21:02.284529 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:37506: use of closed network connection" machine: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-v5ns4 --wait=false machine: (finished: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-v5ns4 --wait=false, in 0.14 seconds) machine: must succeed: sleep 5.0 machine # [ 597.582378] systemd[1]: cri-containerd-736f0b8bf9fc1a6137adc5488f4ac8065bdc46422f5cc48af9c38774d3406873.scope: Deactivated successfully. machine # [ 597.583129] systemd[1]: cri-containerd-736f0b8bf9fc1a6137adc5488f4ac8065bdc46422f5cc48af9c38774d3406873.scope: Consumed 519ms CPU time over 8min 58.001s wall clock time, 12.4M memory peak, 5.2M read from disk. machine # [ 597.609056] k3s[870]: E0930 09:21:02.493076 870 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7\" failed with read version: 854 is not as new as written version: 873 for group resource replicasets.apps" logger="UnhandledError" machine # [ 597.611811] systemd[1]: Created slice libcontainer container kubepods-besteffort-pode57690d2_5606_47da_b239_86312cabb9c6.slice. machine # [ 597.618928] k3s[870]: E0930 09:21:02.499887 870 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7\" failed with read version: 854 is not as new as written version: 873 for group resource replicasets.apps" logger="UnhandledError" machine # [ 597.637423] k3s[870]: E0930 09:21:02.521471 870 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7\" failed with read version: 873 is not as new as written version: 876 for group resource replicasets.apps" logger="UnhandledError" machine # [ 597.641099] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-736f0b8bf9fc1a6137adc5488f4ac8065bdc46422f5cc48af9c38774d3406873-rootfs.mount: Deactivated successfully. machine # [ 597.739106] k3s[870]: I0930 09:21:02.622540 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/e57690d2-5606-47da-b239-86312cabb9c6-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-wjwzk\" (UID: \"e57690d2-5606-47da-b239-86312cabb9c6\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-wjwzk" machine # [ 597.739397] k3s[870]: I0930 09:21:02.622703 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/e57690d2-5606-47da-b239-86312cabb9c6-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-wjwzk\" (UID: \"e57690d2-5606-47da-b239-86312cabb9c6\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-wjwzk" machine # [ 597.739910] k3s[870]: I0930 09:21:02.622762 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/e57690d2-5606-47da-b239-86312cabb9c6-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-wjwzk\" (UID: \"e57690d2-5606-47da-b239-86312cabb9c6\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-wjwzk" machine # [ 597.740630] k3s[870]: I0930 09:21:02.622797 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e57690d2-5606-47da-b239-86312cabb9c6-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-wjwzk\" (UID: \"e57690d2-5606-47da-b239-86312cabb9c6\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-wjwzk" machine # [ 597.741334] k3s[870]: I0930 09:21:02.622837 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/e57690d2-5606-47da-b239-86312cabb9c6-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-wjwzk\" (UID: \"e57690d2-5606-47da-b239-86312cabb9c6\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-wjwzk" machine # [ 597.741903] k3s[870]: I0930 09:21:02.622867 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/e57690d2-5606-47da-b239-86312cabb9c6-build\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-wjwzk\" (UID: \"e57690d2-5606-47da-b239-86312cabb9c6\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-wjwzk" machine # [ 597.742580] k3s[870]: I0930 09:21:02.622895 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzllz\" (UniqueName: \"kubernetes.io/projected/e57690d2-5606-47da-b239-86312cabb9c6-kube-api-access-wzllz\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-wjwzk\" (UID: \"e57690d2-5606-47da-b239-86312cabb9c6\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-wjwzk" machine # [ 597.743160] k3s[870]: I0930 09:21:02.622928 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/e57690d2-5606-47da-b239-86312cabb9c6-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-wjwzk\" (UID: \"e57690d2-5606-47da-b239-86312cabb9c6\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-wjwzk" machine # [ 597.743584] k3s[870]: I0930 09:21:02.622956 870 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/e57690d2-5606-47da-b239-86312cabb9c6-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-wjwzk\" (UID: \"e57690d2-5606-47da-b239-86312cabb9c6\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-wjwzk" machine # [ 598.165922] cni0: port 4(vethdc785ffe) entered blocking state machine # [ 598.168232] cni0: port 4(vethdc785ffe) entered disabled state machine # [ 598.170209] vethdc785ffe: entered allmulticast mode machine # [ 598.172117] vethdc785ffe: entered promiscuous mode machine # [ 598.188925] cni0: port 4(vethdc785ffe) entered blocking state machine # [ 598.191604] cni0: port 4(vethdc785ffe) entered forwarding state machine # [ 598.078297] (udev-worker)[12348]: Network interface NamePolicy= disabled on kernel command line. machine # [ 598.106279] dhcpcd[3603]: vethdc785ffe: IAID 19:f5:36:68 machine # [ 598.107286] dhcpcd[3603]: vethdc785ffe: adding address fe80::e047:19ff:fef5:3668 machine # [ 598.141309] systemd[1]: Started libcontainer container e84a6eba5180e41067a34ecdf942551359f45d212544d8b5c6d645903b208a24. machine # [ 598.398518] systemd[1]: Started libcontainer container bfdcd0e3403b0fe959ac5f9f12ad6f7624464c3f355cc3ed6bc381c108c3d075. machine # [ 599.812580] dhcpcd[3603]: vethdc785ffe: soliciting an IPv6 router machine # [ 600.023412] dhcpcd[3603]: vethdc785ffe: soliciting a DHCP lease machine # [ 601.121462] systemd[1]: cri-containerd-bfdcd0e3403b0fe959ac5f9f12ad6f7624464c3f355cc3ed6bc381c108c3d075.scope: Deactivated successfully. machine # [ 601.127292] systemd[1]: cri-containerd-bfdcd0e3403b0fe959ac5f9f12ad6f7624464c3f355cc3ed6bc381c108c3d075.scope: Consumed 1.166s CPU time over 2.722s wall clock time, 461.4M memory peak, 173.5M read from disk, 148.5M written to disk. machine # [ 601.191111] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-bfdcd0e3403b0fe959ac5f9f12ad6f7624464c3f355cc3ed6bc381c108c3d075-rootfs.mount: Deactivated successfully. machine # [ 602.446524] systemd[1]: tmp-ovl\x2didmapped932247253.mount: Deactivated successfully. machine # [ 602.475434] systemd[1]: Started libcontainer container e40e23bbfd7be28fff368318640dde6255d2012c83b7dd55ad97f86ec2b9261a. machine: (finished: must succeed: sleep 5.0, in 5.03 seconds) machine # [ 602.665366] systemd[1]: Started libcontainer container b9b7520bfe5fc1caf094170a2487a05d27123f986d5f7ebcd31effadd9fc174b. machine # command terminated with exit code 1 machine # [ 602.796134] k3s[870]: E0930 09:21:07.675489 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:37510: use of closed network connection" machine # [ 602.921306] systemd[1]: Started libcontainer container e7820c15b474b51b064d29313166c7cc4d9eefd39cc3149dcd21d6baf24292f7. machine # [ 602.995173] k3s[870]: I0930 09:21:07.879159 870 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-wjwzk" podStartSLOduration=3.186669607 podStartE2EDuration="5.879137783s" totalImagesPullingTime="0s" totalInitContainerRuntime="2.692468176s" isStatefulPod=false podCreationTimestamp="2026-09-30 09:21:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 09:21:07.878162519 +0000 UTC m=+587.579386140" watchObservedRunningTime="2026-09-30 09:21:07.879137783 +0000 UTC m=+587.580361125" machine # [ 603.016159] k3s[870]: E0930 09:21:07.900184 870 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:35890: use of closed network connection" machine: waiting for success: ! systemctl is-active slow machine # [ 605.025412] dhcpcd[3603]: vethdc785ffe: probing for an IPv4LL address machine # [ 610.192947] postgres[759]: [759] LOG: checkpoint starting: time machine # [ 610.420906] dhcpcd[3603]: vethdc785ffe: using IPv4LL address 169.254.205.103 machine # [ 610.424289] dhcpcd[3603]: vethdc785ffe: adding route to 169.254.0.0/16 machine # [ 611.816901] dhcpcd[3603]: vethdc785ffe: no IPv6 Routers available machine # [ 613.637610] postgres[759]: [759] LOG: checkpoint complete: wrote 34 buffers (0.2%), wrote 1 SLRU buffers; 0 WAL file(s) added, 0 removed, 0 recycled; write=3.419 s, sync=0.010 s, total=3.445 s; sync files=26, longest=0.004 s, average=0.001 s; distance=271 kB, estimate=4507 kB; lsn=0/1C86B00, redo lsn=0/1C86A70 machine # [ 617.049095] niks3-server[1175]: 2026/09/30 09:21:21 INFO Received push request method=POST path=/api/pushes machine # [ 617.069439] niks3-server[1175]: 2026/09/30 09:21:21 INFO Received sign narinfos request method=POST path=/api/pushes/30/sign machine # [ 617.072230] niks3-server[1175]: 2026/09/30 09:21:21 INFO Signed narinfos id=30 count=1 machine # [ 617.073850] niks3-server[1175]: 2026/09/30 09:21:21 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.ls machine # [ 617.075555] niks3-server[1175]: 2026/09/30 09:21:21 INFO Registered completed upload object_key=log/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 617.082519] niks3-server[1175]: 2026/09/30 09:21:21 INFO Received complete push request method=POST path=/api/pushes/30/complete machine # [ 617.087879] niks3-server[1175]: 2026/09/30 09:21:21 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo machine # [ 617.985138] systemd[1]: cri-containerd-e4a0609d6ae3ee498d9bf1abb0afafe661c292087bb7b4820b37f5ef72256294.scope: Deactivated successfully. machine # [ 617.988422] systemd[1]: cri-containerd-e4a0609d6ae3ee498d9bf1abb0afafe661c292087bb7b4820b37f5ef72256294.scope: Consumed 3.204s CPU time over 9min 18.598s wall clock time, 71.4M memory peak, 34.9M read from disk, 8K written to disk, 273.7K incoming IP traffic, 340.7K outgoing IP traffic. machine # [ 618.066816] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-e4a0609d6ae3ee498d9bf1abb0afafe661c292087bb7b4820b37f5ef72256294-rootfs.mount: Deactivated successfully. machine # [ 618.140295] systemd[1]: slow.service: Deactivated successfully. machine # [ 618.143655] systemd[1]: slow.service: Consumed 173ms CPU time over 46.461s wall clock time, 38.3M memory peak, 4K written to disk, 5.3K incoming IP traffic, 11.5K outgoing IP traffic. machine # [ 618.177356] k3s[870]: I0930 09:21:23.058938 870 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine: (finished: waiting for success: ! systemctl is-active slow, in 15.60 seconds) machine: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; }, in 0.03 seconds) machine: must fail: journalctl -u slow | grep -q 'asking the scheduler again' machine: (finished: must fail: journalctl -u slow | grep -q 'asking the scheduler again', in 0.03 seconds) machine: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath machine # [ 618.757228] systemd[1]: cri-containerd-4a9b639d40997eb8ae431571b2425c06e739e08aaee660fb8c330d2bf92fca1a.scope: Deactivated successfully. machine # [ 618.759452] systemd[1]: cri-containerd-4a9b639d40997eb8ae431571b2425c06e739e08aaee660fb8c330d2bf92fca1a.scope: Consumed 22.209s CPU time over 9min 19.612s wall clock time, 44.3M memory peak, 26.6M read from disk, 1.1M written to disk, 48.5K incoming IP traffic, 32.9K outgoing IP traffic. machine # [ 618.808951] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-4a9b639d40997eb8ae431571b2425c06e739e08aaee660fb8c330d2bf92fca1a-rootfs.mount: Deactivated successfully. machine: (finished: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath, in 0.13 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null machine # [ 618.833515] systemd[1]: cri-containerd-dcc1fed157ee00633f12251d303fb16baea271eedd8564f1832a05e3c9a1c3c2.scope: Deactivated successfully. machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null, in 0.03 seconds) (finished: subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes, in 47.20 seconds) (finished: run the VM test script, in 619.76 seconds) machine # [ 618.862864] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-dcc1fed157ee00633f12251d303fb16baea271eedd8564f1832a05e3c9a1c3c2-rootfs.mount: Deactivated successfully. test script finished in 619.79s cleanup kill QemuMachine (pid 45) machine # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) machine # [2026-09-30T09:21:24Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-09-30T09:21:24Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-09-30T09:21:24Z INFO virtiofsd] Client disconnected, shutting down (finished: cleanup, in 1.04 seconds) additionally exposed symbols: machine, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh