tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 1200.0 seconds run the VM test script machine: waiting for unit k3s.service machine: waiting for the VM to finish booting machine: starting vm machine: QEMU running (pid 45) machine # Disk image does not exist, creating the virtualisation disk image... machine # Formatting '/build/vm-state-machine/tmp.cP2D2JWpYu', fmt=raw size=17179869184 machine # mke2fs 1.47.4 (6-Mar-2025) machine # Discarding device blocks: 0/4194304 done machine # Creating filesystem with 4194304 4k blocks and 1048576 inodes machine # Filesystem UUID: 0fa6a593-d70e-4456-b970-eeeca397c96a machine # Superblock backups stored on blocks: machine # 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208, machine # 4096000 machine # machine # Allocating group tables: 0/128 done machine # Writing inode tables: 0/128 done machine # Creating journal (32768 blocks): done machine # Writing superblocks and filesystem accounting information: 0/128 done machine # machine # Virtualisation disk image created. machine # Starting virtiofs daemons... machine # [2026-09-28T09:47:53Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-28T09:47:53Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-28T09:47:53Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-28T09:47:53Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-28T09:47:53Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-28T09:47:53Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-28T09:47:53Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-28T09:47:53Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-28T09:47:53Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-28T09:47:53Z INFO virtiofsd] Client connected, servicing requests machine # [2026-09-28T09:47:53Z INFO virtiofsd] Client connected, servicing requests machine # [2026-09-28T09:47:53Z INFO virtiofsd] Client connected, servicing requests machine # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) machine # machine # machine # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+7EFCC730+7EF2C730 CA00 machine # Press Ctrl-B to configure iPXE (PCI 00:02.0)... machine # machine # machine # machine # machine # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 7EFCC730 7EF2C730 CB00 machine # Press Ctrl-B to configure iPXE (PCI 00:05.0)... machine # machine # machine # Booting from ROM... machine # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.53 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 21 13:06:06 UTC 2026 machine # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/c4qnn2haah3r5ic9vfmlyws69nz22yp8-nixos-system-machine-test/init regInfo=/nix/.ro-store/njz4lkz3v3cffczykw1g6qq9ij0a57bv-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.000000] BIOS-provided physical RAM map: machine # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007ffd7fff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000007ffd8000-0x000000007fffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000017fffffff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved machine # [ 0.000000] NX (Execute Disable) protection: active machine # [ 0.000000] APIC: Static calls initialized machine # [ 0.000000] SMBIOS 2.8 present. machine # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 machine # [ 0.000000] DMI: Memory slots populated: 1/1 machine # [ 0.000000] Hypervisor detected: KVM machine # [ 0.000000] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 machine # [ 0.000000] kvm-clock: using sched offset of 533599165 cycles machine # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns machine # [ 0.000005] tsc: Detected 2400.012 MHz processor machine # [ 0.000810] last_pfn = 0x180000 max_arch_pfn = 0x10000000000 machine # [ 0.000837] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs machine # [ 0.000839] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT machine # [ 0.000877] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.002730] found SMP MP-table at [mem 0x000f5450-0x000f545f] machine # [ 0.002740] Using GB pages for direct mapping machine # [ 0.002882] RAMDISK: [mem 0x7e364000-0x7ffcffff] machine # [ 0.002890] ACPI: Early table checksum verification disabled machine # [ 0.002893] ACPI: RSDP 0x00000000000F5250 000014 (v00 BOCHS ) machine # [ 0.002896] ACPI: RSDT 0x000000007FFE2539 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002900] ACPI: FACP 0x000000007FFE2319 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002906] ACPI: DSDT 0x000000007FFE0040 0022D9 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002908] ACPI: FACS 0x000000007FFE0000 000040 machine # [ 0.002910] ACPI: APIC 0x000000007FFE240D 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002911] ACPI: HPET 0x000000007FFE249D 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002913] ACPI: MCFG 0x000000007FFE24D5 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002914] ACPI: WAET 0x000000007FFE2511 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002916] ACPI: Reserving FACP table memory at [mem 0x7ffe2319-0x7ffe240c] machine # [ 0.002917] ACPI: Reserving DSDT table memory at [mem 0x7ffe0040-0x7ffe2318] machine # [ 0.002917] ACPI: Reserving FACS table memory at [mem 0x7ffe0000-0x7ffe003f] machine # [ 0.002918] ACPI: Reserving APIC table memory at [mem 0x7ffe240d-0x7ffe249c] machine # [ 0.002918] ACPI: Reserving HPET table memory at [mem 0x7ffe249d-0x7ffe24d4] machine # [ 0.002919] ACPI: Reserving MCFG table memory at [mem 0x7ffe24d5-0x7ffe2510] machine # [ 0.002919] ACPI: Reserving WAET table memory at [mem 0x7ffe2511-0x7ffe2538] machine # [ 0.003142] No NUMA configuration found machine # [ 0.003143] Faking a node at [mem 0x0000000000000000-0x000000017fffffff] machine # [ 0.003145] NODE_DATA(0) allocated [mem 0x17fff8780-0x17fffdcff] machine # [ 0.005222] Zone ranges: machine # [ 0.005222] DMA [mem 0x0000000000001000-0x0000000000ffffff] machine # [ 0.005224] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] machine # [ 0.005225] Normal [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005226] Device empty machine # [ 0.005226] Movable zone start for each node machine # [ 0.005227] Early memory node ranges machine # [ 0.005227] node 0: [mem 0x0000000000001000-0x000000000009efff] machine # [ 0.005228] node 0: [mem 0x0000000000100000-0x000000007ffd7fff] machine # [ 0.005229] node 0: [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005230] Initmem setup node 0 [mem 0x0000000000001000-0x000000017fffffff] machine # [ 0.005254] On node 0, zone DMA: 1 pages in unavailable ranges machine # [ 0.005499] On node 0, zone DMA: 97 pages in unavailable ranges machine # [ 0.071523] On node 0, zone Normal: 40 pages in unavailable ranges machine # [ 0.072006] ACPI: PM-Timer IO Port: 0x608 machine # [ 0.072020] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) machine # [ 0.072058] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 machine # [ 0.072061] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) machine # [ 0.072063] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) machine # [ 0.072064] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) machine # [ 0.072065] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) machine # [ 0.072066] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) machine # [ 0.072068] ACPI: Using ACPI (MADT) for SMP configuration information machine # [ 0.072070] ACPI: HPET id: 0x8086a201 base: 0xfed00000 machine # [ 0.072074] TSC deadline timer available machine # [ 0.072078] CPU topo: Max. logical packages: 1 machine # [ 0.072079] CPU topo: Max. logical dies: 1 machine # [ 0.072080] CPU topo: Max. dies per package: 1 machine # [ 0.072083] CPU topo: Max. threads per core: 1 machine # [ 0.072084] CPU topo: Num. cores per package: 4 machine # [ 0.072084] CPU topo: Num. threads per package: 4 machine # [ 0.072084] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs machine # [ 0.072110] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() machine # [ 0.072125] kvm-guest: KVM setup pv remote TLB flush machine # [ 0.072127] kvm-guest: setup PV sched yield machine # [ 0.072137] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] machine # [ 0.072138] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] machine # [ 0.072139] PM: hibernation: Registered nosave memory: [mem 0x7ffd8000-0xffffffff] machine # [ 0.072141] [mem 0xc0000000-0xfed1bfff] available for PCI devices machine # [ 0.072142] Booting paravirtualized kernel on KVM machine # [ 0.072146] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns machine # [ 0.076608] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 machine # [ 0.078632] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288 machine # [ 0.078683] kvm-guest: PV spinlocks enabled machine # [ 0.078684] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) machine # [ 0.078687] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/c4qnn2haah3r5ic9vfmlyws69nz22yp8-nixos-system-machine-test/init regInfo=/nix/.ro-store/njz4lkz3v3cffczykw1g6qq9ij0a57bv-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.078781] Unknown kernel command line parameters "regInfo=/nix/.ro-store/njz4lkz3v3cffczykw1g6qq9ij0a57bv-closure-info/registration", will be passed to user space. machine # [ 0.078794] random: crng init done machine # [ 0.078795] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes machine # [ 0.082888] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) machine # [ 0.084879] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) machine # [ 0.084947] software IO TLB: area num 4. machine # [ 0.152467] Fallback order for Node 0: 0 machine # [ 0.152475] Built 1 zonelists, mobility grouping on. Total pages: 1048438 machine # [ 0.152477] Policy zone: Normal machine # [ 0.154914] mem auto-init: stack:all(zero), heap alloc:on, heap free:off machine # [ 0.161482] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 machine # [ 0.169740] allocated 8388608 bytes of page_ext machine # [ 0.179433] ftrace: allocating 48798 entries in 192 pages machine # [ 0.179436] ftrace: allocated 192 pages with 2 groups machine # [ 0.180297] Dynamic Preempt: lazy machine # [ 0.180474] rcu: Preemptible hierarchical RCU implementation. machine # [ 0.180475] rcu: RCU event tracing is enabled. machine # [ 0.180475] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. machine # [ 0.180477] Trampoline variant of Tasks RCU enabled. machine # [ 0.180477] Rude variant of Tasks RCU enabled. machine # [ 0.180477] Tracing variant of Tasks RCU enabled. machine # [ 0.180478] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. machine # [ 0.180479] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 machine # [ 0.180498] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.180500] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.180501] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.184778] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16 machine # [ 0.185058] rcu: srcu_init: Setting srcu_struct sizes based on contention. machine # [ 0.185068] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns machine # [ 0.185178] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) machine # [ 0.188808] Console: colour VGA+ 80x25 machine # [ 0.188811] printk: legacy console [tty0] enabled machine # [ 0.220429] printk: legacy console [ttyS0] enabled machine # [ 0.332690] ACPI: Core revision 20250807 machine # [ 0.333586] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns machine # [ 0.335197] APIC: Switch to symmetric I/O mode setup machine # [ 0.336260] x2apic enabled machine # [ 0.337034] APIC: Switched APIC routing to: physical x2apic machine # [ 0.338006] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask() machine # [ 0.339326] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself() machine # [ 0.340840] kvm-guest: setup PV IPIs machine # [ 0.342430] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 machine # [ 0.343497] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.347838] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) machine # [ 0.348923] x86/cpu: User Mode Instruction Prevention (UMIP) activated machine # [ 0.349953] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 machine # [ 0.350835] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 machine # [ 0.351839] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto machine # [ 0.352835] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl machine # [ 0.353836] Transient Scheduler Attacks: Vulnerable: No microcode machine # [ 0.355835] Spectre V2 : Mitigation: Enhanced / Automatic IBRS machine # [ 0.356817] Speculative Return Stack Overflow: Mitigation: Safe RET machine # [ 0.357835] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization machine # [ 0.358842] Spectre V2 : Enabling IBPB for BPF machine # [ 0.359836] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier machine # [ 0.360835] active return thunk: srso_alias_return_thunk machine # [ 0.362543] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' machine # [ 0.363835] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' machine # [ 0.364835] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' machine # [ 0.365835] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' machine # [ 0.366834] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' machine # [ 0.367835] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' machine # [ 0.368835] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' machine # [ 0.370834] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 machine # [ 0.371835] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 machine # [ 0.372835] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 machine # [ 0.373835] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 machine # [ 0.374835] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 machine # [ 0.375835] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. machine # [ 0.405354] Freeing SMP alternatives memory: 44K machine # [ 0.405837] pid_max: default: 32768 minimum: 301 machine # [ 0.406936] LSM: initializing lsm=capability,landlock,yama,bpf,ima machine # [ 0.407937] landlock: Up and running. machine # [ 0.408836] Yama: becoming mindful. machine # [ 0.409947] LSM support for eBPF active machine # [ 0.410777] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.411902] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.414667] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) machine # [ 0.415363] Performance Events: Fam17h+ core perfctr, AMD PMU driver. machine # [ 0.415840] ... version: 2 machine # [ 0.416575] ... bit width: 48 machine # [ 0.416837] ... generic counters: 6 machine # [ 0.417623] ... generic bitmap: 000000000000003f machine # [ 0.417847] ... fixed-purpose counters: 0 machine # [ 0.418627] ... fixed-purpose bitmap: 0000000000000000 machine # [ 0.419609] ... value mask: 0000ffffffffffff machine # [ 0.419837] ... max period: 00007fffffffffff machine # [ 0.420800] ... global_ctrl mask: 000000000000003f machine # [ 0.421719] signal: max sigframe size: 3376 machine # [ 0.422464] rcu: Hierarchical SRCU implementation. machine # [ 0.422840] rcu: Max phase no-delay instances is 400. machine # [ 0.423884] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level machine # [ 0.429445] smp: Bringing up secondary CPUs ... machine # [ 0.430212] smpboot: x86: Booting SMP configuration: machine # [ 0.430841] .... node #0, CPUs: #1 #2 #3 machine # [ 0.434012] smp: Brought up 1 node, 4 CPUs machine # [ 0.435839] smpboot: Total of 4 processors activated (19200.09 BogoMIPS) machine # [ 0.437469] Memory: 3957832K/4193752K available (17259K kernel code, 2728K rwdata, 13652K rodata, 3656K init, 2968K bss, 220908K reserved, 0K cma-reserved) machine # [ 0.440137] devtmpfs: initialized machine # [ 0.441123] x86/mm: Memory block size: 128MB machine # [ 0.443959] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.444915] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). machine # [ 0.445957] pinctrl core: initialized pinctrl subsystem machine # [ 0.447067] PM: RTC time: 09:47:53, date: 2026-09-28 machine # [ 0.450664] NET: Registered PF_NETLINK/PF_ROUTE protocol family machine # [ 0.452431] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations machine # [ 0.452866] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations machine # [ 0.454353] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations machine # [ 0.454848] audit: initializing netlink subsys (disabled) machine # [ 0.455876] audit: type=2000 audit(1790588874.514:1): state=initialized audit_enabled=0 res=1 machine # [ 0.456115] thermal_sys: Registered thermal governor 'fair_share' machine # [ 0.457839] thermal_sys: Registered thermal governor 'bang_bang' machine # [ 0.458837] thermal_sys: Registered thermal governor 'step_wise' machine # [ 0.459837] thermal_sys: Registered thermal governor 'user_space' machine # [ 0.460838] thermal_sys: Registered thermal governor 'power_allocator' machine # [ 0.461854] cpuidle: using governor menu machine # [ 0.464089] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 machine # [ 0.465064] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] machine # [ 0.465841] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry machine # [ 0.466854] PCI: Using configuration type 1 for base access machine # [ 0.467999] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. machine # [ 0.471067] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages machine # [ 0.473848] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page machine # [ 0.476846] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages machine # [ 0.479843] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page machine # [ 0.487526] ACPI: Added _OSI(Module Device) machine # [ 0.487839] ACPI: Added _OSI(Processor Device) machine # [ 0.488674] ACPI: Added _OSI(Processor Aggregator Device) machine # [ 0.498294] ACPI: 1 ACPI AML tables successfully acquired and loaded machine # [ 0.506129] ACPI: Interpreter enabled machine # [ 0.507920] ACPI: PM: (supports S0 S3 S4 S5) machine # [ 0.509848] ACPI: Using IOAPIC for interrupt routing machine # [ 0.513136] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug machine # [ 0.516848] PCI: Using E820 reservations for host bridge windows machine # [ 0.520376] ACPI: Enabled 2 GPEs in block 00 to 3F machine # [ 0.532348] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) machine # [ 0.534851] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] machine # [ 0.537995] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] machine # [ 0.540091] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] machine # [ 0.543656] PCI host bridge to bus 0000:00 machine # [ 0.544849] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] machine # [ 0.546843] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] machine # [ 0.548843] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] machine # [ 0.550838] pci_bus 0000:00: root bus resource [mem 0x80000000-0xafffffff window] machine # [ 0.552837] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] machine # [ 0.553838] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.555839] pci_bus 0000:00: root bus resource [bus 00-ff] machine # [ 0.557015] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint machine # [ 0.558316] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint machine # [ 0.569934] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] machine # [ 0.570850] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] machine # [ 0.571885] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] machine # [ 0.574414] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] machine # [ 0.580086] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.590882] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] machine # [ 0.592861] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] machine # [ 0.595899] pci 0000:00:02.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref] machine # [ 0.599859] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] machine # [ 0.603257] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.612879] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] machine # [ 0.615860] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] machine # [ 0.617898] pci 0000:00:03.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref] machine # [ 0.623239] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint machine # [ 0.630858] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] machine # [ 0.632855] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] machine # [ 0.634886] pci 0000:00:04.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref] machine # [ 0.639642] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.643879] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] machine # [ 0.644837] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] machine # [ 0.645860] pci 0000:00:05.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref] machine # [ 0.647844] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] machine # [ 0.649444] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint machine # [ 0.652883] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] machine # [ 0.653860] pci 0000:00:06.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref] machine # [ 0.656418] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.658884] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] machine # [ 0.659861] pci 0000:00:07.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref] machine # [ 0.661420] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.664811] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] machine # [ 0.677677] pci 0000:00:08.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref] machine # [ 0.679431] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.681851] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] machine # [ 0.682860] pci 0000:00:09.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref] machine # [ 0.685652] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint machine # [ 0.687856] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] machine # [ 0.688755] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] machine # [ 0.690629] pci 0000:00:0a.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref] machine # [ 0.692374] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.696992] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] machine # [ 0.697845] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] machine # [ 0.698860] pci 0000:00:0b.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref] machine # [ 0.700444] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.702538] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] machine # [ 0.704219] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.707288] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] machine # [ 0.709069] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.710696] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] machine # [ 0.711781] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint machine # [ 0.714878] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] machine # [ 0.716068] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint machine # [ 0.717778] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO machine # [ 0.720093] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint machine # [ 0.722900] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] machine # [ 0.723843] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] machine # [ 0.725167] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint machine # [ 0.727866] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] machine # [ 0.732040] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 machine # [ 0.733949] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 machine # [ 0.734946] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 machine # [ 0.735942] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 machine # [ 0.736938] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 machine # [ 0.737961] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 machine # [ 0.738949] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 machine # [ 0.740942] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 machine # [ 0.741874] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 machine # [ 0.742856] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 machine # [ 0.743850] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 machine # [ 0.744852] ACPI: PCI: Interrupt link GSID configured for IRQ 19 machine # [ 0.745851] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 machine # [ 0.746850] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 machine # [ 0.747853] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 machine # [ 0.748851] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 machine # [ 0.752106] iommu: Default domain type: Translated machine # [ 0.752457] iommu: DMA domain TLB invalidation policy: lazy mode machine # [ 0.754113] ACPI: bus type USB registered machine # [ 0.754897] usbcore: registered new interface driver usbfs machine # [ 0.755856] usbcore: registered new interface driver hub machine # [ 0.756789] usbcore: registered new device driver usb machine # [ 0.758915] NetLabel: Initializing machine # [ 0.759584] NetLabel: domain hash size = 128 machine # [ 0.760838] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO machine # [ 0.761859] NetLabel: unlabeled traffic allowed by default machine # [ 0.762810] PCI: Using ACPI for IRQ routing machine # [ 0.806877] pci 0000:00:01.0: vgaarb: setting as boot VGA device machine # [ 0.807834] pci 0000:00:01.0: vgaarb: bridge control possible machine # [ 0.807834] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none machine # [ 0.809847] vgaarb: loaded machine # [ 0.810670] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 machine # [ 0.811508] hpet0: 3 comparators, 64-bit 100.000000 MHz counter machine # [ 0.815978] clocksource: Switched to clocksource kvm-clock machine # [ 0.817743] VFS: Disk quotas dquot_6.6.0 machine # [ 0.818527] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) machine # [ 0.820191] pnp: PnP ACPI init machine # [ 0.821023] ACPI: IRQ 4 override to edge(!), high(!) machine # [ 0.822054] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved machine # [ 0.823658] pnp: PnP ACPI: found 5 devices machine # [ 0.832696] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns machine # [ 0.834392] clocksource: Switched to clocksource acpi_pm machine # [ 0.835460] NET: Registered PF_INET protocol family machine # [ 0.837092] IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear) machine # [ 0.854261] tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.855975] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) machine # [ 0.857446] TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear) machine # [ 0.859894] TCP bind hash table entries: 32768 (order: 8, 1048576 bytes, linear) machine # [ 0.861255] TCP: Hash tables configured (established 32768 bind 32768) machine # [ 0.862477] MPTCP token hash table entries: 4096 (order: 5, 98304 bytes, linear) machine # [ 0.863847] UDP hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.865061] UDP-Lite hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.866453] NET: Registered PF_UNIX/PF_LOCAL protocol family machine # [ 0.867520] NET: Registered PF_XDP protocol family machine # [ 0.868425] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] machine # [ 0.869502] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] machine # [ 0.870580] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] machine # [ 0.871750] pci_bus 0000:00: resource 7 [mem 0x80000000-0xafffffff window] machine # [ 0.872991] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] machine # [ 0.874173] pci_bus 0000:00: resource 9 [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.876112] ACPI: \_SB_.GSIA: Enabled at IRQ 16 machine # [ 0.878258] ACPI: \_SB_.GSIB: Enabled at IRQ 17 machine # [ 0.880393] ACPI: \_SB_.GSIC: Enabled at IRQ 18 machine # [ 0.882394] ACPI: \_SB_.GSID: Enabled at IRQ 19 machine # [ 0.884120] PCI: CLS 0 bytes, default 64 machine # [ 0.884941] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) machine # [ 0.885529] Trying to unpack rootfs image as initramfs... machine # [ 0.886049] software IO TLB: mapped [mem 0x000000007a364000-0x000000007e364000] (64MB) machine # [ 0.886197] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.909824] Initialise system trusted keyrings machine # [ 0.911094] workingset: timestamp_bits=40 max_order=20 bucket_order=0 machine # [ 0.922335] Key type asymmetric registered machine # [ 0.923096] Asymmetric key parser 'x509' registered machine # [ 0.923997] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) machine # [ 0.925965] io scheduler mq-deadline registered machine # [ 0.926830] io scheduler kyber registered machine # [ 0.931625] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled machine # [ 0.933075] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A machine # [ 0.935525] Linux agpgart interface v0.103 machine # [ 0.936374] ACPI: bus type drm_connector registered machine # [ 0.939643] usbcore: registered new interface driver usbserial_generic machine # [ 0.940803] usbserial: USB Serial support registered for generic machine # [ 0.941912] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. machine # [ 0.941912] Please enable it if your BIOS has the CPPC option. machine # [ 0.944283] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled machine # [ 0.945803] drop_monitor: Initializing network drop monitor service machine # [ 0.947065] NET: Registered PF_INET6 protocol family machine # [ 0.948813] Segment Routing with IPv6 machine # [ 0.949548] In-situ OAM (IOAM) with IPv6 machine # [ 0.952464] IPI shorthand broadcast: enabled machine # [ 0.956815] sched_clock: Marking stable (803011063, 153766466)->(978726437, -21948908) machine # [ 0.958728] registered taskstats version 1 machine # [ 0.959877] Loading compiled-in X.509 certificates machine # [ 0.969748] Demotion targets for Node 0: null machine # [ 0.971109] Key type .fscrypt registered machine # [ 0.971847] Key type fscrypt-provisioning registered machine # [ 0.972874] ima: No TPM chip found, activating TPM-bypass! machine # [ 0.973855] ima: Allocated hash algorithm: sha1 machine # [ 0.974707] ima: No architecture policies found machine # [ 0.975884] PM: Magic number: 10:313:779 machine # [ 0.977612] RAS: Correctable Errors collector initialized. machine # [ 0.982241] clk: Disabling unused clocks machine # [ 0.982998] PM: genpd: Disabling unused power domains machine # [ 1.190906] Freeing initrd memory: 29104K machine # [ 1.194788] Freeing unused decrypted memory: 2028K machine # [ 1.197750] Freeing unused kernel image (initmem) memory: 3656K machine # [ 1.198966] Write protecting the kernel read-only data: 32768k machine # [ 1.201212] Freeing unused kernel image (text/rodata gap) memory: 1172K machine # [ 1.202923] Freeing unused kernel image (rodata/data gap) memory: 684K machine # [ 1.253983] x86/mm: Checked W+X mappings: passed, no W+X pages found. machine # [ 1.255161] Run /init as init process machine # [ 1.269171] systemd[1]: Inserted module 'autofs4' machine # [ 1.295345] fuse: init (API version 7.45) machine # [ 1.304232] ACPI: \_SB_.GSIG: Enabled at IRQ 22 machine # [ 1.306855] ACPI: \_SB_.GSIH: Enabled at IRQ 23 machine # [ 1.310208] ACPI: \_SB_.GSIE: Enabled at IRQ 20 machine # [ 1.312443] ACPI: \_SB_.GSIF: Enabled at IRQ 21 machine # [ 1.317521] virtiofs virtio5: discovered new tag: nix-store machine # [ 1.319116] virtiofs virtio5: virtio_fs_setup_dax: No cache capability machine # [ 1.326169] virtiofs virtio6: discovered new tag: shared machine # [ 1.339283] virtiofs virtio6: virtio_fs_setup_dax: No cache capability machine # [ 1.342878] virtiofs virtio7: discovered new tag: xchg machine # [ 1.344440] virtiofs virtio7: virtio_fs_setup_dax: No cache capability machine # [ 1.373045] systemd[1]: Successfully made /usr/ read-only. machine # [ 1.709062] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 1.714351] systemd[1]: Detected virtualization kvm. machine # [ 1.715233] systemd[1]: Detected architecture x86-64. machine # [ 1.716156] systemd[1]: Running in initrd. machine # [ 1.717249] systemd[1]: Initializing machine ID from random generator. machine # [ 1.718534] systemd[1]: Hostname set to . machine # [ 1.834172] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 1.897369] systemd[1]: Queued start job for default target Initrd Default Target. machine # [ 1.905569] systemd[1]: Created slice Slice /system/modprobe. machine # [ 1.906863] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 1.908392] systemd[1]: Expecting device /dev/disk/by-label/nixos... machine # [ 1.909607] systemd[1]: Reached target Path Units. machine # [ 1.910538] systemd[1]: Reached target Slice Units. machine # [ 1.911477] systemd[1]: Reached target Swaps. machine # [ 1.912307] systemd[1]: Reached target Timer Units. machine # [ 1.913285] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 1.914551] systemd[1]: Listening on Journal Socket (/dev/log). machine # [ 1.915785] systemd[1]: Listening on Journal Sockets. machine # [ 1.916833] systemd[1]: Listening on udev Control Socket. machine # [ 1.917901] systemd[1]: Listening on udev Kernel Socket. machine # [ 1.918896] systemd[1]: Reached target Socket Units. machine # [ 1.921098] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 1.923475] systemd[1]: Starting Load Kernel Module configfs... machine # [ 1.926654] systemd[1]: Starting Journal Service... machine # [ 1.928669] systemd[1]: Starting Load Kernel Modules... machine # [ 1.929707] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 1.940864] systemd[1]: Starting Coldplug All udev Devices... machine # [ 1.954877] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 1.961748] systemd[1]: Finished Load Kernel Module configfs. machine # [ 1.968960] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 1.970986] systemd-journald[88]: Collecting audit messages is disabled. machine # [ 1.972088] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config machine # [ 1.979093] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 1.989226] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. machine # [ 1.993856] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev machine # [ 1.996657] systemd[1]: Finished Load Kernel Modules. machine # [ 1.999893] systemd[1]: Starting Apply Kernel Variables... machine # [ 2.002884] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 2.007566] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 2.012697] systemd[1]: Started Journal Service. machine # [ 1.859653] systemd-modules-load[89]: Using 4 probe threads machine # [ 1.861361] systemd-modules-load[89]: Inserted module 'virtio_balloon' machine # [ 1.862536] systemd-modules-load[89]: Inserted module 'virtio_gpu' machine # [ 1.863693] systemd-modules-load[89]: Inserted module 'dm_mod' machine # [ 1.864773] systemd[1]: Finished Apply Kernel Variables. machine # [ 1.865822] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 1.866956] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 1.868172] systemd[1]: Reached target Local File Systems. machine # [ 1.869080] systemd[1]: Starting Create System Files and Directories... machine # [ 1.870098] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 1.879081] systemd[1]: Finished Create System Files and Directories. machine # [ 1.890786] systemd-udevd[107]: Using default interface naming scheme 'v261'. machine # [ 1.900854] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 1.907331] systemd[1]: Finished Coldplug All udev Devices. machine # [ 1.908448] systemd[1]: Reached target System Initialization. machine # [ 1.909420] systemd[1]: Reached target Basic System. machine # [ 2.154301] virtio_blk virtio2: 4/0/0 default/read/poll queues machine # [ 2.157493] virtio_blk virtio2: [vda] 33554432 512-byte logical blocks (17.2 GB/16.0 GiB) machine # [ 2.175522] uhci_hcd 0000:00:1d.0: UHCI Host Controller machine # [ 2.179116] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 1 machine # [ 2.180338] uhci_hcd 0000:00:1d.0: detected 2 ports machine # [ 2.183069] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 machine # [ 2.186079] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.187500] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.188888] usb usb1: Product: UHCI Host Controller machine # [ 2.189601] usb usb1: Manufacturer: Linux 6.18.53 uhci_hcd machine # [ 2.190457] usb usb1: SerialNumber: 0000:00:1d.0 machine # [ 2.197403] hub 1-0:1.0: USB hub found machine # [ 2.198066] hub 1-0:1.0: 2 ports detected machine # [ 2.204461] SCSI subsystem initialized machine # [ 2.209107] ehci-pci 0000:00:1d.7: EHCI Host Controller machine # [ 2.209916] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 2 machine # [ 2.211402] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 machine # [ 2.219813] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 machine # [ 2.221104] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 machine # [ 2.222888] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.224473] usb usb2: Product: EHCI Host Controller machine # [ 2.225257] usb usb2: Manufacturer: Linux 6.18.53 ehci_hcd machine # [ 2.226629] usb usb2: SerialNumber: 0000:00:1d.7 machine # [ 2.227690] hub 2-0:1.0: USB hub found machine # [ 2.228731] hub 2-0:1.0: 6 ports detected machine # [ 2.078621] systemd[1]: Starting Virtual Console Setup... machine # [ 2.084301] systemd[1]: Found device /dev/disk/by-label/nixos. machine # [ 2.085247] systemd[1]: Reached target Initrd Root Device. machine # [ 2.089943] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... machine # [ 2.250945] hub 1-0:1.0: USB hub found machine # [ 2.251605] hub 1-0:1.0: 2 ports detected machine # [ 2.253107] uhci_hcd 0000:00:1d.1: UHCI Host Controller machine # [ 2.253961] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 machine # [ 2.255116] uhci_hcd 0000:00:1d.1: detected 2 ports machine # [ 2.259060] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 machine # [ 2.260728] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 machine # [ 2.107488] systemd-vconsole-setup[142]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 2.110365] systemd[1]: Finished Virtual Console Setup. machine # [ 2.264868] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.265295] serio: i8042 KBD port at 0x60,0x64 irq 1 machine # [ 2.265301] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.265515] serio: i8042 AUX port at 0x60,0x64 irq 12 machine # [ 2.116108] systemd-fsck[147]: nixos: clean, 12/1048576 files, 109865/4194304 blocks[ 2.265850] usb usb3: Product: UHCI Host Controller machine # [ 2.265852] usb usb3: Manufacturer: Linux 6.18.53 uhci_hcd machine # machine # [ 2.265854] usb usb3: SerialNumber: 0000:00:1d.1 machine # [ 2.266383] hub 3-0:1.0: USB hub found machine # [ 2.123822] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. machine # [ 2.278437] hub 3-0:1.0: 2 ports detected machine # [ 2.281634] uhci_hcd 0000:00:1d.2: UHCI Host Controller machine # [ 2.282593] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 machine # [ 2.283921] uhci_hcd 0000:00:1d.2: detected 2 ports machine # [ 2.284755] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 machine # [ 2.288022] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.289618] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.137281] (udev-worker)[124]: Network interface NamePolicy= disabled on kernel command line. machine # [ 2.291033] usb usb4: Product: UHCI Host Controller machine # [ 2.293312] usb usb4: Manufacturer: Linux 6.18.53 uhci_hcd machine # [ 2.139821] (udev-worker)[116]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 2.294312] usb usb4: SerialNumber: 0000:00:1d.2 machine # [ 2.143090] (udev-worker)[116]: Network interface NamePolicy= disabled on kernel command line. machine # [ 2.299865] hub 4-0:1.0: USB hub found machine # [ 2.300811] hub 4-0:1.0: 2 ports detected machine # [ 2.305744] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 machine # [ 2.316624] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode machine # [ 2.317898] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) machine # [ 2.318820] ahci 0000:00:1f.2: flags: 64bit ncq only machine # [ 2.321567] scsi host0: ahci machine # [ 2.322699] scsi host1: ahci machine # [ 2.323575] scsi host2: ahci machine # [ 2.324375] scsi host3: ahci machine # [ 2.325334] scsi host4: ahci machine # [ 2.326092] scsi host5: ahci machine # [ 2.326708] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 50 lpm-pol 1 machine # [ 2.327979] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 50 lpm-pol 1 machine # [ 2.329193] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 50 lpm-pol 1 machine # [ 2.330473] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 50 lpm-pol 1 machine # [ 2.331742] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 50 lpm-pol 1 machine # [ 2.333009] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 50 lpm-pol 1 machine # [ 2.467131] usb 2-1: new high-speed USB device number 2 using ehci-pci machine # [ 2.597392] usb 2-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 machine # [ 2.600012] usb 2-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 machine # [ 2.602170] usb 2-1: Product: QEMU USB Tablet machine # [ 2.603647] usb 2-1: Manufacturer: QEMU machine # [ 2.604998] usb 2-1: SerialNumber: 28754-0000:00:1d.7-1 machine # [ 2.644209] hid: raw HID events driver (C) Jiri Kosina machine # [ 2.650070] ata2: SATA link down (SStatus 0 SControl 300) machine # [ 2.652011] ata5: SATA link down (SStatus 0 SControl 300) machine # [ 2.654384] ata1: SATA link down (SStatus 0 SControl 300) machine # [ 2.656742] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) machine # [ 2.659210] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 machine # [ 2.661406] ata3.00: applying bridge limits machine # [ 2.663339] ata4: SATA link down (SStatus 0 SControl 300) machine # [ 2.665403] ata6: SATA link down (SStatus 0 SControl 300) machine # [ 2.667653] ata3.00: configured for UDMA/100 machine # [ 2.670244] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 machine # [ 2.700270] usbcore: registered new interface driver usbhid machine # [ 2.701962] usbhid: USB HID core driver machine # [ 2.711741] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb2/2-1/2-1:1.0/0003:0627:0001.0001/input/input2 machine # [ 2.715365] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 machine # [ 2.742328] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray machine # [ 2.771075] cdrom: Uniform CD-ROM driver Revision: 3.20 machine # [ 2.791882] systemd[1]: Mounting /sysroot... machine # [ 3.087681] EXT4-fs (vda): mounted filesystem 0fa6a593-d70e-4456-b970-eeeca397c96a r/w with ordered data mode. Quota mode: none. machine # [ 2.940457] systemd[1]: Mounted /sysroot. machine # [ 2.942287] systemd[1]: Reached target Initrd Root File System. machine # [ 2.944630] systemd[1]: Mounting /sysroot/nix/.ro-store... machine # [ 2.946677] systemd[1]: Mounting /sysroot/nix/.rw-store... machine # [ 2.948538] systemd[1]: Mounting /sysroot/run... machine # [ 2.952123] systemd[1]: Mounting /sysroot/tmp/shared... machine # [ 2.962454] systemd[1]: Mounting /sysroot/tmp/xchg... machine # [ 2.968148] systemd[1]: Starting Mountpoints Configured in the Real Root... machine # [ 2.975863] systemd[1]: Mounted /sysroot/run. machine # [ 2.977411] systemd[1]: Mounted /sysroot/nix/.ro-store. machine # [ 2.978876] systemd[1]: Mounted /sysroot/nix/.rw-store. machine # [ 2.980476] systemd[1]: Mounted /sysroot/tmp/shared. machine # [ 2.981853] systemd[1]: Mounted /sysroot/tmp/xchg. machine # [ 2.983537] systemd-sysroot-fstab-check[192]: /sysroot should be mounted in the initrd, will request daemon-reload. machine # [ 2.988251] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 2.989895] systemd[1]: Reload requested from client PID 192 ('systemd-sysroot') (unit initrd-parse-etc.service)... machine # [ 2.992666] systemd[1]: Reloading... machine # [ 3.046459] systemd[1]: Reloading finished in 57 ms. machine # [ 3.072449] systemd-sysroot-fstab-check[192]: Requesting initrd-fs.target/start/replace... machine # [ 3.075365] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.077932] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.080144] systemd-sysroot-fstab-check[192]: Requesting swap.target/start/replace... machine # [ 3.082627] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.084572] systemd[1]: initrd-parse-etc.service: Deactivated successfully. machine # [ 3.086826] systemd[1]: Finished Mountpoints Configured in the Real Root. machine # [ 3.089169] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. machine # [ 3.112887] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.115435] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.792825] systemd[1]: Mounting /sysroot/nix/store... machine # [ 3.848934] systemd[1]: Mounted /sysroot/nix/store. machine # [ 3.850883] systemd[1]: Reached target Initrd File Systems. machine # [ 3.852864] systemd[1]: Starting Find NixOS closure... machine # [ 3.855107] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... machine # [ 3.887494] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. machine # [ 3.891390] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. machine # [ 3.905061] systemd[1]: Finished Find NixOS closure. machine # [ 3.906892] systemd[1]: Reached target Initrd Default Target. machine # [ 3.909348] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... machine # [ 3.939251] systemd[1]: Stopped target Initrd Default Target. machine # [ 3.941786] systemd[1]: Stopped target Basic System. machine # [ 3.943587] systemd[1]: Stopped target Initrd Root Device. machine # [ 3.945461] systemd[1]: Stopped target Path Units. machine # [ 3.947362] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. machine # [ 3.949945] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. machine # [ 3.952475] systemd[1]: Stopped target Slice Units. machine # [ 3.954257] systemd[1]: Stopped target Socket Units. machine # [ 3.956098] systemd[1]: Stopped target System Initialization. machine # [ 3.958187] systemd[1]: Stopped target Swaps. machine # [ 3.960754] systemd[1]: Stopped target Timer Units. machine # [ 3.964058] systemd[1]: dbus.socket: Deactivated successfully. machine # [ 3.966658] systemd[1]: Closed D-Bus System Message Bus Socket. machine # [ 3.968601] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. machine # [ 3.971213] systemd[1]: Stopped Find NixOS closure. machine # [ 3.973548] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.975208] systemd[1]: systemd-sysctl.service: Deactivated successfully. machine # [ 3.976887] systemd[1]: Stopped Apply Kernel Variables. machine # [ 3.978187] systemd[1]: systemd-modules-load.service: Deactivated successfully. machine # [ 3.979959] systemd[1]: Stopped Load Kernel Modules. machine # [ 3.981198] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. machine # [ 3.983142] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. machine # [ 3.985057] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. machine # [ 3.986904] systemd[1]: Stopped Create System Files and Directories. machine # [ 3.988488] systemd[1]: Stopped target Local File Systems. machine # [ 3.989923] systemd[1]: Stopped target Preparation for Local File Systems. machine # [ 3.991830] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. machine # [ 3.993235] systemd[1]: Stopped Coldplug All udev Devices. machine # [ 3.994202] systemd[1]: Stopping Rule-based Manager for Device Events and Files... machine # [ 3.995423] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 3.996578] systemd[1]: Stopped Virtual Console Setup. machine # [ 3.997442] systemd[1]: initrd-cleanup.service: Deactivated successfully. machine # [ 3.998676] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. machine # [ 3.999861] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 4.001078] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 4.002313] systemd[1]: systemd-udevd.service: Deactivated successfully. machine # [ 4.003426] systemd[1]: Stopped Rule-based Manager for Device Events and Files. machine # [ 4.004540] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. machine # [ 4.005667] systemd[1]: Closed udev Control Socket. machine # [ 4.006509] systemd[1]: Starting Cleanup udev Database... machine # [ 4.007390] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. machine # [ 4.008564] systemd[1]: Stopped Create Static Device Nodes in /dev. machine # [ 4.009552] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. machine # [ 4.010846] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. machine # [ 4.011942] systemd[1]: kmod-static-nodes.service: Deactivated successfully. machine # [ 4.013109] systemd[1]: Stopped Create List of Static Device Nodes. machine # [ 4.020661] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. machine # [ 4.021743] systemd[1]: Finished Cleanup udev Database. machine # [ 4.022478] systemd[1]: Reached target Switch Root. machine # [ 4.023737] systemd[1]: Starting NixOS Activation... machine # [ 4.145378] initrd-nixos-activation-start[239]: booting system configuration /nix/store/c4qnn2haah3r5ic9vfmlyws69nz22yp8-nixos-system-machine-test machine # [ 4.201115] initrd-nixos-activation-start[239]: running activation script... machine # [ 4.510401] initrd-nixos-activation-start[262]: setting up /etc... machine # [ 4.681831] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. machine # [ 4.684694] systemd[1]: Finished NixOS Activation. machine # [ 4.686476] systemd[1]: Starting Switch Root... machine # [ 4.713833] systemd[1]: Switching root. machine # [ 4.929607] systemd-journald[88]: Received SIGTERM from PID 1 (systemd). machine # [ 5.046068] NET: Registered PF_VSOCK protocol family machine # [ 5.425481] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 5.464437] systemd[1]: Detected virtualization kvm. machine # [ 5.466361] systemd[1]: Detected architecture x86-64. machine # [ 5.468368] systemd[1]: Detected first boot. machine # [ 5.472863] systemd[1]: Initializing machine ID from random generator. machine # [ 5.609709] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 5.688688] systemd[1]: Applying preset policy. machine # [ 5.878824] systemd[1]: Populated /etc with preset unit settings. machine # [ 6.124180] systemd[1]: initrd-switch-root.service: Deactivated successfully. machine # [ 6.125660] systemd[1]: Stopped initrd-switch-root.service. machine # [ 6.127822] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. machine # [ 6.130288] systemd[1]: Created slice Slice /system/getty. machine # [ 6.131791] systemd[1]: Created slice User and Session Slice. machine # [ 6.132938] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 6.134192] systemd[1]: Started Forward Password Requests to Wall Directory Watch. machine # [ 6.135426] systemd[1]: Expecting device /dev/hvc0... machine # [ 6.136196] systemd[1]: Expecting device /dev/ttyS0... machine # [ 6.137041] systemd[1]: Reached target Local Encrypted Volumes. machine # [ 6.137918] systemd[1]: Stopped target initrd-fs.target. machine # [ 6.138800] systemd[1]: Stopped target initrd-root-fs.target. machine # [ 6.139778] systemd[1]: Stopped target initrd-switch-root.target. machine # [ 6.140845] systemd[1]: Reached target Virtual Machines and Containers. machine # [ 6.141868] systemd[1]: Reached target Path Units. machine # [ 6.142626] systemd[1]: Reached target Remote File Systems. machine # [ 6.143487] systemd[1]: Reached target Slice Units. machine # [ 6.144350] systemd[1]: Reached target Swaps. machine # [ 6.146575] systemd[1]: Listening on Query the User Interactively for a Password. machine # [ 6.149433] systemd[1]: Listening on Process Core Dump Socket. machine # [ 6.151435] systemd[1]: Listening on Credential Encryption/Decryption. machine # [ 6.155330] systemd[1]: Listening on Factory Reset Management. machine # [ 6.157916] systemd[1]: Listening on Hostname Service Socket. machine # [ 6.165069] systemd[1]: Starting Journal Log Access Socket... machine # [ 6.168043] systemd[1]: Listening on Journal Audit Socket. machine # [ 6.172955] systemd[1]: Listening on Console Output Muting Service Socket. machine # [ 6.175934] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. machine # [ 6.178853] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.182264] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki machine # [ 6.192296] systemd[1]: Listening on Disk Repartitioning Service Socket. machine # [ 6.195041] systemd[1]: Listening on udev Control Socket. machine # [ 6.197308] systemd[1]: Listening on udev Varlink Socket. machine # [ 6.202933] systemd[1]: Mounting Huge Pages File System... machine # [ 6.207713] systemd[1]: Mounting POSIX Message Queue File System... machine # [ 6.212203] systemd[1]: Mounting Kernel Debug File System... machine # [ 6.221117] systemd[1]: Mounting Kernel Trace File System... machine # [ 6.227358] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 6.233383] systemd[1]: Starting Load Kernel Module configfs... machine # [ 6.235322] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm machine # [ 6.238208] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.241437] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.252303] systemd[1]: Mounting FUSE Control File System... machine # [ 6.254156] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.264115] systemd[1]: Starting Journal Service... machine # [ 6.266549] systemd[1]: Starting Load Kernel Modules... machine # [ 6.269491] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... machine # [ 6.275419] systemd[1]: Starting Remount Root and Kernel File Systems... machine # [ 6.276534] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.288347] systemd[1]: Starting Coldplug All udev Devices... machine # [ 6.291255] systemd[1]: Listening on Journal Log Access Socket. machine # [ 6.292359] systemd[1]: Mounted Huge Pages File System. machine # [ 6.293265] systemd[1]: Mounted POSIX Message Queue File System. machine # [ 6.294344] systemd[1]: Mounted Kernel Debug File System. machine # [ 6.295333] systemd[1]: Mounted Kernel Trace File System. machine # [ 6.296827] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 6.298187] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 6.299915] systemd[1]: Finished Load Kernel Module configfs. machine # [ 6.301242] systemd[1]: Mounted FUSE Control File System. machine # [ 6.304123] systemd[1]: Mounting Kernel Configuration File System... machine # [ 6.307320] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 6.318068] systemd-journald[332]: Collecting audit messages is enabled. machine # [ 6.323968] EXT4-fs (vda): re-mounted 0fa6a593-d70e-4456-b970-eeeca397c96a. machine # [ 6.326962] systemd[1]: Mounted Kernel Configuration File System. machine # [ 6.329662] systemd[1]: Finished Remount Root and Kernel File Systems. machine # [ 6.331068] systemd[1]: Listening on Disk Image Download Service Socket. machine # [ 6.332172] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.179934] systemd[1]: Queued start job for default target Multi-User System. machine # [ 6.181602] systemd[1]: systemd-journald.service: Deactivated successfully. machine # [ 6.183182] systemd-modules-load[333]: Using 2 probe threads machine # [ 6.335986] systemd[1]: Starting Load/Save OS Random Seed... machine # [ 6.336165] loop: module loaded machine # [ 6.336513] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.340198] systemd[1]: Started Journal Service. machine # [ 6.187214] systemd-modules-load[333]: Inserted module 'loop' machine # [ 6.190955] systemd-oomd[334]: No swap; memory pressure usage will be degraded machine # [ 6.202805] systemd[1]: Finished Load Kernel Modules. machine # [ 6.203780] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. machine # [ 6.206289] systemd[1]: Starting Flush Journal to Persistent Storage... machine # [ 6.207816] systemd[1]: Starting Apply Kernel Variables... machine # [ 6.217881] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 6.220601] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 6.223434] systemd[1]: Finished Load/Save OS Random Seed. machine # [ 6.224353] systemd[1]: Reached target First Boot Complete. machine # [ 6.385304] systemd-journald[332]: Received client request to flush runtime journal. machine # [ 6.287029] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 6.288439] systemd[1]: Finished Apply Kernel Variables. machine # [ 6.289359] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 6.290402] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 6.291522] systemd[1]: Finished Flush Journal to Persistent Storage. machine # [ 6.298771] systemd-udevd[362]: Using default interface naming scheme 'v261'. machine # [ 6.321116] systemd[1]: Finished Coldplug All udev Devices. machine # [ 6.336144] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 6.412482] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.434939] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. machine # [ 6.438806] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. machine # [ 6.458694] (udev-worker)[368]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.463267] (udev-worker)[389]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 6.465500] (udev-worker)[389]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.487408] systemd[1]: Condition check resulted in Virtio network device being skipped. machine # [ 6.488730] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.490320] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.492573] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.494253] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.495707] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.661125] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console machine # [ 6.675131] Console: switching to colour dummy device 80x25 machine # [ 6.676322] [drm] Found bochs VGA, ID 0xb0c5. machine # [ 6.676324] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. machine # [ 6.679650] mousedev: PS/2 mouse device common for all mice machine # [ 6.683443] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic machine # [ 6.683537] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 machine # [ 6.684219] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 machine # [ 6.689980] ACPI: button: Power Button [PWRF] machine # [ 6.700216] Console: switching to colour frame buffer device 160x50 machine # [ 6.701573] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device machine # [ 6.705072] rtc_cmos PNP0B00:00: RTC can wake from S4 machine # [ 6.705075] parport_pc 00:02: reported by Plug and Play ACPI machine # [ 6.706600] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] machine # [ 6.707771] rtc_cmos PNP0B00:00: registered as rtc0 machine # [ 6.708668] rtc_cmos PNP0B00:00: setting system clock to 2026-09-28T09:48:00 UTC (1790588880) machine # [ 6.710157] systemd-journald[332]: Time jumped backwards, rotating. machine # [ 6.712198] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs machine # [ 6.734867] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized machine # [ 6.754909] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 machine # [ 6.767797] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt machine # [ 6.768696] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD machine # [ 6.778835] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 machine # [ 6.797838] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 machine # [ 6.654375] systemd[1]: Starting Virtual Console Setup... machine # [ 6.834252] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) machine # [ 6.840290] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) machine # [ 6.692996] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 6.694313] systemd[1]: Stopped Virtual Console Setup. machine # [ 6.698060] systemd[1]: Starting Virtual Console Setup... machine # [ 6.856639] ppdev: user-space parallel port driver machine # [ 6.917279] kvm_amd: TSC scaling supported machine # [ 6.917904] kvm_amd: Nested Virtualization enabled machine # [ 6.918438] kvm_amd: Nested Paging enabled machine # [ 6.918945] kvm_amd: LBR virtualization supported machine # [ 6.919478] kvm_amd: Virtual VMLOAD VMSAVE supported machine # [ 6.920054] kvm_amd: Virtual GIF supported machine # [ 6.920532] kvm_amd: Virtual NMI enabled machine # [ 6.987687] EDAC MC: Ver: 3.0.0 machine # [ 6.886288] systemd-vconsole-setup[407]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 6.889785] systemd[1]: Finished Virtual Console Setup. machine # [ 6.974358] systemd[1]: Mounting /run/wrappers... machine # [ 7.005677] systemd[1]: Mounted /run/wrappers. machine # [ 7.007399] systemd[1]: Reached target Local File Systems. machine # [ 7.011267] systemd[1]: Listening on Boot Loader Control Service Socket. machine # [ 7.014448] systemd[1]: Starting register-nix-paths.service... machine # [ 7.017492] systemd[1]: Starting Create SUID/SGID Wrappers... machine # [ 7.019439] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. machine # [ 7.023233] systemd[1]: Starting Save Transient machine-id to Disk... machine # [ 7.030284] systemd[1]: Starting Create System Files and Directories... machine # [ 7.105156] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. machine # [ 7.107538] systemd[1]: Finished Save Transient machine-id to Disk. machine # [ 7.132600] systemd[1]: Finished Create System Files and Directories. machine # [ 7.135682] systemd[1]: Starting Rebuild Journal Catalog... machine # [ 7.137263] systemd[1]: Starting Record System Boot/Shutdown in UTMP... machine # [ 7.165888] systemd[1]: Finished Record System Boot/Shutdown in UTMP. machine # [ 7.179386] systemd[1]: Finished Rebuild Journal Catalog. machine # [ 7.181185] systemd[1]: Starting Update is Completed... machine # [ 7.205434] systemd[1]: Finished Update is Completed. machine # [ 7.299870] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. machine # [ 7.301394] systemd[1]: Finished Create SUID/SGID Wrappers. machine # [ 7.502367] systemd[1]: Finished register-nix-paths.service. machine # [ 7.504369] systemd[1]: Reached target System Initialization. machine # [ 7.507456] systemd[1]: Started Discard unused filesystem blocks once a week. machine # [ 7.509955] systemd[1]: Started niks3 garbage collection timer. machine # [ 7.511887] systemd[1]: Started Daily Cleanup of Temporary Directories. machine # [ 7.513948] systemd[1]: Reached target Timer Units. machine # [ 7.515829] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 7.527120] systemd[1]: Listening on niks3 server socket. machine # [ 7.529178] systemd[1]: Listening on Nix Daemon Socket. machine # [ 7.531121] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. machine # [ 7.533970] systemd[1]: Reached target Socket Units. machine # [ 7.535807] systemd[1]: Reached target Basic System. machine # [ 7.537548] systemd[1]: Started backdoor.service. machine # [ 7.539295] systemd[1]: Starting Import lastlog data into lastlog2 database... machine # [ 7.541730] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 7.545171] systemd[1]: Starting Post-Boot Actions... machine # [ 7.551257] systemd[1]: Started Reset console on configuration changes. machine # [ 7.558137] systemd[1]: Starting resolvconf update... machine # [ 7.561939] systemd[1]: Started rustfs.service. machine # [ 7.573170] systemd[1]: Starting rustfs-bucket.service... machine # [ 7.581297] systemd[1]: Starting D-Bus System Message Bus... machine # [ 7.598219] nsncd[490]: Sep 28 09:48:01.542 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 7.600924] systemd[1]: Finished Post-Boot Actions. machine # [ 7.603553] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 7.605083] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 7.606221] systemd[1]: Reached target User and Group Name Lookups. machine # [ 7.609318] systemd[1]: Starting User Login Management... machine # connecting to host... machine # [ 7.616372] systemd[1]: Finished Import lastlog data into lastlog2 database. machine: Guest shell says: b'Spawning backdoor root shell...\n' machine: connected to guest root shell machine: (connecting took 8.32 seconds) machine: (finished: waiting for the VM to finish booting, in 8.57 seconds) machine # [ 7.664742] dbus-broker-launch[498]: Looking up NSS user entry for 'systemd-timesync'... machine # [ 7.672315] dbus-broker-launch[498]: NSS returned no entry for 'systemd-timesync' machine # [ 7.673603] dbus-broker-launch[498]: Invalid user-name in /nix/store/g7pg57y182bsrh126xs4av309lnxhndq-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" machine # [ 7.681760] systemd-logind[517]: New seat seat0. machine # [ 7.687087] systemd-logind[517]: Watching system buttons on /dev/input/event2 (Power Button) machine # [ 7.687473] systemd-logind[517]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) machine # [ 7.687603] systemd-logind[517]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) machine # [ 7.688128] systemd[1]: Started User Login Management. machine # [ 7.706117] systemd[1]: Started D-Bus System Message Bus. machine # [ 7.710661] systemd[1]: Starting linger-users.service... machine # [ 7.711954] systemd[1]: Stopped target Host and Network Name Lookups. machine # [ 7.712451] systemd[1]: Stopping Host and Network Name Lookups... machine # [ 7.713118] systemd[1]: Stopped target User and Group Name Lookups. machine # [ 7.713637] systemd[1]: Stopping User and Group Name Lookups... machine # [ 7.714437] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... machine # [ 7.718960] systemd[1]: nscd.service: Deactivated successfully. machine # [ 7.720549] systemd[1]: Stopped Name Service Cache Daemon (nsncd). machine # [ 7.728302] dbus-broker-launch[498]: Ready machine # [ 7.728961] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 7.752271] systemd[1]: linger-users.service: Deactivated successfully. machine # [ 7.753494] systemd[1]: Finished linger-users.service. machine # [ 7.762774] nsncd[590]: Sep 28 09:48:01.707 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 7.765049] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 7.765391] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 7.765951] systemd[1]: Reached target User and Group Name Lookups. machine # [ 7.779851] systemd[1]: Finished resolvconf update. machine # [ 7.780710] systemd[1]: Reached target Preparation for Network. machine # [ 7.782874] systemd[1]: Starting DHCP Client... machine # [ 7.784830] systemd[1]: Starting Address configuration of eth1... machine # [ 7.786825] systemd[1]: Starting Extra networking commands.... machine # [ 7.843402] network-addresses-eth1-start[623]: adding address 192.168.1.1/24... done machine # [ 7.853592] network-addresses-eth1-start[623]: adding address 2001:db8:1::1/64... done machine # [ 7.870318] systemd[1]: Finished Address configuration of eth1. machine # [ 7.874456] dhcpcd[637]: dhcpcd-10.3.2 starting machine # [ 7.880271] dhcpcd[684]: dev: loaded udev machine # [ 8.043963] 8021q: 802.1Q VLAN Support v1.8 machine # [ 8.046091] 8021q: adding VLAN 0 to HW filter on device eth1 machine # [ 7.905306] systemd[1]: Finished Extra networking commands.. machine # [ 7.909030] systemd[1]: Reached target Network. machine # [ 7.909447] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. machine # [ 7.912267] systemd[1]: Starting PostgreSQL Server... machine # [ 7.914509] systemd[1]: Starting Permit User Sessions... machine # [ 7.942046] systemd[1]: Finished Permit User Sessions. machine # [ 7.943407] systemd[1]: Started Getty on tty1. machine # [ 7.943812] systemd[1]: Reached target Login Prompts. machine # [ 8.138020] cfg80211: Loading compiled-in X.509 certificates for regulatory database machine # [ 8.149487] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' machine # [ 8.150691] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' machine # [ 8.152460] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 machine # [ 8.154218] cfg80211: failed to load regulatory.db machine # [ 8.181834] 8021q: adding VLAN 0 to HW filter on device eth0 machine # [ 8.030303] dhcpcd[684]: eth0: waiting for carrier machine # [ 8.030701] dhcpcd[684]: eth0: carrier acquired machine # [ 8.038614] dhcpcd[684]: DUID 00:01:00:01:32:4c:f4:51:52:54:00:12:34:56 machine # [ 8.038932] dhcpcd[684]: eth0: IAID 00:12:34:56 machine # [ 8.039597] dhcpcd[684]: eth0: adding address fe80::5054:ff:fe12:3456 machine # [ 8.044036] postgresql-pre-start[714]: The files belonging to this database system will be owned by user "postgres". machine # [ 8.044442] postgresql-pre-start[714]: This user must also own the server process. machine # [ 8.045522] postgresql-pre-start[714]: The database cluster will be initialized with locale "en_US.UTF-8". machine # [ 8.045963] postgresql-pre-start[714]: The default database encoding has accordingly been set to "UTF8". machine # [ 8.046617] postgresql-pre-start[714]: The default text search configuration will be set to "english". machine # [ 8.047156] postgresql-pre-start[714]: Data page checksums are enabled. machine # [ 8.047713] postgresql-pre-start[714]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok machine # [ 8.048180] postgresql-pre-start[714]: creating subdirectories ... ok machine # [ 8.048699] postgresql-pre-start[714]: selecting dynamic shared memory implementation ... posix machine # [ 8.094669] postgresql-pre-start[714]: selecting default "max_connections" ... 100 machine # [ 8.153504] postgresql-pre-start[714]: selecting default "shared_buffers" ... 128MB machine # [ 8.595124] dhcpcd[684]: eth0: soliciting a DHCP lease machine # [ 8.758182] NET: Registered PF_PACKET protocol family machine # [ 8.614620] dhcpcd[684]: eth0: offered 10.0.2.15 from 10.0.2.2 machine # [ 8.619365] dhcpcd[684]: eth0: probing address 10.0.2.15/24 machine # [ 8.873264] postgresql-pre-start[714]: selecting default time zone ... UTC machine # [ 8.875482] postgresql-pre-start[714]: creating configuration files ... ok machine # [ 9.048622] postgresql-pre-start[714]: running bootstrap script ... ok machine # [ 9.500315] postgresql-pre-start[714]: performing post-bootstrap initialization ... ok machine # [ 9.673889] postgresql-pre-start[714]: syncing data to disk ... ok machine # [ 9.674921] postgresql-pre-start[714]: initdb: warning: enabling "trust" authentication for local connections machine # [ 9.675593] postgresql-pre-start[714]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. machine # [ 9.677453] postgresql-pre-start[714]: Success. You can now start the database server using: machine # [ 9.679426] postgresql-pre-start[714]: pg_ctl -D /var/lib/postgresql/18 -l logfile start machine # [ 9.837462] postgres[748]: [748] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit machine # [ 9.842484] postgres[748]: [748] LOG: listening on IPv6 address "::1", port 5432 machine # [ 9.843597] postgres[748]: [748] LOG: listening on IPv4 address "127.0.0.1", port 5432 machine # [ 9.849120] postgres[748]: [748] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" machine # [ 9.865845] postgres[764]: [764] LOG: database system was shut down at 2026-09-28 09:48:03 GMT machine # [ 9.874174] dhcpcd[684]: eth0: soliciting an IPv6 router machine # [ 9.875077] dhcpcd[684]: eth0: Router Advertisement from fe80::2 machine # [ 9.875906] dhcpcd[684]: eth0: adding address fec0::5054:ff:fe12:3456/64 machine # [ 9.877618] dhcpcd[684]: eth0: adding route to fec0::/64 machine # [ 9.879070] postgres[748]: [748] LOG: database system is ready to accept connections machine # [ 9.880251] dhcpcd[684]: eth0: adding default route via fe80::2 machine # [ 9.882471] systemd[1]: Started PostgreSQL Server. machine # [ 9.886395] systemd[1]: Starting PostgreSQL Setup Scripts... machine # [ 10.127543] postgresql-setup-start[777]: CREATE DATABASE machine # [ 10.173299] postgresql-setup-start[782]: CREATE ROLE machine # [ 10.195578] postgresql-setup-start[784]: ALTER DATABASE machine # [ 10.200750] systemd[1]: Finished PostgreSQL Setup Scripts. machine # [ 10.202063] systemd[1]: Reached target PostgreSQL. machine # [ 13.372699] dhcpcd[684]: eth0: leased 10.0.2.15 for 86400 seconds machine # [ 13.373225] dhcpcd[684]: eth0: adding route to 10.0.2.0/24 machine # [ 13.374658] dhcpcd[684]: eth0: adding default route via 10.0.2.2 machine # [ 13.523819] systemd[1]: Started DHCP Client. machine # [ 13.526726] systemd[1]: Reached target Network is Online. machine # [ 13.531723] systemd[1]: Starting k3s service... machine # [ 13.604479] k3s[875]: time="2026-09-28T09:48:07Z" level=info msg="Acquiring lock file /var/lib/rancher/k3s/data/.lock" machine # [ 13.605350] k3s[875]: time="2026-09-28T09:48:07Z" level=info msg="Preparing data dir /var/lib/rancher/k3s/data/53c81a1072dac7aebc0a3715f02f26b7ba95e9416f42c7f7aeed55ccb68af709" machine # [ 16.186741] k3s[875]: time="2026-09-28T09:48:10Z" level=info msg="Starting k3s 1.36.4+k3s1 (4dedb15b)" machine # [ 16.196849] k3s[875]: time="2026-09-28T09:48:10Z" level=info msg="Configuring sqlite3 database connection pooling: maxIdle=20, maxOpen=0, maxLifetime=0s, maxIdleTime=2m0s" machine # [ 16.197650] k3s[875]: time="2026-09-28T09:48:10Z" level=info msg="Kine built with sqlite from github.com/mattn/go-sqlite3 version 3.53.3" machine # [ 16.198458] k3s[875]: time="2026-09-28T09:48:10Z" level=info msg="Configuring database table schema and indexes, this may take a moment..." machine # [ 16.213949] k3s[875]: time="2026-09-28T09:48:10Z" level=info msg="Database tables and indexes are up to date" machine # [ 16.214483] k3s[875]: time="2026-09-28T09:48:10Z" level=info msg="Running startup VACUUM to reclaim disk space, this may take a moment..." machine # [ 16.219848] k3s[875]: time="2026-09-28T09:48:10Z" level=info msg="Startup VACUUM completed successfully" machine # [ 16.224156] k3s[875]: time="2026-09-28T09:48:10Z" level=info msg="Kine available at unix://kine.sock" machine # [ 16.224747] k3s[875]: time="2026-09-28T09:48:10Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 16.238687] k3s[875]: time="2026-09-28T09:48:10Z" level=info msg="Datastore connection validated successfully, proceeding with bootstrap data generation" machine # [ 16.239388] k3s[875]: time="2026-09-28T09:48:10Z" level=info msg="generated self-signed CA certificate CN=k3s-client-ca@1790588890: notBefore=2026-09-28 08:48:10.184223831 +0000 UTC notAfter=2036-09-25 08:48:10.184223831 +0000 UTC" machine # [ 16.240067] k3s[875]: time="2026-09-28T09:48:10Z" level=info msg="certificate CN=system:admin,O=system:masters signed by CN=k3s-client-ca@1790588890: notBefore=2026-09-28 08:48:10 +0000 UTC notAfter=2027-09-28 08:48:10 +0000 UTC" machine # [ 16.240542] k3s[875]: time="2026-09-28T09:48:10Z" level=info msg="certificate CN=system:k3s-supervisor,O=system:masters signed by CN=k3s-client-ca@1790588890: notBefore=2026-09-28 08:48:10 +0000 UTC notAfter=2027-09-28 08:48:10 +0000 UTC" machine # [ 16.241075] k3s[875]: time="2026-09-28T09:48:10Z" level=info msg="certificate CN=system:kube-controller-manager signed by CN=k3s-client-ca@1790588890: notBefore=2026-09-28 08:48:10 +0000 UTC notAfter=2027-09-28 08:48:10 +0000 UTC" machine # [ 16.241532] k3s[875]: time="2026-09-28T09:48:10Z" level=info msg="certificate CN=system:kube-scheduler signed by CN=k3s-client-ca@1790588890: notBefore=2026-09-28 08:48:10 +0000 UTC notAfter=2027-09-28 08:48:10 +0000 UTC" machine # [ 16.242086] k3s[875]: time="2026-09-28T09:48:10Z" level=info msg="certificate CN=system:apiserver,O=system:masters signed by CN=k3s-client-ca@1790588890: notBefore=2026-09-28 08:48:10 +0000 UTC notAfter=2027-09-28 08:48:10 +0000 UTC" machine # [ 16.242595] k3s[875]: time="2026-09-28T09:48:10Z" level=info msg="certificate CN=k3s-cloud-controller-manager signed by CN=k3s-client-ca@1790588890: notBefore=2026-09-28 08:48:10 +0000 UTC notAfter=2027-09-28 08:48:10 +0000 UTC" machine # [ 16.243103] k3s[875]: time="2026-09-28T09:48:10Z" level=info msg="generated self-signed CA certificate CN=k3s-server-ca@1790588890: notBefore=2026-09-28 08:48:10.187360263 +0000 UTC notAfter=2036-09-25 08:48:10.187360263 +0000 UTC" machine # [ 16.243563] k3s[875]: time="2026-09-28T09:48:10Z" level=info msg="certificate CN=kube-apiserver signed by CN=k3s-server-ca@1790588890: notBefore=2026-09-28 08:48:10 +0000 UTC notAfter=2027-09-28 08:48:10 +0000 UTC" machine # [ 16.244120] k3s[875]: time="2026-09-28T09:48:10Z" level=info msg="certificate CN=kube-scheduler signed by CN=k3s-server-ca@1790588890: notBefore=2026-09-28 08:48:10 +0000 UTC notAfter=2027-09-28 08:48:10 +0000 UTC" machine # [ 16.244592] k3s[875]: time="2026-09-28T09:48:10Z" level=info msg="certificate CN=kube-controller-manager signed by CN=k3s-server-ca@1790588890: notBefore=2026-09-28 08:48:10 +0000 UTC notAfter=2027-09-28 08:48:10 +0000 UTC" machine # [ 16.245128] k3s[875]: time="2026-09-28T09:48:10Z" level=info msg="generated self-signed CA certificate CN=k3s-request-header-ca@1790588890: notBefore=2026-09-28 08:48:10.188961864 +0000 UTC notAfter=2036-09-25 08:48:10.188961864 +0000 UTC" machine # [ 16.245655] k3s[875]: time="2026-09-28T09:48:10Z" level=info msg="certificate CN=system:auth-proxy signed by CN=k3s-request-header-ca@1790588890: notBefore=2026-09-28 08:48:10 +0000 UTC notAfter=2027-09-28 08:48:10 +0000 UTC" machine # [ 16.246136] k3s[875]: time="2026-09-28T09:48:10Z" level=info msg="generated self-signed CA certificate CN=etcd-server-ca@1790588890: notBefore=2026-09-28 08:48:10.189722296 +0000 UTC notAfter=2036-09-25 08:48:10.189722296 +0000 UTC" machine # [ 16.246652] k3s[875]: time="2026-09-28T09:48:10Z" level=info msg="certificate CN=etcd-client signed by CN=etcd-server-ca@1790588890: notBefore=2026-09-28 08:48:10 +0000 UTC notAfter=2027-09-28 08:48:10 +0000 UTC" machine # [ 16.247146] k3s[875]: time="2026-09-28T09:48:10Z" level=info msg="generated self-signed CA certificate CN=etcd-peer-ca@1790588890: notBefore=2026-09-28 08:48:10.190404226 +0000 UTC notAfter=2036-09-25 08:48:10.190404226 +0000 UTC" machine # [ 16.247672] k3s[875]: time="2026-09-28T09:48:10Z" level=info msg="certificate CN=etcd-peer signed by CN=etcd-peer-ca@1790588890: notBefore=2026-09-28 08:48:10 +0000 UTC notAfter=2027-09-28 08:48:10 +0000 UTC" machine # [ 16.248144] k3s[875]: time="2026-09-28T09:48:10Z" level=info msg="certificate CN=etcd-server signed by CN=etcd-server-ca@1790588890: notBefore=2026-09-28 08:48:10 +0000 UTC notAfter=2027-09-28 08:48:10 +0000 UTC" machine # [ 16.290167] k3s[875]: time="2026-09-28T09:48:10Z" level=info msg="certificate CN=k3s,O=k3s signed by CN=k3s-server-ca@1790588890: notBefore=2026-09-28 08:48:10 +0000 UTC notAfter=2027-09-28 08:48:10 +0000 UTC" machine # [ 16.291093] k3s[875]: time="2026-09-28T09:48:10Z" level=warning msg="dynamiclistener [::]:6443: no cached certificate available for preload - deferring certificate load until storage initialization or first client request" machine # [ 16.300981] k3s[875]: time="2026-09-28T09:48:10Z" level=info msg="Active TLS secret / (ver=) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__c9ae_78c0_b43f_d9ba-5dcd03:fec0::c9ae:78c0:b43f:d9ba listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=0716703702E90EE1CF15905551B04DB1829CC5DC]" machine # [ 16.380777] rustfs-bucket-start[904]: mb s3://farm machine # [ 16.387226] systemd[1]: Finished rustfs-bucket.service. machine # [ 17.185616] k3s[875]: time="2026-09-28T09:48:11Z" level=info msg="Password verified locally for node machine" machine # [ 17.188106] k3s[875]: time="2026-09-28T09:48:11Z" level=info msg="certificate CN=machine signed by CN=k3s-server-ca@1790588890: notBefore=2026-09-28 08:48:11 +0000 UTC notAfter=2027-09-28 08:48:11 +0000 UTC" machine # [ 17.437594] k3s[875]: time="2026-09-28T09:48:11Z" level=info msg="certificate CN=system:node:machine,O=system:nodes signed by CN=k3s-client-ca@1790588890: notBefore=2026-09-28 08:48:11 +0000 UTC notAfter=2027-09-28 08:48:11 +0000 UTC" machine # [ 17.527916] k3s[875]: time="2026-09-28T09:48:11Z" level=info msg="certificate CN=system:kube-proxy signed by CN=k3s-client-ca@1790588890: notBefore=2026-09-28 08:48:11 +0000 UTC notAfter=2027-09-28 08:48:11 +0000 UTC" machine # [ 17.601943] k3s[875]: time="2026-09-28T09:48:11Z" level=info msg="certificate CN=system:k3s-controller signed by CN=k3s-client-ca@1790588890: notBefore=2026-09-28 08:48:11 +0000 UTC notAfter=2027-09-28 08:48:11 +0000 UTC" machine # [ 17.687865] k3s[875]: time="2026-09-28T09:48:11Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:47040: runtime core not ready" machine # [ 17.779231] k3s[875]: time="2026-09-28T09:48:11Z" level=info msg="Module overlay was already loaded" machine # [ 18.002906] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. machine # [ 18.007615] Bridge firewalling registered machine # [ 17.864728] k3s[875]: time="2026-09-28T09:48:11Z" level=warning msg="Failed to load kernel module iptable_nat with modprobe" machine # [ 17.871555] k3s[875]: time="2026-09-28T09:48:11Z" level=warning msg="Failed to load kernel module iptable_filter with modprobe" machine # [ 17.881970] k3s[875]: time="2026-09-28T09:48:11Z" level=warning msg="Failed to load kernel module nft-expr-counter with modprobe" machine # [ 17.943144] k3s[875]: time="2026-09-28T09:48:11Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400" machine # [ 17.947236] k3s[875]: time="2026-09-28T09:48:11Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600" machine # [ 17.951416] k3s[875]: time="2026-09-28T09:48:11Z" level=info msg="Set sysctl 'net/ipv4/conf/all/forwarding' to 1" machine # [ 17.954718] k3s[875]: time="2026-09-28T09:48:11Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_max' to 131072" machine # [ 17.958270] k3s[875]: time="2026-09-28T09:48:11Z" level=info msg="Creating k3s-cert-monitor event broadcaster" machine # [ 17.961484] k3s[875]: time="2026-09-28T09:48:11Z" level=info msg="Connecting to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 17.965150] k3s[875]: time="2026-09-28T09:48:11Z" level=info msg="Saving cluster bootstrap data to datastore" machine # [ 17.968301] k3s[875]: time="2026-09-28T09:48:11Z" level=info msg="Polling for API server readiness: GET /readyz failed: the server is currently unable to handle the request" machine # [ 17.972215] k3s[875]: time="2026-09-28T09:48:11Z" level=info msg="Connection to etcd is ready" machine # [ 17.974453] k3s[875]: time="2026-09-28T09:48:11Z" level=info msg="ETCD server is now running" machine # [ 17.976713] k3s[875]: time="2026-09-28T09:48:11Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 17.979705] k3s[875]: time="2026-09-28T09:48:11Z" level=info msg="Handling backend connection request [machine]" machine # [ 17.982331] k3s[875]: time="2026-09-28T09:48:11Z" level=info msg="Connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 17.985275] k3s[875]: time="2026-09-28T09:48:11Z" level=info msg="Remotedialer connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 17.988725] k3s[875]: time="2026-09-28T09:48:11Z" level=info msg="Running kube-apiserver --advertise-port=6443 --allow-privileged=true --anonymous-auth=false --api-audiences=https://kubernetes.default.svc.cluster.local,k3s --authorization-mode=Node,RBAC --bind-address=127.0.0.1 --cert-dir=/var/lib/rancher/k3s/server/tls/temporary-certs --client-ca-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --egress-selector-config-file=/var/lib/rancher/k3s/server/etc/egress-selector-config.yaml --enable-admission-plugins=NodeRestriction --enable-aggregator-routing=true --enable-bootstrap-token-auth=true --etcd-servers=unix://kine.sock --kubelet-certificate-authority=/var/lib/rancher/k3s/server/tls/server-ca.crt --kubelet-client-certificate=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.crt --kubelet-client-key=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.key --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --profiling=false --proxy-client-cert-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt --proxy-client-key-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.key --requestheader-allowed-names=system:auth-proxy --requestheader-client-ca-file=/var/lib/rancher/k3s/server/tls/request-header-ca.crt --requestheader-extra-headers-prefix=X-Remote-Extra- --requestheader-group-headers=X-Remote-Group --requestheader-username-headers=X-Remote-User --secure-port=6444 --service-account-issuer=https://kubernetes.default.svc.cluster.local --service-account-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-account-signing-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --storage-backend=etcd3 --tls-cert-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --tls-private-key-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 18.011918] k3s[875]: time="2026-09-28T09:48:11Z" level=info msg="Running kube-scheduler --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --bind-address=127.0.0.1 --kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --leader-elect=false --profiling=false --secure-port=10259 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 18.018397] k3s[875]: time="2026-09-28T09:48:11Z" level=info msg="Running kube-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --bind-address=127.0.0.1 --cluster-cidr=10.42.0.0/16 --cluster-signing-kube-apiserver-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kube-apiserver-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kubelet-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-serving-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-kubelet-serving-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --cluster-signing-legacy-unknown-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-legacy-unknown-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --configure-cloud-routes=false --controllers=*,tokencleaner,-service,-route,-cloud-node-lifecycle --kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --leader-elect=false --profiling=false --root-ca-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --secure-port=10257 --service-account-private-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key --use-service-account-credentials=true" machine # [ 18.036970] k3s[875]: time="2026-09-28T09:48:11Z" level=info msg="Running cloud-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --bind-address=127.0.0.1 --cloud-config=/var/lib/rancher/k3s/server/etc/cloud-config.yaml --cloud-provider=k3s --cluster-cidr=10.42.0.0/16 --configure-cloud-routes=false --controllers=*,-route --kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --leader-elect=false --leader-elect-resource-name=k3s-cloud-controller-manager --node-status-update-frequency=1m0s --profiling=false" machine # [ 18.044719] k3s[875]: time="2026-09-28T09:48:11Z" level=info msg="Server node token is available at /var/lib/rancher/k3s/server/token" machine # [ 18.046331] k3s[875]: time="2026-09-28T09:48:11Z" level=info msg="To join server node to cluster: k3s server -s https://10.0.2.15:6443 -t ${SERVER_NODE_TOKEN}" machine # [ 18.048366] k3s[875]: time="2026-09-28T09:48:11Z" level=info msg="Agent node token is available at /var/lib/rancher/k3s/server/agent-token" machine # [ 18.050164] k3s[875]: time="2026-09-28T09:48:11Z" level=info msg="To join agent node to cluster: k3s agent -s https://10.0.2.15:6443 -t ${AGENT_NODE_TOKEN}" machine # [ 18.052241] k3s[875]: time="2026-09-28T09:48:11Z" level=info msg="Wrote kubeconfig /etc/rancher/k3s/k3s.yaml" machine # [ 18.053682] k3s[875]: time="2026-09-28T09:48:11Z" level=info msg="Run: k3s kubectl" machine # [ 18.054817] k3s[875]: I0928 09:48:11.907917 875 options.go:263] external host was not specified, using 10.0.2.15 machine # [ 18.056302] k3s[875]: I0928 09:48:11.912684 875 server.go:158] Version: v1.36.4+k3s1 machine # [ 18.057469] k3s[875]: I0928 09:48:11.912736 875 server.go:160] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 18.059087] k3s[875]: time="2026-09-28T09:48:11Z" level=info msg="Logging containerd to /var/lib/rancher/k3s/agent/containerd/containerd.log" machine # [ 18.060968] k3s[875]: time="2026-09-28T09:48:11Z" level=info msg="Running containerd -c /var/lib/rancher/k3s/agent/etc/containerd/config.toml" machine # [ 18.062774] k3s[875]: time="2026-09-28T09:48:11Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:47094: runtime core not ready" machine # [ 18.064488] k3s[875]: I0928 09:48:11.992458 875 shared_informer.go:381] "Waiting for caches to sync" controller="node_authorizer" machine # [ 18.066136] k3s[875]: E0928 09:48:11.992812 875 options.go:205] The manifest file is empty, ignoring. machine # [ 18.067456] k3s[875]: I0928 09:48:11.999772 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 18.068860] k3s[875]: I0928 09:48:12.002637 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 18.070196] k3s[875]: I0928 09:48:12.003171 875 plugins.go:157] Loaded 15 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,PodGroupProtection,RuntimeClass,DefaultIngressClass,PodTopologyLabels,MutatingAdmissionPolicy,MutatingAdmissionWebhook. machine # [ 18.075170] k3s[875]: I0928 09:48:12.003189 875 plugins.go:160] Loaded 17 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,PodGroupWorkloadExists,NodeDeclaredFeatureValidator,JobValidation,PodResizeValidator,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. machine # [ 18.080582] k3s[875]: I0928 09:48:12.003487 875 instance.go:240] Using reconciler: lease machine # [ 18.081843] k3s[875]: I0928 09:48:12.012423 875 handler.go:304] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager machine # [ 18.083431] k3s[875]: W0928 09:48:12.012442 875 genericapiserver.go:798] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. machine # [ 18.085236] k3s[875]: I0928 09:48:12.017048 875 cidrallocator.go:198] starting ServiceCIDR Allocator Controller machine # [ 18.121778] k3s[875]: I0928 09:48:12.066763 875 handler.go:304] Adding GroupVersion v1 to ResourceManager machine # [ 18.123271] k3s[875]: I0928 09:48:12.066983 875 apis.go:112] API group "internal.apiserver.k8s.io" is not enabled, skipping. machine # [ 18.145924] k3s[875]: time="2026-09-28T09:48:12Z" level=info msg="Running kube-proxy --cluster-cidr=10.42.0.0/16 --conntrack-max-per-core=0 --conntrack-tcp-timeout-close-wait=0s --conntrack-tcp-timeout-established=0s --healthz-bind-address=127.0.0.1 --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubeproxy.kubeconfig --proxy-mode=iptables" machine # [ 18.153671] k3s[875]: I0928 09:48:12.097939 875 apis.go:112] API group "storagemigration.k8s.io" is not enabled, skipping. machine # [ 18.175384] k3s[875]: I0928 09:48:12.120404 875 handler.go:304] Adding GroupVersion authentication.k8s.io v1 to ResourceManager machine # [ 18.177118] k3s[875]: W0928 09:48:12.120440 875 genericapiserver.go:798] Skipping API authentication.k8s.io/v1beta1 because it has no resources. machine # [ 18.178943] k3s[875]: W0928 09:48:12.120452 875 genericapiserver.go:798] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. machine # [ 18.181226] k3s[875]: I0928 09:48:12.120724 875 handler.go:304] Adding GroupVersion authorization.k8s.io v1 to ResourceManager machine # [ 18.181679] k3s[875]: W0928 09:48:12.120739 875 genericapiserver.go:798] Skipping API authorization.k8s.io/v1beta1 because it has no resources. machine # [ 18.182219] k3s[875]: I0928 09:48:12.121242 875 handler.go:304] Adding GroupVersion autoscaling v2 to ResourceManager machine # [ 18.183080] k3s[875]: I0928 09:48:12.121598 875 handler.go:304] Adding GroupVersion autoscaling v1 to ResourceManager machine # [ 18.184062] k3s[875]: I0928 09:48:12.122302 875 handler.go:304] Adding GroupVersion batch v1 to ResourceManager machine # [ 18.184829] k3s[875]: W0928 09:48:12.122319 875 genericapiserver.go:798] Skipping API batch/v1beta1 because it has no resources. machine # [ 18.186108] k3s[875]: I0928 09:48:12.122715 875 handler.go:304] Adding GroupVersion certificates.k8s.io v1 to ResourceManager machine # [ 18.186592] k3s[875]: W0928 09:48:12.122731 875 genericapiserver.go:798] Skipping API certificates.k8s.io/v1beta1 because it has no resources. machine # [ 18.187316] k3s[875]: W0928 09:48:12.122742 875 genericapiserver.go:798] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. machine # [ 18.188385] k3s[875]: I0928 09:48:12.122994 875 handler.go:304] Adding GroupVersion coordination.k8s.io v1 to ResourceManager machine # [ 18.188878] k3s[875]: W0928 09:48:12.123009 875 genericapiserver.go:798] Skipping API coordination.k8s.io/v1beta1 because it has no resources. machine # [ 18.189679] k3s[875]: W0928 09:48:12.123019 875 genericapiserver.go:798] Skipping API coordination.k8s.io/v1alpha2 because it has no resources. machine # [ 18.190103] k3s[875]: I0928 09:48:12.123400 875 handler.go:304] Adding GroupVersion discovery.k8s.io v1 to ResourceManager machine # [ 18.190797] k3s[875]: W0928 09:48:12.123417 875 genericapiserver.go:798] Skipping API discovery.k8s.io/v1beta1 because it has no resources. machine # [ 18.191449] k3s[875]: I0928 09:48:12.124566 875 handler.go:304] Adding GroupVersion networking.k8s.io v1 to ResourceManager machine # [ 18.191975] k3s[875]: W0928 09:48:12.124585 875 genericapiserver.go:798] Skipping API networking.k8s.io/v1beta1 because it has no resources. machine # [ 18.192700] k3s[875]: I0928 09:48:12.124816 875 handler.go:304] Adding GroupVersion node.k8s.io v1 to ResourceManager machine # [ 18.193404] k3s[875]: W0928 09:48:12.124831 875 genericapiserver.go:798] Skipping API node.k8s.io/v1beta1 because it has no resources. machine # [ 18.193961] k3s[875]: W0928 09:48:12.124843 875 genericapiserver.go:798] Skipping API node.k8s.io/v1alpha1 because it has no resources. machine # [ 18.194674] k3s[875]: I0928 09:48:12.125228 875 handler.go:304] Adding GroupVersion policy v1 to ResourceManager machine # [ 18.195228] k3s[875]: W0928 09:48:12.125243 875 genericapiserver.go:798] Skipping API policy/v1beta1 because it has no resources. machine # [ 18.195523] k3s[875]: I0928 09:48:12.126052 875 handler.go:304] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager machine # [ 18.196080] k3s[875]: W0928 09:48:12.126069 875 genericapiserver.go:798] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. machine # [ 18.196623] k3s[875]: W0928 09:48:12.126080 875 genericapiserver.go:798] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. machine # [ 18.197216] k3s[875]: I0928 09:48:12.126330 875 handler.go:304] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager machine # [ 18.197664] k3s[875]: W0928 09:48:12.126345 875 genericapiserver.go:798] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. machine # [ 18.198245] k3s[875]: W0928 09:48:12.126355 875 genericapiserver.go:798] Skipping API scheduling.k8s.io/v1alpha2 because it has no resources. machine # [ 18.198700] k3s[875]: I0928 09:48:12.127621 875 handler.go:304] Adding GroupVersion storage.k8s.io v1 to ResourceManager machine # [ 18.199260] k3s[875]: W0928 09:48:12.127650 875 genericapiserver.go:798] Skipping API storage.k8s.io/v1beta1 because it has no resources. machine # [ 18.199759] k3s[875]: W0928 09:48:12.127662 875 genericapiserver.go:798] Skipping API storage.k8s.io/v1alpha1 because it has no resources. machine # [ 18.200433] k3s[875]: I0928 09:48:12.128481 875 handler.go:304] Adding GroupVersion flowcontrol.apiserver.k8s.io v1 to ResourceManager machine # [ 18.200972] k3s[875]: W0928 09:48:12.128520 875 genericapiserver.go:798] Skipping API flowcontrol.apiserver.k8s.io/v1beta3 because it has no resources. machine # [ 18.201719] k3s[875]: W0928 09:48:12.128530 875 genericapiserver.go:798] Skipping API flowcontrol.apiserver.k8s.io/v1beta2 because it has no resources. machine # [ 18.202390] k3s[875]: W0928 09:48:12.128558 875 genericapiserver.go:798] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. machine # [ 18.202905] k3s[875]: I0928 09:48:12.132832 875 handler.go:304] Adding GroupVersion apps v1 to ResourceManager machine # [ 18.203588] k3s[875]: W0928 09:48:12.132851 875 genericapiserver.go:798] Skipping API apps/v1beta2 because it has no resources. machine # [ 18.204118] k3s[875]: W0928 09:48:12.132863 875 genericapiserver.go:798] Skipping API apps/v1beta1 because it has no resources. machine # [ 18.204836] k3s[875]: I0928 09:48:12.136213 875 handler.go:304] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager machine # [ 18.205590] k3s[875]: W0928 09:48:12.136232 875 genericapiserver.go:798] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. machine # [ 18.206134] k3s[875]: W0928 09:48:12.136243 875 genericapiserver.go:798] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. machine # [ 18.206625] k3s[875]: I0928 09:48:12.136854 875 handler.go:304] Adding GroupVersion events.k8s.io v1 to ResourceManager machine # [ 18.207141] k3s[875]: W0928 09:48:12.136873 875 genericapiserver.go:798] Skipping API events.k8s.io/v1beta1 because it has no resources. machine # [ 18.207692] k3s[875]: I0928 09:48:12.139333 875 handler.go:304] Adding GroupVersion resource.k8s.io v1 to ResourceManager machine # [ 18.208222] k3s[875]: W0928 09:48:12.139350 875 genericapiserver.go:798] Skipping API resource.k8s.io/v1beta2 because it has no resources. machine # [ 18.208589] k3s[875]: W0928 09:48:12.139360 875 genericapiserver.go:798] Skipping API resource.k8s.io/v1beta1 because it has no resources. machine # [ 18.209129] k3s[875]: W0928 09:48:12.139370 875 genericapiserver.go:798] Skipping API resource.k8s.io/v1alpha3 because it has no resources. machine # [ 18.209667] k3s[875]: I0928 09:48:12.142493 875 handler.go:304] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager machine # [ 18.210510] k3s[875]: W0928 09:48:12.142524 875 genericapiserver.go:798] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. machine # [ 18.577745] k3s[875]: I0928 09:48:12.522589 875 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 18.577982] k3s[875]: I0928 09:48:12.522605 875 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 18.578654] k3s[875]: I0928 09:48:12.522719 875 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 18.579900] k3s[875]: I0928 09:48:12.524924 875 secure_serving.go:214] Serving securely on 127.0.0.1:6444 machine # [ 18.580485] k3s[875]: I0928 09:48:12.525047 875 controller.go:113] "Deleting old lease on startup" lease="kube-system/apiserver-ik4pcwfs7qgdl76byc4pomgvia" machine # [ 18.580985] k3s[875]: I0928 09:48:12.525226 875 system_namespaces_controller.go:66] Starting system namespaces controller machine # [ 18.581649] k3s[875]: I0928 09:48:12.525325 875 dynamic_serving_content.go:135] "Starting controller" name="aggregator-proxy-cert::/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt::/var/lib/rancher/k3s/server/tls/client-auth-proxy.key" machine # [ 18.582143] k3s[875]: I0928 09:48:12.525443 875 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 18.582699] k3s[875]: I0928 09:48:12.525880 875 customresource_discovery_controller.go:294] Starting DiscoveryController machine # [ 18.583187] k3s[875]: I0928 09:48:12.525931 875 apf_controller.go:377] Starting API Priority and Fairness config controller machine # [ 18.583703] k3s[875]: time="2026-09-28T09:48:12Z" level=info msg="Starting apiserver lease garbage collector" logger=k3s machine # [ 18.584355] k3s[875]: time="2026-09-28T09:48:12Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 18.584886] k3s[875]: I0928 09:48:12.526107 875 controller.go:87] "Starting OpenAPI AggregationController" machine # [ 18.585539] k3s[875]: I0928 09:48:12.526177 875 remote_available_controller.go:434] Starting RemoteAvailability controller machine # [ 18.586129] k3s[875]: I0928 09:48:12.526198 875 cache.go:32] Waiting for caches to sync for RemoteAvailability controller machine # [ 18.586675] k3s[875]: I0928 09:48:12.526247 875 controller.go:89] "Starting OpenAPI V3 AggregationController" machine # [ 18.587197] k3s[875]: I0928 09:48:12.526478 875 controller.go:142] Starting OpenAPI controller machine # [ 18.587706] k3s[875]: I0928 09:48:12.526550 875 controller.go:90] Starting OpenAPI V3 controller machine # [ 18.588390] k3s[875]: I0928 09:48:12.526582 875 naming_controller.go:305] Starting NamingConditionController machine # [ 18.588957] k3s[875]: time="2026-09-28T09:48:12Z" level=info msg="Starting legacy_token_tracking_controller" logger=k3s machine # [ 18.589692] k3s[875]: time="2026-09-28T09:48:12Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 18.590205] k3s[875]: I0928 09:48:12.526670 875 nonstructuralschema_controller.go:202] Starting NonStructuralSchemaConditionController machine # [ 18.590730] k3s[875]: I0928 09:48:12.526712 875 apiapproval_controller.go:196] Starting KubernetesAPIApprovalPolicyConformantConditionController machine # [ 18.591386] k3s[875]: I0928 09:48:12.526717 875 apiservice_controller.go:100] Starting APIServiceRegistrationController machine # [ 18.591896] k3s[875]: I0928 09:48:12.526729 875 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller machine # [ 18.592614] k3s[875]: time="2026-09-28T09:48:12Z" level=info msg="Starting CRDFinalizer" logger=k3s machine # [ 18.593154] k3s[875]: I0928 09:48:12.527136 875 storage_readiness_hook.go:70] Storage is ready for all registered resources machine # [ 18.593732] k3s[875]: I0928 09:48:12.527978 875 cluster_authentication_trust_controller.go:459] Starting cluster_authentication_trust_controller controller machine # [ 18.594230] k3s[875]: time="2026-09-28T09:48:12Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 18.594736] k3s[875]: I0928 09:48:12.528309 875 local_available_controller.go:156] Starting LocalAvailability controller machine # [ 18.595409] k3s[875]: I0928 09:48:12.528323 875 cache.go:32] Waiting for caches to sync for LocalAvailability controller machine # [ 18.595927] k3s[875]: I0928 09:48:12.528367 875 aggregator.go:185] waiting for initial CRD sync... machine # [ 18.625408] k3s[875]: I0928 09:48:12.570418 875 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 18.625614] k3s[875]: I0928 09:48:12.570583 875 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 18.626110] k3s[875]: I0928 09:48:12.570857 875 crdregistration_controller.go:114] Starting crd-autoregister controller machine # [ 18.626666] k3s[875]: I0928 09:48:12.570872 875 shared_informer.go:381] "Waiting for caches to sync" controller="crd-autoregister" machine # [ 18.627207] k3s[875]: I0928 09:48:12.570968 875 repairip.go:210] Starting ipallocator-repair-controller machine # [ 18.627721] k3s[875]: I0928 09:48:12.570980 875 shared_informer.go:381] "Waiting for caches to sync" controller="ipallocator-repair-controller" machine # [ 18.628424] k3s[875]: time="2026-09-28T09:48:12Z" level=info msg=Starting controller=kubernetes-service-cidr-controller logger=k3s machine # [ 18.628923] k3s[875]: time="2026-09-28T09:48:12Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 18.658412] k3s[875]: I0928 09:48:12.602719 875 shared_informer.go:409] "Caches are synced" machine # [ 18.658597] k3s[875]: I0928 09:48:12.602755 875 policy_source.go:248] refreshing policies machine # [ 18.681329] k3s[875]: time="2026-09-28T09:48:12Z" level=info msg="Caches are synced" logger=k3s machine # [ 18.681722] k3s[875]: I0928 09:48:12.626467 875 apf_controller.go:382] Running API Priority and Fairness config worker machine # [ 18.682177] k3s[875]: I0928 09:48:12.626488 875 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process machine # [ 18.683278] k3s[875]: I0928 09:48:12.627843 875 cache.go:39] Caches are synced for RemoteAvailability controller machine # [ 18.683898] k3s[875]: I0928 09:48:12.627965 875 cache.go:39] Caches are synced for APIServiceRegistrationController controller machine # [ 18.684777] k3s[875]: time="2026-09-28T09:48:12Z" level=info msg="Caches are synced" logger=k3s machine # [ 18.685820] k3s[875]: I0928 09:48:12.628028 875 handler_discovery.go:459] Starting ResourceDiscoveryManager machine # [ 18.686731] k3s[875]: time="2026-09-28T09:48:12Z" level=info msg="Caches are synced" logger=k3s machine # [ 18.687401] k3s[875]: I0928 09:48:12.628384 875 cache.go:39] Caches are synced for LocalAvailability controller machine # [ 18.715971] k3s[875]: E0928 09:48:12.660980 875 controller.go:201] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" machine # [ 18.726438] k3s[875]: I0928 09:48:12.671388 875 shared_informer.go:388] "Caches are synced" controller="ipallocator-repair-controller" machine # [ 18.728282] k3s[875]: I0928 09:48:12.671446 875 shared_informer.go:388] "Caches are synced" controller="crd-autoregister" machine # [ 18.729899] k3s[875]: I0928 09:48:12.671491 875 aggregator.go:187] initial CRD sync complete... machine # [ 18.731335] k3s[875]: I0928 09:48:12.671520 875 autoregister_controller.go:144] Starting autoregister controller machine # [ 18.731848] k3s[875]: I0928 09:48:12.671543 875 cache.go:32] Waiting for caches to sync for autoregister controller machine # [ 18.732765] k3s[875]: I0928 09:48:12.671565 875 cache.go:39] Caches are synced for autoregister controller machine # [ 18.733391] k3s[875]: time="2026-09-28T09:48:12Z" level=info msg="Caches are synced" logger=k3s machine # [ 18.734119] k3s[875]: time="2026-09-28T09:48:12Z" level=info msg="Creating default ServiceCIDR" CIDRs="[10.43.0.0/16]" logger=k3s machine # [ 18.738265] k3s[875]: E0928 09:48:12.682694 875 controller.go:95] Unable to perform initial Kubernetes service initialization: namespaces "default" not found machine # [ 18.741154] k3s[875]: time="2026-09-28T09:48:12Z" level=error msg="Error while syncing ConfigMap" configmap=kube-system/kube-apiserver-legacy-service-account-token-tracking error="namespaces \"kube-system\" not found" logger=k3s/UnhandledError machine # [ 18.747736] k3s[875]: I0928 09:48:12.692744 875 shared_informer.go:388] "Caches are synced" controller="node_authorizer" machine # [ 18.755192] k3s[875]: I0928 09:48:12.700197 875 shared_informer.go:409] "Caches are synced" machine # [ 18.756639] k3s[875]: I0928 09:48:12.700288 875 policy_source.go:248] refreshing policies machine # [ 18.839879] k3s[875]: I0928 09:48:12.784654 875 cidrallocator.go:302] created ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 18.843502] k3s[875]: time="2026-09-28T09:48:12Z" level=info msg="Setting default ServiceCIDR condition Ready to True" logger=k3s machine # [ 18.856127] k3s[875]: I0928 09:48:12.800838 875 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 18.920022] k3s[875]: I0928 09:48:12.864974 875 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io machine # [ 18.985129] k3s[875]: time="2026-09-28T09:48:12Z" level=info msg="containerd is now running" machine # [ 18.997963] k3s[875]: time="2026-09-28T09:48:12Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/if20jbcicwv9y92klzcxk35m5bcz2ql0-nix-grpc-farm-lb.tar" machine # [ 19.587212] k3s[875]: I0928 09:48:13.531819 875 storage_scheduling.go:137] created PriorityClass system-node-critical with value 2000001000 machine # [ 19.592803] k3s[875]: I0928 09:48:13.537831 875 storage_scheduling.go:137] created PriorityClass system-cluster-critical with value 2000000000 machine # [ 19.593153] k3s[875]: I0928 09:48:13.537860 875 storage_scheduling.go:153] all system priority classes are created successfully or already exist. machine # [ 19.951397] k3s[875]: time="2026-09-28T09:48:13Z" level=info msg="Polling for API server readiness: GET /readyz failed: unknown" machine # [ 20.886938] k3s[875]: I0928 09:48:14.831594 875 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io machine # [ 20.930863] k3s[875]: I0928 09:48:14.875882 875 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io machine # [ 20.933336] k3s[875]: time="2026-09-28T09:48:14Z" level=info msg="Imported docker.io/library/nix-grpc-farm-lb:0.1.0-beta.4" machine # [ 20.937140] k3s[875]: time="2026-09-28T09:48:14Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-lb@sha256:18ee6724be589622e1aee9d13c5121e7b2c992ca636c935ade90c66423e18f37" machine # [ 21.002763] k3s[875]: time="2026-09-28T09:48:14Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nixos/if20jbcicwv9y92klzcxk35m5bcz2ql0-nix-grpc-farm-lb.tar in 2.005061817s" machine # [ 21.003460] k3s[875]: time="2026-09-28T09:48:14Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/j328vg2qwa3vkjb23hlas79a0wlxnwp6-nix-grpc-farm.tar" machine # [ 21.048655] k3s[875]: I0928 09:48:14.993217 875 alloc.go:329] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.43.0.1"} machine # [ 21.054397] k3s[875]: W0928 09:48:14.999411 875 lease.go:265] Resetting endpoints for master service "kubernetes" to [10.0.2.15] machine # [ 21.056054] k3s[875]: I0928 09:48:15.000998 875 controller.go:667] quota admission added evaluator for: endpoints machine # [ 21.062279] k3s[875]: I0928 09:48:15.007303 875 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io machine # [ 21.961878] k3s[875]: time="2026-09-28T09:48:15Z" level=info msg="Kube API server is now running" machine # [ 21.962222] k3s[875]: time="2026-09-28T09:48:15Z" level=info msg="k3s is up and running" machine # [ 21.963368] k3s[875]: time="2026-09-28T09:48:15Z" level=info msg="Waiting for untainted node" machine # [ 21.965395] systemd[1]: Started k3s service. machine # [ 21.971975] systemd[1]: Starting niks3 server... machine # [ 21.974183] k3s[875]: time="2026-09-28T09:48:15Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Node and Certificate Authority certificates managed by k3s are OK" object=machine reason=CertificateExpirationOK type=Normal machine # [ 21.980632] k3s[875]: time="2026-09-28T09:48:15Z" level=info msg="Creating k3s-supervisor event broadcaster" machine # [ 21.991769] k3s[875]: E0928 09:48:15.936740 875 options.go:205] The manifest file is empty, ignoring. machine # [ 21.994419] k3s[875]: I0928 09:48:15.937159 875 controllermanager.go:204] "Starting" version="v1.36.4+k3s1" machine # [ 21.997517] k3s[875]: I0928 09:48:15.937177 875 controllermanager.go:206] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 22.000407] k3s[875]: I0928 09:48:15.941192 875 secure_serving.go:214] Serving securely on 127.0.0.1:10257 machine # [ 22.001979] k3s[875]: I0928 09:48:15.941198 875 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 22.004472] k3s[875]: I0928 09:48:15.941194 875 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 22.006382] k3s[875]: I0928 09:48:15.941229 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 22.006760] k3s[875]: I0928 09:48:15.941241 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 22.007451] k3s[875]: I0928 09:48:15.941289 875 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 22.008025] k3s[875]: I0928 09:48:15.941306 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 22.008537] k3s[875]: I0928 09:48:15.941532 875 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 22.009632] k3s[875]: I0928 09:48:15.941587 875 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key" machine # [ 22.011928] k3s[875]: I0928 09:48:15.956963 875 controller.go:667] quota admission added evaluator for: serviceaccounts machine # [ 22.020656] k3s[875]: I0928 09:48:15.965698 875 node_lifecycle_controller.go:402] "Controller will reconcile labels" logger="node-lifecycle-controller" machine # [ 22.020981] k3s[875]: I0928 09:48:15.965770 875 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" requiredFeatureGates=["ClusterTrustBundle"] machine # [ 22.021658] k3s[875]: I0928 09:48:15.965806 875 controllermanager.go:641] "Warning: skipping controller" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" machine # [ 22.022192] k3s[875]: I0928 09:48:15.965818 875 controllermanager.go:689] "Warning: controller is disabled" controller="selinux-warning-controller" machine # [ 22.056954] k3s[875]: I0928 09:48:16.001977 875 controllermanager.go:689] "Warning: controller is disabled" controller="bootstrap-signer-controller" machine # [ 22.070800] k3s[875]: I0928 09:48:16.015806 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 22.097041] k3s[875]: I0928 09:48:16.041339 875 shared_informer.go:409] "Caches are synced" machine # [ 22.097205] k3s[875]: I0928 09:48:16.041714 875 shared_informer.go:409] "Caches are synced" machine # [ 22.097958] k3s[875]: I0928 09:48:16.041771 875 shared_informer.go:409] "Caches are synced" machine # [ 22.101965] k3s[875]: time="2026-09-28T09:48:16Z" level=info msg="Creating embedded CRD addons.k3s.cattle.io" machine # [ 22.107232] k3s[875]: time="2026-09-28T09:48:16Z" level=info msg="Creating embedded CRD etcdsnapshotfiles.k3s.cattle.io" machine # [ 22.113118] k3s[875]: time="2026-09-28T09:48:16Z" level=info msg="Creating embedded CRD helmchartconfigs.helm.cattle.io" machine # [ 22.117439] k3s[875]: time="2026-09-28T09:48:16Z" level=info msg="Creating embedded CRD helmcharts.helm.cattle.io" machine # [ 22.126724] k3s[875]: I0928 09:48:16.071749 875 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 22.135376] k3s[875]: time="2026-09-28T09:48:16Z" level=info msg="Waiting for CRD etcdsnapshotfiles.k3s.cattle.io to become available" machine # [ 22.140947] k3s[875]: I0928 09:48:16.085528 875 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 22.150320] k3s[875]: I0928 09:48:16.095370 875 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 22.162680] k3s[875]: I0928 09:48:16.107722 875 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="podcertificaterequest-cleaner-controller" requiredFeatureGates=["PodCertificateRequest"] machine # [ 22.165764] k3s[875]: I0928 09:48:16.109169 875 controllermanager.go:641] "Warning: skipping controller" controller="podcertificaterequest-cleaner-controller" machine # [ 22.171717] k3s[875]: I0928 09:48:16.116707 875 shared_informer.go:409] "Caches are synced" machine # [ 22.175701] k3s[875]: I0928 09:48:16.120557 875 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine: (finished: waiting for unit k3s.service, in 23.50 seconds) machine: waiting for success: kubectl get ns farm machine # [ 22.644494] k3s[875]: time="2026-09-28T09:48:16Z" level=info msg="Done waiting for CRD etcdsnapshotfiles.k3s.cattle.io to become available" machine # [ 22.644899] k3s[875]: time="2026-09-28T09:48:16Z" level=info msg="Waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 22.646659] k3s[875]: time="2026-09-28T09:48:16Z" level=info msg="Done waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 22.647752] k3s[875]: time="2026-09-28T09:48:16Z" level=info msg="Waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 22.650195] k3s[875]: time="2026-09-28T09:48:16Z" level=info msg="Done waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 22.651599] k3s[875]: time="2026-09-28T09:48:16Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-40.1.4+up40.1.0.tgz" machine # [ 22.652755] k3s[875]: time="2026-09-28T09:48:16Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-crd-40.1.4+up40.1.0.tgz" machine # [ 22.653858] k3s[875]: time="2026-09-28T09:48:16Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/ccm.yaml" machine # [ 22.654684] k3s[875]: time="2026-09-28T09:48:16Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/coredns.yaml" machine # [ 22.656194] k3s[875]: time="2026-09-28T09:48:16Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/local-storage.yaml" machine # [ 22.656546] k3s[875]: time="2026-09-28T09:48:16Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/rolebindings.yaml" machine # [ 22.658613] k3s[875]: time="2026-09-28T09:48:16Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/runtimes.yaml" machine # [ 22.659507] k3s[875]: time="2026-09-28T09:48:16Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/traefik.yaml" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 22.760612] k3s[875]: time="2026-09-28T09:48:16Z" level=info msg="Starting dynamiclistener CN filter node controller with SANs: [127.0.0.1 ::1 localhost machine 10.0.2.15 fec0::c9ae:78c0:b43f:d9ba 10.43.0.1 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local]" machine # [ 22.761590] k3s[875]: time="2026-09-28T09:48:16Z" level=info msg="Tunnel server egress proxy mode: agent" machine # [ 23.287127] k3s[875]: time="2026-09-28T09:48:17Z" level=info msg="Creating new TLS secret for kube-system/k3s-serving (count: 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__c9ae_78c0_b43f_d9ba-5dcd03:fec0::c9ae:78c0:b43f:d9ba listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=0716703702E90EE1CF15905551B04DB1829CC5DC]" machine # [ 23.300486] k3s[875]: time="2026-09-28T09:48:17Z" level=info msg="Active TLS secret kube-system/k3s-serving (ver=239) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__c9ae_78c0_b43f_d9ba-5dcd03:fec0::c9ae:78c0:b43f:d9ba listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=0716703702E90EE1CF15905551B04DB1829CC5DC]" machine # [ 23.363961] k3s[875]: W0928 09:48:17.308965 875 probe.go:275] Flexvolume plugin directory at /usr/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating. machine # [ 23.515516] k3s[875]: I0928 09:48:17.460420 875 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="storageversion-garbage-collector-controller" requiredFeatureGates=["APIServerIdentity","StorageVersionAPI"] machine # [ 23.516260] k3s[875]: I0928 09:48:17.460466 875 controllermanager.go:641] "Warning: skipping controller" controller="storageversion-garbage-collector-controller" machine # [ 23.663448] k3s[875]: I0928 09:48:17.608194 875 controllermanager.go:641] "Warning: skipping controller" controller="storage-version-migrator-controller" machine # [ 23.664273] k3s[875]: I0928 09:48:17.608234 875 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="podgroup-protection-controller" requiredFeatureGates=["GenericWorkload"] machine # [ 23.665085] k3s[875]: I0928 09:48:17.608250 875 controllermanager.go:641] "Warning: skipping controller" controller="podgroup-protection-controller" machine # [ 23.869117] k3s[875]: time="2026-09-28T09:48:17Z" level=info msg="Starting k3s.cattle.io/v1, Kind=Addon controller" machine # [ 23.871156] k3s[875]: time="2026-09-28T09:48:17Z" level=info msg="Creating deploy event broadcaster" machine # [ 23.876205] k3s[875]: time="2026-09-28T09:48:17Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 23.877494] k3s[875]: time="2026-09-28T09:48:17Z" level=info msg="Creating helm-controller event broadcaster" machine # [ 23.880325] k3s[875]: time="2026-09-28T09:48:17Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 23.886606] k3s[875]: time="2026-09-28T09:48:17Z" level=info msg="Cluster dns configmap has been set successfully" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 24.878738] k3s[875]: time="2026-09-28T09:48:18Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 25.087169] k3s[875]: time="2026-09-28T09:48:19Z" level=info msg="Starting rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding controller" machine # [ 25.093876] k3s[875]: time="2026-09-28T09:48:19Z" level=info msg="Starting batch/v1, Kind=Job controller" machine # [ 25.095412] k3s[875]: time="2026-09-28T09:48:19Z" level=info msg="Starting /v1, Kind=Secret controller" machine # [ 25.096814] k3s[875]: time="2026-09-28T09:48:19Z" level=info msg="Starting /v1, Kind=ConfigMap controller" machine # [ 25.098158] k3s[875]: time="2026-09-28T09:48:19Z" level=info msg="Starting /v1, Kind=ServiceAccount controller" machine # [ 25.101157] k3s[875]: time="2026-09-28T09:48:19Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChart controller" machine # [ 25.102694] k3s[875]: time="2026-09-28T09:48:19Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChartConfig controller" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 25.793376] k3s[875]: time="2026-09-28T09:48:19Z" level=info msg="Imported docker.io/library/nix-grpc-farm:0.1.0-beta.4" machine # [ 25.795827] k3s[875]: time="2026-09-28T09:48:19Z" level=info msg="Tagged docker.io/library/nix-grpc-farm@sha256:64aebbbb2ead171cfb44a41aacfe936acab345cac1bc98dcbc6a45dcd5573066" machine # [ 25.872533] k3s[875]: I0928 09:48:19.817507 875 controller.go:667] quota admission added evaluator for: addons.k3s.cattle.io machine # [ 25.878323] k3s[875]: time="2026-09-28T09:48:19Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=ApplyingManifest type=Normal machine # [ 25.882522] k3s[875]: time="2026-09-28T09:48:19Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 26.124190] k3s[875]: I0928 09:48:20.068853 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="rolebindings.rbac.authorization.k8s.io" machine # [ 26.130241] k3s[875]: I0928 09:48:20.069001 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="controllerrevisions.apps" machine # [ 26.136232] k3s[875]: I0928 09:48:20.069060 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="jobs.batch" machine # [ 26.141762] k3s[875]: I0928 09:48:20.069193 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="addons.k3s.cattle.io" machine # [ 26.147214] k3s[875]: I0928 09:48:20.069269 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="serviceaccounts" machine # [ 26.151708] k3s[875]: I0928 09:48:20.069333 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="csistoragecapacities.storage.k8s.io" machine # [ 26.156839] k3s[875]: I0928 09:48:20.069389 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="leases.coordination.k8s.io" machine # [ 26.161646] k3s[875]: I0928 09:48:20.069443 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="resourceclaimtemplates.resource.k8s.io" machine # [ 26.166753] k3s[875]: I0928 09:48:20.069553 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="statefulsets.apps" machine # [ 26.170157] k3s[875]: I0928 09:48:20.069607 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="poddisruptionbudgets.policy" machine # [ 26.172753] k3s[875]: I0928 09:48:20.069704 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="daemonsets.apps" machine # [ 26.175209] k3s[875]: I0928 09:48:20.069759 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="replicasets.apps" machine # [ 26.177640] k3s[875]: I0928 09:48:20.069808 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="deployments.apps" machine # [ 26.180288] k3s[875]: I0928 09:48:20.069863 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="cronjobs.batch" machine # [ 26.180610] k3s[875]: I0928 09:48:20.069921 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="roles.rbac.authorization.k8s.io" machine # [ 26.181235] k3s[875]: I0928 09:48:20.069978 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmcharts.helm.cattle.io" machine # [ 26.181574] k3s[875]: I0928 09:48:20.070033 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="podtemplates" machine # [ 26.182254] k3s[875]: I0928 09:48:20.070088 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="limitranges" machine # [ 26.182953] k3s[875]: I0928 09:48:20.070281 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="horizontalpodautoscalers.autoscaling" machine # [ 26.183727] k3s[875]: I0928 09:48:20.070343 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="ingresses.networking.k8s.io" machine # [ 26.184422] k3s[875]: I0928 09:48:20.070402 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpointslices.discovery.k8s.io" machine # [ 26.184954] k3s[875]: I0928 09:48:20.070483 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpoints" machine # [ 26.185657] k3s[875]: I0928 09:48:20.070572 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="networkpolicies.networking.k8s.io" machine # [ 26.186161] k3s[875]: I0928 09:48:20.070627 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmchartconfigs.helm.cattle.io" machine # [ 26.240835] k3s[875]: time="2026-09-28T09:48:20Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nixos/j328vg2qwa3vkjb23hlas79a0wlxnwp6-nix-grpc-farm.tar in 5.237484372s" machine # [ 26.241270] k3s[875]: time="2026-09-28T09:48:20Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/jwg451fmk0s7v9d6j857q3y7rc0ch04s-nix-grpc-farm-client.tar" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 26.880749] k3s[875]: time="2026-09-28T09:48:20Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 27.235216] k3s[875]: I0928 09:48:21.178053 875 range_allocator.go:113] "No Secondary Service CIDR provided. Skipping filtering out secondary service addresses" logger="node-ipam-controller" machine # [ 27.235397] k3s[875]: I0928 09:48:21.178214 875 controllermanager.go:689] "Warning: controller is disabled" controller="service-lb-controller" machine # [ 27.236128] k3s[875]: I0928 09:48:21.178228 875 controllermanager.go:689] "Warning: controller is disabled" controller="node-route-controller" machine # [ 27.236615] k3s[875]: I0928 09:48:21.178238 875 controllermanager.go:689] "Warning: controller is disabled" controller="cloud-node-lifecycle-controller" machine # [ 27.238207] k3s[875]: time="2026-09-28T09:48:21Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=AppliedManifest type=Normal machine # [ 27.246041] k3s[875]: I0928 09:48:21.191027 875 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="resourcepoolstatusrequest-controller" requiredFeatureGates=["DRAResourcePoolStatus"] machine # [ 27.246342] k3s[875]: I0928 09:48:21.191055 875 controllermanager.go:641] "Warning: skipping controller" controller="resourcepoolstatusrequest-controller" machine # [ 27.252067] k3s[875]: I0928 09:48:21.196440 875 certificate_controller.go:120] "Starting certificate controller" name="csrapproving" machine # [ 27.252588] k3s[875]: I0928 09:48:21.196470 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.258412] k3s[875]: I0928 09:48:21.203415 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.264867] k3s[875]: I0928 09:48:21.209840 875 replica_set.go:285] "Starting controller" name="replicationcontroller" machine # [ 27.265179] k3s[875]: I0928 09:48:21.209910 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.267918] k3s[875]: I0928 09:48:21.212910 875 job_controller.go:336] "Starting job controller" machine # [ 27.268583] k3s[875]: I0928 09:48:21.212944 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.270401] k3s[875]: I0928 09:48:21.215381 875 pv_protection_controller.go:81] "Starting PV protection controller" machine # [ 27.270859] k3s[875]: I0928 09:48:21.215406 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.271467] k3s[875]: I0928 09:48:21.215462 875 publisher.go:107] "Starting root CA cert publisher controller" machine # [ 27.272144] k3s[875]: I0928 09:48:21.215484 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.275404] k3s[875]: I0928 09:48:21.215521 875 ttl_controller.go:127] "Starting TTL controller" machine # [ 27.275875] k3s[875]: I0928 09:48:21.220470 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.276389] k3s[875]: I0928 09:48:21.220522 875 tokencleaner.go:117] "Starting token cleaner controller" machine # [ 27.279202] k3s[875]: I0928 09:48:21.220535 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.281100] k3s[875]: I0928 09:48:21.226141 875 endpoints_controller.go:193] "Starting endpoint controller" machine # [ 27.281560] k3s[875]: I0928 09:48:21.226169 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.283728] k3s[875]: I0928 09:48:21.228771 875 replica_set.go:285] "Starting controller" name="replicaset" machine # [ 27.284189] k3s[875]: I0928 09:48:21.228794 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.286279] k3s[875]: I0928 09:48:21.228847 875 clusterroleaggregation_controller.go:176] "Starting ClusterRoleAggregator controller" machine # [ 27.286564] k3s[875]: I0928 09:48:21.231344 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.289183] k3s[875]: I0928 09:48:21.234224 875 controller.go:174] "Starting ephemeral volume controller" machine # [ 27.289634] k3s[875]: I0928 09:48:21.234253 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.294113] k3s[875]: I0928 09:48:21.236744 875 legacy_serviceaccount_token_cleaner.go:103] "Starting legacy service account token cleaner controller" machine # [ 27.294402] k3s[875]: I0928 09:48:21.236773 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.294959] k3s[875]: I0928 09:48:21.237325 875 horizontal.go:204] "Starting HPA controller" machine # [ 27.295658] k3s[875]: I0928 09:48:21.237341 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.296197] k3s[875]: I0928 09:48:21.237425 875 cronjob_controllerv2.go:143] "Starting cronjob controller v2" machine # [ 27.296750] k3s[875]: I0928 09:48:21.237439 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.297430] k3s[875]: I0928 09:48:21.237513 875 attach_detach_controller.go:334] "Starting attach detach controller" machine # [ 27.298045] k3s[875]: I0928 09:48:21.237528 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.298520] k3s[875]: I0928 09:48:21.237562 875 ttlafterfinished_controller.go:112] "Starting TTL after finished controller" machine # [ 27.299084] k3s[875]: I0928 09:48:21.237575 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.299592] k3s[875]: I0928 09:48:21.237691 875 controller.go:753] "Starting resource claim controller" machine # [ 27.300106] k3s[875]: I0928 09:48:21.237704 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.300641] k3s[875]: I0928 09:48:21.237787 875 stateful_set.go:234] "Starting stateful set controller" machine # [ 27.301182] k3s[875]: I0928 09:48:21.237802 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.301666] k3s[875]: I0928 09:48:21.237896 875 pv_controller_base.go:318] "Starting persistent volume controller" machine # [ 27.302377] k3s[875]: I0928 09:48:21.237912 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.302900] k3s[875]: I0928 09:48:21.237956 875 device_taint_eviction.go:783] "Starting" controller="device-taint-eviction-controller" numWorkers=8 machine # [ 27.306547] k3s[875]: I0928 09:48:21.238182 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.307098] k3s[875]: I0928 09:48:21.238231 875 disruption.go:453] "Sending events to api server." machine # [ 27.307628] k3s[875]: I0928 09:48:21.238274 875 disruption.go:460] "Starting disruption controller" machine # [ 27.308456] k3s[875]: I0928 09:48:21.238284 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.309055] k3s[875]: I0928 09:48:21.238348 875 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-legacy-unknown" machine # [ 27.309576] k3s[875]: I0928 09:48:21.238364 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.310087] k3s[875]: I0928 09:48:21.238414 875 expand_controller.go:328] "Starting expand controller" machine # [ 27.310656] k3s[875]: I0928 09:48:21.238429 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.311151] k3s[875]: I0928 09:48:21.238468 875 taint_eviction.go:283] "Starting" controller="taint-eviction-controller" machine # [ 27.311677] k3s[875]: I0928 09:48:21.238529 875 taint_eviction.go:288] "Sending events to API server" machine # [ 27.312211] k3s[875]: I0928 09:48:21.238539 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.312771] k3s[875]: I0928 09:48:21.238626 875 servicecidrs_controller.go:137] "Starting" controller="service-cidr-controller" machine # [ 27.313425] k3s[875]: I0928 09:48:21.238653 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.313945] k3s[875]: I0928 09:48:21.238743 875 endpointslice_controller.go:280] "Starting endpoint slice controller" machine # [ 27.314645] k3s[875]: I0928 09:48:21.238758 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.315164] k3s[875]: I0928 09:48:21.238844 875 endpointslicemirroring_controller.go:226] "Starting EndpointSliceMirroring controller" machine # [ 27.315689] k3s[875]: I0928 09:48:21.238856 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.316225] k3s[875]: I0928 09:48:21.238909 875 gc_controller.go:98] "Starting GC controller" machine # [ 27.316749] k3s[875]: I0928 09:48:21.238925 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.317439] k3s[875]: I0928 09:48:21.238971 875 serviceaccounts_controller.go:117] "Starting service account controller" machine # [ 27.317937] k3s[875]: I0928 09:48:21.238984 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.318621] k3s[875]: I0928 09:48:21.239025 875 cleaner.go:83] "Starting CSR cleaner controller" machine # [ 27.319208] k3s[875]: I0928 09:48:21.239093 875 pvc_protection_controller.go:172] "Starting PVC protection controller" machine # [ 27.319681] k3s[875]: I0928 09:48:21.239131 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.320324] k3s[875]: I0928 09:48:21.246677 875 namespace_controller.go:202] "Starting namespace controller" machine # [ 27.320916] k3s[875]: I0928 09:48:21.246699 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.321639] k3s[875]: I0928 09:48:21.246784 875 node_ipam_controller.go:142] "Starting ipam controller" machine # [ 27.322159] k3s[875]: I0928 09:48:21.246797 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.322682] k3s[875]: I0928 09:48:21.246836 875 vac_protection_controller.go:206] "Starting VAC protection controller" machine # [ 27.323228] k3s[875]: I0928 09:48:21.246849 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.323782] k3s[875]: I0928 09:48:21.251146 875 node_lifecycle_controller.go:436] "Sending events to api server" machine # [ 27.324449] k3s[875]: I0928 09:48:21.251221 875 node_lifecycle_controller.go:443] "Starting node controller" machine # [ 27.325211] k3s[875]: I0928 09:48:21.251231 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.325547] k3s[875]: I0928 09:48:21.252872 875 daemon_controller.go:364] "Starting daemon sets controller" machine # [ 27.326116] k3s[875]: I0928 09:48:21.252891 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.326651] k3s[875]: I0928 09:48:21.253023 875 deployment_controller.go:180] "Starting controller" controller="deployment" machine # [ 27.327200] k3s[875]: I0928 09:48:21.253038 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.327764] k3s[875]: I0928 09:48:21.256156 875 device_taint_eviction.go:823] "Sending events to api server" machine # [ 27.328477] k3s[875]: I0928 09:48:21.256259 875 device_taint_eviction.go:1023] "Waiting" for="cache and event handler sync" machine # [ 27.329079] k3s[875]: I0928 09:48:21.256356 875 garbagecollector.go:141] "Starting controller" controller="garbagecollector" machine # [ 27.329646] k3s[875]: I0928 09:48:21.256384 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.330185] k3s[875]: I0928 09:48:21.256570 875 graph_builder.go:387] "Running" component="GraphBuilder" machine # [ 27.330732] k3s[875]: time="2026-09-28T09:48:21Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=ApplyingManifest type=Normal machine # [ 27.331433] k3s[875]: I0928 09:48:21.264272 875 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-serving" machine # [ 27.332057] k3s[875]: I0928 09:48:21.264315 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.332521] k3s[875]: I0928 09:48:21.264361 875 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-client" machine # [ 27.333659] k3s[875]: I0928 09:48:21.264375 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.334883] k3s[875]: I0928 09:48:21.264415 875 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kube-apiserver-client" machine # [ 27.336708] k3s[875]: I0928 09:48:21.264428 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.338079] k3s[875]: I0928 09:48:21.264489 875 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 27.340680] k3s[875]: I0928 09:48:21.264678 875 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 27.344045] k3s[875]: I0928 09:48:21.264767 875 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 27.345970] k3s[875]: I0928 09:48:21.264840 875 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 27.348995] k3s[875]: I0928 09:48:21.272799 875 resource_quota_controller.go:297] "Starting resource quota controller" machine # [ 27.350616] k3s[875]: I0928 09:48:21.272820 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.351627] k3s[875]: I0928 09:48:21.272852 875 resource_quota_monitor.go:309] "QuotaMonitor running" machine # [ 27.353191] k3s[875]: I0928 09:48:21.281421 875 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.DeviceClass" machine # [ 27.355070] k3s[875]: time="2026-09-28T09:48:21Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Deferred node password secret validation complete" object=machine reason=NodePasswordValidationComplete type=Normal machine # [ 27.370601] k3s[875]: I0928 09:48:21.315590 875 shared_informer.go:409] "Caches are synced" machine # [ 27.376168] k3s[875]: I0928 09:48:21.321177 875 shared_informer.go:409] "Caches are synced" machine # [ 27.379505] k3s[875]: I0928 09:48:21.324348 875 shared_informer.go:409] "Caches are synced" machine # [ 27.402957] k3s[875]: I0928 09:48:21.347986 875 shared_informer.go:409] "Caches are synced" machine # [ 27.403884] k3s[875]: I0928 09:48:21.348614 875 shared_informer.go:409] "Caches are synced" machine # [ 27.406515] k3s[875]: I0928 09:48:21.351555 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.407146] k3s[875]: I0928 09:48:21.352021 875 shared_informer.go:409] "Caches are synced" machine # [ 27.407820] k3s[875]: I0928 09:48:21.352169 875 range_allocator.go:177] "Sending events to api server" machine # [ 27.408461] k3s[875]: I0928 09:48:21.352225 875 range_allocator.go:181] "Starting range CIDR allocator" machine # [ 27.410231] k3s[875]: I0928 09:48:21.352237 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.411826] k3s[875]: I0928 09:48:21.352249 875 shared_informer.go:409] "Caches are synced" machine # [ 27.415947] k3s[875]: I0928 09:48:21.361000 875 shared_informer.go:402] "Waiting for caches to sync" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 27.878062] k3s[875]: time="2026-09-28T09:48:21Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 28.040699] k3s[875]: I0928 09:48:21.985659 875 serving.go:417] Generated self-signed cert in-memory machine # [ 28.151652] k3s[875]: I0928 09:48:22.096531 875 serving.go:417] Generated self-signed cert in-memory machine # [ 28.247459] k3s[875]: I0928 09:48:22.191261 875 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceSlice + event handler k8s.io/kubernetes/pkg/controller/devicetainteviction.(*Controller).Run" machine # [ 28.250666] k3s[875]: I0928 09:48:22.191293 875 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.Pod" machine # [ 28.252716] k3s[875]: I0928 09:48:22.191307 875 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.Pod + event handler k8s.io/kubernetes/pkg/controller/devicetainteviction.(*Controller).Run" machine # [ 28.255642] k3s[875]: I0928 09:48:22.192709 875 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceSlice" machine # [ 28.257592] k3s[875]: I0928 09:48:22.193042 875 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceClaim" machine # [ 28.259680] k3s[875]: I0928 09:48:22.193069 875 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceClaim + event handler k8s.io/kubernetes/pkg/controller/devicetainteviction.(*Controller).Run" machine # [ 28.262827] k3s[875]: I0928 09:48:22.202700 875 shared_informer.go:409] "Caches are synced" machine # [ 28.265069] k3s[875]: I0928 09:48:22.210095 875 shared_informer.go:409] "Caches are synced" machine # [ 28.268159] k3s[875]: I0928 09:48:22.213191 875 shared_informer.go:409] "Caches are synced" machine # [ 28.270783] k3s[875]: I0928 09:48:22.215785 875 shared_informer.go:409] "Caches are synced" machine # [ 28.281242] k3s[875]: I0928 09:48:22.226278 875 shared_informer.go:409] "Caches are synced" machine # [ 28.286208] k3s[875]: I0928 09:48:22.231267 875 shared_informer.go:409] "Caches are synced" machine # [ 28.288522] k3s[875]: I0928 09:48:22.232755 875 shared_informer.go:409] "Caches are synced" machine # [ 28.289810] k3s[875]: I0928 09:48:22.234624 875 shared_informer.go:409] "Caches are synced" machine # [ 28.291993] k3s[875]: I0928 09:48:22.237010 875 shared_informer.go:409] "Caches are synced" machine # [ 28.292424] k3s[875]: I0928 09:48:22.237460 875 shared_informer.go:409] "Caches are synced" machine # [ 28.293498] k3s[875]: I0928 09:48:22.237620 875 shared_informer.go:409] "Caches are synced" machine # [ 28.294691] k3s[875]: I0928 09:48:22.237699 875 shared_informer.go:409] "Caches are synced" machine # [ 28.295780] k3s[875]: I0928 09:48:22.237920 875 shared_informer.go:409] "Caches are synced" machine # [ 28.296666] k3s[875]: I0928 09:48:22.237956 875 shared_informer.go:409] "Caches are synced" machine # [ 28.297727] k3s[875]: I0928 09:48:22.238384 875 shared_informer.go:409] "Caches are synced" machine # [ 28.298766] k3s[875]: I0928 09:48:22.238415 875 shared_informer.go:409] "Caches are synced" machine # [ 28.299707] k3s[875]: I0928 09:48:22.238619 875 shared_informer.go:409] "Caches are synced" machine # [ 28.300171] k3s[875]: I0928 09:48:22.238666 875 shared_informer.go:409] "Caches are synced" machine # [ 28.301149] k3s[875]: I0928 09:48:22.238802 875 shared_informer.go:409] "Caches are synced" machine # [ 28.301811] k3s[875]: I0928 09:48:22.238890 875 shared_informer.go:409] "Caches are synced" machine # [ 28.302674] k3s[875]: I0928 09:48:22.238943 875 shared_informer.go:409] "Caches are synced" machine # [ 28.303191] k3s[875]: I0928 09:48:22.239420 875 shared_informer.go:409] "Caches are synced" machine # [ 28.303534] k3s[875]: I0928 09:48:22.239451 875 shared_informer.go:409] "Caches are synced" machine # [ 28.304058] k3s[875]: I0928 09:48:22.239550 875 shared_informer.go:409] "Caches are synced" machine # [ 28.304614] k3s[875]: I0928 09:48:22.239596 875 shared_informer.go:409] "Caches are synced" machine # [ 28.305193] k3s[875]: I0928 09:48:22.247268 875 shared_informer.go:409] "Caches are synced" machine # [ 28.306445] k3s[875]: I0928 09:48:22.251487 875 shared_informer.go:409] "Caches are synced" machine # [ 28.306941] k3s[875]: I0928 09:48:22.251925 875 shared_informer.go:409] "Caches are synced" machine # [ 28.307660] k3s[875]: I0928 09:48:22.252002 875 shared_informer.go:409] "Caches are synced" machine # [ 28.316482] k3s[875]: I0928 09:48:22.261455 875 shared_informer.go:409] "Caches are synced" machine # [ 28.316853] k3s[875]: I0928 09:48:22.261546 875 shared_informer.go:409] "Caches are synced" machine # [ 28.320515] k3s[875]: I0928 09:48:22.265095 875 shared_informer.go:409] "Caches are synced" machine # [ 28.320808] k3s[875]: I0928 09:48:22.265276 875 shared_informer.go:409] "Caches are synced" machine # [ 28.321470] k3s[875]: I0928 09:48:22.265311 875 shared_informer.go:409] "Caches are synced" machine # [ 28.322523] k3s[875]: I0928 09:48:22.267427 875 shared_informer.go:409] "Caches are synced" machine # [ 28.324213] k3s[875]: I0928 09:48:22.269127 875 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 28.327880] k3s[875]: I0928 09:48:22.272925 875 shared_informer.go:409] "Caches are synced" machine # [ 28.337259] k3s[875]: time="2026-09-28T09:48:22Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=AppliedManifest type=Normal machine # [ 28.342325] k3s[875]: I0928 09:48:22.286763 875 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 28.353131] k3s[875]: I0928 09:48:22.298132 875 controllermanager.go:163] Version: v1.36.4+k3s1 machine # [ 28.354864] k3s[875]: time="2026-09-28T09:48:22Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=ApplyingManifest type=Normal machine # [ 28.357506] k3s[875]: I0928 09:48:22.302552 875 secure_serving.go:214] Serving securely on 127.0.0.1:10258 machine # [ 28.358236] k3s[875]: I0928 09:48:22.303064 875 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 28.358910] k3s[875]: I0928 09:48:22.303084 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.362079] k3s[875]: I0928 09:48:22.303147 875 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 28.362871] k3s[875]: I0928 09:48:22.303223 875 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 28.363570] k3s[875]: I0928 09:48:22.303238 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.364116] k3s[875]: I0928 09:48:22.303269 875 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 28.365478] k3s[875]: I0928 09:48:22.303289 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.367722] k3s[875]: time="2026-09-28T09:48:22Z" level=info msg="Creating service-lb-controller event broadcaster" machine # [ 28.643980] postgres[1133]: [1133] ERROR: relation "goose_db_version" does not exist at character 36 machine # [ 28.644283] postgres[1133]: [1133] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC machine # [ 28.667157] niks3-server[1109]: 2026/09/28 09:48:22 OK 20241026095416_initial_model.sql (10.72ms) machine # [ 28.681334] niks3-server[1109]: 2026/09/28 09:48:22 OK 20251210153512_drop_unused_gin_index.sql (6.88ms) machine # [ 28.686181] niks3-server[1109]: 2026/09/28 09:48:22 OK 20251218171726_add_pins.sql (4.16ms) machine # [ 28.691659] niks3-server[1109]: 2026/09/28 09:48:22 OK 20260628120000_add_object_size_and_stats.sql (5.22ms) machine # [ 28.696638] niks3-server[1109]: 2026/09/28 09:48:22 OK 20260905000000_add_claims.sql (5.09ms) machine # [ 28.699716] niks3-server[1109]: 2026/09/28 09:48:22 OK 20260920000000_drop_claims.sql (2.93ms) machine # [ 28.701977] niks3-server[1109]: 2026/09/28 09:48:22 OK 20260923120000_add_pushes.sql (2.15ms) machine # [ 28.702447] niks3-server[1109]: 2026/09/28 09:48:22 goose: successfully migrated database to version: 20260923120000 machine # [ 28.706737] niks3-server[1109]: 2026/09/28 09:48:22 OK 1_commit_pending_closure.sql (4.66ms) machine # [ 28.710273] niks3-server[1109]: 2026/09/28 09:48:22 OK 2_object_stats_trigger.sql (3.62ms) machine # [ 28.713033] niks3-server[1109]: 2026/09/28 09:48:22 OK 3_commit_push.sql (2.41ms) machine # [ 28.713159] niks3-server[1109]: 2026/09/28 09:48:22 goose: up to current file version: 3 machine # [ 28.718928] niks3-server[1109]: 2026/09/28 09:48:22 INFO OIDC provider initialized name=kubernetes issuer=https://kubernetes.default.svc.cluster.local machine # [ 28.721138] niks3-server[1109]: 2026/09/28 09:48:22 INFO OIDC authentication enabled config=/nix/store/v0b0sqyzhrjsz48x3klf7b7vl89apzs0-niks3-oidc.json machine # [ 28.721500] niks3-server[1109]: 2026/09/28 09:48:22 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key machine # [ 28.753365] niks3-server[1109]: 2026/09/28 09:48:22 INFO Read proxy enabled — serving cache objects from S3 machine # [ 28.753797] niks3-server[1109]: 2026/09/28 09:48:22 INFO Using socket-activated listener address=0.0.0.0:5751 machine # [ 28.756364] niks3-server[1109]: 2026/09/28 09:48:22 INFO systemd watchdog enabled interval=15s machine # [ 28.756756] niks3-server[1109]: 2026/09/28 09:48:22 INFO Starting HTTP server address=0.0.0.0:5751 machine # [ 28.758951] systemd[1]: Started niks3 server. machine # [ 28.759128] systemd[1]: Reached target Multi-User System. machine # [ 28.759665] systemd[1]: Startup finished in 1.105s (kernel) + 3.745s (initrd) + 23.904s (userspace) = 28.756s. machine: (finished: waiting for success: kubectl get ns farm, in 6.21 seconds) machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key machine # [ 28.879342] k3s[875]: time="2026-09-28T09:48:22Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 28.959880] k3s[875]: I0928 09:48:22.903268 875 shared_informer.go:409] "Caches are synced" machine # [ 28.961239] k3s[875]: I0928 09:48:22.903327 875 shared_informer.go:409] "Caches are synced" machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key, in 0.18 seconds) machine # [ 28.962907] k3s[875]: I0928 09:48:22.903424 875 shared_informer.go:409] "Caches are synced" machine: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key machine # [ 29.007568] k3s[875]: I0928 09:48:22.952554 875 shared_informer.go:409] "Caches are synced" machine # [ 29.012236] k3s[875]: I0928 09:48:22.957024 875 shared_informer.go:409] "Caches are synced" machine # [ 29.012752] k3s[875]: I0928 09:48:22.957064 875 garbagecollector.go:166] "Garbage collector: all resource monitors have synced" machine # [ 29.013378] k3s[875]: I0928 09:48:22.957076 875 garbagecollector.go:169] "Proceeding to collect garbage" machine: (finished: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key, in 0.16 seconds) machine: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine # [ 29.169106] k3s[875]: time="2026-09-28T09:48:23Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 29.172634] k3s[875]: time="2026-09-28T09:48:23Z" level=info msg="Starting /v1, Kind=Pod controller" machine # [ 29.178054] k3s[875]: time="2026-09-28T09:48:23Z" level=info msg="Starting apps/v1, Kind=DaemonSet controller" machine # [ 29.181890] k3s[875]: W0928 09:48:23.126917 875 controllermanager.go:315] "node-route-controller" is disabled machine # [ 29.182547] k3s[875]: I0928 09:48:23.127277 875 controllermanager.go:338] Started "cloud-node-controller" machine # [ 29.183204] k3s[875]: I0928 09:48:23.127390 875 controllermanager.go:338] Started "cloud-node-lifecycle-controller" machine # [ 29.183760] k3s[875]: I0928 09:48:23.127740 875 controllermanager.go:338] Started "service-lb-controller" machine # [ 29.184641] k3s[875]: time="2026-09-28T09:48:23Z" level=info msg="Starting discovery.k8s.io/v1, Kind=EndpointSlice controller" machine # [ 29.185506] k3s[875]: I0928 09:48:23.128674 875 node_controller.go:179] Sending events to api server. machine # [ 29.186117] k3s[875]: I0928 09:48:23.128731 875 node_lifecycle_controller.go:112] Sending events to api server machine # [ 29.186683] k3s[875]: I0928 09:48:23.128901 875 node_controller.go:188] Waiting for informer caches to sync machine # [ 29.187196] k3s[875]: I0928 09:48:23.129021 875 controller.go:235] Starting service controller machine # [ 29.187701] k3s[875]: I0928 09:48:23.129042 875 shared_informer.go:402] "Waiting for caches to sync" machine: (finished: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.17 seconds) subtest: chart deploys and workers become Ready machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine # [ 29.384953] k3s[875]: I0928 09:48:23.329369 875 shared_informer.go:409] "Caches are synced" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 29.878216] k3s[875]: time="2026-09-28T09:48:23Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 30.231462] k3s[875]: I0928 09:48:24.176396 875 controller.go:667] quota admission added evaluator for: deployments.apps machine # [ 30.244139] k3s[875]: I0928 09:48:24.189170 875 controller.go:667] quota admission added evaluator for: replicasets.apps machine # [ 30.268820] k3s[875]: I0928 09:48:24.213769 875 alloc.go:329] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.43.0.10"} machine # [ 30.270358] k3s[875]: time="2026-09-28T09:48:24Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=AppliedManifest type=Normal machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 30.878855] k3s[875]: time="2026-09-28T09:48:24Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 31.056793] k3s[875]: E0928 09:48:25.001781 875 replica_set.go:640] "Unhandled Error" err="sync \"kube-system/coredns-54996dc9b4\" failed with read version: 309 is not as new as written version: 322 for group resource replicasets.apps" logger="UnhandledError" machine # [ 31.065516] k3s[875]: E0928 09:48:25.010456 875 replica_set.go:640] "Unhandled Error" err="sync \"kube-system/coredns-54996dc9b4\" failed with read version: 322 is not as new as written version: 324 for group resource replicasets.apps" logger="UnhandledError" machine # [ 31.442067] k3s[875]: time="2026-09-28T09:48:25Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" object=kube-system/local-storage reason=DeletingManifest type=Normal machine # [ 31.453803] k3s[875]: time="2026-09-28T09:48:25Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=ApplyingManifest type=Normal machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 31.877588] k3s[875]: time="2026-09-28T09:48:25Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 32.231498] k3s[875]: I0928 09:48:26.176068 875 controller.go:667] quota admission added evaluator for: helmcharts.helm.cattle.io machine # [ 32.234684] k3s[875]: time="2026-09-28T09:48:26Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=AppliedManifest type=Normal machine # [ 32.245741] k3s[875]: time="2026-09-28T09:48:26Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=ApplyingManifest type=Normal machine # [ 32.859597] k3s[875]: time="2026-09-28T09:48:26Z" level=info msg="Imported docker.io/library/nix-grpc-farm-client:0.1.0-beta.4" machine # [ 32.864114] k3s[875]: time="2026-09-28T09:48:26Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-client@sha256:eca0e0cee97a80173543f91b114909091c314d8b6038ce8de7c358b595549a2c" machine # [ 32.878510] k3s[875]: time="2026-09-28T09:48:26Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 33.192058] k3s[875]: time="2026-09-28T09:48:27Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nixos/jwg451fmk0s7v9d6j857q3y7rc0ch04s-nix-grpc-farm-client.tar in 6.950654901s" machine # [ 33.195236] k3s[875]: time="2026-09-28T09:48:27Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/smddpgqzjvlqv3lx57wdzl7kma805fj0-k3s-airgap-images-amd64.tar.zst" machine # [ 33.238361] k3s[875]: time="2026-09-28T09:48:27Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Applying HelmChart from https://%{KUBERNETES_API}%/static/charts/nix-grpc-farm.tgz using Job kube-system/helm-install-nix-grpc-farm " object=kube-system/nix-grpc-farm reason=ApplyJob type=Normal machine # [ 33.265381] k3s[875]: I0928 09:48:27.210348 875 controller.go:667] quota admission added evaluator for: jobs.batch machine # [ 33.291125] k3s[875]: time="2026-09-28T09:48:27Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=AppliedManifest type=Normal machine # [ 33.316094] k3s[875]: time="2026-09-28T09:48:27Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=ApplyingManifest type=Normal machine # [ 33.510494] k3s[875]: time="2026-09-28T09:48:27Z" level=info msg="Running kubelet --cloud-provider=external --config-dir=/var/lib/rancher/k3s/agent/etc/kubelet.conf.d --containerd=/run/k3s/containerd/containerd.sock --eviction-hard=nodefs.available<1%,imagefs.available<1% --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubelet.kubeconfig --node-ip=10.0.2.15,fec0::c9ae:78c0:b43f:d9ba --node-labels= --read-only-port=0" machine # [ 33.523618] k3s[875]: Flag --containerd has been deprecated, This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed. machine # [ 33.542309] k3s[875]: I0928 09:48:27.487229 875 server.go:541] "Kubelet version" kubeletVersion="v1.36.4+k3s1" machine # [ 33.542970] k3s[875]: I0928 09:48:27.487292 875 server.go:543] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 33.543958] k3s[875]: I0928 09:48:27.487356 875 watchdog_linux.go:94] "Systemd watchdog is not enabled" machine # [ 33.545373] k3s[875]: I0928 09:48:27.487383 875 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." machine # [ 33.546321] k3s[875]: I0928 09:48:27.491265 875 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/agent/client-ca.crt" machine # [ 33.554459] k3s[875]: I0928 09:48:27.498704 875 server.go:1444] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" machine # [ 33.562704] k3s[875]: I0928 09:48:27.507618 875 server.go:804] "--cgroups-per-qos enabled, but --cgroup-root was not specified. Defaulting to /" machine # [ 33.563321] k3s[875]: I0928 09:48:27.507676 875 server.go:865] "NoSwap is set due to memorySwapBehavior not specified" memorySwapBehavior="" FailSwapOn=false machine # [ 33.566908] k3s[875]: I0928 09:48:27.511857 875 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] machine # [ 33.567638] k3s[875]: I0928 09:48:27.511921 875 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"machine","RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"MemoryReservationPolicy":"None","PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} machine # [ 33.568634] k3s[875]: I0928 09:48:27.512254 875 topology_manager.go:172] "Creating topology manager with none policy" machine # [ 33.569285] k3s[875]: I0928 09:48:27.512284 875 container_manager_linux.go:309] "Creating device plugin manager" machine # [ 33.569997] k3s[875]: I0928 09:48:27.512439 875 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" machine # [ 33.572628] k3s[875]: I0928 09:48:27.517572 875 state_mem.go:45] "Initialized" logger="CPUManager state memory" machine # [ 33.573871] k3s[875]: I0928 09:48:27.518864 875 kubelet.go:485] "Attempting to sync node with API server" machine # [ 33.574773] k3s[875]: I0928 09:48:27.518901 875 kubelet.go:386] "Adding static pod path" path="/var/lib/rancher/k3s/agent/pod-manifests" machine # [ 33.575753] k3s[875]: I0928 09:48:27.518952 875 kubelet.go:397] "Adding apiserver pod source" machine # [ 33.576578] k3s[875]: I0928 09:48:27.518984 875 apiserver.go:41] "Waiting for node sync before watching apiserver pods" machine # [ 33.594685] k3s[875]: I0928 09:48:27.539265 875 kuberuntime_manager.go:308] "Container runtime initialized" containerRuntime="containerd" version="2.3.4-k3s1.36" apiVersion="v1" machine # [ 33.595388] k3s[875]: I0928 09:48:27.540191 875 kubelet.go:1002] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" machine # [ 33.596292] k3s[875]: I0928 09:48:27.540216 875 kubelet.go:1029] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" machine # [ 33.602884] k3s[875]: I0928 09:48:27.547935 875 server.go:1280] "Started kubelet" machine # [ 33.604263] k3s[875]: I0928 09:48:27.548826 875 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 machine # [ 33.604524] k3s[875]: I0928 09:48:27.548914 875 server_v1.go:49] "podresources" method="list" useActivePods=true machine # [ 33.605645] k3s[875]: I0928 09:48:27.549152 875 server.go:264] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" machine # [ 33.606296] k3s[875]: I0928 09:48:27.549245 875 server.go:193] "Starting to listen" address="0.0.0.0" port=10250 machine # [ 33.606935] k3s[875]: I0928 09:48:27.550443 875 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" machine # [ 33.607611] k3s[875]: I0928 09:48:27.551027 875 dynamic_serving_content.go:135] "Starting controller" name="kubelet-server-cert-files::/var/lib/rancher/k3s/agent/serving-kubelet.crt::/var/lib/rancher/k3s/agent/serving-kubelet.key" machine # [ 33.608354] k3s[875]: I0928 09:48:27.551175 875 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 33.609488] k3s[875]: I0928 09:48:27.554138 875 server.go:354] "Adding debug handlers to kubelet server" machine # [ 33.617517] k3s[875]: E0928 09:48:27.562369 875 kubelet_node_status.go:396] "Error getting the current node from lister" err="node \"machine\" not found" machine # [ 33.618197] k3s[875]: I0928 09:48:27.562434 875 volume_manager.go:310] "Starting Kubelet Volume Manager" machine # [ 33.619230] k3s[875]: I0928 09:48:27.562722 875 desired_state_of_world_populator.go:146] "Desired state populator starts to run" machine # [ 33.619877] k3s[875]: I0928 09:48:27.562807 875 reconciler.go:29] "Reconciler: start to sync state" machine # [ 33.621694] k3s[875]: E0928 09:48:27.565996 875 kubelet.go:1725] "Image garbage collection failed once. Stats initialization may not have completed yet" err="invalid capacity 0 on image filesystem" machine # [ 33.622492] k3s[875]: I0928 09:48:27.566571 875 factory.go:220] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory machine # [ 33.623871] k3s[875]: E0928 09:48:27.568910 875 kubelet.go:3516] "Unable to register mirror pod because node is not registered yet" err="node \"machine\" not found" node="machine" machine # [ 33.627053] k3s[875]: I0928 09:48:27.572080 875 factory.go:222] Registration of the containerd container factory successfully machine # [ 33.627582] k3s[875]: I0928 09:48:27.572130 875 factory.go:222] Registration of the systemd container factory successfully machine # [ 33.630424] k3s[875]: time="2026-09-28T09:48:27Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Resumed synced Job kube-system/helm-install-nix-grpc-farm" object=kube-system/nix-grpc-farm reason=ResumeJob type=Normal machine # [ 33.644625] k3s[875]: E0928 09:48:27.589205 875 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"machine\" not found" node="machine" machine # [ 33.651676] k3s[875]: I0928 09:48:27.596701 875 cpu_manager.go:235] "Starting" policy="none" machine # [ 33.652035] k3s[875]: I0928 09:48:27.596723 875 cpu_manager.go:236] "Reconciling" reconcilePeriod="10s" machine # [ 33.652740] k3s[875]: I0928 09:48:27.596746 875 state_mem.go:45] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" machine # [ 33.658710] k3s[875]: I0928 09:48:27.603715 875 policy_none.go:50] "Start" machine # [ 33.659427] k3s[875]: I0928 09:48:27.603752 875 memory_manager.go:190] "Starting memorymanager" policy="None" machine # [ 33.660440] k3s[875]: I0928 09:48:27.603774 875 state_mem.go:40] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" machine # [ 33.663781] k3s[875]: I0928 09:48:27.608761 875 policy_none.go:44] "Start" machine # [ 33.669325] systemd[1]: Created slice libcontainer container kubepods.slice. machine # [ 33.681184] systemd[1]: Created slice libcontainer container kubepods-burstable.slice. machine # [ 33.682363] k3s[875]: I0928 09:48:27.627165 875 kubelet_network_linux.go:53] "Initialized iptables rules." protocol="IPv6" machine # [ 33.691518] systemd[1]: Created slice libcontainer container kubepods-besteffort.slice. machine # [ 33.697994] k3s[875]: time="2026-09-28T09:48:27Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=AppliedManifest type=Normal machine # [ 33.700329] k3s[875]: E0928 09:48:27.645353 875 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" machine # [ 33.701467] k3s[875]: I0928 09:48:27.646464 875 eviction_manager.go:194] "Eviction manager: starting control loop" machine # [ 33.702144] k3s[875]: I0928 09:48:27.646484 875 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" machine # [ 33.703297] k3s[875]: I0928 09:48:27.648352 875 plugin_manager.go:121] "Starting Kubelet Plugin Manager" machine # [ 33.706783] k3s[875]: E0928 09:48:27.650195 875 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="no imagefs label for configured runtime" machine # [ 33.708680] k3s[875]: E0928 09:48:27.652213 875 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"machine\" not found" machine # [ 33.723996] k3s[875]: E0928 09:48:27.668987 875 kubelet.go:3516] "Unable to register mirror pod because node is not registered yet" err="node \"machine\" not found" node="machine" machine # [ 33.772271] k3s[875]: I0928 09:48:27.717229 875 kubelet_network_linux.go:53] "Initialized iptables rules." protocol="IPv4" machine # [ 33.772425] k3s[875]: I0928 09:48:27.717275 875 status_manager.go:277] "Starting to sync pod status with apiserver" machine # [ 33.773134] k3s[875]: I0928 09:48:27.717326 875 kubelet.go:2622] "Starting kubelet main sync loop" machine # [ 33.773693] k3s[875]: E0928 09:48:27.717385 875 kubelet.go:2646] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" machine # [ 33.804130] k3s[875]: I0928 09:48:27.748749 875 kubelet_node_status.go:75] "Attempting to register node" node="machine" machine # [ 33.813330] k3s[875]: I0928 09:48:27.758372 875 kubelet_node_status.go:78] "Successfully registered node" node="machine" machine # [ 33.814702] k3s[875]: I0928 09:48:27.759713 875 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"machine\" does not exist" machine # [ 33.815767] k3s[875]: time="2026-09-28T09:48:27Z" level=info msg="Adding node OwnerReference to node-password secret machine.node-password.k3s" machine # [ 33.817297] k3s[875]: I0928 09:48:27.760854 875 node_controller.go:432] Initializing node machine with cloud provider machine # [ 33.817819] k3s[875]: I0928 09:48:27.760913 875 node_controller.go:236] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 33.818484] k3s[875]: E0928 09:48:27.760939 875 node_controller.go:247] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 33.820097] k3s[875]: time="2026-09-28T09:48:27Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/traefik.yaml\"" object=kube-system/traefik reason=DeletingManifest type=Normal machine # [ 33.820953] k3s[875]: I0928 09:48:27.765968 875 node_controller.go:432] Initializing node machine with cloud provider machine # [ 33.821843] k3s[875]: I0928 09:48:27.766024 875 node_controller.go:236] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 33.822550] k3s[875]: E0928 09:48:27.766043 875 node_controller.go:247] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 33.835876] k3s[875]: I0928 09:48:27.780269 875 node_controller.go:432] Initializing node machine with cloud provider machine # [ 33.836194] k3s[875]: I0928 09:48:27.780336 875 node_controller.go:236] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 33.836711] k3s[875]: E0928 09:48:27.780360 875 node_controller.go:247] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 33.841058] k3s[875]: time="2026-09-28T09:48:27Z" level=info msg="Annotations and labels have been set successfully on node: machine" machine # [ 33.842576] k3s[875]: I0928 09:48:27.787622 875 node_controller.go:432] Initializing node machine with cloud provider machine # [ 33.844764] k3s[875]: I0928 09:48:27.789741 875 range_allocator.go:433] "Set node PodCIDR" node="machine" podCIDRs=["10.42.0.0/24"] machine # [ 33.852903] k3s[875]: time="2026-09-28T09:48:27Z" level=info msg="Starting flannel with backend vxlan" machine # [ 33.858356] k3s[875]: I0928 09:48:27.803396 875 kuberuntime_manager.go:2172] "Updating runtime config through cri with podcidr" CIDR="10.42.0.0/24" machine # [ 33.859091] k3s[875]: time="2026-09-28T09:48:27Z" level=info msg="Synced coredns NodeHosts entries for machine" machine # [ 33.859946] k3s[875]: I0928 09:48:27.805004 875 kubelet_network.go:48] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.42.0.0/24" machine # [ 33.867046] k3s[875]: E0928 09:48:27.812033 875 range_allocator.go:438] "Failed to update node PodCIDR after multiple attempts" err="failed to patch node CIDR: Node \"machine\" is invalid: [spec.podCIDRs: Invalid value: [\"10.42.1.0/24\",\"10.42.0.0/24\"]: may specify no more than one CIDR for each IP family, spec.podCIDRs: Forbidden: node updates may not change podCIDR except from \"\" to valid]" node="machine" podCIDRs=["10.42.1.0/24"] machine # [ 33.867354] k3s[875]: E0928 09:48:27.812086 875 range_allocator.go:444] "CIDR assignment for node failed. Releasing allocated CIDR" err="failed to patch node CIDR: Node \"machine\" is invalid: [spec.podCIDRs: Invalid value: [\"10.42.1.0/24\",\"10.42.0.0/24\"]: may specify no more than one CIDR for each IP family, spec.podCIDRs: Forbidden: node updates may not change podCIDR except from \"\" to valid]" node="machine" machine # [ 33.876462] k3s[875]: time="2026-09-28T09:48:27Z" level=info msg="Flannel found PodCIDR assigned for node machine" machine # [ 33.878124] k3s[875]: E0928 09:48:27.823122 875 range_allocator.go:257] "Error processing node work item" err="error syncing 'machine': failed to patch node CIDR: Node \"machine\" is invalid: [spec.podCIDRs: Invalid value: [\"10.42.1.0/24\",\"10.42.0.0/24\"]: may specify no more than one CIDR for each IP family, spec.podCIDRs: Forbidden: node updates may not change podCIDR except from \"\" to valid], requeuing" logger="UnhandledError" machine # [ 33.883328] k3s[875]: time="2026-09-28T09:48:27Z" level=info msg="The interface eth0 with ipv4 address 10.0.2.15 will be used by flannel" machine # [ 33.885070] k3s[875]: I0928 09:48:27.829087 875 kube.go:139] Waiting 10m0s for node controller to sync machine # [ 33.886436] k3s[875]: I0928 09:48:27.829160 875 kube.go:537] Starting kube subnet manager machine # [ 33.888889] k3s[875]: time="2026-09-28T09:48:27Z" level=info msg="Labels and annotations have been set successfully on node: machine" machine # [ 33.944247] k3s[875]: I0928 09:48:27.889258 875 node_controller.go:477] Successfully initialized node machine with cloud provider machine # [ 33.946077] k3s[875]: I0928 09:48:27.889585 875 event.go:389] "Event occurred" object="machine" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="Synced" message="Node synced successfully" machine # [ 33.948651] k3s[875]: E0928 09:48:27.889965 875 options.go:205] The manifest file is empty, ignoring. machine # [ 33.951912] k3s[875]: I0928 09:48:27.896951 875 server.go:176] "Starting Kubernetes Scheduler" version="v1.36.4+k3s1" machine # [ 33.953420] k3s[875]: I0928 09:48:27.896978 875 server.go:178] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 33.956590] k3s[875]: I0928 09:48:27.901601 875 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 33.959292] k3s[875]: I0928 09:48:27.901639 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 33.960627] k3s[875]: I0928 09:48:27.901689 875 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 33.962866] k3s[875]: I0928 09:48:27.901710 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 33.964158] k3s[875]: I0928 09:48:27.901737 875 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 33.966655] k3s[875]: I0928 09:48:27.901753 875 shared_informer.go:402] "Waiting for caches to sync" machine # [ 33.967937] k3s[875]: I0928 09:48:27.901776 875 secure_serving.go:214] Serving securely on 127.0.0.1:10259 machine # [ 33.969325] k3s[875]: I0928 09:48:27.901875 875 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 33.972365] k3s[875]: I0928 09:48:27.901989 875 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 34.057694] k3s[875]: I0928 09:48:28.002609 875 shared_informer.go:409] "Caches are synced" machine # [ 34.059120] k3s[875]: I0928 09:48:28.003692 875 shared_informer.go:409] "Caches are synced" machine # [ 34.060381] k3s[875]: I0928 09:48:28.002663 875 shared_informer.go:409] "Caches are synced" machine # [ 34.072173] k3s[875]: I0928 09:48:28.017215 875 kubelet_node_status.go:431] "Fast updating node status as it just became ready" machine # [ 34.173311] k3s[875]: I0928 09:48:28.117651 875 server.go:228] "Successfully retrieved NodeIPs" NodeIPs=["10.0.2.15","fec0::c9ae:78c0:b43f:d9ba"] machine # [ 34.175609] k3s[875]: E0928 09:48:28.119742 875 server.go:265] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`" machine # [ 34.208747] k3s[875]: I0928 09:48:28.153761 875 server.go:274] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4" machine # [ 34.210400] k3s[875]: I0928 09:48:28.153814 875 server_linux.go:137] "Using iptables Proxier" machine # [ 34.225056] k3s[875]: I0928 09:48:28.169911 875 proxier.go:241] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4" machine # [ 34.234801] k3s[875]: I0928 09:48:28.179830 875 server.go:539] "Version info" version="v1.36.4+k3s1" machine # [ 34.234943] k3s[875]: I0928 09:48:28.179858 875 server.go:541] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 34.236561] k3s[875]: I0928 09:48:28.181602 875 config.go:200] "Starting service config controller" machine # [ 34.237463] k3s[875]: I0928 09:48:28.182456 875 shared_informer.go:381] "Waiting for caches to sync" controller="service config" machine # [ 34.239234] k3s[875]: I0928 09:48:28.182597 875 config.go:106] "Starting endpoint slice config controller" machine # [ 34.240673] k3s[875]: I0928 09:48:28.182651 875 shared_informer.go:381] "Waiting for caches to sync" controller="endpoint slice config" machine # [ 34.241406] k3s[875]: I0928 09:48:28.182756 875 config.go:403] "Starting serviceCIDR config controller" machine # [ 34.242771] k3s[875]: I0928 09:48:28.182805 875 shared_informer.go:381] "Waiting for caches to sync" controller="serviceCIDR config" machine # [ 34.243708] k3s[875]: I0928 09:48:28.181870 875 config.go:309] "Starting node config controller" machine # [ 34.244847] k3s[875]: I0928 09:48:28.182940 875 shared_informer.go:381] "Waiting for caches to sync" controller="node config" machine # [ 34.246161] k3s[875]: I0928 09:48:28.182954 875 shared_informer.go:388] "Caches are synced" controller="node config" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 34.575730] k3s[875]: I0928 09:48:28.520676 875 apiserver.go:51] "Watching apiserver" machine # [ 34.885260] k3s[875]: I0928 09:48:28.829989 875 kube.go:163] Node controller sync successful machine # [ 34.886171] k3s[875]: I0928 09:48:28.830160 875 vxlan.go:128] VXLAN config: VNI=1 Port=0 GBP=false Learning=false DirectRouting=false machine # [ 34.898541] k3s[875]: I0928 09:48:28.843454 875 kube.go:704] List of node(machine) annotations: map[string]string{"alpha.kubernetes.io/provided-node-ip":"10.0.2.15,fec0::c9ae:78c0:b43f:d9ba", "k3s.io/hostname":"machine", "k3s.io/internal-ip":"10.0.2.15,fec0::c9ae:78c0:b43f:d9ba", "k3s.io/node-args":"[\"server\",\"--disable\",\"traefik\",\"--disable\",\"metrics-server\",\"--disable\",\"local-storage\",\"--kubelet-arg\",\"eviction-hard=nodefs.available\\u003c1%,imagefs.available\\u003c1%\"]", "k3s.io/node-config-hash":"EFXPOZ7ZWHRCLFNW4X4ZDPFQMSAOP3BLEIN2VE47TDRKQ4UIWKUQ====", "k3s.io/node-env":"{}", "node.alpha.kubernetes.io/ttl":"0", "volumes.kubernetes.io/controller-managed-attach-detach":"true"} machine # [ 34.946125] (udev-worker)[1267]: Network interface NamePolicy= disabled on kernel command line. machine # [ 34.956645] k3s[875]: I0928 09:48:28.901195 875 kube.go:558] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.42.0.0/24] machine # [ 34.957254] k3s[875]: I0928 09:48:28.902301 875 iptables.go:50] Starting flannel in iptables mode... machine # [ 34.958043] k3s[875]: time="2026-09-28T09:48:28Z" level=warning msg="no subnet found for key: FLANNEL_NETWORK in file: /run/flannel/subnet.env" machine # [ 34.961164] k3s[875]: time="2026-09-28T09:48:28Z" level=warning msg="no subnet found for key: FLANNEL_SUBNET in file: /run/flannel/subnet.env" machine # [ 34.961456] k3s[875]: time="2026-09-28T09:48:28Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_NETWORK in file: /run/flannel/subnet.env" machine # [ 34.962217] k3s[875]: time="2026-09-28T09:48:28Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_SUBNET in file: /run/flannel/subnet.env" machine # [ 34.963474] k3s[875]: I0928 09:48:28.903612 875 iptables.go:101] Current network or subnet (10.42.0.0/16, 10.42.0.0/24) is not equal to previous one (0.0.0.0/0, 0.0.0.0/0), trying to recycle old iptables rules machine # [ 34.985037] k3s[875]: time="2026-09-28T09:48:28Z" level=info msg="Tunnel authorizer set Kubelet Port 0.0.0.0:10250" machine # [ 34.989936] systemd[1]: Created slice libcontainer container kubepods-burstable-podf1314f0a_4720_4406_8ce3_9c1f2452b9b0.slice. machine # [ 35.004205] systemd[1]: Created slice libcontainer container kubepods-burstable-poda23ffa20_a145_4473_9a87_f51760e8806c.slice. machine # [ 35.006403] dhcpcd[684]: flannel.1: IAID 09:72:8f:64 machine # [ 35.007428] dhcpcd[684]: flannel.1: adding address fe80::b1:9ff:fe72:8f64 machine # [ 35.018066] k3s[875]: I0928 09:48:28.963051 875 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" machine # [ 35.023146] k3s[875]: I0928 09:48:28.968166 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/a23ffa20-a145-4473-9a87-f51760e8806c-klipper-helm\") pod \"helm-install-nix-grpc-farm-ggrxh\" (UID: \"a23ffa20-a145-4473-9a87-f51760e8806c\") " pod="kube-system/helm-install-nix-grpc-farm-ggrxh" machine # [ 35.023455] k3s[875]: I0928 09:48:28.968213 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/a23ffa20-a145-4473-9a87-f51760e8806c-klipper-cache\") pod \"helm-install-nix-grpc-farm-ggrxh\" (UID: \"a23ffa20-a145-4473-9a87-f51760e8806c\") " pod="kube-system/helm-install-nix-grpc-farm-ggrxh" machine # [ 35.023991] k3s[875]: I0928 09:48:28.968242 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"values\" (UniqueName: \"kubernetes.io/projected/a23ffa20-a145-4473-9a87-f51760e8806c-values\") pod \"helm-install-nix-grpc-farm-ggrxh\" (UID: \"a23ffa20-a145-4473-9a87-f51760e8806c\") " pod="kube-system/helm-install-nix-grpc-farm-ggrxh" machine # [ 35.024844] k3s[875]: I0928 09:48:28.968277 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"content\" (UniqueName: \"kubernetes.io/configmap/a23ffa20-a145-4473-9a87-f51760e8806c-content\") pod \"helm-install-nix-grpc-farm-ggrxh\" (UID: \"a23ffa20-a145-4473-9a87-f51760e8806c\") " pod="kube-system/helm-install-nix-grpc-farm-ggrxh" machine # [ 35.038876] k3s[875]: I0928 09:48:28.983728 875 shared_informer.go:388] "Caches are synced" controller="serviceCIDR config" machine # [ 35.039552] k3s[875]: I0928 09:48:28.983773 875 shared_informer.go:388] "Caches are synced" controller="service config" machine # [ 35.040075] k3s[875]: I0928 09:48:28.983808 875 shared_informer.go:388] "Caches are synced" controller="endpoint slice config" machine # [ 35.044603] k3s[875]: I0928 09:48:28.989193 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/a23ffa20-a145-4473-9a87-f51760e8806c-klipper-config\") pod \"helm-install-nix-grpc-farm-ggrxh\" (UID: \"a23ffa20-a145-4473-9a87-f51760e8806c\") " pod="kube-system/helm-install-nix-grpc-farm-ggrxh" machine # [ 35.049107] k3s[875]: I0928 09:48:28.989318 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a23ffa20-a145-4473-9a87-f51760e8806c-tmp\") pod \"helm-install-nix-grpc-farm-ggrxh\" (UID: \"a23ffa20-a145-4473-9a87-f51760e8806c\") " pod="kube-system/helm-install-nix-grpc-farm-ggrxh" machine # [ 35.053233] k3s[875]: I0928 09:48:28.989349 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxmzj\" (UniqueName: \"kubernetes.io/projected/a23ffa20-a145-4473-9a87-f51760e8806c-kube-api-access-wxmzj\") pod \"helm-install-nix-grpc-farm-ggrxh\" (UID: \"a23ffa20-a145-4473-9a87-f51760e8806c\") " pod="kube-system/helm-install-nix-grpc-farm-ggrxh" machine # [ 35.057502] k3s[875]: I0928 09:48:28.989378 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f1314f0a-4720-4406-8ce3-9c1f2452b9b0-config-volume\") pod \"coredns-54996dc9b4-q985t\" (UID: \"f1314f0a-4720-4406-8ce3-9c1f2452b9b0\") " pod="kube-system/coredns-54996dc9b4-q985t" machine # [ 35.062152] k3s[875]: I0928 09:48:28.989407 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1314f0a-4720-4406-8ce3-9c1f2452b9b0-custom-config-volume\") pod \"coredns-54996dc9b4-q985t\" (UID: \"f1314f0a-4720-4406-8ce3-9c1f2452b9b0\") " pod="kube-system/coredns-54996dc9b4-q985t" machine # [ 35.066711] k3s[875]: I0928 09:48:28.989431 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r86fx\" (UniqueName: \"kubernetes.io/projected/f1314f0a-4720-4406-8ce3-9c1f2452b9b0-kube-api-access-r86fx\") pod \"coredns-54996dc9b4-q985t\" (UID: \"f1314f0a-4720-4406-8ce3-9c1f2452b9b0\") " pod="kube-system/coredns-54996dc9b4-q985t" machine # [ 35.076481] k3s[875]: I0928 09:48:29.021482 875 iptables.go:111] Setting up masking rules machine # [ 35.095598] k3s[875]: I0928 09:48:29.040575 875 iptables.go:212] Changing default FORWARD chain policy to ACCEPT machine # [ 35.106982] k3s[875]: time="2026-09-28T09:48:29Z" level=info msg="Wrote flannel subnet file to /run/flannel/subnet.env" machine # [ 35.107276] k3s[875]: time="2026-09-28T09:48:29Z" level=info msg="Running flannel backend" machine # [ 35.107876] k3s[875]: I0928 09:48:29.052826 875 vxlan_network.go:68] watching for new subnet leases machine # [ 35.108722] k3s[875]: I0928 09:48:29.052866 875 vxlan_network.go:115] starting vxlan device watcher machine # [ 35.169882] k3s[875]: I0928 09:48:29.114837 875 iptables.go:358] bootstrap done machine # [ 35.210355] k3s[875]: I0928 09:48:29.155371 875 iptables.go:358] bootstrap done machine # [ 35.391094] (udev-worker)[1497]: Network interface NamePolicy= disabled on kernel command line. machine # [ 35.546487] cni0: port 1(veth5d61b871) entered blocking state machine # [ 35.393333] (udev-worker)[149[ 35.547418] cni0: port 1(veth5d61b871) entered disabled state machine # 8]: Network interface NamePolicy= disabled on ke[ 35.548595] veth5d61b871: entered allmulticast mode machine # rnel command line. machine # [ 35.549565] veth5d61b871: entered promiscuous mode machine # [ 35.550718] cni0: port 2(veth95ea316a) entered blocking state machine # [ 35.551399] cni0: port 2(veth95ea316a) entered disabled state machine # [ 35.552089] veth95ea316a: entered allmulticast mode machine # [ 35.552911] veth95ea316a: entered promiscuous mode machine # [ 35.576576] cni0: port 1(veth5d61b871) entered blocking state machine # [ 35.577327] cni0: port 1(veth5d61b871) entered forwarding state machine # [ 35.589446] cni0: port 2(veth95ea316a) entered blocking state machine # [ 35.590129] cni0: port 2(veth95ea316a) entered forwarding state machine # [ 35.446567] dhcpcd[684]: veth5d61b871: waiting for carrier machine # [ 35.460630] dhcpcd[684]: veth95ea316a: IAID cf:6a:7b:37 machine # [ 35.461064] dhcpcd[684]: veth95ea316a: adding address fe80::f48a:cfff:fe6a:7b37 machine # [ 35.461679] dhcpcd[684]: veth5d61b871: carrier acquired machine # [ 35.471155] dhcpcd[684]: veth5d61b871: IAID 66:2c:31:ee machine # [ 35.472096] dhcpcd[684]: veth5d61b871: adding address fe80::b059:66ff:fe2c:31ee machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 35.695771] cni0: port 1(veth5d61b871) entered disabled state machine # [ 35.542310] dhcpcd[684]: veth5d61b871: carrier lost machine # [ 35.697969] veth5d61b871 (unregistering): left allmulticast mode machine # [ 35.698873] veth5d61b871 (unregistering): left promiscuous mode machine # [ 35.699636] cni0: port 1(veth5d61b871) entered disabled state machine # [ 35.723281] cni0: port 2(veth95ea316a) entered disabled state machine # [ 35.569980] k3s[875]: E0928 09:48:29.514345 875 remote_runtime.go:237] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to pull image \"rancher/mirrored-pause:3.10.2\": failed to pull and unpack image \"docker.io/rancher/mirrored-pause:3.10.2\": failed to resolve reference \"docker.io/rancher/mirrored-pause:3.10.2\": failed to do request: Head \"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\": dial tcp: lookup registry-1.docker.io: no such host"[ 35.730209] veth95ea316a (unregistering): left allmulticast mode machine # [ 35.731060] veth95ea316a (unregistering): left promiscuous mode machine # [ 35.731766] cni0: port 2(veth95ea316a) entered disabled state machine # machine # [ 35.579182] k3s[875]: E0928 09:48:29.514835 875 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to pull image \"rancher/mirrored-pause:3.10.2\": failed to pull and unpack image \"docker.io/rancher/mirrored-pause:3.10.2\": failed to resolve reference \"docker.io/rancher/mirrored-pause:3.10.2\": failed to do request: Head \"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\": dial tcp: lookup registry-1.docker.io: no such host" pod="kube-system/helm-install-nix-grpc-farm-ggrxh" machine # [ 35.585909] k3s[875]: E0928 09:48:29.514867 875 kuberuntime_manager.go:1640] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to pull image \"rancher/mirrored-pause:3.10.2\": failed to pull and unpack image \"docker.io/rancher/mirrored-pause:3.10.2\": failed to resolve reference \"docker.io/rancher/mirrored-pause:3.10.2\": failed to do request: Head \"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\": dial tcp: lookup registry-1.docker.io: no such host" pod="kube-system/helm-install-nix-grpc-farm-ggrxh" machine # [ 35.592572] k3s[875]: E0928 09:48:29.514960 875 pod_workers.go:1338] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"helm-install-nix-grpc-farm-ggrxh_kube-system(a23ffa20-a145-4473-9a87-f51760e8806c)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"helm-install-nix-grpc-farm-ggrxh_kube-system(a23ffa20-a145-4473-9a87-f51760e8806c)\\\": rpc error: code = Unknown desc = failed to pull image \\\"rancher/mirrored-pause:3.10.2\\\": failed to pull and unpack image \\\"docker.io/rancher/mirrored-pause:3.10.2\\\": failed to resolve reference \\\"docker.io/rancher/mirrored-pause:3.10.2\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="kube-system/helm-install-nix-grpc-farm-ggrxh" podUID="a23ffa20-a145-4473-9a87-f51760e8806c" machine # [ 35.602578] dhcpcd[684]: veth5d61b871: deleting address fe80::b059:66ff:fe2c:31ee machine # [ 35.603785] dhcpcd[684]: veth5d61b871: removing interface machine # [ 35.604685] dhcpcd[684]: veth95ea316a: removing interface machine # [ 35.618070] dhcpcd[684]: veth95ea316a: deleting address fe80::f48a:cfff:fe6a:7b37 machine # [ 35.623636] k3s[875]: E0928 09:48:29.568666 875 remote_runtime.go:237] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to pull image \"rancher/mirrored-pause:3.10.2\": failed to pull and unpack image \"docker.io/rancher/mirrored-pause:3.10.2\": failed to resolve reference \"docker.io/rancher/mirrored-pause:3.10.2\": failed to do request: Head \"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\": dial tcp: lookup registry-1.docker.io: no such host" machine # [ 35.629432] k3s[875]: E0928 09:48:29.568739 875 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to pull image \"rancher/mirrored-pause:3.10.2\": failed to pull and unpack image \"docker.io/rancher/mirrored-pause:3.10.2\": failed to resolve reference \"docker.io/rancher/mirrored-pause:3.10.2\": failed to do request: Head \"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\": dial tcp: lookup registry-1.docker.io: no such host" pod="kube-system/coredns-54996dc9b4-q985t" machine # [ 35.635694] k3s[875]: E0928 09:48:29.568772 875 kuberuntime_manager.go:1640] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to pull image \"rancher/mirrored-pause:3.10.2\": failed to pull and unpack image \"docker.io/rancher/mirrored-pause:3.10.2\": failed to resolve reference \"docker.io/rancher/mirrored-pause:3.10.2\": failed to do request: Head \"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\": dial tcp: lookup registry-1.docker.io: no such host" pod="kube-system/coredns-54996dc9b4-q985t" machine # [ 35.636607] k3s[875]: E0928 09:48:29.568876 875 pod_workers.go:1338] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-54996dc9b4-q985t_kube-system(f1314f0a-4720-4406-8ce3-9c1f2452b9b0)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-54996dc9b4-q985t_kube-system(f1314f0a-4720-4406-8ce3-9c1f2452b9b0)\\\": rpc error: code = Unknown desc = failed to pull image \\\"rancher/mirrored-pause:3.10.2\\\": failed to pull and unpack image \\\"docker.io/rancher/mirrored-pause:3.10.2\\\": failed to resolve reference \\\"docker.io/rancher/mirrored-pause:3.10.2\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="kube-system/coredns-54996dc9b4-q985t" podUID="f1314f0a-4720-4406-8ce3-9c1f2452b9b0" machine # [ 35.690758] dhcpcd[684]: flannel.1: soliciting a DHCP lease machine # [ 36.237702] k3s[875]: time="2026-09-28T09:48:30Z" level=info msg="Starting network policy controller version v2.6.3-k3s1, built on 1970-01-01T01:01:01Z, go1.26.7" machine # [ 36.240119] k3s[875]: I0928 09:48:30.182733 875 network_policy_controller.go:164] Starting network policy controller machine # [ 36.439556] k3s[875]: I0928 09:48:30.384541 875 network_policy_controller.go:179] Starting network policy controller full sync goroutine machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 36.876957] k3s[875]: time="2026-09-28T09:48:30Z" level=info msg="Imported docker.io/rancher/klipper-helm:v0.13.3-build20260727" machine # [ 36.880392] k3s[875]: time="2026-09-28T09:48:30Z" level=info msg="Tagged docker.io/rancher/klipper-helm@sha256:5425a2b4613d2458dbdff99218e8d487ebb59c20e7a941f061c0777070f0aac1" machine # [ 36.880778] k3s[875]: time="2026-09-28T09:48:30Z" level=info msg="Imported docker.io/rancher/klipper-lb:v0.4.17" machine # [ 36.884212] k3s[875]: time="2026-09-28T09:48:30Z" level=info msg="Tagged docker.io/rancher/klipper-lb@sha256:910944bb0bd94f060a82a56ca1ea1c577d3e49b3473a093a47a985f32e92d94a" machine # [ 36.884676] k3s[875]: time="2026-09-28T09:48:30Z" level=info msg="Imported docker.io/rancher/local-path-provisioner:v0.0.37" machine # [ 36.891304] k3s[875]: time="2026-09-28T09:48:30Z" level=info msg="Tagged docker.io/rancher/local-path-provisioner@sha256:e757967a5ec338f6a9b371c5a9688bedaa8c3578ea3dd4db329ea0084be0a86f" machine # [ 36.891698] k3s[875]: time="2026-09-28T09:48:30Z" level=info msg="Imported docker.io/rancher/mirrored-coredns-coredns:1.14.6" machine # [ 36.898758] k3s[875]: time="2026-09-28T09:48:30Z" level=info msg="Tagged docker.io/rancher/mirrored-coredns-coredns@sha256:900f9c109f7a33545d3c811516e8376df9019147b750f5ce3e254468769176ea" machine # [ 36.899043] k3s[875]: time="2026-09-28T09:48:30Z" level=info msg="Imported docker.io/rancher/mirrored-library-busybox:1.37.0" machine # [ 36.904110] k3s[875]: time="2026-09-28T09:48:30Z" level=info msg="Tagged docker.io/rancher/mirrored-library-busybox@sha256:101b4afd76732482eff9b95cae5f94bcf295e521fbec4e01b69c5421f3f3f3e5" machine # [ 36.904225] k3s[875]: time="2026-09-28T09:48:30Z" level=info msg="Imported docker.io/rancher/mirrored-library-traefik:3.7.8" machine # [ 36.908376] k3s[875]: time="2026-09-28T09:48:30Z" level=info msg="Tagged docker.io/rancher/mirrored-library-traefik@sha256:4299bbed850421258fc5448c2e0e6ad350981d4d335a68de11b92448aedbefe5" machine # [ 36.910937] k3s[875]: time="2026-09-28T09:48:30Z" level=info msg="Imported docker.io/rancher/mirrored-metrics-server:v0.9.0" machine # [ 36.912687] k3s[875]: time="2026-09-28T09:48:30Z" level=info msg="Tagged docker.io/rancher/mirrored-metrics-server@sha256:d9862115e7c7881280d3d75ca26bda8ffc0fc213315979575bf23ce9826205c0" machine # [ 36.915202] k3s[875]: time="2026-09-28T09:48:30Z" level=info msg="Imported docker.io/rancher/mirrored-pause:3.10.2" machine # [ 36.915476] k3s[875]: time="2026-09-28T09:48:30Z" level=info msg="Tagged docker.io/rancher/mirrored-pause@sha256:f548e0e8e3dc1896ca956272154dde3314e8cc4fde0a57577ee9fa1c63f5baf4" machine # [ 36.963061] dhcpcd[684]: flannel.1: soliciting an IPv6 router machine # [ 37.082183] k3s[875]: time="2026-09-28T09:48:31Z" level=info msg="Started tunnel to 10.0.2.15:6443" machine # [ 37.082437] k3s[875]: time="2026-09-28T09:48:31Z" level=info msg="Stopped tunnel to 127.0.0.1:6443" machine # [ 37.082925] k3s[875]: time="2026-09-28T09:48:31Z" level=info msg="Connecting to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 37.083669] k3s[875]: time="2026-09-28T09:48:31Z" level=info msg="Proxy done" err="context canceled" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 37.084261] k3s[875]: time="2026-09-28T09:48:31Z" level=info msg="Handling backend connection request [machine]" machine # [ 37.088711] k3s[875]: time="2026-09-28T09:48:31Z" level=info msg="error in remotedialer server [400]: websocket: close 1006 (abnormal closure): unexpected EOF" machine # [ 37.088835] k3s[875]: time="2026-09-28T09:48:31Z" level=info msg="Connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 37.089572] k3s[875]: time="2026-09-28T09:48:31Z" level=info msg="Remotedialer connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 37.205580] k3s[875]: time="2026-09-28T09:48:31Z" level=info msg="Imported 8 images from /var/lib/rancher/k3s/agent/images/nixos/smddpgqzjvlqv3lx57wdzl7kma805fj0-k3s-airgap-images-amd64.tar.zst in 4.010590451s" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 38.309600] k3s[875]: I0928 09:48:32.253549 875 node_lifecycle_controller.go:1217] "Initializing eviction metric for zone" zone="" machine # [ 38.309896] k3s[875]: I0928 09:48:32.253788 875 node_lifecycle_controller.go:869] "Missing timestamp for Node. Assuming now as a timestamp" node="machine" machine # [ 38.312109] k3s[875]: I0928 09:48:32.253978 875 node_lifecycle_controller.go:1063] "Controller detected that zone is now in new state" zone="" newState="Normal" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 40.693072] dhcpcd[684]: flannel.1: probing for an IPv4LL address machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 46.028559] dhcpcd[684]: flannel.1: using IPv4LL address 169.254.158.23 machine # [ 46.028977] dhcpcd[684]: flannel.1: adding route to 169.254.0.0/16 machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 46.984142] cni0: port 1(veth75076c51) entered blocking state machine # [ 46.985894] cni0: port 1(veth75076c51) entered disabled state machine # [ 46.987840] veth75076c51: entered allmulticast mode machine # [ 46.989696] veth75076c51: entered promiscuous mode machine # [ 47.007533] cni0: port 1(veth75076c51) entered blocking state machine # [ 47.009336] cni0: port 1(veth75076c51) entered forwarding state machine # [ 46.902679] (udev-worker)[1977]: Network interface NamePolicy= disabled on kernel command line. machine # [ 46.930711] dhcpcd[684]: veth75076c51: IAID 42:ac:82:da machine # [ 46.930935] dhcpcd[684]: veth75076c51: adding address fe80::40d0:42ff:feac:82da machine # [ 46.932879] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount3865875697.mount: Deactivated successfully. machine # [ 47.009378] systemd[1]: Started libcontainer container 7c18a82830e090ea6f588c9b50669cd4413d8abb5341cc3477186975f7dd44c1. machine # [ 47.778076] systemd[1]: Started libcontainer container e7aed7fe9f766c0c1d6eb4e6bf007b20a3942cef8bb48535c43a439de59664c3. machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 48.266378] dhcpcd[684]: veth75076c51: soliciting a DHCP lease machine # [ 48.865410] k3s[875]: I0928 09:48:42.809552 875 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/coredns-54996dc9b4-q985t" podStartSLOduration=18.80951112 podStartE2EDuration="18.80951112s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-28 09:48:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-28 09:48:41.804578091 +0000 UTC m=+31.845088409" watchObservedRunningTime="2026-09-28 09:48:42.80951112 +0000 UTC m=+32.850025629" machine # [ 48.966884] dhcpcd[684]: flannel.1: no IPv6 Routers available machine # [ 49.082187] dhcpcd[684]: veth75076c51: soliciting an IPv6 router machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 49.973820] cni0: port 2(vethcb952f63) entered blocking state machine # [ 49.975734] cni0: port 2(vethcb952f63) entered disabled state machine # [ 49.822741] ([ 49.977482] vethcb952f63: entered allmulticast mode machine # udev-worker)[198[ 49.979511] vethcb952f63: entered promiscuous mode machine # 0]: Network interface NamePolicy= disabled on kernel command line. machine # [ 50.001552] cni0: port 2(vethcb952f63) entered blocking state machine # [ 50.002812] cni0: port 2(vethcb952f63) entered forwarding state machine # [ 49.875313] dhcpcd[684]: vethcb952f63: IAID 03:1e:b2:c1 machine # [ 49.875539] dhcpcd[684]: vethcb952f63: adding address fe80::789a:3ff:fe1e:b2c1 machine # [ 49.952518] systemd[1]: Started libcontainer container 721916e7f3328feda3df6b36f85e1f2427b47990d8602bdb710b958332f45400. machine # [ 50.129192] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount812449691.mount: Deactivated successfully. machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 50.867203] systemd[1]: Started libcontainer container 698f0e1e562604f856341ec24897d6b291714f70054f41f9e6248324a3b94c4e. machine # [ 50.969987] k3s[875]: I0928 09:48:44.914606 875 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/helm-install-nix-grpc-farm-ggrxh" podStartSLOduration=17.914571679 podStartE2EDuration="17.914571679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-28 09:48:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-28 09:48:44.913249164 +0000 UTC m=+34.953759204" watchObservedRunningTime="2026-09-28 09:48:44.914571679 +0000 UTC m=+34.955081439" machine # [ 51.247520] dhcpcd[684]: vethcb952f63: soliciting an IPv6 router machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 51.689379] k3s[875]: I0928 09:48:45.634371 875 alloc.go:329] "allocated clusterIPs" service="farm/nix-grpc-farm" clusterIPs={"IPv4":"10.43.137.149"} machine # [ 51.767433] systemd[1]: cri-containerd-698f0e1e562604f856341ec24897d6b291714f70054f41f9e6248324a3b94c4e.scope: Deactivated successfully. machine # [ 51.767739] systemd[1]: cri-containerd-698f0e1e562604f856341ec24897d6b291714f70054f41f9e6248324a3b94c4e.scope: Consumed 657ms CPU time over 900ms wall clock time, 34.7M memory peak, 2.6M incoming IP traffic, 152.1K outgoing IP traffic. machine # [ 51.782300] dhcpcd[684]: vethcb952f63: soliciting a DHCP lease machine # [ 51.820153] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-698f0e1e562604f856341ec24897d6b291714f70054f41f9e6248324a3b94c4e-rootfs.mount: Deactivated successfully. machine # [ 51.834482] k3s[875]: E0928 09:48:45.779483 875 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-scheduler-55cccf6d96\" failed with read version: 477 is not as new as written version: 478 for group resource replicasets.apps" logger="UnhandledError" machine # [ 51.844877] k3s[875]: E0928 09:48:45.787525 875 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-lb-5877cc8b4f\" failed with read version: 478 is not as new as written version: 481 for group resource replicasets.apps" logger="UnhandledError" machine # [ 51.882385] systemd[1]: Created slice libcontainer container kubepods-besteffort-podf821af5a_0519_4744_88fe_e88f8be4c980.slice. machine # [ 51.897228] systemd[1]: Created slice libcontainer container kubepods-besteffort-podc2087a35_8205_467c_b6c8_6ad2422f5c95.slice. machine # [ 51.966988] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod730d64de_7d25_4a24_817d_690e9510e92d.slice. machine # [ 51.985316] systemd[1]: Created slice libcontainer container kubepods-besteffort-podaf9d93bb_da5f_4fd2_9cf4_4e1169adec4c.slice. machine # [ 51.988747] k3s[875]: I0928 09:48:45.933132 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/c2087a35-8205-467c-b6c8-6ad2422f5c95-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-l9tvg\" (UID: \"c2087a35-8205-467c-b6c8-6ad2422f5c95\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-l9tvg" machine # [ 51.989121] k3s[875]: I0928 09:48:45.933178 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/c2087a35-8205-467c-b6c8-6ad2422f5c95-build\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-l9tvg\" (UID: \"c2087a35-8205-467c-b6c8-6ad2422f5c95\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-l9tvg" machine # [ 51.989549] k3s[875]: I0928 09:48:45.933263 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/f821af5a-0519-4744-88fe-e88f8be4c980-oidc\") pod \"nix-grpc-farm-scheduler-55cccf6d96-8j72r\" (UID: \"f821af5a-0519-4744-88fe-e88f8be4c980\") " pod="farm/nix-grpc-farm-scheduler-55cccf6d96-8j72r" machine # [ 51.990349] k3s[875]: I0928 09:48:45.933503 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/c2087a35-8205-467c-b6c8-6ad2422f5c95-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-l9tvg\" (UID: \"c2087a35-8205-467c-b6c8-6ad2422f5c95\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-l9tvg" machine # [ 51.991886] k3s[875]: I0928 09:48:45.933544 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f821af5a-0519-4744-88fe-e88f8be4c980-ca\") pod \"nix-grpc-farm-scheduler-55cccf6d96-8j72r\" (UID: \"f821af5a-0519-4744-88fe-e88f8be4c980\") " pod="farm/nix-grpc-farm-scheduler-55cccf6d96-8j72r" machine # [ 51.992701] k3s[875]: I0928 09:48:45.933581 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/c2087a35-8205-467c-b6c8-6ad2422f5c95-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-l9tvg\" (UID: \"c2087a35-8205-467c-b6c8-6ad2422f5c95\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-l9tvg" machine # [ 51.993412] k3s[875]: I0928 09:48:45.933610 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c2087a35-8205-467c-b6c8-6ad2422f5c95-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-l9tvg\" (UID: \"c2087a35-8205-467c-b6c8-6ad2422f5c95\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-l9tvg" machine # [ 51.994089] k3s[875]: I0928 09:48:45.933644 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/c2087a35-8205-467c-b6c8-6ad2422f5c95-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-l9tvg\" (UID: \"c2087a35-8205-467c-b6c8-6ad2422f5c95\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-l9tvg" machine # [ 51.994666] k3s[875]: I0928 09:48:45.933673 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rd4lr\" (UniqueName: \"kubernetes.io/projected/c2087a35-8205-467c-b6c8-6ad2422f5c95-kube-api-access-rd4lr\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-l9tvg\" (UID: \"c2087a35-8205-467c-b6c8-6ad2422f5c95\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-l9tvg" machine # [ 51.995208] k3s[875]: I0928 09:48:45.933700 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/f821af5a-0519-4744-88fe-e88f8be4c980-niks3-token\") pod \"nix-grpc-farm-scheduler-55cccf6d96-8j72r\" (UID: \"f821af5a-0519-4744-88fe-e88f8be4c980\") " pod="farm/nix-grpc-farm-scheduler-55cccf6d96-8j72r" machine # [ 51.995818] k3s[875]: I0928 09:48:45.933724 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/c2087a35-8205-467c-b6c8-6ad2422f5c95-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-l9tvg\" (UID: \"c2087a35-8205-467c-b6c8-6ad2422f5c95\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-l9tvg" machine # [ 51.996664] k3s[875]: I0928 09:48:45.933749 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/c2087a35-8205-467c-b6c8-6ad2422f5c95-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-l9tvg\" (UID: \"c2087a35-8205-467c-b6c8-6ad2422f5c95\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-l9tvg" machine # [ 52.039143] k3s[875]: I0928 09:48:45.933789 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/f821af5a-0519-4744-88fe-e88f8be4c980-tls\") pod \"nix-grpc-farm-scheduler-55cccf6d96-8j72r\" (UID: \"f821af5a-0519-4744-88fe-e88f8be4c980\") " pod="farm/nix-grpc-farm-scheduler-55cccf6d96-8j72r" machine # [ 52.039865] k3s[875]: I0928 09:48:45.933819 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snhj8\" (UniqueName: \"kubernetes.io/projected/f821af5a-0519-4744-88fe-e88f8be4c980-kube-api-access-snhj8\") pod \"nix-grpc-farm-scheduler-55cccf6d96-8j72r\" (UID: \"f821af5a-0519-4744-88fe-e88f8be4c980\") " pod="farm/nix-grpc-farm-scheduler-55cccf6d96-8j72r" machine # [ 52.093872] k3s[875]: I0928 09:48:46.038867 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/730d64de-7d25-4a24-817d-690e9510e92d-tmp\") pod \"nix-grpc-farm-lb-5877cc8b4f-fqf48\" (UID: \"730d64de-7d25-4a24-817d-690e9510e92d\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-fqf48" machine # [ 52.094084] k3s[875]: I0928 09:48:46.038914 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/730d64de-7d25-4a24-817d-690e9510e92d-tls-ca\") pod \"nix-grpc-farm-lb-5877cc8b4f-fqf48\" (UID: \"730d64de-7d25-4a24-817d-690e9510e92d\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-fqf48" machine # [ 52.094739] k3s[875]: I0928 09:48:46.038970 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/af9d93bb-da5f-4fd2-9cf4-4e1169adec4c-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-xplld\" (UID: \"af9d93bb-da5f-4fd2-9cf4-4e1169adec4c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-xplld" machine # [ 52.107132] k3s[875]: I0928 09:48:46.051881 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/af9d93bb-da5f-4fd2-9cf4-4e1169adec4c-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-xplld\" (UID: \"af9d93bb-da5f-4fd2-9cf4-4e1169adec4c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-xplld" machine # [ 52.107702] k3s[875]: I0928 09:48:46.051947 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/af9d93bb-da5f-4fd2-9cf4-4e1169adec4c-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-xplld\" (UID: \"af9d93bb-da5f-4fd2-9cf4-4e1169adec4c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-xplld" machine # [ 52.108441] k3s[875]: I0928 09:48:46.051980 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/af9d93bb-da5f-4fd2-9cf4-4e1169adec4c-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-xplld\" (UID: \"af9d93bb-da5f-4fd2-9cf4-4e1169adec4c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-xplld" machine # [ 52.109025] k3s[875]: I0928 09:48:46.052010 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnq7f\" (UniqueName: \"kubernetes.io/projected/af9d93bb-da5f-4fd2-9cf4-4e1169adec4c-kube-api-access-vnq7f\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-xplld\" (UID: \"af9d93bb-da5f-4fd2-9cf4-4e1169adec4c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-xplld" machine # [ 52.126080] k3s[875]: I0928 09:48:46.070218 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/af9d93bb-da5f-4fd2-9cf4-4e1169adec4c-build\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-xplld\" (UID: \"af9d93bb-da5f-4fd2-9cf4-4e1169adec4c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-xplld" machine # [ 52.126397] k3s[875]: I0928 09:48:46.070272 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/af9d93bb-da5f-4fd2-9cf4-4e1169adec4c-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-xplld\" (UID: \"af9d93bb-da5f-4fd2-9cf4-4e1169adec4c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-xplld" machine # [ 52.126901] k3s[875]: I0928 09:48:46.070304 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/af9d93bb-da5f-4fd2-9cf4-4e1169adec4c-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-xplld\" (UID: \"af9d93bb-da5f-4fd2-9cf4-4e1169adec4c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-xplld" machine # [ 52.127650] k3s[875]: I0928 09:48:46.070360 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/730d64de-7d25-4a24-817d-690e9510e92d-tls-lb\") pod \"nix-grpc-farm-lb-5877cc8b4f-fqf48\" (UID: \"730d64de-7d25-4a24-817d-690e9510e92d\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-fqf48" machine # [ 52.128443] k3s[875]: I0928 09:48:46.070493 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/af9d93bb-da5f-4fd2-9cf4-4e1169adec4c-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-xplld\" (UID: \"af9d93bb-da5f-4fd2-9cf4-4e1169adec4c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-xplld" machine # [ 52.129054] k3s[875]: I0928 09:48:46.070536 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/730d64de-7d25-4a24-817d-690e9510e92d-config\") pod \"nix-grpc-farm-lb-5877cc8b4f-fqf48\" (UID: \"730d64de-7d25-4a24-817d-690e9510e92d\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-fqf48" machine # [ 52.445296] cni0: port 3(veth038b800a) entered blocking state machine # [ 52.446242] cni0: port 3(veth038b800a) entered disabled state machine # [ 52.447025] veth038b800a: entered allmulticast mode machine # [ 52.447770] veth038b800a: entered promiscuous mode machine # [ 52.296317] (udev-worker)[2201]: Network interface NamePolicy= disabled on kernel command line. machine # [ 52.457611] cni0: port 3(veth038b800a) entered blocking state machine # [ 52.458356] cni0: port 3(veth038b800a) entered forwarding state machine # [ 52.326054] dhcpcd[684]: veth038b800a: IAID a9:5c:a9:d3 machine # [ 52.326748] dhcpcd[684]: veth038b800a: adding address fe80::548f:a9ff:fe5c:a9d3 machine # [ 52.488739] cni0: port 4(vethb363dd03) entered blocking state machine # [ 52.489494] cni0: port 4(vethb363dd03) entered disabled state machine # [ 52.490378] vethb363dd03: entered allmulticast mode machine # [ 52.491137] vethb363dd03: entered promiscuous mode machine # [ 52.504891] cni0: port 4(vethb363dd03) entered blocking state machine # [ 52.506182] cni0: port 4(vethb363dd03) entered forwarding state machine # [ 52.369623] dhcpcd[684]: vethb363dd03: IAID aa:81:a9:17 machine # [ 52.370244] dhcpcd[684]: vethb363dd03: adding address fe80::b037:aaff:fe81:a917 machine # [ 52.525336] cni0: port 5(vetha4fe5f3b) entered blocking state machine # [ 52.526674] cni0: port 5(vetha4fe5f3b) entered disabled state machine # [ 52.527551] vetha4fe5f3b: entered allmulticast mode machine # [ 52.528708] vetha4fe5f3b: entered promiscuous mode machine # [ 52.387385] (udev-worker)[2202]: Network interface NamePolicy= disabled on kernel command line. machine # [ 52.543836] cni0: port 5(vetha4fe5f3b) entered blocking state machine # [ 52.544837] cni0: port 5(vetha4fe5f3b) entered forwarding state machine # [ 52.546139] cni0: port 6(veth0818c567) entered blocking state machine # [ 52.548058] cni0: port 6(veth0818c567) entered disabled state machine # [ 52.549164] veth0818c567: entered allmulticast mode machine # [ 52.550354] veth0818c567: entered promiscuous mode machine # [ 52.563626] cni0: port 6(veth0818c567) entered blocking state machine # [ 52.564472] cni0: port 6(veth0818c567) entered forwarding state machine # [ 52.434915] dhcpcd[684]: vetha4fe5f3b: waiting for carrier machine # [ 52.446291] dhcpcd[684]: veth0818c567: IAID c6:1b:ed:77 machine # [ 52.447699] dhcpcd[684]: veth0818c567: adding address fe80::105c:c6ff:fe1b:ed77 machine # [ 52.449387] dhcpcd[684]: veth0818c567: carrier lost machine # [ 52.451401] systemd[1]: Started libcontainer container c2ee50da373093ff954b810bfa68accaf3a82bac01f0f67e8190977525284288. machine # [ 52.476227] dhcpcd[684]: veth0818c567: deleting address fe80::105c:c6ff:fe1b:ed77 machine # [ 52.477168] dhcpcd[684]: vetha4fe5f3b: carrier acquired machine # [ 52.483151] dhcpcd[684]: vetha4fe5f3b: IAID 6d:16:a7:cf machine # [ 52.483474] dhcpcd[684]: vetha4fe5f3b: adding address fe80::20f7:6dff:fe16:a7cf machine # [ 52.484049] dhcpcd[684]: veth0818c567: carrier acquired machine # [ 52.491076] dhcpcd[684]: veth0818c567: IAID c6:1b:ed:77 machine # [ 52.491208] dhcpcd[684]: veth0818c567: adding address fe80::105c:c6ff:fe1b:ed77 machine # [ 52.511939] systemd[1]: Started libcontainer container 3e8638c19e299a073f59d5f4493955f88ebab56ff7bed389c0764324cd4667dd. machine # [ 52.550235] dhcpcd[684]: vethb363dd03: soliciting a DHCP lease machine # [ 52.554853] systemd[1]: Started libcontainer container 25bca95f6132f1b70a2a685fb09a4ebac8bbf9162731b3b61519e0c53639cd6a. machine # [ 52.612341] systemd[1]: Started libcontainer container 9655c4fd73c2320ea078b34131c59a4bb7727c3470b74c19bddff6ad2aca8d8d. machine # [ 53.267123] dhcpcd[684]: veth75076c51: probing for an IPv4LL address machine # [ 53.374543] dhcpcd[684]: veth0818c567: soliciting a DHCP lease machine # [ 53.912645] systemd[1]: cri-containerd-721916e7f3328feda3df6b36f85e1f2427b47990d8602bdb710b958332f45400.scope: Deactivated successfully. machine # [ 53.971256] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-721916e7f3328feda3df6b36f85e1f2427b47990d8602bdb710b958332f45400-rootfs.mount: Deactivated successfully. machine # [ 53.979465] dhcpcd[684]: vetha4fe5f3b: soliciting an IPv6 router machine # [ 53.990405] systemd[1]: Started libcontainer container 16f05d808f441c43cab48dfe7048d0609f418932580ba0274da669861598ac68. machine # [ 53.992211] dhcpcd[684]: veth038b800a: soliciting an IPv6 router machine # [ 54.123737] k3s[875]: I0928 09:48:48.068372 875 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-5877cc8b4f-fqf48" podStartSLOduration=3.068347088 podStartE2EDuration="3.068347088s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-28 09:48:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-28 09:48:48.067443063 +0000 UTC m=+38.107952823" watchObservedRunningTime="2026-09-28 09:48:48.068347088 +0000 UTC m=+38.108856848" machine # [ 54.167202] dhcpcd[684]: veth038b800a: soliciting a DHCP lease machine # [ 54.204664] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-721916e7f3328feda3df6b36f85e1f2427b47990d8602bdb710b958332f45400-shm.mount: Deactivated successfully. machine # [ 54.395757] cni0: port 2(vethcb952f63) entered disabled state machine # [ 54.243694] dhcpcd[684]: vethcb952f63: carrier lost machine # [ 54.399234] vethcb952f63 (unregistering): left allmulticast mode machine # [ 54.400601] vethcb952f63 (unregistering): left promiscuous mode machine # [ 54.401847] cni0: port 2(vethcb952f63) entered disabled state machine # [ 54.274750] systemd[1]: run-netns-cni\x2d9b8635d3\x2de230\x2d9848\x2d1ce9\x2d3abeff2556af.mount: Deactivated successfully. machine # [ 54.287278] dhcpcd[684]: vethcb952f63: deleting address fe80::789a:3ff:fe1e:b2c1 machine # [ 54.331394] dhcpcd[684]: vethcb952f63: removing interface machine # [ 54.439146] dhcpcd[684]: vetha4fe5f3b: soliciting a DHCP lease machine # [ 54.445732] k3s[875]: I0928 09:48:48.390745 875 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a23ffa20-a145-4473-9a87-f51760e8806c-klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/a23ffa20-a145-4473-9a87-f51760e8806c-klipper-cache\") pod \"a23ffa20-a145-4473-9a87-f51760e8806c\" (UID: \"a23ffa20-a145-4473-9a87-f51760e8806c\") " machine # [ 54.446126] k3s[875]: I0928 09:48:48.390814 875 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a23ffa20-a145-4473-9a87-f51760e8806c-kube-api-access-wxmzj\" (UniqueName: \"kubernetes.io/projected/a23ffa20-a145-4473-9a87-f51760e8806c-kube-api-access-wxmzj\") pod \"a23ffa20-a145-4473-9a87-f51760e8806c\" (UID: \"a23ffa20-a145-4473-9a87-f51760e8806c\") " machine # [ 54.446880] k3s[875]: I0928 09:48:48.390853 875 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a23ffa20-a145-4473-9a87-f51760e8806c-content\" (UniqueName: \"kubernetes.io/configmap/a23ffa20-a145-4473-9a87-f51760e8806c-content\") pod \"a23ffa20-a145-4473-9a87-f51760e8806c\" (UID: \"a23ffa20-a145-4473-9a87-f51760e8806c\") " machine # [ 54.447629] k3s[875]: I0928 09:48:48.390885 875 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a23ffa20-a145-4473-9a87-f51760e8806c-tmp\" (UniqueName: \"kubernetes.io/empty-dir/a23ffa20-a145-4473-9a87-f51760e8806c-tmp\") pod \"a23ffa20-a145-4473-9a87-f51760e8806c\" (UID: \"a23ffa20-a145-4473-9a87-f51760e8806c\") " machine # [ 54.447807] k3s[875]: I0928 09:48:48.390914 875 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a23ffa20-a145-4473-9a87-f51760e8806c-klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/a23ffa20-a145-4473-9a87-f51760e8806c-klipper-config\") pod \"a23ffa20-a145-4473-9a87-f51760e8806c\" (UID: \"a23ffa20-a145-4473-9a87-f51760e8806c\") " machine # [ 54.448055] k3s[875]: I0928 09:48:48.390945 875 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a23ffa20-a145-4473-9a87-f51760e8806c-klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/a23ffa20-a145-4473-9a87-f51760e8806c-klipper-helm\") pod \"a23ffa20-a145-4473-9a87-f51760e8806c\" (UID: \"a23ffa20-a145-4473-9a87-f51760e8806c\") " machine # [ 54.448776] k3s[875]: I0928 09:48:48.390973 875 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a23ffa20-a145-4473-9a87-f51760e8806c-values\" (UniqueName: \"kubernetes.io/projected/a23ffa20-a145-4473-9a87-f51760e8806c-values\") pod \"a23ffa20-a145-4473-9a87-f51760e8806c\" (UID: \"a23ffa20-a145-4473-9a87-f51760e8806c\") " machine # [ 54.450140] k3s[875]: I0928 09:48:48.394442 875 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a23ffa20-a145-4473-9a87-f51760e8806c-content" pod "a23ffa20-a145-4473-9a87-f51760e8806c" (UID: "a23ffa20-a145-4473-9a87-f51760e8806c"). InnerVolumeSpecName "content". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 54.450988] systemd[1]: var-lib-kubelet-pods-a23ffa20\x2da145\x2d4473\x2d9a87\x2df51760e8806c-volumes-kubernetes.io\x7eprojected-values.mount: Deactivated successfully. machine # [ 54.453272] systemd[1]: var-lib-kubelet-pods-a23ffa20\x2da145\x2d4473\x2d9a87\x2df51760e8806c-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dhelm.mount: Deactivated successfully. machine # [ 54.455802] systemd[1]: var-lib-kubelet-pods-a23ffa20\x2da145\x2d4473\x2d9a87\x2df51760e8806c-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dcache.mount: Deactivated successfully. machine # [ 54.490407] k3s[875]: I0928 09:48:48.435271 875 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a23ffa20-a145-4473-9a87-f51760e8806c-klipper-helm" pod "a23ffa20-a145-4473-9a87-f51760e8806c" (UID: "a23ffa20-a145-4473-9a87-f51760e8806c"). InnerVolumeSpecName "klipper-helm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 54.490799] k3s[875]: I0928 09:48:48.435434 875 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a23ffa20-a145-4473-9a87-f51760e8806c-values" pod "a23ffa20-a145-4473-9a87-f51760e8806c" (UID: "a23ffa20-a145-4473-9a87-f51760e8806c"). InnerVolumeSpecName "values". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 54.491535] k3s[875]: I0928 09:48:48.435595 875 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a23ffa20-a145-4473-9a87-f51760e8806c-klipper-config" pod "a23ffa20-a145-4473-9a87-f51760e8806c" (UID: "a23ffa20-a145-4473-9a87-f51760e8806c"). InnerVolumeSpecName "klipper-config". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 54.493143] k3s[875]: I0928 09:48:48.438165 875 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a23ffa20-a145-4473-9a87-f51760e8806c-tmp" pod "a23ffa20-a145-4473-9a87-f51760e8806c" (UID: "a23ffa20-a145-4473-9a87-f51760e8806c"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 54.494025] k3s[875]: I0928 09:48:48.438399 875 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a23ffa20-a145-4473-9a87-f51760e8806c-klipper-cache" pod "a23ffa20-a145-4473-9a87-f51760e8806c" (UID: "a23ffa20-a145-4473-9a87-f51760e8806c"). InnerVolumeSpecName "klipper-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 54.514606] k3s[875]: I0928 09:48:48.459605 875 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a23ffa20-a145-4473-9a87-f51760e8806c-kube-api-access-wxmzj" pod "a23ffa20-a145-4473-9a87-f51760e8806c" (UID: "a23ffa20-a145-4473-9a87-f51760e8806c"). InnerVolumeSpecName "kube-api-access-wxmzj". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 54.539443] dhcpcd[684]: veth0818c567: soliciting an IPv6 router machine # [ 54.547157] k3s[875]: I0928 09:48:48.492140 875 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxmzj\" (UniqueName: \"kubernetes.io/projected/a23ffa20-a145-4473-9a87-f51760e8806c-kube-api-access-wxmzj\") on node \"machine\" DevicePath \"\"" machine # [ 54.547772] k3s[875]: I0928 09:48:48.492184 875 reconciler_common.go:299] "Volume detached for volume \"content\" (UniqueName: \"kubernetes.io/configmap/a23ffa20-a145-4473-9a87-f51760e8806c-content\") on node \"machine\" DevicePath \"\"" machine # [ 54.548903] k3s[875]: I0928 09:48:48.492199 875 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a23ffa20-a145-4473-9a87-f51760e8806c-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 54.549876] k3s[875]: I0928 09:48:48.492216 875 reconciler_common.go:299] "Volume detached for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/a23ffa20-a145-4473-9a87-f51760e8806c-klipper-config\") on node \"machine\" DevicePath \"\"" machine # [ 54.550481] k3s[875]: I0928 09:48:48.492228 875 reconciler_common.go:299] "Volume detached for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/a23ffa20-a145-4473-9a87-f51760e8806c-klipper-helm\") on node \"machine\" DevicePath \"\"" machine # [ 54.551166] k3s[875]: I0928 09:48:48.492241 875 reconciler_common.go:299] "Volume detached for volume \"values\" (UniqueName: \"kubernetes.io/projected/a23ffa20-a145-4473-9a87-f51760e8806c-values\") on node \"machine\" DevicePath \"\"" machine # [ 54.551752] k3s[875]: I0928 09:48:48.492255 875 reconciler_common.go:299] "Volume detached for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/a23ffa20-a145-4473-9a87-f51760e8806c-klipper-cache\") on node \"machine\" DevicePath \"\"" machine # [ 54.661995] dhcpcd[684]: vethb363dd03: soliciting an IPv6 router machine # [ 54.890259] k3s[875]: I0928 09:48:48.834297 875 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="721916e7f3328feda3df6b36f85e1f2427b47990d8602bdb710b958332f45400" machine # [ 54.899201] systemd[1]: Removed slice libcontainer container kubepods-burstable-poda23ffa20_a145_4473_9a87_f51760e8806c.slice. machine # [ 54.899460] systemd[1]: kubepods-burstable-poda23ffa20_a145_4473_9a87_f51760e8806c.slice: Consumed 688ms CPU time over 19.892s wall clock time, 35.3M memory peak, 2.6M incoming IP traffic, 152.1K outgoing IP traffic. machine # [ 55.204738] systemd[1]: var-lib-kubelet-pods-a23ffa20\x2da145\x2d4473\x2d9a87\x2df51760e8806c-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dwxmzj.mount: Deactivated successfully. machine # [ 55.205029] systemd[1]: var-lib-kubelet-pods-a23ffa20\x2da145\x2d4473\x2d9a87\x2df51760e8806c-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dconfig.mount: Deactivated successfully. machine # [ 55.205577] systemd[1]: var-lib-kubelet-pods-a23ffa20\x2da145\x2d4473\x2d9a87\x2df51760e8806c-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 57.551923] dhcpcd[684]: vethb363dd03: probing for an IPv4LL address machine # [ 58.064681] dhcpcd[684]: veth75076c51: using IPv4LL address 169.254.171.78 machine # [ 58.067601] dhcpcd[684]: veth75076c51: adding route to 169.254.0.0/16 machine # [ 58.375826] dhcpcd[684]: veth0818c567: probing for an IPv4LL address machine # [ 58.440794] systemd[1]: Started libcontainer container c625c1ad3101325d13e4b330dd46551874adb243320303136607b870966a11f4. machine # [ 58.538376] systemd[1]: tmp-ovl\x2didmapped3461109612.mount: Deactivated successfully. machine # [ 58.562316] systemd[1]: Started libcontainer container ffa96e5eb83dd52364a24099e04f36563905ff852accd8395dec3cba79376aad. machine # [ 58.636949] systemd[1]: Started libcontainer container 4116931ad4b2433b09e381ba60113524dd668d6289cfdc6d148bfadce9060662. machine # [ 58.639272] k3s[875]: I0928 09:48:52.583520 875 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-scheduler-55cccf6d96-8j72r" podStartSLOduration=7.583498874 podStartE2EDuration="7.583498874s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-28 09:48:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-28 09:48:52.45852936 +0000 UTC m=+42.499039120" watchObservedRunningTime="2026-09-28 09:48:52.583498874 +0000 UTC m=+42.624008913" machine # [ 58.761920] niks3-server[1109]: 2026/09/28 09:48:52 INFO lead: acquired remote=10.42.0.6:41102 machine # [ 59.168849] dhcpcd[684]: veth038b800a: probing for an IPv4LL address machine # [ 59.410092] systemd[1]: tmp-ovl\x2didmapped2371938314.mount: Deactivated successfully. machine # [ 59.440088] dhcpcd[684]: vetha4fe5f3b: probing for an IPv4LL address machine # [ 60.744570] systemd[1]: cri-containerd-ffa96e5eb83dd52364a24099e04f36563905ff852accd8395dec3cba79376aad.scope: Deactivated successfully. machine # [ 60.747556] systemd[1]: cri-containerd-ffa96e5eb83dd52364a24099e04f36563905ff852accd8395dec3cba79376aad.scope: Consumed 903ms CPU time over 2.183s wall clock time, 373.6M memory peak, 121.6M read from disk, 260.1M written to disk. machine # [ 60.749956] systemd[1]: cri-containerd-4116931ad4b2433b09e381ba60113524dd668d6289cfdc6d148bfadce9060662.scope: Deactivated successfully. machine # [ 60.751331] systemd[1]: cri-containerd-4116931ad4b2433b09e381ba60113524dd668d6289cfdc6d148bfadce9060662.scope: Consumed 911ms CPU time over 2.113s wall clock time, 366M memory peak, 54.7M read from disk, 269.2M written to disk. machine # [ 60.795703] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-ffa96e5eb83dd52364a24099e04f36563905ff852accd8395dec3cba79376aad-rootfs.mount: Deactivated successfully. machine # [ 60.812515] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-4116931ad4b2433b09e381ba60113524dd668d6289cfdc6d148bfadce9060662-rootfs.mount: Deactivated successfully. machine # [ 61.085418] dhcpcd[684]: veth75076c51: no IPv6 Routers available machine # [ 61.098331] systemd[1]: Started libcontainer container 19bb5012b4cbdfaf7dd8a1fc963dd24d4194f0f16344252853d7d80c6b5e8e8b. machine # [ 61.160583] systemd[1]: Started libcontainer container c20bef1b55f0fe4a24e2347e5470acc106bfe3488d0fd32142dc674cdbc05b83. machine # [ 61.330354] systemd[1]: Started libcontainer container c3ce0f236fc04c137da0643ffffcb529b841d8353e3776f62dd151b903be3956. machine # [ 61.333323] systemd[1]: Started libcontainer container 57b8c08c4f4b772d57e386639acc0128e9ec970607a87d6e368a5af693d6ae07. machine # [ 61.524510] systemd[1]: Started libcontainer container cced0fc2db87d5663bec1227639deb637f1c7bc9304582b3c68551dfda1378e4. machine # [ 61.548328] systemd[1]: Started libcontainer container 6761f1f670e7142c729f68d9317d7876356f7b739348920be627791858e5a671. machine # [ 61.613188] k3s[875]: I0928 09:48:55.557816 875 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-xplld" podStartSLOduration=8.505074381 podStartE2EDuration="10.557795607s" totalImagesPullingTime="0s" totalInitContainerRuntime="2.052721226s" isStatefulPod=false podCreationTimestamp="2026-09-28 09:48:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-28 09:48:55.556899683 +0000 UTC m=+45.597409443" watchObservedRunningTime="2026-09-28 09:48:55.557795607 +0000 UTC m=+45.598305367" machine # [ 61.624068] k3s[875]: I0928 09:48:55.568498 875 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-l9tvg" podStartSLOduration=8.423121228 podStartE2EDuration="10.56848244s" totalImagesPullingTime="0s" totalInitContainerRuntime="2.145361212s" isStatefulPod=false podCreationTimestamp="2026-09-28 09:48:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-28 09:48:55.568481881 +0000 UTC m=+45.608992200" watchObservedRunningTime="2026-09-28 09:48:55.56848244 +0000 UTC m=+45.608992200" machine # [ 61.804503] systemd[1]: tmp-ovl\x2didmapped1399875764.mount: Deactivated successfully. machine # [ 62.352395] dhcpcd[684]: vethb363dd03: using IPv4LL address 169.254.70.35 machine # [ 62.352861] dhcpcd[684]: vethb363dd03: adding route to 169.254.0.0/16 machine # error: timed out waiting for the condition machine # [ 63.479565] dhcpcd[684]: veth0818c567: using IPv4LL address 169.254.90.161 machine # [ 63.480545] dhcpcd[684]: veth0818c567: adding route to 169.254.0.0/16 machine # [ 64.552944] dhcpcd[684]: veth038b800a: using IPv4LL address 169.254.156.4 machine # [ 64.554290] dhcpcd[684]: veth038b800a: adding route to 169.254.0.0/16 machine # [ 64.770921] dhcpcd[684]: vetha4fe5f3b: using IPv4LL address 169.254.224.163 machine # [ 64.773643] dhcpcd[684]: vetha4fe5f3b: adding route to 169.254.0.0/16 machine # [ 65.982969] dhcpcd[684]: vetha4fe5f3b: no IPv6 Routers available machine # [ 65.994581] dhcpcd[684]: veth038b800a: no IPv6 Routers available machine # [ 66.542674] dhcpcd[684]: veth0818c567: no IPv6 Routers available machine # [ 66.664426] dhcpcd[684]: vethb363dd03: no IPv6 Routers available machine # error: timed out waiting for the condition machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 46.68 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s, in 0.16 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s, in 0.15 seconds) machine: waiting for unit niks3.service machine: (finished: waiting for unit niks3.service, in 0.03 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.19 seconds) machine: waiting for success: test $(curl -sf 10.42.0.7:9901/clusters | grep -c 'health_flags::healthy') -ge 3 machine: (finished: waiting for success: test $(curl -sf 10.42.0.7:9901/clusters | grep -c 'health_flags::healthy') -ge 3, in 0.07 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.17 seconds) machine: waiting for success: curl -sf http://10.42.0.6:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2' machine: (finished: waiting for success: curl -sf http://10.42.0.6:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2', in 0.04 seconds) (finished: subtest: chart deploys and workers become Ready, in 47.49 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}', in 0.17 seconds) machine: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt machine: (finished: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt, in 0.14 seconds) subtest: build through the balancer lands in the cache machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1 machine # [ 110.156314] niks3-server[1109]: 2026/09/28 09:49:44 INFO Received push request method=POST path=/api/pushes machine # [ 110.198686] niks3-server[1109]: 2026/09/28 09:49:44 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign machine # [ 110.204775] niks3-server[1109]: 2026/09/28 09:49:44 INFO Signed narinfos id=1 count=1 machine # [ 110.212978] niks3-server[1109]: 2026/09/28 09:49:44 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.ls machine # [ 110.215229] niks3-server[1109]: 2026/09/28 09:49:44 INFO Registered completed upload object_key=nar/0nzzbas7l8d37mridr7mg162smfjvn7lhs6am4crl4ydaxicigj8.nar.zst machine # [ 110.217862] niks3-server[1109]: 2026/09/28 09:49:44 INFO Received complete push request method=POST path=/api/pushes/1/complete machine # [ 110.225875] niks3-server[1109]: 2026/09/28 09:49:44 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.narinfo machine # [ 135.138546] niks3-server[1109]: 2026/09/28 09:50:09 INFO Received push request method=POST path=/api/pushes machine # [ 135.162322] niks3-server[1109]: 2026/09/28 09:50:09 INFO Registered completed upload object_key=log/yz1sqzb72i8v6h2ass0v76ba8cncqj9r-k3s-a.drv machine # [ 135.163193] niks3-server[1109]: 2026/09/28 09:50:09 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign machine # [ 135.164326] niks3-server[1109]: 2026/09/28 09:50:09 INFO Signed narinfos id=2 count=1 machine # [ 135.176114] niks3-server[1109]: 2026/09/28 09:50:09 INFO Registered completed upload object_key=nar/1p7jh5nyz9n68k5f18ymmdpgr34mpnnch1njw7ki7b2b97qlfbjk.nar.zst machine # [ 135.181368] niks3-server[1109]: 2026/09/28 09:50:09 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.ls machine # [ 135.185090] niks3-server[1109]: 2026/09/28 09:50:09 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.narinfo machine # [ 135.188922] niks3-server[1109]: 2026/09/28 09:50:09 INFO Received complete push request method=POST path=/api/pushes/2/complete machine # [ 135.260229] niks3-server[1109]: 2026/09/28 09:50:09 INFO Received push request method=POST path=/api/pushes machine # [ 135.269390] niks3-server[1109]: 2026/09/28 09:50:09 INFO Received sign narinfos request method=POST path=/api/pushes/3/sign machine # [ 135.270191] niks3-server[1109]: 2026/09/28 09:50:09 INFO Signed narinfos id=3 count=1 machine # [ 135.273457] niks3-server[1109]: 2026/09/28 09:50:09 INFO Registered completed upload object_key=nar/03a4ywhyr5knmbc93z4gyml5y8fvgb431xvlmfxrwsm8mrb0qgx2.nar.zst machine # [ 135.275800] niks3-server[1109]: 2026/09/28 09:50:09 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.ls machine # [ 135.278277] niks3-server[1109]: 2026/09/28 09:50:09 INFO Received complete push request method=POST path=/api/pushes/3/complete machine # [ 135.281277] niks3-server[1109]: 2026/09/28 09:50:09 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.narinfo machine # [ 160.000723] niks3-server[1109]: 2026/09/28 09:50:33 INFO Received push request method=POST path=/api/pushes machine # [ 160.024291] niks3-server[1109]: 2026/09/28 09:50:33 INFO Received sign narinfos request method=POST path=/api/pushes/4/sign machine # [ 160.025331] niks3-server[1109]: 2026/09/28 09:50:33 INFO Signed narinfos id=4 count=1 machine # [ 160.027381] niks3-server[1109]: 2026/09/28 09:50:33 INFO Registered completed upload object_key=nar/05qjsj5ff3a6vnxkhb6k5f3m446dcc206p7cd37w4v3mgi95d7kh.nar.zst machine # [ 160.037816] niks3-server[1109]: 2026/09/28 09:50:33 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.ls machine # [ 160.039271] niks3-server[1109]: 2026/09/28 09:50:33 INFO Registered completed upload object_key=log/zfq1xw9bmycqh35l0s44lmv65z4xc7br-k3s-b.drv machine # [ 160.047048] niks3-server[1109]: 2026/09/28 09:50:33 INFO Received complete push request method=POST path=/api/pushes/4/complete machine # [ 160.121774] niks3-server[1109]: 2026/09/28 09:50:34 INFO Received push request method=POST path=/api/pushes machine # [ 160.132707] niks3-server[1109]: 2026/09/28 09:50:34 INFO Received sign narinfos request method=POST path=/api/pushes/5/sign machine # [ 160.133603] niks3-server[1109]: 2026/09/28 09:50:34 INFO Signed narinfos id=5 count=1 machine # [ 160.136168] niks3-server[1109]: 2026/09/28 09:50:34 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.ls machine # [ 160.141628] niks3-server[1109]: 2026/09/28 09:50:34 INFO Registered completed upload object_key=nar/0jyw88klkf3nwxpnj5m5lx3i1dv2idf3hcn6im7883hnldm3gvyq.nar.zst machine # [ 160.144199] niks3-server[1109]: 2026/09/28 09:50:34 INFO Received complete push request method=POST path=/api/pushes/5/complete machine # [ 160.148912] niks3-server[1109]: 2026/09/28 09:50:34 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.narinfo machine # [ 184.869205] niks3-server[1109]: 2026/09/28 09:50:58 INFO Received push request method=POST path=/api/pushes machine # [ 184.888637] niks3-server[1109]: 2026/09/28 09:50:58 INFO Received sign narinfos request method=POST path=/api/pushes/6/sign machine # [ 184.890124] niks3-server[1109]: 2026/09/28 09:50:58 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.ls machine # [ 184.892363] niks3-server[1109]: 2026/09/28 09:50:58 INFO Signed narinfos id=6 count=1 machine # [ 184.893804] niks3-server[1109]: 2026/09/28 09:50:58 INFO Registered completed upload object_key=nar/1q8vp5xqws560mpf8rxk8r8jhqrzibivh13x4wxy0cfqlzbk7cr5.nar.zst machine # [ 184.907365] niks3-server[1109]: 2026/09/28 09:50:58 INFO Registered completed upload object_key=log/n40czam6a4ldp1mh5fdmlcy07fv0akbm-k3s-top.drv machine # [ 184.910232] niks3-server[1109]: 2026/09/28 09:50:58 INFO Received complete push request method=POST path=/api/pushes/6/complete machine # [ 184.916259] niks3-server[1109]: 2026/09/28 09:50:58 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1, in 108.87 seconds) machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath, in 0.17 seconds) machine: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine: (finished: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.02 seconds) machine: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine # copying 3 paths... machine # copying path '/nix/store/r95r891injj9ski5c4w89yxjvjy065mx-k3s-a' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/mrqsh0475wxsmnsvkk55g94v6g5nrcra-k3s-b' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top' from 'http://192.168.1.1:5751'... machine: (finished: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.20 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1 machine # [ 214.833895] niks3-server[1109]: 2026/09/28 09:51:28 INFO Received push request method=POST path=/api/pushes machine # [ 214.860645] niks3-server[1109]: 2026/09/28 09:51:28 INFO Received sign narinfos request method=POST path=/api/pushes/7/sign machine # [ 214.861439] niks3-server[1109]: 2026/09/28 09:51:28 INFO Signed narinfos id=7 count=1 machine # [ 214.863251] niks3-server[1109]: 2026/09/28 09:51:28 INFO Registered completed upload object_key=nar/1fr26arhri17j9bj6hyjzmmd74v730biz1gb3kqd194vjx3ccvp9.nar.zst machine # [ 214.874404] niks3-server[1109]: 2026/09/28 09:51:28 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.ls machine # [ 214.874558] niks3-server[1109]: 2026/09/28 09:51:28 INFO Received complete push request method=POST path=/api/pushes/7/complete machine # [ 214.882459] niks3-server[1109]: 2026/09/28 09:51:28 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.narinfo machine # [ 239.810316] niks3-server[1109]: 2026/09/28 09:51:53 INFO Received push request method=POST path=/api/pushes machine # [ 239.833859] niks3-server[1109]: 2026/09/28 09:51:53 INFO Received sign narinfos request method=POST path=/api/pushes/8/sign machine # [ 239.834784] niks3-server[1109]: 2026/09/28 09:51:53 INFO Signed narinfos id=8 count=1 machine # [ 239.840136] niks3-server[1109]: 2026/09/28 09:51:53 INFO Registered completed upload object_key=nar/1hfc6x4x25k3b0fk091d3nb0k3mympfp05fkslcx19synp3ig0zd.nar.zst machine # [ 239.846062] niks3-server[1109]: 2026/09/28 09:51:53 INFO Registered completed upload object_key=log/pbpqsh50ar10fpasdqqx8xg3lmr5j8iz-k3s-a.drv machine # [ 239.849300] niks3-server[1109]: 2026/09/28 09:51:53 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.ls machine # [ 239.857172] niks3-server[1109]: 2026/09/28 09:51:53 INFO Received complete push request method=POST path=/api/pushes/8/complete machine # [ 239.861774] niks3-server[1109]: 2026/09/28 09:51:53 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.narinfo machine # [ 239.929273] niks3-server[1109]: 2026/09/28 09:51:53 INFO Received push request method=POST path=/api/pushes machine # [ 239.943381] niks3-server[1109]: 2026/09/28 09:51:53 INFO Received sign narinfos request method=POST path=/api/pushes/9/sign machine # [ 239.945368] niks3-server[1109]: 2026/09/28 09:51:53 INFO Signed narinfos id=9 count=1 machine # [ 239.946770] niks3-server[1109]: 2026/09/28 09:51:53 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.ls machine # [ 239.948235] niks3-server[1109]: 2026/09/28 09:51:53 INFO Registered completed upload object_key=nar/0zzq2vgjln4shvh57091n14sam6wh6w06vja6lzb9ppcj4ffyx1n.nar.zst machine # [ 239.954818] niks3-server[1109]: 2026/09/28 09:51:53 INFO Received complete push request method=POST path=/api/pushes/9/complete machine # [ 239.960368] niks3-server[1109]: 2026/09/28 09:51:53 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.narinfo machine # [ 264.883480] niks3-server[1109]: 2026/09/28 09:52:18 INFO Received push request method=POST path=/api/pushes machine # [ 264.906548] niks3-server[1109]: 2026/09/28 09:52:18 INFO Received sign narinfos request method=POST path=/api/pushes/10/sign machine # [ 264.907905] niks3-server[1109]: 2026/09/28 09:52:18 INFO Registered completed upload object_key=nar/0hh3nqk95r6g32lhdmxw8cxjv694vbpx9876zkhcpg4r4qxni2ch.nar.zst machine # [ 264.909158] niks3-server[1109]: 2026/09/28 09:52:18 INFO Signed narinfos id=10 count=1 machine # [ 264.910634] niks3-server[1109]: 2026/09/28 09:52:18 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.ls machine # [ 264.916655] niks3-server[1109]: 2026/09/28 09:52:18 INFO Registered completed upload object_key=log/894h6wzw2l4w5f0hikj1k6q57jfnyi87-k3s-b.drv machine # [ 264.921921] niks3-server[1109]: 2026/09/28 09:52:18 INFO Received complete push request method=POST path=/api/pushes/10/complete machine # [ 264.928678] niks3-server[1109]: 2026/09/28 09:52:18 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.narinfo machine # [ 265.003199] niks3-server[1109]: 2026/09/28 09:52:18 INFO Received push request method=POST path=/api/pushes machine # [ 265.014547] niks3-server[1109]: 2026/09/28 09:52:18 INFO Received sign narinfos request method=POST path=/api/pushes/11/sign machine # [ 265.016416] niks3-server[1109]: 2026/09/28 09:52:18 INFO Signed narinfos id=11 count=1 machine # [ 265.018951] niks3-server[1109]: 2026/09/28 09:52:18 INFO Registered completed upload object_key=nar/0ingamx56k31lwiyxmnxmscjj4n3qfx6sr2kpaynsrwhwz1278iw.nar.zst machine # [ 265.021351] niks3-server[1109]: 2026/09/28 09:52:18 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.ls machine # [ 265.023181] niks3-server[1109]: 2026/09/28 09:52:18 INFO Received complete push request method=POST path=/api/pushes/11/complete machine # [ 265.025897] niks3-server[1109]: 2026/09/28 09:52:18 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.narinfo machine # [ 290.348750] niks3-server[1109]: 2026/09/28 09:52:44 INFO Received push request method=POST path=/api/pushes machine # [ 290.367167] niks3-server[1109]: 2026/09/28 09:52:44 INFO Received sign narinfos request method=POST path=/api/pushes/12/sign machine # [ 290.373543] niks3-server[1109]: 2026/09/28 09:52:44 INFO Signed narinfos id=12 count=1 machine # [ 290.376129] niks3-server[1109]: 2026/09/28 09:52:44 INFO Registered completed upload object_key=nar/0v48x4sp58bvfra08axgkz7yl1n9nc4nirskyv1hwann4i7q277i.nar.zst machine # [ 290.380117] niks3-server[1109]: 2026/09/28 09:52:44 INFO Registered completed upload object_key=log/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g-k3s-top.drv machine # [ 290.383880] niks3-server[1109]: 2026/09/28 09:52:44 INFO Received complete push request method=POST path=/api/pushes/12/complete machine # [ 290.387572] niks3-server[1109]: 2026/09/28 09:52:44 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.ls machine # [ 290.390021] niks3-server[1109]: 2026/09/28 09:52:44 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1, in 104.06 seconds) (finished: subtest: build through the balancer lands in the cache, in 213.32 seconds) subtest: a Job with the client image builds through the farm with its service account machine: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine: (finished: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.14 seconds) machine: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix machine: (finished: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix, in 0.14 seconds) machine: must succeed: kubectl apply -f /nix/store/4qg21n7g16x8lyv0fhhdx9dx3lxqkcdn-ci-job.json machine: (finished: must succeed: kubectl apply -f /nix/store/4qg21n7g16x8lyv0fhhdx9dx3lxqkcdn-ci-job.json, in 0.17 seconds) machine: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed' machine # [ 291.109251] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod27c4e565_4738_4a50_991c_1849e7c41873.slice. machine # [ 291.208427] k3s[875]: I0928 09:52:45.153045 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2xj8\" (UniqueName: \"kubernetes.io/projected/27c4e565-4738-4a50-991c-1849e7c41873-kube-api-access-s2xj8\") pod \"ci-692jf\" (UID: \"27c4e565-4738-4a50-991c-1849e7c41873\") " pod="ci/ci-692jf" machine # [ 291.208703] k3s[875]: I0928 09:52:45.153129 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"job\" (UniqueName: \"kubernetes.io/configmap/27c4e565-4738-4a50-991c-1849e7c41873-job\") pod \"ci-692jf\" (UID: \"27c4e565-4738-4a50-991c-1849e7c41873\") " pod="ci/ci-692jf" machine # [ 291.209946] k3s[875]: I0928 09:52:45.153345 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/27c4e565-4738-4a50-991c-1849e7c41873-nix-grpc-farm\") pod \"ci-692jf\" (UID: \"27c4e565-4738-4a50-991c-1849e7c41873\") " pod="ci/ci-692jf" machine # [ 291.611915] cni0: port 2(vethc20c2329) entered blocking state machine # [ 291.613975] cni0: port 2(vethc20c2329) entered disabled state machine # [ 291.616377] vethc20c2329: entered allmulticast mode machine # [ 291.618707] vethc20c2329: entered promiscuous mode machine # [ 291.635044] cni0: port 2(vethc20c2329) entered blocking state machine # [ 291.636652] cni0: port 2(vethc20c2329) entered forwarding state machine # [ 291.525051] (udev-worker)[5233]: Network interface NamePolicy= disabled on kernel command line. machine # [ 291.553030] dhcpcd[684]: vethc20c2329: IAID 19:a5:71:9b machine # [ 291.553394] dhcpcd[684]: vethc20c2329: adding address fe80::68c8:19ff:fea5:719b machine # [ 291.586447] systemd[1]: Started libcontainer container 28ec87796a4b1841818d0ff18d77f410e40d1157867aca982a778ee5a464fe9f. machine # [ 293.449442] dhcpcd[684]: vethc20c2329: soliciting a DHCP lease machine # [ 293.545661] dhcpcd[684]: vethc20c2329: soliciting an IPv6 router machine # [ 293.704172] systemd[1]: Started libcontainer container 3c210cd3bd08b519a693451e683ccdf2a8ebe019735a142c8988b80d57cd7171. machine # [ 293.784372] k3s[875]: I0928 09:52:47.728646 875 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ci/ci-692jf" podStartSLOduration=2.728608351 podStartE2EDuration="2.728608351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-28 09:52:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-28 09:52:47.727403729 +0000 UTC m=+277.767913489" watchObservedRunningTime="2026-09-28 09:52:47.728608351 +0000 UTC m=+277.769118670" machine # [ 295.121765] niks3-server[1109]: 2026/09/28 09:52:49 INFO Received push request method=POST path=/api/pushes machine # [ 295.138611] niks3-server[1109]: 2026/09/28 09:52:49 INFO Received sign narinfos request method=POST path=/api/pushes/13/sign machine # [ 295.142931] niks3-server[1109]: 2026/09/28 09:52:49 INFO Signed narinfos id=13 count=1 machine # [ 295.146167] niks3-server[1109]: 2026/09/28 09:52:49 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.ls machine # [ 295.150289] niks3-server[1109]: 2026/09/28 09:52:49 INFO Registered completed upload object_key=nar/111g6dyibwcf2z7jhpn72rgja0qvjgpdiv9nc06g2dp7ih0a6kyq.nar.zst machine # [ 295.155383] niks3-server[1109]: 2026/09/28 09:52:49 INFO Received complete push request method=POST path=/api/pushes/13/complete machine # [ 295.158910] niks3-server[1109]: 2026/09/28 09:52:49 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.narinfo machine # [ 298.450898] dhcpcd[684]: vethc20c2329: probing for an IPv4LL address machine # [ 302.912619] dhcpcd[684]: vethc20c2329: using IPv4LL address 169.254.46.121 machine # [ 302.913581] dhcpcd[684]: vethc20c2329: adding route to 169.254.0.0/16 machine # [ 305.550398] dhcpcd[684]: vethc20c2329: no IPv6 Routers available machine # [ 309.953834] postgres[762]: [762] LOG: checkpoint starting: time machine # [ 319.673739] niks3-server[1109]: 2026/09/28 09:53:13 INFO Received push request method=POST path=/api/pushes machine # [ 319.697364] niks3-server[1109]: 2026/09/28 09:53:13 INFO Received sign narinfos request method=POST path=/api/pushes/14/sign machine # [ 319.698610] niks3-server[1109]: 2026/09/28 09:53:13 INFO Signed narinfos id=14 count=1 machine # [ 319.701449] niks3-server[1109]: 2026/09/28 09:53:13 INFO Registered completed upload object_key=nar/058kjd2vfl1r27b4d9ixvwf77d8rkr18a4v894kwx8lg0nwpajnr.nar.zst machine # [ 319.703415] niks3-server[1109]: 2026/09/28 09:53:13 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.ls machine # [ 319.710344] niks3-server[1109]: 2026/09/28 09:53:13 INFO Received complete push request method=POST path=/api/pushes/14/complete machine # [ 319.719500] niks3-server[1109]: 2026/09/28 09:53:13 INFO Registered completed upload object_key=log/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # [ 319.779518] niks3-server[1109]: 2026/09/28 09:53:13 INFO Received push request method=POST path=/api/pushes machine # [ 319.793233] niks3-server[1109]: 2026/09/28 09:53:13 INFO Received sign narinfos request method=POST path=/api/pushes/15/sign machine # [ 319.797204] niks3-server[1109]: 2026/09/28 09:53:13 INFO Signed narinfos id=15 count=1 machine # [ 319.801411] niks3-server[1109]: 2026/09/28 09:53:13 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.ls machine # [ 319.803575] niks3-server[1109]: 2026/09/28 09:53:13 INFO Registered completed upload object_key=nar/138ynhcd5wxzz485x9qcq7xsargaklrf2li31ai69m5r46am35q6.nar.zst machine # [ 319.805173] niks3-server[1109]: 2026/09/28 09:53:13 INFO Received complete push request method=POST path=/api/pushes/15/complete machine # [ 344.328381] niks3-server[1109]: 2026/09/28 09:53:38 INFO Received push request method=POST path=/api/pushes machine # [ 344.358420] niks3-server[1109]: 2026/09/28 09:53:38 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.ls machine # [ 344.359724] niks3-server[1109]: 2026/09/28 09:53:38 INFO Received sign narinfos request method=POST path=/api/pushes/16/sign machine # [ 344.360139] niks3-server[1109]: 2026/09/28 09:53:38 INFO Registered completed upload object_key=nar/0n4lbdlp8w72fs3qbavl2lwrzbrn55i2b1vyglc89cc3pi8vbb1m.nar.zst machine # [ 344.363115] niks3-server[1109]: 2026/09/28 09:53:38 INFO Signed narinfos id=16 count=1 machine # [ 344.376717] niks3-server[1109]: 2026/09/28 09:53:38 INFO Registered completed upload object_key=log/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # [ 344.381076] niks3-server[1109]: 2026/09/28 09:53:38 INFO Received complete push request method=POST path=/api/pushes/16/complete machine # [ 344.385983] niks3-server[1109]: 2026/09/28 09:53:38 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo machine # [ 344.452595] niks3-server[1109]: 2026/09/28 09:53:38 INFO Received push request method=POST path=/api/pushes machine # [ 344.466878] niks3-server[1109]: 2026/09/28 09:53:38 INFO Received sign narinfos request method=POST path=/api/pushes/17/sign machine # [ 344.467376] niks3-server[1109]: 2026/09/28 09:53:38 INFO Signed narinfos id=17 count=1 machine # [ 344.472347] niks3-server[1109]: 2026/09/28 09:53:38 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.ls machine # [ 344.474113] niks3-server[1109]: 2026/09/28 09:53:38 INFO Received complete push request method=POST path=/api/pushes/17/complete machine # [ 344.477600] niks3-server[1109]: 2026/09/28 09:53:38 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.narinfo machine # [ 344.479374] niks3-server[1109]: 2026/09/28 09:53:38 INFO Registered completed upload object_key=nar/1f3gvnvqsm2pm3laixkxkg44kvjb251zqhszcfpp0a00h6x66ljs.nar.zst machine # [ 369.003431] niks3-server[1109]: 2026/09/28 09:54:02 INFO Received push request method=POST path=/api/pushes machine # [ 369.025831] niks3-server[1109]: 2026/09/28 09:54:02 INFO Received sign narinfos request method=POST path=/api/pushes/18/sign machine # [ 369.027403] niks3-server[1109]: 2026/09/28 09:54:02 INFO Signed narinfos id=18 count=1 machine # [ 369.032595] niks3-server[1109]: 2026/09/28 09:54:02 INFO Registered completed upload object_key=nar/1zwf0asrdv12q40fmqga5lx5330dvn9y4in4i9ficz9ij5lhvnf5.nar.zst machine # [ 369.036988] niks3-server[1109]: 2026/09/28 09:54:02 INFO Registered completed upload object_key=log/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # [ 369.040042] niks3-server[1109]: 2026/09/28 09:54:02 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.ls machine # [ 369.042564] niks3-server[1109]: 2026/09/28 09:54:02 INFO Received complete push request method=POST path=/api/pushes/18/complete machine # [ 369.048717] niks3-server[1109]: 2026/09/28 09:54:02 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo machine # [ 370.793919] niks3-server[1109]: 2026/09/28 09:54:04 INFO Received push request method=POST path=/api/pushes machine # [ 370.811681] niks3-server[1109]: 2026/09/28 09:54:04 INFO Received sign narinfos request method=POST path=/api/pushes/19/sign machine # [ 370.815436] niks3-server[1109]: 2026/09/28 09:54:04 INFO Signed narinfos id=19 count=1 machine # [ 370.819376] niks3-server[1109]: 2026/09/28 09:54:04 INFO Registered completed upload object_key=nar/0xiyqcsl8db7dnrq2gqnx5izavr51ma3dcdswrriaxfgj3qzk7xf.nar.zst machine # [ 370.821260] niks3-server[1109]: 2026/09/28 09:54:04 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.ls machine # [ 370.824337] niks3-server[1109]: 2026/09/28 09:54:04 INFO Received complete push request method=POST path=/api/pushes/19/complete machine # [ 370.829813] niks3-server[1109]: 2026/09/28 09:54:04 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.narinfo machine # [ 395.551465] niks3-server[1109]: 2026/09/28 09:54:29 INFO Received push request method=POST path=/api/pushes machine # [ 395.570492] niks3-server[1109]: 2026/09/28 09:54:29 INFO Received sign narinfos request method=POST path=/api/pushes/20/sign machine # [ 395.573160] niks3-server[1109]: 2026/09/28 09:54:29 INFO Signed narinfos id=20 count=1 machine # [ 395.575092] niks3-server[1109]: 2026/09/28 09:54:29 INFO Registered completed upload object_key=log/fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # [ 395.576845] niks3-server[1109]: 2026/09/28 09:54:29 INFO Registered completed upload object_key=nar/0p3l2z3riilylr2rxb1aq2blxdfxg55wbgp4gxkns93srbr4bwyq.nar.zst machine # [ 395.582291] niks3-server[1109]: 2026/09/28 09:54:29 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.ls machine # [ 395.589413] niks3-server[1109]: 2026/09/28 09:54:29 INFO Received complete push request method=POST path=/api/pushes/20/complete machine # [ 395.597572] niks3-server[1109]: 2026/09/28 09:54:29 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo machine # [ 395.733836] systemd[1]: cri-containerd-3c210cd3bd08b519a693451e683ccdf2a8ebe019735a142c8988b80d57cd7171.scope: Deactivated successfully. machine # [ 395.735058] systemd[1]: cri-containerd-3c210cd3bd08b519a693451e683ccdf2a8ebe019735a142c8988b80d57cd7171.scope: Consumed 1.057s CPU time over 1min 42.028s wall clock time, 114.9M memory peak, 45.9M read from disk, 428K written to disk, 18.2K incoming IP traffic, 44.8K outgoing IP traffic. machine # [ 395.782856] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-3c210cd3bd08b519a693451e683ccdf2a8ebe019735a142c8988b80d57cd7171-rootfs.mount: Deactivated successfully. machine # [ 397.417747] systemd[1]: cri-containerd-28ec87796a4b1841818d0ff18d77f410e40d1157867aca982a778ee5a464fe9f.scope: Deactivated successfully. machine # [ 397.486082] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-28ec87796a4b1841818d0ff18d77f410e40d1157867aca982a778ee5a464fe9f-rootfs.mount: Deactivated successfully. machine # [ 397.521501] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-28ec87796a4b1841818d0ff18d77f410e40d1157867aca982a778ee5a464fe9f-shm.mount: Deactivated successfully. machine # [ 397.712099] cni0: port 2(vethc20c2329) entered disabled state machine # [ 397.561550] dhcpcd[684]: vethc20c2329: carrier lost machine # [ 397.715915] vethc20c2329 (unregistering): left allmulticast mode machine # [ 397.718223] vethc20c2329 (unregistering): left promiscuous mode machine # [ 397.720525] cni0: port 2(vethc20c2329) entered disabled state machine # [ 397.587684] dhcpcd[684]: vethc20c2329: deleting address fe80::68c8:19ff:fea5:719b machine # [ 397.590799] systemd[1]: run-netns-cni\x2d75e27cf0\x2d521b\x2d04b0\x2dfbd4\x2d46f3e96651a3.mount: Deactivated successfully. machine # [ 397.592305] dhcpcd[684]: vethc20c2329: deleting route to 169.254.0.0/16 machine # [ 397.662813] dhcpcd[684]: vethc20c2329: removing interface machine # [ 397.763678] k3s[875]: I0928 09:54:31.708213 875 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/27c4e565-4738-4a50-991c-1849e7c41873-nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/27c4e565-4738-4a50-991c-1849e7c41873-nix-grpc-farm\") pod \"27c4e565-4738-4a50-991c-1849e7c41873\" (UID: \"27c4e565-4738-4a50-991c-1849e7c41873\") " machine # [ 397.763896] k3s[875]: I0928 09:54:31.708357 875 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/27c4e565-4738-4a50-991c-1849e7c41873-kube-api-access-s2xj8\" (UniqueName: \"kubernetes.io/projected/27c4e565-4738-4a50-991c-1849e7c41873-kube-api-access-s2xj8\") pod \"27c4e565-4738-4a50-991c-1849e7c41873\" (UID: \"27c4e565-4738-4a50-991c-1849e7c41873\") " machine # [ 397.764522] k3s[875]: I0928 09:54:31.708776 875 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/27c4e565-4738-4a50-991c-1849e7c41873-job\" (UniqueName: \"kubernetes.io/configmap/27c4e565-4738-4a50-991c-1849e7c41873-job\") pod \"27c4e565-4738-4a50-991c-1849e7c41873\" (UID: \"27c4e565-4738-4a50-991c-1849e7c41873\") " machine # [ 397.766960] k3s[875]: I0928 09:54:31.711954 875 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27c4e565-4738-4a50-991c-1849e7c41873-job" pod "27c4e565-4738-4a50-991c-1849e7c41873" (UID: "27c4e565-4738-4a50-991c-1849e7c41873"). InnerVolumeSpecName "job". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 397.768597] systemd[1]: var-lib-kubelet-pods-27c4e565\x2d4738\x2d4a50\x2d991c\x2d1849e7c41873-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2ds2xj8.mount: Deactivated successfully. machine # [ 397.770865] systemd[1]: var-lib-kubelet-pods-27c4e565\x2d4738\x2d4a50\x2d991c\x2d1849e7c41873-volumes-kubernetes.io\x7eprojected-nix\x2dgrpc\x2dfarm.mount: Deactivated successfully. machine # [ 397.784713] k3s[875]: I0928 09:54:31.729696 875 reconciler_common.go:299] "Volume detached for volume \"job\" (UniqueName: \"kubernetes.io/configmap/27c4e565-4738-4a50-991c-1849e7c41873-job\") on node \"machine\" DevicePath \"\"" machine # [ 397.787592] k3s[875]: I0928 09:54:31.732619 875 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27c4e565-4738-4a50-991c-1849e7c41873-nix-grpc-farm" pod "27c4e565-4738-4a50-991c-1849e7c41873" (UID: "27c4e565-4738-4a50-991c-1849e7c41873"). InnerVolumeSpecName "nix-grpc-farm". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 397.787727] k3s[875]: I0928 09:54:31.732678 875 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27c4e565-4738-4a50-991c-1849e7c41873-kube-api-access-s2xj8" pod "27c4e565-4738-4a50-991c-1849e7c41873" (UID: "27c4e565-4738-4a50-991c-1849e7c41873"). InnerVolumeSpecName "kube-api-access-s2xj8". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 397.885420] k3s[875]: I0928 09:54:31.830164 875 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2xj8\" (UniqueName: \"kubernetes.io/projected/27c4e565-4738-4a50-991c-1849e7c41873-kube-api-access-s2xj8\") on node \"machine\" DevicePath \"\"" machine # [ 397.885900] k3s[875]: I0928 09:54:31.830308 875 reconciler_common.go:299] "Volume detached for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/27c4e565-4738-4a50-991c-1849e7c41873-nix-grpc-farm\") on node \"machine\" DevicePath \"\"" machine # [ 398.401730] k3s[875]: I0928 09:54:32.346604 875 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="28ec87796a4b1841818d0ff18d77f410e40d1157867aca982a778ee5a464fe9f" machine # [ 398.418450] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod27c4e565_4738_4a50_991c_1849e7c41873.slice. machine # [ 398.419667] systemd[1]: kubepods-besteffort-pod27c4e565_4738_4a50_991c_1849e7c41873.slice: Consumed 1.087s CPU time over 1min 47.307s wall clock time, 115.1M memory peak, 45.9M read from disk, 632K written to disk, 18.2K incoming IP traffic, 44.8K outgoing IP traffic. machine: (finished: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed', in 108.52 seconds) machine: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1 machine: (finished: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1, in 0.18 seconds) machine # don't know how to build these paths: machine # /nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-a> machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-xplld: building fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-b> machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-xplld: building 1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-top> machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-xplld: building rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # INFO:nix_fast_build.processes:run nix-eval-jobs --gc-roots-dir /tmp/tmpyv7yflwh/gcroots --force-recurse --max-memory-size 4096 --workers 4 --flake '.#checks' --check-cache-status machine # INFO:nix_fast_build.workers:builds: 0 machine # warning: Git tree '/tmp' is dirty machine # warning: Git tree '/tmp' is dirty machine # ▶ x86_64-linux.t started machine # INFO:nix_fast_build.workers:builds: 2 machine # ✔ x86_64-linux.t (26s) machine # x86_64-linux.t> machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-l9tvg: building fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # warning: Git tree '/tmp' is dirty machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath, in 0.16 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null, in 0.05 seconds) (finished: subtest: a Job with the client image builds through the farm with its service account, in 109.64 seconds) subtest: a renewed balancer certificate is served without a rollout machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f - machine # Warning: resource secrets/farm-lb-tls is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically. machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f -, in 0.30 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}', in 0.73 seconds) machine: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-5877cc8b4f-fqf48 -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine # [ 401.369772] k3s[875]: E0928 09:54:35.314064 875 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39130: use of closed network connection" machine: (finished: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-5877cc8b4f-fqf48 -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 0.28 seconds) machine: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine: (finished: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 0.04 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1 machine # [ 401.609708] niks3-server[1109]: 2026/09/28 09:54:35 INFO Received push request method=POST path=/api/pushes machine # [ 401.623246] niks3-server[1109]: 2026/09/28 09:54:35 INFO Received sign narinfos request method=POST path=/api/pushes/21/sign machine # [ 401.625678] niks3-server[1109]: 2026/09/28 09:54:35 INFO Signed narinfos id=21 count=1 machine # [ 401.628091] niks3-server[1109]: 2026/09/28 09:54:35 INFO Registered completed upload object_key=nar/0g42hgwa9jp9abmqxz90dkwxpybsznzbpsy35rm921mlk5sw56jq.nar.zst machine # [ 401.629704] niks3-server[1109]: 2026/09/28 09:54:35 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.ls machine # [ 401.638851] niks3-server[1109]: 2026/09/28 09:54:35 INFO Received complete push request method=POST path=/api/pushes/21/complete machine # [ 401.644604] niks3-server[1109]: 2026/09/28 09:54:35 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.narinfo machine # [ 413.993384] postgres[762]: [762] LOG: checkpoint complete: wrote 1037 buffers (6.3%), wrote 3 SLRU buffers; 1 WAL file(s) added, 0 removed, 0 recycled; write=103.938 s, sync=0.061 s, total=104.040 s; sync files=364, longest=0.003 s, average=0.001 s; distance=4978 kB, estimate=4978 kB; lsn=0/1C75508, redo lsn=0/1C42900 machine # [ 426.368742] niks3-server[1109]: 2026/09/28 09:55:00 INFO Received push request method=POST path=/api/pushes machine # [ 426.385971] niks3-server[1109]: 2026/09/28 09:55:00 INFO Received sign narinfos request method=POST path=/api/pushes/22/sign machine # [ 426.386885] niks3-server[1109]: 2026/09/28 09:55:00 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.ls machine # [ 426.388628] niks3-server[1109]: 2026/09/28 09:55:00 INFO Signed narinfos id=22 count=1 machine # [ 426.389742] niks3-server[1109]: 2026/09/28 09:55:00 INFO Registered completed upload object_key=nar/1vxmmzwi16s4iri6dcmi9v62dpq1ys7wz15b497ncik3sd67nfzg.nar.zst machine # [ 426.398112] niks3-server[1109]: 2026/09/28 09:55:00 INFO Registered completed upload object_key=log/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31-k3s-a.drv machine # [ 426.400832] niks3-server[1109]: 2026/09/28 09:55:00 INFO Received complete push request method=POST path=/api/pushes/22/complete machine # [ 426.405439] niks3-server[1109]: 2026/09/28 09:55:00 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo machine # [ 426.464152] niks3-server[1109]: 2026/09/28 09:55:00 INFO Received push request method=POST path=/api/pushes machine # [ 426.473870] niks3-server[1109]: 2026/09/28 09:55:00 INFO Received sign narinfos request method=POST path=/api/pushes/23/sign machine # [ 426.474540] niks3-server[1109]: 2026/09/28 09:55:00 INFO Signed narinfos id=23 count=1 machine # [ 426.479297] niks3-server[1109]: 2026/09/28 09:55:00 INFO Registered completed upload object_key=nar/0cbxkyxz068xc5mivh2h67kw6y01n1x28cbs11v1a03g8m4c71zm.nar.zst machine # [ 426.480598] niks3-server[1109]: 2026/09/28 09:55:00 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.ls machine # [ 426.483969] niks3-server[1109]: 2026/09/28 09:55:00 INFO Received complete push request method=POST path=/api/pushes/23/complete machine # [ 426.488652] niks3-server[1109]: 2026/09/28 09:55:00 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.narinfo machine # [ 451.613274] niks3-server[1109]: 2026/09/28 09:55:25 INFO Received push request method=POST path=/api/pushes machine # [ 451.640943] niks3-server[1109]: 2026/09/28 09:55:25 INFO Received sign narinfos request method=POST path=/api/pushes/24/sign machine # [ 451.641863] niks3-server[1109]: 2026/09/28 09:55:25 INFO Registered completed upload object_key=nar/0khxywxb2r78vhpc5hsmha3ymgp910z0aka7550jmaqzs333rmzp.nar.zst machine # [ 451.644601] niks3-server[1109]: 2026/09/28 09:55:25 INFO Signed narinfos id=24 count=1 machine # [ 451.648250] niks3-server[1109]: 2026/09/28 09:55:25 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.ls machine # [ 451.649775] niks3-server[1109]: 2026/09/28 09:55:25 INFO Registered completed upload object_key=log/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4-k3s-b.drv machine # [ 451.653651] niks3-server[1109]: 2026/09/28 09:55:25 INFO Received complete push request method=POST path=/api/pushes/24/complete machine # [ 451.657947] niks3-server[1109]: 2026/09/28 09:55:25 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.narinfo machine # [ 451.731308] niks3-server[1109]: 2026/09/28 09:55:25 INFO Received push request method=POST path=/api/pushes machine # [ 451.741774] niks3-server[1109]: 2026/09/28 09:55:25 INFO Received sign narinfos request method=POST path=/api/pushes/25/sign machine # [ 451.742653] niks3-server[1109]: 2026/09/28 09:55:25 INFO Signed narinfos id=25 count=1 machine # [ 451.748216] niks3-server[1109]: 2026/09/28 09:55:25 INFO Received complete push request method=POST path=/api/pushes/25/complete machine # [ 451.750414] niks3-server[1109]: 2026/09/28 09:55:25 INFO Registered completed upload object_key=nar/04bim5f8bvjh25xncf5x40kb529khrlzcbc92qxvapgbc0bdfv2h.nar.zst machine # [ 451.752906] niks3-server[1109]: 2026/09/28 09:55:25 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.ls machine # [ 451.753282] niks3-server[1109]: 2026/09/28 09:55:25 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.narinfo machine # [ 476.276684] niks3-server[1109]: 2026/09/28 09:55:50 INFO Received push request method=POST path=/api/pushes machine # [ 476.301468] niks3-server[1109]: 2026/09/28 09:55:50 INFO Received sign narinfos request method=POST path=/api/pushes/26/sign machine # [ 476.305124] niks3-server[1109]: 2026/09/28 09:55:50 INFO Signed narinfos id=26 count=1 machine # [ 476.307350] niks3-server[1109]: 2026/09/28 09:55:50 INFO Registered completed upload object_key=log/jz7biafi8rj5r3r392blyazw5mdpvy0d-k3s-top.drv machine # [ 476.308488] niks3-server[1109]: 2026/09/28 09:55:50 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.ls machine # [ 476.313646] niks3-server[1109]: 2026/09/28 09:55:50 INFO Registered completed upload object_key=nar/11f7f1hixry25c2yc6np9hs10a2pwwqmymmrxxbswhdjabcyvv0s.nar.zst machine # [ 476.331923] niks3-server[1109]: 2026/09/28 09:55:50 INFO Received complete push request method=POST path=/api/pushes/26/complete machine # [ 476.341042] niks3-server[1109]: 2026/09/28 09:55:50 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1, in 74.95 seconds) (finished: subtest: a renewed balancer certificate is served without a rollout, in 76.31 seconds) subtest: metrics carry build_info machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-l9tvg -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-l9tvg -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.15 seconds) machine: must succeed: curl -sf http://10.42.0.8:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-l9tvg"' machine: (finished: must succeed: curl -sf http://10.42.0.8:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-l9tvg"', in 0.03 seconds) (finished: subtest: metrics carry build_info, in 0.19 seconds) subtest: harmonia-gc frees space and the worker stays Ready machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-l9tvg -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'' machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-l9tvg -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'', in 0.21 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-l9tvg -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done' machine # [ 477.049224] k3s[875]: E0928 09:55:50.993415 875 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39038: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-l9tvg -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done', in 0.29 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-l9tvg -c gc -- sh -c 'fallocate -l 11433029632 /nix/fill' machine # [ 477.294284] k3s[875]: E0928 09:55:51.239243 875 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39044: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-l9tvg -c gc -- sh -c 'fallocate -l 11433029632 /nix/fill', in 0.25 seconds) machine: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-l9tvg -c gc --since=30s | grep -q 'store paths deleted' machine: (finished: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-l9tvg -c gc --since=30s | grep -q 'store paths deleted', in 5.17 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-l9tvg -c gc -- sh -c 'rm /nix/fill' machine # [ 482.669339] k3s[875]: E0928 09:55:56.613956 875 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39056: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-l9tvg -c gc -- sh -c 'rm /nix/fill', in 0.21 seconds) machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-l9tvg -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-l9tvg -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}', in 0.14 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-l9tvg -c gc -- sh -c 'command -v nix-daemon && command -v niks3' machine # [ 483.010454] k3s[875]: E0928 09:55:56.955227 875 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:50530: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-l9tvg -c gc -- sh -c 'command -v nix-daemon && command -v niks3', in 0.20 seconds) (finished: subtest: harmonia-gc frees space and the worker stays Ready, in 6.46 seconds) subtest: losing the balancer mid-build: the client reconnects and the build succeeds machine: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1 machine # [ 483.038045] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1. machine # Running as unit: vialb.service; invocation ID: 5177f9865ab644bf82571fd8c99a9e9f machine: (finished: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1, in 0.03 seconds) machine: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'" machine # [ 483.165379] nix[8841]: don't know how to build these paths: machine # [ 483.166058] nix[8841]: /nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 483.189538] nix[8841]: copying 1 paths to '127.0.0.1:30051'... machine # [ 483.192621] nix[8841]: copying path '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' to '127.0.0.1:30051'... machine # [ 483.261315] niks3-server[1109]: 2026/09/28 09:55:57 INFO Received push request method=POST path=/api/pushes machine # [ 483.278975] niks3-server[1109]: 2026/09/28 09:55:57 INFO Received sign narinfos request method=POST path=/api/pushes/27/sign machine # [ 483.281308] niks3-server[1109]: 2026/09/28 09:55:57 INFO Signed narinfos id=27 count=1 machine # [ 483.284473] niks3-server[1109]: 2026/09/28 09:55:57 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.ls machine # [ 483.287915] niks3-server[1109]: 2026/09/28 09:55:57 INFO Registered completed upload object_key=nar/0kkr2vb091wkq0cb0f1q92413dsfskh76wydp8mwysv7rawns0ar.nar.zst machine # [ 483.292815] niks3-server[1109]: 2026/09/28 09:55:57 INFO Received complete push request method=POST path=/api/pushes/27/complete machine # [ 483.298806] niks3-server[1109]: 2026/09/28 09:55:57 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.narinfo machine # [ 483.309242] nix[8841]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 483.309864] nix[8841]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-l9tvg: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine: (finished: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'", in 1.06 seconds) machine: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false machine: (finished: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false, in 0.25 seconds) machine: waiting for success: ! systemctl is-active vialb machine # [ 484.375122] nix[8841]: d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv: Stream removed (Socket closed), asking the scheduler again machine # [ 484.375883] nix[8841]: scheduler at 127.0.0.1:30051: Stream removed (Socket closed), reconnecting machine # [ 484.396676] systemd[1]: cri-containerd-16f05d808f441c43cab48dfe7048d0609f418932580ba0274da669861598ac68.scope: Deactivated successfully. machine # [ 484.397139] systemd[1]: cri-containerd-16f05d808f441c43cab48dfe7048d0609f418932580ba0274da669861598ac68.scope: Consumed 3.530s CPU time over 7min 10.405s wall clock time, 55.7M memory peak, 35.4M read from disk, 562.9K incoming IP traffic, 693.2K outgoing IP traffic. machine # [ 484.433176] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-16f05d808f441c43cab48dfe7048d0609f418932580ba0274da669861598ac68-rootfs.mount: Deactivated successfully. machine # [ 484.466896] systemd[1]: cri-containerd-3e8638c19e299a073f59d5f4493955f88ebab56ff7bed389c0764324cd4667dd.scope: Deactivated successfully. machine # [ 484.497834] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-3e8638c19e299a073f59d5f4493955f88ebab56ff7bed389c0764324cd4667dd-rootfs.mount: Deactivated successfully. machine # [ 484.525185] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-3e8638c19e299a073f59d5f4493955f88ebab56ff7bed389c0764324cd4667dd-shm.mount: Deactivated successfully. machine # [ 484.711221] cni0: port 4(vethb363dd03) entered disabled state machine # [ 484.559768] dhcpcd[684]: vethb363dd03: carrier lost machine # [ 484.714305] vethb363dd03 (unregistering): left allmulticast mode machine # [ 484.715679] vethb363dd03 (unregistering): left promiscuous mode machine # [ 484.717115] cni0: port 4(vethb363dd03) entered disabled state machine # [ 484.585944] systemd[1]: run-netns-cni\x2d7c15a744\x2d7f71\x2d9128\x2df32e\x2d0d5ed048b66c.mount: Deactivated successfully. machine # [ 484.593645] dhcpcd[684]: vethb363dd03: deleting address fe80::b037:aaff:fe81:a917 machine # [ 484.597303] dhcpcd[684]: vethb363dd03: deleting route to 169.254.0.0/16 machine # [ 484.629268] k3s[875]: E0928 09:55:58.573791 875 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-lb-5877cc8b4f\" failed with read version: 765 is not as new as written version: 790 for group resource replicasets.apps" logger="UnhandledError" machine # [ 484.644097] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod2c066d3c_ae65_4925_a5c8_daa280dc4a4d.slice. machine # [ 484.683386] dhcpcd[684]: vethb363dd03: removing interface machine # [ 484.692487] k3s[875]: I0928 09:55:58.637472 875 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/730d64de-7d25-4a24-817d-690e9510e92d-tls-ca\" (UniqueName: \"kubernetes.io/secret/730d64de-7d25-4a24-817d-690e9510e92d-tls-ca\") pod \"730d64de-7d25-4a24-817d-690e9510e92d\" (UID: \"730d64de-7d25-4a24-817d-690e9510e92d\") " machine # [ 484.692864] k3s[875]: I0928 09:55:58.637553 875 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/730d64de-7d25-4a24-817d-690e9510e92d-tls-lb\" (UniqueName: \"kubernetes.io/secret/730d64de-7d25-4a24-817d-690e9510e92d-tls-lb\") pod \"730d64de-7d25-4a24-817d-690e9510e92d\" (UID: \"730d64de-7d25-4a24-817d-690e9510e92d\") " machine # [ 484.693742] k3s[875]: I0928 09:55:58.637592 875 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/730d64de-7d25-4a24-817d-690e9510e92d-config\" (UniqueName: \"kubernetes.io/configmap/730d64de-7d25-4a24-817d-690e9510e92d-config\") pod \"730d64de-7d25-4a24-817d-690e9510e92d\" (UID: \"730d64de-7d25-4a24-817d-690e9510e92d\") " machine # [ 484.694374] k3s[875]: I0928 09:55:58.637628 875 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/730d64de-7d25-4a24-817d-690e9510e92d-tmp\" (UniqueName: \"kubernetes.io/empty-dir/730d64de-7d25-4a24-817d-690e9510e92d-tmp\") pod \"730d64de-7d25-4a24-817d-690e9510e92d\" (UID: \"730d64de-7d25-4a24-817d-690e9510e92d\") " machine # [ 484.694929] k3s[875]: I0928 09:55:58.637691 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2c066d3c-ae65-4925-a5c8-daa280dc4a4d-config\") pod \"nix-grpc-farm-lb-5877cc8b4f-fjq8b\" (UID: \"2c066d3c-ae65-4925-a5c8-daa280dc4a4d\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-fjq8b" machine # [ 484.695679] k3s[875]: I0928 09:55:58.637729 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c066d3c-ae65-4925-a5c8-daa280dc4a4d-tmp\") pod \"nix-grpc-farm-lb-5877cc8b4f-fjq8b\" (UID: \"2c066d3c-ae65-4925-a5c8-daa280dc4a4d\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-fjq8b" machine # [ 484.696182] k3s[875]: I0928 09:55:58.637754 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/2c066d3c-ae65-4925-a5c8-daa280dc4a4d-tls-ca\") pod \"nix-grpc-farm-lb-5877cc8b4f-fjq8b\" (UID: \"2c066d3c-ae65-4925-a5c8-daa280dc4a4d\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-fjq8b" machine # [ 484.696749] k3s[875]: I0928 09:55:58.637786 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/2c066d3c-ae65-4925-a5c8-daa280dc4a4d-tls-lb\") pod \"nix-grpc-farm-lb-5877cc8b4f-fjq8b\" (UID: \"2c066d3c-ae65-4925-a5c8-daa280dc4a4d\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-fjq8b" machine # [ 484.729560] systemd[1]: var-lib-kubelet-pods-730d64de\x2d7d25\x2d4a24\x2d817d\x2d690e9510e92d-volumes-kubernetes.io\x7esecret-tls\x2dca.mount: Deactivated successfully. machine # [ 484.731469] k3s[875]: I0928 09:55:58.676442 875 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/730d64de-7d25-4a24-817d-690e9510e92d-tls-ca" pod "730d64de-7d25-4a24-817d-690e9510e92d" (UID: "730d64de-7d25-4a24-817d-690e9510e92d"). InnerVolumeSpecName "tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 484.736358] k3s[875]: I0928 09:55:58.681329 875 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/730d64de-7d25-4a24-817d-690e9510e92d-tmp" pod "730d64de-7d25-4a24-817d-690e9510e92d" (UID: "730d64de-7d25-4a24-817d-690e9510e92d"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 484.737245] k3s[875]: I0928 09:55:58.682287 875 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/730d64de-7d25-4a24-817d-690e9510e92d-tls-lb" pod "730d64de-7d25-4a24-817d-690e9510e92d" (UID: "730d64de-7d25-4a24-817d-690e9510e92d"). InnerVolumeSpecName "tls-lb". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 484.751489] k3s[875]: I0928 09:55:58.696498 875 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/730d64de-7d25-4a24-817d-690e9510e92d-config" pod "730d64de-7d25-4a24-817d-690e9510e92d" (UID: "730d64de-7d25-4a24-817d-690e9510e92d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 484.793368] k3s[875]: I0928 09:55:58.738348 875 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/730d64de-7d25-4a24-817d-690e9510e92d-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 484.796524] k3s[875]: I0928 09:55:58.738384 875 reconciler_common.go:299] "Volume detached for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/730d64de-7d25-4a24-817d-690e9510e92d-tls-ca\") on node \"machine\" DevicePath \"\"" machine # [ 484.796959] k3s[875]: I0928 09:55:58.738398 875 reconciler_common.go:299] "Volume detached for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/730d64de-7d25-4a24-817d-690e9510e92d-tls-lb\") on node \"machine\" DevicePath \"\"" machine # [ 484.797696] k3s[875]: I0928 09:55:58.738510 875 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/730d64de-7d25-4a24-817d-690e9510e92d-config\") on node \"machine\" DevicePath \"\"" machine # [ 484.816707] k3s[875]: I0928 09:55:58.761678 875 scope.go:122] "RemoveContainer" containerID="16f05d808f441c43cab48dfe7048d0609f418932580ba0274da669861598ac68" machine # [ 484.826489] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod730d64de_7d25_4a24_817d_690e9510e92d.slice. machine # [ 484.827303] systemd[1]: kubepods-besteffort-pod730d64de_7d25_4a24_817d_690e9510e92d.slice: Consumed 3.563s CPU time over 7min 12.858s wall clock time, 55.9M memory peak, 35.4M read from disk, 562.9K incoming IP traffic, 693.2K outgoing IP traffic. machine # [ 484.833080] k3s[875]: I0928 09:55:58.778060 875 scope.go:122] "RemoveContainer" containerID="16f05d808f441c43cab48dfe7048d0609f418932580ba0274da669861598ac68" machine # [ 484.834431] k3s[875]: E0928 09:55:58.779476 875 remote_runtime.go:569] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"16f05d808f441c43cab48dfe7048d0609f418932580ba0274da669861598ac68\": not found" containerID="16f05d808f441c43cab48dfe7048d0609f418932580ba0274da669861598ac68" machine # [ 484.835812] k3s[875]: I0928 09:55:58.780299 875 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"16f05d808f441c43cab48dfe7048d0609f418932580ba0274da669861598ac68"} err="failed to get container status \"16f05d808f441c43cab48dfe7048d0609f418932580ba0274da669861598ac68\": rpc error: code = NotFound desc = an error occurred when try to find container \"16f05d808f441c43cab48dfe7048d0609f418932580ba0274da669861598ac68\": not found" machine # [ 485.132975] cni0: port 2(veth580f957e) entered blocking state machine # [ 485.134066] cni0: port 2(veth580f957e) entered disabled state machine # [ 484.981458] ([ 485.134984] veth580f957e: entered allmulticast mode machine # udev-worker)[9020]: Network inte[ 485.135894] veth580f957e: entered promiscuous mode machine # rface NamePolicy= disabled on kernel command line. machine # [ 485.144129] cni0: port 2(veth580f957e) entered blocking state machine # [ 485.145166] cni0: port 2(veth580f957e) entered forwarding state machine # [ 485.011020] dhcpcd[684]: veth580f957e: IAID 9e:b9:63:73 machine # [ 485.011230] dhcpcd[684]: veth580f957e: adding address fe80::a84a:9eff:feb9:6373 machine # [ 485.084455] systemd[1]: Started libcontainer container 750be40f907b623dcdad7c864d4243d6d69def837e614292a827cc67fa944b47. machine # [ 485.208585] systemd[1]: Started libcontainer container f441aff3c0d38c07b1879d580147c30704ab2a455e85da242ad7653429500631. machine # [ 485.296347] k3s[875]: I0928 09:55:59.241346 875 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-5877cc8b4f-fjq8b" podStartSLOduration=1.241317626 podStartE2EDuration="1.241317626s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-28 09:55:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-28 09:55:59.239949017 +0000 UTC m=+469.280458777" watchObservedRunningTime="2026-09-28 09:55:59.241317626 +0000 UTC m=+469.281827945" machine # [ 485.442068] systemd[1]: var-lib-kubelet-pods-730d64de\x2d7d25\x2d4a24\x2d817d\x2d690e9510e92d-volume\x2dsubpaths-config-envoy-2.mount: Deactivated successfully. machine # [ 485.442338] systemd[1]: var-lib-kubelet-pods-730d64de\x2d7d25\x2d4a24\x2d817d\x2d690e9510e92d-volume\x2dsubpaths-config-envoy-1.mount: Deactivated successfully. machine # [ 485.442968] systemd[1]: var-lib-kubelet-pods-730d64de\x2d7d25\x2d4a24\x2d817d\x2d690e9510e92d-volume\x2dsubpaths-config-envoy-0.mount: Deactivated successfully. machine # [ 485.443695] systemd[1]: var-lib-kubelet-pods-730d64de\x2d7d25\x2d4a24\x2d817d\x2d690e9510e92d-volumes-kubernetes.io\x7esecret-tls\x2dlb.mount: Deactivated successfully. machine # [ 485.444218] systemd[1]: var-lib-kubelet-pods-730d64de\x2d7d25\x2d4a24\x2d817d\x2d690e9510e92d-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 485.663758] dhcpcd[684]: veth580f957e: soliciting a DHCP lease machine # [ 485.781652] k3s[875]: I0928 09:55:59.725753 875 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="730d64de-7d25-4a24-817d-690e9510e92d" path="/var/lib/kubelet/pods/730d64de-7d25-4a24-817d-690e9510e92d/volumes" machine # [ 486.879713] nix[8841]: scheduler at 127.0.0.1:30051: failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:30051: Failed to connect to remote host: connect() timed out, reconnecting machine # [ 487.387336] dhcpcd[684]: veth580f957e: soliciting an IPv6 router machine # [ 487.931582] nix[8841]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 487.931905] nix[8841]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-xplld: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 490.665217] dhcpcd[684]: veth580f957e: probing for an IPv4LL address machine # [ 495.183735] dhcpcd[684]: veth580f957e: using IPv4LL address 169.254.238.54 machine # [ 495.184747] dhcpcd[684]: veth580f957e: adding route to 169.254.0.0/16 machine # [ 499.392113] dhcpcd[684]: veth580f957e: no IPv6 Routers available machine # [ 533.261661] niks3-server[1109]: 2026/09/28 09:56:47 INFO Received push request method=POST path=/api/pushes machine # [ 533.280988] niks3-server[1109]: 2026/09/28 09:56:47 INFO Received sign narinfos request method=POST path=/api/pushes/28/sign machine # [ 533.283869] niks3-server[1109]: 2026/09/28 09:56:47 INFO Signed narinfos id=28 count=1 machine # [ 533.289944] niks3-server[1109]: 2026/09/28 09:56:47 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.ls machine # [ 533.295147] niks3-server[1109]: 2026/09/28 09:56:47 INFO Registered completed upload object_key=log/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 533.301069] niks3-server[1109]: 2026/09/28 09:56:47 INFO Received complete push request method=POST path=/api/pushes/28/complete machine # [ 533.304631] niks3-server[1109]: 2026/09/28 09:56:47 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.narinfo machine # [ 534.362813] systemd[1]: vialb.service: Deactivated successfully. machine # [ 534.365237] systemd[1]: vialb.service: Consumed 229ms CPU time over 51.324s wall clock time, 38.7M memory peak, 4K written to disk, 8.5K incoming IP traffic, 17.3K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active vialb, in 51.03 seconds) machine: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; }, in 0.04 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 0.32 seconds) (finished: subtest: losing the balancer mid-build: the client reconnects and the build succeeds, in 52.72 seconds) subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes machine: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 machine # Running as unit: slow.service; invocation ID: 93e208a1923a4700a4101b4095e51b49 machine: (finished: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1, in 0.03 seconds) machine # [ 535.773123] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1. machine # [ 535.900406] nix[9877]: don't know how to build these paths: machine # [ 535.900663] nix[9877]: /nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 535.918917] nix[9877]: copying 1 paths to '127.0.0.1:30051'... machine # [ 535.919790] nix[9877]: copying path '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' to '127.0.0.1:30051'... machine # [ 535.969467] niks3-server[1109]: 2026/09/28 09:56:49 INFO Received push request method=POST path=/api/pushes machine # command terminated with exit code 1 machine # [ 535.985846] k3s[875]: E0928 09:56:49.929167 875 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39854: use of closed network connection" machine # [ 535.988109] niks3-server[1109]: 2026/09/28 09:56:49 INFO Received sign narinfos request method=POST path=/api/pushes/29/sign machine # [ 535.989850] niks3-server[1109]: 2026/09/28 09:56:49 INFO Signed narinfos id=29 count=1 machine # [ 535.992223] niks3-server[1109]: 2026/09/28 09:56:49 INFO Registered completed upload object_key=nar/0wl2i9xpw0gwrx1xqdgx9ka4n503ky9qhl20pdrdlphn8d6lcx0i.nar.zst machine # [ 535.994619] niks3-server[1109]: 2026/09/28 09:56:49 INFO Received complete push request method=POST path=/api/pushes/29/complete machine # [ 535.996418] niks3-server[1109]: 2026/09/28 09:56:49 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.ls machine # [ 535.999649] niks3-server[1109]: 2026/09/28 09:56:49 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.narinfo machine # [ 536.009323] nix[9877]: building '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' on 127.0.0.1:30051... machine # [ 536.009818] nix[9877]: slow-s1> machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-l9tvg: building zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 536.196451] k3s[875]: E0928 09:56:50.141305 875 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39858: use of closed network connection" machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 537.502458] k3s[875]: E0928 09:56:51.446013 875 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39866: use of closed network connection" machine # [ 537.697612] k3s[875]: E0928 09:56:51.642139 875 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39880: use of closed network connection" machine # command terminated with exit code 1 machine # [ 538.983323] k3s[875]: E0928 09:56:52.927950 875 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39886: use of closed network connection" machine # command terminated with exit code 1 machine # [ 539.186803] k3s[875]: E0928 09:56:53.131775 875 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39894: use of closed network connection" machine # command terminated with exit code 1 machine # [ 540.452573] k3s[875]: E0928 09:56:54.397211 875 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39902: use of closed network connection" machine # command terminated with exit code 1 machine # [ 540.652579] k3s[875]: E0928 09:56:54.597531 875 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39910: use of closed network connection" machine # command terminated with exit code 1 machine # [ 541.969543] k3s[875]: E0928 09:56:55.913924 875 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39918: use of closed network connection" machine # command terminated with exit code 1 machine # [ 542.177946] k3s[875]: E0928 09:56:56.122896 875 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39932: use of closed network connection" machine # command terminated with exit code 1 machine # [ 543.437362] k3s[875]: E0928 09:56:57.382001 875 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:43292: use of closed network connection" machine # command terminated with exit code 1 machine # [ 543.630897] k3s[875]: E0928 09:56:57.575724 875 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:43294: use of closed network connection" machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 544.906061] k3s[875]: E0928 09:56:58.849844 875 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:43296: use of closed network connection" machine # [ 545.099174] k3s[875]: E0928 09:56:59.044088 875 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:43302: use of closed network connection" machine # command terminated with exit code 1 machine # [ 546.385941] k3s[875]: E0928 09:57:00.330524 875 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:43318: use of closed network connection" machine # command terminated with exit code 1 machine # [ 546.569939] k3s[875]: E0928 09:57:00.514913 875 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:43332: use of closed network connection" machine # command terminated with exit code 1 machine # [ 547.878562] k3s[875]: E0928 09:57:01.823123 875 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:43348: use of closed network connection" machine # command terminated with exit code 1 machine # [ 548.091940] k3s[875]: E0928 09:57:02.036720 875 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:43352: use of closed network connection" machine # command terminated with exit code 1 machine # [ 549.384894] k3s[875]: E0928 09:57:03.329547 875 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:43366: use of closed network connection" machine # command terminated with exit code 1 machine # [ 549.577475] k3s[875]: E0928 09:57:03.522440 875 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:43380: use of closed network connection" machine # command terminated with exit code 1 machine # [ 550.853322] k3s[875]: E0928 09:57:04.797947 875 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:43392: use of closed network connection" machine # command terminated with exit code 1 machine # [ 551.052463] k3s[875]: E0928 09:57:04.997435 875 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:43396: use of closed network connection" machine # command terminated with exit code 1 machine # [ 552.353647] k3s[875]: E0928 09:57:06.298294 875 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:43398: use of closed network connection" machine # command terminated with exit code 1 machine # [ 552.557762] k3s[875]: E0928 09:57:06.502745 875 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:43410: use of closed network connection" machine # command terminated with exit code 1 machine # [ 553.866252] k3s[875]: E0928 09:57:07.810883 875 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:50742: use of closed network connection" machine # command terminated with exit code 1 machine # [ 554.056507] k3s[875]: E0928 09:57:08.001447 875 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:50750: use of closed network connection" machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 555.330047] k3s[875]: E0928 09:57:09.274658 875 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:50764: use of closed network connection" machine # [ 555.554971] k3s[875]: E0928 09:57:09.499927 875 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:50772: use of closed network connection" machine # command terminated with exit code 1 machine # [ 556.866763] k3s[875]: E0928 09:57:10.811396 875 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:50784: use of closed network connection" machine # command terminated with exit code 1 machine # [ 557.073792] k3s[875]: E0928 09:57:11.018757 875 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:50792: use of closed network connection" machine # command terminated with exit code 1 machine # [ 558.373397] k3s[875]: E0928 09:57:12.317758 875 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:50796: use of closed network connection" machine # command terminated with exit code 1 machine # [ 558.577675] k3s[875]: E0928 09:57:12.522643 875 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:50808: use of closed network connection" machine # command terminated with exit code 1 machine # [ 559.884040] k3s[875]: E0928 09:57:13.828580 875 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:50812: use of closed network connection" machine # command terminated with exit code 1 machine # [ 560.082722] k3s[875]: E0928 09:57:14.027683 875 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:50816: use of closed network connection" machine # command terminated with exit code 1 machine # [ 561.339873] k3s[875]: E0928 09:57:15.284351 875 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:50820: use of closed network connection" machine # [ 561.537114] k3s[875]: E0928 09:57:15.481850 875 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:50822: use of closed network connection" machine: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-l9tvg --wait=false machine: (finished: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-l9tvg --wait=false, in 0.16 seconds) machine: must succeed: sleep 5.0 machine # [ 561.764657] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod1a0dea92_02a3_4c6b_be17_81dee0cfd5bd.slice. machine # [ 561.768912] k3s[875]: E0928 09:57:15.713918 875 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7\" failed with read version: 854 is not as new as written version: 857 for group resource replicasets.apps" logger="UnhandledError" machine # [ 561.774959] systemd[1]: cri-containerd-6761f1f670e7142c729f68d9317d7876356f7b739348920be627791858e5a671.scope: Deactivated successfully. machine # [ 561.775539] systemd[1]: cri-containerd-6761f1f670e7142c729f68d9317d7876356f7b739348920be627791858e5a671.scope: Consumed 586ms CPU time over 8min 20.225s wall clock time, 13.9M memory peak, 5.8M read from disk. machine # [ 561.812694] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-6761f1f670e7142c729f68d9317d7876356f7b739348920be627791858e5a671-rootfs.mount: Deactivated successfully. machine # [ 561.816131] k3s[875]: I0928 09:57:15.760881 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/1a0dea92-02a3-4c6b-be17-81dee0cfd5bd-build\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-t8fcs\" (UID: \"1a0dea92-02a3-4c6b-be17-81dee0cfd5bd\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-t8fcs" machine # [ 561.816823] k3s[875]: I0928 09:57:15.761034 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/1a0dea92-02a3-4c6b-be17-81dee0cfd5bd-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-t8fcs\" (UID: \"1a0dea92-02a3-4c6b-be17-81dee0cfd5bd\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-t8fcs" machine # [ 561.816982] k3s[875]: I0928 09:57:15.761066 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/1a0dea92-02a3-4c6b-be17-81dee0cfd5bd-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-t8fcs\" (UID: \"1a0dea92-02a3-4c6b-be17-81dee0cfd5bd\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-t8fcs" machine # [ 561.817977] k3s[875]: I0928 09:57:15.761098 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2cwn\" (UniqueName: \"kubernetes.io/projected/1a0dea92-02a3-4c6b-be17-81dee0cfd5bd-kube-api-access-b2cwn\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-t8fcs\" (UID: \"1a0dea92-02a3-4c6b-be17-81dee0cfd5bd\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-t8fcs" machine # [ 561.818863] k3s[875]: I0928 09:57:15.761146 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/1a0dea92-02a3-4c6b-be17-81dee0cfd5bd-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-t8fcs\" (UID: \"1a0dea92-02a3-4c6b-be17-81dee0cfd5bd\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-t8fcs" machine # [ 561.819949] k3s[875]: I0928 09:57:15.761179 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/1a0dea92-02a3-4c6b-be17-81dee0cfd5bd-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-t8fcs\" (UID: \"1a0dea92-02a3-4c6b-be17-81dee0cfd5bd\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-t8fcs" machine # [ 561.820835] k3s[875]: I0928 09:57:15.761205 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1a0dea92-02a3-4c6b-be17-81dee0cfd5bd-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-t8fcs\" (UID: \"1a0dea92-02a3-4c6b-be17-81dee0cfd5bd\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-t8fcs" machine # [ 561.822796] k3s[875]: I0928 09:57:15.761232 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/1a0dea92-02a3-4c6b-be17-81dee0cfd5bd-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-t8fcs\" (UID: \"1a0dea92-02a3-4c6b-be17-81dee0cfd5bd\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-t8fcs" machine # [ 561.823390] k3s[875]: I0928 09:57:15.761266 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/1a0dea92-02a3-4c6b-be17-81dee0cfd5bd-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-t8fcs\" (UID: \"1a0dea92-02a3-4c6b-be17-81dee0cfd5bd\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-t8fcs" machine # [ 562.305472] cni0: port 4(veth3934dcd0) entered blocking state machine # [ 562.307347] cni0: port 4(veth3934dcd0) entered disabled state machine # [ 562.309811] veth3934dcd0: entered allmulticast mode machine # [ 562.312630] veth3934dcd0: entered promiscuous mode machine # [ 562.331565] cni0: port 4(veth3934dcd0) entered blocking state machine # [ 562.333003] cni0: port 4(veth3934dcd0) entered forwarding state machine # [ 562.215699] (udev-worker)[11464]: Network interface NamePolicy= disabled on kernel command line. machine # [ 562.242399] dhcpcd[684]: veth3934dcd0: IAID bc:bd:43:00 machine # [ 562.242854] dhcpcd[684]: veth3934dcd0: adding address fe80::5ce8:bcff:febd:4300 machine # [ 562.285284] systemd[1]: Started libcontainer container 8b8648ae9d02bba4e723857d707669844d6422fe7ec709df9eac72246cf0143c. machine # [ 562.486426] systemd[1]: Started libcontainer container aae5b97813c800fd85067a7cace47629fa8da661e678d6f3bbbe55844e6c8bc0. machine # [ 563.325886] dhcpcd[684]: veth3934dcd0: soliciting a DHCP lease machine # [ 563.846956] dhcpcd[684]: veth3934dcd0: soliciting an IPv6 router machine # [ 564.869128] systemd[1]: cri-containerd-aae5b97813c800fd85067a7cace47629fa8da661e678d6f3bbbe55844e6c8bc0.scope: Deactivated successfully. machine # [ 564.872142] systemd[1]: cri-containerd-aae5b97813c800fd85067a7cace47629fa8da661e678d6f3bbbe55844e6c8bc0.scope: Consumed 969ms CPU time over 2.383s wall clock time, 474.7M memory peak, 176.6M read from disk, 179.6M written to disk. machine # [ 564.935395] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-aae5b97813c800fd85067a7cace47629fa8da661e678d6f3bbbe55844e6c8bc0-rootfs.mount: Deactivated successfully. machine # [ 565.381211] systemd[1]: tmp-ovl\x2didmapped98365609.mount: Deactivated successfully. machine # [ 565.396406] systemd[1]: Started libcontainer container b34a2addb1c8dce2423653e033e3ac66d6a9a2581e2f788d9efa8b1539128d16. machine # [ 565.556607] systemd[1]: Started libcontainer container 091fad162469df8d861fb89b4eb16470f9681d70504e6229b3d4234b4b599c46. machine # [ 565.745372] systemd[1]: Started libcontainer container a88381041856a2b3ba49c7d2134fba06740d64c72127945c1cd041f08b21d0f8. machine # [ 565.837963] k3s[875]: I0928 09:57:19.779709 875 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-t8fcs" podStartSLOduration=2.425530135 podStartE2EDuration="4.779568428s" totalImagesPullingTime="0s" totalInitContainerRuntime="2.354038293s" isStatefulPod=false podCreationTimestamp="2026-09-28 09:57:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-28 09:57:19.773084085 +0000 UTC m=+549.813593845" watchObservedRunningTime="2026-09-28 09:57:19.779568428 +0000 UTC m=+549.820078188" machine: (finished: must succeed: sleep 5.0, in 5.04 seconds) machine # [ 566.957346] k3s[875]: E0928 09:57:20.901792 875 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:46460: use of closed network connection" machine: waiting for success: ! systemctl is-active slow machine # [ 568.327405] dhcpcd[684]: veth3934dcd0: probing for an IPv4LL address machine # [ 572.856755] dhcpcd[684]: veth3934dcd0: using IPv4LL address 169.254.46.5 machine # [ 572.857652] dhcpcd[684]: veth3934dcd0: adding route to 169.254.0.0/16 machine # [ 575.852394] dhcpcd[684]: veth3934dcd0: no IPv6 Routers available machine # [ 580.961639] niks3-server[1109]: 2026/09/28 09:57:34 INFO Received push request method=POST path=/api/pushes machine # [ 580.979829] niks3-server[1109]: 2026/09/28 09:57:34 INFO Received sign narinfos request method=POST path=/api/pushes/30/sign machine # [ 580.983967] niks3-server[1109]: 2026/09/28 09:57:34 INFO Signed narinfos id=30 count=1 machine # [ 580.987073] niks3-server[1109]: 2026/09/28 09:57:34 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.ls machine # [ 580.991287] niks3-server[1109]: 2026/09/28 09:57:34 INFO Registered completed upload object_key=log/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 580.995934] niks3-server[1109]: 2026/09/28 09:57:34 INFO Received complete push request method=POST path=/api/pushes/30/complete machine # [ 581.001340] niks3-server[1109]: 2026/09/28 09:57:34 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo machine # [ 581.027898] systemd[1]: slow.service: Deactivated successfully. machine # [ 581.030232] systemd[1]: slow.service: Consumed 160ms CPU time over 45.257s wall clock time, 38.3M memory peak, 4K written to disk, 5.4K incoming IP traffic, 11.7K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active slow, in 14.57 seconds) machine: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; }, in 0.04 seconds) machine: must fail: journalctl -u slow | grep -q 'asking the scheduler again' machine: (finished: must fail: journalctl -u slow | grep -q 'asking the scheduler again', in 0.02 seconds) machine: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath, in 0.13 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null, in 0.03 seconds) (finished: subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes, in 46.02 seconds) (finished: run the VM test script, in 582.70 seconds) test script finished in 582.73s cleanup kill QemuMachine (pid 45) machine # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) machine # [2026-09-28T09:57:36Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-09-28T09:57:36Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-09-28T09:57:36Z INFO virtiofsd] Client disconnected, shutting down (finished: cleanup, in 0.91 seconds) additionally exposed symbols: machine, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh