tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 1200.0 seconds run the VM test script machine: waiting for unit k3s.service machine: waiting for the VM to finish booting machine: starting vm machine: QEMU running (pid 45) machine # Disk image does not exist, creating the virtualisation disk image... machine # Formatting '/build/vm-state-machine/tmp.ZESowNvL4q', fmt=raw size=17179869184 machine # mke2fs 1.47.4 (6-Mar-2025) machine # Discarding device blocks: 0/4194304 done machine # Creating filesystem with 4194304 4k blocks and 1048576 inodes machine # Filesystem UUID: 0a7f0bdb-e913-4144-b6cb-14372ee7a991 machine # Superblock backups stored on blocks: machine # 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208, machine # 4096000 machine # machine # Allocating group tables: 0/128 done machine # Writing inode tables: 0/128 done machine # Creating journal (32768 blocks): done machine # Writing superblocks and filesystem accounting information: 0/128 done machine # machine # Virtualisation disk image created. machine # Starting virtiofs daemons... machine # [2026-09-27T14:12:42Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-27T14:12:42Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-27T14:12:42Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-27T14:12:42Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-27T14:12:42Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-27T14:12:42Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-27T14:12:42Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-27T14:12:42Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-27T14:12:42Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-27T14:12:42Z INFO virtiofsd] Client connected, servicing requests machine # [2026-09-27T14:12:42Z INFO virtiofsd] Client connected, servicing requests machine # [2026-09-27T14:12:42Z INFO virtiofsd] Client connected, servicing requests machine # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) machine # machine # machine # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+7EFCC730+7EF2C730 CA00 machine # Press Ctrl-B to configure iPXE (PCI 00:02.0)... machine # machine # machine # machine # machine # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 7EFCC730 7EF2C730 CB00 machine # Press Ctrl-B to configure iPXE (PCI 00:05.0)... machine # machine # machine # Booting from ROM... machine # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 machine # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/2nnda62anar3ksw14hmi5nhz2x2cp15k-nixos-system-machine-test/init regInfo=/nix/store/7cb3l3pi42ryp81g07xr979slrwq7yr7-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.000000] BIOS-provided physical RAM map: machine # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007ffd7fff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000007ffd8000-0x000000007fffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000017fffffff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved machine # [ 0.000000] NX (Execute Disable) protection: active machine # [ 0.000000] APIC: Static calls initialized machine # [ 0.000000] SMBIOS 2.8 present. machine # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 machine # [ 0.000000] DMI: Memory slots populated: 1/1 machine # [ 0.000000] Hypervisor detected: KVM machine # [ 0.000000] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 machine # [ 0.000001] kvm-clock: using sched offset of 556574010 cycles machine # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns machine # [ 0.000005] tsc: Detected 2400.012 MHz processor machine # [ 0.000811] last_pfn = 0x180000 max_arch_pfn = 0x10000000000 machine # [ 0.000839] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs machine # [ 0.000842] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT machine # [ 0.000881] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.002734] found SMP MP-table at [mem 0x000f5450-0x000f545f] machine # [ 0.002746] Using GB pages for direct mapping machine # [ 0.002835] RAMDISK: [mem 0x7e371000-0x7ffcffff] machine # [ 0.002843] ACPI: Early table checksum verification disabled machine # [ 0.002846] ACPI: RSDP 0x00000000000F5250 000014 (v00 BOCHS ) machine # [ 0.002849] ACPI: RSDT 0x000000007FFE2539 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002853] ACPI: FACP 0x000000007FFE2319 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002860] ACPI: DSDT 0x000000007FFE0040 0022D9 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002862] ACPI: FACS 0x000000007FFE0000 000040 machine # [ 0.002863] ACPI: APIC 0x000000007FFE240D 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002865] ACPI: HPET 0x000000007FFE249D 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002866] ACPI: MCFG 0x000000007FFE24D5 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002868] ACPI: WAET 0x000000007FFE2511 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002869] ACPI: Reserving FACP table memory at [mem 0x7ffe2319-0x7ffe240c] machine # [ 0.002870] ACPI: Reserving DSDT table memory at [mem 0x7ffe0040-0x7ffe2318] machine # [ 0.002871] ACPI: Reserving FACS table memory at [mem 0x7ffe0000-0x7ffe003f] machine # [ 0.002871] ACPI: Reserving APIC table memory at [mem 0x7ffe240d-0x7ffe249c] machine # [ 0.002872] ACPI: Reserving HPET table memory at [mem 0x7ffe249d-0x7ffe24d4] machine # [ 0.002872] ACPI: Reserving MCFG table memory at [mem 0x7ffe24d5-0x7ffe2510] machine # [ 0.002873] ACPI: Reserving WAET table memory at [mem 0x7ffe2511-0x7ffe2538] machine # [ 0.003121] No NUMA configuration found machine # [ 0.003122] Faking a node at [mem 0x0000000000000000-0x000000017fffffff] machine # [ 0.003124] NODE_DATA(0) allocated [mem 0x17fffa780-0x17ffffcff] machine # [ 0.005481] Zone ranges: machine # [ 0.005482] DMA [mem 0x0000000000001000-0x0000000000ffffff] machine # [ 0.005484] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] machine # [ 0.005485] Normal [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005486] Device empty machine # [ 0.005487] Movable zone start for each node machine # [ 0.005488] Early memory node ranges machine # [ 0.005488] node 0: [mem 0x0000000000001000-0x000000000009efff] machine # [ 0.005489] node 0: [mem 0x0000000000100000-0x000000007ffd7fff] machine # [ 0.005490] node 0: [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005491] Initmem setup node 0 [mem 0x0000000000001000-0x000000017fffffff] machine # [ 0.005511] On node 0, zone DMA: 1 pages in unavailable ranges machine # [ 0.005785] On node 0, zone DMA: 97 pages in unavailable ranges machine # [ 0.078456] On node 0, zone Normal: 40 pages in unavailable ranges machine # [ 0.078936] ACPI: PM-Timer IO Port: 0x608 machine # [ 0.078950] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) machine # [ 0.078987] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 machine # [ 0.078989] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) machine # [ 0.078991] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) machine # [ 0.078993] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) machine # [ 0.078994] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) machine # [ 0.078995] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) machine # [ 0.078997] ACPI: Using ACPI (MADT) for SMP configuration information machine # [ 0.078998] ACPI: HPET id: 0x8086a201 base: 0xfed00000 machine # [ 0.079003] TSC deadline timer available machine # [ 0.079008] CPU topo: Max. logical packages: 1 machine # [ 0.079008] CPU topo: Max. logical dies: 1 machine # [ 0.079009] CPU topo: Max. dies per package: 1 machine # [ 0.079012] CPU topo: Max. threads per core: 1 machine # [ 0.079013] CPU topo: Num. cores per package: 4 machine # [ 0.079013] CPU topo: Num. threads per package: 4 machine # [ 0.079013] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs machine # [ 0.079039] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() machine # [ 0.079055] kvm-guest: KVM setup pv remote TLB flush machine # [ 0.079058] kvm-guest: setup PV sched yield machine # [ 0.079068] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] machine # [ 0.079069] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] machine # [ 0.079070] PM: hibernation: Registered nosave memory: [mem 0x7ffd8000-0xffffffff] machine # [ 0.079072] [mem 0xc0000000-0xfed1bfff] available for PCI devices machine # [ 0.079074] Booting paravirtualized kernel on KVM machine # [ 0.079078] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns machine # [ 0.083622] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 machine # [ 0.085976] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288 machine # [ 0.086029] kvm-guest: PV spinlocks enabled machine # [ 0.086031] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) machine # [ 0.086034] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/2nnda62anar3ksw14hmi5nhz2x2cp15k-nixos-system-machine-test/init regInfo=/nix/store/7cb3l3pi42ryp81g07xr979slrwq7yr7-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.086141] Unknown kernel command line parameters "regInfo=/nix/store/7cb3l3pi42ryp81g07xr979slrwq7yr7-closure-info/registration", will be passed to user space. machine # [ 0.086154] random: crng init done machine # [ 0.086155] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes machine # [ 0.090291] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) machine # [ 0.092375] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) machine # [ 0.092447] software IO TLB: area num 4. machine # [ 0.164590] Fallback order for Node 0: 0 machine # [ 0.164598] Built 1 zonelists, mobility grouping on. Total pages: 1048438 machine # [ 0.164600] Policy zone: Normal machine # [ 0.167092] mem auto-init: stack:all(zero), heap alloc:on, heap free:off machine # [ 0.174290] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 machine # [ 0.183156] allocated 8388608 bytes of page_ext machine # [ 0.193314] ftrace: allocating 48787 entries in 192 pages machine # [ 0.193317] ftrace: allocated 192 pages with 2 groups machine # [ 0.194198] Dynamic Preempt: lazy machine # [ 0.194373] rcu: Preemptible hierarchical RCU implementation. machine # [ 0.194374] rcu: RCU event tracing is enabled. machine # [ 0.194375] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. machine # [ 0.194376] Trampoline variant of Tasks RCU enabled. machine # [ 0.194377] Rude variant of Tasks RCU enabled. machine # [ 0.194377] Tracing variant of Tasks RCU enabled. machine # [ 0.194377] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. machine # [ 0.194378] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 machine # [ 0.194392] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.194394] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.194395] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.198818] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16 machine # [ 0.199158] rcu: srcu_init: Setting srcu_struct sizes based on contention. machine # [ 0.199167] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns machine # [ 0.199280] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) machine # [ 0.202892] Console: colour VGA+ 80x25 machine # [ 0.202895] printk: legacy console [tty0] enabled machine # [ 0.234471] printk: legacy console [ttyS0] enabled machine # [ 0.346386] ACPI: Core revision 20250807 machine # [ 0.347307] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns machine # [ 0.348939] APIC: Switch to symmetric I/O mode setup machine # [ 0.350000] x2apic enabled machine # [ 0.350760] APIC: Switched APIC routing to: physical x2apic machine # [ 0.351739] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask() machine # [ 0.353049] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself() machine # [ 0.354570] kvm-guest: setup PV IPIs machine # [ 0.356202] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 machine # [ 0.357302] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.361649] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) machine # [ 0.363734] x86/cpu: User Mode Instruction Prevention (UMIP) activated machine # [ 0.364781] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 machine # [ 0.365646] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 machine # [ 0.366649] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto machine # [ 0.368645] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl machine # [ 0.369645] Transient Scheduler Attacks: Vulnerable: No microcode machine # [ 0.370645] Spectre V2 : Mitigation: Enhanced / Automatic IBRS machine # [ 0.371645] Speculative Return Stack Overflow: Mitigation: Safe RET machine # [ 0.372645] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization machine # [ 0.373653] Spectre V2 : Enabling IBPB for BPF machine # [ 0.374646] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier machine # [ 0.375646] active return thunk: srso_alias_return_thunk machine # [ 0.376565] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' machine # [ 0.377645] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' machine # [ 0.378645] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' machine # [ 0.379645] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' machine # [ 0.380645] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' machine # [ 0.381645] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' machine # [ 0.383515] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' machine # [ 0.384646] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 machine # [ 0.385645] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 machine # [ 0.386645] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 machine # [ 0.387645] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 machine # [ 0.388645] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 machine # [ 0.389645] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. machine # [ 0.420352] Freeing SMP alternatives memory: 44K machine # [ 0.420649] pid_max: default: 32768 minimum: 301 machine # [ 0.421753] LSM: initializing lsm=capability,landlock,yama,bpf,ima machine # [ 0.422753] landlock: Up and running. machine # [ 0.423452] Yama: becoming mindful. machine # [ 0.424865] LSM support for eBPF active machine # [ 0.425823] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.426720] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.428960] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) machine # [ 0.430222] Performance Events: Fam17h+ core perfctr, AMD PMU driver. machine # [ 0.430654] ... version: 2 machine # [ 0.431456] ... bit width: 48 machine # [ 0.432260] ... generic counters: 6 machine # [ 0.432647] ... generic bitmap: 000000000000003f machine # [ 0.433607] ... fixed-purpose counters: 0 machine # [ 0.434204] ... fixed-purpose bitmap: 0000000000000000 machine # [ 0.434647] ... value mask: 0000ffffffffffff machine # [ 0.435571] ... max period: 00007fffffffffff machine # [ 0.436371] ... global_ctrl mask: 000000000000003f machine # [ 0.436766] signal: max sigframe size: 3376 machine # [ 0.437583] rcu: Hierarchical SRCU implementation. machine # [ 0.438314] rcu: Max phase no-delay instances is 400. machine # [ 0.438843] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level machine # [ 0.444491] smp: Bringing up secondary CPUs ... machine # [ 0.445684] smpboot: x86: Booting SMP configuration: machine # [ 0.446570] .... node #0, CPUs: #1 #2 #3 machine # [ 0.449789] smp: Brought up 1 node, 4 CPUs machine # [ 0.451393] smpboot: Total of 4 processors activated (19200.09 BogoMIPS) machine # [ 0.452201] Memory: 3957600K/4193752K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 220848K reserved, 0K cma-reserved) machine # [ 0.453648] devtmpfs: initialized machine # [ 0.454878] x86/mm: Memory block size: 128MB machine # [ 0.457721] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.458728] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). machine # [ 0.459728] pinctrl core: initialized pinctrl subsystem machine # [ 0.460952] PM: RTC time: 14:12:43, date: 2026-09-27 machine # [ 0.464458] NET: Registered PF_NETLINK/PF_ROUTE protocol family machine # [ 0.466264] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations machine # [ 0.466685] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations machine # [ 0.468195] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations machine # [ 0.468659] audit: initializing netlink subsys (disabled) machine # [ 0.469704] audit: type=2000 audit(1790518363.188:1): state=initialized audit_enabled=0 res=1 machine # [ 0.469926] thermal_sys: Registered thermal governor 'fair_share' machine # [ 0.471648] thermal_sys: Registered thermal governor 'bang_bang' machine # [ 0.472648] thermal_sys: Registered thermal governor 'step_wise' machine # [ 0.473647] thermal_sys: Registered thermal governor 'user_space' machine # [ 0.474637] thermal_sys: Registered thermal governor 'power_allocator' machine # [ 0.475458] cpuidle: using governor menu machine # [ 0.477859] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 machine # [ 0.478911] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] machine # [ 0.480650] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry machine # [ 0.481662] PCI: Using configuration type 1 for base access machine # [ 0.482817] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. machine # [ 0.485985] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages machine # [ 0.487531] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page machine # [ 0.488513] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages machine # [ 0.489555] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page machine # [ 0.494191] ACPI: Added _OSI(Module Device) machine # [ 0.496656] ACPI: Added _OSI(Processor Device) machine # [ 0.498654] ACPI: Added _OSI(Processor Aggregator Device) machine # [ 0.507291] ACPI: 1 ACPI AML tables successfully acquired and loaded machine # [ 0.515183] ACPI: Interpreter enabled machine # [ 0.516713] ACPI: PM: (supports S0 S3 S4 S5) machine # [ 0.518655] ACPI: Using IOAPIC for interrupt routing machine # [ 0.520785] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug machine # [ 0.524659] PCI: Using E820 reservations for host bridge windows machine # [ 0.528040] ACPI: Enabled 2 GPEs in block 00 to 3F machine # [ 0.540030] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) machine # [ 0.541662] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] machine # [ 0.544825] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] machine # [ 0.547898] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] machine # [ 0.550523] PCI host bridge to bus 0000:00 machine # [ 0.551672] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] machine # [ 0.554652] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] machine # [ 0.556652] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] machine # [ 0.558652] pci_bus 0000:00: root bus resource [mem 0x80000000-0xafffffff window] machine # [ 0.560648] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] machine # [ 0.561647] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.563649] pci_bus 0000:00: root bus resource [bus 00-ff] machine # [ 0.564791] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint machine # [ 0.566127] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint machine # [ 0.580025] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] machine # [ 0.582685] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] machine # [ 0.585710] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] machine # [ 0.588436] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] machine # [ 0.594848] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.605688] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] machine # [ 0.607669] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] machine # [ 0.610710] pci 0000:00:02.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref] machine # [ 0.613669] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] machine # [ 0.618020] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.627689] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] machine # [ 0.629669] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] machine # [ 0.631710] pci 0000:00:03.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref] machine # [ 0.635775] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint machine # [ 0.643908] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] machine # [ 0.645666] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] machine # [ 0.647730] pci 0000:00:04.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref] machine # [ 0.650912] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.658694] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] machine # [ 0.660672] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] machine # [ 0.663711] pci 0000:00:05.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref] machine # [ 0.666673] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] machine # [ 0.671081] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint machine # [ 0.678708] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] machine # [ 0.680726] pci 0000:00:06.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref] machine # [ 0.686204] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.692697] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] machine # [ 0.694696] pci 0000:00:07.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref] machine # [ 0.699775] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.704703] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] machine # [ 0.720526] pci 0000:00:08.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref] machine # [ 0.722674] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.726692] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] machine # [ 0.727670] pci 0000:00:09.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref] machine # [ 0.729423] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint machine # [ 0.734698] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] machine # [ 0.736664] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] machine # [ 0.737670] pci 0000:00:0a.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref] machine # [ 0.739235] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.742613] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] machine # [ 0.743346] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] machine # [ 0.744670] pci 0000:00:0b.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref] machine # [ 0.747295] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.749437] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] machine # [ 0.750854] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.752298] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] machine # [ 0.753855] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.756677] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] machine # [ 0.757901] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint machine # [ 0.760409] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] machine # [ 0.761911] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint machine # [ 0.762941] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO machine # [ 0.764895] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint machine # [ 0.767676] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] machine # [ 0.768681] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] machine # [ 0.769966] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint machine # [ 0.772334] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] machine # [ 0.776752] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 machine # [ 0.777755] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 machine # [ 0.778754] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 machine # [ 0.779749] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 machine # [ 0.780750] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 machine # [ 0.782748] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 machine # [ 0.783746] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 machine # [ 0.784766] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 machine # [ 0.785697] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 machine # [ 0.786661] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 machine # [ 0.787660] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 machine # [ 0.788979] ACPI: PCI: Interrupt link GSID configured for IRQ 19 machine # [ 0.791684] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 machine # [ 0.793698] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 machine # [ 0.795687] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 machine # [ 0.798693] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 machine # [ 0.805711] iommu: Default domain type: Translated machine # [ 0.807655] iommu: DMA domain TLB invalidation policy: lazy mode machine # [ 0.811073] ACPI: bus type USB registered machine # [ 0.812817] usbcore: registered new interface driver usbfs machine # [ 0.815712] usbcore: registered new interface driver hub machine # [ 0.817680] usbcore: registered new device driver usb machine # [ 0.822775] NetLabel: Initializing machine # [ 0.824655] NetLabel: domain hash size = 128 machine # [ 0.826653] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO machine # [ 0.828761] NetLabel: unlabeled traffic allowed by default machine # [ 0.830683] PCI: Using ACPI for IRQ routing machine # [ 0.888881] pci 0000:00:01.0: vgaarb: setting as boot VGA device machine # [ 0.889644] pci 0000:00:01.0: vgaarb: bridge control possible machine # [ 0.889644] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none machine # [ 0.892657] vgaarb: loaded machine # [ 0.893627] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 machine # [ 0.894362] hpet0: 3 comparators, 64-bit 100.000000 MHz counter machine # [ 0.899646] clocksource: Switched to clocksource kvm-clock machine # [ 0.901686] VFS: Disk quotas dquot_6.6.0 machine # [ 0.902453] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) machine # [ 0.904221] pnp: PnP ACPI init machine # [ 0.905110] ACPI: IRQ 4 override to edge(!), high(!) machine # [ 0.906172] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved machine # [ 0.907995] pnp: PnP ACPI: found 5 devices machine # [ 0.919104] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns machine # [ 0.922947] clocksource: Switched to clocksource acpi_pm machine # [ 0.925546] NET: Registered PF_INET protocol family machine # [ 0.929175] IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear) machine # [ 0.963072] tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.964607] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) machine # [ 0.966067] TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear) machine # [ 0.968610] TCP bind hash table entries: 32768 (order: 8, 1048576 bytes, linear) machine # [ 0.969957] TCP: Hash tables configured (established 32768 bind 32768) machine # [ 0.971169] MPTCP token hash table entries: 4096 (order: 5, 98304 bytes, linear) machine # [ 0.972531] UDP hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.973696] UDP-Lite hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.975172] NET: Registered PF_UNIX/PF_LOCAL protocol family machine # [ 0.976229] NET: Registered PF_XDP protocol family machine # [ 0.977142] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] machine # [ 0.978215] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] machine # [ 0.979283] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] machine # [ 0.980448] pci_bus 0000:00: resource 7 [mem 0x80000000-0xafffffff window] machine # [ 0.981648] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] machine # [ 0.982812] pci_bus 0000:00: resource 9 [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.984801] ACPI: \_SB_.GSIA: Enabled at IRQ 16 machine # [ 0.987004] ACPI: \_SB_.GSIB: Enabled at IRQ 17 machine # [ 0.989153] ACPI: \_SB_.GSIC: Enabled at IRQ 18 machine # [ 0.991228] ACPI: \_SB_.GSID: Enabled at IRQ 19 machine # [ 0.993062] PCI: CLS 0 bytes, default 64 machine # [ 0.993960] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) machine # [ 0.994325] Trying to unpack rootfs image as initramfs... machine # [ 0.995073] software IO TLB: mapped [mem 0x000000007a371000-0x000000007e371000] (64MB) machine # [ 0.995220] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 1.019075] Initialise system trusted keyrings machine # [ 1.020437] workingset: timestamp_bits=40 max_order=20 bucket_order=0 machine # [ 1.032043] Key type asymmetric registered machine # [ 1.032831] Asymmetric key parser 'x509' registered machine # [ 1.033728] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) machine # [ 1.035443] io scheduler mq-deadline registered machine # [ 1.036293] io scheduler kyber registered machine # [ 1.041668] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled machine # [ 1.043018] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A machine # [ 1.045417] Linux agpgart interface v0.103 machine # [ 1.046247] ACPI: bus type drm_connector registered machine # [ 1.052600] usbcore: registered new interface driver usbserial_generic machine # [ 1.055597] usbserial: USB Serial support registered for generic machine # [ 1.058175] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. machine # [ 1.058175] Please enable it if your BIOS has the CPPC option. machine # [ 1.064121] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled machine # [ 1.068089] drop_monitor: Initializing network drop monitor service machine # [ 1.071356] NET: Registered PF_INET6 protocol family machine # [ 1.075794] Segment Routing with IPv6 machine # [ 1.077578] In-situ OAM (IOAM) with IPv6 machine # [ 1.082078] IPI shorthand broadcast: enabled machine # [ 1.093374] sched_clock: Marking stable (939035415, 153477927)->(1115735101, -23221759) machine # [ 1.097985] registered taskstats version 1 machine # [ 1.100989] Loading compiled-in X.509 certificates machine # [ 1.123916] Demotion targets for Node 0: null machine # [ 1.125907] Key type .fscrypt registered machine # [ 1.127296] Key type fscrypt-provisioning registered machine # [ 1.129377] ima: No TPM chip found, activating TPM-bypass! machine # [ 1.131255] ima: Allocated hash algorithm: sha1 machine # [ 1.132944] ima: No architecture policies found machine # [ 1.135041] PM: Magic number: 10:700:233 machine # [ 1.138265] RAS: Correctable Errors collector initialized. machine # [ 1.145715] clk: Disabling unused clocks machine # [ 1.146432] PM: genpd: Disabling unused power domains machine # [ 1.285669] Freeing initrd memory: 29052K machine # [ 1.293874] Freeing unused decrypted memory: 2028K machine # [ 1.300924] Freeing unused kernel image (initmem) memory: 3652K machine # [ 1.303927] Write protecting the kernel read-only data: 32768k machine # [ 1.309374] Freeing unused kernel image (text/rodata gap) memory: 1184K machine # [ 1.313681] Freeing unused kernel image (rodata/data gap) memory: 720K machine # [ 1.384662] x86/mm: Checked W+X mappings: passed, no W+X pages found. machine # [ 1.385875] Run /init as init process machine # [ 1.398911] systemd[1]: Inserted module 'autofs4' machine # [ 1.425095] fuse: init (API version 7.45) machine # [ 1.434401] ACPI: \_SB_.GSIG: Enabled at IRQ 22 machine # [ 1.436927] ACPI: \_SB_.GSIH: Enabled at IRQ 23 machine # [ 1.440625] ACPI: \_SB_.GSIE: Enabled at IRQ 20 machine # [ 1.442882] ACPI: \_SB_.GSIF: Enabled at IRQ 21 machine # [ 1.448084] virtiofs virtio5: discovered new tag: nix-store machine # [ 1.449799] virtiofs virtio5: virtio_fs_setup_dax: No cache capability machine # [ 1.456926] virtiofs virtio6: discovered new tag: shared machine # [ 1.469989] virtiofs virtio6: virtio_fs_setup_dax: No cache capability machine # [ 1.475130] virtiofs virtio7: discovered new tag: xchg machine # [ 1.476877] virtiofs virtio7: virtio_fs_setup_dax: No cache capability machine # [ 1.501635] systemd[1]: Successfully made /usr/ read-only. machine # [ 1.841227] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 1.854282] systemd[1]: Detected virtualization kvm. machine # [ 1.856579] systemd[1]: Detected architecture x86-64. machine # [ 1.858882] systemd[1]: Running in initrd. machine # [ 1.861586] systemd[1]: Initializing machine ID from random generator. machine # [ 1.864781] systemd[1]: Hostname set to . machine # [ 1.992280] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 2.034264] systemd[1]: Queued start job for default target Initrd Default Target. machine # [ 2.045221] systemd[1]: Created slice Slice /system/modprobe. machine # [ 2.046464] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 2.048012] systemd[1]: Expecting device /dev/disk/by-label/nixos... machine # [ 2.049212] systemd[1]: Reached target Path Units. machine # [ 2.050145] systemd[1]: Reached target Slice Units. machine # [ 2.051166] systemd[1]: Reached target Swaps. machine # [ 2.052098] systemd[1]: Reached target Timer Units. machine # [ 2.053150] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 2.054420] systemd[1]: Listening on Journal Socket (/dev/log). machine # [ 2.055672] systemd[1]: Listening on Journal Sockets. machine # [ 2.056736] systemd[1]: Listening on udev Control Socket. machine # [ 2.057767] systemd[1]: Listening on udev Kernel Socket. machine # [ 2.058725] systemd[1]: Reached target Socket Units. machine # [ 2.060918] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 2.063132] systemd[1]: Starting Load Kernel Module configfs... machine # [ 2.066306] systemd[1]: Starting Journal Service... machine # [ 2.070565] systemd[1]: Starting Load Kernel Modules... machine # [ 2.071603] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 2.078573] systemd[1]: Starting Coldplug All udev Devices... machine # [ 2.087002] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 2.088876] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 2.090466] systemd[1]: Finished Load Kernel Module configfs. machine # [ 2.092172] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config machine # [ 2.097569] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 2.105080] systemd-journald[92]: Collecting audit messages is disabled. machine # [ 2.114654] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 2.118563] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 2.118849] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. machine # [ 2.122553] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev machine # [ 2.127676] systemd[1]: Finished Load Kernel Modules. machine # [ 2.131670] systemd[1]: Starting Apply Kernel Variables... machine # [ 2.133977] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 2.135514] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 2.136831] systemd[1]: Reached target Local File Systems. machine # [ 2.140752] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 2.142904] systemd[1]: Finished Apply Kernel Variables. machine # [ 2.153912] systemd[1]: Started Journal Service. machine # [ 2.000520] systemd-modules-load[93]: Using 4 probe threads machine # [ 2.002586] systemd-modules-load[93]: Inserted module 'virtio_balloon' machine # [ 2.003730] systemd-modules-load[93]: Inserted module 'virtio_gpu' machine # [ 2.004832] systemd-modules-load[93]: Inserted module 'dm_mod' machine # [ 2.005852] systemd[1]: Starting Create System Files and Directories... machine # [ 2.009541] systemd-udevd[106]: Using default interface naming scheme 'v261'. machine # [ 2.020772] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 2.026063] systemd[1]: Finished Create System Files and Directories. machine # [ 2.060192] systemd[1]: Finished Coldplug All udev Devices. machine # [ 2.061255] systemd[1]: Reached target System Initialization. machine # [ 2.062160] systemd[1]: Reached target Basic System. machine # [ 2.297781] ehci-pci 0000:00:1d.7: EHCI Host Controller machine # [ 2.298598] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 machine # [ 2.302790] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 machine # [ 2.305515] virtio_blk virtio2: 4/0/0 default/read/poll queues machine # [ 2.311511] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 machine # [ 2.312568] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 machine # [ 2.313681] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.314801] usb usb1: Product: EHCI Host Controller machine # [ 2.315580] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd machine # [ 2.316423] usb usb1: SerialNumber: 0000:00:1d.7 machine # [ 2.318467] SCSI subsystem initialized machine # [ 2.319320] virtio_blk virtio2: [vda] 33554432 512-byte logical blocks (17.2 GB/16.0 GiB) machine # [ 2.323234] hub 1-0:1.0: USB hub found machine # [ 2.323942] hub 1-0:1.0: 6 ports detected machine # [ 2.334282] uhci_hcd 0000:00:1d.0: UHCI Host Controller machine # [ 2.335244] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 machine # [ 2.336446] uhci_hcd 0000:00:1d.0: detected 2 ports machine # [ 2.337274] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 machine # [ 2.186069] systemd[1]: Starting Virtual Console Setup... machine # [ 2.341347] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 machine # [ 2.346276] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.347943] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.350351] usb usb2: Product: UHCI Host Controller machine # [ 2.352281] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd machine # [ 2.353133] usb usb2: SerialNumber: 0000:00:1d.0 machine # [ 2.200531] (udev-worker)[120]: Network interface NamePolicy= disabled on kernel command line. machine # [ 2.354037] hub 2-0:1.0: USB hub found machine # [ 2.357503] hub 2-0:1.0: 2 ports detected machine # [ 2.357701] serio: i8042 KBD port at 0x60,0x64 irq 1 machine # [ 2.205713] (udev-worker)[126]: eth1: Config file /etc/systemd/network/40-eth1.link i[ 2.358991] serio: i8042 AUX port at 0x60,0x64 irq 12 machine # s applied to dev[ 2.359864] uhci_hcd 0000:00:1d.1: UHCI Host Controller machine # ice based on potentially unpredictable interface name. machine # [ 2.210215] (udev-worker)[126]: Network interface NamePolicy= disabled on kernel command line. machine # [ 2.370120] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 machine # [ 2.220081] systemd-vconsole-setup[143]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 2.223461] systemd[1]: Finished Virtual Console Setup. machine # [ 2.377775] uhci_hcd 0000:00:1d.1: detected 2 ports machine # [ 2.379521] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 machine # [ 2.381632] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 machine # [ 2.381883] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.384417] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.385655] usb usb3: Product: UHCI Host Controller machine # [ 2.386331] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd machine # [ 2.233782] systemd[1]: Found device /dev/disk/by-label/nixos. machine # [ 2.388051] usb usb3: SerialNumber: 0000:00:1d.1 machine # [ 2.235594] systemd[1]: Reached target Initrd Root Device. machine # [ 2.236600] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... machine # [ 2.391284] hub 3-0:1.0: USB hub found machine # [ 2.392524] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode machine # [ 2.392538] hub 3-0:1.0: 2 ports detected machine # [ 2.392869] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) machine # [ 2.395948] uhci_hcd 0000:00:1d.2: UHCI Host Controller machine # [ 2.396621] ahci 0000:00:1f.2: flags: 64bit ncq only machine # [ 2.398238] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 machine # [ 2.399683] uhci_hcd 0000:00:1d.2: detected 2 ports machine # [ 2.400551] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 machine # [ 2.401465] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.402384] scsi host0: ahci machine # [ 2.402788] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.403702] scsi host1: ahci machine # [ 2.404324] usb usb4: Product: UHCI Host Controller machine # [ 2.405103] scsi host2: ahci machine # [ 2.405601] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd machine # [ 2.405604] usb usb4: SerialNumber: 0000:00:1d.2 machine # [ 2.406696] scsi host3: ahci machine # [ 2.407444] hub 4-0:1.0: USB hub found machine # [ 2.408952] scsi host4: ahci machine # [ 2.409304] scsi host5: ahci machine # [ 2.409502] hub 4-0:1.0: 2 ports detected machine # [ 2.410456] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 50 lpm-pol 1 machine # [ 2.412269] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 50 lpm-pol 1 machine # [ 2.413782] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 50 lpm-pol 1 machine # [ 2.415669] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 50 lpm-pol 1 machine # [ 2.417553] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 50 lpm-pol 1 machine # [ 2.419000] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 50 lpm-pol 1 machine # [ 2.269472] systemd-fsck[164]: nixos: clean, 12/1048576 files, 109865/4194304 blocks machine # [ 2.274959] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. machine # [ 2.561731] usb 1-1: new high-speed USB device number 2 using ehci-pci machine # [ 2.693046] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 machine # [ 2.696313] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 machine # [ 2.699172] usb 1-1: Product: QEMU USB Tablet machine # [ 2.700883] usb 1-1: Manufacturer: QEMU machine # [ 2.702516] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 machine # [ 2.735929] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) machine # [ 2.738437] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 machine # [ 2.739782] hid: raw HID events driver (C) Jiri Kosina machine # [ 2.740633] ata3.00: applying bridge limits machine # [ 2.744248] ata4: SATA link down (SStatus 0 SControl 300) machine # [ 2.746387] ata3.00: configured for UDMA/100 machine # [ 2.748458] ata6: SATA link down (SStatus 0 SControl 300) machine # [ 2.751083] ata1: SATA link down (SStatus 0 SControl 300) machine # [ 2.753341] ata5: SATA link down (SStatus 0 SControl 300) machine # [ 2.755873] ata2: SATA link down (SStatus 0 SControl 300) machine # [ 2.758538] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 machine # [ 2.796200] usbcore: registered new interface driver usbhid machine # [ 2.798388] usbhid: USB HID core driver machine # [ 2.808738] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 machine # [ 2.813179] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 machine # [ 2.831009] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray machine # [ 2.873761] cdrom: Uniform CD-ROM driver Revision: 3.20 machine # [ 2.932953] systemd[1]: Mounting /sysroot... machine # [ 3.235133] EXT4-fs (vda): mounted filesystem 0a7f0bdb-e913-4144-b6cb-14372ee7a991 r/w with ordered data mode. Quota mode: none. machine # [ 3.117183] systemd[1]: Mounted /sysroot. machine # [ 3.119088] systemd[1]: Reached target Initrd Root File System. machine # [ 3.123397] systemd[1]: Mounting /sysroot/nix/.ro-store... machine # [ 3.125409] systemd[1]: Mounting /sysroot/nix/.rw-store... machine # [ 3.129157] systemd[1]: Mounting /sysroot/run... machine # [ 3.139223] systemd[1]: Mounting /sysroot/tmp/shared... machine # [ 3.140805] systemd[1]: Mounting /sysroot/tmp/xchg... machine # [ 3.145077] systemd[1]: Starting Mountpoints Configured in the Real Root... machine # [ 3.152092] systemd[1]: Mounted /sysroot/nix/.ro-store. machine # [ 3.152921] systemd[1]: Mounted /sysroot/nix/.rw-store. machine # [ 3.153706] systemd[1]: Mounted /sysroot/run. machine # [ 3.159287] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.162453] systemd[1]: Mounted /sysroot/tmp/xchg. machine # [ 3.167088] systemd[1]: Mounted /sysroot/tmp/shared. machine # [ 3.168655] systemd-sysroot-fstab-check[193]: /sysroot should be mounted in the initrd, will request daemon-reload. machine # [ 3.171489] systemd[1]: Reload requested from client PID 193 ('systemd-sysroot') (unit initrd-parse-etc.service)... machine # [ 3.173283] systemd[1]: Reloading... machine # [ 3.243335] systemd[1]: Reloading finished in 71 ms. machine # [ 3.267727] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.270576] systemd-sysroot-fstab-check[193]: Requesting initrd-fs.target/start/replace... machine # [ 3.273455] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.275735] systemd-sysroot-fstab-check[193]: Requesting swap.target/start/replace... machine # [ 3.278427] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.280518] systemd[1]: initrd-parse-etc.service: Deactivated successfully. machine # [ 3.282995] systemd[1]: Finished Mountpoints Configured in the Real Root. machine # [ 3.285365] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. machine # [ 3.298296] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.301075] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.934129] systemd[1]: Mounting /sysroot/nix/store... machine # [ 3.993079] systemd[1]: Mounted /sysroot/nix/store. machine # [ 3.995332] systemd[1]: Reached target Initrd File Systems. machine # [ 3.997454] systemd[1]: Starting Find NixOS closure... machine # [ 3.999597] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... machine # [ 4.026499] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. machine # [ 4.029187] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. machine # [ 4.047541] systemd[1]: Finished Find NixOS closure. machine # [ 4.049672] systemd[1]: Reached target Initrd Default Target. machine # [ 4.051964] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... machine # [ 4.079378] systemd[1]: Stopped target Initrd Default Target. machine # [ 4.081430] systemd[1]: Stopped target Basic System. machine # [ 4.083252] systemd[1]: Stopped target Initrd Root Device. machine # [ 4.085171] systemd[1]: Stopped target Path Units. machine # [ 4.086935] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. machine # [ 4.089455] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. machine # [ 4.092272] systemd[1]: Stopped target Slice Units. machine # [ 4.094961] systemd[1]: Stopped target Socket Units. machine # [ 4.098898] systemd[1]: Stopped target System Initialization. machine # [ 4.101076] systemd[1]: Stopped target Swaps. machine # [ 4.103215] systemd[1]: Stopped target Timer Units. machine # [ 4.104939] systemd[1]: dbus.socket: Deactivated successfully. machine # [ 4.107065] systemd[1]: Closed D-Bus System Message Bus Socket. machine # [ 4.109230] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. machine # [ 4.112071] systemd[1]: Stopped Find NixOS closure. machine # [ 4.113940] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 4.115853] systemd[1]: systemd-sysctl.service: Deactivated successfully. machine # [ 4.118312] systemd[1]: Stopped Apply Kernel Variables. machine # [ 4.119928] systemd[1]: systemd-modules-load.service: Deactivated successfully. machine # [ 4.121923] systemd[1]: Stopped Load Kernel Modules. machine # [ 4.123333] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. machine # [ 4.125366] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. machine # [ 4.127449] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. machine # [ 4.129508] systemd[1]: Stopped Create System Files and Directories. machine # [ 4.131213] systemd[1]: Stopped target Local File Systems. machine # [ 4.132792] systemd[1]: Stopped target Preparation for Local File Systems. machine # [ 4.134650] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. machine # [ 4.136590] systemd[1]: Stopped Coldplug All udev Devices. machine # [ 4.137627] systemd[1]: Stopping Rule-based Manager for Device Events and Files... machine # [ 4.138946] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 4.140211] systemd[1]: Stopped Virtual Console Setup. machine # [ 4.141220] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 4.142411] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 4.143222] systemd[1]: initrd-cleanup.service: Deactivated successfully. machine # [ 4.144201] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. machine # [ 4.145140] systemd[1]: systemd-udevd.service: Deactivated successfully. machine # [ 4.146091] systemd[1]: Stopped Rule-based Manager for Device Events and Files. machine # [ 4.147114] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. machine # [ 4.148137] systemd[1]: Closed udev Control Socket. machine # [ 4.148887] systemd[1]: Starting Cleanup udev Database... machine # [ 4.149678] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. machine # [ 4.150769] systemd[1]: Stopped Create Static Device Nodes in /dev. machine # [ 4.151671] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. machine # [ 4.152790] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. machine # [ 4.153811] systemd[1]: kmod-static-nodes.service: Deactivated successfully. machine # [ 4.154803] systemd[1]: Stopped Create List of Static Device Nodes. machine # [ 4.176229] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. machine # [ 4.177398] systemd[1]: Finished Cleanup udev Database. machine # [ 4.178938] systemd[1]: Reached target Switch Root. machine # [ 4.180930] systemd[1]: Starting NixOS Activation... machine # [ 4.342872] initrd-nixos-activation-start[239]: booting system configuration /nix/store/2nnda62anar3ksw14hmi5nhz2x2cp15k-nixos-system-machine-test machine # [ 4.409094] initrd-nixos-activation-start[239]: running activation script... machine # [ 4.736077] initrd-nixos-activation-start[262]: setting up /etc... machine # [ 4.909661] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. machine # [ 4.912885] systemd[1]: Finished NixOS Activation. machine # [ 4.917322] systemd[1]: Starting Switch Root... machine # [ 4.940655] systemd[1]: Switching root. machine # [ 5.160292] systemd-journald[92]: Received SIGTERM from PID 1 (systemd). machine # [ 5.260618] NET: Registered PF_VSOCK protocol family machine # [ 5.638234] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 5.647584] systemd[1]: Detected virtualization kvm. machine # [ 5.649422] systemd[1]: Detected architecture x86-64. machine # [ 5.651435] systemd[1]: Detected first boot. machine # [ 5.656295] systemd[1]: Initializing machine ID from random generator. machine # [ 5.801304] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 5.885433] systemd[1]: Applying preset policy. machine # [ 6.068877] systemd[1]: Populated /etc with preset unit settings. machine # [ 6.308656] systemd[1]: initrd-switch-root.service: Deactivated successfully. machine # [ 6.310122] systemd[1]: Stopped initrd-switch-root.service. machine # [ 6.312563] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. machine # [ 6.314765] systemd[1]: Created slice Slice /system/getty. machine # [ 6.316218] systemd[1]: Created slice User and Session Slice. machine # [ 6.317241] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 6.318608] systemd[1]: Started Forward Password Requests to Wall Directory Watch. machine # [ 6.319831] systemd[1]: Expecting device /dev/hvc0... machine # [ 6.320602] systemd[1]: Expecting device /dev/ttyS0... machine # [ 6.321503] systemd[1]: Reached target Local Encrypted Volumes. machine # [ 6.322448] systemd[1]: Stopped target initrd-fs.target. machine # [ 6.323330] systemd[1]: Stopped target initrd-root-fs.target. machine # [ 6.324344] systemd[1]: Stopped target initrd-switch-root.target. machine # [ 6.325363] systemd[1]: Reached target Virtual Machines and Containers. machine # [ 6.326382] systemd[1]: Reached target Path Units. machine # [ 6.327197] systemd[1]: Reached target Remote File Systems. machine # [ 6.328123] systemd[1]: Reached target Slice Units. machine # [ 6.328895] systemd[1]: Reached target Swaps. machine # [ 6.331054] systemd[1]: Listening on Query the User Interactively for a Password. machine # [ 6.333774] systemd[1]: Listening on Process Core Dump Socket. machine # [ 6.335658] systemd[1]: Listening on Credential Encryption/Decryption. machine # [ 6.337855] systemd[1]: Listening on Factory Reset Management. machine # [ 6.338847] systemd[1]: Listening on Hostname Service Socket. machine # [ 6.342031] systemd[1]: Starting Journal Log Access Socket... machine # [ 6.343498] systemd[1]: Listening on Journal Audit Socket. machine # [ 6.345823] systemd[1]: Listening on Console Output Muting Service Socket. machine # [ 6.347206] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. machine # [ 6.348419] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.349959] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki machine # [ 6.354755] systemd[1]: Listening on Disk Repartitioning Service Socket. machine # [ 6.355884] systemd[1]: Listening on udev Control Socket. machine # [ 6.356799] systemd[1]: Listening on udev Varlink Socket. machine # [ 6.359344] systemd[1]: Mounting Huge Pages File System... machine # [ 6.361765] systemd[1]: Mounting POSIX Message Queue File System... machine # [ 6.364051] systemd[1]: Mounting Kernel Debug File System... machine # [ 6.366345] systemd[1]: Mounting Kernel Trace File System... machine # [ 6.373480] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 6.376103] systemd[1]: Starting Load Kernel Module configfs... machine # [ 6.377055] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm machine # [ 6.378716] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.380400] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.385184] systemd[1]: Mounting FUSE Control File System... machine # [ 6.386225] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.391516] systemd[1]: Starting Journal Service... machine # [ 6.396207] systemd[1]: Starting Load Kernel Modules... machine # [ 6.404512] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... machine # [ 6.406677] systemd[1]: Starting Remount Root and Kernel File Systems... machine # [ 6.407794] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.414553] systemd[1]: Starting Coldplug All udev Devices... machine # [ 6.416984] systemd[1]: Listening on Journal Log Access Socket. machine # [ 6.419236] systemd[1]: Mounted Huge Pages File System. machine # [ 6.420694] systemd[1]: Mounted POSIX Message Queue File System. machine # [ 6.421791] systemd[1]: Mounted Kernel Debug File System. machine # [ 6.422778] systemd[1]: Mounted Kernel Trace File System. machine # [ 6.423858] systemd[1]: Mounted FUSE Control File System. machine # [ 6.433141] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 6.434782] systemd-journald[332]: Collecting audit messages is enabled. machine # [ 6.435657] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 6.444186] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 6.447592] systemd[1]: Finished Load Kernel Module configfs. machine # [ 6.298697] systemd[1]: Queued start job for default target Multi-User System. machine # [ 6.452904] systemd[1]: Mounting Kernel Configuration File System... machine # [ 6.299995] systemd[1]: systemd-journald.service: Deactivated successfully. machine # [ 6.454238] systemd[1]: Started Journal Service. machine # [ 6.302761] systemd-modules-load[333]: Using 2 probe threads machine # [ 6.462565] EXT4-fs (vda): re-mounted 0a7f0bdb-e913-4144-b6cb-14372ee7a991. machine # [ 6.312322] systemd-oomd[334]: No swap; memory pressure usage will be degraded machine # [ 6.315676] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. machine # [ 6.318930] systemd[1]: Finished Remount Root and Kernel File Systems. machine # [ 6.320147] systemd[1]: Listening on Disk Image Download Service Socket. machine # [ 6.322418] systemd[1]: Starting Flush Journal to Persistent Storage... machine # [ 6.323341] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.326513] systemd[1]: Start[ 6.479423] loop: module loaded machine # ing Load/Save OS Random Seed... machine # [ 6.327767] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.331141] systemd[1]: Mounted Kernel Configuration File System. machine # [ 6.333971] systemd-modules-load[333]: Inserted module 'loop' machine # [ 6.335284] systemd[1]: Finished Load Kernel Modules. machine # [ 6.336307] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 6.337290] systemd[1]: Starting Apply Kernel Variables... machine # [ 6.338050] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 6.497958] systemd-journald[332]: Received client request to flush runtime journal. machine # [ 6.402125] systemd[1]: Finished Load/Save OS Random Seed. machine # [ 6.403594] systemd[1]: Reached target First Boot Complete. machine # [ 6.404611] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 6.405557] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 6.406516] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 6.407547] systemd[1]: Finished Apply Kernel Variables. machine # [ 6.408307] systemd[1]: Finished Flush Journal to Persistent Storage. machine # [ 6.410968] systemd-udevd[360]: Using default interface naming scheme 'v261'. machine # [ 6.440667] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 6.447589] systemd[1]: Finished Coldplug All udev Devices. machine # [ 6.510058] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.538435] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. machine # [ 6.545789] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. machine # [ 6.547935] (udev-worker)[376]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 6.550269] (udev-worker)[376]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.551701] (udev-worker)[371]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.568950] systemd[1]: Condition check resulted in Virtio network device being skipped. machine # [ 6.570135] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.571799] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.573980] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.575594] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.576882] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.754244] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console machine # [ 6.768752] Console: switching to colour dummy device 80x25 machine # [ 6.769556] [drm] Found bochs VGA, ID 0xb0c5. machine # [ 6.770074] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. machine # [ 6.785154] mousedev: PS/2 mouse device common for all mice machine # [ 6.786148] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic machine # [ 6.786902] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 machine # [ 6.786944] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input3 machine # [ 6.790276] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized machine # [ 6.797340] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input4 machine # [ 6.802284] Console: switching to colour frame buffer device 160x50 machine # [ 6.805255] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device machine # [ 6.823639] rtc_cmos PNP0B00:00: RTC can wake from S4 machine # [ 6.829825] parport_pc 00:02: reported by Plug and Play ACPI machine # [ 6.832569] ACPI: button: Power Button [PWRF] machine # [ 6.835931] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] machine # [ 6.837773] rtc_cmos PNP0B00:00: registered as rtc0 machine # [ 6.838537] rtc_cmos PNP0B00:00: setting system clock to 2026-09-27T14:12:49 UTC (1790518369) machine # [ 6.840028] systemd-journald[332]: Time jumped backwards, rotating. machine # [ 6.841664] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs machine # [ 6.863182] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt machine # [ 6.865388] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD machine # [ 6.768815] systemd[1]: Starting Virtual Console Setup... machine # [ 6.926512] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 machine # [ 6.931125] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 machine # [ 6.934706] iTCO_wdt iTCO_wdt.0.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) machine # [ 6.795516] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 6.950162] iTCO_wdt iTCO_wdt.0.auto: initialized. heartbeat=30 sec (nowayout=0) machine # [ 6.958538] ppdev: user-space parallel port driver machine # [ 6.808368] systemd[1]: Stopped Virtual Console Setup. machine # [ 6.819879] systemd[1]: Starting Virtual Console Setup... machine # [ 6.829456] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 6.830736] systemd[1]: Stopped Virtual Console Setup. machine # [ 6.833661] systemd[1]: Starting Virtual Console Setup... machine # [ 7.019916] kvm_amd: TSC scaling supported machine # [ 7.020364] kvm_amd: Nested Virtualization enabled machine # [ 7.020990] kvm_amd: Nested Paging enabled machine # [ 7.021408] kvm_amd: LBR virtualization supported machine # [ 7.022011] kvm_amd: Virtual VMLOAD VMSAVE supported machine # [ 7.022570] kvm_amd: Virtual GIF supported machine # [ 7.023032] kvm_amd: Virtual NMI enabled machine # [ 7.117440] EDAC MC: Ver: 3.0.0 machine # [ 7.014457] systemd-vconsole-setup[408]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 7.016960] systemd[1]: Finished Virtual Console Setup. machine # [ 7.160597] systemd[1]: Mounting /run/wrappers... machine # [ 7.195080] systemd[1]: Mounted /run/wrappers. machine # [ 7.196844] systemd[1]: Reached target Local File Systems. machine # [ 7.199561] systemd[1]: Listening on Boot Loader Control Service Socket. machine # [ 7.202897] systemd[1]: Starting register-nix-paths.service... machine # [ 7.206062] systemd[1]: Starting Create SUID/SGID Wrappers... machine # [ 7.208226] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. machine # [ 7.211552] systemd[1]: Starting Save Transient machine-id to Disk... machine # [ 7.216084] systemd[1]: Starting Create System Files and Directories... machine # [ 7.292556] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. machine # [ 7.294750] systemd[1]: Finished Save Transient machine-id to Disk. machine # [ 7.312243] systemd[1]: Finished Create System Files and Directories. machine # [ 7.314908] systemd[1]: Starting Rebuild Journal Catalog... machine # [ 7.317498] systemd[1]: Starting Record System Boot/Shutdown in UTMP... machine # [ 7.341875] systemd[1]: Finished Record System Boot/Shutdown in UTMP. machine # [ 7.359503] systemd[1]: Finished Rebuild Journal Catalog. machine # [ 7.361227] systemd[1]: Starting Update is Completed... machine # [ 7.393217] systemd[1]: Finished Update is Completed. machine # [ 7.494933] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. machine # [ 7.496155] systemd[1]: Finished Create SUID/SGID Wrappers. machine # [ 7.752631] systemd[1]: Finished register-nix-paths.service. machine # [ 7.754980] systemd[1]: Reached target System Initialization. machine # [ 7.757226] systemd[1]: Started Discard unused filesystem blocks once a week. machine # [ 7.759702] systemd[1]: Started niks3 garbage collection timer. machine # [ 7.761898] systemd[1]: Started Daily Cleanup of Temporary Directories. machine # [ 7.764369] systemd[1]: Reached target Timer Units. machine # [ 7.766273] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 7.768554] systemd[1]: Listening on niks3 server socket. machine # [ 7.770536] systemd[1]: Listening on Nix Daemon Socket. machine # [ 7.772478] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. machine # [ 7.775445] systemd[1]: Reached target Socket Units. machine # [ 7.777390] systemd[1]: Reached target Basic System. machine # [ 7.779358] systemd[1]: Started backdoor.service. machine # [ 7.781211] systemd[1]: Starting Import lastlog data into lastlog2 database... machine # [ 7.783734] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 7.786738] systemd[1]: Starting Post-Boot Actions... machine # [ 7.789133] systemd[1]: Started Reset console on configuration changes. machine # [ 7.792203] systemd[1]: Starting resolvconf update... machine # [ 7.795507] systemd[1]: Started rustfs.service. machine # [ 7.797693] systemd[1]: Starting rustfs-bucket.service... machine # [ 7.803104] systemd[1]: Starting D-Bus System Message Bus... machine # [ 7.836790] systemd[1]: Finished Post-Boot Actions. machine # connecting to host... machine # [ 7.855146] systemd[1]: Finished Import lastlog data into lastlog2 database. machine # [ 7.857245] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 7.858069] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 7.859335] nsncd[491]: Sep 27 14:12:50.671 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 7.860318] systemd[1]: Reached target User and Group Name Lookups. machine # [ 7.862876] systemd[1]: Starting User Login Management... machine: Guest shell says: b'Spawning backdoor root shell...\n' machine: connected to guest root shell machine: (connecting took 8.60 seconds) machine: (finished: waiting for the VM to finish booting, in 8.86 seconds) machine # [ 7.894723] dbus-broker-launch[497]: Looking up NSS user entry for 'systemd-timesync'... machine # [ 7.904277] dbus-broker-launch[497]: NSS returned no entry for 'systemd-timesync' machine # [ 7.905199] dbus-broker-launch[497]: Invalid user-name in /nix/store/d3mrkr0v9x5sgbb0rb2pnsl0mysb1m4x-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" machine # [ 7.912689] systemd[1]: Started D-Bus System Message Bus. machine # [ 7.924554] dbus-broker-launch[497]: Ready machine # [ 7.946746] systemd-logind[523]: New seat seat0. machine # [ 7.950830] systemd-logind[523]: Watching system buttons on /dev/input/event3 (Power Button) machine # [ 7.951645] systemd-logind[523]: Watching system buttons on /dev/input/event2 (QEMU Virtio Keyboard) machine # [ 7.952353] systemd-logind[523]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) machine # [ 7.952825] systemd[1]: Started User Login Management. machine # [ 7.956810] systemd[1]: Starting linger-users.service... machine # [ 7.969666] systemd[1]: Stopped target Host and Network Name Lookups. machine # [ 7.970244] systemd[1]: Stopping Host and Network Name Lookups... machine # [ 7.970719] systemd[1]: Stopped target User and Group Name Lookups. machine # [ 7.971191] systemd[1]: Stopping User and Group Name Lookups... machine # [ 7.973064] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... machine # [ 7.974607] systemd[1]: nscd.service: Deactivated successfully. machine # [ 7.975503] systemd[1]: Stopped Name Service Cache Daemon (nsncd). machine # [ 7.977787] systemd[1]: linger-users.service: Deactivated successfully. machine # [ 7.978548] systemd[1]: Finished linger-users.service. machine # [ 7.981936] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 8.011355] nsncd[594]: Sep 27 14:12:50.825 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 8.011779] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 8.012564] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 8.013041] systemd[1]: Reached target User and Group Name Lookups. machine # [ 8.036529] systemd[1]: Finished resolvconf update. machine # [ 8.037508] systemd[1]: Reached target Preparation for Network. machine # [ 8.039714] systemd[1]: Starting DHCP Client... machine # [ 8.042124] systemd[1]: Starting Address configuration of eth1... machine # [ 8.043977] systemd[1]: Starting Extra networking commands.... machine # [ 8.104079] network-addresses-eth1-start[623]: adding address 192.168.1.1/24... done machine # [ 8.118365] network-addresses-eth1-start[623]: adding address 2001:db8:1::1/64... done machine # [ 8.135676] systemd[1]: Finished Address configuration of eth1. machine # [ 8.148484] dhcpcd[635]: dhcpcd-10.3.2 starting machine # [ 8.153630] dhcpcd[684]: dev: loaded udev machine # [ 8.318232] 8021q: 802.1Q VLAN Support v1.8 machine # [ 8.319429] 8021q: adding VLAN 0 to HW filter on device eth1 machine # [ 8.171742] systemd[1]: Finished Extra networking commands.. machine # [ 8.172598] systemd[1]: Reached target Network. machine # [ 8.174855] systemd[1]: Starting PostgreSQL Server... machine # [ 8.176974] systemd[1]: Starting Permit User Sessions... machine # [ 8.190453] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. machine # [ 8.202729] systemd[1]: Finished Permit User Sessions. machine # [ 8.204756] systemd[1]: Started Getty on tty1. machine # [ 8.205859] systemd[1]: Reached target Login Prompts. machine # [ 8.419178] cfg80211: Loading compiled-in X.509 certificates for regulatory database machine # [ 8.436624] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' machine # [ 8.438382] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' machine # [ 8.440571] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 machine # [ 8.441800] cfg80211: failed to load regulatory.db machine # [ 8.325370] postgresql-pre-start[710]: The files belonging to this database system will be owned by user "postgres". machine # [ 8.326125] postgresql-pre-start[710]: This user must also own the server process. machine # [ 8.330581] postgresql-pre-start[710]: The database cluster will be initialized with locale "en_US.UTF-8". machine # [ 8.331360] postgresql-pre-start[710]: The def[ 8.485012] 8021q: adding VLAN 0 to HW filter on device eth0 machine # ault database encoding has accordingly been set to "UTF8". machine # [ 8.332139] postgresql-pre-start[710]: The default text search configuration will be set to "english". machine # [ 8.332315] postgresql-pre-start[710]: Data page checksums are enabled. machine # [ 8.334210] postgresql-pre-start[710]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok machine # [ 8.334846] dhcpcd[684]: eth0: waiting for carrier machine # [ 8.335675] dhcpcd[684]: eth0: carrier acquired machine # [ 8.339141] postgresql-pre-start[710]: creating subdirectories ... ok machine # [ 8.339870] postgresql-pre-start[710]: selecting dynamic shared memory implementation ... posix machine # [ 8.344987] dhcpcd[684]: DUID 00:01:00:01:32:4b:e0:e3:52:54:00:12:34:56 machine # [ 8.345508] dhcpcd[684]: eth0: IAID 00:12:34:56 machine # [ 8.346054] dhcpcd[684]: eth0: adding address fe80::5054:ff:fe12:3456 machine # [ 8.405078] postgresql-pre-start[710]: selecting default "max_connections" ... 100 machine # [ 8.461928] postgresql-pre-start[710]: selecting default "shared_buffers" ... 128MB machine # [ 9.188223] postgresql-pre-start[710]: selecting default time zone ... UTC machine # [ 9.190879] postgresql-pre-start[710]: creating configuration files ... ok machine # [ 9.369396] postgresql-pre-start[710]: running bootstrap script ... ok machine # [ 9.460469] dhcpcd[684]: eth0: soliciting a DHCP lease machine # [ 9.633291] NET: Registered PF_PACKET protocol family machine # [ 9.495357] dhcpcd[684]: eth0: offered 10.0.2.15 from 10.0.2.2 machine # [ 9.499699] dhcpcd[684]: eth0: probing address 10.0.2.15/24 machine # [ 9.831681] postgresql-pre-start[710]: performing post-bootstrap initialization ... ok machine # [ 10.010213] postgresql-pre-start[710]: syncing data to disk ... ok machine # [ 10.011357] postgresql-pre-start[710]: initdb: warning: enabling "trust" authentication for local connections machine # [ 10.012231] postgresql-pre-start[710]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. machine # [ 10.013044] postgresql-pre-start[710]: Success. You can now start the database server using: machine # [ 10.014004] postgresql-pre-start[710]: pg_ctl -D /var/lib/postgresql/18 -l logfile start machine # [ 10.164438] postgres[747]: [747] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit machine # [ 10.169204] postgres[747]: [747] LOG: listening on IPv6 address "::1", port 5432 machine # [ 10.171092] postgres[747]: [747] LOG: listening on IPv4 address "127.0.0.1", port 5432 machine # [ 10.176723] postgres[747]: [747] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" machine # [ 10.195312] postgres[765]: [765] LOG: database system was shut down at 2026-09-27 14:12:52 GMT machine # [ 10.204874] postgres[747]: [747] LOG: database system is ready to accept connections machine # [ 10.212680] systemd[1]: Started PostgreSQL Server. machine # [ 10.218631] systemd[1]: Starting PostgreSQL Setup Scripts... machine # [ 10.479183] postgresql-setup-start[776]: CREATE DATABASE machine # [ 10.524794] postgresql-setup-start[781]: CREATE ROLE machine # [ 10.537662] dhcpcd[684]: eth0: soliciting an IPv6 router machine # [ 10.539303] dhcpcd[684]: eth0: Router Advertisement from fe80::2 machine # [ 10.541259] dhcpcd[684]: eth0: adding address fec0::5054:ff:fe12:3456/64 machine # [ 10.543104] dhcpcd[684]: eth0: adding route to fec0::/64 machine # [ 10.545507] postgresql-setup-start[783]: ALTER DATABASE machine # [ 10.547264] dhcpcd[684]: eth0: adding default route via fe80::2 machine # [ 10.549153] systemd[1]: Finished PostgreSQL Setup Scripts. machine # [ 10.551239] systemd[1]: Reached target PostgreSQL. machine # [ 14.553842] dhcpcd[684]: eth0: leased 10.0.2.15 for 86400 seconds machine # [ 14.555947] dhcpcd[684]: eth0: adding route to 10.0.2.0/24 machine # [ 14.557485] dhcpcd[684]: eth0: adding default route via 10.0.2.2 machine # [ 14.698370] systemd[1]: Started DHCP Client. machine # [ 14.700561] systemd[1]: Reached target Network is Online. machine # [ 14.706137] systemd[1]: Starting k3s service... machine # [ 14.761232] k3s[882]: time="2026-09-27T14:12:57Z" level=info msg="Acquiring lock file /var/lib/rancher/k3s/data/.lock" machine # [ 14.764840] k3s[882]: time="2026-09-27T14:12:57Z" level=info msg="Preparing data dir /var/lib/rancher/k3s/data/05fb32d1d5d79ab4bf8f805d07e4a7dfb491001fd5137b587aa471efd4746099" machine # [ 16.452414] rustfs-bucket-start[894]: mb s3://farm machine # [ 16.459342] systemd[1]: Finished rustfs-bucket.service. machine # [ 17.346232] k3s[882]: time="2026-09-27T14:13:00Z" level=info msg="Starting k3s 1.35.8+k3s1 (e952d68a)" machine # [ 17.360144] k3s[882]: time="2026-09-27T14:13:00Z" level=info msg="Configuring sqlite3 database connection pooling: maxIdle=20, maxOpen=0, maxLifetime=0s, maxIdleTime=2m0s" machine # [ 17.365229] k3s[882]: time="2026-09-27T14:13:00Z" level=info msg="Kine built with sqlite from github.com/mattn/go-sqlite3 version 3.53.3" machine # [ 17.369346] k3s[882]: time="2026-09-27T14:13:00Z" level=info msg="Configuring database table schema and indexes, this may take a moment..." machine # [ 17.382813] k3s[882]: time="2026-09-27T14:13:00Z" level=info msg="Database tables and indexes are up to date" machine # [ 17.386582] k3s[882]: time="2026-09-27T14:13:00Z" level=info msg="Running startup VACUUM to reclaim disk space, this may take a moment..." machine # [ 17.388179] k3s[882]: time="2026-09-27T14:13:00Z" level=info msg="Startup VACUUM completed successfully" machine # [ 17.390447] k3s[882]: time="2026-09-27T14:13:00Z" level=info msg="Kine available at unix://kine.sock" machine # [ 17.392507] k3s[882]: time="2026-09-27T14:13:00Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 17.395328] k3s[882]: time="2026-09-27T14:13:00Z" level=info msg="Datastore connection validated successfully, proceeding with bootstrap data generation" machine # [ 17.396981] k3s[882]: time="2026-09-27T14:13:00Z" level=info msg="generated self-signed CA certificate CN=k3s-client-ca@1790518380: notBefore=2026-09-27 13:13:00.211185358 +0000 UTC notAfter=2036-09-24 13:13:00.211185358 +0000 UTC" machine # [ 17.398554] k3s[882]: time="2026-09-27T14:13:00Z" level=info msg="certificate CN=system:admin,O=system:masters signed by CN=k3s-client-ca@1790518380: notBefore=2026-09-27 13:13:00 +0000 UTC notAfter=2027-09-27 13:13:00 +0000 UTC" machine # [ 17.400123] k3s[882]: time="2026-09-27T14:13:00Z" level=info msg="certificate CN=system:k3s-supervisor,O=system:masters signed by CN=k3s-client-ca@1790518380: notBefore=2026-09-27 13:13:00 +0000 UTC notAfter=2027-09-27 13:13:00 +0000 UTC" machine # [ 17.401182] k3s[882]: time="2026-09-27T14:13:00Z" level=info msg="certificate CN=system:kube-controller-manager signed by CN=k3s-client-ca@1790518380: notBefore=2026-09-27 13:13:00 +0000 UTC notAfter=2027-09-27 13:13:00 +0000 UTC" machine # [ 17.402396] k3s[882]: time="2026-09-27T14:13:00Z" level=info msg="certificate CN=system:kube-scheduler signed by CN=k3s-client-ca@1790518380: notBefore=2026-09-27 13:13:00 +0000 UTC notAfter=2027-09-27 13:13:00 +0000 UTC" machine # [ 17.403880] k3s[882]: time="2026-09-27T14:13:00Z" level=info msg="certificate CN=system:apiserver,O=system:masters signed by CN=k3s-client-ca@1790518380: notBefore=2026-09-27 13:13:00 +0000 UTC notAfter=2027-09-27 13:13:00 +0000 UTC" machine # [ 17.405519] k3s[882]: time="2026-09-27T14:13:00Z" level=info msg="certificate CN=k3s-cloud-controller-manager signed by CN=k3s-client-ca@1790518380: notBefore=2026-09-27 13:13:00 +0000 UTC notAfter=2027-09-27 13:13:00 +0000 UTC" machine # [ 17.406998] k3s[882]: time="2026-09-27T14:13:00Z" level=info msg="generated self-signed CA certificate CN=k3s-server-ca@1790518380: notBefore=2026-09-27 13:13:00.219095582 +0000 UTC notAfter=2036-09-24 13:13:00.219095582 +0000 UTC" machine # [ 17.408227] k3s[882]: time="2026-09-27T14:13:00Z" level=info msg="certificate CN=kube-apiserver signed by CN=k3s-server-ca@1790518380: notBefore=2026-09-27 13:13:00 +0000 UTC notAfter=2027-09-27 13:13:00 +0000 UTC" machine # [ 17.409369] k3s[882]: time="2026-09-27T14:13:00Z" level=info msg="certificate CN=kube-scheduler signed by CN=k3s-server-ca@1790518380: notBefore=2026-09-27 13:13:00 +0000 UTC notAfter=2027-09-27 13:13:00 +0000 UTC" machine # [ 17.410055] k3s[882]: time="2026-09-27T14:13:00Z" level=info msg="certificate CN=kube-controller-manager signed by CN=k3s-server-ca@1790518380: notBefore=2026-09-27 13:13:00 +0000 UTC notAfter=2027-09-27 13:13:00 +0000 UTC" machine # [ 17.410965] k3s[882]: time="2026-09-27T14:13:00Z" level=info msg="generated self-signed CA certificate CN=k3s-request-header-ca@1790518380: notBefore=2026-09-27 13:13:00.223427696 +0000 UTC notAfter=2036-09-24 13:13:00.223427696 +0000 UTC" machine # [ 17.411868] k3s[882]: time="2026-09-27T14:13:00Z" level=info msg="certificate CN=system:auth-proxy signed by CN=k3s-request-header-ca@1790518380: notBefore=2026-09-27 13:13:00 +0000 UTC notAfter=2027-09-27 13:13:00 +0000 UTC" machine # [ 17.412822] k3s[882]: time="2026-09-27T14:13:00Z" level=info msg="generated self-signed CA certificate CN=etcd-server-ca@1790518380: notBefore=2026-09-27 13:13:00.225668484 +0000 UTC notAfter=2036-09-24 13:13:00.225668484 +0000 UTC" machine # [ 17.413401] k3s[882]: time="2026-09-27T14:13:00Z" level=info msg="certificate CN=etcd-client signed by CN=etcd-server-ca@1790518380: notBefore=2026-09-27 13:13:00 +0000 UTC notAfter=2027-09-27 13:13:00 +0000 UTC" machine # [ 17.414046] k3s[882]: time="2026-09-27T14:13:00Z" level=info msg="generated self-signed CA certificate CN=etcd-peer-ca@1790518380: notBefore=2026-09-27 13:13:00.227698351 +0000 UTC notAfter=2036-09-24 13:13:00.227698351 +0000 UTC" machine # [ 17.414932] k3s[882]: time="2026-09-27T14:13:00Z" level=info msg="certificate CN=etcd-peer signed by CN=etcd-peer-ca@1790518380: notBefore=2026-09-27 13:13:00 +0000 UTC notAfter=2027-09-27 13:13:00 +0000 UTC" machine # [ 17.415875] k3s[882]: time="2026-09-27T14:13:00Z" level=info msg="certificate CN=etcd-server signed by CN=etcd-server-ca@1790518380: notBefore=2026-09-27 13:13:00 +0000 UTC notAfter=2027-09-27 13:13:00 +0000 UTC" machine # [ 17.467162] k3s[882]: time="2026-09-27T14:13:00Z" level=info msg="certificate CN=k3s,O=k3s signed by CN=k3s-server-ca@1790518380: notBefore=2026-09-27 13:13:00 +0000 UTC notAfter=2027-09-27 13:13:00 +0000 UTC" machine # [ 17.470717] k3s[882]: time="2026-09-27T14:13:00Z" level=warning msg="dynamiclistener [::]:6443: no cached certificate available for preload - deferring certificate load until storage initialization or first client request" machine # [ 17.477870] k3s[882]: time="2026-09-27T14:13:00Z" level=info msg="Active TLS secret / (ver=) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__dc4c_54a2_4e9d_bb2a-896a88:fec0::dc4c:54a2:4e9d:bb2a listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=500C789B8581A26A4C065AA73C514C2670A490D4]" machine # [ 18.505842] k3s[882]: time="2026-09-27T14:13:01Z" level=info msg="Password verified locally for node machine" machine # [ 18.507530] k3s[882]: time="2026-09-27T14:13:01Z" level=info msg="certificate CN=machine signed by CN=k3s-server-ca@1790518380: notBefore=2026-09-27 13:13:01 +0000 UTC notAfter=2027-09-27 13:13:01 +0000 UTC" machine # [ 18.741144] k3s[882]: time="2026-09-27T14:13:01Z" level=info msg="certificate CN=system:node:machine,O=system:nodes signed by CN=k3s-client-ca@1790518380: notBefore=2026-09-27 13:13:01 +0000 UTC notAfter=2027-09-27 13:13:01 +0000 UTC" machine # [ 18.851240] k3s[882]: time="2026-09-27T14:13:01Z" level=info msg="certificate CN=system:kube-proxy signed by CN=k3s-client-ca@1790518380: notBefore=2026-09-27 13:13:01 +0000 UTC notAfter=2027-09-27 13:13:01 +0000 UTC" machine # [ 18.936299] k3s[882]: time="2026-09-27T14:13:01Z" level=info msg="certificate CN=system:k3s-controller signed by CN=k3s-client-ca@1790518380: notBefore=2026-09-27 13:13:01 +0000 UTC notAfter=2027-09-27 13:13:01 +0000 UTC" machine # [ 19.044176] k3s[882]: time="2026-09-27T14:13:01Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:46994: runtime core not ready" machine # [ 19.145658] k3s[882]: time="2026-09-27T14:13:01Z" level=info msg="Module overlay was already loaded" machine # [ 19.384478] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. machine # [ 19.389985] Bridge firewalling registered machine # [ 19.246879] k3s[882]: time="2026-09-27T14:13:02Z" level=warning msg="Failed to load kernel module iptable_nat with modprobe" machine # [ 19.254855] k3s[882]: time="2026-09-27T14:13:02Z" level=warning msg="Failed to load kernel module iptable_filter with modprobe" machine # [ 19.262778] k3s[882]: time="2026-09-27T14:13:02Z" level=warning msg="Failed to load kernel module nft-expr-counter with modprobe" machine # [ 19.357813] k3s[882]: time="2026-09-27T14:13:02Z" level=info msg="Set sysctl 'net/ipv4/conf/default/forwarding' to 1" machine # [ 19.359291] k3s[882]: time="2026-09-27T14:13:02Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_max' to 131072" machine # [ 19.360351] k3s[882]: time="2026-09-27T14:13:02Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400" machine # [ 19.361493] k3s[882]: time="2026-09-27T14:13:02Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600" machine # [ 19.362959] k3s[882]: time="2026-09-27T14:13:02Z" level=info msg="Set sysctl 'net/ipv4/conf/all/forwarding' to 1" machine # [ 19.364554] k3s[882]: time="2026-09-27T14:13:02Z" level=info msg="Creating k3s-cert-monitor event broadcaster" machine # [ 19.366044] k3s[882]: time="2026-09-27T14:13:02Z" level=info msg="Connecting to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 19.367179] k3s[882]: time="2026-09-27T14:13:02Z" level=info msg="Saving cluster bootstrap data to datastore" machine # [ 19.368378] k3s[882]: time="2026-09-27T14:13:02Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 19.369873] k3s[882]: time="2026-09-27T14:13:02Z" level=info msg="Connection to etcd is ready" machine # [ 19.371456] k3s[882]: time="2026-09-27T14:13:02Z" level=info msg="ETCD server is now running" machine # [ 19.380716] k3s[882]: time="2026-09-27T14:13:02Z" level=info msg="Logging containerd to /var/lib/rancher/k3s/agent/containerd/containerd.log" machine # [ 19.381630] k3s[882]: time="2026-09-27T14:13:02Z" level=info msg="Running containerd -c /var/lib/rancher/k3s/agent/etc/containerd/config.toml" machine # [ 19.396028] k3s[882]: time="2026-09-27T14:13:02Z" level=info msg="Running kube-apiserver --advertise-port=6443 --allow-privileged=true --anonymous-auth=false --api-audiences=https://kubernetes.default.svc.cluster.local,k3s --authorization-mode=Node,RBAC --bind-address=127.0.0.1 --cert-dir=/var/lib/rancher/k3s/server/tls/temporary-certs --client-ca-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --egress-selector-config-file=/var/lib/rancher/k3s/server/etc/egress-selector-config.yaml --enable-admission-plugins=NodeRestriction --enable-aggregator-routing=true --enable-bootstrap-token-auth=true --etcd-servers=unix://kine.sock --kubelet-certificate-authority=/var/lib/rancher/k3s/server/tls/server-ca.crt --kubelet-client-certificate=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.crt --kubelet-client-key=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.key --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --profiling=false --proxy-client-cert-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt --proxy-client-key-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.key --requestheader-allowed-names=system:auth-proxy --requestheader-client-ca-file=/var/lib/rancher/k3s/server/tls/request-header-ca.crt --requestheader-extra-headers-prefix=X-Remote-Extra- --requestheader-group-headers=X-Remote-Group --requestheader-username-headers=X-Remote-User --secure-port=6444 --service-account-issuer=https://kubernetes.default.svc.cluster.local --service-account-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-account-signing-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --storage-backend=etcd3 --tls-cert-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --tls-private-key-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 19.417772] k3s[882]: time="2026-09-27T14:13:02Z" level=info msg="Handling backend connection request [machine]" machine # [ 19.419249] k3s[882]: time="2026-09-27T14:13:02Z" level=info msg="Running kube-scheduler --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --bind-address=127.0.0.1 --kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --leader-elect=false --profiling=false --secure-port=10259 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 19.419897] k3s[882]: time="2026-09-27T14:13:02Z" level=info msg="Connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 19.420542] k3s[882]: time="2026-09-27T14:13:02Z" level=info msg="Remotedialer connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 19.428071] k3s[882]: time="2026-09-27T14:13:02Z" level=info msg="Running kube-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --bind-address=127.0.0.1 --cluster-cidr=10.42.0.0/16 --cluster-signing-kube-apiserver-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kube-apiserver-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kubelet-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-serving-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-kubelet-serving-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --cluster-signing-legacy-unknown-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-legacy-unknown-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --configure-cloud-routes=false --controllers=*,tokencleaner,-service,-route,-cloud-node-lifecycle --kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --leader-elect=false --profiling=false --root-ca-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --secure-port=10257 --service-account-private-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key --use-service-account-credentials=true" machine # [ 19.428737] k3s[882]: time="2026-09-27T14:13:02Z" level=info msg="Polling for API server readiness: GET /readyz failed: the server is currently unable to handle the request" machine # [ 19.448244] k3s[882]: I0927 14:13:02.263107 882 options.go:263] external host was not specified, using 10.0.2.15 machine # [ 19.449762] k3s[882]: time="2026-09-27T14:13:02Z" level=info msg="Running cloud-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --bind-address=127.0.0.1 --cloud-config=/var/lib/rancher/k3s/server/etc/cloud-config.yaml --cloud-provider=k3s --cluster-cidr=10.42.0.0/16 --configure-cloud-routes=false --controllers=*,-route --kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --leader-elect=false --leader-elect-resource-name=k3s-cloud-controller-manager --node-status-update-frequency=1m0s --profiling=false" machine # [ 19.458090] k3s[882]: time="2026-09-27T14:13:02Z" level=info msg="Server node token is available at /var/lib/rancher/k3s/server/token" machine # [ 19.459417] k3s[882]: I0927 14:13:02.274309 882 server.go:158] Version: v1.35.8+k3s1 machine # [ 19.460556] k3s[882]: I0927 14:13:02.274350 882 server.go:160] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 19.462413] k3s[882]: time="2026-09-27T14:13:02Z" level=info msg="To join server node to cluster: k3s server -s https://10.0.2.15:6443 -t ${SERVER_NODE_TOKEN}" machine # [ 19.463081] k3s[882]: time="2026-09-27T14:13:02Z" level=info msg="Agent node token is available at /var/lib/rancher/k3s/server/agent-token" machine # [ 19.466042] k3s[882]: time="2026-09-27T14:13:02Z" level=info msg="To join agent node to cluster: k3s agent -s https://10.0.2.15:6443 -t ${AGENT_NODE_TOKEN}" machine # [ 19.468430] k3s[882]: time="2026-09-27T14:13:02Z" level=info msg="Wrote kubeconfig /etc/rancher/k3s/k3s.yaml" machine # [ 19.468981] k3s[882]: time="2026-09-27T14:13:02Z" level=info msg="Run: k3s kubectl" machine # [ 19.532199] k3s[882]: time="2026-09-27T14:13:02Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:47054: runtime core not ready" machine # [ 19.537188] k3s[882]: I0927 14:13:02.352036 882 shared_informer.go:349] "Waiting for caches to sync" controller="node_authorizer" machine # [ 19.540289] k3s[882]: I0927 14:13:02.355135 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 19.541667] k3s[882]: I0927 14:13:02.356539 882 plugins.go:157] Loaded 14 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,PodTopologyLabels,MutatingAdmissionPolicy,MutatingAdmissionWebhook. machine # [ 19.542122] k3s[882]: I0927 14:13:02.356567 882 plugins.go:160] Loaded 14 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,NodeDeclaredFeatureValidator,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. machine # [ 19.542619] k3s[882]: I0927 14:13:02.356861 882 instance.go:240] Using reconciler: lease machine # [ 19.549577] k3s[882]: I0927 14:13:02.364458 882 handler.go:304] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager machine # [ 19.550488] k3s[882]: W0927 14:13:02.364487 882 genericapiserver.go:787] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. machine # [ 19.554749] k3s[882]: I0927 14:13:02.369615 882 cidrallocator.go:198] starting ServiceCIDR Allocator Controller machine # [ 19.605089] k3s[882]: I0927 14:13:02.419858 882 handler.go:304] Adding GroupVersion v1 to ResourceManager machine # [ 19.606242] k3s[882]: I0927 14:13:02.420104 882 apis.go:112] API group "internal.apiserver.k8s.io" is not enabled, skipping. machine # [ 19.625060] k3s[882]: time="2026-09-27T14:13:02Z" level=info msg="Running kube-proxy --cluster-cidr=10.42.0.0/16 --conntrack-max-per-core=0 --conntrack-tcp-timeout-close-wait=0s --conntrack-tcp-timeout-established=0s --healthz-bind-address=127.0.0.1 --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubeproxy.kubeconfig --proxy-mode=iptables" machine # [ 19.638197] k3s[882]: I0927 14:13:02.452390 882 apis.go:112] API group "storagemigration.k8s.io" is not enabled, skipping. machine # [ 19.657649] k3s[882]: I0927 14:13:02.472528 882 handler.go:304] Adding GroupVersion authentication.k8s.io v1 to ResourceManager machine # [ 19.658164] k3s[882]: W0927 14:13:02.472559 882 genericapiserver.go:787] Skipping API authentication.k8s.io/v1beta1 because it has no resources. machine # [ 19.658870] k3s[882]: W0927 14:13:02.472571 882 genericapiserver.go:787] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. machine # [ 19.659465] k3s[882]: I0927 14:13:02.472814 882 handler.go:304] Adding GroupVersion authorization.k8s.io v1 to ResourceManager machine # [ 19.659913] k3s[882]: W0927 14:13:02.472828 882 genericapiserver.go:787] Skipping API authorization.k8s.io/v1beta1 because it has no resources. machine # [ 19.660604] k3s[882]: I0927 14:13:02.473306 882 handler.go:304] Adding GroupVersion autoscaling v2 to ResourceManager machine # [ 19.661085] k3s[882]: I0927 14:13:02.473609 882 handler.go:304] Adding GroupVersion autoscaling v1 to ResourceManager machine # [ 19.661764] k3s[882]: W0927 14:13:02.473624 882 genericapiserver.go:787] Skipping API autoscaling/v2beta1 because it has no resources. machine # [ 19.662417] k3s[882]: W0927 14:13:02.473634 882 genericapiserver.go:787] Skipping API autoscaling/v2beta2 because it has no resources. machine # [ 19.662871] k3s[882]: I0927 14:13:02.474225 882 handler.go:304] Adding GroupVersion batch v1 to ResourceManager machine # [ 19.663587] k3s[882]: W0927 14:13:02.474241 882 genericapiserver.go:787] Skipping API batch/v1beta1 because it has no resources. machine # [ 19.664151] k3s[882]: I0927 14:13:02.474636 882 handler.go:304] Adding GroupVersion certificates.k8s.io v1 to ResourceManager machine # [ 19.664606] k3s[882]: W0927 14:13:02.474652 882 genericapiserver.go:787] Skipping API certificates.k8s.io/v1beta1 because it has no resources. machine # [ 19.665107] k3s[882]: W0927 14:13:02.474662 882 genericapiserver.go:787] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. machine # [ 19.665611] k3s[882]: I0927 14:13:02.474902 882 handler.go:304] Adding GroupVersion coordination.k8s.io v1 to ResourceManager machine # [ 19.666085] k3s[882]: W0927 14:13:02.474915 882 genericapiserver.go:787] Skipping API coordination.k8s.io/v1beta1 because it has no resources. machine # [ 19.666589] k3s[882]: W0927 14:13:02.474925 882 genericapiserver.go:787] Skipping API coordination.k8s.io/v1alpha2 because it has no resources. machine # [ 19.667131] k3s[882]: I0927 14:13:02.475209 882 handler.go:304] Adding GroupVersion discovery.k8s.io v1 to ResourceManager machine # [ 19.667648] k3s[882]: W0927 14:13:02.475227 882 genericapiserver.go:787] Skipping API discovery.k8s.io/v1beta1 because it has no resources. machine # [ 19.668133] k3s[882]: I0927 14:13:02.476231 882 handler.go:304] Adding GroupVersion networking.k8s.io v1 to ResourceManager machine # [ 19.668304] k3s[882]: W0927 14:13:02.476248 882 genericapiserver.go:787] Skipping API networking.k8s.io/v1beta1 because it has no resources. machine # [ 19.668798] k3s[882]: I0927 14:13:02.476448 882 handler.go:304] Adding GroupVersion node.k8s.io v1 to ResourceManager machine # [ 19.669488] k3s[882]: W0927 14:13:02.476461 882 genericapiserver.go:787] Skipping API node.k8s.io/v1beta1 because it has no resources. machine # [ 19.669937] k3s[882]: W0927 14:13:02.476471 882 genericapiserver.go:787] Skipping API node.k8s.io/v1alpha1 because it has no resources. machine # [ 19.670694] k3s[882]: I0927 14:13:02.476786 882 handler.go:304] Adding GroupVersion policy v1 to ResourceManager machine # [ 19.671186] k3s[882]: W0927 14:13:02.476801 882 genericapiserver.go:787] Skipping API policy/v1beta1 because it has no resources. machine # [ 19.671665] k3s[882]: I0927 14:13:02.477585 882 handler.go:304] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager machine # [ 19.672143] k3s[882]: W0927 14:13:02.477602 882 genericapiserver.go:787] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. machine # [ 19.672638] k3s[882]: W0927 14:13:02.477613 882 genericapiserver.go:787] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. machine # [ 19.673123] k3s[882]: I0927 14:13:02.477810 882 handler.go:304] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager machine # [ 19.673606] k3s[882]: W0927 14:13:02.477822 882 genericapiserver.go:787] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. machine # [ 19.674086] k3s[882]: W0927 14:13:02.477832 882 genericapiserver.go:787] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. machine # [ 19.674633] k3s[882]: I0927 14:13:02.478905 882 handler.go:304] Adding GroupVersion storage.k8s.io v1 to ResourceManager machine # [ 19.675144] k3s[882]: W0927 14:13:02.478924 882 genericapiserver.go:787] Skipping API storage.k8s.io/v1beta1 because it has no resources. machine # [ 19.675645] k3s[882]: W0927 14:13:02.478936 882 genericapiserver.go:787] Skipping API storage.k8s.io/v1alpha1 because it has no resources. machine # [ 19.676211] k3s[882]: I0927 14:13:02.479446 882 handler.go:304] Adding GroupVersion flowcontrol.apiserver.k8s.io v1 to ResourceManager machine # [ 19.676666] k3s[882]: W0927 14:13:02.479463 882 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta3 because it has no resources. machine # [ 19.677183] k3s[882]: W0927 14:13:02.479473 882 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta2 because it has no resources. machine # [ 19.677656] k3s[882]: W0927 14:13:02.479484 882 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. machine # [ 19.678162] k3s[882]: I0927 14:13:02.481036 882 handler.go:304] Adding GroupVersion apps v1 to ResourceManager machine # [ 19.678642] k3s[882]: W0927 14:13:02.481052 882 genericapiserver.go:787] Skipping API apps/v1beta2 because it has no resources. machine # [ 19.679150] k3s[882]: W0927 14:13:02.481063 882 genericapiserver.go:787] Skipping API apps/v1beta1 because it has no resources. machine # [ 19.679652] k3s[882]: I0927 14:13:02.481859 882 handler.go:304] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager machine # [ 19.680173] k3s[882]: W0927 14:13:02.481875 882 genericapiserver.go:787] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. machine # [ 19.680672] k3s[882]: W0927 14:13:02.481885 882 genericapiserver.go:787] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. machine # [ 19.682311] k3s[882]: I0927 14:13:02.482154 882 handler.go:304] Adding GroupVersion events.k8s.io v1 to ResourceManager machine # [ 19.683632] k3s[882]: W0927 14:13:02.482168 882 genericapiserver.go:787] Skipping API events.k8s.io/v1beta1 because it has no resources. machine # [ 19.685186] k3s[882]: I0927 14:13:02.482991 882 handler.go:304] Adding GroupVersion resource.k8s.io v1 to ResourceManager machine # [ 19.686749] k3s[882]: W0927 14:13:02.483007 882 genericapiserver.go:787] Skipping API resource.k8s.io/v1beta2 because it has no resources. machine # [ 19.688433] k3s[882]: W0927 14:13:02.483018 882 genericapiserver.go:787] Skipping API resource.k8s.io/v1beta1 because it has no resources. machine # [ 19.689760] k3s[882]: W0927 14:13:02.483027 882 genericapiserver.go:787] Skipping API resource.k8s.io/v1alpha3 because it has no resources. machine # [ 19.691472] k3s[882]: I0927 14:13:02.484815 882 handler.go:304] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager machine # [ 19.692774] k3s[882]: W0927 14:13:02.484833 882 genericapiserver.go:787] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. machine # [ 20.016712] k3s[882]: I0927 14:13:02.831444 882 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 20.017292] k3s[882]: I0927 14:13:02.831534 882 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 20.017807] k3s[882]: I0927 14:13:02.831719 882 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 20.026092] k3s[882]: I0927 14:13:02.831723 882 secure_serving.go:211] Serving securely on 127.0.0.1:6444 machine # [ 20.026741] k3s[882]: I0927 14:13:02.831822 882 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 20.027410] k3s[882]: time="2026-09-27T14:13:02Z" level=info msg="Starting apiserver lease garbage collector" logger=k3s machine # [ 20.027867] k3s[882]: time="2026-09-27T14:13:02Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 20.028574] k3s[882]: I0927 14:13:02.838105 882 aggregator.go:185] waiting for initial CRD sync... machine # [ 20.029070] k3s[882]: I0927 14:13:02.838129 882 controller.go:78] Starting OpenAPI AggregationController machine # [ 20.029616] k3s[882]: I0927 14:13:02.838224 882 apiservice_controller.go:100] Starting APIServiceRegistrationController machine # [ 20.030114] k3s[882]: I0927 14:13:02.838244 882 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller machine # [ 20.030620] k3s[882]: I0927 14:13:02.838160 882 controller.go:80] Starting OpenAPI V3 AggregationController machine # [ 20.031160] k3s[882]: I0927 14:13:02.838759 882 cluster_authentication_trust_controller.go:459] Starting cluster_authentication_trust_controller controller machine # [ 20.031690] k3s[882]: time="2026-09-27T14:13:02Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 20.032430] k3s[882]: I0927 14:13:02.838826 882 controller.go:113] "Deleting old lease on startup" lease="kube-system/apiserver-ik4pcwfs7qgdl76byc4pomgvia" machine # [ 20.032895] k3s[882]: I0927 14:13:02.838846 882 system_namespaces_controller.go:66] Starting system namespaces controller machine # [ 20.033573] k3s[882]: I0927 14:13:02.838926 882 dynamic_serving_content.go:135] "Starting controller" name="aggregator-proxy-cert::/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt::/var/lib/rancher/k3s/server/tls/client-auth-proxy.key" machine # [ 20.034057] k3s[882]: time="2026-09-27T14:13:02Z" level=info msg="Starting legacy_token_tracking_controller" logger=k3s machine # [ 20.034569] k3s[882]: time="2026-09-27T14:13:02Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 20.047794] k3s[882]: I0927 14:13:02.839621 882 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 20.048571] k3s[882]: I0927 14:13:02.839752 882 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 20.049108] k3s[882]: I0927 14:13:02.838928 882 repairip.go:210] Starting ipallocator-repair-controller machine # [ 20.049286] k3s[882]: I0927 14:13:02.840247 882 shared_informer.go:349] "Waiting for caches to sync" controller="ipallocator-repair-controller" machine # [ 20.049825] k3s[882]: I0927 14:13:02.840487 882 default_servicecidr_controller.go:110] Starting kubernetes-service-cidr-controller machine # [ 20.050561] k3s[882]: I0927 14:13:02.840495 882 controller.go:142] Starting OpenAPI controller machine # [ 20.051097] k3s[882]: I0927 14:13:02.840511 882 shared_informer.go:349] "Waiting for caches to sync" controller="kubernetes-service-cidr-controller" machine # [ 20.051651] k3s[882]: I0927 14:13:02.840633 882 controller.go:90] Starting OpenAPI V3 controller machine # [ 20.052188] k3s[882]: I0927 14:13:02.840668 882 naming_controller.go:305] Starting NamingConditionController machine # [ 20.052747] k3s[882]: I0927 14:13:02.840736 882 nonstructuralschema_controller.go:202] Starting NonStructuralSchemaConditionController machine # [ 20.053505] k3s[882]: I0927 14:13:02.840768 882 apiapproval_controller.go:196] Starting KubernetesAPIApprovalPolicyConformantConditionController machine # [ 20.054023] k3s[882]: I0927 14:13:02.840796 882 crd_finalizer.go:273] Starting CRDFinalizer machine # [ 20.054615] k3s[882]: I0927 14:13:02.839039 882 local_available_controller.go:156] Starting LocalAvailability controller machine # [ 20.055113] k3s[882]: I0927 14:13:02.841042 882 cache.go:32] Waiting for caches to sync for LocalAvailability controller machine # [ 20.055289] k3s[882]: I0927 14:13:02.839190 882 apf_controller.go:377] Starting API Priority and Fairness config controller machine # [ 20.055835] k3s[882]: I0927 14:13:02.839333 882 remote_available_controller.go:425] Starting RemoteAvailability controller machine # [ 20.056569] k3s[882]: I0927 14:13:02.841106 882 cache.go:32] Waiting for caches to sync for RemoteAvailability controller machine # [ 20.057095] k3s[882]: I0927 14:13:02.839381 882 crdregistration_controller.go:114] Starting crd-autoregister controller machine # [ 20.057650] k3s[882]: I0927 14:13:02.841142 882 shared_informer.go:349] "Waiting for caches to sync" controller="crd-autoregister" machine # [ 20.058180] k3s[882]: I0927 14:13:02.839562 882 customresource_discovery_controller.go:294] Starting DiscoveryController machine # [ 20.078502] k3s[882]: I0927 14:13:02.893255 882 shared_informer.go:377] "Caches are synced" machine # [ 20.079192] k3s[882]: I0927 14:13:02.893308 882 policy_source.go:248] refreshing policies machine # [ 20.124498] k3s[882]: time="2026-09-27T14:13:02Z" level=info msg="Caches are synced" logger=k3s machine # [ 20.125885] k3s[882]: I0927 14:13:02.939323 882 cache.go:39] Caches are synced for APIServiceRegistrationController controller machine # [ 20.127521] k3s[882]: I0927 14:13:02.939411 882 handler_discovery.go:451] Starting ResourceDiscoveryManager machine # [ 20.129023] k3s[882]: time="2026-09-27T14:13:02Z" level=info msg="Caches are synced" logger=k3s machine # [ 20.130265] k3s[882]: I0927 14:13:02.940372 882 shared_informer.go:356] "Caches are synced" controller="ipallocator-repair-controller" machine # [ 20.131949] k3s[882]: I0927 14:13:02.940711 882 shared_informer.go:356] "Caches are synced" controller="kubernetes-service-cidr-controller" machine # [ 20.133792] k3s[882]: I0927 14:13:02.940742 882 default_servicecidr_controller.go:169] Creating default ServiceCIDR with CIDRs: [10.43.0.0/16] machine # [ 20.135607] k3s[882]: I0927 14:13:02.941092 882 cache.go:39] Caches are synced for LocalAvailability controller machine # [ 20.137086] k3s[882]: I0927 14:13:02.941130 882 apf_controller.go:382] Running API Priority and Fairness config worker machine # [ 20.138663] k3s[882]: I0927 14:13:02.941145 882 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process machine # [ 20.140426] k3s[882]: I0927 14:13:02.941174 882 cache.go:39] Caches are synced for RemoteAvailability controller machine # [ 20.141891] k3s[882]: I0927 14:13:02.941320 882 shared_informer.go:356] "Caches are synced" controller="crd-autoregister" machine # [ 20.143479] k3s[882]: I0927 14:13:02.941401 882 aggregator.go:187] initial CRD sync complete... machine # [ 20.144728] k3s[882]: I0927 14:13:02.941415 882 autoregister_controller.go:144] Starting autoregister controller machine # [ 20.146222] k3s[882]: I0927 14:13:02.941430 882 cache.go:32] Waiting for caches to sync for autoregister controller machine # [ 20.147753] k3s[882]: I0927 14:13:02.941443 882 cache.go:39] Caches are synced for autoregister controller machine # [ 20.149135] k3s[882]: I0927 14:13:02.941866 882 controller.go:667] quota admission added evaluator for: namespaces machine # [ 20.150630] k3s[882]: time="2026-09-27T14:13:02Z" level=info msg="Caches are synced" logger=k3s machine # [ 20.151873] k3s[882]: I0927 14:13:02.949312 882 default_servicecidr_controller.go:231] Setting default ServiceCIDR condition Ready to True machine # [ 20.153768] k3s[882]: I0927 14:13:02.951639 882 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io machine # [ 20.155471] k3s[882]: I0927 14:13:02.952125 882 shared_informer.go:356] "Caches are synced" controller="node_authorizer" machine # [ 20.157020] k3s[882]: I0927 14:13:02.963567 882 default_servicecidr_controller.go:231] Setting default ServiceCIDR condition Ready to True machine # [ 20.158842] k3s[882]: I0927 14:13:02.969976 882 cidrallocator.go:302] created ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 20.181394] k3s[882]: I0927 14:13:02.996233 882 alloc.go:329] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.43.0.1"} machine # [ 20.189353] k3s[882]: W0927 14:13:03.004205 882 lease.go:265] Resetting endpoints for master service "kubernetes" to [10.0.2.15] machine # [ 20.190581] k3s[882]: I0927 14:13:03.005464 882 controller.go:667] quota admission added evaluator for: endpoints machine # [ 20.195344] k3s[882]: I0927 14:13:03.010212 882 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io machine # [ 20.202187] k3s[882]: E0927 14:13:03.017060 882 controller.go:102] Error removing old endpoints from kubernetes service: no API server IP addresses were listed in storage, refusing to erase all endpoints for the kubernetes Service machine # [ 20.393618] k3s[882]: time="2026-09-27T14:13:03Z" level=info msg="containerd is now running" machine # [ 20.404127] k3s[882]: time="2026-09-27T14:13:03Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/k3s-airgap-images-amd64.tar.zst" machine # [ 21.030402] k3s[882]: I0927 14:13:03.844882 882 storage_scheduling.go:123] created PriorityClass system-node-critical with value 2000001000 machine # [ 21.035018] k3s[882]: I0927 14:13:03.849834 882 storage_scheduling.go:123] created PriorityClass system-cluster-critical with value 2000000000 machine # [ 21.035728] k3s[882]: I0927 14:13:03.849876 882 storage_scheduling.go:139] all system priority classes are created successfully or already exist. machine # [ 21.369920] k3s[882]: time="2026-09-27T14:13:04Z" level=info msg="Polling for API server readiness: GET /readyz failed: unknown" machine # [ 22.035695] k3s[882]: I0927 14:13:04.849877 882 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io machine # [ 22.081157] k3s[882]: I0927 14:13:04.895992 882 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io machine # [ 23.377196] k3s[882]: time="2026-09-27T14:13:06Z" level=info msg="Waiting for untainted node" machine # [ 23.382240] k3s[882]: time="2026-09-27T14:13:06Z" level=info msg="Kube API server is now running" machine # [ 23.384060] k3s[882]: time="2026-09-27T14:13:06Z" level=info msg="k3s is up and running" machine # [ 23.385240] k3s[882]: time="2026-09-27T14:13:06Z" level=info msg="Creating k3s-supervisor event broadcaster" machine # [ 23.388200] k3s[882]: time="2026-09-27T14:13:06Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Node and Certificate Authority certificates managed by k3s are OK" object=machine reason=CertificateExpirationOK type=Normal machine # [ 23.390077] systemd[1]: Started k3s service. machine # [ 23.400180] systemd[1]: Starting niks3 server... machine # [ 23.421864] k3s[882]: I0927 14:13:06.236726 882 controllermanager.go:189] "Starting" version="v1.35.8+k3s1" machine # [ 23.422530] k3s[882]: I0927 14:13:06.236756 882 controllermanager.go:191] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 23.425723] k3s[882]: I0927 14:13:06.240607 882 secure_serving.go:211] Serving securely on 127.0.0.1:10257 machine # [ 23.426647] k3s[882]: I0927 14:13:06.241104 882 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 23.427234] k3s[882]: I0927 14:13:06.241124 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 23.427793] k3s[882]: I0927 14:13:06.241165 882 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key" machine # [ 23.428477] k3s[882]: I0927 14:13:06.241259 882 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 23.428937] k3s[882]: I0927 14:13:06.241321 882 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 23.429626] k3s[882]: I0927 14:13:06.241352 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 23.430137] k3s[882]: I0927 14:13:06.241386 882 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 23.430655] k3s[882]: I0927 14:13:06.241404 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 23.443710] k3s[882]: I0927 14:13:06.258596 882 controller.go:667] quota admission added evaluator for: serviceaccounts machine # [ 23.494086] k3s[882]: I0927 14:13:06.308150 882 controllermanager.go:627] "Warning: controller is disabled" controller="cloud-node-lifecycle-controller" machine # [ 23.510066] k3s[882]: I0927 14:13:06.324907 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 23.516831] k3s[882]: time="2026-09-27T14:13:06Z" level=info msg="Creating embedded CRD addons.k3s.cattle.io" machine # [ 23.522945] k3s[882]: time="2026-09-27T14:13:06Z" level=info msg="Creating embedded CRD etcdsnapshotfiles.k3s.cattle.io" machine # [ 23.526354] k3s[882]: I0927 14:13:06.341236 882 shared_informer.go:377] "Caches are synced" machine # [ 23.527814] k3s[882]: I0927 14:13:06.342622 882 shared_informer.go:377] "Caches are synced" machine # [ 23.529738] k3s[882]: I0927 14:13:06.344591 882 shared_informer.go:377] "Caches are synced" machine # [ 23.531173] k3s[882]: time="2026-09-27T14:13:06Z" level=info msg="Creating embedded CRD helmcharts.helm.cattle.io" machine # [ 23.540886] k3s[882]: I0927 14:13:06.355778 882 controllermanager.go:627] "Warning: controller is disabled" controller="bootstrap-signer-controller" machine # [ 23.549061] k3s[882]: time="2026-09-27T14:13:06Z" level=info msg="Creating embedded CRD helmchartconfigs.helm.cattle.io" machine # [ 23.549568] k3s[882]: I0927 14:13:06.363734 882 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 23.560989] k3s[882]: I0927 14:13:06.375691 882 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 23.576849] k3s[882]: I0927 14:13:06.391719 882 controllermanager.go:579] "Warning: skipping controller" controller="storage-version-migrator-controller" machine # [ 23.577605] k3s[882]: time="2026-09-27T14:13:06Z" level=info msg="Waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 23.594912] k3s[882]: I0927 14:13:06.409775 882 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 23.598879] k3s[882]: I0927 14:13:06.413515 882 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 23.710438] k3s[882]: I0927 14:13:06.525256 882 shared_informer.go:377] "Caches are synced" machine: (finished: waiting for unit k3s.service, in 24.73 seconds) machine: waiting for success: kubectl get ns farm machine # [ 23.800126] k3s[882]: I0927 14:13:06.613894 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="roles.rbac.authorization.k8s.io" machine # [ 23.802923] k3s[882]: I0927 14:13:06.613986 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmcharts.helm.cattle.io" machine # [ 23.805603] k3s[882]: I0927 14:13:06.614026 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmchartconfigs.helm.cattle.io" machine # [ 23.808198] k3s[882]: I0927 14:13:06.614054 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="csistoragecapacities.storage.k8s.io" machine # [ 23.810800] k3s[882]: I0927 14:13:06.614103 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpoints" machine # [ 23.812975] k3s[882]: I0927 14:13:06.614127 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="daemonsets.apps" machine # [ 23.815257] k3s[882]: I0927 14:13:06.614156 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="horizontalpodautoscalers.autoscaling" machine # [ 23.817918] k3s[882]: I0927 14:13:06.614183 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="poddisruptionbudgets.policy" machine # [ 23.820543] k3s[882]: I0927 14:13:06.614207 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="rolebindings.rbac.authorization.k8s.io" machine # [ 23.823088] k3s[882]: I0927 14:13:06.614231 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="addons.k3s.cattle.io" machine # [ 23.825645] k3s[882]: I0927 14:13:06.614273 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="serviceaccounts" machine # [ 23.828150] k3s[882]: I0927 14:13:06.614320 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="cronjobs.batch" machine # [ 23.830488] k3s[882]: I0927 14:13:06.614355 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="leases.coordination.k8s.io" machine # [ 23.833040] k3s[882]: I0927 14:13:06.614379 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpointslices.discovery.k8s.io" machine # [ 23.835682] k3s[882]: I0927 14:13:06.614407 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="podtemplates" machine # [ 23.838186] k3s[882]: I0927 14:13:06.614430 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="statefulsets.apps" machine # [ 23.840587] k3s[882]: I0927 14:13:06.614453 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="deployments.apps" machine # [ 23.842982] k3s[882]: I0927 14:13:06.614482 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="ingresses.networking.k8s.io" machine # [ 23.845367] k3s[882]: I0927 14:13:06.614531 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="controllerrevisions.apps" machine # [ 23.847809] k3s[882]: I0927 14:13:06.614555 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="replicasets.apps" machine # [ 23.850229] k3s[882]: I0927 14:13:06.614582 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="jobs.batch" machine # [ 23.852552] k3s[882]: I0927 14:13:06.614607 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="resourceclaimtemplates.resource.k8s.io" machine # [ 23.855159] k3s[882]: I0927 14:13:06.614660 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="limitranges" machine # [ 23.857419] k3s[882]: I0927 14:13:06.614685 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="networkpolicies.networking.k8s.io" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 24.073813] k3s[882]: time="2026-09-27T14:13:06Z" level=info msg="Imported docker.io/rancher/klipper-helm:v0.13.3-build20260727" machine # [ 24.077369] k3s[882]: time="2026-09-27T14:13:06Z" level=info msg="Tagged docker.io/rancher/klipper-helm@sha256:5425a2b4613d2458dbdff99218e8d487ebb59c20e7a941f061c0777070f0aac1" machine # [ 24.079697] k3s[882]: time="2026-09-27T14:13:06Z" level=info msg="Imported docker.io/rancher/klipper-lb:v0.4.17" machine # [ 24.081254] k3s[882]: time="2026-09-27T14:13:06Z" level=info msg="Tagged docker.io/rancher/klipper-lb@sha256:910944bb0bd94f060a82a56ca1ea1c577d3e49b3473a093a47a985f32e92d94a" machine # [ 24.083432] k3s[882]: time="2026-09-27T14:13:06Z" level=info msg="Imported docker.io/rancher/local-path-provisioner:v0.0.37" machine # [ 24.086532] k3s[882]: time="2026-09-27T14:13:06Z" level=info msg="Tagged docker.io/rancher/local-path-provisioner@sha256:e757967a5ec338f6a9b371c5a9688bedaa8c3578ea3dd4db329ea0084be0a86f" machine # [ 24.089154] k3s[882]: time="2026-09-27T14:13:06Z" level=info msg="Imported docker.io/rancher/mirrored-coredns-coredns:1.14.6" machine # [ 24.092568] k3s[882]: time="2026-09-27T14:13:06Z" level=info msg="Done waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 24.093526] k3s[882]: time="2026-09-27T14:13:06Z" level=info msg="Waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 24.096226] k3s[882]: time="2026-09-27T14:13:06Z" level=info msg="Tagged docker.io/rancher/mirrored-coredns-coredns@sha256:900f9c109f7a33545d3c811516e8376df9019147b750f5ce3e254468769176ea" machine # [ 24.098651] k3s[882]: time="2026-09-27T14:13:06Z" level=info msg="Imported docker.io/rancher/mirrored-library-busybox:1.37.0" machine # [ 24.099254] k3s[882]: time="2026-09-27T14:13:06Z" level=info msg="Done waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 24.100072] k3s[882]: time="2026-09-27T14:13:06Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-40.1.4+up40.1.0.tgz" machine # [ 24.100622] k3s[882]: time="2026-09-27T14:13:06Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-crd-40.1.4+up40.1.0.tgz" machine # [ 24.101091] k3s[882]: time="2026-09-27T14:13:06Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/ccm.yaml" machine # [ 24.101662] k3s[882]: time="2026-09-27T14:13:06Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/coredns.yaml" machine # [ 24.102250] k3s[882]: time="2026-09-27T14:13:06Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/local-storage.yaml" machine # [ 24.102783] k3s[882]: time="2026-09-27T14:13:06Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/rolebindings.yaml" machine # [ 24.103519] k3s[882]: time="2026-09-27T14:13:06Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/runtimes.yaml" machine # [ 24.104032] k3s[882]: time="2026-09-27T14:13:06Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/traefik.yaml" machine # [ 24.116571] k3s[882]: time="2026-09-27T14:13:06Z" level=info msg="Tagged docker.io/rancher/mirrored-library-busybox@sha256:101b4afd76732482eff9b95cae5f94bcf295e521fbec4e01b69c5421f3f3f3e5" machine # [ 24.117243] k3s[882]: time="2026-09-27T14:13:06Z" level=info msg="Imported docker.io/rancher/mirrored-library-traefik:3.7.8" machine # [ 24.130668] k3s[882]: time="2026-09-27T14:13:06Z" level=info msg="Tagged docker.io/rancher/mirrored-library-traefik@sha256:4299bbed850421258fc5448c2e0e6ad350981d4d335a68de11b92448aedbefe5" machine # [ 24.131648] k3s[882]: time="2026-09-27T14:13:06Z" level=info msg="Imported docker.io/rancher/mirrored-metrics-server:v0.9.0" machine # [ 24.137890] k3s[882]: time="2026-09-27T14:13:06Z" level=info msg="Tagged docker.io/rancher/mirrored-metrics-server@sha256:d9862115e7c7881280d3d75ca26bda8ffc0fc213315979575bf23ce9826205c0" machine # [ 24.138699] k3s[882]: time="2026-09-27T14:13:06Z" level=info msg="Imported docker.io/rancher/mirrored-pause:3.10.2" machine # [ 24.140241] k3s[882]: time="2026-09-27T14:13:06Z" level=info msg="Tagged docker.io/rancher/mirrored-pause@sha256:f548e0e8e3dc1896ca956272154dde3314e8cc4fde0a57577ee9fa1c63f5baf4" machine # [ 24.289699] k3s[882]: I0927 14:13:07.104499 882 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="device-taint-eviction-controller" requiredFeatureGates=["DynamicResourceAllocation","DRADeviceTaints"] machine # [ 24.292582] k3s[882]: I0927 14:13:07.104557 882 controllermanager.go:579] "Warning: skipping controller" controller="device-taint-eviction-controller" machine # [ 24.294502] k3s[882]: time="2026-09-27T14:13:07Z" level=info msg="Starting dynamiclistener CN filter node controller with SANs: [127.0.0.1 ::1 localhost machine 10.0.2.15 fec0::dc4c:54a2:4e9d:bb2a 10.43.0.1 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local]" machine # [ 24.298153] k3s[882]: time="2026-09-27T14:13:07Z" level=info msg="Tunnel server egress proxy mode: agent" machine # [ 24.421220] k3s[882]: time="2026-09-27T14:13:07Z" level=info msg="Imported 8 images from /var/lib/rancher/k3s/agent/images/k3s-airgap-images-amd64.tar.zst in 4.017448306s" machine # [ 24.421817] k3s[882]: time="2026-09-27T14:13:07Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-client.tar" machine # [ 24.467845] k3s[882]: time="2026-09-27T14:13:07Z" level=info msg="Creating new TLS secret for kube-system/k3s-serving (count: 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__dc4c_54a2_4e9d_bb2a-896a88:fec0::dc4c:54a2:4e9d:bb2a listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=500C789B8581A26A4C065AA73C514C2670A490D4]" machine # [ 24.477672] k3s[882]: time="2026-09-27T14:13:07Z" level=info msg="Active TLS secret kube-system/k3s-serving (ver=237) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__dc4c_54a2_4e9d_bb2a-896a88:fec0::dc4c:54a2:4e9d:bb2a listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=500C789B8581A26A4C065AA73C514C2670A490D4]" machine # [ 25.088210] k3s[882]: I0927 14:13:07.903024 882 node_lifecycle_controller.go:419] "Controller will reconcile labels" logger="node-lifecycle-controller" machine # [ 25.088682] k3s[882]: I0927 14:13:07.903097 882 controllermanager.go:627] "Warning: controller is disabled" controller="service-lb-controller" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 25.244165] k3s[882]: W0927 14:13:08.058914 882 probe.go:272] Flexvolume plugin directory at /usr/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating. machine # [ 25.502872] k3s[882]: time="2026-09-27T14:13:08Z" level=info msg="Starting k3s.cattle.io/v1, Kind=Addon controller" machine # [ 25.506820] k3s[882]: time="2026-09-27T14:13:08Z" level=info msg="Creating deploy event broadcaster" machine # [ 25.509766] k3s[882]: I0927 14:13:08.322578 882 controller.go:667] quota admission added evaluator for: addons.k3s.cattle.io machine # [ 25.516421] k3s[882]: time="2026-09-27T14:13:08Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 25.519558] k3s[882]: time="2026-09-27T14:13:08Z" level=info msg="Creating helm-controller event broadcaster" machine # [ 25.522973] k3s[882]: time="2026-09-27T14:13:08Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=ApplyingManifest type=Normal machine # [ 25.531101] k3s[882]: time="2026-09-27T14:13:08Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 25.537982] k3s[882]: time="2026-09-27T14:13:08Z" level=info msg="Cluster dns configmap has been set successfully" machine # [ 25.998089] k3s[882]: time="2026-09-27T14:13:08Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=AppliedManifest type=Normal machine # [ 26.007490] k3s[882]: time="2026-09-27T14:13:08Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=ApplyingManifest type=Normal machine # [ 26.088685] k3s[882]: I0927 14:13:08.903488 882 controllermanager.go:627] "Warning: controller is disabled" controller="node-route-controller" machine # [ 26.242169] k3s[882]: I0927 14:13:09.056845 882 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" requiredFeatureGates=["ClusterTrustBundle"] machine # [ 26.243449] k3s[882]: I0927 14:13:09.056880 882 controllermanager.go:579] "Warning: skipping controller" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" machine # [ 26.244641] k3s[882]: I0927 14:13:09.056894 882 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="storageversion-garbage-collector-controller" requiredFeatureGates=["APIServerIdentity","StorageVersionAPI"] machine # [ 26.245522] k3s[882]: I0927 14:13:09.056905 882 controllermanager.go:579] "Warning: skipping controller" controller="storageversion-garbage-collector-controller" machine: (finished: waiting for success: kubectl get ns farm, in 2.54 seconds) machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key machine # [ 26.394178] k3s[882]: time="2026-09-27T14:13:09Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=AppliedManifest type=Normal machine # [ 26.408038] k3s[882]: time="2026-09-27T14:13:09Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=ApplyingManifest type=Normal machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key, in 0.15 seconds) machine: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key machine # [ 26.519667] k3s[882]: time="2026-09-27T14:13:09Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 26.561640] k3s[882]: I0927 14:13:09.376512 882 serving.go:392] Generated self-signed cert in-memory machine: (finished: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key, in 0.16 seconds) machine: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine # [ 26.638873] k3s[882]: time="2026-09-27T14:13:09Z" level=info msg="Starting rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding controller" machine # [ 26.641482] k3s[882]: time="2026-09-27T14:13:09Z" level=info msg="Starting /v1, Kind=ServiceAccount controller" machine # [ 26.643664] k3s[882]: time="2026-09-27T14:13:09Z" level=info msg="Starting batch/v1, Kind=Job controller" machine # [ 26.645583] k3s[882]: time="2026-09-27T14:13:09Z" level=info msg="Starting /v1, Kind=Secret controller" machine # [ 26.646078] k3s[882]: time="2026-09-27T14:13:09Z" level=info msg="Starting /v1, Kind=ConfigMap controller" machine # [ 26.646631] k3s[882]: time="2026-09-27T14:13:09Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChart controller" machine # [ 26.647402] k3s[882]: time="2026-09-27T14:13:09Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChartConfig controller" machine: (finished: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.17 seconds) subtest: chart deploys and workers become Ready machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine # [ 26.788177] k3s[882]: I0927 14:13:09.602923 882 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="podcertificaterequest-cleaner-controller" requiredFeatureGates=["PodCertificateRequest"] machine # [ 26.788968] k3s[882]: I0927 14:13:09.602996 882 controllermanager.go:579] "Warning: skipping controller" controller="podcertificaterequest-cleaner-controller" machine # [ 26.813611] k3s[882]: I0927 14:13:09.628456 882 serving.go:392] Generated self-signed cert in-memory machine # [ 26.902117] k3s[882]: I0927 14:13:09.716749 882 controllermanager.go:160] Version: v1.35.8+k3s1 machine # [ 26.905926] k3s[882]: I0927 14:13:09.720806 882 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 26.906834] k3s[882]: I0927 14:13:09.720851 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.907544] k3s[882]: I0927 14:13:09.720862 882 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 26.908103] k3s[882]: I0927 14:13:09.720864 882 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 26.912951] k3s[882]: I0927 14:13:09.727841 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.913860] k3s[882]: I0927 14:13:09.720888 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.915572] k3s[882]: I0927 14:13:09.722789 882 secure_serving.go:211] Serving securely on 127.0.0.1:10258 machine # [ 26.916290] k3s[882]: I0927 14:13:09.722807 882 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 26.922292] k3s[882]: time="2026-09-27T14:13:09Z" level=info msg="Creating service-lb-controller event broadcaster" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 27.006921] k3s[882]: I0927 14:13:09.821757 882 shared_informer.go:377] "Caches are synced" machine # [ 27.013982] k3s[882]: I0927 14:13:09.828862 882 shared_informer.go:377] "Caches are synced" machine # [ 27.015929] k3s[882]: I0927 14:13:09.830805 882 shared_informer.go:377] "Caches are synced" machine # [ 27.396139] k3s[882]: I0927 14:13:10.210436 882 range_allocator.go:113] "No Secondary Service CIDR provided. Skipping filtering out secondary service addresses" logger="node-ipam-controller" machine # [ 27.415608] k3s[882]: I0927 14:13:10.230478 882 controllermanager.go:627] "Warning: controller is disabled" controller="selinux-warning-controller" machine # [ 27.428611] k3s[882]: I0927 14:13:10.243391 882 controller.go:667] quota admission added evaluator for: deployments.apps machine # [ 27.520348] k3s[882]: time="2026-09-27T14:13:10Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 27.546441] k3s[882]: I0927 14:13:10.361269 882 alloc.go:329] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.43.0.10"} machine # [ 27.547790] k3s[882]: time="2026-09-27T14:13:10Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=AppliedManifest type=Normal machine # [ 27.610891] k3s[882]: time="2026-09-27T14:13:10Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 27.615582] k3s[882]: time="2026-09-27T14:13:10Z" level=info msg="Starting /v1, Kind=Pod controller" machine # [ 27.620243] k3s[882]: time="2026-09-27T14:13:10Z" level=info msg="Starting apps/v1, Kind=DaemonSet controller" machine # [ 27.624822] k3s[882]: I0927 14:13:10.439705 882 controllermanager.go:329] Started "cloud-node-controller" machine # [ 27.626230] k3s[882]: I0927 14:13:10.439845 882 controllermanager.go:329] Started "cloud-node-lifecycle-controller" machine # [ 27.627667] k3s[882]: I0927 14:13:10.440100 882 node_controller.go:176] Sending events to api server. machine # [ 27.628998] k3s[882]: time="2026-09-27T14:13:10Z" level=info msg="Starting discovery.k8s.io/v1, Kind=EndpointSlice controller" machine # [ 27.630588] k3s[882]: I0927 14:13:10.440167 882 node_controller.go:185] Waiting for informer caches to sync machine # [ 27.631915] k3s[882]: I0927 14:13:10.440341 882 node_lifecycle_controller.go:112] Sending events to api server machine # [ 27.633266] k3s[882]: I0927 14:13:10.440696 882 controllermanager.go:329] Started "service-lb-controller" machine # [ 27.634568] k3s[882]: W0927 14:13:10.440708 882 controllermanager.go:306] "node-route-controller" is disabled machine # [ 27.635903] k3s[882]: I0927 14:13:10.441086 882 controller.go:235] Starting service controller machine # [ 27.637189] k3s[882]: I0927 14:13:10.441127 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.827320] k3s[882]: I0927 14:13:10.642126 882 shared_informer.go:377] "Caches are synced" machine # [ 27.997096] k3s[882]: I0927 14:13:10.810112 882 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-legacy-unknown" machine # [ 27.999027] k3s[882]: I0927 14:13:10.810158 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.000400] k3s[882]: I0927 14:13:10.812021 882 node_lifecycle_controller.go:453] "Sending events to api server" machine # [ 28.001824] k3s[882]: I0927 14:13:10.812071 882 node_lifecycle_controller.go:460] "Starting node controller" machine # [ 28.003246] k3s[882]: I0927 14:13:10.812098 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.004545] k3s[882]: I0927 14:13:10.812193 882 attach_detach_controller.go:335] "Starting attach detach controller" machine # [ 28.006041] k3s[882]: I0927 14:13:10.812214 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.007434] k3s[882]: I0927 14:13:10.812262 882 ttlafterfinished_controller.go:112] "Starting TTL after finished controller" machine # [ 28.008994] k3s[882]: I0927 14:13:10.812282 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.010310] k3s[882]: I0927 14:13:10.812348 882 controller.go:174] "Starting ephemeral volume controller" machine # [ 28.011551] k3s[882]: I0927 14:13:10.812396 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.012829] k3s[882]: I0927 14:13:10.812440 882 legacy_serviceaccount_token_cleaner.go:103] "Starting legacy service account token cleaner controller" machine # [ 28.014588] k3s[882]: I0927 14:13:10.812461 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.015898] k3s[882]: I0927 14:13:10.812602 882 replica_set.go:241] "Starting controller" name="replicationcontroller" machine # [ 28.017320] k3s[882]: I0927 14:13:10.812622 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.019289] k3s[882]: I0927 14:13:10.812843 882 publisher.go:107] "Starting root CA cert publisher controller" machine # [ 28.020597] k3s[882]: I0927 14:13:10.812856 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.021823] k3s[882]: I0927 14:13:10.812887 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.023068] k3s[882]: I0927 14:13:10.813069 882 endpointslicemirroring_controller.go:226] "Starting EndpointSliceMirroring controller" machine # [ 28.024656] k3s[882]: I0927 14:13:10.813090 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.025871] k3s[882]: I0927 14:13:10.813231 882 daemon_controller.go:309] "Starting daemon sets controller" machine # [ 28.027150] k3s[882]: I0927 14:13:10.813251 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.028412] k3s[882]: I0927 14:13:10.813280 882 cleaner.go:83] "Starting CSR cleaner controller" machine # [ 28.032114] k3s[882]: I0927 14:13:10.813417 882 ttl_controller.go:127] "Starting TTL controller" machine # [ 28.033452] k3s[882]: I0927 14:13:10.813469 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.034754] k3s[882]: I0927 14:13:10.813571 882 node_ipam_controller.go:142] "Starting ipam controller" machine # [ 28.035986] k3s[882]: I0927 14:13:10.813591 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.037230] k3s[882]: I0927 14:13:10.813872 882 pv_controller_base.go:307] "Starting persistent volume controller" machine # [ 28.038649] k3s[882]: I0927 14:13:10.813892 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.039868] k3s[882]: I0927 14:13:10.813993 882 endpoints_controller.go:193] "Starting endpoint controller" machine # [ 28.041247] k3s[882]: I0927 14:13:10.814030 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.042493] k3s[882]: I0927 14:13:10.814058 882 namespace_controller.go:202] "Starting namespace controller" machine # [ 28.044166] k3s[882]: I0927 14:13:10.814110 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.045492] k3s[882]: I0927 14:13:10.814183 882 replica_set.go:241] "Starting controller" name="replicaset" machine # [ 28.046767] k3s[882]: I0927 14:13:10.814203 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.047978] k3s[882]: I0927 14:13:10.814289 882 stateful_set.go:180] "Starting stateful set controller" machine # [ 28.049274] k3s[882]: I0927 14:13:10.814313 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.050521] k3s[882]: I0927 14:13:10.814367 882 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-serving" machine # [ 28.052353] k3s[882]: I0927 14:13:10.814389 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.053668] k3s[882]: I0927 14:13:10.814427 882 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-client" machine # [ 28.058073] k3s[882]: I0927 14:13:10.814474 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.059568] k3s[882]: I0927 14:13:10.814506 882 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kube-apiserver-client" machine # [ 28.061544] k3s[882]: I0927 14:13:10.814525 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.062798] k3s[882]: I0927 14:13:10.814577 882 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 28.065460] k3s[882]: I0927 14:13:10.815435 882 garbagecollector.go:141] "Starting controller" controller="garbagecollector" machine # [ 28.067303] k3s[882]: I0927 14:13:10.815471 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.068692] k3s[882]: I0927 14:13:10.815591 882 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 28.071373] k3s[882]: I0927 14:13:10.815877 882 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 28.073800] k3s[882]: I0927 14:13:10.816090 882 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 28.080182] k3s[882]: I0927 14:13:10.816659 882 graph_builder.go:386] "Running" component="GraphBuilder" machine # [ 28.081728] k3s[882]: I0927 14:13:10.830898 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.082959] k3s[882]: I0927 14:13:10.831009 882 tokencleaner.go:117] "Starting token cleaner controller" machine # [ 28.084242] k3s[882]: I0927 14:13:10.831032 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.085443] k3s[882]: I0927 14:13:10.831088 882 taint_eviction.go:283] "Starting" controller="taint-eviction-controller" machine # [ 28.086882] k3s[882]: I0927 14:13:10.831180 882 taint_eviction.go:288] "Sending events to API server" machine # [ 28.088223] k3s[882]: I0927 14:13:10.831191 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.089569] k3s[882]: I0927 14:13:10.831299 882 servicecidrs_controller.go:136] "Starting" controller="service-cidr-controller" machine # [ 28.091142] k3s[882]: I0927 14:13:10.831315 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.092440] k3s[882]: I0927 14:13:10.831523 882 endpointslice_controller.go:283] "Starting endpoint slice controller" machine # [ 28.093902] k3s[882]: I0927 14:13:10.831537 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.095078] k3s[882]: I0927 14:13:10.831782 882 serviceaccounts_controller.go:117] "Starting service account controller" machine # [ 28.096522] k3s[882]: I0927 14:13:10.831799 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.097847] k3s[882]: I0927 14:13:10.832040 882 pv_protection_controller.go:81] "Starting PV protection controller" machine # [ 28.099345] k3s[882]: I0927 14:13:10.832055 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.100605] k3s[882]: I0927 14:13:10.832260 882 disruption.go:458] "Sending events to api server." machine # [ 28.101838] k3s[882]: I0927 14:13:10.832339 882 disruption.go:465] "Starting disruption controller" machine # [ 28.103069] k3s[882]: I0927 14:13:10.832351 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.104394] k3s[882]: I0927 14:13:10.832551 882 certificate_controller.go:120] "Starting certificate controller" name="csrapproving" machine # [ 28.105812] k3s[882]: I0927 14:13:10.832567 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.106993] k3s[882]: I0927 14:13:10.832695 882 expand_controller.go:328] "Starting expand controller" machine # [ 28.108218] k3s[882]: I0927 14:13:10.832716 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.109465] k3s[882]: I0927 14:13:10.835401 882 horizontal.go:204] "Starting HPA controller" machine # [ 28.110653] k3s[882]: I0927 14:13:10.835418 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.111957] k3s[882]: I0927 14:13:10.835642 882 cronjob_controllerv2.go:143] "Starting cronjob controller v2" machine # [ 28.113453] k3s[882]: I0927 14:13:10.835659 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.114721] k3s[882]: I0927 14:13:10.835763 882 vac_protection_controller.go:206] "Starting VAC protection controller" machine # [ 28.116135] k3s[882]: I0927 14:13:10.835782 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.117514] k3s[882]: I0927 14:13:10.836049 882 deployment_controller.go:172] "Starting controller" controller="deployment" machine # [ 28.119097] k3s[882]: I0927 14:13:10.836067 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.120458] k3s[882]: I0927 14:13:10.836331 882 clusterroleaggregation_controller.go:194] "Starting ClusterRoleAggregator controller" machine # [ 28.122153] k3s[882]: I0927 14:13:10.836346 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.123472] k3s[882]: I0927 14:13:10.836557 882 pvc_protection_controller.go:166] "Starting PVC protection controller" machine # [ 28.124987] k3s[882]: I0927 14:13:10.836578 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.126349] k3s[882]: I0927 14:13:10.836662 882 gc_controller.go:98] "Starting GC controller" machine # [ 28.127595] k3s[882]: I0927 14:13:10.836676 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.128856] k3s[882]: I0927 14:13:10.837082 882 job_controller.go:254] "Starting job controller" machine # [ 28.130123] k3s[882]: I0927 14:13:10.837104 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.131487] k3s[882]: I0927 14:13:10.837895 882 controller.go:423] "Starting resource claim controller" machine # [ 28.132766] k3s[882]: I0927 14:13:10.837915 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.133940] k3s[882]: I0927 14:13:10.841167 882 resource_quota_controller.go:297] "Starting resource quota controller" machine # [ 28.135436] k3s[882]: I0927 14:13:10.841191 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.136751] k3s[882]: I0927 14:13:10.841688 882 resource_quota_monitor.go:309] "QuotaMonitor running" machine # [ 28.138097] k3s[882]: I0927 14:13:10.861817 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.139599] k3s[882]: I0927 14:13:10.934313 882 shared_informer.go:370] "Waiting for caches to sync" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 28.402145] k3s[882]: I0927 14:13:11.214450 882 shared_informer.go:377] "Caches are synced" machine # [ 28.403571] k3s[882]: I0927 14:13:11.214521 882 shared_informer.go:377] "Caches are synced" machine # [ 28.404804] k3s[882]: I0927 14:13:11.214580 882 shared_informer.go:377] "Caches are synced" machine # [ 28.413740] k3s[882]: time="2026-09-27T14:13:11Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" object=kube-system/local-storage reason=DeletingManifest type=Normal machine # [ 28.417378] k3s[882]: I0927 14:13:11.232281 882 shared_informer.go:377] "Caches are synced" machine # [ 28.418763] k3s[882]: I0927 14:13:11.233672 882 shared_informer.go:377] "Caches are synced" machine # [ 28.420228] k3s[882]: I0927 14:13:11.235135 882 shared_informer.go:377] "Caches are synced" machine # [ 28.421612] k3s[882]: I0927 14:13:11.236501 882 shared_informer.go:377] "Caches are synced" machine # [ 28.422737] k3s[882]: I0927 14:13:11.236544 882 shared_informer.go:377] "Caches are synced" machine # [ 28.423891] k3s[882]: I0927 14:13:11.236625 882 shared_informer.go:377] "Caches are synced" machine # [ 28.425113] k3s[882]: I0927 14:13:11.237182 882 shared_informer.go:377] "Caches are synced" machine # [ 28.426361] k3s[882]: I0927 14:13:11.237275 882 shared_informer.go:377] "Caches are synced" machine # [ 28.427562] k3s[882]: I0927 14:13:11.237647 882 shared_informer.go:377] "Caches are synced" machine # [ 28.428822] k3s[882]: I0927 14:13:11.237677 882 shared_informer.go:377] "Caches are synced" machine # [ 28.430077] k3s[882]: I0927 14:13:11.242684 882 shared_informer.go:377] "Caches are synced" machine # [ 28.431228] k3s[882]: I0927 14:13:11.242865 882 shared_informer.go:377] "Caches are synced" machine # [ 28.432438] k3s[882]: I0927 14:13:11.242929 882 shared_informer.go:377] "Caches are synced" machine # [ 28.433690] k3s[882]: I0927 14:13:11.242990 882 shared_informer.go:377] "Caches are synced" machine # [ 28.434918] k3s[882]: I0927 14:13:11.243027 882 shared_informer.go:377] "Caches are synced" machine # [ 28.436150] k3s[882]: I0927 14:13:11.244183 882 shared_informer.go:377] "Caches are synced" machine # [ 28.437365] k3s[882]: I0927 14:13:11.244228 882 shared_informer.go:377] "Caches are synced" machine # [ 28.438541] k3s[882]: I0927 14:13:11.244275 882 shared_informer.go:377] "Caches are synced" machine # [ 28.439673] k3s[882]: I0927 14:13:11.244324 882 shared_informer.go:377] "Caches are synced" machine # [ 28.440912] k3s[882]: I0927 14:13:11.244407 882 shared_informer.go:377] "Caches are synced" machine # [ 28.442176] k3s[882]: time="2026-09-27T14:13:11Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=ApplyingManifest type=Normal machine # [ 28.445466] k3s[882]: I0927 14:13:11.260134 882 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 28.447882] k3s[882]: I0927 14:13:11.262770 882 shared_informer.go:377] "Caches are synced" machine # [ 28.453829] k3s[882]: I0927 14:13:11.268697 882 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 28.496234] k3s[882]: I0927 14:13:11.311052 882 shared_informer.go:377] "Caches are synced" machine # [ 28.497957] k3s[882]: I0927 14:13:11.312476 882 shared_informer.go:377] "Caches are synced" machine # [ 28.498593] k3s[882]: I0927 14:13:11.312501 882 shared_informer.go:377] "Caches are synced" machine # [ 28.499113] k3s[882]: I0927 14:13:11.312539 882 shared_informer.go:377] "Caches are synced" machine # [ 28.499630] k3s[882]: I0927 14:13:11.312595 882 shared_informer.go:377] "Caches are synced" machine # [ 28.500151] k3s[882]: I0927 14:13:11.312752 882 shared_informer.go:377] "Caches are synced" machine # [ 28.500667] k3s[882]: I0927 14:13:11.312802 882 shared_informer.go:377] "Caches are synced" machine # [ 28.501223] k3s[882]: I0927 14:13:11.312980 882 shared_informer.go:377] "Caches are synced" machine # [ 28.501725] k3s[882]: I0927 14:13:11.313432 882 shared_informer.go:377] "Caches are synced" machine # [ 28.502230] k3s[882]: I0927 14:13:11.313437 882 shared_informer.go:377] "Caches are synced" machine # [ 28.502736] k3s[882]: I0927 14:13:11.313519 882 shared_informer.go:377] "Caches are synced" machine # [ 28.503420] k3s[882]: I0927 14:13:11.313626 882 shared_informer.go:377] "Caches are synced" machine # [ 28.503918] k3s[882]: I0927 14:13:11.313996 882 shared_informer.go:377] "Caches are synced" machine # [ 28.504615] k3s[882]: I0927 14:13:11.313999 882 shared_informer.go:377] "Caches are synced" machine # [ 28.505096] k3s[882]: I0927 14:13:11.314065 882 shared_informer.go:377] "Caches are synced" machine # [ 28.505792] k3s[882]: I0927 14:13:11.314166 882 shared_informer.go:377] "Caches are synced" machine # [ 28.506484] k3s[882]: I0927 14:13:11.314244 882 shared_informer.go:377] "Caches are synced" machine # [ 28.506978] k3s[882]: I0927 14:13:11.314362 882 shared_informer.go:377] "Caches are synced" machine # [ 28.507658] k3s[882]: I0927 14:13:11.314546 882 range_allocator.go:177] "Sending events to api server" machine # [ 28.508134] k3s[882]: I0927 14:13:11.314597 882 range_allocator.go:181] "Starting range CIDR allocator" machine # [ 28.508600] k3s[882]: I0927 14:13:11.314609 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.509067] k3s[882]: I0927 14:13:11.314621 882 shared_informer.go:377] "Caches are synced" machine # [ 28.518741] k3s[882]: time="2026-09-27T14:13:11Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 28.542879] k3s[882]: I0927 14:13:11.357389 882 controller.go:667] quota admission added evaluator for: replicasets.apps machine # [ 28.548436] k3s[882]: I0927 14:13:11.363316 882 controller.go:667] quota admission added evaluator for: helmcharts.helm.cattle.io machine # [ 28.551671] k3s[882]: time="2026-09-27T14:13:11Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=AppliedManifest type=Normal machine # [ 28.563908] k3s[882]: time="2026-09-27T14:13:11Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=ApplyingManifest type=Normal machine # [ 28.587069] k3s[882]: time="2026-09-27T14:13:11Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Deferred node password secret validation complete" object=machine reason=NodePasswordValidationComplete type=Normal machine # [ 28.591075] k3s[882]: time="2026-09-27T14:13:11Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Applying HelmChart from https://%{KUBERNETES_API}%/static/charts/nix-grpc-farm.tgz using Job kube-system/helm-install-nix-grpc-farm " object=kube-system/nix-grpc-farm reason=ApplyJob type=Normal machine # [ 28.619883] k3s[882]: I0927 14:13:11.434727 882 controller.go:667] quota admission added evaluator for: jobs.batch machine # [ 28.953707] k3s[882]: time="2026-09-27T14:13:11Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=AppliedManifest type=Normal machine # [ 28.966273] k3s[882]: time="2026-09-27T14:13:11Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=ApplyingManifest type=Normal machine # [ 29.042176] k3s[882]: time="2026-09-27T14:13:11Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=AppliedManifest type=Normal machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 29.395939] k3s[882]: time="2026-09-27T14:13:12Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/traefik.yaml\"" object=kube-system/traefik reason=DeletingManifest type=Normal machine # [ 29.400840] k3s[882]: I0927 14:13:12.215738 882 shared_informer.go:377] "Caches are synced" machine # [ 29.402108] k3s[882]: I0927 14:13:12.215761 882 garbagecollector.go:166] "Garbage collector: all resource monitors have synced" machine # [ 29.403774] k3s[882]: I0927 14:13:12.215773 882 garbagecollector.go:169] "Proceeding to collect garbage" machine # [ 29.407968] k3s[882]: time="2026-09-27T14:13:12Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Resumed synced Job kube-system/helm-install-nix-grpc-farm" object=kube-system/nix-grpc-farm reason=ResumeJob type=Normal machine # [ 29.419676] k3s[882]: I0927 14:13:12.234536 882 shared_informer.go:377] "Caches are synced" machine # [ 29.519591] k3s[882]: time="2026-09-27T14:13:12Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 30.093222] postgres[1194]: [1194] ERROR: relation "goose_db_version" does not exist at character 36 machine # [ 30.094594] postgres[1194]: [1194] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC machine # [ 30.117109] niks3-server[1186]: 2026/09/27 14:13:12 OK 20241026095416_initial_model.sql (11.98ms) machine # [ 30.127759] niks3-server[1186]: 2026/09/27 14:13:12 OK 20251210153512_drop_unused_gin_index.sql (3.45ms) machine # [ 30.132041] niks3-server[1186]: 2026/09/27 14:13:12 OK 20251218171726_add_pins.sql (4.22ms) machine # [ 30.136513] niks3-server[1186]: 2026/09/27 14:13:12 OK 20260628120000_add_object_size_and_stats.sql (4.35ms) machine # [ 30.143228] niks3-server[1186]: 2026/09/27 14:13:12 OK 20260905000000_add_claims.sql (6.7ms) machine # [ 30.146740] niks3-server[1186]: 2026/09/27 14:13:12 OK 20260920000000_drop_claims.sql (3.48ms) machine # [ 30.148691] niks3-server[1186]: 2026/09/27 14:13:12 OK 20260923120000_add_pushes.sql (1.9ms) machine # [ 30.149643] niks3-server[1186]: 2026/09/27 14:13:12 goose: successfully migrated database to version: 20260923120000 machine # [ 30.154349] niks3-server[1186]: 2026/09/27 14:13:12 OK 1_commit_pending_closure.sql (3.04ms) machine # [ 30.156444] niks3-server[1186]: 2026/09/27 14:13:12 OK 2_object_stats_trigger.sql (2.05ms) machine # [ 30.158987] niks3-server[1186]: 2026/09/27 14:13:12 OK 3_commit_push.sql (2.44ms) machine # [ 30.159539] niks3-server[1186]: 2026/09/27 14:13:12 goose: up to current file version: 3 machine # [ 30.164215] niks3-server[1186]: 2026/09/27 14:13:12 INFO OIDC provider initialized name=kubernetes issuer=https://kubernetes.default.svc.cluster.local machine # [ 30.164915] niks3-server[1186]: 2026/09/27 14:13:12 INFO OIDC authentication enabled config=/nix/store/v0b0sqyzhrjsz48x3klf7b7vl89apzs0-niks3-oidc.json machine # [ 30.165464] niks3-server[1186]: 2026/09/27 14:13:12 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key machine # [ 30.199525] niks3-server[1186]: 2026/09/27 14:13:13 INFO Read proxy enabled — serving cache objects from S3 machine # [ 30.200319] niks3-server[1186]: 2026/09/27 14:13:13 INFO Using socket-activated listener address=0.0.0.0:5751 machine # [ 30.200954] niks3-server[1186]: 2026/09/27 14:13:13 INFO systemd watchdog enabled interval=15s machine # [ 30.202098] systemd[1]: Started niks3 server. machine # [ 30.202726] niks3-server[1186]: 2026/09/27 14:13:13 INFO Starting HTTP server address=0.0.0.0:5751 machine # [ 30.203211] systemd[1]: Reached target Multi-User System. machine # [ 30.204216] systemd[1]: Startup finished in 1.236s (kernel) + 3.841s (initrd) + 25.124s (userspace) = 30.201s. machine # [ 30.519674] k3s[882]: time="2026-09-27T14:13:13Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 31.521138] k3s[882]: time="2026-09-27T14:13:14Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 31.728853] k3s[882]: time="2026-09-27T14:13:14Z" level=info msg="Imported docker.io/library/nix-grpc-farm-client:0.1.0-beta.4" machine # [ 31.731611] k3s[882]: time="2026-09-27T14:13:14Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-client@sha256:8b612cf4676d209af4096f134d9f8682be2ba7291fb36d9feeabcff9a5423895" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 32.215235] k3s[882]: time="2026-09-27T14:13:15Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-client.tar in 7.794149535s" machine # [ 32.216110] k3s[882]: time="2026-09-27T14:13:15Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-lb.tar" machine # [ 32.410559] k3s[882]: time="2026-09-27T14:13:15Z" level=info msg="Started tunnel to 10.0.2.15:6443" machine # [ 32.412172] k3s[882]: time="2026-09-27T14:13:15Z" level=info msg="Stopped tunnel to 127.0.0.1:6443" machine # [ 32.412907] k3s[882]: time="2026-09-27T14:13:15Z" level=info msg="Connecting to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 32.414510] k3s[882]: time="2026-09-27T14:13:15Z" level=info msg="Proxy done" err="context canceled" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 32.416103] k3s[882]: time="2026-09-27T14:13:15Z" level=info msg="error in remotedialer server [400]: websocket: close 1006 (abnormal closure): unexpected EOF" machine # [ 32.431038] k3s[882]: time="2026-09-27T14:13:15Z" level=info msg="Handling backend connection request [machine]" machine # [ 32.433761] k3s[882]: time="2026-09-27T14:13:15Z" level=info msg="Connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 32.436665] k3s[882]: time="2026-09-27T14:13:15Z" level=info msg="Remotedialer connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 32.520574] k3s[882]: time="2026-09-27T14:13:15Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 33.520460] k3s[882]: time="2026-09-27T14:13:16Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 33.827618] k3s[882]: time="2026-09-27T14:13:16Z" level=info msg="Imported docker.io/library/nix-grpc-farm-lb:0.1.0-beta.4" machine # [ 33.838113] k3s[882]: time="2026-09-27T14:13:16Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-lb@sha256:18ee6724be589622e1aee9d13c5121e7b2c992ca636c935ade90c66423e18f37" machine # [ 33.894773] k3s[882]: time="2026-09-27T14:13:16Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-lb.tar in 1.679014791s" machine # [ 33.899710] k3s[882]: time="2026-09-27T14:13:16Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm.tar" machine # [ 33.914072] k3s[882]: time="2026-09-27T14:13:16Z" level=info msg="Running kubelet --cloud-provider=external --config-dir=/var/lib/rancher/k3s/agent/etc/kubelet.conf.d --containerd=/run/k3s/containerd/containerd.sock --eviction-hard=nodefs.available<1%,imagefs.available<1% --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubelet.kubeconfig --node-ip=10.0.2.15,fec0::dc4c:54a2:4e9d:bb2a --node-labels= --read-only-port=0" machine # [ 33.915534] k3s[882]: Flag --containerd has been deprecated, This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed. machine # [ 33.929952] k3s[882]: I0927 14:13:16.744735 882 server.go:521] "Kubelet version" kubeletVersion="v1.35.8+k3s1" machine # [ 33.931956] k3s[882]: I0927 14:13:16.744784 882 server.go:523] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 33.933338] k3s[882]: I0927 14:13:16.744832 882 watchdog_linux.go:95] "Systemd watchdog is not enabled" machine # [ 33.934612] k3s[882]: I0927 14:13:16.744854 882 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." machine # [ 33.937850] k3s[882]: I0927 14:13:16.747223 882 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/agent/client-ca.crt" machine # [ 33.938864] k3s[882]: I0927 14:13:16.752877 882 server.go:1414] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" machine # [ 33.945248] k3s[882]: I0927 14:13:16.760000 882 server.go:771] "--cgroups-per-qos enabled, but --cgroup-root was not specified. Defaulting to /" machine # [ 33.946445] k3s[882]: I0927 14:13:16.760032 882 server.go:832] "NoSwap is set due to memorySwapBehavior not specified" memorySwapBehavior="" FailSwapOn=false machine # [ 33.947566] k3s[882]: I0927 14:13:16.760233 882 container_manager_linux.go:272] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] machine # [ 33.948555] k3s[882]: I0927 14:13:16.760255 882 container_manager_linux.go:277] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"machine","RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} machine # [ 33.949584] k3s[882]: I0927 14:13:16.760428 882 topology_manager.go:143] "Creating topology manager with none policy" machine # [ 33.950293] k3s[882]: I0927 14:13:16.760444 882 container_manager_linux.go:308] "Creating device plugin manager" machine # [ 33.951083] k3s[882]: I0927 14:13:16.760511 882 container_manager_linux.go:317] "Creating Dynamic Resource Allocation (DRA) manager" machine # [ 33.952147] k3s[882]: I0927 14:13:16.767031 882 state_mem.go:41] "Initialized" logger="CPUManager state memory" machine # [ 33.953224] k3s[882]: I0927 14:13:16.767295 882 kubelet.go:482] "Attempting to sync node with API server" machine # [ 33.953946] k3s[882]: I0927 14:13:16.767316 882 kubelet.go:383] "Adding static pod path" path="/var/lib/rancher/k3s/agent/pod-manifests" machine # [ 33.954311] k3s[882]: I0927 14:13:16.767350 882 kubelet.go:394] "Adding apiserver pod source" machine # [ 33.954977] k3s[882]: I0927 14:13:16.767366 882 apiserver.go:42] "Waiting for node sync before watching apiserver pods" machine # [ 33.955691] k3s[882]: I0927 14:13:16.770292 882 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="containerd" version="2.2.7-k3s1" apiVersion="v1" machine # [ 33.956597] k3s[882]: I0927 14:13:16.771385 882 kubelet.go:945] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" machine # [ 33.957336] k3s[882]: I0927 14:13:16.771410 882 kubelet.go:972] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" machine # [ 33.987937] k3s[882]: I0927 14:13:16.802805 882 server.go:1252] "Started kubelet" machine # [ 33.990151] k3s[882]: I0927 14:13:16.803784 882 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 machine # [ 33.992100] k3s[882]: I0927 14:13:16.803899 882 server_v1.go:49] "podresources" method="list" useActivePods=true machine # [ 33.993501] k3s[882]: I0927 14:13:16.804086 882 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" machine # [ 33.995396] k3s[882]: I0927 14:13:16.804143 882 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 machine # [ 33.996903] k3s[882]: I0927 14:13:16.805180 882 server.go:317] "Adding debug handlers to kubelet server" machine # [ 33.998247] k3s[882]: I0927 14:13:16.809371 882 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" machine # [ 33.999590] k3s[882]: E0927 14:13:16.810155 882 kubelet.go:1661] "Image garbage collection failed once. Stats initialization may not have completed yet" err="invalid capacity 0 on image filesystem" machine # [ 34.001972] k3s[882]: I0927 14:13:16.810454 882 dynamic_serving_content.go:135] "Starting controller" name="kubelet-server-cert-files::/var/lib/rancher/k3s/agent/serving-kubelet.crt::/var/lib/rancher/k3s/agent/serving-kubelet.key" machine # [ 34.004703] k3s[882]: I0927 14:13:16.810861 882 volume_manager.go:311] "Starting Kubelet Volume Manager" machine # [ 34.006094] k3s[882]: I0927 14:13:16.811070 882 desired_state_of_world_populator.go:146] "Desired state populator starts to run" machine # [ 34.007739] k3s[882]: I0927 14:13:16.811120 882 reconciler.go:29] "Reconciler: start to sync state" machine # [ 34.009084] k3s[882]: E0927 14:13:16.815007 882 kubelet_node_status.go:392] "Error getting the current node from lister" err="node \"machine\" not found" machine # [ 34.010878] k3s[882]: I0927 14:13:16.815575 882 factory.go:223] Registration of the systemd container factory successfully machine # [ 34.012340] k3s[882]: I0927 14:13:16.815799 882 factory.go:221] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory machine # [ 34.014981] k3s[882]: I0927 14:13:16.818843 882 factory.go:223] Registration of the containerd container factory successfully machine # [ 34.016574] k3s[882]: E0927 14:13:16.830239 882 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"machine\" not found" node="machine" machine # [ 34.029439] k3s[882]: I0927 14:13:16.843854 882 cpu_manager.go:225] "Starting" policy="none" machine # [ 34.030912] k3s[882]: I0927 14:13:16.843876 882 cpu_manager.go:226] "Reconciling" reconcilePeriod="10s" machine # [ 34.032369] k3s[882]: I0927 14:13:16.843899 882 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" machine # [ 34.035029] k3s[882]: I0927 14:13:16.849663 882 policy_none.go:50] "Start" machine # [ 34.036165] k3s[882]: I0927 14:13:16.850047 882 memory_manager.go:187] "Starting memorymanager" policy="None" machine # [ 34.037739] k3s[882]: I0927 14:13:16.850187 882 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" machine # [ 34.044657] k3s[882]: I0927 14:13:16.859448 882 policy_none.go:44] "Start" machine # [ 34.052217] systemd[1]: Created slice libcontainer container kubepods.slice. machine # [ 34.067084] systemd[1]: Created slice libcontainer container kubepods-burstable.slice. machine # [ 34.072725] systemd[1]: Created slice libcontainer container kubepods-besteffort.slice. machine # [ 34.086332] k3s[882]: E0927 14:13:16.900370 882 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" machine # [ 34.087094] k3s[882]: I0927 14:13:16.900486 882 eviction_manager.go:194] "Eviction manager: starting control loop" machine # [ 34.087923] k3s[882]: I0927 14:13:16.900515 882 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" machine # [ 34.088288] k3s[882]: I0927 14:13:16.900866 882 plugin_manager.go:121] "Starting Kubelet Plugin Manager" machine # [ 34.094062] k3s[882]: E0927 14:13:16.906584 882 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="no imagefs label for configured runtime" machine # [ 34.094755] k3s[882]: E0927 14:13:16.906627 882 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"machine\" not found" machine # [ 34.131111] k3s[882]: I0927 14:13:16.945968 882 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" machine # [ 34.137688] k3s[882]: I0927 14:13:16.952567 882 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" machine # [ 34.138590] k3s[882]: I0927 14:13:16.952619 882 status_manager.go:249] "Starting to sync pod status with apiserver" machine # [ 34.139049] k3s[882]: I0927 14:13:16.952665 882 kubelet.go:2506] "Starting kubelet main sync loop" machine # [ 34.139584] k3s[882]: E0927 14:13:16.952722 882 kubelet.go:2530] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 34.187349] k3s[882]: I0927 14:13:17.002183 882 kubelet_node_status.go:74] "Attempting to register node" node="machine" machine # [ 34.192466] k3s[882]: I0927 14:13:17.007338 882 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"machine\" does not exist" machine # [ 34.195859] k3s[882]: time="2026-09-27T14:13:17Z" level=info msg="Adding node OwnerReference to node-password secret machine.node-password.k3s" machine # [ 34.199783] k3s[882]: I0927 14:13:17.008976 882 node_controller.go:429] Initializing node machine with cloud provider machine # [ 34.200448] k3s[882]: I0927 14:13:17.009023 882 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 34.200962] k3s[882]: E0927 14:13:17.009043 882 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 34.201697] k3s[882]: I0927 14:13:17.010858 882 kubelet_node_status.go:77] "Successfully registered node" node="machine" machine # [ 34.202198] k3s[882]: I0927 14:13:17.014279 882 node_controller.go:429] Initializing node machine with cloud provider machine # [ 34.202994] k3s[882]: I0927 14:13:17.014332 882 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 34.203893] k3s[882]: E0927 14:13:17.014383 882 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 34.204727] k3s[882]: I0927 14:13:17.016346 882 range_allocator.go:433] "Set node PodCIDR" node="machine" podCIDRs=["10.42.0.0/24"] machine # [ 34.207838] k3s[882]: time="2026-09-27T14:13:17Z" level=info msg="Annotations and labels have been set successfully on node: machine" machine # [ 34.210764] k3s[882]: time="2026-09-27T14:13:17Z" level=info msg="Starting flannel with backend vxlan" machine # [ 34.215324] k3s[882]: I0927 14:13:17.030180 882 node_controller.go:429] Initializing node machine with cloud provider machine # [ 34.216218] k3s[882]: I0927 14:13:17.030228 882 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 34.217057] k3s[882]: E0927 14:13:17.031051 882 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 34.223982] k3s[882]: I0927 14:13:17.038652 882 node_controller.go:429] Initializing node machine with cloud provider machine # [ 34.224731] k3s[882]: I0927 14:13:17.038701 882 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 34.225389] k3s[882]: E0927 14:13:17.038720 882 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 34.229734] k3s[882]: time="2026-09-27T14:13:17Z" level=info msg="Synced coredns NodeHosts entries for machine" machine # [ 34.231751] k3s[882]: I0927 14:13:17.046627 882 node_controller.go:429] Initializing node machine with cloud provider machine # [ 34.236167] k3s[882]: I0927 14:13:17.050973 882 kuberuntime_manager.go:2095] "Updating runtime config through cri with podcidr" CIDR="10.42.0.0/24" machine # [ 34.237669] k3s[882]: I0927 14:13:17.052406 882 kubelet_network.go:47] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.42.0.0/24" machine # [ 34.244513] k3s[882]: time="2026-09-27T14:13:17Z" level=info msg="Flannel found PodCIDR assigned for node machine" machine # [ 34.245048] k3s[882]: time="2026-09-27T14:13:17Z" level=info msg="The interface eth0 with ipv4 address 10.0.2.15 will be used by flannel" machine # [ 34.247671] k3s[882]: I0927 14:13:17.062550 882 kube.go:139] Waiting 10m0s for node controller to sync machine # [ 34.248524] k3s[882]: I0927 14:13:17.062626 882 kube.go:537] Starting kube subnet manager machine # [ 34.309617] k3s[882]: I0927 14:13:17.124480 882 node_controller.go:474] Successfully initialized node machine with cloud provider machine # [ 34.310038] k3s[882]: I0927 14:13:17.124757 882 event.go:389] "Event occurred" object="machine" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="Synced" message="Node synced successfully" machine # [ 34.319510] k3s[882]: I0927 14:13:17.134391 882 server.go:173] "Starting Kubernetes Scheduler" version="v1.35.8+k3s1" machine # [ 34.320151] k3s[882]: I0927 14:13:17.134413 882 server.go:175] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 34.323102] k3s[882]: I0927 14:13:17.137340 882 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 34.324919] k3s[882]: I0927 14:13:17.137346 882 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 34.327255] k3s[882]: I0927 14:13:17.137401 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 34.328705] k3s[882]: I0927 14:13:17.137425 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 34.330251] k3s[882]: I0927 14:13:17.137448 882 secure_serving.go:211] Serving securely on 127.0.0.1:10259 machine # [ 34.331711] k3s[882]: I0927 14:13:17.137371 882 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 34.334354] k3s[882]: I0927 14:13:17.137471 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 34.336097] k3s[882]: I0927 14:13:17.137542 882 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 34.336831] k3s[882]: I0927 14:13:17.137673 882 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 34.341332] k3s[882]: I0927 14:13:17.156149 882 kubelet_node_status.go:427] "Fast updating node status as it just became ready" machine # [ 34.346338] k3s[882]: I0927 14:13:17.161182 882 topologycache.go:237] "Can't get CPU or zone information for node" node="machine" machine # [ 34.381449] k3s[882]: time="2026-09-27T14:13:17Z" level=info msg="Tunnel authorizer set Kubelet Port 0.0.0.0:10250" machine # [ 34.523162] k3s[882]: I0927 14:13:17.337655 882 shared_informer.go:377] "Caches are synced" machine # [ 34.524607] k3s[882]: I0927 14:13:17.337799 882 shared_informer.go:377] "Caches are synced" machine # [ 34.525803] k3s[882]: I0927 14:13:17.338069 882 shared_informer.go:377] "Caches are synced" machine # [ 34.527067] k3s[882]: time="2026-09-27T14:13:17Z" level=info msg="Labels and annotations have been set successfully on node: machine" machine # [ 34.711583] k3s[882]: I0927 14:13:17.526311 882 server.go:218] "Successfully retrieved NodeIPs" NodeIPs=["10.0.2.15","fec0::dc4c:54a2:4e9d:bb2a"] machine # [ 34.715249] k3s[882]: E0927 14:13:17.526483 882 server.go:255] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`" machine # [ 34.738236] k3s[882]: I0927 14:13:17.553039 882 server.go:264] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4" machine # [ 34.740719] k3s[882]: I0927 14:13:17.553105 882 server_linux.go:136] "Using iptables Proxier" machine # [ 34.754621] k3s[882]: I0927 14:13:17.569490 882 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4" machine # [ 34.766158] k3s[882]: I0927 14:13:17.581021 882 server.go:529] "Version info" version="v1.35.8+k3s1" machine # [ 34.767550] k3s[882]: I0927 14:13:17.581053 882 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 34.769227] k3s[882]: I0927 14:13:17.582630 882 config.go:403] "Starting serviceCIDR config controller" machine # [ 34.771086] k3s[882]: I0927 14:13:17.582657 882 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config" machine # [ 34.772743] k3s[882]: I0927 14:13:17.582703 882 config.go:200] "Starting service config controller" machine # [ 34.773983] k3s[882]: I0927 14:13:17.582716 882 shared_informer.go:349] "Waiting for caches to sync" controller="service config" machine # [ 34.775618] k3s[882]: I0927 14:13:17.582748 882 config.go:106] "Starting endpoint slice config controller" machine # [ 34.776993] k3s[882]: I0927 14:13:17.582761 882 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config" machine # [ 34.778987] k3s[882]: I0927 14:13:17.583284 882 config.go:309] "Starting node config controller" machine # [ 34.779686] k3s[882]: I0927 14:13:17.583319 882 shared_informer.go:349] "Waiting for caches to sync" controller="node config" machine # [ 34.780402] k3s[882]: I0927 14:13:17.583351 882 shared_informer.go:356] "Caches are synced" controller="node config" machine # [ 34.953472] k3s[882]: I0927 14:13:17.768232 882 apiserver.go:52] "Watching apiserver" machine # [ 35.248514] k3s[882]: I0927 14:13:18.063293 882 kube.go:163] Node controller sync successful machine # [ 35.250087] k3s[882]: I0927 14:13:18.063411 882 vxlan.go:128] VXLAN config: VNI=1 Port=0 GBP=false Learning=false DirectRouting=false machine # [ 35.252154] k3s[882]: I0927 14:13:18.066761 882 kube.go:704] List of node(machine) annotations: map[string]string{"alpha.kubernetes.io/provided-node-ip":"10.0.2.15,fec0::dc4c:54a2:4e9d:bb2a", "k3s.io/hostname":"machine", "k3s.io/internal-ip":"10.0.2.15,fec0::dc4c:54a2:4e9d:bb2a", "k3s.io/node-args":"[\"server\",\"--disable\",\"traefik\",\"--disable\",\"metrics-server\",\"--disable\",\"local-storage\",\"--kubelet-arg\",\"eviction-hard=nodefs.available\\u003c1%,imagefs.available\\u003c1%\"]", "k3s.io/node-config-hash":"EFXPOZ7ZWHRCLFNW4X4ZDPFQMSAOP3BLEIN2VE47TDRKQ4UIWKUQ====", "k3s.io/node-env":"{}", "node.alpha.kubernetes.io/ttl":"0", "volumes.kubernetes.io/controller-managed-attach-detach":"true"} machine # [ 35.286348] (udev-worker)[1274]: Network interface NamePolicy= disabled on kernel command line. machine # [ 35.298098] k3s[882]: I0927 14:13:18.111918 882 iptables.go:50] Starting flannel in iptables mode... machine # [ 35.299918] k3s[882]: time="2026-09-27T14:13:18Z" level=warning msg="no subnet found for key: FLANNEL_NETWORK in file: /run/flannel/subnet.env" machine # [ 35.301687] k3s[882]: time="2026-09-27T14:13:18Z" level=warning msg="no subnet found for key: FLANNEL_SUBNET in file: /run/flannel/subnet.env" machine # [ 35.303737] k3s[882]: time="2026-09-27T14:13:18Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_NETWORK in file: /run/flannel/subnet.env" machine # [ 35.305848] k3s[882]: time="2026-09-27T14:13:18Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_SUBNET in file: /run/flannel/subnet.env" machine # [ 35.308346] k3s[882]: I0927 14:13:18.112183 882 iptables.go:101] Current network or subnet (10.42.0.0/16, 10.42.0.0/24) is not equal to previous one (0.0.0.0/0, 0.0.0.0/0), trying to recycle old iptables rules machine # [ 35.311450] k3s[882]: I0927 14:13:18.112930 882 kube.go:558] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.42.0.0/24] machine # [ 35.318075] systemd[1]: Created slice libcontainer container kubepods-burstable-pod701c990d_96cc_45af_8607_d8d51be65771.slice. machine # [ 35.328428] dhcpcd[684]: flannel.1: IAID 58:52:0b:b0 machine # [ 35.329236] dhcpcd[684]: flannel.1: adding address fe80::109f:58ff:fe52:bb0 machine # [ 35.338508] systemd[1]: Created slice libcontainer container kubepods-burstable-pod19979905_8f3a_4a8c_bb22_e6627815cae6.slice. machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 35.367857] k3s[882]: I0927 14:13:18.182738 882 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config" machine # [ 35.368847] k3s[882]: I0927 14:13:18.183750 882 shared_informer.go:356] "Caches are synced" controller="endpoint slice config" machine # [ 35.369662] k3s[882]: I0927 14:13:18.183029 882 shared_informer.go:356] "Caches are synced" controller="service config" machine # [ 35.382913] k3s[882]: I0927 14:13:18.197760 882 iptables.go:111] Setting up masking rules machine # [ 35.396857] k3s[882]: I0927 14:13:18.211699 882 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" machine # [ 35.402326] k3s[882]: I0927 14:13:18.217193 882 iptables.go:212] Changing default FORWARD chain policy to ACCEPT machine # [ 35.403318] k3s[882]: I0927 14:13:18.218202 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/701c990d-96cc-45af-8607-d8d51be65771-config-volume\") pod \"coredns-c5fdd76cf-bc7ln\" (UID: \"701c990d-96cc-45af-8607-d8d51be65771\") " pod="kube-system/coredns-c5fdd76cf-bc7ln" machine # [ 35.403930] k3s[882]: I0927 14:13:18.218248 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-config-volume\" (UniqueName: \"kubernetes.io/configmap/701c990d-96cc-45af-8607-d8d51be65771-custom-config-volume\") pod \"coredns-c5fdd76cf-bc7ln\" (UID: \"701c990d-96cc-45af-8607-d8d51be65771\") " pod="kube-system/coredns-c5fdd76cf-bc7ln" machine # [ 35.404627] k3s[882]: I0927 14:13:18.218280 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/19979905-8f3a-4a8c-bb22-e6627815cae6-klipper-helm\") pod \"helm-install-nix-grpc-farm-d9sxg\" (UID: \"19979905-8f3a-4a8c-bb22-e6627815cae6\") " pod="kube-system/helm-install-nix-grpc-farm-d9sxg" machine # [ 35.405128] k3s[882]: I0927 14:13:18.218311 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/19979905-8f3a-4a8c-bb22-e6627815cae6-klipper-cache\") pod \"helm-install-nix-grpc-farm-d9sxg\" (UID: \"19979905-8f3a-4a8c-bb22-e6627815cae6\") " pod="kube-system/helm-install-nix-grpc-farm-d9sxg" machine # [ 35.405292] k3s[882]: I0927 14:13:18.218349 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"values\" (UniqueName: \"kubernetes.io/projected/19979905-8f3a-4a8c-bb22-e6627815cae6-values\") pod \"helm-install-nix-grpc-farm-d9sxg\" (UID: \"19979905-8f3a-4a8c-bb22-e6627815cae6\") " pod="kube-system/helm-install-nix-grpc-farm-d9sxg" machine # [ 35.405845] k3s[882]: I0927 14:13:18.218373 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tpl8\" (UniqueName: \"kubernetes.io/projected/701c990d-96cc-45af-8607-d8d51be65771-kube-api-access-6tpl8\") pod \"coredns-c5fdd76cf-bc7ln\" (UID: \"701c990d-96cc-45af-8607-d8d51be65771\") " pod="kube-system/coredns-c5fdd76cf-bc7ln" machine # [ 35.406559] k3s[882]: I0927 14:13:18.218403 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/19979905-8f3a-4a8c-bb22-e6627815cae6-klipper-config\") pod \"helm-install-nix-grpc-farm-d9sxg\" (UID: \"19979905-8f3a-4a8c-bb22-e6627815cae6\") " pod="kube-system/helm-install-nix-grpc-farm-d9sxg" machine # [ 35.407185] k3s[882]: I0927 14:13:18.218429 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19979905-8f3a-4a8c-bb22-e6627815cae6-tmp\") pod \"helm-install-nix-grpc-farm-d9sxg\" (UID: \"19979905-8f3a-4a8c-bb22-e6627815cae6\") " pod="kube-system/helm-install-nix-grpc-farm-d9sxg" machine # [ 35.408049] k3s[882]: I0927 14:13:18.218461 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"content\" (UniqueName: \"kubernetes.io/configmap/19979905-8f3a-4a8c-bb22-e6627815cae6-content\") pod \"helm-install-nix-grpc-farm-d9sxg\" (UID: \"19979905-8f3a-4a8c-bb22-e6627815cae6\") " pod="kube-system/helm-install-nix-grpc-farm-d9sxg" machine # [ 35.408716] k3s[882]: I0927 14:13:18.218487 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddp8v\" (UniqueName: \"kubernetes.io/projected/19979905-8f3a-4a8c-bb22-e6627815cae6-kube-api-access-ddp8v\") pod \"helm-install-nix-grpc-farm-d9sxg\" (UID: \"19979905-8f3a-4a8c-bb22-e6627815cae6\") " pod="kube-system/helm-install-nix-grpc-farm-d9sxg" machine # [ 35.446604] k3s[882]: time="2026-09-27T14:13:18Z" level=info msg="Wrote flannel subnet file to /run/flannel/subnet.env" machine # [ 35.447161] k3s[882]: time="2026-09-27T14:13:18Z" level=info msg="Running flannel backend" machine # [ 35.447612] k3s[882]: I0927 14:13:18.261274 882 vxlan_network.go:68] watching for new subnet leases machine # [ 35.448159] k3s[882]: I0927 14:13:18.261298 882 vxlan_network.go:115] starting vxlan device watcher machine # [ 35.499905] k3s[882]: I0927 14:13:18.314688 882 iptables.go:358] bootstrap done machine # [ 35.563935] k3s[882]: I0927 14:13:18.378455 882 iptables.go:358] bootstrap done machine # [ 35.858272] cni0: port 1(vethada2e27c) entered blocking state machine # [ 35.859137] cni0: port 1(vethada2e27c) entered disabled state machine # [ 35.860035] vethada2e27c: entered allmulticast mode machine # [ 35.860880] vethada2e27c: entered promiscuous mode machine # [ 35.709967] (udev-worker)[1336]: Network interface NamePolicy= disabled on kernel command line. machine # [ 35.868812] cni0: port 2(vethc42a4b56) entered blocking state machine # [ 35.869920] cni0: port 2(vethc42a4b56) entered disabled state machine # [ 35.871260] vethc42a4b56: entered allmulticast mode machine # [ 35.872014] vethc42a4b56: entered promiscuous mode machine # [ 35.877174] cni0: port 1(vethada2e27c) entered blocking state machine # [ 35.877967] cni0: port 1(vethada2e27c) entered forwarding state machine # [ 35.882148] cni0: port 2(vethc42a4b56) entered blocking state machine # [ 35.882852] cni0: port 2(vethc42a4b56) entered forwarding state machine # [ 35.748083] dhcpcd[684]: vethada2e27c: IAID 9c:80:63:5b machine # [ 35.748826] dhcpcd[684]: vethada2e27c: adding address fe80::4c7:9cff:fe80:635b machine # [ 35.761442] dhcpcd[684]: vethc42a4b56: IAID b9:64:10:ac machine # [ 35.762350] dhcpcd[684]: vethc42a4b56: adding address fe80::5006:b9ff:fe64:10ac machine # [ 35.918309] systemd[1]: Started libcontainer container 47d916bf90f4f0faa3b4c9897a4893e5845d6bf235bad3a4464b62c00be9f440. machine # [ 35.921350] systemd[1]: Started libcontainer container 1e79e2d03a6fa663c2576348768d68e968be575e02a68d78372abd85933f5b91. machine # [ 36.156074] dhcpcd[684]: flannel.1: soliciting a DHCP lease machine # [ 36.481934] k3s[882]: time="2026-09-27T14:13:19Z" level=info msg="Starting network policy controller version v2.6.3-k3s1, built on 1970-01-01T01:01:01Z, go1.26.7" machine # [ 36.482742] k3s[882]: I0927 14:13:19.296504 882 network_policy_controller.go:164] Starting network policy controller machine # [ 36.505291] dhcpcd[684]: vethada2e27c: soliciting a DHCP lease machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 36.759605] k3s[882]: I0927 14:13:19.574068 882 network_policy_controller.go:179] Starting network policy controller full sync goroutine machine # [ 37.000081] systemd[1]: Started libcontainer container 1e623a59ed04e931bbd1c9c27be170109eef3ce2de0887da6eddd24b27186e0b. machine # [ 37.233301] systemd[1]: Started libcontainer container da33b01132adcedadc57d284f8b8719c6824b356efc208f87fd52b71d9e4b839. machine # [ 37.311761] k3s[882]: I0927 14:13:20.126549 882 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/coredns-c5fdd76cf-bc7ln" podStartSLOduration=8.12652711 podStartE2EDuration="8.12652711s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-27 14:13:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-27 14:13:19.990829138 +0000 UTC m=+20.024317614" watchObservedRunningTime="2026-09-27 14:13:20.12652711 +0000 UTC m=+20.160015307" machine # [ 37.338270] dhcpcd[684]: flannel.1: soliciting an IPv6 router machine # [ 37.618745] dhcpcd[684]: vethc42a4b56: soliciting a DHCP lease machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 37.867129] k3s[882]: I0927 14:13:20.681464 882 alloc.go:329] "allocated clusterIPs" service="farm/nix-grpc-farm" clusterIPs={"IPv4":"10.43.121.136"} machine # [ 37.912089] systemd[1]: cri-containerd-da33b01132adcedadc57d284f8b8719c6824b356efc208f87fd52b71d9e4b839.scope: Deactivated successfully. machine # [ 37.915115] systemd[1]: cri-containerd-da33b01132adcedadc57d284f8b8719c6824b356efc208f87fd52b71d9e4b839.scope: Consumed 544ms CPU time over 678ms wall clock time, 34.4M memory peak, 2.4M incoming IP traffic, 146.2K outgoing IP traffic. machine # [ 37.945923] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-da33b01132adcedadc57d284f8b8719c6824b356efc208f87fd52b71d9e4b839-rootfs.mount: Deactivated successfully. machine # [ 38.039715] dhcpcd[684]: vethada2e27c: soliciting an IPv6 router machine # [ 38.079945] dhcpcd[684]: vethc42a4b56: soliciting an IPv6 router machine # [ 38.232397] systemd[1]: Created slice libcontainer container kubepods-besteffort-podb8898e70_6936_4af4_9084_7ad19988c3b9.slice. machine # [ 38.254877] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod06e6753d_89e1_415c_874f_78b9b10862f1.slice. machine # [ 38.265081] systemd[1]: Created slice libcontainer container kubepods-besteffort-podec8a4a09_1ed7_4735_9a6a_ec094fa7a250.slice. machine # [ 38.274462] systemd[1]: Created slice libcontainer container kubepods-besteffort-podb0a62eec_8579_4afd_9664_c1be8e13a248.slice. machine # [ 38.318478] k3s[882]: I0927 14:13:21.133345 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/b0a62eec-8579-4afd-9664-c1be8e13a248-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-6ftt5\" (UID: \"b0a62eec-8579-4afd-9664-c1be8e13a248\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-6ftt5" machine # [ 38.323161] k3s[882]: I0927 14:13:21.138035 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/b0a62eec-8579-4afd-9664-c1be8e13a248-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-6ftt5\" (UID: \"b0a62eec-8579-4afd-9664-c1be8e13a248\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-6ftt5" machine # [ 38.327872] k3s[882]: I0927 14:13:21.138089 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/b8898e70-6936-4af4-9084-7ad19988c3b9-tls-ca\") pod \"nix-grpc-farm-lb-75b44f88dd-t84lb\" (UID: \"b8898e70-6936-4af4-9084-7ad19988c3b9\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-t84lb" machine # [ 38.331991] k3s[882]: I0927 14:13:21.138121 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/06e6753d-89e1-415c-874f-78b9b10862f1-oidc\") pod \"nix-grpc-farm-scheduler-c5d75967-fpzn7\" (UID: \"06e6753d-89e1-415c-874f-78b9b10862f1\") " pod="farm/nix-grpc-farm-scheduler-c5d75967-fpzn7" machine # [ 38.336147] k3s[882]: I0927 14:13:21.138149 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/b0a62eec-8579-4afd-9664-c1be8e13a248-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-6ftt5\" (UID: \"b0a62eec-8579-4afd-9664-c1be8e13a248\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-6ftt5" machine # [ 38.340866] k3s[882]: I0927 14:13:21.138173 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/b0a62eec-8579-4afd-9664-c1be8e13a248-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-6ftt5\" (UID: \"b0a62eec-8579-4afd-9664-c1be8e13a248\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-6ftt5" machine # [ 38.345477] k3s[882]: I0927 14:13:21.138203 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/06e6753d-89e1-415c-874f-78b9b10862f1-ca\") pod \"nix-grpc-farm-scheduler-c5d75967-fpzn7\" (UID: \"06e6753d-89e1-415c-874f-78b9b10862f1\") " pod="farm/nix-grpc-farm-scheduler-c5d75967-fpzn7" machine # [ 38.349644] k3s[882]: I0927 14:13:21.138229 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/ec8a4a09-1ed7-4735-9a6a-ec094fa7a250-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-jlwrq\" (UID: \"ec8a4a09-1ed7-4735-9a6a-ec094fa7a250\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-jlwrq" machine # [ 38.354119] k3s[882]: I0927 14:13:21.138253 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/ec8a4a09-1ed7-4735-9a6a-ec094fa7a250-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-jlwrq\" (UID: \"ec8a4a09-1ed7-4735-9a6a-ec094fa7a250\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-jlwrq" machine # [ 38.358682] k3s[882]: I0927 14:13:21.138391 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b8898e70-6936-4af4-9084-7ad19988c3b9-config\") pod \"nix-grpc-farm-lb-75b44f88dd-t84lb\" (UID: \"b8898e70-6936-4af4-9084-7ad19988c3b9\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-t84lb" machine # [ 38.362843] k3s[882]: I0927 14:13:21.138431 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8898e70-6936-4af4-9084-7ad19988c3b9-tmp\") pod \"nix-grpc-farm-lb-75b44f88dd-t84lb\" (UID: \"b8898e70-6936-4af4-9084-7ad19988c3b9\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-t84lb" machine # [ 38.366873] k3s[882]: I0927 14:13:21.138467 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/b0a62eec-8579-4afd-9664-c1be8e13a248-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-6ftt5\" (UID: \"b0a62eec-8579-4afd-9664-c1be8e13a248\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-6ftt5" machine # [ 38.371446] k3s[882]: I0927 14:13:21.138494 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/ec8a4a09-1ed7-4735-9a6a-ec094fa7a250-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-jlwrq\" (UID: \"ec8a4a09-1ed7-4735-9a6a-ec094fa7a250\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-jlwrq" machine # [ 38.375953] k3s[882]: I0927 14:13:21.138527 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmsbs\" (UniqueName: \"kubernetes.io/projected/b0a62eec-8579-4afd-9664-c1be8e13a248-kube-api-access-xmsbs\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-6ftt5\" (UID: \"b0a62eec-8579-4afd-9664-c1be8e13a248\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-6ftt5" machine # [ 38.380580] k3s[882]: I0927 14:13:21.138556 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/ec8a4a09-1ed7-4735-9a6a-ec094fa7a250-build\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-jlwrq\" (UID: \"ec8a4a09-1ed7-4735-9a6a-ec094fa7a250\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-jlwrq" machine # [ 38.385045] k3s[882]: I0927 14:13:21.138579 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ec8a4a09-1ed7-4735-9a6a-ec094fa7a250-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-jlwrq\" (UID: \"ec8a4a09-1ed7-4735-9a6a-ec094fa7a250\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-jlwrq" machine # [ 38.389503] k3s[882]: I0927 14:13:21.138602 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/ec8a4a09-1ed7-4735-9a6a-ec094fa7a250-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-jlwrq\" (UID: \"ec8a4a09-1ed7-4735-9a6a-ec094fa7a250\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-jlwrq" machine # [ 38.393913] k3s[882]: I0927 14:13:21.138626 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/b8898e70-6936-4af4-9084-7ad19988c3b9-tls-lb\") pod \"nix-grpc-farm-lb-75b44f88dd-t84lb\" (UID: \"b8898e70-6936-4af4-9084-7ad19988c3b9\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-t84lb" machine # [ 38.398084] k3s[882]: I0927 14:13:21.138657 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/06e6753d-89e1-415c-874f-78b9b10862f1-tls\") pod \"nix-grpc-farm-scheduler-c5d75967-fpzn7\" (UID: \"06e6753d-89e1-415c-874f-78b9b10862f1\") " pod="farm/nix-grpc-farm-scheduler-c5d75967-fpzn7" machine # [ 38.402397] k3s[882]: I0927 14:13:21.138728 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/b0a62eec-8579-4afd-9664-c1be8e13a248-build\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-6ftt5\" (UID: \"b0a62eec-8579-4afd-9664-c1be8e13a248\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-6ftt5" machine # [ 38.407128] k3s[882]: I0927 14:13:21.138780 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b0a62eec-8579-4afd-9664-c1be8e13a248-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-6ftt5\" (UID: \"b0a62eec-8579-4afd-9664-c1be8e13a248\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-6ftt5" machine # [ 38.407601] k3s[882]: I0927 14:13:21.138803 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/06e6753d-89e1-415c-874f-78b9b10862f1-niks3-token\") pod \"nix-grpc-farm-scheduler-c5d75967-fpzn7\" (UID: \"06e6753d-89e1-415c-874f-78b9b10862f1\") " pod="farm/nix-grpc-farm-scheduler-c5d75967-fpzn7" machine # [ 38.408111] k3s[882]: I0927 14:13:21.138881 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/ec8a4a09-1ed7-4735-9a6a-ec094fa7a250-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-jlwrq\" (UID: \"ec8a4a09-1ed7-4735-9a6a-ec094fa7a250\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-jlwrq" machine # [ 38.408624] k3s[882]: I0927 14:13:21.138906 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7wsn\" (UniqueName: \"kubernetes.io/projected/ec8a4a09-1ed7-4735-9a6a-ec094fa7a250-kube-api-access-q7wsn\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-jlwrq\" (UID: \"ec8a4a09-1ed7-4735-9a6a-ec094fa7a250\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-jlwrq" machine # [ 38.409242] k3s[882]: I0927 14:13:21.138932 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt6vr\" (UniqueName: \"kubernetes.io/projected/06e6753d-89e1-415c-874f-78b9b10862f1-kube-api-access-mt6vr\") pod \"nix-grpc-farm-scheduler-c5d75967-fpzn7\" (UID: \"06e6753d-89e1-415c-874f-78b9b10862f1\") " pod="farm/nix-grpc-farm-scheduler-c5d75967-fpzn7" machine # [ 38.498487] k3s[882]: I0927 14:13:21.313244 882 node_lifecycle_controller.go:1234] "Initializing eviction metric for zone" zone="" machine # [ 38.500312] k3s[882]: I0927 14:13:21.313365 882 node_lifecycle_controller.go:886] "Missing timestamp for Node. Assuming now as a timestamp" node="machine" machine # [ 38.500910] k3s[882]: I0927 14:13:21.313457 882 node_lifecycle_controller.go:1080] "Controller detected that zone is now in new state" zone="" newState="Normal" machine # [ 38.728430] cni0: port 3(veth1ca5effc) entered blocking state machine # [ 38.729081] cni0: port 3(veth1ca5effc) entered disabled state machine # [ 38.729831] veth1ca5effc: entered allmulticast mode machine # [ 38.730558] veth1ca5effc: entered promiscuous mode machine # [ 38.578475] (udev-worker)[1813]: Network interface NamePolicy= disabled on kernel command line. machine # [ 38.740598] cni0: port 3(veth1ca5effc) entered blocking state machine # [ 38.741461] cni0: port 3(veth1ca5effc) entered forwarding state machine # [ 38.612676] dhcpcd[684]: veth1ca5effc: IAID 9b:22:f3:7f machine # [ 38.613659] dhcpcd[684]: veth1ca5effc: adding address fe80::a484:9bff:fe22:f37f machine # [ 38.773979] cni0: port 4(veth2b831003) entered blocking state machine # [ 38.775029] cni0: port 4(veth2b831003) entered disabled state machine # [ 38.776066] veth2b831003: entered allmulticast mode machine # [ 38.776891] veth2b831003: entered promiscuous mode machine # [ 38.625863] (udev-worker)[2056]: Network interface NamePolicy= disabled on kernel command line. machine # [ 38.785035] cni0: port 4(veth2b831003) entered blocking state machine # [ 38.785713] cni0: port 4(veth2b831003) entered forwarding state machine # [ 38.654693] dhcpcd[684]: veth2b831003: IAID c0:33:a9:a6 machine # [ 38.655534] dhcpcd[684]: veth2b831003: adding address fe80::28fe:c0ff:fe33:a9a6 machine # [ 38.835181] cni0: port 5(vethecd58e35) entered blocking state machine # [ 38.837289] cni0: port 5(vethecd58e35) entered disabled state machine # [ 38.838140] vethecd58e35: entered allmulticast mode machine # [ 38.838862] vethecd58e35: entered promiscuous mode machine # [ 38.692027] (udev-worker)[2058]: Network interface NamePolicy= disabled on kernel command line. machine # [ 38.847057] cni0: port 6(vetha416bff2) entered blocking state machine # [ 38.848683] cni0: port 6(vetha416bff2) entered disabled state machine # [ 38.849732] vetha416bff2: entered allmulticast mode machine # [ 38.850812] vetha416bff2: entered promiscuous mode machine # [ 38.863031] cni0: port 5(vethecd58e35) entered blocking state machine # [ 38.863738] cni0: port 5(vethecd58e35) entered forwarding state machine # [ 38.873448] cni0: port 6(vetha416bff2) entered blocking state machine # [ 38.874189] cni0: port 6(vetha416bff2) entered forwarding state machine # [ 38.740938] dhcpcd[684]: vethecd58e35: waiting for carrier machine # [ 38.754148] dhcpcd[684]: vetha416bff2: IAID 66:9f:76:0b machine # [ 38.754864] dhcpcd[684]: vetha416bff2: adding address fe80::6c12:66ff:fe9f:760b machine # [ 38.755580] dhcpcd[684]: vethecd58e35: carrier acquired machine # [ 38.763284] dhcpcd[684]: vethecd58e35: IAID c8:1c:f2:34 machine # [ 38.764930] dhcpcd[684]: vethecd58e35: adding address fe80::a4fb:c8ff:fe1c:f234 machine # [ 38.768271] systemd[1]: Started libcontainer container 00ea951629f5cc9f7b577fe7e2cc4b1f8aa1a0af95ec4f9ee17db199939cec40. machine # [ 38.772290] systemd[1]: Started libcontainer container 37817902e104bcd9dca839fb759fdfda84fd069a9fc53f14f5c5d3caac312fad. machine # [ 38.878402] k3s[882]: E0927 14:13:21.692590 882 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.4" machine # [ 38.892166] k3s[882]: E0927 14:13:21.692719 882 kuberuntime_image.go:43] "Failed to pull image" err="failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.4" machine # [ 38.902830] k3s[882]: E0927 14:13:21.692968 882 kuberuntime_manager.go:1674] "Unhandled Error" err="container nix-grpc-daemon start failed in pod nix-grpc-farm-scheduler-c5d75967-fpzn7_farm(06e6753d-89e1-415c-874f-78b9b10862f1): ErrImagePull: failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" logger="UnhandledError" machine # [ 38.903390] k3s[882]: E0927 14:13:21.693029 882 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nix-grpc-daemon\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-scheduler-c5d75967-fpzn7" podUID="06e6753d-89e1-415c-874f-78b9b10862f1" machine # [ 38.904065] systemd[1]: Started libcontainer container 3391ed870794c5ae5ff40ec67366bdefa85b01c635b32ed4bd32db67a0a28ae9. machine # [ 38.952446] systemd[1]: Started libcontainer container 761c904f7872eeeee34c70e487431754896492ccb06d603e186161728170009b. machine # [ 39.032525] dhcpcd[684]: vethecd58e35: soliciting a DHCP lease machine # [ 39.103573] k3s[882]: E0927 14:13:21.918347 882 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.4" machine # [ 39.109750] k3s[882]: E0927 14:13:21.918430 882 kuberuntime_image.go:43] "Failed to pull image" err="failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.4" machine # [ 39.115949] k3s[882]: E0927 14:13:21.918589 882 kuberuntime_manager.go:1674] "Unhandled Error" err="init container seed-store start failed in pod nix-grpc-farm-worker-x86-64-linux-c74f46454-6ftt5_farm(b0a62eec-8579-4afd-9664-c1be8e13a248): ErrImagePull: failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" logger="UnhandledError" machine # [ 39.123401] k3s[882]: E0927 14:13:21.918654 882 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-6ftt5" podUID="b0a62eec-8579-4afd-9664-c1be8e13a248" machine # [ 39.130846] k3s[882]: E0927 14:13:21.932151 882 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.4" machine # [ 39.137047] k3s[882]: E0927 14:13:21.932186 882 kuberuntime_image.go:43] "Failed to pull image" err="failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.4" machine # [ 39.142969] k3s[882]: E0927 14:13:21.932395 882 kuberuntime_manager.go:1674] "Unhandled Error" err="init container seed-store start failed in pod nix-grpc-farm-worker-x86-64-linux-c74f46454-jlwrq_farm(ec8a4a09-1ed7-4735-9a6a-ec094fa7a250): ErrImagePull: failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" logger="UnhandledError" machine # [ 39.150307] k3s[882]: E0927 14:13:21.932453 882 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-jlwrq" podUID="ec8a4a09-1ed7-4735-9a6a-ec094fa7a250" machine # [ 39.177064] k3s[882]: E0927 14:13:21.990646 882 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ImagePullBackOff: \"Back-off pulling image \\\"nix-grpc-farm:0.1.0-beta.4\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-jlwrq" podUID="ec8a4a09-1ed7-4735-9a6a-ec094fa7a250" machine # [ 39.185758] k3s[882]: E0927 14:13:21.996966 882 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ImagePullBackOff: \"Back-off pulling image \\\"nix-grpc-farm:0.1.0-beta.4\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-6ftt5" podUID="b0a62eec-8579-4afd-9664-c1be8e13a248" machine # [ 39.194169] k3s[882]: E0927 14:13:22.002704 882 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nix-grpc-daemon\" with ImagePullBackOff: \"Back-off pulling image \\\"nix-grpc-farm:0.1.0-beta.4\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-scheduler-c5d75967-fpzn7" podUID="06e6753d-89e1-415c-874f-78b9b10862f1" machine # [ 39.215516] systemd[1]: cri-containerd-47d916bf90f4f0faa3b4c9897a4893e5845d6bf235bad3a4464b62c00be9f440.scope: Deactivated successfully. machine # [ 39.337149] dhcpcd[684]: veth1ca5effc: soliciting a DHCP lease machine # [ 39.541704] cni0: port 2(vethc42a4b56) entered disabled state machine # [ 39.388541] dhcpcd[684]: vethc42a4b56: carrier lost machine # [ 39.545198] vethc42a4b56 (unregistering): left allmulticast mode machine # [ 39.546576] vethc42a4b56 (unregistering): left promiscuous mode machine # [ 39.547285] cni0: port 2(vethc42a4b56) entered disabled state machine # [ 39.424091] dhcpcd[684]: vethc42a4b56: deleting address fe80::5006:b9ff:fe64:10ac machine # [ 39.464272] dhcpcd[684]: vethc42a4b56: removing interface machine # [ 39.512824] k3s[882]: time="2026-09-27T14:13:22Z" level=info msg="Imported docker.io/library/nix-grpc-farm:0.1.0-beta.4" machine # [ 39.522068] k3s[882]: time="2026-09-27T14:13:22Z" level=info msg="Tagged docker.io/library/nix-grpc-farm@sha256:fd74e2404cb942b6b2e27faccfed1b9ad350f5557ed5f7a6e784bbe43bf96fbb" machine # [ 39.528254] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-47d916bf90f4f0faa3b4c9897a4893e5845d6bf235bad3a4464b62c00be9f440-rootfs.mount: Deactivated successfully. machine # [ 39.530708] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-47d916bf90f4f0faa3b4c9897a4893e5845d6bf235bad3a4464b62c00be9f440-shm.mount: Deactivated successfully. machine # [ 39.532982] systemd[1]: run-netns-cni\x2d3e040fc9\x2dd25b\x2df8cd\x2d896b\x2df9fc3513ddf4.mount: Deactivated successfully. machine # [ 39.534651] k3s[882]: I0927 14:13:22.347217 882 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/19979905-8f3a-4a8c-bb22-e6627815cae6-kube-api-access-ddp8v\" (UniqueName: \"kubernetes.io/projected/19979905-8f3a-4a8c-bb22-e6627815cae6-kube-api-access-ddp8v\") pod \"19979905-8f3a-4a8c-bb22-e6627815cae6\" (UID: \"19979905-8f3a-4a8c-bb22-e6627815cae6\") " machine # [ 39.541221] k3s[882]: I0927 14:13:22.347264 882 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/19979905-8f3a-4a8c-bb22-e6627815cae6-klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/19979905-8f3a-4a8c-bb22-e6627815cae6-klipper-cache\") pod \"19979905-8f3a-4a8c-bb22-e6627815cae6\" (UID: \"19979905-8f3a-4a8c-bb22-e6627815cae6\") " machine # [ 39.545889] k3s[882]: I0927 14:13:22.347300 882 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/19979905-8f3a-4a8c-bb22-e6627815cae6-klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/19979905-8f3a-4a8c-bb22-e6627815cae6-klipper-config\") pod \"19979905-8f3a-4a8c-bb22-e6627815cae6\" (UID: \"19979905-8f3a-4a8c-bb22-e6627815cae6\") " machine # [ 39.550780] k3s[882]: I0927 14:13:22.347340 882 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/19979905-8f3a-4a8c-bb22-e6627815cae6-values\" (UniqueName: \"kubernetes.io/projected/19979905-8f3a-4a8c-bb22-e6627815cae6-values\") pod \"19979905-8f3a-4a8c-bb22-e6627815cae6\" (UID: \"19979905-8f3a-4a8c-bb22-e6627815cae6\") " machine # [ 39.555592] k3s[882]: I0927 14:13:22.347367 882 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/19979905-8f3a-4a8c-bb22-e6627815cae6-tmp\" (UniqueName: \"kubernetes.io/empty-dir/19979905-8f3a-4a8c-bb22-e6627815cae6-tmp\") pod \"19979905-8f3a-4a8c-bb22-e6627815cae6\" (UID: \"19979905-8f3a-4a8c-bb22-e6627815cae6\") " machine # [ 39.559761] k3s[882]: I0927 14:13:22.347395 882 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/19979905-8f3a-4a8c-bb22-e6627815cae6-content\" (UniqueName: \"kubernetes.io/configmap/19979905-8f3a-4a8c-bb22-e6627815cae6-content\") pod \"19979905-8f3a-4a8c-bb22-e6627815cae6\" (UID: \"19979905-8f3a-4a8c-bb22-e6627815cae6\") " machine # [ 39.564282] k3s[882]: I0927 14:13:22.347421 882 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/19979905-8f3a-4a8c-bb22-e6627815cae6-klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/19979905-8f3a-4a8c-bb22-e6627815cae6-klipper-helm\") pod \"19979905-8f3a-4a8c-bb22-e6627815cae6\" (UID: \"19979905-8f3a-4a8c-bb22-e6627815cae6\") " machine # [ 39.569216] k3s[882]: I0927 14:13:22.355283 882 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19979905-8f3a-4a8c-bb22-e6627815cae6-content" pod "19979905-8f3a-4a8c-bb22-e6627815cae6" (UID: "19979905-8f3a-4a8c-bb22-e6627815cae6"). InnerVolumeSpecName "content". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 39.573814] k3s[882]: I0927 14:13:22.356200 882 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19979905-8f3a-4a8c-bb22-e6627815cae6-klipper-config" pod "19979905-8f3a-4a8c-bb22-e6627815cae6" (UID: "19979905-8f3a-4a8c-bb22-e6627815cae6"). InnerVolumeSpecName "klipper-config". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 39.578610] k3s[882]: I0927 14:13:22.357080 882 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19979905-8f3a-4a8c-bb22-e6627815cae6-values" pod "19979905-8f3a-4a8c-bb22-e6627815cae6" (UID: "19979905-8f3a-4a8c-bb22-e6627815cae6"). InnerVolumeSpecName "values". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 39.583453] k3s[882]: I0927 14:13:22.360921 882 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19979905-8f3a-4a8c-bb22-e6627815cae6-klipper-helm" pod "19979905-8f3a-4a8c-bb22-e6627815cae6" (UID: "19979905-8f3a-4a8c-bb22-e6627815cae6"). InnerVolumeSpecName "klipper-helm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 39.588264] k3s[882]: I0927 14:13:22.362983 882 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19979905-8f3a-4a8c-bb22-e6627815cae6-klipper-cache" pod "19979905-8f3a-4a8c-bb22-e6627815cae6" (UID: "19979905-8f3a-4a8c-bb22-e6627815cae6"). InnerVolumeSpecName "klipper-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 39.588852] k3s[882]: I0927 14:13:22.366313 882 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19979905-8f3a-4a8c-bb22-e6627815cae6-tmp" pod "19979905-8f3a-4a8c-bb22-e6627815cae6" (UID: "19979905-8f3a-4a8c-bb22-e6627815cae6"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 39.589568] k3s[882]: I0927 14:13:22.366357 882 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19979905-8f3a-4a8c-bb22-e6627815cae6-kube-api-access-ddp8v" pod "19979905-8f3a-4a8c-bb22-e6627815cae6" (UID: "19979905-8f3a-4a8c-bb22-e6627815cae6"). InnerVolumeSpecName "kube-api-access-ddp8v". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 39.590184] systemd[1]: var-lib-kubelet-pods-19979905\x2d8f3a\x2d4a8c\x2dbb22\x2de6627815cae6-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dcache.mount: Deactivated successfully. machine # [ 39.590848] systemd[1]: var-lib-kubelet-pods-19979905\x2d8f3a\x2d4a8c\x2dbb22\x2de6627815cae6-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dhelm.mount: Deactivated successfully. machine # [ 39.591194] systemd[1]: var-lib-kubelet-pods-19979905\x2d8f3a\x2d4a8c\x2dbb22\x2de6627815cae6-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dconfig.mount: Deactivated successfully. machine # [ 39.591768] systemd[1]: var-lib-kubelet-pods-19979905\x2d8f3a\x2d4a8c\x2dbb22\x2de6627815cae6-volumes-kubernetes.io\x7eprojected-values.mount: Deactivated successfully. machine # [ 39.592506] systemd[1]: var-lib-kubelet-pods-19979905\x2d8f3a\x2d4a8c\x2dbb22\x2de6627815cae6-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 39.627315] systemd[1]: Started libcontainer container e231f150ddc2c32bccc6d25697ccb6894e2952050abaa9a6a40fc0ff1fc712e9. machine # [ 39.633129] k3s[882]: I0927 14:13:22.448006 882 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddp8v\" (UniqueName: \"kubernetes.io/projected/19979905-8f3a-4a8c-bb22-e6627815cae6-kube-api-access-ddp8v\") on node \"machine\" DevicePath \"\"" machine # [ 39.633839] k3s[882]: I0927 14:13:22.448034 882 reconciler_common.go:299] "Volume detached for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/19979905-8f3a-4a8c-bb22-e6627815cae6-klipper-cache\") on node \"machine\" DevicePath \"\"" machine # [ 39.634649] k3s[882]: I0927 14:13:22.448083 882 reconciler_common.go:299] "Volume detached for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/19979905-8f3a-4a8c-bb22-e6627815cae6-klipper-config\") on node \"machine\" DevicePath \"\"" machine # [ 39.635152] k3s[882]: I0927 14:13:22.448097 882 reconciler_common.go:299] "Volume detached for volume \"values\" (UniqueName: \"kubernetes.io/projected/19979905-8f3a-4a8c-bb22-e6627815cae6-values\") on node \"machine\" DevicePath \"\"" machine # [ 39.635700] k3s[882]: I0927 14:13:22.448110 882 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19979905-8f3a-4a8c-bb22-e6627815cae6-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 39.636495] k3s[882]: I0927 14:13:22.448122 882 reconciler_common.go:299] "Volume detached for volume \"content\" (UniqueName: \"kubernetes.io/configmap/19979905-8f3a-4a8c-bb22-e6627815cae6-content\") on node \"machine\" DevicePath \"\"" machine # [ 39.637034] k3s[882]: I0927 14:13:22.448134 882 reconciler_common.go:299] "Volume detached for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/19979905-8f3a-4a8c-bb22-e6627815cae6-klipper-helm\") on node \"machine\" DevicePath \"\"" machine # [ 39.908724] k3s[882]: time="2026-09-27T14:13:22Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm.tar in 6.012944382s" machine # [ 40.076527] dhcpcd[684]: veth2b831003: soliciting a DHCP lease machine # [ 40.163247] systemd[1]: Removed slice libcontainer container kubepods-burstable-pod19979905_8f3a_4a8c_bb22_e6627815cae6.slice. machine # [ 40.165406] systemd[1]: kubepods-burstable-pod19979905_8f3a_4a8c_bb22_e6627815cae6.slice: Consumed 580ms CPU time over 4.823s wall clock time, 34.9M memory peak, 2.4M incoming IP traffic, 146.2K outgoing IP traffic. machine # [ 40.199379] k3s[882]: I0927 14:13:23.014163 882 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="47d916bf90f4f0faa3b4c9897a4893e5845d6bf235bad3a4464b62c00be9f440" machine # [ 40.209763] dhcpcd[684]: veth2b831003: soliciting an IPv6 router machine # [ 40.240140] k3s[882]: I0927 14:13:23.054032 882 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-75b44f88dd-t84lb" podStartSLOduration=2.053924028 podStartE2EDuration="2.053924028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-27 14:13:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-27 14:13:23.053838542 +0000 UTC m=+23.087331488" watchObservedRunningTime="2026-09-27 14:13:23.053924028 +0000 UTC m=+23.087416695" machine # [ 40.519284] systemd[1]: var-lib-kubelet-pods-19979905\x2d8f3a\x2d4a8c\x2dbb22\x2de6627815cae6-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dddp8v.mount: Deactivated successfully. machine # [ 40.630280] dhcpcd[684]: veth1ca5effc: soliciting an IPv6 router machine # [ 40.661676] dhcpcd[684]: vetha416bff2: soliciting a DHCP lease machine # [ 41.157161] dhcpcd[684]: flannel.1: probing for an IPv4LL address machine # [ 41.226784] dhcpcd[684]: vetha416bff2: soliciting an IPv6 router machine # [ 41.441525] dhcpcd[684]: vethecd58e35: soliciting an IPv6 router machine # [ 41.505928] dhcpcd[684]: vethada2e27c: probing for an IPv4LL address machine # [ 44.033617] dhcpcd[684]: vethecd58e35: probing for an IPv4LL address machine # [ 44.337726] dhcpcd[684]: veth1ca5effc: probing for an IPv4LL address machine # [ 45.077630] dhcpcd[684]: veth2b831003: probing for an IPv4LL address machine # [ 45.662215] dhcpcd[684]: vetha416bff2: probing for an IPv4LL address machine # [ 45.673641] dhcpcd[684]: vethada2e27c: using IPv4LL address 169.254.196.9 machine # [ 45.675140] dhcpcd[684]: vethada2e27c: adding route to 169.254.0.0/16 machine # [ 46.129778] dhcpcd[684]: flannel.1: using IPv4LL address 169.254.242.23 machine # [ 46.131436] dhcpcd[684]: flannel.1: adding route to 169.254.0.0/16 machine # [ 48.474962] dhcpcd[684]: vethecd58e35: using IPv4LL address 169.254.142.103 machine # [ 48.477152] dhcpcd[684]: vethecd58e35: adding route to 169.254.0.0/16 machine # error: timed out waiting for the condition machine # [ 49.253166] dhcpcd[684]: veth1ca5effc: using IPv4LL address 169.254.180.133 machine # [ 49.255298] dhcpcd[684]: veth1ca5effc: adding route to 169.254.0.0/16 machine # [ 49.339922] dhcpcd[684]: flannel.1: no IPv6 Routers available machine # [ 50.044875] dhcpcd[684]: vethada2e27c: no IPv6 Routers available machine # [ 50.341095] dhcpcd[684]: veth2b831003: using IPv4LL address 169.254.240.214 machine # [ 50.343271] dhcpcd[684]: veth2b831003: adding route to 169.254.0.0/16 machine # [ 50.969956] dhcpcd[684]: vetha416bff2: using IPv4LL address 169.254.4.174 machine # [ 50.972274] dhcpcd[684]: vetha416bff2: adding route to 169.254.0.0/16 machine # [ 51.183934] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount1009494862.mount: Deactivated successfully. machine # [ 52.213160] dhcpcd[684]: veth2b831003: no IPv6 Routers available machine # [ 52.633118] dhcpcd[684]: veth1ca5effc: no IPv6 Routers available machine # [ 53.230325] dhcpcd[684]: vetha416bff2: no IPv6 Routers available machine # [ 53.444474] dhcpcd[684]: vethecd58e35: no IPv6 Routers available machine # [ 53.983279] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount2248989510.mount: Deactivated successfully. machine # [ 54.042436] systemd[1]: Started libcontainer container eb91434bd6888391c1f73999c965d669e901f0b62f80246ecd1d87daf35fa0a5. machine # [ 54.166924] niks3-server[1186]: 2026/09/27 14:13:36 INFO lead: acquired remote=10.42.0.5:39366 machine # [ 54.184867] systemd[1]: Started libcontainer container 1a6baf221a3cdf77ab9f3ad98d0c167aee581a20b7bd73fb1f0b6a7aad636660. machine # [ 54.282170] systemd[1]: Started libcontainer container 903e255e5cdef33d39c98a5cc92155dd9b28d80938be152fcb9a96393adf69a0. machine # [ 54.982182] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount2064804221.mount: Deactivated successfully. machine # [ 54.983819] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped494511452.mount: Deactivated successfully. machine # [ 55.303654] k3s[882]: I0927 14:13:38.117637 882 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-scheduler-c5d75967-fpzn7" podStartSLOduration=4.830926971 podStartE2EDuration="17.117610333s" totalImagesPullingTime="12.286683362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-27 14:13:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-27 14:13:37.156579252 +0000 UTC m=+37.190068567" watchObservedRunningTime="2026-09-27 14:13:38.117610333 +0000 UTC m=+38.151098530" machine # [ 55.616523] systemd[1]: cri-containerd-1a6baf221a3cdf77ab9f3ad98d0c167aee581a20b7bd73fb1f0b6a7aad636660.scope: Deactivated successfully. machine # [ 55.619571] systemd[1]: cri-containerd-1a6baf221a3cdf77ab9f3ad98d0c167aee581a20b7bd73fb1f0b6a7aad636660.scope: Consumed 686ms CPU time over 1.433s wall clock time, 325.4M memory peak, 79.7M read from disk, 231M written to disk. machine # [ 55.620718] systemd[1]: cri-containerd-903e255e5cdef33d39c98a5cc92155dd9b28d80938be152fcb9a96393adf69a0.scope: Deactivated successfully. machine # [ 55.623662] systemd[1]: cri-containerd-903e255e5cdef33d39c98a5cc92155dd9b28d80938be152fcb9a96393adf69a0.scope: Consumed 634ms CPU time over 1.339s wall clock time, 379.5M memory peak, 62.1M read from disk, 248M written to disk. machine # [ 55.666416] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-903e255e5cdef33d39c98a5cc92155dd9b28d80938be152fcb9a96393adf69a0-rootfs.mount: Deactivated successfully. machine # [ 55.669978] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-1a6baf221a3cdf77ab9f3ad98d0c167aee581a20b7bd73fb1f0b6a7aad636660-rootfs.mount: Deactivated successfully. machine # [ 56.394172] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped1133940397.mount: Deactivated successfully. machine # [ 56.544493] systemd[1]: Started libcontainer container 172e0820e818d9951d454e016e1d246ca8a51a51714ceadfa9e1dcfbf4676e85. machine # [ 56.594570] systemd[1]: Started libcontainer container 62499d0ab1d4143a0cc9901ec2899a9d2df302fe7816b6e60f657623f784be93. machine # [ 56.706945] systemd[1]: Started libcontainer container 3d9dc4e74a0ff8d9f005a7742630a11c1b635802090ac6d2e774b8cb5800cbfc. machine # [ 56.747478] systemd[1]: Started libcontainer container 890393719c9eb9357670f79be9d9875bc0c76c6c9ebcfb209bafffc18d318679. machine # [ 56.913275] systemd[1]: Started libcontainer container 55aa9317b0550d376fe7a7ef0ba878314ebec5c874c63fef72a6ac9f4ff4072b. machine # [ 56.935319] systemd[1]: Started libcontainer container ed21e2c8c2d873b8b483a08cb674ff5f73842dce273130eb3695315131b08f68. machine # [ 57.338288] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped2289906819.mount: Deactivated successfully. machine # [ 57.340048] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount2035253266.mount: Deactivated successfully. machine # [ 57.352626] k3s[882]: I0927 14:13:40.166718 882 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-jlwrq" podStartSLOduration=3.940693994 podStartE2EDuration="19.166679418s" totalImagesPullingTime="14.056100704s" totalInitContainerRuntime="1.16988472s" isStatefulPod=false podCreationTimestamp="2026-09-27 14:13:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-27 14:13:40.165557767 +0000 UTC m=+40.199051551" watchObservedRunningTime="2026-09-27 14:13:40.166679418 +0000 UTC m=+40.200170688" machine # error: timed out waiting for the condition machine # [ 60.927172] k3s[882]: I0927 14:13:43.741127 882 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-6ftt5" podStartSLOduration=7.21085794 podStartE2EDuration="22.741078399s" totalImagesPullingTime="14.135908333s" totalInitContainerRuntime="1.394312126s" isStatefulPod=false podCreationTimestamp="2026-09-27 14:13:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-27 14:13:40.193261847 +0000 UTC m=+40.226753955" watchObservedRunningTime="2026-09-27 14:13:43.741078399 +0000 UTC m=+43.774571065" machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 35.54 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s, in 0.19 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s, in 0.15 seconds) machine: waiting for unit niks3.service machine: (finished: waiting for unit niks3.service, in 0.03 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.72 seconds) machine: waiting for success: test $(curl -sf 10.42.0.4:9901/clusters | grep -c 'health_flags::healthy') -ge 3 machine: (finished: waiting for success: test $(curl -sf 10.42.0.4:9901/clusters | grep -c 'health_flags::healthy') -ge 3, in 8.56 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.23 seconds) machine: waiting for success: curl -sf http://10.42.0.5:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2' machine: (finished: waiting for success: curl -sf http://10.42.0.5:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2', in 0.04 seconds) (finished: subtest: chart deploys and workers become Ready, in 45.46 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}', in 0.24 seconds) machine: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt machine: (finished: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt, in 0.19 seconds) subtest: build through the balancer lands in the cache machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1 machine # [ 109.781208] niks3-server[1186]: 2026/09/27 14:14:32 INFO Received push request method=POST path=/api/pushes machine # [ 109.809554] niks3-server[1186]: 2026/09/27 14:14:32 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign machine # [ 109.814574] niks3-server[1186]: 2026/09/27 14:14:32 INFO Signed narinfos id=1 count=1 machine # [ 109.820892] niks3-server[1186]: 2026/09/27 14:14:32 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.ls machine # [ 109.824317] niks3-server[1186]: 2026/09/27 14:14:32 INFO Registered completed upload object_key=nar/0nzzbas7l8d37mridr7mg162smfjvn7lhs6am4crl4ydaxicigj8.nar.zst machine # [ 109.828256] niks3-server[1186]: 2026/09/27 14:14:32 INFO Received complete push request method=POST path=/api/pushes/1/complete machine # [ 109.836037] niks3-server[1186]: 2026/09/27 14:14:32 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.narinfo machine # [ 134.550636] niks3-server[1186]: 2026/09/27 14:14:57 INFO Received push request method=POST path=/api/pushes machine # [ 134.575171] niks3-server[1186]: 2026/09/27 14:14:57 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign machine # [ 134.576939] niks3-server[1186]: 2026/09/27 14:14:57 INFO Signed narinfos id=2 count=1 machine # [ 134.578441] niks3-server[1186]: 2026/09/27 14:14:57 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.ls machine # [ 134.581462] niks3-server[1186]: 2026/09/27 14:14:57 INFO Registered completed upload object_key=nar/1p7jh5nyz9n68k5f18ymmdpgr34mpnnch1njw7ki7b2b97qlfbjk.nar.zst machine # [ 134.583684] niks3-server[1186]: 2026/09/27 14:14:57 INFO Registered completed upload object_key=log/yz1sqzb72i8v6h2ass0v76ba8cncqj9r-k3s-a.drv machine # [ 134.585480] niks3-server[1186]: 2026/09/27 14:14:57 INFO Received complete push request method=POST path=/api/pushes/2/complete machine # [ 134.589078] niks3-server[1186]: 2026/09/27 14:14:57 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.narinfo machine # [ 134.650165] niks3-server[1186]: 2026/09/27 14:14:57 INFO Received push request method=POST path=/api/pushes machine # [ 134.662021] niks3-server[1186]: 2026/09/27 14:14:57 INFO Received sign narinfos request method=POST path=/api/pushes/3/sign machine # [ 134.663945] niks3-server[1186]: 2026/09/27 14:14:57 INFO Signed narinfos id=3 count=1 machine # [ 134.665110] niks3-server[1186]: 2026/09/27 14:14:57 INFO Registered completed upload object_key=nar/03a4ywhyr5knmbc93z4gyml5y8fvgb431xvlmfxrwsm8mrb0qgx2.nar.zst machine # [ 134.667630] niks3-server[1186]: 2026/09/27 14:14:57 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.ls machine # [ 134.669543] niks3-server[1186]: 2026/09/27 14:14:57 INFO Received complete push request method=POST path=/api/pushes/3/complete machine # [ 134.672097] niks3-server[1186]: 2026/09/27 14:14:57 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.narinfo machine # [ 159.789170] niks3-server[1186]: 2026/09/27 14:15:22 INFO Received push request method=POST path=/api/pushes machine # [ 159.809893] niks3-server[1186]: 2026/09/27 14:15:22 INFO Received sign narinfos request method=POST path=/api/pushes/4/sign machine # [ 159.811484] niks3-server[1186]: 2026/09/27 14:15:22 INFO Signed narinfos id=4 count=1 machine # [ 159.818173] niks3-server[1186]: 2026/09/27 14:15:22 INFO Registered completed upload object_key=log/zfq1xw9bmycqh35l0s44lmv65z4xc7br-k3s-b.drv machine # [ 159.823165] niks3-server[1186]: 2026/09/27 14:15:22 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.ls machine # [ 159.826352] niks3-server[1186]: 2026/09/27 14:15:22 INFO Registered completed upload object_key=nar/05qjsj5ff3a6vnxkhb6k5f3m446dcc206p7cd37w4v3mgi95d7kh.nar.zst machine # [ 159.830920] niks3-server[1186]: 2026/09/27 14:15:22 INFO Received complete push request method=POST path=/api/pushes/4/complete machine # [ 159.836917] niks3-server[1186]: 2026/09/27 14:15:22 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.narinfo machine # [ 159.906355] niks3-server[1186]: 2026/09/27 14:15:22 INFO Received push request method=POST path=/api/pushes machine # [ 159.918342] niks3-server[1186]: 2026/09/27 14:15:22 INFO Received sign narinfos request method=POST path=/api/pushes/5/sign machine # [ 159.920390] niks3-server[1186]: 2026/09/27 14:15:22 INFO Signed narinfos id=5 count=1 machine # [ 159.922933] niks3-server[1186]: 2026/09/27 14:15:22 INFO Registered completed upload object_key=nar/0jyw88klkf3nwxpnj5m5lx3i1dv2idf3hcn6im7883hnldm3gvyq.nar.zst machine # [ 159.924960] niks3-server[1186]: 2026/09/27 14:15:22 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.ls machine # [ 159.928397] niks3-server[1186]: 2026/09/27 14:15:22 INFO Received complete push request method=POST path=/api/pushes/5/complete machine # [ 159.933758] niks3-server[1186]: 2026/09/27 14:15:22 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.narinfo machine # [ 185.047436] niks3-server[1186]: 2026/09/27 14:15:47 INFO Received push request method=POST path=/api/pushes machine # [ 185.068033] niks3-server[1186]: 2026/09/27 14:15:47 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.ls machine # [ 185.072397] niks3-server[1186]: 2026/09/27 14:15:47 INFO Received sign narinfos request method=POST path=/api/pushes/6/sign machine # [ 185.074222] niks3-server[1186]: 2026/09/27 14:15:47 INFO Registered completed upload object_key=nar/1q8vp5xqws560mpf8rxk8r8jhqrzibivh13x4wxy0cfqlzbk7cr5.nar.zst machine # [ 185.074982] niks3-server[1186]: 2026/09/27 14:15:47 INFO Signed narinfos id=6 count=1 machine # [ 185.084210] niks3-server[1186]: 2026/09/27 14:15:47 INFO Received complete push request method=POST path=/api/pushes/6/complete machine # [ 185.090623] niks3-server[1186]: 2026/09/27 14:15:47 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.narinfo machine # [ 185.091980] niks3-server[1186]: 2026/09/27 14:15:47 INFO Registered completed upload object_key=log/n40czam6a4ldp1mh5fdmlcy07fv0akbm-k3s-top.drv machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1, in 112.46 seconds) machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath, in 0.13 seconds) machine: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine: (finished: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.01 seconds) machine: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine # copying 3 paths... machine # copying path '/nix/store/r95r891injj9ski5c4w89yxjvjy065mx-k3s-a' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/mrqsh0475wxsmnsvkk55g94v6g5nrcra-k3s-b' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top' from 'http://192.168.1.1:5751'... machine: (finished: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.17 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1 machine # [ 210.511344] niks3-server[1186]: 2026/09/27 14:16:13 INFO Received push request method=POST path=/api/pushes machine # [ 210.533487] niks3-server[1186]: 2026/09/27 14:16:13 INFO Received sign narinfos request method=POST path=/api/pushes/7/sign machine # [ 210.536703] niks3-server[1186]: 2026/09/27 14:16:13 INFO Signed narinfos id=7 count=1 machine # [ 210.538133] niks3-server[1186]: 2026/09/27 14:16:13 INFO Registered completed upload object_key=nar/1fr26arhri17j9bj6hyjzmmd74v730biz1gb3kqd194vjx3ccvp9.nar.zst machine # [ 210.541930] niks3-server[1186]: 2026/09/27 14:16:13 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.ls machine # [ 210.548257] niks3-server[1186]: 2026/09/27 14:16:13 INFO Received complete push request method=POST path=/api/pushes/7/complete machine # [ 210.556493] niks3-server[1186]: 2026/09/27 14:16:13 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.narinfo machine # [ 235.673353] niks3-server[1186]: 2026/09/27 14:16:38 INFO Received push request method=POST path=/api/pushes machine # [ 235.697991] niks3-server[1186]: 2026/09/27 14:16:38 INFO Received sign narinfos request method=POST path=/api/pushes/8/sign machine # [ 235.699366] niks3-server[1186]: 2026/09/27 14:16:38 INFO Registered completed upload object_key=log/pbpqsh50ar10fpasdqqx8xg3lmr5j8iz-k3s-a.drv machine # [ 235.702369] niks3-server[1186]: 2026/09/27 14:16:38 INFO Registered completed upload object_key=nar/1hfc6x4x25k3b0fk091d3nb0k3mympfp05fkslcx19synp3ig0zd.nar.zst machine # [ 235.704153] niks3-server[1186]: 2026/09/27 14:16:38 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.ls machine # [ 235.713474] niks3-server[1186]: 2026/09/27 14:16:38 INFO Signed narinfos id=8 count=1 machine # [ 235.722672] niks3-server[1186]: 2026/09/27 14:16:38 INFO Received complete push request method=POST path=/api/pushes/8/complete machine # [ 235.731220] niks3-server[1186]: 2026/09/27 14:16:38 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.narinfo machine # [ 235.786104] niks3-server[1186]: 2026/09/27 14:16:38 INFO Received push request method=POST path=/api/pushes machine # [ 235.797797] niks3-server[1186]: 2026/09/27 14:16:38 INFO Received sign narinfos request method=POST path=/api/pushes/9/sign machine # [ 235.799848] niks3-server[1186]: 2026/09/27 14:16:38 INFO Signed narinfos id=9 count=1 machine # [ 235.802112] niks3-server[1186]: 2026/09/27 14:16:38 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.ls machine # [ 235.803457] niks3-server[1186]: 2026/09/27 14:16:38 INFO Registered completed upload object_key=nar/0zzq2vgjln4shvh57091n14sam6wh6w06vja6lzb9ppcj4ffyx1n.nar.zst machine # [ 235.806670] niks3-server[1186]: 2026/09/27 14:16:38 INFO Received complete push request method=POST path=/api/pushes/9/complete machine # [ 235.809983] niks3-server[1186]: 2026/09/27 14:16:38 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.narinfo machine # [ 260.934101] niks3-server[1186]: 2026/09/27 14:17:03 INFO Received push request method=POST path=/api/pushes machine # [ 260.962806] niks3-server[1186]: 2026/09/27 14:17:03 INFO Registered completed upload object_key=log/894h6wzw2l4w5f0hikj1k6q57jfnyi87-k3s-b.drv machine # [ 260.964202] niks3-server[1186]: 2026/09/27 14:17:03 INFO Received sign narinfos request method=POST path=/api/pushes/10/sign machine # [ 260.965488] niks3-server[1186]: 2026/09/27 14:17:03 INFO Signed narinfos id=10 count=1 machine # [ 260.966334] niks3-server[1186]: 2026/09/27 14:17:03 INFO Registered completed upload object_key=nar/0hh3nqk95r6g32lhdmxw8cxjv694vbpx9876zkhcpg4r4qxni2ch.nar.zst machine # [ 260.968503] niks3-server[1186]: 2026/09/27 14:17:03 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.ls machine # [ 260.979049] niks3-server[1186]: 2026/09/27 14:17:03 INFO Received complete push request method=POST path=/api/pushes/10/complete machine # [ 260.985400] niks3-server[1186]: 2026/09/27 14:17:03 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.narinfo machine # [ 261.050371] niks3-server[1186]: 2026/09/27 14:17:03 INFO Received push request method=POST path=/api/pushes machine # [ 261.061697] niks3-server[1186]: 2026/09/27 14:17:03 INFO Received sign narinfos request method=POST path=/api/pushes/11/sign machine # [ 261.063491] niks3-server[1186]: 2026/09/27 14:17:03 INFO Signed narinfos id=11 count=1 machine # [ 261.065038] niks3-server[1186]: 2026/09/27 14:17:03 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.ls machine # [ 261.067107] niks3-server[1186]: 2026/09/27 14:17:03 INFO Registered completed upload object_key=nar/0ingamx56k31lwiyxmnxmscjj4n3qfx6sr2kpaynsrwhwz1278iw.nar.zst machine # [ 261.069248] niks3-server[1186]: 2026/09/27 14:17:03 INFO Received complete push request method=POST path=/api/pushes/11/complete machine # [ 261.072688] niks3-server[1186]: 2026/09/27 14:17:03 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.narinfo machine # [ 285.993963] niks3-server[1186]: 2026/09/27 14:17:28 INFO Received push request method=POST path=/api/pushes machine # [ 286.018186] niks3-server[1186]: 2026/09/27 14:17:28 INFO Received sign narinfos request method=POST path=/api/pushes/12/sign machine # [ 286.019979] niks3-server[1186]: 2026/09/27 14:17:28 INFO Registered completed upload object_key=nar/0v48x4sp58bvfra08axgkz7yl1n9nc4nirskyv1hwann4i7q277i.nar.zst machine # [ 286.022169] niks3-server[1186]: 2026/09/27 14:17:28 INFO Signed narinfos id=12 count=1 machine # [ 286.023544] niks3-server[1186]: 2026/09/27 14:17:28 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.ls machine # [ 286.027489] niks3-server[1186]: 2026/09/27 14:17:28 INFO Registered completed upload object_key=log/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g-k3s-top.drv machine # [ 286.032879] niks3-server[1186]: 2026/09/27 14:17:28 INFO Received complete push request method=POST path=/api/pushes/12/complete machine # [ 286.037442] niks3-server[1186]: 2026/09/27 14:17:28 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1, in 100.62 seconds) (finished: subtest: build through the balancer lands in the cache, in 213.39 seconds) subtest: a Job with the client image builds through the farm with its service account machine: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine: (finished: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.16 seconds) machine: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix machine: (finished: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix, in 0.14 seconds) machine: must succeed: kubectl apply -f /nix/store/4qg21n7g16x8lyv0fhhdx9dx3lxqkcdn-ci-job.json machine: (finished: must succeed: kubectl apply -f /nix/store/4qg21n7g16x8lyv0fhhdx9dx3lxqkcdn-ci-job.json, in 0.15 seconds) machine: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed' machine # [ 287.435613] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod25b0cc8b_2576_4c7b_8e2f_6daa3078705e.slice. machine # [ 287.485273] k3s[882]: I0927 14:17:30.299554 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/25b0cc8b-2576-4c7b-8e2f-6daa3078705e-nix-grpc-farm\") pod \"ci-vtsqf\" (UID: \"25b0cc8b-2576-4c7b-8e2f-6daa3078705e\") " pod="ci/ci-vtsqf" machine # [ 287.486251] k3s[882]: I0927 14:17:30.299611 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g6fg\" (UniqueName: \"kubernetes.io/projected/25b0cc8b-2576-4c7b-8e2f-6daa3078705e-kube-api-access-9g6fg\") pod \"ci-vtsqf\" (UID: \"25b0cc8b-2576-4c7b-8e2f-6daa3078705e\") " pod="ci/ci-vtsqf" machine # [ 287.486939] k3s[882]: I0927 14:17:30.299638 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"job\" (UniqueName: \"kubernetes.io/configmap/25b0cc8b-2576-4c7b-8e2f-6daa3078705e-job\") pod \"ci-vtsqf\" (UID: \"25b0cc8b-2576-4c7b-8e2f-6daa3078705e\") " pod="ci/ci-vtsqf" machine # [ 288.844923] cni0: port 2(veth2e69c4f5) entered blocking state machine # [ 288.846561] cni0: port 2(veth2e69c4f5) entered disabled state machine # [ 288.849521] veth2e69c4f5: entered allmulticast mode machine # [ 288.852057] veth2e69c4f5: entered promiscuous mode machine # [ 288.869311] cni0: port 2(veth2e69c4f5) entered blocking state machine # [ 288.871255] cni0: port 2(veth2e69c4f5) entered forwarding state machine # [ 288.762976] (udev-worker)[4901]: Network interface NamePolicy= disabled on kernel command line. machine # [ 288.793744] dhcpcd[684]: veth2e69c4f5: IAID 73:7c:cf:89 machine # [ 288.794841] dhcpcd[684]: veth2e69c4f5: adding address fe80::c0d6:73ff:fe7c:cf89 machine # [ 288.828662] systemd[1]: Started libcontainer container 39966e5adba2dc1b100424ea608fe4fd690242f7a0b9618c07cd998d9e0db9c6. machine # [ 288.849859] dhcpcd[684]: veth2e69c4f5: soliciting a DHCP lease machine # [ 291.028193] dhcpcd[684]: veth2e69c4f5: soliciting an IPv6 router machine # [ 291.318401] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount2591299195.mount: Deactivated successfully. machine # [ 291.369286] systemd[1]: Started libcontainer container 4ec1ed11fb4b343f0ae8e196597f76ecc33b55796e1109a16da62dcb4a6b1de7. machine # [ 292.333215] k3s[882]: I0927 14:17:35.147223 882 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ci/ci-vtsqf" podStartSLOduration=5.147178309 podStartE2EDuration="5.147178309s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-27 14:17:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-27 14:17:35.146401674 +0000 UTC m=+275.179895179" watchObservedRunningTime="2026-09-27 14:17:35.147178309 +0000 UTC m=+275.180670976" machine # [ 292.792619] niks3-server[1186]: 2026/09/27 14:17:35 INFO Received push request method=POST path=/api/pushes machine # [ 292.812743] niks3-server[1186]: 2026/09/27 14:17:35 INFO Received sign narinfos request method=POST path=/api/pushes/13/sign machine # [ 292.816261] niks3-server[1186]: 2026/09/27 14:17:35 INFO Signed narinfos id=13 count=1 machine # [ 292.821799] niks3-server[1186]: 2026/09/27 14:17:35 INFO Registered completed upload object_key=nar/111g6dyibwcf2z7jhpn72rgja0qvjgpdiv9nc06g2dp7ih0a6kyq.nar.zst machine # [ 292.827500] niks3-server[1186]: 2026/09/27 14:17:35 INFO Received complete push request method=POST path=/api/pushes/13/complete machine # [ 292.829820] niks3-server[1186]: 2026/09/27 14:17:35 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.ls machine # [ 292.836445] niks3-server[1186]: 2026/09/27 14:17:35 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.narinfo machine # [ 293.851288] dhcpcd[684]: veth2e69c4f5: probing for an IPv4LL address machine # [ 298.227346] dhcpcd[684]: veth2e69c4f5: using IPv4LL address 169.254.234.254 machine # [ 298.229898] dhcpcd[684]: veth2e69c4f5: adding route to 169.254.0.0/16 machine # [ 303.034337] dhcpcd[684]: veth2e69c4f5: no IPv6 Routers available machine # [ 310.273950] postgres[763]: [763] LOG: checkpoint starting: time machine # [ 318.171245] niks3-server[1186]: 2026/09/27 14:18:00 INFO Received push request method=POST path=/api/pushes machine # [ 318.193001] niks3-server[1186]: 2026/09/27 14:18:01 INFO Received sign narinfos request method=POST path=/api/pushes/14/sign machine # [ 318.195409] niks3-server[1186]: 2026/09/27 14:18:01 INFO Registered completed upload object_key=nar/058kjd2vfl1r27b4d9ixvwf77d8rkr18a4v894kwx8lg0nwpajnr.nar.zst machine # [ 318.198521] niks3-server[1186]: 2026/09/27 14:18:01 INFO Registered completed upload object_key=log/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # [ 318.200796] niks3-server[1186]: 2026/09/27 14:18:01 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.ls machine # [ 318.209567] niks3-server[1186]: 2026/09/27 14:18:01 INFO Signed narinfos id=14 count=1 machine # [ 318.222121] niks3-server[1186]: 2026/09/27 14:18:01 INFO Received complete push request method=POST path=/api/pushes/14/complete machine # [ 318.225571] niks3-server[1186]: 2026/09/27 14:18:01 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.narinfo machine # [ 318.296636] niks3-server[1186]: 2026/09/27 14:18:01 INFO Received push request method=POST path=/api/pushes machine # [ 318.307567] niks3-server[1186]: 2026/09/27 14:18:01 INFO Received sign narinfos request method=POST path=/api/pushes/15/sign machine # [ 318.308501] niks3-server[1186]: 2026/09/27 14:18:01 INFO Signed narinfos id=15 count=1 machine # [ 318.312673] niks3-server[1186]: 2026/09/27 14:18:01 INFO Registered completed upload object_key=nar/138ynhcd5wxzz485x9qcq7xsargaklrf2li31ai69m5r46am35q6.nar.zst machine # [ 318.314685] niks3-server[1186]: 2026/09/27 14:18:01 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.ls machine # [ 318.318267] niks3-server[1186]: 2026/09/27 14:18:01 INFO Received complete push request method=POST path=/api/pushes/15/complete machine # [ 318.324838] niks3-server[1186]: 2026/09/27 14:18:01 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.narinfo machine # [ 343.043675] niks3-server[1186]: 2026/09/27 14:18:25 INFO Received push request method=POST path=/api/pushes machine # [ 343.069140] niks3-server[1186]: 2026/09/27 14:18:25 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.ls machine # [ 343.073329] niks3-server[1186]: 2026/09/27 14:18:25 INFO Registered completed upload object_key=nar/0n4lbdlp8w72fs3qbavl2lwrzbrn55i2b1vyglc89cc3pi8vbb1m.nar.zst machine # [ 343.078337] niks3-server[1186]: 2026/09/27 14:18:25 INFO Received sign narinfos request method=POST path=/api/pushes/16/sign machine # [ 343.081967] niks3-server[1186]: 2026/09/27 14:18:25 INFO Signed narinfos id=16 count=1 machine # [ 343.084596] niks3-server[1186]: 2026/09/27 14:18:25 INFO Registered completed upload object_key=log/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # [ 343.088865] niks3-server[1186]: 2026/09/27 14:18:25 INFO Received complete push request method=POST path=/api/pushes/16/complete machine # [ 343.094136] niks3-server[1186]: 2026/09/27 14:18:25 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo machine # [ 343.159314] niks3-server[1186]: 2026/09/27 14:18:25 INFO Received push request method=POST path=/api/pushes machine # [ 343.169435] niks3-server[1186]: 2026/09/27 14:18:25 INFO Received sign narinfos request method=POST path=/api/pushes/17/sign machine # [ 343.170222] niks3-server[1186]: 2026/09/27 14:18:25 INFO Signed narinfos id=17 count=1 machine # [ 343.175320] niks3-server[1186]: 2026/09/27 14:18:25 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.ls machine # [ 343.177314] niks3-server[1186]: 2026/09/27 14:18:25 INFO Registered completed upload object_key=nar/1f3gvnvqsm2pm3laixkxkg44kvjb251zqhszcfpp0a00h6x66ljs.nar.zst machine # [ 343.178121] niks3-server[1186]: 2026/09/27 14:18:25 INFO Received complete push request method=POST path=/api/pushes/17/complete machine # [ 343.182441] niks3-server[1186]: 2026/09/27 14:18:25 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.narinfo machine # [ 367.901930] niks3-server[1186]: 2026/09/27 14:18:50 INFO Received push request method=POST path=/api/pushes machine # [ 367.915738] niks3-server[1186]: 2026/09/27 14:18:50 INFO Received sign narinfos request method=POST path=/api/pushes/18/sign machine # [ 367.920050] niks3-server[1186]: 2026/09/27 14:18:50 INFO Registered completed upload object_key=nar/1zwf0asrdv12q40fmqga5lx5330dvn9y4in4i9ficz9ij5lhvnf5.nar.zst machine # [ 367.921512] niks3-server[1186]: 2026/09/27 14:18:50 INFO Registered completed upload object_key=log/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # [ 367.924616] niks3-server[1186]: 2026/09/27 14:18:50 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.ls machine # [ 367.925420] niks3-server[1186]: 2026/09/27 14:18:50 INFO Signed narinfos id=18 count=1 machine # [ 367.940811] niks3-server[1186]: 2026/09/27 14:18:50 INFO Received complete push request method=POST path=/api/pushes/18/complete machine # [ 367.950430] niks3-server[1186]: 2026/09/27 14:18:50 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo machine # [ 369.664289] niks3-server[1186]: 2026/09/27 14:18:52 INFO Received push request method=POST path=/api/pushes machine # [ 369.682780] niks3-server[1186]: 2026/09/27 14:18:52 INFO Received sign narinfos request method=POST path=/api/pushes/19/sign machine # [ 369.684727] niks3-server[1186]: 2026/09/27 14:18:52 INFO Signed narinfos id=19 count=1 machine # [ 369.688563] niks3-server[1186]: 2026/09/27 14:18:52 INFO Registered completed upload object_key=nar/0xiyqcsl8db7dnrq2gqnx5izavr51ma3dcdswrriaxfgj3qzk7xf.nar.zst machine # [ 369.690794] niks3-server[1186]: 2026/09/27 14:18:52 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.ls machine # [ 369.697747] niks3-server[1186]: 2026/09/27 14:18:52 INFO Received complete push request method=POST path=/api/pushes/19/complete machine # [ 369.703736] niks3-server[1186]: 2026/09/27 14:18:52 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.narinfo machine # [ 394.407658] niks3-server[1186]: 2026/09/27 14:19:17 INFO Received push request method=POST path=/api/pushes machine # [ 394.431112] niks3-server[1186]: 2026/09/27 14:19:17 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.ls machine # [ 394.435779] niks3-server[1186]: 2026/09/27 14:19:17 INFO Registered completed upload object_key=nar/0p3l2z3riilylr2rxb1aq2blxdfxg55wbgp4gxkns93srbr4bwyq.nar.zst machine # [ 394.437265] niks3-server[1186]: 2026/09/27 14:19:17 INFO Received sign narinfos request method=POST path=/api/pushes/20/sign machine # [ 394.439336] niks3-server[1186]: 2026/09/27 14:19:17 INFO Signed narinfos id=20 count=1 machine # [ 394.442731] niks3-server[1186]: 2026/09/27 14:19:17 INFO Registered completed upload object_key=log/fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # [ 394.448476] niks3-server[1186]: 2026/09/27 14:19:17 INFO Received complete push request method=POST path=/api/pushes/20/complete machine # [ 394.453261] niks3-server[1186]: 2026/09/27 14:19:17 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo machine # [ 394.606179] systemd[1]: cri-containerd-4ec1ed11fb4b343f0ae8e196597f76ecc33b55796e1109a16da62dcb4a6b1de7.scope: Deactivated successfully. machine # [ 394.608619] systemd[1]: cri-containerd-4ec1ed11fb4b343f0ae8e196597f76ecc33b55796e1109a16da62dcb4a6b1de7.scope: Consumed 1.047s CPU time over 1min 43.238s wall clock time, 142.2M memory peak, 73.1M read from disk, 428K written to disk, 18.2K incoming IP traffic, 44.8K outgoing IP traffic. machine # [ 394.657438] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-4ec1ed11fb4b343f0ae8e196597f76ecc33b55796e1109a16da62dcb4a6b1de7-rootfs.mount: Deactivated successfully. machine # [ 395.806337] systemd[1]: cri-containerd-39966e5adba2dc1b100424ea608fe4fd690242f7a0b9618c07cd998d9e0db9c6.scope: Deactivated successfully. machine # [ 395.869484] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-39966e5adba2dc1b100424ea608fe4fd690242f7a0b9618c07cd998d9e0db9c6-rootfs.mount: Deactivated successfully. machine # [ 395.905222] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-39966e5adba2dc1b100424ea608fe4fd690242f7a0b9618c07cd998d9e0db9c6-shm.mount: Deactivated successfully. machine # [ 396.094718] cni0: port 2(veth2e69c4f5) entered disabled state machine # [ 395.943207] dhcpcd[684]: veth2e69c4f5: carrier lost machine # [ 396.097211] veth2e69c4f5 (unregistering): left allmulticast mode machine # [ 396.098440] veth2e69c4f5 (unregistering): left promiscuous mode machine # [ 396.099524] cni0: port 2(veth2e69c4f5) entered disabled state machine # [ 395.972423] systemd[1]: run-netns-cni\x2dabed52b9\x2d228a\x2d8fb6\x2dea23\x2d2f3b73d41339.mount: Deactivated successfully. machine # [ 395.978328] dhcpcd[684]: veth2e69c4f5: deleting address fe80::c0d6:73ff:fe7c:cf89 machine # [ 395.983192] dhcpcd[684]: veth2e69c4f5: deleting route to 169.254.0.0/16 machine # [ 396.058368] dhcpcd[684]: veth2e69c4f5: removing interface machine # [ 396.159815] k3s[882]: I0927 14:19:18.974292 882 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/25b0cc8b-2576-4c7b-8e2f-6daa3078705e-nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/25b0cc8b-2576-4c7b-8e2f-6daa3078705e-nix-grpc-farm\") pod \"25b0cc8b-2576-4c7b-8e2f-6daa3078705e\" (UID: \"25b0cc8b-2576-4c7b-8e2f-6daa3078705e\") " machine # [ 396.160616] k3s[882]: I0927 14:19:18.974432 882 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/25b0cc8b-2576-4c7b-8e2f-6daa3078705e-kube-api-access-9g6fg\" (UniqueName: \"kubernetes.io/projected/25b0cc8b-2576-4c7b-8e2f-6daa3078705e-kube-api-access-9g6fg\") pod \"25b0cc8b-2576-4c7b-8e2f-6daa3078705e\" (UID: \"25b0cc8b-2576-4c7b-8e2f-6daa3078705e\") " machine # [ 396.161064] k3s[882]: I0927 14:19:18.974466 882 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/25b0cc8b-2576-4c7b-8e2f-6daa3078705e-job\" (UniqueName: \"kubernetes.io/configmap/25b0cc8b-2576-4c7b-8e2f-6daa3078705e-job\") pod \"25b0cc8b-2576-4c7b-8e2f-6daa3078705e\" (UID: \"25b0cc8b-2576-4c7b-8e2f-6daa3078705e\") " machine # [ 396.161580] k3s[882]: I0927 14:19:18.975146 882 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25b0cc8b-2576-4c7b-8e2f-6daa3078705e-job" pod "25b0cc8b-2576-4c7b-8e2f-6daa3078705e" (UID: "25b0cc8b-2576-4c7b-8e2f-6daa3078705e"). InnerVolumeSpecName "job". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 396.163884] systemd[1]: var-lib-kubelet-pods-25b0cc8b\x2d2576\x2d4c7b\x2d8e2f\x2d6daa3078705e-volumes-kubernetes.io\x7eprojected-nix\x2dgrpc\x2dfarm.mount: Deactivated successfully. machine # [ 396.179660] k3s[882]: I0927 14:19:18.994477 882 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25b0cc8b-2576-4c7b-8e2f-6daa3078705e-nix-grpc-farm" pod "25b0cc8b-2576-4c7b-8e2f-6daa3078705e" (UID: "25b0cc8b-2576-4c7b-8e2f-6daa3078705e"). InnerVolumeSpecName "nix-grpc-farm". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 396.182893] systemd[1]: var-lib-kubelet-pods-25b0cc8b\x2d2576\x2d4c7b\x2d8e2f\x2d6daa3078705e-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2d9g6fg.mount: Deactivated successfully. machine # [ 396.186978] k3s[882]: I0927 14:19:19.001691 882 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25b0cc8b-2576-4c7b-8e2f-6daa3078705e-kube-api-access-9g6fg" pod "25b0cc8b-2576-4c7b-8e2f-6daa3078705e" (UID: "25b0cc8b-2576-4c7b-8e2f-6daa3078705e"). InnerVolumeSpecName "kube-api-access-9g6fg". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 396.260565] k3s[882]: I0927 14:19:19.075378 882 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9g6fg\" (UniqueName: \"kubernetes.io/projected/25b0cc8b-2576-4c7b-8e2f-6daa3078705e-kube-api-access-9g6fg\") on node \"machine\" DevicePath \"\"" machine # [ 396.260973] k3s[882]: I0927 14:19:19.075438 882 reconciler_common.go:299] "Volume detached for volume \"job\" (UniqueName: \"kubernetes.io/configmap/25b0cc8b-2576-4c7b-8e2f-6daa3078705e-job\") on node \"machine\" DevicePath \"\"" machine # [ 396.261774] k3s[882]: I0927 14:19:19.075465 882 reconciler_common.go:299] "Volume detached for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/25b0cc8b-2576-4c7b-8e2f-6daa3078705e-nix-grpc-farm\") on node \"machine\" DevicePath \"\"" machine # [ 396.788837] k3s[882]: I0927 14:19:19.603609 882 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="39966e5adba2dc1b100424ea608fe4fd690242f7a0b9618c07cd998d9e0db9c6" machine # [ 396.811495] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod25b0cc8b_2576_4c7b_8e2f_6daa3078705e.slice. machine # [ 396.813377] systemd[1]: kubepods-besteffort-pod25b0cc8b_2576_4c7b_8e2f_6daa3078705e.slice: Consumed 1.078s CPU time over 1min 49.373s wall clock time, 142.5M memory peak, 73.1M read from disk, 632K written to disk, 18.2K incoming IP traffic, 44.8K outgoing IP traffic. machine: (finished: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed', in 110.79 seconds) machine: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1 machine: (finished: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1, in 0.16 seconds) machine # don't know how to build these paths: machine # /nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-a> machine/nix-grpc-farm-worker-x86-64-linux-c74f46454-6ftt5: building fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-b> machine/nix-grpc-farm-worker-x86-64-linux-c74f46454-6ftt5: building 1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-top> machine/nix-grpc-farm-worker-x86-64-linux-c74f46454-6ftt5: building rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # INFO:nix_fast_build.processes:run nix-eval-jobs --gc-roots-dir /tmp/tmprjqwey5k/gcroots --force-recurse --max-memory-size 4096 --workers 4 --flake '.#checks' --check-cache-status machine # INFO:nix_fast_build.workers:builds: 0 machine # warning: Git tree '/tmp' is dirty machine # warning: Git tree '/tmp' is dirty machine # ▶ x86_64-linux.t started machine # INFO:nix_fast_build.workers:builds: 2 machine # ✔ x86_64-linux.t (26s) machine # x86_64-linux.t> machine/nix-grpc-farm-worker-x86-64-linux-c74f46454-jlwrq: building fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # warning: Git tree '/tmp' is dirty machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath, in 0.17 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null, in 0.04 seconds) (finished: subtest: a Job with the client image builds through the farm with its service account, in 111.94 seconds) subtest: a renewed balancer certificate is served without a rollout machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f - machine # Warning: resource secrets/farm-lb-tls is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically. machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f -, in 0.30 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}', in 0.22 seconds) machine: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-75b44f88dd-t84lb -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine # [ 398.814349] k3s[882]: E0927 14:19:21.628684 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58946: use of closed network connection machine # [ 400.097171] k3s[882]: E0927 14:19:22.910835 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58972: use of closed network connection machine # [ 400.101051] k3s[882]: time="2026-09-27T14:19:22Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:53508->127.0.0.1:10250: write: broken pipe" machine # [ 401.402696] k3s[882]: E0927 14:19:24.217117 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59010: use of closed network connection machine # [ 402.733722] k3s[882]: E0927 14:19:25.548122 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59044: use of closed network connection machine # [ 404.052304] k3s[882]: E0927 14:19:26.866231 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41100: use of closed network connection machine # [ 405.328901] k3s[882]: E0927 14:19:28.143050 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41130: use of closed network connection machine # [ 406.637628] k3s[882]: E0927 14:19:29.451937 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41148: use of closed network connection machine # [ 407.963244] k3s[882]: E0927 14:19:30.777766 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41188: use of closed network connection machine # [ 409.271224] k3s[882]: E0927 14:19:32.085611 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41230: use of closed network connection machine # [ 410.597161] k3s[882]: E0927 14:19:33.411311 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41268: use of closed network connection machine # [ 411.899035] k3s[882]: E0927 14:19:34.713409 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41292: use of closed network connection machine # [ 413.215422] k3s[882]: E0927 14:19:36.029767 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40440: use of closed network connection machine # [ 414.528503] k3s[882]: E0927 14:19:37.343020 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40466: use of closed network connection machine # [ 414.591532] postgres[763]: [763] LOG: checkpoint complete: wrote 1037 buffers (6.3%), wrote 3 SLRU buffers; 1 WAL file(s) added, 0 removed, 0 recycled; write=104.229 s, sync=0.049 s, total=104.319 s; sync files=364, longest=0.004 s, average=0.001 s; distance=4978 kB, estimate=4978 kB; lsn=0/1C74BC0, redo lsn=0/1C42BD0 machine # [ 415.825359] k3s[882]: E0927 14:19:38.639438 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40508: use of closed network connection machine # [ 417.120088] k3s[882]: E0927 14:19:39.934224 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40534: use of closed network connection machine # [ 419.742578] k3s[882]: E0927 14:19:42.556811 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40578: use of closed network connection machine # [ 421.040882] k3s[882]: E0927 14:19:43.855208 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40614: use of closed network connection machine # [ 422.350815] k3s[882]: E0927 14:19:45.165343 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40640: use of closed network connection machine # [ 423.675781] k3s[882]: E0927 14:19:46.489548 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46196: use of closed network connection machine # [ 424.996451] k3s[882]: E0927 14:19:47.810708 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46234: use of closed network connection machine # [ 426.341497] k3s[882]: E0927 14:19:49.156023 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46250: use of closed network connection machine # [ 427.636796] k3s[882]: E0927 14:19:50.451322 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46270: use of closed network connection machine # [ 428.936706] k3s[882]: E0927 14:19:51.751152 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46294: use of closed network connection machine # [ 430.232254] k3s[882]: E0927 14:19:53.046324 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46330: use of closed network connection machine # [ 431.519867] k3s[882]: E0927 14:19:54.333911 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46362: use of closed network connection machine # [ 432.844377] k3s[882]: E0927 14:19:55.658727 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46402: use of closed network connection machine: (finished: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-75b44f88dd-t84lb -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 34.33 seconds) machine: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine: (finished: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 0.04 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1 machine # [ 433.101279] niks3-server[1186]: 2026/09/27 14:19:55 INFO Received push request method=POST path=/api/pushes machine # [ 433.114444] niks3-server[1186]: 2026/09/27 14:19:55 INFO Received sign narinfos request method=POST path=/api/pushes/21/sign machine # [ 433.115891] niks3-server[1186]: 2026/09/27 14:19:55 INFO Signed narinfos id=21 count=1 machine # [ 433.116815] niks3-server[1186]: 2026/09/27 14:19:55 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.ls machine # [ 433.120827] niks3-server[1186]: 2026/09/27 14:19:55 INFO Registered completed upload object_key=nar/0g42hgwa9jp9abmqxz90dkwxpybsznzbpsy35rm921mlk5sw56jq.nar.zst machine # [ 433.124698] niks3-server[1186]: 2026/09/27 14:19:55 INFO Received complete push request method=POST path=/api/pushes/21/complete machine # [ 433.130138] niks3-server[1186]: 2026/09/27 14:19:55 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.narinfo machine # [ 457.832646] niks3-server[1186]: 2026/09/27 14:20:20 INFO Received push request method=POST path=/api/pushes machine # [ 457.850757] niks3-server[1186]: 2026/09/27 14:20:20 INFO Received sign narinfos request method=POST path=/api/pushes/22/sign machine # [ 457.852779] niks3-server[1186]: 2026/09/27 14:20:20 INFO Signed narinfos id=22 count=1 machine # [ 457.854850] niks3-server[1186]: 2026/09/27 14:20:20 INFO Registered completed upload object_key=log/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31-k3s-a.drv machine # [ 457.857283] niks3-server[1186]: 2026/09/27 14:20:20 INFO Registered completed upload object_key=nar/1vxmmzwi16s4iri6dcmi9v62dpq1ys7wz15b497ncik3sd67nfzg.nar.zst machine # [ 457.861262] niks3-server[1186]: 2026/09/27 14:20:20 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.ls machine # [ 457.865476] niks3-server[1186]: 2026/09/27 14:20:20 INFO Received complete push request method=POST path=/api/pushes/22/complete machine # [ 457.871471] niks3-server[1186]: 2026/09/27 14:20:20 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo machine # [ 457.943048] niks3-server[1186]: 2026/09/27 14:20:20 INFO Received push request method=POST path=/api/pushes machine # [ 457.954159] niks3-server[1186]: 2026/09/27 14:20:20 INFO Received sign narinfos request method=POST path=/api/pushes/23/sign machine # [ 457.955706] niks3-server[1186]: 2026/09/27 14:20:20 INFO Signed narinfos id=23 count=1 machine # [ 457.958335] niks3-server[1186]: 2026/09/27 14:20:20 INFO Registered completed upload object_key=nar/0cbxkyxz068xc5mivh2h67kw6y01n1x28cbs11v1a03g8m4c71zm.nar.zst machine # [ 457.960159] niks3-server[1186]: 2026/09/27 14:20:20 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.ls machine # [ 457.963198] niks3-server[1186]: 2026/09/27 14:20:20 INFO Received complete push request method=POST path=/api/pushes/23/complete machine # [ 457.967883] niks3-server[1186]: 2026/09/27 14:20:20 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.narinfo machine # [ 482.691094] niks3-server[1186]: 2026/09/27 14:20:45 INFO Received push request method=POST path=/api/pushes machine # [ 482.714116] niks3-server[1186]: 2026/09/27 14:20:45 INFO Received sign narinfos request method=POST path=/api/pushes/24/sign machine # [ 482.716379] niks3-server[1186]: 2026/09/27 14:20:45 INFO Signed narinfos id=24 count=1 machine # [ 482.723823] niks3-server[1186]: 2026/09/27 14:20:45 INFO Registered completed upload object_key=nar/0khxywxb2r78vhpc5hsmha3ymgp910z0aka7550jmaqzs333rmzp.nar.zst machine # [ 482.729798] niks3-server[1186]: 2026/09/27 14:20:45 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.ls machine # [ 482.731606] niks3-server[1186]: 2026/09/27 14:20:45 INFO Received complete push request method=POST path=/api/pushes/24/complete machine # [ 482.733552] niks3-server[1186]: 2026/09/27 14:20:45 INFO Registered completed upload object_key=log/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4-k3s-b.drv machine # [ 482.737837] niks3-server[1186]: 2026/09/27 14:20:45 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.narinfo machine # [ 482.809046] niks3-server[1186]: 2026/09/27 14:20:45 INFO Received push request method=POST path=/api/pushes machine # [ 482.821298] niks3-server[1186]: 2026/09/27 14:20:45 INFO Received sign narinfos request method=POST path=/api/pushes/25/sign machine # [ 482.822247] niks3-server[1186]: 2026/09/27 14:20:45 INFO Signed narinfos id=25 count=1 machine # [ 482.824450] niks3-server[1186]: 2026/09/27 14:20:45 INFO Registered completed upload object_key=nar/04bim5f8bvjh25xncf5x40kb529khrlzcbc92qxvapgbc0bdfv2h.nar.zst machine # [ 482.826510] niks3-server[1186]: 2026/09/27 14:20:45 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.ls machine # [ 482.829083] niks3-server[1186]: 2026/09/27 14:20:45 INFO Received complete push request method=POST path=/api/pushes/25/complete machine # [ 482.832173] niks3-server[1186]: 2026/09/27 14:20:45 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.narinfo machine # [ 507.141718] niks3-server[1186]: 2026/09/27 14:21:09 INFO Received push request method=POST path=/api/pushes machine # [ 507.158984] niks3-server[1186]: 2026/09/27 14:21:09 INFO Received sign narinfos request method=POST path=/api/pushes/26/sign machine # [ 507.163245] niks3-server[1186]: 2026/09/27 14:21:09 INFO Signed narinfos id=26 count=1 machine # [ 507.166479] niks3-server[1186]: 2026/09/27 14:21:09 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.ls machine # [ 507.170658] niks3-server[1186]: 2026/09/27 14:21:09 INFO Registered completed upload object_key=log/jz7biafi8rj5r3r392blyazw5mdpvy0d-k3s-top.drv machine # [ 507.175612] niks3-server[1186]: 2026/09/27 14:21:09 INFO Registered completed upload object_key=nar/11f7f1hixry25c2yc6np9hs10a2pwwqmymmrxxbswhdjabcyvv0s.nar.zst machine # [ 507.179868] niks3-server[1186]: 2026/09/27 14:21:09 INFO Received complete push request method=POST path=/api/pushes/26/complete machine # [ 507.189115] niks3-server[1186]: 2026/09/27 14:21:10 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1, in 74.32 seconds) (finished: subtest: a renewed balancer certificate is served without a rollout, in 109.21 seconds) subtest: metrics carry build_info machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-c74f46454-6ftt5 -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-c74f46454-6ftt5 -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.14 seconds) machine: must succeed: curl -sf http://10.42.0.6:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-c74f46454-6ftt5"' machine: (finished: must succeed: curl -sf http://10.42.0.6:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-c74f46454-6ftt5"', in 0.03 seconds) (finished: subtest: metrics carry build_info, in 0.17 seconds) subtest: harmonia-gc frees space and the worker stays Ready machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-c74f46454-6ftt5 -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'' machine # [ 507.574097] k3s[882]: E0927 14:21:10.388603 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51584: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-c74f46454-6ftt5 -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'', in 0.19 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-c74f46454-6ftt5 -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done' machine # [ 507.839335] k3s[882]: time="2026-09-27T14:21:10Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:33992->127.0.0.1:10250: write: broken pipe" machine # [ 507.840118] k3s[882]: E0927 14:21:10.654561 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51612: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-c74f46454-6ftt5 -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done', in 0.27 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-c74f46454-6ftt5 -c gc -- sh -c 'fallocate -l 11438784512 /nix/fill' machine # [ 508.050921] k3s[882]: E0927 14:21:10.865665 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51640: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-c74f46454-6ftt5 -c gc -- sh -c 'fallocate -l 11438784512 /nix/fill', in 0.21 seconds) machine: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-c74f46454-6ftt5 -c gc --since=30s | grep -q 'store paths deleted' machine: (finished: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-c74f46454-6ftt5 -c gc --since=30s | grep -q 'store paths deleted', in 10.02 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-c74f46454-6ftt5 -c gc -- sh -c 'rm /nix/fill' machine # [ 518.299858] k3s[882]: E0927 14:21:21.114201 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45826: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-c74f46454-6ftt5 -c gc -- sh -c 'rm /nix/fill', in 0.22 seconds) machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-c74f46454-6ftt5 -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-c74f46454-6ftt5 -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}', in 0.14 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-c74f46454-6ftt5 -c gc -- sh -c 'command -v nix-daemon && command -v niks3' machine # [ 518.614877] k3s[882]: E0927 14:21:21.429591 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45862: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-c74f46454-6ftt5 -c gc -- sh -c 'command -v nix-daemon && command -v niks3', in 0.18 seconds) (finished: subtest: harmonia-gc frees space and the worker stays Ready, in 11.23 seconds) subtest: losing the balancer mid-build: the client reconnects and the build succeeds machine: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1 machine # [ 518.641314] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1. machine # Running as unit: vialb.service; invocation ID: bed4a63b7b3646b782e21d377475a7de machine: (finished: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1, in 0.02 seconds) machine: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'" machine # [ 518.771542] nix[9783]: don't know how to build these paths: machine # [ 518.773341] nix[9783]: /nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 518.794170] nix[9783]: copying 1 paths to '127.0.0.1:30051'... machine # [ 518.795327] nix[9783]: copying path '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' to '127.0.0.1:30051'... machine # [ 518.845143] niks3-server[1186]: 2026/09/27 14:21:21 INFO Received push request method=POST path=/api/pushes machine # [ 518.860309] niks3-server[1186]: 2026/09/27 14:21:21 INFO Received sign narinfos request method=POST path=/api/pushes/27/sign machine # [ 518.862291] niks3-server[1186]: 2026/09/27 14:21:21 INFO Signed narinfos id=27 count=1 machine # [ 518.866294] niks3-server[1186]: 2026/09/27 14:21:21 INFO Registered completed upload object_key=nar/0kkr2vb091wkq0cb0f1q92413dsfskh76wydp8mwysv7rawns0ar.nar.zst machine # [ 518.868160] niks3-server[1186]: 2026/09/27 14:21:21 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.ls machine # [ 518.871112] niks3-server[1186]: 2026/09/27 14:21:21 INFO Received complete push request method=POST path=/api/pushes/27/complete machine # [ 518.877471] niks3-server[1186]: 2026/09/27 14:21:21 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.narinfo machine # [ 518.883372] nix[9783]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 518.884786] nix[9783]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-c74f46454-jlwrq: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine: (finished: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'", in 1.06 seconds) machine: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false machine: (finished: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false, in 0.22 seconds) machine: waiting for success: ! systemctl is-active vialb machine # [ 519.933659] k3s[882]: I0927 14:21:22.747631 882 endpointslice_controller.go:361] "Error syncing endpoint slices for service, retrying" key="farm/nix-grpc-farm" err="EndpointSlice informer cache is out of date" machine # [ 519.941433] nix[9783]: d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv: Stream removed (Socket closed), asking the scheduler again machine # [ 519.942913] nix[9783]: scheduler at 127.0.0.1:30051: Stream removed (Socket closed), reconnecting machine # [ 519.967400] systemd[1]: cri-containerd-e231f150ddc2c32bccc6d25697ccb6894e2952050abaa9a6a40fc0ff1fc712e9.scope: Deactivated successfully. machine # [ 519.968978] systemd[1]: cri-containerd-e231f150ddc2c32bccc6d25697ccb6894e2952050abaa9a6a40fc0ff1fc712e9.scope: Consumed 4.640s CPU time over 8min 339ms wall clock time, 57.6M memory peak, 39.9M read from disk, 606.5K incoming IP traffic, 757.2K outgoing IP traffic. machine # [ 519.998152] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-e231f150ddc2c32bccc6d25697ccb6894e2952050abaa9a6a40fc0ff1fc712e9-rootfs.mount: Deactivated successfully. machine # [ 520.032645] systemd[1]: cri-containerd-00ea951629f5cc9f7b577fe7e2cc4b1f8aa1a0af95ec4f9ee17db199939cec40.scope: Deactivated successfully. machine # [ 520.061121] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-00ea951629f5cc9f7b577fe7e2cc4b1f8aa1a0af95ec4f9ee17db199939cec40-rootfs.mount: Deactivated successfully. machine # [ 520.088754] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-00ea951629f5cc9f7b577fe7e2cc4b1f8aa1a0af95ec4f9ee17db199939cec40-shm.mount: Deactivated successfully. machine # [ 520.273420] cni0: port 3(veth1ca5effc) entered disabled state machine # [ 520.123965] dhcpcd[684]: veth1ca5effc: carrier lost machine # [ 520.275787] veth1ca5effc (unregistering): left allmulticast mode machine # [ 520.277500] veth1ca5effc (unregistering): left promiscuous mode machine # [ 520.278663] cni0: port 3(veth1ca5effc) entered disabled state machine # [ 520.145151] systemd[1]: run-netns-cni\x2d2e6930a0\x2dec77\x2dfa61\x2d8209\x2d1fba1fb11099.mount: Deactivated successfully. machine # [ 520.161524] dhcpcd[684]: veth1ca5effc: deleting address fe80::a484:9bff:fe22:f37f machine # [ 520.165246] dhcpcd[684]: veth1ca5effc: deleting route to 169.254.0.0/16 machine # [ 520.206165] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod143b4e16_81a3_439c_a91e_88ccb53fc1d9.slice. machine # [ 520.249307] dhcpcd[684]: veth1ca5effc: removing interface machine # [ 520.337473] k3s[882]: I0927 14:21:23.152285 882 scope.go:122] "RemoveContainer" containerID="e231f150ddc2c32bccc6d25697ccb6894e2952050abaa9a6a40fc0ff1fc712e9" machine # [ 520.344466] k3s[882]: I0927 14:21:23.159245 882 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b8898e70-6936-4af4-9084-7ad19988c3b9-tls-lb\" (UniqueName: \"kubernetes.io/secret/b8898e70-6936-4af4-9084-7ad19988c3b9-tls-lb\") pod \"b8898e70-6936-4af4-9084-7ad19988c3b9\" (UID: \"b8898e70-6936-4af4-9084-7ad19988c3b9\") " machine # [ 520.345263] k3s[882]: I0927 14:21:23.159295 882 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b8898e70-6936-4af4-9084-7ad19988c3b9-tls-ca\" (UniqueName: \"kubernetes.io/secret/b8898e70-6936-4af4-9084-7ad19988c3b9-tls-ca\") pod \"b8898e70-6936-4af4-9084-7ad19988c3b9\" (UID: \"b8898e70-6936-4af4-9084-7ad19988c3b9\") " machine # [ 520.346194] k3s[882]: I0927 14:21:23.159339 882 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b8898e70-6936-4af4-9084-7ad19988c3b9-config\" (UniqueName: \"kubernetes.io/configmap/b8898e70-6936-4af4-9084-7ad19988c3b9-config\") pod \"b8898e70-6936-4af4-9084-7ad19988c3b9\" (UID: \"b8898e70-6936-4af4-9084-7ad19988c3b9\") " machine # [ 520.346776] k3s[882]: I0927 14:21:23.159383 882 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b8898e70-6936-4af4-9084-7ad19988c3b9-tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8898e70-6936-4af4-9084-7ad19988c3b9-tmp\") pod \"b8898e70-6936-4af4-9084-7ad19988c3b9\" (UID: \"b8898e70-6936-4af4-9084-7ad19988c3b9\") " machine # [ 520.347699] k3s[882]: I0927 14:21:23.159442 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/143b4e16-81a3-439c-a91e-88ccb53fc1d9-config\") pod \"nix-grpc-farm-lb-75b44f88dd-nncgh\" (UID: \"143b4e16-81a3-439c-a91e-88ccb53fc1d9\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-nncgh" machine # [ 520.349076] k3s[882]: I0927 14:21:23.159472 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/143b4e16-81a3-439c-a91e-88ccb53fc1d9-tls-lb\") pod \"nix-grpc-farm-lb-75b44f88dd-nncgh\" (UID: \"143b4e16-81a3-439c-a91e-88ccb53fc1d9\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-nncgh" machine # [ 520.349680] k3s[882]: I0927 14:21:23.159496 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/143b4e16-81a3-439c-a91e-88ccb53fc1d9-tmp\") pod \"nix-grpc-farm-lb-75b44f88dd-nncgh\" (UID: \"143b4e16-81a3-439c-a91e-88ccb53fc1d9\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-nncgh" machine # [ 520.351225] k3s[882]: I0927 14:21:23.159522 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/143b4e16-81a3-439c-a91e-88ccb53fc1d9-tls-ca\") pod \"nix-grpc-farm-lb-75b44f88dd-nncgh\" (UID: \"143b4e16-81a3-439c-a91e-88ccb53fc1d9\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-nncgh" machine # [ 520.351935] k3s[882]: I0927 14:21:23.163767 882 scope.go:122] "RemoveContainer" containerID="e231f150ddc2c32bccc6d25697ccb6894e2952050abaa9a6a40fc0ff1fc712e9" machine # [ 520.352623] systemd[1]: var-lib-kubelet-pods-b8898e70\x2d6936\x2d4af4\x2d9084\x2d7ad19988c3b9-volumes-kubernetes.io\x7esecret-tls\x2dlb.mount: Deactivated successfully. machine # [ 520.353634] k3s[882]: E0927 14:21:23.168220 882 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"e231f150ddc2c32bccc6d25697ccb6894e2952050abaa9a6a40fc0ff1fc712e9\": not found" containerID="e231f150ddc2c32bccc6d25697ccb6894e2952050abaa9a6a40fc0ff1fc712e9" machine # [ 520.354494] k3s[882]: I0927 14:21:23.168256 882 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"e231f150ddc2c32bccc6d25697ccb6894e2952050abaa9a6a40fc0ff1fc712e9"} err="failed to get container status \"e231f150ddc2c32bccc6d25697ccb6894e2952050abaa9a6a40fc0ff1fc712e9\": rpc error: code = NotFound desc = an error occurred when try to find container \"e231f150ddc2c32bccc6d25697ccb6894e2952050abaa9a6a40fc0ff1fc712e9\": not found" machine # [ 520.390113] k3s[882]: I0927 14:21:23.204916 882 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8898e70-6936-4af4-9084-7ad19988c3b9-tls-ca" pod "b8898e70-6936-4af4-9084-7ad19988c3b9" (UID: "b8898e70-6936-4af4-9084-7ad19988c3b9"). InnerVolumeSpecName "tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 520.391278] k3s[882]: I0927 14:21:23.205401 882 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8898e70-6936-4af4-9084-7ad19988c3b9-tmp" pod "b8898e70-6936-4af4-9084-7ad19988c3b9" (UID: "b8898e70-6936-4af4-9084-7ad19988c3b9"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 520.391964] k3s[882]: I0927 14:21:23.206023 882 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8898e70-6936-4af4-9084-7ad19988c3b9-tls-lb" pod "b8898e70-6936-4af4-9084-7ad19988c3b9" (UID: "b8898e70-6936-4af4-9084-7ad19988c3b9"). InnerVolumeSpecName "tls-lb". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 520.407834] k3s[882]: I0927 14:21:23.222692 882 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8898e70-6936-4af4-9084-7ad19988c3b9-config" pod "b8898e70-6936-4af4-9084-7ad19988c3b9" (UID: "b8898e70-6936-4af4-9084-7ad19988c3b9"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 520.445674] k3s[882]: I0927 14:21:23.260455 882 reconciler_common.go:299] "Volume detached for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/b8898e70-6936-4af4-9084-7ad19988c3b9-tls-lb\") on node \"machine\" DevicePath \"\"" machine # [ 520.446578] k3s[882]: I0927 14:21:23.260485 882 reconciler_common.go:299] "Volume detached for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/b8898e70-6936-4af4-9084-7ad19988c3b9-tls-ca\") on node \"machine\" DevicePath \"\"" machine # [ 520.447187] k3s[882]: I0927 14:21:23.260498 882 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b8898e70-6936-4af4-9084-7ad19988c3b9-config\") on node \"machine\" DevicePath \"\"" machine # [ 520.447729] k3s[882]: I0927 14:21:23.260513 882 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8898e70-6936-4af4-9084-7ad19988c3b9-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 520.689015] cni0: port 2(veth29f98d3f) entered blocking state machine # [ 520.537906] (udev-worker)[9959]: Network interface NamePolicy= disabled on kernel command line. machine # [ 520.691527] cni0: port 2(veth29f98d3f) entered disabled state machine # [ 520.692577] veth29f98d3f: entered allmulticast mode machine # [ 520.693375] veth29f98d3f: entered promiscuous mode machine # [ 520.700434] cni0: port 2(veth29f98d3f) entered blocking state machine # [ 520.701945] cni0: port 2(veth29f98d3f) entered forwarding state machine # [ 520.568613] dhcpcd[684]: veth29f98d3f: IAID 30:a1:c0:01 machine # [ 520.569174] dhcpcd[684]: veth29f98d3f: adding address fe80::d076:30ff:fea1:c001 machine # [ 520.634517] systemd[1]: Started libcontainer container 1061ed796a5fad323ec5f23c81a0986381b2d0d386950b90882c6851bbad41fb. machine # [ 520.651095] systemd[1]: Removed slice libcontainer container kubepods-besteffort-podb8898e70_6936_4af4_9084_7ad19988c3b9.slice. machine # [ 520.652879] systemd[1]: kubepods-besteffort-podb8898e70_6936_4af4_9084_7ad19988c3b9.slice: Consumed 4.671s CPU time over 8min 2.418s wall clock time, 57.9M memory peak, 39.9M read from disk, 606.5K incoming IP traffic, 757.2K outgoing IP traffic. machine # [ 520.765623] systemd[1]: Started libcontainer container cf3d72b217ab04fdc99a06de3cdec755c54e783f38fec425552789435efbf668. machine # [ 521.007761] systemd[1]: var-lib-kubelet-pods-b8898e70\x2d6936\x2d4af4\x2d9084\x2d7ad19988c3b9-volume\x2dsubpaths-config-envoy-2.mount: Deactivated successfully. machine # [ 521.009237] systemd[1]: var-lib-kubelet-pods-b8898e70\x2d6936\x2d4af4\x2d9084\x2d7ad19988c3b9-volume\x2dsubpaths-config-envoy-1.mount: Deactivated successfully. machine # [ 521.010517] systemd[1]: var-lib-kubelet-pods-b8898e70\x2d6936\x2d4af4\x2d9084\x2d7ad19988c3b9-volume\x2dsubpaths-config-envoy-0.mount: Deactivated successfully. machine # [ 521.011580] systemd[1]: var-lib-kubelet-pods-b8898e70\x2d6936\x2d4af4\x2d9084\x2d7ad19988c3b9-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 521.012913] systemd[1]: var-lib-kubelet-pods-b8898e70\x2d6936\x2d4af4\x2d9084\x2d7ad19988c3b9-volumes-kubernetes.io\x7esecret-tls\x2dca.mount: Deactivated successfully. machine # [ 521.389478] k3s[882]: I0927 14:21:24.203052 882 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-75b44f88dd-nncgh" podStartSLOduration=2.203008005 podStartE2EDuration="2.203008005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-27 14:21:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-27 14:21:24.183664205 +0000 UTC m=+504.217155755" watchObservedRunningTime="2026-09-27 14:21:24.203008005 +0000 UTC m=+504.236500671" machine # [ 522.147075] k3s[882]: I0927 14:21:24.961729 882 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b8898e70-6936-4af4-9084-7ad19988c3b9" path="/var/lib/kubelet/pods/b8898e70-6936-4af4-9084-7ad19988c3b9/volumes" machine # [ 522.445071] nix[9783]: scheduler at 127.0.0.1:30051: failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:30051: tcp handshaker shutdown, reconnecting machine # [ 522.505775] dhcpcd[684]: veth29f98d3f: soliciting a DHCP lease machine # [ 522.877253] dhcpcd[684]: veth29f98d3f: soliciting an IPv6 router machine # [ 523.491951] nix[9783]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 523.494738] nix[9783]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-c74f46454-6ftt5: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 527.505985] dhcpcd[684]: veth29f98d3f: probing for an IPv4LL address machine # [ 532.727559] dhcpcd[684]: veth29f98d3f: using IPv4LL address 169.254.195.46 machine # [ 532.729436] dhcpcd[684]: veth29f98d3f: adding route to 169.254.0.0/16 machine # [ 534.880717] dhcpcd[684]: veth29f98d3f: no IPv6 Routers available machine # [ 568.221896] niks3-server[1186]: 2026/09/27 14:22:11 INFO Received push request method=POST path=/api/pushes machine # [ 568.241502] niks3-server[1186]: 2026/09/27 14:22:11 INFO Received sign narinfos request method=POST path=/api/pushes/28/sign machine # [ 568.244844] niks3-server[1186]: 2026/09/27 14:22:11 INFO Signed narinfos id=28 count=1 machine # [ 568.246982] niks3-server[1186]: 2026/09/27 14:22:11 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.ls machine # [ 568.250287] niks3-server[1186]: 2026/09/27 14:22:11 INFO Registered completed upload object_key=log/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 568.258291] niks3-server[1186]: 2026/09/27 14:22:11 INFO Received complete push request method=POST path=/api/pushes/28/complete machine # [ 568.265407] niks3-server[1186]: 2026/09/27 14:22:11 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.narinfo machine # [ 568.299674] systemd[1]: vialb.service: Deactivated successfully. machine # [ 568.300415] systemd[1]: vialb.service: Consumed 218ms CPU time over 49.658s wall clock time, 42.4M memory peak, 4K written to disk, 8.5K incoming IP traffic, 17.3K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active vialb, in 48.99 seconds) machine: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; }, in 0.03 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 0.23 seconds) (finished: subtest: losing the balancer mid-build: the client reconnects and the build succeeds, in 50.55 seconds) subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes machine: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 machine # [ 569.207811] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1. machine # Running as unit: slow.service; invocation ID: a03e7221da98472a8cfb7a34368e198e machine: (finished: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1, in 0.04 seconds) machine # [ 569.344142] nix[10694]: don't know how to build these paths: machine # [ 569.344992] nix[10694]: /nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 569.367732] nix[10694]: copying 1 paths to '127.0.0.1:30051'... machine # [ 569.368866] nix[10694]: copying path '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' to '127.0.0.1:30051'... machine # [ 569.410467] niks3-server[1186]: 2026/09/27 14:22:12 INFO Received push request method=POST path=/api/pushes machine # [ 569.425896] niks3-server[1186]: 2026/09/27 14:22:12 INFO Received sign narinfos request method=POST path=/api/pushes/29/sign machine # [ 569.428302] niks3-server[1186]: 2026/09/27 14:22:12 INFO Signed narinfos id=29 count=1 machine # [ 569.431770] niks3-server[1186]: 2026/09/27 14:22:12 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.ls machine # [ 569.433367] niks3-server[1186]: 2026/09/27 14:22:12 INFO Registered completed upload object_key=nar/0wl2i9xpw0gwrx1xqdgx9ka4n503ky9qhl20pdrdlphn8d6lcx0i.nar.zst machine # [ 569.437353] niks3-server[1186]: 2026/09/27 14:22:12 INFO Received complete push request method=POST path=/api/pushes/29/complete machine # [ 569.440071] niks3-server[1186]: 2026/09/27 14:22:12 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.narinfo machine # [ 569.451176] nix[10694]: building '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' on 127.0.0.1:30051... machine # [ 569.451729] nix[10694]: slow-s1> machine/nix-grpc-farm-worker-x86-64-linux-c74f46454-jlwrq: building zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 569.452892] k3s[882]: E0927 14:22:12.266910 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:49598: use of closed network connection machine # command terminated with exit code 1 machine # [ 569.654443] k3s[882]: E0927 14:22:12.469180 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:49626: use of closed network connection machine # command terminated with exit code 1 machine # [ 570.927311] k3s[882]: E0927 14:22:13.741735 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:49646: use of closed network connection machine # command terminated with exit code 1 machine # [ 571.124260] k3s[882]: E0927 14:22:13.938927 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:49670: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 572.428953] k3s[882]: E0927 14:22:15.243399 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:49704: use of closed network connection machine # [ 572.627233] k3s[882]: E0927 14:22:15.442064 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:49732: use of closed network connection machine # command terminated with exit code 1 machine # [ 573.907811] k3s[882]: E0927 14:22:16.722115 882 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:55944->127.0.0.1:10010: write tcp 127.0.0.1:55944->127.0.0.1:10010: write: broken pipe machine # command terminated with exit code 1 machine # [ 573.911129] k3s[882]: E0927 14:22:16.722263 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51588: use of closed network connection machine # [ 574.119781] k3s[882]: E0927 14:22:16.934209 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51606: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 575.392782] k3s[882]: E0927 14:22:18.206938 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51636: use of closed network connection machine # [ 575.611607] k3s[882]: E0927 14:22:18.426369 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51658: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 576.860324] k3s[882]: E0927 14:22:19.674394 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51674: use of closed network connection machine # [ 577.092543] k3s[882]: E0927 14:22:19.907259 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51698: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 578.394612] k3s[882]: E0927 14:22:21.209079 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51724: use of closed network connection machine # [ 578.602407] k3s[882]: E0927 14:22:21.417122 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51754: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 579.910363] k3s[882]: E0927 14:22:22.724837 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51768: use of closed network connection machine # [ 580.104050] k3s[882]: E0927 14:22:22.918831 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51786: use of closed network connection machine # command terminated with exit code 1 machine # [ 581.363196] k3s[882]: time="2026-09-27T14:22:24Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:36084->127.0.0.1:10250: write: broken pipe" machine # command terminated with exit code 1 machine # [ 581.365765] k3s[882]: E0927 14:22:24.177695 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51818: use of closed network connection machine # [ 581.540637] k3s[882]: E0927 14:22:24.355470 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51846: use of closed network connection machine # command terminated with exit code 1 machine # [ 582.854168] k3s[882]: E0927 14:22:25.668600 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51872: use of closed network connection machine # command terminated with exit code 1 machine # [ 583.049943] k3s[882]: E0927 14:22:25.864772 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37546: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 584.317283] k3s[882]: E0927 14:22:27.131714 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37556: use of closed network connection machine # [ 584.501985] k3s[882]: E0927 14:22:27.316731 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37584: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 585.824563] k3s[882]: E0927 14:22:28.638928 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37616: use of closed network connection machine # command terminated with exit code 1 machine # [ 586.013497] k3s[882]: E0927 14:22:28.828315 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37650: use of closed network connection machine # command terminated with exit code 1 machine # [ 587.307675] k3s[882]: E0927 14:22:30.122181 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37676: use of closed network connection machine # [ 587.497208] k3s[882]: E0927 14:22:30.312035 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37710: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 588.822866] k3s[882]: time="2026-09-27T14:22:31Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:44724->127.0.0.1:10250: write: broken pipe" machine # [ 588.824233] k3s[882]: E0927 14:22:31.637133 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37726: use of closed network connection machine # [ 589.029921] k3s[882]: E0927 14:22:31.844746 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37760: use of closed network connection machine # command terminated with exit code 1 machine # [ 590.332538] k3s[882]: E0927 14:22:33.146994 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37792: use of closed network connection machine # command terminated with exit code 1 machine # [ 590.535931] k3s[882]: E0927 14:22:33.350783 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37810: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 591.802816] k3s[882]: E0927 14:22:34.617300 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37834: use of closed network connection machine # [ 591.996542] k3s[882]: E0927 14:22:34.811392 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37858: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 593.294307] k3s[882]: E0927 14:22:36.108191 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57912: use of closed network connection machine # [ 593.502318] k3s[882]: E0927 14:22:36.317171 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57924: use of closed network connection machine # command terminated with exit code 1 machine # [ 594.765298] k3s[882]: E0927 14:22:37.579761 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57966: use of closed network connection machine # command terminated with exit code 1 machine # [ 595.208886] k3s[882]: E0927 14:22:38.023728 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58012: use of closed network connection machine # command terminated with exit code 1 machine # [ 595.394910] k3s[882]: E0927 14:22:38.209675 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58044: use of closed network connection machine: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-c74f46454-jlwrq --wait=false machine: (finished: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-c74f46454-jlwrq --wait=false, in 0.15 seconds) machine: must succeed: sleep 5.0 machine # [ 595.597153] systemd[1]: cri-containerd-55aa9317b0550d376fe7a7ef0ba878314ebec5c874c63fef72a6ac9f4ff4072b.scope: Deactivated successfully. machine # [ 595.598161] systemd[1]: cri-containerd-55aa9317b0550d376fe7a7ef0ba878314ebec5c874c63fef72a6ac9f4ff4072b.scope: Consumed 532ms CPU time over 8min 58.681s wall clock time, 12.4M memory peak, 5.2M read from disk. machine # [ 595.617058] systemd[1]: Created slice libcontainer container kubepods-besteffort-pode44bb844_8272_4b63_959b_ee462e9091ce.slice. machine # [ 595.650250] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-55aa9317b0550d376fe7a7ef0ba878314ebec5c874c63fef72a6ac9f4ff4072b-rootfs.mount: Deactivated successfully. machine # [ 595.727437] k3s[882]: I0927 14:22:38.542241 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hckz7\" (UniqueName: \"kubernetes.io/projected/e44bb844-8272-4b63-959b-ee462e9091ce-kube-api-access-hckz7\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-nxf8z\" (UID: \"e44bb844-8272-4b63-959b-ee462e9091ce\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-nxf8z" machine # [ 595.728308] k3s[882]: I0927 14:22:38.542296 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/e44bb844-8272-4b63-959b-ee462e9091ce-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-nxf8z\" (UID: \"e44bb844-8272-4b63-959b-ee462e9091ce\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-nxf8z" machine # [ 595.728961] k3s[882]: I0927 14:22:38.542339 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/e44bb844-8272-4b63-959b-ee462e9091ce-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-nxf8z\" (UID: \"e44bb844-8272-4b63-959b-ee462e9091ce\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-nxf8z" machine # [ 595.730066] k3s[882]: I0927 14:22:38.542368 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/e44bb844-8272-4b63-959b-ee462e9091ce-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-nxf8z\" (UID: \"e44bb844-8272-4b63-959b-ee462e9091ce\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-nxf8z" machine # [ 595.730557] k3s[882]: I0927 14:22:38.542393 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e44bb844-8272-4b63-959b-ee462e9091ce-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-nxf8z\" (UID: \"e44bb844-8272-4b63-959b-ee462e9091ce\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-nxf8z" machine # [ 595.731067] k3s[882]: I0927 14:22:38.542420 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/e44bb844-8272-4b63-959b-ee462e9091ce-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-nxf8z\" (UID: \"e44bb844-8272-4b63-959b-ee462e9091ce\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-nxf8z" machine # [ 595.731615] k3s[882]: I0927 14:22:38.542602 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/e44bb844-8272-4b63-959b-ee462e9091ce-build\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-nxf8z\" (UID: \"e44bb844-8272-4b63-959b-ee462e9091ce\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-nxf8z" machine # [ 595.732129] k3s[882]: I0927 14:22:38.542675 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/e44bb844-8272-4b63-959b-ee462e9091ce-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-c74f46454-nxf8z\" (UID: \"e44bb844-8272-4b63-959b-ee462e9091ce\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-nxf8z" machine # [ 596.139809] cni0: port 3(veth8bcb26e2) entered blocking state machine # [ 596.151542] cni0: port 3(veth8bcb26e2) entered disabled state machine # [ 596.153104] veth8bcb26e2: entered allmulticast mode machine # [ 596.154369] veth8bcb26e2: entered promiscuous mode machine # [ 596.165257] cni0: port 3(veth8bcb26e2) entered blocking state machine # [ 596.166788] cni0: port 3(veth8bcb26e2) entered forwarding state machine # [ 596.044816] (udev-worker)[12422]: Network interface NamePolicy= disabled on kernel command line. machine # [ 596.074420] dhcpcd[684]: veth8bcb26e2: IAID ba:87:87:58 machine # [ 596.075168] dhcpcd[684]: veth8bcb26e2: adding address fe80::ec64:baff:fe87:8758 machine # [ 596.114328] systemd[1]: Started libcontainer container 3858b0a57fcf674f82c470945b99cbb813db81b3f60759219c521eb5a32d6b68. machine # [ 596.415900] systemd[1]: Started libcontainer container 1f91b4d9ece1d8456eab72297a6151f84f5c71be8cfd1ad7a1bee5c406c48fc4. machine # [ 596.861417] dhcpcd[684]: veth8bcb26e2: soliciting a DHCP lease machine # [ 598.347169] dhcpcd[684]: veth8bcb26e2: soliciting an IPv6 router machine # [ 598.771894] systemd[1]: cri-containerd-1f91b4d9ece1d8456eab72297a6151f84f5c71be8cfd1ad7a1bee5c406c48fc4.scope: Deactivated successfully. machine # [ 598.776651] systemd[1]: cri-containerd-1f91b4d9ece1d8456eab72297a6151f84f5c71be8cfd1ad7a1bee5c406c48fc4.scope: Consumed 1.103s CPU time over 2.355s wall clock time, 473.8M memory peak, 176.7M read from disk, 133.7M written to disk. machine # [ 598.844854] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-1f91b4d9ece1d8456eab72297a6151f84f5c71be8cfd1ad7a1bee5c406c48fc4-rootfs.mount: Deactivated successfully. machine # [ 599.842971] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount170568869.mount: Deactivated successfully. machine # [ 599.844924] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped416362680.mount: Deactivated successfully. machine # [ 599.911567] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped2973294416.mount: Deactivated successfully. machine # [ 599.919206] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount3429826649.mount: Deactivated successfully. machine # [ 600.006642] systemd[1]: Started libcontainer container 9c8abe49a1fb5687df00871f0c177ac0d893247be31f43bb5c456a44da3f1e9b. machine # [ 600.301688] systemd[1]: Started libcontainer container e41a0de2c18a5bf95bc4fff45b8cb8615a8dadfe52983c0ff385dd18a81209f2. machine: (finished: must succeed: sleep 5.0, in 5.03 seconds) machine # [ 600.630832] systemd[1]: Started libcontainer container 5d4d60cf91ebf8ef4c6bbd22594be4817786826a0f2d929023d35d11ed03d1e0. machine # command terminated with exit code 1 machine # [ 600.829847] k3s[882]: E0927 14:22:43.644340 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58074: use of closed network connection machine # [ 600.943583] k3s[882]: I0927 14:22:43.758400 882 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-c74f46454-nxf8z" podStartSLOduration=3.461301717 podStartE2EDuration="5.758377183s" totalImagesPullingTime="0s" totalInitContainerRuntime="2.297075466s" isStatefulPod=false podCreationTimestamp="2026-09-27 14:22:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-27 14:22:43.563552143 +0000 UTC m=+583.597040619" watchObservedRunningTime="2026-09-27 14:22:43.758377183 +0000 UTC m=+583.791865660" machine # [ 601.031365] k3s[882]: E0927 14:22:43.846000 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58090: use of closed network connection machine: waiting for success: ! systemctl is-active slow machine # [ 601.862432] dhcpcd[684]: veth8bcb26e2: probing for an IPv4LL address machine # [ 606.870925] dhcpcd[684]: veth8bcb26e2: using IPv4LL address 169.254.233.87 machine # [ 606.873621] dhcpcd[684]: veth8bcb26e2: adding route to 169.254.0.0/16 machine # [ 610.352967] dhcpcd[684]: veth8bcb26e2: no IPv6 Routers available machine # [ 610.692079] postgres[763]: [763] LOG: checkpoint starting: time machine # [ 613.733667] postgres[763]: [763] LOG: checkpoint complete: wrote 30 buffers (0.2%), wrote 1 SLRU buffers; 0 WAL file(s) added, 0 removed, 0 recycled; write=3.016 s, sync=0.009 s, total=3.042 s; sync files=24, longest=0.004 s, average=0.001 s; distance=263 kB, estimate=4507 kB; lsn=0/1C84C20, redo lsn=0/1C84B90 machine # [ 614.591700] niks3-server[1186]: 2026/09/27 14:22:57 INFO Received push request method=POST path=/api/pushes machine # [ 614.610094] niks3-server[1186]: 2026/09/27 14:22:57 INFO Received sign narinfos request method=POST path=/api/pushes/30/sign machine # [ 614.612768] niks3-server[1186]: 2026/09/27 14:22:57 INFO Signed narinfos id=30 count=1 machine # [ 614.615236] niks3-server[1186]: 2026/09/27 14:22:57 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.ls machine # [ 614.620159] niks3-server[1186]: 2026/09/27 14:22:57 INFO Received complete push request method=POST path=/api/pushes/30/complete machine # [ 614.627413] niks3-server[1186]: 2026/09/27 14:22:57 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo machine # [ 615.355248] systemd[1]: cri-containerd-890393719c9eb9357670f79be9d9875bc0c76c6c9ebcfb209bafffc18d318679.scope: Deactivated successfully. machine # [ 615.357849] systemd[1]: cri-containerd-890393719c9eb9357670f79be9d9875bc0c76c6c9ebcfb209bafffc18d318679.scope: Consumed 3.419s CPU time over 9min 18.606s wall clock time, 65.1M memory peak, 26M read from disk, 8K written to disk, 272.8K incoming IP traffic, 338.3K outgoing IP traffic. machine # [ 615.425326] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-890393719c9eb9357670f79be9d9875bc0c76c6c9ebcfb209bafffc18d318679-rootfs.mount: Deactivated successfully. machine # [ 615.685404] systemd[1]: slow.service: Deactivated successfully. machine # [ 615.687750] systemd[1]: slow.service: Consumed 180ms CPU time over 46.477s wall clock time, 38.5M memory peak, 4K written to disk, 5.5K incoming IP traffic, 11.7K outgoing IP traffic. machine # [ 615.767625] systemd[1]: cri-containerd-62499d0ab1d4143a0cc9901ec2899a9d2df302fe7816b6e60f657623f784be93.scope: Deactivated successfully. machine # [ 615.769469] systemd[1]: cri-containerd-62499d0ab1d4143a0cc9901ec2899a9d2df302fe7816b6e60f657623f784be93.scope: Consumed 22.299s CPU time over 9min 19.173s wall clock time, 39.6M memory peak, 21.7M read from disk, 1.1M written to disk, 47.5K incoming IP traffic, 31.9K outgoing IP traffic. machine # [ 615.831066] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-62499d0ab1d4143a0cc9901ec2899a9d2df302fe7816b6e60f657623f784be93-rootfs.mount: Deactivated successfully. machine # [ 615.854755] systemd[1]: cri-containerd-761c904f7872eeeee34c70e487431754896492ccb06d603e186161728170009b.scope: Deactivated successfully. machine # [ 615.886954] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-761c904f7872eeeee34c70e487431754896492ccb06d603e186161728170009b-rootfs.mount: Deactivated successfully. machine # [ 615.917789] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-761c904f7872eeeee34c70e487431754896492ccb06d603e186161728170009b-shm.mount: Deactivated successfully. machine # [ 616.104492] cni0: port 6(vetha416bff2) entered disabled state machine # [ 615.954874] dhcpcd[684]: vetha416bff2: carrier lost machine # [ 616.107440] vetha416bff2 (unregistering): left allmulticast mode machine # [ 616.108663] vetha416bff2 (unregistering): left promiscuous mode machine # [ 616.109856] cni0: port 6(vetha416bff2) entered disabled state machine # [ 615.978940] systemd[1]: run-netns-cni\x2d90c9dd46\x2d8743\x2db841\x2da6de\x2dab37ed176728.mount: Deactivated successfully. machine # [ 615.991169] dhcpcd[684]: vetha416bff2: deleting address fe80::6c12:66ff:fe9f:760b machine # [ 615.994277] dhcpcd[684]: vetha416bff2: deleting route to 169.254.0.0/16 machine # [ 616.058350] dhcpcd[684]: vetha416bff2: removing interface machine # [ 616.094264] k3s[882]: I0927 14:22:58.908697 882 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ec8a4a09-1ed7-4735-9a6a-ec094fa7a250-tls\" (UniqueName: \"kubernetes.io/secret/ec8a4a09-1ed7-4735-9a6a-ec094fa7a250-tls\") pod \"ec8a4a09-1ed7-4735-9a6a-ec094fa7a250\" (UID: \"ec8a4a09-1ed7-4735-9a6a-ec094fa7a250\") " machine # [ 616.094881] k3s[882]: I0927 14:22:58.908748 882 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ec8a4a09-1ed7-4735-9a6a-ec094fa7a250-build\" (UniqueName: \"kubernetes.io/empty-dir/ec8a4a09-1ed7-4735-9a6a-ec094fa7a250-build\") pod \"ec8a4a09-1ed7-4735-9a6a-ec094fa7a250\" (UID: \"ec8a4a09-1ed7-4735-9a6a-ec094fa7a250\") " machine # [ 616.095492] k3s[882]: I0927 14:22:58.908776 882 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ec8a4a09-1ed7-4735-9a6a-ec094fa7a250-oidc\" (UniqueName: \"kubernetes.io/secret/ec8a4a09-1ed7-4735-9a6a-ec094fa7a250-oidc\") pod \"ec8a4a09-1ed7-4735-9a6a-ec094fa7a250\" (UID: \"ec8a4a09-1ed7-4735-9a6a-ec094fa7a250\") " machine # [ 616.095975] k3s[882]: I0927 14:22:58.908809 882 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ec8a4a09-1ed7-4735-9a6a-ec094fa7a250-kube-api-access-q7wsn\" (UniqueName: \"kubernetes.io/projected/ec8a4a09-1ed7-4735-9a6a-ec094fa7a250-kube-api-access-q7wsn\") pod \"ec8a4a09-1ed7-4735-9a6a-ec094fa7a250\" (UID: \"ec8a4a09-1ed7-4735-9a6a-ec094fa7a250\") " machine # [ 616.096921] k3s[882]: I0927 14:22:58.908846 882 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ec8a4a09-1ed7-4735-9a6a-ec094fa7a250-nixconf\" (UniqueName: \"kubernetes.io/configmap/ec8a4a09-1ed7-4735-9a6a-ec094fa7a250-nixconf\") pod \"ec8a4a09-1ed7-4735-9a6a-ec094fa7a250\" (UID: \"ec8a4a09-1ed7-4735-9a6a-ec094fa7a250\") " machine # [ 616.097779] k3s[882]: I0927 14:22:58.908892 882 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ec8a4a09-1ed7-4735-9a6a-ec094fa7a250-nix\" (UniqueName: \"kubernetes.io/empty-dir/ec8a4a09-1ed7-4735-9a6a-ec094fa7a250-nix\") pod \"ec8a4a09-1ed7-4735-9a6a-ec094fa7a250\" (UID: \"ec8a4a09-1ed7-4735-9a6a-ec094fa7a250\") " machine # [ 616.098648] k3s[882]: I0927 14:22:58.908923 882 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ec8a4a09-1ed7-4735-9a6a-ec094fa7a250-niks3-token\" (UniqueName: \"kubernetes.io/projected/ec8a4a09-1ed7-4735-9a6a-ec094fa7a250-niks3-token\") pod \"ec8a4a09-1ed7-4735-9a6a-ec094fa7a250\" (UID: \"ec8a4a09-1ed7-4735-9a6a-ec094fa7a250\") " machine # [ 616.099489] k3s[882]: I0927 14:22:58.908984 882 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ec8a4a09-1ed7-4735-9a6a-ec094fa7a250-ca\" (UniqueName: \"kubernetes.io/secret/ec8a4a09-1ed7-4735-9a6a-ec094fa7a250-ca\") pod \"ec8a4a09-1ed7-4735-9a6a-ec094fa7a250\" (UID: \"ec8a4a09-1ed7-4735-9a6a-ec094fa7a250\") " machine # [ 616.108121] k3s[882]: I0927 14:22:58.922965 882 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec8a4a09-1ed7-4735-9a6a-ec094fa7a250-build" pod "ec8a4a09-1ed7-4735-9a6a-ec094fa7a250" (UID: "ec8a4a09-1ed7-4735-9a6a-ec094fa7a250"). InnerVolumeSpecName "build". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 616.108929] k3s[882]: I0927 14:22:58.923362 882 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec8a4a09-1ed7-4735-9a6a-ec094fa7a250-nixconf" pod "ec8a4a09-1ed7-4735-9a6a-ec094fa7a250" (UID: "ec8a4a09-1ed7-4735-9a6a-ec094fa7a250"). InnerVolumeSpecName "nixconf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 616.137053] k3s[882]: I0927 14:22:58.951840 882 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec8a4a09-1ed7-4735-9a6a-ec094fa7a250-kube-api-access-q7wsn" pod "ec8a4a09-1ed7-4735-9a6a-ec094fa7a250" (UID: "ec8a4a09-1ed7-4735-9a6a-ec094fa7a250"). InnerVolumeSpecName "kube-api-access-q7wsn". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 616.138033] k3s[882]: I0927 14:22:58.951864 882 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec8a4a09-1ed7-4735-9a6a-ec094fa7a250-tls" pod "ec8a4a09-1ed7-4735-9a6a-ec094fa7a250" (UID: "ec8a4a09-1ed7-4735-9a6a-ec094fa7a250"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 616.138957] k3s[882]: I0927 14:22:58.952383 882 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec8a4a09-1ed7-4735-9a6a-ec094fa7a250-ca" pod "ec8a4a09-1ed7-4735-9a6a-ec094fa7a250" (UID: "ec8a4a09-1ed7-4735-9a6a-ec094fa7a250"). InnerVolumeSpecName "ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 616.139635] k3s[882]: I0927 14:22:58.952798 882 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec8a4a09-1ed7-4735-9a6a-ec094fa7a250-oidc" pod "ec8a4a09-1ed7-4735-9a6a-ec094fa7a250" (UID: "ec8a4a09-1ed7-4735-9a6a-ec094fa7a250"). InnerVolumeSpecName "oidc". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 616.153112] k3s[882]: I0927 14:22:58.967839 882 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec8a4a09-1ed7-4735-9a6a-ec094fa7a250-niks3-token" pod "ec8a4a09-1ed7-4735-9a6a-ec094fa7a250" (UID: "ec8a4a09-1ed7-4735-9a6a-ec094fa7a250"). InnerVolumeSpecName "niks3-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 616.195112] k3s[882]: I0927 14:22:59.009900 882 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/ec8a4a09-1ed7-4735-9a6a-ec094fa7a250-tls\") on node \"machine\" DevicePath \"\"" machine # [ 616.195884] k3s[882]: I0927 14:22:59.009941 882 reconciler_common.go:299] "Volume detached for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/ec8a4a09-1ed7-4735-9a6a-ec094fa7a250-build\") on node \"machine\" DevicePath \"\"" machine # [ 616.196486] k3s[882]: I0927 14:22:59.009987 882 reconciler_common.go:299] "Volume detached for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/ec8a4a09-1ed7-4735-9a6a-ec094fa7a250-oidc\") on node \"machine\" DevicePath \"\"" machine # [ 616.196990] k3s[882]: I0927 14:22:59.010004 882 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7wsn\" (UniqueName: \"kubernetes.io/projected/ec8a4a09-1ed7-4735-9a6a-ec094fa7a250-kube-api-access-q7wsn\") on node \"machine\" DevicePath \"\"" machine # [ 616.197710] k3s[882]: I0927 14:22:59.010017 882 reconciler_common.go:299] "Volume detached for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/ec8a4a09-1ed7-4735-9a6a-ec094fa7a250-nixconf\") on node \"machine\" DevicePath \"\"" machine # [ 616.198299] k3s[882]: I0927 14:22:59.010033 882 reconciler_common.go:299] "Volume detached for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/ec8a4a09-1ed7-4735-9a6a-ec094fa7a250-niks3-token\") on node \"machine\" DevicePath \"\"" machine # [ 616.198865] k3s[882]: I0927 14:22:59.010047 882 reconciler_common.go:299] "Volume detached for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ec8a4a09-1ed7-4735-9a6a-ec094fa7a250-ca\") on node \"machine\" DevicePath \"\"" machine # [ 616.309710] k3s[882]: I0927 14:22:59.124271 882 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec8a4a09-1ed7-4735-9a6a-ec094fa7a250-nix" pod "ec8a4a09-1ed7-4735-9a6a-ec094fa7a250" (UID: "ec8a4a09-1ed7-4735-9a6a-ec094fa7a250"). InnerVolumeSpecName "nix". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 616.396807] k3s[882]: I0927 14:22:59.211547 882 reconciler_common.go:299] "Volume detached for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/ec8a4a09-1ed7-4735-9a6a-ec094fa7a250-nix\") on node \"machine\" DevicePath \"\"" machine # [ 616.427940] systemd[1]: var-lib-kubelet-pods-ec8a4a09\x2d1ed7\x2d4735\x2d9a6a\x2dec094fa7a250-volume\x2dsubpaths-nix-gc-0.mount: Deactivated successfully. machine # [ 616.429663] systemd[1]: var-lib-kubelet-pods-ec8a4a09\x2d1ed7\x2d4735\x2d9a6a\x2dec094fa7a250-volume\x2dsubpaths-nix-nix\x2dgrpc\x2ddaemon-0.mount: Deactivated successfully. machine # [ 616.431152] systemd[1]: var-lib-kubelet-pods-ec8a4a09\x2d1ed7\x2d4735\x2d9a6a\x2dec094fa7a250-volume\x2dsubpaths-nix-nix\x2ddaemon-0.mount: Deactivated successfully. machine # [ 616.432315] systemd[1]: var-lib-kubelet-pods-ec8a4a09\x2d1ed7\x2d4735\x2d9a6a\x2dec094fa7a250-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dq7wsn.mount: Deactivated successfully. machine # [ 616.433594] systemd[1]: var-lib-kubelet-pods-ec8a4a09\x2d1ed7\x2d4735\x2d9a6a\x2dec094fa7a250-volumes-kubernetes.io\x7eprojected-niks3\x2dtoken.mount: Deactivated successfully. machine # [ 616.435129] systemd[1]: var-lib-kubelet-pods-ec8a4a09\x2d1ed7\x2d4735\x2d9a6a\x2dec094fa7a250-volumes-kubernetes.io\x7esecret-tls.mount: Deactivated successfully. machine # [ 616.435504] systemd[1]: var-lib-kubelet-pods-ec8a4a09\x2d1ed7\x2d4735\x2d9a6a\x2dec094fa7a250-volumes-kubernetes.io\x7esecret-ca.mount: Deactivated successfully. machine # [ 616.437099] systemd[1]: var-lib-kubelet-pods-ec8a4a09\x2d1ed7\x2d4735\x2d9a6a\x2dec094fa7a250-volumes-kubernetes.io\x7esecret-oidc.mount: Deactivated successfully. machine: (finished: waiting for success: ! systemctl is-active slow, in 15.63 seconds) machine: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; }, in 0.04 seconds) machine: must fail: journalctl -u slow | grep -q 'asking the scheduler again' machine: (finished: must fail: journalctl -u slow | grep -q 'asking the scheduler again', in 0.03 seconds) machine: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath machine # [ 616.822856] k3s[882]: I0927 14:22:59.637660 882 scope.go:122] "RemoveContainer" containerID="55aa9317b0550d376fe7a7ef0ba878314ebec5c874c63fef72a6ac9f4ff4072b" machine # [ 616.839076] systemd[1]: Removed slice libcontainer container kubepods-besteffort-podec8a4a09_1ed7_4735_9a6a_ec094fa7a250.slice. machine # [ 616.840461] systemd[1]: kubepods-besteffort-podec8a4a09_1ed7_4735_9a6a_ec094fa7a250.slice: Consumed 26.916s CPU time over 9min 38.572s wall clock time, 415.6M memory peak, 115.1M read from disk, 286.2M written to disk, 320.3K incoming IP traffic, 370.2K outgoing IP traffic. machine # [ 616.849686] k3s[882]: I0927 14:22:59.664482 882 scope.go:122] "RemoveContainer" containerID="890393719c9eb9357670f79be9d9875bc0c76c6c9ebcfb209bafffc18d318679" machine # [ 616.864859] k3s[882]: I0927 14:22:59.679540 882 scope.go:122] "RemoveContainer" containerID="62499d0ab1d4143a0cc9901ec2899a9d2df302fe7816b6e60f657623f784be93" machine # [ 616.878202] k3s[882]: I0927 14:22:59.693054 882 scope.go:122] "RemoveContainer" containerID="903e255e5cdef33d39c98a5cc92155dd9b28d80938be152fcb9a96393adf69a0" machine # [ 616.889250] k3s[882]: I0927 14:22:59.704101 882 scope.go:122] "RemoveContainer" containerID="55aa9317b0550d376fe7a7ef0ba878314ebec5c874c63fef72a6ac9f4ff4072b" machine # [ 616.891972] k3s[882]: E0927 14:22:59.706829 882 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"55aa9317b0550d376fe7a7ef0ba878314ebec5c874c63fef72a6ac9f4ff4072b\": not found" containerID="55aa9317b0550d376fe7a7ef0ba878314ebec5c874c63fef72a6ac9f4ff4072b" machine # [ 616.892715] k3s[882]: I0927 14:22:59.706883 882 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"55aa9317b0550d376fe7a7ef0ba878314ebec5c874c63fef72a6ac9f4ff4072b"} err="failed to get container status \"55aa9317b0550d376fe7a7ef0ba878314ebec5c874c63fef72a6ac9f4ff4072b\": rpc error: code = NotFound desc = an error occurred when try to find container \"55aa9317b0550d376fe7a7ef0ba878314ebec5c874c63fef72a6ac9f4ff4072b\": not found" machine # [ 616.893209] k3s[882]: I0927 14:22:59.706928 882 scope.go:122] "RemoveContainer" containerID="890393719c9eb9357670f79be9d9875bc0c76c6c9ebcfb209bafffc18d318679" machine # [ 616.903512] k3s[882]: E0927 14:22:59.718368 882 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"890393719c9eb9357670f79be9d9875bc0c76c6c9ebcfb209bafffc18d318679\": not found" containerID="890393719c9eb9357670f79be9d9875bc0c76c6c9ebcfb209bafffc18d318679" machine # [ 616.904190] k3s[882]: I0927 14:22:59.718428 882 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"890393719c9eb9357670f79be9d9875bc0c76c6c9ebcfb209bafffc18d318679"} err="failed to get container status \"890393719c9eb9357670f79be9d9875bc0c76c6c9ebcfb209bafffc18d318679\": rpc error: code = NotFound desc = an error occurred when try to find container \"890393719c9eb9357670f79be9d9875bc0c76c6c9ebcfb209bafffc18d318679\": not found" machine # [ 616.904908] k3s[882]: I0927 14:22:59.718472 882 scope.go:122] "RemoveContainer" containerID="62499d0ab1d4143a0cc9901ec2899a9d2df302fe7816b6e60f657623f784be93" machine # [ 616.905626] k3s[882]: E0927 14:22:59.719165 882 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"62499d0ab1d4143a0cc9901ec2899a9d2df302fe7816b6e60f657623f784be93\": not found" containerID="62499d0ab1d4143a0cc9901ec2899a9d2df302fe7816b6e60f657623f784be93" machine # [ 616.907408] k3s[882]: I0927 14:22:59.719193 882 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"62499d0ab1d4143a0cc9901ec2899a9d2df302fe7816b6e60f657623f784be93"} err="failed to get container status \"62499d0ab1d4143a0cc9901ec2899a9d2df302fe7816b6e60f657623f784be93\": rpc error: code = NotFound desc = an error occurred when try to find container \"62499d0ab1d4143a0cc9901ec2899a9d2df302fe7816b6e60f657623f784be93\": not found" machine # [ 616.908407] k3s[882]: I0927 14:22:59.719216 882 scope.go:122] "RemoveContainer" containerID="903e255e5cdef33d39c98a5cc92155dd9b28d80938be152fcb9a96393adf69a0" machine # [ 616.909304] k3s[882]: E0927 14:22:59.721981 882 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"903e255e5cdef33d39c98a5cc92155dd9b28d80938be152fcb9a96393adf69a0\": not found" containerID="903e255e5cdef33d39c98a5cc92155dd9b28d80938be152fcb9a96393adf69a0" machine # [ 616.910153] k3s[882]: I0927 14:22:59.722028 882 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"903e255e5cdef33d39c98a5cc92155dd9b28d80938be152fcb9a96393adf69a0"} err="failed to get container status \"903e255e5cdef33d39c98a5cc92155dd9b28d80938be152fcb9a96393adf69a0\": rpc error: code = NotFound desc = an error occurred when try to find container \"903e255e5cdef33d39c98a5cc92155dd9b28d80938be152fcb9a96393adf69a0\": not found" machine: (finished: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath, in 0.21 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null, in 0.03 seconds) (finished: subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes, in 47.81 seconds) (finished: run the VM test script, in 617.95 seconds) test script finished in 617.99s cleanup kill QemuMachine (pid 45) machine # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) machine # [2026-09-27T14:23:00Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-09-27T14:23:00Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-09-27T14:23:00Z INFO virtiofsd] Client disconnected, shutting down (finished: cleanup, in 1.00 seconds) additionally exposed symbols: machine, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh