tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 1200.0 seconds run the VM test script machine: waiting for unit k3s.service machine: waiting for the VM to finish booting machine: starting vm machine: QEMU running (pid 45) machine # Disk image does not exist, creating the virtualisation disk image... machine # Formatting '/build/vm-state-machine/tmp.EC8lDoYLXH', fmt=raw size=17179869184 machine # mke2fs 1.47.4 (6-Mar-2025) machine # Discarding device blocks: 0/4194304 done machine # Creating filesystem with 4194304 4k blocks and 1048576 inodes machine # Filesystem UUID: 3e461403-197f-4a21-b2f5-8a16c291d0e6 machine # Superblock backups stored on blocks: machine # 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208, machine # 4096000 machine # machine # Allocating group tables: 0/128 done machine # Writing inode tables: 0/128 done machine # Creating journal (32768 blocks): done machine # Writing superblocks and filesystem accounting information: 0/128 done machine # machine # Virtualisation disk image created. machine # Starting virtiofs daemons... machine # [2026-09-22T14:50:49Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-22T14:50:49Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-22T14:50:49Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-22T14:50:49Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-22T14:50:49Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-22T14:50:49Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-22T14:50:49Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-22T14:50:49Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-22T14:50:49Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-22T14:50:49Z INFO virtiofsd] Client connected, servicing requests machine # [2026-09-22T14:50:49Z INFO virtiofsd] Client connected, servicing requests machine # [2026-09-22T14:50:49Z INFO virtiofsd] Client connected, servicing requests machine # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) machine # machine # machine # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+7EFCC730+7EF2C730 CA00 machine # Press Ctrl-B to configure iPXE (PCI 00:02.0)... machine # machine # machine # machine # machine # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 7EFCC730 7EF2C730 CB00 machine # Press Ctrl-B to configure iPXE (PCI 00:05.0)... machine # machine # machine # Booting from ROM... machine # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 machine # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ig5rdvigiwkwqm7xa9zhdvw16icd9fc1-nixos-system-machine-test/init regInfo=/nix/store/sb1j2fc5habxmjg8kxa1ky1wjk6qxp0i-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.000000] BIOS-provided physical RAM map: machine # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007ffd7fff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000007ffd8000-0x000000007fffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000017fffffff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved machine # [ 0.000000] NX (Execute Disable) protection: active machine # [ 0.000000] APIC: Static calls initialized machine # [ 0.000000] SMBIOS 2.8 present. machine # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 machine # [ 0.000000] DMI: Memory slots populated: 1/1 machine # [ 0.000000] Hypervisor detected: KVM machine # [ 0.000000] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 machine # [ 0.000001] kvm-clock: using sched offset of 481601205 cycles machine # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns machine # [ 0.000004] tsc: Detected 2400.012 MHz processor machine # [ 0.000811] last_pfn = 0x180000 max_arch_pfn = 0x10000000000 machine # [ 0.000838] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs machine # [ 0.000841] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT machine # [ 0.000880] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.002750] found SMP MP-table at [mem 0x000f5450-0x000f545f] machine # [ 0.002761] Using GB pages for direct mapping machine # [ 0.002835] RAMDISK: [mem 0x7e371000-0x7ffcffff] machine # [ 0.002843] ACPI: Early table checksum verification disabled machine # [ 0.002847] ACPI: RSDP 0x00000000000F5250 000014 (v00 BOCHS ) machine # [ 0.002851] ACPI: RSDT 0x000000007FFE2539 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002855] ACPI: FACP 0x000000007FFE2319 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002862] ACPI: DSDT 0x000000007FFE0040 0022D9 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002864] ACPI: FACS 0x000000007FFE0000 000040 machine # [ 0.002866] ACPI: APIC 0x000000007FFE240D 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002867] ACPI: HPET 0x000000007FFE249D 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002869] ACPI: MCFG 0x000000007FFE24D5 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002870] ACPI: WAET 0x000000007FFE2511 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002872] ACPI: Reserving FACP table memory at [mem 0x7ffe2319-0x7ffe240c] machine # [ 0.002873] ACPI: Reserving DSDT table memory at [mem 0x7ffe0040-0x7ffe2318] machine # [ 0.002873] ACPI: Reserving FACS table memory at [mem 0x7ffe0000-0x7ffe003f] machine # [ 0.002874] ACPI: Reserving APIC table memory at [mem 0x7ffe240d-0x7ffe249c] machine # [ 0.002874] ACPI: Reserving HPET table memory at [mem 0x7ffe249d-0x7ffe24d4] machine # [ 0.002875] ACPI: Reserving MCFG table memory at [mem 0x7ffe24d5-0x7ffe2510] machine # [ 0.002875] ACPI: Reserving WAET table memory at [mem 0x7ffe2511-0x7ffe2538] machine # [ 0.003107] No NUMA configuration found machine # [ 0.003108] Faking a node at [mem 0x0000000000000000-0x000000017fffffff] machine # [ 0.003111] NODE_DATA(0) allocated [mem 0x17fff8780-0x17fffdcff] machine # [ 0.005395] Zone ranges: machine # [ 0.005396] DMA [mem 0x0000000000001000-0x0000000000ffffff] machine # [ 0.005398] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] machine # [ 0.005399] Normal [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005400] Device empty machine # [ 0.005401] Movable zone start for each node machine # [ 0.005402] Early memory node ranges machine # [ 0.005402] node 0: [mem 0x0000000000001000-0x000000000009efff] machine # [ 0.005403] node 0: [mem 0x0000000000100000-0x000000007ffd7fff] machine # [ 0.005404] node 0: [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005405] Initmem setup node 0 [mem 0x0000000000001000-0x000000017fffffff] machine # [ 0.005427] On node 0, zone DMA: 1 pages in unavailable ranges machine # [ 0.005691] On node 0, zone DMA: 97 pages in unavailable ranges machine # [ 0.075776] On node 0, zone Normal: 40 pages in unavailable ranges machine # [ 0.076266] ACPI: PM-Timer IO Port: 0x608 machine # [ 0.076281] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) machine # [ 0.076323] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 machine # [ 0.076326] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) machine # [ 0.076328] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) machine # [ 0.076329] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) machine # [ 0.076330] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) machine # [ 0.076331] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) machine # [ 0.076334] ACPI: Using ACPI (MADT) for SMP configuration information machine # [ 0.076335] ACPI: HPET id: 0x8086a201 base: 0xfed00000 machine # [ 0.076340] TSC deadline timer available machine # [ 0.076344] CPU topo: Max. logical packages: 1 machine # [ 0.076345] CPU topo: Max. logical dies: 1 machine # [ 0.076345] CPU topo: Max. dies per package: 1 machine # [ 0.076349] CPU topo: Max. threads per core: 1 machine # [ 0.076349] CPU topo: Num. cores per package: 4 machine # [ 0.076350] CPU topo: Num. threads per package: 4 machine # [ 0.076350] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs machine # [ 0.076374] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() machine # [ 0.076391] kvm-guest: KVM setup pv remote TLB flush machine # [ 0.076394] kvm-guest: setup PV sched yield machine # [ 0.076404] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] machine # [ 0.076405] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] machine # [ 0.076406] PM: hibernation: Registered nosave memory: [mem 0x7ffd8000-0xffffffff] machine # [ 0.076408] [mem 0xc0000000-0xfed1bfff] available for PCI devices machine # [ 0.076410] Booting paravirtualized kernel on KVM machine # [ 0.076414] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns machine # [ 0.080909] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 machine # [ 0.083050] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288 machine # [ 0.083102] kvm-guest: PV spinlocks enabled machine # [ 0.083104] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) machine # [ 0.083106] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ig5rdvigiwkwqm7xa9zhdvw16icd9fc1-nixos-system-machine-test/init regInfo=/nix/store/sb1j2fc5habxmjg8kxa1ky1wjk6qxp0i-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.083205] Unknown kernel command line parameters "regInfo=/nix/store/sb1j2fc5habxmjg8kxa1ky1wjk6qxp0i-closure-info/registration", will be passed to user space. machine # [ 0.083218] random: crng init done machine # [ 0.083218] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes machine # [ 0.087853] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) machine # [ 0.089939] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) machine # [ 0.090009] software IO TLB: area num 4. machine # [ 0.162760] Fallback order for Node 0: 0 machine # [ 0.162768] Built 1 zonelists, mobility grouping on. Total pages: 1048438 machine # [ 0.162770] Policy zone: Normal machine # [ 0.165502] mem auto-init: stack:all(zero), heap alloc:on, heap free:off machine # [ 0.172447] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 machine # [ 0.181375] allocated 8388608 bytes of page_ext machine # [ 0.191502] ftrace: allocating 48787 entries in 192 pages machine # [ 0.191504] ftrace: allocated 192 pages with 2 groups machine # [ 0.192360] Dynamic Preempt: lazy machine # [ 0.192544] rcu: Preemptible hierarchical RCU implementation. machine # [ 0.192545] rcu: RCU event tracing is enabled. machine # [ 0.192546] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. machine # [ 0.192547] Trampoline variant of Tasks RCU enabled. machine # [ 0.192548] Rude variant of Tasks RCU enabled. machine # [ 0.192548] Tracing variant of Tasks RCU enabled. machine # [ 0.192549] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. machine # [ 0.192550] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 machine # [ 0.192574] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.192576] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.192577] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.196948] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16 machine # [ 0.197220] rcu: srcu_init: Setting srcu_struct sizes based on contention. machine # [ 0.197229] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns machine # [ 0.197349] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) machine # [ 0.200899] Console: colour VGA+ 80x25 machine # [ 0.200901] printk: legacy console [tty0] enabled machine # [ 0.232785] printk: legacy console [ttyS0] enabled machine # [ 0.345174] ACPI: Core revision 20250807 machine # [ 0.346154] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns machine # [ 0.347793] APIC: Switch to symmetric I/O mode setup machine # [ 0.348812] x2apic enabled machine # [ 0.349587] APIC: Switched APIC routing to: physical x2apic machine # [ 0.350583] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask() machine # [ 0.351909] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself() machine # [ 0.353449] kvm-guest: setup PV IPIs machine # [ 0.355072] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 machine # [ 0.356214] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.360655] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) machine # [ 0.362731] x86/cpu: User Mode Instruction Prevention (UMIP) activated machine # [ 0.363796] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 machine # [ 0.364651] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 machine # [ 0.366500] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto machine # [ 0.367651] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl machine # [ 0.369651] Transient Scheduler Attacks: Vulnerable: No microcode machine # [ 0.370650] Spectre V2 : Mitigation: Enhanced / Automatic IBRS machine # [ 0.371651] Speculative Return Stack Overflow: Mitigation: Safe RET machine # [ 0.372651] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization machine # [ 0.373659] Spectre V2 : Enabling IBPB for BPF machine # [ 0.375238] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier machine # [ 0.376650] active return thunk: srso_alias_return_thunk machine # [ 0.377673] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' machine # [ 0.378651] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' machine # [ 0.379651] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' machine # [ 0.380651] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' machine # [ 0.382498] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' machine # [ 0.383486] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' machine # [ 0.384651] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' machine # [ 0.385651] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 machine # [ 0.386651] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 machine # [ 0.387651] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 machine # [ 0.388651] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 machine # [ 0.390466] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 machine # [ 0.391462] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. machine # [ 0.421414] Freeing SMP alternatives memory: 44K machine # [ 0.422301] pid_max: default: 32768 minimum: 301 machine # [ 0.422742] LSM: initializing lsm=capability,landlock,yama,bpf,ima machine # [ 0.423748] landlock: Up and running. machine # [ 0.425140] Yama: becoming mindful. machine # [ 0.425863] LSM support for eBPF active machine # [ 0.426845] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.427728] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.430979] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) machine # [ 0.432246] Performance Events: Fam17h+ core perfctr, AMD PMU driver. machine # [ 0.432661] ... version: 2 machine # [ 0.433444] ... bit width: 48 machine # [ 0.433654] ... generic counters: 6 machine # [ 0.434441] ... generic bitmap: 000000000000003f machine # [ 0.434653] ... fixed-purpose counters: 0 machine # [ 0.435430] ... fixed-purpose bitmap: 0000000000000000 machine # [ 0.436370] ... value mask: 0000ffffffffffff machine # [ 0.436653] ... max period: 00007fffffffffff machine # [ 0.437631] ... global_ctrl mask: 000000000000003f machine # [ 0.438544] signal: max sigframe size: 3376 machine # [ 0.439278] rcu: Hierarchical SRCU implementation. machine # [ 0.439657] rcu: Max phase no-delay instances is 400. machine # [ 0.440755] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level machine # [ 0.446199] smp: Bringing up secondary CPUs ... machine # [ 0.447041] smpboot: x86: Booting SMP configuration: machine # [ 0.447662] .... node #0, CPUs: #1 #2 #3 machine # [ 0.450797] smp: Brought up 1 node, 4 CPUs machine # [ 0.452427] smpboot: Total of 4 processors activated (19200.09 BogoMIPS) machine # [ 0.453913] Memory: 3957936K/4193752K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 220856K reserved, 0K cma-reserved) machine # [ 0.455654] devtmpfs: initialized machine # [ 0.456919] x86/mm: Memory block size: 128MB machine # [ 0.459740] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.460729] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). machine # [ 0.461770] pinctrl core: initialized pinctrl subsystem machine # [ 0.462976] PM: RTC time: 14:50:50, date: 2026-09-22 machine # [ 0.466609] NET: Registered PF_NETLINK/PF_ROUTE protocol family machine # [ 0.468313] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations machine # [ 0.468690] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations machine # [ 0.470238] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations machine # [ 0.470665] audit: initializing netlink subsys (disabled) machine # [ 0.471715] audit: type=2000 audit(1790088650.820:1): state=initialized audit_enabled=0 res=1 machine # [ 0.472008] thermal_sys: Registered thermal governor 'fair_share' machine # [ 0.473654] thermal_sys: Registered thermal governor 'bang_bang' machine # [ 0.474654] thermal_sys: Registered thermal governor 'step_wise' machine # [ 0.475654] thermal_sys: Registered thermal governor 'user_space' machine # [ 0.476653] thermal_sys: Registered thermal governor 'power_allocator' machine # [ 0.477669] cpuidle: using governor menu machine # [ 0.479861] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 machine # [ 0.480919] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] machine # [ 0.481657] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry machine # [ 0.482668] PCI: Using configuration type 1 for base access machine # [ 0.483788] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. machine # [ 0.486721] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages machine # [ 0.487654] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page machine # [ 0.488654] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages machine # [ 0.489653] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page machine # [ 0.495358] ACPI: Added _OSI(Module Device) machine # [ 0.496660] ACPI: Added _OSI(Processor Device) machine # [ 0.498662] ACPI: Added _OSI(Processor Aggregator Device) machine # [ 0.507428] ACPI: 1 ACPI AML tables successfully acquired and loaded machine # [ 0.515297] ACPI: Interpreter enabled machine # [ 0.516713] ACPI: PM: (supports S0 S3 S4 S5) machine # [ 0.518664] ACPI: Using IOAPIC for interrupt routing machine # [ 0.520845] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug machine # [ 0.524663] PCI: Using E820 reservations for host bridge windows machine # [ 0.528048] ACPI: Enabled 2 GPEs in block 00 to 3F machine # [ 0.540364] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) machine # [ 0.542667] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] machine # [ 0.545855] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] machine # [ 0.547915] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] machine # [ 0.551484] PCI host bridge to bus 0000:00 machine # [ 0.552666] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] machine # [ 0.554658] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] machine # [ 0.556657] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] machine # [ 0.559658] pci_bus 0000:00: root bus resource [mem 0x80000000-0xafffffff window] machine # [ 0.560654] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] machine # [ 0.562654] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.563655] pci_bus 0000:00: root bus resource [bus 00-ff] machine # [ 0.564719] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint machine # [ 0.566146] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint machine # [ 0.582802] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] machine # [ 0.583670] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] machine # [ 0.584676] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] machine # [ 0.587499] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] machine # [ 0.593915] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.603698] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] machine # [ 0.605674] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] machine # [ 0.608714] pci 0000:00:02.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref] machine # [ 0.611675] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] machine # [ 0.616068] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.622701] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] machine # [ 0.624670] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] machine # [ 0.626701] pci 0000:00:03.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref] machine # [ 0.629783] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint machine # [ 0.637719] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] machine # [ 0.638660] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] machine # [ 0.640735] pci 0000:00:04.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref] machine # [ 0.642413] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.645694] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] machine # [ 0.646637] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] machine # [ 0.647480] pci 0000:00:05.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref] machine # [ 0.648659] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] machine # [ 0.651440] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint machine # [ 0.658722] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] machine # [ 0.661715] pci 0000:00:06.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref] machine # [ 0.666091] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.673723] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] machine # [ 0.676713] pci 0000:00:07.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref] machine # [ 0.681217] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.687707] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] machine # [ 0.714706] pci 0000:00:08.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref] machine # [ 0.718685] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.721703] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] machine # [ 0.722676] pci 0000:00:09.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref] machine # [ 0.725220] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint machine # [ 0.729700] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] machine # [ 0.731663] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] machine # [ 0.732675] pci 0000:00:0a.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref] machine # [ 0.734219] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.737693] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] machine # [ 0.738624] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] machine # [ 0.740486] pci 0000:00:0b.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref] machine # [ 0.743234] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.745557] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] machine # [ 0.746671] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.748410] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] machine # [ 0.749856] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.753108] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] machine # [ 0.753923] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint machine # [ 0.756517] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] machine # [ 0.757711] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint machine # [ 0.758952] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO machine # [ 0.761154] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint machine # [ 0.764326] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] machine # [ 0.764660] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] machine # [ 0.765989] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint machine # [ 0.768464] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] machine # [ 0.772528] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 machine # [ 0.774598] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 machine # [ 0.775584] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 machine # [ 0.776571] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 machine # [ 0.777576] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 machine # [ 0.778572] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 machine # [ 0.780552] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 machine # [ 0.781571] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 machine # [ 0.783214] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 machine # [ 0.785700] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 machine # [ 0.788693] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 machine # [ 0.790704] ACPI: PCI: Interrupt link GSID configured for IRQ 19 machine # [ 0.792691] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 machine # [ 0.795690] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 machine # [ 0.797696] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 machine # [ 0.800690] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 machine # [ 0.807017] iommu: Default domain type: Translated machine # [ 0.808658] iommu: DMA domain TLB invalidation policy: lazy mode machine # [ 0.812796] ACPI: bus type USB registered machine # [ 0.814819] usbcore: registered new interface driver usbfs machine # [ 0.816688] usbcore: registered new interface driver hub machine # [ 0.818680] usbcore: registered new device driver usb machine # [ 0.824357] NetLabel: Initializing machine # [ 0.825658] NetLabel: domain hash size = 128 machine # [ 0.827658] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO machine # [ 0.830032] NetLabel: unlabeled traffic allowed by default machine # [ 0.832688] PCI: Using ACPI for IRQ routing machine # [ 0.882889] pci 0000:00:01.0: vgaarb: setting as boot VGA device machine # [ 0.883650] pci 0000:00:01.0: vgaarb: bridge control possible machine # [ 0.883650] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none machine # [ 0.886660] vgaarb: loaded machine # [ 0.887530] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 machine # [ 0.888347] hpet0: 3 comparators, 64-bit 100.000000 MHz counter machine # [ 0.892911] clocksource: Switched to clocksource kvm-clock machine # [ 0.896727] VFS: Disk quotas dquot_6.6.0 machine # [ 0.897483] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) machine # [ 0.899187] pnp: PnP ACPI init machine # [ 0.900125] ACPI: IRQ 4 override to edge(!), high(!) machine # [ 0.901158] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved machine # [ 0.902823] pnp: PnP ACPI: found 5 devices machine # [ 0.913042] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns machine # [ 0.914667] clocksource: Switched to clocksource acpi_pm machine # [ 0.915696] NET: Registered PF_INET protocol family machine # [ 0.917256] IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear) machine # [ 0.934512] tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.936095] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) machine # [ 0.937495] TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear) machine # [ 0.940020] TCP bind hash table entries: 32768 (order: 8, 1048576 bytes, linear) machine # [ 0.941388] TCP: Hash tables configured (established 32768 bind 32768) machine # [ 0.942669] MPTCP token hash table entries: 4096 (order: 5, 98304 bytes, linear) machine # [ 0.944046] UDP hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.945246] UDP-Lite hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.946706] NET: Registered PF_UNIX/PF_LOCAL protocol family machine # [ 0.947746] NET: Registered PF_XDP protocol family machine # [ 0.948631] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] machine # [ 0.949687] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] machine # [ 0.950730] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] machine # [ 0.951943] pci_bus 0000:00: resource 7 [mem 0x80000000-0xafffffff window] machine # [ 0.953125] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] machine # [ 0.954358] pci_bus 0000:00: resource 9 [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.956399] ACPI: \_SB_.GSIA: Enabled at IRQ 16 machine # [ 0.958650] ACPI: \_SB_.GSIB: Enabled at IRQ 17 machine # [ 0.960805] ACPI: \_SB_.GSIC: Enabled at IRQ 18 machine # [ 0.962900] ACPI: \_SB_.GSID: Enabled at IRQ 19 machine # [ 0.965114] PCI: CLS 0 bytes, default 64 machine # [ 0.966072] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) machine # [ 0.966399] Trying to unpack rootfs image as initramfs... machine # [ 0.967190] software IO TLB: mapped [mem 0x000000007a371000-0x000000007e371000] (64MB) machine # [ 0.967333] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.990574] Initialise system trusted keyrings machine # [ 0.991669] workingset: timestamp_bits=40 max_order=20 bucket_order=0 machine # [ 1.003355] Key type asymmetric registered machine # [ 1.006140] Asymmetric key parser 'x509' registered machine # [ 1.007189] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) machine # [ 1.008924] io scheduler mq-deadline registered machine # [ 1.009786] io scheduler kyber registered machine # [ 1.014899] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled machine # [ 1.016318] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A machine # [ 1.018735] Linux agpgart interface v0.103 machine # [ 1.019554] ACPI: bus type drm_connector registered machine # [ 1.021808] usbcore: registered new interface driver usbserial_generic machine # [ 1.022957] usbserial: USB Serial support registered for generic machine # [ 1.024017] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. machine # [ 1.024017] Please enable it if your BIOS has the CPPC option. machine # [ 1.026403] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled machine # [ 1.027909] drop_monitor: Initializing network drop monitor service machine # [ 1.029199] NET: Registered PF_INET6 protocol family machine # [ 1.031010] Segment Routing with IPv6 machine # [ 1.031724] In-situ OAM (IOAM) with IPv6 machine # [ 1.033791] IPI shorthand broadcast: enabled machine # [ 1.038211] sched_clock: Marking stable (883015801, 154421773)->(1060532877, -23095303) machine # [ 1.040091] registered taskstats version 1 machine # [ 1.041203] Loading compiled-in X.509 certificates machine # [ 1.051296] Demotion targets for Node 0: null machine # [ 1.052490] Key type .fscrypt registered machine # [ 1.053234] Key type fscrypt-provisioning registered machine # [ 1.054284] ima: No TPM chip found, activating TPM-bypass! machine # [ 1.055277] ima: Allocated hash algorithm: sha1 machine # [ 1.056154] ima: No architecture policies found machine # [ 1.057266] PM: Magic number: 10:943:839 machine # [ 1.059255] RAS: Correctable Errors collector initialized. machine # [ 1.063914] clk: Disabling unused clocks machine # [ 1.064662] PM: genpd: Disabling unused power domains machine # [ 1.250630] Freeing initrd memory: 29052K machine # [ 1.255646] Freeing unused decrypted memory: 2028K machine # [ 1.258460] Freeing unused kernel image (initmem) memory: 3652K machine # [ 1.259645] Write protecting the kernel read-only data: 32768k machine # [ 1.261764] Freeing unused kernel image (text/rodata gap) memory: 1184K machine # [ 1.263400] Freeing unused kernel image (rodata/data gap) memory: 720K machine # [ 1.314394] x86/mm: Checked W+X mappings: passed, no W+X pages found. machine # [ 1.315971] Run /init as init process machine # [ 1.330238] systemd[1]: Inserted module 'autofs4' machine # [ 1.356010] fuse: init (API version 7.45) machine # [ 1.365471] ACPI: \_SB_.GSIG: Enabled at IRQ 22 machine # [ 1.368085] ACPI: \_SB_.GSIH: Enabled at IRQ 23 machine # [ 1.371316] ACPI: \_SB_.GSIE: Enabled at IRQ 20 machine # [ 1.373576] ACPI: \_SB_.GSIF: Enabled at IRQ 21 machine # [ 1.378797] virtiofs virtio5: discovered new tag: nix-store machine # [ 1.380695] virtiofs virtio5: virtio_fs_setup_dax: No cache capability machine # [ 1.387860] virtiofs virtio6: discovered new tag: shared machine # [ 1.400918] virtiofs virtio6: virtio_fs_setup_dax: No cache capability machine # [ 1.404933] virtiofs virtio7: discovered new tag: xchg machine # [ 1.406581] virtiofs virtio7: virtio_fs_setup_dax: No cache capability machine # [ 1.431381] systemd[1]: Successfully made /usr/ read-only. machine # [ 1.767229] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 1.772502] systemd[1]: Detected virtualization kvm. machine # [ 1.773356] systemd[1]: Detected architecture x86-64. machine # [ 1.774247] systemd[1]: Running in initrd. machine # [ 1.775347] systemd[1]: Initializing machine ID from random generator. machine # [ 1.776577] systemd[1]: Hostname set to . machine # [ 1.878623] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 1.912607] systemd[1]: Queued start job for default target Initrd Default Target. machine # [ 1.927014] systemd[1]: Created slice Slice /system/modprobe. machine # [ 1.928247] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 1.929768] systemd[1]: Expecting device /dev/disk/by-label/nixos... machine # [ 1.930912] systemd[1]: Reached target Path Units. machine # [ 1.931844] systemd[1]: Reached target Slice Units. machine # [ 1.932750] systemd[1]: Reached target Swaps. machine # [ 1.933573] systemd[1]: Reached target Timer Units. machine # [ 1.934638] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 1.935981] systemd[1]: Listening on Journal Socket (/dev/log). machine # [ 1.937167] systemd[1]: Listening on Journal Sockets. machine # [ 1.938222] systemd[1]: Listening on udev Control Socket. machine # [ 1.939326] systemd[1]: Listening on udev Kernel Socket. machine # [ 1.940349] systemd[1]: Reached target Socket Units. machine # [ 1.942232] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 1.944253] systemd[1]: Starting Load Kernel Module configfs... machine # [ 1.947088] systemd[1]: Starting Journal Service... machine # [ 1.948973] systemd[1]: Starting Load Kernel Modules... machine # [ 1.951117] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 1.955880] systemd[1]: Starting Coldplug All udev Devices... machine # [ 1.958057] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 1.959785] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 1.961321] systemd[1]: Finished Load Kernel Module configfs. machine # [ 1.962741] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config machine # [ 1.965009] systemd-journald[93]: Collecting audit messages is disabled. machine # [ 1.966582] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 1.980351] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. machine # [ 1.983464] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev machine # [ 1.985605] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 1.988274] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 1.991969] systemd[1]: Finished Load Kernel Modules. machine # [ 1.995463] systemd[1]: Starting Apply Kernel Variables... machine # [ 2.000607] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 2.001907] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 2.003154] systemd[1]: Reached target Local File Systems. machine # [ 1.850561] systemd-modules-load[94]: Using 4[ 2.005174] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # probe threads machine # [ 2.006960] systemd[1]: Started Journal Service. machine # [ 1.852729] systemd-modules-load[94]: Inserted module 'virtio_balloon' machine # [ 1.854293] systemd-modules-load[94]: Inserted module 'dm_mod' machine # [ 1.855264] systemd-modules-load[94]: Inserted module 'virtio_gpu' machine # [ 1.856248] systemd[1]: Finished Apply Kernel Variables. machine # [ 1.863154] systemd[1]: Starting Create System Files and Directories... machine # [ 1.873359] systemd-udevd[105]: Using default interface naming scheme 'v261'. machine # [ 1.874670] systemd[1]: Finished Create System Files and Directories. machine # [ 1.884129] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 1.922645] systemd[1]: Finished Coldplug All udev Devices. machine # [ 1.923563] systemd[1]: Reached target System Initialization. machine # [ 1.924370] systemd[1]: Reached target Basic System. machine # [ 2.153169] virtio_blk virtio2: 4/0/0 default/read/poll queues machine # [ 2.155306] ehci-pci 0000:00:1d.7: EHCI Host Controller machine # [ 2.157183] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 machine # [ 2.159816] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 machine # [ 2.162888] SCSI subsystem initialized machine # [ 2.166476] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 machine # [ 2.167843] virtio_blk virtio2: [vda] 33554432 512-byte logical blocks (17.2 GB/16.0 GiB) machine # [ 2.169465] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 machine # [ 2.171453] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.172559] usb usb1: Product: EHCI Host Controller machine # [ 2.173282] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd machine # [ 2.174130] usb usb1: SerialNumber: 0000:00:1d.7 machine # [ 2.181842] hub 1-0:1.0: USB hub found machine # [ 2.182532] hub 1-0:1.0: 6 ports detected machine # [ 2.185530] uhci_hcd 0000:00:1d.0: UHCI Host Controller machine # [ 2.186288] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 machine # [ 2.187495] uhci_hcd 0000:00:1d.0: detected 2 ports machine # [ 2.194918] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 machine # [ 2.196336] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.197608] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.198672] usb usb2: Product: UHCI Host Controller machine # [ 2.198912] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 machine # [ 2.199384] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd machine # [ 2.201610] usb usb2: SerialNumber: 0000:00:1d.0 machine # [ 2.202226] serio: i8042 KBD port at 0x60,0x64 irq 1 machine # [ 2.202587] hub 2-0:1.0: USB hub found machine # [ 2.202629] serio: i8042 AUX port at 0x60,0x64 irq 12 machine # [ 2.202810] hub 2-0:1.0: 2 ports detected machine # [ 2.208792] uhci_hcd 0000:00:1d.1: UHCI Host Controller machine # [ 2.209956] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 machine # [ 2.211160] uhci_hcd 0000:00:1d.1: detected 2 ports machine # [ 2.212408] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 machine # [ 2.213842] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.215204] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.216285] usb usb3: Product: UHCI Host Controller machine # [ 2.217059] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd machine # [ 2.217903] usb usb3: SerialNumber: 0000:00:1d.1 machine # [ 2.221172] hub 3-0:1.0: USB hub found machine # [ 2.222514] hub 3-0:1.0: 2 ports detected machine # [ 2.233870] uhci_hcd 0000:00:1d.2: UHCI Host Controller machine # [ 2.234687] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 machine # [ 2.236610] uhci_hcd 0000:00:1d.2: detected 2 ports machine # [ 2.240824] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 machine # [ 2.087062] (udev-worker)[121]: Network interface NamePolicy= disabled on kernel command line. machine # [ 2.243158] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.244475] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.245711] usb usb4: Product: UHCI Host Controller machine # [ 2.092057] systemd[1]: Starting Virtual Console Setup... machine # [ 2.246505] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd machine # [ 2.093491] (udev-worker)[130]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 2.248493] usb usb4: SerialNumber: 0000:00:1d.2 machine # [ 2.251839] hub 4-0:1.0: USB hub found machine # [ 2.097836] (udev-worker)[130]: Network interface NamePolicy= disabled on kernel command line. machine # [ 2.252491] hub 4-0:1.0: 2 ports detected machine # [ 2.258628] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 machine # [ 2.261515] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode machine # [ 2.262804] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) machine # [ 2.262806] ahci 0000:00:1f.2: flags: 64bit ncq only machine # [ 2.116549] systemd[1]: Found device /dev/disk/by-label/nixos. machine # [ 2.119813] systemd[1]: Reached target Initrd Root Device. machine # [ 2.120721] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... machine # [ 2.122196] systemd-vconsole-setup[147]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 2.277758] scsi host0: ahci machine # [ 2.124527] systemd[1]: Finis[ 2.278880] scsi host1: ahci machine # hed Virtual Console Setup. machine # [ 2.281564] scsi host2: ahci machine # [ 2.283881] scsi host3: ahci machine # [ 2.284977] scsi host4: ahci machine # [ 2.286020] scsi host5: ahci machine # [ 2.287036] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 50 lpm-pol 1 machine # [ 2.288991] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 50 lpm-pol 1 machine # [ 2.290595] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 50 lpm-pol 1 machine # [ 2.291869] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 50 lpm-pol 1 machine # [ 2.139443] systemd-fsck[165]: nixos: clean, 12/1048576 files, 109865/4194304 blocks machine # [ 2.293763] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 50 lpm-pol 1 machine # [ 2.295959] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 50 lpm-pol 1 machine # [ 2.143876] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. machine # [ 2.423678] usb 1-1: new high-speed USB device number 2 using ehci-pci machine # [ 2.552892] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 machine # [ 2.554157] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 machine # [ 2.555298] usb 1-1: Product: QEMU USB Tablet machine # [ 2.556030] usb 1-1: Manufacturer: QEMU machine # [ 2.556641] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 machine # [ 2.574177] hid: raw HID events driver (C) Jiri Kosina machine # [ 2.614414] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) machine # [ 2.617020] ata6: SATA link down (SStatus 0 SControl 300) machine # [ 2.619346] ata1: SATA link down (SStatus 0 SControl 300) machine # [ 2.620537] ata2: SATA link down (SStatus 0 SControl 300) machine # [ 2.622632] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 machine # [ 2.624676] ata3.00: applying bridge limits machine # [ 2.626427] ata5: SATA link down (SStatus 0 SControl 300) machine # [ 2.627597] ata4: SATA link down (SStatus 0 SControl 300) machine # [ 2.629776] ata3.00: configured for UDMA/100 machine # [ 2.632335] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 machine # [ 2.657519] usbcore: registered new interface driver usbhid machine # [ 2.659620] usbhid: USB HID core driver machine # [ 2.670766] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 machine # [ 2.675136] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 machine # [ 2.697845] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray machine # [ 2.730703] cdrom: Uniform CD-ROM driver Revision: 3.20 machine # [ 2.805714] systemd[1]: Mounting /sysroot... machine # [ 3.084507] EXT4-fs (vda): mounted filesystem 3e461403-197f-4a21-b2f5-8a16c291d0e6 r/w with ordered data mode. Quota mode: none. machine # [ 2.936387] systemd[1]: Mounted /sysroot. machine # [ 2.938241] systemd[1]: Reached target Initrd Root File System. machine # [ 2.940456] systemd[1]: Mounting /sysroot/nix/.ro-store... machine # [ 2.942559] systemd[1]: Mounting /sysroot/nix/.rw-store... machine # [ 2.944643] systemd[1]: Mounting /sysroot/run... machine # [ 2.946480] systemd[1]: Mounting /sysroot/tmp/shared... machine # [ 2.953229] systemd[1]: Mounting /sysroot/tmp/xchg... machine # [ 2.955402] systemd[1]: Starting Mountpoints Configured in the Real Root... machine # [ 2.957879] systemd[1]: Mounted /sysroot/nix/.rw-store. machine # [ 2.960062] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 2.968406] systemd-sysroot-fstab-check[195]: /sysroot should be mounted in the initrd, will request daemon-reload. machine # [ 2.973607] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 2.976464] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 2.978265] systemd[1]: Reload requested from client PID 195 ('systemd-sysroot') (unit initrd-parse-etc.service)... machine # [ 2.982634] systemd[1]: Reloading... machine # [ 3.026478] systemd[1]: Reloading finished in 54 ms. machine # [ 3.047052] systemd-sysroot-fstab-check[195]: Requesting initrd-fs.target/start/replace... machine # [ 3.049500] systemd[1]: Mounted /sysroot/nix/.ro-store. machine # [ 3.050885] systemd[1]: Mounted /sysroot/run. machine # [ 3.052081] systemd[1]: Mounted /sysroot/tmp/shared. machine # [ 3.053446] systemd[1]: Mounted /sysroot/tmp/xchg. machine # [ 3.058788] systemd-sysroot-fstab-check[195]: Requesting swap.target/start/replace... machine # [ 3.061252] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.064550] systemd[1]: initrd-parse-etc.service: Deactivated successfully. machine # [ 3.073914] systemd[1]: Finished Mountpoints Configured in the Real Root. machine # [ 3.076195] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. machine # [ 3.079077] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.081429] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.806679] systemd[1]: Mounting /sysroot/nix/store... machine # [ 3.857759] systemd[1]: Mounted /sysroot/nix/store. machine # [ 3.859609] systemd[1]: Reached target Initrd File Systems. machine # [ 3.861832] systemd[1]: Starting Find NixOS closure... machine # [ 3.863804] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... machine # [ 3.893189] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. machine # [ 3.895854] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. machine # [ 3.912673] systemd[1]: Finished Find NixOS closure. machine # [ 3.914673] systemd[1]: Reached target Initrd Default Target. machine # [ 3.916867] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... machine # [ 3.946370] systemd[1]: Stopped target Initrd Default Target. machine # [ 3.948411] systemd[1]: Stopped target Basic System. machine # [ 3.950208] systemd[1]: Stopped target Initrd Root Device. machine # [ 3.952127] systemd[1]: Stopped target Path Units. machine # [ 3.953844] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. machine # [ 3.956378] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. machine # [ 3.958984] systemd[1]: Stopped target Slice Units. machine # [ 3.960828] systemd[1]: Stopped target Socket Units. machine # [ 3.963679] systemd[1]: Stopped target System Initialization. machine # [ 3.966487] systemd[1]: Stopped target Swaps. machine # [ 3.969745] systemd[1]: Stopped target Timer Units. machine # [ 3.972104] systemd[1]: dbus.socket: Deactivated successfully. machine # [ 3.974218] systemd[1]: Closed D-Bus System Message Bus Socket. machine # [ 3.976223] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. machine # [ 3.978774] systemd[1]: Stopped Find NixOS closure. machine # [ 3.980496] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.982466] systemd[1]: systemd-sysctl.service: Deactivated successfully. machine # [ 3.984703] systemd[1]: Stopped Apply Kernel Variables. machine # [ 3.986447] systemd[1]: systemd-modules-load.service: Deactivated successfully. machine # [ 3.988446] systemd[1]: Stopped Load Kernel Modules. machine # [ 3.989869] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. machine # [ 3.991996] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. machine # [ 3.994160] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. machine # [ 3.996156] systemd[1]: Stopped Create System Files and Directories. machine # [ 3.997914] systemd[1]: Stopped target Local File Systems. machine # [ 3.999518] systemd[1]: Stopped target Preparation for Local File Systems. machine # [ 4.001670] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. machine # [ 4.003891] systemd[1]: Stopped Coldplug All udev Devices. machine # [ 4.005392] systemd[1]: Stopping Rule-based Manager for Device Events and Files... machine # [ 4.007381] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 4.009327] systemd[1]: Stopped Virtual Console Setup. machine # [ 4.010274] systemd[1]: initrd-cleanup.service: Deactivated successfully. machine # [ 4.011198] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. machine # [ 4.012137] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 4.013130] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 4.013967] systemd[1]: systemd-udevd.service: Deactivated successfully. machine # [ 4.014885] systemd[1]: Stopped Rule-based Manager for Device Events and Files. machine # [ 4.015886] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. machine # [ 4.016881] systemd[1]: Closed udev Control Socket. machine # [ 4.017602] systemd[1]: Starting Cleanup udev Database... machine # [ 4.018397] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. machine # [ 4.019454] systemd[1]: Stopped Create Static Device Nodes in /dev. machine # [ 4.020296] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. machine # [ 4.021409] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. machine # [ 4.022451] systemd[1]: kmod-static-nodes.service: Deactivated successfully. machine # [ 4.023433] systemd[1]: Stopped Create List of Static Device Nodes. machine # [ 4.047449] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. machine # [ 4.048566] systemd[1]: Finished Cleanup udev Database. machine # [ 4.050662] systemd[1]: Reached target Switch Root. machine # [ 4.052151] systemd[1]: Starting NixOS Activation... machine # [ 4.178302] initrd-nixos-activation-start[244]: booting system configuration /nix/store/ig5rdvigiwkwqm7xa9zhdvw16icd9fc1-nixos-system-machine-test machine # [ 4.230531] initrd-nixos-activation-start[244]: running activation script... machine # [ 4.480764] initrd-nixos-activation-start[267]: setting up /etc... machine # [ 4.609340] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. machine # [ 4.611563] systemd[1]: Finished NixOS Activation. machine # [ 4.613285] systemd[1]: Starting Switch Root... machine # [ 4.646386] systemd[1]: Switching root. machine # [ 4.862280] systemd-journald[93]: Received SIGTERM from PID 1 (systemd). machine # [ 4.980782] NET: Registered PF_VSOCK protocol family machine # [ 5.355643] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 5.365236] systemd[1]: Detected virtualization kvm. machine # [ 5.367325] systemd[1]: Detected architecture x86-64. machine # [ 5.369578] systemd[1]: Detected first boot. machine # [ 5.374799] systemd[1]: Initializing machine ID from random generator. machine # [ 5.522703] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 5.596431] systemd[1]: Applying preset policy. machine # [ 5.800747] systemd[1]: Populated /etc with preset unit settings. machine # [ 6.028287] systemd[1]: initrd-switch-root.service: Deactivated successfully. machine # [ 6.029824] systemd[1]: Stopped initrd-switch-root.service. machine # [ 6.031934] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. machine # [ 6.034135] systemd[1]: Created slice Slice /system/getty. machine # [ 6.035647] systemd[1]: Created slice User and Session Slice. machine # [ 6.036632] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 6.038097] systemd[1]: Started Forward Password Requests to Wall Directory Watch. machine # [ 6.039287] systemd[1]: Expecting device /dev/hvc0... machine # [ 6.040086] systemd[1]: Expecting device /dev/ttyS0... machine # [ 6.040928] systemd[1]: Reached target Local Encrypted Volumes. machine # [ 6.041838] systemd[1]: Stopped target initrd-fs.target. machine # [ 6.042655] systemd[1]: Stopped target initrd-root-fs.target. machine # [ 6.043527] systemd[1]: Stopped target initrd-switch-root.target. machine # [ 6.044459] systemd[1]: Reached target Virtual Machines and Containers. machine # [ 6.045488] systemd[1]: Reached target Path Units. machine # [ 6.046259] systemd[1]: Reached target Remote File Systems. machine # [ 6.047131] systemd[1]: Reached target Slice Units. machine # [ 6.047947] systemd[1]: Reached target Swaps. machine # [ 6.050090] systemd[1]: Listening on Query the User Interactively for a Password. machine # [ 6.052778] systemd[1]: Listening on Process Core Dump Socket. machine # [ 6.054700] systemd[1]: Listening on Credential Encryption/Decryption. machine # [ 6.056945] systemd[1]: Listening on Factory Reset Management. machine # [ 6.057975] systemd[1]: Listening on Hostname Service Socket. machine # [ 6.061110] systemd[1]: Starting Journal Log Access Socket... machine # [ 6.062496] systemd[1]: Listening on Journal Audit Socket. machine # [ 6.064675] systemd[1]: Listening on Console Output Muting Service Socket. machine # [ 6.065868] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. machine # [ 6.067082] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.068512] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki machine # [ 6.073473] systemd[1]: Listening on Disk Repartitioning Service Socket. machine # [ 6.074544] systemd[1]: Listening on udev Control Socket. machine # [ 6.075463] systemd[1]: Listening on udev Varlink Socket. machine # [ 6.078106] systemd[1]: Mounting Huge Pages File System... machine # [ 6.080312] systemd[1]: Mounting POSIX Message Queue File System... machine # [ 6.082745] systemd[1]: Mounting Kernel Debug File System... machine # [ 6.094931] systemd[1]: Mounting Kernel Trace File System... machine # [ 6.100267] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 6.105224] systemd[1]: Starting Load Kernel Module configfs... machine # [ 6.107217] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm machine # [ 6.110237] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.113541] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.118944] systemd[1]: Mounting FUSE Control File System... machine # [ 6.119890] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.124922] systemd[1]: Starting Journal Service... machine # [ 6.131623] systemd[1]: Starting Load Kernel Modules... machine # [ 6.139700] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... machine # [ 6.142465] systemd[1]: Starting Remount Root and Kernel File Systems... machine # [ 6.143546] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.151141] systemd[1]: Starting Coldplug All udev Devices... machine # [ 6.154093] systemd[1]: Listening on Journal Log Access Socket. machine # [ 6.156377] systemd[1]: Mounted Huge Pages File System. machine # [ 6.157384] systemd[1]: Mounted POSIX Message Queue File System. machine # [ 6.158825] systemd[1]: Mounted Kernel Debug File System. machine # [ 6.160000] systemd[1]: Mounted Kernel Trace File System. machine # [ 6.164773] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 6.167686] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 6.173160] systemd[1]: Mounted FUSE Control File System. machine # [ 6.182925] systemd-journald[340]: Collecting audit messages is enabled. machine # [ 6.186520] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 6.189278] systemd[1]: Finished Load Kernel Module configfs. machine # [ 6.194034] systemd[1]: Mounting Kernel Configuration File System... machine # [ 6.199167] systemd[1]: Started Journal Service. machine # [ 6.045946] systemd[1]: Queued start job for default target Multi-User System. machine # [ 6.047455] systemd[1]: systemd-journald.service: Deactivated successfully. machine # [ 6.203811] EXT4-fs (vda): re-mounted 3e461403-197f-4a21-b2f5-8a16c291d0e6. machine # [ 6.050917] systemd-modules-load[341]: Using 2 probe threads machine # [ 6.054490] systemd[1]: Finished Remount Root and Kernel File Systems. machine # [ 6.212618] loop: module loaded machine # [ 6.059648] systemd-modules-load[341]: Inserted module 'loop' machine # [ 6.060839] systemd[1]: Listening on Disk Image Download Service Socket. machine # [ 6.064741] systemd-oomd[343]: No swap; memory pressure usage will be degraded machine # [ 6.066318] systemd[1]: Starting Flush Journal to Persistent Storage... machine # [ 6.067515] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.069497] systemd[1]: Starting Load/Save OS Random Seed... machine # [ 6.070386] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.071865] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. machine # [ 6.074161] systemd[1]: Finished Load Kernel Modules. machine # [ 6.075063] systemd[1]: Mounted Kernel Configuration File System. machine # [ 6.078092] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 6.081066] systemd[1]: Starting Apply Kernel Variables... machine # [ 6.237553] systemd-journald[340]: Received client request to flush runtime journal. machine # [ 6.140503] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 6.142212] systemd[1]: Finished Load/Save OS Random Seed. machine # [ 6.143315] systemd[1]: Reached target First Boot Complete. machine # [ 6.144287] systemd[1]: Finished Apply Kernel Variables. machine # [ 6.145273] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 6.146186] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 6.147267] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 6.148321] systemd[1]: Finished Flush Journal to Persistent Storage. machine # [ 6.175918] systemd[1]: Finished Coldplug All udev Devices. machine # [ 6.177840] systemd-udevd[368]: Using default interface naming scheme 'v261'. machine # [ 6.212554] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 6.292551] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.318619] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. machine # [ 6.320114] (udev-worker)[378]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.333384] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. machine # [ 6.339873] (udev-worker)[385]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 6.342637] (udev-worker)[385]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.365607] systemd[1]: Condition check resulted in Virtio network device being skipped. machine # [ 6.366874] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.368496] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.370788] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.372515] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.374022] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.541509] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 machine # [ 6.544338] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console machine # [ 6.547862] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 machine # [ 6.554139] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized machine # [ 6.554727] ACPI: button: Power Button [PWRF] machine # [ 6.562505] Console: switching to colour dummy device 80x25 machine # [ 6.565689] [drm] Found bochs VGA, ID 0xb0c5. machine # [ 6.566130] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. machine # [ 6.570945] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic machine # [ 6.571737] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 machine # [ 6.590576] Console: switching to colour frame buffer device 160x50 machine # [ 6.591984] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device machine # [ 6.592642] mousedev: PS/2 mouse device common for all mice machine # [ 6.598186] rtc_cmos PNP0B00:00: RTC can wake from S4 machine # [ 6.613538] parport_pc 00:02: reported by Plug and Play ACPI machine # [ 6.615991] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] machine # [ 6.618696] rtc_cmos PNP0B00:00: registered as rtc0 machine # [ 6.619306] rtc_cmos PNP0B00:00: setting system clock to 2026-09-22T14:50:57 UTC (1790088657) machine # [ 6.621152] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs machine # [ 6.638922] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt machine # [ 6.639521] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 machine # [ 6.640678] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD machine # [ 6.677523] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 machine # [ 6.538589] systemd[1]: Starting Virtual Console Setup... machine # [ 6.727354] iTCO_wdt iTCO_wdt.0.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) machine # [ 6.577532] systemd[1]: systemd-vconsole-setu[ 6.732467] iTCO_wdt iTCO_wdt.0.auto: initialized. heartbeat=30 sec (nowayout=0) machine # p.service: Deactivated successfully. machine # [ 6.579805] s[ 6.734225] ppdev: user-space parallel port driver machine # ystemd[1]: Stopped Virtual Console Setup. machine # [ 6.584877] systemd[1]: Starting Virtual Console Setup... machine # [ 6.758069] kvm_amd: TSC scaling supported machine # [ 6.758631] kvm_amd: Nested Virtualization enabled machine # [ 6.759127] kvm_amd: Nested Paging enabled machine # [ 6.759627] kvm_amd: LBR virtualization supported machine # [ 6.760212] kvm_amd: Virtual VMLOAD VMSAVE supported machine # [ 6.760845] kvm_amd: Virtual GIF supported machine # [ 6.761261] kvm_amd: Virtual NMI enabled machine # [ 6.862124] EDAC MC: Ver: 3.0.0 machine # [ 6.759117] systemd-vconsole-setup[415]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 6.765817] systemd[1]: Finished Virtual Console Setup. machine # [ 6.878690] systemd[1]: Mounting /run/wrappers... machine # [ 6.911777] systemd[1]: Mounted /run/wrappers. machine # [ 6.913626] systemd[1]: Reached target Local File Systems. machine # [ 6.915691] systemd[1]: Listening on Boot Loader Control Service Socket. machine # [ 6.918779] systemd[1]: Starting register-nix-paths.service... machine # [ 6.921604] systemd[1]: Starting Create SUID/SGID Wrappers... machine # [ 6.923697] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. machine # [ 6.929345] systemd[1]: Starting Save Transient machine-id to Disk... machine # [ 6.931587] systemd[1]: Starting Create System Files and Directories... machine # [ 7.025746] systemd[1]: Finished Create System Files and Directories. machine # [ 7.029766] systemd[1]: Starting Rebuild Journal Catalog... machine # [ 7.033747] systemd[1]: Starting Record System Boot/Shutdown in UTMP... machine # [ 7.038708] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. machine # [ 7.047843] systemd[1]: Finished Save Transient machine-id to Disk. machine # [ 7.066354] systemd[1]: Finished Record System Boot/Shutdown in UTMP. machine # [ 7.079526] systemd[1]: Finished Rebuild Journal Catalog. machine # [ 7.081939] systemd[1]: Starting Update is Completed... machine # [ 7.112260] systemd[1]: Finished Update is Completed. machine # [ 7.228297] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. machine # [ 7.229548] systemd[1]: Finished Create SUID/SGID Wrappers. machine # [ 7.450919] systemd[1]: Finished register-nix-paths.service. machine # [ 7.452645] systemd[1]: Reached target System Initialization. machine # [ 7.454110] systemd[1]: Started Discard unused filesystem blocks once a week. machine # [ 7.455603] systemd[1]: Started niks3 garbage collection timer. machine # [ 7.456917] systemd[1]: Started Daily Cleanup of Temporary Directories. machine # [ 7.458345] systemd[1]: Reached target Timer Units. machine # [ 7.459471] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 7.463659] systemd[1]: Listening on niks3 server socket. machine # [ 7.464985] systemd[1]: Listening on Nix Daemon Socket. machine # [ 7.466290] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. machine # [ 7.468050] systemd[1]: Reached target Socket Units. machine # [ 7.469302] systemd[1]: Reached target Basic System. machine # [ 7.470442] systemd[1]: Started backdoor.service. machine # [ 7.471629] systemd[1]: Starting Import lastlog data into lastlog2 database... machine # [ 7.474310] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 7.485112] systemd[1]: Starting Post-Boot Actions... machine # [ 7.487966] systemd[1]: Started Reset console on configuration changes. machine # [ 7.490711] systemd[1]: Starting resolvconf update... machine # [ 7.493696] systemd[1]: Started rustfs.service. machine # [ 7.498494] systemd[1]: Starting rustfs-bucket.service... machine # [ 7.509493] systemd[1]: Starting D-Bus System Message Bus... machine # [ 7.520263] systemd[1]: Finished Post-Boot Actions. machine # [ 7.534172] nsncd[498]: Sep 22 14:50:58.568 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 7.536537] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # connecting to host... machine # [ 7.538103] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 7.539162] systemd[1]: Reached target User and Group Name Lookups. machine # [ 7.540139] systemd[1]: Starting User Login Management... machine # [ 7.555100] systemd[1]: Finished Import lastlog data into lastlog2 database. machine: Guest shell says: b'Spawning backdoor root shell...\n' machine: connected to guest root shell machine: (connecting took 8.20 seconds) machine: (finished: waiting for the VM to finish booting, in 8.41 seconds) machine # [ 7.585206] dbus-broker-launch[505]: Looking up NSS user entry for 'systemd-timesync'... machine # [ 7.592592] systemd-logind[525]: New seat seat0. machine # [ 7.596343] dbus-broker-launch[505]: NSS returned no entry for 'systemd-timesync' machine # [ 7.597904] dbus-broker-launch[505]: Invalid user-name in /nix/store/d3mrkr0v9x5sgbb0rb2pnsl0mysb1m4x-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" machine # [ 7.599932] systemd-logind[525]: Watching system buttons on /dev/input/event2 (Power Button) machine # [ 7.600881] systemd-logind[525]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) machine # [ 7.602331] systemd-logind[525]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) machine # [ 7.603218] systemd[1]: Started User Login Management. machine # [ 7.603922] systemd[1]: Starting linger-users.service... machine # [ 7.618105] systemd[1]: Started D-Bus System Message Bus. machine # [ 7.629825] systemd[1]: linger-users.service: Deactivated successfully. machine # [ 7.631200] systemd[1]: Finished linger-users.service. machine # [ 7.634185] dbus-broker-launch[505]: Ready machine # [ 7.639961] systemd[1]: Stopped target Host and Network Name Lookups. machine # [ 7.640678] systemd[1]: Stopping Host and Network Name Lookups... machine # [ 7.641140] systemd[1]: Stopped target User and Group Name Lookups. machine # [ 7.641661] systemd[1]: Stopping User and Group Name Lookups... machine # [ 7.642313] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... machine # [ 7.646209] systemd[1]: nscd.service: Deactivated successfully. machine # [ 7.648221] systemd[1]: Stopped Name Service Cache Daemon (nsncd). machine # [ 7.651118] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 7.678323] nsncd[605]: Sep 22 14:50:58.712 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 7.680526] systemd[1]: Finished resolvconf update. machine # [ 7.681311] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 7.682174] systemd[1]: Reached target Preparation for Network. machine # [ 7.683102] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 7.684040] systemd[1]: Reached target User and Group Name Lookups. machine # [ 7.684929] systemd[1]: Starting DHCP Client... machine # [ 7.685683] systemd[1]: Starting Address configuration of eth1... machine # [ 7.686601] systemd[1]: Starting Extra networking commands.... machine # [ 7.743071] network-addresses-eth1-start[630]: adding address 192.168.1.1/24... done machine # [ 7.752255] network-addresses-eth1-start[630]: adding address 2001:db8:1::1/64... done machine # [ 7.762181] systemd[1]: Finished Address configuration of eth1. machine # [ 7.777450] dhcpcd[641]: dhcpcd-10.3.2 starting machine # [ 7.781243] dhcpcd[697]: dev: loaded udev machine # [ 7.944327] 8021q: 802.1Q VLAN Support v1.8 machine # [ 7.944915] 8021q: adding VLAN 0 to HW filter on device eth1 machine # [ 7.797293] systemd[1]: Finished Extra networking commands.. machine # [ 7.798303] systemd[1]: Reached target Network. machine # [ 7.801418] systemd[1]: Starting PostgreSQL Server... machine # [ 7.804392] systemd[1]: Starting Permit User Sessions... machine # [ 7.809762] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. machine # [ 7.828178] systemd[1]: Finished Permit User Sessions. machine # [ 7.831124] systemd[1]: Started Getty on tty1. machine # [ 7.832593] systemd[1]: Reached target Login Prompts. machine # [ 8.040250] cfg80211: Loading compiled-in X.509 certificates for regulatory database machine # [ 8.051881] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' machine # [ 8.053224] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' machine # [ 8.055179] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 machine # [ 8.056482] cfg80211: failed to load regulatory.db machine # [ 7.918214] postgresql-pre-start[716]: The files belonging to this database system will be owned by user "postgres". machine # [ 7.918657] postgresql-pre-start[716]: This user must also own the server process. machine # [ 7.921082] postgresql-pre-start[716]: The database cluster will be initialized with locale "en_US.UTF-8". machine # [ 7.921724] postgresql-pre-start[716]: The default database encoding has accordingly been set to "UTF8". machine # [ 7.922532] postgresql-pre-start[716]: The default text search configuration will be set to "english". machine # [ 7.923038] postgresql-pre-start[716]: Data page checksums are enabled. machine # [ 7.923631] postgresql-pre-start[716]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok machine # [ 7.924107] postgresql-pre-start[716]: creating subdirectories ... ok machine # [ 7.924758] postgresql-pre-start[716]: selecting dynamic shared memory implementation ... posix machine # [ 8.095570] 8021q: adding VLAN 0 to HW filter on device eth0 machine # [ 7.942842] dhcpcd[697]: eth0: waiting for carrier machine # [ 7.943772] dhcpcd[697]: eth0: carrier acquired machine # [ 7.950913] dhcpcd[697]: DUID 00:01:00:01:32:45:52:52:52:54:00:12:34:56 machine # [ 7.951990] dhcpcd[697]: eth0: IAID 00:12:34:56 machine # [ 7.952708] dhcpcd[697]: eth0: adding address fe80::5054:ff:fe12:3456 machine # [ 7.978569] postgresql-pre-start[716]: selecting default "max_connections" ... 100 machine # [ 8.028760] postgresql-pre-start[716]: selecting default "shared_buffers" ... 128MB machine # [ 8.146667] dhcpcd[697]: eth0: soliciting a DHCP lease machine # [ 8.318123] NET: Registered PF_PACKET protocol family machine # [ 8.178689] dhcpcd[697]: eth0: offered 10.0.2.15 from 10.0.2.2 machine # [ 8.184377] dhcpcd[697]: eth0: probing address 10.0.2.15/24 machine # [ 8.768976] postgresql-pre-start[716]: selecting default time zone ... UTC machine # [ 8.770824] postgresql-pre-start[716]: creating configuration files ... ok machine # [ 8.942520] postgresql-pre-start[716]: running bootstrap script ... ok machine # [ 9.362361] postgresql-pre-start[716]: performing post-bootstrap initialization ... ok machine # [ 9.525843] postgresql-pre-start[716]: syncing data to disk ... ok machine # [ 9.526748] postgresql-pre-start[716]: initdb: warning: enabling "trust" authentication for local connections machine # [ 9.527601] postgresql-pre-start[716]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. machine # [ 9.528295] postgresql-pre-start[716]: Success. You can now start the database server using: machine # [ 9.528923] postgresql-pre-start[716]: pg_ctl -D /var/lib/postgresql/18 -l logfile start machine # [ 9.678994] postgres[752]: [752] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit machine # [ 9.683409] postgres[752]: [752] LOG: listening on IPv6 address "::1", port 5432 machine # [ 9.685337] postgres[752]: [752] LOG: listening on IPv4 address "127.0.0.1", port 5432 machine # [ 9.689804] postgres[752]: [752] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" machine # [ 9.703573] postgres[761]: [761] LOG: database system was shut down at 2026-09-22 14:51:00 GMT machine # [ 9.711123] postgres[752]: [752] LOG: database system is ready to accept connections machine # [ 9.717339] systemd[1]: Started PostgreSQL Server. machine # [ 9.719917] systemd[1]: Starting PostgreSQL Setup Scripts... machine # [ 9.894696] postgresql-setup-start[781]: CREATE DATABASE machine # [ 9.933660] postgresql-setup-start[786]: CREATE ROLE machine # [ 9.951429] postgresql-setup-start[788]: ALTER DATABASE machine # [ 9.954469] systemd[1]: Finished PostgreSQL Setup Scripts. machine # [ 9.954918] systemd[1]: Reached target PostgreSQL. machine # [ 10.069071] dhcpcd[697]: eth0: soliciting an IPv6 router machine # [ 10.070517] dhcpcd[697]: eth0: Router Advertisement from fe80::2 machine # [ 10.072200] dhcpcd[697]: eth0: adding address fec0::5054:ff:fe12:3456/64 machine # [ 10.073484] dhcpcd[697]: eth0: adding route to fec0::/64 machine # [ 10.074992] dhcpcd[697]: eth0: adding default route via fe80::2 machine # [ 13.167262] dhcpcd[697]: eth0: leased 10.0.2.15 for 86400 seconds machine # [ 13.168447] dhcpcd[697]: eth0: adding route to 10.0.2.0/24 machine # [ 13.169518] dhcpcd[697]: eth0: adding default route via 10.0.2.2 machine # [ 13.261890] systemd[1]: Started DHCP Client. machine # [ 13.264541] systemd[1]: Reached target Network is Online. machine # [ 13.268996] systemd[1]: Starting k3s service... machine # [ 13.352705] k3s[879]: time="2026-09-22T14:51:04Z" level=info msg="Acquiring lock file /var/lib/rancher/k3s/data/.lock" machine # [ 13.353890] k3s[879]: time="2026-09-22T14:51:04Z" level=info msg="Preparing data dir /var/lib/rancher/k3s/data/05fb32d1d5d79ab4bf8f805d07e4a7dfb491001fd5137b587aa471efd4746099" machine # [ 15.248456] k3s[879]: time="2026-09-22T14:51:06Z" level=info msg="Starting k3s 1.35.8+k3s1 (e952d68a)" machine # [ 15.261520] k3s[879]: time="2026-09-22T14:51:06Z" level=info msg="Configuring sqlite3 database connection pooling: maxIdle=20, maxOpen=0, maxLifetime=0s, maxIdleTime=2m0s" machine # [ 15.266365] k3s[879]: time="2026-09-22T14:51:06Z" level=info msg="Kine built with sqlite from github.com/mattn/go-sqlite3 version 3.53.3" machine # [ 15.267028] k3s[879]: time="2026-09-22T14:51:06Z" level=info msg="Configuring database table schema and indexes, this may take a moment..." machine # [ 15.285737] k3s[879]: time="2026-09-22T14:51:06Z" level=info msg="Database tables and indexes are up to date" machine # [ 15.287289] k3s[879]: time="2026-09-22T14:51:06Z" level=info msg="Running startup VACUUM to reclaim disk space, this may take a moment..." machine # [ 15.295814] k3s[879]: time="2026-09-22T14:51:06Z" level=info msg="Startup VACUUM completed successfully" machine # [ 15.298132] k3s[879]: time="2026-09-22T14:51:06Z" level=info msg="Kine available at unix://kine.sock" machine # [ 15.299700] k3s[879]: time="2026-09-22T14:51:06Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 15.301734] k3s[879]: time="2026-09-22T14:51:06Z" level=info msg="Datastore connection validated successfully, proceeding with bootstrap data generation" machine # [ 15.303165] k3s[879]: time="2026-09-22T14:51:06Z" level=info msg="generated self-signed CA certificate CN=k3s-client-ca@1790088666: notBefore=2026-09-22 13:51:06.337375698 +0000 UTC notAfter=2036-09-19 13:51:06.337375698 +0000 UTC" machine # [ 15.304345] k3s[879]: time="2026-09-22T14:51:06Z" level=info msg="certificate CN=system:admin,O=system:masters signed by CN=k3s-client-ca@1790088666: notBefore=2026-09-22 13:51:06 +0000 UTC notAfter=2027-09-22 13:51:06 +0000 UTC" machine # [ 15.305566] k3s[879]: time="2026-09-22T14:51:06Z" level=info msg="certificate CN=system:k3s-supervisor,O=system:masters signed by CN=k3s-client-ca@1790088666: notBefore=2026-09-22 13:51:06 +0000 UTC notAfter=2027-09-22 13:51:06 +0000 UTC" machine # [ 15.307125] k3s[879]: time="2026-09-22T14:51:06Z" level=info msg="certificate CN=system:kube-controller-manager signed by CN=k3s-client-ca@1790088666: notBefore=2026-09-22 13:51:06 +0000 UTC notAfter=2027-09-22 13:51:06 +0000 UTC" machine # [ 15.308271] k3s[879]: time="2026-09-22T14:51:06Z" level=info msg="certificate CN=system:kube-scheduler signed by CN=k3s-client-ca@1790088666: notBefore=2026-09-22 13:51:06 +0000 UTC notAfter=2027-09-22 13:51:06 +0000 UTC" machine # [ 15.309416] k3s[879]: time="2026-09-22T14:51:06Z" level=info msg="certificate CN=system:apiserver,O=system:masters signed by CN=k3s-client-ca@1790088666: notBefore=2026-09-22 13:51:06 +0000 UTC notAfter=2027-09-22 13:51:06 +0000 UTC" machine # [ 15.311111] k3s[879]: time="2026-09-22T14:51:06Z" level=info msg="certificate CN=k3s-cloud-controller-manager signed by CN=k3s-client-ca@1790088666: notBefore=2026-09-22 13:51:06 +0000 UTC notAfter=2027-09-22 13:51:06 +0000 UTC" machine # [ 15.312241] k3s[879]: time="2026-09-22T14:51:06Z" level=info msg="generated self-signed CA certificate CN=k3s-server-ca@1790088666: notBefore=2026-09-22 13:51:06.343079775 +0000 UTC notAfter=2036-09-19 13:51:06.343079775 +0000 UTC" machine # [ 15.313408] k3s[879]: time="2026-09-22T14:51:06Z" level=info msg="certificate CN=kube-apiserver signed by CN=k3s-server-ca@1790088666: notBefore=2026-09-22 13:51:06 +0000 UTC notAfter=2027-09-22 13:51:06 +0000 UTC" machine # [ 15.314969] k3s[879]: time="2026-09-22T14:51:06Z" level=info msg="certificate CN=kube-scheduler signed by CN=k3s-server-ca@1790088666: notBefore=2026-09-22 13:51:06 +0000 UTC notAfter=2027-09-22 13:51:06 +0000 UTC" machine # [ 15.316343] k3s[879]: time="2026-09-22T14:51:06Z" level=info msg="certificate CN=kube-controller-manager signed by CN=k3s-server-ca@1790088666: notBefore=2026-09-22 13:51:06 +0000 UTC notAfter=2027-09-22 13:51:06 +0000 UTC" machine # [ 15.317375] k3s[879]: time="2026-09-22T14:51:06Z" level=info msg="generated self-signed CA certificate CN=k3s-request-header-ca@1790088666: notBefore=2026-09-22 13:51:06.34595556 +0000 UTC notAfter=2036-09-19 13:51:06.34595556 +0000 UTC" machine # [ 15.318289] k3s[879]: time="2026-09-22T14:51:06Z" level=info msg="certificate CN=system:auth-proxy signed by CN=k3s-request-header-ca@1790088666: notBefore=2026-09-22 13:51:06 +0000 UTC notAfter=2027-09-22 13:51:06 +0000 UTC" machine # [ 15.319258] k3s[879]: time="2026-09-22T14:51:06Z" level=info msg="generated self-signed CA certificate CN=etcd-server-ca@1790088666: notBefore=2026-09-22 13:51:06.34728422 +0000 UTC notAfter=2036-09-19 13:51:06.34728422 +0000 UTC" machine # [ 15.320229] k3s[879]: time="2026-09-22T14:51:06Z" level=info msg="certificate CN=etcd-client signed by CN=etcd-server-ca@1790088666: notBefore=2026-09-22 13:51:06 +0000 UTC notAfter=2027-09-22 13:51:06 +0000 UTC" machine # [ 15.321212] k3s[879]: time="2026-09-22T14:51:06Z" level=info msg="generated self-signed CA certificate CN=etcd-peer-ca@1790088666: notBefore=2026-09-22 13:51:06.348519294 +0000 UTC notAfter=2036-09-19 13:51:06.348519294 +0000 UTC" machine # [ 15.322134] k3s[879]: time="2026-09-22T14:51:06Z" level=info msg="certificate CN=etcd-peer signed by CN=etcd-peer-ca@1790088666: notBefore=2026-09-22 13:51:06 +0000 UTC notAfter=2027-09-22 13:51:06 +0000 UTC" machine # [ 15.322456] k3s[879]: time="2026-09-22T14:51:06Z" level=info msg="certificate CN=etcd-server signed by CN=etcd-server-ca@1790088666: notBefore=2026-09-22 13:51:06 +0000 UTC notAfter=2027-09-22 13:51:06 +0000 UTC" machine # [ 15.433160] k3s[879]: time="2026-09-22T14:51:06Z" level=info msg="certificate CN=k3s,O=k3s signed by CN=k3s-server-ca@1790088666: notBefore=2026-09-22 13:51:06 +0000 UTC notAfter=2027-09-22 13:51:06 +0000 UTC" machine # [ 15.438916] k3s[879]: time="2026-09-22T14:51:06Z" level=warning msg="dynamiclistener [::]:6443: no cached certificate available for preload - deferring certificate load until storage initialization or first client request" machine # [ 15.445401] k3s[879]: time="2026-09-22T14:51:06Z" level=info msg="Active TLS secret / (ver=) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__63b7_820d_553e_9054-389f35:fec0::63b7:820d:553e:9054 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=04C8883B3C018283FDA7F9898E63507DEC77C48A]" machine # [ 16.386832] k3s[879]: time="2026-09-22T14:51:07Z" level=info msg="Password verified locally for node machine" machine # [ 16.388588] k3s[879]: time="2026-09-22T14:51:07Z" level=info msg="certificate CN=machine signed by CN=k3s-server-ca@1790088666: notBefore=2026-09-22 13:51:07 +0000 UTC notAfter=2027-09-22 13:51:07 +0000 UTC" machine # [ 16.507459] rustfs-bucket-start[910]: mb s3://farm machine # [ 16.517731] systemd[1]: Finished rustfs-bucket.service. machine # [ 16.633271] k3s[879]: time="2026-09-22T14:51:07Z" level=info msg="certificate CN=system:node:machine,O=system:nodes signed by CN=k3s-client-ca@1790088666: notBefore=2026-09-22 13:51:07 +0000 UTC notAfter=2027-09-22 13:51:07 +0000 UTC" machine # [ 16.715779] k3s[879]: time="2026-09-22T14:51:07Z" level=info msg="certificate CN=system:kube-proxy signed by CN=k3s-client-ca@1790088666: notBefore=2026-09-22 13:51:07 +0000 UTC notAfter=2027-09-22 13:51:07 +0000 UTC" machine # [ 16.792179] k3s[879]: time="2026-09-22T14:51:07Z" level=info msg="certificate CN=system:k3s-controller signed by CN=k3s-client-ca@1790088666: notBefore=2026-09-22 13:51:07 +0000 UTC notAfter=2027-09-22 13:51:07 +0000 UTC" machine # [ 16.876559] k3s[879]: time="2026-09-22T14:51:07Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:46600: runtime core not ready" machine # [ 16.979216] k3s[879]: time="2026-09-22T14:51:08Z" level=info msg="Module overlay was already loaded" machine # [ 17.227188] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. machine # [ 17.232167] Bridge firewalling registered machine # [ 17.089410] k3s[879]: time="2026-09-22T14:51:08Z" level=warning msg="Failed to load kernel module iptable_nat with modprobe" machine # [ 17.097203] k3s[879]: time="2026-09-22T14:51:08Z" level=warning msg="Failed to load kernel module iptable_filter with modprobe" machine # [ 17.106164] k3s[879]: time="2026-09-22T14:51:08Z" level=warning msg="Failed to load kernel module nft-expr-counter with modprobe" machine # [ 17.172126] k3s[879]: time="2026-09-22T14:51:08Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400" machine # [ 17.173540] k3s[879]: time="2026-09-22T14:51:08Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600" machine # [ 17.175137] k3s[879]: time="2026-09-22T14:51:08Z" level=info msg="Set sysctl 'net/ipv4/conf/all/forwarding' to 1" machine # [ 17.179812] k3s[879]: time="2026-09-22T14:51:08Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_max' to 131072" machine # [ 17.181472] k3s[879]: time="2026-09-22T14:51:08Z" level=info msg="Creating k3s-cert-monitor event broadcaster" machine # [ 17.183288] k3s[879]: time="2026-09-22T14:51:08Z" level=info msg="Connecting to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 17.184075] k3s[879]: time="2026-09-22T14:51:08Z" level=info msg="Saving cluster bootstrap data to datastore" machine # [ 17.184836] k3s[879]: time="2026-09-22T14:51:08Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 17.185961] k3s[879]: time="2026-09-22T14:51:08Z" level=info msg="Connection to etcd is ready" machine # [ 17.187270] k3s[879]: time="2026-09-22T14:51:08Z" level=info msg="ETCD server is now running" machine # [ 17.188160] k3s[879]: time="2026-09-22T14:51:08Z" level=info msg="Handling backend connection request [machine]" machine # [ 17.189064] k3s[879]: time="2026-09-22T14:51:08Z" level=info msg="Connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 17.189937] k3s[879]: time="2026-09-22T14:51:08Z" level=info msg="Polling for API server readiness: GET /readyz failed: the server is currently unable to handle the request" machine # [ 17.191499] k3s[879]: time="2026-09-22T14:51:08Z" level=info msg="Remotedialer connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 17.192342] k3s[879]: time="2026-09-22T14:51:08Z" level=info msg="Running kube-apiserver --advertise-port=6443 --allow-privileged=true --anonymous-auth=false --api-audiences=https://kubernetes.default.svc.cluster.local,k3s --authorization-mode=Node,RBAC --bind-address=127.0.0.1 --cert-dir=/var/lib/rancher/k3s/server/tls/temporary-certs --client-ca-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --egress-selector-config-file=/var/lib/rancher/k3s/server/etc/egress-selector-config.yaml --enable-admission-plugins=NodeRestriction --enable-aggregator-routing=true --enable-bootstrap-token-auth=true --etcd-servers=unix://kine.sock --kubelet-certificate-authority=/var/lib/rancher/k3s/server/tls/server-ca.crt --kubelet-client-certificate=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.crt --kubelet-client-key=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.key --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --profiling=false --proxy-client-cert-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt --proxy-client-key-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.key --requestheader-allowed-names=system:auth-proxy --requestheader-client-ca-file=/var/lib/rancher/k3s/server/tls/request-header-ca.crt --requestheader-extra-headers-prefix=X-Remote-Extra- --requestheader-group-headers=X-Remote-Group --requestheader-username-headers=X-Remote-User --secure-port=6444 --service-account-issuer=https://kubernetes.default.svc.cluster.local --service-account-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-account-signing-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --storage-backend=etcd3 --tls-cert-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --tls-private-key-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 17.193506] k3s[879]: time="2026-09-22T14:51:08Z" level=info msg="Running kube-scheduler --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --bind-address=127.0.0.1 --kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --leader-elect=false --profiling=false --secure-port=10259 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 17.194553] k3s[879]: time="2026-09-22T14:51:08Z" level=info msg="Running kube-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --bind-address=127.0.0.1 --cluster-cidr=10.42.0.0/16 --cluster-signing-kube-apiserver-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kube-apiserver-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kubelet-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-serving-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-kubelet-serving-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --cluster-signing-legacy-unknown-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-legacy-unknown-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --configure-cloud-routes=false --controllers=*,tokencleaner,-service,-route,-cloud-node-lifecycle --kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --leader-elect=false --profiling=false --root-ca-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --secure-port=10257 --service-account-private-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key --use-service-account-credentials=true" machine # [ 17.244634] k3s[879]: time="2026-09-22T14:51:08Z" level=info msg="Running cloud-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --bind-address=127.0.0.1 --cloud-config=/var/lib/rancher/k3s/server/etc/cloud-config.yaml --cloud-provider=k3s --cluster-cidr=10.42.0.0/16 --configure-cloud-routes=false --controllers=*,-route --kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --leader-elect=false --leader-elect-resource-name=k3s-cloud-controller-manager --node-status-update-frequency=1m0s --profiling=false" machine # [ 17.245474] k3s[879]: time="2026-09-22T14:51:08Z" level=info msg="Server node token is available at /var/lib/rancher/k3s/server/token" machine # [ 17.245970] k3s[879]: time="2026-09-22T14:51:08Z" level=info msg="To join server node to cluster: k3s server -s https://10.0.2.15:6443 -t ${SERVER_NODE_TOKEN}" machine # [ 17.246633] k3s[879]: time="2026-09-22T14:51:08Z" level=info msg="Agent node token is available at /var/lib/rancher/k3s/server/agent-token" machine # [ 17.247154] k3s[879]: time="2026-09-22T14:51:08Z" level=info msg="To join agent node to cluster: k3s agent -s https://10.0.2.15:6443 -t ${AGENT_NODE_TOKEN}" machine # [ 17.247614] k3s[879]: time="2026-09-22T14:51:08Z" level=info msg="Wrote kubeconfig /etc/rancher/k3s/k3s.yaml" machine # [ 17.248123] k3s[879]: time="2026-09-22T14:51:08Z" level=info msg="Run: k3s kubectl" machine # [ 17.248617] k3s[879]: I0922 14:51:08.223068 879 options.go:263] external host was not specified, using 10.0.2.15 machine # [ 17.249123] k3s[879]: I0922 14:51:08.226717 879 server.go:158] Version: v1.35.8+k3s1 machine # [ 17.249648] k3s[879]: I0922 14:51:08.226777 879 server.go:160] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 17.252148] k3s[879]: time="2026-09-22T14:51:08Z" level=info msg="Logging containerd to /var/lib/rancher/k3s/agent/containerd/containerd.log" machine # [ 17.252563] k3s[879]: time="2026-09-22T14:51:08Z" level=info msg="Running containerd -c /var/lib/rancher/k3s/agent/etc/containerd/config.toml" machine # [ 17.260049] k3s[879]: time="2026-09-22T14:51:08Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:46654: runtime core not ready" machine # [ 17.350186] k3s[879]: I0922 14:51:08.385185 879 shared_informer.go:349] "Waiting for caches to sync" controller="node_authorizer" machine # [ 17.354657] k3s[879]: I0922 14:51:08.389709 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 17.356280] k3s[879]: I0922 14:51:08.391278 879 plugins.go:157] Loaded 14 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,PodTopologyLabels,MutatingAdmissionPolicy,MutatingAdmissionWebhook. machine # [ 17.356911] k3s[879]: I0922 14:51:08.391313 879 plugins.go:160] Loaded 14 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,NodeDeclaredFeatureValidator,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. machine # [ 17.357567] k3s[879]: I0922 14:51:08.391605 879 instance.go:240] Using reconciler: lease machine # [ 17.363185] k3s[879]: I0922 14:51:08.398230 879 handler.go:304] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager machine # [ 17.363905] k3s[879]: W0922 14:51:08.398252 879 genericapiserver.go:787] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. machine # [ 17.365945] k3s[879]: I0922 14:51:08.401002 879 cidrallocator.go:198] starting ServiceCIDR Allocator Controller machine # [ 17.386162] k3s[879]: time="2026-09-22T14:51:08Z" level=info msg="Running kube-proxy --cluster-cidr=10.42.0.0/16 --conntrack-max-per-core=0 --conntrack-tcp-timeout-close-wait=0s --conntrack-tcp-timeout-established=0s --healthz-bind-address=127.0.0.1 --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubeproxy.kubeconfig --proxy-mode=iptables" machine # [ 17.398598] k3s[879]: I0922 14:51:08.433351 879 handler.go:304] Adding GroupVersion v1 to ResourceManager machine # [ 17.399348] k3s[879]: I0922 14:51:08.434398 879 apis.go:112] API group "internal.apiserver.k8s.io" is not enabled, skipping. machine # [ 17.426689] k3s[879]: I0922 14:51:08.461676 879 apis.go:112] API group "storagemigration.k8s.io" is not enabled, skipping. machine # [ 17.467207] k3s[879]: I0922 14:51:08.502213 879 handler.go:304] Adding GroupVersion authentication.k8s.io v1 to ResourceManager machine # [ 17.467934] k3s[879]: W0922 14:51:08.502243 879 genericapiserver.go:787] Skipping API authentication.k8s.io/v1beta1 because it has no resources. machine # [ 17.468573] k3s[879]: W0922 14:51:08.502254 879 genericapiserver.go:787] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. machine # [ 17.472141] k3s[879]: I0922 14:51:08.507188 879 handler.go:304] Adding GroupVersion authorization.k8s.io v1 to ResourceManager machine # [ 17.472799] k3s[879]: W0922 14:51:08.507209 879 genericapiserver.go:787] Skipping API authorization.k8s.io/v1beta1 because it has no resources. machine # [ 17.476151] k3s[879]: I0922 14:51:08.511183 879 handler.go:304] Adding GroupVersion autoscaling v2 to ResourceManager machine # [ 17.476807] k3s[879]: I0922 14:51:08.511865 879 handler.go:304] Adding GroupVersion autoscaling v1 to ResourceManager machine # [ 17.477463] k3s[879]: W0922 14:51:08.511885 879 genericapiserver.go:787] Skipping API autoscaling/v2beta1 because it has no resources. machine # [ 17.478050] k3s[879]: W0922 14:51:08.511897 879 genericapiserver.go:787] Skipping API autoscaling/v2beta2 because it has no resources. machine # [ 17.482694] k3s[879]: I0922 14:51:08.517735 879 handler.go:304] Adding GroupVersion batch v1 to ResourceManager machine # [ 17.483487] k3s[879]: W0922 14:51:08.517762 879 genericapiserver.go:787] Skipping API batch/v1beta1 because it has no resources. machine # [ 17.483981] k3s[879]: I0922 14:51:08.518342 879 handler.go:304] Adding GroupVersion certificates.k8s.io v1 to ResourceManager machine # [ 17.484625] k3s[879]: W0922 14:51:08.518359 879 genericapiserver.go:787] Skipping API certificates.k8s.io/v1beta1 because it has no resources. machine # [ 17.485094] k3s[879]: W0922 14:51:08.518369 879 genericapiserver.go:787] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. machine # [ 17.485599] k3s[879]: I0922 14:51:08.518703 879 handler.go:304] Adding GroupVersion coordination.k8s.io v1 to ResourceManager machine # [ 17.486080] k3s[879]: W0922 14:51:08.518717 879 genericapiserver.go:787] Skipping API coordination.k8s.io/v1beta1 because it has no resources. machine # [ 17.486589] k3s[879]: W0922 14:51:08.518727 879 genericapiserver.go:787] Skipping API coordination.k8s.io/v1alpha2 because it has no resources. machine # [ 17.487155] k3s[879]: I0922 14:51:08.519080 879 handler.go:304] Adding GroupVersion discovery.k8s.io v1 to ResourceManager machine # [ 17.487609] k3s[879]: W0922 14:51:08.519096 879 genericapiserver.go:787] Skipping API discovery.k8s.io/v1beta1 because it has no resources. machine # [ 17.488117] k3s[879]: I0922 14:51:08.520421 879 handler.go:304] Adding GroupVersion networking.k8s.io v1 to ResourceManager machine # [ 17.488623] k3s[879]: W0922 14:51:08.520439 879 genericapiserver.go:787] Skipping API networking.k8s.io/v1beta1 because it has no resources. machine # [ 17.489140] k3s[879]: I0922 14:51:08.520691 879 handler.go:304] Adding GroupVersion node.k8s.io v1 to ResourceManager machine # [ 17.489441] k3s[879]: W0922 14:51:08.520707 879 genericapiserver.go:787] Skipping API node.k8s.io/v1beta1 because it has no resources. machine # [ 17.489919] k3s[879]: W0922 14:51:08.520717 879 genericapiserver.go:787] Skipping API node.k8s.io/v1alpha1 because it has no resources. machine # [ 17.490588] k3s[879]: I0922 14:51:08.521130 879 handler.go:304] Adding GroupVersion policy v1 to ResourceManager machine # [ 17.491079] k3s[879]: W0922 14:51:08.521144 879 genericapiserver.go:787] Skipping API policy/v1beta1 because it has no resources. machine # [ 17.491553] k3s[879]: I0922 14:51:08.522020 879 handler.go:304] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager machine # [ 17.492061] k3s[879]: W0922 14:51:08.522037 879 genericapiserver.go:787] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. machine # [ 17.492584] k3s[879]: W0922 14:51:08.522049 879 genericapiserver.go:787] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. machine # [ 17.493090] k3s[879]: I0922 14:51:08.522305 879 handler.go:304] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager machine # [ 17.493547] k3s[879]: W0922 14:51:08.522319 879 genericapiserver.go:787] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. machine # [ 17.494061] k3s[879]: W0922 14:51:08.522329 879 genericapiserver.go:787] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. machine # [ 17.494559] k3s[879]: I0922 14:51:08.523648 879 handler.go:304] Adding GroupVersion storage.k8s.io v1 to ResourceManager machine # [ 17.495101] k3s[879]: W0922 14:51:08.523667 879 genericapiserver.go:787] Skipping API storage.k8s.io/v1beta1 because it has no resources. machine # [ 17.495567] k3s[879]: W0922 14:51:08.523678 879 genericapiserver.go:787] Skipping API storage.k8s.io/v1alpha1 because it has no resources. machine # [ 17.496064] k3s[879]: I0922 14:51:08.524331 879 handler.go:304] Adding GroupVersion flowcontrol.apiserver.k8s.io v1 to ResourceManager machine # [ 17.496518] k3s[879]: W0922 14:51:08.524347 879 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta3 because it has no resources. machine # [ 17.497022] k3s[879]: W0922 14:51:08.524358 879 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta2 because it has no resources. machine # [ 17.497536] k3s[879]: W0922 14:51:08.524369 879 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. machine # [ 17.498022] k3s[879]: I0922 14:51:08.526801 879 handler.go:304] Adding GroupVersion apps v1 to ResourceManager machine # [ 17.498498] k3s[879]: W0922 14:51:08.526820 879 genericapiserver.go:787] Skipping API apps/v1beta2 because it has no resources. machine # [ 17.499023] k3s[879]: W0922 14:51:08.526833 879 genericapiserver.go:787] Skipping API apps/v1beta1 because it has no resources. machine # [ 17.499554] k3s[879]: I0922 14:51:08.528963 879 handler.go:304] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager machine # [ 17.500059] k3s[879]: W0922 14:51:08.528982 879 genericapiserver.go:787] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. machine # [ 17.500539] k3s[879]: W0922 14:51:08.528993 879 genericapiserver.go:787] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. machine # [ 17.501036] k3s[879]: I0922 14:51:08.529705 879 handler.go:304] Adding GroupVersion events.k8s.io v1 to ResourceManager machine # [ 17.501578] k3s[879]: W0922 14:51:08.529721 879 genericapiserver.go:787] Skipping API events.k8s.io/v1beta1 because it has no resources. machine # [ 17.502081] k3s[879]: I0922 14:51:08.531965 879 handler.go:304] Adding GroupVersion resource.k8s.io v1 to ResourceManager machine # [ 17.502549] k3s[879]: W0922 14:51:08.531983 879 genericapiserver.go:787] Skipping API resource.k8s.io/v1beta2 because it has no resources. machine # [ 17.503076] k3s[879]: W0922 14:51:08.531995 879 genericapiserver.go:787] Skipping API resource.k8s.io/v1beta1 because it has no resources. machine # [ 17.503596] k3s[879]: W0922 14:51:08.532004 879 genericapiserver.go:787] Skipping API resource.k8s.io/v1alpha3 because it has no resources. machine # [ 17.504153] k3s[879]: I0922 14:51:08.534920 879 handler.go:304] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager machine # [ 17.504652] k3s[879]: W0922 14:51:08.534940 879 genericapiserver.go:787] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. machine # [ 17.833195] k3s[879]: I0922 14:51:08.866765 879 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 17.833583] k3s[879]: I0922 14:51:08.866814 879 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 17.834027] k3s[879]: I0922 14:51:08.867138 879 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 17.834535] k3s[879]: I0922 14:51:08.867213 879 secure_serving.go:211] Serving securely on 127.0.0.1:6444 machine # [ 17.835023] k3s[879]: I0922 14:51:08.867369 879 system_namespaces_controller.go:66] Starting system namespaces controller machine # [ 17.835329] k3s[879]: I0922 14:51:08.867497 879 cluster_authentication_trust_controller.go:459] Starting cluster_authentication_trust_controller controller machine # [ 17.835803] k3s[879]: time="2026-09-22T14:51:08Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 17.838105] k3s[879]: I0922 14:51:08.867553 879 controller.go:78] Starting OpenAPI AggregationController machine # [ 17.838761] k3s[879]: I0922 14:51:08.867605 879 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 17.839409] k3s[879]: I0922 14:51:08.867774 879 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 17.839902] k3s[879]: I0922 14:51:08.867809 879 remote_available_controller.go:425] Starting RemoteAvailability controller machine # [ 17.849482] k3s[879]: I0922 14:51:08.867826 879 cache.go:32] Waiting for caches to sync for RemoteAvailability controller machine # [ 17.850105] k3s[879]: I0922 14:51:08.867887 879 apf_controller.go:377] Starting API Priority and Fairness config controller machine # [ 17.850422] k3s[879]: I0922 14:51:08.867914 879 customresource_discovery_controller.go:294] Starting DiscoveryController machine # [ 17.850936] k3s[879]: I0922 14:51:08.868043 879 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 17.851606] k3s[879]: time="2026-09-22T14:51:08Z" level=info msg="Starting legacy_token_tracking_controller" logger=k3s machine # [ 17.852076] k3s[879]: time="2026-09-22T14:51:08Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 17.852581] k3s[879]: I0922 14:51:08.868228 879 controller.go:113] "Deleting old lease on startup" lease="kube-system/apiserver-ik4pcwfs7qgdl76byc4pomgvia" machine # [ 17.853159] k3s[879]: time="2026-09-22T14:51:08Z" level=info msg="Starting apiserver lease garbage collector" logger=k3s machine # [ 17.853600] k3s[879]: time="2026-09-22T14:51:08Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 17.854085] k3s[879]: I0922 14:51:08.871565 879 local_available_controller.go:156] Starting LocalAvailability controller machine # [ 17.854576] k3s[879]: I0922 14:51:08.871584 879 cache.go:32] Waiting for caches to sync for LocalAvailability controller machine # [ 17.855061] k3s[879]: I0922 14:51:08.871803 879 aggregator.go:185] waiting for initial CRD sync... machine # [ 17.855577] k3s[879]: I0922 14:51:08.871857 879 controller.go:142] Starting OpenAPI controller machine # [ 17.856090] k3s[879]: I0922 14:51:08.871923 879 controller.go:90] Starting OpenAPI V3 controller machine # [ 17.856568] k3s[879]: I0922 14:51:08.871957 879 naming_controller.go:305] Starting NamingConditionController machine # [ 17.857051] k3s[879]: I0922 14:51:08.872081 879 nonstructuralschema_controller.go:202] Starting NonStructuralSchemaConditionController machine # [ 17.857569] k3s[879]: I0922 14:51:08.872131 879 apiapproval_controller.go:196] Starting KubernetesAPIApprovalPolicyConformantConditionController machine # [ 17.858101] k3s[879]: I0922 14:51:08.872164 879 crd_finalizer.go:273] Starting CRDFinalizer machine # [ 17.858645] k3s[879]: I0922 14:51:08.872217 879 crdregistration_controller.go:114] Starting crd-autoregister controller machine # [ 17.859161] k3s[879]: I0922 14:51:08.872233 879 shared_informer.go:349] "Waiting for caches to sync" controller="crd-autoregister" machine # [ 17.859623] k3s[879]: I0922 14:51:08.872732 879 dynamic_serving_content.go:135] "Starting controller" name="aggregator-proxy-cert::/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt::/var/lib/rancher/k3s/server/tls/client-auth-proxy.key" machine # [ 17.860105] k3s[879]: I0922 14:51:08.872987 879 apiservice_controller.go:100] Starting APIServiceRegistrationController machine # [ 17.860589] k3s[879]: I0922 14:51:08.873002 879 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller machine # [ 17.861094] k3s[879]: I0922 14:51:08.873063 879 controller.go:80] Starting OpenAPI V3 AggregationController machine # [ 17.861622] k3s[879]: I0922 14:51:08.884352 879 default_servicecidr_controller.go:110] Starting kubernetes-service-cidr-controller machine # [ 17.862100] k3s[879]: I0922 14:51:08.884380 879 shared_informer.go:349] "Waiting for caches to sync" controller="kubernetes-service-cidr-controller" machine # [ 17.889645] k3s[879]: I0922 14:51:08.924664 879 repairip.go:210] Starting ipallocator-repair-controller machine # [ 17.890510] k3s[879]: I0922 14:51:08.924698 879 shared_informer.go:349] "Waiting for caches to sync" controller="ipallocator-repair-controller" machine # [ 17.932979] k3s[879]: time="2026-09-22T14:51:08Z" level=info msg="Caches are synced" logger=k3s machine # [ 17.934268] k3s[879]: I0922 14:51:08.968048 879 apf_controller.go:382] Running API Priority and Fairness config worker machine # [ 17.936082] k3s[879]: I0922 14:51:08.968074 879 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process machine # [ 17.936707] k3s[879]: I0922 14:51:08.968182 879 cache.go:39] Caches are synced for RemoteAvailability controller machine # [ 17.937230] k3s[879]: time="2026-09-22T14:51:08Z" level=info msg="Caches are synced" logger=k3s machine # [ 17.937752] k3s[879]: time="2026-09-22T14:51:08Z" level=info msg="Caches are synced" logger=k3s machine # [ 17.938463] k3s[879]: I0922 14:51:08.972788 879 shared_informer.go:356] "Caches are synced" controller="crd-autoregister" machine # [ 17.938966] k3s[879]: I0922 14:51:08.972852 879 cache.go:39] Caches are synced for LocalAvailability controller machine # [ 17.939297] k3s[879]: I0922 14:51:08.973007 879 aggregator.go:187] initial CRD sync complete... machine # [ 17.939809] k3s[879]: I0922 14:51:08.973024 879 autoregister_controller.go:144] Starting autoregister controller machine # [ 17.940534] k3s[879]: I0922 14:51:08.973039 879 cache.go:32] Waiting for caches to sync for autoregister controller machine # [ 17.941051] k3s[879]: I0922 14:51:08.973050 879 cache.go:39] Caches are synced for autoregister controller machine # [ 17.941594] k3s[879]: I0922 14:51:08.973612 879 cache.go:39] Caches are synced for APIServiceRegistrationController controller machine # [ 17.942110] k3s[879]: I0922 14:51:08.973664 879 handler_discovery.go:451] Starting ResourceDiscoveryManager machine # [ 17.951896] k3s[879]: I0922 14:51:08.986909 879 shared_informer.go:356] "Caches are synced" controller="node_authorizer" machine # [ 17.956213] k3s[879]: I0922 14:51:08.991255 879 shared_informer.go:377] "Caches are synced" machine # [ 17.956789] k3s[879]: I0922 14:51:08.991289 879 policy_source.go:248] refreshing policies machine # [ 17.962620] k3s[879]: E0922 14:51:08.997654 879 controller.go:201] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" machine # [ 17.988194] k3s[879]: I0922 14:51:09.023094 879 shared_informer.go:356] "Caches are synced" controller="kubernetes-service-cidr-controller" machine # [ 17.988866] k3s[879]: I0922 14:51:09.023207 879 default_servicecidr_controller.go:169] Creating default ServiceCIDR with CIDRs: [10.43.0.0/16] machine # [ 17.991599] k3s[879]: I0922 14:51:09.026596 879 shared_informer.go:356] "Caches are synced" controller="ipallocator-repair-controller" machine # [ 17.992638] k3s[879]: time="2026-09-22T14:51:09Z" level=error msg="Error while syncing ConfigMap" configmap=kube-system/kube-apiserver-legacy-service-account-token-tracking error="namespaces \"kube-system\" not found" logger=k3s/UnhandledError machine # [ 17.998535] k3s[879]: E0922 14:51:09.032445 879 controller.go:95] Unable to perform initial Kubernetes service initialization: namespaces "default" not found machine # [ 17.999664] k3s[879]: I0922 14:51:09.032449 879 default_servicecidr_controller.go:231] Setting default ServiceCIDR condition Ready to True machine # [ 18.000491] k3s[879]: I0922 14:51:09.032697 879 cidrallocator.go:302] created ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 18.006390] k3s[879]: I0922 14:51:09.041450 879 default_servicecidr_controller.go:231] Setting default ServiceCIDR condition Ready to True machine # [ 18.007222] k3s[879]: I0922 14:51:09.041821 879 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 18.037879] k3s[879]: I0922 14:51:09.072854 879 controller.go:667] quota admission added evaluator for: namespaces machine # [ 18.166587] k3s[879]: I0922 14:51:09.201516 879 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io machine # [ 18.215640] k3s[879]: time="2026-09-22T14:51:09Z" level=info msg="containerd is now running" machine # [ 18.223729] k3s[879]: time="2026-09-22T14:51:09Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/k3s-airgap-images-amd64.tar.zst" machine # [ 18.843056] k3s[879]: I0922 14:51:09.877657 879 storage_scheduling.go:123] created PriorityClass system-node-critical with value 2000001000 machine # [ 18.846642] k3s[879]: I0922 14:51:09.881636 879 storage_scheduling.go:123] created PriorityClass system-cluster-critical with value 2000000000 machine # [ 18.847453] k3s[879]: I0922 14:51:09.881658 879 storage_scheduling.go:139] all system priority classes are created successfully or already exist. machine # [ 19.183788] k3s[879]: time="2026-09-22T14:51:10Z" level=info msg="Polling for API server readiness: GET /readyz failed: unknown" machine # [ 19.860888] k3s[879]: I0922 14:51:10.895545 879 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io machine # [ 19.896982] k3s[879]: I0922 14:51:10.932013 879 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io machine # [ 20.012305] k3s[879]: I0922 14:51:11.046963 879 alloc.go:329] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.43.0.1"} machine # [ 20.027220] k3s[879]: W0922 14:51:11.062174 879 lease.go:265] Resetting endpoints for master service "kubernetes" to [10.0.2.15] machine # [ 20.033196] k3s[879]: I0922 14:51:11.068148 879 controller.go:667] quota admission added evaluator for: endpoints machine # [ 20.042587] k3s[879]: I0922 14:51:11.077525 879 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io machine # [ 21.190995] k3s[879]: time="2026-09-22T14:51:12Z" level=info msg="Waiting for untainted node" machine # [ 21.193846] k3s[879]: time="2026-09-22T14:51:12Z" level=info msg="Creating k3s-supervisor event broadcaster" machine # [ 21.195069] k3s[879]: time="2026-09-22T14:51:12Z" level=info msg="Kube API server is now running" machine # [ 21.196414] k3s[879]: time="2026-09-22T14:51:12Z" level=info msg="k3s is up and running" machine # [ 21.198738] systemd[1]: Started k3s service. machine # [ 21.205653] systemd[1]: Starting niks3 server... machine # [ 21.214156] k3s[879]: time="2026-09-22T14:51:12Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Node and Certificate Authority certificates managed by k3s are OK" object=machine reason=CertificateExpirationOK type=Normal machine # [ 21.228111] k3s[879]: I0922 14:51:12.263147 879 controllermanager.go:189] "Starting" version="v1.35.8+k3s1" machine # [ 21.228939] k3s[879]: I0922 14:51:12.263178 879 controllermanager.go:191] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 21.236700] k3s[879]: I0922 14:51:12.271503 879 secure_serving.go:211] Serving securely on 127.0.0.1:10257 machine # [ 21.237690] k3s[879]: I0922 14:51:12.272006 879 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key" machine # [ 21.238238] k3s[879]: I0922 14:51:12.272090 879 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 21.238873] k3s[879]: I0922 14:51:12.273142 879 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 21.240303] k3s[879]: I0922 14:51:12.273164 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 21.242978] k3s[879]: I0922 14:51:12.277863 879 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 21.243590] k3s[879]: I0922 14:51:12.277890 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 21.244087] k3s[879]: I0922 14:51:12.277984 879 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 21.244611] k3s[879]: I0922 14:51:12.278001 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 21.263060] k3s[879]: I0922 14:51:12.298013 879 controller.go:667] quota admission added evaluator for: serviceaccounts machine: (finished: waiting for unit k3s.service, in 22.13 seconds) machine: waiting for success: kubectl get ns farm machine # [ 21.292083] k3s[879]: I0922 14:51:12.326143 879 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="podcertificaterequest-cleaner-controller" requiredFeatureGates=["PodCertificateRequest"] machine # [ 21.292782] k3s[879]: I0922 14:51:12.326189 879 controllermanager.go:579] "Warning: skipping controller" controller="podcertificaterequest-cleaner-controller" machine # [ 21.293459] k3s[879]: I0922 14:51:12.326201 879 controllermanager.go:627] "Warning: controller is disabled" controller="bootstrap-signer-controller" machine # [ 21.310977] k3s[879]: I0922 14:51:12.346015 879 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="device-taint-eviction-controller" requiredFeatureGates=["DynamicResourceAllocation","DRADeviceTaints"] machine # [ 21.311891] k3s[879]: I0922 14:51:12.346865 879 controllermanager.go:579] "Warning: skipping controller" controller="device-taint-eviction-controller" machine # [ 21.312746] k3s[879]: I0922 14:51:12.346884 879 controllermanager.go:627] "Warning: controller is disabled" controller="service-lb-controller" machine # [ 21.329585] k3s[879]: time="2026-09-22T14:51:12Z" level=info msg="Creating embedded CRD addons.k3s.cattle.io" machine # [ 21.337277] k3s[879]: I0922 14:51:12.372318 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 21.339153] k3s[879]: time="2026-09-22T14:51:12Z" level=info msg="Creating embedded CRD etcdsnapshotfiles.k3s.cattle.io" machine # [ 21.372090] k3s[879]: I0922 14:51:12.405630 879 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 21.372813] k3s[879]: time="2026-09-22T14:51:12Z" level=info msg="Creating embedded CRD helmcharts.helm.cattle.io" machine # [ 21.383187] k3s[879]: I0922 14:51:12.418224 879 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 21.398633] k3s[879]: time="2026-09-22T14:51:12Z" level=info msg="Creating embedded CRD helmchartconfigs.helm.cattle.io" machine # [ 21.428449] k3s[879]: time="2026-09-22T14:51:12Z" level=info msg="Waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 21.429171] k3s[879]: I0922 14:51:12.462721 879 shared_informer.go:377] "Caches are synced" machine # [ 21.429576] k3s[879]: I0922 14:51:12.462803 879 shared_informer.go:377] "Caches are synced" machine # [ 21.438639] k3s[879]: I0922 14:51:12.473479 879 shared_informer.go:377] "Caches are synced" machine # [ 21.471847] k3s[879]: I0922 14:51:12.506765 879 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 21.481892] k3s[879]: I0922 14:51:12.516591 879 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="storageversion-garbage-collector-controller" requiredFeatureGates=["APIServerIdentity","StorageVersionAPI"] machine # [ 21.483211] k3s[879]: I0922 14:51:12.518226 879 controllermanager.go:579] "Warning: skipping controller" controller="storageversion-garbage-collector-controller" machine # [ 21.486923] k3s[879]: I0922 14:51:12.521822 879 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # Error from server (NotFound): namespaces "farm" not found machine # [ 21.537806] k3s[879]: I0922 14:51:12.572815 879 shared_informer.go:377] "Caches are synced" machine # [ 21.884303] k3s[879]: time="2026-09-22T14:51:12Z" level=info msg="Imported docker.io/rancher/klipper-helm:v0.13.3-build20260727" machine # [ 21.887611] k3s[879]: time="2026-09-22T14:51:12Z" level=info msg="Tagged docker.io/rancher/klipper-helm@sha256:5425a2b4613d2458dbdff99218e8d487ebb59c20e7a941f061c0777070f0aac1" machine # [ 21.888531] k3s[879]: time="2026-09-22T14:51:12Z" level=info msg="Imported docker.io/rancher/klipper-lb:v0.4.17" machine # [ 21.892586] k3s[879]: time="2026-09-22T14:51:12Z" level=info msg="Tagged docker.io/rancher/klipper-lb@sha256:910944bb0bd94f060a82a56ca1ea1c577d3e49b3473a093a47a985f32e92d94a" machine # [ 21.893471] k3s[879]: time="2026-09-22T14:51:12Z" level=info msg="Imported docker.io/rancher/local-path-provisioner:v0.0.37" machine # [ 21.898565] k3s[879]: time="2026-09-22T14:51:12Z" level=info msg="Tagged docker.io/rancher/local-path-provisioner@sha256:e757967a5ec338f6a9b371c5a9688bedaa8c3578ea3dd4db329ea0084be0a86f" machine # [ 21.899476] k3s[879]: time="2026-09-22T14:51:12Z" level=info msg="Imported docker.io/rancher/mirrored-coredns-coredns:1.14.6" machine # [ 21.903920] k3s[879]: time="2026-09-22T14:51:12Z" level=info msg="Tagged docker.io/rancher/mirrored-coredns-coredns@sha256:900f9c109f7a33545d3c811516e8376df9019147b750f5ce3e254468769176ea" machine # [ 21.906763] k3s[879]: time="2026-09-22T14:51:12Z" level=info msg="Imported docker.io/rancher/mirrored-library-busybox:1.37.0" machine # [ 21.907677] k3s[879]: time="2026-09-22T14:51:12Z" level=info msg="Tagged docker.io/rancher/mirrored-library-busybox@sha256:101b4afd76732482eff9b95cae5f94bcf295e521fbec4e01b69c5421f3f3f3e5" machine # [ 21.909023] k3s[879]: time="2026-09-22T14:51:12Z" level=info msg="Imported docker.io/rancher/mirrored-library-traefik:3.7.8" machine # [ 21.911355] k3s[879]: time="2026-09-22T14:51:12Z" level=info msg="Tagged docker.io/rancher/mirrored-library-traefik@sha256:4299bbed850421258fc5448c2e0e6ad350981d4d335a68de11b92448aedbefe5" machine # [ 21.912546] k3s[879]: time="2026-09-22T14:51:12Z" level=info msg="Imported docker.io/rancher/mirrored-metrics-server:v0.9.0" machine # [ 21.916946] k3s[879]: time="2026-09-22T14:51:12Z" level=info msg="Tagged docker.io/rancher/mirrored-metrics-server@sha256:d9862115e7c7881280d3d75ca26bda8ffc0fc213315979575bf23ce9826205c0" machine # [ 21.917952] k3s[879]: time="2026-09-22T14:51:12Z" level=info msg="Imported docker.io/rancher/mirrored-pause:3.10.2" machine # [ 21.920654] k3s[879]: time="2026-09-22T14:51:12Z" level=info msg="Tagged docker.io/rancher/mirrored-pause@sha256:f548e0e8e3dc1896ca956272154dde3314e8cc4fde0a57577ee9fa1c63f5baf4" machine # [ 21.951553] k3s[879]: time="2026-09-22T14:51:12Z" level=info msg="Done waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 21.952262] k3s[879]: time="2026-09-22T14:51:12Z" level=info msg="Waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 21.957643] k3s[879]: time="2026-09-22T14:51:12Z" level=info msg="Done waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 21.959461] k3s[879]: time="2026-09-22T14:51:12Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-40.1.4+up40.1.0.tgz" machine # [ 21.960111] k3s[879]: time="2026-09-22T14:51:12Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-crd-40.1.4+up40.1.0.tgz" machine # [ 21.960688] k3s[879]: time="2026-09-22T14:51:12Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/ccm.yaml" machine # [ 21.961471] k3s[879]: time="2026-09-22T14:51:12Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/coredns.yaml" machine # [ 21.961924] k3s[879]: time="2026-09-22T14:51:12Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/local-storage.yaml" machine # [ 21.962625] k3s[879]: time="2026-09-22T14:51:12Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/rolebindings.yaml" machine # [ 21.963150] k3s[879]: time="2026-09-22T14:51:12Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/runtimes.yaml" machine # [ 21.963635] k3s[879]: time="2026-09-22T14:51:12Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/traefik.yaml" machine # [ 22.061405] k3s[879]: time="2026-09-22T14:51:13Z" level=info msg="Starting dynamiclistener CN filter node controller with SANs: [127.0.0.1 ::1 localhost machine 10.0.2.15 fec0::63b7:820d:553e:9054 10.43.0.1 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local]" machine # [ 22.065084] k3s[879]: time="2026-09-22T14:51:13Z" level=info msg="Tunnel server egress proxy mode: agent" machine # [ 22.144403] k3s[879]: time="2026-09-22T14:51:13Z" level=info msg="Imported 8 images from /var/lib/rancher/k3s/agent/images/k3s-airgap-images-amd64.tar.zst in 3.920995824s" machine # [ 22.146576] k3s[879]: time="2026-09-22T14:51:13Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-client.tar" machine # [ 22.434224] k3s[879]: time="2026-09-22T14:51:13Z" level=info msg="Creating new TLS secret for kube-system/k3s-serving (count: 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__63b7_820d_553e_9054-389f35:fec0::63b7:820d:553e:9054 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=04C8883B3C018283FDA7F9898E63507DEC77C48A]" machine # [ 22.451673] k3s[879]: time="2026-09-22T14:51:13Z" level=info msg="Active TLS secret kube-system/k3s-serving (ver=235) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__63b7_820d_553e_9054-389f35:fec0::63b7:820d:553e:9054 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=04C8883B3C018283FDA7F9898E63507DEC77C48A]" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 23.064731] k3s[879]: I0922 14:51:14.099677 879 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" requiredFeatureGates=["ClusterTrustBundle"] machine # [ 23.066290] k3s[879]: I0922 14:51:14.099737 879 controllermanager.go:579] "Warning: skipping controller" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" machine # [ 23.272951] k3s[879]: time="2026-09-22T14:51:14Z" level=info msg="Starting k3s.cattle.io/v1, Kind=Addon controller" machine # [ 23.275148] k3s[879]: time="2026-09-22T14:51:14Z" level=info msg="Creating deploy event broadcaster" machine # [ 23.279774] k3s[879]: I0922 14:51:14.314697 879 controller.go:667] quota admission added evaluator for: addons.k3s.cattle.io machine # [ 23.282929] k3s[879]: time="2026-09-22T14:51:14Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 23.287069] k3s[879]: time="2026-09-22T14:51:14Z" level=info msg="Creating helm-controller event broadcaster" machine # [ 23.291309] k3s[879]: time="2026-09-22T14:51:14Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 23.306844] k3s[879]: time="2026-09-22T14:51:14Z" level=info msg="Cluster dns configmap has been set successfully" machine # [ 23.308873] k3s[879]: time="2026-09-22T14:51:14Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=ApplyingManifest type=Normal machine # [ 23.373216] k3s[879]: I0922 14:51:14.408028 879 controllermanager.go:579] "Warning: skipping controller" controller="storage-version-migrator-controller" machine # [ 23.666489] k3s[879]: I0922 14:51:14.701132 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="horizontalpodautoscalers.autoscaling" machine # [ 23.667267] k3s[879]: I0922 14:51:14.701189 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpointslices.discovery.k8s.io" machine # [ 23.667707] k3s[879]: I0922 14:51:14.701235 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="csistoragecapacities.storage.k8s.io" machine # [ 23.667958] k3s[879]: I0922 14:51:14.701343 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="deployments.apps" machine # [ 23.668653] k3s[879]: I0922 14:51:14.701406 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmcharts.helm.cattle.io" machine # [ 23.669511] k3s[879]: I0922 14:51:14.701434 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="replicasets.apps" machine # [ 23.670026] k3s[879]: I0922 14:51:14.701466 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="jobs.batch" machine # [ 23.670618] k3s[879]: I0922 14:51:14.701496 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="roles.rbac.authorization.k8s.io" machine # [ 23.671195] k3s[879]: I0922 14:51:14.701523 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="leases.coordination.k8s.io" machine # [ 23.671749] k3s[879]: I0922 14:51:14.701549 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="daemonsets.apps" machine # [ 23.672472] k3s[879]: I0922 14:51:14.701613 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="rolebindings.rbac.authorization.k8s.io" machine # [ 23.692916] k3s[879]: I0922 14:51:14.727740 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="limitranges" machine # [ 23.693667] k3s[879]: I0922 14:51:14.727866 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="podtemplates" machine # [ 23.694062] k3s[879]: I0922 14:51:14.727911 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="resourceclaimtemplates.resource.k8s.io" machine # [ 23.694607] k3s[879]: I0922 14:51:14.727945 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmchartconfigs.helm.cattle.io" machine # [ 23.695193] k3s[879]: I0922 14:51:14.727992 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="addons.k3s.cattle.io" machine # [ 23.695790] k3s[879]: I0922 14:51:14.728021 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="ingresses.networking.k8s.io" machine # [ 23.696497] k3s[879]: I0922 14:51:14.728051 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="poddisruptionbudgets.policy" machine # [ 23.708838] k3s[879]: I0922 14:51:14.743855 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="controllerrevisions.apps" machine # [ 23.709627] k3s[879]: I0922 14:51:14.743909 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="serviceaccounts" machine # [ 23.710102] k3s[879]: I0922 14:51:14.743957 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="cronjobs.batch" machine # [ 23.710558] k3s[879]: I0922 14:51:14.743998 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="networkpolicies.networking.k8s.io" machine # [ 23.711047] k3s[879]: I0922 14:51:14.744027 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpoints" machine # [ 23.711528] k3s[879]: I0922 14:51:14.744080 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="statefulsets.apps" machine # [ 23.816373] k3s[879]: time="2026-09-22T14:51:14Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=AppliedManifest type=Normal machine # [ 23.828469] k3s[879]: time="2026-09-22T14:51:14Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=ApplyingManifest type=Normal machine # Error from server (NotFound): namespaces "farm" not found machine # [ 23.860452] k3s[879]: I0922 14:51:14.895467 879 node_lifecycle_controller.go:419] "Controller will reconcile labels" logger="node-lifecycle-controller" machine # [ 24.169276] k3s[879]: time="2026-09-22T14:51:15Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=AppliedManifest type=Normal machine # [ 24.178299] k3s[879]: time="2026-09-22T14:51:15Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=ApplyingManifest type=Normal machine # [ 24.247573] k3s[879]: I0922 14:51:15.282578 879 serving.go:392] Generated self-signed cert in-memory machine # [ 24.285631] k3s[879]: time="2026-09-22T14:51:15Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 24.328472] k3s[879]: I0922 14:51:15.363471 879 serving.go:392] Generated self-signed cert in-memory machine # [ 24.360409] k3s[879]: I0922 14:51:15.395410 879 controllermanager.go:627] "Warning: controller is disabled" controller="node-route-controller" machine # [ 24.390924] k3s[879]: I0922 14:51:15.425919 879 controllermanager.go:160] Version: v1.35.8+k3s1 machine # [ 24.397066] k3s[879]: I0922 14:51:15.429409 879 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 24.397726] k3s[879]: I0922 14:51:15.429439 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 24.398313] k3s[879]: I0922 14:51:15.429446 879 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 24.398887] k3s[879]: I0922 14:51:15.429483 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 24.399427] k3s[879]: I0922 14:51:15.429480 879 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 24.399944] k3s[879]: I0922 14:51:15.429528 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 24.400521] k3s[879]: I0922 14:51:15.429767 879 secure_serving.go:211] Serving securely on 127.0.0.1:10258 machine # [ 24.401052] k3s[879]: I0922 14:51:15.429881 879 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 24.412568] k3s[879]: time="2026-09-22T14:51:15Z" level=info msg="Creating service-lb-controller event broadcaster" machine # [ 24.504390] k3s[879]: time="2026-09-22T14:51:15Z" level=info msg="Starting rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding controller" machine # [ 24.509478] k3s[879]: time="2026-09-22T14:51:15Z" level=info msg="Starting batch/v1, Kind=Job controller" machine # [ 24.510157] k3s[879]: time="2026-09-22T14:51:15Z" level=info msg="Starting /v1, Kind=Secret controller" machine # [ 24.510620] k3s[879]: time="2026-09-22T14:51:15Z" level=info msg="Starting /v1, Kind=ConfigMap controller" machine # [ 24.516059] k3s[879]: time="2026-09-22T14:51:15Z" level=info msg="Starting /v1, Kind=ServiceAccount controller" machine # [ 24.516718] k3s[879]: W0922 14:51:15.551024 879 probe.go:272] Flexvolume plugin directory at /usr/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating. machine # [ 24.525151] k3s[879]: time="2026-09-22T14:51:15Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChartConfig controller" machine # [ 24.526918] k3s[879]: time="2026-09-22T14:51:15Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChart controller" machine # [ 24.595464] k3s[879]: I0922 14:51:15.630460 879 shared_informer.go:377] "Caches are synced" machine # [ 24.596193] k3s[879]: I0922 14:51:15.630514 879 shared_informer.go:377] "Caches are synced" machine # [ 24.596802] k3s[879]: I0922 14:51:15.630538 879 shared_informer.go:377] "Caches are synced" machine # [ 24.727782] k3s[879]: time="2026-09-22T14:51:15Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 24.732290] k3s[879]: time="2026-09-22T14:51:15Z" level=info msg="Starting /v1, Kind=Pod controller" machine # [ 24.736296] k3s[879]: time="2026-09-22T14:51:15Z" level=info msg="Starting apps/v1, Kind=DaemonSet controller" machine # [ 24.741044] k3s[879]: W0922 14:51:15.776074 879 controllermanager.go:306] "node-route-controller" is disabled machine # [ 24.741709] k3s[879]: I0922 14:51:15.776462 879 controllermanager.go:329] Started "cloud-node-controller" machine # [ 24.742174] k3s[879]: I0922 14:51:15.776665 879 controllermanager.go:329] Started "cloud-node-lifecycle-controller" machine # [ 24.742755] k3s[879]: I0922 14:51:15.777128 879 controllermanager.go:329] Started "service-lb-controller" machine # [ 24.743467] k3s[879]: I0922 14:51:15.777134 879 node_controller.go:176] Sending events to api server. machine # [ 24.744274] k3s[879]: I0922 14:51:15.777247 879 node_controller.go:185] Waiting for informer caches to sync machine # [ 24.744756] k3s[879]: I0922 14:51:15.777324 879 node_lifecycle_controller.go:112] Sending events to api server machine # [ 24.745507] k3s[879]: I0922 14:51:15.777604 879 controller.go:235] Starting service controller machine # [ 24.745930] k3s[879]: I0922 14:51:15.777626 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 24.752141] k3s[879]: time="2026-09-22T14:51:15Z" level=info msg="Starting discovery.k8s.io/v1, Kind=EndpointSlice controller" machine # [ 24.819880] k3s[879]: I0922 14:51:15.854730 879 controller.go:667] quota admission added evaluator for: deployments.apps machine: (finished: waiting for success: kubectl get ns farm, in 3.73 seconds) machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key machine # [ 25.146434] k3s[879]: I0922 14:51:16.181377 879 range_allocator.go:113] "No Secondary Service CIDR provided. Skipping filtering out secondary service addresses" logger="node-ipam-controller" machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key, in 0.14 seconds) machine # [ 25.154116] k3s[879]: I0922 14:51:16.189159 879 alloc.go:329] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.43.0.10"} machine: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key machine # [ 25.156020] k3s[879]: time="2026-09-22T14:51:16Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=AppliedManifest type=Normal machine # [ 25.243122] k3s[879]: I0922 14:51:16.278087 879 shared_informer.go:377] "Caches are synced" machine # [ 25.284584] k3s[879]: time="2026-09-22T14:51:16Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine: (finished: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key, in 0.14 seconds) machine: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine: (finished: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.12 seconds) subtest: chart deploys and workers become Ready machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 25.762178] k3s[879]: time="2026-09-22T14:51:16Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" object=kube-system/local-storage reason=DeletingManifest type=Normal machine # [ 25.771953] k3s[879]: time="2026-09-22T14:51:16Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=ApplyingManifest type=Normal machine # [ 25.811323] k3s[879]: I0922 14:51:16.846267 879 controllermanager.go:627] "Warning: controller is disabled" controller="cloud-node-lifecycle-controller" machine # [ 25.812028] k3s[879]: I0922 14:51:16.846292 879 controllermanager.go:627] "Warning: controller is disabled" controller="selinux-warning-controller" machine # [ 25.816077] k3s[879]: I0922 14:51:16.848923 879 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-legacy-unknown" machine # [ 25.816695] k3s[879]: I0922 14:51:16.848947 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.817184] k3s[879]: I0922 14:51:16.849315 879 replica_set.go:241] "Starting controller" name="replicaset" machine # [ 25.817646] k3s[879]: I0922 14:51:16.849349 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.818131] k3s[879]: I0922 14:51:16.849373 879 tokencleaner.go:117] "Starting token cleaner controller" machine # [ 25.818619] k3s[879]: I0922 14:51:16.849390 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.819088] k3s[879]: I0922 14:51:16.849494 879 pv_controller_base.go:307] "Starting persistent volume controller" machine # [ 25.819605] k3s[879]: I0922 14:51:16.849509 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.823092] k3s[879]: I0922 14:51:16.849591 879 endpointslice_controller.go:283] "Starting endpoint slice controller" machine # [ 25.823653] k3s[879]: I0922 14:51:16.849605 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.824139] k3s[879]: I0922 14:51:16.849667 879 replica_set.go:241] "Starting controller" name="replicationcontroller" machine # [ 25.824584] k3s[879]: I0922 14:51:16.849681 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.825065] k3s[879]: I0922 14:51:16.849730 879 namespace_controller.go:202] "Starting namespace controller" machine # [ 25.825531] k3s[879]: I0922 14:51:16.849744 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.826041] k3s[879]: I0922 14:51:16.849807 879 daemon_controller.go:309] "Starting daemon sets controller" machine # [ 25.826490] k3s[879]: I0922 14:51:16.849821 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.826960] k3s[879]: I0922 14:51:16.849855 879 publisher.go:107] "Starting root CA cert publisher controller" machine # [ 25.827626] k3s[879]: I0922 14:51:16.849874 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.831092] k3s[879]: I0922 14:51:16.849926 879 legacy_serviceaccount_token_cleaner.go:103] "Starting legacy service account token cleaner controller" machine # [ 25.831722] k3s[879]: I0922 14:51:16.849941 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.832196] k3s[879]: I0922 14:51:16.850016 879 endpoints_controller.go:193] "Starting endpoint controller" machine # [ 25.832659] k3s[879]: I0922 14:51:16.850037 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.833122] k3s[879]: I0922 14:51:16.850139 879 deployment_controller.go:172] "Starting controller" controller="deployment" machine # [ 25.833578] k3s[879]: I0922 14:51:16.850153 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.834105] k3s[879]: I0922 14:51:16.850184 879 ttl_controller.go:127] "Starting TTL controller" machine # [ 25.834589] k3s[879]: I0922 14:51:16.850206 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.835087] k3s[879]: I0922 14:51:16.850235 879 vac_protection_controller.go:206] "Starting VAC protection controller" machine # [ 25.835544] k3s[879]: I0922 14:51:16.850249 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.836187] k3s[879]: I0922 14:51:16.850280 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.836666] k3s[879]: I0922 14:51:16.850351 879 endpointslicemirroring_controller.go:226] "Starting EndpointSliceMirroring controller" machine # [ 25.840095] k3s[879]: I0922 14:51:16.850365 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.840664] k3s[879]: I0922 14:51:16.850415 879 horizontal.go:204] "Starting HPA controller" machine # [ 25.841185] k3s[879]: I0922 14:51:16.850437 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.841645] k3s[879]: I0922 14:51:16.850472 879 cleaner.go:83] "Starting CSR cleaner controller" machine # [ 25.842149] k3s[879]: I0922 14:51:16.850523 879 clusterroleaggregation_controller.go:194] "Starting ClusterRoleAggregator controller" machine # [ 25.842630] k3s[879]: I0922 14:51:16.850546 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.843136] k3s[879]: I0922 14:51:16.850590 879 controller.go:174] "Starting ephemeral volume controller" machine # [ 25.843606] k3s[879]: I0922 14:51:16.850605 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.844077] k3s[879]: I0922 14:51:16.850639 879 taint_eviction.go:283] "Starting" controller="taint-eviction-controller" machine # [ 25.844539] k3s[879]: I0922 14:51:16.850688 879 taint_eviction.go:288] "Sending events to API server" machine # [ 25.848077] k3s[879]: I0922 14:51:16.850698 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.848768] k3s[879]: I0922 14:51:16.850899 879 expand_controller.go:328] "Starting expand controller" machine # [ 25.849447] k3s[879]: I0922 14:51:16.850920 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.849901] k3s[879]: I0922 14:51:16.850992 879 node_lifecycle_controller.go:453] "Sending events to api server" machine # [ 25.850515] k3s[879]: I0922 14:51:16.851029 879 node_lifecycle_controller.go:460] "Starting node controller" machine # [ 25.851026] k3s[879]: I0922 14:51:16.851039 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.851511] k3s[879]: I0922 14:51:16.851090 879 serviceaccounts_controller.go:117] "Starting service account controller" machine # [ 25.851959] k3s[879]: I0922 14:51:16.851125 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.852624] k3s[879]: I0922 14:51:16.851210 879 job_controller.go:254] "Starting job controller" machine # [ 25.853040] k3s[879]: I0922 14:51:16.851232 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.853511] k3s[879]: I0922 14:51:16.851288 879 stateful_set.go:180] "Starting stateful set controller" machine # [ 25.854026] k3s[879]: I0922 14:51:16.851302 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.854545] k3s[879]: I0922 14:51:16.851328 879 certificate_controller.go:120] "Starting certificate controller" name="csrapproving" machine # [ 25.854989] k3s[879]: I0922 14:51:16.851342 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.855616] k3s[879]: I0922 14:51:16.851403 879 attach_detach_controller.go:335] "Starting attach detach controller" machine # [ 25.856130] k3s[879]: I0922 14:51:16.851417 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.856628] k3s[879]: I0922 14:51:16.851448 879 pvc_protection_controller.go:166] "Starting PVC protection controller" machine # [ 25.857102] k3s[879]: I0922 14:51:16.851463 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.857582] k3s[879]: I0922 14:51:16.851502 879 disruption.go:458] "Sending events to api server." machine # [ 25.858059] k3s[879]: I0922 14:51:16.851531 879 disruption.go:465] "Starting disruption controller" machine # [ 25.858549] k3s[879]: I0922 14:51:16.851541 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.859026] k3s[879]: I0922 14:51:16.851634 879 node_ipam_controller.go:142] "Starting ipam controller" machine # [ 25.859503] k3s[879]: I0922 14:51:16.851649 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.860019] k3s[879]: I0922 14:51:16.851676 879 pv_protection_controller.go:81] "Starting PV protection controller" machine # [ 25.860479] k3s[879]: I0922 14:51:16.851695 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.860941] k3s[879]: I0922 14:51:16.851727 879 ttlafterfinished_controller.go:112] "Starting TTL after finished controller" machine # [ 25.861613] k3s[879]: I0922 14:51:16.851758 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.862111] k3s[879]: I0922 14:51:16.851844 879 controller.go:423] "Starting resource claim controller" machine # [ 25.862588] k3s[879]: I0922 14:51:16.851859 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.863058] k3s[879]: I0922 14:51:16.851930 879 servicecidrs_controller.go:136] "Starting" controller="service-cidr-controller" machine # [ 25.863535] k3s[879]: I0922 14:51:16.851944 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.864051] k3s[879]: I0922 14:51:16.851996 879 cronjob_controllerv2.go:143] "Starting cronjob controller v2" machine # [ 25.864545] k3s[879]: I0922 14:51:16.852010 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.865055] k3s[879]: I0922 14:51:16.852069 879 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-serving" machine # [ 25.865539] k3s[879]: I0922 14:51:16.852083 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.865992] k3s[879]: I0922 14:51:16.852135 879 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-client" machine # [ 25.866484] k3s[879]: I0922 14:51:16.852149 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.866942] k3s[879]: I0922 14:51:16.852182 879 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kube-apiserver-client" machine # [ 25.867586] k3s[879]: I0922 14:51:16.852206 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.868059] k3s[879]: I0922 14:51:16.852238 879 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 25.870446] k3s[879]: I0922 14:51:16.852500 879 resource_quota_controller.go:297] "Starting resource quota controller" machine # [ 25.871549] k3s[879]: I0922 14:51:16.852524 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.872713] k3s[879]: I0922 14:51:16.852706 879 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 25.874918] k3s[879]: I0922 14:51:16.852830 879 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 25.877473] k3s[879]: I0922 14:51:16.852933 879 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 25.879608] k3s[879]: I0922 14:51:16.853177 879 resource_quota_monitor.go:309] "QuotaMonitor running" machine # [ 25.880680] k3s[879]: I0922 14:51:16.855548 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.919511] k3s[879]: I0922 14:51:16.855593 879 gc_controller.go:98] "Starting GC controller" machine # [ 25.920168] k3s[879]: I0922 14:51:16.855817 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.920628] k3s[879]: I0922 14:51:16.857078 879 garbagecollector.go:141] "Starting controller" controller="garbagecollector" machine # [ 25.921113] k3s[879]: I0922 14:51:16.857139 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.921586] k3s[879]: I0922 14:51:16.857637 879 graph_builder.go:386] "Running" component="GraphBuilder" machine # [ 25.922058] k3s[879]: I0922 14:51:16.872601 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.926642] k3s[879]: I0922 14:51:16.961602 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.286607] k3s[879]: time="2026-09-22T14:51:17Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 26.315058] k3s[879]: I0922 14:51:17.349951 879 shared_informer.go:377] "Caches are synced" machine # [ 26.318327] k3s[879]: I0922 14:51:17.353333 879 controller.go:667] quota admission added evaluator for: helmcharts.helm.cattle.io machine # [ 26.321334] k3s[879]: I0922 14:51:17.353827 879 shared_informer.go:377] "Caches are synced" machine # [ 26.323527] k3s[879]: I0922 14:51:17.353938 879 shared_informer.go:377] "Caches are synced" machine # [ 26.325763] k3s[879]: I0922 14:51:17.354294 879 shared_informer.go:377] "Caches are synced" machine # [ 26.327418] k3s[879]: time="2026-09-22T14:51:17Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=AppliedManifest type=Normal machine # [ 26.347969] k3s[879]: I0922 14:51:17.383004 879 shared_informer.go:377] "Caches are synced" machine # [ 26.351390] k3s[879]: I0922 14:51:17.386446 879 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 26.356147] k3s[879]: time="2026-09-22T14:51:17Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=ApplyingManifest type=Normal machine # [ 26.359536] k3s[879]: I0922 14:51:17.390811 879 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 26.414641] k3s[879]: I0922 14:51:17.449649 879 shared_informer.go:377] "Caches are synced" machine # [ 26.416502] k3s[879]: I0922 14:51:17.451527 879 shared_informer.go:377] "Caches are synced" machine # [ 26.417744] k3s[879]: I0922 14:51:17.452605 879 shared_informer.go:377] "Caches are synced" machine # [ 26.418977] k3s[879]: I0922 14:51:17.452659 879 shared_informer.go:377] "Caches are synced" machine # [ 26.420274] k3s[879]: I0922 14:51:17.452978 879 shared_informer.go:377] "Caches are synced" machine # [ 26.421541] k3s[879]: I0922 14:51:17.456610 879 shared_informer.go:377] "Caches are synced" machine # [ 26.423253] k3s[879]: I0922 14:51:17.453036 879 shared_informer.go:377] "Caches are synced" machine # [ 26.426097] k3s[879]: I0922 14:51:17.453065 879 shared_informer.go:377] "Caches are synced" machine # [ 26.427349] k3s[879]: I0922 14:51:17.453094 879 shared_informer.go:377] "Caches are synced" machine # [ 26.428514] k3s[879]: I0922 14:51:17.453150 879 shared_informer.go:377] "Caches are synced" machine # [ 26.429674] k3s[879]: I0922 14:51:17.453177 879 shared_informer.go:377] "Caches are synced" machine # [ 26.430772] k3s[879]: I0922 14:51:17.453202 879 shared_informer.go:377] "Caches are synced" machine # [ 26.431874] k3s[879]: I0922 14:51:17.453225 879 shared_informer.go:377] "Caches are synced" machine # [ 26.433124] k3s[879]: I0922 14:51:17.453251 879 shared_informer.go:377] "Caches are synced" machine # [ 26.434258] k3s[879]: I0922 14:51:17.453275 879 shared_informer.go:377] "Caches are synced" machine # [ 26.435464] k3s[879]: I0922 14:51:17.453297 879 shared_informer.go:377] "Caches are synced" machine # [ 26.436628] k3s[879]: I0922 14:51:17.453320 879 shared_informer.go:377] "Caches are synced" machine # [ 26.437743] k3s[879]: I0922 14:51:17.453355 879 shared_informer.go:377] "Caches are synced" machine # [ 26.438868] k3s[879]: I0922 14:51:17.453382 879 shared_informer.go:377] "Caches are synced" machine # [ 26.440045] k3s[879]: I0922 14:51:17.453407 879 shared_informer.go:377] "Caches are synced" machine # [ 26.441188] k3s[879]: I0922 14:51:17.453430 879 shared_informer.go:377] "Caches are synced" machine # [ 26.442381] k3s[879]: I0922 14:51:17.453462 879 shared_informer.go:377] "Caches are synced" machine # [ 26.443521] k3s[879]: I0922 14:51:17.453498 879 shared_informer.go:377] "Caches are synced" machine # [ 26.444678] k3s[879]: I0922 14:51:17.453528 879 shared_informer.go:377] "Caches are synced" machine # [ 26.445840] k3s[879]: I0922 14:51:17.453552 879 shared_informer.go:377] "Caches are synced" machine # [ 26.446996] k3s[879]: I0922 14:51:17.453572 879 shared_informer.go:377] "Caches are synced" machine # [ 26.448227] k3s[879]: I0922 14:51:17.453596 879 shared_informer.go:377] "Caches are synced" machine # [ 26.449414] k3s[879]: I0922 14:51:17.453628 879 shared_informer.go:377] "Caches are synced" machine # [ 26.450616] k3s[879]: I0922 14:51:17.453653 879 shared_informer.go:377] "Caches are synced" machine # [ 26.451783] k3s[879]: I0922 14:51:17.453676 879 shared_informer.go:377] "Caches are synced" machine # [ 26.452943] k3s[879]: I0922 14:51:17.468937 879 range_allocator.go:177] "Sending events to api server" machine # [ 26.454196] k3s[879]: I0922 14:51:17.468986 879 range_allocator.go:181] "Starting range CIDR allocator" machine # [ 26.455526] k3s[879]: I0922 14:51:17.468999 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.456768] k3s[879]: I0922 14:51:17.469013 879 shared_informer.go:377] "Caches are synced" machine # [ 26.458024] k3s[879]: I0922 14:51:17.453699 879 shared_informer.go:377] "Caches are synced" machine # [ 26.459233] k3s[879]: I0922 14:51:17.453724 879 shared_informer.go:377] "Caches are synced" machine # [ 26.460469] k3s[879]: I0922 14:51:17.453748 879 shared_informer.go:377] "Caches are synced" machine # [ 26.461680] k3s[879]: I0922 14:51:17.453774 879 shared_informer.go:377] "Caches are synced" machine # [ 26.462832] k3s[879]: I0922 14:51:17.453801 879 shared_informer.go:377] "Caches are synced" machine # [ 26.464041] k3s[879]: I0922 14:51:17.453015 879 shared_informer.go:377] "Caches are synced" machine # [ 26.465265] k3s[879]: I0922 14:51:17.457356 879 shared_informer.go:377] "Caches are synced" machine # [ 26.466577] k3s[879]: I0922 14:51:17.482444 879 controller.go:667] quota admission added evaluator for: replicasets.apps machine # [ 26.468110] k3s[879]: time="2026-09-22T14:51:17Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Applying HelmChart from https://%{KUBERNETES_API}%/static/charts/nix-grpc-farm.tgz using Job kube-system/helm-install-nix-grpc-farm " object=kube-system/nix-grpc-farm reason=ApplyJob type=Normal machine # [ 26.487259] k3s[879]: I0922 14:51:17.522280 879 controller.go:667] quota admission added evaluator for: jobs.batch machine # [ 26.541117] k3s[879]: time="2026-09-22T14:51:17Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Deferred node password secret validation complete" object=machine reason=NodePasswordValidationComplete type=Normal machine # [ 26.554581] k3s[879]: time="2026-09-22T14:51:17Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=AppliedManifest type=Normal machine # [ 26.568719] k3s[879]: time="2026-09-22T14:51:17Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=ApplyingManifest type=Normal machine # [ 26.669512] k3s[879]: time="2026-09-22T14:51:17Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=AppliedManifest type=Normal machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 26.717090] k3s[879]: time="2026-09-22T14:51:17Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/traefik.yaml\"" object=kube-system/traefik reason=DeletingManifest type=Normal machine # [ 26.932744] k3s[879]: time="2026-09-22T14:51:17Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Resumed synced Job kube-system/helm-install-nix-grpc-farm" object=kube-system/nix-grpc-farm reason=ResumeJob type=Normal machine # [ 27.285473] k3s[879]: time="2026-09-22T14:51:18Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 27.322437] k3s[879]: I0922 14:51:18.357437 879 shared_informer.go:377] "Caches are synced" machine # [ 27.323151] k3s[879]: I0922 14:51:18.357468 879 garbagecollector.go:166] "Garbage collector: all resource monitors have synced" machine # [ 27.323592] k3s[879]: I0922 14:51:18.357478 879 garbagecollector.go:169] "Proceeding to collect garbage" machine # [ 27.327394] k3s[879]: I0922 14:51:18.362455 879 shared_informer.go:377] "Caches are synced" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 27.920494] postgres[1204]: [1204] ERROR: relation "goose_db_version" does not exist at character 36 machine # [ 27.921233] postgres[1204]: [1204] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC machine # [ 27.942846] niks3-server[1193]: 2026/09/22 14:51:18 OK 20241026095416_initial_model.sql (9.7ms) machine # [ 27.945969] niks3-server[1193]: 2026/09/22 14:51:18 OK 20251210153512_drop_unused_gin_index.sql (3.38ms) machine # [ 27.951239] niks3-server[1193]: 2026/09/22 14:51:18 OK 20251218171726_add_pins.sql (5.21ms) machine # [ 27.957867] niks3-server[1193]: 2026/09/22 14:51:18 OK 20260628120000_add_object_size_and_stats.sql (5.08ms) machine # [ 27.962963] niks3-server[1193]: 2026/09/22 14:51:18 OK 20260905000000_add_claims.sql (4.99ms) machine # [ 27.965985] niks3-server[1193]: 2026/09/22 14:51:19 OK 20260920000000_drop_claims.sql (3.04ms) machine # [ 27.967665] niks3-server[1193]: 2026/09/22 14:51:19 goose: successfully migrated database to version: 20260920000000 machine # [ 27.969858] niks3-server[1193]: 2026/09/22 14:51:19 OK 1_commit_pending_closure.sql (3.16ms) machine # [ 27.972079] niks3-server[1193]: 2026/09/22 14:51:19 OK 2_object_stats_trigger.sql (2.16ms) machine # [ 27.972818] niks3-server[1193]: 2026/09/22 14:51:19 goose: up to current file version: 2 machine # [ 27.975752] niks3-server[1193]: 2026/09/22 14:51:19 INFO OIDC provider initialized name=kubernetes issuer=https://kubernetes.default.svc.cluster.local machine # [ 27.977978] niks3-server[1193]: 2026/09/22 14:51:19 INFO OIDC authentication enabled config=/nix/store/v0b0sqyzhrjsz48x3klf7b7vl89apzs0-niks3-oidc.json machine # [ 27.981267] niks3-server[1193]: 2026/09/22 14:51:19 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key machine # [ 28.014732] niks3-server[1193]: 2026/09/22 14:51:19 INFO Read proxy enabled — serving cache objects from S3 machine # [ 28.015775] niks3-server[1193]: 2026/09/22 14:51:19 INFO Using socket-activated listener address=0.0.0.0:5751 machine # [ 28.016343] niks3-server[1193]: 2026/09/22 14:51:19 INFO systemd watchdog enabled interval=15s machine # [ 28.017647] niks3-server[1193]: 2026/09/22 14:51:19 INFO Starting HTTP server address=0.0.0.0:5751 machine # [ 28.019055] systemd[1]: Started niks3 server. machine # [ 28.020056] systemd[1]: Reached target Multi-User System. machine # [ 28.021826] systemd[1]: Startup finished in 1.166s (kernel) + 3.632s (initrd) + 23.223s (userspace) = 28.021s. machine # [ 28.288857] k3s[879]: time="2026-09-22T14:51:19Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 29.286574] k3s[879]: time="2026-09-22T14:51:20Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 30.285442] k3s[879]: time="2026-09-22T14:51:21Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 30.303220] k3s[879]: time="2026-09-22T14:51:21Z" level=info msg="Started tunnel to 10.0.2.15:6443" machine # [ 30.304487] k3s[879]: time="2026-09-22T14:51:21Z" level=info msg="Stopped tunnel to 127.0.0.1:6443" machine # [ 30.305745] k3s[879]: time="2026-09-22T14:51:21Z" level=info msg="Connecting to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 30.307187] k3s[879]: time="2026-09-22T14:51:21Z" level=info msg="Proxy done" err="context canceled" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 30.308847] k3s[879]: time="2026-09-22T14:51:21Z" level=info msg="error in remotedialer server [400]: websocket: close 1006 (abnormal closure): unexpected EOF" machine # [ 30.310638] k3s[879]: time="2026-09-22T14:51:21Z" level=info msg="Handling backend connection request [machine]" machine # [ 30.311970] k3s[879]: time="2026-09-22T14:51:21Z" level=info msg="Connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 30.313603] k3s[879]: time="2026-09-22T14:51:21Z" level=info msg="Remotedialer connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 30.689705] k3s[879]: time="2026-09-22T14:51:21Z" level=info msg="Imported docker.io/library/nix-grpc-farm-client:0.1.0-beta.2" machine # [ 30.693950] k3s[879]: time="2026-09-22T14:51:21Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-client@sha256:2949fe91b1f7b6e8e563ce8860495628cc8930df8acb85f0be1d7a554d1a4441" machine # [ 31.190962] k3s[879]: time="2026-09-22T14:51:22Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-client.tar in 9.046234088s" machine # [ 31.193183] k3s[879]: time="2026-09-22T14:51:22Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-lb.tar" machine # [ 31.291354] k3s[879]: time="2026-09-22T14:51:22Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 32.287370] k3s[879]: time="2026-09-22T14:51:23Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 33.156925] k3s[879]: time="2026-09-22T14:51:24Z" level=info msg="Imported docker.io/library/nix-grpc-farm-lb:0.1.0-beta.2" machine # [ 33.162154] k3s[879]: time="2026-09-22T14:51:24Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-lb@sha256:18ee6724be589622e1aee9d13c5121e7b2c992ca636c935ade90c66423e18f37" machine # [ 33.215516] k3s[879]: time="2026-09-22T14:51:24Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-lb.tar in 2.022607901s" machine # [ 33.220401] k3s[879]: time="2026-09-22T14:51:24Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm.tar" machine # [ 33.237967] k3s[879]: time="2026-09-22T14:51:24Z" level=info msg="Running kubelet --cloud-provider=external --config-dir=/var/lib/rancher/k3s/agent/etc/kubelet.conf.d --containerd=/run/k3s/containerd/containerd.sock --eviction-hard=nodefs.available<1%,imagefs.available<1% --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubelet.kubeconfig --node-ip=10.0.2.15,fec0::63b7:820d:553e:9054 --node-labels= --read-only-port=0" machine # [ 33.239647] k3s[879]: Flag --containerd has been deprecated, This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed. machine # [ 33.249597] k3s[879]: I0922 14:51:24.284553 879 server.go:521] "Kubelet version" kubeletVersion="v1.35.8+k3s1" machine # [ 33.251196] k3s[879]: I0922 14:51:24.284606 879 server.go:523] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 33.252108] k3s[879]: I0922 14:51:24.284655 879 watchdog_linux.go:95] "Systemd watchdog is not enabled" machine # [ 33.252441] k3s[879]: I0922 14:51:24.284681 879 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." machine # [ 33.254543] k3s[879]: I0922 14:51:24.287098 879 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/agent/client-ca.crt" machine # [ 33.258590] k3s[879]: I0922 14:51:24.293608 879 server.go:1414] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" machine # [ 33.266478] k3s[879]: I0922 14:51:24.301471 879 server.go:771] "--cgroups-per-qos enabled, but --cgroup-root was not specified. Defaulting to /" machine # [ 33.267354] k3s[879]: I0922 14:51:24.301523 879 server.go:832] "NoSwap is set due to memorySwapBehavior not specified" memorySwapBehavior="" FailSwapOn=false machine # [ 33.268248] k3s[879]: I0922 14:51:24.301851 879 container_manager_linux.go:272] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] machine # [ 33.268979] k3s[879]: I0922 14:51:24.301890 879 container_manager_linux.go:277] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"machine","RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} machine # [ 33.269749] k3s[879]: I0922 14:51:24.302184 879 topology_manager.go:143] "Creating topology manager with none policy" machine # [ 33.270515] k3s[879]: I0922 14:51:24.302210 879 container_manager_linux.go:308] "Creating device plugin manager" machine # [ 33.271193] k3s[879]: I0922 14:51:24.302321 879 container_manager_linux.go:317] "Creating Dynamic Resource Allocation (DRA) manager" machine # [ 33.286460] k3s[879]: time="2026-09-22T14:51:24Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 33.297543] k3s[879]: I0922 14:51:24.332527 879 state_mem.go:41] "Initialized" logger="CPUManager state memory" machine # [ 33.299529] k3s[879]: I0922 14:51:24.333100 879 kubelet.go:482] "Attempting to sync node with API server" machine # [ 33.300604] k3s[879]: I0922 14:51:24.333212 879 kubelet.go:383] "Adding static pod path" path="/var/lib/rancher/k3s/agent/pod-manifests" machine # [ 33.301653] k3s[879]: I0922 14:51:24.333273 879 kubelet.go:394] "Adding apiserver pod source" machine # [ 33.303382] k3s[879]: I0922 14:51:24.333313 879 apiserver.go:42] "Waiting for node sync before watching apiserver pods" machine # [ 33.304084] k3s[879]: I0922 14:51:24.336809 879 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="containerd" version="2.2.7-k3s1" apiVersion="v1" machine # [ 33.304827] k3s[879]: I0922 14:51:24.337381 879 kubelet.go:945] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" machine # [ 33.307149] k3s[879]: I0922 14:51:24.337405 879 kubelet.go:972] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" machine # [ 33.314077] k3s[879]: I0922 14:51:24.349032 879 server.go:1252] "Started kubelet" machine # [ 33.315672] k3s[879]: I0922 14:51:24.350616 879 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 machine # [ 33.316855] k3s[879]: I0922 14:51:24.350712 879 server_v1.go:49] "podresources" method="list" useActivePods=true machine # [ 33.317898] k3s[879]: I0922 14:51:24.350932 879 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 machine # [ 33.318258] k3s[879]: I0922 14:51:24.350979 879 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" machine # [ 33.318989] k3s[879]: I0922 14:51:24.351689 879 server.go:317] "Adding debug handlers to kubelet server" machine # [ 33.322665] k3s[879]: I0922 14:51:24.357664 879 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" machine # [ 33.327122] k3s[879]: I0922 14:51:24.360438 879 dynamic_serving_content.go:135] "Starting controller" name="kubelet-server-cert-files::/var/lib/rancher/k3s/agent/serving-kubelet.crt::/var/lib/rancher/k3s/agent/serving-kubelet.key" machine # [ 33.328121] k3s[879]: I0922 14:51:24.360604 879 volume_manager.go:311] "Starting Kubelet Volume Manager" machine # [ 33.328895] k3s[879]: E0922 14:51:24.360648 879 kubelet_node_status.go:392] "Error getting the current node from lister" err="node \"machine\" not found" machine # [ 33.329736] k3s[879]: I0922 14:51:24.361840 879 desired_state_of_world_populator.go:146] "Desired state populator starts to run" machine # [ 33.330627] k3s[879]: I0922 14:51:24.363929 879 reconciler.go:29] "Reconciler: start to sync state" machine # [ 33.333884] k3s[879]: E0922 14:51:24.368891 879 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"machine\" not found" node="machine" machine # [ 33.337912] k3s[879]: E0922 14:51:24.371302 879 kubelet.go:1661] "Image garbage collection failed once. Stats initialization may not have completed yet" err="invalid capacity 0 on image filesystem" machine # [ 33.338817] k3s[879]: I0922 14:51:24.372875 879 factory.go:223] Registration of the systemd container factory successfully machine # [ 33.342395] k3s[879]: I0922 14:51:24.377244 879 factory.go:221] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory machine # [ 33.346433] k3s[879]: I0922 14:51:24.381493 879 factory.go:223] Registration of the containerd container factory successfully machine # [ 33.358854] k3s[879]: I0922 14:51:24.393847 879 cpu_manager.go:225] "Starting" policy="none" machine # [ 33.359826] k3s[879]: I0922 14:51:24.393864 879 cpu_manager.go:226] "Reconciling" reconcilePeriod="10s" machine # [ 33.360633] k3s[879]: I0922 14:51:24.393887 879 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" machine # [ 33.363484] k3s[879]: I0922 14:51:24.398539 879 policy_none.go:50] "Start" machine # [ 33.364162] k3s[879]: I0922 14:51:24.398563 879 memory_manager.go:187] "Starting memorymanager" policy="None" machine # [ 33.365308] k3s[879]: I0922 14:51:24.398580 879 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" machine # [ 33.367168] k3s[879]: I0922 14:51:24.402221 879 policy_none.go:44] "Start" machine # [ 33.372628] systemd[1]: Created slice libcontainer container kubepods.slice. machine # [ 33.382597] systemd[1]: Created slice libcontainer container kubepods-burstable.slice. machine # [ 33.387076] systemd[1]: Created slice libcontainer container kubepods-besteffort.slice. machine # [ 33.396836] k3s[879]: E0922 14:51:24.431865 879 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" machine # [ 33.397629] k3s[879]: I0922 14:51:24.431977 879 eviction_manager.go:194] "Eviction manager: starting control loop" machine # [ 33.398029] k3s[879]: I0922 14:51:24.432006 879 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" machine # [ 33.398562] k3s[879]: I0922 14:51:24.432656 879 plugin_manager.go:121] "Starting Kubelet Plugin Manager" machine # [ 33.399236] k3s[879]: E0922 14:51:24.434015 879 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="no imagefs label for configured runtime" machine # [ 33.400028] k3s[879]: E0922 14:51:24.434046 879 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"machine\" not found" machine # [ 33.429768] k3s[879]: I0922 14:51:24.464724 879 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" machine # [ 33.432867] k3s[879]: I0922 14:51:24.467919 879 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" machine # [ 33.433641] k3s[879]: I0922 14:51:24.467958 879 status_manager.go:249] "Starting to sync pod status with apiserver" machine # [ 33.434534] k3s[879]: I0922 14:51:24.467993 879 kubelet.go:2506] "Starting kubelet main sync loop" machine # [ 33.435492] k3s[879]: E0922 14:51:24.468045 879 kubelet.go:2530] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" machine # [ 33.499935] k3s[879]: I0922 14:51:24.534953 879 kubelet_node_status.go:74] "Attempting to register node" node="machine" machine # [ 33.506067] k3s[879]: I0922 14:51:24.540201 879 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"machine\" does not exist" machine # [ 33.513976] k3s[879]: time="2026-09-22T14:51:24Z" level=info msg="Adding node OwnerReference to node-password secret machine.node-password.k3s" machine # [ 33.515784] k3s[879]: I0922 14:51:24.540667 879 node_controller.go:429] Initializing node machine with cloud provider machine # [ 33.517400] k3s[879]: I0922 14:51:24.540716 879 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 33.519856] k3s[879]: E0922 14:51:24.540736 879 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 33.522867] k3s[879]: I0922 14:51:24.541256 879 kubelet_node_status.go:77] "Successfully registered node" node="machine" machine # [ 33.524345] k3s[879]: I0922 14:51:24.548707 879 node_controller.go:429] Initializing node machine with cloud provider machine # [ 33.525731] k3s[879]: I0922 14:51:24.548753 879 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 33.527941] k3s[879]: E0922 14:51:24.548772 879 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 33.530623] k3s[879]: I0922 14:51:24.551638 879 range_allocator.go:433] "Set node PodCIDR" node="machine" podCIDRs=["10.42.0.0/24"] machine # [ 33.532971] k3s[879]: I0922 14:51:24.550127 879 node_controller.go:429] Initializing node machine with cloud provider machine # [ 33.534475] k3s[879]: I0922 14:51:24.553184 879 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 33.536951] k3s[879]: E0922 14:51:24.553202 879 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 33.539840] k3s[879]: time="2026-09-22T14:51:24Z" level=info msg="Synced coredns NodeHosts entries for machine" machine # [ 33.541391] k3s[879]: I0922 14:51:24.555144 879 kuberuntime_manager.go:2095] "Updating runtime config through cri with podcidr" CIDR="10.42.0.0/24" machine # [ 33.543443] k3s[879]: I0922 14:51:24.556085 879 kubelet_network.go:47] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.42.0.0/24" machine # [ 33.545253] k3s[879]: I0922 14:51:24.558834 879 node_controller.go:429] Initializing node machine with cloud provider machine # [ 33.547064] k3s[879]: I0922 14:51:24.558877 879 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 33.549947] k3s[879]: E0922 14:51:24.558894 879 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 33.550390] k3s[879]: time="2026-09-22T14:51:24Z" level=info msg="Annotations and labels have been set successfully on node: machine" machine # [ 33.550902] k3s[879]: time="2026-09-22T14:51:24Z" level=info msg="Starting flannel with backend vxlan" machine # [ 33.551597] k3s[879]: I0922 14:51:24.564488 879 node_controller.go:429] Initializing node machine with cloud provider machine # [ 33.552095] k3s[879]: I0922 14:51:24.572896 879 server.go:218] "Successfully retrieved NodeIPs" NodeIPs=["10.0.2.15","fec0::63b7:820d:553e:9054"] machine # [ 33.552616] k3s[879]: E0922 14:51:24.572967 879 server.go:255] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`" machine # [ 33.553129] k3s[879]: time="2026-09-22T14:51:24Z" level=info msg="Flannel found PodCIDR assigned for node machine" machine # [ 33.553669] k3s[879]: time="2026-09-22T14:51:24Z" level=info msg="The interface eth0 with ipv4 address 10.0.2.15 will be used by flannel" machine # [ 33.554134] k3s[879]: I0922 14:51:24.581310 879 kube.go:139] Waiting 10m0s for node controller to sync machine # [ 33.554640] k3s[879]: I0922 14:51:24.581330 879 kube.go:537] Starting kube subnet manager machine # [ 33.573542] k3s[879]: I0922 14:51:24.608561 879 server.go:264] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4" machine # [ 33.574098] k3s[879]: I0922 14:51:24.608606 879 server_linux.go:136] "Using iptables Proxier" machine # [ 33.590428] k3s[879]: I0922 14:51:24.625349 879 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4" machine # [ 33.600320] k3s[879]: I0922 14:51:24.635088 879 server.go:529] "Version info" version="v1.35.8+k3s1" machine # [ 33.600848] k3s[879]: I0922 14:51:24.635159 879 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 33.601542] k3s[879]: I0922 14:51:24.636040 879 config.go:403] "Starting serviceCIDR config controller" machine # [ 33.601884] k3s[879]: I0922 14:51:24.636062 879 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config" machine # [ 33.602259] k3s[879]: I0922 14:51:24.636092 879 config.go:200] "Starting service config controller" machine # [ 33.602779] k3s[879]: I0922 14:51:24.636130 879 shared_informer.go:349] "Waiting for caches to sync" controller="service config" machine # [ 33.603354] k3s[879]: I0922 14:51:24.636156 879 config.go:106] "Starting endpoint slice config controller" machine # [ 33.603901] k3s[879]: I0922 14:51:24.636170 879 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config" machine # [ 33.604402] k3s[879]: I0922 14:51:24.636238 879 config.go:309] "Starting node config controller" machine # [ 33.604877] k3s[879]: I0922 14:51:24.636255 879 shared_informer.go:349] "Waiting for caches to sync" controller="node config" machine # [ 33.605565] k3s[879]: I0922 14:51:24.636268 879 shared_informer.go:356] "Caches are synced" controller="node config" machine # [ 33.620126] k3s[879]: I0922 14:51:24.655158 879 node_controller.go:474] Successfully initialized node machine with cloud provider machine # [ 33.621889] k3s[879]: I0922 14:51:24.655694 879 event.go:389] "Event occurred" object="machine" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="Synced" message="Node synced successfully" machine # [ 33.629083] k3s[879]: I0922 14:51:24.664090 879 server.go:173] "Starting Kubernetes Scheduler" version="v1.35.8+k3s1" machine # [ 33.629832] k3s[879]: I0922 14:51:24.664138 879 server.go:175] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 33.632853] k3s[879]: I0922 14:51:24.667885 879 secure_serving.go:211] Serving securely on 127.0.0.1:10259 machine # [ 33.634431] k3s[879]: I0922 14:51:24.668006 879 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 33.634872] k3s[879]: I0922 14:51:24.668022 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 33.635508] k3s[879]: I0922 14:51:24.668062 879 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 33.635991] k3s[879]: I0922 14:51:24.668207 879 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 33.636686] k3s[879]: I0922 14:51:24.668726 879 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 33.638551] k3s[879]: I0922 14:51:24.668743 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 33.639090] k3s[879]: I0922 14:51:24.668778 879 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 33.639574] k3s[879]: I0922 14:51:24.668796 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 33.701311] k3s[879]: I0922 14:51:24.736274 879 shared_informer.go:356] "Caches are synced" controller="endpoint slice config" machine # [ 33.702134] k3s[879]: I0922 14:51:24.736310 879 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config" machine # [ 33.702882] k3s[879]: I0922 14:51:24.736327 879 shared_informer.go:356] "Caches are synced" controller="service config" machine # [ 33.730077] k3s[879]: I0922 14:51:24.764471 879 kubelet_node_status.go:427] "Fast updating node status as it just became ready" machine # [ 33.733357] k3s[879]: I0922 14:51:24.768093 879 shared_informer.go:377] "Caches are synced" machine # [ 33.735153] k3s[879]: I0922 14:51:24.770204 879 shared_informer.go:377] "Caches are synced" machine # [ 33.737045] k3s[879]: I0922 14:51:24.771487 879 shared_informer.go:377] "Caches are synced" machine # [ 33.742599] k3s[879]: I0922 14:51:24.777620 879 topologycache.go:237] "Can't get CPU or zone information for node" node="machine" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 34.199121] k3s[879]: time="2026-09-22T14:51:25Z" level=info msg="Tunnel authorizer set Kubelet Port 0.0.0.0:10250" machine # [ 34.295643] k3s[879]: time="2026-09-22T14:51:25Z" level=info msg="Labels and annotations have been set successfully on node: machine" machine # [ 34.299624] k3s[879]: I0922 14:51:25.334607 879 apiserver.go:52] "Watching apiserver" machine # [ 34.371133] systemd[1]: Created slice libcontainer container kubepods-burstable-pod0002cded_da2f_4591_a820_979156767c19.slice. machine # [ 34.389136] systemd[1]: Created slice libcontainer container kubepods-burstable-pod773469c0_9faf_41ba_a379_449d3b359b88.slice. machine # [ 34.427925] k3s[879]: I0922 14:51:25.462890 879 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" machine # [ 34.434228] k3s[879]: I0922 14:51:25.469212 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"content\" (UniqueName: \"kubernetes.io/configmap/773469c0-9faf-41ba-a379-449d3b359b88-content\") pod \"helm-install-nix-grpc-farm-zbqv8\" (UID: \"773469c0-9faf-41ba-a379-449d3b359b88\") " pod="kube-system/helm-install-nix-grpc-farm-zbqv8" machine # [ 34.442404] k3s[879]: I0922 14:51:25.469271 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-config-volume\" (UniqueName: \"kubernetes.io/configmap/0002cded-da2f-4591-a820-979156767c19-custom-config-volume\") pod \"coredns-c5fdd76cf-jmdmh\" (UID: \"0002cded-da2f-4591-a820-979156767c19\") " pod="kube-system/coredns-c5fdd76cf-jmdmh" machine # [ 34.451179] k3s[879]: I0922 14:51:25.469324 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjpns\" (UniqueName: \"kubernetes.io/projected/0002cded-da2f-4591-a820-979156767c19-kube-api-access-hjpns\") pod \"coredns-c5fdd76cf-jmdmh\" (UID: \"0002cded-da2f-4591-a820-979156767c19\") " pod="kube-system/coredns-c5fdd76cf-jmdmh" machine # [ 34.456108] k3s[879]: I0922 14:51:25.469411 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/773469c0-9faf-41ba-a379-449d3b359b88-klipper-helm\") pod \"helm-install-nix-grpc-farm-zbqv8\" (UID: \"773469c0-9faf-41ba-a379-449d3b359b88\") " pod="kube-system/helm-install-nix-grpc-farm-zbqv8" machine # [ 34.460637] k3s[879]: I0922 14:51:25.469455 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/773469c0-9faf-41ba-a379-449d3b359b88-klipper-cache\") pod \"helm-install-nix-grpc-farm-zbqv8\" (UID: \"773469c0-9faf-41ba-a379-449d3b359b88\") " pod="kube-system/helm-install-nix-grpc-farm-zbqv8" machine # [ 34.465264] k3s[879]: I0922 14:51:25.469582 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/773469c0-9faf-41ba-a379-449d3b359b88-tmp\") pod \"helm-install-nix-grpc-farm-zbqv8\" (UID: \"773469c0-9faf-41ba-a379-449d3b359b88\") " pod="kube-system/helm-install-nix-grpc-farm-zbqv8" machine # [ 34.469680] k3s[879]: I0922 14:51:25.469697 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"values\" (UniqueName: \"kubernetes.io/projected/773469c0-9faf-41ba-a379-449d3b359b88-values\") pod \"helm-install-nix-grpc-farm-zbqv8\" (UID: \"773469c0-9faf-41ba-a379-449d3b359b88\") " pod="kube-system/helm-install-nix-grpc-farm-zbqv8" machine # [ 34.474147] k3s[879]: I0922 14:51:25.469796 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kkpv\" (UniqueName: \"kubernetes.io/projected/773469c0-9faf-41ba-a379-449d3b359b88-kube-api-access-9kkpv\") pod \"helm-install-nix-grpc-farm-zbqv8\" (UID: \"773469c0-9faf-41ba-a379-449d3b359b88\") " pod="kube-system/helm-install-nix-grpc-farm-zbqv8" machine # [ 34.478707] k3s[879]: I0922 14:51:25.469883 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0002cded-da2f-4591-a820-979156767c19-config-volume\") pod \"coredns-c5fdd76cf-jmdmh\" (UID: \"0002cded-da2f-4591-a820-979156767c19\") " pod="kube-system/coredns-c5fdd76cf-jmdmh" machine # [ 34.482922] k3s[879]: I0922 14:51:25.470007 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/773469c0-9faf-41ba-a379-449d3b359b88-klipper-config\") pod \"helm-install-nix-grpc-farm-zbqv8\" (UID: \"773469c0-9faf-41ba-a379-449d3b359b88\") " pod="kube-system/helm-install-nix-grpc-farm-zbqv8" machine # [ 34.546508] k3s[879]: I0922 14:51:25.581514 879 kube.go:163] Node controller sync successful machine # [ 34.547856] k3s[879]: I0922 14:51:25.581608 879 vxlan.go:128] VXLAN config: VNI=1 Port=0 GBP=false Learning=false DirectRouting=false machine # [ 34.553363] k3s[879]: I0922 14:51:25.588366 879 kube.go:704] List of node(machine) annotations: map[string]string{"alpha.kubernetes.io/provided-node-ip":"10.0.2.15,fec0::63b7:820d:553e:9054", "k3s.io/hostname":"machine", "k3s.io/internal-ip":"10.0.2.15,fec0::63b7:820d:553e:9054", "k3s.io/node-args":"[\"server\",\"--disable\",\"traefik\",\"--disable\",\"metrics-server\",\"--disable\",\"local-storage\",\"--kubelet-arg\",\"eviction-hard=nodefs.available\\u003c1%,imagefs.available\\u003c1%\"]", "k3s.io/node-config-hash":"EFXPOZ7ZWHRCLFNW4X4ZDPFQMSAOP3BLEIN2VE47TDRKQ4UIWKUQ====", "k3s.io/node-env":"{}", "node.alpha.kubernetes.io/ttl":"0", "volumes.kubernetes.io/controller-managed-attach-detach":"true"} machine # [ 34.585389] (udev-worker)[1306]: Network interface NamePolicy= disabled on kernel command line. machine # [ 34.590085] k3s[879]: I0922 14:51:25.625098 879 kube.go:558] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.42.0.0/24] machine # [ 34.592524] k3s[879]: I0922 14:51:25.627550 879 iptables.go:50] Starting flannel in iptables mode... machine # [ 34.593360] k3s[879]: time="2026-09-22T14:51:25Z" level=warning msg="no subnet found for key: FLANNEL_NETWORK in file: /run/flannel/subnet.env" machine # [ 34.594180] k3s[879]: time="2026-09-22T14:51:25Z" level=warning msg="no subnet found for key: FLANNEL_SUBNET in file: /run/flannel/subnet.env" machine # [ 34.595057] k3s[879]: time="2026-09-22T14:51:25Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_NETWORK in file: /run/flannel/subnet.env" machine # [ 34.596063] k3s[879]: time="2026-09-22T14:51:25Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_SUBNET in file: /run/flannel/subnet.env" machine # [ 34.596979] k3s[879]: I0922 14:51:25.628241 879 iptables.go:101] Current network or subnet (10.42.0.0/16, 10.42.0.0/24) is not equal to previous one (0.0.0.0/0, 0.0.0.0/0), trying to recycle old iptables rules machine # [ 34.618885] dhcpcd[697]: flannel.1: IAID b2:2c:0c:90 machine # [ 34.619603] dhcpcd[697]: flannel.1: adding address fe80::6054:b2ff:fe2c:c90 machine # [ 34.641039] k3s[879]: I0922 14:51:25.676057 879 iptables.go:111] Setting up masking rules machine # [ 34.653959] k3s[879]: I0922 14:51:25.689002 879 iptables.go:212] Changing default FORWARD chain policy to ACCEPT machine # [ 34.661339] k3s[879]: time="2026-09-22T14:51:25Z" level=info msg="Wrote flannel subnet file to /run/flannel/subnet.env" machine # [ 34.662417] k3s[879]: time="2026-09-22T14:51:25Z" level=info msg="Running flannel backend" machine # [ 34.663161] k3s[879]: I0922 14:51:25.696414 879 vxlan_network.go:68] watching for new subnet leases machine # [ 34.663874] k3s[879]: I0922 14:51:25.696444 879 vxlan_network.go:115] starting vxlan device watcher machine # [ 34.702280] k3s[879]: I0922 14:51:25.737217 879 iptables.go:358] bootstrap done machine # [ 34.738880] k3s[879]: I0922 14:51:25.773884 879 iptables.go:358] bootstrap done machine # [ 34.755030] (udev-worker)[1535]: Network interface NamePolicy= disabled on kernel command line. machine # [ 34.912754] cni0: port 1(veth5a164099) entered blocking state machine # [ 34.913597] cni0: port 1(veth5a164099) entered disabled state machine # [ 34.914204] veth5a164099: entered allmulticast mode machine # [ 34.915086] veth5a164099: entered promiscuous mode machine # [ 34.915843] cni0: port 2(veth63f9dd46) entered blocking state machine # [ 34.916639] cni0: port 2(veth63f9dd46) entered disabled state machine # [ 34.917390] veth63f9dd46: entered allmulticast mode machine # [ 34.917968] veth63f9dd46: entered promiscuous mode machine # [ 34.932908] cni0: port 1(veth5a164099) entered blocking state machine # [ 34.933594] cni0: port 1(veth5a164099) entered forwarding state machine # [ 34.936915] cni0: port 2(veth63f9dd46) entered blocking state machine # [ 34.937635] cni0: port 2(veth63f9dd46) entered forwarding state machine # [ 34.806842] dhcpcd[697]: veth5a164099: waiting for carrier machine # [ 34.817107] dhcpcd[697]: veth63f9dd46: IAID c9:d2:93:67 machine # [ 34.817840] dhcpcd[697]: veth63f9dd46: adding address fe80::87d:c9ff:fed2:9367 machine # [ 34.818621] dhcpcd[697]: veth5a164099: carrier acquired machine # [ 34.823406] dhcpcd[697]: veth5a164099: IAID a7:79:3f:e3 machine # [ 34.824066] dhcpcd[697]: veth5a164099: adding address fe80::4cc8:a7ff:fe79:3fe3 machine # [ 34.905290] dhcpcd[697]: veth63f9dd46: soliciting a DHCP lease machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 34.969337] systemd[1]: Started libcontainer container fb1358d8ea5886775d62be193bc472817aae7a689a0200ec97fe1a1c0c3e8b89. machine # [ 34.975660] systemd[1]: Started libcontainer container 9c652f2179c0b65dd5477cadcfc50a56374c3f6d1efd419caf531a7b05199704. machine # [ 35.674685] dhcpcd[697]: flannel.1: soliciting a DHCP lease machine # [ 35.683483] k3s[879]: time="2026-09-22T14:51:26Z" level=info msg="Starting network policy controller version v2.6.3-k3s1, built on 1970-01-01T01:01:01Z, go1.26.7" machine # [ 35.684236] k3s[879]: I0922 14:51:26.718242 879 network_policy_controller.go:164] Starting network policy controller machine # [ 35.705381] dhcpcd[697]: veth5a164099: soliciting a DHCP lease machine # [ 35.844528] k3s[879]: I0922 14:51:26.879289 879 network_policy_controller.go:179] Starting network policy controller full sync goroutine machine # [ 35.936966] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount1973986683.mount: Deactivated successfully. machine # [ 35.984336] systemd[1]: Started libcontainer container 098171ddacb17790815449d8a48535d292d512ec4f6692d239dc0447a9198667. machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 36.167344] systemd[1]: Started libcontainer container 3cb9065b5099490f700776b3c3654e06ca8d90129447a1ac0c1dc9af7719f59a. machine # [ 36.433409] k3s[879]: I0922 14:51:27.468392 879 node_lifecycle_controller.go:1234] "Initializing eviction metric for zone" zone="" machine # [ 36.434246] k3s[879]: I0922 14:51:27.468516 879 node_lifecycle_controller.go:886] "Missing timestamp for Node. Assuming now as a timestamp" node="machine" machine # [ 36.434778] k3s[879]: I0922 14:51:27.468593 879 node_lifecycle_controller.go:1080] "Controller detected that zone is now in new state" zone="" newState="Normal" machine # [ 36.466805] k3s[879]: I0922 14:51:27.501785 879 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/helm-install-nix-grpc-farm-zbqv8" podStartSLOduration=10.501732898 podStartE2EDuration="10.501732898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-22 14:51:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-22 14:51:27.499685152 +0000 UTC m=+21.342876538" watchObservedRunningTime="2026-09-22 14:51:27.501732898 +0000 UTC m=+21.344924284" machine # [ 36.727808] dhcpcd[697]: flannel.1: soliciting an IPv6 router machine # [ 37.188392] dhcpcd[697]: veth5a164099: soliciting an IPv6 router machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 37.461768] dhcpcd[697]: veth63f9dd46: soliciting an IPv6 router machine # [ 37.593689] k3s[879]: I0922 14:51:28.628350 879 alloc.go:329] "allocated clusterIPs" service="farm/nix-grpc-farm" clusterIPs={"IPv4":"10.43.178.145"} machine # [ 37.644724] systemd[1]: cri-containerd-3cb9065b5099490f700776b3c3654e06ca8d90129447a1ac0c1dc9af7719f59a.scope: Deactivated successfully. machine # [ 37.645587] systemd[1]: cri-containerd-3cb9065b5099490f700776b3c3654e06ca8d90129447a1ac0c1dc9af7719f59a.scope: Consumed 512ms CPU time over 1.476s wall clock time, 32.3M memory peak, 2.4M incoming IP traffic, 141.4K outgoing IP traffic. machine # [ 37.693963] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-3cb9065b5099490f700776b3c3654e06ca8d90129447a1ac0c1dc9af7719f59a-rootfs.mount: Deactivated successfully. machine # [ 37.737428] k3s[879]: I0922 14:51:28.772288 879 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/coredns-c5fdd76cf-jmdmh" podStartSLOduration=11.772260018 podStartE2EDuration="11.772260018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-22 14:51:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-22 14:51:27.517877408 +0000 UTC m=+21.361069073" watchObservedRunningTime="2026-09-22 14:51:28.772260018 +0000 UTC m=+22.615451404" machine # [ 37.799087] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod5be2c431_ac05_413b_a5fb_696064daa05b.slice. machine # [ 37.811506] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod2fc989c7_e813_4036_8f10_1f9e3ea2329e.slice. machine # [ 37.825541] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod9364f398_d892_4696_a7f5_d93009befe96.slice. machine # [ 37.838653] systemd[1]: Created slice libcontainer container kubepods-besteffort-podc588497d_2c3b_4a16_8cf8_71c14eced140.slice. machine # [ 37.867323] k3s[879]: I0922 14:51:28.901991 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/5be2c431-ac05-413b-a5fb-696064daa05b-niks3-token\") pod \"nix-grpc-farm-scheduler-547d7b8d9c-m8f8r\" (UID: \"5be2c431-ac05-413b-a5fb-696064daa05b\") " pod="farm/nix-grpc-farm-scheduler-547d7b8d9c-m8f8r" machine # [ 37.868096] k3s[879]: I0922 14:51:28.902176 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/2fc989c7-e813-4036-8f10-1f9e3ea2329e-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-cxfvt\" (UID: \"2fc989c7-e813-4036-8f10-1f9e3ea2329e\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-cxfvt" machine # [ 37.868726] k3s[879]: I0922 14:51:28.902201 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/2fc989c7-e813-4036-8f10-1f9e3ea2329e-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-cxfvt\" (UID: \"2fc989c7-e813-4036-8f10-1f9e3ea2329e\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-cxfvt" machine # [ 37.869621] k3s[879]: I0922 14:51:28.902231 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/c588497d-2c3b-4a16-8cf8-71c14eced140-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-fx57t\" (UID: \"c588497d-2c3b-4a16-8cf8-71c14eced140\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-fx57t" machine # [ 37.870274] k3s[879]: I0922 14:51:28.902258 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c588497d-2c3b-4a16-8cf8-71c14eced140-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-fx57t\" (UID: \"c588497d-2c3b-4a16-8cf8-71c14eced140\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-fx57t" machine # [ 37.870818] k3s[879]: I0922 14:51:28.902287 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/5be2c431-ac05-413b-a5fb-696064daa05b-tls\") pod \"nix-grpc-farm-scheduler-547d7b8d9c-m8f8r\" (UID: \"5be2c431-ac05-413b-a5fb-696064daa05b\") " pod="farm/nix-grpc-farm-scheduler-547d7b8d9c-m8f8r" machine # [ 37.871482] k3s[879]: I0922 14:51:28.902316 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/2fc989c7-e813-4036-8f10-1f9e3ea2329e-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-cxfvt\" (UID: \"2fc989c7-e813-4036-8f10-1f9e3ea2329e\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-cxfvt" machine # [ 37.872172] k3s[879]: I0922 14:51:28.902342 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/c588497d-2c3b-4a16-8cf8-71c14eced140-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-fx57t\" (UID: \"c588497d-2c3b-4a16-8cf8-71c14eced140\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-fx57t" machine # [ 37.872960] k3s[879]: I0922 14:51:28.902369 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/5be2c431-ac05-413b-a5fb-696064daa05b-oidc\") pod \"nix-grpc-farm-scheduler-547d7b8d9c-m8f8r\" (UID: \"5be2c431-ac05-413b-a5fb-696064daa05b\") " pod="farm/nix-grpc-farm-scheduler-547d7b8d9c-m8f8r" machine # [ 37.873640] k3s[879]: I0922 14:51:28.902395 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/c588497d-2c3b-4a16-8cf8-71c14eced140-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-fx57t\" (UID: \"c588497d-2c3b-4a16-8cf8-71c14eced140\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-fx57t" machine # [ 37.874530] k3s[879]: I0922 14:51:28.902424 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsqzq\" (UniqueName: \"kubernetes.io/projected/c588497d-2c3b-4a16-8cf8-71c14eced140-kube-api-access-xsqzq\") pod \"nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-fx57t\" (UID: \"c588497d-2c3b-4a16-8cf8-71c14eced140\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-fx57t" machine # [ 37.874983] k3s[879]: I0922 14:51:28.902455 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/2fc989c7-e813-4036-8f10-1f9e3ea2329e-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-cxfvt\" (UID: \"2fc989c7-e813-4036-8f10-1f9e3ea2329e\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-cxfvt" machine # [ 37.877460] k3s[879]: I0922 14:51:28.902480 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2fc989c7-e813-4036-8f10-1f9e3ea2329e-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-cxfvt\" (UID: \"2fc989c7-e813-4036-8f10-1f9e3ea2329e\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-cxfvt" machine # [ 37.881657] k3s[879]: I0922 14:51:28.902503 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/c588497d-2c3b-4a16-8cf8-71c14eced140-build\") pod \"nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-fx57t\" (UID: \"c588497d-2c3b-4a16-8cf8-71c14eced140\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-fx57t" machine # [ 37.886151] k3s[879]: I0922 14:51:28.902531 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9364f398-d892-4696-a7f5-d93009befe96-tmp\") pod \"nix-grpc-farm-lb-748bbd6bdc-mdq2s\" (UID: \"9364f398-d892-4696-a7f5-d93009befe96\") " pod="farm/nix-grpc-farm-lb-748bbd6bdc-mdq2s" machine # [ 37.925884] k3s[879]: I0922 14:51:28.902557 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5be2c431-ac05-413b-a5fb-696064daa05b-ca\") pod \"nix-grpc-farm-scheduler-547d7b8d9c-m8f8r\" (UID: \"5be2c431-ac05-413b-a5fb-696064daa05b\") " pod="farm/nix-grpc-farm-scheduler-547d7b8d9c-m8f8r" machine # [ 37.926603] k3s[879]: I0922 14:51:28.902581 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsk8b\" (UniqueName: \"kubernetes.io/projected/5be2c431-ac05-413b-a5fb-696064daa05b-kube-api-access-bsk8b\") pod \"nix-grpc-farm-scheduler-547d7b8d9c-m8f8r\" (UID: \"5be2c431-ac05-413b-a5fb-696064daa05b\") " pod="farm/nix-grpc-farm-scheduler-547d7b8d9c-m8f8r" machine # [ 37.927104] k3s[879]: I0922 14:51:28.902608 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5mqw\" (UniqueName: \"kubernetes.io/projected/2fc989c7-e813-4036-8f10-1f9e3ea2329e-kube-api-access-j5mqw\") pod \"nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-cxfvt\" (UID: \"2fc989c7-e813-4036-8f10-1f9e3ea2329e\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-cxfvt" machine # [ 37.927634] k3s[879]: I0922 14:51:28.902638 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/c588497d-2c3b-4a16-8cf8-71c14eced140-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-fx57t\" (UID: \"c588497d-2c3b-4a16-8cf8-71c14eced140\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-fx57t" machine # [ 37.928163] k3s[879]: I0922 14:51:28.902668 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/2fc989c7-e813-4036-8f10-1f9e3ea2329e-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-cxfvt\" (UID: \"2fc989c7-e813-4036-8f10-1f9e3ea2329e\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-cxfvt" machine # [ 37.928652] k3s[879]: I0922 14:51:28.902692 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/9364f398-d892-4696-a7f5-d93009befe96-tls-ca\") pod \"nix-grpc-farm-lb-748bbd6bdc-mdq2s\" (UID: \"9364f398-d892-4696-a7f5-d93009befe96\") " pod="farm/nix-grpc-farm-lb-748bbd6bdc-mdq2s" machine # [ 37.929475] k3s[879]: I0922 14:51:28.902716 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/2fc989c7-e813-4036-8f10-1f9e3ea2329e-build\") pod \"nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-cxfvt\" (UID: \"2fc989c7-e813-4036-8f10-1f9e3ea2329e\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-cxfvt" machine # [ 37.929950] k3s[879]: I0922 14:51:28.902750 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9364f398-d892-4696-a7f5-d93009befe96-config\") pod \"nix-grpc-farm-lb-748bbd6bdc-mdq2s\" (UID: \"9364f398-d892-4696-a7f5-d93009befe96\") " pod="farm/nix-grpc-farm-lb-748bbd6bdc-mdq2s" machine # [ 37.930652] k3s[879]: I0922 14:51:28.902778 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/c588497d-2c3b-4a16-8cf8-71c14eced140-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-fx57t\" (UID: \"c588497d-2c3b-4a16-8cf8-71c14eced140\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-fx57t" machine # [ 37.931133] k3s[879]: I0922 14:51:28.902805 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/9364f398-d892-4696-a7f5-d93009befe96-tls-lb\") pod \"nix-grpc-farm-lb-748bbd6bdc-mdq2s\" (UID: \"9364f398-d892-4696-a7f5-d93009befe96\") " pod="farm/nix-grpc-farm-lb-748bbd6bdc-mdq2s" machine # [ 38.589235] cni0: port 3(veth4460433a) entered blocking state machine # [ 38.590027] cni0: port 3(veth4460433a) entered disabled state machine # [ 38.590925] veth4460433a: entered allmulticast mode machine # [ 38.591671] veth4460433a: entered promiscuous mode machine # [ 38.439561] (udev-worker)[1903]: Network interface NamePolicy= disabled on kernel command line. machine # [ 38.603353] cni0: port 3(veth4460433a) entered blocking state machine # [ 38.604148] cni0: port 3(veth4460433a) entered forwarding state machine # [ 38.474483] dhcpcd[697]: veth4460433a: IAID ae:05:7a:5e machine # [ 38.475339] dhcpcd[697]: veth4460433a: adding address fe80::a0d9:aeff:fe05:7a5e machine # [ 38.483910] ([ 38.638135] cni0: port 4(veth797fa628) entered blocking state machine # udev-worker)[2127]: Network interface NamePolicy= disabled on kernel command line. machine # [ 38.641189] cni0: port 4(veth797fa628) entered disabled state machine # [ 38.642141] veth797fa628: entered allmulticast mode machine # [ 38.643073] veth797fa628: entered promiscuous mode machine # [ 38.656708] cni0: port 4(veth797fa628) entered blocking state machine # [ 38.657490] cni0: port 4(veth797fa628) entered forwarding state machine # [ 38.502785] (udev-worker)[2126]: Network interface NamePolicy= disabled on kernel command line. machine # [ 38.663453] cni0: port 5(veth12a5a3eb) entered blocking state machine # [ 38.664152] cni0: port 5(veth12a5a3eb) entered disabled state machine # [ 38.665112] veth12a5a3eb: entered allmulticast mode machine # [ 38.665943] veth12a5a3eb: entered promiscuous mode machine # [ 38.521814] dhcpcd[697]: veth797fa628: IAID 39:16:77:c2 machine # [ 38.522710] dhcpcd[697]: veth797fa628: adding address fe80::e851:39ff:fe16:77c2 machine # [ 38.687800] cni0: port 6(veth93d5953b) entered blocking state machine # [ 38.533950] (udev-worker)[212[ 38.688956] cni0: port 6(veth93d5953b) entered disabled state machine # 0]: Network interface NamePolicy[ 38.689883] veth93d5953b: entered allmulticast mode machine # = disabled on kernel command lin[ 38.690910] veth93d5953b: entered promiscuous mode machine # e. machine # [ 38.696492] cni0: port 5(veth12a5a3eb) entered blocking state machine # [ 38.697260] cni0: port 5(veth12a5a3eb) entered forwarding state machine # [ 38.705858] cni0: port 6(veth93d5953b) entered blocking state machine # [ 38.706622] cni0: port 6(veth93d5953b) entered forwarding state machine # [ 38.576349] dhcpcd[697]: veth12a5a3eb: waiting for carrier machine # [ 38.589348] dhcpcd[697]: veth93d5953b: IAID 36:3d:5b:a7 machine # [ 38.590105] dhcpcd[697]: veth93d5953b: adding address fe80::a457:36ff:fe3d:5ba7 machine # [ 38.590713] dhcpcd[697]: veth93d5953b: old hardware address: a6:57:36:3d:5b:a7 machine # [ 38.591574] dhcpcd[697]: veth93d5953b: new hardware address: ea:74:38:a4:ef:07 machine # [ 38.592087] dhcpcd[697]: veth93d5953b: carrier lost machine # [ 38.612407] systemd[1]: Started libcontainer container fe1989d2ca92b35f937a3f0f4eff6c2a9554236962f996e726ef74acd79820b1. machine # [ 38.614990] dhcpcd[697]: veth93d5953b: deleting address fe80::a457:36ff:fe3d:5ba7 machine # [ 38.616135] dhcpcd[697]: veth12a5a3eb: carrier acquired machine # [ 38.621729] dhcpcd[697]: veth12a5a3eb: IAID f3:f0:25:1d machine # [ 38.622665] dhcpcd[697]: veth12a5a3eb: adding address fe80::903f:f3ff:fef0:251d machine # [ 38.623677] dhcpcd[697]: veth93d5953b: carrier acquired machine # [ 38.632186] dhcpcd[697]: veth93d5953b: IAID 38:a4:ef:07 machine # [ 38.632863] dhcpcd[697]: veth93d5953b: adding address fe80::e874:38ff:fea4:ef07 machine # [ 38.681927] systemd[1]: Started libcontainer container da7a8036805d9b8700b1b3f911cfbaad874f24e5d0647059ea83697071dd8f4f. machine # [ 38.701301] k3s[879]: E0922 14:51:29.735763 879 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.2\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.2\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.2\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.2" machine # [ 38.701919] k3s[879]: E0922 14:51:29.735881 879 kuberuntime_image.go:43] "Failed to pull image" err="failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.2\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.2\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.2\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.2" machine # [ 38.702567] k3s[879]: E0922 14:51:29.736282 879 kuberuntime_manager.go:1674] "Unhandled Error" err="container nix-grpc-daemon start failed in pod nix-grpc-farm-scheduler-547d7b8d9c-m8f8r_farm(5be2c431-ac05-413b-a5fb-696064daa05b): ErrImagePull: failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.2\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.2\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.2\": dial tcp: lookup registry-1.docker.io: no such host" logger="UnhandledError" machine # [ 38.703062] k3s[879]: E0922 14:51:29.736347 879 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nix-grpc-daemon\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.2\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.2\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.2\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-scheduler-547d7b8d9c-m8f8r" podUID="5be2c431-ac05-413b-a5fb-696064daa05b" machine # [ 38.729621] systemd[1]: Started libcontainer container 50ca86113d20388d9c11c5a63320d4c5c8f640ad62518213b60c562f841d50f8. machine # [ 38.734706] systemd[1]: Started libcontainer container 4ef3a81f43bd5d13587cec8f34064bd9ee43d1cab28fe56d021c6a47a371f419. machine # [ 38.823081] k3s[879]: E0922 14:51:29.858052 879 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.2\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.2\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.2\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.2" machine # [ 38.824165] k3s[879]: E0922 14:51:29.858094 879 kuberuntime_image.go:43] "Failed to pull image" err="failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.2\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.2\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.2\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.2" machine # [ 38.824886] k3s[879]: E0922 14:51:29.858887 879 kuberuntime_manager.go:1674] "Unhandled Error" err="init container seed-store start failed in pod nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-fx57t_farm(c588497d-2c3b-4a16-8cf8-71c14eced140): ErrImagePull: failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.2\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.2\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.2\": dial tcp: lookup registry-1.docker.io: no such host" logger="UnhandledError" machine # [ 38.825595] k3s[879]: E0922 14:51:29.858962 879 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.2\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.2\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.2\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-fx57t" podUID="c588497d-2c3b-4a16-8cf8-71c14eced140" machine # [ 38.858219] k3s[879]: E0922 14:51:29.893208 879 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.2\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.2\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.2\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.2" machine # [ 38.858720] k3s[879]: E0922 14:51:29.893255 879 kuberuntime_image.go:43] "Failed to pull image" err="failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.2\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.2\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.2\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.2" machine # [ 38.859642] k3s[879]: E0922 14:51:29.893453 879 kuberuntime_manager.go:1674] "Unhandled Error" err="init container seed-store start failed in pod nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-cxfvt_farm(2fc989c7-e813-4036-8f10-1f9e3ea2329e): ErrImagePull: failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.2\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.2\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.2\": dial tcp: lookup registry-1.docker.io: no such host" logger="UnhandledError" machine # [ 38.860487] k3s[879]: E0922 14:51:29.893512 879 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.2\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.2\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.2\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-cxfvt" podUID="2fc989c7-e813-4036-8f10-1f9e3ea2329e" machine # [ 38.885572] k3s[879]: time="2026-09-22T14:51:29Z" level=info msg="Imported docker.io/library/nix-grpc-farm:0.1.0-beta.2" machine # [ 38.892033] k3s[879]: time="2026-09-22T14:51:29Z" level=info msg="Tagged docker.io/library/nix-grpc-farm@sha256:7372cc34a62814fde45430bc5c397bb739cb96ffc0ce4c00f0efc1f66d2696f4" machine # [ 39.208288] systemd[1]: Started libcontainer container 29e7d977c111c86a04901b74dadbb50b9f855479e62cbe8e387fdee010527e44. machine # [ 39.318262] k3s[879]: time="2026-09-22T14:51:30Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm.tar in 6.102446819s" machine # [ 39.554233] systemd[1]: cri-containerd-fb1358d8ea5886775d62be193bc472817aae7a689a0200ec97fe1a1c0c3e8b89.scope: Deactivated successfully. machine # [ 39.593280] k3s[879]: I0922 14:51:30.628266 879 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-748bbd6bdc-mdq2s" podStartSLOduration=2.628244228 podStartE2EDuration="2.628244228s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-22 14:51:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-22 14:51:30.627142132 +0000 UTC m=+24.470333519" watchObservedRunningTime="2026-09-22 14:51:30.628244228 +0000 UTC m=+24.471435614" machine # [ 39.605035] dhcpcd[697]: veth93d5953b: soliciting a DHCP lease machine # [ 39.695571] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-fb1358d8ea5886775d62be193bc472817aae7a689a0200ec97fe1a1c0c3e8b89-rootfs.mount: Deactivated successfully. machine # [ 39.724282] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-fb1358d8ea5886775d62be193bc472817aae7a689a0200ec97fe1a1c0c3e8b89-shm.mount: Deactivated successfully. machine # [ 39.909621] cni0: port 2(veth63f9dd46) entered disabled state machine # [ 39.756505] dhcpcd[697]: veth[ 39.911097] veth63f9dd46 (unregistering): left allmulticast mode machine # 63f9dd46: carrier lost machine # [ 39.912186] veth63f9dd46 (unregistering): left promiscuous mode machine # [ 39.913219] cni0: port 2(veth63f9dd46) entered disabled state machine # [ 39.779577] systemd[1]: run-netns-cni\x2dab13a848\x2db1aa\x2dcba4\x2d5e4a\x2d5e3e16de63f4.mount: Deactivated successfully. machine # [ 39.788578] dhcpcd[697]: veth63f9dd46: deleting address fe80::87d:c9ff:fed2:9367 machine # [ 39.827346] dhcpcd[697]: veth63f9dd46: removing interface machine # [ 39.882605] k3s[879]: I0922 14:51:30.917302 879 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/773469c0-9faf-41ba-a379-449d3b359b88-klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/773469c0-9faf-41ba-a379-449d3b359b88-klipper-config\") pod \"773469c0-9faf-41ba-a379-449d3b359b88\" (UID: \"773469c0-9faf-41ba-a379-449d3b359b88\") " machine # [ 39.883607] k3s[879]: I0922 14:51:30.917351 879 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/773469c0-9faf-41ba-a379-449d3b359b88-klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/773469c0-9faf-41ba-a379-449d3b359b88-klipper-cache\") pod \"773469c0-9faf-41ba-a379-449d3b359b88\" (UID: \"773469c0-9faf-41ba-a379-449d3b359b88\") " machine # [ 39.884086] k3s[879]: I0922 14:51:30.917383 879 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/773469c0-9faf-41ba-a379-449d3b359b88-values\" (UniqueName: \"kubernetes.io/projected/773469c0-9faf-41ba-a379-449d3b359b88-values\") pod \"773469c0-9faf-41ba-a379-449d3b359b88\" (UID: \"773469c0-9faf-41ba-a379-449d3b359b88\") " machine # [ 39.884697] k3s[879]: I0922 14:51:30.917410 879 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/773469c0-9faf-41ba-a379-449d3b359b88-kube-api-access-9kkpv\" (UniqueName: \"kubernetes.io/projected/773469c0-9faf-41ba-a379-449d3b359b88-kube-api-access-9kkpv\") pod \"773469c0-9faf-41ba-a379-449d3b359b88\" (UID: \"773469c0-9faf-41ba-a379-449d3b359b88\") " machine # [ 39.886158] k3s[879]: I0922 14:51:30.917451 879 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/773469c0-9faf-41ba-a379-449d3b359b88-content\" (UniqueName: \"kubernetes.io/configmap/773469c0-9faf-41ba-a379-449d3b359b88-content\") pod \"773469c0-9faf-41ba-a379-449d3b359b88\" (UID: \"773469c0-9faf-41ba-a379-449d3b359b88\") " machine # [ 39.887652] k3s[879]: I0922 14:51:30.917480 879 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/773469c0-9faf-41ba-a379-449d3b359b88-klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/773469c0-9faf-41ba-a379-449d3b359b88-klipper-helm\") pod \"773469c0-9faf-41ba-a379-449d3b359b88\" (UID: \"773469c0-9faf-41ba-a379-449d3b359b88\") " machine # [ 39.888701] k3s[879]: I0922 14:51:30.917509 879 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/773469c0-9faf-41ba-a379-449d3b359b88-tmp\" (UniqueName: \"kubernetes.io/empty-dir/773469c0-9faf-41ba-a379-449d3b359b88-tmp\") pod \"773469c0-9faf-41ba-a379-449d3b359b88\" (UID: \"773469c0-9faf-41ba-a379-449d3b359b88\") " machine # [ 39.889386] k3s[879]: I0922 14:51:30.918601 879 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/773469c0-9faf-41ba-a379-449d3b359b88-content" pod "773469c0-9faf-41ba-a379-449d3b359b88" (UID: "773469c0-9faf-41ba-a379-449d3b359b88"). InnerVolumeSpecName "content". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 39.894849] systemd[1]: var-lib-kubelet-pods-773469c0\x2d9faf\x2d41ba\x2da379\x2d449d3b359b88-volumes-kubernetes.io\x7eprojected-values.mount: Deactivated successfully. machine # [ 39.898431] systemd[1]: var-lib-kubelet-pods-773469c0\x2d9faf\x2d41ba\x2da379\x2d449d3b359b88-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2d9kkpv.mount: Deactivated successfully. machine # [ 39.899197] systemd[1]: var-lib-kubelet-pods-773469c0\x2d9faf\x2d41ba\x2da379\x2d449d3b359b88-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dcache.mount: Deactivated successfully. machine # [ 39.899717] systemd[1]: var-lib-kubelet-pods-773469c0\x2d9faf\x2d41ba\x2da379\x2d449d3b359b88-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dhelm.mount: Deactivated successfully. machine # [ 39.900226] systemd[1]: var-lib-kubelet-pods-773469c0\x2d9faf\x2d41ba\x2da379\x2d449d3b359b88-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 39.900698] systemd[1]: var-lib-kubelet-pods-773469c0\x2d9faf\x2d41ba\x2da379\x2d449d3b359b88-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dconfig.mount: Deactivated successfully. machine # [ 39.930668] k3s[879]: I0922 14:51:30.965501 879 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/773469c0-9faf-41ba-a379-449d3b359b88-klipper-cache" pod "773469c0-9faf-41ba-a379-449d3b359b88" (UID: "773469c0-9faf-41ba-a379-449d3b359b88"). InnerVolumeSpecName "klipper-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 39.932205] k3s[879]: I0922 14:51:30.965802 879 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/773469c0-9faf-41ba-a379-449d3b359b88-tmp" pod "773469c0-9faf-41ba-a379-449d3b359b88" (UID: "773469c0-9faf-41ba-a379-449d3b359b88"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 39.932942] k3s[879]: I0922 14:51:30.966351 879 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/773469c0-9faf-41ba-a379-449d3b359b88-klipper-helm" pod "773469c0-9faf-41ba-a379-449d3b359b88" (UID: "773469c0-9faf-41ba-a379-449d3b359b88"). InnerVolumeSpecName "klipper-helm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 39.933943] k3s[879]: I0922 14:51:30.966958 879 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/773469c0-9faf-41ba-a379-449d3b359b88-klipper-config" pod "773469c0-9faf-41ba-a379-449d3b359b88" (UID: "773469c0-9faf-41ba-a379-449d3b359b88"). InnerVolumeSpecName "klipper-config". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 39.934639] k3s[879]: I0922 14:51:30.967082 879 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/773469c0-9faf-41ba-a379-449d3b359b88-kube-api-access-9kkpv" pod "773469c0-9faf-41ba-a379-449d3b359b88" (UID: "773469c0-9faf-41ba-a379-449d3b359b88"). InnerVolumeSpecName "kube-api-access-9kkpv". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 39.935144] k3s[879]: I0922 14:51:30.967173 879 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/773469c0-9faf-41ba-a379-449d3b359b88-values" pod "773469c0-9faf-41ba-a379-449d3b359b88" (UID: "773469c0-9faf-41ba-a379-449d3b359b88"). InnerVolumeSpecName "values". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 39.983028] k3s[879]: I0922 14:51:31.017999 879 reconciler_common.go:299] "Volume detached for volume \"values\" (UniqueName: \"kubernetes.io/projected/773469c0-9faf-41ba-a379-449d3b359b88-values\") on node \"machine\" DevicePath \"\"" machine # [ 39.983867] k3s[879]: I0922 14:51:31.018033 879 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9kkpv\" (UniqueName: \"kubernetes.io/projected/773469c0-9faf-41ba-a379-449d3b359b88-kube-api-access-9kkpv\") on node \"machine\" DevicePath \"\"" machine # [ 39.984587] k3s[879]: I0922 14:51:31.018046 879 reconciler_common.go:299] "Volume detached for volume \"content\" (UniqueName: \"kubernetes.io/configmap/773469c0-9faf-41ba-a379-449d3b359b88-content\") on node \"machine\" DevicePath \"\"" machine # [ 39.991158] k3s[879]: I0922 14:51:31.018062 879 reconciler_common.go:299] "Volume detached for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/773469c0-9faf-41ba-a379-449d3b359b88-klipper-helm\") on node \"machine\" DevicePath \"\"" machine # [ 39.991818] k3s[879]: I0922 14:51:31.018075 879 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/773469c0-9faf-41ba-a379-449d3b359b88-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 39.992634] k3s[879]: I0922 14:51:31.018087 879 reconciler_common.go:299] "Volume detached for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/773469c0-9faf-41ba-a379-449d3b359b88-klipper-config\") on node \"machine\" DevicePath \"\"" machine # [ 39.993226] k3s[879]: I0922 14:51:31.018099 879 reconciler_common.go:299] "Volume detached for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/773469c0-9faf-41ba-a379-449d3b359b88-klipper-cache\") on node \"machine\" DevicePath \"\"" machine # [ 40.038593] dhcpcd[697]: veth4460433a: soliciting a DHCP lease machine # [ 40.141249] dhcpcd[697]: veth93d5953b: soliciting an IPv6 router machine # [ 40.425979] dhcpcd[697]: veth797fa628: soliciting a DHCP lease machine # [ 40.535370] k3s[879]: I0922 14:51:31.570260 879 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fb1358d8ea5886775d62be193bc472817aae7a689a0200ec97fe1a1c0c3e8b89" machine # [ 40.543523] dhcpcd[697]: veth12a5a3eb: soliciting a DHCP lease machine # [ 40.549250] systemd[1]: Removed slice libcontainer container kubepods-burstable-pod773469c0_9faf_41ba_a379_449d3b359b88.slice. machine # [ 40.550701] systemd[1]: kubepods-burstable-pod773469c0_9faf_41ba_a379_449d3b359b88.slice: Consumed 542ms CPU time over 6.159s wall clock time, 32.5M memory peak, 2.4M incoming IP traffic, 141.4K outgoing IP traffic. machine # [ 40.675748] dhcpcd[697]: flannel.1: probing for an IPv4LL address machine # [ 40.706378] dhcpcd[697]: veth5a164099: probing for an IPv4LL address machine # [ 40.781635] dhcpcd[697]: veth797fa628: soliciting an IPv6 router machine # [ 40.830815] dhcpcd[697]: veth12a5a3eb: soliciting an IPv6 router machine # [ 41.144497] dhcpcd[697]: veth4460433a: soliciting an IPv6 router machine # [ 44.292726] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount677420651.mount: Deactivated successfully. machine # [ 44.302887] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped1965132288.mount: Deactivated successfully. machine # [ 44.303876] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount3089854498.mount: Deactivated successfully. machine # [ 44.372347] systemd[1]: Started libcontainer container 1bc859a6b419fc7cc66121da6fff04c41e01c55dcd491e45eb76fa977dc146c2. machine # [ 44.429324] systemd[1]: Started libcontainer container db5c8ded848f6fc0061e60e727b87ec1d693cf47b013fb4e34c0be7e503eef7c. machine # [ 44.506333] systemd[1]: Started libcontainer container 603d6e6fd98fd8c19af262178767c9905f5d64c1ee23c0cc56bbe23e3ad610ae. machine # [ 44.605791] dhcpcd[697]: veth93d5953b: probing for an IPv4LL address machine # [ 44.612623] k3s[879]: I0922 14:51:35.647058 879 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-scheduler-547d7b8d9c-m8f8r" podStartSLOduration=6.80472336 podStartE2EDuration="7.647036001s" totalImagesPullingTime="842.312641ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-22 14:51:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-22 14:51:35.639859949 +0000 UTC m=+29.483051335" watchObservedRunningTime="2026-09-22 14:51:35.647036001 +0000 UTC m=+29.490227387" machine # [ 44.633433] niks3-server[1193]: 2026/09/22 14:51:35 INFO lead: acquired remote=10.42.0.4:57876 machine # [ 45.038971] dhcpcd[697]: veth4460433a: probing for an IPv4LL address machine # [ 45.235991] dhcpcd[697]: flannel.1: using IPv4LL address 169.254.91.231 machine # [ 45.236860] dhcpcd[697]: flannel.1: adding route to 169.254.0.0/16 machine # [ 45.426658] dhcpcd[697]: veth797fa628: probing for an IPv4LL address machine # [ 45.458528] dhcpcd[697]: veth5a164099: using IPv4LL address 169.254.10.188 machine # [ 45.458967] dhcpcd[697]: veth5a164099: adding route to 169.254.0.0/16 machine # [ 45.544499] dhcpcd[697]: veth12a5a3eb: probing for an IPv4LL address machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 20.19 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s, in 0.15 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s machine # [ 46.114972] systemd[1]: cri-containerd-603d6e6fd98fd8c19af262178767c9905f5d64c1ee23c0cc56bbe23e3ad610ae.scope: Deactivated successfully. machine # [ 46.115849] systemd[1]: cri-containerd-603d6e6fd98fd8c19af262178767c9905f5d64c1ee23c0cc56bbe23e3ad610ae.scope: Consumed 654ms CPU time over 1.607s wall clock time, 349.2M memory peak, 82.3M read from disk, 232.3M written to disk. machine # [ 46.118246] systemd[1]: cri-containerd-db5c8ded848f6fc0061e60e727b87ec1d693cf47b013fb4e34c0be7e503eef7c.scope: Deactivated successfully. machine # [ 46.120133] systemd[1]: cri-containerd-db5c8ded848f6fc0061e60e727b87ec1d693cf47b013fb4e34c0be7e503eef7c.scope: Consumed 657ms CPU time over 1.688s wall clock time, 335.6M memory peak, 80.2M read from disk, 232.3M written to disk. machine # [ 46.167565] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-db5c8ded848f6fc0061e60e727b87ec1d693cf47b013fb4e34c0be7e503eef7c-rootfs.mount: Deactivated successfully. machine # [ 46.186212] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-603d6e6fd98fd8c19af262178767c9905f5d64c1ee23c0cc56bbe23e3ad610ae-rootfs.mount: Deactivated successfully. machine # [ 46.672619] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped803881127.mount: Deactivated successfully. machine # [ 46.819318] systemd[1]: Started libcontainer container 635ec21a77c4013e93d1bb568dd1d5ab857a863a9dbaf7091fa2a367cf2f7017. machine # [ 46.822146] systemd[1]: Started libcontainer container e593c0aad7a21f9df2f05c0af0b610faab5011bf54d76dc3885468f92a096e41. machine # [ 46.967280] systemd[1]: Started libcontainer container 13898df19b9652ccf1925cee509b3e8472a676bcbd4e524fd7c9d0a21b501d54. machine # [ 47.013411] systemd[1]: Started libcontainer container aa21d3e54a05106b61374766c1769ffb0e0e874fd8f9dae3928539cd654a3868. machine # [ 47.159480] systemd[1]: Started libcontainer container e53542fe5f6ba4b62266e86042ffae8f59869a418e78eb6d60a2455178151f25. machine # [ 47.200077] systemd[1]: Started libcontainer container 02b71c7dc9ed256450c86b5235b011c9a5e6a91d96b397236b8cc71b4fd3b9e3. machine # [ 47.644258] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount2152217525.mount: Deactivated successfully. machine # [ 47.648282] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped1318162077.mount: Deactivated successfully. machine # [ 47.660254] k3s[879]: I0922 14:51:38.694382 879 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-fx57t" podStartSLOduration=8.335049421 podStartE2EDuration="10.694342292s" totalImagesPullingTime="696.732686ms" totalInitContainerRuntime="1.662560185s" isStatefulPod=false podCreationTimestamp="2026-09-22 14:51:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-22 14:51:38.693356692 +0000 UTC m=+32.536553666" watchObservedRunningTime="2026-09-22 14:51:38.694342292 +0000 UTC m=+32.537538148" machine # [ 48.439852] k3s[879]: I0922 14:51:39.474712 879 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-cxfvt" podStartSLOduration=9.234212025 podStartE2EDuration="11.474668842s" totalImagesPullingTime="685.888848ms" totalInitContainerRuntime="1.554567969s" isStatefulPod=false podCreationTimestamp="2026-09-22 14:51:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-22 14:51:38.71994387 +0000 UTC m=+32.563160679" watchObservedRunningTime="2026-09-22 14:51:39.474668842 +0000 UTC m=+33.317864698" machine # [ 48.731756] dhcpcd[697]: flannel.1: no IPv6 Routers available machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s, in 2.98 seconds) machine: waiting for unit niks3.service machine: (finished: waiting for unit niks3.service, in 0.05 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine # [ 49.190611] dhcpcd[697]: veth5a164099: no IPv6 Routers available machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.54 seconds) machine: waiting for success: test $(curl -sf 10.42.0.5:9901/clusters | grep -c 'health_flags::healthy') -ge 3 machine # [ 49.470570] dhcpcd[697]: veth4460433a: using IPv4LL address 169.254.120.84 machine # [ 49.471750] dhcpcd[697]: veth4460433a: adding route to 169.254.0.0/16 machine # [ 49.571366] dhcpcd[697]: veth93d5953b: using IPv4LL address 169.254.80.47 machine # [ 49.572143] dhcpcd[697]: veth93d5953b: adding route to 169.254.0.0/16 machine # [ 50.916305] dhcpcd[697]: veth797fa628: using IPv4LL address 169.254.83.175 machine # [ 50.917701] dhcpcd[697]: veth797fa628: adding route to 169.254.0.0/16 machine # [ 50.943456] dhcpcd[697]: veth12a5a3eb: using IPv4LL address 169.254.208.159 machine # [ 50.944748] dhcpcd[697]: veth12a5a3eb: adding route to 169.254.0.0/16 machine # [ 52.144902] dhcpcd[697]: veth93d5953b: no IPv6 Routers available machine # [ 52.784333] dhcpcd[697]: veth797fa628: no IPv6 Routers available machine # [ 52.833593] dhcpcd[697]: veth12a5a3eb: no IPv6 Routers available machine # [ 53.147976] dhcpcd[697]: veth4460433a: no IPv6 Routers available machine: (finished: waiting for success: test $(curl -sf 10.42.0.5:9901/clusters | grep -c 'health_flags::healthy') -ge 3, in 7.41 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.14 seconds) machine: waiting for success: curl -sf http://10.42.0.4:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2' machine: (finished: waiting for success: curl -sf http://10.42.0.4:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2', in 0.03 seconds) (finished: subtest: chart deploys and workers become Ready, in 31.48 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}', in 0.12 seconds) machine: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt machine: (finished: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt, in 0.14 seconds) subtest: build through the balancer lands in the cache machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1 machine # [ 94.582773] niks3-server[1193]: 2026/09/22 14:52:25 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 94.612849] niks3-server[1193]: 2026/09/22 14:52:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign machine # [ 94.616184] niks3-server[1193]: 2026/09/22 14:52:25 INFO Registered completed upload object_key=nar/0nzzbas7l8d37mridr7mg162smfjvn7lhs6am4crl4ydaxicigj8.nar.zst machine # [ 94.618491] niks3-server[1193]: 2026/09/22 14:52:25 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.ls machine # [ 94.627697] niks3-server[1193]: 2026/09/22 14:52:25 INFO Signed narinfos id=1 count=1 machine # [ 94.636690] niks3-server[1193]: 2026/09/22 14:52:25 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete machine # [ 94.640471] niks3-server[1193]: 2026/09/22 14:52:25 INFO Completed upload id=1 machine # [ 94.643789] niks3-server[1193]: 2026/09/22 14:52:25 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.narinfo machine # [ 119.727618] niks3-server[1193]: 2026/09/22 14:52:50 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 119.742552] niks3-server[1193]: 2026/09/22 14:52:50 INFO Registered completed upload object_key=nar/1p7jh5nyz9n68k5f18ymmdpgr34mpnnch1njw7ki7b2b97qlfbjk.nar.zst machine # [ 119.747156] niks3-server[1193]: 2026/09/22 14:52:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign machine # [ 119.748302] niks3-server[1193]: 2026/09/22 14:52:50 INFO Registered completed upload object_key=log/yz1sqzb72i8v6h2ass0v76ba8cncqj9r-k3s-a.drv machine # [ 119.749404] niks3-server[1193]: 2026/09/22 14:52:50 INFO Signed narinfos id=2 count=1 machine # [ 119.750686] niks3-server[1193]: 2026/09/22 14:52:50 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.ls machine # [ 119.758520] niks3-server[1193]: 2026/09/22 14:52:50 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete machine # [ 119.761060] niks3-server[1193]: 2026/09/22 14:52:50 INFO Completed upload id=2 machine # [ 119.762623] niks3-server[1193]: 2026/09/22 14:52:50 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.narinfo machine # [ 119.849282] niks3-server[1193]: 2026/09/22 14:52:50 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 119.863446] niks3-server[1193]: 2026/09/22 14:52:50 INFO Registered completed upload object_key=nar/03a4ywhyr5knmbc93z4gyml5y8fvgb431xvlmfxrwsm8mrb0qgx2.nar.zst machine # [ 119.869296] niks3-server[1193]: 2026/09/22 14:52:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign machine # [ 119.870077] niks3-server[1193]: 2026/09/22 14:52:50 INFO Signed narinfos id=3 count=1 machine # [ 119.875530] niks3-server[1193]: 2026/09/22 14:52:50 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.ls machine # [ 119.876527] niks3-server[1193]: 2026/09/22 14:52:50 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete machine # [ 119.879137] niks3-server[1193]: 2026/09/22 14:52:50 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.narinfo machine # [ 119.881286] niks3-server[1193]: 2026/09/22 14:52:50 INFO Completed upload id=3 machine # [ 144.980130] niks3-server[1193]: 2026/09/22 14:53:16 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 144.995160] niks3-server[1193]: 2026/09/22 14:53:16 INFO Registered completed upload object_key=nar/05qjsj5ff3a6vnxkhb6k5f3m446dcc206p7cd37w4v3mgi95d7kh.nar.zst machine # [ 144.996555] niks3-server[1193]: 2026/09/22 14:53:16 INFO Registered completed upload object_key=log/zfq1xw9bmycqh35l0s44lmv65z4xc7br-k3s-b.drv machine # [ 145.004437] niks3-server[1193]: 2026/09/22 14:53:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign machine # [ 145.007405] niks3-server[1193]: 2026/09/22 14:53:16 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.ls machine # [ 145.011625] niks3-server[1193]: 2026/09/22 14:53:16 INFO Signed narinfos id=4 count=1 machine # [ 145.019261] niks3-server[1193]: 2026/09/22 14:53:16 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete machine # [ 145.020977] niks3-server[1193]: 2026/09/22 14:53:16 INFO Completed upload id=4 machine # [ 145.024363] niks3-server[1193]: 2026/09/22 14:53:16 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.narinfo machine # [ 145.106471] niks3-server[1193]: 2026/09/22 14:53:16 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 145.119280] niks3-server[1193]: 2026/09/22 14:53:16 INFO Registered completed upload object_key=nar/0jyw88klkf3nwxpnj5m5lx3i1dv2idf3hcn6im7883hnldm3gvyq.nar.zst machine # [ 145.121948] niks3-server[1193]: 2026/09/22 14:53:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign machine # [ 145.123670] niks3-server[1193]: 2026/09/22 14:53:16 INFO Signed narinfos id=5 count=1 machine # [ 145.125431] niks3-server[1193]: 2026/09/22 14:53:16 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.ls machine # [ 145.129721] niks3-server[1193]: 2026/09/22 14:53:16 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete machine # [ 145.132069] niks3-server[1193]: 2026/09/22 14:53:16 INFO Completed upload id=5 machine # [ 169.637125] niks3-server[1193]: 2026/09/22 14:53:40 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 169.660710] niks3-server[1193]: 2026/09/22 14:53:40 INFO Registered completed upload object_key=log/n40czam6a4ldp1mh5fdmlcy07fv0akbm-k3s-top.drv machine # [ 169.665318] niks3-server[1193]: 2026/09/22 14:53:40 INFO Registered completed upload object_key=nar/1q8vp5xqws560mpf8rxk8r8jhqrzibivh13x4wxy0cfqlzbk7cr5.nar.zst machine # [ 169.666888] niks3-server[1193]: 2026/09/22 14:53:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign machine # [ 169.668212] niks3-server[1193]: 2026/09/22 14:53:40 INFO Signed narinfos id=6 count=1 machine # [ 169.674670] niks3-server[1193]: 2026/09/22 14:53:40 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.ls machine # [ 169.678443] niks3-server[1193]: 2026/09/22 14:53:40 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete machine # [ 169.681927] niks3-server[1193]: 2026/09/22 14:53:40 INFO Completed upload id=6 machine # [ 169.684250] niks3-server[1193]: 2026/09/22 14:53:40 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1, in 113.58 seconds) machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath, in 0.17 seconds) machine: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine: (finished: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.01 seconds) machine: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine # copying 3 paths... machine # copying path '/nix/store/r95r891injj9ski5c4w89yxjvjy065mx-k3s-a' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/mrqsh0475wxsmnsvkk55g94v6g5nrcra-k3s-b' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top' from 'http://192.168.1.1:5751'... machine: (finished: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.18 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1 machine # [ 196.096785] niks3-server[1193]: 2026/09/22 14:54:07 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 196.116861] niks3-server[1193]: 2026/09/22 14:54:07 INFO Registered completed upload object_key=nar/1fr26arhri17j9bj6hyjzmmd74v730biz1gb3kqd194vjx3ccvp9.nar.zst machine # [ 196.118921] niks3-server[1193]: 2026/09/22 14:54:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign machine # [ 196.121071] niks3-server[1193]: 2026/09/22 14:54:07 INFO Signed narinfos id=7 count=1 machine # [ 196.125384] niks3-server[1193]: 2026/09/22 14:54:07 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.ls machine # [ 196.133085] niks3-server[1193]: 2026/09/22 14:54:07 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete machine # [ 196.135616] niks3-server[1193]: 2026/09/22 14:54:07 INFO Completed upload id=7 machine # [ 196.137159] niks3-server[1193]: 2026/09/22 14:54:07 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.narinfo machine # [ 220.626310] niks3-server[1193]: 2026/09/22 14:54:31 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 220.643730] niks3-server[1193]: 2026/09/22 14:54:31 INFO Registered completed upload object_key=nar/1hfc6x4x25k3b0fk091d3nb0k3mympfp05fkslcx19synp3ig0zd.nar.zst machine # [ 220.645381] niks3-server[1193]: 2026/09/22 14:54:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign machine # [ 220.646380] niks3-server[1193]: 2026/09/22 14:54:31 INFO Signed narinfos id=8 count=1 machine # [ 220.648764] niks3-server[1193]: 2026/09/22 14:54:31 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.ls machine # [ 220.652551] niks3-server[1193]: 2026/09/22 14:54:31 INFO Registered completed upload object_key=log/pbpqsh50ar10fpasdqqx8xg3lmr5j8iz-k3s-a.drv machine # [ 220.656031] niks3-server[1193]: 2026/09/22 14:54:31 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete machine # [ 220.659054] niks3-server[1193]: 2026/09/22 14:54:31 INFO Completed upload id=8 machine # [ 220.661691] niks3-server[1193]: 2026/09/22 14:54:31 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.narinfo machine # [ 220.743476] niks3-server[1193]: 2026/09/22 14:54:31 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 220.757277] niks3-server[1193]: 2026/09/22 14:54:31 INFO Registered completed upload object_key=nar/0zzq2vgjln4shvh57091n14sam6wh6w06vja6lzb9ppcj4ffyx1n.nar.zst machine # [ 220.757947] niks3-server[1193]: 2026/09/22 14:54:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign machine # [ 220.758615] niks3-server[1193]: 2026/09/22 14:54:31 INFO Signed narinfos id=9 count=1 machine # [ 220.761641] niks3-server[1193]: 2026/09/22 14:54:31 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.ls machine # [ 220.764204] niks3-server[1193]: 2026/09/22 14:54:31 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete machine # [ 220.767334] niks3-server[1193]: 2026/09/22 14:54:31 INFO Completed upload id=9 machine # [ 220.768153] niks3-server[1193]: 2026/09/22 14:54:31 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.narinfo machine # [ 246.048144] niks3-server[1193]: 2026/09/22 14:54:57 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 246.067959] niks3-server[1193]: 2026/09/22 14:54:57 INFO Registered completed upload object_key=nar/0hh3nqk95r6g32lhdmxw8cxjv694vbpx9876zkhcpg4r4qxni2ch.nar.zst machine # [ 246.071200] niks3-server[1193]: 2026/09/22 14:54:57 INFO Registered completed upload object_key=log/894h6wzw2l4w5f0hikj1k6q57jfnyi87-k3s-b.drv machine # [ 246.073741] niks3-server[1193]: 2026/09/22 14:54:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign machine # [ 246.076259] niks3-server[1193]: 2026/09/22 14:54:57 INFO Signed narinfos id=10 count=1 machine # [ 246.078459] niks3-server[1193]: 2026/09/22 14:54:57 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.ls machine # [ 246.086679] niks3-server[1193]: 2026/09/22 14:54:57 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete machine # [ 246.089706] niks3-server[1193]: 2026/09/22 14:54:57 INFO Completed upload id=10 machine # [ 246.091647] niks3-server[1193]: 2026/09/22 14:54:57 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.narinfo machine # [ 246.174847] niks3-server[1193]: 2026/09/22 14:54:57 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 246.188437] niks3-server[1193]: 2026/09/22 14:54:57 INFO Registered completed upload object_key=nar/0ingamx56k31lwiyxmnxmscjj4n3qfx6sr2kpaynsrwhwz1278iw.nar.zst machine # [ 246.192361] niks3-server[1193]: 2026/09/22 14:54:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign machine # [ 246.193116] niks3-server[1193]: 2026/09/22 14:54:57 INFO Signed narinfos id=11 count=1 machine # [ 246.198322] niks3-server[1193]: 2026/09/22 14:54:57 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.ls machine # [ 246.200898] niks3-server[1193]: 2026/09/22 14:54:57 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete machine # [ 246.203043] niks3-server[1193]: 2026/09/22 14:54:57 INFO Completed upload id=11 machine # [ 246.204482] niks3-server[1193]: 2026/09/22 14:54:57 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.narinfo machine # [ 270.905625] niks3-server[1193]: 2026/09/22 14:55:21 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 270.923766] niks3-server[1193]: 2026/09/22 14:55:21 INFO Registered completed upload object_key=log/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g-k3s-top.drv machine # [ 270.930107] niks3-server[1193]: 2026/09/22 14:55:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign machine # [ 270.934416] niks3-server[1193]: 2026/09/22 14:55:21 INFO Signed narinfos id=12 count=1 machine # [ 270.938168] niks3-server[1193]: 2026/09/22 14:55:21 INFO Registered completed upload object_key=nar/0v48x4sp58bvfra08axgkz7yl1n9nc4nirskyv1hwann4i7q277i.nar.zst machine # [ 270.943841] niks3-server[1193]: 2026/09/22 14:55:21 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete machine # [ 270.947480] niks3-server[1193]: 2026/09/22 14:55:21 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.ls machine # [ 270.950836] niks3-server[1193]: 2026/09/22 14:55:21 INFO Completed upload id=12 machine # [ 270.952709] niks3-server[1193]: 2026/09/22 14:55:21 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1, in 99.86 seconds) (finished: subtest: build through the balancer lands in the cache, in 213.81 seconds) subtest: a Job with the client image builds through the farm with its service account machine: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine: (finished: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.13 seconds) machine: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix machine: (finished: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix, in 0.13 seconds) machine: must succeed: kubectl apply -f /nix/store/5zbfzipmjpmaynlxm0inx5vg2nv8690v-ci-job.json machine: (finished: must succeed: kubectl apply -f /nix/store/5zbfzipmjpmaynlxm0inx5vg2nv8690v-ci-job.json, in 0.14 seconds) machine: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed' machine # [ 272.335028] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod06ff0f5c_c52f_4167_9b3f_3f597b1b6250.slice. machine # [ 272.474219] k3s[879]: I0922 14:55:23.508834 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/06ff0f5c-c52f-4167-9b3f-3f597b1b6250-nix-grpc-farm\") pod \"ci-dzrct\" (UID: \"06ff0f5c-c52f-4167-9b3f-3f597b1b6250\") " pod="ci/ci-dzrct" machine # [ 272.474717] k3s[879]: I0922 14:55:23.508948 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"job\" (UniqueName: \"kubernetes.io/configmap/06ff0f5c-c52f-4167-9b3f-3f597b1b6250-job\") pod \"ci-dzrct\" (UID: \"06ff0f5c-c52f-4167-9b3f-3f597b1b6250\") " pod="ci/ci-dzrct" machine # [ 272.475479] k3s[879]: I0922 14:55:23.509019 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95dbl\" (UniqueName: \"kubernetes.io/projected/06ff0f5c-c52f-4167-9b3f-3f597b1b6250-kube-api-access-95dbl\") pod \"ci-dzrct\" (UID: \"06ff0f5c-c52f-4167-9b3f-3f597b1b6250\") " pod="ci/ci-dzrct" machine # [ 272.814237] cni0: port 2(vethe57f2240) entered blocking state machine # [ 272.814936] cni0: port 2(vethe57f2240) entered disabled state machine # [ 272.816015] vethe57f2240: entered allmulticast mode machine # [ 272.816905] vethe57f2240: entered promiscuous mode machine # [ 272.825620] cni0: port 2(vethe57f2240) entered blocking state machine # [ 272.826672] cni0: port 2(vethe57f2240) entered forwarding state machine # [ 272.701917] (udev-worker)[4912]: Network interface NamePolicy= disabled on kernel command line. machine # [ 272.729116] dhcpcd[697]: vethe57f2240: IAID 1c:3e:fd:88 machine # [ 272.729960] dhcpcd[697]: vethe57f2240: adding address fe80::f0c6:1cff:fe3e:fd88 machine # [ 272.752273] systemd[1]: Started libcontainer container 5e193a5e6c74377e4f66df48b9f0a392f2dd8a333132a762368f45d955e2b79d. machine # [ 273.430259] dhcpcd[697]: vethe57f2240: soliciting a DHCP lease machine # [ 274.083961] dhcpcd[697]: vethe57f2240: soliciting an IPv6 router machine # [ 274.514562] systemd[1]: Started libcontainer container 8ec2a6f5aa0c882f7db9e842fb1be5b29fdc5832e062a381aaad8dc061887776. machine # [ 275.459908] k3s[879]: I0922 14:55:26.494216 879 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ci/ci-dzrct" podStartSLOduration=3.494174089 podStartE2EDuration="3.494174089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-22 14:55:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-22 14:55:26.493415612 +0000 UTC m=+260.336612027" watchObservedRunningTime="2026-09-22 14:55:26.494174089 +0000 UTC m=+260.337370224" machine # [ 275.868719] niks3-server[1193]: 2026/09/22 14:55:26 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 275.886394] niks3-server[1193]: 2026/09/22 14:55:26 INFO Registered completed upload object_key=nar/111g6dyibwcf2z7jhpn72rgja0qvjgpdiv9nc06g2dp7ih0a6kyq.nar.zst machine # [ 275.891836] niks3-server[1193]: 2026/09/22 14:55:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign machine # [ 275.895996] niks3-server[1193]: 2026/09/22 14:55:26 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.ls machine # [ 275.896992] niks3-server[1193]: 2026/09/22 14:55:26 INFO Signed narinfos id=13 count=1 machine # [ 275.907546] niks3-server[1193]: 2026/09/22 14:55:26 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete machine # [ 275.909897] niks3-server[1193]: 2026/09/22 14:55:26 INFO Completed upload id=13 machine # [ 275.914620] niks3-server[1193]: 2026/09/22 14:55:26 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.narinfo machine # [ 278.431892] dhcpcd[697]: vethe57f2240: probing for an IPv4LL address machine # [ 283.852785] dhcpcd[697]: vethe57f2240: using IPv4LL address 169.254.54.208 machine # [ 283.855288] dhcpcd[697]: vethe57f2240: adding route to 169.254.0.0/16 machine # [ 286.087502] dhcpcd[697]: vethe57f2240: no IPv6 Routers available machine # [ 300.621406] niks3-server[1193]: 2026/09/22 14:55:51 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 300.640297] niks3-server[1193]: 2026/09/22 14:55:51 INFO Registered completed upload object_key=nar/058kjd2vfl1r27b4d9ixvwf77d8rkr18a4v894kwx8lg0nwpajnr.nar.zst machine # [ 300.642218] niks3-server[1193]: 2026/09/22 14:55:51 INFO Registered completed upload object_key=log/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # [ 300.643604] niks3-server[1193]: 2026/09/22 14:55:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign machine # [ 300.645476] niks3-server[1193]: 2026/09/22 14:55:51 INFO Signed narinfos id=14 count=1 machine # [ 300.647433] niks3-server[1193]: 2026/09/22 14:55:51 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.ls machine # [ 300.651504] niks3-server[1193]: 2026/09/22 14:55:51 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete machine # [ 300.653405] niks3-server[1193]: 2026/09/22 14:55:51 INFO Completed upload id=14 machine # [ 300.655566] niks3-server[1193]: 2026/09/22 14:55:51 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.narinfo machine # [ 300.755894] niks3-server[1193]: 2026/09/22 14:55:51 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 300.768886] niks3-server[1193]: 2026/09/22 14:55:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign machine # [ 300.770765] niks3-server[1193]: 2026/09/22 14:55:51 INFO Signed narinfos id=15 count=1 machine # [ 300.775317] niks3-server[1193]: 2026/09/22 14:55:51 INFO Registered completed upload object_key=nar/138ynhcd5wxzz485x9qcq7xsargaklrf2li31ai69m5r46am35q6.nar.zst machine # [ 300.778040] niks3-server[1193]: 2026/09/22 14:55:51 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete machine # [ 300.779662] niks3-server[1193]: 2026/09/22 14:55:51 INFO Completed upload id=15 machine # [ 300.781493] niks3-server[1193]: 2026/09/22 14:55:51 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.narinfo machine # [ 309.803438] postgres[759]: [759] LOG: checkpoint starting: time machine # [ 325.894931] niks3-server[1193]: 2026/09/22 14:56:16 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 325.914879] niks3-server[1193]: 2026/09/22 14:56:16 INFO Registered completed upload object_key=nar/0n4lbdlp8w72fs3qbavl2lwrzbrn55i2b1vyglc89cc3pi8vbb1m.nar.zst machine # [ 325.920330] niks3-server[1193]: 2026/09/22 14:56:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign machine # [ 325.922053] niks3-server[1193]: 2026/09/22 14:56:16 INFO Signed narinfos id=16 count=1 machine # [ 325.925970] niks3-server[1193]: 2026/09/22 14:56:16 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.ls machine # [ 325.929227] niks3-server[1193]: 2026/09/22 14:56:16 INFO Registered completed upload object_key=log/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # [ 325.932617] niks3-server[1193]: 2026/09/22 14:56:16 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete machine # [ 325.935953] niks3-server[1193]: 2026/09/22 14:56:16 INFO Completed upload id=16 machine # [ 325.940091] niks3-server[1193]: 2026/09/22 14:56:16 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo machine # [ 326.033101] niks3-server[1193]: 2026/09/22 14:56:17 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 326.047671] niks3-server[1193]: 2026/09/22 14:56:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign machine # [ 326.049668] niks3-server[1193]: 2026/09/22 14:56:17 INFO Registered completed upload object_key=nar/1f3gvnvqsm2pm3laixkxkg44kvjb251zqhszcfpp0a00h6x66ljs.nar.zst machine # [ 326.052022] niks3-server[1193]: 2026/09/22 14:56:17 INFO Signed narinfos id=17 count=1 machine # [ 326.053273] niks3-server[1193]: 2026/09/22 14:56:17 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.ls machine # [ 326.055140] niks3-server[1193]: 2026/09/22 14:56:17 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete machine # [ 326.057399] niks3-server[1193]: 2026/09/22 14:56:17 INFO Completed upload id=17 machine # [ 326.059512] niks3-server[1193]: 2026/09/22 14:56:17 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.narinfo machine # [ 350.538175] niks3-server[1193]: 2026/09/22 14:56:41 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 350.551050] niks3-server[1193]: 2026/09/22 14:56:41 INFO Registered completed upload object_key=nar/1zwf0asrdv12q40fmqga5lx5330dvn9y4in4i9ficz9ij5lhvnf5.nar.zst machine # [ 350.553055] niks3-server[1193]: 2026/09/22 14:56:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign machine # [ 350.554360] niks3-server[1193]: 2026/09/22 14:56:41 INFO Registered completed upload object_key=log/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # [ 350.556074] niks3-server[1193]: 2026/09/22 14:56:41 INFO Signed narinfos id=18 count=1 machine # [ 350.557428] niks3-server[1193]: 2026/09/22 14:56:41 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.ls machine # [ 350.560534] niks3-server[1193]: 2026/09/22 14:56:41 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete machine # [ 350.562764] niks3-server[1193]: 2026/09/22 14:56:41 INFO Completed upload id=18 machine # [ 350.564207] niks3-server[1193]: 2026/09/22 14:56:41 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo machine # [ 352.249716] niks3-server[1193]: 2026/09/22 14:56:43 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 352.266637] niks3-server[1193]: 2026/09/22 14:56:43 INFO Registered completed upload object_key=nar/0xiyqcsl8db7dnrq2gqnx5izavr51ma3dcdswrriaxfgj3qzk7xf.nar.zst machine # [ 352.268564] niks3-server[1193]: 2026/09/22 14:56:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign machine # [ 352.269968] niks3-server[1193]: 2026/09/22 14:56:43 INFO Signed narinfos id=19 count=1 machine # [ 352.273284] niks3-server[1193]: 2026/09/22 14:56:43 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.ls machine # [ 352.277191] niks3-server[1193]: 2026/09/22 14:56:43 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete machine # [ 352.279313] niks3-server[1193]: 2026/09/22 14:56:43 INFO Completed upload id=19 machine # [ 352.281019] niks3-server[1193]: 2026/09/22 14:56:43 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.narinfo machine # [ 376.963828] niks3-server[1193]: 2026/09/22 14:57:07 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 376.979339] niks3-server[1193]: 2026/09/22 14:57:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign machine # [ 376.981227] niks3-server[1193]: 2026/09/22 14:57:08 INFO Registered completed upload object_key=nar/0p3l2z3riilylr2rxb1aq2blxdfxg55wbgp4gxkns93srbr4bwyq.nar.zst machine # [ 376.983432] niks3-server[1193]: 2026/09/22 14:57:08 INFO Signed narinfos id=20 count=1 machine # [ 376.984811] niks3-server[1193]: 2026/09/22 14:57:08 INFO Registered completed upload object_key=log/fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # [ 376.986888] niks3-server[1193]: 2026/09/22 14:57:08 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.ls machine # [ 376.988962] niks3-server[1193]: 2026/09/22 14:57:08 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete machine # [ 376.991400] niks3-server[1193]: 2026/09/22 14:57:08 INFO Completed upload id=20 machine # [ 376.992171] niks3-server[1193]: 2026/09/22 14:57:08 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo machine # [ 377.120190] systemd[1]: cri-containerd-8ec2a6f5aa0c882f7db9e842fb1be5b29fdc5832e062a381aaad8dc061887776.scope: Deactivated successfully. machine # [ 377.123888] systemd[1]: cri-containerd-8ec2a6f5aa0c882f7db9e842fb1be5b29fdc5832e062a381aaad8dc061887776.scope: Consumed 919ms CPU time over 1min 42.607s wall clock time, 130.6M memory peak, 61.1M read from disk, 428K written to disk, 17K incoming IP traffic, 44.1K outgoing IP traffic. machine # [ 377.185700] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-8ec2a6f5aa0c882f7db9e842fb1be5b29fdc5832e062a381aaad8dc061887776-rootfs.mount: Deactivated successfully. machine # [ 378.812832] systemd[1]: cri-containerd-5e193a5e6c74377e4f66df48b9f0a392f2dd8a333132a762368f45d955e2b79d.scope: Deactivated successfully. machine # [ 378.870587] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-5e193a5e6c74377e4f66df48b9f0a392f2dd8a333132a762368f45d955e2b79d-rootfs.mount: Deactivated successfully. machine # [ 378.906225] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-5e193a5e6c74377e4f66df48b9f0a392f2dd8a333132a762368f45d955e2b79d-shm.mount: Deactivated successfully. machine # [ 379.091608] cni0: port 2(vethe57f2240) entered disabled state machine # [ 378.939819] dhcpcd[697]: vethe57f2240: carrier lost machine # [ 379.093660] vethe57f2240 (unregistering): left allmulticast mode machine # [ 379.094545] vethe57f2240 (unregistering): left promiscuous mode machine # [ 379.095790] cni0: port 2(vethe57f2240) entered disabled state machine # [ 378.965167] systemd[1]: run-netns-cni\x2d02d9d04c\x2d5988\x2dfd00\x2d8061\x2d228f940a3593.mount: Deactivated successfully. machine # [ 378.967039] dhcpcd[697]: vethe57f2240: deleting address fe80::f0c6:1cff:fe3e:fd88 machine # [ 378.969458] dhcpcd[697]: vethe57f2240: deleting route to 169.254.0.0/16 machine # [ 379.022278] dhcpcd[697]: vethe57f2240: removing interface machine # [ 379.082087] k3s[879]: I0922 14:57:10.116696 879 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/06ff0f5c-c52f-4167-9b3f-3f597b1b6250-job\" (UniqueName: \"kubernetes.io/configmap/06ff0f5c-c52f-4167-9b3f-3f597b1b6250-job\") pod \"06ff0f5c-c52f-4167-9b3f-3f597b1b6250\" (UID: \"06ff0f5c-c52f-4167-9b3f-3f597b1b6250\") " machine # [ 379.082990] k3s[879]: I0922 14:57:10.116781 879 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/06ff0f5c-c52f-4167-9b3f-3f597b1b6250-nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/06ff0f5c-c52f-4167-9b3f-3f597b1b6250-nix-grpc-farm\") pod \"06ff0f5c-c52f-4167-9b3f-3f597b1b6250\" (UID: \"06ff0f5c-c52f-4167-9b3f-3f597b1b6250\") " machine # [ 379.083595] k3s[879]: I0922 14:57:10.116814 879 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/06ff0f5c-c52f-4167-9b3f-3f597b1b6250-kube-api-access-95dbl\" (UniqueName: \"kubernetes.io/projected/06ff0f5c-c52f-4167-9b3f-3f597b1b6250-kube-api-access-95dbl\") pod \"06ff0f5c-c52f-4167-9b3f-3f597b1b6250\" (UID: \"06ff0f5c-c52f-4167-9b3f-3f597b1b6250\") " machine # [ 379.084158] k3s[879]: I0922 14:57:10.117820 879 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06ff0f5c-c52f-4167-9b3f-3f597b1b6250-job" pod "06ff0f5c-c52f-4167-9b3f-3f597b1b6250" (UID: "06ff0f5c-c52f-4167-9b3f-3f597b1b6250"). InnerVolumeSpecName "job". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 379.085950] systemd[1]: var-lib-kubelet-pods-06ff0f5c\x2dc52f\x2d4167\x2d9b3f\x2d3f597b1b6250-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2d95dbl.mount: Deactivated successfully. machine # [ 379.089017] systemd[1]: var-lib-kubelet-pods-06ff0f5c\x2dc52f\x2d4167\x2d9b3f\x2d3f597b1b6250-volumes-kubernetes.io\x7eprojected-nix\x2dgrpc\x2dfarm.mount: Deactivated successfully. machine # [ 379.102826] k3s[879]: I0922 14:57:10.137854 879 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06ff0f5c-c52f-4167-9b3f-3f597b1b6250-kube-api-access-95dbl" pod "06ff0f5c-c52f-4167-9b3f-3f597b1b6250" (UID: "06ff0f5c-c52f-4167-9b3f-3f597b1b6250"). InnerVolumeSpecName "kube-api-access-95dbl". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 379.103499] k3s[879]: I0922 14:57:10.137947 879 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06ff0f5c-c52f-4167-9b3f-3f597b1b6250-nix-grpc-farm" pod "06ff0f5c-c52f-4167-9b3f-3f597b1b6250" (UID: "06ff0f5c-c52f-4167-9b3f-3f597b1b6250"). InnerVolumeSpecName "nix-grpc-farm". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 379.182340] k3s[879]: I0922 14:57:10.217231 879 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95dbl\" (UniqueName: \"kubernetes.io/projected/06ff0f5c-c52f-4167-9b3f-3f597b1b6250-kube-api-access-95dbl\") on node \"machine\" DevicePath \"\"" machine # [ 379.183918] k3s[879]: I0922 14:57:10.217289 879 reconciler_common.go:299] "Volume detached for volume \"job\" (UniqueName: \"kubernetes.io/configmap/06ff0f5c-c52f-4167-9b3f-3f597b1b6250-job\") on node \"machine\" DevicePath \"\"" machine # [ 379.185151] k3s[879]: I0922 14:57:10.217316 879 reconciler_common.go:299] "Volume detached for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/06ff0f5c-c52f-4167-9b3f-3f597b1b6250-nix-grpc-farm\") on node \"machine\" DevicePath \"\"" machine # [ 379.457137] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod06ff0f5c_c52f_4167_9b3f_3f597b1b6250.slice. machine # [ 379.459388] systemd[1]: kubepods-besteffort-pod06ff0f5c_c52f_4167_9b3f_3f597b1b6250.slice: Consumed 948ms CPU time over 1min 47.120s wall clock time, 130.9M memory peak, 61.1M read from disk, 632K written to disk, 17K incoming IP traffic, 44.1K outgoing IP traffic. machine # [ 379.806690] k3s[879]: I0922 14:57:10.841607 879 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5e193a5e6c74377e4f66df48b9f0a392f2dd8a333132a762368f45d955e2b79d" machine: (finished: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed', in 109.14 seconds) machine: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1 machine: (finished: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1, in 0.13 seconds) machine # don't know how to build these paths: machine # /nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-a> machine/nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-fx57t: building fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-b> machine/nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-fx57t: building 1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-top> machine/nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-fx57t: building rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # INFO:nix_fast_build.processes:run nix-eval-jobs --gc-roots-dir /tmp/tmpt4xw241b/gcroots --force-recurse --max-memory-size 4096 --workers 4 --flake '.#checks' --check-cache-status machine # INFO:nix_fast_build.workers:builds: 0 machine # warning: Git tree '/tmp' is dirty machine # warning: Git tree '/tmp' is dirty machine # ▶ x86_64-linux.t started machine # INFO:nix_fast_build.workers:builds: 2 machine # ✔ x86_64-linux.t (25s) machine # x86_64-linux.t> machine/nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-cxfvt: building fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # warning: Git tree '/tmp' is dirty machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath, in 0.15 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null, in 0.04 seconds) (finished: subtest: a Job with the client image builds through the farm with its service account, in 110.17 seconds) subtest: a renewed balancer certificate is served without a rollout machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f - machine # Warning: resource secrets/farm-lb-tls is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically. machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f -, in 0.28 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}', in 0.90 seconds) machine: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-748bbd6bdc-mdq2s -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine # [ 382.583053] k3s[879]: E0922 14:57:13.617456 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60822: use of closed network connection machine # [ 383.819045] k3s[879]: E0922 14:57:14.853623 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46442: use of closed network connection machine # [ 385.055566] k3s[879]: E0922 14:57:16.090229 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46470: use of closed network connection machine # [ 386.313646] k3s[879]: E0922 14:57:17.348301 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46496: use of closed network connection machine # [ 387.522655] k3s[879]: E0922 14:57:18.557304 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46520: use of closed network connection machine # [ 388.748334] k3s[879]: E0922 14:57:19.782643 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46538: use of closed network connection machine # [ 390.001444] k3s[879]: E0922 14:57:21.035891 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46566: use of closed network connection machine # [ 391.206827] k3s[879]: E0922 14:57:22.241548 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46596: use of closed network connection machine # [ 392.519732] k3s[879]: E0922 14:57:23.554275 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46630: use of closed network connection machine # [ 393.770501] k3s[879]: E0922 14:57:24.805155 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41020: use of closed network connection machine # [ 395.019614] k3s[879]: E0922 14:57:26.054272 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41058: use of closed network connection machine # [ 396.303358] k3s[879]: E0922 14:57:27.338027 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41076: use of closed network connection machine # [ 396.308300] k3s[879]: time="2026-09-22T14:57:27Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:57194->127.0.0.1:10250: write: broken pipe" machine # [ 396.308907] k3s[879]: time="2026-09-22T14:57:27Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:6443->127.0.0.1:41086: write: broken pipe" machine # [ 397.612687] k3s[879]: E0922 14:57:28.647338 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41104: use of closed network connection machine # [ 398.887654] k3s[879]: E0922 14:57:29.922167 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41140: use of closed network connection machine # [ 398.888875] k3s[879]: E0922 14:57:29.922386 879 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:50826->127.0.0.1:10010: write tcp 127.0.0.1:50826->127.0.0.1:10010: write: broken pipe machine # [ 398.889789] k3s[879]: time="2026-09-22T14:57:29Z" level=warning msg="Proxy error: read failed: read tcp 127.0.0.1:57218->127.0.0.1:10250: read: connection reset by peer" machine # [ 400.132421] k3s[879]: E0922 14:57:31.166856 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41170: use of closed network connection machine # [ 401.414070] k3s[879]: E0922 14:57:32.448769 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41206: use of closed network connection machine # [ 402.666443] k3s[879]: E0922 14:57:33.700583 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41244: use of closed network connection machine # [ 403.903188] k3s[879]: E0922 14:57:34.937754 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59928: use of closed network connection machine # [ 405.170406] k3s[879]: E0922 14:57:36.204634 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59954: use of closed network connection machine # [ 406.385346] k3s[879]: E0922 14:57:37.420056 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59970: use of closed network connection machine # [ 407.673922] k3s[879]: E0922 14:57:38.708438 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59996: use of closed network connection machine # [ 408.895852] k3s[879]: E0922 14:57:39.930070 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60016: use of closed network connection machine # [ 410.114392] k3s[879]: E0922 14:57:41.148813 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60040: use of closed network connection machine # [ 411.393836] k3s[879]: E0922 14:57:42.428212 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60078: use of closed network connection machine # [ 413.751846] postgres[759]: [759] LOG: checkpoint complete: wrote 1037 buffers (6.3%), wrote 3 SLRU buffers; 1 WAL file(s) added, 0 removed, 0 recycled; write=103.885 s, sync=0.033 s, total=103.949 s; sync files=364, longest=0.003 s, average=0.001 s; distance=4978 kB, estimate=4978 kB; lsn=0/1C71288, redo lsn=0/1C42AE8 machine # [ 413.925411] k3s[879]: E0922 14:57:44.960055 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53148: use of closed network connection machine # [ 415.132371] k3s[879]: E0922 14:57:46.166784 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53182: use of closed network connection machine # [ 416.367127] k3s[879]: E0922 14:57:47.401841 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53206: use of closed network connection machine # [ 417.602150] k3s[879]: E0922 14:57:48.636244 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53248: use of closed network connection machine: (finished: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-748bbd6bdc-mdq2s -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 35.29 seconds) machine: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine: (finished: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 0.05 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1 machine # [ 417.857884] niks3-server[1193]: 2026/09/22 14:57:48 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 417.874177] niks3-server[1193]: 2026/09/22 14:57:48 INFO Registered completed upload object_key=nar/0g42hgwa9jp9abmqxz90dkwxpybsznzbpsy35rm921mlk5sw56jq.nar.zst machine # [ 417.878678] niks3-server[1193]: 2026/09/22 14:57:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign machine # [ 417.880655] niks3-server[1193]: 2026/09/22 14:57:48 INFO Signed narinfos id=21 count=1 machine # [ 417.884313] niks3-server[1193]: 2026/09/22 14:57:48 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.ls machine # [ 417.888372] niks3-server[1193]: 2026/09/22 14:57:48 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete machine # [ 417.890157] niks3-server[1193]: 2026/09/22 14:57:48 INFO Completed upload id=21 machine # [ 417.891684] niks3-server[1193]: 2026/09/22 14:57:48 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.narinfo machine # [ 442.392328] niks3-server[1193]: 2026/09/22 14:58:13 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 442.412446] niks3-server[1193]: 2026/09/22 14:58:13 INFO Registered completed upload object_key=nar/1vxmmzwi16s4iri6dcmi9v62dpq1ys7wz15b497ncik3sd67nfzg.nar.zst machine # [ 442.417897] niks3-server[1193]: 2026/09/22 14:58:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign machine # [ 442.420542] niks3-server[1193]: 2026/09/22 14:58:13 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.ls machine # [ 442.422853] niks3-server[1193]: 2026/09/22 14:58:13 INFO Signed narinfos id=22 count=1 machine # [ 442.425561] niks3-server[1193]: 2026/09/22 14:58:13 INFO Registered completed upload object_key=log/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31-k3s-a.drv machine # [ 442.428519] niks3-server[1193]: 2026/09/22 14:58:13 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete machine # [ 442.431523] niks3-server[1193]: 2026/09/22 14:58:13 INFO Completed upload id=22 machine # [ 442.434845] niks3-server[1193]: 2026/09/22 14:58:13 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo machine # [ 442.524930] niks3-server[1193]: 2026/09/22 14:58:13 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 442.538902] niks3-server[1193]: 2026/09/22 14:58:13 INFO Registered completed upload object_key=nar/0cbxkyxz068xc5mivh2h67kw6y01n1x28cbs11v1a03g8m4c71zm.nar.zst machine # [ 442.545688] niks3-server[1193]: 2026/09/22 14:58:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign machine # [ 442.548935] niks3-server[1193]: 2026/09/22 14:58:13 INFO Signed narinfos id=23 count=1 machine # [ 442.549714] niks3-server[1193]: 2026/09/22 14:58:13 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.ls machine # [ 442.552942] niks3-server[1193]: 2026/09/22 14:58:13 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete machine # [ 442.554907] niks3-server[1193]: 2026/09/22 14:58:13 INFO Completed upload id=23 machine # [ 442.555961] niks3-server[1193]: 2026/09/22 14:58:13 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.narinfo machine # [ 467.869352] niks3-server[1193]: 2026/09/22 14:58:38 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 467.890643] niks3-server[1193]: 2026/09/22 14:58:38 INFO Registered completed upload object_key=nar/0khxywxb2r78vhpc5hsmha3ymgp910z0aka7550jmaqzs333rmzp.nar.zst machine # [ 467.892670] niks3-server[1193]: 2026/09/22 14:58:38 INFO Registered completed upload object_key=log/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4-k3s-b.drv machine # [ 467.894987] niks3-server[1193]: 2026/09/22 14:58:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign machine # [ 467.897096] niks3-server[1193]: 2026/09/22 14:58:38 INFO Signed narinfos id=24 count=1 machine # [ 467.902069] niks3-server[1193]: 2026/09/22 14:58:38 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.ls machine # [ 467.904125] niks3-server[1193]: 2026/09/22 14:58:38 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete machine # [ 467.906620] niks3-server[1193]: 2026/09/22 14:58:38 INFO Completed upload id=24 machine # [ 467.909165] niks3-server[1193]: 2026/09/22 14:58:38 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.narinfo machine # [ 468.012244] niks3-server[1193]: 2026/09/22 14:58:39 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 468.024967] niks3-server[1193]: 2026/09/22 14:58:39 INFO Registered completed upload object_key=nar/04bim5f8bvjh25xncf5x40kb529khrlzcbc92qxvapgbc0bdfv2h.nar.zst machine # [ 468.029890] niks3-server[1193]: 2026/09/22 14:58:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign machine # [ 468.030953] niks3-server[1193]: 2026/09/22 14:58:39 INFO Signed narinfos id=25 count=1 machine # [ 468.037668] niks3-server[1193]: 2026/09/22 14:58:39 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.ls machine # [ 468.040896] niks3-server[1193]: 2026/09/22 14:58:39 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete machine # [ 468.045268] niks3-server[1193]: 2026/09/22 14:58:39 INFO Completed upload id=25 machine # [ 468.047576] niks3-server[1193]: 2026/09/22 14:58:39 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.narinfo machine # [ 493.362126] niks3-server[1193]: 2026/09/22 14:59:04 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 493.382849] niks3-server[1193]: 2026/09/22 14:59:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign machine # [ 493.385135] niks3-server[1193]: 2026/09/22 14:59:04 INFO Registered completed upload object_key=nar/11f7f1hixry25c2yc6np9hs10a2pwwqmymmrxxbswhdjabcyvv0s.nar.zst machine # [ 493.386855] niks3-server[1193]: 2026/09/22 14:59:04 INFO Signed narinfos id=26 count=1 machine # [ 493.388659] niks3-server[1193]: 2026/09/22 14:59:04 INFO Registered completed upload object_key=log/jz7biafi8rj5r3r392blyazw5mdpvy0d-k3s-top.drv machine # [ 493.391584] niks3-server[1193]: 2026/09/22 14:59:04 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.ls machine # [ 493.394154] niks3-server[1193]: 2026/09/22 14:59:04 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete machine # [ 493.395535] niks3-server[1193]: 2026/09/22 14:59:04 INFO Completed upload id=26 machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1, in 76.80 seconds) (finished: subtest: a renewed balancer certificate is served without a rollout, in 113.32 seconds) subtest: metrics carry build_info machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-cxfvt -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-cxfvt -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.17 seconds) machine: must succeed: curl -sf http://10.42.0.6:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-cxfvt"' machine: (finished: must succeed: curl -sf http://10.42.0.6:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-cxfvt"', in 0.03 seconds) (finished: subtest: metrics carry build_info, in 0.20 seconds) subtest: harmonia-gc frees space and the worker stays Ready machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-cxfvt -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'' machine # [ 494.832465] k3s[879]: E0922 14:59:05.867009 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37090: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-cxfvt -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'', in 0.18 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-cxfvt -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done' machine # [ 495.058028] k3s[879]: E0922 14:59:06.093004 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37112: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-cxfvt -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done', in 0.23 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-cxfvt -c gc -- sh -c 'fallocate -l 11444412416 /nix/fill' machine # [ 495.243462] k3s[879]: E0922 14:59:06.278184 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37136: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-cxfvt -c gc -- sh -c 'fallocate -l 11444412416 /nix/fill', in 0.18 seconds) machine: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-cxfvt -c gc --since=30s | grep -q 'store paths deleted' machine: (finished: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-cxfvt -c gc --since=30s | grep -q 'store paths deleted', in 2.54 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-cxfvt -c gc -- sh -c 'rm /nix/fill' machine # [ 497.950519] k3s[879]: E0922 14:59:08.985079 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37206: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-cxfvt -c gc -- sh -c 'rm /nix/fill', in 0.17 seconds) machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-cxfvt -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-cxfvt -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}', in 0.13 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-cxfvt -c gc -- sh -c 'command -v nix-daemon && command -v niks3' machine # [ 498.240286] k3s[879]: E0922 14:59:09.275216 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37240: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-cxfvt -c gc -- sh -c 'command -v nix-daemon && command -v niks3', in 0.16 seconds) (finished: subtest: harmonia-gc frees space and the worker stays Ready, in 3.59 seconds) subtest: losing the balancer mid-build: the client reconnects and the build succeeds machine: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1 machine # [ 498.262353] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1. machine # Running as unit: vialb.service; invocation ID: 7a80bdc27ae1429db0189b935908ae4b machine: (finished: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1, in 0.02 seconds) machine: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'" machine # [ 498.372942] nix[9839]: don't know how to build these paths: machine # [ 498.374047] nix[9839]: /nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 498.391728] nix[9839]: copying 1 paths to '127.0.0.1:30051'... machine # [ 498.393321] nix[9839]: copying path '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' to '127.0.0.1:30051'... machine # [ 498.474642] niks3-server[1193]: 2026/09/22 14:59:09 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 498.490481] niks3-server[1193]: 2026/09/22 14:59:09 INFO Registered completed upload object_key=nar/0kkr2vb091wkq0cb0f1q92413dsfskh76wydp8mwysv7rawns0ar.nar.zst machine # [ 498.493747] niks3-server[1193]: 2026/09/22 14:59:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign machine # [ 498.495444] niks3-server[1193]: 2026/09/22 14:59:09 INFO Signed narinfos id=27 count=1 machine # [ 498.497819] niks3-server[1193]: 2026/09/22 14:59:09 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.ls machine # [ 498.502141] niks3-server[1193]: 2026/09/22 14:59:09 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete machine # [ 498.504562] niks3-server[1193]: 2026/09/22 14:59:09 INFO Completed upload id=27 machine # [ 498.507212] niks3-server[1193]: 2026/09/22 14:59:09 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.narinfo machine # [ 498.514340] nix[9839]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 498.515884] nix[9839]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-cxfvt: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine: (finished: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'", in 1.05 seconds) machine: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false machine: (finished: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false, in 0.25 seconds) machine: waiting for success: ! systemctl is-active vialb machine # [ 499.588260] nix[9839]: d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv: Stream removed (Socket closed), asking the scheduler again machine # [ 499.589358] nix[9839]: scheduler at 127.0.0.1:30051: Stream removed (Socket closed), reconnecting machine # [ 499.606084] systemd[1]: cri-containerd-29e7d977c111c86a04901b74dadbb50b9f855479e62cbe8e387fdee010527e44.scope: Deactivated successfully. machine # [ 499.608212] systemd[1]: cri-containerd-29e7d977c111c86a04901b74dadbb50b9f855479e62cbe8e387fdee010527e44.scope: Consumed 3.812s CPU time over 7min 40.396s wall clock time, 61.7M memory peak, 40.2M read from disk, 706.8K incoming IP traffic, 682.7K outgoing IP traffic. machine # [ 499.641368] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-29e7d977c111c86a04901b74dadbb50b9f855479e62cbe8e387fdee010527e44-rootfs.mount: Deactivated successfully. machine # [ 499.673860] systemd[1]: cri-containerd-da7a8036805d9b8700b1b3f911cfbaad874f24e5d0647059ea83697071dd8f4f.scope: Deactivated successfully. machine # [ 499.702653] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-da7a8036805d9b8700b1b3f911cfbaad874f24e5d0647059ea83697071dd8f4f-rootfs.mount: Deactivated successfully. machine # [ 499.726082] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-da7a8036805d9b8700b1b3f911cfbaad874f24e5d0647059ea83697071dd8f4f-shm.mount: Deactivated successfully. machine # [ 499.903934] cni0: port 4(veth797fa628) entered disabled state machine # [ 499.753380] dhcpcd[697]: veth797fa628: carrier lost machine # [ 499.905969] veth797fa628 (unregistering): left allmulticast mode machine # [ 499.907181] veth797fa628 (unregistering): left promiscuous mode machine # [ 499.908344] cni0: port 4(veth797fa628) entered disabled state machine # [ 499.775089] systemd[1]: run-netns-cni\x2d484bee36\x2d1219\x2d65de\x2df511\x2dfa1bb0d90866.mount: Deactivated successfully. machine # [ 499.784951] dhcpcd[697]: veth797fa628: deleting address fe80::e851:39ff:fe16:77c2 machine # [ 499.788289] dhcpcd[697]: veth797fa628: deleting route to 169.254.0.0/16 machine # [ 499.810081] k3s[879]: I0922 14:59:10.844638 879 endpointslice_controller.go:361] "Error syncing endpoint slices for service, retrying" key="farm/nix-grpc-farm" err="EndpointSlice informer cache is out of date" machine # [ 499.826850] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod262801fe_d8b1_4289_aecc_9231fee742e1.slice. machine # [ 499.856304] dhcpcd[697]: veth797fa628: removing interface machine # [ 499.870498] k3s[879]: I0922 14:59:10.905505 879 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9364f398-d892-4696-a7f5-d93009befe96-config\" (UniqueName: \"kubernetes.io/configmap/9364f398-d892-4696-a7f5-d93009befe96-config\") pod \"9364f398-d892-4696-a7f5-d93009befe96\" (UID: \"9364f398-d892-4696-a7f5-d93009befe96\") " machine # [ 499.871291] k3s[879]: I0922 14:59:10.905545 879 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9364f398-d892-4696-a7f5-d93009befe96-tmp\" (UniqueName: \"kubernetes.io/empty-dir/9364f398-d892-4696-a7f5-d93009befe96-tmp\") pod \"9364f398-d892-4696-a7f5-d93009befe96\" (UID: \"9364f398-d892-4696-a7f5-d93009befe96\") " machine # [ 499.871961] k3s[879]: I0922 14:59:10.905581 879 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9364f398-d892-4696-a7f5-d93009befe96-tls-ca\" (UniqueName: \"kubernetes.io/secret/9364f398-d892-4696-a7f5-d93009befe96-tls-ca\") pod \"9364f398-d892-4696-a7f5-d93009befe96\" (UID: \"9364f398-d892-4696-a7f5-d93009befe96\") " machine # [ 499.872715] k3s[879]: I0922 14:59:10.905606 879 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9364f398-d892-4696-a7f5-d93009befe96-tls-lb\" (UniqueName: \"kubernetes.io/secret/9364f398-d892-4696-a7f5-d93009befe96-tls-lb\") pod \"9364f398-d892-4696-a7f5-d93009befe96\" (UID: \"9364f398-d892-4696-a7f5-d93009befe96\") " machine # [ 499.879140] systemd[1]: var-lib-kubelet-pods-9364f398\x2dd892\x2d4696\x2da7f5\x2dd93009befe96-volume\x2dsubpaths-config-envoy-0.mount: Deactivated successfully. machine # [ 499.880145] systemd[1]: var-lib-kubelet-pods-9364f398\x2dd892\x2d4696\x2da7f5\x2dd93009befe96-volumes-kubernetes.io\x7esecret-tls\x2dca.mount: Deactivated successfully. machine # [ 499.880448] systemd[1]: var-lib-kubelet-pods-9364f398\x2dd892\x2d4696\x2da7f5\x2dd93009befe96-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 499.880954] systemd[1]: var-lib-kubelet-pods-9364f398\x2dd892\x2d4696\x2da7f5\x2dd93009befe96-volumes-kubernetes.io\x7esecret-tls\x2dlb.mount: Deactivated successfully. machine # [ 499.894594] k3s[879]: I0922 14:59:10.905646 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/262801fe-d8b1-4289-aecc-9231fee742e1-tls-ca\") pod \"nix-grpc-farm-lb-748bbd6bdc-48rbl\" (UID: \"262801fe-d8b1-4289-aecc-9231fee742e1\") " pod="farm/nix-grpc-farm-lb-748bbd6bdc-48rbl" machine # [ 499.895232] k3s[879]: I0922 14:59:10.929715 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/262801fe-d8b1-4289-aecc-9231fee742e1-tls-lb\") pod \"nix-grpc-farm-lb-748bbd6bdc-48rbl\" (UID: \"262801fe-d8b1-4289-aecc-9231fee742e1\") " pod="farm/nix-grpc-farm-lb-748bbd6bdc-48rbl" machine # [ 499.897079] k3s[879]: I0922 14:59:10.932062 879 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9364f398-d892-4696-a7f5-d93009befe96-tmp" pod "9364f398-d892-4696-a7f5-d93009befe96" (UID: "9364f398-d892-4696-a7f5-d93009befe96"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 499.907134] k3s[879]: I0922 14:59:10.942149 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/262801fe-d8b1-4289-aecc-9231fee742e1-config\") pod \"nix-grpc-farm-lb-748bbd6bdc-48rbl\" (UID: \"262801fe-d8b1-4289-aecc-9231fee742e1\") " pod="farm/nix-grpc-farm-lb-748bbd6bdc-48rbl" machine # [ 499.908080] k3s[879]: I0922 14:59:10.942187 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/262801fe-d8b1-4289-aecc-9231fee742e1-tmp\") pod \"nix-grpc-farm-lb-748bbd6bdc-48rbl\" (UID: \"262801fe-d8b1-4289-aecc-9231fee742e1\") " pod="farm/nix-grpc-farm-lb-748bbd6bdc-48rbl" machine # [ 499.908847] k3s[879]: I0922 14:59:10.942213 879 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9364f398-d892-4696-a7f5-d93009befe96-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 499.909809] k3s[879]: I0922 14:59:10.944837 879 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9364f398-d892-4696-a7f5-d93009befe96-tls-lb" pod "9364f398-d892-4696-a7f5-d93009befe96" (UID: "9364f398-d892-4696-a7f5-d93009befe96"). InnerVolumeSpecName "tls-lb". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 499.910689] k3s[879]: I0922 14:59:10.945376 879 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9364f398-d892-4696-a7f5-d93009befe96-tls-ca" pod "9364f398-d892-4696-a7f5-d93009befe96" (UID: "9364f398-d892-4696-a7f5-d93009befe96"). InnerVolumeSpecName "tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 499.930896] k3s[879]: I0922 14:59:10.965930 879 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9364f398-d892-4696-a7f5-d93009befe96-config" pod "9364f398-d892-4696-a7f5-d93009befe96" (UID: "9364f398-d892-4696-a7f5-d93009befe96"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 500.007952] k3s[879]: I0922 14:59:11.042953 879 reconciler_common.go:299] "Volume detached for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/9364f398-d892-4696-a7f5-d93009befe96-tls-ca\") on node \"machine\" DevicePath \"\"" machine # [ 500.010908] k3s[879]: I0922 14:59:11.042988 879 reconciler_common.go:299] "Volume detached for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/9364f398-d892-4696-a7f5-d93009befe96-tls-lb\") on node \"machine\" DevicePath \"\"" machine # [ 500.013653] k3s[879]: I0922 14:59:11.043002 879 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9364f398-d892-4696-a7f5-d93009befe96-config\") on node \"machine\" DevicePath \"\"" machine # [ 500.322073] cni0: port 2(veth4ed72f0e) entered blocking state machine # [ 500.325039] cni0: port 2(veth4ed72f0e) entered disabled state machine # [ 500.327030] veth4ed72f0e: entered allmulticast mode machine # [ 500.328902] veth4ed72f0e: entered promiscuous mode machine # [ 500.181128] (udev-worker)[10023]: Network interface NamePolicy= disabled on kernel command line. machine # [ 500.345768] cni0: port 2(veth4ed72f0e) entered blocking state machine # [ 500.347468] cni0: port 2(veth4ed72f0e) entered forwarding state machine # [ 500.213569] dhcpcd[697]: veth4ed72f0e: IAID 17:d9:bc:1a machine # [ 500.214714] dhcpcd[697]: veth4ed72f0e: adding address fe80::fc70:17ff:fed9:bc1a machine # [ 500.220458] k3s[879]: I0922 14:59:11.255475 879 scope.go:122] "RemoveContainer" containerID="29e7d977c111c86a04901b74dadbb50b9f855479e62cbe8e387fdee010527e44" machine # [ 500.230483] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod9364f398_d892_4696_a7f5_d93009befe96.slice. machine # [ 500.232819] systemd[1]: kubepods-besteffort-pod9364f398_d892_4696_a7f5_d93009befe96.slice: Consumed 3.842s CPU time over 7min 42.404s wall clock time, 62M memory peak, 40.2M read from disk, 706.8K incoming IP traffic, 682.7K outgoing IP traffic. machine # [ 500.236063] k3s[879]: I0922 14:59:11.267696 879 scope.go:122] "RemoveContainer" containerID="29e7d977c111c86a04901b74dadbb50b9f855479e62cbe8e387fdee010527e44" machine # [ 500.238081] k3s[879]: E0922 14:59:11.268393 879 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"29e7d977c111c86a04901b74dadbb50b9f855479e62cbe8e387fdee010527e44\": not found" containerID="29e7d977c111c86a04901b74dadbb50b9f855479e62cbe8e387fdee010527e44" machine # [ 500.242063] k3s[879]: I0922 14:59:11.268427 879 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"29e7d977c111c86a04901b74dadbb50b9f855479e62cbe8e387fdee010527e44"} err="failed to get container status \"29e7d977c111c86a04901b74dadbb50b9f855479e62cbe8e387fdee010527e44\": rpc error: code = NotFound desc = an error occurred when try to find container \"29e7d977c111c86a04901b74dadbb50b9f855479e62cbe8e387fdee010527e44\": not found" machine # [ 500.287423] systemd[1]: Started libcontainer container c5c651f208077421e091b236568f81819661e2af040a30f5a61b5c34273be1dd. machine # [ 500.400445] systemd[1]: Started libcontainer container 469fccad1c8a2a0d309d23684c9ed7e5c4ff0f6a6e9ee9427ef87f695b9181a4. machine # [ 500.650131] systemd[1]: var-lib-kubelet-pods-9364f398\x2dd892\x2d4696\x2da7f5\x2dd93009befe96-volume\x2dsubpaths-config-envoy-2.mount: Deactivated successfully. machine # [ 500.651415] systemd[1]: var-lib-kubelet-pods-9364f398\x2dd892\x2d4696\x2da7f5\x2dd93009befe96-volume\x2dsubpaths-config-envoy-1.mount: Deactivated successfully. machine # [ 501.439575] k3s[879]: I0922 14:59:12.473877 879 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9364f398-d892-4696-a7f5-d93009befe96" path="/var/lib/kubelet/pods/9364f398-d892-4696-a7f5-d93009befe96/volumes" machine # [ 501.748472] dhcpcd[697]: veth4ed72f0e: soliciting a DHCP lease machine # [ 501.777628] dhcpcd[697]: veth4ed72f0e: soliciting an IPv6 router machine # [ 502.092447] nix[9839]: scheduler at 127.0.0.1:30051: failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:30051: Failed to connect to remote host: connect() timed out, reconnecting machine # [ 503.093234] nix[9839]: scheduler at 127.0.0.1:30051: failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:30051: Failed to connect to remote host: connect() timed out, reconnecting machine # [ 505.093688] nix[9839]: scheduler at 127.0.0.1:30051: failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:30051: Failed to connect to remote host: Connection refused, reconnecting machine # [ 506.249998] k3s[879]: I0922 14:59:17.284171 879 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-748bbd6bdc-48rbl" podStartSLOduration=7.2841498829999995 podStartE2EDuration="7.284149883s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-22 14:59:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-22 14:59:12.289718748 +0000 UTC m=+486.132969639" watchObservedRunningTime="2026-09-22 14:59:17.284149883 +0000 UTC m=+491.127341269" machine # [ 506.749782] dhcpcd[697]: veth4ed72f0e: probing for an IPv4LL address machine # [ 509.118425] nix[9839]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 509.119241] nix[9839]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-fx57t: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 511.923841] dhcpcd[697]: veth4ed72f0e: using IPv4LL address 169.254.53.87 machine # [ 511.924569] dhcpcd[697]: veth4ed72f0e: adding route to 169.254.0.0/16 machine # [ 513.782890] dhcpcd[697]: veth4ed72f0e: no IPv6 Routers available machine # [ 554.047698] niks3-server[1193]: 2026/09/22 15:00:05 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 554.061626] niks3-server[1193]: 2026/09/22 15:00:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign machine # [ 554.063895] niks3-server[1193]: 2026/09/22 15:00:05 INFO Signed narinfos id=28 count=1 machine # [ 554.065583] niks3-server[1193]: 2026/09/22 15:00:05 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.ls machine # [ 554.066180] niks3-server[1193]: 2026/09/22 15:00:05 INFO Registered completed upload object_key=log/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 554.073404] niks3-server[1193]: 2026/09/22 15:00:05 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete machine # [ 554.076730] niks3-server[1193]: 2026/09/22 15:00:05 INFO Completed upload id=28 machine # [ 554.082778] niks3-server[1193]: 2026/09/22 15:00:05 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.narinfo machine # [ 555.133351] systemd[1]: vialb.service: Deactivated successfully. machine # [ 555.135472] systemd[1]: vialb.service: Consumed 208ms CPU time over 56.870s wall clock time, 38.7M memory peak, 4K written to disk, 8K incoming IP traffic, 17.3K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active vialb, in 55.66 seconds) machine: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; }, in 0.03 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 0.19 seconds) (finished: subtest: losing the balancer mid-build: the client reconnects and the build succeeds, in 57.20 seconds) subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes machine: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 machine # [ 555.469237] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1. machine # Running as unit: slow.service; invocation ID: e37c1e2b20b3454cb7b86bc71c826e47 machine: (finished: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1, in 0.02 seconds) machine # [ 555.583309] nix[10899]: don't know how to build these paths: machine # [ 555.584028] nix[10899]: /nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 555.607255] nix[10899]: copying 1 paths to '127.0.0.1:30051'... machine # [ 555.609370] nix[10899]: copying path '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' to '127.0.0.1:30051'... machine # [ 555.668087] k3s[879]: E0922 15:00:06.702793 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56268: use of closed network connection machine # command terminated with exit code 1 machine # [ 555.684887] niks3-server[1193]: 2026/09/22 15:00:06 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 555.697886] niks3-server[1193]: 2026/09/22 15:00:06 INFO Registered completed upload object_key=nar/0wl2i9xpw0gwrx1xqdgx9ka4n503ky9qhl20pdrdlphn8d6lcx0i.nar.zst machine # [ 555.702288] niks3-server[1193]: 2026/09/22 15:00:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign machine # [ 555.704328] niks3-server[1193]: 2026/09/22 15:00:06 INFO Signed narinfos id=29 count=1 machine # [ 555.706347] niks3-server[1193]: 2026/09/22 15:00:06 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.ls machine # [ 555.712383] niks3-server[1193]: 2026/09/22 15:00:06 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete machine # [ 555.715990] niks3-server[1193]: 2026/09/22 15:00:06 INFO Completed upload id=29 machine # [ 555.717930] niks3-server[1193]: 2026/09/22 15:00:06 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.narinfo machine # [ 555.724541] nix[10899]: building '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' on 127.0.0.1:30051... machine # [ 555.725399] nix[10899]: slow-s1> machine/nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-cxfvt: building zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 555.849885] k3s[879]: E0922 15:00:06.884824 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56304: use of closed network connection machine # command terminated with exit code 1 machine # [ 557.155812] k3s[879]: E0922 15:00:08.190387 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56316: use of closed network connection machine # command terminated with exit code 1 machine # [ 557.160060] k3s[879]: E0922 15:00:08.195072 879 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:60492->127.0.0.1:10010: write tcp 127.0.0.1:60492->127.0.0.1:10010: write: broken pipe machine # [ 557.339819] k3s[879]: E0922 15:00:08.374790 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56334: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 558.606915] k3s[879]: E0922 15:00:09.641327 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56356: use of closed network connection machine # [ 558.778710] k3s[879]: E0922 15:00:09.813716 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56370: use of closed network connection machine # command terminated with exit code 1 machine # [ 559.989734] k3s[879]: E0922 15:00:11.024465 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56400: use of closed network connection machine # command terminated with exit code 1 machine # [ 560.147255] k3s[879]: E0922 15:00:11.182003 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56422: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 561.345050] k3s[879]: E0922 15:00:12.379725 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56458: use of closed network connection machine # [ 561.518702] k3s[879]: E0922 15:00:12.553655 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56472: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 562.718766] k3s[879]: E0922 15:00:13.753064 879 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:60570->127.0.0.1:10010: write tcp 127.0.0.1:60570->127.0.0.1:10010: write: broken pipe machine # [ 562.720302] k3s[879]: time="2026-09-22T15:00:13Z" level=warning msg="Proxy error: read failed: read tcp 127.0.0.1:52872->127.0.0.1:10250: read: connection reset by peer" machine # [ 562.721151] k3s[879]: E0922 15:00:13.753507 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56498: use of closed network connection machine # [ 562.895965] k3s[879]: E0922 15:00:13.930967 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56518: use of closed network connection machine # command terminated with exit code 1 machine # [ 564.100119] k3s[879]: E0922 15:00:15.134636 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55046: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 564.265605] k3s[879]: E0922 15:00:15.300436 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55082: use of closed network connection machine # command terminated with exit code 1 machine # [ 565.472949] k3s[879]: E0922 15:00:16.507401 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55106: use of closed network connection machine # [ 565.640249] k3s[879]: E0922 15:00:16.675267 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55128: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 566.832040] k3s[879]: E0922 15:00:17.866609 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55140: use of closed network connection machine # [ 566.987610] k3s[879]: E0922 15:00:18.022599 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55156: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 568.169158] k3s[879]: E0922 15:00:19.203826 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55178: use of closed network connection machine # [ 568.311450] k3s[879]: E0922 15:00:19.346424 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55202: use of closed network connection machine # command terminated with exit code 1 machine # [ 569.560278] k3s[879]: E0922 15:00:20.594986 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55238: use of closed network connection machine # command terminated with exit code 1 machine # [ 569.739777] k3s[879]: E0922 15:00:20.774779 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55258: use of closed network connection machine # command terminated with exit code 1 machine # [ 570.962126] k3s[879]: E0922 15:00:21.996721 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55282: use of closed network connection machine # command terminated with exit code 1 machine # [ 571.130309] k3s[879]: E0922 15:00:22.165311 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55310: use of closed network connection machine # command terminated with exit code 1 machine # [ 572.404213] k3s[879]: E0922 15:00:23.438921 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55346: use of closed network connection machine # command terminated with exit code 1 machine # [ 572.575861] k3s[879]: E0922 15:00:23.610769 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55366: use of closed network connection machine # command terminated with exit code 1 machine # [ 573.802746] k3s[879]: E0922 15:00:24.837476 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33374: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 573.963972] k3s[879]: E0922 15:00:24.998799 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33396: use of closed network connection machine # command terminated with exit code 1 machine # [ 575.203472] k3s[879]: E0922 15:00:26.238211 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33430: use of closed network connection machine # [ 575.357112] k3s[879]: E0922 15:00:26.392066 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33476: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 576.548467] k3s[879]: E0922 15:00:27.582957 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33498: use of closed network connection machine # [ 576.703261] k3s[879]: E0922 15:00:27.738245 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33534: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 577.949973] k3s[879]: E0922 15:00:28.984542 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33576: use of closed network connection machine # [ 578.101143] k3s[879]: E0922 15:00:29.136149 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33610: use of closed network connection machine # command terminated with exit code 1 machine # [ 579.394330] k3s[879]: E0922 15:00:30.429007 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33636: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 579.557864] k3s[879]: E0922 15:00:30.592866 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33680: use of closed network connection machine # command terminated with exit code 1 machine # [ 580.833116] k3s[879]: E0922 15:00:31.867769 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33718: use of closed network connection machine # [ 581.011154] k3s[879]: E0922 15:00:32.046043 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33748: use of closed network connection machine # command terminated with exit code 1 machine # [ 582.216187] k3s[879]: E0922 15:00:33.250909 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33774: use of closed network connection machine # [ 582.366816] k3s[879]: E0922 15:00:33.401813 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33792: use of closed network connection machine: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-cxfvt --wait=false machine: (finished: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-cxfvt --wait=false, in 0.13 seconds) machine: must succeed: sleep 5.0 machine # [ 582.551787] systemd[1]: cri-containerd-02b71c7dc9ed256450c86b5235b011c9a5e6a91d96b397236b8cc71b4fd3b9e3.scope: Deactivated successfully. machine # [ 582.553830] systemd[1]: cri-containerd-02b71c7dc9ed256450c86b5235b011c9a5e6a91d96b397236b8cc71b4fd3b9e3.scope: Consumed 471ms CPU time over 8min 55.352s wall clock time, 13.3M memory peak, 5.2M read from disk. machine # [ 582.582978] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-02b71c7dc9ed256450c86b5235b011c9a5e6a91d96b397236b8cc71b4fd3b9e3-rootfs.mount: Deactivated successfully. machine # [ 583.339520] systemd[1]: Created slice libcontainer container kubepods-besteffort-podbaf14a2e_8900_4c27_ad19_0ce531493250.slice. machine # [ 583.420979] k3s[879]: I0922 15:00:34.455683 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/baf14a2e-8900-4c27-ad19-0ce531493250-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-n7vsr\" (UID: \"baf14a2e-8900-4c27-ad19-0ce531493250\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-n7vsr" machine # [ 583.421828] k3s[879]: I0922 15:00:34.455772 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/baf14a2e-8900-4c27-ad19-0ce531493250-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-n7vsr\" (UID: \"baf14a2e-8900-4c27-ad19-0ce531493250\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-n7vsr" machine # [ 583.422452] k3s[879]: I0922 15:00:34.455833 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/baf14a2e-8900-4c27-ad19-0ce531493250-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-n7vsr\" (UID: \"baf14a2e-8900-4c27-ad19-0ce531493250\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-n7vsr" machine # [ 583.422935] k3s[879]: I0922 15:00:34.455911 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/baf14a2e-8900-4c27-ad19-0ce531493250-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-n7vsr\" (UID: \"baf14a2e-8900-4c27-ad19-0ce531493250\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-n7vsr" machine # [ 583.423606] k3s[879]: I0922 15:00:34.455979 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/baf14a2e-8900-4c27-ad19-0ce531493250-build\") pod \"nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-n7vsr\" (UID: \"baf14a2e-8900-4c27-ad19-0ce531493250\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-n7vsr" machine # [ 583.424064] k3s[879]: I0922 15:00:34.456043 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/baf14a2e-8900-4c27-ad19-0ce531493250-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-n7vsr\" (UID: \"baf14a2e-8900-4c27-ad19-0ce531493250\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-n7vsr" machine # [ 583.424552] k3s[879]: I0922 15:00:34.456096 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/baf14a2e-8900-4c27-ad19-0ce531493250-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-n7vsr\" (UID: \"baf14a2e-8900-4c27-ad19-0ce531493250\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-n7vsr" machine # [ 583.425038] k3s[879]: I0922 15:00:34.456208 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbbc7\" (UniqueName: \"kubernetes.io/projected/baf14a2e-8900-4c27-ad19-0ce531493250-kube-api-access-qbbc7\") pod \"nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-n7vsr\" (UID: \"baf14a2e-8900-4c27-ad19-0ce531493250\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-n7vsr" machine # [ 583.832874] cni0: port 4(vethf1a10db3) entered blocking state machine # [ 583.834998] cni0: port 4(vethf1a10db3) entered disabled state machine # [ 583.836098] vethf1a10db3: entered allmulticast mode machine # [ 583.838375] vethf1a10db3: entered promiscuous mode machine # [ 583.853619] cni0: port 4(vethf1a10db3) entered blocking state machine # [ 583.854434] cni0: port 4(vethf1a10db3) entered forwarding state machine # [ 583.728114] (udev-worker)[12677]: Network interface NamePolicy= disabled on kernel command line. machine # [ 583.752669] dhcpcd[697]: vethf1a10db3: IAID 49:a4:c4:e7 machine # [ 583.753509] dhcpcd[697]: vethf1a10db3: adding address fe80::88c:49ff:fea4:c4e7 machine # [ 583.785432] systemd[1]: Started libcontainer container 0e6ab0a6d007c055efae0413d0c4a595636c44feded9961d9653e9540aec7bb2. machine # [ 583.926892] dhcpcd[697]: vethf1a10db3: soliciting a DHCP lease machine # [ 584.040468] systemd[1]: Started libcontainer container 2627d3fce1bbb873f7bc7c361580205670729167e5bc0bb68dc9a804ca5dcb27. machine # [ 585.720726] systemd[1]: cri-containerd-2627d3fce1bbb873f7bc7c361580205670729167e5bc0bb68dc9a804ca5dcb27.scope: Deactivated successfully. machine # [ 585.723682] systemd[1]: cri-containerd-2627d3fce1bbb873f7bc7c361580205670729167e5bc0bb68dc9a804ca5dcb27.scope: Consumed 775ms CPU time over 1.682s wall clock time, 486.4M memory peak, 192.8M read from disk, 221.2M written to disk. machine # [ 585.777244] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-2627d3fce1bbb873f7bc7c361580205670729167e5bc0bb68dc9a804ca5dcb27-rootfs.mount: Deactivated successfully. machine # [ 585.959584] dhcpcd[697]: vethf1a10db3: soliciting an IPv6 router machine # [ 586.628640] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount2774765233.mount: Deactivated successfully. machine # [ 586.630827] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped3343482005.mount: Deactivated successfully. machine # [ 586.732976] systemd[1]: Started libcontainer container fb4bbda942bdecc3381ed22b1e5625b2cda648b1b45b42968ccd8c93e6590539. machine # [ 586.860976] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped2457598340.mount: Deactivated successfully. machine # [ 586.937633] systemd[1]: Started libcontainer container da8858a60dd1e716c062d24b5d74578df5a5fdb6e8ec0596488032e4fc3e7bb7. machine # [ 587.089533] systemd[1]: Started libcontainer container 201f3853b958684858919bf66f5c9fde0b79b5b0979f9f0cce25a83f8c5b5b92. machine: (finished: must succeed: sleep 5.0, in 5.04 seconds) machine # [ 587.756720] k3s[879]: E0922 15:00:38.791415 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41136: use of closed network connection machine: waiting for success: ! systemctl is-active slow machine # [ 587.781091] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount1049368773.mount: Deactivated successfully. machine # [ 588.676171] k3s[879]: I0922 15:00:39.709965 879 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-75bfcdc7c8-n7vsr" podStartSLOduration=4.081858521 podStartE2EDuration="5.709921585s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.628063064s" isStatefulPod=false podCreationTimestamp="2026-09-22 15:00:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-22 15:00:38.591458764 +0000 UTC m=+572.434655737" watchObservedRunningTime="2026-09-22 15:00:39.709921585 +0000 UTC m=+573.553117720" machine # [ 588.929161] dhcpcd[697]: vethf1a10db3: probing for an IPv4LL address machine # [ 593.904512] dhcpcd[697]: vethf1a10db3: using IPv4LL address 169.254.95.218 machine # [ 593.905916] dhcpcd[697]: vethf1a10db3: adding route to 169.254.0.0/16 machine # [ 597.962688] dhcpcd[697]: vethf1a10db3: no IPv6 Routers available machine # [ 601.059174] niks3-server[1193]: 2026/09/22 15:00:52 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 601.076587] niks3-server[1193]: 2026/09/22 15:00:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign machine # [ 601.080065] niks3-server[1193]: 2026/09/22 15:00:52 INFO Signed narinfos id=30 count=1 machine # [ 601.082148] niks3-server[1193]: 2026/09/22 15:00:52 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.ls machine # [ 601.085749] niks3-server[1193]: 2026/09/22 15:00:52 INFO Registered completed upload object_key=log/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 601.090341] niks3-server[1193]: 2026/09/22 15:00:52 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete machine # [ 601.093612] niks3-server[1193]: 2026/09/22 15:00:52 INFO Completed upload id=30 machine # [ 601.096895] niks3-server[1193]: 2026/09/22 15:00:52 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo machine # [ 601.129478] systemd[1]: slow.service: Deactivated successfully. machine # [ 601.131054] systemd[1]: slow.service: Consumed 143ms CPU time over 45.660s wall clock time, 38.3M memory peak, 4K written to disk, 4.8K incoming IP traffic, 11.3K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active slow, in 13.46 seconds) machine: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; }, in 0.04 seconds) machine: must fail: journalctl -u slow | grep -q 'asking the scheduler again' machine: (finished: must fail: journalctl -u slow | grep -q 'asking the scheduler again', in 0.02 seconds) machine: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath, in 0.12 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null, in 0.03 seconds) (finished: subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes, in 45.98 seconds) (finished: run the VM test script, in 602.27 seconds) test script finished in 602.31s cleanup kill QemuMachine (pid 45) machine # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) machine # [2026-09-22T15:00:52Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-09-22T15:00:52Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-09-22T15:00:52Z INFO virtiofsd] Client disconnected, shutting down (finished: cleanup, in 1.12 seconds) additionally exposed symbols: machine, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh