tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 1200.0 seconds run the VM test script machine: waiting for unit k3s.service machine: waiting for the VM to finish booting machine: starting vm machine # Disk image does not exist, creating the virtualisation disk image... machine: QEMU running (pid 45) machine # Formatting '/build/vm-state-machine/tmp.X53bEF0rSr', fmt=raw size=17179869184 machine # mke2fs 1.47.4 (6-Mar-2025) machine # Discarding device blocks: 0/4194304 done machine # Creating filesystem with 4194304 4k blocks and 1048576 inodes machine # Filesystem UUID: 33cf84dd-2c19-4aec-951d-8070bbdef301 machine # Superblock backups stored on blocks: machine # 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208, machine # 4096000 machine # machine # Allocating group tables: 0/128 done machine # Writing inode tables: 0/128 done machine # Creating journal (32768 blocks): done machine # Writing superblocks and filesystem accounting information: 0/128 done machine # machine # Virtualisation disk image created. machine # Starting virtiofs daemons... machine # [2026-09-21T13:21:20Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-21T13:21:20Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-21T13:21:20Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-21T13:21:20Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-21T13:21:20Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-21T13:21:20Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-21T13:21:20Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-21T13:21:20Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-21T13:21:20Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-21T13:21:20Z INFO virtiofsd] Client connected, servicing requests machine # [2026-09-21T13:21:20Z INFO virtiofsd] Client connected, servicing requests machine # [2026-09-21T13:21:20Z INFO virtiofsd] Client connected, servicing requests machine # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) machine # machine # machine # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+7EFCC730+7EF2C730 CA00 machine # Press Ctrl-B to configure iPXE (PCI 00:02.0)... machine # machine # machine # machine # machine # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 7EFCC730 7EF2C730 CB00 machine # Press Ctrl-B to configure iPXE (PCI 00:05.0)... machine # machine # machine # Booting from ROM... machine # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 machine # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/nisc8ppra28hvw39ib9xhrk4ifbq04i7-nixos-system-machine-test/init regInfo=/nix/store/jiqrk8yp5cd1c45477hqd91vw5nqhs7m-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.000000] BIOS-provided physical RAM map: machine # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007ffd7fff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000007ffd8000-0x000000007fffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000017fffffff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved machine # [ 0.000000] NX (Execute Disable) protection: active machine # [ 0.000000] APIC: Static calls initialized machine # [ 0.000000] SMBIOS 2.8 present. machine # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 machine # [ 0.000000] DMI: Memory slots populated: 1/1 machine # [ 0.000000] Hypervisor detected: KVM machine # [ 0.000000] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 machine # [ 0.000000] kvm-clock: using sched offset of 487393224 cycles machine # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns machine # [ 0.000005] tsc: Detected 2400.012 MHz processor machine # [ 0.000810] last_pfn = 0x180000 max_arch_pfn = 0x10000000000 machine # [ 0.000837] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs machine # [ 0.000839] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT machine # [ 0.000878] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.002725] found SMP MP-table at [mem 0x000f5450-0x000f545f] machine # [ 0.002736] Using GB pages for direct mapping machine # [ 0.002870] RAMDISK: [mem 0x7e371000-0x7ffcffff] machine # [ 0.002878] ACPI: Early table checksum verification disabled machine # [ 0.002880] ACPI: RSDP 0x00000000000F5250 000014 (v00 BOCHS ) machine # [ 0.002884] ACPI: RSDT 0x000000007FFE2539 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002887] ACPI: FACP 0x000000007FFE2319 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002894] ACPI: DSDT 0x000000007FFE0040 0022D9 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002896] ACPI: FACS 0x000000007FFE0000 000040 machine # [ 0.002898] ACPI: APIC 0x000000007FFE240D 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002899] ACPI: HPET 0x000000007FFE249D 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002901] ACPI: MCFG 0x000000007FFE24D5 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002902] ACPI: WAET 0x000000007FFE2511 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002904] ACPI: Reserving FACP table memory at [mem 0x7ffe2319-0x7ffe240c] machine # [ 0.002905] ACPI: Reserving DSDT table memory at [mem 0x7ffe0040-0x7ffe2318] machine # [ 0.002905] ACPI: Reserving FACS table memory at [mem 0x7ffe0000-0x7ffe003f] machine # [ 0.002906] ACPI: Reserving APIC table memory at [mem 0x7ffe240d-0x7ffe249c] machine # [ 0.002906] ACPI: Reserving HPET table memory at [mem 0x7ffe249d-0x7ffe24d4] machine # [ 0.002907] ACPI: Reserving MCFG table memory at [mem 0x7ffe24d5-0x7ffe2510] machine # [ 0.002907] ACPI: Reserving WAET table memory at [mem 0x7ffe2511-0x7ffe2538] machine # [ 0.003124] No NUMA configuration found machine # [ 0.003124] Faking a node at [mem 0x0000000000000000-0x000000017fffffff] machine # [ 0.003127] NODE_DATA(0) allocated [mem 0x17fff8780-0x17fffdcff] machine # [ 0.005399] Zone ranges: machine # [ 0.005400] DMA [mem 0x0000000000001000-0x0000000000ffffff] machine # [ 0.005402] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] machine # [ 0.005403] Normal [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005404] Device empty machine # [ 0.005405] Movable zone start for each node machine # [ 0.005405] Early memory node ranges machine # [ 0.005406] node 0: [mem 0x0000000000001000-0x000000000009efff] machine # [ 0.005407] node 0: [mem 0x0000000000100000-0x000000007ffd7fff] machine # [ 0.005408] node 0: [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005408] Initmem setup node 0 [mem 0x0000000000001000-0x000000017fffffff] machine # [ 0.005428] On node 0, zone DMA: 1 pages in unavailable ranges machine # [ 0.005697] On node 0, zone DMA: 97 pages in unavailable ranges machine # [ 0.077530] On node 0, zone Normal: 40 pages in unavailable ranges machine # [ 0.078000] ACPI: PM-Timer IO Port: 0x608 machine # [ 0.078014] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) machine # [ 0.078045] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 machine # [ 0.078047] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) machine # [ 0.078049] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) machine # [ 0.078050] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) machine # [ 0.078052] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) machine # [ 0.078052] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) machine # [ 0.078055] ACPI: Using ACPI (MADT) for SMP configuration information machine # [ 0.078056] ACPI: HPET id: 0x8086a201 base: 0xfed00000 machine # [ 0.078060] TSC deadline timer available machine # [ 0.078065] CPU topo: Max. logical packages: 1 machine # [ 0.078066] CPU topo: Max. logical dies: 1 machine # [ 0.078066] CPU topo: Max. dies per package: 1 machine # [ 0.078069] CPU topo: Max. threads per core: 1 machine # [ 0.078071] CPU topo: Num. cores per package: 4 machine # [ 0.078071] CPU topo: Num. threads per package: 4 machine # [ 0.078071] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs machine # [ 0.078094] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() machine # [ 0.078109] kvm-guest: KVM setup pv remote TLB flush machine # [ 0.078112] kvm-guest: setup PV sched yield machine # [ 0.078122] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] machine # [ 0.078123] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] machine # [ 0.078124] PM: hibernation: Registered nosave memory: [mem 0x7ffd8000-0xffffffff] machine # [ 0.078126] [mem 0xc0000000-0xfed1bfff] available for PCI devices machine # [ 0.078127] Booting paravirtualized kernel on KVM machine # [ 0.078131] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns machine # [ 0.082618] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 machine # [ 0.084824] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288 machine # [ 0.084874] kvm-guest: PV spinlocks enabled machine # [ 0.084876] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) machine # [ 0.084879] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/nisc8ppra28hvw39ib9xhrk4ifbq04i7-nixos-system-machine-test/init regInfo=/nix/store/jiqrk8yp5cd1c45477hqd91vw5nqhs7m-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.084973] Unknown kernel command line parameters "regInfo=/nix/store/jiqrk8yp5cd1c45477hqd91vw5nqhs7m-closure-info/registration", will be passed to user space. machine # [ 0.084986] random: crng init done machine # [ 0.084987] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes machine # [ 0.089535] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) machine # [ 0.091684] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) machine # [ 0.091757] software IO TLB: area num 4. machine # [ 0.165964] Fallback order for Node 0: 0 machine # [ 0.165971] Built 1 zonelists, mobility grouping on. Total pages: 1048438 machine # [ 0.165972] Policy zone: Normal machine # [ 0.168469] mem auto-init: stack:all(zero), heap alloc:on, heap free:off machine # [ 0.175552] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 machine # [ 0.184619] allocated 8388608 bytes of page_ext machine # [ 0.194510] ftrace: allocating 48787 entries in 192 pages machine # [ 0.194512] ftrace: allocated 192 pages with 2 groups machine # [ 0.195351] Dynamic Preempt: lazy machine # [ 0.195514] rcu: Preemptible hierarchical RCU implementation. machine # [ 0.195515] rcu: RCU event tracing is enabled. machine # [ 0.195516] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. machine # [ 0.195517] Trampoline variant of Tasks RCU enabled. machine # [ 0.195518] Rude variant of Tasks RCU enabled. machine # [ 0.195518] Tracing variant of Tasks RCU enabled. machine # [ 0.195518] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. machine # [ 0.195519] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 machine # [ 0.195539] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.195541] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.195542] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.199964] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16 machine # [ 0.200253] rcu: srcu_init: Setting srcu_struct sizes based on contention. machine # [ 0.200262] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns machine # [ 0.200373] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) machine # [ 0.203981] Console: colour VGA+ 80x25 machine # [ 0.203984] printk: legacy console [tty0] enabled machine # [ 0.235670] printk: legacy console [ttyS0] enabled machine # [ 0.347766] ACPI: Core revision 20250807 machine # [ 0.348731] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns machine # [ 0.350336] APIC: Switch to symmetric I/O mode setup machine # [ 0.351405] x2apic enabled machine # [ 0.352156] APIC: Switched APIC routing to: physical x2apic machine # [ 0.353125] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask() machine # [ 0.354402] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself() machine # [ 0.355973] kvm-guest: setup PV IPIs machine # [ 0.357593] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 machine # [ 0.358666] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.363027] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) machine # [ 0.365097] x86/cpu: User Mode Instruction Prevention (UMIP) activated machine # [ 0.366144] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 machine # [ 0.367024] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 machine # [ 0.368028] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto machine # [ 0.370024] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl machine # [ 0.371024] Transient Scheduler Attacks: Vulnerable: No microcode machine # [ 0.373024] Spectre V2 : Mitigation: Enhanced / Automatic IBRS machine # [ 0.374024] Speculative Return Stack Overflow: Mitigation: Safe RET machine # [ 0.375024] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization machine # [ 0.376031] Spectre V2 : Enabling IBPB for BPF machine # [ 0.377025] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier machine # [ 0.378025] active return thunk: srso_alias_return_thunk machine # [ 0.379735] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' machine # [ 0.381024] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' machine # [ 0.382024] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' machine # [ 0.383024] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' machine # [ 0.384024] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' machine # [ 0.385024] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' machine # [ 0.386024] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' machine # [ 0.388024] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 machine # [ 0.389023] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 machine # [ 0.390024] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 machine # [ 0.391024] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 machine # [ 0.392024] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 machine # [ 0.393024] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. machine # [ 0.422407] Freeing SMP alternatives memory: 44K machine # [ 0.423027] pid_max: default: 32768 minimum: 301 machine # [ 0.424119] LSM: initializing lsm=capability,landlock,yama,bpf,ima machine # [ 0.425135] landlock: Up and running. machine # [ 0.426025] Yama: becoming mindful. machine # [ 0.426874] LSM support for eBPF active machine # [ 0.427703] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.429102] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.431794] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) machine # [ 0.432551] Performance Events: Fam17h+ core perfctr, AMD PMU driver. machine # [ 0.433029] ... version: 2 machine # [ 0.433800] ... bit width: 48 machine # [ 0.434027] ... generic counters: 6 machine # [ 0.434839] ... generic bitmap: 000000000000003f machine # [ 0.435833] ... fixed-purpose counters: 0 machine # [ 0.436027] ... fixed-purpose bitmap: 0000000000000000 machine # [ 0.436975] ... value mask: 0000ffffffffffff machine # [ 0.437789] ... max period: 00007fffffffffff machine # [ 0.438026] ... global_ctrl mask: 000000000000003f machine # [ 0.439119] signal: max sigframe size: 3376 machine # [ 0.439951] rcu: Hierarchical SRCU implementation. machine # [ 0.440650] rcu: Max phase no-delay instances is 400. machine # [ 0.441205] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level machine # [ 0.446625] smp: Bringing up secondary CPUs ... machine # [ 0.447419] smpboot: x86: Booting SMP configuration: machine # [ 0.448035] .... node #0, CPUs: #1 #2 #3 machine # [ 0.451170] smp: Brought up 1 node, 4 CPUs machine # [ 0.452775] smpboot: Total of 4 processors activated (19200.09 BogoMIPS) machine # [ 0.453594] Memory: 3957868K/4193752K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 220856K reserved, 0K cma-reserved) machine # [ 0.455027] devtmpfs: initialized machine # [ 0.456149] x86/mm: Memory block size: 128MB machine # [ 0.459095] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.460107] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). machine # [ 0.461149] pinctrl core: initialized pinctrl subsystem machine # [ 0.462321] PM: RTC time: 13:21:20, date: 2026-09-21 machine # [ 0.466255] NET: Registered PF_NETLINK/PF_ROUTE protocol family machine # [ 0.467827] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations machine # [ 0.469027] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations machine # [ 0.470581] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations machine # [ 0.471039] audit: initializing netlink subsys (disabled) machine # [ 0.472090] audit: type=2000 audit(1789996881.404:1): state=initialized audit_enabled=0 res=1 machine # [ 0.472342] thermal_sys: Registered thermal governor 'fair_share' machine # [ 0.474027] thermal_sys: Registered thermal governor 'bang_bang' machine # [ 0.475026] thermal_sys: Registered thermal governor 'step_wise' machine # [ 0.476027] thermal_sys: Registered thermal governor 'user_space' machine # [ 0.477026] thermal_sys: Registered thermal governor 'power_allocator' machine # [ 0.478051] cpuidle: using governor menu machine # [ 0.480265] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 machine # [ 0.481306] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] machine # [ 0.482030] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry machine # [ 0.483041] PCI: Using configuration type 1 for base access machine # [ 0.484178] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. machine # [ 0.487304] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages machine # [ 0.488940] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page machine # [ 0.489889] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages machine # [ 0.490939] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page machine # [ 0.496425] ACPI: Added _OSI(Module Device) machine # [ 0.498039] ACPI: Added _OSI(Processor Device) machine # [ 0.500033] ACPI: Added _OSI(Processor Aggregator Device) machine # [ 0.508776] ACPI: 1 ACPI AML tables successfully acquired and loaded machine # [ 0.515642] ACPI: Interpreter enabled machine # [ 0.517097] ACPI: PM: (supports S0 S3 S4 S5) machine # [ 0.519036] ACPI: Using IOAPIC for interrupt routing machine # [ 0.521264] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug machine # [ 0.525034] PCI: Using E820 reservations for host bridge windows machine # [ 0.528410] ACPI: Enabled 2 GPEs in block 00 to 3F machine # [ 0.540865] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) machine # [ 0.543039] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] machine # [ 0.546186] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] machine # [ 0.549292] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] machine # [ 0.551864] PCI host bridge to bus 0000:00 machine # [ 0.553037] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] machine # [ 0.556031] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] machine # [ 0.558031] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] machine # [ 0.560031] pci_bus 0000:00: root bus resource [mem 0x80000000-0xafffffff window] machine # [ 0.563030] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] machine # [ 0.564027] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.566028] pci_bus 0000:00: root bus resource [bus 00-ff] machine # [ 0.567145] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint machine # [ 0.568516] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint machine # [ 0.583150] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] machine # [ 0.584042] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] machine # [ 0.585055] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] machine # [ 0.588862] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] machine # [ 0.594116] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.605073] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] machine # [ 0.607048] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] machine # [ 0.610087] pci 0000:00:02.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref] machine # [ 0.613047] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] machine # [ 0.617402] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.625074] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] machine # [ 0.626042] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] machine # [ 0.628073] pci 0000:00:03.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref] machine # [ 0.632083] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint machine # [ 0.640059] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] machine # [ 0.642092] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] machine # [ 0.643049] pci 0000:00:04.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref] machine # [ 0.645768] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.655067] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] machine # [ 0.658051] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] machine # [ 0.661089] pci 0000:00:05.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref] machine # [ 0.664049] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] machine # [ 0.669405] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint machine # [ 0.677084] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] machine # [ 0.679087] pci 0000:00:06.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref] machine # [ 0.683436] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.691082] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] machine # [ 0.693099] pci 0000:00:07.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref] machine # [ 0.698459] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.704085] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] machine # [ 0.726898] pci 0000:00:08.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref] machine # [ 0.728680] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.732022] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] machine # [ 0.733083] pci 0000:00:09.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref] machine # [ 0.735925] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint machine # [ 0.746075] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] machine # [ 0.748049] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] machine # [ 0.751096] pci 0000:00:0a.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref] machine # [ 0.756500] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.766071] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] machine # [ 0.768048] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] machine # [ 0.771087] pci 0000:00:0b.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref] machine # [ 0.775516] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.782119] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] machine # [ 0.784580] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.790031] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] machine # [ 0.792442] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.796110] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] machine # [ 0.799299] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint machine # [ 0.802261] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] machine # [ 0.804161] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint machine # [ 0.806646] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO machine # [ 0.809546] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint machine # [ 0.816114] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] machine # [ 0.818043] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] machine # [ 0.820679] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint machine # [ 0.826085] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] machine # [ 0.833119] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 machine # [ 0.836298] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 machine # [ 0.838233] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 machine # [ 0.840226] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 machine # [ 0.842227] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 machine # [ 0.844226] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 machine # [ 0.846227] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 machine # [ 0.848250] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 machine # [ 0.851156] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 machine # [ 0.853059] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 machine # [ 0.855055] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 machine # [ 0.856043] ACPI: PCI: Interrupt link GSID configured for IRQ 19 machine # [ 0.857039] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 machine # [ 0.858042] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 machine # [ 0.859041] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 machine # [ 0.860039] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 machine # [ 0.863624] iommu: Default domain type: Translated machine # [ 0.863896] iommu: DMA domain TLB invalidation policy: lazy mode machine # [ 0.866308] ACPI: bus type USB registered machine # [ 0.867105] usbcore: registered new interface driver usbfs machine # [ 0.868279] usbcore: registered new interface driver hub machine # [ 0.870137] usbcore: registered new device driver usb machine # [ 0.877193] NetLabel: Initializing machine # [ 0.878033] NetLabel: domain hash size = 128 machine # [ 0.880033] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO machine # [ 0.883143] NetLabel: unlabeled traffic allowed by default machine # [ 0.885061] PCI: Using ACPI for IRQ routing machine # [ 0.959189] pci 0000:00:01.0: vgaarb: setting as boot VGA device machine # [ 0.960023] pci 0000:00:01.0: vgaarb: bridge control possible machine # [ 0.960023] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none machine # [ 0.963037] vgaarb: loaded machine # [ 0.963891] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 machine # [ 0.964703] hpet0: 3 comparators, 64-bit 100.000000 MHz counter machine # [ 0.970337] clocksource: Switched to clocksource kvm-clock machine # [ 0.972084] VFS: Disk quotas dquot_6.6.0 machine # [ 0.972923] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) machine # [ 0.974612] pnp: PnP ACPI init machine # [ 0.975512] ACPI: IRQ 4 override to edge(!), high(!) machine # [ 0.976570] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved machine # [ 0.978262] pnp: PnP ACPI: found 5 devices machine # [ 0.987930] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns machine # [ 0.989561] clocksource: Switched to clocksource acpi_pm machine # [ 0.990603] NET: Registered PF_INET protocol family machine # [ 0.992160] IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear) machine # [ 1.010022] tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 1.011618] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) machine # [ 1.013113] TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear) machine # [ 1.015713] TCP bind hash table entries: 32768 (order: 8, 1048576 bytes, linear) machine # [ 1.017090] TCP: Hash tables configured (established 32768 bind 32768) machine # [ 1.018319] MPTCP token hash table entries: 4096 (order: 5, 98304 bytes, linear) machine # [ 1.019712] UDP hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 1.020921] UDP-Lite hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 1.022319] NET: Registered PF_UNIX/PF_LOCAL protocol family machine # [ 1.023366] NET: Registered PF_XDP protocol family machine # [ 1.024250] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] machine # [ 1.025332] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] machine # [ 1.026404] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] machine # [ 1.027584] pci_bus 0000:00: resource 7 [mem 0x80000000-0xafffffff window] machine # [ 1.028791] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] machine # [ 1.029969] pci_bus 0000:00: resource 9 [mem 0xe0000000000-0xe07ffffffff window] machine # [ 1.032046] ACPI: \_SB_.GSIA: Enabled at IRQ 16 machine # [ 1.034404] ACPI: \_SB_.GSIB: Enabled at IRQ 17 machine # [ 1.036418] ACPI: \_SB_.GSIC: Enabled at IRQ 18 machine # [ 1.038402] ACPI: \_SB_.GSID: Enabled at IRQ 19 machine # [ 1.040122] PCI: CLS 0 bytes, default 64 machine # [ 1.040968] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) machine # [ 1.041441] Trying to unpack rootfs image as initramfs... machine # [ 1.042105] software IO TLB: mapped [mem 0x000000007a371000-0x000000007e371000] (64MB) machine # [ 1.042245] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 1.066305] Initialise system trusted keyrings machine # [ 1.067666] workingset: timestamp_bits=40 max_order=20 bucket_order=0 machine # [ 1.079394] Key type asymmetric registered machine # [ 1.080161] Asymmetric key parser 'x509' registered machine # [ 1.081121] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) machine # [ 1.082907] io scheduler mq-deadline registered machine # [ 1.083788] io scheduler kyber registered machine # [ 1.087227] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled machine # [ 1.088626] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A machine # [ 1.091251] Linux agpgart interface v0.103 machine # [ 1.092110] ACPI: bus type drm_connector registered machine # [ 1.095259] usbcore: registered new interface driver usbserial_generic machine # [ 1.096435] usbserial: USB Serial support registered for generic machine # [ 1.097467] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. machine # [ 1.097467] Please enable it if your BIOS has the CPPC option. machine # [ 1.099940] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled machine # [ 1.101471] drop_monitor: Initializing network drop monitor service machine # [ 1.102816] NET: Registered PF_INET6 protocol family machine # [ 1.104838] Segment Routing with IPv6 machine # [ 1.105511] In-situ OAM (IOAM) with IPv6 machine # [ 1.108081] IPI shorthand broadcast: enabled machine # [ 1.112609] sched_clock: Marking stable (958011086, 153761816)->(1133595112, -21822210) machine # [ 1.114594] registered taskstats version 1 machine # [ 1.115677] Loading compiled-in X.509 certificates machine # [ 1.126389] Demotion targets for Node 0: null machine # [ 1.127506] Key type .fscrypt registered machine # [ 1.128253] Key type fscrypt-provisioning registered machine # [ 1.129274] ima: No TPM chip found, activating TPM-bypass! machine # [ 1.130270] ima: Allocated hash algorithm: sha1 machine # [ 1.131144] ima: No architecture policies found machine # [ 1.132350] PM: Magic number: 10:797:382 machine # [ 1.133174] container PNP0A06:00: hash matches machine # [ 1.134066] acpi PNP0A06:00: hash matches machine # [ 1.135896] RAS: Correctable Errors collector initialized. machine # [ 1.140491] clk: Disabling unused clocks machine # [ 1.141261] PM: genpd: Disabling unused power domains machine # [ 1.329888] Freeing initrd memory: 29052K machine # [ 1.334011] Freeing unused decrypted memory: 2028K machine # [ 1.337327] Freeing unused kernel image (initmem) memory: 3652K machine # [ 1.338479] Write protecting the kernel read-only data: 32768k machine # [ 1.340934] Freeing unused kernel image (text/rodata gap) memory: 1184K machine # [ 1.342691] Freeing unused kernel image (rodata/data gap) memory: 720K machine # [ 1.393675] x86/mm: Checked W+X mappings: passed, no W+X pages found. machine # [ 1.394903] Run /init as init process machine # [ 1.410606] systemd[1]: Inserted module 'autofs4' machine # [ 1.437601] fuse: init (API version 7.45) machine # [ 1.446886] ACPI: \_SB_.GSIG: Enabled at IRQ 22 machine # [ 1.449478] ACPI: \_SB_.GSIH: Enabled at IRQ 23 machine # [ 1.452986] ACPI: \_SB_.GSIE: Enabled at IRQ 20 machine # [ 1.455210] ACPI: \_SB_.GSIF: Enabled at IRQ 21 machine # [ 1.460263] virtiofs virtio5: discovered new tag: nix-store machine # [ 1.473250] virtiofs virtio5: virtio_fs_setup_dax: No cache capability machine # [ 1.480583] virtiofs virtio6: discovered new tag: shared machine # [ 1.482131] virtiofs virtio6: virtio_fs_setup_dax: No cache capability machine # [ 1.485735] virtiofs virtio7: discovered new tag: xchg machine # [ 1.487293] virtiofs virtio7: virtio_fs_setup_dax: No cache capability machine # [ 1.514361] systemd[1]: Successfully made /usr/ read-only. machine # [ 1.851347] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 1.863973] systemd[1]: Detected virtualization kvm. machine # [ 1.866213] systemd[1]: Detected architecture x86-64. machine # [ 1.868424] systemd[1]: Running in initrd. machine # [ 1.871086] systemd[1]: Initializing machine ID from random generator. machine # [ 1.874037] systemd[1]: Hostname set to . machine # [ 2.002633] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 2.042631] systemd[1]: Queued start job for default target Initrd Default Target. machine # [ 2.055515] systemd[1]: Created slice Slice /system/modprobe. machine # [ 2.056825] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 2.058289] systemd[1]: Expecting device /dev/disk/by-label/nixos... machine # [ 2.059447] systemd[1]: Reached target Path Units. machine # [ 2.060352] systemd[1]: Reached target Slice Units. machine # [ 2.061263] systemd[1]: Reached target Swaps. machine # [ 2.062200] systemd[1]: Reached target Timer Units. machine # [ 2.063296] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 2.064573] systemd[1]: Listening on Journal Socket (/dev/log). machine # [ 2.065800] systemd[1]: Listening on Journal Sockets. machine # [ 2.066849] systemd[1]: Listening on udev Control Socket. machine # [ 2.067936] systemd[1]: Listening on udev Kernel Socket. machine # [ 2.068946] systemd[1]: Reached target Socket Units. machine # [ 2.071188] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 2.073406] systemd[1]: Starting Load Kernel Module configfs... machine # [ 2.076523] systemd[1]: Starting Journal Service... machine # [ 2.078416] systemd[1]: Starting Load Kernel Modules... machine # [ 2.080857] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 2.087140] systemd[1]: Starting Coldplug All udev Devices... machine # [ 2.091507] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 2.093159] systemd[1]: Finished Load Kernel Module configfs. machine # [ 2.095129] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config machine # [ 2.100481] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 2.113018] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 2.121551] systemd-journald[90]: Collecting audit messages is disabled. machine # [ 2.127404] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. machine # [ 2.131840] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev machine # [ 2.134713] systemd[1]: Finished Load Kernel Modules. machine # [ 2.136969] systemd[1]: Starting Apply Kernel Variables... machine # [ 2.138699] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 2.143674] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 2.150366] systemd[1]: Finished Apply Kernel Variables. machine # [ 2.155263] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 2.156662] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 2.157996] systemd[1]: Reached target Local File Systems. machine # [ 2.160069] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 2.169040] systemd[1]: Started Journal Service. machine # [ 2.015371] systemd-modules-load[91]: Using 4 probe threads machine # [ 2.017510] systemd-modules-load[91]: Inserted module 'virtio_balloon' machine # [ 2.018657] systemd-modules-load[91]: Inserted module 'virtio_gpu' machine # [ 2.019728] systemd-modules-load[91]: Inserted module 'dm_mod' machine # [ 2.022156] systemd[1]: Starting Create System Files and Directories... machine # [ 2.033218] systemd-udevd[102]: Using default interface naming scheme 'v261'. machine # [ 2.039805] systemd[1]: Finished Create System Files and Directories. machine # [ 2.046275] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 2.063478] systemd[1]: Finished Coldplug All udev Devices. machine # [ 2.064788] systemd[1]: Reached target System Initialization. machine # [ 2.065653] systemd[1]: Reached target Basic System. machine # [ 2.301984] virtio_blk virtio2: 4/0/0 default/read/poll queues machine # [ 2.305035] virtio_blk virtio2: [vda] 33554432 512-byte logical blocks (17.2 GB/16.0 GiB) machine # [ 2.336603] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 machine # [ 2.339374] uhci_hcd 0000:00:1d.0: UHCI Host Controller machine # [ 2.340225] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 1 machine # [ 2.341582] uhci_hcd 0000:00:1d.0: detected 2 ports machine # [ 2.342727] serio: i8042 KBD port at 0x60,0x64 irq 1 machine # [ 2.343476] serio: i8042 AUX port at 0x60,0x64 irq 12 machine # [ 2.344426] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 machine # [ 2.345615] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.346881] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.347993] usb usb1: Product: UHCI Host Controller machine # [ 2.349230] usb usb1: Manufacturer: Linux 6.18.52 uhci_hcd machine # [ 2.350185] usb usb1: SerialNumber: 0000:00:1d.0 machine # [ 2.354336] hub 1-0:1.0: USB hub found machine # [ 2.355173] hub 1-0:1.0: 2 ports detected machine # [ 2.365281] ehci-pci 0000:00:1d.7: EHCI Host Controller machine # [ 2.366460] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 2 machine # [ 2.368341] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 machine # [ 2.374818] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 machine # [ 2.376301] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 machine # [ 2.377705] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.379178] usb usb2: Product: EHCI Host Controller machine # [ 2.380050] usb usb2: Manufacturer: Linux 6.18.52 ehci_hcd machine # [ 2.381121] usb usb2: SerialNumber: 0000:00:1d.7 machine # [ 2.382398] hub 2-0:1.0: USB hub found machine # [ 2.229469] systemd[1]: Starting Virtual Console Setup... machine # [ 2.384483] hub 2-0:1.0: 6 ports detected machine # [ 2.237954] systemd[1]: Found device /dev/disk/by-label/nixos. machine # [ 2.238903] systemd[1]: Reached target Initrd Root Device. machine # [ 2.249217] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... machine # [ 2.406924] hub 1-0:1.0: USB hub found machine # [ 2.407798] hub 1-0:1.0: 2 ports detected machine # [ 2.408799] uhci_hcd 0000:00:1d.1: UHCI Host Controller machine # [ 2.409613] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 machine # [ 2.410854] uhci_hcd 0000:00:1d.1: detected 2 ports machine # [ 2.414374] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 machine # [ 2.261904] systemd-vconsole-setup[141]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 2.419863] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 machine # [ 2.421011] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.422297] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.269131] systemd[1]: Finished Virtual Console Setup. machine # [ 2.423680] usb usb3: Product: UHCI Host Controller machine # [ 2.425087] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd machine # [ 2.425963] usb usb3: SerialNumber: 0000:00:1d.1 machine # [ 2.428474] hub 3-0:1.0: USB hub found machine # [ 2.429551] hub 3-0:1.0: 2 ports detected machine # [ 2.431951] uhci_hcd 0000:00:1d.2: UHCI Host Controller machine # [ 2.433576] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 machine # [ 2.435595] uhci_hcd 0000:00:1d.2: detected 2 ports machine # [ 2.436613] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 machine # [ 2.438322] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.439177] SCSI subsystem initialized machine # [ 2.440604] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.442212] usb usb4: Product: UHCI Host Controller machine # [ 2.289175] (udev-worker)[121]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 2.445492] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd machine # [ 2.292122] (udev-worker)[128]: Network interface NamePolicy= disabled on kernel command line. machine # [ 2.294353] systemd-fsck[147]: nixos: clean, 12/1048576 files, 109865/4194304 blocks machine # [ 2.295674] (udev-worker)[121]: Network interface NamePolicy= disabled on kernel command line. machine # [ 2.451829] usb usb4: SerialNumber: 0000:00:1d.2 machine # [ 2.452909] hub 4-0:1.0: USB hub found machine # [ 2.300186] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. machine # [ 2.453824] hub 4-0:1.0: 2 ports detected machine # [ 2.471273] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode machine # [ 2.473248] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) machine # [ 2.474460] ahci 0000:00:1f.2: flags: 64bit ncq only machine # [ 2.477792] scsi host0: ahci machine # [ 2.478902] scsi host1: ahci machine # [ 2.480177] scsi host2: ahci machine # [ 2.481119] scsi host3: ahci machine # [ 2.482197] scsi host4: ahci machine # [ 2.483196] scsi host5: ahci machine # [ 2.483861] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 50 lpm-pol 1 machine # [ 2.485088] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 50 lpm-pol 1 machine # [ 2.486340] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 50 lpm-pol 1 machine # [ 2.487561] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 50 lpm-pol 1 machine # [ 2.488848] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 50 lpm-pol 1 machine # [ 2.490052] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 50 lpm-pol 1 machine # [ 2.627022] usb 2-1: new high-speed USB device number 2 using ehci-pci machine # [ 2.758200] usb 2-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 machine # [ 2.761233] usb 2-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 machine # [ 2.763975] usb 2-1: Product: QEMU USB Tablet machine # [ 2.765653] usb 2-1: Manufacturer: QEMU machine # [ 2.767185] usb 2-1: SerialNumber: 28754-0000:00:1d.7-1 machine # [ 2.801955] ata2: SATA link down (SStatus 0 SControl 300) machine # [ 2.802630] hid: raw HID events driver (C) Jiri Kosina machine # [ 2.804651] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) machine # [ 2.808887] ata5: SATA link down (SStatus 0 SControl 300) machine # [ 2.811207] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 machine # [ 2.812922] ata3.00: applying bridge limits machine # [ 2.814674] ata1: SATA link down (SStatus 0 SControl 300) machine # [ 2.817127] ata4: SATA link down (SStatus 0 SControl 300) machine # [ 2.819364] ata6: SATA link down (SStatus 0 SControl 300) machine # [ 2.821515] ata3.00: configured for UDMA/100 machine # [ 2.824056] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 machine # [ 2.860511] usbcore: registered new interface driver usbhid machine # [ 2.862659] usbhid: USB HID core driver machine # [ 2.872746] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb2/2-1/2-1:1.0/0003:0627:0001.0001/input/input2 machine # [ 2.876218] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 machine # [ 2.912093] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray machine # [ 2.940004] cdrom: Uniform CD-ROM driver Revision: 3.20 machine # [ 2.938299] systemd[1]: Mounting /sysroot... machine # [ 3.232430] EXT4-fs (vda): mounted filesystem 33cf84dd-2c19-4aec-951d-8070bbdef301 r/w with ordered data mode. Quota mode: none. machine # [ 3.084983] systemd[1]: Mounted /sysroot. machine # [ 3.086997] systemd[1]: Reached target Initrd Root File System. machine # [ 3.089295] systemd[1]: Mounting /sysroot/nix/.ro-store... machine # [ 3.091441] systemd[1]: Mounting /sysroot/nix/.rw-store... machine # [ 3.093464] systemd[1]: Mounting /sysroot/run... machine # [ 3.095284] systemd[1]: Mounting /sysroot/tmp/shared... machine # [ 3.100109] systemd[1]: Mounting /sysroot/tmp/xchg... machine # [ 3.104301] systemd[1]: Starting Mountpoints Configured in the Real Root... machine # [ 3.111623] systemd[1]: Mounted /sysroot/nix/.ro-store. machine # [ 3.113690] systemd-sysroot-fstab-check[191]: /sysroot should be mounted in the initrd, will request daemon-reload. machine # [ 3.118348] systemd[1]: Mounted /sysroot/nix/.rw-store. machine # [ 3.121366] systemd[1]: Mounted /sysroot/run. machine # [ 3.123460] systemd[1]: Mounted /sysroot/tmp/shared. machine # [ 3.124907] systemd[1]: Mounted /sysroot/tmp/xchg. machine # [ 3.132234] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.133471] systemd[1]: Reload requested from client PID 191 ('systemd-sysroot') (unit initrd-parse-etc.service)... machine # [ 3.135221] systemd[1]: Reloading... machine # [ 3.192657] systemd[1]: Reloading finished in 57 ms. machine # [ 3.212619] systemd-sysroot-fstab-check[191]: Requesting initrd-fs.target/start/replace... machine # [ 3.215546] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.217984] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.220232] systemd-sysroot-fstab-check[191]: Requesting swap.target/start/replace... machine # [ 3.222739] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.224729] systemd[1]: initrd-parse-etc.service: Deactivated successfully. machine # [ 3.226977] systemd[1]: Finished Mountpoints Configured in the Real Root. machine # [ 3.229269] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. machine # [ 3.242755] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.245202] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.939189] systemd[1]: Mounting /sysroot/nix/store... machine # [ 3.993972] systemd[1]: Mounted /sysroot/nix/store. machine # [ 3.996088] systemd[1]: Reached target Initrd File Systems. machine # [ 3.997941] systemd[1]: Starting Find NixOS closure... machine # [ 3.999664] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... machine # [ 4.033975] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. machine # [ 4.036738] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. machine # [ 4.047880] systemd[1]: Finished Find NixOS closure. machine # [ 4.049831] systemd[1]: Reached target Initrd Default Target. machine # [ 4.051902] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... machine # [ 4.080100] systemd[1]: Stopped target Initrd Default Target. machine # [ 4.082368] systemd[1]: Stopped target Basic System. machine # [ 4.084241] systemd[1]: Stopped target Initrd Root Device. machine # [ 4.086588] systemd[1]: Stopped target Path Units. machine # [ 4.088362] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. machine # [ 4.091319] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. machine # [ 4.094176] systemd[1]: Stopped target Slice Units. machine # [ 4.098310] systemd[1]: Stopped target Socket Units. machine # [ 4.100344] systemd[1]: Stopped target System Initialization. machine # [ 4.103680] systemd[1]: Stopped target Swaps. machine # [ 4.105318] systemd[1]: Stopped target Timer Units. machine # [ 4.107530] systemd[1]: dbus.socket: Deactivated successfully. machine # [ 4.110341] systemd[1]: Closed D-Bus System Message Bus Socket. machine # [ 4.112352] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. machine # [ 4.114954] systemd[1]: Stopped Find NixOS closure. machine # [ 4.116564] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 4.118542] systemd[1]: systemd-sysctl.service: Deactivated successfully. machine # [ 4.120717] systemd[1]: Stopped Apply Kernel Variables. machine # [ 4.122500] systemd[1]: systemd-modules-load.service: Deactivated successfully. machine # [ 4.124878] systemd[1]: Stopped Load Kernel Modules. machine # [ 4.126579] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. machine # [ 4.128982] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. machine # [ 4.130761] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. machine # [ 4.132482] systemd[1]: Stopped Create System Files and Directories. machine # [ 4.133978] systemd[1]: Stopped target Local File Systems. machine # [ 4.135213] systemd[1]: Stopped target Preparation for Local File Systems. machine # [ 4.136700] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. machine # [ 4.138383] systemd[1]: Stopped Coldplug All udev Devices. machine # [ 4.139585] systemd[1]: Stopping Rule-based Manager for Device Events and Files... machine # [ 4.141326] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 4.143027] systemd[1]: Stopped Virtual Console Setup. machine # [ 4.144164] systemd[1]: initrd-cleanup.service: Deactivated successfully. machine # [ 4.145650] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. machine # [ 4.147168] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 4.148454] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 4.149777] systemd[1]: systemd-udevd.service: Deactivated successfully. machine # [ 4.151333] systemd[1]: Stopped Rule-based Manager for Device Events and Files. machine # [ 4.152702] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. machine # [ 4.154094] systemd[1]: Closed udev Control Socket. machine # [ 4.155155] systemd[1]: Starting Cleanup udev Database... machine # [ 4.156268] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. machine # [ 4.157664] systemd[1]: Stopped Create Static Device Nodes in /dev. machine # [ 4.158850] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. machine # [ 4.160320] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. machine # [ 4.161678] systemd[1]: kmod-static-nodes.service: Deactivated successfully. machine # [ 4.163163] systemd[1]: Stopped Create List of Static Device Nodes. machine # [ 4.164384] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. machine # [ 4.165708] systemd[1]: Finished Cleanup udev Database. machine # [ 4.166758] systemd[1]: Reached target Switch Root. machine # [ 4.167748] systemd[1]: Starting NixOS Activation... machine # [ 4.292596] initrd-nixos-activation-start[236]: booting system configuration /nix/store/nisc8ppra28hvw39ib9xhrk4ifbq04i7-nixos-system-machine-test machine # [ 4.360913] initrd-nixos-activation-start[236]: running activation script... machine # [ 4.712077] initrd-nixos-activation-start[259]: setting up /etc... machine # [ 4.887552] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. machine # [ 4.889826] systemd[1]: Finished NixOS Activation. machine # [ 4.891466] systemd[1]: Starting Switch Root... machine # [ 4.914134] systemd[1]: Switching root. machine # [ 5.135932] systemd-journald[90]: Received SIGTERM from PID 1 (systemd). machine # [ 5.243502] NET: Registered PF_VSOCK protocol family machine # [ 5.633361] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 5.643607] systemd[1]: Detected virtualization kvm. machine # [ 5.645531] systemd[1]: Detected architecture x86-64. machine # [ 5.647564] systemd[1]: Detected first boot. machine # [ 5.652056] systemd[1]: Initializing machine ID from random generator. machine # [ 5.801966] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 5.890380] systemd[1]: Applying preset policy. machine # [ 6.150905] systemd[1]: Populated /etc with preset unit settings. machine # [ 6.407588] systemd[1]: initrd-switch-root.service: Deactivated successfully. machine # [ 6.409072] systemd[1]: Stopped initrd-switch-root.service. machine # [ 6.411898] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. machine # [ 6.414084] systemd[1]: Created slice Slice /system/getty. machine # [ 6.415575] systemd[1]: Created slice User and Session Slice. machine # [ 6.416533] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 6.417942] systemd[1]: Started Forward Password Requests to Wall Directory Watch. machine # [ 6.419109] systemd[1]: Expecting device /dev/hvc0... machine # [ 6.419907] systemd[1]: Expecting device /dev/ttyS0... machine # [ 6.420824] systemd[1]: Reached target Local Encrypted Volumes. machine # [ 6.421755] systemd[1]: Stopped target initrd-fs.target. machine # [ 6.422532] systemd[1]: Stopped target initrd-root-fs.target. machine # [ 6.423340] systemd[1]: Stopped target initrd-switch-root.target. machine # [ 6.424251] systemd[1]: Reached target Virtual Machines and Containers. machine # [ 6.425261] systemd[1]: Reached target Path Units. machine # [ 6.426075] systemd[1]: Reached target Remote File Systems. machine # [ 6.427004] systemd[1]: Reached target Slice Units. machine # [ 6.427836] systemd[1]: Reached target Swaps. machine # [ 6.430085] systemd[1]: Listening on Query the User Interactively for a Password. machine # [ 6.433021] systemd[1]: Listening on Process Core Dump Socket. machine # [ 6.435135] systemd[1]: Listening on Credential Encryption/Decryption. machine # [ 6.437382] systemd[1]: Listening on Factory Reset Management. machine # [ 6.438420] systemd[1]: Listening on Hostname Service Socket. machine # [ 6.441820] systemd[1]: Starting Journal Log Access Socket... machine # [ 6.443493] systemd[1]: Listening on Journal Audit Socket. machine # [ 6.445977] systemd[1]: Listening on Console Output Muting Service Socket. machine # [ 6.447231] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. machine # [ 6.448434] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.449887] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki machine # [ 6.455008] systemd[1]: Listening on Disk Repartitioning Service Socket. machine # [ 6.456138] systemd[1]: Listening on udev Control Socket. machine # [ 6.457134] systemd[1]: Listening on udev Varlink Socket. machine # [ 6.459920] systemd[1]: Mounting Huge Pages File System... machine # [ 6.462287] systemd[1]: Mounting POSIX Message Queue File System... machine # [ 6.465029] systemd[1]: Mounting Kernel Debug File System... machine # [ 6.474480] systemd[1]: Mounting Kernel Trace File System... machine # [ 6.477415] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 6.482956] systemd[1]: Starting Load Kernel Module configfs... machine # [ 6.485232] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm machine # [ 6.488939] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.492938] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.500073] systemd[1]: Mounting FUSE Control File System... machine # [ 6.501183] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.506857] systemd[1]: Starting Journal Service... machine # [ 6.511336] systemd[1]: Starting Load Kernel Modules... machine # [ 6.518995] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... machine # [ 6.522838] systemd[1]: Starting Remount Root and Kernel File Systems... machine # [ 6.523920] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.527230] systemd[1]: Starting Coldplug All udev Devices... machine # [ 6.530672] systemd[1]: Listening on Journal Log Access Socket. machine # [ 6.533478] systemd[1]: Mounted Huge Pages File System. machine # [ 6.535461] systemd[1]: Mounted POSIX Message Queue File System. machine # [ 6.538712] systemd[1]: Mounted Kernel Debug File System. machine # [ 6.540787] systemd[1]: Mounted Kernel Trace File System. machine # [ 6.543545] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 6.546324] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 6.548950] systemd[1]: Finished Load Kernel Module configfs. machine # [ 6.550239] systemd[1]: Mounted FUSE Control File System. machine # [ 6.552961] systemd[1]: Mounting Kernel Configuration File System... machine # [ 6.556658] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 6.563826] systemd-journald[331]: Collecting audit messages is enabled. machine # [ 6.566785] EXT4-fs (vda): re-mounted 33cf84dd-2c19-4aec-951d-8070bbdef301. machine # [ 6.577433] systemd[1]: Finished Remount Root and Kernel File Systems. machine # [ 6.578746] systemd[1]: Listening on Disk Image Download Service Socket. machine # [ 6.579913] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.429735] systemd[1]: Queued start job for default target Multi-User System. machine # [ 6.431234] systemd[1]: systemd-journald.serv[ 6.584831] systemd[1]: Starting Load/Save OS Random Seed... machine # ice: Deactivated successfully. machine # [ 6.586293] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.433554] systemd-modules-load[332]: Using 2 probe threads machine # [ 6.588080] systemd[1]: Started Journal Service. machine # [ 6.439864] systemd[1]: Mounted Kernel Configuration File System. machine # [ 6.441791] systemd-oomd[333]: No swap; memory pressure usage will be degraded machine # [ 6.447858] systemd[1]: Starting Flush Journal to Persistent Storage... machine # [ 6.448853] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. machine # [ 6.603492] loop: module loaded machine # [ 6.450632] systemd-modules-load[332]: Inserted module 'loop' machine # [ 6.455709] systemd[1]: Finished Load Kernel Modules. machine # [ 6.457536] systemd[1]: Starting Apply Kernel Variables... machine # [ 6.628368] systemd-journald[331]: Received client request to flush runtime journal. machine # [ 6.534964] systemd[1]: Finished Load/Save OS Random Seed. machine # [ 6.536361] systemd[1]: Reached target First Boot Complete. machine # [ 6.537459] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 6.538974] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 6.540028] systemd[1]: Finished Apply Kernel Variables. machine # [ 6.540806] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 6.541710] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 6.542704] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 6.543802] systemd[1]: Finished Flush Journal to Persistent Storage. machine # [ 6.549872] systemd[1]: Finished Coldplug All udev Devices. machine # [ 6.570643] systemd-udevd[360]: Using default interface naming scheme 'v261'. machine # [ 6.610637] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 6.690647] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.715728] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. machine # [ 6.729830] (udev-worker)[387]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.734613] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. machine # [ 6.738202] (udev-worker)[379]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 6.740569] (udev-worker)[379]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.770645] systemd[1]: Condition check resulted in Virtio network device being skipped. machine # [ 6.771869] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.773427] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.775683] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.777301] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.778668] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.932698] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 machine # [ 6.939899] mousedev: PS/2 mouse device common for all mice machine # [ 6.945600] ACPI: button: Power Button [PWRF] machine # [ 6.955853] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console machine # [ 6.962095] rtc_cmos PNP0B00:00: RTC can wake from S4 machine # [ 6.965697] rtc_cmos PNP0B00:00: registered as rtc0 machine # [ 6.965897] rtc_cmos PNP0B00:00: setting system clock to 2026-09-21T13:21:27 UTC (1789996887) machine # [ 6.966334] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 machine # [ 6.969374] systemd-journald[331]: Time jumped backwards, rotating. machine # [ 6.969832] parport_pc 00:02: reported by Plug and Play ACPI machine # [ 6.969977] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs machine # [ 6.970000] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] machine # [ 6.975010] Console: switching to colour dummy device 80x25 machine # [ 6.982595] [drm] Found bochs VGA, ID 0xb0c5. machine # [ 6.982597] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. machine # [ 6.989903] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic machine # [ 6.990704] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 machine # [ 6.992121] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized machine # [ 7.016428] Console: switching to colour frame buffer device 160x50 machine # [ 7.018151] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device machine # [ 7.030290] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt machine # [ 7.031141] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD machine # [ 6.913392] systemd[1]: Starting Virtual Console Setup... machine # [ 7.078080] ppdev: user-space parallel port driver machine # [ 6.925752] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 6.931587] systemd[1]: Stopped Virtual Console Setup. machine # [ 7.107637] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) machine # [ 7.115860] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 machine # [ 7.119805] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) machine # [ 6.971263] systemd[1]: Starting Virtual Console Setup... machine # [ 6.977159] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 6.979339] systemd[1]: Stopped Virtual Console Setup. machine # [ 7.134267] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 machine # [ 6.995932] systemd[1]: Starting Virtual Console Setup... machine # [ 7.203066] kvm_amd: TSC scaling supported machine # [ 7.203590] kvm_amd: Nested Virtualization enabled machine # [ 7.204207] kvm_amd: Nested Paging enabled machine # [ 7.204694] kvm_amd: LBR virtualization supported machine # [ 7.205257] kvm_amd: Virtual VMLOAD VMSAVE supported machine # [ 7.205893] kvm_amd: Virtual GIF supported machine # [ 7.206331] kvm_amd: Virtual NMI enabled machine # [ 7.313854] EDAC MC: Ver: 3.0.0 machine # [ 7.182947] systemd-vconsole-setup[406]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 7.186578] systemd[1]: Finished Virtual Console Setup. machine # [ 7.259357] systemd[1]: Mounting /run/wrappers... machine # [ 7.299581] systemd[1]: Mounted /run/wrappers. machine # [ 7.301499] systemd[1]: Reached target Local File Systems. machine # [ 7.303450] systemd[1]: Listening on Boot Loader Control Service Socket. machine # [ 7.306377] systemd[1]: Starting register-nix-paths.service... machine # [ 7.309366] systemd[1]: Starting Create SUID/SGID Wrappers... machine # [ 7.311746] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. machine # [ 7.317348] systemd[1]: Starting Save Transient machine-id to Disk... machine # [ 7.324063] systemd[1]: Starting Create System Files and Directories... machine # [ 7.384569] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. machine # [ 7.387964] systemd[1]: Finished Save Transient machine-id to Disk. machine # [ 7.414502] systemd[1]: Finished Create System Files and Directories. machine # [ 7.416758] systemd[1]: Starting Rebuild Journal Catalog... machine # [ 7.418465] systemd[1]: Starting Record System Boot/Shutdown in UTMP... machine # [ 7.451248] systemd[1]: Finished Record System Boot/Shutdown in UTMP. machine # [ 7.463897] systemd[1]: Finished Rebuild Journal Catalog. machine # [ 7.465696] systemd[1]: Starting Update is Completed... machine # [ 7.487951] systemd[1]: Finished Update is Completed. machine # [ 7.612381] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. machine # [ 7.613734] systemd[1]: Finished Create SUID/SGID Wrappers. machine # [ 7.870862] systemd[1]: Finished register-nix-paths.service. machine # [ 7.872506] systemd[1]: Reached target System Initialization. machine # [ 7.873945] systemd[1]: Started Discard unused filesystem blocks once a week. machine # [ 7.875481] systemd[1]: Started niks3 garbage collection timer. machine # [ 7.876869] systemd[1]: Started Daily Cleanup of Temporary Directories. machine # [ 7.878339] systemd[1]: Reached target Timer Units. machine # [ 7.879563] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 7.884144] systemd[1]: Listening on niks3 server socket. machine # [ 7.885443] systemd[1]: Listening on Nix Daemon Socket. machine # [ 7.886675] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. machine # [ 7.888455] systemd[1]: Reached target Socket Units. machine # [ 7.889391] systemd[1]: Reached target Basic System. machine # [ 7.890284] systemd[1]: Started backdoor.service. machine # [ 7.891761] systemd[1]: Starting Import lastlog data into lastlog2 database... machine # [ 7.895196] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 7.900211] systemd[1]: Starting Post-Boot Actions... machine # [ 7.903974] systemd[1]: Started Reset console on configuration changes. machine # [ 7.910220] systemd[1]: Starting resolvconf update... machine # [ 7.913499] systemd[1]: Started rustfs.service. machine # [ 7.918709] systemd[1]: Starting rustfs-bucket.service... machine # [ 7.920438] systemd[1]: Starting D-Bus System Message Bus... machine # [ 7.944637] systemd[1]: Finished Post-Boot Actions. machine # [ 7.970088] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 7.971399] nsncd[490]: Sep 21 13:21:28.654 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 7.973523] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 7.974527] systemd[1]: Reached target User and Group Name Lookups. machine # [ 7.975549] systemd[1]: Starting User Login Management... machine # connecting to host... machine # [ 7.984061] systemd[1]: Finished Import lastlog data into lastlog2 database. machine: Guest shell says: b'Spawning backdoor root shell...\n' machine: connected to guest root shell machine: (connecting took 8.66 seconds) machine: (finished: waiting for the VM to finish booting, in 8.92 seconds) machine # [ 8.025097] dbus-broker-launch[497]: Looking up NSS user entry for 'systemd-timesync'... machine # [ 8.037570] dbus-broker-launch[497]: NSS returned no entry for 'systemd-timesync' machine # [ 8.039157] dbus-broker-launch[497]: Invalid user-name in /nix/store/d3mrkr0v9x5sgbb0rb2pnsl0mysb1m4x-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" machine # [ 8.044108] systemd-logind[518]: New seat seat0. machine # [ 8.048589] systemd-logind[518]: Watching system buttons on /dev/input/event2 (Power Button) machine # [ 8.049838] systemd-logind[518]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) machine # [ 8.051494] systemd-logind[518]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) machine # [ 8.053350] systemd[1]: Started User Login Management. machine # [ 8.055347] systemd[1]: Starting linger-users.service... machine # [ 8.063032] systemd[1]: Started D-Bus System Message Bus. machine # [ 8.082525] systemd[1]: Stopped target Host and Network Name Lookups. machine # [ 8.083563] systemd[1]: Stopping Host and Network Name Lookups... machine # [ 8.087500] systemd[1]: Stopped target User and Group Name Lookups. machine # [ 8.088597] systemd[1]: Stopping User and Group Name Lookups... machine # [ 8.089464] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... machine # [ 8.090206] systemd[1]: nscd.service: Deactivated successfully. machine # [ 8.090909] dbus-broker-launch[497]: Ready machine # [ 8.091587] systemd[1]: Stopped Name Service Cache Daemon (nsncd). machine # [ 8.092973] systemd[1]: linger-users.service: Deactivated successfully. machine # [ 8.093661] systemd[1]: Finished linger-users.service. machine # [ 8.101210] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 8.136451] nsncd[593]: Sep 21 13:21:28.822 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 8.137128] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 8.137810] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 8.138464] systemd[1]: Reached target User and Group Name Lookups. machine # [ 8.159058] systemd[1]: Finished resolvconf update. machine # [ 8.159607] systemd[1]: Reached target Preparation for Network. machine # [ 8.162158] systemd[1]: Starting DHCP Client... machine # [ 8.163678] systemd[1]: Starting Address configuration of eth1... machine # [ 8.165624] systemd[1]: Starting Extra networking commands.... machine # [ 8.228683] network-addresses-eth1-start[625]: adding address 192.168.1.1/24... done machine # [ 8.239082] network-addresses-eth1-start[625]: adding address 2001:db8:1::1/64... done machine # [ 8.254836] systemd[1]: Finished Address configuration of eth1. machine # [ 8.257114] dhcpcd[636]: dhcpcd-10.3.2 starting machine # [ 8.263569] dhcpcd[681]: dev: loaded udev machine # [ 8.433822] 8021q: 802.1Q VLAN Support v1.8 machine # [ 8.434324] 8021q: adding VLAN 0 to HW filter on device eth1 machine # [ 8.297870] systemd[1]: Finished Extra networking commands.. machine # [ 8.298774] systemd[1]: Reached target Network. machine # [ 8.299533] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. machine # [ 8.302283] systemd[1]: Starting PostgreSQL Server... machine # [ 8.305244] systemd[1]: Starting Permit User Sessions... machine # [ 8.331895] systemd[1]: Finished Permit User Sessions. machine # [ 8.350139] systemd[1]: Started Getty on tty1. machine # [ 8.352299] systemd[1]: Reached target Login Prompts. machine # [ 8.524010] cfg80211: Loading compiled-in X.509 certificates for regulatory database machine # [ 8.540944] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' machine # [ 8.541813] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' machine # [ 8.545031] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 machine # [ 8.546056] cfg80211: failed to load regulatory.db machine # [ 8.592404] 8021q: adding VLAN 0 to HW filter on device eth0 machine # [ 8.440405] dhcpcd[681]: eth0: waiting for carrier machine # [ 8.441131] dhcpcd[681]: eth0: carrier acquired machine # [ 8.449509] dhcpcd[681]: DUID 00:01:00:01:32:43:eb:d9:52:54:00:12:34:56 machine # [ 8.450642] dhcpcd[681]: eth0: IAID 00:12:34:56 machine # [ 8.451445] dhcpcd[681]: eth0: adding address fe80::5054:ff:fe12:3456 machine # [ 8.457270] postgresql-pre-start[716]: The files belonging to this database system will be owned by user "postgres". machine # [ 8.458037] postgresql-pre-start[716]: This user must also own the server process. machine # [ 8.462672] postgresql-pre-start[716]: The database cluster will be initialized with locale "en_US.UTF-8". machine # [ 8.463523] postgresql-pre-start[716]: The default database encoding has accordingly been set to "UTF8". machine # [ 8.463837] postgresql-pre-start[716]: The default text search configuration will be set to "english". machine # [ 8.464493] postgresql-pre-start[716]: Data page checksums are enabled. machine # [ 8.467146] postgresql-pre-start[716]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok machine # [ 8.469214] postgresql-pre-start[716]: creating subdirectories ... ok machine # [ 8.470222] postgresql-pre-start[716]: selecting dynamic shared memory implementation ... posix machine # [ 8.533047] postgresql-pre-start[716]: selecting default "max_connections" ... 100 machine # [ 8.583192] postgresql-pre-start[716]: selecting default "shared_buffers" ... 128MB machine # [ 9.372260] postgresql-pre-start[716]: selecting default time zone ... UTC machine # [ 9.375089] postgresql-pre-start[716]: creating configuration files ... ok machine # [ 9.383638] dhcpcd[681]: eth0: soliciting a DHCP lease machine # [ 9.556325] NET: Registered PF_PACKET protocol family machine # [ 9.410719] dhcpcd[681]: eth0: offered 10.0.2.15 from 10.0.2.2 machine # [ 9.416323] dhcpcd[681]: eth0: probing address 10.0.2.15/24 machine # [ 9.597150] postgresql-pre-start[716]: running bootstrap script ... ok machine # [ 10.105523] postgresql-pre-start[716]: performing post-bootstrap initialization ... ok machine # [ 10.287543] postgresql-pre-start[716]: syncing data to disk ... ok machine # [ 10.289379] postgresql-pre-start[716]: initdb: warning: enabling "trust" authentication for local connections machine # [ 10.289989] postgresql-pre-start[716]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. machine # [ 10.291247] postgresql-pre-start[716]: Success. You can now start the database server using: machine # [ 10.292432] postgresql-pre-start[716]: pg_ctl -D /var/lib/postgresql/18 -l logfile start machine # [ 10.473331] postgres[757]: [757] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit machine # [ 10.477803] postgres[757]: [757] LOG: listening on IPv6 address "::1", port 5432 machine # [ 10.478870] postgres[757]: [757] LOG: listening on IPv4 address "127.0.0.1", port 5432 machine # [ 10.484820] postgres[757]: [757] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" machine # [ 10.497276] postgres[766]: [766] LOG: database system was shut down at 2026-09-21 13:21:30 GMT machine # [ 10.506254] postgres[757]: [757] LOG: database system is ready to accept connections machine # [ 10.512731] systemd[1]: Started PostgreSQL Server. machine # [ 10.517731] systemd[1]: Starting PostgreSQL Setup Scripts... machine # [ 10.658935] dhcpcd[681]: eth0: soliciting an IPv6 router machine # [ 10.661048] dhcpcd[681]: eth0: Router Advertisement from fe80::2 machine # [ 10.662509] dhcpcd[681]: eth0: adding address fec0::5054:ff:fe12:3456/64 machine # [ 10.664083] dhcpcd[681]: eth0: adding route to fec0::/64 machine # [ 10.665278] dhcpcd[681]: eth0: adding default route via fe80::2 machine # [ 10.797727] postgresql-setup-start[777]: CREATE DATABASE machine # [ 10.849460] postgresql-setup-start[782]: CREATE ROLE machine # [ 10.869471] postgresql-setup-start[784]: ALTER DATABASE machine # [ 10.877568] systemd[1]: Finished PostgreSQL Setup Scripts. machine # [ 10.878785] systemd[1]: Reached target PostgreSQL. machine # [ 14.180337] dhcpcd[681]: eth0: leased 10.0.2.15 for 86400 seconds machine # [ 14.182679] dhcpcd[681]: eth0: adding route to 10.0.2.0/24 machine # [ 14.184250] dhcpcd[681]: eth0: adding default route via 10.0.2.2 machine # [ 14.342077] systemd[1]: Started DHCP Client. machine # [ 14.344094] systemd[1]: Reached target Network is Online. machine # [ 14.347598] systemd[1]: Starting k3s service... machine # [ 14.445706] k3s[875]: time="2026-09-21T13:21:35Z" level=info msg="Acquiring lock file /var/lib/rancher/k3s/data/.lock" machine # [ 14.447280] k3s[875]: time="2026-09-21T13:21:35Z" level=info msg="Preparing data dir /var/lib/rancher/k3s/data/05fb32d1d5d79ab4bf8f805d07e4a7dfb491001fd5137b587aa471efd4746099" machine # [ 15.784849] rustfs-bucket-start[890]: mb s3://farm machine # [ 15.788339] systemd[1]: Finished rustfs-bucket.service. machine # [ 17.306832] k3s[875]: time="2026-09-21T13:21:37Z" level=info msg="Starting k3s 1.35.8+k3s1 (e952d68a)" machine # [ 17.322780] k3s[875]: time="2026-09-21T13:21:38Z" level=info msg="Configuring sqlite3 database connection pooling: maxIdle=20, maxOpen=0, maxLifetime=0s, maxIdleTime=2m0s" machine # [ 17.324370] k3s[875]: time="2026-09-21T13:21:38Z" level=info msg="Kine built with sqlite from github.com/mattn/go-sqlite3 version 3.53.3" machine # [ 17.325489] k3s[875]: time="2026-09-21T13:21:38Z" level=info msg="Configuring database table schema and indexes, this may take a moment..." machine # [ 17.346251] k3s[875]: time="2026-09-21T13:21:38Z" level=info msg="Database tables and indexes are up to date" machine # [ 17.348264] k3s[875]: time="2026-09-21T13:21:38Z" level=info msg="Running startup VACUUM to reclaim disk space, this may take a moment..." machine # [ 17.353746] k3s[875]: time="2026-09-21T13:21:38Z" level=info msg="Startup VACUUM completed successfully" machine # [ 17.357161] k3s[875]: time="2026-09-21T13:21:38Z" level=info msg="Kine available at unix://kine.sock" machine # [ 17.360365] k3s[875]: time="2026-09-21T13:21:38Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 17.364152] k3s[875]: time="2026-09-21T13:21:38Z" level=info msg="Datastore connection validated successfully, proceeding with bootstrap data generation" machine # [ 17.364895] k3s[875]: time="2026-09-21T13:21:38Z" level=info msg="generated self-signed CA certificate CN=k3s-client-ca@1789996898: notBefore=2026-09-21 12:21:38.051052716 +0000 UTC notAfter=2036-09-18 12:21:38.051052716 +0000 UTC" machine # [ 17.366108] k3s[875]: time="2026-09-21T13:21:38Z" level=info msg="certificate CN=system:admin,O=system:masters signed by CN=k3s-client-ca@1789996898: notBefore=2026-09-21 12:21:38 +0000 UTC notAfter=2027-09-21 12:21:38 +0000 UTC" machine # [ 17.366807] k3s[875]: time="2026-09-21T13:21:38Z" level=info msg="certificate CN=system:k3s-supervisor,O=system:masters signed by CN=k3s-client-ca@1789996898: notBefore=2026-09-21 12:21:38 +0000 UTC notAfter=2027-09-21 12:21:38 +0000 UTC" machine # [ 17.367986] k3s[875]: time="2026-09-21T13:21:38Z" level=info msg="certificate CN=system:kube-controller-manager signed by CN=k3s-client-ca@1789996898: notBefore=2026-09-21 12:21:38 +0000 UTC notAfter=2027-09-21 12:21:38 +0000 UTC" machine # [ 17.369137] k3s[875]: time="2026-09-21T13:21:38Z" level=info msg="certificate CN=system:kube-scheduler signed by CN=k3s-client-ca@1789996898: notBefore=2026-09-21 12:21:38 +0000 UTC notAfter=2027-09-21 12:21:38 +0000 UTC" machine # [ 17.369927] k3s[875]: time="2026-09-21T13:21:38Z" level=info msg="certificate CN=system:apiserver,O=system:masters signed by CN=k3s-client-ca@1789996898: notBefore=2026-09-21 12:21:38 +0000 UTC notAfter=2027-09-21 12:21:38 +0000 UTC" machine # [ 17.371082] k3s[875]: time="2026-09-21T13:21:38Z" level=info msg="certificate CN=k3s-cloud-controller-manager signed by CN=k3s-client-ca@1789996898: notBefore=2026-09-21 12:21:38 +0000 UTC notAfter=2027-09-21 12:21:38 +0000 UTC" machine # [ 17.371790] k3s[875]: time="2026-09-21T13:21:38Z" level=info msg="generated self-signed CA certificate CN=k3s-server-ca@1789996898: notBefore=2026-09-21 12:21:38.058660945 +0000 UTC notAfter=2036-09-18 12:21:38.058660945 +0000 UTC" machine # [ 17.373018] k3s[875]: time="2026-09-21T13:21:38Z" level=info msg="certificate CN=kube-apiserver signed by CN=k3s-server-ca@1789996898: notBefore=2026-09-21 12:21:38 +0000 UTC notAfter=2027-09-21 12:21:38 +0000 UTC" machine # [ 17.373730] k3s[875]: time="2026-09-21T13:21:38Z" level=info msg="certificate CN=kube-scheduler signed by CN=k3s-server-ca@1789996898: notBefore=2026-09-21 12:21:38 +0000 UTC notAfter=2027-09-21 12:21:38 +0000 UTC" machine # [ 17.374922] k3s[875]: time="2026-09-21T13:21:38Z" level=info msg="certificate CN=kube-controller-manager signed by CN=k3s-server-ca@1789996898: notBefore=2026-09-21 12:21:38 +0000 UTC notAfter=2027-09-21 12:21:38 +0000 UTC" machine # [ 17.376095] k3s[875]: time="2026-09-21T13:21:38Z" level=info msg="generated self-signed CA certificate CN=k3s-request-header-ca@1789996898: notBefore=2026-09-21 12:21:38.062574292 +0000 UTC notAfter=2036-09-18 12:21:38.062574292 +0000 UTC" machine # [ 17.376802] k3s[875]: time="2026-09-21T13:21:38Z" level=info msg="certificate CN=system:auth-proxy signed by CN=k3s-request-header-ca@1789996898: notBefore=2026-09-21 12:21:38 +0000 UTC notAfter=2027-09-21 12:21:38 +0000 UTC" machine # [ 17.377980] k3s[875]: time="2026-09-21T13:21:38Z" level=info msg="generated self-signed CA certificate CN=etcd-server-ca@1789996898: notBefore=2026-09-21 12:21:38.064282051 +0000 UTC notAfter=2036-09-18 12:21:38.064282051 +0000 UTC" machine # [ 17.379155] k3s[875]: time="2026-09-21T13:21:38Z" level=info msg="certificate CN=etcd-client signed by CN=etcd-server-ca@1789996898: notBefore=2026-09-21 12:21:38 +0000 UTC notAfter=2027-09-21 12:21:38 +0000 UTC" machine # [ 17.379913] k3s[875]: time="2026-09-21T13:21:38Z" level=info msg="generated self-signed CA certificate CN=etcd-peer-ca@1789996898: notBefore=2026-09-21 12:21:38.066779296 +0000 UTC notAfter=2036-09-18 12:21:38.066779296 +0000 UTC" machine # [ 17.380845] k3s[875]: time="2026-09-21T13:21:38Z" level=info msg="certificate CN=etcd-peer signed by CN=etcd-peer-ca@1789996898: notBefore=2026-09-21 12:21:38 +0000 UTC notAfter=2027-09-21 12:21:38 +0000 UTC" machine # [ 17.381858] k3s[875]: time="2026-09-21T13:21:38Z" level=info msg="certificate CN=etcd-server signed by CN=etcd-server-ca@1789996898: notBefore=2026-09-21 12:21:38 +0000 UTC notAfter=2027-09-21 12:21:38 +0000 UTC" machine # [ 17.462444] k3s[875]: time="2026-09-21T13:21:38Z" level=info msg="certificate CN=k3s,O=k3s signed by CN=k3s-server-ca@1789996898: notBefore=2026-09-21 12:21:38 +0000 UTC notAfter=2027-09-21 12:21:38 +0000 UTC" machine # [ 17.463159] k3s[875]: time="2026-09-21T13:21:38Z" level=warning msg="dynamiclistener [::]:6443: no cached certificate available for preload - deferring certificate load until storage initialization or first client request" machine # [ 17.473939] k3s[875]: time="2026-09-21T13:21:38Z" level=info msg="Active TLS secret / (ver=) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__ee77_2868_a29c_5b07-01e60d:fec0::ee77:2868:a29c:5b07 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=ACA016C606EE921F482BA2377EC1369FBB948849]" machine # [ 18.541264] k3s[875]: time="2026-09-21T13:21:39Z" level=info msg="Password verified locally for node machine" machine # [ 18.543786] k3s[875]: time="2026-09-21T13:21:39Z" level=info msg="certificate CN=machine signed by CN=k3s-server-ca@1789996898: notBefore=2026-09-21 12:21:39 +0000 UTC notAfter=2027-09-21 12:21:39 +0000 UTC" machine # [ 18.829672] k3s[875]: time="2026-09-21T13:21:39Z" level=info msg="certificate CN=system:node:machine,O=system:nodes signed by CN=k3s-client-ca@1789996898: notBefore=2026-09-21 12:21:39 +0000 UTC notAfter=2027-09-21 12:21:39 +0000 UTC" machine # [ 18.933128] k3s[875]: time="2026-09-21T13:21:39Z" level=info msg="certificate CN=system:kube-proxy signed by CN=k3s-client-ca@1789996898: notBefore=2026-09-21 12:21:39 +0000 UTC notAfter=2027-09-21 12:21:39 +0000 UTC" machine # [ 19.039204] k3s[875]: time="2026-09-21T13:21:39Z" level=info msg="certificate CN=system:k3s-controller signed by CN=k3s-client-ca@1789996898: notBefore=2026-09-21 12:21:39 +0000 UTC notAfter=2027-09-21 12:21:39 +0000 UTC" machine # [ 19.150509] k3s[875]: time="2026-09-21T13:21:39Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:54844: runtime core not ready" machine # [ 19.255703] k3s[875]: time="2026-09-21T13:21:39Z" level=info msg="Module overlay was already loaded" machine # [ 19.487672] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. machine # [ 19.493023] Bridge firewalling registered machine # [ 19.351338] k3s[875]: time="2026-09-21T13:21:40Z" level=warning msg="Failed to load kernel module iptable_nat with modprobe" machine # [ 19.360398] k3s[875]: time="2026-09-21T13:21:40Z" level=warning msg="Failed to load kernel module iptable_filter with modprobe" machine # [ 19.370919] k3s[875]: time="2026-09-21T13:21:40Z" level=warning msg="Failed to load kernel module nft-expr-counter with modprobe" machine # [ 19.445559] k3s[875]: time="2026-09-21T13:21:40Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400" machine # [ 19.447250] k3s[875]: time="2026-09-21T13:21:40Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600" machine # [ 19.447909] k3s[875]: time="2026-09-21T13:21:40Z" level=info msg="Set sysctl 'net/ipv4/conf/all/forwarding' to 1" machine # [ 19.449563] k3s[875]: time="2026-09-21T13:21:40Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_max' to 131072" machine # [ 19.450321] k3s[875]: time="2026-09-21T13:21:40Z" level=info msg="Creating k3s-cert-monitor event broadcaster" machine # [ 19.451449] k3s[875]: time="2026-09-21T13:21:40Z" level=info msg="Connecting to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 19.453075] k3s[875]: time="2026-09-21T13:21:40Z" level=info msg="Saving cluster bootstrap data to datastore" machine # [ 19.454069] k3s[875]: time="2026-09-21T13:21:40Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 19.454907] k3s[875]: time="2026-09-21T13:21:40Z" level=info msg="Connection to etcd is ready" machine # [ 19.456221] k3s[875]: time="2026-09-21T13:21:40Z" level=info msg="ETCD server is now running" machine # [ 19.457212] k3s[875]: time="2026-09-21T13:21:40Z" level=info msg="Handling backend connection request [machine]" machine # [ 19.458216] k3s[875]: time="2026-09-21T13:21:40Z" level=info msg="Connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 19.459206] k3s[875]: time="2026-09-21T13:21:40Z" level=info msg="Remotedialer connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 19.460231] k3s[875]: time="2026-09-21T13:21:40Z" level=info msg="Running kube-apiserver --advertise-port=6443 --allow-privileged=true --anonymous-auth=false --api-audiences=https://kubernetes.default.svc.cluster.local,k3s --authorization-mode=Node,RBAC --bind-address=127.0.0.1 --cert-dir=/var/lib/rancher/k3s/server/tls/temporary-certs --client-ca-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --egress-selector-config-file=/var/lib/rancher/k3s/server/etc/egress-selector-config.yaml --enable-admission-plugins=NodeRestriction --enable-aggregator-routing=true --enable-bootstrap-token-auth=true --etcd-servers=unix://kine.sock --kubelet-certificate-authority=/var/lib/rancher/k3s/server/tls/server-ca.crt --kubelet-client-certificate=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.crt --kubelet-client-key=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.key --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --profiling=false --proxy-client-cert-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt --proxy-client-key-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.key --requestheader-allowed-names=system:auth-proxy --requestheader-client-ca-file=/var/lib/rancher/k3s/server/tls/request-header-ca.crt --requestheader-extra-headers-prefix=X-Remote-Extra- --requestheader-group-headers=X-Remote-Group --requestheader-username-headers=X-Remote-User --secure-port=6444 --service-account-issuer=https://kubernetes.default.svc.cluster.local --service-account-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-account-signing-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --storage-backend=etcd3 --tls-cert-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --tls-private-key-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 19.461819] k3s[875]: time="2026-09-21T13:21:40Z" level=info msg="Running kube-scheduler --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --bind-address=127.0.0.1 --kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --leader-elect=false --profiling=false --secure-port=10259 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 19.462710] k3s[875]: time="2026-09-21T13:21:40Z" level=info msg="Running kube-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --bind-address=127.0.0.1 --cluster-cidr=10.42.0.0/16 --cluster-signing-kube-apiserver-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kube-apiserver-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kubelet-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-serving-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-kubelet-serving-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --cluster-signing-legacy-unknown-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-legacy-unknown-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --configure-cloud-routes=false --controllers=*,tokencleaner,-service,-route,-cloud-node-lifecycle --kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --leader-elect=false --profiling=false --root-ca-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --secure-port=10257 --service-account-private-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key --use-service-account-credentials=true" machine # [ 19.507838] k3s[875]: time="2026-09-21T13:21:40Z" level=info msg="Polling for API server readiness: GET /readyz failed: the server is currently unable to handle the request" machine # [ 19.508560] k3s[875]: time="2026-09-21T13:21:40Z" level=info msg="Running cloud-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --bind-address=127.0.0.1 --cloud-config=/var/lib/rancher/k3s/server/etc/cloud-config.yaml --cloud-provider=k3s --cluster-cidr=10.42.0.0/16 --configure-cloud-routes=false --controllers=*,-route --kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --leader-elect=false --leader-elect-resource-name=k3s-cloud-controller-manager --node-status-update-frequency=1m0s --profiling=false" machine # [ 19.509428] k3s[875]: time="2026-09-21T13:21:40Z" level=info msg="Server node token is available at /var/lib/rancher/k3s/server/token" machine # [ 19.509940] k3s[875]: time="2026-09-21T13:21:40Z" level=info msg="To join server node to cluster: k3s server -s https://10.0.2.15:6443 -t ${SERVER_NODE_TOKEN}" machine # [ 19.510599] k3s[875]: time="2026-09-21T13:21:40Z" level=info msg="Agent node token is available at /var/lib/rancher/k3s/server/agent-token" machine # [ 19.511139] k3s[875]: time="2026-09-21T13:21:40Z" level=info msg="To join agent node to cluster: k3s agent -s https://10.0.2.15:6443 -t ${AGENT_NODE_TOKEN}" machine # [ 19.511637] k3s[875]: time="2026-09-21T13:21:40Z" level=info msg="Wrote kubeconfig /etc/rancher/k3s/k3s.yaml" machine # [ 19.512148] k3s[875]: time="2026-09-21T13:21:40Z" level=info msg="Run: k3s kubectl" machine # [ 19.512614] k3s[875]: I0921 13:21:40.151721 875 options.go:263] external host was not specified, using 10.0.2.15 machine # [ 19.513171] k3s[875]: time="2026-09-21T13:21:40Z" level=info msg="Logging containerd to /var/lib/rancher/k3s/agent/containerd/containerd.log" machine # [ 19.513647] k3s[875]: time="2026-09-21T13:21:40Z" level=info msg="Running containerd -c /var/lib/rancher/k3s/agent/etc/containerd/config.toml" machine # [ 19.514204] k3s[875]: I0921 13:21:40.155170 875 server.go:158] Version: v1.35.8+k3s1 machine # [ 19.514710] k3s[875]: I0921 13:21:40.155198 875 server.go:160] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 19.551618] k3s[875]: time="2026-09-21T13:21:40Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:54908: runtime core not ready" machine # [ 19.563828] k3s[875]: I0921 13:21:40.251582 875 shared_informer.go:349] "Waiting for caches to sync" controller="node_authorizer" machine # [ 19.569800] k3s[875]: I0921 13:21:40.257565 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 19.573061] k3s[875]: I0921 13:21:40.260645 875 plugins.go:157] Loaded 14 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,PodTopologyLabels,MutatingAdmissionPolicy,MutatingAdmissionWebhook. machine # [ 19.573516] k3s[875]: I0921 13:21:40.260689 875 plugins.go:160] Loaded 14 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,NodeDeclaredFeatureValidator,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. machine # [ 19.574075] k3s[875]: I0921 13:21:40.261152 875 instance.go:240] Using reconciler: lease machine # [ 19.583063] k3s[875]: I0921 13:21:40.270254 875 handler.go:304] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager machine # [ 19.583693] k3s[875]: W0921 13:21:40.270282 875 genericapiserver.go:787] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. machine # [ 19.585055] k3s[875]: I0921 13:21:40.272576 875 cidrallocator.go:198] starting ServiceCIDR Allocator Controller machine # [ 19.632932] k3s[875]: I0921 13:21:40.320670 875 handler.go:304] Adding GroupVersion v1 to ResourceManager machine # [ 19.633652] k3s[875]: I0921 13:21:40.320905 875 apis.go:112] API group "internal.apiserver.k8s.io" is not enabled, skipping. machine # [ 19.658869] k3s[875]: time="2026-09-21T13:21:40Z" level=info msg="Running kube-proxy --cluster-cidr=10.42.0.0/16 --conntrack-max-per-core=0 --conntrack-tcp-timeout-close-wait=0s --conntrack-tcp-timeout-established=0s --healthz-bind-address=127.0.0.1 --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubeproxy.kubeconfig --proxy-mode=iptables" machine # [ 19.666351] k3s[875]: I0921 13:21:40.354136 875 apis.go:112] API group "storagemigration.k8s.io" is not enabled, skipping. machine # [ 19.694478] k3s[875]: I0921 13:21:40.382229 875 handler.go:304] Adding GroupVersion authentication.k8s.io v1 to ResourceManager machine # [ 19.695057] k3s[875]: W0921 13:21:40.382260 875 genericapiserver.go:787] Skipping API authentication.k8s.io/v1beta1 because it has no resources. machine # [ 19.695511] k3s[875]: W0921 13:21:40.382272 875 genericapiserver.go:787] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. machine # [ 19.696199] k3s[875]: I0921 13:21:40.382544 875 handler.go:304] Adding GroupVersion authorization.k8s.io v1 to ResourceManager machine # [ 19.697074] k3s[875]: W0921 13:21:40.382559 875 genericapiserver.go:787] Skipping API authorization.k8s.io/v1beta1 because it has no resources. machine # [ 19.697858] k3s[875]: I0921 13:21:40.383142 875 handler.go:304] Adding GroupVersion autoscaling v2 to ResourceManager machine # [ 19.698651] k3s[875]: I0921 13:21:40.383590 875 handler.go:304] Adding GroupVersion autoscaling v1 to ResourceManager machine # [ 19.699648] k3s[875]: W0921 13:21:40.383606 875 genericapiserver.go:787] Skipping API autoscaling/v2beta1 because it has no resources. machine # [ 19.700617] k3s[875]: W0921 13:21:40.383633 875 genericapiserver.go:787] Skipping API autoscaling/v2beta2 because it has no resources. machine # [ 19.708778] k3s[875]: I0921 13:21:40.396559 875 handler.go:304] Adding GroupVersion batch v1 to ResourceManager machine # [ 19.709403] k3s[875]: W0921 13:21:40.396601 875 genericapiserver.go:787] Skipping API batch/v1beta1 because it has no resources. machine # [ 19.709969] k3s[875]: I0921 13:21:40.397332 875 handler.go:304] Adding GroupVersion certificates.k8s.io v1 to ResourceManager machine # [ 19.710548] k3s[875]: W0921 13:21:40.397351 875 genericapiserver.go:787] Skipping API certificates.k8s.io/v1beta1 because it has no resources. machine # [ 19.711160] k3s[875]: W0921 13:21:40.397362 875 genericapiserver.go:787] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. machine # [ 19.711952] k3s[875]: I0921 13:21:40.397643 875 handler.go:304] Adding GroupVersion coordination.k8s.io v1 to ResourceManager machine # [ 19.712741] k3s[875]: W0921 13:21:40.397656 875 genericapiserver.go:787] Skipping API coordination.k8s.io/v1beta1 because it has no resources. machine # [ 19.713583] k3s[875]: W0921 13:21:40.397665 875 genericapiserver.go:787] Skipping API coordination.k8s.io/v1alpha2 because it has no resources. machine # [ 19.714664] k3s[875]: I0921 13:21:40.398009 875 handler.go:304] Adding GroupVersion discovery.k8s.io v1 to ResourceManager machine # [ 19.715433] k3s[875]: W0921 13:21:40.398025 875 genericapiserver.go:787] Skipping API discovery.k8s.io/v1beta1 because it has no resources. machine # [ 19.716417] k3s[875]: I0921 13:21:40.399407 875 handler.go:304] Adding GroupVersion networking.k8s.io v1 to ResourceManager machine # [ 19.717235] k3s[875]: W0921 13:21:40.399425 875 genericapiserver.go:787] Skipping API networking.k8s.io/v1beta1 because it has no resources. machine # [ 19.718134] k3s[875]: I0921 13:21:40.399752 875 handler.go:304] Adding GroupVersion node.k8s.io v1 to ResourceManager machine # [ 19.719063] k3s[875]: W0921 13:21:40.399767 875 genericapiserver.go:787] Skipping API node.k8s.io/v1beta1 because it has no resources. machine # [ 19.719778] k3s[875]: W0921 13:21:40.399778 875 genericapiserver.go:787] Skipping API node.k8s.io/v1alpha1 because it has no resources. machine # [ 19.720803] k3s[875]: I0921 13:21:40.400203 875 handler.go:304] Adding GroupVersion policy v1 to ResourceManager machine # [ 19.721704] k3s[875]: W0921 13:21:40.400219 875 genericapiserver.go:787] Skipping API policy/v1beta1 because it has no resources. machine # [ 19.723853] k3s[875]: I0921 13:21:40.401140 875 handler.go:304] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager machine # [ 19.724654] k3s[875]: W0921 13:21:40.401157 875 genericapiserver.go:787] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. machine # [ 19.725617] k3s[875]: W0921 13:21:40.401169 875 genericapiserver.go:787] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. machine # [ 19.726574] k3s[875]: I0921 13:21:40.401382 875 handler.go:304] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager machine # [ 19.727590] k3s[875]: W0921 13:21:40.401394 875 genericapiserver.go:787] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. machine # [ 19.728589] k3s[875]: W0921 13:21:40.401404 875 genericapiserver.go:787] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. machine # [ 19.729643] k3s[875]: I0921 13:21:40.402618 875 handler.go:304] Adding GroupVersion storage.k8s.io v1 to ResourceManager machine # [ 19.730599] k3s[875]: W0921 13:21:40.402638 875 genericapiserver.go:787] Skipping API storage.k8s.io/v1beta1 because it has no resources. machine # [ 19.731116] k3s[875]: W0921 13:21:40.402649 875 genericapiserver.go:787] Skipping API storage.k8s.io/v1alpha1 because it has no resources. machine # [ 19.731952] k3s[875]: I0921 13:21:40.403212 875 handler.go:304] Adding GroupVersion flowcontrol.apiserver.k8s.io v1 to ResourceManager machine # [ 19.732781] k3s[875]: W0921 13:21:40.403229 875 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta3 because it has no resources. machine # [ 19.733613] k3s[875]: W0921 13:21:40.403239 875 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta2 because it has no resources. machine # [ 19.734580] k3s[875]: W0921 13:21:40.403248 875 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. machine # [ 19.735433] k3s[875]: I0921 13:21:40.404996 875 handler.go:304] Adding GroupVersion apps v1 to ResourceManager machine # [ 19.736139] k3s[875]: W0921 13:21:40.405014 875 genericapiserver.go:787] Skipping API apps/v1beta2 because it has no resources. machine # [ 19.736743] k3s[875]: W0921 13:21:40.405024 875 genericapiserver.go:787] Skipping API apps/v1beta1 because it has no resources. machine # [ 19.737497] k3s[875]: I0921 13:21:40.405999 875 handler.go:304] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager machine # [ 19.738211] k3s[875]: W0921 13:21:40.406016 875 genericapiserver.go:787] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. machine # [ 19.738647] k3s[875]: W0921 13:21:40.406026 875 genericapiserver.go:787] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. machine # [ 19.739195] k3s[875]: I0921 13:21:40.406321 875 handler.go:304] Adding GroupVersion events.k8s.io v1 to ResourceManager machine # [ 19.739670] k3s[875]: W0921 13:21:40.406335 875 genericapiserver.go:787] Skipping API events.k8s.io/v1beta1 because it has no resources. machine # [ 19.740245] k3s[875]: I0921 13:21:40.407223 875 handler.go:304] Adding GroupVersion resource.k8s.io v1 to ResourceManager machine # [ 19.740701] k3s[875]: W0921 13:21:40.407240 875 genericapiserver.go:787] Skipping API resource.k8s.io/v1beta2 because it has no resources. machine # [ 19.741408] k3s[875]: W0921 13:21:40.407255 875 genericapiserver.go:787] Skipping API resource.k8s.io/v1beta1 because it has no resources. machine # [ 19.741906] k3s[875]: W0921 13:21:40.407265 875 genericapiserver.go:787] Skipping API resource.k8s.io/v1alpha3 because it has no resources. machine # [ 19.742515] k3s[875]: I0921 13:21:40.410241 875 handler.go:304] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager machine # [ 19.743063] k3s[875]: W0921 13:21:40.410257 875 genericapiserver.go:787] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. machine # [ 20.082904] k3s[875]: I0921 13:21:40.770209 875 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 20.083700] k3s[875]: I0921 13:21:40.770221 875 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 20.084477] k3s[875]: I0921 13:21:40.770304 875 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 20.084814] k3s[875]: I0921 13:21:40.770501 875 secure_serving.go:211] Serving securely on 127.0.0.1:6444 machine # [ 20.090553] k3s[875]: I0921 13:21:40.770538 875 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 20.091272] k3s[875]: I0921 13:21:40.770733 875 system_namespaces_controller.go:66] Starting system namespaces controller machine # [ 20.091724] k3s[875]: I0921 13:21:40.770747 875 controller.go:113] "Deleting old lease on startup" lease="kube-system/apiserver-ik4pcwfs7qgdl76byc4pomgvia" machine # [ 20.092549] k3s[875]: I0921 13:21:40.771016 875 cluster_authentication_trust_controller.go:459] Starting cluster_authentication_trust_controller controller machine # [ 20.093139] k3s[875]: time="2026-09-21T13:21:40Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 20.093561] k3s[875]: I0921 13:21:40.771106 875 apf_controller.go:377] Starting API Priority and Fairness config controller machine # [ 20.094443] k3s[875]: I0921 13:21:40.771400 875 customresource_discovery_controller.go:294] Starting DiscoveryController machine # [ 20.094983] k3s[875]: I0921 13:21:40.771459 875 controller.go:78] Starting OpenAPI AggregationController machine # [ 20.095642] k3s[875]: I0921 13:21:40.778330 875 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 20.096164] k3s[875]: I0921 13:21:40.778405 875 nonstructuralschema_controller.go:202] Starting NonStructuralSchemaConditionController machine # [ 20.096602] k3s[875]: I0921 13:21:40.778466 875 apiapproval_controller.go:196] Starting KubernetesAPIApprovalPolicyConformantConditionController machine # [ 20.097135] k3s[875]: I0921 13:21:40.778497 875 crd_finalizer.go:273] Starting CRDFinalizer machine # [ 20.097594] k3s[875]: I0921 13:21:40.778623 875 repairip.go:210] Starting ipallocator-repair-controller machine # [ 20.098154] k3s[875]: I0921 13:21:40.778636 875 shared_informer.go:349] "Waiting for caches to sync" controller="ipallocator-repair-controller" machine # [ 20.098654] k3s[875]: time="2026-09-21T13:21:40Z" level=info msg="Starting apiserver lease garbage collector" logger=k3s machine # [ 20.098808] k3s[875]: time="2026-09-21T13:21:40Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 20.099489] k3s[875]: I0921 13:21:40.779005 875 default_servicecidr_controller.go:110] Starting kubernetes-service-cidr-controller machine # [ 20.100023] k3s[875]: I0921 13:21:40.779027 875 shared_informer.go:349] "Waiting for caches to sync" controller="kubernetes-service-cidr-controller" machine # [ 20.100564] k3s[875]: I0921 13:21:40.786169 875 controller.go:142] Starting OpenAPI controller machine # [ 20.101200] k3s[875]: I0921 13:21:40.789000 875 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 20.101852] k3s[875]: I0921 13:21:40.789663 875 controller.go:90] Starting OpenAPI V3 controller machine # [ 20.102545] k3s[875]: I0921 13:21:40.790362 875 naming_controller.go:305] Starting NamingConditionController machine # [ 20.111479] k3s[875]: I0921 13:21:40.799268 875 dynamic_serving_content.go:135] "Starting controller" name="aggregator-proxy-cert::/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt::/var/lib/rancher/k3s/server/tls/client-auth-proxy.key" machine # [ 20.112600] k3s[875]: I0921 13:21:40.800414 875 local_available_controller.go:156] Starting LocalAvailability controller machine # [ 20.113212] k3s[875]: I0921 13:21:40.801029 875 cache.go:32] Waiting for caches to sync for LocalAvailability controller machine # [ 20.113704] k3s[875]: I0921 13:21:40.801523 875 remote_available_controller.go:425] Starting RemoteAvailability controller machine # [ 20.113856] k3s[875]: I0921 13:21:40.801678 875 cache.go:32] Waiting for caches to sync for RemoteAvailability controller machine # [ 20.114606] k3s[875]: I0921 13:21:40.802423 875 apiservice_controller.go:100] Starting APIServiceRegistrationController machine # [ 20.117060] k3s[875]: I0921 13:21:40.803180 875 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller machine # [ 20.117732] k3s[875]: I0921 13:21:40.803234 875 aggregator.go:185] waiting for initial CRD sync... machine # [ 20.118421] k3s[875]: I0921 13:21:40.803258 875 controller.go:80] Starting OpenAPI V3 AggregationController machine # [ 20.118941] k3s[875]: time="2026-09-21T13:21:40Z" level=info msg="Starting legacy_token_tracking_controller" logger=k3s machine # [ 20.119589] k3s[875]: time="2026-09-21T13:21:40Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 20.120134] k3s[875]: I0921 13:21:40.804658 875 crdregistration_controller.go:114] Starting crd-autoregister controller machine # [ 20.120579] k3s[875]: I0921 13:21:40.804674 875 shared_informer.go:349] "Waiting for caches to sync" controller="crd-autoregister" machine # [ 20.184273] k3s[875]: time="2026-09-21T13:21:40Z" level=info msg="Caches are synced" logger=k3s machine # [ 20.384572] k3s[875]: I0921 13:21:41.072069 875 apf_controller.go:382] Running API Priority and Fairness config worker machine # [ 20.386325] k3s[875]: I0921 13:21:41.072125 875 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process machine # [ 20.392463] k3s[875]: I0921 13:21:41.079397 875 shared_informer.go:356] "Caches are synced" controller="kubernetes-service-cidr-controller" machine # [ 20.393943] k3s[875]: I0921 13:21:41.079483 875 default_servicecidr_controller.go:169] Creating default ServiceCIDR with CIDRs: [10.43.0.0/16] machine # [ 20.395490] k3s[875]: time="2026-09-21T13:21:41Z" level=info msg="Caches are synced" logger=k3s machine # [ 20.397095] k3s[875]: I0921 13:21:41.079571 875 shared_informer.go:356] "Caches are synced" controller="ipallocator-repair-controller" machine # [ 20.415261] k3s[875]: I0921 13:21:41.102763 875 cache.go:39] Caches are synced for RemoteAvailability controller machine # [ 20.417171] k3s[875]: I0921 13:21:41.102911 875 cache.go:39] Caches are synced for LocalAvailability controller machine # [ 20.421765] k3s[875]: I0921 13:21:41.109398 875 shared_informer.go:356] "Caches are synced" controller="crd-autoregister" machine # [ 20.423821] k3s[875]: I0921 13:21:41.109579 875 cache.go:39] Caches are synced for APIServiceRegistrationController controller machine # [ 20.424467] k3s[875]: I0921 13:21:41.109764 875 handler_discovery.go:451] Starting ResourceDiscoveryManager machine # [ 20.426047] k3s[875]: time="2026-09-21T13:21:41Z" level=info msg="Caches are synced" logger=k3s machine # [ 20.428001] k3s[875]: I0921 13:21:41.110310 875 aggregator.go:187] initial CRD sync complete... machine # [ 20.429230] k3s[875]: I0921 13:21:41.110357 875 autoregister_controller.go:144] Starting autoregister controller machine # [ 20.430400] k3s[875]: I0921 13:21:41.110389 875 cache.go:32] Waiting for caches to sync for autoregister controller machine # [ 20.431982] k3s[875]: I0921 13:21:41.110417 875 cache.go:39] Caches are synced for autoregister controller machine # [ 20.464593] k3s[875]: I0921 13:21:41.152240 875 shared_informer.go:356] "Caches are synced" controller="node_authorizer" machine # [ 20.471077] k3s[875]: I0921 13:21:41.158721 875 shared_informer.go:377] "Caches are synced" machine # [ 20.472524] k3s[875]: I0921 13:21:41.158840 875 policy_source.go:248] refreshing policies machine # [ 20.484811] k3s[875]: time="2026-09-21T13:21:41Z" level=error msg="Error while syncing ConfigMap" configmap=kube-system/kube-apiserver-legacy-service-account-token-tracking error="namespaces \"kube-system\" not found" logger=k3s/UnhandledError machine # [ 20.493125] k3s[875]: E0921 13:21:41.173773 875 controller.go:95] Unable to perform initial Kubernetes service initialization: namespaces "default" not found machine # [ 20.494994] k3s[875]: time="2026-09-21T13:21:41Z" level=info msg="containerd is now running" machine # [ 20.499395] k3s[875]: I0921 13:21:41.179486 875 controller.go:667] quota admission added evaluator for: namespaces machine # [ 20.505520] k3s[875]: I0921 13:21:41.193187 875 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io machine # [ 20.513435] k3s[875]: I0921 13:21:41.201152 875 default_servicecidr_controller.go:231] Setting default ServiceCIDR condition Ready to True machine # [ 20.516680] k3s[875]: I0921 13:21:41.204191 875 cidrallocator.go:302] created ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 20.518803] k3s[875]: time="2026-09-21T13:21:41Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/k3s-airgap-images-amd64.tar.zst" machine # [ 20.526349] k3s[875]: I0921 13:21:41.214057 875 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 21.123094] k3s[875]: I0921 13:21:41.810431 875 storage_scheduling.go:123] created PriorityClass system-node-critical with value 2000001000 machine # [ 21.129278] k3s[875]: I0921 13:21:41.816917 875 storage_scheduling.go:123] created PriorityClass system-cluster-critical with value 2000000000 machine # [ 21.130142] k3s[875]: I0921 13:21:41.816976 875 storage_scheduling.go:139] all system priority classes are created successfully or already exist. machine # [ 21.451511] k3s[875]: time="2026-09-21T13:21:42Z" level=info msg="Polling for API server readiness: GET /readyz failed: unknown" machine # [ 21.933935] k3s[875]: I0921 13:21:42.621607 875 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io machine # [ 21.979260] k3s[875]: I0921 13:21:42.667004 875 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io machine # [ 22.096485] k3s[875]: I0921 13:21:42.784171 875 alloc.go:329] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.43.0.1"} machine # [ 22.105108] k3s[875]: W0921 13:21:42.792811 875 lease.go:265] Resetting endpoints for master service "kubernetes" to [10.0.2.15] machine # [ 22.108443] k3s[875]: I0921 13:21:42.796170 875 controller.go:667] quota admission added evaluator for: endpoints machine # [ 22.114638] k3s[875]: I0921 13:21:42.802418 875 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io machine # [ 23.463813] k3s[875]: time="2026-09-21T13:21:44Z" level=info msg="Waiting for untainted node" machine # [ 23.467183] k3s[875]: time="2026-09-21T13:21:44Z" level=info msg="Kube API server is now running" machine # [ 23.470359] k3s[875]: time="2026-09-21T13:21:44Z" level=info msg="k3s is up and running" machine # [ 23.477839] systemd[1]: Started k3s service. machine # [ 23.479596] k3s[875]: time="2026-09-21T13:21:44Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Node and Certificate Authority certificates managed by k3s are OK" object=machine reason=CertificateExpirationOK type=Normal machine # [ 23.491388] k3s[875]: time="2026-09-21T13:21:44Z" level=info msg="Creating k3s-supervisor event broadcaster" machine # [ 23.493990] systemd[1]: Starting niks3 server... machine # [ 23.495434] k3s[875]: I0921 13:21:44.183100 875 controllermanager.go:189] "Starting" version="v1.35.8+k3s1" machine # [ 23.497981] k3s[875]: I0921 13:21:44.183125 875 controllermanager.go:191] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 23.501068] k3s[875]: I0921 13:21:44.187463 875 secure_serving.go:211] Serving securely on 127.0.0.1:10257 machine # [ 23.503592] k3s[875]: I0921 13:21:44.188349 875 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 23.506498] k3s[875]: I0921 13:21:44.188443 875 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key" machine # [ 23.510665] k3s[875]: I0921 13:21:44.188541 875 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 23.512108] k3s[875]: I0921 13:21:44.188733 875 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 23.514306] k3s[875]: I0921 13:21:44.188766 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 23.515628] k3s[875]: I0921 13:21:44.190296 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 23.516932] k3s[875]: I0921 13:21:44.190358 875 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 23.519255] k3s[875]: I0921 13:21:44.190384 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 23.529189] k3s[875]: I0921 13:21:44.216964 875 controller.go:667] quota admission added evaluator for: serviceaccounts machine # [ 23.564125] k3s[875]: I0921 13:21:44.250897 875 node_lifecycle_controller.go:419] "Controller will reconcile labels" logger="node-lifecycle-controller" machine # [ 23.577967] k3s[875]: time="2026-09-21T13:21:44Z" level=info msg="Creating embedded CRD addons.k3s.cattle.io" machine # [ 23.584459] k3s[875]: I0921 13:21:44.272226 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 23.585367] k3s[875]: time="2026-09-21T13:21:44Z" level=info msg="Creating embedded CRD etcdsnapshotfiles.k3s.cattle.io" machine # [ 23.594405] k3s[875]: time="2026-09-21T13:21:44Z" level=info msg="Creating embedded CRD helmcharts.helm.cattle.io" machine # [ 23.602187] k3s[875]: I0921 13:21:44.289967 875 shared_informer.go:377] "Caches are synced" machine # [ 23.606233] k3s[875]: I0921 13:21:44.293246 875 shared_informer.go:377] "Caches are synced" machine # [ 23.607084] k3s[875]: I0921 13:21:44.294194 875 shared_informer.go:377] "Caches are synced" machine # [ 23.611063] k3s[875]: time="2026-09-21T13:21:44Z" level=info msg="Creating embedded CRD helmchartconfigs.helm.cattle.io" machine # [ 23.615484] k3s[875]: I0921 13:21:44.303138 875 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 23.622385] k3s[875]: I0921 13:21:44.310167 875 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 23.627681] k3s[875]: time="2026-09-21T13:21:44Z" level=info msg="Waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 23.649108] k3s[875]: I0921 13:21:44.336892 875 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 23.652499] k3s[875]: I0921 13:21:44.340302 875 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 23.661305] k3s[875]: I0921 13:21:44.349084 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="jobs.batch" machine # [ 23.661993] k3s[875]: I0921 13:21:44.349156 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="cronjobs.batch" machine # [ 23.662459] k3s[875]: I0921 13:21:44.349207 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="networkpolicies.networking.k8s.io" machine # [ 23.663030] k3s[875]: I0921 13:21:44.349309 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="deployments.apps" machine # [ 23.663506] k3s[875]: I0921 13:21:44.349340 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpointslices.discovery.k8s.io" machine # [ 23.664267] k3s[875]: I0921 13:21:44.349393 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="statefulsets.apps" machine # [ 23.664981] k3s[875]: I0921 13:21:44.349430 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="ingresses.networking.k8s.io" machine # [ 23.665877] k3s[875]: I0921 13:21:44.349483 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="csistoragecapacities.storage.k8s.io" machine # [ 23.666749] k3s[875]: I0921 13:21:44.349548 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmcharts.helm.cattle.io" machine # [ 23.666826] k3s[875]: I0921 13:21:44.349594 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="resourceclaimtemplates.resource.k8s.io" machine # [ 23.667840] k3s[875]: I0921 13:21:44.349625 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="poddisruptionbudgets.policy" machine # [ 23.668603] k3s[875]: I0921 13:21:44.349667 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpoints" machine # [ 23.669901] k3s[875]: I0921 13:21:44.349717 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="limitranges" machine # [ 23.670760] k3s[875]: I0921 13:21:44.349755 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="horizontalpodautoscalers.autoscaling" machine # [ 23.672107] k3s[875]: I0921 13:21:44.349784 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="roles.rbac.authorization.k8s.io" machine # [ 23.672983] k3s[875]: I0921 13:21:44.349814 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="leases.coordination.k8s.io" machine # [ 23.673648] k3s[875]: I0921 13:21:44.349873 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="podtemplates" machine # [ 23.674164] k3s[875]: I0921 13:21:44.349922 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="daemonsets.apps" machine # [ 23.674982] k3s[875]: I0921 13:21:44.349985 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="rolebindings.rbac.authorization.k8s.io" machine # [ 23.675645] k3s[875]: I0921 13:21:44.350016 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmchartconfigs.helm.cattle.io" machine # [ 23.675817] k3s[875]: I0921 13:21:44.350052 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="addons.k3s.cattle.io" machine # [ 23.676506] k3s[875]: I0921 13:21:44.350110 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="serviceaccounts" machine # [ 23.677058] k3s[875]: I0921 13:21:44.350139 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="controllerrevisions.apps" machine # [ 23.677538] k3s[875]: I0921 13:21:44.350167 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="replicasets.apps" machine # [ 23.678117] k3s[875]: I0921 13:21:44.361376 875 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="podcertificaterequest-cleaner-controller" requiredFeatureGates=["PodCertificateRequest"] machine # [ 23.678617] k3s[875]: I0921 13:21:44.361419 875 controllermanager.go:579] "Warning: skipping controller" controller="podcertificaterequest-cleaner-controller" machine # [ 23.820441] k3s[875]: I0921 13:21:44.508043 875 controllermanager.go:579] "Warning: skipping controller" controller="storage-version-migrator-controller" machine # [ 23.884876] k3s[875]: I0921 13:21:44.572573 875 shared_informer.go:377] "Caches are synced" machine: (finished: waiting for unit k3s.service, in 24.83 seconds) machine: waiting for success: kubectl get ns farm machine # Error from server (NotFound): namespaces "farm" not found machine # [ 24.140528] k3s[875]: time="2026-09-21T13:21:44Z" level=info msg="Done waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 24.141486] k3s[875]: time="2026-09-21T13:21:44Z" level=info msg="Waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 24.143637] k3s[875]: time="2026-09-21T13:21:44Z" level=info msg="Done waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 24.144398] k3s[875]: time="2026-09-21T13:21:44Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-40.1.4+up40.1.0.tgz" machine # [ 24.144971] k3s[875]: time="2026-09-21T13:21:44Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-crd-40.1.4+up40.1.0.tgz" machine # [ 24.145631] k3s[875]: time="2026-09-21T13:21:44Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/ccm.yaml" machine # [ 24.146236] k3s[875]: time="2026-09-21T13:21:44Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/coredns.yaml" machine # [ 24.146920] k3s[875]: time="2026-09-21T13:21:44Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/local-storage.yaml" machine # [ 24.147451] k3s[875]: time="2026-09-21T13:21:44Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/rolebindings.yaml" machine # [ 24.147952] k3s[875]: time="2026-09-21T13:21:44Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/runtimes.yaml" machine # [ 24.148615] k3s[875]: time="2026-09-21T13:21:44Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/traefik.yaml" machine # [ 24.304057] k3s[875]: time="2026-09-21T13:21:44Z" level=info msg="Imported docker.io/rancher/klipper-helm:v0.13.3-build20260727" machine # [ 24.308661] k3s[875]: time="2026-09-21T13:21:44Z" level=info msg="Tagged docker.io/rancher/klipper-helm@sha256:5425a2b4613d2458dbdff99218e8d487ebb59c20e7a941f061c0777070f0aac1" machine # [ 24.309576] k3s[875]: time="2026-09-21T13:21:44Z" level=info msg="Imported docker.io/rancher/klipper-lb:v0.4.17" machine # [ 24.316251] k3s[875]: time="2026-09-21T13:21:45Z" level=info msg="Tagged docker.io/rancher/klipper-lb@sha256:910944bb0bd94f060a82a56ca1ea1c577d3e49b3473a093a47a985f32e92d94a" machine # [ 24.316914] k3s[875]: time="2026-09-21T13:21:45Z" level=info msg="Imported docker.io/rancher/local-path-provisioner:v0.0.37" machine # [ 24.324171] k3s[875]: time="2026-09-21T13:21:45Z" level=info msg="Tunnel server egress proxy mode: agent" machine # [ 24.325676] k3s[875]: time="2026-09-21T13:21:45Z" level=info msg="Starting dynamiclistener CN filter node controller with SANs: [127.0.0.1 ::1 localhost machine 10.0.2.15 fec0::ee77:2868:a29c:5b07 10.43.0.1 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local]" machine # [ 24.330479] k3s[875]: time="2026-09-21T13:21:45Z" level=info msg="Tagged docker.io/rancher/local-path-provisioner@sha256:e757967a5ec338f6a9b371c5a9688bedaa8c3578ea3dd4db329ea0084be0a86f" machine # [ 24.333137] k3s[875]: time="2026-09-21T13:21:45Z" level=info msg="Imported docker.io/rancher/mirrored-coredns-coredns:1.14.6" machine # [ 24.338598] k3s[875]: time="2026-09-21T13:21:45Z" level=info msg="Tagged docker.io/rancher/mirrored-coredns-coredns@sha256:900f9c109f7a33545d3c811516e8376df9019147b750f5ce3e254468769176ea" machine # [ 24.339488] k3s[875]: time="2026-09-21T13:21:45Z" level=info msg="Imported docker.io/rancher/mirrored-library-busybox:1.37.0" machine # [ 24.346044] k3s[875]: time="2026-09-21T13:21:45Z" level=info msg="Tagged docker.io/rancher/mirrored-library-busybox@sha256:101b4afd76732482eff9b95cae5f94bcf295e521fbec4e01b69c5421f3f3f3e5" machine # [ 24.348465] k3s[875]: time="2026-09-21T13:21:45Z" level=info msg="Imported docker.io/rancher/mirrored-library-traefik:3.7.8" machine # [ 24.353254] k3s[875]: time="2026-09-21T13:21:45Z" level=info msg="Tagged docker.io/rancher/mirrored-library-traefik@sha256:4299bbed850421258fc5448c2e0e6ad350981d4d335a68de11b92448aedbefe5" machine # [ 24.353905] k3s[875]: time="2026-09-21T13:21:45Z" level=info msg="Imported docker.io/rancher/mirrored-metrics-server:v0.9.0" machine # [ 24.356148] k3s[875]: time="2026-09-21T13:21:45Z" level=info msg="Tagged docker.io/rancher/mirrored-metrics-server@sha256:d9862115e7c7881280d3d75ca26bda8ffc0fc213315979575bf23ce9826205c0" machine # [ 24.356735] k3s[875]: time="2026-09-21T13:21:45Z" level=info msg="Imported docker.io/rancher/mirrored-pause:3.10.2" machine # [ 24.358505] k3s[875]: time="2026-09-21T13:21:45Z" level=info msg="Tagged docker.io/rancher/mirrored-pause@sha256:f548e0e8e3dc1896ca956272154dde3314e8cc4fde0a57577ee9fa1c63f5baf4" machine # [ 24.459533] k3s[875]: time="2026-09-21T13:21:45Z" level=info msg="Creating new TLS secret for kube-system/k3s-serving (count: 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__ee77_2868_a29c_5b07-01e60d:fec0::ee77:2868:a29c:5b07 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=ACA016C606EE921F482BA2377EC1369FBB948849]" machine # [ 24.469038] k3s[875]: time="2026-09-21T13:21:45Z" level=info msg="Active TLS secret kube-system/k3s-serving (ver=232) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__ee77_2868_a29c_5b07-01e60d:fec0::ee77:2868:a29c:5b07 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=ACA016C606EE921F482BA2377EC1369FBB948849]" machine # [ 24.639975] k3s[875]: time="2026-09-21T13:21:45Z" level=info msg="Imported 8 images from /var/lib/rancher/k3s/agent/images/k3s-airgap-images-amd64.tar.zst in 4.121971088s" machine # [ 24.641295] k3s[875]: time="2026-09-21T13:21:45Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-client.tar" machine # [ 24.793160] k3s[875]: I0921 13:21:45.480618 875 controllermanager.go:627] "Warning: controller is disabled" controller="bootstrap-signer-controller" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 25.432161] k3s[875]: time="2026-09-21T13:21:46Z" level=info msg="Starting k3s.cattle.io/v1, Kind=Addon controller" machine # [ 25.433451] k3s[875]: time="2026-09-21T13:21:46Z" level=info msg="Creating deploy event broadcaster" machine # [ 25.441141] k3s[875]: time="2026-09-21T13:21:46Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 25.442106] k3s[875]: I0921 13:21:46.126536 875 controller.go:667] quota admission added evaluator for: addons.k3s.cattle.io machine # [ 25.442755] k3s[875]: time="2026-09-21T13:21:46Z" level=info msg="Creating helm-controller event broadcaster" machine # [ 25.447569] k3s[875]: time="2026-09-21T13:21:46Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 25.453835] k3s[875]: time="2026-09-21T13:21:46Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=ApplyingManifest type=Normal machine # [ 25.458609] k3s[875]: time="2026-09-21T13:21:46Z" level=info msg="Cluster dns configmap has been set successfully" machine # [ 25.979547] k3s[875]: time="2026-09-21T13:21:46Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=AppliedManifest type=Normal machine # [ 26.003262] k3s[875]: time="2026-09-21T13:21:46Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=ApplyingManifest type=Normal machine # [ 26.279615] k3s[875]: time="2026-09-21T13:21:46Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=AppliedManifest type=Normal machine # [ 26.294399] k3s[875]: time="2026-09-21T13:21:46Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=ApplyingManifest type=Normal machine # [ 26.441205] k3s[875]: time="2026-09-21T13:21:47Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine: (finished: waiting for success: kubectl get ns farm, in 2.56 seconds) machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key machine # [ 26.635973] k3s[875]: I0921 13:21:47.323628 875 serving.go:392] Generated self-signed cert in-memory machine # [ 26.659253] k3s[875]: I0921 13:21:47.347019 875 range_allocator.go:113] "No Secondary Service CIDR provided. Skipping filtering out secondary service addresses" logger="node-ipam-controller" machine # [ 26.660265] k3s[875]: I0921 13:21:47.347678 875 controllermanager.go:627] "Warning: controller is disabled" controller="service-lb-controller" machine # [ 26.660830] k3s[875]: I0921 13:21:47.347696 875 controllermanager.go:627] "Warning: controller is disabled" controller="node-route-controller" machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key, in 0.19 seconds) machine: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key machine # [ 26.755088] k3s[875]: time="2026-09-21T13:21:47Z" level=info msg="Starting rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding controller" machine # [ 26.762399] k3s[875]: time="2026-09-21T13:21:47Z" level=info msg="Starting /v1, Kind=ConfigMap controller" machine # [ 26.764054] k3s[875]: time="2026-09-21T13:21:47Z" level=info msg="Starting batch/v1, Kind=Job controller" machine # [ 26.768112] k3s[875]: time="2026-09-21T13:21:47Z" level=info msg="Starting /v1, Kind=ServiceAccount controller" machine # [ 26.769752] k3s[875]: time="2026-09-21T13:21:47Z" level=info msg="Starting /v1, Kind=Secret controller" machine # [ 26.777571] k3s[875]: time="2026-09-21T13:21:47Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChartConfig controller" machine # [ 26.779721] k3s[875]: time="2026-09-21T13:21:47Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChart controller" machine # [ 26.837769] k3s[875]: I0921 13:21:47.525497 875 serving.go:392] Generated self-signed cert in-memory machine: (finished: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key, in 0.19 seconds) machine: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine # [ 26.955662] k3s[875]: I0921 13:21:47.643299 875 controllermanager.go:160] Version: v1.35.8+k3s1 machine # [ 26.959081] k3s[875]: I0921 13:21:47.646283 875 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 26.960613] k3s[875]: I0921 13:21:47.646326 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.961978] k3s[875]: I0921 13:21:47.646359 875 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 26.965962] k3s[875]: I0921 13:21:47.646392 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.967258] k3s[875]: I0921 13:21:47.646515 875 secure_serving.go:211] Serving securely on 127.0.0.1:10258 machine # [ 26.968634] k3s[875]: I0921 13:21:47.646316 875 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 26.971219] k3s[875]: I0921 13:21:47.646720 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.973726] k3s[875]: I0921 13:21:47.646985 875 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 26.975334] k3s[875]: time="2026-09-21T13:21:47Z" level=info msg="Creating service-lb-controller event broadcaster" machine # [ 26.985146] k3s[875]: I0921 13:21:47.672559 875 controller.go:667] quota admission added evaluator for: deployments.apps machine: (finished: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.15 seconds) subtest: chart deploys and workers become Ready machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine # [ 27.013611] k3s[875]: I0921 13:21:47.701363 875 alloc.go:329] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.43.0.10"} machine # [ 27.015639] k3s[875]: time="2026-09-21T13:21:47Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=AppliedManifest type=Normal machine # [ 27.021387] k3s[875]: W0921 13:21:47.707809 875 probe.go:272] Flexvolume plugin directory at /usr/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating. machine # [ 27.023906] k3s[875]: I0921 13:21:47.708330 875 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" requiredFeatureGates=["ClusterTrustBundle"] machine # [ 27.027102] k3s[875]: I0921 13:21:47.708350 875 controllermanager.go:579] "Warning: skipping controller" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" machine # [ 27.059177] k3s[875]: I0921 13:21:47.746940 875 shared_informer.go:377] "Caches are synced" machine # [ 27.060593] k3s[875]: I0921 13:21:47.746978 875 shared_informer.go:377] "Caches are synced" machine # [ 27.061953] k3s[875]: I0921 13:21:47.747010 875 shared_informer.go:377] "Caches are synced" machine # [ 27.170537] k3s[875]: I0921 13:21:47.857516 875 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="device-taint-eviction-controller" requiredFeatureGates=["DynamicResourceAllocation","DRADeviceTaints"] machine # [ 27.173461] k3s[875]: I0921 13:21:47.857555 875 controllermanager.go:579] "Warning: skipping controller" controller="device-taint-eviction-controller" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 27.209664] k3s[875]: time="2026-09-21T13:21:47Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 27.217069] k3s[875]: time="2026-09-21T13:21:47Z" level=info msg="Starting /v1, Kind=Pod controller" machine # [ 27.221654] k3s[875]: time="2026-09-21T13:21:47Z" level=info msg="Starting apps/v1, Kind=DaemonSet controller" machine # [ 27.227434] k3s[875]: time="2026-09-21T13:21:47Z" level=info msg="Starting discovery.k8s.io/v1, Kind=EndpointSlice controller" machine # [ 27.228351] k3s[875]: I0921 13:21:47.915144 875 controllermanager.go:329] Started "cloud-node-controller" machine # [ 27.229318] k3s[875]: I0921 13:21:47.915278 875 controllermanager.go:329] Started "cloud-node-lifecycle-controller" machine # [ 27.230177] k3s[875]: I0921 13:21:47.915351 875 node_controller.go:176] Sending events to api server. machine # [ 27.230991] k3s[875]: I0921 13:21:47.915457 875 node_controller.go:185] Waiting for informer caches to sync machine # [ 27.231871] k3s[875]: I0921 13:21:47.916050 875 node_lifecycle_controller.go:112] Sending events to api server machine # [ 27.235932] k3s[875]: I0921 13:21:47.923700 875 controllermanager.go:329] Started "service-lb-controller" machine # [ 27.236578] k3s[875]: W0921 13:21:47.923725 875 controllermanager.go:306] "node-route-controller" is disabled machine # [ 27.237532] k3s[875]: I0921 13:21:47.923963 875 controller.go:235] Starting service controller machine # [ 27.238137] k3s[875]: I0921 13:21:47.924000 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.337127] k3s[875]: I0921 13:21:48.024830 875 shared_informer.go:377] "Caches are synced" machine # [ 27.408315] k3s[875]: time="2026-09-21T13:21:48Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" object=kube-system/local-storage reason=DeletingManifest type=Normal machine # [ 27.419470] k3s[875]: time="2026-09-21T13:21:48Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=ApplyingManifest type=Normal machine # [ 27.441228] k3s[875]: time="2026-09-21T13:21:48Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 27.471625] k3s[875]: I0921 13:21:48.159317 875 controller.go:667] quota admission added evaluator for: helmcharts.helm.cattle.io machine # [ 27.475841] k3s[875]: time="2026-09-21T13:21:48Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=AppliedManifest type=Normal machine # [ 27.486612] k3s[875]: time="2026-09-21T13:21:48Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=ApplyingManifest type=Normal machine # [ 27.620631] k3s[875]: I0921 13:21:48.308390 875 controllermanager.go:627] "Warning: controller is disabled" controller="cloud-node-lifecycle-controller" machine # [ 27.627145] k3s[875]: time="2026-09-21T13:21:48Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Applying HelmChart from https://%{KUBERNETES_API}%/static/charts/nix-grpc-farm.tgz using Job kube-system/helm-install-nix-grpc-farm " object=kube-system/nix-grpc-farm reason=ApplyJob type=Normal machine # [ 27.647890] k3s[875]: I0921 13:21:48.335650 875 controller.go:667] quota admission added evaluator for: jobs.batch machine # [ 27.781397] k3s[875]: time="2026-09-21T13:21:48Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=AppliedManifest type=Normal machine # [ 27.789551] k3s[875]: time="2026-09-21T13:21:48Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=ApplyingManifest type=Normal machine # [ 28.072466] k3s[875]: I0921 13:21:48.759747 875 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="storageversion-garbage-collector-controller" requiredFeatureGates=["APIServerIdentity","StorageVersionAPI"] machine # [ 28.072853] k3s[875]: I0921 13:21:48.759781 875 controllermanager.go:579] "Warning: skipping controller" controller="storageversion-garbage-collector-controller" machine # [ 28.073499] k3s[875]: I0921 13:21:48.759795 875 controllermanager.go:627] "Warning: controller is disabled" controller="selinux-warning-controller" machine # [ 28.080095] k3s[875]: I0921 13:21:48.765587 875 publisher.go:107] "Starting root CA cert publisher controller" machine # [ 28.080590] k3s[875]: I0921 13:21:48.765614 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.081130] k3s[875]: I0921 13:21:48.766613 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.081625] k3s[875]: I0921 13:21:48.766652 875 namespace_controller.go:202] "Starting namespace controller" machine # [ 28.085793] k3s[875]: I0921 13:21:48.766667 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.086397] k3s[875]: I0921 13:21:48.766751 875 node_lifecycle_controller.go:453] "Sending events to api server" machine # [ 28.086957] k3s[875]: I0921 13:21:48.766783 875 node_lifecycle_controller.go:460] "Starting node controller" machine # [ 28.087649] k3s[875]: I0921 13:21:48.766793 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.088436] k3s[875]: I0921 13:21:48.766904 875 pv_controller_base.go:307] "Starting persistent volume controller" machine # [ 28.088965] k3s[875]: I0921 13:21:48.766917 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.089641] k3s[875]: I0921 13:21:48.766949 875 clusterroleaggregation_controller.go:194] "Starting ClusterRoleAggregator controller" machine # [ 28.090193] k3s[875]: I0921 13:21:48.766962 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.090713] k3s[875]: I0921 13:21:48.766994 875 ttlafterfinished_controller.go:112] "Starting TTL after finished controller" machine # [ 28.093069] k3s[875]: I0921 13:21:48.767009 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.093670] k3s[875]: I0921 13:21:48.767041 875 taint_eviction.go:283] "Starting" controller="taint-eviction-controller" machine # [ 28.094415] k3s[875]: I0921 13:21:48.767085 875 taint_eviction.go:288] "Sending events to API server" machine # [ 28.094960] k3s[875]: I0921 13:21:48.767095 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.095627] k3s[875]: I0921 13:21:48.767134 875 gc_controller.go:98] "Starting GC controller" machine # [ 28.096200] k3s[875]: I0921 13:21:48.767147 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.096662] k3s[875]: I0921 13:21:48.767408 875 replica_set.go:241] "Starting controller" name="replicaset" machine # [ 28.097228] k3s[875]: I0921 13:21:48.767423 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.097750] k3s[875]: I0921 13:21:48.767494 875 controller.go:423] "Starting resource claim controller" machine # [ 28.098468] k3s[875]: I0921 13:21:48.767509 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.099063] k3s[875]: I0921 13:21:48.767576 875 servicecidrs_controller.go:136] "Starting" controller="service-cidr-controller" machine # [ 28.099587] k3s[875]: I0921 13:21:48.767588 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.100171] k3s[875]: I0921 13:21:48.767666 875 daemon_controller.go:309] "Starting daemon sets controller" machine # [ 28.100640] k3s[875]: I0921 13:21:48.767678 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.101390] k3s[875]: I0921 13:21:48.767710 875 disruption.go:458] "Sending events to api server." machine # [ 28.101960] k3s[875]: I0921 13:21:48.767751 875 disruption.go:465] "Starting disruption controller" machine # [ 28.102681] k3s[875]: I0921 13:21:48.767760 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.103440] k3s[875]: I0921 13:21:48.767795 875 cleaner.go:83] "Starting CSR cleaner controller" machine # [ 28.104113] k3s[875]: I0921 13:21:48.767872 875 ttl_controller.go:127] "Starting TTL controller" machine # [ 28.104541] k3s[875]: I0921 13:21:48.770914 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.105141] k3s[875]: I0921 13:21:48.770962 875 expand_controller.go:328] "Starting expand controller" machine # [ 28.105629] k3s[875]: I0921 13:21:48.770975 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.106226] k3s[875]: I0921 13:21:48.771010 875 pv_protection_controller.go:81] "Starting PV protection controller" machine # [ 28.106743] k3s[875]: I0921 13:21:48.771023 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.107474] k3s[875]: I0921 13:21:48.771100 875 endpoints_controller.go:193] "Starting endpoint controller" machine # [ 28.108050] k3s[875]: I0921 13:21:48.771115 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.108562] k3s[875]: I0921 13:21:48.771203 875 endpointslice_controller.go:283] "Starting endpoint slice controller" machine # [ 28.109168] k3s[875]: I0921 13:21:48.771216 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.109658] k3s[875]: I0921 13:21:48.771292 875 replica_set.go:241] "Starting controller" name="replicationcontroller" machine # [ 28.110403] k3s[875]: I0921 13:21:48.771306 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.110938] k3s[875]: I0921 13:21:48.771339 875 serviceaccounts_controller.go:117] "Starting service account controller" machine # [ 28.111623] k3s[875]: I0921 13:21:48.771352 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.112165] k3s[875]: I0921 13:21:48.771526 875 horizontal.go:204] "Starting HPA controller" machine # [ 28.112641] k3s[875]: I0921 13:21:48.771539 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.113181] k3s[875]: I0921 13:21:48.771572 875 pvc_protection_controller.go:166] "Starting PVC protection controller" machine # [ 28.113695] k3s[875]: I0921 13:21:48.771586 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.114366] k3s[875]: I0921 13:21:48.771674 875 job_controller.go:254] "Starting job controller" machine # [ 28.114879] k3s[875]: I0921 13:21:48.771688 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.115532] k3s[875]: I0921 13:21:48.771774 875 deployment_controller.go:172] "Starting controller" controller="deployment" machine # [ 28.116110] k3s[875]: I0921 13:21:48.771788 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.116551] k3s[875]: I0921 13:21:48.771826 875 tokencleaner.go:117] "Starting token cleaner controller" machine # [ 28.117096] k3s[875]: I0921 13:21:48.771841 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.117536] k3s[875]: I0921 13:21:48.771954 875 node_ipam_controller.go:142] "Starting ipam controller" machine # [ 28.118075] k3s[875]: I0921 13:21:48.771966 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.118515] k3s[875]: I0921 13:21:48.772003 875 vac_protection_controller.go:206] "Starting VAC protection controller" machine # [ 28.119039] k3s[875]: I0921 13:21:48.772016 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.119519] k3s[875]: I0921 13:21:48.772127 875 attach_detach_controller.go:335] "Starting attach detach controller" machine # [ 28.120061] k3s[875]: I0921 13:21:48.772139 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.120505] k3s[875]: I0921 13:21:48.772185 875 controller.go:174] "Starting ephemeral volume controller" machine # [ 28.121059] k3s[875]: I0921 13:21:48.772200 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.121536] k3s[875]: I0921 13:21:48.772239 875 legacy_serviceaccount_token_cleaner.go:103] "Starting legacy service account token cleaner controller" machine # [ 28.122077] k3s[875]: I0921 13:21:48.772258 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.122513] k3s[875]: I0921 13:21:48.772337 875 endpointslicemirroring_controller.go:226] "Starting EndpointSliceMirroring controller" machine # [ 28.123062] k3s[875]: I0921 13:21:48.772350 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.123496] k3s[875]: I0921 13:21:48.772416 875 cronjob_controllerv2.go:143] "Starting cronjob controller v2" machine # [ 28.124038] k3s[875]: I0921 13:21:48.772429 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.124476] k3s[875]: I0921 13:21:48.772467 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.125037] k3s[875]: I0921 13:21:48.772523 875 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-legacy-unknown" machine # [ 28.126166] k3s[875]: I0921 13:21:48.772536 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.127097] k3s[875]: I0921 13:21:48.772567 875 certificate_controller.go:120] "Starting certificate controller" name="csrapproving" machine # [ 28.128626] k3s[875]: I0921 13:21:48.772580 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.129570] k3s[875]: I0921 13:21:48.772838 875 resource_quota_controller.go:297] "Starting resource quota controller" machine # [ 28.130754] k3s[875]: I0921 13:21:48.772874 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.131897] k3s[875]: I0921 13:21:48.773027 875 garbagecollector.go:141] "Starting controller" controller="garbagecollector" machine # [ 28.133230] k3s[875]: I0921 13:21:48.773058 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.134595] k3s[875]: I0921 13:21:48.773136 875 stateful_set.go:180] "Starting stateful set controller" machine # [ 28.135593] k3s[875]: I0921 13:21:48.773152 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.136805] k3s[875]: I0921 13:21:48.773223 875 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-serving" machine # [ 28.138431] k3s[875]: I0921 13:21:48.773236 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.178197] k3s[875]: I0921 13:21:48.773274 875 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-client" machine # [ 28.178751] k3s[875]: I0921 13:21:48.773286 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.179412] k3s[875]: I0921 13:21:48.773317 875 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kube-apiserver-client" machine # [ 28.179972] k3s[875]: I0921 13:21:48.773331 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.180633] k3s[875]: I0921 13:21:48.773397 875 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 28.181198] k3s[875]: I0921 13:21:48.773571 875 resource_quota_monitor.go:309] "QuotaMonitor running" machine # [ 28.181640] k3s[875]: I0921 13:21:48.775967 875 graph_builder.go:386] "Running" component="GraphBuilder" machine # [ 28.182206] k3s[875]: I0921 13:21:48.776010 875 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 28.182646] k3s[875]: I0921 13:21:48.776089 875 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 28.183241] k3s[875]: I0921 13:21:48.776162 875 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 28.212076] k3s[875]: I0921 13:21:48.898442 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.233077] k3s[875]: I0921 13:21:48.920655 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.259094] k3s[875]: time="2026-09-21T13:21:48Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=AppliedManifest type=Normal machine # [ 28.279867] k3s[875]: I0921 13:21:48.967658 875 shared_informer.go:377] "Caches are synced" machine # [ 28.283622] k3s[875]: I0921 13:21:48.971432 875 shared_informer.go:377] "Caches are synced" machine # [ 28.284852] k3s[875]: I0921 13:21:48.972661 875 shared_informer.go:377] "Caches are synced" machine # [ 28.378269] k3s[875]: I0921 13:21:49.065923 875 shared_informer.go:377] "Caches are synced" machine # [ 28.379233] k3s[875]: I0921 13:21:49.067018 875 shared_informer.go:377] "Caches are synced" machine # [ 28.380468] k3s[875]: I0921 13:21:49.068259 875 shared_informer.go:377] "Caches are synced" machine # [ 28.380972] k3s[875]: I0921 13:21:49.068296 875 shared_informer.go:377] "Caches are synced" machine # [ 28.381652] k3s[875]: I0921 13:21:49.068509 875 shared_informer.go:377] "Caches are synced" machine # [ 28.381840] k3s[875]: I0921 13:21:49.066665 875 shared_informer.go:377] "Caches are synced" machine # [ 28.382507] k3s[875]: I0921 13:21:49.070133 875 shared_informer.go:377] "Caches are synced" machine # [ 28.384518] k3s[875]: I0921 13:21:49.070175 875 shared_informer.go:377] "Caches are synced" machine # [ 28.385521] k3s[875]: I0921 13:21:49.070971 875 shared_informer.go:377] "Caches are synced" machine # [ 28.386570] k3s[875]: I0921 13:21:49.071051 875 shared_informer.go:377] "Caches are synced" machine # [ 28.387396] k3s[875]: I0921 13:21:49.071217 875 shared_informer.go:377] "Caches are synced" machine # [ 28.387929] k3s[875]: I0921 13:21:49.071403 875 shared_informer.go:377] "Caches are synced" machine # [ 28.389204] k3s[875]: I0921 13:21:49.068260 875 shared_informer.go:377] "Caches are synced" machine # [ 28.390056] k3s[875]: I0921 13:21:49.072064 875 shared_informer.go:377] "Caches are synced" machine # [ 28.390506] k3s[875]: I0921 13:21:49.072102 875 shared_informer.go:377] "Caches are synced" machine # [ 28.391594] k3s[875]: I0921 13:21:49.072107 875 shared_informer.go:377] "Caches are synced" machine # [ 28.392617] k3s[875]: I0921 13:21:49.072145 875 shared_informer.go:377] "Caches are synced" machine # [ 28.393162] k3s[875]: I0921 13:21:49.072198 875 shared_informer.go:377] "Caches are synced" machine # [ 28.393596] k3s[875]: I0921 13:21:49.072241 875 shared_informer.go:377] "Caches are synced" machine # [ 28.394145] k3s[875]: I0921 13:21:49.072274 875 shared_informer.go:377] "Caches are synced" machine # [ 28.394613] k3s[875]: I0921 13:21:49.072309 875 shared_informer.go:377] "Caches are synced" machine # [ 28.395212] k3s[875]: I0921 13:21:49.072516 875 shared_informer.go:377] "Caches are synced" machine # [ 28.395735] k3s[875]: I0921 13:21:49.072549 875 shared_informer.go:377] "Caches are synced" machine # [ 28.396469] k3s[875]: I0921 13:21:49.072595 875 shared_informer.go:377] "Caches are synced" machine # [ 28.397040] k3s[875]: I0921 13:21:49.072633 875 shared_informer.go:377] "Caches are synced" machine # [ 28.397504] k3s[875]: I0921 13:21:49.072676 875 shared_informer.go:377] "Caches are synced" machine # [ 28.398124] k3s[875]: I0921 13:21:49.072892 875 shared_informer.go:377] "Caches are synced" machine # [ 28.398757] k3s[875]: I0921 13:21:49.073082 875 shared_informer.go:377] "Caches are synced" machine # [ 28.399439] k3s[875]: I0921 13:21:49.073112 875 shared_informer.go:377] "Caches are synced" machine # [ 28.400096] k3s[875]: I0921 13:21:49.073695 875 shared_informer.go:377] "Caches are synced" machine # [ 28.400561] k3s[875]: I0921 13:21:49.073728 875 shared_informer.go:377] "Caches are synced" machine # [ 28.401112] k3s[875]: I0921 13:21:49.073777 875 range_allocator.go:177] "Sending events to api server" machine # [ 28.401543] k3s[875]: I0921 13:21:49.073817 875 range_allocator.go:181] "Starting range CIDR allocator" machine # [ 28.402144] k3s[875]: I0921 13:21:49.073828 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.402588] k3s[875]: I0921 13:21:49.073839 875 shared_informer.go:377] "Caches are synced" machine # [ 28.403196] k3s[875]: I0921 13:21:49.074899 875 shared_informer.go:377] "Caches are synced" machine # [ 28.403735] k3s[875]: I0921 13:21:49.075337 875 shared_informer.go:377] "Caches are synced" machine # [ 28.404541] k3s[875]: I0921 13:21:49.075477 875 shared_informer.go:377] "Caches are synced" machine # [ 28.405147] k3s[875]: I0921 13:21:49.075537 875 shared_informer.go:377] "Caches are synced" machine # [ 28.405622] k3s[875]: I0921 13:21:49.075617 875 shared_informer.go:377] "Caches are synced" machine # [ 28.406195] k3s[875]: I0921 13:21:49.075653 875 shared_informer.go:377] "Caches are synced" machine # [ 28.406713] k3s[875]: I0921 13:21:49.075684 875 shared_informer.go:377] "Caches are synced" machine # [ 28.407642] k3s[875]: time="2026-09-21T13:21:49Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/traefik.yaml\"" object=kube-system/traefik reason=DeletingManifest type=Normal machine # [ 28.411397] k3s[875]: I0921 13:21:49.099180 875 shared_informer.go:377] "Caches are synced" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 28.441343] k3s[875]: time="2026-09-21T13:21:49Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 28.632830] k3s[875]: time="2026-09-21T13:21:49Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Deferred node password secret validation complete" object=machine reason=NodePasswordValidationComplete type=Normal machine # [ 28.824783] k3s[875]: I0921 13:21:49.512530 875 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 28.828950] k3s[875]: I0921 13:21:49.516661 875 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 29.023556] k3s[875]: I0921 13:21:49.711207 875 controller.go:667] quota admission added evaluator for: replicasets.apps machine # [ 29.090845] k3s[875]: time="2026-09-21T13:21:49Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Resumed synced Job kube-system/helm-install-nix-grpc-farm" object=kube-system/nix-grpc-farm reason=ResumeJob type=Normal machine # [ 29.385530] k3s[875]: I0921 13:21:50.073191 875 shared_informer.go:377] "Caches are synced" machine # [ 29.386958] k3s[875]: I0921 13:21:50.073247 875 garbagecollector.go:166] "Garbage collector: all resource monitors have synced" machine # [ 29.388311] k3s[875]: I0921 13:21:50.073258 875 garbagecollector.go:169] "Proceeding to collect garbage" machine # [ 29.433209] k3s[875]: I0921 13:21:50.120932 875 shared_informer.go:377] "Caches are synced" machine # [ 29.442327] k3s[875]: time="2026-09-21T13:21:50Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 30.406408] postgres[1186]: [1186] ERROR: relation "goose_db_version" does not exist at character 36 machine # [ 30.407948] postgres[1186]: [1186] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC machine # [ 30.426973] niks3-server[1178]: 2026/09/21 13:21:51 OK 20241026095416_initial_model.sql (10ms) machine # [ 30.432385] niks3-server[1178]: 2026/09/21 13:21:51 OK 20251210153512_drop_unused_gin_index.sql (4.18ms) machine # [ 30.438342] niks3-server[1178]: 2026/09/21 13:21:51 OK 20251218171726_add_pins.sql (5.78ms) machine # [ 30.444206] k3s[875]: time="2026-09-21T13:21:51Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 30.445923] niks3-server[1178]: 2026/09/21 13:21:51 OK 20260628120000_add_object_size_and_stats.sql (6.28ms) machine # [ 30.452573] niks3-server[1178]: 2026/09/21 13:21:51 OK 20260905000000_add_claims.sql (6.57ms) machine # [ 30.456181] niks3-server[1178]: 2026/09/21 13:21:51 OK 20260920000000_drop_claims.sql (3.59ms) machine # [ 30.457707] niks3-server[1178]: 2026/09/21 13:21:51 goose: successfully migrated database to version: 20260920000000 machine # [ 30.463054] niks3-server[1178]: 2026/09/21 13:21:51 OK 1_commit_pending_closure.sql (6.71ms) machine # [ 30.467612] niks3-server[1178]: 2026/09/21 13:21:51 OK 2_object_stats_trigger.sql (4.38ms) machine # [ 30.468881] niks3-server[1178]: 2026/09/21 13:21:51 goose: up to current file version: 2 machine # [ 30.473164] niks3-server[1178]: 2026/09/21 13:21:51 INFO OIDC provider initialized name=kubernetes issuer=https://kubernetes.default.svc.cluster.local machine # [ 30.475266] niks3-server[1178]: 2026/09/21 13:21:51 INFO OIDC authentication enabled config=/nix/store/v0b0sqyzhrjsz48x3klf7b7vl89apzs0-niks3-oidc.json machine # [ 30.475725] niks3-server[1178]: 2026/09/21 13:21:51 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key machine # [ 30.509501] niks3-server[1178]: 2026/09/21 13:21:51 INFO Read proxy enabled — serving cache objects from S3 machine # [ 30.511299] niks3-server[1178]: 2026/09/21 13:21:51 INFO Using socket-activated listener address=0.0.0.0:5751 machine # [ 30.512857] niks3-server[1178]: 2026/09/21 13:21:51 INFO systemd watchdog enabled interval=15s machine # [ 30.514176] niks3-server[1178]: 2026/09/21 13:21:51 INFO Starting HTTP server address=0.0.0.0:5751 machine # [ 30.515903] systemd[1]: Started niks3 server. machine # [ 30.516703] systemd[1]: Reached target Multi-User System. machine # [ 30.517664] systemd[1]: Startup finished in 1.246s (kernel) + 3.810s (initrd) + 25.453s (userspace) = 30.511s. machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 31.443105] k3s[875]: time="2026-09-21T13:21:52Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 31.633660] k3s[875]: time="2026-09-21T13:21:52Z" level=info msg="Started tunnel to 10.0.2.15:6443" machine # [ 31.635967] k3s[875]: time="2026-09-21T13:21:52Z" level=info msg="Connecting to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 31.637460] k3s[875]: time="2026-09-21T13:21:52Z" level=info msg="Proxy done" err="context canceled" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 31.638116] k3s[875]: time="2026-09-21T13:21:52Z" level=info msg="Stopped tunnel to 127.0.0.1:6443" machine # [ 31.639350] k3s[875]: time="2026-09-21T13:21:52Z" level=info msg="error in remotedialer server [400]: websocket: close 1006 (abnormal closure): unexpected EOF" machine # [ 31.640054] k3s[875]: time="2026-09-21T13:21:52Z" level=info msg="Handling backend connection request [machine]" machine # [ 31.641126] k3s[875]: time="2026-09-21T13:21:52Z" level=info msg="Connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 31.642223] k3s[875]: time="2026-09-21T13:21:52Z" level=info msg="Remotedialer connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 32.052904] k3s[875]: time="2026-09-21T13:21:52Z" level=info msg="Imported docker.io/library/nix-grpc-farm-client:0.1.0-beta.1" machine # [ 32.056263] k3s[875]: time="2026-09-21T13:21:52Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-client@sha256:051a918f50b24871a2b9e907dee37a0e6ff2de2126f226ec1bdf9f3b3da86562" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 32.444912] k3s[875]: time="2026-09-21T13:21:53Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 32.554684] k3s[875]: time="2026-09-21T13:21:53Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-client.tar in 7.914331849s" machine # [ 32.555895] k3s[875]: time="2026-09-21T13:21:53Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-lb.tar" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 33.442570] k3s[875]: time="2026-09-21T13:21:54Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 34.375979] k3s[875]: time="2026-09-21T13:21:55Z" level=info msg="Imported docker.io/library/nix-grpc-farm-lb:0.1.0-beta.1" machine # [ 34.379088] k3s[875]: time="2026-09-21T13:21:55Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-lb@sha256:18ee6724be589622e1aee9d13c5121e7b2c992ca636c935ade90c66423e18f37" machine # [ 34.442869] k3s[875]: time="2026-09-21T13:21:55Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 34.490103] k3s[875]: time="2026-09-21T13:21:55Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-lb.tar in 1.935085325s" machine # [ 34.490940] k3s[875]: time="2026-09-21T13:21:55Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm.tar" machine # [ 34.526777] k3s[875]: time="2026-09-21T13:21:55Z" level=info msg="Running kubelet --cloud-provider=external --config-dir=/var/lib/rancher/k3s/agent/etc/kubelet.conf.d --containerd=/run/k3s/containerd/containerd.sock --eviction-hard=nodefs.available<1%,imagefs.available<1% --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubelet.kubeconfig --node-ip=10.0.2.15,fec0::ee77:2868:a29c:5b07 --node-labels= --read-only-port=0" machine # [ 34.533141] k3s[875]: Flag --containerd has been deprecated, This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed. machine # [ 34.545967] k3s[875]: I0921 13:21:55.233637 875 server.go:521] "Kubelet version" kubeletVersion="v1.35.8+k3s1" machine # [ 34.547151] k3s[875]: I0921 13:21:55.233702 875 server.go:523] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 34.547905] k3s[875]: I0921 13:21:55.233786 875 watchdog_linux.go:95] "Systemd watchdog is not enabled" machine # [ 34.548768] k3s[875]: I0921 13:21:55.233815 875 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." machine # [ 34.549695] k3s[875]: I0921 13:21:55.236685 875 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/agent/client-ca.crt" machine # [ 34.555871] k3s[875]: I0921 13:21:55.243594 875 server.go:1414] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" machine # [ 34.564023] k3s[875]: I0921 13:21:55.251779 875 server.go:771] "--cgroups-per-qos enabled, but --cgroup-root was not specified. Defaulting to /" machine # [ 34.564688] k3s[875]: I0921 13:21:55.251843 875 server.go:832] "NoSwap is set due to memorySwapBehavior not specified" memorySwapBehavior="" FailSwapOn=false machine # [ 34.567962] k3s[875]: I0921 13:21:55.255714 875 container_manager_linux.go:272] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] machine # [ 34.568600] k3s[875]: I0921 13:21:55.255782 875 container_manager_linux.go:277] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"machine","RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} machine # [ 34.569282] k3s[875]: I0921 13:21:55.256063 875 topology_manager.go:143] "Creating topology manager with none policy" machine # [ 34.569729] k3s[875]: I0921 13:21:55.256084 875 container_manager_linux.go:308] "Creating device plugin manager" machine # [ 34.570587] k3s[875]: I0921 13:21:55.256167 875 container_manager_linux.go:317] "Creating Dynamic Resource Allocation (DRA) manager" machine # [ 34.574747] k3s[875]: I0921 13:21:55.262515 875 state_mem.go:41] "Initialized" logger="CPUManager state memory" machine # [ 34.575624] k3s[875]: I0921 13:21:55.262829 875 kubelet.go:482] "Attempting to sync node with API server" machine # [ 34.576144] k3s[875]: I0921 13:21:55.262876 875 kubelet.go:383] "Adding static pod path" path="/var/lib/rancher/k3s/agent/pod-manifests" machine # [ 34.576612] k3s[875]: I0921 13:21:55.262908 875 kubelet.go:394] "Adding apiserver pod source" machine # [ 34.577210] k3s[875]: I0921 13:21:55.262931 875 apiserver.go:42] "Waiting for node sync before watching apiserver pods" machine # [ 34.580493] k3s[875]: I0921 13:21:55.268269 875 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="containerd" version="2.2.7-k3s1" apiVersion="v1" machine # [ 34.581258] k3s[875]: I0921 13:21:55.268989 875 kubelet.go:945] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" machine # [ 34.581643] k3s[875]: I0921 13:21:55.269015 875 kubelet.go:972] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" machine # [ 34.583729] k3s[875]: I0921 13:21:55.271531 875 server.go:1252] "Started kubelet" machine # [ 34.586990] k3s[875]: I0921 13:21:55.274774 875 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" machine # [ 34.595066] k3s[875]: I0921 13:21:55.281591 875 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 machine # [ 34.595735] k3s[875]: I0921 13:21:55.282513 875 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 machine # [ 34.596413] k3s[875]: I0921 13:21:55.282578 875 server_v1.go:49] "podresources" method="list" useActivePods=true machine # [ 34.597021] k3s[875]: I0921 13:21:55.282690 875 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" machine # [ 34.597924] k3s[875]: I0921 13:21:55.283506 875 dynamic_serving_content.go:135] "Starting controller" name="kubelet-server-cert-files::/var/lib/rancher/k3s/agent/serving-kubelet.crt::/var/lib/rancher/k3s/agent/serving-kubelet.key" machine # [ 34.598986] k3s[875]: I0921 13:21:55.286763 875 server.go:317] "Adding debug handlers to kubelet server" machine # [ 34.603141] k3s[875]: E0921 13:21:55.290882 875 kubelet.go:1661] "Image garbage collection failed once. Stats initialization may not have completed yet" err="invalid capacity 0 on image filesystem" machine # [ 34.608053] k3s[875]: I0921 13:21:55.295470 875 volume_manager.go:311] "Starting Kubelet Volume Manager" machine # [ 34.608782] k3s[875]: I0921 13:21:55.295663 875 desired_state_of_world_populator.go:146] "Desired state populator starts to run" machine # [ 34.610234] k3s[875]: I0921 13:21:55.295723 875 reconciler.go:29] "Reconciler: start to sync state" machine # [ 34.611560] k3s[875]: E0921 13:21:55.299226 875 kubelet_node_status.go:392] "Error getting the current node from lister" err="node \"machine\" not found" machine # [ 34.613055] k3s[875]: I0921 13:21:55.300453 875 factory.go:223] Registration of the systemd container factory successfully machine # [ 34.613696] k3s[875]: I0921 13:21:55.300572 875 factory.go:221] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory machine # [ 34.624673] k3s[875]: E0921 13:21:55.308243 875 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"machine\" not found" node="machine" machine # [ 34.627053] k3s[875]: I0921 13:21:55.314752 875 factory.go:223] Registration of the containerd container factory successfully machine # [ 34.646362] k3s[875]: I0921 13:21:55.334154 875 cpu_manager.go:225] "Starting" policy="none" machine # [ 34.646752] k3s[875]: I0921 13:21:55.334565 875 cpu_manager.go:226] "Reconciling" reconcilePeriod="10s" machine # [ 34.647511] k3s[875]: I0921 13:21:55.335327 875 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" machine # [ 34.656087] k3s[875]: I0921 13:21:55.343889 875 policy_none.go:50] "Start" machine # [ 34.656773] k3s[875]: I0921 13:21:55.344588 875 memory_manager.go:187] "Starting memorymanager" policy="None" machine # [ 34.657707] k3s[875]: I0921 13:21:55.345522 875 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" machine # [ 34.661477] k3s[875]: I0921 13:21:55.349259 875 policy_none.go:44] "Start" machine # [ 34.666269] systemd[1]: Created slice libcontainer container kubepods.slice. machine # [ 34.680589] systemd[1]: Created slice libcontainer container kubepods-burstable.slice. machine # [ 34.685810] systemd[1]: Created slice libcontainer container kubepods-besteffort.slice. machine # [ 34.696506] k3s[875]: E0921 13:21:55.384262 875 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" machine # [ 34.698789] k3s[875]: I0921 13:21:55.386560 875 eviction_manager.go:194] "Eviction manager: starting control loop" machine # [ 34.700183] k3s[875]: I0921 13:21:55.386602 875 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" machine # [ 34.700631] k3s[875]: I0921 13:21:55.387026 875 plugin_manager.go:121] "Starting Kubelet Plugin Manager" machine # [ 34.703266] k3s[875]: E0921 13:21:55.391036 875 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="no imagefs label for configured runtime" machine # [ 34.704278] k3s[875]: E0921 13:21:55.391087 875 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"machine\" not found" machine # [ 34.718908] k3s[875]: I0921 13:21:55.406627 875 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" machine # [ 34.724108] k3s[875]: I0921 13:21:55.411828 875 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" machine # [ 34.725867] k3s[875]: I0921 13:21:55.411906 875 status_manager.go:249] "Starting to sync pod status with apiserver" machine # [ 34.727754] k3s[875]: I0921 13:21:55.411950 875 kubelet.go:2506] "Starting kubelet main sync loop" machine # [ 34.728651] k3s[875]: E0921 13:21:55.412006 875 kubelet.go:2530] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" machine # [ 34.800747] k3s[875]: I0921 13:21:55.488484 875 kubelet_node_status.go:74] "Attempting to register node" node="machine" machine # [ 34.810096] k3s[875]: time="2026-09-21T13:21:55Z" level=info msg="Adding node OwnerReference to node-password secret machine.node-password.k3s" machine # [ 34.811956] k3s[875]: I0921 13:21:55.497822 875 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"machine\" does not exist" machine # [ 34.815661] k3s[875]: I0921 13:21:55.498425 875 node_controller.go:429] Initializing node machine with cloud provider machine # [ 34.817147] k3s[875]: I0921 13:21:55.498485 875 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 34.819350] k3s[875]: E0921 13:21:55.498510 875 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 34.822171] k3s[875]: I0921 13:21:55.498834 875 kubelet_node_status.go:77] "Successfully registered node" node="machine" machine # [ 34.823692] k3s[875]: I0921 13:21:55.506657 875 node_controller.go:429] Initializing node machine with cloud provider machine # [ 34.825188] k3s[875]: I0921 13:21:55.506754 875 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 34.827397] k3s[875]: E0921 13:21:55.506781 875 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 34.830188] k3s[875]: I0921 13:21:55.506920 875 node_controller.go:429] Initializing node machine with cloud provider machine # [ 34.831673] k3s[875]: I0921 13:21:55.506986 875 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 34.834241] k3s[875]: E0921 13:21:55.507000 875 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 34.837234] k3s[875]: I0921 13:21:55.510478 875 range_allocator.go:433] "Set node PodCIDR" node="machine" podCIDRs=["10.42.0.0/24"] machine # [ 34.838943] k3s[875]: I0921 13:21:55.514568 875 kuberuntime_manager.go:2095] "Updating runtime config through cri with podcidr" CIDR="10.42.0.0/24" machine # [ 34.840720] k3s[875]: I0921 13:21:55.515266 875 kubelet_network.go:47] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.42.0.0/24" machine # [ 34.842607] k3s[875]: time="2026-09-21T13:21:55Z" level=info msg="Annotations and labels have been set successfully on node: machine" machine # [ 34.844553] k3s[875]: time="2026-09-21T13:21:55Z" level=info msg="Starting flannel with backend vxlan" machine # [ 34.845427] k3s[875]: I0921 13:21:55.517939 875 node_controller.go:429] Initializing node machine with cloud provider machine # [ 34.846222] k3s[875]: time="2026-09-21T13:21:55Z" level=info msg="Synced coredns NodeHosts entries for machine" machine # [ 34.853820] k3s[875]: time="2026-09-21T13:21:55Z" level=info msg="Flannel found PodCIDR assigned for node machine" machine # [ 34.855409] k3s[875]: time="2026-09-21T13:21:55Z" level=info msg="The interface eth0 with ipv4 address 10.0.2.15 will be used by flannel" machine # [ 34.857166] k3s[875]: I0921 13:21:55.542760 875 kube.go:139] Waiting 10m0s for node controller to sync machine # [ 34.858704] k3s[875]: I0921 13:21:55.542832 875 kube.go:537] Starting kube subnet manager machine # [ 34.886628] k3s[875]: I0921 13:21:55.574281 875 server.go:218] "Successfully retrieved NodeIPs" NodeIPs=["10.0.2.15","fec0::ee77:2868:a29c:5b07"] machine # [ 34.887548] k3s[875]: E0921 13:21:55.574385 875 server.go:255] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`" machine # [ 34.904614] k3s[875]: I0921 13:21:55.592353 875 server.go:264] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4" machine # [ 34.905488] k3s[875]: I0921 13:21:55.592402 875 server_linux.go:136] "Using iptables Proxier" machine # [ 34.925100] k3s[875]: I0921 13:21:55.611287 875 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4" machine # [ 34.938252] k3s[875]: I0921 13:21:55.625964 875 server.go:529] "Version info" version="v1.35.8+k3s1" machine # [ 34.939880] k3s[875]: I0921 13:21:55.626011 875 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 34.941400] k3s[875]: I0921 13:21:55.627490 875 config.go:200] "Starting service config controller" machine # [ 34.942966] k3s[875]: I0921 13:21:55.627528 875 shared_informer.go:349] "Waiting for caches to sync" controller="service config" machine # [ 34.943769] k3s[875]: I0921 13:21:55.627573 875 config.go:106] "Starting endpoint slice config controller" machine # [ 34.944511] k3s[875]: I0921 13:21:55.627596 875 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config" machine # [ 34.945080] k3s[875]: I0921 13:21:55.627639 875 config.go:403] "Starting serviceCIDR config controller" machine # [ 34.945791] k3s[875]: I0921 13:21:55.627652 875 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config" machine # [ 34.946403] k3s[875]: I0921 13:21:55.629033 875 config.go:309] "Starting node config controller" machine # [ 34.946976] k3s[875]: I0921 13:21:55.629051 875 shared_informer.go:349] "Waiting for caches to sync" controller="node config" machine # [ 34.947639] k3s[875]: I0921 13:21:55.629065 875 shared_informer.go:356] "Caches are synced" controller="node config" machine # [ 34.963122] k3s[875]: I0921 13:21:55.650894 875 node_controller.go:474] Successfully initialized node machine with cloud provider machine # [ 34.963677] k3s[875]: I0921 13:21:55.651215 875 event.go:389] "Event occurred" object="machine" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="Synced" message="Node synced successfully" machine # [ 34.973417] k3s[875]: I0921 13:21:55.661195 875 server.go:173] "Starting Kubernetes Scheduler" version="v1.35.8+k3s1" machine # [ 34.974169] k3s[875]: I0921 13:21:55.661220 875 server.go:175] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 34.978199] k3s[875]: I0921 13:21:55.665016 875 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 34.978777] k3s[875]: I0921 13:21:55.665031 875 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 34.979501] k3s[875]: I0921 13:21:55.665055 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 34.980053] k3s[875]: I0921 13:21:55.665072 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 34.980548] k3s[875]: I0921 13:21:55.665098 875 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 34.981302] k3s[875]: I0921 13:21:55.665131 875 shared_informer.go:370] "Waiting for caches to sync" machine # [ 34.981699] k3s[875]: I0921 13:21:55.665179 875 secure_serving.go:211] Serving securely on 127.0.0.1:10259 machine # [ 34.982410] k3s[875]: I0921 13:21:55.665298 875 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 34.983089] k3s[875]: I0921 13:21:55.665594 875 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 35.036573] k3s[875]: I0921 13:21:55.723496 875 kubelet_node_status.go:427] "Fast updating node status as it just became ready" machine # [ 35.043377] k3s[875]: I0921 13:21:55.731160 875 topologycache.go:237] "Can't get CPU or zone information for node" node="machine" machine # [ 35.077681] k3s[875]: I0921 13:21:55.765432 875 shared_informer.go:377] "Caches are synced" machine # [ 35.078426] k3s[875]: I0921 13:21:55.765476 875 shared_informer.go:377] "Caches are synced" machine # [ 35.079091] k3s[875]: I0921 13:21:55.765987 875 shared_informer.go:377] "Caches are synced" machine # [ 35.140159] k3s[875]: I0921 13:21:55.827741 875 shared_informer.go:356] "Caches are synced" controller="service config" machine # [ 35.140742] k3s[875]: I0921 13:21:55.827796 875 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config" machine # [ 35.441174] k3s[875]: I0921 13:21:56.127731 875 shared_informer.go:356] "Caches are synced" controller="endpoint slice config" machine # [ 35.455278] k3s[875]: time="2026-09-21T13:21:56Z" level=info msg="Labels and annotations have been set successfully on node: machine" machine # [ 35.469791] k3s[875]: time="2026-09-21T13:21:56Z" level=info msg="Tunnel authorizer set Kubelet Port 0.0.0.0:10250" machine # [ 35.576553] k3s[875]: I0921 13:21:56.264208 875 apiserver.go:52] "Watching apiserver" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 35.855767] k3s[875]: I0921 13:21:56.543437 875 kube.go:163] Node controller sync successful machine # [ 35.856643] k3s[875]: I0921 13:21:56.543523 875 vxlan.go:128] VXLAN config: VNI=1 Port=0 GBP=false Learning=false DirectRouting=false machine # [ 35.862862] k3s[875]: I0921 13:21:56.550586 875 kube.go:704] List of node(machine) annotations: map[string]string{"alpha.kubernetes.io/provided-node-ip":"10.0.2.15,fec0::ee77:2868:a29c:5b07", "k3s.io/hostname":"machine", "k3s.io/internal-ip":"10.0.2.15,fec0::ee77:2868:a29c:5b07", "k3s.io/node-args":"[\"server\",\"--disable\",\"traefik\",\"--disable\",\"metrics-server\",\"--disable\",\"local-storage\",\"--kubelet-arg\",\"eviction-hard=nodefs.available\\u003c1%,imagefs.available\\u003c1%\"]", "k3s.io/node-config-hash":"EFXPOZ7ZWHRCLFNW4X4ZDPFQMSAOP3BLEIN2VE47TDRKQ4UIWKUQ====", "k3s.io/node-env":"{}", "node.alpha.kubernetes.io/ttl":"0", "volumes.kubernetes.io/controller-managed-attach-detach":"true"} machine # [ 35.888871] (udev-worker)[1244]: Network interface NamePolicy= disabled on kernel command line. machine # [ 35.899044] k3s[875]: I0921 13:21:56.586780 875 kube.go:558] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.42.0.0/24] machine # [ 35.901510] k3s[875]: I0921 13:21:56.589256 875 iptables.go:50] Starting flannel in iptables mode... machine # [ 35.902214] k3s[875]: time="2026-09-21T13:21:56Z" level=warning msg="no subnet found for key: FLANNEL_NETWORK in file: /run/flannel/subnet.env" machine # [ 35.902700] k3s[875]: time="2026-09-21T13:21:56Z" level=warning msg="no subnet found for key: FLANNEL_SUBNET in file: /run/flannel/subnet.env" machine # [ 35.903431] k3s[875]: time="2026-09-21T13:21:56Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_NETWORK in file: /run/flannel/subnet.env" machine # [ 35.903974] k3s[875]: time="2026-09-21T13:21:56Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_SUBNET in file: /run/flannel/subnet.env" machine # [ 35.905308] k3s[875]: I0921 13:21:56.589367 875 iptables.go:101] Current network or subnet (10.42.0.0/16, 10.42.0.0/24) is not equal to previous one (0.0.0.0/0, 0.0.0.0/0), trying to recycle old iptables rules machine # [ 35.915786] k3s[875]: I0921 13:21:56.602757 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/34609472-d608-4844-8592-ffa6c3ff282c-config-volume\") pod \"coredns-c5fdd76cf-7hx6j\" (UID: \"34609472-d608-4844-8592-ffa6c3ff282c\") " pod="kube-system/coredns-c5fdd76cf-7hx6j" machine # [ 35.916530] k3s[875]: I0921 13:21:56.603325 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-config-volume\" (UniqueName: \"kubernetes.io/configmap/34609472-d608-4844-8592-ffa6c3ff282c-custom-config-volume\") pod \"coredns-c5fdd76cf-7hx6j\" (UID: \"34609472-d608-4844-8592-ffa6c3ff282c\") " pod="kube-system/coredns-c5fdd76cf-7hx6j" machine # [ 35.916981] k3s[875]: I0921 13:21:56.603361 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zskww\" (UniqueName: \"kubernetes.io/projected/34609472-d608-4844-8592-ffa6c3ff282c-kube-api-access-zskww\") pod \"coredns-c5fdd76cf-7hx6j\" (UID: \"34609472-d608-4844-8592-ffa6c3ff282c\") " pod="kube-system/coredns-c5fdd76cf-7hx6j" machine # [ 35.939322] dhcpcd[681]: flannel.1: IAID a0:38:b9:ca machine # [ 35.940147] dhcpcd[681]: flannel.1: adding address fe80::d85b:a0ff:fe38:b9ca machine # [ 35.941237] systemd[1]: Created slice libcontainer container kubepods-burstable-pod34609472_d608_4844_8592_ffa6c3ff282c.slice. machine # [ 35.963770] systemd[1]: Created slice libcontainer container kubepods-burstable-pode92ea803_c4e9_4186_9f52_ff766dc59162.slice. machine # [ 35.988805] k3s[875]: I0921 13:21:56.676560 875 iptables.go:111] Setting up masking rules machine # [ 36.003073] k3s[875]: I0921 13:21:56.690821 875 iptables.go:212] Changing default FORWARD chain policy to ACCEPT machine # [ 36.008439] k3s[875]: I0921 13:21:56.696189 875 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" machine # [ 36.013472] k3s[875]: time="2026-09-21T13:21:56Z" level=info msg="Wrote flannel subnet file to /run/flannel/subnet.env" machine # [ 36.014380] k3s[875]: time="2026-09-21T13:21:56Z" level=info msg="Running flannel backend" machine # [ 36.015054] k3s[875]: I0921 13:21:56.701282 875 vxlan_network.go:68] watching for new subnet leases machine # [ 36.015786] k3s[875]: I0921 13:21:56.701318 875 vxlan_network.go:115] starting vxlan device watcher machine # [ 36.017975] k3s[875]: I0921 13:21:56.704446 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/e92ea803-c4e9-4186-9f52-ff766dc59162-klipper-helm\") pod \"helm-install-nix-grpc-farm-nfj2t\" (UID: \"e92ea803-c4e9-4186-9f52-ff766dc59162\") " pod="kube-system/helm-install-nix-grpc-farm-nfj2t" machine # [ 36.018618] k3s[875]: I0921 13:21:56.705487 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/e92ea803-c4e9-4186-9f52-ff766dc59162-klipper-cache\") pod \"helm-install-nix-grpc-farm-nfj2t\" (UID: \"e92ea803-c4e9-4186-9f52-ff766dc59162\") " pod="kube-system/helm-install-nix-grpc-farm-nfj2t" machine # [ 36.019156] k3s[875]: I0921 13:21:56.705578 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/e92ea803-c4e9-4186-9f52-ff766dc59162-klipper-config\") pod \"helm-install-nix-grpc-farm-nfj2t\" (UID: \"e92ea803-c4e9-4186-9f52-ff766dc59162\") " pod="kube-system/helm-install-nix-grpc-farm-nfj2t" machine # [ 36.019649] k3s[875]: I0921 13:21:56.705621 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e92ea803-c4e9-4186-9f52-ff766dc59162-tmp\") pod \"helm-install-nix-grpc-farm-nfj2t\" (UID: \"e92ea803-c4e9-4186-9f52-ff766dc59162\") " pod="kube-system/helm-install-nix-grpc-farm-nfj2t" machine # [ 36.020528] k3s[875]: I0921 13:21:56.705667 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"values\" (UniqueName: \"kubernetes.io/projected/e92ea803-c4e9-4186-9f52-ff766dc59162-values\") pod \"helm-install-nix-grpc-farm-nfj2t\" (UID: \"e92ea803-c4e9-4186-9f52-ff766dc59162\") " pod="kube-system/helm-install-nix-grpc-farm-nfj2t" machine # [ 36.021212] k3s[875]: I0921 13:21:56.705797 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"content\" (UniqueName: \"kubernetes.io/configmap/e92ea803-c4e9-4186-9f52-ff766dc59162-content\") pod \"helm-install-nix-grpc-farm-nfj2t\" (UID: \"e92ea803-c4e9-4186-9f52-ff766dc59162\") " pod="kube-system/helm-install-nix-grpc-farm-nfj2t" machine # [ 36.022110] k3s[875]: I0921 13:21:56.705897 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbc7w\" (UniqueName: \"kubernetes.io/projected/e92ea803-c4e9-4186-9f52-ff766dc59162-kube-api-access-xbc7w\") pod \"helm-install-nix-grpc-farm-nfj2t\" (UID: \"e92ea803-c4e9-4186-9f52-ff766dc59162\") " pod="kube-system/helm-install-nix-grpc-farm-nfj2t" machine # [ 36.078764] k3s[875]: I0921 13:21:56.766482 875 iptables.go:358] bootstrap done machine # [ 36.143326] k3s[875]: I0921 13:21:56.831023 875 iptables.go:358] bootstrap done machine # [ 36.633781] (udev-worker)[1520]: Network interface NamePolicy= disabled on kernel command line. machine # [ 36.793737] cni0: port 1(vetheef04d23) entered blocking state machine # [ 36.794409] cni0: port 1(vetheef04d23) entered disabled state machine # [ 36.797884] vetheef04d23: entered allmulticast mode machine # [ 36.798837] vetheef04d23: entered promiscuous mode machine # [ 36.801368] cni0: port 2(veth28f3706f) entered blocking state machine # [ 36.802255] cni0: port 2(veth28f3706f) entered disabled state machine # [ 36.803390] veth28f3706f: entered allmulticast mode machine # [ 36.806310] veth28f3706f: entered promiscuous mode machine # [ 36.829513] cni0: port 2(veth28f3706f) entered blocking state machine # [ 36.830180] cni0: port 2(veth28f3706f) entered forwarding state machine # [ 36.850082] cni0: port 1(vetheef04d23) entered blocking state machine # [ 36.850748] cni0: port 1(vetheef04d23) entered forwarding state machine # [ 36.717619] dhcpcd[681]: vetheef04d23: waiting for carrier machine # [ 36.731697] dhcpcd[681]: veth28f3706f: IAID 7c:17:ec:97 machine # [ 36.732525] dhcpcd[681]: veth28f3706f: adding address fe80::b06a:7cff:fe17:ec97 machine # [ 36.733167] dhcpcd[681]: veth28f3706f: carrier lost machine # [ 36.773146] dhcpcd[681]: veth28f3706f: deleting address fe80::b06a:7cff:fe17:ec97 machine # [ 36.773909] dhcpcd[681]: veth28f3706f: carrier acquired machine # [ 36.784221] dhcpcd[681]: veth28f3706f: IAID 7c:17:ec:97 machine # [ 36.784770] dhcpcd[681]: veth28f3706f: adding address fe80::b06a:7cff:fe17:ec97 machine # [ 36.785861] dhcpcd[681]: vetheef04d23: carrier acquired machine # [ 36.795872] dhcpcd[681]: vetheef04d23: IAID 70:92:48:fe machine # [ 36.796585] dhcpcd[681]: vetheef04d23: adding address fe80::8000:70ff:fe92:48fe machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 36.940121] systemd[1]: Started libcontainer container db0a58c2ce3b5c51aada475ea5d11a4542e8e4cb42fffbf60556e56459520040. machine # [ 36.945343] systemd[1]: Started libcontainer container 13a936dd221abac2797b8221cffe9655d92660e2cd2207b0564b3c8d8e5bf065. machine # [ 36.989048] k3s[875]: time="2026-09-21T13:21:57Z" level=info msg="Starting network policy controller version v2.6.3-k3s1, built on 1970-01-01T01:01:01Z, go1.26.7" machine # [ 36.989820] k3s[875]: I0921 13:21:57.676264 875 network_policy_controller.go:164] Starting network policy controller machine # [ 37.109147] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount3536987929.mount: Deactivated successfully. machine # [ 37.183946] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount30686131.mount: Deactivated successfully. machine # [ 37.218628] k3s[875]: I0921 13:21:57.906314 875 network_policy_controller.go:179] Starting network policy controller full sync goroutine machine # [ 37.232507] dhcpcd[681]: flannel.1: soliciting a DHCP lease machine # [ 37.334292] dhcpcd[681]: vetheef04d23: soliciting a DHCP lease machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 38.131731] systemd[1]: Started libcontainer container 44d64ac19b25ca3bbb636b2fea8c7d777430882411e0187ad74a54c6a46d96d7. machine # [ 38.266891] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount364666677.mount: Deactivated successfully. machine # [ 38.381267] k3s[875]: I0921 13:21:59.068362 875 node_lifecycle_controller.go:1234] "Initializing eviction metric for zone" zone="" machine # [ 38.381648] k3s[875]: I0921 13:21:59.068504 875 node_lifecycle_controller.go:886] "Missing timestamp for Node. Assuming now as a timestamp" node="machine" machine # [ 38.382466] k3s[875]: I0921 13:21:59.068615 875 node_lifecycle_controller.go:1080] "Controller detected that zone is now in new state" zone="" newState="Normal" machine # [ 38.518183] dhcpcd[681]: flannel.1: soliciting an IPv6 router machine # [ 38.623447] systemd[1]: Started libcontainer container 36b1e530bfb25c8c1d07369b4b58964a54d66c98edfe831d3b954f37998902dd. machine # [ 38.700953] dhcpcd[681]: vetheef04d23: soliciting an IPv6 router machine # [ 38.753368] dhcpcd[681]: veth28f3706f: soliciting a DHCP lease machine # [ 38.801196] k3s[875]: I0921 13:21:59.488391 875 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/coredns-c5fdd76cf-7hx6j" podStartSLOduration=9.488364718 podStartE2EDuration="9.488364718s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-21 13:21:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-21 13:21:59.488194026 +0000 UTC m=+21.653961606" watchObservedRunningTime="2026-09-21 13:21:59.488364718 +0000 UTC m=+21.654131739" machine # [ 38.801643] k3s[875]: I0921 13:21:59.488553 875 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/helm-install-nix-grpc-farm-nfj2t" podStartSLOduration=9.488539042 podStartE2EDuration="9.488539042s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-21 13:21:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-21 13:21:59.471725732 +0000 UTC m=+21.637492753" watchObservedRunningTime="2026-09-21 13:21:59.488539042 +0000 UTC m=+21.654306063" machine # [ 39.072551] dhcpcd[681]: veth28f3706f: soliciting an IPv6 router machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 39.806393] k3s[875]: I0921 13:22:00.493505 875 alloc.go:329] "allocated clusterIPs" service="farm/nix-grpc-farm" clusterIPs={"IPv4":"10.43.166.194"} machine # [ 39.868546] systemd[1]: cri-containerd-36b1e530bfb25c8c1d07369b4b58964a54d66c98edfe831d3b954f37998902dd.scope: Deactivated successfully. machine # [ 39.869538] systemd[1]: cri-containerd-36b1e530bfb25c8c1d07369b4b58964a54d66c98edfe831d3b954f37998902dd.scope: Consumed 599ms CPU time over 1.244s wall clock time, 32.3M memory peak, 2.4M incoming IP traffic, 141.2K outgoing IP traffic. machine # [ 39.912203] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-36b1e530bfb25c8c1d07369b4b58964a54d66c98edfe831d3b954f37998902dd-rootfs.mount: Deactivated successfully. machine # [ 40.086809] k3s[875]: time="2026-09-21T13:22:00Z" level=info msg="Imported docker.io/library/nix-grpc-farm:0.1.0-beta.1" machine # [ 40.092287] k3s[875]: time="2026-09-21T13:22:00Z" level=info msg="Tagged docker.io/library/nix-grpc-farm@sha256:0ecb8413e473944337df7087c5ddf385ecb20da0145780626f132d3eec8f4809" machine # [ 40.446536] k3s[875]: I0921 13:22:01.134182 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/88b2e47b-0f35-4162-ac39-54dd6047a828-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-s2grm\" (UID: \"88b2e47b-0f35-4162-ac39-54dd6047a828\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-s2grm" machine # [ 40.447503] k3s[875]: I0921 13:22:01.134238 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/88b2e47b-0f35-4162-ac39-54dd6047a828-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-s2grm\" (UID: \"88b2e47b-0f35-4162-ac39-54dd6047a828\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-s2grm" machine # [ 40.447989] k3s[875]: I0921 13:22:01.134268 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/88b2e47b-0f35-4162-ac39-54dd6047a828-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-s2grm\" (UID: \"88b2e47b-0f35-4162-ac39-54dd6047a828\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-s2grm" machine # [ 40.451536] k3s[875]: I0921 13:22:01.134295 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/88b2e47b-0f35-4162-ac39-54dd6047a828-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-s2grm\" (UID: \"88b2e47b-0f35-4162-ac39-54dd6047a828\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-s2grm" machine # [ 40.465970] k3s[875]: I0921 13:22:01.134320 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/88b2e47b-0f35-4162-ac39-54dd6047a828-build\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-s2grm\" (UID: \"88b2e47b-0f35-4162-ac39-54dd6047a828\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-s2grm" machine # [ 40.466591] k3s[875]: I0921 13:22:01.134348 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/88b2e47b-0f35-4162-ac39-54dd6047a828-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-s2grm\" (UID: \"88b2e47b-0f35-4162-ac39-54dd6047a828\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-s2grm" machine # [ 40.467206] k3s[875]: I0921 13:22:01.134375 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/88b2e47b-0f35-4162-ac39-54dd6047a828-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-s2grm\" (UID: \"88b2e47b-0f35-4162-ac39-54dd6047a828\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-s2grm" machine # [ 40.467684] k3s[875]: I0921 13:22:01.134399 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkfpl\" (UniqueName: \"kubernetes.io/projected/88b2e47b-0f35-4162-ac39-54dd6047a828-kube-api-access-dkfpl\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-s2grm\" (UID: \"88b2e47b-0f35-4162-ac39-54dd6047a828\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-s2grm" machine # [ 40.468396] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod88b2e47b_0f35_4162_ac39_54dd6047a828.slice. machine # [ 40.499939] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod8d6faff6_2a76_4d14_a733_3f00ccc900d8.slice. machine # [ 40.514490] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod9f4a445f_fc7d_4ff5_bd22_b3e21d64f733.slice. machine # [ 40.532113] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod0a6eb72d_c98c_45f5_9063_c951a2af28c4.slice. machine # [ 40.547169] k3s[875]: I0921 13:22:01.234922 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/0a6eb72d-c98c-45f5-9063-c951a2af28c4-build\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-hn285\" (UID: \"0a6eb72d-c98c-45f5-9063-c951a2af28c4\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-hn285" machine # [ 40.549427] k3s[875]: I0921 13:22:01.234968 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md4wx\" (UniqueName: \"kubernetes.io/projected/0a6eb72d-c98c-45f5-9063-c951a2af28c4-kube-api-access-md4wx\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-hn285\" (UID: \"0a6eb72d-c98c-45f5-9063-c951a2af28c4\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-hn285" machine # [ 40.549875] k3s[875]: I0921 13:22:01.235026 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/0a6eb72d-c98c-45f5-9063-c951a2af28c4-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-hn285\" (UID: \"0a6eb72d-c98c-45f5-9063-c951a2af28c4\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-hn285" machine # [ 40.550918] k3s[875]: I0921 13:22:01.235054 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/0a6eb72d-c98c-45f5-9063-c951a2af28c4-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-hn285\" (UID: \"0a6eb72d-c98c-45f5-9063-c951a2af28c4\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-hn285" machine # [ 40.551770] k3s[875]: I0921 13:22:01.235101 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/0a6eb72d-c98c-45f5-9063-c951a2af28c4-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-hn285\" (UID: \"0a6eb72d-c98c-45f5-9063-c951a2af28c4\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-hn285" machine # [ 40.552525] k3s[875]: I0921 13:22:01.235128 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/8d6faff6-2a76-4d14-a733-3f00ccc900d8-niks3-token\") pod \"nix-grpc-farm-scheduler-5844ddf54b-gspws\" (UID: \"8d6faff6-2a76-4d14-a733-3f00ccc900d8\") " pod="farm/nix-grpc-farm-scheduler-5844ddf54b-gspws" machine # [ 40.553091] k3s[875]: I0921 13:22:01.235181 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0a6eb72d-c98c-45f5-9063-c951a2af28c4-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-hn285\" (UID: \"0a6eb72d-c98c-45f5-9063-c951a2af28c4\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-hn285" machine # [ 40.553573] k3s[875]: I0921 13:22:01.235207 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/8d6faff6-2a76-4d14-a733-3f00ccc900d8-oidc\") pod \"nix-grpc-farm-scheduler-5844ddf54b-gspws\" (UID: \"8d6faff6-2a76-4d14-a733-3f00ccc900d8\") " pod="farm/nix-grpc-farm-scheduler-5844ddf54b-gspws" machine # [ 40.555661] k3s[875]: I0921 13:22:01.235234 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f4a445f-fc7d-4ff5-bd22-b3e21d64f733-tmp\") pod \"nix-grpc-farm-lb-68c8f49bd6-d25vm\" (UID: \"9f4a445f-fc7d-4ff5-bd22-b3e21d64f733\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-d25vm" machine # [ 40.556635] k3s[875]: I0921 13:22:01.235259 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/9f4a445f-fc7d-4ff5-bd22-b3e21d64f733-tls-lb\") pod \"nix-grpc-farm-lb-68c8f49bd6-d25vm\" (UID: \"9f4a445f-fc7d-4ff5-bd22-b3e21d64f733\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-d25vm" machine # [ 40.558644] k3s[875]: I0921 13:22:01.235287 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/9f4a445f-fc7d-4ff5-bd22-b3e21d64f733-tls-ca\") pod \"nix-grpc-farm-lb-68c8f49bd6-d25vm\" (UID: \"9f4a445f-fc7d-4ff5-bd22-b3e21d64f733\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-d25vm" machine # [ 40.559449] k3s[875]: I0921 13:22:01.235327 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttswm\" (UniqueName: \"kubernetes.io/projected/8d6faff6-2a76-4d14-a733-3f00ccc900d8-kube-api-access-ttswm\") pod \"nix-grpc-farm-scheduler-5844ddf54b-gspws\" (UID: \"8d6faff6-2a76-4d14-a733-3f00ccc900d8\") " pod="farm/nix-grpc-farm-scheduler-5844ddf54b-gspws" machine # [ 40.559986] k3s[875]: I0921 13:22:01.235369 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/0a6eb72d-c98c-45f5-9063-c951a2af28c4-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-hn285\" (UID: \"0a6eb72d-c98c-45f5-9063-c951a2af28c4\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-hn285" machine # [ 40.561244] k3s[875]: I0921 13:22:01.235399 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/0a6eb72d-c98c-45f5-9063-c951a2af28c4-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-hn285\" (UID: \"0a6eb72d-c98c-45f5-9063-c951a2af28c4\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-hn285" machine # [ 40.565677] k3s[875]: I0921 13:22:01.235428 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/8d6faff6-2a76-4d14-a733-3f00ccc900d8-tls\") pod \"nix-grpc-farm-scheduler-5844ddf54b-gspws\" (UID: \"8d6faff6-2a76-4d14-a733-3f00ccc900d8\") " pod="farm/nix-grpc-farm-scheduler-5844ddf54b-gspws" machine # [ 40.569580] k3s[875]: I0921 13:22:01.235451 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/8d6faff6-2a76-4d14-a733-3f00ccc900d8-ca\") pod \"nix-grpc-farm-scheduler-5844ddf54b-gspws\" (UID: \"8d6faff6-2a76-4d14-a733-3f00ccc900d8\") " pod="farm/nix-grpc-farm-scheduler-5844ddf54b-gspws" machine # [ 40.573597] k3s[875]: I0921 13:22:01.235476 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9f4a445f-fc7d-4ff5-bd22-b3e21d64f733-config\") pod \"nix-grpc-farm-lb-68c8f49bd6-d25vm\" (UID: \"9f4a445f-fc7d-4ff5-bd22-b3e21d64f733\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-d25vm" machine # [ 40.986700] cni0: port 3(veth669d94a8) entered blocking state machine # [ 40.987430] cni0: port 3(veth669d94a8) entered disabled state machine # [ 40.988603] veth669d94a8: entered allmulticast mode machine # [ 40.989336] veth669d94a8: entered promiscuous mode machine # [ 40.838805] (udev-worker)[1998]: Network interface NamePolicy= disabled on kernel command line. machine # [ 41.003316] cni0: port 3(veth669d94a8) entered blocking state machine # [ 41.004089] cni0: port 3(veth669d94a8) entered forwarding state machine # [ 40.856417] (udev-worker)[2120]: Network interface NamePolicy= disabled on kernel command lin[ 41.010987] cni0: port 4(veth6b76791e) entered blocking state machine # e. machine # [ 41.016259] cni0: port 4(veth6b76791e) entered disabled state machine # [ 41.019494] veth6b76791e: entered allmulticast mode machine # [ 41.023670] veth6b76791e: entered promiscuous mode machine # [ 41.039589] cni0: port 5(vethf07cafa1) entered blocking state machine # [ 40.886386] (udev-worker)[2135]: Network interface NamePolicy= disabled on kernel command line. machine # [ 40.887746] dhcpcd[681]: veth669d94a8: IAID 9b:92:e4:88 machine # [ 40.888995] dhcpcd[681]: veth669d94a8: adding address fe80::c[ 41.043216] cni0: port 5(vethf07cafa1) entered disabled state machine # fa:9bff:fe92:e488 machine # [ 41.047793] vethf07cafa1: entered allmulticast mode machine # [ 41.049274] vethf07cafa1: entered promiscuous mode machine # [ 41.052340] cni0: port 4(veth6b76791e) entered blocking state machine # [ 41.053048] cni0: port 4(veth6b76791e) entered forwarding state machine # [ 41.083207] cni0: port 6(vethd7ab983d) entered blocking state machine # [ 41.084560] cni0: port 6(vethd7ab983d) entered disabled state machine # [ 41.085199] vethd7ab983d: entered allmulticast mode machine # [ 41.086728] vethd7ab983d: entered promiscuous mode machine # [ 41.088173] cni0: port 5(vethf07cafa1) entered blocking state machine # [ 41.088995] cni0: port 5(vethf07cafa1) entered forwarding state machine # [ 40.941141] dhcpcd[681]: veth6b76791e: waiting for carrier machine # [ 41.099608] cni0: port 6(vethd7ab983d) entered blocking state machine # [ 41.100319] cni0: port 6(vethd7ab983d) entered forwarding state machine # [ 40.955925] dhcpcd[681]: vethf07cafa1: IAID f4:46:a4:e8 machine # [ 40.956646] dhcpcd[681]: vethf07cafa1: adding address fe80::901e:f4ff:fe46:a4e8 machine # [ 40.970408] dhcpcd[681]: vethd7ab983d: IAID f6:17:c1:9a machine # [ 40.971692] dhcpcd[681]: vethd7ab983d: adding address fe80::6895:f6ff:fe17:c19a machine # [ 40.973128] dhcpcd[681]: vethf07cafa1: old hardware address: 92:1e:f4:46:a4:e8 machine # [ 40.975122] dhcpcd[681]: vethf07cafa1: new hardware address: 5e:9e:b3:93:92:2a machine # [ 40.975765] dhcpcd[681]: vethf07cafa1: carrier lost machine # [ 40.979096] k3s[875]: time="2026-09-21T13:22:01Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm.tar in 6.487634601s" machine # [ 41.000614] dhcpcd[681]: vethf07cafa1: deleting address fe80::901e:f4ff:fe46:a4e8 machine # [ 41.001711] dhcpcd[681]: veth6b76791e: carrier acquired machine # [ 41.008586] dhcpcd[681]: veth6b76791e: IAID 65:6a:06:b1 machine # [ 41.009639] dhcpcd[681]: veth6b76791e: adding address fe80::e46f:65ff:fe6a:6b1 machine # [ 41.010516] dhcpcd[681]: vethd7ab983d: old hardware address: 6a:95:f6:17:c1:9a machine # [ 41.011321] dhcpcd[681]: vethd7ab983d: new hardware address: 26:3b:9c:d8:ad:4e machine # [ 41.012034] dhcpcd[681]: vethd7ab983d: carrier lost machine # [ 41.039409] dhcpcd[681]: vethd7ab983d: deleting address fe80::6895:f6ff:fe17:c19a machine # [ 41.040298] dhcpcd[681]: vethf07cafa1: carrier acquired machine # [ 41.042742] systemd[1]: Started libcontainer container ba74b7240e64eb1e2c823a41e6e0ab6601943914858ecd8b3737d033cc9a098e. machine # [ 41.051066] dhcpcd[681]: vethf07cafa1: IAID b3:93:92:2a machine # [ 41.052772] dhcpcd[681]: vethf07cafa1: adding address fe80::5c9e:b3ff:fe93:922a machine # [ 41.053741] dhcpcd[681]: vethd7ab983d: carrier acquired machine # [ 41.060615] dhcpcd[681]: vethd7ab983d: IAID 9c:d8:ad:4e machine # [ 41.061930] dhcpcd[681]: vethd7ab983d: adding address fe80::243b:9cff:fed8:ad4e machine # [ 41.083309] systemd[1]: Started libcontainer container a8bf8b72be1e1bbe966ed77eb9d2e0b91c3735f61f7b79b5c946a3a841b48922. machine # [ 41.103492] systemd[1]: Started libcontainer container 7b605c1e2ecc5dbcb7f93a915bde3a2a1fac2432eeb9749d1edfd34eb1943796. machine # [ 41.123480] systemd[1]: Started libcontainer container 825efd5a76f67dcc6e1200123aa0df6c03bfd5c4bcdf015a86c3a4a7d9d48be6. machine # [ 41.450542] dhcpcd[681]: vethf07cafa1: soliciting a DHCP lease machine # [ 41.817423] dhcpcd[681]: veth6b76791e: soliciting a DHCP lease machine # [ 41.823967] systemd[1]: cri-containerd-13a936dd221abac2797b8221cffe9655d92660e2cd2207b0564b3c8d8e5bf065.scope: Deactivated successfully. machine # [ 41.906259] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-13a936dd221abac2797b8221cffe9655d92660e2cd2207b0564b3c8d8e5bf065-rootfs.mount: Deactivated successfully. machine # [ 42.233281] dhcpcd[681]: flannel.1: probing for an IPv4LL address machine # [ 42.268205] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-13a936dd221abac2797b8221cffe9655d92660e2cd2207b0564b3c8d8e5bf065-shm.mount: Deactivated successfully. machine # [ 42.273804] dhcpcd[681]: veth669d94a8: soliciting a DHCP lease machine # [ 42.289415] dhcpcd[681]: vethd7ab983d: soliciting a DHCP lease machine # [ 42.460020] cni0: port 2(veth28f3706f) entered disabled state machine # [ 42.306577] dhcpcd[681]: veth28f3706f: carrier lost machine # [ 42.462142] veth28f3706f (unregistering): left allmulticast mode machine # [ 42.462981] veth28f3706f (unregistering): left promiscuous mode machine # [ 42.463992] cni0: port 2(veth28f3706f) entered disabled state machine # [ 42.326703] systemd[1]: run-netns-cni\x2dcce127c0\x2dea26\x2d7a2c\x2dcb03\x2da5890bbd9080.mount: Deactivated successfully. machine # [ 42.339426] dhcpcd[681]: veth28f3706f: deleting address fe80::b06a:7cff:fe17:ec97 machine # [ 42.366336] k3s[875]: I0921 13:22:03.053749 875 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e92ea803-c4e9-4186-9f52-ff766dc59162-klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/e92ea803-c4e9-4186-9f52-ff766dc59162-klipper-helm\") pod \"e92ea803-c4e9-4186-9f52-ff766dc59162\" (UID: \"e92ea803-c4e9-4186-9f52-ff766dc59162\") " machine # [ 42.366894] k3s[875]: I0921 13:22:03.053798 875 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e92ea803-c4e9-4186-9f52-ff766dc59162-tmp\" (UniqueName: \"kubernetes.io/empty-dir/e92ea803-c4e9-4186-9f52-ff766dc59162-tmp\") pod \"e92ea803-c4e9-4186-9f52-ff766dc59162\" (UID: \"e92ea803-c4e9-4186-9f52-ff766dc59162\") " machine # [ 42.367457] k3s[875]: I0921 13:22:03.053829 875 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e92ea803-c4e9-4186-9f52-ff766dc59162-kube-api-access-xbc7w\" (UniqueName: \"kubernetes.io/projected/e92ea803-c4e9-4186-9f52-ff766dc59162-kube-api-access-xbc7w\") pod \"e92ea803-c4e9-4186-9f52-ff766dc59162\" (UID: \"e92ea803-c4e9-4186-9f52-ff766dc59162\") " machine # [ 42.368036] k3s[875]: I0921 13:22:03.053885 875 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e92ea803-c4e9-4186-9f52-ff766dc59162-klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/e92ea803-c4e9-4186-9f52-ff766dc59162-klipper-config\") pod \"e92ea803-c4e9-4186-9f52-ff766dc59162\" (UID: \"e92ea803-c4e9-4186-9f52-ff766dc59162\") " machine # [ 42.368459] k3s[875]: I0921 13:22:03.053914 875 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e92ea803-c4e9-4186-9f52-ff766dc59162-content\" (UniqueName: \"kubernetes.io/configmap/e92ea803-c4e9-4186-9f52-ff766dc59162-content\") pod \"e92ea803-c4e9-4186-9f52-ff766dc59162\" (UID: \"e92ea803-c4e9-4186-9f52-ff766dc59162\") " machine # [ 42.368975] k3s[875]: I0921 13:22:03.053944 875 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e92ea803-c4e9-4186-9f52-ff766dc59162-values\" (UniqueName: \"kubernetes.io/projected/e92ea803-c4e9-4186-9f52-ff766dc59162-values\") pod \"e92ea803-c4e9-4186-9f52-ff766dc59162\" (UID: \"e92ea803-c4e9-4186-9f52-ff766dc59162\") " machine # [ 42.369663] k3s[875]: I0921 13:22:03.053971 875 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e92ea803-c4e9-4186-9f52-ff766dc59162-klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/e92ea803-c4e9-4186-9f52-ff766dc59162-klipper-cache\") pod \"e92ea803-c4e9-4186-9f52-ff766dc59162\" (UID: \"e92ea803-c4e9-4186-9f52-ff766dc59162\") " machine # [ 42.370213] k3s[875]: I0921 13:22:03.054533 875 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e92ea803-c4e9-4186-9f52-ff766dc59162-content" pod "e92ea803-c4e9-4186-9f52-ff766dc59162" (UID: "e92ea803-c4e9-4186-9f52-ff766dc59162"). InnerVolumeSpecName "content". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 42.380285] systemd[1]: var-lib-kubelet-pods-e92ea803\x2dc4e9\x2d4186\x2d9f52\x2dff766dc59162-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dcache.mount: Deactivated successfully. machine # [ 42.381050] systemd[1]: var-lib-kubelet-pods-e92ea803\x2dc4e9\x2d4186\x2d9f52\x2dff766dc59162-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dconfig.mount: Deactivated successfully. machine # [ 42.404706] k3s[875]: I0921 13:22:03.092476 875 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e92ea803-c4e9-4186-9f52-ff766dc59162-klipper-config" pod "e92ea803-c4e9-4186-9f52-ff766dc59162" (UID: "e92ea803-c4e9-4186-9f52-ff766dc59162"). InnerVolumeSpecName "klipper-config". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 42.410677] k3s[875]: I0921 13:22:03.098441 875 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e92ea803-c4e9-4186-9f52-ff766dc59162-values" pod "e92ea803-c4e9-4186-9f52-ff766dc59162" (UID: "e92ea803-c4e9-4186-9f52-ff766dc59162"). InnerVolumeSpecName "values". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 42.411672] k3s[875]: I0921 13:22:03.098579 875 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e92ea803-c4e9-4186-9f52-ff766dc59162-klipper-cache" pod "e92ea803-c4e9-4186-9f52-ff766dc59162" (UID: "e92ea803-c4e9-4186-9f52-ff766dc59162"). InnerVolumeSpecName "klipper-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 42.412518] dhcpcd[681]: vetheef04d23: probing for an IPv4LL address machine # [ 42.417941] k3s[875]: I0921 13:22:03.105662 875 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e92ea803-c4e9-4186-9f52-ff766dc59162-klipper-helm" pod "e92ea803-c4e9-4186-9f52-ff766dc59162" (UID: "e92ea803-c4e9-4186-9f52-ff766dc59162"). InnerVolumeSpecName "klipper-helm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 42.424135] k3s[875]: I0921 13:22:03.111900 875 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e92ea803-c4e9-4186-9f52-ff766dc59162-kube-api-access-xbc7w" pod "e92ea803-c4e9-4186-9f52-ff766dc59162" (UID: "e92ea803-c4e9-4186-9f52-ff766dc59162"). InnerVolumeSpecName "kube-api-access-xbc7w". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 42.424954] k3s[875]: I0921 13:22:03.112727 875 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e92ea803-c4e9-4186-9f52-ff766dc59162-tmp" pod "e92ea803-c4e9-4186-9f52-ff766dc59162" (UID: "e92ea803-c4e9-4186-9f52-ff766dc59162"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 42.432425] dhcpcd[681]: veth28f3706f: removing interface machine # [ 42.467391] k3s[875]: I0921 13:22:03.155149 875 reconciler_common.go:299] "Volume detached for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/e92ea803-c4e9-4186-9f52-ff766dc59162-klipper-helm\") on node \"machine\" DevicePath \"\"" machine # [ 42.468188] k3s[875]: I0921 13:22:03.155183 875 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e92ea803-c4e9-4186-9f52-ff766dc59162-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 42.468623] k3s[875]: I0921 13:22:03.155201 875 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbc7w\" (UniqueName: \"kubernetes.io/projected/e92ea803-c4e9-4186-9f52-ff766dc59162-kube-api-access-xbc7w\") on node \"machine\" DevicePath \"\"" machine # [ 42.469559] k3s[875]: I0921 13:22:03.155215 875 reconciler_common.go:299] "Volume detached for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/e92ea803-c4e9-4186-9f52-ff766dc59162-klipper-config\") on node \"machine\" DevicePath \"\"" machine # [ 42.470193] k3s[875]: I0921 13:22:03.155228 875 reconciler_common.go:299] "Volume detached for volume \"content\" (UniqueName: \"kubernetes.io/configmap/e92ea803-c4e9-4186-9f52-ff766dc59162-content\") on node \"machine\" DevicePath \"\"" machine # [ 42.470644] k3s[875]: I0921 13:22:03.155241 875 reconciler_common.go:299] "Volume detached for volume \"values\" (UniqueName: \"kubernetes.io/projected/e92ea803-c4e9-4186-9f52-ff766dc59162-values\") on node \"machine\" DevicePath \"\"" machine # [ 42.471280] k3s[875]: I0921 13:22:03.155253 875 reconciler_common.go:299] "Volume detached for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/e92ea803-c4e9-4186-9f52-ff766dc59162-klipper-cache\") on node \"machine\" DevicePath \"\"" machine # [ 42.553427] dhcpcd[681]: vethd7ab983d: soliciting an IPv6 router machine # [ 42.555672] systemd[1]: var-lib-kubelet-pods-e92ea803\x2dc4e9\x2d4186\x2d9f52\x2dff766dc59162-volumes-kubernetes.io\x7eprojected-values.mount: Deactivated successfully. machine # [ 42.556554] systemd[1]: var-lib-kubelet-pods-e92ea803\x2dc4e9\x2d4186\x2d9f52\x2dff766dc59162-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dxbc7w.mount: Deactivated successfully. machine # [ 42.557078] systemd[1]: var-lib-kubelet-pods-e92ea803\x2dc4e9\x2d4186\x2d9f52\x2dff766dc59162-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 42.557565] systemd[1]: var-lib-kubelet-pods-e92ea803\x2dc4e9\x2d4186\x2d9f52\x2dff766dc59162-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dhelm.mount: Deactivated successfully. machine # [ 42.688442] systemd[1]: Started libcontainer container 3a8d05a7cad07bfb4617b60d97ab9c87dd5150089f236852a071ae1a5277eeb1. machine # [ 42.742063] systemd[1]: Removed slice libcontainer container kubepods-burstable-pode92ea803_c4e9_4186_9f52_ff766dc59162.slice. machine # [ 42.742923] systemd[1]: kubepods-burstable-pode92ea803_c4e9_4186_9f52_ff766dc59162.slice: Consumed 637ms CPU time over 6.777s wall clock time, 32.6M memory peak, 2.4M incoming IP traffic, 141.2K outgoing IP traffic. machine # [ 42.807478] k3s[875]: I0921 13:22:03.495127 875 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="13a936dd221abac2797b8221cffe9655d92660e2cd2207b0564b3c8d8e5bf065" machine # [ 42.830629] k3s[875]: I0921 13:22:03.518359 875 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-68c8f49bd6-d25vm" podStartSLOduration=2.518335287 podStartE2EDuration="2.518335287s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-21 13:22:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-21 13:22:03.517117255 +0000 UTC m=+25.682884555" watchObservedRunningTime="2026-09-21 13:22:03.518335287 +0000 UTC m=+25.684102587" machine # [ 43.106623] dhcpcd[681]: vethf07cafa1: soliciting an IPv6 router machine # [ 43.395477] dhcpcd[681]: veth6b76791e: soliciting an IPv6 router machine # [ 43.422336] dhcpcd[681]: veth669d94a8: soliciting an IPv6 router machine # [ 46.451545] dhcpcd[681]: vethf07cafa1: probing for an IPv4LL address machine # [ 46.712651] dhcpcd[681]: vetheef04d23: using IPv4LL address 169.254.189.238 machine # [ 46.714459] dhcpcd[681]: vetheef04d23: adding route to 169.254.0.0/16 machine # [ 46.818062] dhcpcd[681]: veth6b76791e: probing for an IPv4LL address machine # [ 46.927587] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount2081043039.mount: Deactivated successfully. machine # [ 47.004657] systemd[1]: Started libcontainer container e0af309f61be05d00e0e86e0ede86ac55487ce924da18f92916f3700747710ec. machine # [ 47.076758] systemd[1]: Started libcontainer container 0b3fad2ef4ea326b8eee9bfea495dd05ecab59a09247599a3381f485564c803d. machine # [ 47.088448] systemd[1]: Started libcontainer container f38826dddd376df44b4e4a9afe1e4a286f7ff87360277ce29bb816ebea6b6027. machine # [ 47.274652] dhcpcd[681]: veth669d94a8: probing for an IPv4LL address machine # [ 47.290423] dhcpcd[681]: vethd7ab983d: probing for an IPv4LL address machine # [ 47.438150] niks3-server[1178]: 2026/09/21 13:22:08 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 47.438757] niks3-server[1178]: 2026/09/21 13:22:08 INFO lead: acquired remote=10.42.0.5:45498 machine # [ 47.551973] dhcpcd[681]: flannel.1: using IPv4LL address 169.254.81.184 machine # [ 47.555115] dhcpcd[681]: flannel.1: adding route to 169.254.0.0/16 machine # [ 47.891898] k3s[875]: I0921 13:22:08.578350 875 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-scheduler-5844ddf54b-gspws" podStartSLOduration=7.578325871 podStartE2EDuration="7.578325871s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-21 13:22:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-21 13:22:08.57703744 +0000 UTC m=+30.742804740" watchObservedRunningTime="2026-09-21 13:22:08.578325871 +0000 UTC m=+30.744092892" machine # [ 48.891396] systemd[1]: cri-containerd-e0af309f61be05d00e0e86e0ede86ac55487ce924da18f92916f3700747710ec.scope: Deactivated successfully. machine # [ 48.894657] systemd[1]: cri-containerd-e0af309f61be05d00e0e86e0ede86ac55487ce924da18f92916f3700747710ec.scope: Consumed 717ms CPU time over 1.886s wall clock time, 357.2M memory peak, 98.2M read from disk, 259.8M written to disk. machine # [ 48.896243] systemd[1]: cri-containerd-f38826dddd376df44b4e4a9afe1e4a286f7ff87360277ce29bb816ebea6b6027.scope: Deactivated successfully. machine # [ 48.897143] systemd[1]: cri-containerd-f38826dddd376df44b4e4a9afe1e4a286f7ff87360277ce29bb816ebea6b6027.scope: Consumed 700ms CPU time over 1.805s wall clock time, 376.3M memory peak, 63M read from disk, 203.8M written to disk. machine # [ 48.940098] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-f38826dddd376df44b4e4a9afe1e4a286f7ff87360277ce29bb816ebea6b6027-rootfs.mount: Deactivated successfully. machine # [ 48.945524] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-e0af309f61be05d00e0e86e0ede86ac55487ce924da18f92916f3700747710ec-rootfs.mount: Deactivated successfully. machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 22.92 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s machine # [ 49.940758] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount2070978780.mount: Deactivated successfully. machine # [ 49.978298] systemd[1]: Started libcontainer container 8bacb8716e3663102a57a32a10225d3a3ff626f98ca92e9d4793e9b65ce00b0e. machine # [ 49.982287] systemd[1]: Started libcontainer container b6d906d79b77e167e3d1b8ce7a96b2402c9c11c1053521eb2ff12b9c5c249fd7. machine # [ 50.143434] systemd[1]: Started libcontainer container 33456ce91c3c06c78d76bb7fb64600a4b906f9bbf1b9f924f2a966fda772f4af. machine # [ 50.149277] systemd[1]: Started libcontainer container 8551251b4d27103d131dee743b4ab126944e67ea80cc4876b5c870890b81bcb1. machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s, in 0.31 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s machine # [ 50.284436] systemd[1]: Started libcontainer container ac1a13d8a84652603a79df14306e52076de836b946790c7c35aaa5eac9029e78. machine # [ 50.386390] systemd[1]: Started libcontainer container b1102b8b6f1b0d5a68a218d5f89fad82889e24b8a676744efe13fe26e407d95d. machine # [ 50.521300] dhcpcd[681]: flannel.1: no IPv6 Routers available machine # [ 50.703475] dhcpcd[681]: vetheef04d23: no IPv6 Routers available machine # [ 50.943170] k3s[875]: I0921 13:22:11.630038 875 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-hn285" podStartSLOduration=8.867146936 podStartE2EDuration="10.629986347s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.762839411s" isStatefulPod=false podCreationTimestamp="2026-09-21 13:22:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-21 13:22:11.62431328 +0000 UTC m=+33.790085888" watchObservedRunningTime="2026-09-21 13:22:11.629986347 +0000 UTC m=+33.795757838" machine # [ 51.563753] dhcpcd[681]: vethd7ab983d: using IPv4LL address 169.254.124.98 machine # [ 51.566730] dhcpcd[681]: vethd7ab983d: adding route to 169.254.0.0/16 machine # [ 51.671365] dhcpcd[681]: vethf07cafa1: using IPv4LL address 169.254.32.118 machine # [ 51.673996] dhcpcd[681]: vethf07cafa1: adding route to 169.254.0.0/16 machine # [ 52.103664] dhcpcd[681]: veth6b76791e: using IPv4LL address 169.254.225.201 machine # [ 52.106282] dhcpcd[681]: veth6b76791e: adding route to 169.254.0.0/16 machine # [ 52.830131] dhcpcd[681]: veth669d94a8: using IPv4LL address 169.254.12.122 machine # [ 52.832695] dhcpcd[681]: veth669d94a8: adding route to 169.254.0.0/16 machine # [ 53.938057] dhcpcd[681]: segfault at 5f159a79b ip 00005f1577096cb3 sp 00007fff02918ae8 error 4 in dhcpcd[38cb3,5f1577067000+40000] likely on CPU 0 (core 0, socket 0) machine # [ 53.942677] Code: 45 ae 01 e9 0f fe ff ff 0f 1f 80 00 00 00 00 c6 45 af 01 e9 ff fd ff ff e8 fa 05 fd ff 66 2e 0f 1f 84 00 00 00 00 00 48 8b 07 <48> 8b 80 50 03 00 00 48 85 c0 74 31 90 48 8b 00 48 85 c0 74 1e 48 machine # [ 53.806928] systemd-coredump[3267]: Process 681 (dhcpcd) of user 999 terminated abnormally with signal 11/SEGV, processing... machine # [ 53.818415] systemd[1]: Created slice Slice /system/systemd-coredump. machine # [ 53.822834] systemd[1]: Started Process Core Dump (PID 3267/UID 0). machine # [ 54.030720] systemd-coredump[3268]: Process 681 (dhcpcd) of user 999 dumped core. machine # machine # Module udev.so without build-id. machine # Module dhcpcd without build-id. machine # Stack trace of thread 681: machine # #0 0x00005f1577096cb3 ipv6nd_expire (dhcpcd + 0x38cb3) machine # #1 0x00005f157707006a eloop_start (dhcpcd + 0x1206a) machine # #2 0x00005f1577068300 main (dhcpcd + 0xa300) machine # #3 0x00007cf9bc624285 __libc_start_call_main (libc.so.6 + 0x2b285) machine # #4 0x00007cf9bc624338 __libc_start_main@@GLIBC_2.34 (libc.so.6 + 0x2b338) machine # #5 0x00005f1577069365 _start (dhcpcd + 0xb365) machine # ELF object binary architecture: AMD x86-64 machine # machine # [ 54.046876] systemd[1]: systemd-coredump@0-1-3267_3268-0.service: Deactivated successfully. machine # [ 54.126126] systemd[1]: dhcpcd.service: Main process exited, code=dumped, status=11/SEGV machine # [ 54.129522] systemd[1]: dhcpcd.service: Failed with result 'core-dump'. machine # [ 54.133782] systemd[1]: dhcpcd.service: Consumed 677ms CPU time over 45.970s wall clock time, 6.5M memory peak, 8K written to disk, 96B incoming IP traffic, 1.2K outgoing IP traffic. machine # [ 54.295603] systemd[1]: dhcpcd.service: Scheduled restart job, restart counter is at 1. machine # [ 54.304119] systemd[1]: Starting DHCP Client... machine # [ 54.510946] dhcpcd[3280]: dhcpcd-10.3.2 starting machine # [ 54.515831] dhcpcd[3284]: dev: loaded udev machine # [ 54.517488] dhcpcd[3284]: DUID 00:01:00:01:32:43:eb:d9:52:54:00:12:34:56 machine # [ 54.660247] dhcpcd[3284]: eth0: IAID 00:12:34:56 machine # [ 54.662126] dhcpcd[3284]: flannel.1: IAID a0:38:b9:ca machine # [ 54.663954] dhcpcd[3284]: vetheef04d23: IAID 70:92:48:fe machine # [ 54.665529] dhcpcd[3284]: veth669d94a8: IAID 9b:92:e4:88 machine # [ 54.667245] dhcpcd[3284]: veth6b76791e: IAID 65:6a:06:b1 machine # [ 54.669212] dhcpcd[3284]: vethf07cafa1: IAID f4:46:a4:e8 machine # [ 54.671151] dhcpcd[3284]: vethd7ab983d: IAID f6:17:c1:9a machine # [ 54.943832] dhcpcd[3284]: flannel.1: soliciting an IPv6 router machine # [ 54.969984] dhcpcd[3284]: eth0: rebinding lease of 10.0.2.15 machine # [ 54.977736] dhcpcd[3284]: eth0: leased 10.0.2.15 for 86400 seconds machine # [ 55.038908] systemd[1]: Started DHCP Client. machine # [ 55.061736] dhcpcd[3284]: veth669d94a8: soliciting an IPv6 router machine # [ 55.089094] dhcpcd[3284]: flannel.1: soliciting a DHCP lease machine # [ 55.321930] dhcpcd[3284]: eth0: soliciting an IPv6 router machine # [ 55.324095] dhcpcd[3284]: eth0: Router Advertisement from fe80::2 machine # [ 55.325615] dhcpcd[3284]: eth0: adding address fec0::5054:ff:fe12:3456/64 machine # [ 55.374752] dhcpcd[3284]: vethf07cafa1: soliciting an IPv6 router machine # [ 55.467451] dhcpcd[3284]: vetheef04d23: soliciting an IPv6 router machine # [ 55.542362] dhcpcd[3284]: vethd7ab983d: soliciting an IPv6 router machine # [ 55.568100] dhcpcd[3284]: vethf07cafa1: soliciting a DHCP lease machine # [ 55.594998] dhcpcd[3284]: veth6b76791e: soliciting an IPv6 router machine # [ 55.831431] k3s[875]: I0921 13:22:16.518195 875 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-s2grm" podStartSLOduration=13.667462898 podStartE2EDuration="15.518149228s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.85068633s" isStatefulPod=false podCreationTimestamp="2026-09-21 13:22:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-21 13:22:11.655077805 +0000 UTC m=+33.820848178" watchObservedRunningTime="2026-09-21 13:22:16.518149228 +0000 UTC m=+38.683920998" machine # [ 55.848157] dhcpcd[3284]: vethd7ab983d: soliciting a DHCP lease machine # [ 55.883908] dhcpcd[3284]: veth6b76791e: soliciting a DHCP lease machine # [ 55.887542] dhcpcd[3284]: vetheef04d23: soliciting a DHCP lease machine # [ 55.942750] dhcpcd[3284]: veth669d94a8: soliciting a DHCP lease machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s, in 5.82 seconds) machine: waiting for unit niks3.service machine: (finished: waiting for unit niks3.service, in 0.04 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.28 seconds) machine: waiting for success: test $(curl -sf 10.42.0.6:9901/clusters | grep -c 'health_flags::healthy') -ge 3 machine: (finished: waiting for success: test $(curl -sf 10.42.0.6:9901/clusters | grep -c 'health_flags::healthy') -ge 3, in 3.27 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.21 seconds) machine: waiting for success: curl -sf http://10.42.0.5:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2' machine: (finished: waiting for success: curl -sf http://10.42.0.5:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2', in 0.04 seconds) (finished: subtest: chart deploys and workers become Ready, in 32.89 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}', in 0.19 seconds) machine: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt machine: (finished: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt, in 0.16 seconds) subtest: build through the balancer lands in the cache machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1 machine # [ 65.137233] dhcpcd[3284]: flannel.1: using IPv4LL address 169.254.81.184 machine # [ 65.139856] dhcpcd[3284]: flannel.1: adding route to 169.254.0.0/16 machine # [ 65.141391] dhcpcd[3284]: vetheef04d23: adding route to 169.254.0.0/16 machine # [ 65.142572] dhcpcd[3284]: veth669d94a8: adding route to 169.254.0.0/16 machine # [ 65.144153] dhcpcd[3284]: veth6b76791e: adding route to 169.254.0.0/16 machine # [ 65.145350] dhcpcd[3284]: vethf07cafa1: adding route to 169.254.0.0/16 machine # [ 65.146538] dhcpcd[3284]: vethd7ab983d: adding route to 169.254.0.0/16 machine # [ 65.518692] dhcpcd[3284]: veth669d94a8: using IPv4LL address 169.254.12.122 machine # [ 65.609872] dhcpcd[3284]: veth6b76791e: using IPv4LL address 169.254.225.201 machine # [ 66.097557] dhcpcd[3284]: vetheef04d23: using IPv4LL address 169.254.189.238 machine # [ 66.149792] dhcpcd[3284]: vethd7ab983d: using IPv4LL address 169.254.124.98 machine # [ 66.199351] dhcpcd[3284]: vethf07cafa1: using IPv4LL address 169.254.32.118 machine # [ 66.946937] dhcpcd[3284]: flannel.1: no IPv6 Routers available machine # [ 67.063321] dhcpcd[3284]: veth669d94a8: no IPv6 Routers available machine # [ 67.378920] dhcpcd[3284]: vethf07cafa1: no IPv6 Routers available machine # [ 67.469819] dhcpcd[3284]: vetheef04d23: no IPv6 Routers available machine # [ 67.544217] dhcpcd[3284]: vethd7ab983d: no IPv6 Routers available machine # [ 67.597388] dhcpcd[3284]: veth6b76791e: no IPv6 Routers available machine # [ 93.676081] niks3-server[1178]: 2026/09/21 13:22:54 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 122.437865] niks3-server[1178]: 2026/09/21 13:23:23 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 122.506124] niks3-server[1178]: 2026/09/21 13:23:23 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 122.508810] niks3-server[1178]: 2026/09/21 13:23:23 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 122.526739] niks3-server[1178]: 2026/09/21 13:23:23 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 122.534874] niks3-server[1178]: 2026/09/21 13:23:23 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 122.536108] niks3-server[1178]: 2026/09/21 13:23:23 INFO Registered completed upload object_key=nar/0nzzbas7l8d37mridr7mg162smfjvn7lhs6am4crl4ydaxicigj8.nar.zst machine # [ 122.538764] niks3-server[1178]: 2026/09/21 13:23:23 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 122.539450] niks3-server[1178]: 2026/09/21 13:23:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign machine # [ 122.543522] niks3-server[1178]: 2026/09/21 13:23:23 INFO Signed narinfos id=1 count=1 machine # [ 122.546560] niks3-server[1178]: 2026/09/21 13:23:23 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.ls machine # [ 122.554570] niks3-server[1178]: 2026/09/21 13:23:23 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 122.556233] niks3-server[1178]: 2026/09/21 13:23:23 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 122.558162] niks3-server[1178]: 2026/09/21 13:23:23 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete machine # [ 122.558951] niks3-server[1178]: 2026/09/21 13:23:23 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.narinfo machine # [ 122.563815] niks3-server[1178]: 2026/09/21 13:23:23 INFO Completed upload id=1 machine # [ 147.425520] niks3-server[1178]: 2026/09/21 13:23:48 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 147.471858] niks3-server[1178]: 2026/09/21 13:23:48 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 147.472831] niks3-server[1178]: 2026/09/21 13:23:48 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 147.496059] niks3-server[1178]: 2026/09/21 13:23:48 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 147.497252] niks3-server[1178]: 2026/09/21 13:23:48 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 147.501632] niks3-server[1178]: 2026/09/21 13:23:48 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 147.504486] niks3-server[1178]: 2026/09/21 13:23:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign machine # [ 147.505584] niks3-server[1178]: 2026/09/21 13:23:48 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 147.513523] niks3-server[1178]: 2026/09/21 13:23:48 INFO Signed narinfos id=2 count=1 machine # [ 147.516591] niks3-server[1178]: 2026/09/21 13:23:48 INFO Registered completed upload object_key=log/yz1sqzb72i8v6h2ass0v76ba8cncqj9r-k3s-a.drv machine # [ 147.522692] niks3-server[1178]: 2026/09/21 13:23:48 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 147.525364] niks3-server[1178]: 2026/09/21 13:23:48 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete machine # [ 147.526336] niks3-server[1178]: 2026/09/21 13:23:48 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 147.534524] niks3-server[1178]: 2026/09/21 13:23:48 INFO Registered completed upload object_key=nar/1p7jh5nyz9n68k5f18ymmdpgr34mpnnch1njw7ki7b2b97qlfbjk.nar.zst machine # [ 147.540773] niks3-server[1178]: 2026/09/21 13:23:48 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.ls machine # [ 147.545486] niks3-server[1178]: 2026/09/21 13:23:48 INFO Completed upload id=2 machine # [ 147.547393] niks3-server[1178]: 2026/09/21 13:23:48 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.narinfo machine # [ 147.560031] niks3-server[1178]: 2026/09/21 13:23:48 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 147.583510] niks3-server[1178]: 2026/09/21 13:23:48 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 147.599511] niks3-server[1178]: 2026/09/21 13:23:48 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 147.687076] niks3-server[1178]: 2026/09/21 13:23:48 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 147.687975] niks3-server[1178]: 2026/09/21 13:23:48 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 147.706181] niks3-server[1178]: 2026/09/21 13:23:48 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 147.711481] niks3-server[1178]: 2026/09/21 13:23:48 INFO Registered completed upload object_key=nar/03a4ywhyr5knmbc93z4gyml5y8fvgb431xvlmfxrwsm8mrb0qgx2.nar.zst machine # [ 147.715833] niks3-server[1178]: 2026/09/21 13:23:48 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 147.716714] niks3-server[1178]: 2026/09/21 13:23:48 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 147.718135] niks3-server[1178]: 2026/09/21 13:23:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign machine # [ 147.719331] niks3-server[1178]: 2026/09/21 13:23:48 INFO Signed narinfos id=3 count=1 machine # [ 147.726686] niks3-server[1178]: 2026/09/21 13:23:48 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.ls machine # [ 147.730448] niks3-server[1178]: 2026/09/21 13:23:48 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 147.732822] niks3-server[1178]: 2026/09/21 13:23:48 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 147.733667] niks3-server[1178]: 2026/09/21 13:23:48 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete machine # [ 147.735909] niks3-server[1178]: 2026/09/21 13:23:48 INFO Completed upload id=3 machine # [ 147.746414] niks3-server[1178]: 2026/09/21 13:23:48 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.narinfo machine # [ 172.197593] niks3-server[1178]: 2026/09/21 13:24:12 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 172.252711] niks3-server[1178]: 2026/09/21 13:24:12 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 172.254284] niks3-server[1178]: 2026/09/21 13:24:12 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 172.274312] niks3-server[1178]: 2026/09/21 13:24:12 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 172.277715] niks3-server[1178]: 2026/09/21 13:24:12 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 172.279278] niks3-server[1178]: 2026/09/21 13:24:12 INFO Registered completed upload object_key=log/zfq1xw9bmycqh35l0s44lmv65z4xc7br-k3s-b.drv machine # [ 172.280963] niks3-server[1178]: 2026/09/21 13:24:12 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 172.282489] niks3-server[1178]: 2026/09/21 13:24:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign machine # [ 172.284847] niks3-server[1178]: 2026/09/21 13:24:12 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 172.286218] niks3-server[1178]: 2026/09/21 13:24:12 INFO Signed narinfos id=4 count=1 machine # [ 172.291342] niks3-server[1178]: 2026/09/21 13:24:12 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.ls machine # [ 172.293724] niks3-server[1178]: 2026/09/21 13:24:12 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 172.297238] niks3-server[1178]: 2026/09/21 13:24:12 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete machine # [ 172.298039] niks3-server[1178]: 2026/09/21 13:24:12 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 172.298749] niks3-server[1178]: 2026/09/21 13:24:12 INFO Completed upload id=4 machine # [ 172.301152] niks3-server[1178]: 2026/09/21 13:24:12 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.narinfo machine # [ 172.314679] niks3-server[1178]: 2026/09/21 13:24:13 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 172.329307] niks3-server[1178]: 2026/09/21 13:24:13 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 172.338920] niks3-server[1178]: 2026/09/21 13:24:13 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 172.405100] niks3-server[1178]: 2026/09/21 13:24:13 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 172.405864] niks3-server[1178]: 2026/09/21 13:24:13 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 172.429423] niks3-server[1178]: 2026/09/21 13:24:13 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 172.436080] niks3-server[1178]: 2026/09/21 13:24:13 INFO Registered completed upload object_key=nar/0jyw88klkf3nwxpnj5m5lx3i1dv2idf3hcn6im7883hnldm3gvyq.nar.zst machine # [ 172.441866] niks3-server[1178]: 2026/09/21 13:24:13 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 172.442629] niks3-server[1178]: 2026/09/21 13:24:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign machine # [ 172.443433] niks3-server[1178]: 2026/09/21 13:24:13 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 172.444020] niks3-server[1178]: 2026/09/21 13:24:13 INFO Signed narinfos id=5 count=1 machine # [ 172.445226] niks3-server[1178]: 2026/09/21 13:24:13 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.ls machine # [ 172.450611] niks3-server[1178]: 2026/09/21 13:24:13 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 172.452103] niks3-server[1178]: 2026/09/21 13:24:13 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete machine # [ 172.454270] niks3-server[1178]: 2026/09/21 13:24:13 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 172.455625] niks3-server[1178]: 2026/09/21 13:24:13 INFO Completed upload id=5 machine # [ 172.456873] niks3-server[1178]: 2026/09/21 13:24:13 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.narinfo machine # [ 197.516220] niks3-server[1178]: 2026/09/21 13:24:38 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 197.572626] niks3-server[1178]: 2026/09/21 13:24:38 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 197.574270] niks3-server[1178]: 2026/09/21 13:24:38 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 197.591465] niks3-server[1178]: 2026/09/21 13:24:38 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 197.598153] niks3-server[1178]: 2026/09/21 13:24:38 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 197.600331] niks3-server[1178]: 2026/09/21 13:24:38 INFO Registered completed upload object_key=nar/1q8vp5xqws560mpf8rxk8r8jhqrzibivh13x4wxy0cfqlzbk7cr5.nar.zst machine # [ 197.603157] niks3-server[1178]: 2026/09/21 13:24:38 INFO Registered completed upload object_key=log/n40czam6a4ldp1mh5fdmlcy07fv0akbm-k3s-top.drv machine # [ 197.613035] niks3-server[1178]: 2026/09/21 13:24:38 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 197.613783] niks3-server[1178]: 2026/09/21 13:24:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign machine # [ 197.615533] niks3-server[1178]: 2026/09/21 13:24:38 INFO Signed narinfos id=6 count=1 machine # [ 197.621416] niks3-server[1178]: 2026/09/21 13:24:38 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 197.623638] niks3-server[1178]: 2026/09/21 13:24:38 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 197.624863] niks3-server[1178]: 2026/09/21 13:24:38 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete machine # [ 197.626344] niks3-server[1178]: 2026/09/21 13:24:38 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 197.626917] niks3-server[1178]: 2026/09/21 13:24:38 INFO Completed upload id=6 machine # [ 197.628968] niks3-server[1178]: 2026/09/21 13:24:38 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.ls machine # [ 197.636362] niks3-server[1178]: 2026/09/21 13:24:38 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1, in 138.44 seconds) machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath, in 0.18 seconds) machine: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine: (finished: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.02 seconds) machine: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine # copying 3 paths... machine # copying path '/nix/store/r95r891injj9ski5c4w89yxjvjy065mx-k3s-a' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/mrqsh0475wxsmnsvkk55g94v6g5nrcra-k3s-b' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top' from 'http://192.168.1.1:5751'... machine: (finished: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.25 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1 machine # [ 199.308435] niks3-server[1178]: 2026/09/21 13:24:39 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 199.410731] niks3-server[1178]: 2026/09/21 13:24:40 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 199.503538] niks3-server[1178]: 2026/09/21 13:24:40 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 199.505144] niks3-server[1178]: 2026/09/21 13:24:40 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 199.526079] niks3-server[1178]: 2026/09/21 13:24:40 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 199.531139] niks3-server[1178]: 2026/09/21 13:24:40 INFO Registered completed upload object_key=nar/1fr26arhri17j9bj6hyjzmmd74v730biz1gb3kqd194vjx3ccvp9.nar.zst machine # [ 199.536832] niks3-server[1178]: 2026/09/21 13:24:40 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 199.538221] niks3-server[1178]: 2026/09/21 13:24:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign machine # [ 199.539798] niks3-server[1178]: 2026/09/21 13:24:40 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 199.542361] niks3-server[1178]: 2026/09/21 13:24:40 INFO Signed narinfos id=7 count=1 machine # [ 199.544826] niks3-server[1178]: 2026/09/21 13:24:40 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.ls machine # [ 199.556299] niks3-server[1178]: 2026/09/21 13:24:40 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 199.557327] niks3-server[1178]: 2026/09/21 13:24:40 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete machine # [ 199.558236] niks3-server[1178]: 2026/09/21 13:24:40 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 199.561476] niks3-server[1178]: 2026/09/21 13:24:40 INFO Completed upload id=7 machine # [ 199.566319] niks3-server[1178]: 2026/09/21 13:24:40 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.narinfo machine # [ 224.225391] niks3-server[1178]: 2026/09/21 13:25:04 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 224.281918] niks3-server[1178]: 2026/09/21 13:25:04 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 224.285650] niks3-server[1178]: 2026/09/21 13:25:04 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 224.302308] niks3-server[1178]: 2026/09/21 13:25:04 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 224.307788] niks3-server[1178]: 2026/09/21 13:25:04 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 224.312126] niks3-server[1178]: 2026/09/21 13:25:04 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 224.314037] niks3-server[1178]: 2026/09/21 13:25:05 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 224.315029] niks3-server[1178]: 2026/09/21 13:25:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign machine # [ 224.321696] niks3-server[1178]: 2026/09/21 13:25:05 INFO Registered completed upload object_key=log/pbpqsh50ar10fpasdqqx8xg3lmr5j8iz-k3s-a.drv machine # [ 224.323909] niks3-server[1178]: 2026/09/21 13:25:05 INFO Registered completed upload object_key=nar/1hfc6x4x25k3b0fk091d3nb0k3mympfp05fkslcx19synp3ig0zd.nar.zst machine # [ 224.324980] niks3-server[1178]: 2026/09/21 13:25:05 INFO Signed narinfos id=8 count=1 machine # [ 224.327934] niks3-server[1178]: 2026/09/21 13:25:05 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.ls machine # [ 224.331957] niks3-server[1178]: 2026/09/21 13:25:05 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 224.332825] niks3-server[1178]: 2026/09/21 13:25:05 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete machine # [ 224.333992] niks3-server[1178]: 2026/09/21 13:25:05 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 224.334481] niks3-server[1178]: 2026/09/21 13:25:05 INFO Completed upload id=8 machine # [ 224.344785] niks3-server[1178]: 2026/09/21 13:25:05 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.narinfo machine # [ 224.347415] niks3-server[1178]: 2026/09/21 13:25:05 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 224.361801] niks3-server[1178]: 2026/09/21 13:25:05 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 224.371091] niks3-server[1178]: 2026/09/21 13:25:05 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 224.436052] niks3-server[1178]: 2026/09/21 13:25:05 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 224.436845] niks3-server[1178]: 2026/09/21 13:25:05 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 224.448649] niks3-server[1178]: 2026/09/21 13:25:05 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 224.452711] niks3-server[1178]: 2026/09/21 13:25:05 INFO Registered completed upload object_key=nar/0zzq2vgjln4shvh57091n14sam6wh6w06vja6lzb9ppcj4ffyx1n.nar.zst machine # [ 224.454514] niks3-server[1178]: 2026/09/21 13:25:05 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 224.455754] niks3-server[1178]: 2026/09/21 13:25:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign machine # [ 224.456842] niks3-server[1178]: 2026/09/21 13:25:05 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 224.457940] niks3-server[1178]: 2026/09/21 13:25:05 INFO Signed narinfos id=9 count=1 machine # [ 224.459387] niks3-server[1178]: 2026/09/21 13:25:05 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.ls machine # [ 224.460099] niks3-server[1178]: 2026/09/21 13:25:05 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 224.460683] niks3-server[1178]: 2026/09/21 13:25:05 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete machine # [ 224.461770] niks3-server[1178]: 2026/09/21 13:25:05 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 224.463534] niks3-server[1178]: 2026/09/21 13:25:05 INFO Completed upload id=9 machine # [ 224.464453] niks3-server[1178]: 2026/09/21 13:25:05 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.narinfo machine # [ 248.937160] niks3-server[1178]: 2026/09/21 13:25:29 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 248.994977] niks3-server[1178]: 2026/09/21 13:25:29 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 248.995841] niks3-server[1178]: 2026/09/21 13:25:29 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 249.011648] niks3-server[1178]: 2026/09/21 13:25:29 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 249.014424] niks3-server[1178]: 2026/09/21 13:25:29 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 249.019364] niks3-server[1178]: 2026/09/21 13:25:29 INFO Registered completed upload object_key=nar/0hh3nqk95r6g32lhdmxw8cxjv694vbpx9876zkhcpg4r4qxni2ch.nar.zst machine # [ 249.021839] niks3-server[1178]: 2026/09/21 13:25:29 INFO Registered completed upload object_key=log/894h6wzw2l4w5f0hikj1k6q57jfnyi87-k3s-b.drv machine # [ 249.030083] niks3-server[1178]: 2026/09/21 13:25:29 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 249.031020] niks3-server[1178]: 2026/09/21 13:25:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign machine # [ 249.031797] niks3-server[1178]: 2026/09/21 13:25:29 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 249.035663] niks3-server[1178]: 2026/09/21 13:25:29 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.ls machine # [ 249.043674] niks3-server[1178]: 2026/09/21 13:25:29 INFO Signed narinfos id=10 count=1 machine # [ 249.052289] niks3-server[1178]: 2026/09/21 13:25:29 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 249.053871] niks3-server[1178]: 2026/09/21 13:25:29 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 249.055507] niks3-server[1178]: 2026/09/21 13:25:29 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete machine # [ 249.061287] niks3-server[1178]: 2026/09/21 13:25:29 INFO Completed upload id=10 machine # [ 249.070107] niks3-server[1178]: 2026/09/21 13:25:29 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 249.072955] niks3-server[1178]: 2026/09/21 13:25:29 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.narinfo machine # [ 249.087054] niks3-server[1178]: 2026/09/21 13:25:29 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 249.097673] niks3-server[1178]: 2026/09/21 13:25:29 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 249.163578] niks3-server[1178]: 2026/09/21 13:25:29 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 249.164785] niks3-server[1178]: 2026/09/21 13:25:29 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 249.174214] niks3-server[1178]: 2026/09/21 13:25:29 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 249.179869] niks3-server[1178]: 2026/09/21 13:25:29 INFO Registered completed upload object_key=nar/0ingamx56k31lwiyxmnxmscjj4n3qfx6sr2kpaynsrwhwz1278iw.nar.zst machine # [ 249.180605] niks3-server[1178]: 2026/09/21 13:25:29 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 249.183954] niks3-server[1178]: 2026/09/21 13:25:29 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 249.185559] niks3-server[1178]: 2026/09/21 13:25:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign machine # [ 249.187240] niks3-server[1178]: 2026/09/21 13:25:29 INFO Signed narinfos id=11 count=1 machine # [ 249.188723] niks3-server[1178]: 2026/09/21 13:25:29 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.ls machine # [ 249.191434] niks3-server[1178]: 2026/09/21 13:25:29 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 249.193489] niks3-server[1178]: 2026/09/21 13:25:29 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 249.196105] niks3-server[1178]: 2026/09/21 13:25:29 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete machine # [ 249.197896] niks3-server[1178]: 2026/09/21 13:25:29 INFO Completed upload id=11 machine # [ 249.198964] niks3-server[1178]: 2026/09/21 13:25:29 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.narinfo machine # [ 273.653411] niks3-server[1178]: 2026/09/21 13:25:54 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 273.715749] niks3-server[1178]: 2026/09/21 13:25:54 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 273.717927] niks3-server[1178]: 2026/09/21 13:25:54 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 273.729631] niks3-server[1178]: 2026/09/21 13:25:54 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 273.733713] niks3-server[1178]: 2026/09/21 13:25:54 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 273.737936] niks3-server[1178]: 2026/09/21 13:25:54 INFO Registered completed upload object_key=log/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g-k3s-top.drv machine # [ 273.743127] niks3-server[1178]: 2026/09/21 13:25:54 INFO Registered completed upload object_key=nar/0v48x4sp58bvfra08axgkz7yl1n9nc4nirskyv1hwann4i7q277i.nar.zst machine # [ 273.748265] niks3-server[1178]: 2026/09/21 13:25:54 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 273.751984] niks3-server[1178]: 2026/09/21 13:25:54 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 273.755287] niks3-server[1178]: 2026/09/21 13:25:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign machine # [ 273.758866] niks3-server[1178]: 2026/09/21 13:25:54 INFO Signed narinfos id=12 count=1 machine # [ 273.761751] niks3-server[1178]: 2026/09/21 13:25:54 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.ls machine # [ 273.764773] niks3-server[1178]: 2026/09/21 13:25:54 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 273.767611] niks3-server[1178]: 2026/09/21 13:25:54 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 273.770291] niks3-server[1178]: 2026/09/21 13:25:54 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete machine # [ 273.773823] niks3-server[1178]: 2026/09/21 13:25:54 INFO Completed upload id=12 machine # [ 273.775781] niks3-server[1178]: 2026/09/21 13:25:54 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1, in 74.65 seconds) (finished: subtest: build through the balancer lands in the cache, in 213.55 seconds) subtest: a Job with the client image builds through the farm with its service account machine: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine: (finished: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.15 seconds) machine: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix machine: (finished: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix, in 0.13 seconds) machine: must succeed: kubectl apply -f /nix/store/r1c20r6fvmcx0m38prrp0nbq0k6mls0f-ci-job.json machine: (finished: must succeed: kubectl apply -f /nix/store/r1c20r6fvmcx0m38prrp0nbq0k6mls0f-ci-job.json, in 0.16 seconds) machine: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed' machine # [ 274.404714] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod519ebead_908e_49db_864c_2a198c1e287f.slice. machine # [ 274.489288] k3s[875]: I0921 13:25:55.176635 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9sg9\" (UniqueName: \"kubernetes.io/projected/519ebead-908e-49db-864c-2a198c1e287f-kube-api-access-j9sg9\") pod \"ci-rxv5f\" (UID: \"519ebead-908e-49db-864c-2a198c1e287f\") " pod="ci/ci-rxv5f" machine # [ 274.489696] k3s[875]: I0921 13:25:55.176699 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"job\" (UniqueName: \"kubernetes.io/configmap/519ebead-908e-49db-864c-2a198c1e287f-job\") pod \"ci-rxv5f\" (UID: \"519ebead-908e-49db-864c-2a198c1e287f\") " pod="ci/ci-rxv5f" machine # [ 274.490175] k3s[875]: I0921 13:25:55.176730 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/519ebead-908e-49db-864c-2a198c1e287f-nix-grpc-farm\") pod \"ci-rxv5f\" (UID: \"519ebead-908e-49db-864c-2a198c1e287f\") " pod="ci/ci-rxv5f" machine # [ 275.798399] cni0: port 2(veth449d9f01) entered blocking state machine # [ 275.802607] cni0: port 2(veth449d9f01) entered disabled state machine # [ 275.803918] veth449d9f01: entered allmulticast mode machine # [ 275.804972] veth449d9f01: entered promiscuous mode machine # [ 275.816754] cni0: port 2(veth449d9f01) entered blocking state machine # [ 275.817878] cni0: port 2(veth449d9f01) entered forwarding state machine # [ 275.695493] (udev-worker)[4817]: Network interface NamePolicy= disabled on kernel command line. machine # [ 275.727611] dhcpcd[3284]: veth449d9f01: IAID 1e:e4:eb:d0 machine # [ 275.728522] dhcpcd[3284]: veth449d9f01: adding address fe80::3400:1eff:fee4:ebd0 machine # [ 275.755466] systemd[1]: Started libcontainer container 585746c9dc356c57788d08ee3336c60dfe60ca0e7bd060028b346f072844cc60. machine # [ 277.111454] dhcpcd[3284]: veth449d9f01: soliciting a DHCP lease machine # [ 277.186607] dhcpcd[3284]: veth449d9f01: soliciting an IPv6 router machine # [ 277.749124] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount2782534451.mount: Deactivated successfully. machine # [ 277.835739] systemd[1]: Started libcontainer container 9bf6b9c9a96a8f95b2b6617794a10f0dbab4f0450483afd358f59ad2c4f113c3. machine # [ 279.145856] niks3-server[1178]: 2026/09/21 13:25:59 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 279.187272] niks3-server[1178]: 2026/09/21 13:25:59 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 279.269788] niks3-server[1178]: 2026/09/21 13:25:59 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 279.271345] niks3-server[1178]: 2026/09/21 13:25:59 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 279.278260] niks3-server[1178]: 2026/09/21 13:25:59 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 279.282897] niks3-server[1178]: 2026/09/21 13:25:59 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 279.283644] niks3-server[1178]: 2026/09/21 13:25:59 INFO Registered completed upload object_key=nar/111g6dyibwcf2z7jhpn72rgja0qvjgpdiv9nc06g2dp7ih0a6kyq.nar.zst machine # [ 279.284400] niks3-server[1178]: 2026/09/21 13:25:59 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 279.284872] niks3-server[1178]: 2026/09/21 13:25:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign machine # [ 279.285704] niks3-server[1178]: 2026/09/21 13:25:59 INFO Signed narinfos id=13 count=1 machine # [ 279.288348] niks3-server[1178]: 2026/09/21 13:25:59 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.ls machine # [ 279.291750] niks3-server[1178]: 2026/09/21 13:25:59 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 279.292244] niks3-server[1178]: 2026/09/21 13:25:59 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete machine # [ 279.292960] niks3-server[1178]: 2026/09/21 13:25:59 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 279.296582] niks3-server[1178]: 2026/09/21 13:25:59 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.narinfo machine # [ 279.298385] niks3-server[1178]: 2026/09/21 13:25:59 INFO Completed upload id=13 machine # [ 282.112817] dhcpcd[3284]: veth449d9f01: probing for an IPv4LL address machine # [ 287.769974] dhcpcd[3284]: veth449d9f01: using IPv4LL address 169.254.149.2 machine # [ 287.771134] dhcpcd[3284]: veth449d9f01: adding route to 169.254.0.0/16 machine # [ 289.190902] dhcpcd[3284]: veth449d9f01: no IPv6 Routers available machine # [ 304.558117] niks3-server[1178]: 2026/09/21 13:26:25 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 304.618089] niks3-server[1178]: 2026/09/21 13:26:25 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 304.619231] niks3-server[1178]: 2026/09/21 13:26:25 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 304.637909] niks3-server[1178]: 2026/09/21 13:26:25 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 304.645312] niks3-server[1178]: 2026/09/21 13:26:25 INFO Registered completed upload object_key=nar/058kjd2vfl1r27b4d9ixvwf77d8rkr18a4v894kwx8lg0nwpajnr.nar.zst machine # [ 304.651812] niks3-server[1178]: 2026/09/21 13:26:25 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 304.653243] niks3-server[1178]: 2026/09/21 13:26:25 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 304.655085] niks3-server[1178]: 2026/09/21 13:26:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign machine # [ 304.656450] niks3-server[1178]: 2026/09/21 13:26:25 INFO Signed narinfos id=14 count=1 machine # [ 304.658348] niks3-server[1178]: 2026/09/21 13:26:25 INFO Registered completed upload object_key=log/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # [ 304.663863] niks3-server[1178]: 2026/09/21 13:26:25 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 304.665243] niks3-server[1178]: 2026/09/21 13:26:25 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete machine # [ 304.666850] niks3-server[1178]: 2026/09/21 13:26:25 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 304.669623] niks3-server[1178]: 2026/09/21 13:26:25 INFO Completed upload id=14 machine # [ 304.679366] niks3-server[1178]: 2026/09/21 13:26:25 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 304.684481] niks3-server[1178]: 2026/09/21 13:26:25 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 304.686364] niks3-server[1178]: 2026/09/21 13:26:25 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.narinfo machine # [ 304.696535] niks3-server[1178]: 2026/09/21 13:26:25 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 304.705813] niks3-server[1178]: 2026/09/21 13:26:25 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 304.773754] niks3-server[1178]: 2026/09/21 13:26:25 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 304.774508] niks3-server[1178]: 2026/09/21 13:26:25 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 304.786625] niks3-server[1178]: 2026/09/21 13:26:25 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 304.792186] niks3-server[1178]: 2026/09/21 13:26:25 INFO Registered completed upload object_key=nar/138ynhcd5wxzz485x9qcq7xsargaklrf2li31ai69m5r46am35q6.nar.zst machine # [ 304.796363] niks3-server[1178]: 2026/09/21 13:26:25 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 304.796811] niks3-server[1178]: 2026/09/21 13:26:25 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 304.797448] niks3-server[1178]: 2026/09/21 13:26:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign machine # [ 304.800651] niks3-server[1178]: 2026/09/21 13:26:25 INFO Signed narinfos id=15 count=1 machine # [ 304.804382] niks3-server[1178]: 2026/09/21 13:26:25 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.ls machine # [ 304.808369] niks3-server[1178]: 2026/09/21 13:26:25 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 304.810223] niks3-server[1178]: 2026/09/21 13:26:25 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete machine # [ 304.811650] niks3-server[1178]: 2026/09/21 13:26:25 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 304.813882] niks3-server[1178]: 2026/09/21 13:26:25 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.narinfo machine # [ 304.814809] niks3-server[1178]: 2026/09/21 13:26:25 INFO Completed upload id=15 machine # [ 310.597126] postgres[764]: [764] LOG: checkpoint starting: time machine # [ 329.680828] niks3-server[1178]: 2026/09/21 13:26:50 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 329.731650] niks3-server[1178]: 2026/09/21 13:26:50 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 329.733305] niks3-server[1178]: 2026/09/21 13:26:50 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 329.752711] niks3-server[1178]: 2026/09/21 13:26:50 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 329.754061] niks3-server[1178]: 2026/09/21 13:26:50 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 329.758061] niks3-server[1178]: 2026/09/21 13:26:50 INFO Registered completed upload object_key=log/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # [ 329.763208] niks3-server[1178]: 2026/09/21 13:26:50 INFO Registered completed upload object_key=nar/0n4lbdlp8w72fs3qbavl2lwrzbrn55i2b1vyglc89cc3pi8vbb1m.nar.zst machine # [ 329.769058] niks3-server[1178]: 2026/09/21 13:26:50 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 329.769850] niks3-server[1178]: 2026/09/21 13:26:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign machine # [ 329.770493] niks3-server[1178]: 2026/09/21 13:26:50 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 329.773174] niks3-server[1178]: 2026/09/21 13:26:50 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.ls machine # [ 329.775130] niks3-server[1178]: 2026/09/21 13:26:50 INFO Signed narinfos id=16 count=1 machine # [ 329.781085] niks3-server[1178]: 2026/09/21 13:26:50 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 329.781700] niks3-server[1178]: 2026/09/21 13:26:50 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete machine # [ 329.782261] niks3-server[1178]: 2026/09/21 13:26:50 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 329.784283] niks3-server[1178]: 2026/09/21 13:26:50 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo machine # [ 329.789924] niks3-server[1178]: 2026/09/21 13:26:50 INFO Completed upload id=16 machine # [ 329.798056] niks3-server[1178]: 2026/09/21 13:26:50 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 329.814682] niks3-server[1178]: 2026/09/21 13:26:50 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 329.825680] niks3-server[1178]: 2026/09/21 13:26:50 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 329.889549] niks3-server[1178]: 2026/09/21 13:26:50 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 329.889972] niks3-server[1178]: 2026/09/21 13:26:50 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 329.900133] niks3-server[1178]: 2026/09/21 13:26:50 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 329.903287] niks3-server[1178]: 2026/09/21 13:26:50 INFO Registered completed upload object_key=nar/1f3gvnvqsm2pm3laixkxkg44kvjb251zqhszcfpp0a00h6x66ljs.nar.zst machine # [ 329.905962] niks3-server[1178]: 2026/09/21 13:26:50 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 329.906644] niks3-server[1178]: 2026/09/21 13:26:50 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 329.907152] niks3-server[1178]: 2026/09/21 13:26:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign machine # [ 329.910096] niks3-server[1178]: 2026/09/21 13:26:50 INFO Signed narinfos id=17 count=1 machine # [ 329.912162] niks3-server[1178]: 2026/09/21 13:26:50 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 329.912825] niks3-server[1178]: 2026/09/21 13:26:50 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete machine # [ 329.913623] niks3-server[1178]: 2026/09/21 13:26:50 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 329.914161] niks3-server[1178]: 2026/09/21 13:26:50 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.ls machine # [ 329.915044] niks3-server[1178]: 2026/09/21 13:26:50 INFO Completed upload id=17 machine # [ 355.179500] niks3-server[1178]: 2026/09/21 13:27:15 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 355.240503] niks3-server[1178]: 2026/09/21 13:27:15 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 355.241698] niks3-server[1178]: 2026/09/21 13:27:15 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 355.260127] niks3-server[1178]: 2026/09/21 13:27:15 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 355.267748] niks3-server[1178]: 2026/09/21 13:27:15 INFO Registered completed upload object_key=nar/1zwf0asrdv12q40fmqga5lx5330dvn9y4in4i9ficz9ij5lhvnf5.nar.zst machine # [ 355.270414] niks3-server[1178]: 2026/09/21 13:27:15 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 355.272742] niks3-server[1178]: 2026/09/21 13:27:15 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 355.273736] niks3-server[1178]: 2026/09/21 13:27:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign machine # [ 355.274406] niks3-server[1178]: 2026/09/21 13:27:15 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 355.278083] niks3-server[1178]: 2026/09/21 13:27:15 INFO Signed narinfos id=18 count=1 machine # [ 355.279914] niks3-server[1178]: 2026/09/21 13:27:15 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.ls machine # [ 355.281994] niks3-server[1178]: 2026/09/21 13:27:15 INFO Registered completed upload object_key=log/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # [ 355.289755] niks3-server[1178]: 2026/09/21 13:27:15 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 355.290882] niks3-server[1178]: 2026/09/21 13:27:15 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 355.292922] niks3-server[1178]: 2026/09/21 13:27:15 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete machine # [ 355.295822] niks3-server[1178]: 2026/09/21 13:27:15 INFO Completed upload id=18 machine # [ 355.299276] niks3-server[1178]: 2026/09/21 13:27:15 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo machine # [ 357.889631] niks3-server[1178]: 2026/09/21 13:27:18 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 357.921067] niks3-server[1178]: 2026/09/21 13:27:18 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 357.988332] niks3-server[1178]: 2026/09/21 13:27:18 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 357.989639] niks3-server[1178]: 2026/09/21 13:27:18 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 358.001859] niks3-server[1178]: 2026/09/21 13:27:18 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 358.006253] niks3-server[1178]: 2026/09/21 13:27:18 INFO Registered completed upload object_key=nar/0xiyqcsl8db7dnrq2gqnx5izavr51ma3dcdswrriaxfgj3qzk7xf.nar.zst machine # [ 358.008345] niks3-server[1178]: 2026/09/21 13:27:18 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 358.009709] niks3-server[1178]: 2026/09/21 13:27:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign machine # [ 358.011484] niks3-server[1178]: 2026/09/21 13:27:18 INFO Signed narinfos id=19 count=1 machine # [ 358.012708] niks3-server[1178]: 2026/09/21 13:27:18 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 358.014190] niks3-server[1178]: 2026/09/21 13:27:18 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.ls machine # [ 358.016070] niks3-server[1178]: 2026/09/21 13:27:18 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 358.019094] niks3-server[1178]: 2026/09/21 13:27:18 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 358.019795] niks3-server[1178]: 2026/09/21 13:27:18 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete machine # [ 358.020468] niks3-server[1178]: 2026/09/21 13:27:18 INFO Completed upload id=19 machine # [ 358.021543] niks3-server[1178]: 2026/09/21 13:27:18 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.narinfo machine # [ 383.081238] niks3-server[1178]: 2026/09/21 13:27:43 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 383.137474] niks3-server[1178]: 2026/09/21 13:27:43 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 383.139224] niks3-server[1178]: 2026/09/21 13:27:43 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 383.155163] niks3-server[1178]: 2026/09/21 13:27:43 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 383.160071] niks3-server[1178]: 2026/09/21 13:27:43 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 383.163766] niks3-server[1178]: 2026/09/21 13:27:43 INFO Registered completed upload object_key=nar/0p3l2z3riilylr2rxb1aq2blxdfxg55wbgp4gxkns93srbr4bwyq.nar.zst machine # [ 383.169259] niks3-server[1178]: 2026/09/21 13:27:43 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 383.172644] niks3-server[1178]: 2026/09/21 13:27:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign machine # [ 383.176329] niks3-server[1178]: 2026/09/21 13:27:43 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 383.179264] niks3-server[1178]: 2026/09/21 13:27:43 INFO Signed narinfos id=20 count=1 machine # [ 383.181750] niks3-server[1178]: 2026/09/21 13:27:43 INFO Registered completed upload object_key=log/fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # [ 383.189160] niks3-server[1178]: 2026/09/21 13:27:43 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.ls machine # [ 383.189904] niks3-server[1178]: 2026/09/21 13:27:43 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 383.191245] niks3-server[1178]: 2026/09/21 13:27:43 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete machine # [ 383.191963] niks3-server[1178]: 2026/09/21 13:27:43 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 383.193317] niks3-server[1178]: 2026/09/21 13:27:43 INFO Completed upload id=20 machine # [ 383.193988] niks3-server[1178]: 2026/09/21 13:27:43 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo machine # [ 384.370579] systemd[1]: cri-containerd-9bf6b9c9a96a8f95b2b6617794a10f0dbab4f0450483afd358f59ad2c4f113c3.scope: Deactivated successfully. machine # [ 384.372656] systemd[1]: cri-containerd-9bf6b9c9a96a8f95b2b6617794a10f0dbab4f0450483afd358f59ad2c4f113c3.scope: Consumed 1.061s CPU time over 1min 46.534s wall clock time, 130.1M memory peak, 60.5M read from disk, 428K written to disk, 16.5K incoming IP traffic, 44.2K outgoing IP traffic. machine # [ 384.423289] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-9bf6b9c9a96a8f95b2b6617794a10f0dbab4f0450483afd358f59ad2c4f113c3-rootfs.mount: Deactivated successfully. machine # [ 386.418146] systemd[1]: cri-containerd-585746c9dc356c57788d08ee3336c60dfe60ca0e7bd060028b346f072844cc60.scope: Deactivated successfully. machine # [ 386.451783] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-585746c9dc356c57788d08ee3336c60dfe60ca0e7bd060028b346f072844cc60-rootfs.mount: Deactivated successfully. machine # [ 386.480167] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-585746c9dc356c57788d08ee3336c60dfe60ca0e7bd060028b346f072844cc60-shm.mount: Deactivated successfully. machine # [ 386.661157] cni0: port 2(veth449d9f01) entered disabled state machine # [ 386.510198] dhcpcd[3284]: veth449d9f01: carrier lost machine # [ 386.663515] veth449d9f01 (unregistering): left allmulticast mode machine # [ 386.664807] veth449d9f01 (unregistering): left promiscuous mode machine # [ 386.665979] cni0: port 2(veth449d9f01) entered disabled state machine # [ 386.532603] systemd[1]: run-netns-cni\x2db247c031\x2d6e06\x2d6cdf\x2de64b\x2df930f938db7c.mount: Deactivated successfully. machine # [ 386.538835] dhcpcd[3284]: veth449d9f01: deleting address fe80::3400:1eff:fee4:ebd0 machine # [ 386.541174] dhcpcd[3284]: veth449d9f01: deleting route to 169.254.0.0/16 machine # [ 386.602605] k3s[875]: I0921 13:27:47.290079 875 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/519ebead-908e-49db-864c-2a198c1e287f-nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/519ebead-908e-49db-864c-2a198c1e287f-nix-grpc-farm\") pod \"519ebead-908e-49db-864c-2a198c1e287f\" (UID: \"519ebead-908e-49db-864c-2a198c1e287f\") " machine # [ 386.606968] k3s[875]: I0921 13:27:47.290140 875 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/519ebead-908e-49db-864c-2a198c1e287f-kube-api-access-j9sg9\" (UniqueName: \"kubernetes.io/projected/519ebead-908e-49db-864c-2a198c1e287f-kube-api-access-j9sg9\") pod \"519ebead-908e-49db-864c-2a198c1e287f\" (UID: \"519ebead-908e-49db-864c-2a198c1e287f\") " machine # [ 386.611456] k3s[875]: I0921 13:27:47.290198 875 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/519ebead-908e-49db-864c-2a198c1e287f-job\" (UniqueName: \"kubernetes.io/configmap/519ebead-908e-49db-864c-2a198c1e287f-job\") pod \"519ebead-908e-49db-864c-2a198c1e287f\" (UID: \"519ebead-908e-49db-864c-2a198c1e287f\") " machine # [ 386.615508] k3s[875]: I0921 13:27:47.290668 875 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/519ebead-908e-49db-864c-2a198c1e287f-job" pod "519ebead-908e-49db-864c-2a198c1e287f" (UID: "519ebead-908e-49db-864c-2a198c1e287f"). InnerVolumeSpecName "job". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 386.619487] k3s[875]: I0921 13:27:47.296431 875 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/519ebead-908e-49db-864c-2a198c1e287f-nix-grpc-farm" pod "519ebead-908e-49db-864c-2a198c1e287f" (UID: "519ebead-908e-49db-864c-2a198c1e287f"). InnerVolumeSpecName "nix-grpc-farm". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 386.623662] systemd[1]: var-lib-kubelet-pods-519ebead\x2d908e\x2d49db\x2d864c\x2d2a198c1e287f-volumes-kubernetes.io\x7eprojected-nix\x2dgrpc\x2dfarm.mount: Deactivated successfully. machine # [ 386.625761] dhcpcd[3284]: veth449d9f01: removing interface machine # [ 386.626572] k3s[875]: I0921 13:27:47.299845 875 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/519ebead-908e-49db-864c-2a198c1e287f-kube-api-access-j9sg9" pod "519ebead-908e-49db-864c-2a198c1e287f" (UID: "519ebead-908e-49db-864c-2a198c1e287f"). InnerVolumeSpecName "kube-api-access-j9sg9". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 386.630739] systemd[1]: var-lib-kubelet-pods-519ebead\x2d908e\x2d49db\x2d864c\x2d2a198c1e287f-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dj9sg9.mount: Deactivated successfully. machine # [ 386.702834] k3s[875]: I0921 13:27:47.390501 875 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9sg9\" (UniqueName: \"kubernetes.io/projected/519ebead-908e-49db-864c-2a198c1e287f-kube-api-access-j9sg9\") on node \"machine\" DevicePath \"\"" machine # [ 386.705891] k3s[875]: I0921 13:27:47.390538 875 reconciler_common.go:299] "Volume detached for volume \"job\" (UniqueName: \"kubernetes.io/configmap/519ebead-908e-49db-864c-2a198c1e287f-job\") on node \"machine\" DevicePath \"\"" machine # [ 386.708515] k3s[875]: I0921 13:27:47.390555 875 reconciler_common.go:299] "Volume detached for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/519ebead-908e-49db-864c-2a198c1e287f-nix-grpc-farm\") on node \"machine\" DevicePath \"\"" machine # [ 386.735221] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod519ebead_908e_49db_864c_2a198c1e287f.slice. machine # [ 386.736178] systemd[1]: kubepods-besteffort-pod519ebead_908e_49db_864c_2a198c1e287f.slice: Consumed 1.091s CPU time over 1min 52.330s wall clock time, 130.3M memory peak, 60.5M read from disk, 632K written to disk, 16.5K incoming IP traffic, 44.2K outgoing IP traffic. machine # [ 387.412100] k3s[875]: I0921 13:27:48.099681 875 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="585746c9dc356c57788d08ee3336c60dfe60ca0e7bd060028b346f072844cc60" machine: (finished: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed', in 113.38 seconds) machine: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1 machine: (finished: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1, in 0.14 seconds) machine # don't know how to build these paths: machine # /nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-a> machine/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-s2grm: building fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-b> machine/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-s2grm: building 1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-top> machine/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-s2grm: building rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # INFO:nix_fast_build.processes:run nix-eval-jobs --gc-roots-dir /tmp/tmpklwzptrp/gcroots --force-recurse --max-memory-size 4096 --workers 4 --flake '.#checks' --check-cache-status machine # INFO:nix_fast_build.workers:builds: 0 machine # warning: Git tree '/tmp' is dirty machine # warning: Git tree '/tmp' is dirty machine # ▶ x86_64-linux.t started machine # INFO:nix_fast_build.workers:builds: 2 machine # ✔ x86_64-linux.t (27s) machine # x86_64-linux.t> machine/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-hn285: building fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # warning: Git tree '/tmp' is dirty machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath, in 0.17 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null, in 0.04 seconds) (finished: subtest: a Job with the client image builds through the farm with its service account, in 114.87 seconds) subtest: a renewed balancer certificate is served without a rollout machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f - machine # Warning: resource secrets/farm-lb-tls is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically. machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f -, in 0.29 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}', in 0.43 seconds) machine: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-68c8f49bd6-d25vm -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine # [ 389.649220] k3s[875]: E0921 13:27:50.336346 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55928: use of closed network connection machine # [ 390.977172] k3s[875]: E0921 13:27:51.664242 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55942: use of closed network connection machine # [ 392.305668] k3s[875]: E0921 13:27:52.992940 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55972: use of closed network connection machine # [ 393.600422] k3s[875]: E0921 13:27:54.287711 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:49238: use of closed network connection machine # [ 394.871462] k3s[875]: E0921 13:27:55.558898 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:49260: use of closed network connection machine # [ 396.176334] k3s[875]: E0921 13:27:56.863671 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:49284: use of closed network connection machine # [ 397.512418] k3s[875]: E0921 13:27:58.199393 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:49306: use of closed network connection machine # [ 398.822903] k3s[875]: E0921 13:27:59.510342 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:49336: use of closed network connection machine # [ 400.109686] k3s[875]: E0921 13:28:00.797002 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:49362: use of closed network connection machine # [ 401.401840] k3s[875]: E0921 13:28:02.088651 875 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:36544->127.0.0.1:10010: write tcp 127.0.0.1:36544->127.0.0.1:10010: write: connection reset by peer machine # [ 401.403113] k3s[875]: E0921 13:28:02.088834 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:49394: use of closed network connection machine # [ 401.404203] k3s[875]: time="2026-09-21T13:28:02Z" level=warning msg="Proxy error: read failed: read tcp 127.0.0.1:55310->127.0.0.1:10250: read: connection reset by peer" machine # [ 402.728344] k3s[875]: E0921 13:28:03.415732 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:49420: use of closed network connection machine # [ 404.060910] k3s[875]: E0921 13:28:04.748314 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60502: use of closed network connection machine # [ 405.376431] k3s[875]: E0921 13:28:06.063600 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60542: use of closed network connection machine # [ 406.689344] k3s[875]: E0921 13:28:07.376704 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60580: use of closed network connection machine # [ 407.992225] k3s[875]: E0921 13:28:08.679047 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60614: use of closed network connection machine # [ 409.326226] k3s[875]: E0921 13:28:10.013291 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60634: use of closed network connection machine # [ 410.618969] k3s[875]: E0921 13:28:11.306161 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60668: use of closed network connection machine # [ 410.620255] k3s[875]: E0921 13:28:11.306301 875 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:56158->127.0.0.1:10010: write tcp 127.0.0.1:56158->127.0.0.1:10010: write: broken pipe machine # [ 411.953621] k3s[875]: E0921 13:28:12.641047 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60702: use of closed network connection machine # [ 411.955711] k3s[875]: E0921 13:28:12.641702 875 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:56162->127.0.0.1:10010: write tcp 127.0.0.1:56162->127.0.0.1:10010: write: connection reset by peer machine # [ 413.283498] k3s[875]: E0921 13:28:13.970570 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58120: use of closed network connection machine # [ 414.604655] k3s[875]: E0921 13:28:15.291610 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58146: use of closed network connection machine # [ 414.834922] postgres[764]: [764] LOG: checkpoint complete: wrote 1037 buffers (6.3%), wrote 3 SLRU buffers; 1 WAL file(s) added, 0 removed, 0 recycled; write=104.124 s, sync=0.075 s, total=104.239 s; sync files=364, longest=0.005 s, average=0.001 s; distance=4978 kB, estimate=4978 kB; lsn=0/1C71130, redo lsn=0/1C42A90 machine # [ 415.942988] k3s[875]: E0921 13:28:16.630364 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58166: use of closed network connection machine # [ 417.286625] k3s[875]: E0921 13:28:17.974043 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58200: use of closed network connection machine # [ 418.576582] k3s[875]: E0921 13:28:19.263234 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58242: use of closed network connection machine # [ 418.578056] k3s[875]: E0921 13:28:19.263762 875 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:41846->127.0.0.1:10010: write tcp 127.0.0.1:41846->127.0.0.1:10010: write: broken pipe machine # [ 419.856843] k3s[875]: E0921 13:28:20.543976 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58284: use of closed network connection machine # [ 421.160746] k3s[875]: E0921 13:28:21.847996 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58308: use of closed network connection machine # [ 422.435919] k3s[875]: E0921 13:28:23.122939 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58328: use of closed network connection machine # [ 425.070852] k3s[875]: E0921 13:28:25.758227 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:42338: use of closed network connection machine # [ 426.369764] k3s[875]: E0921 13:28:27.057190 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:42360: use of closed network connection machine # [ 427.695874] k3s[875]: E0921 13:28:28.383287 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:42378: use of closed network connection machine # [ 428.982971] k3s[875]: E0921 13:28:29.670259 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:42418: use of closed network connection machine # [ 430.295235] k3s[875]: E0921 13:28:30.982313 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:42444: use of closed network connection machine # [ 430.298384] k3s[875]: E0921 13:28:30.982374 875 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:55824->127.0.0.1:10010: write tcp 127.0.0.1:55824->127.0.0.1:10010: write: broken pipe machine # [ 431.617451] k3s[875]: E0921 13:28:32.304780 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:42464: use of closed network connection machine # [ 432.922393] k3s[875]: E0921 13:28:33.609645 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:42486: use of closed network connection machine # [ 434.270528] k3s[875]: E0921 13:28:34.957773 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:47934: use of closed network connection machine # [ 435.567368] k3s[875]: time="2026-09-21T13:28:36Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:60788->127.0.0.1:10250: write: broken pipe" machine # [ 438.194579] k3s[875]: E0921 13:28:38.881513 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:48002: use of closed network connection machine # [ 439.531392] k3s[875]: E0921 13:28:40.218481 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:48032: use of closed network connection machine: (finished: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-68c8f49bd6-d25vm -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 50.16 seconds) machine: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine: (finished: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 0.04 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1 machine # [ 439.714865] niks3-server[1178]: 2026/09/21 13:28:40 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 439.744981] niks3-server[1178]: 2026/09/21 13:28:40 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 439.811155] niks3-server[1178]: 2026/09/21 13:28:40 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 439.812044] niks3-server[1178]: 2026/09/21 13:28:40 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 439.821550] niks3-server[1178]: 2026/09/21 13:28:40 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 439.825843] niks3-server[1178]: 2026/09/21 13:28:40 INFO Registered completed upload object_key=nar/0g42hgwa9jp9abmqxz90dkwxpybsznzbpsy35rm921mlk5sw56jq.nar.zst machine # [ 439.827910] niks3-server[1178]: 2026/09/21 13:28:40 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 439.829445] niks3-server[1178]: 2026/09/21 13:28:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign machine # [ 439.829836] niks3-server[1178]: 2026/09/21 13:28:40 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 439.832070] niks3-server[1178]: 2026/09/21 13:28:40 INFO Signed narinfos id=21 count=1 machine # [ 439.832860] niks3-server[1178]: 2026/09/21 13:28:40 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.ls machine # [ 439.834599] niks3-server[1178]: 2026/09/21 13:28:40 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 439.835896] niks3-server[1178]: 2026/09/21 13:28:40 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 439.837948] niks3-server[1178]: 2026/09/21 13:28:40 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete machine # [ 439.839755] niks3-server[1178]: 2026/09/21 13:28:40 INFO Completed upload id=21 machine # [ 439.841447] niks3-server[1178]: 2026/09/21 13:28:40 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.narinfo machine # [ 464.514189] niks3-server[1178]: 2026/09/21 13:29:05 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 464.575979] niks3-server[1178]: 2026/09/21 13:29:05 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 464.578186] niks3-server[1178]: 2026/09/21 13:29:05 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 464.598942] niks3-server[1178]: 2026/09/21 13:29:05 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 464.600478] niks3-server[1178]: 2026/09/21 13:29:05 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 464.607610] niks3-server[1178]: 2026/09/21 13:29:05 INFO Registered completed upload object_key=nar/1vxmmzwi16s4iri6dcmi9v62dpq1ys7wz15b497ncik3sd67nfzg.nar.zst machine # [ 464.609959] niks3-server[1178]: 2026/09/21 13:29:05 INFO Registered completed upload object_key=log/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31-k3s-a.drv machine # [ 464.612057] niks3-server[1178]: 2026/09/21 13:29:05 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 464.614509] niks3-server[1178]: 2026/09/21 13:29:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign machine # [ 464.616089] niks3-server[1178]: 2026/09/21 13:29:05 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 464.616910] niks3-server[1178]: 2026/09/21 13:29:05 INFO Signed narinfos id=22 count=1 machine # [ 464.619381] niks3-server[1178]: 2026/09/21 13:29:05 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.ls machine # [ 464.623832] niks3-server[1178]: 2026/09/21 13:29:05 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 464.625054] niks3-server[1178]: 2026/09/21 13:29:05 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 464.625912] niks3-server[1178]: 2026/09/21 13:29:05 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete machine # [ 464.627365] niks3-server[1178]: 2026/09/21 13:29:05 INFO Completed upload id=22 machine # [ 464.630441] niks3-server[1178]: 2026/09/21 13:29:05 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo machine # [ 464.643404] niks3-server[1178]: 2026/09/21 13:29:05 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 464.661464] niks3-server[1178]: 2026/09/21 13:29:05 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 464.671648] niks3-server[1178]: 2026/09/21 13:29:05 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 464.736167] niks3-server[1178]: 2026/09/21 13:29:05 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 464.736748] niks3-server[1178]: 2026/09/21 13:29:05 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 464.747395] niks3-server[1178]: 2026/09/21 13:29:05 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 464.752046] niks3-server[1178]: 2026/09/21 13:29:05 INFO Registered completed upload object_key=nar/0cbxkyxz068xc5mivh2h67kw6y01n1x28cbs11v1a03g8m4c71zm.nar.zst machine # [ 464.753191] niks3-server[1178]: 2026/09/21 13:29:05 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 464.754968] niks3-server[1178]: 2026/09/21 13:29:05 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 464.755620] niks3-server[1178]: 2026/09/21 13:29:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign machine # [ 464.756180] niks3-server[1178]: 2026/09/21 13:29:05 INFO Signed narinfos id=23 count=1 machine # [ 464.761664] niks3-server[1178]: 2026/09/21 13:29:05 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.ls machine # [ 464.764063] niks3-server[1178]: 2026/09/21 13:29:05 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 464.764935] niks3-server[1178]: 2026/09/21 13:29:05 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete machine # [ 464.765673] niks3-server[1178]: 2026/09/21 13:29:05 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 464.768689] niks3-server[1178]: 2026/09/21 13:29:05 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.narinfo machine # [ 464.770707] niks3-server[1178]: 2026/09/21 13:29:05 INFO Completed upload id=23 machine # [ 489.834604] niks3-server[1178]: 2026/09/21 13:29:30 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 489.892809] niks3-server[1178]: 2026/09/21 13:29:30 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 489.893929] niks3-server[1178]: 2026/09/21 13:29:30 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 489.911756] niks3-server[1178]: 2026/09/21 13:29:30 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 489.915840] niks3-server[1178]: 2026/09/21 13:29:30 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 489.919457] niks3-server[1178]: 2026/09/21 13:29:30 INFO Registered completed upload object_key=nar/0khxywxb2r78vhpc5hsmha3ymgp910z0aka7550jmaqzs333rmzp.nar.zst machine # [ 489.921755] niks3-server[1178]: 2026/09/21 13:29:30 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 489.923268] niks3-server[1178]: 2026/09/21 13:29:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign machine # [ 489.925377] niks3-server[1178]: 2026/09/21 13:29:30 INFO Registered completed upload object_key=log/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4-k3s-b.drv machine # [ 489.927400] niks3-server[1178]: 2026/09/21 13:29:30 INFO Signed narinfos id=24 count=1 machine # [ 489.928983] niks3-server[1178]: 2026/09/21 13:29:30 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 489.931357] niks3-server[1178]: 2026/09/21 13:29:30 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.ls machine # [ 489.938080] niks3-server[1178]: 2026/09/21 13:29:30 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 489.939250] niks3-server[1178]: 2026/09/21 13:29:30 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete machine # [ 489.940199] niks3-server[1178]: 2026/09/21 13:29:30 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 489.945748] niks3-server[1178]: 2026/09/21 13:29:30 INFO Completed upload id=24 machine # [ 489.946867] niks3-server[1178]: 2026/09/21 13:29:30 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.narinfo machine # [ 489.956294] niks3-server[1178]: 2026/09/21 13:29:30 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 489.972853] niks3-server[1178]: 2026/09/21 13:29:30 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 489.982049] niks3-server[1178]: 2026/09/21 13:29:30 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 490.045095] niks3-server[1178]: 2026/09/21 13:29:30 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 490.045640] niks3-server[1178]: 2026/09/21 13:29:30 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 490.055403] niks3-server[1178]: 2026/09/21 13:29:30 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 490.058841] niks3-server[1178]: 2026/09/21 13:29:30 INFO Registered completed upload object_key=nar/04bim5f8bvjh25xncf5x40kb529khrlzcbc92qxvapgbc0bdfv2h.nar.zst machine # [ 490.061478] niks3-server[1178]: 2026/09/21 13:29:30 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 490.063049] niks3-server[1178]: 2026/09/21 13:29:30 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 490.064042] niks3-server[1178]: 2026/09/21 13:29:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign machine # [ 490.064819] niks3-server[1178]: 2026/09/21 13:29:30 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.ls machine # [ 490.068091] niks3-server[1178]: 2026/09/21 13:29:30 INFO Signed narinfos id=25 count=1 machine # [ 490.073137] niks3-server[1178]: 2026/09/21 13:29:30 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 490.073778] niks3-server[1178]: 2026/09/21 13:29:30 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete machine # [ 490.074613] niks3-server[1178]: 2026/09/21 13:29:30 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 490.075452] niks3-server[1178]: 2026/09/21 13:29:30 INFO Completed upload id=25 machine # [ 514.735797] niks3-server[1178]: 2026/09/21 13:29:55 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 514.788754] niks3-server[1178]: 2026/09/21 13:29:55 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 514.792486] niks3-server[1178]: 2026/09/21 13:29:55 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 514.809692] niks3-server[1178]: 2026/09/21 13:29:55 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 514.815179] niks3-server[1178]: 2026/09/21 13:29:55 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 514.818718] niks3-server[1178]: 2026/09/21 13:29:55 INFO Registered completed upload object_key=log/jz7biafi8rj5r3r392blyazw5mdpvy0d-k3s-top.drv machine # [ 514.822539] niks3-server[1178]: 2026/09/21 13:29:55 INFO Registered completed upload object_key=nar/11f7f1hixry25c2yc6np9hs10a2pwwqmymmrxxbswhdjabcyvv0s.nar.zst machine # [ 514.826286] niks3-server[1178]: 2026/09/21 13:29:55 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 514.829308] niks3-server[1178]: 2026/09/21 13:29:55 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 514.832207] niks3-server[1178]: 2026/09/21 13:29:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign machine # [ 514.839091] niks3-server[1178]: 2026/09/21 13:29:55 INFO Signed narinfos id=26 count=1 machine # [ 514.839710] niks3-server[1178]: 2026/09/21 13:29:55 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.ls machine # [ 514.841249] niks3-server[1178]: 2026/09/21 13:29:55 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 514.841907] niks3-server[1178]: 2026/09/21 13:29:55 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete machine # [ 514.842774] niks3-server[1178]: 2026/09/21 13:29:55 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 514.843577] niks3-server[1178]: 2026/09/21 13:29:55 INFO Completed upload id=26 machine # [ 514.844156] niks3-server[1178]: 2026/09/21 13:29:55 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1, in 76.32 seconds) (finished: subtest: a renewed balancer certificate is served without a rollout, in 127.25 seconds) subtest: metrics carry build_info machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-hn285 -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-hn285 -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.22 seconds) machine: must succeed: curl -sf http://10.42.0.7:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-hn285"' machine: (finished: must succeed: curl -sf http://10.42.0.7:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-hn285"', in 0.04 seconds) (finished: subtest: metrics carry build_info, in 0.26 seconds) subtest: harmonia-gc frees space and the worker stays Ready machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-hn285 -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'' machine # [ 516.390203] k3s[875]: E0921 13:29:57.077559 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33712: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-hn285 -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'', in 0.23 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-hn285 -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done' machine # [ 516.653686] k3s[875]: time="2026-09-21T13:29:57Z" level=warning msg="Proxy error: read failed: read tcp 127.0.0.1:34108->127.0.0.1:10250: read: connection reset by peer" machine # [ 516.654805] k3s[875]: E0921 13:29:57.341436 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33748: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-hn285 -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done', in 0.27 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-hn285 -c gc -- sh -c 'fallocate -l 11440173056 /nix/fill' machine # [ 516.853874] k3s[875]: E0921 13:29:57.541532 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33780: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-hn285 -c gc -- sh -c 'fallocate -l 11440173056 /nix/fill', in 0.20 seconds) machine: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-hn285 -c gc --since=30s | grep -q 'store paths deleted' machine: (finished: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-hn285 -c gc --since=30s | grep -q 'store paths deleted', in 5.15 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-hn285 -c gc -- sh -c 'rm /nix/fill' machine # [ 522.224486] k3s[875]: E0921 13:30:02.911917 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33854: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-hn285 -c gc -- sh -c 'rm /nix/fill', in 0.22 seconds) machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-hn285 -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-hn285 -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}', in 0.13 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-hn285 -c gc -- sh -c 'command -v nix-daemon && command -v niks3' machine # [ 522.539366] k3s[875]: E0921 13:30:03.226822 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33868: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-hn285 -c gc -- sh -c 'command -v nix-daemon && command -v niks3', in 0.18 seconds) (finished: subtest: harmonia-gc frees space and the worker stays Ready, in 6.38 seconds) subtest: losing the balancer mid-build: the client reconnects and the build succeeds machine: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1 machine # [ 522.564098] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1. machine # Running as unit: vialb.service; invocation ID: 3d6ea8fc7f6a4dd3a1854bfdaa4638c5 machine: (finished: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1, in 0.02 seconds) machine: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'" machine # [ 522.691257] nix[10286]: don't know how to build these paths: machine # [ 522.692200] nix[10286]: /nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 522.704615] niks3-server[1178]: 2026/09/21 13:30:03 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 522.730607] nix[10286]: copying 1 paths to '127.0.0.1:30051'... machine # [ 522.733243] nix[10286]: copying path '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' to '127.0.0.1:30051'... machine # [ 522.750834] niks3-server[1178]: 2026/09/21 13:30:03 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 522.827813] niks3-server[1178]: 2026/09/21 13:30:03 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 522.828557] niks3-server[1178]: 2026/09/21 13:30:03 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 522.843720] niks3-server[1178]: 2026/09/21 13:30:03 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 522.849079] niks3-server[1178]: 2026/09/21 13:30:03 INFO Registered completed upload object_key=nar/0kkr2vb091wkq0cb0f1q92413dsfskh76wydp8mwysv7rawns0ar.nar.zst machine # [ 522.854536] niks3-server[1178]: 2026/09/21 13:30:03 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 522.855484] niks3-server[1178]: 2026/09/21 13:30:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign machine # [ 522.856292] niks3-server[1178]: 2026/09/21 13:30:03 INFO Signed narinfos id=27 count=1 machine # [ 522.859642] niks3-server[1178]: 2026/09/21 13:30:03 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 522.864666] niks3-server[1178]: 2026/09/21 13:30:03 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.ls machine # [ 522.871790] niks3-server[1178]: 2026/09/21 13:30:03 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 522.872398] niks3-server[1178]: 2026/09/21 13:30:03 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete machine # [ 522.872926] niks3-server[1178]: 2026/09/21 13:30:03 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 522.875813] niks3-server[1178]: 2026/09/21 13:30:03 INFO Completed upload id=27 machine # [ 522.877336] niks3-server[1178]: 2026/09/21 13:30:03 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.narinfo machine # [ 522.886523] nix[10286]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 522.887047] nix[10286]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-hn285: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine: (finished: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'", in 1.06 seconds) machine: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false machine: (finished: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false, in 0.27 seconds) machine: waiting for success: ! systemctl is-active vialb machine # [ 523.924925] nix[10286]: d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv: Stream removed (Socket closed), asking the scheduler again machine # [ 523.928382] nix[10286]: scheduler at 127.0.0.1:30051: Stream removed (Socket closed), reconnecting machine # [ 523.948783] systemd[1]: cri-containerd-3a8d05a7cad07bfb4617b60d97ab9c87dd5150089f236852a071ae1a5277eeb1.scope: Deactivated successfully. machine # [ 523.950995] systemd[1]: cri-containerd-3a8d05a7cad07bfb4617b60d97ab9c87dd5150089f236852a071ae1a5277eeb1.scope: Consumed 5.120s CPU time over 8min 1.260s wall clock time, 56.7M memory peak, 35M read from disk, 730.1K incoming IP traffic, 694.7K outgoing IP traffic. machine # [ 523.980693] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-3a8d05a7cad07bfb4617b60d97ab9c87dd5150089f236852a071ae1a5277eeb1-rootfs.mount: Deactivated successfully. machine # [ 524.010875] systemd[1]: cri-containerd-825efd5a76f67dcc6e1200123aa0df6c03bfd5c4bcdf015a86c3a4a7d9d48be6.scope: Deactivated successfully. machine # [ 524.038626] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-825efd5a76f67dcc6e1200123aa0df6c03bfd5c4bcdf015a86c3a4a7d9d48be6-rootfs.mount: Deactivated successfully. machine # [ 524.063647] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-825efd5a76f67dcc6e1200123aa0df6c03bfd5c4bcdf015a86c3a4a7d9d48be6-shm.mount: Deactivated successfully. machine # [ 524.245652] cni0: port 5(vethf07cafa1) entered disabled state machine # [ 524.095352] dhcpcd[3284]: vethf07cafa1: carrier lost machine # [ 524.247998] vethf07cafa1 (unregistering): left allmulticast mode machine # [ 524.249058] vethf07cafa1 (unregistering): left promiscuous mode machine # [ 524.250211] cni0: port 5(vethf07cafa1) entered disabled state machine # [ 524.119350] systemd[1]: run-netns-cni\x2d6487b861\x2d5907\x2dd1e7\x2d2ce3\x2d4da565b6861e.mount: Deactivated successfully. machine # [ 524.128595] dhcpcd[3284]: vethf07cafa1: deleting route to 169.254.0.0/16 machine # [ 524.172396] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod6bf680c4_14b8_412c_b5c2_dd32540eaf75.slice. machine # [ 524.210357] dhcpcd[3284]: vethf07cafa1: removing interface machine # [ 524.248650] k3s[875]: I0921 13:30:04.936111 875 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9f4a445f-fc7d-4ff5-bd22-b3e21d64f733-tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f4a445f-fc7d-4ff5-bd22-b3e21d64f733-tmp\") pod \"9f4a445f-fc7d-4ff5-bd22-b3e21d64f733\" (UID: \"9f4a445f-fc7d-4ff5-bd22-b3e21d64f733\") " machine # [ 524.249520] k3s[875]: I0921 13:30:04.936169 875 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9f4a445f-fc7d-4ff5-bd22-b3e21d64f733-tls-ca\" (UniqueName: \"kubernetes.io/secret/9f4a445f-fc7d-4ff5-bd22-b3e21d64f733-tls-ca\") pod \"9f4a445f-fc7d-4ff5-bd22-b3e21d64f733\" (UID: \"9f4a445f-fc7d-4ff5-bd22-b3e21d64f733\") " machine # [ 524.250149] k3s[875]: I0921 13:30:04.936205 875 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9f4a445f-fc7d-4ff5-bd22-b3e21d64f733-tls-lb\" (UniqueName: \"kubernetes.io/secret/9f4a445f-fc7d-4ff5-bd22-b3e21d64f733-tls-lb\") pod \"9f4a445f-fc7d-4ff5-bd22-b3e21d64f733\" (UID: \"9f4a445f-fc7d-4ff5-bd22-b3e21d64f733\") " machine # [ 524.250570] k3s[875]: I0921 13:30:04.936238 875 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9f4a445f-fc7d-4ff5-bd22-b3e21d64f733-config\" (UniqueName: \"kubernetes.io/configmap/9f4a445f-fc7d-4ff5-bd22-b3e21d64f733-config\") pod \"9f4a445f-fc7d-4ff5-bd22-b3e21d64f733\" (UID: \"9f4a445f-fc7d-4ff5-bd22-b3e21d64f733\") " machine # [ 524.251121] k3s[875]: I0921 13:30:04.936295 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/6bf680c4-14b8-412c-b5c2-dd32540eaf75-tls-lb\") pod \"nix-grpc-farm-lb-68c8f49bd6-rj7nh\" (UID: \"6bf680c4-14b8-412c-b5c2-dd32540eaf75\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-rj7nh" machine # [ 524.251589] k3s[875]: I0921 13:30:04.936324 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6bf680c4-14b8-412c-b5c2-dd32540eaf75-tmp\") pod \"nix-grpc-farm-lb-68c8f49bd6-rj7nh\" (UID: \"6bf680c4-14b8-412c-b5c2-dd32540eaf75\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-rj7nh" machine # [ 524.252214] k3s[875]: I0921 13:30:04.936353 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/6bf680c4-14b8-412c-b5c2-dd32540eaf75-tls-ca\") pod \"nix-grpc-farm-lb-68c8f49bd6-rj7nh\" (UID: \"6bf680c4-14b8-412c-b5c2-dd32540eaf75\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-rj7nh" machine # [ 524.252700] k3s[875]: I0921 13:30:04.936379 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6bf680c4-14b8-412c-b5c2-dd32540eaf75-config\") pod \"nix-grpc-farm-lb-68c8f49bd6-rj7nh\" (UID: \"6bf680c4-14b8-412c-b5c2-dd32540eaf75\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-rj7nh" machine # [ 524.256799] systemd[1]: var-lib-kubelet-pods-9f4a445f\x2dfc7d\x2d4ff5\x2dbd22\x2db3e21d64f733-volume\x2dsubpaths-config-envoy-0.mount: Deactivated successfully. machine # [ 524.287903] k3s[875]: I0921 13:30:04.975624 875 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f4a445f-fc7d-4ff5-bd22-b3e21d64f733-tls-ca" pod "9f4a445f-fc7d-4ff5-bd22-b3e21d64f733" (UID: "9f4a445f-fc7d-4ff5-bd22-b3e21d64f733"). InnerVolumeSpecName "tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 524.288865] k3s[875]: I0921 13:30:04.976648 875 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f4a445f-fc7d-4ff5-bd22-b3e21d64f733-tmp" pod "9f4a445f-fc7d-4ff5-bd22-b3e21d64f733" (UID: "9f4a445f-fc7d-4ff5-bd22-b3e21d64f733"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 524.296158] k3s[875]: I0921 13:30:04.983914 875 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f4a445f-fc7d-4ff5-bd22-b3e21d64f733-tls-lb" pod "9f4a445f-fc7d-4ff5-bd22-b3e21d64f733" (UID: "9f4a445f-fc7d-4ff5-bd22-b3e21d64f733"). InnerVolumeSpecName "tls-lb". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 524.302034] k3s[875]: I0921 13:30:04.989758 875 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f4a445f-fc7d-4ff5-bd22-b3e21d64f733-config" pod "9f4a445f-fc7d-4ff5-bd22-b3e21d64f733" (UID: "9f4a445f-fc7d-4ff5-bd22-b3e21d64f733"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 524.350040] k3s[875]: I0921 13:30:05.037688 875 reconciler_common.go:299] "Volume detached for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/9f4a445f-fc7d-4ff5-bd22-b3e21d64f733-tls-ca\") on node \"machine\" DevicePath \"\"" machine # [ 524.350588] k3s[875]: I0921 13:30:05.037723 875 reconciler_common.go:299] "Volume detached for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/9f4a445f-fc7d-4ff5-bd22-b3e21d64f733-tls-lb\") on node \"machine\" DevicePath \"\"" machine # [ 524.351089] k3s[875]: I0921 13:30:05.037941 875 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9f4a445f-fc7d-4ff5-bd22-b3e21d64f733-config\") on node \"machine\" DevicePath \"\"" machine # [ 524.351524] k3s[875]: I0921 13:30:05.038946 875 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f4a445f-fc7d-4ff5-bd22-b3e21d64f733-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 524.653040] cni0: port 2(vethddf5f998) entered blocking state machine # [ 524.502893] (udev-worker)[10472]: Network interface NamePolic[ 524.654454] cni0: port 2(vethddf5f998) entered disabled state machine # y= disabled on kernel command line.[ 524.655616] vethddf5f998: entered allmulticast mode machine # machine # [ 524.656603] vethddf5f998: entered promiscuous mode machine # [ 524.665373] cni0: port 2(vethddf5f998) entered blocking state machine # [ 524.667013] cni0: port 2(vethddf5f998) entered forwarding state machine # [ 524.532932] dhcpcd[3284]: vethddf5f998: IAID fd:24:7c:33 machine # [ 524.533625] dhcpcd[3284]: vethddf5f998: adding address fe80::6c5a:fdff:fe24:7c33 machine # [ 524.597432] systemd[1]: Started libcontainer container df0f92a9cdf4c2cd01570bcbf99fd7373b9988009fc32863e044ab398189466a. machine # [ 524.724986] systemd[1]: Started libcontainer container ab8aa30871c3a0921280645ce3b693e5ea4d6ba5132f41f113d0fae42aa82e89. machine # [ 524.735474] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod9f4a445f_fc7d_4ff5_bd22_b3e21d64f733.slice. machine # [ 524.736328] systemd[1]: kubepods-besteffort-pod9f4a445f_fc7d_4ff5_bd22_b3e21d64f733.slice: Consumed 5.153s CPU time over 8min 4.220s wall clock time, 57M memory peak, 35M read from disk, 730.1K incoming IP traffic, 694.7K outgoing IP traffic. machine # [ 524.998283] systemd[1]: var-lib-kubelet-pods-9f4a445f\x2dfc7d\x2d4ff5\x2dbd22\x2db3e21d64f733-volume\x2dsubpaths-config-envoy-2.mount: Deactivated successfully. machine # [ 524.999240] systemd[1]: var-lib-kubelet-pods-9f4a445f\x2dfc7d\x2d4ff5\x2dbd22\x2db3e21d64f733-volume\x2dsubpaths-config-envoy-1.mount: Deactivated successfully. machine # [ 525.000161] systemd[1]: var-lib-kubelet-pods-9f4a445f\x2dfc7d\x2d4ff5\x2dbd22\x2db3e21d64f733-volumes-kubernetes.io\x7esecret-tls\x2dlb.mount: Deactivated successfully. machine # [ 525.000969] systemd[1]: var-lib-kubelet-pods-9f4a445f\x2dfc7d\x2d4ff5\x2dbd22\x2db3e21d64f733-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 525.001825] systemd[1]: var-lib-kubelet-pods-9f4a445f\x2dfc7d\x2d4ff5\x2dbd22\x2db3e21d64f733-volumes-kubernetes.io\x7esecret-tls\x2dca.mount: Deactivated successfully. machine # [ 525.069187] k3s[875]: I0921 13:30:05.755835 875 scope.go:122] "RemoveContainer" containerID="3a8d05a7cad07bfb4617b60d97ab9c87dd5150089f236852a071ae1a5277eeb1" machine # [ 525.086462] k3s[875]: I0921 13:30:05.774152 875 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-68c8f49bd6-rj7nh" podStartSLOduration=1.774109918 podStartE2EDuration="1.774109918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-21 13:30:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-21 13:30:05.770173384 +0000 UTC m=+507.935943757" watchObservedRunningTime="2026-09-21 13:30:05.774109918 +0000 UTC m=+507.939881968" machine # [ 526.431553] nix[10286]: scheduler at 127.0.0.1:30051: failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:30051: Failed to connect to remote host: connect() timed out, reconnecting machine # [ 526.465514] dhcpcd[3284]: vethddf5f998: soliciting a DHCP lease machine # [ 526.732855] k3s[875]: I0921 13:30:07.419658 875 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9f4a445f-fc7d-4ff5-bd22-b3e21d64f733" path="/var/lib/kubelet/pods/9f4a445f-fc7d-4ff5-bd22-b3e21d64f733/volumes" machine # [ 527.173440] dhcpcd[3284]: vethddf5f998: soliciting an IPv6 router machine # [ 527.441128] niks3-server[1178]: 2026/09/21 13:30:08 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 527.480580] nix[10286]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 527.482446] nix[10286]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-s2grm: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 531.465972] dhcpcd[3284]: vethddf5f998: probing for an IPv4LL address machine # [ 536.765786] dhcpcd[3284]: vethddf5f998: using IPv4LL address 169.254.71.132 machine # [ 536.766963] dhcpcd[3284]: vethddf5f998: adding route to 169.254.0.0/16 machine # [ 539.178653] dhcpcd[3284]: vethddf5f998: no IPv6 Routers available machine # [ 571.764819] niks3-server[1178]: 2026/09/21 13:30:52 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 571.821197] niks3-server[1178]: 2026/09/21 13:30:52 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 571.822415] niks3-server[1178]: 2026/09/21 13:30:52 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 571.840833] niks3-server[1178]: 2026/09/21 13:30:52 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 571.841752] niks3-server[1178]: 2026/09/21 13:30:52 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 571.845994] niks3-server[1178]: 2026/09/21 13:30:52 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.ls machine # [ 571.847874] niks3-server[1178]: 2026/09/21 13:30:52 INFO Registered completed upload object_key=log/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 571.855584] niks3-server[1178]: 2026/09/21 13:30:52 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 571.857241] niks3-server[1178]: 2026/09/21 13:30:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign machine # [ 571.862246] niks3-server[1178]: 2026/09/21 13:30:52 INFO Signed narinfos id=28 count=1 machine # [ 571.870659] niks3-server[1178]: 2026/09/21 13:30:52 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 571.871879] niks3-server[1178]: 2026/09/21 13:30:52 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 571.873258] niks3-server[1178]: 2026/09/21 13:30:52 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete machine # [ 571.874902] niks3-server[1178]: 2026/09/21 13:30:52 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.narinfo machine # [ 571.884637] niks3-server[1178]: 2026/09/21 13:30:52 INFO Completed upload id=28 machine # [ 571.910603] systemd[1]: vialb.service: Deactivated successfully. machine # [ 571.911578] systemd[1]: vialb.service: Consumed 194ms CPU time over 49.346s wall clock time, 42.7M memory peak, 4K written to disk, 7.8K incoming IP traffic, 17K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active vialb, in 48.94 seconds) machine: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; }, in 0.04 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 0.29 seconds) (finished: subtest: losing the balancer mid-build: the client reconnects and the build succeeds, in 50.62 seconds) subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes machine: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 machine # [ 573.197521] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1. machine # Running as unit: slow.service; invocation ID: 7cfbdfa8d1bd43f880b2aad779421149 machine: (finished: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1, in 0.05 seconds) machine # [ 573.339329] nix[11212]: don't know how to build these paths: machine # [ 573.339917] nix[11212]: /nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 573.345482] niks3-server[1178]: 2026/09/21 13:30:54 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 573.360715] nix[11212]: copying 1 paths to '127.0.0.1:30051'... machine # [ 573.362310] nix[11212]: copying path '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' to '127.0.0.1:30051'... machine # [ 573.368810] niks3-server[1178]: 2026/09/21 13:30:54 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 573.430395] niks3-server[1178]: 2026/09/21 13:30:54 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 573.431970] niks3-server[1178]: 2026/09/21 13:30:54 INFO Received uploads request method=POST path=/api/pending_closures machine # command terminated with exit code 1 machine # [ 573.435873] k3s[875]: E0921 13:30:54.122571 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33602: use of closed network connection machine # [ 573.442474] niks3-server[1178]: 2026/09/21 13:30:54 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 573.446046] niks3-server[1178]: 2026/09/21 13:30:54 INFO Registered completed upload object_key=nar/0wl2i9xpw0gwrx1xqdgx9ka4n503ky9qhl20pdrdlphn8d6lcx0i.nar.zst machine # [ 573.449383] niks3-server[1178]: 2026/09/21 13:30:54 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 573.451039] niks3-server[1178]: 2026/09/21 13:30:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign machine # [ 573.452877] niks3-server[1178]: 2026/09/21 13:30:54 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 573.454298] niks3-server[1178]: 2026/09/21 13:30:54 INFO Signed narinfos id=29 count=1 machine # [ 573.455387] niks3-server[1178]: 2026/09/21 13:30:54 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.ls machine # [ 573.459766] niks3-server[1178]: 2026/09/21 13:30:54 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 573.461530] niks3-server[1178]: 2026/09/21 13:30:54 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete machine # [ 573.462297] niks3-server[1178]: 2026/09/21 13:30:54 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 573.464658] niks3-server[1178]: 2026/09/21 13:30:54 INFO Completed upload id=29 machine # [ 573.467982] niks3-server[1178]: 2026/09/21 13:30:54 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.narinfo machine # [ 573.476166] nix[11212]: building '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' on 127.0.0.1:30051... machine # [ 573.477794] nix[11212]: slow-s1> machine/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-hn285: building zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 573.636382] k3s[875]: E0921 13:30:54.324087 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33632: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 574.864304] k3s[875]: E0921 13:30:55.551599 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33662: use of closed network connection machine # [ 575.048985] k3s[875]: E0921 13:30:55.736715 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33676: use of closed network connection machine # command terminated with exit code 1 machine # [ 576.361594] k3s[875]: E0921 13:30:57.048967 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33700: use of closed network connection machine # command terminated with exit code 1 machine # [ 576.570753] k3s[875]: E0921 13:30:57.258483 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33722: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 577.828588] k3s[875]: E0921 13:30:58.515647 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33758: use of closed network connection machine # [ 578.018389] k3s[875]: E0921 13:30:58.706114 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33796: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 579.344228] k3s[875]: E0921 13:31:00.031611 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33826: use of closed network connection machine # [ 579.553755] k3s[875]: E0921 13:31:00.241493 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33848: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 580.847419] k3s[875]: E0921 13:31:01.534447 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33882: use of closed network connection machine # [ 581.033135] k3s[875]: E0921 13:31:01.720827 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33916: use of closed network connection machine # command terminated with exit code 1 machine # [ 582.309993] k3s[875]: E0921 13:31:02.997407 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33942: use of closed network connection machine # command terminated with exit code 1 machine # [ 582.519596] k3s[875]: E0921 13:31:03.207330 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33970: use of closed network connection machine # command terminated with exit code 1 machine # [ 583.801557] k3s[875]: E0921 13:31:04.488995 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46184: use of closed network connection machine # command terminated with exit code 1 machine # [ 584.016889] k3s[875]: E0921 13:31:04.704611 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46200: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 585.309573] k3s[875]: E0921 13:31:05.996890 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46232: use of closed network connection machine # [ 585.516474] k3s[875]: E0921 13:31:06.204165 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46272: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 586.780039] k3s[875]: E0921 13:31:07.467319 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46298: use of closed network connection machine # command terminated with exit code 1 machine # [ 587.012487] k3s[875]: E0921 13:31:07.699346 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46334: use of closed network connection machine # [ 588.310905] k3s[875]: E0921 13:31:08.998200 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46354: use of closed network connection machine # command terminated with exit code 1 machine # [ 588.538190] k3s[875]: E0921 13:31:09.225786 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46382: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 589.820784] k3s[875]: E0921 13:31:10.507981 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46408: use of closed network connection machine # command terminated with exit code 1 machine # [ 590.017434] k3s[875]: E0921 13:31:10.704277 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46430: use of closed network connection machine # [ 591.305078] k3s[875]: E0921 13:31:11.992473 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46450: use of closed network connection machine # [ 591.305688] k3s[875]: time="2026-09-21T13:31:11Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:49292->127.0.0.1:10250: write: broken pipe" machine # command terminated with exit code 1 machine # [ 591.510108] k3s[875]: E0921 13:31:12.197824 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46486: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 592.776396] k3s[875]: E0921 13:31:13.463234 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46520: use of closed network connection machine # [ 592.970919] k3s[875]: E0921 13:31:13.658284 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54696: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 594.275648] k3s[875]: E0921 13:31:14.962743 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54728: use of closed network connection machine # [ 594.482954] k3s[875]: E0921 13:31:15.170653 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54764: use of closed network connection machine # command terminated with exit code 1 machine # [ 595.786046] k3s[875]: E0921 13:31:16.473377 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54792: use of closed network connection machine # command terminated with exit code 1 machine # [ 595.997208] k3s[875]: E0921 13:31:16.684943 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54810: use of closed network connection machine # command terminated with exit code 1 machine # [ 597.274423] k3s[875]: E0921 13:31:17.961757 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54834: use of closed network connection machine # command terminated with exit code 1 machine # [ 597.493187] k3s[875]: E0921 13:31:18.180787 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54862: use of closed network connection machine # command terminated with exit code 1 machine # [ 598.762842] k3s[875]: E0921 13:31:19.449567 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54878: use of closed network connection machine # [ 598.946785] k3s[875]: E0921 13:31:19.634458 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54900: use of closed network connection machine: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-hn285 --wait=false machine: (finished: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-hn285 --wait=false, in 0.16 seconds) machine: must succeed: sleep 5.0 machine # [ 599.148346] systemd[1]: cri-containerd-b1102b8b6f1b0d5a68a218d5f89fad82889e24b8a676744efe13fe26e407d95d.scope: Deactivated successfully. machine # [ 599.150356] systemd[1]: cri-containerd-b1102b8b6f1b0d5a68a218d5f89fad82889e24b8a676744efe13fe26e407d95d.scope: Consumed 596ms CPU time over 9min 8.761s wall clock time, 13.3M memory peak, 5.2M read from disk. machine # [ 599.186431] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod77dcd9ea_7bd7_4c6d_9cd3_5b36b4511adc.slice. machine # [ 599.218927] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-b1102b8b6f1b0d5a68a218d5f89fad82889e24b8a676744efe13fe26e407d95d-rootfs.mount: Deactivated successfully. machine # [ 599.230804] k3s[875]: I0921 13:31:19.918578 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/77dcd9ea-7bd7-4c6d-9cd3-5b36b4511adc-build\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-f2tjp\" (UID: \"77dcd9ea-7bd7-4c6d-9cd3-5b36b4511adc\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-f2tjp" machine # [ 599.231635] k3s[875]: I0921 13:31:19.918642 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/77dcd9ea-7bd7-4c6d-9cd3-5b36b4511adc-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-f2tjp\" (UID: \"77dcd9ea-7bd7-4c6d-9cd3-5b36b4511adc\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-f2tjp" machine # [ 599.232548] k3s[875]: I0921 13:31:19.918675 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/77dcd9ea-7bd7-4c6d-9cd3-5b36b4511adc-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-f2tjp\" (UID: \"77dcd9ea-7bd7-4c6d-9cd3-5b36b4511adc\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-f2tjp" machine # [ 599.245374] k3s[875]: I0921 13:31:19.933084 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/77dcd9ea-7bd7-4c6d-9cd3-5b36b4511adc-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-f2tjp\" (UID: \"77dcd9ea-7bd7-4c6d-9cd3-5b36b4511adc\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-f2tjp" machine # [ 599.246350] k3s[875]: I0921 13:31:19.933146 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/77dcd9ea-7bd7-4c6d-9cd3-5b36b4511adc-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-f2tjp\" (UID: \"77dcd9ea-7bd7-4c6d-9cd3-5b36b4511adc\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-f2tjp" machine # [ 599.247110] k3s[875]: I0921 13:31:19.933181 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsgwx\" (UniqueName: \"kubernetes.io/projected/77dcd9ea-7bd7-4c6d-9cd3-5b36b4511adc-kube-api-access-lsgwx\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-f2tjp\" (UID: \"77dcd9ea-7bd7-4c6d-9cd3-5b36b4511adc\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-f2tjp" machine # [ 599.247827] k3s[875]: I0921 13:31:19.933218 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/77dcd9ea-7bd7-4c6d-9cd3-5b36b4511adc-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-f2tjp\" (UID: \"77dcd9ea-7bd7-4c6d-9cd3-5b36b4511adc\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-f2tjp" machine # [ 599.248698] k3s[875]: I0921 13:31:19.933253 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/77dcd9ea-7bd7-4c6d-9cd3-5b36b4511adc-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-f2tjp\" (UID: \"77dcd9ea-7bd7-4c6d-9cd3-5b36b4511adc\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-f2tjp" machine # [ 599.686265] cni0: port 5(vethaaa4799b) entered blocking state machine # [ 599.691033] cni0: port 5(vethaaa4799b) entered disabled state machine # [ 599.694003] vethaaa4799b: entered allmulticast mode machine # [ 599.697274] vethaaa4799b: entered promiscuous mode machine # [ 599.714583] cni0: port 5(vethaaa4799b) entered blocking state machine # [ 599.716386] cni0: port 5(vethaaa4799b) entered forwarding state machine # [ 599.606814] (udev-worker)[12874]: Network interface NamePolicy= disabled on kernel command line. machine # [ 599.640309] dhcpcd[3284]: vethaaa4799b: IAID 3b:69:b8:f7 machine # [ 599.640867] dhcpcd[3284]: vethaaa4799b: adding address fe80::e8b0:3bff:fe69:b8f7 machine # [ 599.660314] systemd[1]: Started libcontainer container 8cc4eb49415aeb0de9a8d25d61d613958ad8157d92e02261303b45856b6cca0d. machine # [ 599.699736] dhcpcd[3284]: vethaaa4799b: soliciting a DHCP lease machine # [ 599.754301] systemd[1]: Started libcontainer container 3f627e42ba83ad2b45f6eafa286f6adc6e64edbc58c9c9bd5024a2c4c580b958. machine # [ 601.447823] dhcpcd[3284]: vethaaa4799b: soliciting an IPv6 router machine # [ 601.902817] systemd[1]: cri-containerd-3f627e42ba83ad2b45f6eafa286f6adc6e64edbc58c9c9bd5024a2c4c580b958.scope: Deactivated successfully. machine # [ 601.910347] systemd[1]: cri-containerd-3f627e42ba83ad2b45f6eafa286f6adc6e64edbc58c9c9bd5024a2c4c580b958.scope: Consumed 984ms CPU time over 2.147s wall clock time, 471.1M memory peak, 178.1M read from disk, 160.3M written to disk. machine # [ 601.970986] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-3f627e42ba83ad2b45f6eafa286f6adc6e64edbc58c9c9bd5024a2c4c580b958-rootfs.mount: Deactivated successfully. machine # [ 602.501428] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount3287334722.mount: Deactivated successfully. machine # [ 602.538407] systemd[1]: Started libcontainer container 114b06b79338a9a620f42c952d5b43ee5df344ba850346bd70394d9e9cac8e62. machine # [ 602.675334] systemd[1]: Started libcontainer container fecfb3c1947db10ff7e8baef16597324df8571eda951c01e6b3d4928237ba620. machine # [ 602.791377] systemd[1]: Started libcontainer container 5ae6d00952ef2640f2779cf474a091248c5ed0de2aa0c7db10f4f8879cbcaa4a. machine # [ 603.477150] k3s[875]: I0921 13:31:24.163328 875 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-f2tjp" podStartSLOduration=3.029163833 podStartE2EDuration="5.163210479s" totalImagesPullingTime="0s" totalInitContainerRuntime="2.134046646s" isStatefulPod=false podCreationTimestamp="2026-09-21 13:31:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-21 13:31:24.162144701 +0000 UTC m=+586.327916751" watchObservedRunningTime="2026-09-21 13:31:24.163210479 +0000 UTC m=+586.328983087" machine: (finished: must succeed: sleep 5.0, in 5.03 seconds) machine # [ 604.375255] k3s[875]: E0921 13:31:25.062974 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53574: use of closed network connection machine: waiting for success: ! systemctl is-active slow machine # [ 604.701088] dhcpcd[3284]: vethaaa4799b: probing for an IPv4LL address machine # [ 609.308548] dhcpcd[3284]: vethaaa4799b: using IPv4LL address 169.254.22.198 machine # [ 609.309592] dhcpcd[3284]: vethaaa4799b: adding route to 169.254.0.0/16 machine # [ 610.918095] postgres[764]: [764] LOG: checkpoint starting: time machine # [ 613.450538] dhcpcd[3284]: vethaaa4799b: no IPv6 Routers available machine # [ 613.642429] postgres[764]: [764] LOG: checkpoint complete: wrote 27 buffers (0.2%), wrote 1 SLRU buffers; 0 WAL file(s) added, 0 removed, 0 recycled; write=2.712 s, sync=0.004 s, total=2.725 s; sync files=21, longest=0.003 s, average=0.001 s; distance=223 kB, estimate=4502 kB; lsn=0/1C7A868, redo lsn=0/1C7A810 machine # [ 618.557475] niks3-server[1178]: 2026/09/21 13:31:39 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 618.612920] niks3-server[1178]: 2026/09/21 13:31:39 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 618.614185] niks3-server[1178]: 2026/09/21 13:31:39 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 618.624113] niks3-server[1178]: 2026/09/21 13:31:39 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 618.625805] niks3-server[1178]: 2026/09/21 13:31:39 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 618.626764] niks3-server[1178]: 2026/09/21 13:31:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign machine # [ 618.627847] niks3-server[1178]: 2026/09/21 13:31:39 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 618.629602] niks3-server[1178]: 2026/09/21 13:31:39 INFO Signed narinfos id=30 count=1 machine # [ 618.636287] niks3-server[1178]: 2026/09/21 13:31:39 INFO Registered completed upload object_key=log/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 618.637818] niks3-server[1178]: 2026/09/21 13:31:39 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.ls machine # [ 618.639371] niks3-server[1178]: 2026/09/21 13:31:39 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 618.641414] niks3-server[1178]: 2026/09/21 13:31:39 INFO OIDC auth successful provider=kubernetes scopes=[write] machine # [ 618.642090] niks3-server[1178]: 2026/09/21 13:31:39 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete machine # [ 618.643590] niks3-server[1178]: 2026/09/21 13:31:39 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo machine # [ 618.648478] niks3-server[1178]: 2026/09/21 13:31:39 INFO Completed upload id=30 machine # [ 619.700310] systemd[1]: slow.service: Deactivated successfully. machine # [ 619.702729] systemd[1]: slow.service: Consumed 178ms CPU time over 46.502s wall clock time, 42.3M memory peak, 4K written to disk, 4.7K incoming IP traffic, 11.3K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active slow, in 15.50 seconds) machine: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; }, in 0.04 seconds) machine: must fail: journalctl -u slow | grep -q 'asking the scheduler again' machine: (finished: must fail: journalctl -u slow | grep -q 'asking the scheduler again', in 0.03 seconds) machine: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath, in 0.16 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null, in 0.04 seconds) (finished: subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes, in 46.99 seconds) (finished: run the VM test script, in 621.06 seconds) machine # [ 620.277342] systemd[1]: cri-containerd-33456ce91c3c06c78d76bb7fb64600a4b906f9bbf1b9f924f2a966fda772f4af.scope: Deactivated successfully. machine # [ 620.279057] systemd[1]: cri-containerd-33456ce91c3c06c78d76bb7fb64600a4b906f9bbf1b9f924f2a966fda772f4af.scope: Consumed 3.599s CPU time over 9min 30.134s wall clock time, 69.7M memory peak, 35.6M read from disk, 278.7K incoming IP traffic, 351.9K outgoing IP traffic. test script finished in 621.20s cleanup kill QemuMachine (pid 45) machine # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) machine # [2026-09-21T13:31:41Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-09-21T13:31:41Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-09-21T13:31:41Z INFO virtiofsd] Client disconnected, shutting down (finished: cleanup, in 1.24 seconds) additionally exposed symbols: machine, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh