tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 1200.0 seconds run the VM test script machine: waiting for unit k3s.service machine: waiting for the VM to finish booting machine: starting vm machine: QEMU running (pid 45) machine # Disk image does not exist, creating the virtualisation disk image... machine # Formatting '/build/vm-state-machine/tmp.DI2n3dw1O5', fmt=raw size=17179869184 machine # mke2fs 1.47.4 (6-Mar-2025) machine # Discarding device blocks: 0/4194304 done machine # Creating filesystem with 4194304 4k blocks and 1048576 inodes machine # Filesystem UUID: 21069e6b-bab5-4f70-9849-0cc0af0cc60b machine # Superblock backups stored on blocks: machine # 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208, machine # 4096000 machine # machine # Allocating group tables: 0/128 done machine # Writing inode tables: 0/128 done machine # Creating journal (32768 blocks): done machine # Writing superblocks and filesystem accounting information: 0/128 done machine # machine # Virtualisation disk image created. machine # Starting virtiofs daemons... machine # [2026-09-23T10:32:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-23T10:32:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-23T10:32:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-23T10:32:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-23T10:32:31Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-23T10:32:31Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-23T10:32:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-23T10:32:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-23T10:32:31Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-23T10:32:31Z INFO virtiofsd] Client connected, servicing requests machine # [2026-09-23T10:32:31Z INFO virtiofsd] Client connected, servicing requests machine # [2026-09-23T10:32:31Z INFO virtiofsd] Client connected, servicing requests machine # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) machine # machine # machine # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+7EFCC730+7EF2C730 CA00 machine # Press Ctrl-B to configure iPXE (PCI 00:02.0)... machine # machine # machine # machine # machine # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 7EFCC730 7EF2C730 CB00 machine # Press Ctrl-B to configure iPXE (PCI 00:05.0)... machine # machine # machine # Booting from ROM... machine # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 machine # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/c5w72g0vwr4wzw9bd7wj2pf3y1lprgcx-nixos-system-machine-test/init regInfo=/nix/store/dkli7xy72b1b67bbplcr6cbkkpcb9nai-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.000000] BIOS-provided physical RAM map: machine # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007ffd7fff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000007ffd8000-0x000000007fffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000017fffffff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved machine # [ 0.000000] NX (Execute Disable) protection: active machine # [ 0.000000] APIC: Static calls initialized machine # [ 0.000000] SMBIOS 2.8 present. machine # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 machine # [ 0.000000] DMI: Memory slots populated: 1/1 machine # [ 0.000000] Hypervisor detected: KVM machine # [ 0.000000] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 machine # [ 0.000000] kvm-clock: using sched offset of 499444635 cycles machine # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns machine # [ 0.000004] tsc: Detected 2400.012 MHz processor machine # [ 0.000810] last_pfn = 0x180000 max_arch_pfn = 0x10000000000 machine # [ 0.000837] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs machine # [ 0.000839] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT machine # [ 0.000877] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.002721] found SMP MP-table at [mem 0x000f5450-0x000f545f] machine # [ 0.002732] Using GB pages for direct mapping machine # [ 0.002868] RAMDISK: [mem 0x7e371000-0x7ffcffff] machine # [ 0.002876] ACPI: Early table checksum verification disabled machine # [ 0.002878] ACPI: RSDP 0x00000000000F5250 000014 (v00 BOCHS ) machine # [ 0.002882] ACPI: RSDT 0x000000007FFE2539 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002885] ACPI: FACP 0x000000007FFE2319 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002892] ACPI: DSDT 0x000000007FFE0040 0022D9 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002894] ACPI: FACS 0x000000007FFE0000 000040 machine # [ 0.002896] ACPI: APIC 0x000000007FFE240D 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002897] ACPI: HPET 0x000000007FFE249D 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002899] ACPI: MCFG 0x000000007FFE24D5 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002900] ACPI: WAET 0x000000007FFE2511 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002902] ACPI: Reserving FACP table memory at [mem 0x7ffe2319-0x7ffe240c] machine # [ 0.002903] ACPI: Reserving DSDT table memory at [mem 0x7ffe0040-0x7ffe2318] machine # [ 0.002903] ACPI: Reserving FACS table memory at [mem 0x7ffe0000-0x7ffe003f] machine # [ 0.002904] ACPI: Reserving APIC table memory at [mem 0x7ffe240d-0x7ffe249c] machine # [ 0.002904] ACPI: Reserving HPET table memory at [mem 0x7ffe249d-0x7ffe24d4] machine # [ 0.002905] ACPI: Reserving MCFG table memory at [mem 0x7ffe24d5-0x7ffe2510] machine # [ 0.002905] ACPI: Reserving WAET table memory at [mem 0x7ffe2511-0x7ffe2538] machine # [ 0.003130] No NUMA configuration found machine # [ 0.003131] Faking a node at [mem 0x0000000000000000-0x000000017fffffff] machine # [ 0.003134] NODE_DATA(0) allocated [mem 0x17fffa780-0x17ffffcff] machine # [ 0.005299] Zone ranges: machine # [ 0.005301] DMA [mem 0x0000000000001000-0x0000000000ffffff] machine # [ 0.005302] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] machine # [ 0.005304] Normal [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005304] Device empty machine # [ 0.005305] Movable zone start for each node machine # [ 0.005306] Early memory node ranges machine # [ 0.005306] node 0: [mem 0x0000000000001000-0x000000000009efff] machine # [ 0.005307] node 0: [mem 0x0000000000100000-0x000000007ffd7fff] machine # [ 0.005308] node 0: [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005309] Initmem setup node 0 [mem 0x0000000000001000-0x000000017fffffff] machine # [ 0.005328] On node 0, zone DMA: 1 pages in unavailable ranges machine # [ 0.005581] On node 0, zone DMA: 97 pages in unavailable ranges machine # [ 0.073626] On node 0, zone Normal: 40 pages in unavailable ranges machine # [ 0.074103] ACPI: PM-Timer IO Port: 0x608 machine # [ 0.074117] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) machine # [ 0.074146] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 machine # [ 0.074149] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) machine # [ 0.074151] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) machine # [ 0.074152] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) machine # [ 0.074153] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) machine # [ 0.074154] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) machine # [ 0.074156] ACPI: Using ACPI (MADT) for SMP configuration information machine # [ 0.074157] ACPI: HPET id: 0x8086a201 base: 0xfed00000 machine # [ 0.074162] TSC deadline timer available machine # [ 0.074166] CPU topo: Max. logical packages: 1 machine # [ 0.074167] CPU topo: Max. logical dies: 1 machine # [ 0.074167] CPU topo: Max. dies per package: 1 machine # [ 0.074171] CPU topo: Max. threads per core: 1 machine # [ 0.074171] CPU topo: Num. cores per package: 4 machine # [ 0.074172] CPU topo: Num. threads per package: 4 machine # [ 0.074172] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs machine # [ 0.074196] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() machine # [ 0.074210] kvm-guest: KVM setup pv remote TLB flush machine # [ 0.074213] kvm-guest: setup PV sched yield machine # [ 0.074222] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] machine # [ 0.074224] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] machine # [ 0.074225] PM: hibernation: Registered nosave memory: [mem 0x7ffd8000-0xffffffff] machine # [ 0.074226] [mem 0xc0000000-0xfed1bfff] available for PCI devices machine # [ 0.074228] Booting paravirtualized kernel on KVM machine # [ 0.074231] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns machine # [ 0.078705] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 machine # [ 0.080814] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288 machine # [ 0.080860] kvm-guest: PV spinlocks enabled machine # [ 0.080862] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) machine # [ 0.080865] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/c5w72g0vwr4wzw9bd7wj2pf3y1lprgcx-nixos-system-machine-test/init regInfo=/nix/store/dkli7xy72b1b67bbplcr6cbkkpcb9nai-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.080958] Unknown kernel command line parameters "regInfo=/nix/store/dkli7xy72b1b67bbplcr6cbkkpcb9nai-closure-info/registration", will be passed to user space. machine # [ 0.080971] random: crng init done machine # [ 0.080972] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes machine # [ 0.085259] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) machine # [ 0.087318] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) machine # [ 0.087388] software IO TLB: area num 4. machine # [ 0.157573] Fallback order for Node 0: 0 machine # [ 0.157580] Built 1 zonelists, mobility grouping on. Total pages: 1048438 machine # [ 0.157582] Policy zone: Normal machine # [ 0.160205] mem auto-init: stack:all(zero), heap alloc:on, heap free:off machine # [ 0.166704] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 machine # [ 0.175348] allocated 8388608 bytes of page_ext machine # [ 0.185252] ftrace: allocating 48787 entries in 192 pages machine # [ 0.185254] ftrace: allocated 192 pages with 2 groups machine # [ 0.186093] Dynamic Preempt: lazy machine # [ 0.186276] rcu: Preemptible hierarchical RCU implementation. machine # [ 0.186277] rcu: RCU event tracing is enabled. machine # [ 0.186278] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. machine # [ 0.186279] Trampoline variant of Tasks RCU enabled. machine # [ 0.186279] Rude variant of Tasks RCU enabled. machine # [ 0.186280] Tracing variant of Tasks RCU enabled. machine # [ 0.186280] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. machine # [ 0.186281] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 machine # [ 0.186300] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.186302] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.186303] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.190573] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16 machine # [ 0.190866] rcu: srcu_init: Setting srcu_struct sizes based on contention. machine # [ 0.190874] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns machine # [ 0.190977] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) machine # [ 0.194557] Console: colour VGA+ 80x25 machine # [ 0.194559] printk: legacy console [tty0] enabled machine # [ 0.226217] printk: legacy console [ttyS0] enabled machine # [ 0.337824] ACPI: Core revision 20250807 machine # [ 0.338756] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns machine # [ 0.340336] APIC: Switch to symmetric I/O mode setup machine # [ 0.341393] x2apic enabled machine # [ 0.342151] APIC: Switched APIC routing to: physical x2apic machine # [ 0.343115] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask() machine # [ 0.344439] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself() machine # [ 0.345976] kvm-guest: setup PV IPIs machine # [ 0.347560] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 machine # [ 0.348616] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.353034] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) machine # [ 0.355110] x86/cpu: User Mode Instruction Prevention (UMIP) activated machine # [ 0.356161] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 machine # [ 0.357031] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 machine # [ 0.358035] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto machine # [ 0.360031] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl machine # [ 0.361031] Transient Scheduler Attacks: Vulnerable: No microcode machine # [ 0.363031] Spectre V2 : Mitigation: Enhanced / Automatic IBRS machine # [ 0.364031] Speculative Return Stack Overflow: Mitigation: Safe RET machine # [ 0.365031] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization machine # [ 0.366038] Spectre V2 : Enabling IBPB for BPF machine # [ 0.367032] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier machine # [ 0.368032] active return thunk: srso_alias_return_thunk machine # [ 0.369742] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' machine # [ 0.371031] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' machine # [ 0.372031] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' machine # [ 0.373031] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' machine # [ 0.374030] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' machine # [ 0.375031] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' machine # [ 0.376031] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' machine # [ 0.378031] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 machine # [ 0.379030] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 machine # [ 0.379855] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 machine # [ 0.381031] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 machine # [ 0.382030] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 machine # [ 0.383031] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. machine # [ 0.412170] Freeing SMP alternatives memory: 44K machine # [ 0.413034] pid_max: default: 32768 minimum: 301 machine # [ 0.413925] LSM: initializing lsm=capability,landlock,yama,bpf,ima machine # [ 0.415136] landlock: Up and running. machine # [ 0.415795] Yama: becoming mindful. machine # [ 0.416704] LSM support for eBPF active machine # [ 0.417190] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.419057] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.421532] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) machine # [ 0.422601] Performance Events: Fam17h+ core perfctr, AMD PMU driver. machine # [ 0.423041] ... version: 2 machine # [ 0.423822] ... bit width: 48 machine # [ 0.424034] ... generic counters: 6 machine # [ 0.424826] ... generic bitmap: 000000000000003f machine # [ 0.425789] ... fixed-purpose counters: 0 machine # [ 0.426033] ... fixed-purpose bitmap: 0000000000000000 machine # [ 0.426964] ... value mask: 0000ffffffffffff machine # [ 0.427743] ... max period: 00007fffffffffff machine # [ 0.428033] ... global_ctrl mask: 000000000000003f machine # [ 0.429122] signal: max sigframe size: 3376 machine # [ 0.429964] rcu: Hierarchical SRCU implementation. machine # [ 0.430717] rcu: Max phase no-delay instances is 400. machine # [ 0.431253] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level machine # [ 0.436563] smp: Bringing up secondary CPUs ... machine # [ 0.437423] smpboot: x86: Booting SMP configuration: machine # [ 0.438037] .... node #0, CPUs: #1 #2 #3 machine # [ 0.441169] smp: Brought up 1 node, 4 CPUs machine # [ 0.442759] smpboot: Total of 4 processors activated (19200.09 BogoMIPS) machine # [ 0.443372] Memory: 3957668K/4193752K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 220848K reserved, 0K cma-reserved) machine # [ 0.445034] devtmpfs: initialized machine # [ 0.446056] x86/mm: Memory block size: 128MB machine # [ 0.449083] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.450107] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). machine # [ 0.451130] pinctrl core: initialized pinctrl subsystem machine # [ 0.452301] PM: RTC time: 10:32:31, date: 2026-09-23 machine # [ 0.456052] NET: Registered PF_NETLINK/PF_ROUTE protocol family machine # [ 0.457782] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations machine # [ 0.458066] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations machine # [ 0.459556] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations machine # [ 0.460046] audit: initializing netlink subsys (disabled) machine # [ 0.461091] audit: type=2000 audit(1790159552.613:1): state=initialized audit_enabled=0 res=1 machine # [ 0.461313] thermal_sys: Registered thermal governor 'fair_share' machine # [ 0.463034] thermal_sys: Registered thermal governor 'bang_bang' machine # [ 0.464034] thermal_sys: Registered thermal governor 'step_wise' machine # [ 0.465034] thermal_sys: Registered thermal governor 'user_space' machine # [ 0.466021] thermal_sys: Registered thermal governor 'power_allocator' machine # [ 0.466841] cpuidle: using governor menu machine # [ 0.469242] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 machine # [ 0.470295] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] machine # [ 0.471038] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry machine # [ 0.472048] PCI: Using configuration type 1 for base access machine # [ 0.473202] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. machine # [ 0.476481] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages machine # [ 0.477035] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page machine # [ 0.478034] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages machine # [ 0.479033] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page machine # [ 0.483976] ACPI: Added _OSI(Module Device) machine # [ 0.486040] ACPI: Added _OSI(Processor Device) machine # [ 0.488040] ACPI: Added _OSI(Processor Aggregator Device) machine # [ 0.496721] ACPI: 1 ACPI AML tables successfully acquired and loaded machine # [ 0.503733] ACPI: Interpreter enabled machine # [ 0.505073] ACPI: PM: (supports S0 S3 S4 S5) machine # [ 0.507043] ACPI: Using IOAPIC for interrupt routing machine # [ 0.509279] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug machine # [ 0.513040] PCI: Using E820 reservations for host bridge windows machine # [ 0.516433] ACPI: Enabled 2 GPEs in block 00 to 3F machine # [ 0.528918] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) machine # [ 0.531046] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] machine # [ 0.534194] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] machine # [ 0.537299] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] machine # [ 0.539742] PCI host bridge to bus 0000:00 machine # [ 0.541044] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] machine # [ 0.544038] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] machine # [ 0.546037] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] machine # [ 0.548037] pci_bus 0000:00: root bus resource [mem 0x80000000-0xafffffff window] machine # [ 0.551038] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] machine # [ 0.553035] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.554034] pci_bus 0000:00: root bus resource [bus 00-ff] machine # [ 0.555134] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint machine # [ 0.557479] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint machine # [ 0.569262] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] machine # [ 0.571101] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] machine # [ 0.572064] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] machine # [ 0.573403] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] machine # [ 0.576034] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.581600] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] machine # [ 0.582041] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] machine # [ 0.583056] pci 0000:00:02.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref] machine # [ 0.585040] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] machine # [ 0.586583] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.590075] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] machine # [ 0.590956] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] machine # [ 0.592857] pci 0000:00:03.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref] machine # [ 0.594617] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint machine # [ 0.599076] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] machine # [ 0.599969] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] machine # [ 0.600823] pci 0000:00:04.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref] machine # [ 0.603123] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.606072] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] machine # [ 0.606996] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] machine # [ 0.607876] pci 0000:00:05.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref] machine # [ 0.609033] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] machine # [ 0.610598] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint machine # [ 0.615078] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] machine # [ 0.616056] pci 0000:00:06.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref] machine # [ 0.617616] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.620047] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] machine # [ 0.621085] pci 0000:00:07.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref] machine # [ 0.623574] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.626077] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] machine # [ 0.638922] pci 0000:00:08.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref] machine # [ 0.641155] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.644047] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] machine # [ 0.645055] pci 0000:00:09.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref] machine # [ 0.647608] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint machine # [ 0.650079] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] machine # [ 0.651014] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] machine # [ 0.651881] pci 0000:00:0a.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref] machine # [ 0.654594] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.658072] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] machine # [ 0.658987] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] machine # [ 0.659858] pci 0000:00:0b.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref] machine # [ 0.661588] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.663711] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] machine # [ 0.665267] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.667743] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] machine # [ 0.668951] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.671723] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] machine # [ 0.672267] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint machine # [ 0.674712] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] machine # [ 0.676252] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint machine # [ 0.677328] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO machine # [ 0.680286] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint machine # [ 0.682062] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] machine # [ 0.683003] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] machine # [ 0.685277] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint machine # [ 0.686918] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] machine # [ 0.691482] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 machine # [ 0.693140] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 machine # [ 0.694141] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 machine # [ 0.695132] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 machine # [ 0.696135] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 machine # [ 0.698132] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 machine # [ 0.699130] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 machine # [ 0.700135] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 machine # [ 0.701078] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 machine # [ 0.702051] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 machine # [ 0.703049] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 machine # [ 0.704052] ACPI: PCI: Interrupt link GSID configured for IRQ 19 machine # [ 0.706050] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 machine # [ 0.707048] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 machine # [ 0.708047] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 machine # [ 0.709047] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 machine # [ 0.711355] iommu: Default domain type: Translated machine # [ 0.712036] iommu: DMA domain TLB invalidation policy: lazy mode machine # [ 0.714333] ACPI: bus type USB registered machine # [ 0.715536] usbcore: registered new interface driver usbfs machine # [ 0.718240] usbcore: registered new interface driver hub machine # [ 0.720164] usbcore: registered new device driver usb machine # [ 0.725979] NetLabel: Initializing machine # [ 0.728038] NetLabel: domain hash size = 128 machine # [ 0.730038] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO machine # [ 0.732362] NetLabel: unlabeled traffic allowed by default machine # [ 0.734070] PCI: Using ACPI for IRQ routing machine # [ 0.807674] pci 0000:00:01.0: vgaarb: setting as boot VGA device machine # [ 0.808030] pci 0000:00:01.0: vgaarb: bridge control possible machine # [ 0.808030] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none machine # [ 0.811040] vgaarb: loaded machine # [ 0.811810] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 machine # [ 0.813034] hpet0: 3 comparators, 64-bit 100.000000 MHz counter machine # [ 0.819305] clocksource: Switched to clocksource kvm-clock machine # [ 0.822573] VFS: Disk quotas dquot_6.6.0 machine # [ 0.823346] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) machine # [ 0.824948] pnp: PnP ACPI init machine # [ 0.825804] ACPI: IRQ 4 override to edge(!), high(!) machine # [ 0.826779] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved machine # [ 0.828482] pnp: PnP ACPI: found 5 devices machine # [ 0.838214] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns machine # [ 0.839835] clocksource: Switched to clocksource acpi_pm machine # [ 0.840867] NET: Registered PF_INET protocol family machine # [ 0.842401] IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear) machine # [ 0.860480] tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.862053] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) machine # [ 0.863519] TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear) machine # [ 0.864996] TCP bind hash table entries: 32768 (order: 8, 1048576 bytes, linear) machine # [ 0.866378] TCP: Hash tables configured (established 32768 bind 32768) machine # [ 0.867888] MPTCP token hash table entries: 4096 (order: 5, 98304 bytes, linear) machine # [ 0.869398] UDP hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.870706] UDP-Lite hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.872072] NET: Registered PF_UNIX/PF_LOCAL protocol family machine # [ 0.873103] NET: Registered PF_XDP protocol family machine # [ 0.874011] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] machine # [ 0.875089] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] machine # [ 0.876148] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] machine # [ 0.877393] pci_bus 0000:00: resource 7 [mem 0x80000000-0xafffffff window] machine # [ 0.878567] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] machine # [ 0.879764] pci_bus 0000:00: resource 9 [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.881677] ACPI: \_SB_.GSIA: Enabled at IRQ 16 machine # [ 0.884085] ACPI: \_SB_.GSIB: Enabled at IRQ 17 machine # [ 0.886398] ACPI: \_SB_.GSIC: Enabled at IRQ 18 machine # [ 0.888500] ACPI: \_SB_.GSID: Enabled at IRQ 19 machine # [ 0.890330] PCI: CLS 0 bytes, default 64 machine # [ 0.891228] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) machine # [ 0.891734] Trying to unpack rootfs image as initramfs... machine # [ 0.892342] software IO TLB: mapped [mem 0x000000007a371000-0x000000007e371000] (64MB) machine # [ 0.892481] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.915918] Initialise system trusted keyrings machine # [ 0.917149] workingset: timestamp_bits=40 max_order=20 bucket_order=0 machine # [ 0.928525] Key type asymmetric registered machine # [ 0.929320] Asymmetric key parser 'x509' registered machine # [ 0.930279] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) machine # [ 0.932112] io scheduler mq-deadline registered machine # [ 0.932933] io scheduler kyber registered machine # [ 0.936018] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled machine # [ 0.937399] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A machine # [ 0.939810] Linux agpgart interface v0.103 machine # [ 0.940605] ACPI: bus type drm_connector registered machine # [ 0.942938] usbcore: registered new interface driver usbserial_generic machine # [ 0.944097] usbserial: USB Serial support registered for generic machine # [ 0.945186] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. machine # [ 0.945186] Please enable it if your BIOS has the CPPC option. machine # [ 0.947551] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled machine # [ 0.949044] drop_monitor: Initializing network drop monitor service machine # [ 0.950309] NET: Registered PF_INET6 protocol family machine # [ 0.952235] Segment Routing with IPv6 machine # [ 0.952941] In-situ OAM (IOAM) with IPv6 machine # [ 0.954712] IPI shorthand broadcast: enabled machine # [ 0.959137] sched_clock: Marking stable (805015327, 153156519)->(978631467, -20459621) machine # [ 0.960990] registered taskstats version 1 machine # [ 0.962056] Loading compiled-in X.509 certificates machine # [ 0.972073] Demotion targets for Node 0: null machine # [ 0.973213] Key type .fscrypt registered machine # [ 0.973921] Key type fscrypt-provisioning registered machine # [ 0.974925] ima: No TPM chip found, activating TPM-bypass! machine # [ 0.975873] ima: Allocated hash algorithm: sha1 machine # [ 0.976729] ima: No architecture policies found machine # [ 0.977787] PM: Magic number: 10:285:528 machine # [ 0.979423] RAS: Correctable Errors collector initialized. machine # [ 0.983908] clk: Disabling unused clocks machine # [ 0.984627] PM: genpd: Disabling unused power domains machine # [ 1.172538] Freeing initrd memory: 29052K machine # [ 1.179892] Freeing unused decrypted memory: 2028K machine # [ 1.186247] Freeing unused kernel image (initmem) memory: 3652K machine # [ 1.188950] Write protecting the kernel read-only data: 32768k machine # [ 1.193832] Freeing unused kernel image (text/rodata gap) memory: 1184K machine # [ 1.197745] Freeing unused kernel image (rodata/data gap) memory: 720K machine # [ 1.265942] x86/mm: Checked W+X mappings: passed, no W+X pages found. machine # [ 1.267128] Run /init as init process machine # [ 1.279955] systemd[1]: Inserted module 'autofs4' machine # [ 1.305696] fuse: init (API version 7.45) machine # [ 1.314693] ACPI: \_SB_.GSIG: Enabled at IRQ 22 machine # [ 1.316992] ACPI: \_SB_.GSIH: Enabled at IRQ 23 machine # [ 1.320306] ACPI: \_SB_.GSIE: Enabled at IRQ 20 machine # [ 1.322456] ACPI: \_SB_.GSIF: Enabled at IRQ 21 machine # [ 1.327652] virtiofs virtio5: discovered new tag: nix-store machine # [ 1.329365] virtiofs virtio5: virtio_fs_setup_dax: No cache capability machine # [ 1.336458] virtiofs virtio6: discovered new tag: shared machine # [ 1.349459] virtiofs virtio6: virtio_fs_setup_dax: No cache capability machine # [ 1.352686] virtiofs virtio7: discovered new tag: xchg machine # [ 1.354230] virtiofs virtio7: virtio_fs_setup_dax: No cache capability machine # [ 1.378731] systemd[1]: Successfully made /usr/ read-only. machine # [ 1.715820] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 1.729558] systemd[1]: Detected virtualization kvm. machine # [ 1.731946] systemd[1]: Detected architecture x86-64. machine # [ 1.734421] systemd[1]: Running in initrd. machine # [ 1.737108] systemd[1]: Initializing machine ID from random generator. machine # [ 1.740425] systemd[1]: Hostname set to . machine # [ 1.867705] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 1.935987] systemd[1]: Queued start job for default target Initrd Default Target. machine # [ 1.946904] systemd[1]: Created slice Slice /system/modprobe. machine # [ 1.948130] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 1.950277] systemd[1]: Expecting device /dev/disk/by-label/nixos... machine # [ 1.952451] systemd[1]: Reached target Path Units. machine # [ 1.954219] systemd[1]: Reached target Slice Units. machine # [ 1.955947] systemd[1]: Reached target Swaps. machine # [ 1.957559] systemd[1]: Reached target Timer Units. machine # [ 1.959474] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 1.961850] systemd[1]: Listening on Journal Socket (/dev/log). machine # [ 1.964143] systemd[1]: Listening on Journal Sockets. machine # [ 1.966198] systemd[1]: Listening on udev Control Socket. machine # [ 1.968257] systemd[1]: Listening on udev Kernel Socket. machine # [ 1.969263] systemd[1]: Reached target Socket Units. machine # [ 1.971363] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 1.973538] systemd[1]: Starting Load Kernel Module configfs... machine # [ 1.976634] systemd[1]: Starting Journal Service... machine # [ 1.984433] systemd[1]: Starting Load Kernel Modules... machine # [ 1.987320] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 1.993955] systemd[1]: Starting Coldplug All udev Devices... machine # [ 1.998758] systemd-journald[90]: Collecting audit messages is disabled. machine # [ 1.999763] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 2.004796] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 2.009417] systemd[1]: Finished Load Kernel Module configfs. machine # [ 2.013509] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config machine # [ 2.022396] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 2.033979] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. machine # [ 2.036430] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev machine # [ 2.043173] systemd[1]: Finished Load Kernel Modules. machine # [ 1.893051] systemd-modules-l[ 2.046353] systemd[1]: Starting Apply Kernel Variables... machine # oad[91]: Using 4 probe threads machine # [ 2.047686] systemd[1]: Started Journal Service. machine # [ 1.894916] systemd-modules-load[91]: Inserted module 'virtio_balloon' machine # [ 1.896658] systemd-modules-load[91]: Inserted module 'dm_mod' machine # [ 1.897700] systemd-modules-load[91]: Inserted module 'virtio_gpu' machine # [ 1.901560] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 1.904862] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 1.906872] systemd[1]: Finished Apply Kernel Variables. machine # [ 1.928683] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 1.929581] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 1.930515] systemd[1]: Reached target Local File Systems. machine # [ 1.931339] systemd[1]: Starting Create System Files and Directories... machine # [ 1.932309] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 1.941588] systemd[1]: Finished Create System Files and Directories. machine # [ 1.951572] systemd-udevd[111]: Using default interface naming scheme 'v261'. machine # [ 1.961663] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 1.975697] systemd[1]: Finished Coldplug All udev Devices. machine # [ 1.976547] systemd[1]: Reached target System Initialization. machine # [ 1.977390] systemd[1]: Reached target Basic System. machine # [ 2.231410] ehci-pci 0000:00:1d.7: EHCI Host Controller machine # [ 2.232445] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 machine # [ 2.234460] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 machine # [ 2.241375] SCSI subsystem initialized machine # [ 2.243249] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 machine # [ 2.244530] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 machine # [ 2.246016] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.246286] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 machine # [ 2.246426] usb usb1: Product: EHCI Host Controller machine # [ 2.250317] serio: i8042 KBD port at 0x60,0x64 irq 1 machine # [ 2.250413] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd machine # [ 2.250588] serio: i8042 AUX port at 0x60,0x64 irq 12 machine # [ 2.250803] usb usb1: SerialNumber: 0000:00:1d.7 machine # [ 2.254242] hub 1-0:1.0: USB hub found machine # [ 2.254959] hub 1-0:1.0: 6 ports detected machine # [ 2.255203] virtio_blk virtio2: 4/0/0 default/read/poll queues machine # [ 2.259941] uhci_hcd 0000:00:1d.0: UHCI Host Controller machine # [ 2.260863] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 machine # [ 2.262759] uhci_hcd 0000:00:1d.0: detected 2 ports machine # [ 2.265589] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 machine # [ 2.266749] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.267944] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.268996] usb usb2: Product: UHCI Host Controller machine # [ 2.269687] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd machine # [ 2.270449] usb usb2: SerialNumber: 0000:00:1d.0 machine # [ 2.278924] virtio_blk virtio2: [vda] 33554432 512-byte logical blocks (17.2 GB/16.0 GiB) machine # [ 2.288287] hub 2-0:1.0: USB hub found machine # [ 2.289108] hub 2-0:1.0: 2 ports detected machine # [ 2.291502] uhci_hcd 0000:00:1d.1: UHCI Host Controller machine # [ 2.139926] systemd[1]: Starting Virtual Console Setup... machine # [ 2.296227] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 machine # [ 2.297816] uhci_hcd 0000:00:1d.1: detected 2 ports machine # [ 2.305082] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 machine # [ 2.306500] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.153777] (udev-worker)[128]: eth1: Config file /et[ 2.307809] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # c/systemd/network/40-eth1.link is applied to device based on pot[ 2.309598] usb usb3: Product: UHCI Host Controller machine # entially unpredictable interface name.[ 2.310855] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd machine # machine # [ 2.312002] usb usb3: SerialNumber: 0000:00:1d.1 machine # [ 2.160437] (udev-worker)[128]: Network interface NamePolicy= disabled on kernel command line. machine # [ 2.316375] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode machine # [ 2.317650] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) machine # [ 2.319365] ahci 0000:00:1f.2: flags: 64bit ncq only machine # [ 2.320634] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 machine # [ 2.172140] systemd-vconsole-setup[143]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 2.326618] hub 3-0:1.0: USB hub found machine # [ 2.327440] hub 3-0:1.0: 2 ports detected machine # [ 2.174536] (udev-worker)[127]: Network interface NamePolicy=[ 2.328318] scsi host0: ahci machine # disabled on kernel command line. machine # [ 2.176779] systemd[1]: Finished Virtual Console Setup.[ 2.330832] uhci_hcd 0000:00:1d.2: UHCI Host Controller machine # machine # [ 2.331972] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 machine # [ 2.179628] systemd[1]: Found device /dev/dis[ 2.333193] uhci_hcd 0000:00:1d.2: detected 2 ports machine # k/by-label/nixos. machine # [ 2.334563] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 machine # [ 2.334693] scsi host1: ahci machine # [ 2.335016] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.182871] systemd[1]: Reached target Initrd[ 2.337258] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # Root Device. machine # [ 2.338504] scsi host2: ahci machine # [ 2.338629] usb usb4: Product: UHCI Host Controller machine # [ 2.186071] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... machine # [ 2.339933] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd machine # [ 2.340301] scsi host3: ahci machine # [ 2.340486] usb usb4: SerialNumber: 0000:00:1d.2 machine # [ 2.342893] scsi host4: ahci machine # [ 2.343208] hub 4-0:1.0: USB hub found machine # [ 2.343686] scsi host5: ahci machine # [ 2.344000] hub 4-0:1.0: 2 ports detected machine # [ 2.344265] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 50 lpm-pol 1 machine # [ 2.346540] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 50 lpm-pol 1 machine # [ 2.347771] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 50 lpm-pol 1 machine # [ 2.349113] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 50 lpm-pol 1 machine # [ 2.350370] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 50 lpm-pol 1 machine # [ 2.351585] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 50 lpm-pol 1 machine # [ 2.208866] systemd-fsck[172]: nixos: clean, 12/1048576 files, 109865/4194304 blocks machine # [ 2.212762] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. machine # [ 2.496413] usb 1-1: new high-speed USB device number 2 using ehci-pci machine # [ 2.629647] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 machine # [ 2.632694] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 machine # [ 2.635382] usb 1-1: Product: QEMU USB Tablet machine # [ 2.637067] usb 1-1: Manufacturer: QEMU machine # [ 2.638639] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 machine # [ 2.672037] ata2: SATA link down (SStatus 0 SControl 300) machine # [ 2.674491] ata4: SATA link down (SStatus 0 SControl 300) machine # [ 2.677020] ata5: SATA link down (SStatus 0 SControl 300) machine # [ 2.677742] hid: raw HID events driver (C) Jiri Kosina machine # [ 2.679405] ata6: SATA link down (SStatus 0 SControl 300) machine # [ 2.683357] ata1: SATA link down (SStatus 0 SControl 300) machine # [ 2.685686] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) machine # [ 2.688104] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 machine # [ 2.690203] ata3.00: applying bridge limits machine # [ 2.692067] ata3.00: configured for UDMA/100 machine # [ 2.694564] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 machine # [ 2.735671] usbcore: registered new interface driver usbhid machine # [ 2.737765] usbhid: USB HID core driver machine # [ 2.747383] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 machine # [ 2.752068] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 machine # [ 2.773726] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray machine # [ 2.808647] cdrom: Uniform CD-ROM driver Revision: 3.20 machine # [ 2.848342] systemd[1]: Mounting /sysroot... machine # [ 3.145854] EXT4-fs (vda): mounted filesystem 21069e6b-bab5-4f70-9849-0cc0af0cc60b r/w with ordered data mode. Quota mode: none. machine # [ 2.997587] systemd[1]: Mounted /sysroot. machine # [ 2.998984] systemd[1]: Reached target Initrd Root File System. machine # [ 3.003298] systemd[1]: Mounting /sysroot/nix/.ro-store... machine # [ 3.005834] systemd[1]: Mounting /sysroot/nix/.rw-store... machine # [ 3.009666] systemd[1]: Mounting /sysroot/run... machine # [ 3.020120] systemd[1]: Mounting /sysroot/tmp/shared... machine # [ 3.026190] systemd[1]: Mounting /sysroot/tmp/xchg... machine # [ 3.030519] systemd[1]: Starting Mountpoints Configured in the Real Root... machine # [ 3.036742] systemd[1]: Mounted /sysroot/nix/.ro-store. machine # [ 3.037631] systemd[1]: Mounted /sysroot/nix/.rw-store. machine # [ 3.038477] systemd[1]: Mounted /sysroot/run. machine # [ 3.039243] systemd[1]: Mounted /sysroot/tmp/xchg. machine # [ 3.043666] systemd[1]: Mounted /sysroot/tmp/shared. machine # [ 3.046558] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.048237] systemd-sysroot-fstab-check[191]: /sysroot should be mounted in the initrd, will request daemon-reload. machine # [ 3.050506] systemd[1]: Reload requested from client PID 191 ('systemd-sysroot') (unit initrd-parse-etc.service)... machine # [ 3.052117] systemd[1]: Reloading... machine # [ 3.110415] systemd[1]: Reloading finished in 59 ms. machine # [ 3.131421] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.133101] systemd-sysroot-fstab-check[191]: Requesting initrd-fs.target/start/replace... machine # [ 3.134699] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.137065] systemd-sysroot-fstab-check[191]: Requesting swap.target/start/replace... machine # [ 3.139253] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.142548] systemd[1]: initrd-parse-etc.service: Deactivated successfully. machine # [ 3.144118] systemd[1]: Finished Mountpoints Configured in the Real Root. machine # [ 3.145434] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. machine # [ 3.162834] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.164467] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.848980] systemd[1]: Mounting /sysroot/nix/store... machine # [ 3.907411] systemd[1]: Mounted /sysroot/nix/store. machine # [ 3.910294] systemd[1]: Reached target Initrd File Systems. machine # [ 3.913907] systemd[1]: Starting Find NixOS closure... machine # [ 3.917322] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... machine # [ 3.940139] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. machine # [ 3.942840] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. machine # [ 3.957061] systemd[1]: Finished Find NixOS closure. machine # [ 3.958807] systemd[1]: Reached target Initrd Default Target. machine # [ 3.961264] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... machine # [ 3.990841] systemd[1]: Stopped target Initrd Default Target. machine # [ 3.993121] systemd[1]: Stopped target Basic System. machine # [ 3.995049] systemd[1]: Stopped target Initrd Root Device. machine # [ 3.997133] systemd[1]: Stopped target Path Units. machine # [ 3.998941] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. machine # [ 4.001647] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. machine # [ 4.004459] systemd[1]: Stopped target Slice Units. machine # [ 4.006400] systemd[1]: Stopped target Socket Units. machine # [ 4.009226] systemd[1]: Stopped target System Initialization. machine # [ 4.012115] systemd[1]: Stopped target Swaps. machine # [ 4.013983] systemd[1]: Stopped target Timer Units. machine # [ 4.016319] systemd[1]: dbus.socket: Deactivated successfully. machine # [ 4.018529] systemd[1]: Closed D-Bus System Message Bus Socket. machine # [ 4.020771] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. machine # [ 4.023440] systemd[1]: Stopped Find NixOS closure. machine # [ 4.025360] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 4.027651] systemd[1]: systemd-sysctl.service: Deactivated successfully. machine # [ 4.029647] systemd[1]: Stopped Apply Kernel Variables. machine # [ 4.031198] systemd[1]: systemd-modules-load.service: Deactivated successfully. machine # [ 4.033239] systemd[1]: Stopped Load Kernel Modules. machine # [ 4.034717] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. machine # [ 4.037278] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. machine # [ 4.039502] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. machine # [ 4.041526] systemd[1]: Stopped Create System Files and Directories. machine # [ 4.043295] systemd[1]: Stopped target Local File Systems. machine # [ 4.044828] systemd[1]: Stopped target Preparation for Local File Systems. machine # [ 4.046786] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. machine # [ 4.048903] systemd[1]: Stopped Coldplug All udev Devices. machine # [ 4.050927] systemd[1]: Stopping Rule-based Manager for Device Events and Files... machine # [ 4.052469] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 4.053946] systemd[1]: Stopped Virtual Console Setup. machine # [ 4.055167] systemd[1]: initrd-cleanup.service: Deactivated successfully. machine # [ 4.056583] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. machine # [ 4.058134] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 4.059580] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 4.060844] systemd[1]: systemd-udevd.service: Deactivated successfully. machine # [ 4.062228] systemd[1]: Stopped Rule-based Manager for Device Events and Files. machine # [ 4.063643] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. machine # [ 4.064953] systemd[1]: Closed udev Control Socket. machine # [ 4.065973] systemd[1]: Starting Cleanup udev Database... machine # [ 4.067263] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. machine # [ 4.068602] systemd[1]: Stopped Create Static Device Nodes in /dev. machine # [ 4.069829] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. machine # [ 4.071295] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. machine # [ 4.072608] systemd[1]: kmod-static-nodes.service: Deactivated successfully. machine # [ 4.073923] systemd[1]: Stopped Create List of Static Device Nodes. machine # [ 4.075224] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. machine # [ 4.076590] systemd[1]: Finished Cleanup udev Database. machine # [ 4.077633] systemd[1]: Reached target Switch Root. machine # [ 4.078670] systemd[1]: Starting NixOS Activation... machine # [ 4.225031] initrd-nixos-activation-start[237]: booting system configuration /nix/store/c5w72g0vwr4wzw9bd7wj2pf3y1lprgcx-nixos-system-machine-test machine # [ 4.292352] initrd-nixos-activation-start[237]: running activation script... machine # [ 4.629215] initrd-nixos-activation-start[260]: setting up /etc... machine # [ 4.765884] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. machine # [ 4.768634] systemd[1]: Finished NixOS Activation. machine # [ 4.770535] systemd[1]: Starting Switch Root... machine # [ 4.781259] systemd[1]: Switching root. machine # [ 4.998339] systemd-journald[90]: Received SIGTERM from PID 1 (systemd). machine # [ 5.146455] NET: Registered PF_VSOCK protocol family machine # [ 5.543420] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 5.553749] systemd[1]: Detected virtualization kvm. machine # [ 5.555675] systemd[1]: Detected architecture x86-64. machine # [ 5.586989] systemd[1]: Detected first boot. machine # [ 5.592242] systemd[1]: Initializing machine ID from random generator. machine # [ 5.735078] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 5.824404] systemd[1]: Applying preset policy. machine # [ 6.047379] systemd[1]: Populated /etc with preset unit settings. machine # [ 6.332830] systemd[1]: initrd-switch-root.service: Deactivated successfully. machine # [ 6.336728] systemd[1]: Stopped initrd-switch-root.service. machine # [ 6.341440] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. machine # [ 6.346094] systemd[1]: Created slice Slice /system/getty. machine # [ 6.349069] systemd[1]: Created slice User and Session Slice. machine # [ 6.351042] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 6.353617] systemd[1]: Started Forward Password Requests to Wall Directory Watch. machine # [ 6.355951] systemd[1]: Expecting device /dev/hvc0... machine # [ 6.357520] systemd[1]: Expecting device /dev/ttyS0... machine # [ 6.359203] systemd[1]: Reached target Local Encrypted Volumes. machine # [ 6.361003] systemd[1]: Stopped target initrd-fs.target. machine # [ 6.362665] systemd[1]: Stopped target initrd-root-fs.target. machine # [ 6.364355] systemd[1]: Stopped target initrd-switch-root.target. machine # [ 6.365304] systemd[1]: Reached target Virtual Machines and Containers. machine # [ 6.366339] systemd[1]: Reached target Path Units. machine # [ 6.367123] systemd[1]: Reached target Remote File Systems. machine # [ 6.368041] systemd[1]: Reached target Slice Units. machine # [ 6.368793] systemd[1]: Reached target Swaps. machine # [ 6.371465] systemd[1]: Listening on Query the User Interactively for a Password. machine # [ 6.374505] systemd[1]: Listening on Process Core Dump Socket. machine # [ 6.376763] systemd[1]: Listening on Credential Encryption/Decryption. machine # [ 6.379041] systemd[1]: Listening on Factory Reset Management. machine # [ 6.380121] systemd[1]: Listening on Hostname Service Socket. machine # [ 6.383503] systemd[1]: Starting Journal Log Access Socket... machine # [ 6.384847] systemd[1]: Listening on Journal Audit Socket. machine # [ 6.387093] systemd[1]: Listening on Console Output Muting Service Socket. machine # [ 6.388412] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. machine # [ 6.389633] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.391072] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki machine # [ 6.396371] systemd[1]: Listening on Disk Repartitioning Service Socket. machine # [ 6.397579] systemd[1]: Listening on udev Control Socket. machine # [ 6.398620] systemd[1]: Listening on udev Varlink Socket. machine # [ 6.401297] systemd[1]: Mounting Huge Pages File System... machine # [ 6.403707] systemd[1]: Mounting POSIX Message Queue File System... machine # [ 6.406416] systemd[1]: Mounting Kernel Debug File System... machine # [ 6.408966] systemd[1]: Mounting Kernel Trace File System... machine # [ 6.415908] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 6.421249] systemd[1]: Starting Load Kernel Module configfs... machine # [ 6.423513] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm machine # [ 6.427121] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.430993] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.438100] systemd[1]: Mounting FUSE Control File System... machine # [ 6.440395] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.450763] systemd[1]: Starting Journal Service... machine # [ 6.456308] systemd[1]: Starting Load Kernel Modules... machine # [ 6.466254] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... machine # [ 6.470256] systemd[1]: Starting Remount Root and Kernel File Systems... machine # [ 6.471377] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.474608] systemd[1]: Starting Coldplug All udev Devices... machine # [ 6.477357] systemd[1]: Listening on Journal Log Access Socket. machine # [ 6.478482] systemd[1]: Mounted Huge Pages File System. machine # [ 6.479449] systemd[1]: Mounted POSIX Message Queue File System. machine # [ 6.480569] systemd[1]: Mounted Kernel Debug File System. machine # [ 6.481554] systemd[1]: Mounted Kernel Trace File System. machine # [ 6.483110] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 6.484532] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 6.485940] systemd[1]: Finished Load Kernel Module configfs. machine # [ 6.487034] systemd[1]: Mounted FUSE Control File System. machine # [ 6.489875] systemd[1]: Mounting Kernel Configuration File System... machine # [ 6.490825] systemd-journald[330]: Collecting audit messages is enabled. machine # [ 6.495633] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 6.498056] loop: module loaded machine # [ 6.501031] systemd[1]: Finished Load Kernel Modules. machine # [ 6.349744] systemd[1]: Queued start job for default target Multi-User System. machine # [ 6.351120] systemd[1]: syste[ 6.503906] EXT4-fs (vda): re-mounted 21069e6b-bab5-4f70-9849-0cc0af0cc60b. machine # md-journald.serv[ 6.503921] systemd[1]: Starting Apply Kernel Variables... machine # ice: Deactivated successfully. machine # [ 6.506900] systemd[1]: Started Journal Service. machine # [ 6.354297] systemd-modules-load[331]: Using 2 probe threads machine # [ 6.355652] systemd-modules-load[331]: Inserted module 'loop' machine # [ 6.356846] systemd[1]: Finished Remount Root and Kernel File Systems. machine # [ 6.363103] systemd[1]: Listening on Disk Image Download Service Socket. machine # [ 6.365076] systemd[1]: Starting Flush Journal to Persistent Storage... machine # [ 6.366123] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.369290] systemd[1]: Starting Load/Save OS Random Seed... machine # [ 6.370509] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.371851] systemd[1]: Mounted Kernel Configuration File System. machine # [ 6.374800] systemd-oomd[333]: No swap; memory pressure usage will be degraded machine # [ 6.376256] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. machine # [ 6.538351] systemd-journald[330]: Received client request to flush runtime journal. machine # [ 6.440401] systemd[1]: Finished Load/Save OS Random Seed. machine # [ 6.441746] systemd[1]: Reached target First Boot Complete. machine # [ 6.442632] systemd[1]: Finished Apply Kernel Variables. machine # [ 6.443433] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 6.444465] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 6.445526] systemd[1]: Finished Flush Journal to Persistent Storage. machine # [ 6.446980] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 6.447952] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 6.448985] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 6.487479] systemd-udevd[362]: Using default interface naming scheme 'v261'. machine # [ 6.491929] systemd[1]: Finished Coldplug All udev Devices. machine # [ 6.526044] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 6.604093] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.634579] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. machine # [ 6.640823] (udev-worker)[373]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.642874] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. machine # [ 6.655855] (udev-worker)[367]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 6.658364] (udev-worker)[367]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.669543] systemd[1]: Condition check resulted in Virtio network device being skipped. machine # [ 6.670979] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.672595] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.675251] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.677227] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.678485] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.845346] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized machine # [ 6.847390] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input3 machine # [ 6.847538] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input4 machine # [ 6.882426] rtc_cmos PNP0B00:00: RTC can wake from S4 machine # [ 6.887209] ACPI: button: Power Button [PWRF] machine # [ 6.888424] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console machine # [ 6.901439] Console: switching to colour dummy device 80x25 machine # [ 6.902252] [drm] Found bochs VGA, ID 0xb0c5. machine # [ 6.902702] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. machine # [ 6.907013] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic machine # [ 6.908054] parport_pc 00:02: reported by Plug and Play ACPI machine # [ 6.908386] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 machine # [ 6.910556] rtc_cmos PNP0B00:00: registered as rtc0 machine # [ 6.911226] rtc_cmos PNP0B00:00: setting system clock to 2026-09-23T10:32:38 UTC (1790159558) machine # [ 6.911441] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] machine # [ 6.913220] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs machine # [ 6.918453] Console: switching to colour frame buffer device 160x50 machine # [ 6.918465] mousedev: PS/2 mouse device common for all mice machine # [ 6.921416] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device machine # [ 6.924939] systemd-journald[330]: Time jumped backwards, rotating. machine # [ 6.952261] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 machine # [ 6.954686] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 machine # [ 6.962305] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt machine # [ 6.963328] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD machine # [ 6.830450] systemd[1]: Starting Virtual Console Setup... machine # [ 6.985878] iTCO_wdt iTCO_wdt.0.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) machine # [ 6.988252] iTCO_wdt iTCO_wdt.0.auto: initialized. heartbeat=30 sec (nowayout=0) machine # [ 6.855986] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 6.857608] systemd[1]: Stopped Virtual Console Setup. machine # [ 6.867280] systemd[1]: Starting Virtual Console Setup... machine # [ 7.038784] ppdev: user-space parallel port driver machine # [ 7.085343] kvm_amd: TSC scaling supported machine # [ 7.085771] kvm_amd: Nested Virtualization enabled machine # [ 7.086368] kvm_amd: Nested Paging enabled machine # [ 7.086813] kvm_amd: LBR virtualization supported machine # [ 7.087471] kvm_amd: Virtual VMLOAD VMSAVE supported machine # [ 7.088067] kvm_amd: Virtual GIF supported machine # [ 7.088535] kvm_amd: Virtual NMI enabled machine # [ 7.204884] EDAC MC: Ver: 3.0.0 machine # [ 7.062159] systemd-vconsole-setup[405]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 7.066195] systemd[1]: Finished Virtual Console Setup. machine # [ 7.184545] systemd[1]: Mounting /run/wrappers... machine # [ 7.219848] systemd[1]: Mounted /run/wrappers. machine # [ 7.221926] systemd[1]: Reached target Local File Systems. machine # [ 7.224713] systemd[1]: Listening on Boot Loader Control Service Socket. machine # [ 7.227945] systemd[1]: Starting register-nix-paths.service... machine # [ 7.231208] systemd[1]: Starting Create SUID/SGID Wrappers... machine # [ 7.233361] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. machine # [ 7.236786] systemd[1]: Starting Save Transient machine-id to Disk... machine # [ 7.241340] systemd[1]: Starting Create System Files and Directories... machine # [ 7.307772] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. machine # [ 7.311480] systemd[1]: Finished Save Transient machine-id to Disk. machine # [ 7.338500] systemd[1]: Finished Create System Files and Directories. machine # [ 7.341923] systemd[1]: Starting Rebuild Journal Catalog... machine # [ 7.343318] systemd[1]: Starting Record System Boot/Shutdown in UTMP... machine # [ 7.368237] systemd[1]: Finished Record System Boot/Shutdown in UTMP. machine # [ 7.381123] systemd[1]: Finished Rebuild Journal Catalog. machine # [ 7.382779] systemd[1]: Starting Update is Completed... machine # [ 7.405761] systemd[1]: Finished Update is Completed. machine # [ 7.517058] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. machine # [ 7.518568] systemd[1]: Finished Create SUID/SGID Wrappers. machine # [ 7.757291] systemd[1]: Finished register-nix-paths.service. machine # [ 7.759829] systemd[1]: Reached target System Initialization. machine # [ 7.762597] systemd[1]: Started Discard unused filesystem blocks once a week. machine # [ 7.765222] systemd[1]: Started niks3 garbage collection timer. machine # [ 7.767423] systemd[1]: Started Daily Cleanup of Temporary Directories. machine # [ 7.769906] systemd[1]: Reached target Timer Units. machine # [ 7.771803] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 7.783142] systemd[1]: Listening on niks3 server socket. machine # [ 7.785324] systemd[1]: Listening on Nix Daemon Socket. machine # [ 7.787398] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. machine # [ 7.790465] systemd[1]: Reached target Socket Units. machine # [ 7.792450] systemd[1]: Reached target Basic System. machine # [ 7.794454] systemd[1]: Started backdoor.service. machine # [ 7.796423] systemd[1]: Starting Import lastlog data into lastlog2 database... machine # [ 7.799202] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 7.801688] systemd[1]: Starting Post-Boot Actions... machine # [ 7.807772] systemd[1]: Started Reset console on configuration changes. machine # [ 7.812950] systemd[1]: Starting resolvconf update... machine # [ 7.816754] systemd[1]: Started rustfs.service. machine # [ 7.822101] systemd[1]: Starting rustfs-bucket.service... machine # [ 7.825828] systemd[1]: Starting D-Bus System Message Bus... machine # [ 7.857098] systemd[1]: Finished Post-Boot Actions. machine # connecting to host... machine # [ 7.875390] nsncd[488]: Sep 23 10:32:39.616 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 7.876557] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 7.877492] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 7.878484] systemd[1]: Reached target User and Group Name Lookups. machine # [ 7.880772] systemd[1]: Starting User Login Management... machine: Guest shell says: b'Spawning backdoor root shell...\n' machine # [ 7.895724] systemd[1]: Finished Import lastlog data into lastlog2 database. machine: connected to guest root shell machine: (connecting took 8.55 seconds) machine: (finished: waiting for the VM to finish booting, in 8.81 seconds) machine # [ 7.910789] dbus-broker-launch[494]: Looking up NSS user entry for 'systemd-timesync'... machine # [ 7.919388] dbus-broker-launch[494]: NSS returned no entry for 'systemd-timesync' machine # [ 7.920508] dbus-broker-launch[494]: Invalid user-name in /nix/store/d3mrkr0v9x5sgbb0rb2pnsl0mysb1m4x-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" machine # [ 7.928237] systemd[1]: Started D-Bus System Message Bus. machine # [ 7.948610] dbus-broker-launch[494]: Ready machine # [ 7.949657] systemd-logind[519]: New seat seat0. machine # [ 7.954801] systemd-logind[519]: Watching system buttons on /dev/input/event3 (Power Button) machine # [ 7.956069] systemd-logind[519]: Watching system buttons on /dev/input/event2 (QEMU Virtio Keyboard) machine # [ 7.957296] systemd-logind[519]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) machine # [ 7.958924] systemd[1]: Started User Login Management. machine # [ 7.962689] systemd[1]: Starting linger-users.service... machine # [ 7.969822] systemd[1]: Stopped target Host and Network Name Lookups. machine # [ 7.970979] systemd[1]: Stopping Host and Network Name Lookups... machine # [ 7.973825] systemd[1]: Stopped target User and Group Name Lookups. machine # [ 7.974590] systemd[1]: Stopping User and Group Name Lookups... machine # [ 7.975786] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... machine # [ 7.976548] systemd[1]: nscd.service: Deactivated successfully. machine # [ 7.977197] systemd[1]: Stopped Name Service Cache Daemon (nsncd). machine # [ 7.977883] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 7.998346] systemd[1]: linger-users.service: Deactivated successfully. machine # [ 8.000242] systemd[1]: Finished linger-users.service. machine # [ 8.013829] nsncd[590]: Sep 23 10:32:39.754 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 8.014527] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 8.015160] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 8.015599] systemd[1]: Reached target User and Group Name Lookups. machine # [ 8.035324] systemd[1]: Finished resolvconf update. machine # [ 8.036065] systemd[1]: Reached target Preparation for Network. machine # [ 8.037908] systemd[1]: Starting DHCP Client... machine # [ 8.039323] systemd[1]: Starting Address configuration of eth1... machine # [ 8.040819] systemd[1]: Starting Extra networking commands.... machine # [ 8.098068] network-addresses-eth1-start[626]: adding address 192.168.1.1/24... done machine # [ 8.108079] network-addresses-eth1-start[626]: adding address 2001:db8:1::1/64... done machine # [ 8.119058] systemd[1]: Finished Address configuration of eth1. machine # [ 8.127678] dhcpcd[636]: dhcpcd-10.3.2 starting machine # [ 8.133987] dhcpcd[692]: dev: loaded udev machine # [ 8.144311] systemd[1]: Finished Extra networking commands.. machine # [ 8.145037] systemd[1]: Reached target Network. machine # [ 8.299019] 8021q: 802.1Q VLAN Support v1.8 machine # [ 8.299781] 8021q: adding VLAN 0 to HW filter on device eth1 machine # [ 8.147372] systemd[1]: Starting PostgreSQL Server... machine # [ 8.148946] systemd[1]: Starting Permit User Sessions... machine # [ 8.163070] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. machine # [ 8.184110] systemd[1]: Finished Permit User Sessions. machine # [ 8.185772] systemd[1]: Started Getty on tty1. machine # [ 8.186673] systemd[1]: Reached target Login Prompts. machine # [ 8.395510] cfg80211: Loading compiled-in X.509 certificates for regulatory database machine # [ 8.414359] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' machine # [ 8.415211] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' machine # [ 8.416706] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 machine # [ 8.418088] cfg80211: failed to load regulatory.db machine # [ 8.288201] postgresql-pre-start[710]: The files belonging to this database system will be owned by user "postgres". machine # [ 8.289213] postgresql-pre-start[710]: This user must also own the server process. machine # [ 8.292240] postgresql-pre-start[710]: The database cluster will be initialized with locale "en_US.UTF-8". machine # [ 8.292886] postgresql-pre-start[710]: The default database encoding has accordingly been set to "UTF8". machine # [ 8.293608] postgresql-pre-start[710]: The default text search configuration will be set to "english". machine # [ 8.294138] postgresql-pre-start[710]: Data page checksums are enabled. machine # [ 8.296789] postgresql-pre-start[710]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok machine # [ 8.298611] postgresql-pre-start[710]: creating subdirectories ... ok machine # [ 8.299554] postgresql-pre-start[710]: selecting dynamic shared memory implementation ... posix machine # [ 8.460178] 8021q: adding VLAN 0 to HW filter on device eth0 machine # [ 8.308590] dhcpcd[692]: eth0: waiting for carrier machine # [ 8.309730] dhcpcd[692]: eth0: carrier acquired machine # [ 8.316902] dhcpcd[692]: DUID 00:01:00:01:32:46:67:48:52:54:00:12:34:56 machine # [ 8.317668] dhcpcd[692]: eth0: IAID 00:12:34:56 machine # [ 8.318563] dhcpcd[692]: eth0: adding address fe80::5054:ff:fe12:3456 machine # [ 8.362137] postgresql-pre-start[710]: selecting default "max_connections" ... 100 machine # [ 8.418265] postgresql-pre-start[710]: selecting default "shared_buffers" ... 128MB machine # [ 9.161323] postgresql-pre-start[710]: selecting default time zone ... UTC machine # [ 9.163440] postgresql-pre-start[710]: creating configuration files ... ok machine # [ 9.326799] postgresql-pre-start[710]: running bootstrap script ... ok machine # [ 9.424404] dhcpcd[692]: eth0: soliciting a DHCP lease machine # [ 9.596295] NET: Registered PF_PACKET protocol family machine # [ 9.463778] dhcpcd[692]: eth0: offered 10.0.2.15 from 10.0.2.2 machine # [ 9.466418] dhcpcd[692]: eth0: probing address 10.0.2.15/24 machine # [ 9.801821] postgresql-pre-start[710]: performing post-bootstrap initialization ... ok machine # [ 9.850885] dhcpcd[692]: eth0: soliciting an IPv6 router machine # [ 9.852985] dhcpcd[692]: eth0: Router Advertisement from fe80::2 machine # [ 9.855263] dhcpcd[692]: eth0: adding address fec0::5054:ff:fe12:3456/64 machine # [ 9.857345] dhcpcd[692]: eth0: adding route to fec0::/64 machine # [ 9.859296] dhcpcd[692]: eth0: adding default route via fe80::2 machine # [ 9.983600] postgresql-pre-start[710]: syncing data to disk ... ok machine # [ 9.984959] postgresql-pre-start[710]: initdb: warning: enabling "trust" authentication for local connections machine # [ 9.986432] postgresql-pre-start[710]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. machine # [ 9.987999] postgresql-pre-start[710]: Success. You can now start the database server using: machine # [ 9.989272] postgresql-pre-start[710]: pg_ctl -D /var/lib/postgresql/18 -l logfile start machine # [ 10.144131] postgres[745]: [745] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit machine # [ 10.148288] postgres[745]: [745] LOG: listening on IPv6 address "::1", port 5432 machine # [ 10.149299] postgres[745]: [745] LOG: listening on IPv4 address "127.0.0.1", port 5432 machine # [ 10.155105] postgres[745]: [745] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" machine # [ 10.169867] postgres[763]: [763] LOG: database system was shut down at 2026-09-23 10:32:41 GMT machine # [ 10.178460] postgres[745]: [745] LOG: database system is ready to accept connections machine # [ 10.189323] systemd[1]: Started PostgreSQL Server. machine # [ 10.190137] systemd[1]: Starting PostgreSQL Setup Scripts... machine # [ 10.467412] postgresql-setup-start[774]: CREATE DATABASE machine # [ 10.513721] postgresql-setup-start[779]: CREATE ROLE machine # [ 10.538303] postgresql-setup-start[781]: ALTER DATABASE machine # [ 10.543325] systemd[1]: Finished PostgreSQL Setup Scripts. machine # [ 10.545305] systemd[1]: Reached target PostgreSQL. machine # [ 14.738537] dhcpcd[692]: eth0: leased 10.0.2.15 for 86400 seconds machine # [ 14.740451] dhcpcd[692]: eth0: adding route to 10.0.2.0/24 machine # [ 14.742288] dhcpcd[692]: eth0: adding default route via 10.0.2.2 machine # [ 14.880302] systemd[1]: Started DHCP Client. machine # [ 14.881990] systemd[1]: Reached target Network is Online. machine # [ 14.885127] systemd[1]: Starting k3s service... machine # [ 14.950651] k3s[882]: time="2026-09-23T10:32:46Z" level=info msg="Acquiring lock file /var/lib/rancher/k3s/data/.lock" machine # [ 14.954314] k3s[882]: time="2026-09-23T10:32:46Z" level=info msg="Preparing data dir /var/lib/rancher/k3s/data/05fb32d1d5d79ab4bf8f805d07e4a7dfb491001fd5137b587aa471efd4746099" machine # [ 16.968677] k3s[882]: time="2026-09-23T10:32:48Z" level=info msg="Starting k3s 1.35.8+k3s1 (e952d68a)" machine # [ 16.983239] k3s[882]: time="2026-09-23T10:32:48Z" level=info msg="Configuring sqlite3 database connection pooling: maxIdle=20, maxOpen=0, maxLifetime=0s, maxIdleTime=2m0s" machine # [ 16.988251] k3s[882]: time="2026-09-23T10:32:48Z" level=info msg="Kine built with sqlite from github.com/mattn/go-sqlite3 version 3.53.3" machine # [ 16.992305] k3s[882]: time="2026-09-23T10:32:48Z" level=info msg="Configuring database table schema and indexes, this may take a moment..." machine # [ 16.999096] k3s[882]: time="2026-09-23T10:32:48Z" level=info msg="Database tables and indexes are up to date" machine # [ 17.000642] k3s[882]: time="2026-09-23T10:32:48Z" level=info msg="Running startup VACUUM to reclaim disk space, this may take a moment..." machine # [ 17.009546] k3s[882]: time="2026-09-23T10:32:48Z" level=info msg="Startup VACUUM completed successfully" machine # [ 17.013859] k3s[882]: time="2026-09-23T10:32:48Z" level=info msg="Kine available at unix://kine.sock" machine # [ 17.016761] k3s[882]: time="2026-09-23T10:32:48Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 17.022423] k3s[882]: time="2026-09-23T10:32:48Z" level=info msg="Datastore connection validated successfully, proceeding with bootstrap data generation" machine # [ 17.024308] k3s[882]: time="2026-09-23T10:32:48Z" level=info msg="generated self-signed CA certificate CN=k3s-client-ca@1790159568: notBefore=2026-09-23 09:32:48.765220299 +0000 UTC notAfter=2036-09-20 09:32:48.765220299 +0000 UTC" machine # [ 17.025471] k3s[882]: time="2026-09-23T10:32:48Z" level=info msg="certificate CN=system:admin,O=system:masters signed by CN=k3s-client-ca@1790159568: notBefore=2026-09-23 09:32:48 +0000 UTC notAfter=2027-09-23 09:32:48 +0000 UTC" machine # [ 17.027060] k3s[882]: time="2026-09-23T10:32:48Z" level=info msg="certificate CN=system:k3s-supervisor,O=system:masters signed by CN=k3s-client-ca@1790159568: notBefore=2026-09-23 09:32:48 +0000 UTC notAfter=2027-09-23 09:32:48 +0000 UTC" machine # [ 17.028176] k3s[882]: time="2026-09-23T10:32:48Z" level=info msg="certificate CN=system:kube-controller-manager signed by CN=k3s-client-ca@1790159568: notBefore=2026-09-23 09:32:48 +0000 UTC notAfter=2027-09-23 09:32:48 +0000 UTC" machine # [ 17.029375] k3s[882]: time="2026-09-23T10:32:48Z" level=info msg="certificate CN=system:kube-scheduler signed by CN=k3s-client-ca@1790159568: notBefore=2026-09-23 09:32:48 +0000 UTC notAfter=2027-09-23 09:32:48 +0000 UTC" machine # [ 17.030506] k3s[882]: time="2026-09-23T10:32:48Z" level=info msg="certificate CN=system:apiserver,O=system:masters signed by CN=k3s-client-ca@1790159568: notBefore=2026-09-23 09:32:48 +0000 UTC notAfter=2027-09-23 09:32:48 +0000 UTC" machine # [ 17.031337] k3s[882]: time="2026-09-23T10:32:48Z" level=info msg="certificate CN=k3s-cloud-controller-manager signed by CN=k3s-client-ca@1790159568: notBefore=2026-09-23 09:32:48 +0000 UTC notAfter=2027-09-23 09:32:48 +0000 UTC" machine # [ 17.032461] k3s[882]: time="2026-09-23T10:32:48Z" level=info msg="generated self-signed CA certificate CN=k3s-server-ca@1790159568: notBefore=2026-09-23 09:32:48.773513811 +0000 UTC notAfter=2036-09-20 09:32:48.773513811 +0000 UTC" machine # [ 17.034045] k3s[882]: time="2026-09-23T10:32:48Z" level=info msg="certificate CN=kube-apiserver signed by CN=k3s-server-ca@1790159568: notBefore=2026-09-23 09:32:48 +0000 UTC notAfter=2027-09-23 09:32:48 +0000 UTC" machine # [ 17.035267] k3s[882]: time="2026-09-23T10:32:48Z" level=info msg="certificate CN=kube-scheduler signed by CN=k3s-server-ca@1790159568: notBefore=2026-09-23 09:32:48 +0000 UTC notAfter=2027-09-23 09:32:48 +0000 UTC" machine # [ 17.036408] k3s[882]: time="2026-09-23T10:32:48Z" level=info msg="certificate CN=kube-controller-manager signed by CN=k3s-server-ca@1790159568: notBefore=2026-09-23 09:32:48 +0000 UTC notAfter=2027-09-23 09:32:48 +0000 UTC" machine # [ 17.037473] k3s[882]: time="2026-09-23T10:32:48Z" level=info msg="generated self-signed CA certificate CN=k3s-request-header-ca@1790159568: notBefore=2026-09-23 09:32:48.77824905 +0000 UTC notAfter=2036-09-20 09:32:48.77824905 +0000 UTC" machine # [ 17.038412] k3s[882]: time="2026-09-23T10:32:48Z" level=info msg="certificate CN=system:auth-proxy signed by CN=k3s-request-header-ca@1790159568: notBefore=2026-09-23 09:32:48 +0000 UTC notAfter=2027-09-23 09:32:48 +0000 UTC" machine # [ 17.039367] k3s[882]: time="2026-09-23T10:32:48Z" level=info msg="generated self-signed CA certificate CN=etcd-server-ca@1790159568: notBefore=2026-09-23 09:32:48.779757342 +0000 UTC notAfter=2036-09-20 09:32:48.779757342 +0000 UTC" machine # [ 17.040356] k3s[882]: time="2026-09-23T10:32:48Z" level=info msg="certificate CN=etcd-client signed by CN=etcd-server-ca@1790159568: notBefore=2026-09-23 09:32:48 +0000 UTC notAfter=2027-09-23 09:32:48 +0000 UTC" machine # [ 17.041252] k3s[882]: time="2026-09-23T10:32:48Z" level=info msg="generated self-signed CA certificate CN=etcd-peer-ca@1790159568: notBefore=2026-09-23 09:32:48.781443031 +0000 UTC notAfter=2036-09-20 09:32:48.781443031 +0000 UTC" machine # [ 17.042245] k3s[882]: time="2026-09-23T10:32:48Z" level=info msg="certificate CN=etcd-peer signed by CN=etcd-peer-ca@1790159568: notBefore=2026-09-23 09:32:48 +0000 UTC notAfter=2027-09-23 09:32:48 +0000 UTC" machine # [ 17.043145] k3s[882]: time="2026-09-23T10:32:48Z" level=info msg="certificate CN=etcd-server signed by CN=etcd-server-ca@1790159568: notBefore=2026-09-23 09:32:48 +0000 UTC notAfter=2027-09-23 09:32:48 +0000 UTC" machine # [ 17.093891] k3s[882]: time="2026-09-23T10:32:48Z" level=info msg="certificate CN=k3s,O=k3s signed by CN=k3s-server-ca@1790159568: notBefore=2026-09-23 09:32:48 +0000 UTC notAfter=2027-09-23 09:32:48 +0000 UTC" machine # [ 17.097432] k3s[882]: time="2026-09-23T10:32:48Z" level=warning msg="dynamiclistener [::]:6443: no cached certificate available for preload - deferring certificate load until storage initialization or first client request" machine # [ 17.101558] k3s[882]: time="2026-09-23T10:32:48Z" level=info msg="Active TLS secret / (ver=) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__b947_b336_321f_1e6b-6f060b:fec0::b947:b336:321f:1e6b listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=A57AE5BB0274FF6CCE07AAAFBF0152794AD36F1C]" machine # [ 18.111329] k3s[882]: time="2026-09-23T10:32:49Z" level=info msg="Password verified locally for node machine" machine # [ 18.113778] k3s[882]: time="2026-09-23T10:32:49Z" level=info msg="certificate CN=machine signed by CN=k3s-server-ca@1790159568: notBefore=2026-09-23 09:32:49 +0000 UTC notAfter=2027-09-23 09:32:49 +0000 UTC" machine # [ 18.352136] k3s[882]: time="2026-09-23T10:32:50Z" level=info msg="certificate CN=system:node:machine,O=system:nodes signed by CN=k3s-client-ca@1790159568: notBefore=2026-09-23 09:32:50 +0000 UTC notAfter=2027-09-23 09:32:50 +0000 UTC" machine # [ 18.457755] k3s[882]: time="2026-09-23T10:32:50Z" level=info msg="certificate CN=system:kube-proxy signed by CN=k3s-client-ca@1790159568: notBefore=2026-09-23 09:32:50 +0000 UTC notAfter=2027-09-23 09:32:50 +0000 UTC" machine # [ 18.561530] k3s[882]: time="2026-09-23T10:32:50Z" level=info msg="certificate CN=system:k3s-controller signed by CN=k3s-client-ca@1790159568: notBefore=2026-09-23 09:32:50 +0000 UTC notAfter=2027-09-23 09:32:50 +0000 UTC" machine # [ 18.638793] k3s[882]: time="2026-09-23T10:32:50Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:44608: runtime core not ready" machine # [ 18.737726] k3s[882]: time="2026-09-23T10:32:50Z" level=info msg="Module overlay was already loaded" machine # [ 18.971947] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. machine # [ 18.976775] Bridge firewalling registered machine # [ 18.833463] k3s[882]: time="2026-09-23T10:32:50Z" level=warning msg="Failed to load kernel module iptable_nat with modprobe" machine # [ 18.845615] k3s[882]: time="2026-09-23T10:32:50Z" level=warning msg="Failed to load kernel module iptable_filter with modprobe" machine # [ 18.856162] k3s[882]: time="2026-09-23T10:32:50Z" level=warning msg="Failed to load kernel module nft-expr-counter with modprobe" machine # [ 18.921500] k3s[882]: time="2026-09-23T10:32:50Z" level=info msg="Set sysctl 'net/ipv4/conf/all/forwarding' to 1" machine # [ 18.923149] k3s[882]: time="2026-09-23T10:32:50Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_max' to 131072" machine # [ 18.924231] k3s[882]: time="2026-09-23T10:32:50Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400" machine # [ 18.925348] k3s[882]: time="2026-09-23T10:32:50Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600" machine # [ 18.926535] k3s[882]: time="2026-09-23T10:32:50Z" level=info msg="Polling for API server readiness: GET /readyz failed: the server is currently unable to handle the request" machine # [ 18.933104] k3s[882]: time="2026-09-23T10:32:50Z" level=info msg="Connecting to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 18.934190] k3s[882]: time="2026-09-23T10:32:50Z" level=info msg="Creating k3s-cert-monitor event broadcaster" machine # [ 18.935136] k3s[882]: time="2026-09-23T10:32:50Z" level=info msg="Saving cluster bootstrap data to datastore" machine # [ 18.936101] k3s[882]: time="2026-09-23T10:32:50Z" level=info msg="Handling backend connection request [machine]" machine # [ 18.937039] k3s[882]: time="2026-09-23T10:32:50Z" level=info msg="Connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 18.938846] k3s[882]: time="2026-09-23T10:32:50Z" level=info msg="Remotedialer connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 18.942203] k3s[882]: time="2026-09-23T10:32:50Z" level=info msg="Connection to etcd is ready" machine # [ 18.943150] k3s[882]: time="2026-09-23T10:32:50Z" level=info msg="ETCD server is now running" machine # [ 18.943672] k3s[882]: time="2026-09-23T10:32:50Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 18.950083] k3s[882]: time="2026-09-23T10:32:50Z" level=info msg="Running kube-apiserver --advertise-port=6443 --allow-privileged=true --anonymous-auth=false --api-audiences=https://kubernetes.default.svc.cluster.local,k3s --authorization-mode=Node,RBAC --bind-address=127.0.0.1 --cert-dir=/var/lib/rancher/k3s/server/tls/temporary-certs --client-ca-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --egress-selector-config-file=/var/lib/rancher/k3s/server/etc/egress-selector-config.yaml --enable-admission-plugins=NodeRestriction --enable-aggregator-routing=true --enable-bootstrap-token-auth=true --etcd-servers=unix://kine.sock --kubelet-certificate-authority=/var/lib/rancher/k3s/server/tls/server-ca.crt --kubelet-client-certificate=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.crt --kubelet-client-key=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.key --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --profiling=false --proxy-client-cert-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt --proxy-client-key-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.key --requestheader-allowed-names=system:auth-proxy --requestheader-client-ca-file=/var/lib/rancher/k3s/server/tls/request-header-ca.crt --requestheader-extra-headers-prefix=X-Remote-Extra- --requestheader-group-headers=X-Remote-Group --requestheader-username-headers=X-Remote-User --secure-port=6444 --service-account-issuer=https://kubernetes.default.svc.cluster.local --service-account-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-account-signing-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --storage-backend=etcd3 --tls-cert-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --tls-private-key-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 18.952057] k3s[882]: time="2026-09-23T10:32:50Z" level=info msg="Running kube-scheduler --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --bind-address=127.0.0.1 --kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --leader-elect=false --profiling=false --secure-port=10259 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 18.952528] k3s[882]: time="2026-09-23T10:32:50Z" level=info msg="Running kube-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --bind-address=127.0.0.1 --cluster-cidr=10.42.0.0/16 --cluster-signing-kube-apiserver-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kube-apiserver-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kubelet-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-serving-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-kubelet-serving-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --cluster-signing-legacy-unknown-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-legacy-unknown-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --configure-cloud-routes=false --controllers=*,tokencleaner,-service,-route,-cloud-node-lifecycle --kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --leader-elect=false --profiling=false --root-ca-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --secure-port=10257 --service-account-private-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key --use-service-account-credentials=true" machine # [ 18.992734] k3s[882]: time="2026-09-23T10:32:50Z" level=info msg="Running cloud-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --bind-address=127.0.0.1 --cloud-config=/var/lib/rancher/k3s/server/etc/cloud-config.yaml --cloud-provider=k3s --cluster-cidr=10.42.0.0/16 --configure-cloud-routes=false --controllers=*,-route --kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --leader-elect=false --leader-elect-resource-name=k3s-cloud-controller-manager --node-status-update-frequency=1m0s --profiling=false" machine # [ 18.993376] k3s[882]: time="2026-09-23T10:32:50Z" level=info msg="Server node token is available at /var/lib/rancher/k3s/server/token" machine # [ 18.993850] k3s[882]: I0923 10:32:50.695581 882 options.go:263] external host was not specified, using 10.0.2.15 machine # [ 18.994472] k3s[882]: I0923 10:32:50.697401 882 server.go:158] Version: v1.35.8+k3s1 machine # [ 18.994952] k3s[882]: I0923 10:32:50.697427 882 server.go:160] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 18.997418] k3s[882]: time="2026-09-23T10:32:50Z" level=info msg="To join server node to cluster: k3s server -s https://10.0.2.15:6443 -t ${SERVER_NODE_TOKEN}" machine # [ 18.997922] k3s[882]: time="2026-09-23T10:32:50Z" level=info msg="Agent node token is available at /var/lib/rancher/k3s/server/agent-token" machine # [ 18.998523] k3s[882]: time="2026-09-23T10:32:50Z" level=info msg="To join agent node to cluster: k3s agent -s https://10.0.2.15:6443 -t ${AGENT_NODE_TOKEN}" machine # [ 18.999053] k3s[882]: time="2026-09-23T10:32:50Z" level=info msg="Wrote kubeconfig /etc/rancher/k3s/k3s.yaml" machine # [ 18.999539] k3s[882]: time="2026-09-23T10:32:50Z" level=info msg="Run: k3s kubectl" machine # [ 19.000081] k3s[882]: time="2026-09-23T10:32:50Z" level=info msg="Logging containerd to /var/lib/rancher/k3s/agent/containerd/containerd.log" machine # [ 19.000517] k3s[882]: time="2026-09-23T10:32:50Z" level=info msg="Running containerd -c /var/lib/rancher/k3s/agent/etc/containerd/config.toml" machine # [ 19.023326] k3s[882]: time="2026-09-23T10:32:50Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:44652: runtime core not ready" machine # [ 19.102213] k3s[882]: I0923 10:32:50.844028 882 shared_informer.go:349] "Waiting for caches to sync" controller="node_authorizer" machine # [ 19.105054] k3s[882]: I0923 10:32:50.846537 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 19.107053] k3s[882]: I0923 10:32:50.848201 882 plugins.go:157] Loaded 14 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,PodTopologyLabels,MutatingAdmissionPolicy,MutatingAdmissionWebhook. machine # [ 19.107600] k3s[882]: I0923 10:32:50.848226 882 plugins.go:160] Loaded 14 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,NodeDeclaredFeatureValidator,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. machine # [ 19.108092] k3s[882]: I0923 10:32:50.848587 882 instance.go:240] Using reconciler: lease machine # [ 19.123363] k3s[882]: I0923 10:32:50.864458 882 handler.go:304] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager machine # [ 19.123980] k3s[882]: W0923 10:32:50.864487 882 genericapiserver.go:787] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. machine # [ 19.125056] k3s[882]: I0923 10:32:50.866852 882 cidrallocator.go:198] starting ServiceCIDR Allocator Controller machine # [ 19.131172] k3s[882]: time="2026-09-23T10:32:50Z" level=info msg="Running kube-proxy --cluster-cidr=10.42.0.0/16 --conntrack-max-per-core=0 --conntrack-tcp-timeout-close-wait=0s --conntrack-tcp-timeout-established=0s --healthz-bind-address=127.0.0.1 --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubeproxy.kubeconfig --proxy-mode=iptables" machine # [ 19.156115] k3s[882]: I0923 10:32:50.897958 882 handler.go:304] Adding GroupVersion v1 to ResourceManager machine # [ 19.156844] k3s[882]: I0923 10:32:50.898095 882 apis.go:112] API group "internal.apiserver.k8s.io" is not enabled, skipping. machine # [ 19.180703] k3s[882]: I0923 10:32:50.922449 882 apis.go:112] API group "storagemigration.k8s.io" is not enabled, skipping. machine # [ 19.217074] k3s[882]: I0923 10:32:50.958874 882 handler.go:304] Adding GroupVersion authentication.k8s.io v1 to ResourceManager machine # [ 19.217720] k3s[882]: W0923 10:32:50.958906 882 genericapiserver.go:787] Skipping API authentication.k8s.io/v1beta1 because it has no resources. machine # [ 19.218203] k3s[882]: W0923 10:32:50.958919 882 genericapiserver.go:787] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. machine # [ 19.218654] k3s[882]: I0923 10:32:50.959252 882 handler.go:304] Adding GroupVersion authorization.k8s.io v1 to ResourceManager machine # [ 19.219163] k3s[882]: W0923 10:32:50.959268 882 genericapiserver.go:787] Skipping API authorization.k8s.io/v1beta1 because it has no resources. machine # [ 19.219645] k3s[882]: I0923 10:32:50.959789 882 handler.go:304] Adding GroupVersion autoscaling v2 to ResourceManager machine # [ 19.220164] k3s[882]: I0923 10:32:50.960290 882 handler.go:304] Adding GroupVersion autoscaling v1 to ResourceManager machine # [ 19.220662] k3s[882]: W0923 10:32:50.960306 882 genericapiserver.go:787] Skipping API autoscaling/v2beta1 because it has no resources. machine # [ 19.221504] k3s[882]: W0923 10:32:50.960317 882 genericapiserver.go:787] Skipping API autoscaling/v2beta2 because it has no resources. machine # [ 19.222457] k3s[882]: I0923 10:32:50.961102 882 handler.go:304] Adding GroupVersion batch v1 to ResourceManager machine # [ 19.223345] k3s[882]: W0923 10:32:50.961128 882 genericapiserver.go:787] Skipping API batch/v1beta1 because it has no resources. machine # [ 19.223930] k3s[882]: I0923 10:32:50.961626 882 handler.go:304] Adding GroupVersion certificates.k8s.io v1 to ResourceManager machine # [ 19.224532] k3s[882]: W0923 10:32:50.961642 882 genericapiserver.go:787] Skipping API certificates.k8s.io/v1beta1 because it has no resources. machine # [ 19.225055] k3s[882]: W0923 10:32:50.961652 882 genericapiserver.go:787] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. machine # [ 19.225674] k3s[882]: I0923 10:32:50.962000 882 handler.go:304] Adding GroupVersion coordination.k8s.io v1 to ResourceManager machine # [ 19.226188] k3s[882]: W0923 10:32:50.962015 882 genericapiserver.go:787] Skipping API coordination.k8s.io/v1beta1 because it has no resources. machine # [ 19.226616] k3s[882]: W0923 10:32:50.962025 882 genericapiserver.go:787] Skipping API coordination.k8s.io/v1alpha2 because it has no resources. machine # [ 19.227133] k3s[882]: I0923 10:32:50.962360 882 handler.go:304] Adding GroupVersion discovery.k8s.io v1 to ResourceManager machine # [ 19.227585] k3s[882]: W0923 10:32:50.962376 882 genericapiserver.go:787] Skipping API discovery.k8s.io/v1beta1 because it has no resources. machine # [ 19.228089] k3s[882]: I0923 10:32:50.963621 882 handler.go:304] Adding GroupVersion networking.k8s.io v1 to ResourceManager machine # [ 19.228572] k3s[882]: W0923 10:32:50.963637 882 genericapiserver.go:787] Skipping API networking.k8s.io/v1beta1 because it has no resources. machine # [ 19.229094] k3s[882]: I0923 10:32:50.963912 882 handler.go:304] Adding GroupVersion node.k8s.io v1 to ResourceManager machine # [ 19.229558] k3s[882]: W0923 10:32:50.963946 882 genericapiserver.go:787] Skipping API node.k8s.io/v1beta1 because it has no resources. machine # [ 19.230092] k3s[882]: W0923 10:32:50.963961 882 genericapiserver.go:787] Skipping API node.k8s.io/v1alpha1 because it has no resources. machine # [ 19.230577] k3s[882]: I0923 10:32:50.964393 882 handler.go:304] Adding GroupVersion policy v1 to ResourceManager machine # [ 19.231089] k3s[882]: W0923 10:32:50.964410 882 genericapiserver.go:787] Skipping API policy/v1beta1 because it has no resources. machine # [ 19.231533] k3s[882]: I0923 10:32:50.965319 882 handler.go:304] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager machine # [ 19.232052] k3s[882]: W0923 10:32:50.965335 882 genericapiserver.go:787] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. machine # [ 19.232554] k3s[882]: W0923 10:32:50.965346 882 genericapiserver.go:787] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. machine # [ 19.233107] k3s[882]: I0923 10:32:50.965573 882 handler.go:304] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager machine # [ 19.233590] k3s[882]: W0923 10:32:50.965585 882 genericapiserver.go:787] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. machine # [ 19.234150] k3s[882]: W0923 10:32:50.965596 882 genericapiserver.go:787] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. machine # [ 19.234597] k3s[882]: I0923 10:32:50.966906 882 handler.go:304] Adding GroupVersion storage.k8s.io v1 to ResourceManager machine # [ 19.234794] k3s[882]: W0923 10:32:50.966949 882 genericapiserver.go:787] Skipping API storage.k8s.io/v1beta1 because it has no resources. machine # [ 19.235478] k3s[882]: W0923 10:32:50.966961 882 genericapiserver.go:787] Skipping API storage.k8s.io/v1alpha1 because it has no resources. machine # [ 19.236068] k3s[882]: I0923 10:32:50.967623 882 handler.go:304] Adding GroupVersion flowcontrol.apiserver.k8s.io v1 to ResourceManager machine # [ 19.236546] k3s[882]: W0923 10:32:50.967640 882 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta3 because it has no resources. machine # [ 19.237086] k3s[882]: W0923 10:32:50.967651 882 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta2 because it has no resources. machine # [ 19.237524] k3s[882]: W0923 10:32:50.967661 882 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. machine # [ 19.238053] k3s[882]: I0923 10:32:50.969720 882 handler.go:304] Adding GroupVersion apps v1 to ResourceManager machine # [ 19.238527] k3s[882]: W0923 10:32:50.969739 882 genericapiserver.go:787] Skipping API apps/v1beta2 because it has no resources. machine # [ 19.239098] k3s[882]: W0923 10:32:50.969754 882 genericapiserver.go:787] Skipping API apps/v1beta1 because it has no resources. machine # [ 19.239589] k3s[882]: I0923 10:32:50.970979 882 handler.go:304] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager machine # [ 19.240095] k3s[882]: W0923 10:32:50.970995 882 genericapiserver.go:787] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. machine # [ 19.240550] k3s[882]: W0923 10:32:50.971006 882 genericapiserver.go:787] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. machine # [ 19.241535] k3s[882]: I0923 10:32:50.971621 882 handler.go:304] Adding GroupVersion events.k8s.io v1 to ResourceManager machine # [ 19.242921] k3s[882]: W0923 10:32:50.971637 882 genericapiserver.go:787] Skipping API events.k8s.io/v1beta1 because it has no resources. machine # [ 19.244596] k3s[882]: I0923 10:32:50.973968 882 handler.go:304] Adding GroupVersion resource.k8s.io v1 to ResourceManager machine # [ 19.245810] k3s[882]: W0923 10:32:50.973985 882 genericapiserver.go:787] Skipping API resource.k8s.io/v1beta2 because it has no resources. machine # [ 19.247436] k3s[882]: W0923 10:32:50.973996 882 genericapiserver.go:787] Skipping API resource.k8s.io/v1beta1 because it has no resources. machine # [ 19.286622] k3s[882]: W0923 10:32:50.974008 882 genericapiserver.go:787] Skipping API resource.k8s.io/v1alpha3 because it has no resources. machine # [ 19.287198] k3s[882]: I0923 10:32:50.976775 882 handler.go:304] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager machine # [ 19.287638] k3s[882]: W0923 10:32:50.976795 882 genericapiserver.go:787] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. machine # [ 19.527136] k3s[882]: I0923 10:32:51.268426 882 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 19.529381] k3s[882]: I0923 10:32:51.268440 882 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 19.531293] k3s[882]: I0923 10:32:51.268531 882 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 19.533892] k3s[882]: I0923 10:32:51.268732 882 secure_serving.go:211] Serving securely on 127.0.0.1:6444 machine # [ 19.535170] k3s[882]: I0923 10:32:51.268866 882 local_available_controller.go:156] Starting LocalAvailability controller machine # [ 19.536599] k3s[882]: I0923 10:32:51.268883 882 cache.go:32] Waiting for caches to sync for LocalAvailability controller machine # [ 19.538075] k3s[882]: I0923 10:32:51.269282 882 customresource_discovery_controller.go:294] Starting DiscoveryController machine # [ 19.542091] k3s[882]: I0923 10:32:51.269356 882 remote_available_controller.go:425] Starting RemoteAvailability controller machine # [ 19.543489] k3s[882]: I0923 10:32:51.269367 882 cache.go:32] Waiting for caches to sync for RemoteAvailability controller machine # [ 19.544872] k3s[882]: I0923 10:32:51.269387 882 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 19.546231] k3s[882]: I0923 10:32:51.269412 882 apiservice_controller.go:100] Starting APIServiceRegistrationController machine # [ 19.547583] k3s[882]: I0923 10:32:51.269422 882 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller machine # [ 19.549175] k3s[882]: I0923 10:32:51.269528 882 aggregator.go:185] waiting for initial CRD sync... machine # [ 19.550369] k3s[882]: I0923 10:32:51.270005 882 controller.go:142] Starting OpenAPI controller machine # [ 19.551513] k3s[882]: I0923 10:32:51.270062 882 controller.go:90] Starting OpenAPI V3 controller machine # [ 19.552701] k3s[882]: time="2026-09-23T10:32:51Z" level=info msg="Starting legacy_token_tracking_controller" logger=k3s machine # [ 19.554123] k3s[882]: time="2026-09-23T10:32:51Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 19.555379] k3s[882]: I0923 10:32:51.270091 882 naming_controller.go:305] Starting NamingConditionController machine # [ 19.556694] k3s[882]: I0923 10:32:51.270235 882 nonstructuralschema_controller.go:202] Starting NonStructuralSchemaConditionController machine # [ 19.558354] k3s[882]: I0923 10:32:51.270265 882 apiapproval_controller.go:196] Starting KubernetesAPIApprovalPolicyConformantConditionController machine # [ 19.560110] k3s[882]: I0923 10:32:51.270271 882 dynamic_serving_content.go:135] "Starting controller" name="aggregator-proxy-cert::/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt::/var/lib/rancher/k3s/server/tls/client-auth-proxy.key" machine # [ 19.562709] k3s[882]: I0923 10:32:51.270294 882 crd_finalizer.go:273] Starting CRDFinalizer machine # [ 19.563840] k3s[882]: I0923 10:32:51.270383 882 crdregistration_controller.go:114] Starting crd-autoregister controller machine # [ 19.565315] k3s[882]: I0923 10:32:51.270399 882 shared_informer.go:349] "Waiting for caches to sync" controller="crd-autoregister" machine # [ 19.566818] k3s[882]: I0923 10:32:51.270416 882 controller.go:113] "Deleting old lease on startup" lease="kube-system/apiserver-ik4pcwfs7qgdl76byc4pomgvia" machine # [ 19.568528] k3s[882]: I0923 10:32:51.270619 882 controller.go:78] Starting OpenAPI AggregationController machine # [ 19.569736] k3s[882]: I0923 10:32:51.270653 882 controller.go:80] Starting OpenAPI V3 AggregationController machine # [ 19.571089] k3s[882]: I0923 10:32:51.270800 882 cluster_authentication_trust_controller.go:459] Starting cluster_authentication_trust_controller controller machine # [ 19.572892] k3s[882]: time="2026-09-23T10:32:51Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 19.574206] k3s[882]: I0923 10:32:51.270851 882 apf_controller.go:377] Starting API Priority and Fairness config controller machine # [ 19.575671] k3s[882]: time="2026-09-23T10:32:51Z" level=info msg="Starting apiserver lease garbage collector" logger=k3s machine # [ 19.577119] k3s[882]: time="2026-09-23T10:32:51Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 19.578299] k3s[882]: I0923 10:32:51.271142 882 default_servicecidr_controller.go:110] Starting kubernetes-service-cidr-controller machine # [ 19.579858] k3s[882]: I0923 10:32:51.271157 882 shared_informer.go:349] "Waiting for caches to sync" controller="kubernetes-service-cidr-controller" machine # [ 19.581527] k3s[882]: I0923 10:32:51.271658 882 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 19.583471] k3s[882]: I0923 10:32:51.271724 882 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 19.585440] k3s[882]: I0923 10:32:51.272041 882 repairip.go:210] Starting ipallocator-repair-controller machine # [ 19.586630] k3s[882]: I0923 10:32:51.272054 882 shared_informer.go:349] "Waiting for caches to sync" controller="ipallocator-repair-controller" machine # [ 19.588384] k3s[882]: I0923 10:32:51.281522 882 system_namespaces_controller.go:66] Starting system namespaces controller machine # [ 19.603284] k3s[882]: I0923 10:32:51.345087 882 shared_informer.go:356] "Caches are synced" controller="node_authorizer" machine # [ 19.604838] k3s[882]: I0923 10:32:51.346710 882 shared_informer.go:377] "Caches are synced" machine # [ 19.605427] k3s[882]: I0923 10:32:51.346744 882 policy_source.go:248] refreshing policies machine # [ 19.615712] k3s[882]: E0923 10:32:51.357578 882 controller.go:201] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" machine # [ 19.628238] k3s[882]: I0923 10:32:51.370040 882 cache.go:39] Caches are synced for APIServiceRegistrationController controller machine # [ 19.629130] k3s[882]: I0923 10:32:51.370101 882 cache.go:39] Caches are synced for LocalAvailability controller machine # [ 19.629693] k3s[882]: time="2026-09-23T10:32:51Z" level=info msg="Caches are synced" logger=k3s machine # [ 19.630224] k3s[882]: I0923 10:32:51.370198 882 handler_discovery.go:451] Starting ResourceDiscoveryManager machine # [ 19.630702] k3s[882]: I0923 10:32:51.370447 882 shared_informer.go:356] "Caches are synced" controller="crd-autoregister" machine # [ 19.631411] k3s[882]: I0923 10:32:51.370491 882 cache.go:39] Caches are synced for RemoteAvailability controller machine # [ 19.631938] k3s[882]: I0923 10:32:51.370501 882 aggregator.go:187] initial CRD sync complete... machine # [ 19.632591] k3s[882]: I0923 10:32:51.370582 882 autoregister_controller.go:144] Starting autoregister controller machine # [ 19.633116] k3s[882]: I0923 10:32:51.370593 882 cache.go:32] Waiting for caches to sync for autoregister controller machine # [ 19.633566] k3s[882]: I0923 10:32:51.370604 882 cache.go:39] Caches are synced for autoregister controller machine # [ 19.634137] k3s[882]: I0923 10:32:51.375774 882 shared_informer.go:356] "Caches are synced" controller="ipallocator-repair-controller" machine # [ 19.634618] k3s[882]: time="2026-09-23T10:32:51Z" level=info msg="Caches are synced" logger=k3s machine # [ 19.635154] k3s[882]: I0923 10:32:51.375872 882 apf_controller.go:382] Running API Priority and Fairness config worker machine # [ 19.635608] k3s[882]: I0923 10:32:51.375887 882 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process machine # [ 19.636572] k3s[882]: time="2026-09-23T10:32:51Z" level=info msg="Caches are synced" logger=k3s machine # [ 19.636824] k3s[882]: I0923 10:32:51.378503 882 shared_informer.go:356] "Caches are synced" controller="kubernetes-service-cidr-controller" machine # [ 19.637492] k3s[882]: I0923 10:32:51.378527 882 default_servicecidr_controller.go:169] Creating default ServiceCIDR with CIDRs: [10.43.0.0/16] machine # [ 19.653071] k3s[882]: I0923 10:32:51.392514 882 default_servicecidr_controller.go:231] Setting default ServiceCIDR condition Ready to True machine # [ 19.653698] k3s[882]: I0923 10:32:51.393757 882 cidrallocator.go:302] created ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 19.654198] k3s[882]: I0923 10:32:51.394319 882 controller.go:667] quota admission added evaluator for: namespaces machine # [ 19.662750] k3s[882]: I0923 10:32:51.404625 882 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 19.685504] k3s[882]: I0923 10:32:51.427335 882 alloc.go:329] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.43.0.1"} machine # [ 19.691385] k3s[882]: W0923 10:32:51.433235 882 lease.go:265] Resetting endpoints for master service "kubernetes" to [10.0.2.15] machine # [ 19.692556] k3s[882]: I0923 10:32:51.434415 882 controller.go:667] quota admission added evaluator for: endpoints machine # [ 19.697632] k3s[882]: I0923 10:32:51.439497 882 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io machine # [ 19.703060] k3s[882]: E0923 10:32:51.444609 882 controller.go:102] Error removing old endpoints from kubernetes service: no API server IP addresses were listed in storage, refusing to erase all endpoints for the kubernetes Service machine # [ 19.823214] k3s[882]: I0923 10:32:51.564777 882 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io machine # [ 19.970221] k3s[882]: time="2026-09-23T10:32:51Z" level=info msg="containerd is now running" machine # [ 19.984745] k3s[882]: time="2026-09-23T10:32:51Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/k3s-airgap-images-amd64.tar.zst" machine # [ 20.032269] rustfs-bucket-start[951]: mb s3://farm machine # [ 20.036884] systemd[1]: Finished rustfs-bucket.service. machine # [ 20.533341] k3s[882]: I0923 10:32:52.274800 882 storage_scheduling.go:123] created PriorityClass system-node-critical with value 2000001000 machine # [ 20.539312] k3s[882]: I0923 10:32:52.280806 882 storage_scheduling.go:123] created PriorityClass system-cluster-critical with value 2000000000 machine # [ 20.540079] k3s[882]: I0923 10:32:52.280833 882 storage_scheduling.go:139] all system priority classes are created successfully or already exist. machine # [ 20.931332] k3s[882]: time="2026-09-23T10:32:52Z" level=info msg="Polling for API server readiness: GET /readyz failed: unknown" machine # [ 21.588629] k3s[882]: I0923 10:32:53.330127 882 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io machine # [ 21.627119] k3s[882]: I0923 10:32:53.368951 882 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io machine # [ 22.939880] k3s[882]: time="2026-09-23T10:32:54Z" level=info msg="Kube API server is now running" machine # [ 22.944632] k3s[882]: time="2026-09-23T10:32:54Z" level=info msg="k3s is up and running" machine # [ 22.947333] k3s[882]: time="2026-09-23T10:32:54Z" level=info msg="Waiting for untainted node" machine # [ 22.953252] systemd[1]: Started k3s service. machine # [ 22.954863] k3s[882]: time="2026-09-23T10:32:54Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Node and Certificate Authority certificates managed by k3s are OK" object=machine reason=CertificateExpirationOK type=Normal machine # [ 22.962140] k3s[882]: time="2026-09-23T10:32:54Z" level=info msg="Creating k3s-supervisor event broadcaster" machine # [ 22.964785] k3s[882]: I0923 10:32:54.704958 882 controllermanager.go:189] "Starting" version="v1.35.8+k3s1" machine # [ 22.967392] k3s[882]: I0923 10:32:54.704979 882 controllermanager.go:191] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 22.970341] systemd[1]: Starting niks3 server... machine # [ 22.971735] k3s[882]: I0923 10:32:54.708755 882 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 22.974513] k3s[882]: I0923 10:32:54.708774 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 22.976844] k3s[882]: I0923 10:32:54.708822 882 secure_serving.go:211] Serving securely on 127.0.0.1:10257 machine # [ 22.979291] k3s[882]: I0923 10:32:54.708850 882 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 22.982156] k3s[882]: I0923 10:32:54.708866 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 22.983478] k3s[882]: I0923 10:32:54.708921 882 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 22.985993] k3s[882]: I0923 10:32:54.708977 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 22.987396] k3s[882]: I0923 10:32:54.709283 882 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key" machine # [ 22.990974] k3s[882]: I0923 10:32:54.709387 882 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 22.992386] k3s[882]: I0923 10:32:54.720001 882 controller.go:667] quota admission added evaluator for: serviceaccounts machine # [ 22.993870] k3s[882]: W0923 10:32:54.721850 882 probe.go:272] Flexvolume plugin directory at /usr/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating. machine # [ 23.015113] k3s[882]: I0923 10:32:54.756944 882 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="podcertificaterequest-cleaner-controller" requiredFeatureGates=["PodCertificateRequest"] machine # [ 23.017978] k3s[882]: I0923 10:32:54.756984 882 controllermanager.go:579] "Warning: skipping controller" controller="podcertificaterequest-cleaner-controller" machine # [ 23.030888] k3s[882]: I0923 10:32:54.772739 882 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" requiredFeatureGates=["ClusterTrustBundle"] machine # [ 23.031817] k3s[882]: I0923 10:32:54.772770 882 controllermanager.go:579] "Warning: skipping controller" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" machine # [ 23.032461] k3s[882]: I0923 10:32:54.773911 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 23.055801] k3s[882]: time="2026-09-23T10:32:54Z" level=info msg="Creating embedded CRD etcdsnapshotfiles.k3s.cattle.io" machine # [ 23.062917] k3s[882]: time="2026-09-23T10:32:54Z" level=info msg="Creating embedded CRD addons.k3s.cattle.io" machine # [ 23.067957] k3s[882]: I0923 10:32:54.809172 882 shared_informer.go:377] "Caches are synced" machine # [ 23.068644] k3s[882]: I0923 10:32:54.810391 882 shared_informer.go:377] "Caches are synced" machine # [ 23.069159] k3s[882]: I0923 10:32:54.810479 882 shared_informer.go:377] "Caches are synced" machine # [ 23.076414] k3s[882]: time="2026-09-23T10:32:54Z" level=info msg="Creating embedded CRD helmchartconfigs.helm.cattle.io" machine # [ 23.076944] k3s[882]: I0923 10:32:54.818609 882 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 23.082915] k3s[882]: time="2026-09-23T10:32:54Z" level=info msg="Creating embedded CRD helmcharts.helm.cattle.io" machine # [ 23.094673] k3s[882]: I0923 10:32:54.836474 882 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 23.099841] k3s[882]: I0923 10:32:54.841719 882 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 23.102526] k3s[882]: time="2026-09-23T10:32:54Z" level=info msg="Waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 23.119286] k3s[882]: I0923 10:32:54.861142 882 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 23.132988] k3s[882]: I0923 10:32:54.874838 882 shared_informer.go:377] "Caches are synced" machine # [ 23.178327] k3s[882]: I0923 10:32:54.920164 882 controllermanager.go:627] "Warning: controller is disabled" controller="node-route-controller" machine # [ 23.273591] k3s[882]: time="2026-09-23T10:32:55Z" level=info msg="Imported docker.io/rancher/klipper-helm:v0.13.3-build20260727" machine # [ 23.277538] k3s[882]: time="2026-09-23T10:32:55Z" level=info msg="Tagged docker.io/rancher/klipper-helm@sha256:5425a2b4613d2458dbdff99218e8d487ebb59c20e7a941f061c0777070f0aac1" machine # [ 23.278217] k3s[882]: time="2026-09-23T10:32:55Z" level=info msg="Imported docker.io/rancher/klipper-lb:v0.4.17" machine # [ 23.281295] k3s[882]: time="2026-09-23T10:32:55Z" level=info msg="Tagged docker.io/rancher/klipper-lb@sha256:910944bb0bd94f060a82a56ca1ea1c577d3e49b3473a093a47a985f32e92d94a" machine # [ 23.281982] k3s[882]: time="2026-09-23T10:32:55Z" level=info msg="Imported docker.io/rancher/local-path-provisioner:v0.0.37" machine # [ 23.285222] k3s[882]: time="2026-09-23T10:32:55Z" level=info msg="Tagged docker.io/rancher/local-path-provisioner@sha256:e757967a5ec338f6a9b371c5a9688bedaa8c3578ea3dd4db329ea0084be0a86f" machine # [ 23.286113] k3s[882]: time="2026-09-23T10:32:55Z" level=info msg="Imported docker.io/rancher/mirrored-coredns-coredns:1.14.6" machine # [ 23.289194] k3s[882]: time="2026-09-23T10:32:55Z" level=info msg="Tagged docker.io/rancher/mirrored-coredns-coredns@sha256:900f9c109f7a33545d3c811516e8376df9019147b750f5ce3e254468769176ea" machine # [ 23.289840] k3s[882]: time="2026-09-23T10:32:55Z" level=info msg="Imported docker.io/rancher/mirrored-library-busybox:1.37.0" machine # [ 23.294978] k3s[882]: time="2026-09-23T10:32:55Z" level=info msg="Tagged docker.io/rancher/mirrored-library-busybox@sha256:101b4afd76732482eff9b95cae5f94bcf295e521fbec4e01b69c5421f3f3f3e5" machine # [ 23.295954] k3s[882]: time="2026-09-23T10:32:55Z" level=info msg="Imported docker.io/rancher/mirrored-library-traefik:3.7.8" machine # [ 23.301188] k3s[882]: time="2026-09-23T10:32:55Z" level=info msg="Tagged docker.io/rancher/mirrored-library-traefik@sha256:4299bbed850421258fc5448c2e0e6ad350981d4d335a68de11b92448aedbefe5" machine # [ 23.301970] k3s[882]: time="2026-09-23T10:32:55Z" level=info msg="Imported docker.io/rancher/mirrored-metrics-server:v0.9.0" machine # [ 23.309644] k3s[882]: time="2026-09-23T10:32:55Z" level=info msg="Tagged docker.io/rancher/mirrored-metrics-server@sha256:d9862115e7c7881280d3d75ca26bda8ffc0fc213315979575bf23ce9826205c0" machine # [ 23.310566] k3s[882]: time="2026-09-23T10:32:55Z" level=info msg="Imported docker.io/rancher/mirrored-pause:3.10.2" machine # [ 23.320294] k3s[882]: time="2026-09-23T10:32:55Z" level=info msg="Tagged docker.io/rancher/mirrored-pause@sha256:f548e0e8e3dc1896ca956272154dde3314e8cc4fde0a57577ee9fa1c63f5baf4" machine # [ 23.588359] k3s[882]: time="2026-09-23T10:32:55Z" level=info msg="Imported 8 images from /var/lib/rancher/k3s/agent/images/k3s-airgap-images-amd64.tar.zst in 3.604229867s" machine # [ 23.589639] k3s[882]: time="2026-09-23T10:32:55Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-client.tar" machine # [ 23.614852] k3s[882]: time="2026-09-23T10:32:55Z" level=info msg="Done waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 23.616631] k3s[882]: time="2026-09-23T10:32:55Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-40.1.4+up40.1.0.tgz" machine # [ 23.618558] k3s[882]: time="2026-09-23T10:32:55Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-crd-40.1.4+up40.1.0.tgz" machine # [ 23.620546] k3s[882]: time="2026-09-23T10:32:55Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/ccm.yaml" machine # [ 23.622313] k3s[882]: time="2026-09-23T10:32:55Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/coredns.yaml" machine # [ 23.624083] k3s[882]: time="2026-09-23T10:32:55Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/local-storage.yaml" machine # [ 23.625836] k3s[882]: time="2026-09-23T10:32:55Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/rolebindings.yaml" machine # [ 23.627677] k3s[882]: time="2026-09-23T10:32:55Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/runtimes.yaml" machine # [ 23.629299] k3s[882]: time="2026-09-23T10:32:55Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/traefik.yaml" machine: (finished: waiting for unit k3s.service, in 24.65 seconds) machine: waiting for success: kubectl get ns farm machine # Error from server (NotFound): namespaces "farm" not found machine # [ 24.020466] k3s[882]: I0923 10:32:55.761886 882 range_allocator.go:113] "No Secondary Service CIDR provided. Skipping filtering out secondary service addresses" logger="node-ipam-controller" machine # [ 24.020991] k3s[882]: time="2026-09-23T10:32:55Z" level=info msg="Starting dynamiclistener CN filter node controller with SANs: [127.0.0.1 ::1 localhost machine 10.0.2.15 fec0::b947:b336:321f:1e6b 10.43.0.1 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local]" machine # [ 24.021440] k3s[882]: time="2026-09-23T10:32:55Z" level=info msg="Tunnel server egress proxy mode: agent" machine # [ 24.029065] k3s[882]: I0923 10:32:55.769152 882 node_lifecycle_controller.go:419] "Controller will reconcile labels" logger="node-lifecycle-controller" machine # [ 24.029648] k3s[882]: I0923 10:32:55.769212 882 controllermanager.go:627] "Warning: controller is disabled" controller="cloud-node-lifecycle-controller" machine # [ 24.061322] k3s[882]: I0923 10:32:55.803159 882 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="device-taint-eviction-controller" requiredFeatureGates=["DynamicResourceAllocation","DRADeviceTaints"] machine # [ 24.061968] k3s[882]: I0923 10:32:55.803186 882 controllermanager.go:579] "Warning: skipping controller" controller="device-taint-eviction-controller" machine # [ 24.094052] k3s[882]: time="2026-09-23T10:32:55Z" level=info msg="Creating new TLS secret for kube-system/k3s-serving (count: 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__b947_b336_321f_1e6b-6f060b:fec0::b947:b336:321f:1e6b listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=A57AE5BB0274FF6CCE07AAAFBF0152794AD36F1C]" machine # [ 24.111032] k3s[882]: time="2026-09-23T10:32:55Z" level=info msg="Active TLS secret kube-system/k3s-serving (ver=236) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__b947_b336_321f_1e6b-6f060b:fec0::b947:b336:321f:1e6b listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=A57AE5BB0274FF6CCE07AAAFBF0152794AD36F1C]" machine # [ 24.127517] k3s[882]: I0923 10:32:55.869349 882 controllermanager.go:579] "Warning: skipping controller" controller="storage-version-migrator-controller" machine # [ 24.630319] k3s[882]: I0923 10:32:56.372063 882 controllermanager.go:627] "Warning: controller is disabled" controller="service-lb-controller" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 25.128891] k3s[882]: time="2026-09-23T10:32:56Z" level=info msg="Starting k3s.cattle.io/v1, Kind=Addon controller" machine # [ 25.129611] k3s[882]: time="2026-09-23T10:32:56Z" level=info msg="Creating deploy event broadcaster" machine # [ 25.133711] k3s[882]: time="2026-09-23T10:32:56Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 25.134546] k3s[882]: I0923 10:32:56.875553 882 controller.go:667] quota admission added evaluator for: addons.k3s.cattle.io machine # [ 25.136937] k3s[882]: time="2026-09-23T10:32:56Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 25.138738] k3s[882]: time="2026-09-23T10:32:56Z" level=info msg="Creating helm-controller event broadcaster" machine # [ 25.140345] k3s[882]: time="2026-09-23T10:32:56Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=ApplyingManifest type=Normal machine # [ 25.141196] k3s[882]: time="2026-09-23T10:32:56Z" level=info msg="Cluster dns configmap has been set successfully" machine # [ 25.681709] k3s[882]: I0923 10:32:57.423457 882 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="storageversion-garbage-collector-controller" requiredFeatureGates=["APIServerIdentity","StorageVersionAPI"] machine # [ 25.686915] k3s[882]: I0923 10:32:57.423539 882 controllermanager.go:579] "Warning: skipping controller" controller="storageversion-garbage-collector-controller" machine # [ 25.690619] k3s[882]: time="2026-09-23T10:32:57Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=AppliedManifest type=Normal machine # [ 25.703347] k3s[882]: time="2026-09-23T10:32:57Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=ApplyingManifest type=Normal machine # [ 25.984139] k3s[882]: time="2026-09-23T10:32:57Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=AppliedManifest type=Normal machine # [ 25.997665] k3s[882]: time="2026-09-23T10:32:57Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=ApplyingManifest type=Normal machine # [ 26.043192] k3s[882]: I0923 10:32:57.784998 882 serving.go:392] Generated self-signed cert in-memory machine # [ 26.126431] k3s[882]: I0923 10:32:57.868256 882 serving.go:392] Generated self-signed cert in-memory machine # [ 26.136719] k3s[882]: time="2026-09-23T10:32:57Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 26.221185] k3s[882]: I0923 10:32:57.962573 882 controllermanager.go:160] Version: v1.35.8+k3s1 machine # [ 26.224757] k3s[882]: I0923 10:32:57.966624 882 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 26.227660] k3s[882]: I0923 10:32:57.966701 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.228133] k3s[882]: I0923 10:32:57.966741 882 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 26.228583] k3s[882]: I0923 10:32:57.966760 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.229139] k3s[882]: I0923 10:32:57.966764 882 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 26.229590] k3s[882]: I0923 10:32:57.966799 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.230118] k3s[882]: I0923 10:32:57.967394 882 secure_serving.go:211] Serving securely on 127.0.0.1:10258 machine # [ 26.230599] k3s[882]: I0923 10:32:57.968185 882 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 26.243637] k3s[882]: time="2026-09-23T10:32:57Z" level=info msg="Creating service-lb-controller event broadcaster" machine: (finished: waiting for success: kubectl get ns farm, in 2.53 seconds) machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key machine # [ 26.349353] k3s[882]: time="2026-09-23T10:32:58Z" level=info msg="Starting rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding controller" machine # [ 26.355789] k3s[882]: time="2026-09-23T10:32:58Z" level=info msg="Starting batch/v1, Kind=Job controller" machine # [ 26.356484] k3s[882]: time="2026-09-23T10:32:58Z" level=info msg="Starting /v1, Kind=Secret controller" machine # [ 26.356984] k3s[882]: time="2026-09-23T10:32:58Z" level=info msg="Starting /v1, Kind=ConfigMap controller" machine # [ 26.360108] k3s[882]: time="2026-09-23T10:32:58Z" level=info msg="Starting /v1, Kind=ServiceAccount controller" machine # [ 26.368058] k3s[882]: time="2026-09-23T10:32:58Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChart controller" machine # [ 26.369522] k3s[882]: time="2026-09-23T10:32:58Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChartConfig controller" machine # [ 26.434481] k3s[882]: I0923 10:32:58.174730 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="networkpolicies.networking.k8s.io" machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key, in 0.16 seconds) machine: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key machine # [ 26.437295] k3s[882]: I0923 10:32:58.174778 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="csistoragecapacities.storage.k8s.io" machine # [ 26.439843] k3s[882]: I0923 10:32:58.174842 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="limitranges" machine # [ 26.442095] k3s[882]: I0923 10:32:58.174884 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="replicasets.apps" machine # [ 26.444176] k3s[882]: I0923 10:32:58.174908 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="daemonsets.apps" machine # [ 26.446313] k3s[882]: I0923 10:32:58.174983 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="jobs.batch" machine # [ 26.448810] k3s[882]: I0923 10:32:58.175018 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="roles.rbac.authorization.k8s.io" machine # [ 26.451201] k3s[882]: I0923 10:32:58.175053 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmchartconfigs.helm.cattle.io" machine # [ 26.453818] k3s[882]: I0923 10:32:58.175079 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="addons.k3s.cattle.io" machine # [ 26.456281] k3s[882]: I0923 10:32:58.175118 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="cronjobs.batch" machine # [ 26.458516] k3s[882]: I0923 10:32:58.175146 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="ingresses.networking.k8s.io" machine # [ 26.461016] k3s[882]: I0923 10:32:58.175170 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="rolebindings.rbac.authorization.k8s.io" machine # [ 26.463827] k3s[882]: I0923 10:32:58.175193 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="leases.coordination.k8s.io" machine # [ 26.466323] k3s[882]: I0923 10:32:58.175230 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="serviceaccounts" machine # [ 26.468699] k3s[882]: I0923 10:32:58.175252 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="controllerrevisions.apps" machine # [ 26.471030] k3s[882]: I0923 10:32:58.175287 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="resourceclaimtemplates.resource.k8s.io" machine # [ 26.473417] k3s[882]: I0923 10:32:58.175310 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="deployments.apps" machine # [ 26.475752] k3s[882]: I0923 10:32:58.175336 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpoints" machine # [ 26.478329] k3s[882]: I0923 10:32:58.175373 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="statefulsets.apps" machine # [ 26.480517] k3s[882]: I0923 10:32:58.175398 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="podtemplates" machine # [ 26.482902] k3s[882]: I0923 10:32:58.175460 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="horizontalpodautoscalers.autoscaling" machine # [ 26.485507] k3s[882]: I0923 10:32:58.175488 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="poddisruptionbudgets.policy" machine # [ 26.488043] k3s[882]: I0923 10:32:58.175511 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpointslices.discovery.k8s.io" machine # [ 26.490607] k3s[882]: I0923 10:32:58.175536 882 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmcharts.helm.cattle.io" machine # [ 26.493128] k3s[882]: I0923 10:32:58.175555 882 controllermanager.go:627] "Warning: controller is disabled" controller="bootstrap-signer-controller" machine # [ 26.525926] k3s[882]: I0923 10:32:58.266848 882 shared_informer.go:377] "Caches are synced" machine # [ 26.526584] k3s[882]: I0923 10:32:58.266868 882 shared_informer.go:377] "Caches are synced" machine # [ 26.528294] k3s[882]: I0923 10:32:58.266971 882 shared_informer.go:377] "Caches are synced" machine: (finished: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key, in 0.16 seconds) machine: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine # [ 26.636619] k3s[882]: time="2026-09-23T10:32:58Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 26.641674] k3s[882]: time="2026-09-23T10:32:58Z" level=info msg="Starting /v1, Kind=Pod controller" machine # [ 26.647381] k3s[882]: time="2026-09-23T10:32:58Z" level=info msg="Starting apps/v1, Kind=DaemonSet controller" machine # [ 26.652869] k3s[882]: I0923 10:32:58.394736 882 controllermanager.go:329] Started "cloud-node-lifecycle-controller" machine # [ 26.653684] k3s[882]: time="2026-09-23T10:32:58Z" level=info msg="Starting discovery.k8s.io/v1, Kind=EndpointSlice controller" machine # [ 26.654649] k3s[882]: I0923 10:32:58.396535 882 controllermanager.go:329] Started "service-lb-controller" machine # [ 26.655774] k3s[882]: I0923 10:32:58.395505 882 node_lifecycle_controller.go:112] Sending events to api server machine # [ 26.656510] k3s[882]: I0923 10:32:58.397446 882 controller.go:235] Starting service controller machine # [ 26.658156] k3s[882]: W0923 10:32:58.397912 882 controllermanager.go:306] "node-route-controller" is disabled machine # [ 26.658710] k3s[882]: I0923 10:32:58.398223 882 controllermanager.go:329] Started "cloud-node-controller" machine # [ 26.659420] k3s[882]: I0923 10:32:58.398609 882 node_controller.go:176] Sending events to api server. machine # [ 26.660169] k3s[882]: I0923 10:32:58.398671 882 node_controller.go:185] Waiting for informer caches to sync machine # [ 26.660639] k3s[882]: I0923 10:32:58.397652 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.732495] k3s[882]: I0923 10:32:58.474024 882 controller.go:667] quota admission added evaluator for: deployments.apps machine: (finished: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.15 seconds) subtest: chart deploys and workers become Ready machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine # [ 26.757737] k3s[882]: I0923 10:32:58.499595 882 shared_informer.go:377] "Caches are synced" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 26.983121] k3s[882]: I0923 10:32:58.724247 882 alloc.go:329] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.43.0.10"} machine # [ 26.984748] k3s[882]: time="2026-09-23T10:32:58Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=AppliedManifest type=Normal machine # [ 27.137691] k3s[882]: time="2026-09-23T10:32:58Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 27.527221] k3s[882]: I0923 10:32:59.268274 882 controllermanager.go:627] "Warning: controller is disabled" controller="selinux-warning-controller" machine # [ 27.530368] k3s[882]: I0923 10:32:59.272152 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.531687] k3s[882]: I0923 10:32:59.273556 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.533031] k3s[882]: I0923 10:32:59.274882 882 attach_detach_controller.go:335] "Starting attach detach controller" machine # [ 27.533565] k3s[882]: I0923 10:32:59.274901 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.534113] k3s[882]: I0923 10:32:59.274959 882 tokencleaner.go:117] "Starting token cleaner controller" machine # [ 27.536626] k3s[882]: I0923 10:32:59.278491 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.537954] k3s[882]: I0923 10:32:59.278569 882 deployment_controller.go:172] "Starting controller" controller="deployment" machine # [ 27.538513] k3s[882]: I0923 10:32:59.279845 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.542138] k3s[882]: I0923 10:32:59.282533 882 stateful_set.go:180] "Starting stateful set controller" machine # [ 27.542890] k3s[882]: I0923 10:32:59.282555 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.543499] k3s[882]: I0923 10:32:59.282588 882 pv_protection_controller.go:81] "Starting PV protection controller" machine # [ 27.544058] k3s[882]: I0923 10:32:59.282600 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.544517] k3s[882]: I0923 10:32:59.282634 882 ttlafterfinished_controller.go:112] "Starting TTL after finished controller" machine # [ 27.545118] k3s[882]: I0923 10:32:59.282646 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.545562] k3s[882]: I0923 10:32:59.282696 882 gc_controller.go:98] "Starting GC controller" machine # [ 27.546119] k3s[882]: I0923 10:32:59.282708 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.546565] k3s[882]: I0923 10:32:59.282738 882 serviceaccounts_controller.go:117] "Starting service account controller" machine # [ 27.547112] k3s[882]: I0923 10:32:59.282751 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.547564] k3s[882]: I0923 10:32:59.282784 882 disruption.go:458] "Sending events to api server." machine # [ 27.548765] k3s[882]: I0923 10:32:59.282815 882 disruption.go:465] "Starting disruption controller" machine # [ 27.549460] k3s[882]: I0923 10:32:59.282825 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.549770] k3s[882]: I0923 10:32:59.282880 882 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-legacy-unknown" machine # [ 27.550486] k3s[882]: I0923 10:32:59.282893 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.551023] k3s[882]: I0923 10:32:59.282945 882 expand_controller.go:328] "Starting expand controller" machine # [ 27.551491] k3s[882]: I0923 10:32:59.282958 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.552022] k3s[882]: I0923 10:32:59.282993 882 taint_eviction.go:283] "Starting" controller="taint-eviction-controller" machine # [ 27.552540] k3s[882]: I0923 10:32:59.283038 882 taint_eviction.go:288] "Sending events to API server" machine # [ 27.553093] k3s[882]: I0923 10:32:59.283048 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.553569] k3s[882]: I0923 10:32:59.283143 882 node_ipam_controller.go:142] "Starting ipam controller" machine # [ 27.554120] k3s[882]: I0923 10:32:59.283157 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.554579] k3s[882]: I0923 10:32:59.283232 882 node_lifecycle_controller.go:453] "Sending events to api server" machine # [ 27.555197] k3s[882]: I0923 10:32:59.283264 882 node_lifecycle_controller.go:460] "Starting node controller" machine # [ 27.555629] k3s[882]: I0923 10:32:59.283274 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.556212] k3s[882]: I0923 10:32:59.283303 882 clusterroleaggregation_controller.go:194] "Starting ClusterRoleAggregator controller" machine # [ 27.556655] k3s[882]: I0923 10:32:59.283316 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.557172] k3s[882]: I0923 10:32:59.283364 882 controller.go:174] "Starting ephemeral volume controller" machine # [ 27.557637] k3s[882]: I0923 10:32:59.283377 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.558171] k3s[882]: I0923 10:32:59.283446 882 servicecidrs_controller.go:136] "Starting" controller="service-cidr-controller" machine # [ 27.558648] k3s[882]: I0923 10:32:59.283457 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.559160] k3s[882]: I0923 10:32:59.283634 882 horizontal.go:204] "Starting HPA controller" machine # [ 27.559663] k3s[882]: I0923 10:32:59.283646 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.560207] k3s[882]: I0923 10:32:59.283676 882 cleaner.go:83] "Starting CSR cleaner controller" machine # [ 27.560646] k3s[882]: I0923 10:32:59.283762 882 controller.go:423] "Starting resource claim controller" machine # [ 27.561221] k3s[882]: I0923 10:32:59.283776 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.561669] k3s[882]: I0923 10:32:59.283875 882 endpoints_controller.go:193] "Starting endpoint controller" machine # [ 27.562235] k3s[882]: I0923 10:32:59.283887 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.562728] k3s[882]: I0923 10:32:59.283981 882 job_controller.go:254] "Starting job controller" machine # [ 27.563484] k3s[882]: I0923 10:32:59.284030 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.563963] k3s[882]: I0923 10:32:59.284090 882 cronjob_controllerv2.go:143] "Starting cronjob controller v2" machine # [ 27.564588] k3s[882]: I0923 10:32:59.284102 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.565138] k3s[882]: I0923 10:32:59.306401 882 pvc_protection_controller.go:166] "Starting PVC protection controller" machine # [ 27.565713] k3s[882]: I0923 10:32:59.306426 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.566434] k3s[882]: I0923 10:32:59.306461 882 vac_protection_controller.go:206] "Starting VAC protection controller" machine # [ 27.566914] k3s[882]: I0923 10:32:59.306475 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.567608] k3s[882]: I0923 10:32:59.306529 882 legacy_serviceaccount_token_cleaner.go:103] "Starting legacy service account token cleaner controller" machine # [ 27.568118] k3s[882]: I0923 10:32:59.306543 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.568575] k3s[882]: I0923 10:32:59.306623 882 endpointslicemirroring_controller.go:226] "Starting EndpointSliceMirroring controller" machine # [ 27.569099] k3s[882]: I0923 10:32:59.306635 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.569561] k3s[882]: I0923 10:32:59.306708 882 replica_set.go:241] "Starting controller" name="replicationcontroller" machine # [ 27.570092] k3s[882]: I0923 10:32:59.306721 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.570541] k3s[882]: I0923 10:32:59.307002 882 endpointslice_controller.go:283] "Starting endpoint slice controller" machine # [ 27.571081] k3s[882]: I0923 10:32:59.307016 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.571550] k3s[882]: I0923 10:32:59.307047 882 namespace_controller.go:202] "Starting namespace controller" machine # [ 27.572160] k3s[882]: I0923 10:32:59.307059 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.572625] k3s[882]: I0923 10:32:59.307130 882 daemon_controller.go:309] "Starting daemon sets controller" machine # [ 27.573187] k3s[882]: I0923 10:32:59.307143 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.573650] k3s[882]: I0923 10:32:59.307174 882 certificate_controller.go:120] "Starting certificate controller" name="csrapproving" machine # [ 27.574233] k3s[882]: I0923 10:32:59.307186 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.574693] k3s[882]: I0923 10:32:59.307254 882 pv_controller_base.go:307] "Starting persistent volume controller" machine # [ 27.575444] k3s[882]: I0923 10:32:59.307267 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.575940] k3s[882]: I0923 10:32:59.307301 882 publisher.go:107] "Starting root CA cert publisher controller" machine # [ 27.576772] k3s[882]: I0923 10:32:59.307314 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.578032] k3s[882]: I0923 10:32:59.307399 882 replica_set.go:241] "Starting controller" name="replicaset" machine # [ 27.579226] k3s[882]: I0923 10:32:59.307411 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.580622] k3s[882]: I0923 10:32:59.307473 882 resource_quota_controller.go:297] "Starting resource quota controller" machine # [ 27.581729] k3s[882]: I0923 10:32:59.307487 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.582813] k3s[882]: I0923 10:32:59.307543 882 resource_quota_monitor.go:309] "QuotaMonitor running" machine # [ 27.584061] k3s[882]: I0923 10:32:59.315382 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.585170] k3s[882]: I0923 10:32:59.317672 882 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-serving" machine # [ 27.586717] k3s[882]: I0923 10:32:59.317688 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.587925] k3s[882]: I0923 10:32:59.317717 882 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-client" machine # [ 27.589390] k3s[882]: I0923 10:32:59.317730 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.590497] k3s[882]: I0923 10:32:59.317760 882 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kube-apiserver-client" machine # [ 27.592115] k3s[882]: I0923 10:32:59.317772 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.593491] k3s[882]: I0923 10:32:59.317812 882 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 27.595818] k3s[882]: I0923 10:32:59.318166 882 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 27.637739] k3s[882]: I0923 10:32:59.318235 882 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 27.638517] k3s[882]: I0923 10:32:59.318909 882 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 27.639093] k3s[882]: I0923 10:32:59.321051 882 garbagecollector.go:141] "Starting controller" controller="garbagecollector" machine # [ 27.639557] k3s[882]: I0923 10:32:59.321128 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.640105] k3s[882]: I0923 10:32:59.321220 882 graph_builder.go:386] "Running" component="GraphBuilder" machine # [ 27.648065] k3s[882]: I0923 10:32:59.387475 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.651073] k3s[882]: I0923 10:32:59.284141 882 ttl_controller.go:127] "Starting TTL controller" machine # [ 27.651750] k3s[882]: I0923 10:32:59.392479 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.029101] k3s[882]: time="2026-09-23T10:32:59Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" object=kube-system/local-storage reason=DeletingManifest type=Normal machine # [ 28.034537] k3s[882]: I0923 10:32:59.775015 882 shared_informer.go:377] "Caches are synced" machine # [ 28.041055] k3s[882]: I0923 10:32:59.782640 882 shared_informer.go:377] "Caches are synced" machine # [ 28.041722] k3s[882]: I0923 10:32:59.782696 882 shared_informer.go:377] "Caches are synced" machine # [ 28.043380] k3s[882]: I0923 10:32:59.785254 882 shared_informer.go:377] "Caches are synced" machine # [ 28.045556] k3s[882]: I0923 10:32:59.787434 882 shared_informer.go:377] "Caches are synced" machine # [ 28.046877] k3s[882]: I0923 10:32:59.788749 882 shared_informer.go:377] "Caches are synced" machine # [ 28.048187] k3s[882]: I0923 10:32:59.790047 882 shared_informer.go:377] "Caches are synced" machine # [ 28.048745] k3s[882]: I0923 10:32:59.790098 882 range_allocator.go:177] "Sending events to api server" machine # [ 28.050490] k3s[882]: I0923 10:32:59.792357 882 range_allocator.go:181] "Starting range CIDR allocator" machine # [ 28.051089] k3s[882]: I0923 10:32:59.792374 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.051572] k3s[882]: I0923 10:32:59.792385 882 shared_informer.go:377] "Caches are synced" machine # [ 28.054285] k3s[882]: I0923 10:32:59.796149 882 shared_informer.go:377] "Caches are synced" machine # [ 28.054901] k3s[882]: I0923 10:32:59.796194 882 shared_informer.go:377] "Caches are synced" machine # [ 28.056907] k3s[882]: I0923 10:32:59.798773 882 shared_informer.go:377] "Caches are synced" machine # [ 28.057509] k3s[882]: I0923 10:32:59.798813 882 shared_informer.go:377] "Caches are synced" machine # [ 28.059062] k3s[882]: time="2026-09-23T10:32:59Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=ApplyingManifest type=Normal machine # [ 28.062268] k3s[882]: I0923 10:32:59.804131 882 shared_informer.go:377] "Caches are synced" machine # [ 28.062832] k3s[882]: I0923 10:32:59.804196 882 shared_informer.go:377] "Caches are synced" machine # [ 28.064489] k3s[882]: I0923 10:32:59.806355 882 shared_informer.go:377] "Caches are synced" machine # [ 28.065115] k3s[882]: I0923 10:32:59.806526 882 shared_informer.go:377] "Caches are synced" machine # [ 28.065571] k3s[882]: I0923 10:32:59.806578 882 shared_informer.go:377] "Caches are synced" machine # [ 28.066098] k3s[882]: I0923 10:32:59.806780 882 shared_informer.go:377] "Caches are synced" machine # [ 28.066554] k3s[882]: I0923 10:32:59.806873 882 shared_informer.go:377] "Caches are synced" machine # [ 28.067100] k3s[882]: I0923 10:32:59.807006 882 shared_informer.go:377] "Caches are synced" machine # [ 28.067565] k3s[882]: I0923 10:32:59.807130 882 shared_informer.go:377] "Caches are synced" machine # [ 28.068098] k3s[882]: I0923 10:32:59.807185 882 shared_informer.go:377] "Caches are synced" machine # [ 28.068561] k3s[882]: I0923 10:32:59.807234 882 shared_informer.go:377] "Caches are synced" machine # [ 28.069086] k3s[882]: I0923 10:32:59.807306 882 shared_informer.go:377] "Caches are synced" machine # [ 28.069546] k3s[882]: I0923 10:32:59.807357 882 shared_informer.go:377] "Caches are synced" machine # [ 28.069892] k3s[882]: I0923 10:32:59.807645 882 shared_informer.go:377] "Caches are synced" machine # [ 28.070543] k3s[882]: I0923 10:32:59.808408 882 shared_informer.go:377] "Caches are synced" machine # [ 28.076805] k3s[882]: I0923 10:32:59.816257 882 shared_informer.go:377] "Caches are synced" machine # [ 28.077580] k3s[882]: I0923 10:32:59.816344 882 shared_informer.go:377] "Caches are synced" machine # [ 28.078069] k3s[882]: I0923 10:32:59.817674 882 shared_informer.go:377] "Caches are synced" machine # [ 28.078505] k3s[882]: I0923 10:32:59.818054 882 shared_informer.go:377] "Caches are synced" machine # [ 28.079056] k3s[882]: I0923 10:32:59.818484 882 shared_informer.go:377] "Caches are synced" machine # [ 28.079514] k3s[882]: I0923 10:32:59.818517 882 shared_informer.go:377] "Caches are synced" machine # [ 28.085890] k3s[882]: I0923 10:32:59.827757 882 shared_informer.go:377] "Caches are synced" machine # [ 28.086525] k3s[882]: I0923 10:32:59.827920 882 shared_informer.go:377] "Caches are synced" machine # [ 28.097063] k3s[882]: I0923 10:32:59.838908 882 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 28.110102] k3s[882]: I0923 10:32:59.851965 882 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 28.131888] k3s[882]: I0923 10:32:59.873722 882 controller.go:667] quota admission added evaluator for: helmcharts.helm.cattle.io machine # [ 28.132620] k3s[882]: I0923 10:32:59.873827 882 shared_informer.go:377] "Caches are synced" machine # [ 28.133309] k3s[882]: I0923 10:32:59.875116 882 shared_informer.go:377] "Caches are synced" machine # [ 28.137071] k3s[882]: I0923 10:32:59.878691 882 shared_informer.go:377] "Caches are synced" machine # [ 28.138647] k3s[882]: I0923 10:32:59.880258 882 shared_informer.go:377] "Caches are synced" machine # [ 28.140968] k3s[882]: I0923 10:32:59.882832 882 shared_informer.go:377] "Caches are synced" machine # [ 28.141585] k3s[882]: I0923 10:32:59.882917 882 shared_informer.go:377] "Caches are synced" machine # [ 28.142103] k3s[882]: I0923 10:32:59.883748 882 shared_informer.go:377] "Caches are synced" machine # [ 28.142714] k3s[882]: I0923 10:32:59.883823 882 shared_informer.go:377] "Caches are synced" machine # [ 28.143435] k3s[882]: time="2026-09-23T10:32:59Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=AppliedManifest type=Normal machine # [ 28.151774] k3s[882]: time="2026-09-23T10:32:59Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 28.163064] k3s[882]: time="2026-09-23T10:32:59Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=ApplyingManifest type=Normal machine # [ 28.239779] k3s[882]: time="2026-09-23T10:32:59Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Applying HelmChart from https://%{KUBERNETES_API}%/static/charts/nix-grpc-farm.tgz using Job kube-system/helm-install-nix-grpc-farm " object=kube-system/nix-grpc-farm reason=ApplyJob type=Normal machine # [ 28.253916] k3s[882]: time="2026-09-23T10:32:59Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Deferred node password secret validation complete" object=machine reason=NodePasswordValidationComplete type=Normal machine # [ 28.268873] k3s[882]: time="2026-09-23T10:33:00Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=AppliedManifest type=Normal machine # [ 28.271411] k3s[882]: I0923 10:33:00.013194 882 controller.go:667] quota admission added evaluator for: jobs.batch machine # [ 28.284113] k3s[882]: time="2026-09-23T10:33:00Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=ApplyingManifest type=Normal machine # [ 28.380757] k3s[882]: I0923 10:33:00.122590 882 controller.go:667] quota admission added evaluator for: replicasets.apps machine # [ 28.433145] k3s[882]: time="2026-09-23T10:33:00Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=AppliedManifest type=Normal machine # [ 28.582047] k3s[882]: time="2026-09-23T10:33:00Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/traefik.yaml\"" object=kube-system/traefik reason=DeletingManifest type=Normal machine # [ 28.598426] k3s[882]: time="2026-09-23T10:33:00Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Resumed synced Job kube-system/helm-install-nix-grpc-farm" object=kube-system/nix-grpc-farm reason=ResumeJob type=Normal machine # [ 29.046112] k3s[882]: I0923 10:33:00.787860 882 shared_informer.go:377] "Caches are synced" machine # [ 29.080017] k3s[882]: I0923 10:33:00.821845 882 shared_informer.go:377] "Caches are synced" machine # [ 29.081414] k3s[882]: I0923 10:33:00.821873 882 garbagecollector.go:166] "Garbage collector: all resource monitors have synced" machine # [ 29.081838] k3s[882]: I0923 10:33:00.821884 882 garbagecollector.go:169] "Proceeding to collect garbage" machine # [ 29.136463] k3s[882]: time="2026-09-23T10:33:00Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 29.566465] postgres[1193]: [1193] ERROR: relation "goose_db_version" does not exist at character 36 machine # [ 29.567220] postgres[1193]: [1193] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC machine # [ 29.592909] niks3-server[1184]: 2026/09/23 10:33:01 OK 20241026095416_initial_model.sql (10.57ms) machine # [ 29.603095] niks3-server[1184]: 2026/09/23 10:33:01 OK 20251210153512_drop_unused_gin_index.sql (2.14ms) machine # [ 29.608244] niks3-server[1184]: 2026/09/23 10:33:01 OK 20251218171726_add_pins.sql (5.01ms) machine # [ 29.611910] niks3-server[1184]: 2026/09/23 10:33:01 OK 20260628120000_add_object_size_and_stats.sql (3.61ms) machine # [ 29.616821] niks3-server[1184]: 2026/09/23 10:33:01 OK 20260905000000_add_claims.sql (4.62ms) machine # [ 29.619622] niks3-server[1184]: 2026/09/23 10:33:01 OK 20260920000000_drop_claims.sql (2.76ms) machine # [ 29.620433] niks3-server[1184]: 2026/09/23 10:33:01 goose: successfully migrated database to version: 20260920000000 machine # [ 29.625132] niks3-server[1184]: 2026/09/23 10:33:01 OK 1_commit_pending_closure.sql (5.41ms) machine # [ 29.628053] niks3-server[1184]: 2026/09/23 10:33:01 OK 2_object_stats_trigger.sql (2.69ms) machine # [ 29.629022] niks3-server[1184]: 2026/09/23 10:33:01 goose: up to current file version: 2 machine # [ 29.632153] niks3-server[1184]: 2026/09/23 10:33:01 INFO OIDC provider initialized name=kubernetes issuer=https://kubernetes.default.svc.cluster.local machine # [ 29.632780] niks3-server[1184]: 2026/09/23 10:33:01 INFO OIDC authentication enabled config=/nix/store/v0b0sqyzhrjsz48x3klf7b7vl89apzs0-niks3-oidc.json machine # [ 29.633775] niks3-server[1184]: 2026/09/23 10:33:01 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key machine # [ 29.662909] niks3-server[1184]: 2026/09/23 10:33:01 INFO Read proxy enabled — serving cache objects from S3 machine # [ 29.664797] niks3-server[1184]: 2026/09/23 10:33:01 INFO Using socket-activated listener address=0.0.0.0:5751 machine # [ 29.667074] niks3-server[1184]: 2026/09/23 10:33:01 INFO systemd watchdog enabled interval=15s machine # [ 29.667715] niks3-server[1184]: 2026/09/23 10:33:01 INFO Starting HTTP server address=0.0.0.0:5751 machine # [ 29.668595] systemd[1]: Started niks3 server. machine # [ 29.670307] systemd[1]: Reached target Multi-User System. machine # [ 29.671046] systemd[1]: Startup finished in 1.117s (kernel) + 3.823s (initrd) + 24.729s (userspace) = 29.670s. machine # [ 30.140505] k3s[882]: time="2026-09-23T10:33:01Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 30.388533] k3s[882]: time="2026-09-23T10:33:02Z" level=info msg="Imported docker.io/library/nix-grpc-farm-client:0.1.0-beta.3" machine # [ 30.393264] k3s[882]: time="2026-09-23T10:33:02Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-client@sha256:9dc830839ae1dc56eef4f139aeee0baa7a0b7d0e5414b21287e85855a5d150f2" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 30.847733] k3s[882]: time="2026-09-23T10:33:02Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-client.tar in 7.25902454s" machine # [ 30.849436] k3s[882]: time="2026-09-23T10:33:02Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-lb.tar" machine # [ 31.140662] k3s[882]: time="2026-09-23T10:33:02Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 32.033960] k3s[882]: time="2026-09-23T10:33:03Z" level=info msg="Started tunnel to 10.0.2.15:6443" machine # [ 32.034695] k3s[882]: time="2026-09-23T10:33:03Z" level=info msg="Stopped tunnel to 127.0.0.1:6443" machine # [ 32.035208] k3s[882]: time="2026-09-23T10:33:03Z" level=info msg="Connecting to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 32.035668] k3s[882]: time="2026-09-23T10:33:03Z" level=info msg="Proxy done" err="context canceled" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 32.036185] k3s[882]: time="2026-09-23T10:33:03Z" level=info msg="error in remotedialer server [400]: websocket: close 1006 (abnormal closure): unexpected EOF" machine # [ 32.043726] k3s[882]: time="2026-09-23T10:33:03Z" level=info msg="Handling backend connection request [machine]" machine # [ 32.044501] k3s[882]: time="2026-09-23T10:33:03Z" level=info msg="Connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 32.045028] k3s[882]: time="2026-09-23T10:33:03Z" level=info msg="Remotedialer connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 32.137298] k3s[882]: time="2026-09-23T10:33:03Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 32.551968] k3s[882]: time="2026-09-23T10:33:04Z" level=info msg="Imported docker.io/library/nix-grpc-farm-lb:0.1.0-beta.3" machine # [ 32.562126] k3s[882]: time="2026-09-23T10:33:04Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-lb@sha256:18ee6724be589622e1aee9d13c5121e7b2c992ca636c935ade90c66423e18f37" machine # [ 32.626456] k3s[882]: time="2026-09-23T10:33:04Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-lb.tar in 1.778569901s" machine # [ 32.629565] k3s[882]: time="2026-09-23T10:33:04Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm.tar" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 32.992714] k3s[882]: time="2026-09-23T10:33:04Z" level=info msg="Running kubelet --cloud-provider=external --config-dir=/var/lib/rancher/k3s/agent/etc/kubelet.conf.d --containerd=/run/k3s/containerd/containerd.sock --eviction-hard=nodefs.available<1%,imagefs.available<1% --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubelet.kubeconfig --node-ip=10.0.2.15,fec0::b947:b336:321f:1e6b --node-labels= --read-only-port=0" machine # [ 32.998057] k3s[882]: Flag --containerd has been deprecated, This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed. machine # [ 33.011535] k3s[882]: I0923 10:33:04.753312 882 server.go:521] "Kubelet version" kubeletVersion="v1.35.8+k3s1" machine # [ 33.012581] k3s[882]: I0923 10:33:04.753341 882 server.go:523] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 33.013497] k3s[882]: I0923 10:33:04.753367 882 watchdog_linux.go:95] "Systemd watchdog is not enabled" machine # [ 33.014242] k3s[882]: I0923 10:33:04.753378 882 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." machine # [ 33.018830] k3s[882]: I0923 10:33:04.760663 882 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/agent/client-ca.crt" machine # [ 33.025670] k3s[882]: I0923 10:33:04.767493 882 server.go:1414] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" machine # [ 33.030188] k3s[882]: I0923 10:33:04.772037 882 server.go:771] "--cgroups-per-qos enabled, but --cgroup-root was not specified. Defaulting to /" machine # [ 33.032390] k3s[882]: I0923 10:33:04.772072 882 server.go:832] "NoSwap is set due to memorySwapBehavior not specified" memorySwapBehavior="" FailSwapOn=false machine # [ 33.033356] k3s[882]: I0923 10:33:04.772265 882 container_manager_linux.go:272] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] machine # [ 33.034152] k3s[882]: I0923 10:33:04.772288 882 container_manager_linux.go:277] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"machine","RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} machine # [ 33.034819] k3s[882]: I0923 10:33:04.772463 882 topology_manager.go:143] "Creating topology manager with none policy" machine # [ 33.035647] k3s[882]: I0923 10:33:04.772478 882 container_manager_linux.go:308] "Creating device plugin manager" machine # [ 33.035986] k3s[882]: I0923 10:33:04.772544 882 container_manager_linux.go:317] "Creating Dynamic Resource Allocation (DRA) manager" machine # [ 33.053904] k3s[882]: I0923 10:33:04.795716 882 state_mem.go:41] "Initialized" logger="CPUManager state memory" machine # [ 33.054839] k3s[882]: I0923 10:33:04.795988 882 kubelet.go:482] "Attempting to sync node with API server" machine # [ 33.055575] k3s[882]: I0923 10:33:04.796008 882 kubelet.go:383] "Adding static pod path" path="/var/lib/rancher/k3s/agent/pod-manifests" machine # [ 33.056550] k3s[882]: I0923 10:33:04.796040 882 kubelet.go:394] "Adding apiserver pod source" machine # [ 33.057227] k3s[882]: I0923 10:33:04.796056 882 apiserver.go:42] "Waiting for node sync before watching apiserver pods" machine # [ 33.057940] k3s[882]: I0923 10:33:04.797757 882 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="containerd" version="2.2.7-k3s1" apiVersion="v1" machine # [ 33.058707] k3s[882]: I0923 10:33:04.798862 882 kubelet.go:945] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" machine # [ 33.059570] k3s[882]: I0923 10:33:04.798911 882 kubelet.go:972] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" machine # [ 33.063358] k3s[882]: I0923 10:33:04.805170 882 server.go:1252] "Started kubelet" machine # [ 33.067114] k3s[882]: I0923 10:33:04.806348 882 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 machine # [ 33.067770] k3s[882]: I0923 10:33:04.806480 882 server_v1.go:49] "podresources" method="list" useActivePods=true machine # [ 33.068671] k3s[882]: I0923 10:33:04.806769 882 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" machine # [ 33.069490] k3s[882]: I0923 10:33:04.806846 882 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 machine # [ 33.069835] k3s[882]: I0923 10:33:04.807274 882 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" machine # [ 33.070652] k3s[882]: I0923 10:33:04.808389 882 server.go:317] "Adding debug handlers to kubelet server" machine # [ 33.071854] k3s[882]: I0923 10:33:04.813732 882 dynamic_serving_content.go:135] "Starting controller" name="kubelet-server-cert-files::/var/lib/rancher/k3s/agent/serving-kubelet.crt::/var/lib/rancher/k3s/agent/serving-kubelet.key" machine # [ 33.074026] k3s[882]: E0923 10:33:04.815883 882 kubelet_node_status.go:392] "Error getting the current node from lister" err="node \"machine\" not found" machine # [ 33.074640] k3s[882]: I0923 10:33:04.815960 882 volume_manager.go:311] "Starting Kubelet Volume Manager" machine # [ 33.075140] k3s[882]: I0923 10:33:04.816375 882 desired_state_of_world_populator.go:146] "Desired state populator starts to run" machine # [ 33.075601] k3s[882]: I0923 10:33:04.816604 882 reconciler.go:29] "Reconciler: start to sync state" machine # [ 33.080691] k3s[882]: E0923 10:33:04.822569 882 kubelet.go:1661] "Image garbage collection failed once. Stats initialization may not have completed yet" err="invalid capacity 0 on image filesystem" machine # [ 33.082173] k3s[882]: I0923 10:33:04.824041 882 factory.go:223] Registration of the containerd container factory successfully machine # [ 33.082745] k3s[882]: I0923 10:33:04.824065 882 factory.go:223] Registration of the systemd container factory successfully machine # [ 33.083465] k3s[882]: I0923 10:33:04.824181 882 factory.go:221] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory machine # [ 33.086131] k3s[882]: E0923 10:33:04.828009 882 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"machine\" not found" node="machine" machine # [ 33.096722] k3s[882]: I0923 10:33:04.838590 882 cpu_manager.go:225] "Starting" policy="none" machine # [ 33.097493] k3s[882]: I0923 10:33:04.838613 882 cpu_manager.go:226] "Reconciling" reconcilePeriod="10s" machine # [ 33.098062] k3s[882]: I0923 10:33:04.838646 882 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" machine # [ 33.099358] k3s[882]: I0923 10:33:04.841220 882 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" machine # [ 33.109082] k3s[882]: I0923 10:33:04.850950 882 policy_none.go:50] "Start" machine # [ 33.109739] k3s[882]: I0923 10:33:04.850973 882 memory_manager.go:187] "Starting memorymanager" policy="None" machine # [ 33.110399] k3s[882]: I0923 10:33:04.850989 882 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" machine # [ 33.117142] k3s[882]: I0923 10:33:04.858951 882 policy_none.go:44] "Start" machine # [ 33.121937] systemd[1]: Created slice libcontainer container kubepods.slice. machine # [ 33.136270] k3s[882]: time="2026-09-23T10:33:04Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 33.138769] systemd[1]: Created slice libcontainer container kubepods-besteffort.slice. machine # [ 33.151260] systemd[1]: Created slice libcontainer container kubepods-burstable.slice. machine # [ 33.152462] k3s[882]: E0923 10:33:04.894068 882 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" machine # [ 33.154462] k3s[882]: I0923 10:33:04.894190 882 eviction_manager.go:194] "Eviction manager: starting control loop" machine # [ 33.157116] k3s[882]: I0923 10:33:04.894214 882 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" machine # [ 33.157830] k3s[882]: I0923 10:33:04.895221 882 plugin_manager.go:121] "Starting Kubelet Plugin Manager" machine # [ 33.158465] k3s[882]: E0923 10:33:04.897549 882 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="no imagefs label for configured runtime" machine # [ 33.158949] k3s[882]: E0923 10:33:04.897663 882 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"machine\" not found" machine # [ 33.187197] k3s[882]: I0923 10:33:04.929030 882 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" machine # [ 33.187889] k3s[882]: I0923 10:33:04.929073 882 status_manager.go:249] "Starting to sync pod status with apiserver" machine # [ 33.188544] k3s[882]: I0923 10:33:04.929114 882 kubelet.go:2506] "Starting kubelet main sync loop" machine # [ 33.191075] k3s[882]: E0923 10:33:04.932951 882 kubelet.go:2530] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" machine # [ 33.255267] k3s[882]: I0923 10:33:04.997034 882 kubelet_node_status.go:74] "Attempting to register node" node="machine" machine # [ 33.261307] k3s[882]: I0923 10:33:05.003123 882 node_controller.go:429] Initializing node machine with cloud provider machine # [ 33.262063] k3s[882]: I0923 10:33:05.003186 882 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 33.262487] k3s[882]: E0923 10:33:05.003210 882 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 33.263538] k3s[882]: I0923 10:33:05.004999 882 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"machine\" does not exist" machine # [ 33.264148] k3s[882]: time="2026-09-23T10:33:05Z" level=info msg="Adding node OwnerReference to node-password secret machine.node-password.k3s" machine # [ 33.271803] k3s[882]: I0923 10:33:05.008279 882 node_controller.go:429] Initializing node machine with cloud provider machine # [ 33.272399] k3s[882]: I0923 10:33:05.008330 882 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 33.272897] k3s[882]: E0923 10:33:05.008350 882 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 33.276608] k3s[882]: I0923 10:33:05.018474 882 node_controller.go:429] Initializing node machine with cloud provider machine # [ 33.277409] k3s[882]: I0923 10:33:05.018530 882 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 33.277918] k3s[882]: E0923 10:33:05.018550 882 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 33.278573] k3s[882]: time="2026-09-23T10:33:05Z" level=info msg="Synced coredns NodeHosts entries for machine" machine # [ 33.281949] k3s[882]: I0923 10:33:05.023769 882 node_controller.go:429] Initializing node machine with cloud provider machine # [ 33.282705] k3s[882]: I0923 10:33:05.023817 882 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 33.283357] k3s[882]: E0923 10:33:05.023834 882 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 33.290339] k3s[882]: I0923 10:33:05.029762 882 range_allocator.go:433] "Set node PodCIDR" node="machine" podCIDRs=["10.42.0.0/24"] machine # [ 33.292732] k3s[882]: I0923 10:33:05.034584 882 node_controller.go:429] Initializing node machine with cloud provider machine # [ 33.293494] k3s[882]: I0923 10:33:05.034654 882 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 33.296222] k3s[882]: E0923 10:33:05.034679 882 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 33.297120] k3s[882]: I0923 10:33:05.039000 882 kubelet_node_status.go:77] "Successfully registered node" node="machine" machine # [ 33.297846] k3s[882]: I0923 10:33:05.039737 882 kuberuntime_manager.go:2095] "Updating runtime config through cri with podcidr" CIDR="10.42.0.0/24" machine # [ 33.300413] k3s[882]: I0923 10:33:05.042277 882 kubelet_network.go:47] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.42.0.0/24" machine # [ 33.302544] k3s[882]: time="2026-09-23T10:33:05Z" level=info msg="Annotations and labels have been set successfully on node: machine" machine # [ 33.304072] k3s[882]: time="2026-09-23T10:33:05Z" level=info msg="Starting flannel with backend vxlan" machine # [ 33.306485] k3s[882]: I0923 10:33:05.048346 882 node_controller.go:429] Initializing node machine with cloud provider machine # [ 33.325684] k3s[882]: time="2026-09-23T10:33:05Z" level=info msg="Flannel found PodCIDR assigned for node machine" machine # [ 33.326492] k3s[882]: time="2026-09-23T10:33:05Z" level=info msg="The interface eth0 with ipv4 address 10.0.2.15 will be used by flannel" machine # [ 33.327036] k3s[882]: I0923 10:33:05.068534 882 kube.go:139] Waiting 10m0s for node controller to sync machine # [ 33.327506] k3s[882]: I0923 10:33:05.068601 882 kube.go:537] Starting kube subnet manager machine # [ 33.404327] k3s[882]: I0923 10:33:05.146165 882 node_controller.go:474] Successfully initialized node machine with cloud provider machine # [ 33.404897] k3s[882]: I0923 10:33:05.146281 882 event.go:389] "Event occurred" object="machine" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="Synced" message="Node synced successfully" machine # [ 33.413032] k3s[882]: I0923 10:33:05.154848 882 server.go:173] "Starting Kubernetes Scheduler" version="v1.35.8+k3s1" machine # [ 33.414786] k3s[882]: I0923 10:33:05.154871 882 server.go:175] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 33.415897] k3s[882]: I0923 10:33:05.157761 882 secure_serving.go:211] Serving securely on 127.0.0.1:10259 machine # [ 33.416534] k3s[882]: I0923 10:33:05.157868 882 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 33.417105] k3s[882]: I0923 10:33:05.157885 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 33.417670] k3s[882]: I0923 10:33:05.157950 882 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 33.421227] k3s[882]: I0923 10:33:05.158039 882 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 33.421807] k3s[882]: I0923 10:33:05.159995 882 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 33.422465] k3s[882]: I0923 10:33:05.160028 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 33.423025] k3s[882]: I0923 10:33:05.159920 882 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 33.423529] k3s[882]: I0923 10:33:05.160252 882 shared_informer.go:370] "Waiting for caches to sync" machine # [ 33.424417] k3s[882]: I0923 10:33:05.164559 882 kubelet_node_status.go:427] "Fast updating node status as it just became ready" machine # [ 33.434726] k3s[882]: I0923 10:33:05.176580 882 topologycache.go:237] "Can't get CPU or zone information for node" node="machine" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 33.943295] k3s[882]: time="2026-09-23T10:33:05Z" level=info msg="Tunnel authorizer set Kubelet Port 0.0.0.0:10250" machine # [ 34.055636] k3s[882]: I0923 10:33:05.797300 882 apiserver.go:52] "Watching apiserver" machine # [ 34.074841] k3s[882]: I0923 10:33:05.816668 882 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" machine # [ 34.116604] k3s[882]: I0923 10:33:05.858349 882 shared_informer.go:377] "Caches are synced" machine # [ 34.119454] k3s[882]: I0923 10:33:05.861301 882 shared_informer.go:377] "Caches are synced" machine # [ 34.120546] k3s[882]: I0923 10:33:05.862318 882 shared_informer.go:377] "Caches are synced" machine # [ 34.133302] k3s[882]: I0923 10:33:05.875122 882 server.go:218] "Successfully retrieved NodeIPs" NodeIPs=["10.0.2.15","fec0::b947:b336:321f:1e6b"] machine # [ 34.133994] k3s[882]: E0923 10:33:05.875195 882 server.go:255] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`" machine # [ 34.135427] systemd[1]: Created slice libcontainer container kubepods-burstable-pod2fe52cee_b40a_4956_8e95_703a58e2a352.slice. machine # [ 34.144432] k3s[882]: time="2026-09-23T10:33:05Z" level=info msg="Labels and annotations have been set successfully on node: machine" machine # [ 34.151331] systemd[1]: Created slice libcontainer container kubepods-burstable-pod393a0c68_c501_4ad2_96fe_e2d96f5554c3.slice. machine # [ 34.163947] k3s[882]: I0923 10:33:05.905641 882 server.go:264] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4" machine # [ 34.164600] k3s[882]: I0923 10:33:05.905684 882 server_linux.go:136] "Using iptables Proxier" machine # [ 34.179704] k3s[882]: I0923 10:33:05.921554 882 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4" machine # [ 34.188549] k3s[882]: I0923 10:33:05.930385 882 server.go:529] "Version info" version="v1.35.8+k3s1" machine # [ 34.189436] k3s[882]: I0923 10:33:05.930415 882 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 34.190171] k3s[882]: I0923 10:33:05.931512 882 config.go:200] "Starting service config controller" machine # [ 34.190590] k3s[882]: I0923 10:33:05.931532 882 shared_informer.go:349] "Waiting for caches to sync" controller="service config" machine # [ 34.194582] k3s[882]: I0923 10:33:05.931567 882 config.go:106] "Starting endpoint slice config controller" machine # [ 34.195382] k3s[882]: I0923 10:33:05.931581 882 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config" machine # [ 34.195864] k3s[882]: I0923 10:33:05.931612 882 config.go:403] "Starting serviceCIDR config controller" machine # [ 34.196605] k3s[882]: I0923 10:33:05.931624 882 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config" machine # [ 34.197237] k3s[882]: I0923 10:33:05.932176 882 config.go:309] "Starting node config controller" machine # [ 34.197648] k3s[882]: I0923 10:33:05.932190 882 shared_informer.go:349] "Waiting for caches to sync" controller="node config" machine # [ 34.197829] k3s[882]: I0923 10:33:05.932201 882 shared_informer.go:356] "Caches are synced" controller="node config" machine # [ 34.198568] k3s[882]: I0923 10:33:05.938861 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-config-volume\" (UniqueName: \"kubernetes.io/configmap/2fe52cee-b40a-4956-8e95-703a58e2a352-custom-config-volume\") pod \"coredns-c5fdd76cf-cnfqz\" (UID: \"2fe52cee-b40a-4956-8e95-703a58e2a352\") " pod="kube-system/coredns-c5fdd76cf-cnfqz" machine # [ 34.199119] k3s[882]: I0923 10:33:05.938890 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7mz6\" (UniqueName: \"kubernetes.io/projected/2fe52cee-b40a-4956-8e95-703a58e2a352-kube-api-access-g7mz6\") pod \"coredns-c5fdd76cf-cnfqz\" (UID: \"2fe52cee-b40a-4956-8e95-703a58e2a352\") " pod="kube-system/coredns-c5fdd76cf-cnfqz" machine # [ 34.199749] k3s[882]: I0923 10:33:05.939017 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/393a0c68-c501-4ad2-96fe-e2d96f5554c3-klipper-helm\") pod \"helm-install-nix-grpc-farm-c85c8\" (UID: \"393a0c68-c501-4ad2-96fe-e2d96f5554c3\") " pod="kube-system/helm-install-nix-grpc-farm-c85c8" machine # [ 34.201115] k3s[882]: I0923 10:33:05.939089 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/393a0c68-c501-4ad2-96fe-e2d96f5554c3-klipper-cache\") pod \"helm-install-nix-grpc-farm-c85c8\" (UID: \"393a0c68-c501-4ad2-96fe-e2d96f5554c3\") " pod="kube-system/helm-install-nix-grpc-farm-c85c8" machine # [ 34.201253] k3s[882]: I0923 10:33:05.939128 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"content\" (UniqueName: \"kubernetes.io/configmap/393a0c68-c501-4ad2-96fe-e2d96f5554c3-content\") pod \"helm-install-nix-grpc-farm-c85c8\" (UID: \"393a0c68-c501-4ad2-96fe-e2d96f5554c3\") " pod="kube-system/helm-install-nix-grpc-farm-c85c8" machine # [ 34.201770] k3s[882]: I0923 10:33:05.939198 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpszm\" (UniqueName: \"kubernetes.io/projected/393a0c68-c501-4ad2-96fe-e2d96f5554c3-kube-api-access-hpszm\") pod \"helm-install-nix-grpc-farm-c85c8\" (UID: \"393a0c68-c501-4ad2-96fe-e2d96f5554c3\") " pod="kube-system/helm-install-nix-grpc-farm-c85c8" machine # [ 34.202434] k3s[882]: I0923 10:33:05.939222 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2fe52cee-b40a-4956-8e95-703a58e2a352-config-volume\") pod \"coredns-c5fdd76cf-cnfqz\" (UID: \"2fe52cee-b40a-4956-8e95-703a58e2a352\") " pod="kube-system/coredns-c5fdd76cf-cnfqz" machine # [ 34.202962] k3s[882]: I0923 10:33:05.939246 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/393a0c68-c501-4ad2-96fe-e2d96f5554c3-klipper-config\") pod \"helm-install-nix-grpc-farm-c85c8\" (UID: \"393a0c68-c501-4ad2-96fe-e2d96f5554c3\") " pod="kube-system/helm-install-nix-grpc-farm-c85c8" machine # [ 34.204131] k3s[882]: I0923 10:33:05.939434 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/393a0c68-c501-4ad2-96fe-e2d96f5554c3-tmp\") pod \"helm-install-nix-grpc-farm-c85c8\" (UID: \"393a0c68-c501-4ad2-96fe-e2d96f5554c3\") " pod="kube-system/helm-install-nix-grpc-farm-c85c8" machine # [ 34.204602] k3s[882]: I0923 10:33:05.939464 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"values\" (UniqueName: \"kubernetes.io/projected/393a0c68-c501-4ad2-96fe-e2d96f5554c3-values\") pod \"helm-install-nix-grpc-farm-c85c8\" (UID: \"393a0c68-c501-4ad2-96fe-e2d96f5554c3\") " pod="kube-system/helm-install-nix-grpc-farm-c85c8" machine # [ 34.326805] k3s[882]: I0923 10:33:06.068640 882 kube.go:163] Node controller sync successful machine # [ 34.327648] k3s[882]: I0923 10:33:06.068708 882 vxlan.go:128] VXLAN config: VNI=1 Port=0 GBP=false Learning=false DirectRouting=false machine # [ 34.332565] k3s[882]: I0923 10:33:06.074417 882 kube.go:704] List of node(machine) annotations: map[string]string{"alpha.kubernetes.io/provided-node-ip":"10.0.2.15,fec0::b947:b336:321f:1e6b", "k3s.io/hostname":"machine", "k3s.io/internal-ip":"10.0.2.15,fec0::b947:b336:321f:1e6b", "k3s.io/node-args":"[\"server\",\"--disable\",\"traefik\",\"--disable\",\"metrics-server\",\"--disable\",\"local-storage\",\"--kubelet-arg\",\"eviction-hard=nodefs.available\\u003c1%,imagefs.available\\u003c1%\"]", "k3s.io/node-config-hash":"EFXPOZ7ZWHRCLFNW4X4ZDPFQMSAOP3BLEIN2VE47TDRKQ4UIWKUQ====", "k3s.io/node-env":"{}", "node.alpha.kubernetes.io/ttl":"0", "volumes.kubernetes.io/controller-managed-attach-detach":"true"} machine # [ 34.362877] (udev-worker)[1295]: Network interface NamePolicy= disabled on kernel command line. machine # [ 34.368779] k3s[882]: I0923 10:33:06.110567 882 kube.go:558] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.42.0.0/24] machine # [ 34.371722] k3s[882]: I0923 10:33:06.113564 882 iptables.go:50] Starting flannel in iptables mode... machine # [ 34.372591] k3s[882]: time="2026-09-23T10:33:06Z" level=warning msg="no subnet found for key: FLANNEL_NETWORK in file: /run/flannel/subnet.env" machine # [ 34.373672] k3s[882]: time="2026-09-23T10:33:06Z" level=warning msg="no subnet found for key: FLANNEL_SUBNET in file: /run/flannel/subnet.env" machine # [ 34.374590] k3s[882]: time="2026-09-23T10:33:06Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_NETWORK in file: /run/flannel/subnet.env" machine # [ 34.375501] k3s[882]: time="2026-09-23T10:33:06Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_SUBNET in file: /run/flannel/subnet.env" machine # [ 34.376432] k3s[882]: I0923 10:33:06.113657 882 iptables.go:101] Current network or subnet (10.42.0.0/16, 10.42.0.0/24) is not equal to previous one (0.0.0.0/0, 0.0.0.0/0), trying to recycle old iptables rules machine # [ 34.390932] k3s[882]: I0923 10:33:06.132756 882 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config" machine # [ 34.391706] k3s[882]: I0923 10:33:06.132809 882 shared_informer.go:356] "Caches are synced" controller="service config" machine # [ 34.392215] k3s[882]: I0923 10:33:06.132840 882 shared_informer.go:356] "Caches are synced" controller="endpoint slice config" machine # [ 34.406146] dhcpcd[692]: flannel.1: IAID 21:a6:74:2e machine # [ 34.406822] dhcpcd[692]: flannel.1: adding address fe80::f46b:21ff:fea6:742e machine # [ 34.424346] k3s[882]: I0923 10:33:06.166198 882 iptables.go:111] Setting up masking rules machine # [ 34.439266] k3s[882]: I0923 10:33:06.181055 882 iptables.go:212] Changing default FORWARD chain policy to ACCEPT machine # [ 34.452065] k3s[882]: time="2026-09-23T10:33:06Z" level=info msg="Wrote flannel subnet file to /run/flannel/subnet.env" machine # [ 34.452773] k3s[882]: time="2026-09-23T10:33:06Z" level=info msg="Running flannel backend" machine # [ 34.453856] k3s[882]: I0923 10:33:06.193875 882 vxlan_network.go:68] watching for new subnet leases machine # [ 34.454749] k3s[882]: I0923 10:33:06.193903 882 vxlan_network.go:115] starting vxlan device watcher machine # [ 34.671403] cni0: port 1(veth1a87563e) entered blocking state machine # [ 34.672620] cni0: port 1(veth1a87563e) entered disabled state machine # [ 34.673509] veth1a87563e: entered allmulticast mode machine # [ 34.674397] veth1a87563e: entered promiscuous mode machine # [ 34.523629] (udev-worker)[1434]: Network interface NamePolicy= disabled on kernel command line. machine # [ 34.525080] (udev-worker)[1328]: Network inte[ 34.678576] cni0: port 2(veth5cff1c63) entered blocking state machine # rface NamePolicy= disabled on kernel command lin[ 34.679581] cni0: port 2(veth5cff1c63) entered disabled state machine # e. machine # [ 34.526419] k3s[882]: I0923 10:33:06.268278 882 iptables.go:358] boot[ 34.681121] veth5cff1c63: entered allmulticast mode machine # strap done machine # [ 34.681853] veth5cff1c63: entered promiscuous mode machine # [ 34.695591] cni0: port 1(veth1a87563e) entered blocking state machine # [ 34.696280] cni0: port 1(veth1a87563e) entered forwarding state machine # [ 34.702287] cni0: port 2(veth5cff1c63) entered blocking state machine # [ 34.703036] cni0: port 2(veth5cff1c63) entered forwarding state machine # [ 34.576075] dhcpcd[692]: veth1a87563e: waiting for carrier machine # [ 34.589795] dhcpcd[692]: veth5cff1c63: IAID 65:e4:98:87 machine # [ 34.590450] dhcpcd[692]: veth5cff1c63: adding address fe80::14fe:65ff:fee4:9887 machine # [ 34.591097] dhcpcd[692]: veth1a87563e: carrier acquired machine # [ 34.596529] dhcpcd[692]: veth1a87563e: IAID db:50:4b:62 machine # [ 34.597343] dhcpcd[692]: veth1a87563e: adding address fe80::d067:dbff:fe50:4b62 machine # [ 34.605130] k3s[882]: I0923 10:33:06.346994 882 iptables.go:358] bootstrap done machine # [ 34.649154] dhcpcd[692]: flannel.1: soliciting a DHCP lease machine # [ 34.759457] systemd[1]: Started libcontainer container df5e7cc30e0b8fa0ed43e4e5807446f7ac0c5110e94029d443fdf533640b9173. machine # [ 34.762636] systemd[1]: Started libcontainer container e0a36357d8cc2e3f05718b86b4fcb50b117befb90468b0fe31d1cd2c9049351b. machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 35.350515] dhcpcd[692]: veth1a87563e: soliciting a DHCP lease machine # [ 35.467224] k3s[882]: time="2026-09-23T10:33:07Z" level=info msg="Starting network policy controller version v2.6.3-k3s1, built on 1970-01-01T01:01:01Z, go1.26.7" machine # [ 35.467699] k3s[882]: I0923 10:33:07.208724 882 network_policy_controller.go:164] Starting network policy controller machine # [ 35.733416] k3s[882]: I0923 10:33:07.475198 882 network_policy_controller.go:179] Starting network policy controller full sync goroutine machine # [ 35.792493] systemd[1]: Started libcontainer container a7f28f6d6712220695c103f2e45c2c53049784b394b922f04cf14d30c3a91dbb. machine # [ 35.993202] systemd[1]: Started libcontainer container c4f513a98006e777540adb8d4dc215f8043f8abe6dc5c2d2fb50dfd3b26bd0fd. machine # [ 36.232382] k3s[882]: I0923 10:33:07.974161 882 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/coredns-c5fdd76cf-cnfqz" podStartSLOduration=7.97414238 podStartE2EDuration="7.97414238s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-23 10:33:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-23 10:33:07.973901009 +0000 UTC m=+19.418953805" watchObservedRunningTime="2026-09-23 10:33:07.97414238 +0000 UTC m=+19.419195176" machine # [ 36.289956] k3s[882]: I0923 10:33:08.030949 882 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/helm-install-nix-grpc-farm-c85c8" podStartSLOduration=8.030907695 podStartE2EDuration="8.030907695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-23 10:33:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-23 10:33:08.026353765 +0000 UTC m=+19.473937329" watchObservedRunningTime="2026-09-23 10:33:08.030907695 +0000 UTC m=+19.475960771" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 36.374619] dhcpcd[692]: veth5cff1c63: soliciting a DHCP lease machine # [ 36.778827] dhcpcd[692]: veth1a87563e: soliciting an IPv6 router machine # [ 36.891070] dhcpcd[692]: flannel.1: soliciting an IPv6 router machine # [ 37.170527] dhcpcd[692]: veth5cff1c63: soliciting an IPv6 router machine # [ 37.304971] k3s[882]: time="2026-09-23T10:33:09Z" level=info msg="Imported docker.io/library/nix-grpc-farm:0.1.0-beta.3" machine # [ 37.308836] k3s[882]: time="2026-09-23T10:33:09Z" level=info msg="Tagged docker.io/library/nix-grpc-farm@sha256:2ca26524577447325f3fa58e9a6d8958797db65458e976bf7e7a53e6ee13da8a" machine # [ 37.346076] k3s[882]: I0923 10:33:09.086493 882 alloc.go:329] "allocated clusterIPs" service="farm/nix-grpc-farm" clusterIPs={"IPv4":"10.43.171.149"} machine # [ 37.424681] systemd[1]: cri-containerd-c4f513a98006e777540adb8d4dc215f8043f8abe6dc5c2d2fb50dfd3b26bd0fd.scope: Deactivated successfully. machine # [ 37.425588] systemd[1]: cri-containerd-c4f513a98006e777540adb8d4dc215f8043f8abe6dc5c2d2fb50dfd3b26bd0fd.scope: Consumed 526ms CPU time over 1.432s wall clock time, 33M memory peak, 2.4M incoming IP traffic, 146.3K outgoing IP traffic. machine # [ 37.455854] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-c4f513a98006e777540adb8d4dc215f8043f8abe6dc5c2d2fb50dfd3b26bd0fd-rootfs.mount: Deactivated successfully. machine # [ 37.768911] k3s[882]: time="2026-09-23T10:33:09Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm.tar in 5.142031738s" machine # [ 38.075425] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod9b5362bf_e589_4c7d_81bd_e7c62be7466f.slice. machine # [ 38.082121] k3s[882]: I0923 10:33:09.822266 882 node_lifecycle_controller.go:1234] "Initializing eviction metric for zone" zone="" machine # [ 38.083339] k3s[882]: I0923 10:33:09.822477 882 node_lifecycle_controller.go:886] "Missing timestamp for Node. Assuming now as a timestamp" node="machine" machine # [ 38.084275] k3s[882]: I0923 10:33:09.822620 882 node_lifecycle_controller.go:1080] "Controller detected that zone is now in new state" zone="" newState="Normal" machine # [ 38.157226] systemd[1]: Created slice libcontainer container kubepods-besteffort-pode70619f6_a046_4b63_a6f4_2b193dfb3364.slice. machine # [ 38.173069] k3s[882]: I0923 10:33:09.914390 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9b5362bf-e589-4c7d-81bd-e7c62be7466f-config\") pod \"nix-grpc-farm-lb-6f57bb48cc-wg4d2\" (UID: \"9b5362bf-e589-4c7d-81bd-e7c62be7466f\") " pod="farm/nix-grpc-farm-lb-6f57bb48cc-wg4d2" machine # [ 38.173830] k3s[882]: I0923 10:33:09.914441 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/9b5362bf-e589-4c7d-81bd-e7c62be7466f-tls-lb\") pod \"nix-grpc-farm-lb-6f57bb48cc-wg4d2\" (UID: \"9b5362bf-e589-4c7d-81bd-e7c62be7466f\") " pod="farm/nix-grpc-farm-lb-6f57bb48cc-wg4d2" machine # [ 38.174467] k3s[882]: I0923 10:33:09.914471 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b5362bf-e589-4c7d-81bd-e7c62be7466f-tmp\") pod \"nix-grpc-farm-lb-6f57bb48cc-wg4d2\" (UID: \"9b5362bf-e589-4c7d-81bd-e7c62be7466f\") " pod="farm/nix-grpc-farm-lb-6f57bb48cc-wg4d2" machine # [ 38.174963] k3s[882]: I0923 10:33:09.914497 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/9b5362bf-e589-4c7d-81bd-e7c62be7466f-tls-ca\") pod \"nix-grpc-farm-lb-6f57bb48cc-wg4d2\" (UID: \"9b5362bf-e589-4c7d-81bd-e7c62be7466f\") " pod="farm/nix-grpc-farm-lb-6f57bb48cc-wg4d2" machine # [ 38.189085] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod24785c20_8c39_4c6f_a165_9bbe9715eeff.slice. machine # [ 38.215730] systemd[1]: Created slice libcontainer container kubepods-besteffort-podef6a1732_f047_4a42_8347_63f652ba0d30.slice. machine # [ 38.273855] k3s[882]: I0923 10:33:10.015657 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/24785c20-8c39-4c6f-a165-9bbe9715eeff-oidc\") pod \"nix-grpc-farm-scheduler-887c9b678-9plcn\" (UID: \"24785c20-8c39-4c6f-a165-9bbe9715eeff\") " pod="farm/nix-grpc-farm-scheduler-887c9b678-9plcn" machine # [ 38.274942] k3s[882]: I0923 10:33:10.015705 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcnv2\" (UniqueName: \"kubernetes.io/projected/24785c20-8c39-4c6f-a165-9bbe9715eeff-kube-api-access-mcnv2\") pod \"nix-grpc-farm-scheduler-887c9b678-9plcn\" (UID: \"24785c20-8c39-4c6f-a165-9bbe9715eeff\") " pod="farm/nix-grpc-farm-scheduler-887c9b678-9plcn" machine # [ 38.276167] k3s[882]: I0923 10:33:10.015739 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/e70619f6-a046-4b63-a6f4-2b193dfb3364-build\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lh6xc\" (UID: \"e70619f6-a046-4b63-a6f4-2b193dfb3364\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lh6xc" machine # [ 38.276762] k3s[882]: I0923 10:33:10.015766 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/e70619f6-a046-4b63-a6f4-2b193dfb3364-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lh6xc\" (UID: \"e70619f6-a046-4b63-a6f4-2b193dfb3364\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lh6xc" machine # [ 38.277551] k3s[882]: I0923 10:33:10.015790 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/ef6a1732-f047-4a42-8347-63f652ba0d30-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-p4svn\" (UID: \"ef6a1732-f047-4a42-8347-63f652ba0d30\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-p4svn" machine # [ 38.279260] k3s[882]: I0923 10:33:10.015817 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb4bk\" (UniqueName: \"kubernetes.io/projected/ef6a1732-f047-4a42-8347-63f652ba0d30-kube-api-access-bb4bk\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-p4svn\" (UID: \"ef6a1732-f047-4a42-8347-63f652ba0d30\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-p4svn" machine # [ 38.280756] k3s[882]: I0923 10:33:10.015843 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/e70619f6-a046-4b63-a6f4-2b193dfb3364-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lh6xc\" (UID: \"e70619f6-a046-4b63-a6f4-2b193dfb3364\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lh6xc" machine # [ 38.281511] k3s[882]: I0923 10:33:10.016558 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/e70619f6-a046-4b63-a6f4-2b193dfb3364-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lh6xc\" (UID: \"e70619f6-a046-4b63-a6f4-2b193dfb3364\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lh6xc" machine # [ 38.282098] k3s[882]: I0923 10:33:10.016623 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e70619f6-a046-4b63-a6f4-2b193dfb3364-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lh6xc\" (UID: \"e70619f6-a046-4b63-a6f4-2b193dfb3364\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lh6xc" machine # [ 38.282526] k3s[882]: I0923 10:33:10.016798 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/ef6a1732-f047-4a42-8347-63f652ba0d30-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-p4svn\" (UID: \"ef6a1732-f047-4a42-8347-63f652ba0d30\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-p4svn" machine # [ 38.283138] k3s[882]: I0923 10:33:10.017621 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/24785c20-8c39-4c6f-a165-9bbe9715eeff-niks3-token\") pod \"nix-grpc-farm-scheduler-887c9b678-9plcn\" (UID: \"24785c20-8c39-4c6f-a165-9bbe9715eeff\") " pod="farm/nix-grpc-farm-scheduler-887c9b678-9plcn" machine # [ 38.283923] k3s[882]: I0923 10:33:10.017682 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/24785c20-8c39-4c6f-a165-9bbe9715eeff-ca\") pod \"nix-grpc-farm-scheduler-887c9b678-9plcn\" (UID: \"24785c20-8c39-4c6f-a165-9bbe9715eeff\") " pod="farm/nix-grpc-farm-scheduler-887c9b678-9plcn" machine # [ 38.284653] k3s[882]: I0923 10:33:10.017820 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/e70619f6-a046-4b63-a6f4-2b193dfb3364-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lh6xc\" (UID: \"e70619f6-a046-4b63-a6f4-2b193dfb3364\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lh6xc" machine # [ 38.287903] k3s[882]: I0923 10:33:10.017844 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/e70619f6-a046-4b63-a6f4-2b193dfb3364-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lh6xc\" (UID: \"e70619f6-a046-4b63-a6f4-2b193dfb3364\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lh6xc" machine # [ 38.292434] k3s[882]: I0923 10:33:10.017881 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/ef6a1732-f047-4a42-8347-63f652ba0d30-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-p4svn\" (UID: \"ef6a1732-f047-4a42-8347-63f652ba0d30\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-p4svn" machine # [ 38.296602] k3s[882]: I0923 10:33:10.017906 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/24785c20-8c39-4c6f-a165-9bbe9715eeff-tls\") pod \"nix-grpc-farm-scheduler-887c9b678-9plcn\" (UID: \"24785c20-8c39-4c6f-a165-9bbe9715eeff\") " pod="farm/nix-grpc-farm-scheduler-887c9b678-9plcn" machine # [ 38.336418] k3s[882]: I0923 10:33:10.017958 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ef6a1732-f047-4a42-8347-63f652ba0d30-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-p4svn\" (UID: \"ef6a1732-f047-4a42-8347-63f652ba0d30\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-p4svn" machine # [ 38.337076] k3s[882]: I0923 10:33:10.018458 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsf5s\" (UniqueName: \"kubernetes.io/projected/e70619f6-a046-4b63-a6f4-2b193dfb3364-kube-api-access-vsf5s\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lh6xc\" (UID: \"e70619f6-a046-4b63-a6f4-2b193dfb3364\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lh6xc" machine # [ 38.337562] k3s[882]: I0923 10:33:10.018493 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/ef6a1732-f047-4a42-8347-63f652ba0d30-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-p4svn\" (UID: \"ef6a1732-f047-4a42-8347-63f652ba0d30\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-p4svn" machine # [ 38.337980] k3s[882]: I0923 10:33:10.019425 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/ef6a1732-f047-4a42-8347-63f652ba0d30-build\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-p4svn\" (UID: \"ef6a1732-f047-4a42-8347-63f652ba0d30\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-p4svn" machine # [ 38.338601] k3s[882]: I0923 10:33:10.019471 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/ef6a1732-f047-4a42-8347-63f652ba0d30-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-p4svn\" (UID: \"ef6a1732-f047-4a42-8347-63f652ba0d30\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-p4svn" machine # [ 38.587981] cni0: port 3(vetha348a11e) entered blocking state machine # [ 38.588797] cni0: port 3(vetha348a11e) entered disabled state machine # [ 38.589574] vetha348a11e: entered allmulticast mode machine # [ 38.590366] vetha348a11e: entered promiscuous mode machine # [ 38.438948] (udev-worker)[1940]: Network interface NamePolicy= disabled on kernel command line. machine # [ 38.599312] cni0: port 3(vetha348a11e) entered blocking state machine # [ 38.599982] cni0: port 3(vetha348a11e) entered forwarding state machine # [ 38.472171] dhcpcd[692]: vetha348a11e: IAID 62:a4:a3:c4 machine # [ 38.473116] dhcpcd[692]: vetha348a11e: adding address fe80::98de:62ff:fea4:a3c4 machine # [ 38.656148] cni0: port 4(veth17d96a84) entered blocking state machine # [ 38.656979] cni0: port 4(veth17d96a84) entered disabled state machine # [ 38.657733] veth17d96a84: entered allmulticast mode machine # [ 38.658452] veth17d96a84: entered promiscuous mode machine # [ 38.506972] (udev-worker)[2072]: Network interface NamePolicy= disabled on kernel command line. machine # [ 38.666073] cni0: port 4(veth17d96a84) entered blocking state machine # [ 38.666814] cni0: port 4(veth17d96a84) entered forwarding state machine # [ 38.536589] dhcpcd[692]: veth17d96a84: IAID bf:57:f5:9c machine # [ 38.537205] dhcpcd[692]: veth17d96a84: adding address fe80::cc7b:bfff:fe57:f59c machine # [ 38.697710] cni0: port 5(veth326904ae) entered blocking state machine # [ 38.698547] cni0: port 5(veth326904ae) entered disabled state machine # [ 38.699407] veth326904ae: entered allmulticast mode machine # [ 38.700266] veth326904ae: entered promiscuous mode machine # [ 38.710996] cni0: port 5(veth326904ae) entered blocking state machine # [ 38.711680] cni0: port 5(veth326904ae) entered forwarding state machine # [ 38.584818] systemd[1]: Started libcontainer container e9a76f5f4fcd24b4e6198fdaf5b826f756be4064f4f448d394f7a8945594d2ad. machine # [ 38.593863] dhcpcd[692]: veth326904ae: waiting for carrier machine # [ 38.594879] dhcpcd[692]: veth326904ae: carrier acquired machine # [ 38.752590] cni0: port 6(veth517f4254) entered blocking state machine # [ 38.753406] cni0: port 6(veth517f4254) entered disabled state machine # [ 38.754122] veth517f4254: entered allmulticast mode machine # [ 38.601099] dhcpcd[692]: veth326904ae: IAID 57:29:bc:c9 machine # [ 38.602779] dhcpcd[692]: veth326904ae: adding address fe80::d4e5:57ff:fe29:bcc9 machine # [ 38.757260] veth517f4254: entered promiscuous mode machine # [ 38.769156] cni0: port 6(veth517f4254) entered blocking state machine # [ 38.769896] cni0: port 6(veth517f4254) entered forwarding state machine # [ 38.636712] dhcpcd[692]: veth517f4254: IAID ac:d9:3a:87 machine # [ 38.637545] dhcpcd[692]: veth517f4254: adding address fe80::5cce:acff:fed9:3a87 machine # [ 38.638202] dhcpcd[692]: veth17d96a84: soliciting a DHCP lease machine # [ 38.655587] systemd[1]: Started libcontainer container 47048f2ccac3a814e35599f2fad1f5538a2dd86c3b9345203bb30d61c2fea87c. machine # [ 38.690449] systemd[1]: Started libcontainer container e564fbecc44140d53f011ab0fb52c2a4214128522b348654299bcb255a380957. machine # [ 38.736758] systemd[1]: Started libcontainer container 44a6ef87180e57582c0db2c6fa080c4875709e8ea8e6fdc03d670966839108c7. machine # [ 38.903560] dhcpcd[692]: veth517f4254: soliciting a DHCP lease machine # [ 39.252155] dhcpcd[692]: veth326904ae: soliciting a DHCP lease machine # [ 39.343204] systemd[1]: cri-containerd-df5e7cc30e0b8fa0ed43e4e5807446f7ac0c5110e94029d443fdf533640b9173.scope: Deactivated successfully. machine # [ 39.466513] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-df5e7cc30e0b8fa0ed43e4e5807446f7ac0c5110e94029d443fdf533640b9173-rootfs.mount: Deactivated successfully. machine # [ 39.649941] dhcpcd[692]: flannel.1: probing for an IPv4LL address machine # [ 39.739109] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-df5e7cc30e0b8fa0ed43e4e5807446f7ac0c5110e94029d443fdf533640b9173-shm.mount: Deactivated successfully. machine # [ 39.934957] cni0: port 1(veth1a87563e) entered disabled state machine # [ 39.782145] dhcpcd[692]: veth1a87563e: carrier lost machine # [ 39.937143] veth1a87563e (unregistering): left allmulticast mode machine # [ 39.937929] veth1a87563e (unregistering): left promiscuous mode machine # [ 39.938827] cni0: port 1(veth1a87563e) entered disabled state machine # [ 39.794821] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount539994526.mount: Deactivated successfully. machine # [ 39.801763] systemd[1]: run-netns-cni\x2d9a6e95a5\x2d0442\x2dc4d8\x2d76ac\x2df150c61a4f11.mount: Deactivated successfully. machine # [ 39.818630] dhcpcd[692]: veth1a87563e: deleting address fe80::d067:dbff:fe50:4b62 machine # [ 39.858436] dhcpcd[692]: veth1a87563e: removing interface machine # [ 39.860281] systemd[1]: Started libcontainer container 35ddeb49e45c97927e7c4f2e5621e4d05d71176bd63b0778698d9a618404be61. machine # [ 39.995724] k3s[882]: I0923 10:33:11.737198 882 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/393a0c68-c501-4ad2-96fe-e2d96f5554c3-klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/393a0c68-c501-4ad2-96fe-e2d96f5554c3-klipper-helm\") pod \"393a0c68-c501-4ad2-96fe-e2d96f5554c3\" (UID: \"393a0c68-c501-4ad2-96fe-e2d96f5554c3\") " machine # [ 39.996601] k3s[882]: I0923 10:33:11.737274 882 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/393a0c68-c501-4ad2-96fe-e2d96f5554c3-klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/393a0c68-c501-4ad2-96fe-e2d96f5554c3-klipper-cache\") pod \"393a0c68-c501-4ad2-96fe-e2d96f5554c3\" (UID: \"393a0c68-c501-4ad2-96fe-e2d96f5554c3\") " machine # [ 39.996939] k3s[882]: I0923 10:33:11.737354 882 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/393a0c68-c501-4ad2-96fe-e2d96f5554c3-tmp\" (UniqueName: \"kubernetes.io/empty-dir/393a0c68-c501-4ad2-96fe-e2d96f5554c3-tmp\") pod \"393a0c68-c501-4ad2-96fe-e2d96f5554c3\" (UID: \"393a0c68-c501-4ad2-96fe-e2d96f5554c3\") " machine # [ 39.997597] k3s[882]: I0923 10:33:11.737386 882 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/393a0c68-c501-4ad2-96fe-e2d96f5554c3-kube-api-access-hpszm\" (UniqueName: \"kubernetes.io/projected/393a0c68-c501-4ad2-96fe-e2d96f5554c3-kube-api-access-hpszm\") pod \"393a0c68-c501-4ad2-96fe-e2d96f5554c3\" (UID: \"393a0c68-c501-4ad2-96fe-e2d96f5554c3\") " machine # [ 39.998137] k3s[882]: I0923 10:33:11.737419 882 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/393a0c68-c501-4ad2-96fe-e2d96f5554c3-content\" (UniqueName: \"kubernetes.io/configmap/393a0c68-c501-4ad2-96fe-e2d96f5554c3-content\") pod \"393a0c68-c501-4ad2-96fe-e2d96f5554c3\" (UID: \"393a0c68-c501-4ad2-96fe-e2d96f5554c3\") " machine # [ 39.998612] k3s[882]: I0923 10:33:11.737454 882 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/393a0c68-c501-4ad2-96fe-e2d96f5554c3-values\" (UniqueName: \"kubernetes.io/projected/393a0c68-c501-4ad2-96fe-e2d96f5554c3-values\") pod \"393a0c68-c501-4ad2-96fe-e2d96f5554c3\" (UID: \"393a0c68-c501-4ad2-96fe-e2d96f5554c3\") " machine # [ 39.999287] k3s[882]: I0923 10:33:11.737506 882 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/393a0c68-c501-4ad2-96fe-e2d96f5554c3-klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/393a0c68-c501-4ad2-96fe-e2d96f5554c3-klipper-config\") pod \"393a0c68-c501-4ad2-96fe-e2d96f5554c3\" (UID: \"393a0c68-c501-4ad2-96fe-e2d96f5554c3\") " machine # [ 40.000132] k3s[882]: I0923 10:33:11.739398 882 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/393a0c68-c501-4ad2-96fe-e2d96f5554c3-content" pod "393a0c68-c501-4ad2-96fe-e2d96f5554c3" (UID: "393a0c68-c501-4ad2-96fe-e2d96f5554c3"). InnerVolumeSpecName "content". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 40.028780] k3s[882]: I0923 10:33:11.770626 882 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/393a0c68-c501-4ad2-96fe-e2d96f5554c3-klipper-helm" pod "393a0c68-c501-4ad2-96fe-e2d96f5554c3" (UID: "393a0c68-c501-4ad2-96fe-e2d96f5554c3"). InnerVolumeSpecName "klipper-helm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 40.029697] k3s[882]: I0923 10:33:11.770719 882 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/393a0c68-c501-4ad2-96fe-e2d96f5554c3-kube-api-access-hpszm" pod "393a0c68-c501-4ad2-96fe-e2d96f5554c3" (UID: "393a0c68-c501-4ad2-96fe-e2d96f5554c3"). InnerVolumeSpecName "kube-api-access-hpszm". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 40.030212] k3s[882]: I0923 10:33:11.771444 882 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/393a0c68-c501-4ad2-96fe-e2d96f5554c3-values" pod "393a0c68-c501-4ad2-96fe-e2d96f5554c3" (UID: "393a0c68-c501-4ad2-96fe-e2d96f5554c3"). InnerVolumeSpecName "values". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 40.030358] k3s[882]: I0923 10:33:11.771574 882 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/393a0c68-c501-4ad2-96fe-e2d96f5554c3-klipper-config" pod "393a0c68-c501-4ad2-96fe-e2d96f5554c3" (UID: "393a0c68-c501-4ad2-96fe-e2d96f5554c3"). InnerVolumeSpecName "klipper-config". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 40.031029] k3s[882]: I0923 10:33:11.771643 882 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/393a0c68-c501-4ad2-96fe-e2d96f5554c3-tmp" pod "393a0c68-c501-4ad2-96fe-e2d96f5554c3" (UID: "393a0c68-c501-4ad2-96fe-e2d96f5554c3"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 40.049485] k3s[882]: I0923 10:33:11.791314 882 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/393a0c68-c501-4ad2-96fe-e2d96f5554c3-klipper-cache" pod "393a0c68-c501-4ad2-96fe-e2d96f5554c3" (UID: "393a0c68-c501-4ad2-96fe-e2d96f5554c3"). InnerVolumeSpecName "klipper-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 40.096284] k3s[882]: I0923 10:33:11.838100 882 reconciler_common.go:299] "Volume detached for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/393a0c68-c501-4ad2-96fe-e2d96f5554c3-klipper-config\") on node \"machine\" DevicePath \"\"" machine # [ 40.097084] k3s[882]: I0923 10:33:11.838139 882 reconciler_common.go:299] "Volume detached for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/393a0c68-c501-4ad2-96fe-e2d96f5554c3-klipper-helm\") on node \"machine\" DevicePath \"\"" machine # [ 40.097229] k3s[882]: I0923 10:33:11.838152 882 reconciler_common.go:299] "Volume detached for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/393a0c68-c501-4ad2-96fe-e2d96f5554c3-klipper-cache\") on node \"machine\" DevicePath \"\"" machine # [ 40.097733] k3s[882]: I0923 10:33:11.838166 882 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/393a0c68-c501-4ad2-96fe-e2d96f5554c3-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 40.098414] k3s[882]: I0923 10:33:11.838182 882 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpszm\" (UniqueName: \"kubernetes.io/projected/393a0c68-c501-4ad2-96fe-e2d96f5554c3-kube-api-access-hpszm\") on node \"machine\" DevicePath \"\"" machine # [ 40.098953] k3s[882]: I0923 10:33:11.838197 882 reconciler_common.go:299] "Volume detached for volume \"content\" (UniqueName: \"kubernetes.io/configmap/393a0c68-c501-4ad2-96fe-e2d96f5554c3-content\") on node \"machine\" DevicePath \"\"" machine # [ 40.099559] k3s[882]: I0923 10:33:11.838209 882 reconciler_common.go:299] "Volume detached for volume \"values\" (UniqueName: \"kubernetes.io/projected/393a0c68-c501-4ad2-96fe-e2d96f5554c3-values\") on node \"machine\" DevicePath \"\"" machine # [ 40.259526] dhcpcd[692]: vetha348a11e: soliciting a DHCP lease machine # [ 40.321365] k3s[882]: I0923 10:33:12.063198 882 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="df5e7cc30e0b8fa0ed43e4e5807446f7ac0c5110e94029d443fdf533640b9173" machine # [ 40.333134] systemd[1]: Removed slice libcontainer container kubepods-burstable-pod393a0c68_c501_4ad2_96fe_e2d96f5554c3.slice. machine # [ 40.334314] systemd[1]: kubepods-burstable-pod393a0c68_c501_4ad2_96fe_e2d96f5554c3.slice: Consumed 560ms CPU time over 6.179s wall clock time, 33.3M memory peak, 2.4M incoming IP traffic, 146.3K outgoing IP traffic. machine # [ 40.416344] dhcpcd[692]: veth17d96a84: soliciting an IPv6 router machine # [ 40.457823] systemd[1]: var-lib-kubelet-pods-393a0c68\x2dc501\x2d4ad2\x2d96fe\x2de2d96f5554c3-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dhpszm.mount: Deactivated successfully. machine # [ 40.458552] systemd[1]: var-lib-kubelet-pods-393a0c68\x2dc501\x2d4ad2\x2d96fe\x2de2d96f5554c3-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dhelm.mount: Deactivated successfully. machine # [ 40.459067] systemd[1]: var-lib-kubelet-pods-393a0c68\x2dc501\x2d4ad2\x2d96fe\x2de2d96f5554c3-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dcache.mount: Deactivated successfully. machine # [ 40.459503] systemd[1]: var-lib-kubelet-pods-393a0c68\x2dc501\x2d4ad2\x2d96fe\x2de2d96f5554c3-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dconfig.mount: Deactivated successfully. machine # [ 40.459987] systemd[1]: var-lib-kubelet-pods-393a0c68\x2dc501\x2d4ad2\x2d96fe\x2de2d96f5554c3-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 40.460745] systemd[1]: var-lib-kubelet-pods-393a0c68\x2dc501\x2d4ad2\x2d96fe\x2de2d96f5554c3-volumes-kubernetes.io\x7eprojected-values.mount: Deactivated successfully. machine # [ 40.471503] dhcpcd[692]: veth517f4254: soliciting an IPv6 router machine # [ 40.572857] dhcpcd[692]: vetha348a11e: soliciting an IPv6 router machine # [ 40.714516] dhcpcd[692]: veth326904ae: soliciting an IPv6 router machine # [ 40.865656] k3s[882]: I0923 10:33:12.607389 882 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-6f57bb48cc-wg4d2" podStartSLOduration=3.6073661550000002 podStartE2EDuration="3.607366155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-23 10:33:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-23 10:33:12.084605302 +0000 UTC m=+23.529658098" watchObservedRunningTime="2026-09-23 10:33:12.607366155 +0000 UTC m=+24.052418951" machine # [ 41.374797] dhcpcd[692]: veth5cff1c63: probing for an IPv4LL address machine # [ 43.638158] dhcpcd[692]: veth17d96a84: probing for an IPv4LL address machine # [ 43.905143] dhcpcd[692]: veth517f4254: probing for an IPv4LL address machine # [ 44.253103] dhcpcd[692]: veth326904ae: probing for an IPv4LL address machine # [ 44.575073] dhcpcd[692]: flannel.1: using IPv4LL address 169.254.238.218 machine # [ 44.577321] dhcpcd[692]: flannel.1: adding route to 169.254.0.0/16 machine # [ 44.661435] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped2065002467.mount: Deactivated successfully. machine # [ 44.677175] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped1537980644.mount: Deactivated successfully. machine # [ 44.761320] systemd[1]: Started libcontainer container 4201c703baad517f8334dce00e82146a0f5a80f1e724fa38fa7774d062003569. machine # [ 44.765529] systemd[1]: Started libcontainer container 48e1ca3e7f48d9a41429c3167f72bde26cf5fb6e6f5788d7e72af887f2eff43a. machine # [ 44.940377] systemd[1]: Started libcontainer container c76510c539d4759d5d4bdbf182390fab330ff13c0994ea1c86745c7ad5808245. machine # [ 45.014672] niks3-server[1184]: 2026/09/23 10:33:16 INFO lead: acquired remote=10.42.0.6:44356 machine # [ 45.260586] dhcpcd[692]: vetha348a11e: probing for an IPv4LL address machine # [ 46.405758] dhcpcd[692]: veth5cff1c63: using IPv4LL address 169.254.209.48 machine # [ 46.406884] dhcpcd[692]: veth5cff1c63: adding route to 169.254.0.0/16 machine # [ 46.662313] systemd[1]: cri-containerd-48e1ca3e7f48d9a41429c3167f72bde26cf5fb6e6f5788d7e72af887f2eff43a.scope: Deactivated successfully. machine # [ 46.664450] systemd[1]: cri-containerd-48e1ca3e7f48d9a41429c3167f72bde26cf5fb6e6f5788d7e72af887f2eff43a.scope: Consumed 746ms CPU time over 1.896s wall clock time, 431.4M memory peak, 118M read from disk, 220.2M written to disk. machine # [ 46.666222] systemd[1]: cri-containerd-c76510c539d4759d5d4bdbf182390fab330ff13c0994ea1c86745c7ad5808245.scope: Deactivated successfully. machine # [ 46.667171] systemd[1]: cri-containerd-c76510c539d4759d5d4bdbf182390fab330ff13c0994ea1c86745c7ad5808245.scope: Consumed 721ms CPU time over 1.724s wall clock time, 361.2M memory peak, 48.5M read from disk, 193.6M written to disk. machine # [ 46.710084] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-48e1ca3e7f48d9a41429c3167f72bde26cf5fb6e6f5788d7e72af887f2eff43a-rootfs.mount: Deactivated successfully. machine # [ 46.724988] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-c76510c539d4759d5d4bdbf182390fab330ff13c0994ea1c86745c7ad5808245-rootfs.mount: Deactivated successfully. machine # [ 47.399703] k3s[882]: I0923 10:33:19.140423 882 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-scheduler-887c9b678-9plcn" podStartSLOduration=10.140386413 podStartE2EDuration="10.140386413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-23 10:33:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-23 10:33:17.126861789 +0000 UTC m=+28.571914585" watchObservedRunningTime="2026-09-23 10:33:19.140386413 +0000 UTC m=+30.585442282" machine # error: timed out waiting for the condition machine # [ 47.608506] systemd[1]: Started libcontainer container 3a87fefe37cc5a98159cafef52a53ed7c4ec90edfcf8c47dabdbe34471469a16. machine # [ 47.624295] systemd[1]: Started libcontainer container 5fa5c1c3aca1ffdbc05890039ed50d9ee6443bdb7bb0461be0416a4d5cf1c5f4. machine # [ 47.716335] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped588335561.mount: Deactivated successfully. machine # [ 47.760282] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped3094130250.mount: Deactivated successfully. machine # [ 47.761708] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount3431883008.mount: Deactivated successfully. machine # [ 47.763301] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped1690905067.mount: Deactivated successfully. machine # [ 47.836419] systemd[1]: Started libcontainer container bf03730b0a64fe62d9c5e7631d8da76ae8fb393f0fcc02e080aa5e5e2813e63d. machine # [ 47.877440] systemd[1]: Started libcontainer container 1f6a0bfbb17a4d2d69435682d58467b5846fa221778e5f52dd0397a94bafacba. machine # [ 48.115347] systemd[1]: Started libcontainer container 335ae24303084ada28e3581f07f11a16a7212365b62bd86ac26698421bf0875a. machine # [ 48.209319] systemd[1]: Started libcontainer container 057c8cc9ede135aacad70fa87f7aca8cd76736fc050a219e79bde3e011e85ad6. machine # [ 48.415788] k3s[882]: I0923 10:33:20.156730 882 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-p4svn" podStartSLOduration=9.507608784 podStartE2EDuration="11.156690161s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.649081377s" isStatefulPod=false podCreationTimestamp="2026-09-23 10:33:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-23 10:33:20.155056433 +0000 UTC m=+31.600113979" watchObservedRunningTime="2026-09-23 10:33:20.156690161 +0000 UTC m=+31.601748265" machine # [ 48.480042] k3s[882]: I0923 10:33:20.221746 882 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lh6xc" podStartSLOduration=9.359012523 podStartE2EDuration="11.221710715s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.862698192s" isStatefulPod=false podCreationTimestamp="2026-09-23 10:33:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-23 10:33:20.189603282 +0000 UTC m=+31.634659151" watchObservedRunningTime="2026-09-23 10:33:20.221710715 +0000 UTC m=+31.666766584" machine # [ 48.708806] dhcpcd[692]: veth17d96a84: using IPv4LL address 169.254.137.142 machine # [ 48.709528] dhcpcd[692]: veth17d96a84: adding route to 169.254.0.0/16 machine # [ 48.716060] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount31195912.mount: Deactivated successfully. machine # [ 48.761721] dhcpcd[692]: veth517f4254: using IPv4LL address 169.254.8.79 machine # [ 48.762779] dhcpcd[692]: veth517f4254: adding route to 169.254.0.0/16 machine # [ 48.893395] dhcpcd[692]: flannel.1: no IPv6 Routers available machine # [ 49.115904] dhcpcd[692]: veth326904ae: using IPv4LL address 169.254.230.122 machine # [ 49.118486] dhcpcd[692]: veth326904ae: adding route to 169.254.0.0/16 machine # [ 49.173060] dhcpcd[692]: veth5cff1c63: no IPv6 Routers available machine # [ 50.347244] dhcpcd[692]: vetha348a11e: using IPv4LL address 169.254.166.83 machine # [ 50.349584] dhcpcd[692]: vetha348a11e: adding route to 169.254.0.0/16 machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 24.66 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s machine # [ 51.750728] dhcpcd[692]: segfault at 58b3a831e ip 000058b37be92cb3 sp 00007ffdffff10c8 error 4 in dhcpcd[38cb3,58b37be63000+40000] likely on CPU 3 (core 3, socket 0) machine # [ 51.755812] Code: 45 ae 01 e9 0f fe ff ff 0f 1f 80 00 00 00 00 c6 45 af 01 e9 ff fd ff ff e8 fa 05 fd ff 66 2e 0f 1f 84 00 00 00 00 00 48 8b 07 <48> 8b 80 50 03 00 00 48 85 c0 74 31 90 48 8b 00 48 85 c0 74 1e 48 machine # [ 51.616249] systemd-coredump[3387]: Process 692 (dhcpcd) of user 999 terminated abnormally with signal 11/SEGV, processing... machine # [ 51.629873] systemd[1]: Created slice Slice /system/systemd-coredump. machine # [ 51.635424] systemd[1]: Started Process Core Dump (PID 3387/UID 0). machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s, in 0.23 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s machine # [ 51.798212] systemd-coredump[3388]: Process 692 (dhcpcd) of user 999 dumped core. machine # machine # Module udev.so without build-id. machine # Module dhcpcd without build-id. machine # Stack trace of thread 692: machine # #0 0x000058b37be92cb3 ipv6nd_expire (dhcpcd + 0x38cb3) machine # #1 0x000058b37be6c06a eloop_start (dhcpcd + 0x1206a) machine # #2 0x000058b37be64300 main (dhcpcd + 0xa300) machine # #3 0x000076e755094285 __libc_start_call_main (libc.so.6 + 0x2b285) machine # #4 0x000076e755094338 __libc_start_main@@GLIBC_2.34 (libc.so.6 + 0x2b338) machine # #5 0x000058b37be65365 _start (dhcpcd + 0xb365) machine # ELF object binary architecture: AMD x86-64 machine # machine # [ 51.805711] systemd[1]: systemd-coredump@0-1-3387_3388-0.service: Deactivated successfully. machine # [ 51.842416] systemd[1]: dhcpcd.service: Main process exited, code=dumped, status=11/SEGV machine # [ 51.843271] systemd[1]: dhcpcd.service: Failed with result 'core-dump'. machine # [ 51.844387] systemd[1]: dhcpcd.service: Consumed 514ms CPU time over 43.805s wall clock time, 6.5M memory peak, 8K written to disk, 96B incoming IP traffic, 1.2K outgoing IP traffic. machine # [ 51.976618] systemd[1]: dhcpcd.service: Scheduled restart job, restart counter is at 1. machine # [ 51.984792] systemd[1]: Starting DHCP Client... machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s, in 0.41 seconds) machine: waiting for unit niks3.service machine: (finished: waiting for unit niks3.service, in 0.04 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine # [ 52.176698] dhcpcd[3419]: dhcpcd-10.3.2 starting machine # [ 52.178681] dhcpcd[3442]: dev: loaded udev machine # [ 52.179443] dhcpcd[3442]: DUID 00:01:00:01:32:46:67:48:52:54:00:12:34:56 machine # [ 52.249637] dhcpcd[3442]: eth0: IAID 00:12:34:56 machine # [ 52.250495] dhcpcd[3442]: flannel.1: IAID 21:a6:74:2e machine # [ 52.251301] dhcpcd[3442]: veth5cff1c63: IAID 65:e4:98:87 machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.15 seconds) machine # [ 52.252212] dhcpcd[3442]: vetha348a11e: IAID 62:a4:a3:c4 machine: waiting for success: test $(curl -sf 10.42.0.4:9901/clusters | grep -c 'health_flags::healthy') -ge 3 machine # [ 52.252978] dhcpcd[3442]: veth17d96a84: IAID bf:57:f5:9c machine # [ 52.253752] dhcpcd[3442]: veth326904ae: IAID 57:29:bc:c9 machine # [ 52.254515] dhcpcd[3442]: veth517f4254: IAID ac:d9:3a:87 machine: (finished: waiting for success: test $(curl -sf 10.42.0.4:9901/clusters | grep -c 'health_flags::healthy') -ge 3, in 0.03 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.12 seconds) machine: waiting for success: curl -sf http://10.42.0.6:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2' machine: (finished: waiting for success: curl -sf http://10.42.0.6:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2', in 0.04 seconds) (finished: subtest: chart deploys and workers become Ready, in 25.69 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}' machine # [ 52.451157] dhcpcd[3442]: flannel.1: soliciting an IPv6 router machine # [ 52.460289] dhcpcd[3442]: eth0: soliciting an IPv6 router machine # [ 52.461078] dhcpcd[3442]: eth0: Router Advertisement from fe80::2 machine # [ 52.461787] dhcpcd[3442]: eth0: adding address fec0::5054:ff:fe12:3456/64 machine # [ 52.493367] dhcpcd[3442]: veth326904ae: soliciting a DHCP lease machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}', in 0.14 seconds) machine: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt machine # [ 52.600496] dhcpcd[3442]: vetha348a11e: soliciting an IPv6 router machine # [ 52.630624] dhcpcd[3442]: veth326904ae: soliciting an IPv6 router machine # [ 52.671801] dhcpcd[3442]: veth517f4254: soliciting an IPv6 router machine: (finished: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt, in 0.15 seconds) subtest: build through the balancer lands in the cache machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1 machine # [ 52.737933] dhcpcd[3442]: veth17d96a84: soliciting a DHCP lease machine # [ 52.879577] dhcpcd[3442]: veth17d96a84: soliciting an IPv6 router machine # [ 53.007874] dhcpcd[3442]: veth5cff1c63: soliciting an IPv6 router machine # [ 53.112165] dhcpcd[3442]: eth0: rebinding lease of 10.0.2.15 machine # [ 53.119578] dhcpcd[3442]: eth0: leased 10.0.2.15 for 86400 seconds machine # [ 53.182986] systemd[1]: Started DHCP Client. machine # [ 53.610939] dhcpcd[3442]: veth517f4254: soliciting a DHCP lease machine # [ 53.625685] dhcpcd[3442]: flannel.1: soliciting a DHCP lease machine # [ 53.914207] dhcpcd[3442]: veth5cff1c63: soliciting a DHCP lease machine # [ 54.171272] dhcpcd[3442]: vetha348a11e: soliciting a DHCP lease machine # [ 63.146111] dhcpcd[3442]: veth517f4254: using IPv4LL address 169.254.8.79 machine # [ 63.148396] dhcpcd[3442]: flannel.1: adding route to 169.254.0.0/16 machine # [ 63.150344] dhcpcd[3442]: veth5cff1c63: adding route to 169.254.0.0/16 machine # [ 63.152332] dhcpcd[3442]: vetha348a11e: adding route to 169.254.0.0/16 machine # [ 63.154315] dhcpcd[3442]: veth17d96a84: adding route to 169.254.0.0/16 machine # [ 63.156334] dhcpcd[3442]: veth326904ae: adding route to 169.254.0.0/16 machine # [ 63.158316] dhcpcd[3442]: veth517f4254: adding route to 169.254.0.0/16 machine # [ 63.244110] dhcpcd[3442]: veth17d96a84: using IPv4LL address 169.254.137.142 machine # [ 63.291146] dhcpcd[3442]: veth326904ae: using IPv4LL address 169.254.230.122 machine # [ 63.840767] dhcpcd[3442]: veth5cff1c63: using IPv4LL address 169.254.209.48 machine # [ 64.396292] dhcpcd[3442]: flannel.1: using IPv4LL address 169.254.238.218 machine # [ 64.440567] dhcpcd[3442]: vetha348a11e: using IPv4LL address 169.254.166.83 machine # [ 64.487495] dhcpcd[3442]: flannel.1: no IPv6 Routers available machine # [ 64.602941] dhcpcd[3442]: vetha348a11e: no IPv6 Routers available machine # [ 64.632221] dhcpcd[3442]: veth326904ae: no IPv6 Routers available machine # [ 64.673656] dhcpcd[3442]: veth517f4254: no IPv6 Routers available machine # [ 64.883172] dhcpcd[3442]: veth17d96a84: no IPv6 Routers available machine # [ 65.010709] dhcpcd[3442]: veth5cff1c63: no IPv6 Routers available machine # [ 114.542836] niks3-server[1184]: 2026/09/23 10:34:26 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 114.578085] niks3-server[1184]: 2026/09/23 10:34:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign machine # [ 114.584260] niks3-server[1184]: 2026/09/23 10:34:26 INFO Signed narinfos id=1 count=1 machine # [ 114.591282] niks3-server[1184]: 2026/09/23 10:34:26 INFO Registered completed upload object_key=nar/0nzzbas7l8d37mridr7mg162smfjvn7lhs6am4crl4ydaxicigj8.nar.zst machine # [ 114.593196] niks3-server[1184]: 2026/09/23 10:34:26 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete machine # [ 114.596704] niks3-server[1184]: 2026/09/23 10:34:26 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.narinfo machine # [ 114.599059] niks3-server[1184]: 2026/09/23 10:34:26 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.ls machine # [ 114.603466] niks3-server[1184]: 2026/09/23 10:34:26 INFO Completed upload id=1 machine # [ 138.905745] niks3-server[1184]: 2026/09/23 10:34:50 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 138.930746] niks3-server[1184]: 2026/09/23 10:34:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign machine # [ 138.934126] niks3-server[1184]: 2026/09/23 10:34:50 INFO Signed narinfos id=2 count=1 machine # [ 138.936330] niks3-server[1184]: 2026/09/23 10:34:50 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.ls machine # [ 138.939456] niks3-server[1184]: 2026/09/23 10:34:50 INFO Registered completed upload object_key=log/yz1sqzb72i8v6h2ass0v76ba8cncqj9r-k3s-a.drv machine # [ 138.941760] niks3-server[1184]: 2026/09/23 10:34:50 INFO Registered completed upload object_key=nar/1p7jh5nyz9n68k5f18ymmdpgr34mpnnch1njw7ki7b2b97qlfbjk.nar.zst machine # [ 138.944949] niks3-server[1184]: 2026/09/23 10:34:50 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete machine # [ 138.948429] niks3-server[1184]: 2026/09/23 10:34:50 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.narinfo machine # [ 138.950525] niks3-server[1184]: 2026/09/23 10:34:50 INFO Completed upload id=2 machine # [ 139.006429] niks3-server[1184]: 2026/09/23 10:34:50 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 139.016130] niks3-server[1184]: 2026/09/23 10:34:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign machine # [ 139.016813] niks3-server[1184]: 2026/09/23 10:34:50 INFO Signed narinfos id=3 count=1 machine # [ 139.020850] niks3-server[1184]: 2026/09/23 10:34:50 INFO Registered completed upload object_key=nar/03a4ywhyr5knmbc93z4gyml5y8fvgb431xvlmfxrwsm8mrb0qgx2.nar.zst machine # [ 139.024454] niks3-server[1184]: 2026/09/23 10:34:50 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.ls machine # [ 139.025726] niks3-server[1184]: 2026/09/23 10:34:50 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete machine # [ 139.028841] niks3-server[1184]: 2026/09/23 10:34:50 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.narinfo machine # [ 139.030533] niks3-server[1184]: 2026/09/23 10:34:50 INFO Completed upload id=3 machine # [ 163.939174] niks3-server[1184]: 2026/09/23 10:35:15 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 163.957450] niks3-server[1184]: 2026/09/23 10:35:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign machine # [ 163.959411] niks3-server[1184]: 2026/09/23 10:35:15 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.ls machine # [ 163.961365] niks3-server[1184]: 2026/09/23 10:35:15 INFO Signed narinfos id=4 count=1 machine # [ 163.962520] niks3-server[1184]: 2026/09/23 10:35:15 INFO Registered completed upload object_key=nar/05qjsj5ff3a6vnxkhb6k5f3m446dcc206p7cd37w4v3mgi95d7kh.nar.zst machine # [ 163.964486] niks3-server[1184]: 2026/09/23 10:35:15 INFO Registered completed upload object_key=log/zfq1xw9bmycqh35l0s44lmv65z4xc7br-k3s-b.drv machine # [ 163.969287] niks3-server[1184]: 2026/09/23 10:35:15 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete machine # [ 163.972782] niks3-server[1184]: 2026/09/23 10:35:15 INFO Completed upload id=4 machine # [ 163.974168] niks3-server[1184]: 2026/09/23 10:35:15 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.narinfo machine # [ 164.039085] niks3-server[1184]: 2026/09/23 10:35:15 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 164.051740] niks3-server[1184]: 2026/09/23 10:35:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign machine # [ 164.053663] niks3-server[1184]: 2026/09/23 10:35:15 INFO Signed narinfos id=5 count=1 machine # [ 164.056785] niks3-server[1184]: 2026/09/23 10:35:15 INFO Registered completed upload object_key=nar/0jyw88klkf3nwxpnj5m5lx3i1dv2idf3hcn6im7883hnldm3gvyq.nar.zst machine # [ 164.059478] niks3-server[1184]: 2026/09/23 10:35:15 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.ls machine # [ 164.061614] niks3-server[1184]: 2026/09/23 10:35:15 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete machine # [ 164.064097] niks3-server[1184]: 2026/09/23 10:35:15 INFO Completed upload id=5 machine # [ 164.065393] niks3-server[1184]: 2026/09/23 10:35:15 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.narinfo machine # [ 188.970793] niks3-server[1184]: 2026/09/23 10:35:40 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 188.982688] niks3-server[1184]: 2026/09/23 10:35:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign machine # [ 188.985316] niks3-server[1184]: 2026/09/23 10:35:40 INFO Signed narinfos id=6 count=1 machine # [ 188.990492] niks3-server[1184]: 2026/09/23 10:35:40 INFO Registered completed upload object_key=log/n40czam6a4ldp1mh5fdmlcy07fv0akbm-k3s-top.drv machine # [ 188.992230] niks3-server[1184]: 2026/09/23 10:35:40 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.ls machine # [ 188.997728] niks3-server[1184]: 2026/09/23 10:35:40 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete machine # [ 189.004097] niks3-server[1184]: 2026/09/23 10:35:40 INFO Registered completed upload object_key=nar/1q8vp5xqws560mpf8rxk8r8jhqrzibivh13x4wxy0cfqlzbk7cr5.nar.zst machine # [ 189.006445] niks3-server[1184]: 2026/09/23 10:35:40 INFO Completed upload id=6 machine # [ 189.007803] niks3-server[1184]: 2026/09/23 10:35:40 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1, in 137.34 seconds) machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath, in 0.16 seconds) machine: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine: (finished: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.01 seconds) machine: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine # copying 3 paths... machine # copying path '/nix/store/r95r891injj9ski5c4w89yxjvjy065mx-k3s-a' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/mrqsh0475wxsmnsvkk55g94v6g5nrcra-k3s-b' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top' from 'http://192.168.1.1:5751'... machine: (finished: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.24 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1 machine # [ 190.786957] niks3-server[1184]: 2026/09/23 10:35:42 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 190.805337] niks3-server[1184]: 2026/09/23 10:35:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign machine # [ 190.807564] niks3-server[1184]: 2026/09/23 10:35:42 INFO Signed narinfos id=7 count=1 machine # [ 190.812293] niks3-server[1184]: 2026/09/23 10:35:42 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.ls machine # [ 190.815949] niks3-server[1184]: 2026/09/23 10:35:42 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete machine # [ 190.819646] niks3-server[1184]: 2026/09/23 10:35:42 INFO Registered completed upload object_key=nar/1fr26arhri17j9bj6hyjzmmd74v730biz1gb3kqd194vjx3ccvp9.nar.zst machine # [ 190.825368] niks3-server[1184]: 2026/09/23 10:35:42 INFO Completed upload id=7 machine # [ 190.826530] niks3-server[1184]: 2026/09/23 10:35:42 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.narinfo machine # [ 215.132760] niks3-server[1184]: 2026/09/23 10:36:06 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 215.149043] niks3-server[1184]: 2026/09/23 10:36:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign machine # [ 215.152340] niks3-server[1184]: 2026/09/23 10:36:06 INFO Signed narinfos id=8 count=1 machine # [ 215.154214] niks3-server[1184]: 2026/09/23 10:36:06 INFO Registered completed upload object_key=nar/1hfc6x4x25k3b0fk091d3nb0k3mympfp05fkslcx19synp3ig0zd.nar.zst machine # [ 215.156964] niks3-server[1184]: 2026/09/23 10:36:06 INFO Registered completed upload object_key=log/pbpqsh50ar10fpasdqqx8xg3lmr5j8iz-k3s-a.drv machine # [ 215.160313] niks3-server[1184]: 2026/09/23 10:36:06 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.ls machine # [ 215.162890] niks3-server[1184]: 2026/09/23 10:36:06 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete machine # [ 215.165835] niks3-server[1184]: 2026/09/23 10:36:06 INFO Completed upload id=8 machine # [ 215.167344] niks3-server[1184]: 2026/09/23 10:36:06 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.narinfo machine # [ 215.228354] niks3-server[1184]: 2026/09/23 10:36:06 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 215.239486] niks3-server[1184]: 2026/09/23 10:36:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign machine # [ 215.241349] niks3-server[1184]: 2026/09/23 10:36:06 INFO Registered completed upload object_key=nar/0zzq2vgjln4shvh57091n14sam6wh6w06vja6lzb9ppcj4ffyx1n.nar.zst machine # [ 215.243343] niks3-server[1184]: 2026/09/23 10:36:06 INFO Signed narinfos id=9 count=1 machine # [ 215.244740] niks3-server[1184]: 2026/09/23 10:36:06 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.ls machine # [ 215.246568] niks3-server[1184]: 2026/09/23 10:36:06 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete machine # [ 215.248402] niks3-server[1184]: 2026/09/23 10:36:06 INFO Completed upload id=9 machine # [ 215.249529] niks3-server[1184]: 2026/09/23 10:36:06 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.narinfo machine # [ 239.752821] niks3-server[1184]: 2026/09/23 10:36:31 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 239.768897] niks3-server[1184]: 2026/09/23 10:36:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign machine # [ 239.773215] niks3-server[1184]: 2026/09/23 10:36:31 INFO Signed narinfos id=10 count=1 machine # [ 239.776426] niks3-server[1184]: 2026/09/23 10:36:31 INFO Registered completed upload object_key=nar/0hh3nqk95r6g32lhdmxw8cxjv694vbpx9876zkhcpg4r4qxni2ch.nar.zst machine # [ 239.781482] niks3-server[1184]: 2026/09/23 10:36:31 INFO Registered completed upload object_key=log/894h6wzw2l4w5f0hikj1k6q57jfnyi87-k3s-b.drv machine # [ 239.786334] niks3-server[1184]: 2026/09/23 10:36:31 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.ls machine # [ 239.791495] niks3-server[1184]: 2026/09/23 10:36:31 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete machine # [ 239.796474] niks3-server[1184]: 2026/09/23 10:36:31 INFO Completed upload id=10 machine # [ 239.798902] niks3-server[1184]: 2026/09/23 10:36:31 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.narinfo machine # [ 239.852638] niks3-server[1184]: 2026/09/23 10:36:31 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 239.866239] niks3-server[1184]: 2026/09/23 10:36:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign machine # [ 239.870538] niks3-server[1184]: 2026/09/23 10:36:31 INFO Signed narinfos id=11 count=1 machine # [ 239.870894] niks3-server[1184]: 2026/09/23 10:36:31 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.ls machine # [ 239.872473] niks3-server[1184]: 2026/09/23 10:36:31 INFO Registered completed upload object_key=nar/0ingamx56k31lwiyxmnxmscjj4n3qfx6sr2kpaynsrwhwz1278iw.nar.zst machine # [ 239.881081] niks3-server[1184]: 2026/09/23 10:36:31 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete machine # [ 239.883870] niks3-server[1184]: 2026/09/23 10:36:31 INFO Completed upload id=11 machine # [ 239.885045] niks3-server[1184]: 2026/09/23 10:36:31 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.narinfo machine # [ 264.390308] niks3-server[1184]: 2026/09/23 10:36:56 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 264.412812] niks3-server[1184]: 2026/09/23 10:36:56 INFO Registered completed upload object_key=log/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g-k3s-top.drv machine # [ 264.415552] niks3-server[1184]: 2026/09/23 10:36:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign machine # [ 264.416587] niks3-server[1184]: 2026/09/23 10:36:56 INFO Signed narinfos id=12 count=1 machine # [ 264.419410] niks3-server[1184]: 2026/09/23 10:36:56 INFO Registered completed upload object_key=nar/0v48x4sp58bvfra08axgkz7yl1n9nc4nirskyv1hwann4i7q277i.nar.zst machine # [ 264.422234] niks3-server[1184]: 2026/09/23 10:36:56 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.ls machine # [ 264.432160] niks3-server[1184]: 2026/09/23 10:36:56 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete machine # [ 264.437452] niks3-server[1184]: 2026/09/23 10:36:56 INFO Completed upload id=12 machine # [ 264.441655] niks3-server[1184]: 2026/09/23 10:36:56 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1, in 73.98 seconds) (finished: subtest: build through the balancer lands in the cache, in 211.74 seconds) subtest: a Job with the client image builds through the farm with its service account machine: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine: (finished: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.13 seconds) machine: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix machine: (finished: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix, in 0.11 seconds) machine: must succeed: kubectl apply -f /nix/store/lp0q6rjq0cw1vs9npm6c3ggx088f4vva-ci-job.json machine: (finished: must succeed: kubectl apply -f /nix/store/lp0q6rjq0cw1vs9npm6c3ggx088f4vva-ci-job.json, in 0.13 seconds) machine: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed' machine # [ 265.071097] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod80dba9c6_6738_4a96_ac44_092ac8c8c303.slice. machine # [ 265.187590] k3s[882]: I0923 10:36:56.929134 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/80dba9c6-6738-4a96-ac44-092ac8c8c303-nix-grpc-farm\") pod \"ci-tvp8m\" (UID: \"80dba9c6-6738-4a96-ac44-092ac8c8c303\") " pod="ci/ci-tvp8m" machine # [ 265.188747] k3s[882]: I0923 10:36:56.929198 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"job\" (UniqueName: \"kubernetes.io/configmap/80dba9c6-6738-4a96-ac44-092ac8c8c303-job\") pod \"ci-tvp8m\" (UID: \"80dba9c6-6738-4a96-ac44-092ac8c8c303\") " pod="ci/ci-tvp8m" machine # [ 265.189893] k3s[882]: I0923 10:36:56.929228 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4c9g\" (UniqueName: \"kubernetes.io/projected/80dba9c6-6738-4a96-ac44-092ac8c8c303-kube-api-access-j4c9g\") pod \"ci-tvp8m\" (UID: \"80dba9c6-6738-4a96-ac44-092ac8c8c303\") " pod="ci/ci-tvp8m" machine # [ 266.471713] cni0: port 1(veth811a287a) entered blocking state machine # [ 266.474394] cni0: port 1(veth811a287a) entered disabled state machine # [ 266.476809] veth811a287a: entered allmulticast mode machine # [ 266.479346] veth811a287a: entered promiscuous mode machine # [ 266.494876] cni0: port 1(veth811a287a) entered blocking state machine # [ 266.496557] cni0: port 1(veth811a287a) entered forwarding state machine # [ 266.396393] (udev-worker)[4885]: Network interface NamePolicy= disabled on kernel command line. machine # [ 266.427463] dhcpcd[3442]: veth811a287a: IAID 52:87:48:68 machine # [ 266.428350] dhcpcd[3442]: veth811a287a: adding address fe80::c086:52ff:fe87:4868 machine # [ 266.446647] systemd[1]: Started libcontainer container 6388fb0f0996e71d9bef6ba9f3df9dcfa621aa48ae783a53438e08ba402535d0. machine # [ 266.955094] dhcpcd[3442]: veth811a287a: soliciting a DHCP lease machine # [ 268.394321] dhcpcd[3442]: veth811a287a: soliciting an IPv6 router machine # [ 268.570386] systemd[1]: Started libcontainer container 8c600de158bb471801c9a0850ac921b991eb0c3ba19c3c8a29486a4f3345090e. machine # [ 269.785451] niks3-server[1184]: 2026/09/23 10:37:01 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 269.795690] niks3-server[1184]: 2026/09/23 10:37:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign machine # [ 269.798215] niks3-server[1184]: 2026/09/23 10:37:01 INFO Signed narinfos id=13 count=1 machine # [ 269.799611] niks3-server[1184]: 2026/09/23 10:37:01 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.ls machine # [ 269.801693] niks3-server[1184]: 2026/09/23 10:37:01 INFO Registered completed upload object_key=nar/111g6dyibwcf2z7jhpn72rgja0qvjgpdiv9nc06g2dp7ih0a6kyq.nar.zst machine # [ 269.804043] niks3-server[1184]: 2026/09/23 10:37:01 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete machine # [ 269.808402] niks3-server[1184]: 2026/09/23 10:37:01 INFO Completed upload id=13 machine # [ 269.809292] niks3-server[1184]: 2026/09/23 10:37:01 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.narinfo machine # [ 271.955684] dhcpcd[3442]: veth811a287a: probing for an IPv4LL address machine # [ 276.877141] dhcpcd[3442]: veth811a287a: using IPv4LL address 169.254.226.77 machine # [ 276.879867] dhcpcd[3442]: veth811a287a: adding route to 169.254.0.0/16 machine # [ 280.397800] dhcpcd[3442]: veth811a287a: no IPv6 Routers available machine # [ 294.512230] niks3-server[1184]: 2026/09/23 10:37:26 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 294.536264] niks3-server[1184]: 2026/09/23 10:37:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign machine # [ 294.542607] niks3-server[1184]: 2026/09/23 10:37:26 INFO Signed narinfos id=14 count=1 machine # [ 294.550908] niks3-server[1184]: 2026/09/23 10:37:26 INFO Registered completed upload object_key=nar/058kjd2vfl1r27b4d9ixvwf77d8rkr18a4v894kwx8lg0nwpajnr.nar.zst machine # [ 294.555098] niks3-server[1184]: 2026/09/23 10:37:26 INFO Registered completed upload object_key=log/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # [ 294.558297] niks3-server[1184]: 2026/09/23 10:37:26 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete machine # [ 294.560429] niks3-server[1184]: 2026/09/23 10:37:26 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.ls machine # [ 294.561896] niks3-server[1184]: 2026/09/23 10:37:26 INFO Completed upload id=14 machine # [ 294.564736] niks3-server[1184]: 2026/09/23 10:37:26 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.narinfo machine # [ 294.627767] niks3-server[1184]: 2026/09/23 10:37:26 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 294.636878] niks3-server[1184]: 2026/09/23 10:37:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign machine # [ 294.637610] niks3-server[1184]: 2026/09/23 10:37:26 INFO Signed narinfos id=15 count=1 machine # [ 294.641766] niks3-server[1184]: 2026/09/23 10:37:26 INFO Registered completed upload object_key=nar/138ynhcd5wxzz485x9qcq7xsargaklrf2li31ai69m5r46am35q6.nar.zst machine # [ 294.644035] niks3-server[1184]: 2026/09/23 10:37:26 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.ls machine # [ 294.647259] niks3-server[1184]: 2026/09/23 10:37:26 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete machine # [ 294.649691] niks3-server[1184]: 2026/09/23 10:37:26 INFO Completed upload id=15 machine # [ 294.651925] niks3-server[1184]: 2026/09/23 10:37:26 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.narinfo machine # [ 310.269743] postgres[761]: [761] LOG: checkpoint starting: time machine # [ 319.536363] niks3-server[1184]: 2026/09/23 10:37:51 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 319.549117] niks3-server[1184]: 2026/09/23 10:37:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign machine # [ 319.550322] niks3-server[1184]: 2026/09/23 10:37:51 INFO Signed narinfos id=16 count=1 machine # [ 319.554402] niks3-server[1184]: 2026/09/23 10:37:51 INFO Registered completed upload object_key=log/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # [ 319.556248] niks3-server[1184]: 2026/09/23 10:37:51 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.ls machine # [ 319.557682] niks3-server[1184]: 2026/09/23 10:37:51 INFO Registered completed upload object_key=nar/0n4lbdlp8w72fs3qbavl2lwrzbrn55i2b1vyglc89cc3pi8vbb1m.nar.zst machine # [ 319.558918] niks3-server[1184]: 2026/09/23 10:37:51 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete machine # [ 319.561035] niks3-server[1184]: 2026/09/23 10:37:51 INFO Completed upload id=16 machine # [ 319.564736] niks3-server[1184]: 2026/09/23 10:37:51 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo machine # [ 319.618998] niks3-server[1184]: 2026/09/23 10:37:51 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 319.627475] niks3-server[1184]: 2026/09/23 10:37:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign machine # [ 319.629404] niks3-server[1184]: 2026/09/23 10:37:51 INFO Signed narinfos id=17 count=1 machine # [ 319.630769] niks3-server[1184]: 2026/09/23 10:37:51 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.ls machine # [ 319.632697] niks3-server[1184]: 2026/09/23 10:37:51 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete machine # [ 319.634554] niks3-server[1184]: 2026/09/23 10:37:51 INFO Registered completed upload object_key=nar/1f3gvnvqsm2pm3laixkxkg44kvjb251zqhszcfpp0a00h6x66ljs.nar.zst machine # [ 319.636675] niks3-server[1184]: 2026/09/23 10:37:51 INFO Completed upload id=17 machine # [ 344.123616] niks3-server[1184]: 2026/09/23 10:38:15 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 344.148641] niks3-server[1184]: 2026/09/23 10:38:15 INFO Registered completed upload object_key=nar/1zwf0asrdv12q40fmqga5lx5330dvn9y4in4i9ficz9ij5lhvnf5.nar.zst machine # [ 344.150565] niks3-server[1184]: 2026/09/23 10:38:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign machine # [ 344.152147] niks3-server[1184]: 2026/09/23 10:38:15 INFO Signed narinfos id=18 count=1 machine # [ 344.155773] niks3-server[1184]: 2026/09/23 10:38:15 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.ls machine # [ 344.162366] niks3-server[1184]: 2026/09/23 10:38:15 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete machine # [ 344.166275] niks3-server[1184]: 2026/09/23 10:38:15 INFO Completed upload id=18 machine # [ 344.168830] niks3-server[1184]: 2026/09/23 10:38:15 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo machine # [ 344.173110] niks3-server[1184]: 2026/09/23 10:38:15 INFO Registered completed upload object_key=log/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # [ 346.812822] niks3-server[1184]: 2026/09/23 10:38:18 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 346.824968] niks3-server[1184]: 2026/09/23 10:38:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign machine # [ 346.828868] niks3-server[1184]: 2026/09/23 10:38:18 INFO Signed narinfos id=19 count=1 machine # [ 346.831630] niks3-server[1184]: 2026/09/23 10:38:18 INFO Registered completed upload object_key=nar/0xiyqcsl8db7dnrq2gqnx5izavr51ma3dcdswrriaxfgj3qzk7xf.nar.zst machine # [ 346.836219] niks3-server[1184]: 2026/09/23 10:38:18 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.ls machine # [ 346.840128] niks3-server[1184]: 2026/09/23 10:38:18 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete machine # [ 346.843989] niks3-server[1184]: 2026/09/23 10:38:18 INFO Completed upload id=19 machine # [ 346.846413] niks3-server[1184]: 2026/09/23 10:38:18 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.narinfo machine # [ 371.551398] niks3-server[1184]: 2026/09/23 10:38:43 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 371.576105] niks3-server[1184]: 2026/09/23 10:38:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign machine # [ 371.577964] niks3-server[1184]: 2026/09/23 10:38:43 INFO Signed narinfos id=20 count=1 machine # [ 371.581165] niks3-server[1184]: 2026/09/23 10:38:43 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.ls machine # [ 371.583423] niks3-server[1184]: 2026/09/23 10:38:43 INFO Registered completed upload object_key=log/fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # [ 371.588564] niks3-server[1184]: 2026/09/23 10:38:43 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete machine # [ 371.592168] niks3-server[1184]: 2026/09/23 10:38:43 INFO Completed upload id=20 machine # [ 371.593835] niks3-server[1184]: 2026/09/23 10:38:43 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo machine # [ 371.604947] niks3-server[1184]: 2026/09/23 10:38:43 INFO Registered completed upload object_key=nar/0p3l2z3riilylr2rxb1aq2blxdfxg55wbgp4gxkns93srbr4bwyq.nar.zst machine # [ 372.774504] systemd[1]: cri-containerd-8c600de158bb471801c9a0850ac921b991eb0c3ba19c3c8a29486a4f3345090e.scope: Deactivated successfully. machine # [ 372.776743] systemd[1]: cri-containerd-8c600de158bb471801c9a0850ac921b991eb0c3ba19c3c8a29486a4f3345090e.scope: Consumed 971ms CPU time over 1min 44.204s wall clock time, 86.3M memory peak, 16.6M read from disk, 428K written to disk, 18.2K incoming IP traffic, 44.6K outgoing IP traffic. machine # [ 372.829163] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-8c600de158bb471801c9a0850ac921b991eb0c3ba19c3c8a29486a4f3345090e-rootfs.mount: Deactivated successfully. machine # [ 374.676662] systemd[1]: cri-containerd-6388fb0f0996e71d9bef6ba9f3df9dcfa621aa48ae783a53438e08ba402535d0.scope: Deactivated successfully. machine # [ 374.745238] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-6388fb0f0996e71d9bef6ba9f3df9dcfa621aa48ae783a53438e08ba402535d0-rootfs.mount: Deactivated successfully. machine # [ 374.783176] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-6388fb0f0996e71d9bef6ba9f3df9dcfa621aa48ae783a53438e08ba402535d0-shm.mount: Deactivated successfully. machine # [ 374.969682] cni0: port 1(veth811a287a) entered disabled state machine # [ 374.971770] veth811a287a (unregistering): left allmulticast mode machine # [ 374.820429] dhcpcd[3442]: vet[ 374.973116] veth811a287a (unregistering): left promiscuous mode machine # h811a287a: carrier lost machine # [ 374.974495] cni0: port 1(veth811a287a) entered disabled state machine # [ 374.841243] systemd[1]: run-netns-cni\x2d019ed5ea\x2db5fa\x2de31b\x2d7aa0\x2d331d08c94365.mount: Deactivated successfully. machine # [ 374.854801] dhcpcd[3442]: veth811a287a: deleting address fe80::c086:52ff:fe87:4868 machine # [ 374.858229] dhcpcd[3442]: veth811a287a: deleting route to 169.254.0.0/16 machine # [ 374.917295] dhcpcd[3442]: veth811a287a: removing interface machine # [ 374.965628] k3s[882]: I0923 10:38:46.707122 882 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/80dba9c6-6738-4a96-ac44-092ac8c8c303-nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/80dba9c6-6738-4a96-ac44-092ac8c8c303-nix-grpc-farm\") pod \"80dba9c6-6738-4a96-ac44-092ac8c8c303\" (UID: \"80dba9c6-6738-4a96-ac44-092ac8c8c303\") " machine # [ 374.970130] k3s[882]: I0923 10:38:46.707171 882 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/80dba9c6-6738-4a96-ac44-092ac8c8c303-kube-api-access-j4c9g\" (UniqueName: \"kubernetes.io/projected/80dba9c6-6738-4a96-ac44-092ac8c8c303-kube-api-access-j4c9g\") pod \"80dba9c6-6738-4a96-ac44-092ac8c8c303\" (UID: \"80dba9c6-6738-4a96-ac44-092ac8c8c303\") " machine # [ 374.974591] k3s[882]: I0923 10:38:46.707207 882 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/80dba9c6-6738-4a96-ac44-092ac8c8c303-job\" (UniqueName: \"kubernetes.io/configmap/80dba9c6-6738-4a96-ac44-092ac8c8c303-job\") pod \"80dba9c6-6738-4a96-ac44-092ac8c8c303\" (UID: \"80dba9c6-6738-4a96-ac44-092ac8c8c303\") " machine # [ 374.978743] k3s[882]: I0923 10:38:46.707633 882 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80dba9c6-6738-4a96-ac44-092ac8c8c303-job" pod "80dba9c6-6738-4a96-ac44-092ac8c8c303" (UID: "80dba9c6-6738-4a96-ac44-092ac8c8c303"). InnerVolumeSpecName "job". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 374.982743] k3s[882]: I0923 10:38:46.714249 882 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80dba9c6-6738-4a96-ac44-092ac8c8c303-kube-api-access-j4c9g" pod "80dba9c6-6738-4a96-ac44-092ac8c8c303" (UID: "80dba9c6-6738-4a96-ac44-092ac8c8c303"). InnerVolumeSpecName "kube-api-access-j4c9g". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 374.987091] k3s[882]: I0923 10:38:46.717133 882 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80dba9c6-6738-4a96-ac44-092ac8c8c303-nix-grpc-farm" pod "80dba9c6-6738-4a96-ac44-092ac8c8c303" (UID: "80dba9c6-6738-4a96-ac44-092ac8c8c303"). InnerVolumeSpecName "nix-grpc-farm". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 374.991377] systemd[1]: var-lib-kubelet-pods-80dba9c6\x2d6738\x2d4a96\x2dac44\x2d092ac8c8c303-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dj4c9g.mount: Deactivated successfully. machine # [ 374.993620] systemd[1]: var-lib-kubelet-pods-80dba9c6\x2d6738\x2d4a96\x2dac44\x2d092ac8c8c303-volumes-kubernetes.io\x7eprojected-nix\x2dgrpc\x2dfarm.mount: Deactivated successfully. machine # [ 375.065963] k3s[882]: I0923 10:38:46.807699 882 reconciler_common.go:299] "Volume detached for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/80dba9c6-6738-4a96-ac44-092ac8c8c303-nix-grpc-farm\") on node \"machine\" DevicePath \"\"" machine # [ 375.067071] k3s[882]: I0923 10:38:46.807743 882 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4c9g\" (UniqueName: \"kubernetes.io/projected/80dba9c6-6738-4a96-ac44-092ac8c8c303-kube-api-access-j4c9g\") on node \"machine\" DevicePath \"\"" machine # [ 375.068117] k3s[882]: I0923 10:38:46.807758 882 reconciler_common.go:299] "Volume detached for volume \"job\" (UniqueName: \"kubernetes.io/configmap/80dba9c6-6738-4a96-ac44-092ac8c8c303-job\") on node \"machine\" DevicePath \"\"" machine # [ 375.210578] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod80dba9c6_6738_4a96_ac44_092ac8c8c303.slice. machine # [ 375.212408] systemd[1]: kubepods-besteffort-pod80dba9c6_6738_4a96_ac44_092ac8c8c303.slice: Consumed 1.001s CPU time over 1min 50.138s wall clock time, 86.6M memory peak, 16.6M read from disk, 632K written to disk, 18.2K incoming IP traffic, 44.6K outgoing IP traffic. machine # [ 375.660896] k3s[882]: I0923 10:38:47.402677 882 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6388fb0f0996e71d9bef6ba9f3df9dcfa621aa48ae783a53438e08ba402535d0" machine: (finished: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed', in 112.04 seconds) machine: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1 machine: (finished: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1, in 0.17 seconds) machine # don't know how to build these paths: machine # /nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-a> machine/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lh6xc: building fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-b> machine/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lh6xc: building 1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-top> machine/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lh6xc: building rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # INFO:nix_fast_build.processes:run nix-eval-jobs --gc-roots-dir /tmp/tmpv9xu2_ju/gcroots --force-recurse --max-memory-size 4096 --workers 4 --flake '.#checks' --check-cache-status machine # INFO:nix_fast_build.workers:builds: 0 machine # warning: Git tree '/tmp' is dirty machine # warning: Git tree '/tmp' is dirty machine # ▶ x86_64-linux.t started machine # INFO:nix_fast_build.workers:builds: 2 machine # ✔ x86_64-linux.t (26s) machine # x86_64-linux.t> machine/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-p4svn: building fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # warning: Git tree '/tmp' is dirty machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath, in 0.17 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null, in 0.03 seconds) (finished: subtest: a Job with the client image builds through the farm with its service account, in 113.06 seconds) subtest: a renewed balancer certificate is served without a rollout machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f - machine # Warning: resource secrets/farm-lb-tls is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically. machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f -, in 0.27 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}', in 0.24 seconds) machine: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-6f57bb48cc-wg4d2 -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine # [ 378.285840] k3s[882]: E0923 10:38:50.027390 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:44272: use of closed network connection machine # [ 379.580614] k3s[882]: E0923 10:38:51.322067 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:44292: use of closed network connection machine # [ 380.904529] k3s[882]: time="2026-09-23T10:38:52Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:60882->127.0.0.1:10250: write: broken pipe" machine # [ 380.907930] k3s[882]: E0923 10:38:52.649720 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:44326: use of closed network connection machine # [ 382.190907] k3s[882]: time="2026-09-23T10:38:53Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:60894->127.0.0.1:10250: write: broken pipe" machine # [ 382.191801] k3s[882]: E0923 10:38:53.932361 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:44338: use of closed network connection machine # [ 383.449248] k3s[882]: E0923 10:38:55.190630 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58800: use of closed network connection machine # [ 384.695690] k3s[882]: E0923 10:38:56.437233 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58824: use of closed network connection machine # [ 387.286290] k3s[882]: E0923 10:38:59.027786 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58870: use of closed network connection machine # [ 388.577432] k3s[882]: E0923 10:39:00.318730 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58894: use of closed network connection machine # [ 389.854897] k3s[882]: E0923 10:39:01.596209 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58918: use of closed network connection machine # [ 391.184735] k3s[882]: E0923 10:39:02.925806 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58932: use of closed network connection machine # [ 392.465820] k3s[882]: E0923 10:39:04.207286 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58966: use of closed network connection machine # [ 393.768863] k3s[882]: E0923 10:39:05.510413 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:44818: use of closed network connection machine # [ 395.082784] k3s[882]: E0923 10:39:06.824350 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:44846: use of closed network connection machine # [ 396.385640] k3s[882]: time="2026-09-23T10:39:08Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:60944->127.0.0.1:10250: write: broken pipe" machine # [ 396.386533] k3s[882]: E0923 10:39:08.127096 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:44868: use of closed network connection machine # [ 397.706148] k3s[882]: E0923 10:39:09.447549 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:44894: use of closed network connection machine # [ 397.708228] k3s[882]: E0923 10:39:09.447726 882 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:50144->127.0.0.1:10010: write tcp 127.0.0.1:50144->127.0.0.1:10010: write: broken pipe machine # [ 399.007296] k3s[882]: E0923 10:39:10.748387 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:44922: use of closed network connection machine # [ 400.308632] k3s[882]: E0923 10:39:12.050044 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:44960: use of closed network connection machine # [ 401.615967] k3s[882]: E0923 10:39:13.357437 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:44998: use of closed network connection machine # [ 402.964166] k3s[882]: E0923 10:39:14.705266 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45024: use of closed network connection machine # [ 405.590068] k3s[882]: E0923 10:39:17.331572 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55770: use of closed network connection machine # [ 406.895900] k3s[882]: E0923 10:39:18.637466 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55796: use of closed network connection machine # [ 408.197212] k3s[882]: E0923 10:39:19.938604 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55814: use of closed network connection machine # [ 409.478623] k3s[882]: E0923 10:39:21.219676 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55850: use of closed network connection machine # [ 410.736393] k3s[882]: E0923 10:39:22.476753 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55872: use of closed network connection machine # [ 412.007602] k3s[882]: E0923 10:39:23.748972 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55906: use of closed network connection machine # [ 413.292902] k3s[882]: E0923 10:39:25.034428 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58502: use of closed network connection machine # [ 414.555646] postgres[761]: [761] LOG: checkpoint complete: wrote 1037 buffers (6.3%), wrote 3 SLRU buffers; 1 WAL file(s) added, 0 removed, 0 recycled; write=104.200 s, sync=0.056 s, total=104.286 s; sync files=364, longest=0.005 s, average=0.001 s; distance=4980 kB, estimate=4980 kB; lsn=0/1C6F948, redo lsn=0/1C43118 machine # [ 414.575855] k3s[882]: E0923 10:39:26.317114 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58524: use of closed network connection machine # [ 415.851750] k3s[882]: E0923 10:39:27.592763 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58556: use of closed network connection machine # [ 417.149295] k3s[882]: E0923 10:39:28.890525 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58584: use of closed network connection machine # [ 418.429750] k3s[882]: E0923 10:39:30.171062 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58616: use of closed network connection machine # [ 419.728902] k3s[882]: E0923 10:39:31.470120 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58650: use of closed network connection machine # [ 421.009079] k3s[882]: E0923 10:39:32.750505 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58674: use of closed network connection machine: (finished: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-6f57bb48cc-wg4d2 -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 42.98 seconds) machine: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine: (finished: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 0.04 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1 machine # [ 421.244694] niks3-server[1184]: 2026/09/23 10:39:32 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 421.258548] niks3-server[1184]: 2026/09/23 10:39:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign machine # [ 421.260685] niks3-server[1184]: 2026/09/23 10:39:33 INFO Signed narinfos id=21 count=1 machine # [ 421.261601] niks3-server[1184]: 2026/09/23 10:39:33 INFO Registered completed upload object_key=nar/0g42hgwa9jp9abmqxz90dkwxpybsznzbpsy35rm921mlk5sw56jq.nar.zst machine # [ 421.266463] niks3-server[1184]: 2026/09/23 10:39:33 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.ls machine # [ 421.267755] niks3-server[1184]: 2026/09/23 10:39:33 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete machine # [ 421.270157] niks3-server[1184]: 2026/09/23 10:39:33 INFO Completed upload id=21 machine # [ 421.272543] niks3-server[1184]: 2026/09/23 10:39:33 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.narinfo machine # [ 446.377687] niks3-server[1184]: 2026/09/23 10:39:58 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 446.394619] niks3-server[1184]: 2026/09/23 10:39:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign machine # [ 446.396979] niks3-server[1184]: 2026/09/23 10:39:58 INFO Signed narinfos id=22 count=1 machine # [ 446.400343] niks3-server[1184]: 2026/09/23 10:39:58 INFO Registered completed upload object_key=nar/1vxmmzwi16s4iri6dcmi9v62dpq1ys7wz15b497ncik3sd67nfzg.nar.zst machine # [ 446.402075] niks3-server[1184]: 2026/09/23 10:39:58 INFO Registered completed upload object_key=log/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31-k3s-a.drv machine # [ 446.404162] niks3-server[1184]: 2026/09/23 10:39:58 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.ls machine # [ 446.409042] niks3-server[1184]: 2026/09/23 10:39:58 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete machine # [ 446.410921] niks3-server[1184]: 2026/09/23 10:39:58 INFO Completed upload id=22 machine # [ 446.412819] niks3-server[1184]: 2026/09/23 10:39:58 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo machine # [ 446.478227] niks3-server[1184]: 2026/09/23 10:39:58 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 446.488306] niks3-server[1184]: 2026/09/23 10:39:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign machine # [ 446.490052] niks3-server[1184]: 2026/09/23 10:39:58 INFO Signed narinfos id=23 count=1 machine # [ 446.492813] niks3-server[1184]: 2026/09/23 10:39:58 INFO Registered completed upload object_key=nar/0cbxkyxz068xc5mivh2h67kw6y01n1x28cbs11v1a03g8m4c71zm.nar.zst machine # [ 446.496302] niks3-server[1184]: 2026/09/23 10:39:58 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.ls machine # [ 446.498263] niks3-server[1184]: 2026/09/23 10:39:58 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete machine # [ 446.500415] niks3-server[1184]: 2026/09/23 10:39:58 INFO Completed upload id=23 machine # [ 446.501895] niks3-server[1184]: 2026/09/23 10:39:58 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.narinfo machine # [ 471.616153] niks3-server[1184]: 2026/09/23 10:40:23 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 471.631467] niks3-server[1184]: 2026/09/23 10:40:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign machine # [ 471.633583] niks3-server[1184]: 2026/09/23 10:40:23 INFO Signed narinfos id=24 count=1 machine # [ 471.636560] niks3-server[1184]: 2026/09/23 10:40:23 INFO Registered completed upload object_key=log/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4-k3s-b.drv machine # [ 471.638684] niks3-server[1184]: 2026/09/23 10:40:23 INFO Registered completed upload object_key=nar/0khxywxb2r78vhpc5hsmha3ymgp910z0aka7550jmaqzs333rmzp.nar.zst machine # [ 471.640304] niks3-server[1184]: 2026/09/23 10:40:23 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.ls machine # [ 471.646591] niks3-server[1184]: 2026/09/23 10:40:23 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete machine # [ 471.652974] niks3-server[1184]: 2026/09/23 10:40:23 INFO Completed upload id=24 machine # [ 471.654540] niks3-server[1184]: 2026/09/23 10:40:23 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.narinfo machine # [ 471.717680] niks3-server[1184]: 2026/09/23 10:40:23 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 471.726691] niks3-server[1184]: 2026/09/23 10:40:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign machine # [ 471.728248] niks3-server[1184]: 2026/09/23 10:40:23 INFO Signed narinfos id=25 count=1 machine # [ 471.729738] niks3-server[1184]: 2026/09/23 10:40:23 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.ls machine # [ 471.734177] niks3-server[1184]: 2026/09/23 10:40:23 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete machine # [ 471.737395] niks3-server[1184]: 2026/09/23 10:40:23 INFO Completed upload id=25 machine # [ 471.738377] niks3-server[1184]: 2026/09/23 10:40:23 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.narinfo machine # [ 496.653735] niks3-server[1184]: 2026/09/23 10:40:48 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 496.676277] niks3-server[1184]: 2026/09/23 10:40:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign machine # [ 496.680758] niks3-server[1184]: 2026/09/23 10:40:48 INFO Registered completed upload object_key=nar/11f7f1hixry25c2yc6np9hs10a2pwwqmymmrxxbswhdjabcyvv0s.nar.zst machine # [ 496.682433] niks3-server[1184]: 2026/09/23 10:40:48 INFO Registered completed upload object_key=log/jz7biafi8rj5r3r392blyazw5mdpvy0d-k3s-top.drv machine # [ 496.684237] niks3-server[1184]: 2026/09/23 10:40:48 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.ls machine # [ 496.692820] niks3-server[1184]: 2026/09/23 10:40:48 INFO Signed narinfos id=26 count=1 machine # [ 496.702453] niks3-server[1184]: 2026/09/23 10:40:48 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete machine # [ 496.705047] niks3-server[1184]: 2026/09/23 10:40:48 INFO Completed upload id=26 machine # [ 496.708225] niks3-server[1184]: 2026/09/23 10:40:48 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1, in 75.68 seconds) (finished: subtest: a renewed balancer certificate is served without a rollout, in 119.21 seconds) subtest: metrics carry build_info machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lh6xc -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lh6xc -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.16 seconds) machine: must succeed: curl -sf http://10.42.0.5:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lh6xc"' machine: (finished: must succeed: curl -sf http://10.42.0.5:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lh6xc"', in 0.03 seconds) (finished: subtest: metrics carry build_info, in 0.19 seconds) subtest: harmonia-gc frees space and the worker stays Ready machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lh6xc -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'' machine # [ 497.095028] k3s[882]: E0923 10:40:48.835238 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:52068: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lh6xc -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'', in 0.17 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lh6xc -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done' machine # [ 497.330476] k3s[882]: E0923 10:40:49.071552 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:52096: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lh6xc -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done', in 0.24 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lh6xc -c gc -- sh -c 'fallocate -l 11438845952 /nix/fill' machine # [ 497.526460] k3s[882]: E0923 10:40:49.268224 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:52124: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lh6xc -c gc -- sh -c 'fallocate -l 11438845952 /nix/fill', in 0.19 seconds) machine: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lh6xc -c gc --since=30s | grep -q 'store paths deleted' machine: (finished: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lh6xc -c gc --since=30s | grep -q 'store paths deleted', in 1.32 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lh6xc -c gc -- sh -c 'rm /nix/fill' machine # [ 499.054033] k3s[882]: E0923 10:40:50.795443 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:52176: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lh6xc -c gc -- sh -c 'rm /nix/fill', in 0.20 seconds) machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lh6xc -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lh6xc -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}', in 0.12 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lh6xc -c gc -- sh -c 'command -v nix-daemon && command -v niks3' machine # [ 499.345509] k3s[882]: E0923 10:40:51.087131 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:52210: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lh6xc -c gc -- sh -c 'command -v nix-daemon && command -v niks3', in 0.17 seconds) (finished: subtest: harmonia-gc frees space and the worker stays Ready, in 2.42 seconds) subtest: losing the balancer mid-build: the client reconnects and the build succeeds machine: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1 machine # [ 499.368595] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1. machine # Running as unit: vialb.service; invocation ID: dbb6f71984294f86ad75013dfafe9d2a machine: (finished: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1, in 0.02 seconds) machine: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'" machine # [ 499.483992] nix[9951]: don't know how to build these paths: machine # [ 499.485760] nix[9951]: /nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 499.508376] nix[9951]: copying 1 paths to '127.0.0.1:30051'... machine # [ 499.510702] nix[9951]: copying path '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' to '127.0.0.1:30051'... machine # [ 499.558140] niks3-server[1184]: 2026/09/23 10:40:51 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 499.571429] niks3-server[1184]: 2026/09/23 10:40:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign machine # [ 499.572710] niks3-server[1184]: 2026/09/23 10:40:51 INFO Signed narinfos id=27 count=1 machine # [ 499.575089] niks3-server[1184]: 2026/09/23 10:40:51 INFO Registered completed upload object_key=nar/0kkr2vb091wkq0cb0f1q92413dsfskh76wydp8mwysv7rawns0ar.nar.zst machine # [ 499.578299] niks3-server[1184]: 2026/09/23 10:40:51 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.ls machine # [ 499.581969] niks3-server[1184]: 2026/09/23 10:40:51 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete machine # [ 499.584848] niks3-server[1184]: 2026/09/23 10:40:51 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.narinfo machine # [ 499.587277] niks3-server[1184]: 2026/09/23 10:40:51 INFO Completed upload id=27 machine # [ 499.597327] nix[9951]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 499.598324] nix[9951]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-p4svn: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine: (finished: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'", in 1.06 seconds) machine: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false machine: (finished: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false, in 0.26 seconds) machine: waiting for success: ! systemctl is-active vialb machine # [ 500.708339] nix[9951]: scheduler at 127.0.0.1:30051: Stream removed (Socket closed), reconnecting machine # [ 500.709098] nix[9951]: d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv: Stream removed (Socket closed), asking the scheduler again machine # [ 500.728554] systemd[1]: cri-containerd-35ddeb49e45c97927e7c4f2e5621e4d05d71176bd63b0778698d9a618404be61.scope: Deactivated successfully. machine # [ 500.729231] systemd[1]: cri-containerd-35ddeb49e45c97927e7c4f2e5621e4d05d71176bd63b0778698d9a618404be61.scope: Consumed 4.331s CPU time over 7min 40.867s wall clock time, 61.9M memory peak, 39.9M read from disk, 596.1K incoming IP traffic, 727.5K outgoing IP traffic. machine # [ 500.759978] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-35ddeb49e45c97927e7c4f2e5621e4d05d71176bd63b0778698d9a618404be61-rootfs.mount: Deactivated successfully. machine # [ 500.790732] systemd[1]: cri-containerd-e9a76f5f4fcd24b4e6198fdaf5b826f756be4064f4f448d394f7a8945594d2ad.scope: Deactivated successfully. machine # [ 500.818337] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-e9a76f5f4fcd24b4e6198fdaf5b826f756be4064f4f448d394f7a8945594d2ad-rootfs.mount: Deactivated successfully. machine # [ 500.843174] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-e9a76f5f4fcd24b4e6198fdaf5b826f756be4064f4f448d394f7a8945594d2ad-shm.mount: Deactivated successfully. machine # [ 501.024162] cni0: port 3(vetha348a11e) entered disabled state machine # [ 500.874340] dhcpcd[3442]: vetha348a11e: carrier lost machine # [ 501.026852] vetha348a11e (unregistering): left allmulticast mode machine # [ 501.028047] vetha348a11e (unregistering): left promiscuous mode machine # [ 501.029068] cni0: port 3(vetha348a11e) entered disabled state machine # [ 500.896588] systemd[1]: run-netns-cni\x2d88677356\x2d56b8\x2d8d1c\x2dfbdf\x2d35e7883a2cba.mount: Deactivated successfully. machine # [ 500.900255] dhcpcd[3442]: vetha348a11e: deleting route to 169.254.0.0/16 machine # [ 500.933279] k3s[882]: I0923 10:40:52.674768 882 endpointslice_controller.go:361] "Error syncing endpoint slices for service, retrying" key="farm/nix-grpc-farm" err="EndpointSlice informer cache is out of date" machine # [ 500.953533] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod471a8e9b_dc54_4264_ae60_ae913ea8b40c.slice. machine # [ 500.967355] dhcpcd[3442]: vetha348a11e: removing interface machine # [ 501.072849] k3s[882]: I0923 10:40:52.814670 882 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9b5362bf-e589-4c7d-81bd-e7c62be7466f-tls-ca\" (UniqueName: \"kubernetes.io/secret/9b5362bf-e589-4c7d-81bd-e7c62be7466f-tls-ca\") pod \"9b5362bf-e589-4c7d-81bd-e7c62be7466f\" (UID: \"9b5362bf-e589-4c7d-81bd-e7c62be7466f\") " machine # [ 501.077535] k3s[882]: I0923 10:40:52.814713 882 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9b5362bf-e589-4c7d-81bd-e7c62be7466f-tls-lb\" (UniqueName: \"kubernetes.io/secret/9b5362bf-e589-4c7d-81bd-e7c62be7466f-tls-lb\") pod \"9b5362bf-e589-4c7d-81bd-e7c62be7466f\" (UID: \"9b5362bf-e589-4c7d-81bd-e7c62be7466f\") " machine # [ 501.081732] k3s[882]: I0923 10:40:52.814752 882 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9b5362bf-e589-4c7d-81bd-e7c62be7466f-tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b5362bf-e589-4c7d-81bd-e7c62be7466f-tmp\") pod \"9b5362bf-e589-4c7d-81bd-e7c62be7466f\" (UID: \"9b5362bf-e589-4c7d-81bd-e7c62be7466f\") " machine # [ 501.086137] k3s[882]: I0923 10:40:52.814786 882 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9b5362bf-e589-4c7d-81bd-e7c62be7466f-config\" (UniqueName: \"kubernetes.io/configmap/9b5362bf-e589-4c7d-81bd-e7c62be7466f-config\") pod \"9b5362bf-e589-4c7d-81bd-e7c62be7466f\" (UID: \"9b5362bf-e589-4c7d-81bd-e7c62be7466f\") " machine # [ 501.090400] k3s[882]: I0923 10:40:52.814832 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/471a8e9b-dc54-4264-ae60-ae913ea8b40c-tls-ca\") pod \"nix-grpc-farm-lb-6f57bb48cc-zgw9w\" (UID: \"471a8e9b-dc54-4264-ae60-ae913ea8b40c\") " pod="farm/nix-grpc-farm-lb-6f57bb48cc-zgw9w" machine # [ 501.094421] k3s[882]: I0923 10:40:52.814865 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/471a8e9b-dc54-4264-ae60-ae913ea8b40c-config\") pod \"nix-grpc-farm-lb-6f57bb48cc-zgw9w\" (UID: \"471a8e9b-dc54-4264-ae60-ae913ea8b40c\") " pod="farm/nix-grpc-farm-lb-6f57bb48cc-zgw9w" machine # [ 501.098835] k3s[882]: I0923 10:40:52.814896 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/471a8e9b-dc54-4264-ae60-ae913ea8b40c-tmp\") pod \"nix-grpc-farm-lb-6f57bb48cc-zgw9w\" (UID: \"471a8e9b-dc54-4264-ae60-ae913ea8b40c\") " pod="farm/nix-grpc-farm-lb-6f57bb48cc-zgw9w" machine # [ 501.102927] k3s[882]: I0923 10:40:52.814945 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/471a8e9b-dc54-4264-ae60-ae913ea8b40c-tls-lb\") pod \"nix-grpc-farm-lb-6f57bb48cc-zgw9w\" (UID: \"471a8e9b-dc54-4264-ae60-ae913ea8b40c\") " pod="farm/nix-grpc-farm-lb-6f57bb48cc-zgw9w" machine # [ 501.107114] systemd[1]: var-lib-kubelet-pods-9b5362bf\x2de589\x2d4c7d\x2d81bd\x2de7c62be7466f-volumes-kubernetes.io\x7esecret-tls\x2dca.mount: Deactivated successfully. machine # [ 501.109143] k3s[882]: I0923 10:40:52.824989 882 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b5362bf-e589-4c7d-81bd-e7c62be7466f-tls-ca" pod "9b5362bf-e589-4c7d-81bd-e7c62be7466f" (UID: "9b5362bf-e589-4c7d-81bd-e7c62be7466f"). InnerVolumeSpecName "tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 501.113205] k3s[882]: I0923 10:40:52.825251 882 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b5362bf-e589-4c7d-81bd-e7c62be7466f-tls-lb" pod "9b5362bf-e589-4c7d-81bd-e7c62be7466f" (UID: "9b5362bf-e589-4c7d-81bd-e7c62be7466f"). InnerVolumeSpecName "tls-lb". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 501.117150] k3s[882]: I0923 10:40:52.825264 882 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b5362bf-e589-4c7d-81bd-e7c62be7466f-tmp" pod "9b5362bf-e589-4c7d-81bd-e7c62be7466f" (UID: "9b5362bf-e589-4c7d-81bd-e7c62be7466f"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 501.121150] k3s[882]: I0923 10:40:52.838323 882 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b5362bf-e589-4c7d-81bd-e7c62be7466f-config" pod "9b5362bf-e589-4c7d-81bd-e7c62be7466f" (UID: "9b5362bf-e589-4c7d-81bd-e7c62be7466f"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 501.171105] k3s[882]: I0923 10:40:52.912646 882 scope.go:122] "RemoveContainer" containerID="35ddeb49e45c97927e7c4f2e5621e4d05d71176bd63b0778698d9a618404be61" machine # [ 501.173800] k3s[882]: I0923 10:40:52.915654 882 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9b5362bf-e589-4c7d-81bd-e7c62be7466f-config\") on node \"machine\" DevicePath \"\"" machine # [ 501.177261] k3s[882]: I0923 10:40:52.915677 882 reconciler_common.go:299] "Volume detached for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/9b5362bf-e589-4c7d-81bd-e7c62be7466f-tls-ca\") on node \"machine\" DevicePath \"\"" machine # [ 501.178549] k3s[882]: I0923 10:40:52.915689 882 reconciler_common.go:299] "Volume detached for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/9b5362bf-e589-4c7d-81bd-e7c62be7466f-tls-lb\") on node \"machine\" DevicePath \"\"" machine # [ 501.179459] k3s[882]: I0923 10:40:52.915701 882 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b5362bf-e589-4c7d-81bd-e7c62be7466f-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 501.181681] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod9b5362bf_e589_4c7d_81bd_e7c62be7466f.slice. machine # [ 501.183147] systemd[1]: kubepods-besteffort-pod9b5362bf_e589_4c7d_81bd_e7c62be7466f.slice: Consumed 4.362s CPU time over 7min 43.105s wall clock time, 62.1M memory peak, 39.9M read from disk, 596.1K incoming IP traffic, 727.5K outgoing IP traffic. machine # [ 501.184356] k3s[882]: I0923 10:40:52.926084 882 scope.go:122] "RemoveContainer" containerID="35ddeb49e45c97927e7c4f2e5621e4d05d71176bd63b0778698d9a618404be61" machine # [ 501.185615] k3s[882]: E0923 10:40:52.927481 882 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"35ddeb49e45c97927e7c4f2e5621e4d05d71176bd63b0778698d9a618404be61\": not found" containerID="35ddeb49e45c97927e7c4f2e5621e4d05d71176bd63b0778698d9a618404be61" machine # [ 501.186449] k3s[882]: I0923 10:40:52.927527 882 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"35ddeb49e45c97927e7c4f2e5621e4d05d71176bd63b0778698d9a618404be61"} err="failed to get container status \"35ddeb49e45c97927e7c4f2e5621e4d05d71176bd63b0778698d9a618404be61\": rpc error: code = NotFound desc = an error occurred when try to find container \"35ddeb49e45c97927e7c4f2e5621e4d05d71176bd63b0778698d9a618404be61\": not found" machine # [ 501.435963] cni0: port 1(veth07909697) entered blocking state machine # [ 501.437223] cni0: port 1(veth07909697) entered disabled state machine # [ 501.438308] veth07909697: entered allmulticast mode machine # [ 501.439322] veth07909697: entered promiscuous mode machine # [ 501.291130] (udev-worker)[10126]: Network interface NamePolicy= disabled on kernel command line. machine # [ 501.446927] cni0: port 1(veth07909697) entered blocking state machine # [ 501.448300] cni0: port 1(veth07909697) entered forwarding state machine # [ 501.319239] dhcpcd[3442]: veth07909697: IAID 29:4f:31:00 machine # [ 501.320075] dhcpcd[3442]: veth07909697: adding address fe80::346b:29ff:fe4f:3100 machine # [ 501.375430] systemd[1]: Started libcontainer container b6bb39f1e74b4f8083a773fcf472f07c3a4e9f62df5645b2573e380836c99815. machine # [ 501.489295] systemd[1]: Started libcontainer container 14287300a93ef410a8ce9e3b6823033252f19b7a44fa9f58e89c4be2bdc1e0a3. machine # [ 501.778259] systemd[1]: var-lib-kubelet-pods-9b5362bf\x2de589\x2d4c7d\x2d81bd\x2de7c62be7466f-volume\x2dsubpaths-config-envoy-2.mount: Deactivated successfully. machine # [ 501.780377] systemd[1]: var-lib-kubelet-pods-9b5362bf\x2de589\x2d4c7d\x2d81bd\x2de7c62be7466f-volume\x2dsubpaths-config-envoy-1.mount: Deactivated successfully. machine # [ 501.782279] systemd[1]: var-lib-kubelet-pods-9b5362bf\x2de589\x2d4c7d\x2d81bd\x2de7c62be7466f-volume\x2dsubpaths-config-envoy-0.mount: Deactivated successfully. machine # [ 501.783437] systemd[1]: var-lib-kubelet-pods-9b5362bf\x2de589\x2d4c7d\x2d81bd\x2de7c62be7466f-volumes-kubernetes.io\x7esecret-tls\x2dlb.mount: Deactivated successfully. machine # [ 501.784607] systemd[1]: var-lib-kubelet-pods-9b5362bf\x2de589\x2d4c7d\x2d81bd\x2de7c62be7466f-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 502.200350] k3s[882]: I0923 10:40:53.941247 882 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-6f57bb48cc-zgw9w" podStartSLOduration=1.941206018 podStartE2EDuration="1.941206018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-23 10:40:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-23 10:40:53.940543364 +0000 UTC m=+485.385600909" watchObservedRunningTime="2026-09-23 10:40:53.941206018 +0000 UTC m=+485.386263284" machine # [ 503.194573] k3s[882]: I0923 10:40:54.936280 882 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9b5362bf-e589-4c7d-81bd-e7c62be7466f" path="/var/lib/kubelet/pods/9b5362bf-e589-4c7d-81bd-e7c62be7466f/volumes" machine # [ 503.211208] nix[9951]: scheduler at 127.0.0.1:30051: failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:30051: tcp handshaker shutdown, reconnecting machine # [ 503.249847] dhcpcd[3442]: veth07909697: soliciting a DHCP lease machine # [ 504.008068] dhcpcd[3442]: veth07909697: soliciting an IPv6 router machine # [ 504.260292] nix[9951]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 504.262223] nix[9951]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-lh6xc: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 508.250842] dhcpcd[3442]: veth07909697: probing for an IPv4LL address machine # [ 512.540560] dhcpcd[3442]: veth07909697: using IPv4LL address 169.254.143.0 machine # [ 512.542442] dhcpcd[3442]: veth07909697: adding route to 169.254.0.0/16 machine # [ 516.013475] dhcpcd[3442]: veth07909697: no IPv6 Routers available machine # [ 549.201581] niks3-server[1184]: 2026/09/23 10:41:40 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 549.218467] niks3-server[1184]: 2026/09/23 10:41:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign machine # [ 549.220334] niks3-server[1184]: 2026/09/23 10:41:40 INFO Signed narinfos id=28 count=1 machine # [ 549.223585] niks3-server[1184]: 2026/09/23 10:41:40 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.ls machine # [ 549.226262] niks3-server[1184]: 2026/09/23 10:41:40 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete machine # [ 549.229735] niks3-server[1184]: 2026/09/23 10:41:40 INFO Completed upload id=28 machine # [ 549.234682] niks3-server[1184]: 2026/09/23 10:41:40 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.narinfo machine # [ 550.282843] systemd[1]: vialb.service: Deactivated successfully. machine # [ 550.286248] systemd[1]: vialb.service: Consumed 208ms CPU time over 50.913s wall clock time, 42.5M memory peak, 4K written to disk, 8.6K incoming IP traffic, 17.4K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active vialb, in 49.95 seconds) machine: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; }, in 0.03 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 0.25 seconds) (finished: subtest: losing the balancer mid-build: the client reconnects and the build succeeds, in 51.58 seconds) subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes machine: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 machine # [ 550.961931] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1. machine # Running as unit: slow.service; invocation ID: c963f9ea658a4996987856f46fd5f03a machine: (finished: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1, in 0.04 seconds) machine # [ 551.092556] nix[10975]: don't know how to build these paths: machine # [ 551.093823] nix[10975]: /nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 551.112912] nix[10975]: copying 1 paths to '127.0.0.1:30051'... machine # [ 551.114166] nix[10975]: copying path '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' to '127.0.0.1:30051'... machine # [ 551.148907] niks3-server[1184]: 2026/09/23 10:41:42 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 551.160115] niks3-server[1184]: 2026/09/23 10:41:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign machine # [ 551.161515] niks3-server[1184]: 2026/09/23 10:41:42 INFO Signed narinfos id=29 count=1 machine # [ 551.161950] niks3-server[1184]: 2026/09/23 10:41:42 INFO Registered completed upload object_key=nar/0wl2i9xpw0gwrx1xqdgx9ka4n503ky9qhl20pdrdlphn8d6lcx0i.nar.zst machine # [ 551.164818] niks3-server[1184]: 2026/09/23 10:41:42 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.ls machine # [ 551.167824] niks3-server[1184]: 2026/09/23 10:41:42 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete machine # command terminated with exit code 1 machine # [ 551.170323] k3s[882]: E0923 10:41:42.911387 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37918: use of closed network connection machine # [ 551.172172] niks3-server[1184]: 2026/09/23 10:41:42 INFO Completed upload id=29 machine # [ 551.173925] niks3-server[1184]: 2026/09/23 10:41:42 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.narinfo machine # [ 551.179832] nix[10975]: building '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' on 127.0.0.1:30051... machine # [ 551.180453] nix[10975]: slow-s1> machine/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-p4svn: building zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 551.348986] k3s[882]: E0923 10:41:43.090814 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37946: use of closed network connection machine # command terminated with exit code 1 machine # [ 552.637036] k3s[882]: E0923 10:41:44.378456 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37974: use of closed network connection machine # command terminated with exit code 1 machine # [ 552.818795] k3s[882]: E0923 10:41:44.560592 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38002: use of closed network connection machine # command terminated with exit code 1 machine # [ 554.070503] k3s[882]: E0923 10:41:45.812061 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54696: use of closed network connection machine # command terminated with exit code 1 machine # [ 554.266669] k3s[882]: E0923 10:41:46.008408 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54728: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 555.502606] k3s[882]: E0923 10:41:47.243750 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54760: use of closed network connection machine # [ 555.672667] k3s[882]: E0923 10:41:47.414446 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54786: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 558.425403] k3s[882]: E0923 10:41:50.166824 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54852: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 558.603123] k3s[882]: E0923 10:41:50.344125 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54888: use of closed network connection machine # [ 559.854759] k3s[882]: E0923 10:41:51.596239 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54920: use of closed network connection machine # command terminated with exit code 1 machine # [ 560.038444] k3s[882]: E0923 10:41:51.780227 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54956: use of closed network connection machine # command terminated with exit code 1 machine # [ 561.329341] k3s[882]: E0923 10:41:53.070867 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55004: use of closed network connection machine # command terminated with exit code 1 machine # [ 561.511719] k3s[882]: E0923 10:41:53.253561 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55024: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 562.765092] k3s[882]: E0923 10:41:54.506336 882 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:44076->127.0.0.1:10010: write tcp 127.0.0.1:44076->127.0.0.1:10010: write: broken pipe machine # [ 562.766428] k3s[882]: E0923 10:41:54.506370 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55052: use of closed network connection machine # [ 562.941651] k3s[882]: E0923 10:41:54.683469 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35020: use of closed network connection machine # command terminated with exit code 1 machine # [ 564.192859] k3s[882]: E0923 10:41:55.934433 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35054: use of closed network connection machine # command terminated with exit code 1 machine # [ 564.375346] k3s[882]: E0923 10:41:56.117091 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35066: use of closed network connection machine # command terminated with exit code 1 machine # [ 565.647958] k3s[882]: E0923 10:41:57.389492 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35076: use of closed network connection machine # command terminated with exit code 1 machine # [ 565.828801] k3s[882]: E0923 10:41:57.570617 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35104: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 567.259595] k3s[882]: E0923 10:41:59.000659 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35144: use of closed network connection machine # command terminated with exit code 1 machine # [ 568.541252] k3s[882]: time="2026-09-23T10:42:00Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:56946->127.0.0.1:10250: write: broken pipe" machine # [ 568.541925] k3s[882]: E0923 10:42:00.280287 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35162: use of closed network connection machine # [ 568.704692] k3s[882]: E0923 10:42:00.446511 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35190: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 569.946964] k3s[882]: E0923 10:42:01.687699 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35214: use of closed network connection machine # [ 570.112903] k3s[882]: E0923 10:42:01.854731 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35232: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 571.399829] k3s[882]: E0923 10:42:03.141152 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35272: use of closed network connection machine # command terminated with exit code 1 machine # [ 571.588134] k3s[882]: E0923 10:42:03.329193 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35306: use of closed network connection machine # command terminated with exit code 1 machine # [ 572.854988] k3s[882]: E0923 10:42:04.596181 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35344: use of closed network connection machine # [ 573.032168] k3s[882]: E0923 10:42:04.773761 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40692: use of closed network connection machine # command terminated with exit code 1 machine # [ 574.291598] k3s[882]: E0923 10:42:06.032800 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40704: use of closed network connection machine # command terminated with exit code 1 machine # [ 574.474832] k3s[882]: E0923 10:42:06.216563 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40724: use of closed network connection machine # command terminated with exit code 1 machine # [ 575.692645] k3s[882]: E0923 10:42:07.433829 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40760: use of closed network connection machine # command terminated with exit code 1 machine # [ 575.863698] k3s[882]: E0923 10:42:07.605530 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40798: use of closed network connection machine # command terminated with exit code 1 machine # [ 576.036043] k3s[882]: E0923 10:42:07.777801 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40836: use of closed network connection machine # [ 576.211411] k3s[882]: E0923 10:42:07.953146 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40876: use of closed network connection machine: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-cfb8578f6-p4svn --wait=false machine: (finished: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-cfb8578f6-p4svn --wait=false, in 0.14 seconds) machine: must succeed: sleep 5.0 machine # [ 576.387253] systemd[1]: cri-containerd-057c8cc9ede135aacad70fa87f7aca8cd76736fc050a219e79bde3e011e85ad6.scope: Deactivated successfully. machine # [ 576.388049] systemd[1]: cri-containerd-057c8cc9ede135aacad70fa87f7aca8cd76736fc050a219e79bde3e011e85ad6.scope: Consumed 492ms CPU time over 8min 48.176s wall clock time, 13.6M memory peak, 6.4M read from disk. machine # [ 576.423285] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-057c8cc9ede135aacad70fa87f7aca8cd76736fc050a219e79bde3e011e85ad6-rootfs.mount: Deactivated successfully. machine # [ 577.080104] systemd[1]: Created slice libcontainer container kubepods-besteffort-podd82f21a6_935d_48a4_a7ac_c53576639c62.slice. machine # [ 577.161937] k3s[882]: I0923 10:42:08.903498 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/d82f21a6-935d-48a4-a7ac-c53576639c62-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-zz7f4\" (UID: \"d82f21a6-935d-48a4-a7ac-c53576639c62\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-zz7f4" machine # [ 577.162662] k3s[882]: I0923 10:42:08.903543 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/d82f21a6-935d-48a4-a7ac-c53576639c62-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-zz7f4\" (UID: \"d82f21a6-935d-48a4-a7ac-c53576639c62\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-zz7f4" machine # [ 577.162799] k3s[882]: I0923 10:42:08.903593 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/d82f21a6-935d-48a4-a7ac-c53576639c62-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-zz7f4\" (UID: \"d82f21a6-935d-48a4-a7ac-c53576639c62\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-zz7f4" machine # [ 577.163452] k3s[882]: I0923 10:42:08.903623 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/d82f21a6-935d-48a4-a7ac-c53576639c62-build\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-zz7f4\" (UID: \"d82f21a6-935d-48a4-a7ac-c53576639c62\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-zz7f4" machine # [ 577.163962] k3s[882]: I0923 10:42:08.903830 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/d82f21a6-935d-48a4-a7ac-c53576639c62-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-zz7f4\" (UID: \"d82f21a6-935d-48a4-a7ac-c53576639c62\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-zz7f4" machine # [ 577.183988] k3s[882]: I0923 10:42:08.925847 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d82f21a6-935d-48a4-a7ac-c53576639c62-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-zz7f4\" (UID: \"d82f21a6-935d-48a4-a7ac-c53576639c62\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-zz7f4" machine # [ 577.184669] k3s[882]: I0923 10:42:08.925905 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/d82f21a6-935d-48a4-a7ac-c53576639c62-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-zz7f4\" (UID: \"d82f21a6-935d-48a4-a7ac-c53576639c62\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-zz7f4" machine # [ 577.193386] k3s[882]: I0923 10:42:08.935004 882 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7h7q\" (UniqueName: \"kubernetes.io/projected/d82f21a6-935d-48a4-a7ac-c53576639c62-kube-api-access-v7h7q\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-zz7f4\" (UID: \"d82f21a6-935d-48a4-a7ac-c53576639c62\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-zz7f4" machine # [ 577.579154] cni0: port 3(veth8f7cd0fa) entered blocking state machine # [ 577.580431] cni0: port 3(veth8f7cd0fa) entered disabled state machine # [ 577.581508] veth8f7cd0fa: entered allmulticast mode machine # [ 577.582525] veth8f7cd0fa: entered promiscuous mode machine # [ 577.589459] cni0: port 3(veth8f7cd0fa) entered blocking state machine # [ 577.590747] cni0: port 3(veth8f7cd0fa) entered forwarding state machine # [ 577.477424] (udev-worker)[12674]: Network interface NamePolicy= disabled on kernel command line. machine # [ 577.505163] dhcpcd[3442]: veth8f7cd0fa: IAID 41:08:3a:3c machine # [ 577.505929] dhcpcd[3442]: veth8f7cd0fa: adding address fe80::60ae:41ff:fe08:3a3c machine # [ 577.531431] systemd[1]: Started libcontainer container 13be2f4fa4319901bf0e3b70e14ccc171c6475c579db4d7eaa18d13a49f2a1f4. machine # [ 577.788562] systemd[1]: Started libcontainer container 58d6ba92e629cdfced2a1e618dcd62c4f7365b68eb0c6df24afcd17ffa139bca. machine # [ 578.749416] dhcpcd[3442]: veth8f7cd0fa: soliciting a DHCP lease machine # [ 579.022808] dhcpcd[3442]: veth8f7cd0fa: soliciting an IPv6 router machine # [ 579.799580] systemd[1]: cri-containerd-58d6ba92e629cdfced2a1e618dcd62c4f7365b68eb0c6df24afcd17ffa139bca.scope: Deactivated successfully. machine # [ 579.804331] systemd[1]: cri-containerd-58d6ba92e629cdfced2a1e618dcd62c4f7365b68eb0c6df24afcd17ffa139bca.scope: Consumed 878ms CPU time over 2.010s wall clock time, 446.8M memory peak, 161M read from disk, 187.7M written to disk. machine # [ 579.866506] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-58d6ba92e629cdfced2a1e618dcd62c4f7365b68eb0c6df24afcd17ffa139bca-rootfs.mount: Deactivated successfully. machine # [ 580.580738] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped2043088677.mount: Deactivated successfully. machine # [ 580.719878] systemd[1]: Started libcontainer container bb566bdf82e5a76d96c7efbf8cb6561c42466a4b460c48d27ae2aaf9a6823b1b. machine # [ 580.871230] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped2303204479.mount: Deactivated successfully. machine # [ 580.886271] systemd[1]: Started libcontainer container 5536d0ae1c859ee7e8f6a1a588937f2071d991a6e4793872278e7a5154a021f4. machine # [ 580.976292] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount3388704610.mount: Deactivated successfully. machine # [ 580.976873] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped552175704.mount: Deactivated successfully. machine # [ 581.038548] systemd[1]: Started libcontainer container 9d0d4b4bd9a3de4ce62c2437ea4f6c08c323719ac94a77459492cda6943b130d. machine: (finished: must succeed: sleep 5.0, in 5.02 seconds) machine # [ 581.555324] k3s[882]: I0923 10:42:13.296707 882 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-zz7f4" podStartSLOduration=3.32018574 podStartE2EDuration="5.296687502s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.976501762s" isStatefulPod=false podCreationTimestamp="2026-09-23 10:42:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-23 10:42:13.294565724 +0000 UTC m=+564.739618799" watchObservedRunningTime="2026-09-23 10:42:13.296687502 +0000 UTC m=+564.741740298" machine # [ 581.602178] k3s[882]: E0923 10:42:13.344038 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40916: use of closed network connection machine # command terminated with exit code 1 machine # [ 581.774860] k3s[882]: E0923 10:42:13.516701 882 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40934: use of closed network connection machine: waiting for success: ! systemctl is-active slow machine # [ 583.750547] dhcpcd[3442]: veth8f7cd0fa: probing for an IPv4LL address machine # [ 589.167646] dhcpcd[3442]: veth8f7cd0fa: using IPv4LL address 169.254.114.97 machine # [ 589.173555] dhcpcd[3442]: veth8f7cd0fa: adding route to 169.254.0.0/16 machine # [ 591.027886] dhcpcd[3442]: veth8f7cd0fa: no IPv6 Routers available machine # [ 595.723754] niks3-server[1184]: 2026/09/23 10:42:27 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 595.739583] niks3-server[1184]: 2026/09/23 10:42:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign machine # [ 595.744940] niks3-server[1184]: 2026/09/23 10:42:27 INFO Signed narinfos id=30 count=1 machine # [ 595.748616] niks3-server[1184]: 2026/09/23 10:42:27 INFO Registered completed upload object_key=log/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 595.753930] niks3-server[1184]: 2026/09/23 10:42:27 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.ls machine # [ 595.759368] niks3-server[1184]: 2026/09/23 10:42:27 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete machine # [ 595.763429] niks3-server[1184]: 2026/09/23 10:42:27 INFO Completed upload id=30 machine # [ 595.765856] niks3-server[1184]: 2026/09/23 10:42:27 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo machine # [ 595.792981] systemd[1]: slow.service: Deactivated successfully. machine # [ 595.795267] systemd[1]: slow.service: Consumed 148ms CPU time over 44.830s wall clock time, 40.1M memory peak, 4K written to disk, 5.3K incoming IP traffic, 11.5K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active slow, in 14.56 seconds) machine: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; }, in 0.04 seconds) machine: must fail: journalctl -u slow | grep -q 'asking the scheduler again' machine: (finished: must fail: journalctl -u slow | grep -q 'asking the scheduler again', in 0.03 seconds) machine: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath machine # [ 596.494772] systemd[1]: cri-containerd-1f6a0bfbb17a4d2d69435682d58467b5846fa221778e5f52dd0397a94bafacba.scope: Deactivated successfully. machine # [ 596.496070] systemd[1]: cri-containerd-1f6a0bfbb17a4d2d69435682d58467b5846fa221778e5f52dd0397a94bafacba.scope: Consumed 3.109s CPU time over 9min 8.617s wall clock time, 75M memory peak, 38.1M read from disk, 275.6K incoming IP traffic, 340.8K outgoing IP traffic. machine # [ 596.538819] systemd[1]: cri-containerd-5fa5c1c3aca1ffdbc05890039ed50d9ee6443bdb7bb0461be0416a4d5cf1c5f4.scope: Deactivated successfully. machine # [ 596.540592] systemd[1]: cri-containerd-5fa5c1c3aca1ffdbc05890039ed50d9ee6443bdb7bb0461be0416a4d5cf1c5f4.scope: Consumed 22.022s CPU time over 9min 8.915s wall clock time, 36.3M memory peak, 19M read from disk, 1.1M written to disk, 50.2K incoming IP traffic, 34.9K outgoing IP traffic. machine: (finished: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath, in 0.14 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null machine # [ 596.547273] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-1f6a0bfbb17a4d2d69435682d58467b5846fa221778e5f52dd0397a94bafacba-rootfs.mount: Deactivated successfully. machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null, in 0.03 seconds) (finished: subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes, in 45.64 seconds) (finished: run the VM test script, in 597.48 seconds) machine # [ 596.582050] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-5fa5c1c3aca1ffdbc05890039ed50d9ee6443bdb7bb0461be0416a4d5cf1c5f4-rootfs.mount: Deactivated successfully. test script finished in 597.51s cleanup kill QemuMachine (pid 45) machine # [ 596.602191] systemd[1]: cri-containerd-44a6ef87180e57582c0db2c6fa080c4875709e8ea8e6fdc03d670966839108c7.scope: Deactivated successfullyqemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) machine # .[2026-09-23T10:42:29Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-09-23T10:42:29Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-09-23T10:42:29Z INFO virtiofsd] Client disconnected, shutting down (finished: cleanup, in 0.96 seconds) additionally exposed symbols: machine, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh