tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 1200.0 seconds run the VM test script machine: waiting for unit k3s.service machine: waiting for the VM to finish booting machine: starting vm machine # Disk image does not exist, creating the virtualisation disk image... machine: QEMU running (pid 45) machine # Formatting '/build/vm-state-machine/tmp.Ux6ZbkSnQA', fmt=raw size=17179869184 machine # mke2fs 1.47.4 (6-Mar-2025) machine # Discarding device blocks: 0/4194304 done machine # Creating filesystem with 4194304 4k blocks and 1048576 inodes machine # Filesystem UUID: 8763d140-24b0-44d9-9fc9-07e1b064f2fe machine # Superblock backups stored on blocks: machine # 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208, machine # 4096000 machine # machine # Allocating group tables: 0/128 done machine # Writing inode tables: 0/128 done machine # Creating journal (32768 blocks): done machine # Writing superblocks and filesystem accounting information: 0/128 done machine # machine # Virtualisation disk image created. machine # Starting virtiofs daemons... machine # [2026-09-23T04:41:54Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-23T04:41:54Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-23T04:41:54Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-23T04:41:54Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-23T04:41:54Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-23T04:41:54Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-23T04:41:54Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-23T04:41:54Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-23T04:41:54Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-23T04:41:54Z INFO virtiofsd] Client connected, servicing requests machine # [2026-09-23T04:41:54Z INFO virtiofsd] Client connected, servicing requests machine # [2026-09-23T04:41:54Z INFO virtiofsd] Client connected, servicing requests machine # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) machine # machine # machine # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+7EFCC730+7EF2C730 CA00 machine # Press Ctrl-B to configure iPXE (PCI 00:02.0)... machine # machine # machine # machine # machine # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 7EFCC730 7EF2C730 CB00 machine # Press Ctrl-B to configure iPXE (PCI 00:05.0)... machine # machine # machine # Booting from ROM... machine # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 machine # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/i5vsm9kabmwpf9hxpymdbjd6p1qrpzma-nixos-system-machine-test/init regInfo=/nix/store/yw49giy5qpc2hd0nfjzfqxq41xrby2ni-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.000000] BIOS-provided physical RAM map: machine # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007ffd7fff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000007ffd8000-0x000000007fffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000017fffffff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved machine # [ 0.000000] NX (Execute Disable) protection: active machine # [ 0.000000] APIC: Static calls initialized machine # [ 0.000000] SMBIOS 2.8 present. machine # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 machine # [ 0.000000] DMI: Memory slots populated: 1/1 machine # [ 0.000000] Hypervisor detected: KVM machine # [ 0.000000] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 machine # [ 0.000001] kvm-clock: using sched offset of 477919691 cycles machine # [ 0.000003] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns machine # [ 0.000005] tsc: Detected 2400.012 MHz processor machine # [ 0.000818] last_pfn = 0x180000 max_arch_pfn = 0x10000000000 machine # [ 0.000846] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs machine # [ 0.000848] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT machine # [ 0.000896] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.002758] found SMP MP-table at [mem 0x000f5450-0x000f545f] machine # [ 0.002771] Using GB pages for direct mapping machine # [ 0.002910] RAMDISK: [mem 0x7e371000-0x7ffcffff] machine # [ 0.002919] ACPI: Early table checksum verification disabled machine # [ 0.002923] ACPI: RSDP 0x00000000000F5250 000014 (v00 BOCHS ) machine # [ 0.002927] ACPI: RSDT 0x000000007FFE2539 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002932] ACPI: FACP 0x000000007FFE2319 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002939] ACPI: DSDT 0x000000007FFE0040 0022D9 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002941] ACPI: FACS 0x000000007FFE0000 000040 machine # [ 0.002942] ACPI: APIC 0x000000007FFE240D 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002944] ACPI: HPET 0x000000007FFE249D 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002945] ACPI: MCFG 0x000000007FFE24D5 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002947] ACPI: WAET 0x000000007FFE2511 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002948] ACPI: Reserving FACP table memory at [mem 0x7ffe2319-0x7ffe240c] machine # [ 0.002949] ACPI: Reserving DSDT table memory at [mem 0x7ffe0040-0x7ffe2318] machine # [ 0.002950] ACPI: Reserving FACS table memory at [mem 0x7ffe0000-0x7ffe003f] machine # [ 0.002950] ACPI: Reserving APIC table memory at [mem 0x7ffe240d-0x7ffe249c] machine # [ 0.002951] ACPI: Reserving HPET table memory at [mem 0x7ffe249d-0x7ffe24d4] machine # [ 0.002951] ACPI: Reserving MCFG table memory at [mem 0x7ffe24d5-0x7ffe2510] machine # [ 0.002952] ACPI: Reserving WAET table memory at [mem 0x7ffe2511-0x7ffe2538] machine # [ 0.003179] No NUMA configuration found machine # [ 0.003180] Faking a node at [mem 0x0000000000000000-0x000000017fffffff] machine # [ 0.003183] NODE_DATA(0) allocated [mem 0x17fff8780-0x17fffdcff] machine # [ 0.005994] Zone ranges: machine # [ 0.005996] DMA [mem 0x0000000000001000-0x0000000000ffffff] machine # [ 0.005997] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] machine # [ 0.005999] Normal [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.006000] Device empty machine # [ 0.006000] Movable zone start for each node machine # [ 0.006001] Early memory node ranges machine # [ 0.006002] node 0: [mem 0x0000000000001000-0x000000000009efff] machine # [ 0.006003] node 0: [mem 0x0000000000100000-0x000000007ffd7fff] machine # [ 0.006004] node 0: [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.006005] Initmem setup node 0 [mem 0x0000000000001000-0x000000017fffffff] machine # [ 0.006258] On node 0, zone DMA: 1 pages in unavailable ranges machine # [ 0.006557] On node 0, zone DMA: 97 pages in unavailable ranges machine # [ 0.086570] On node 0, zone Normal: 40 pages in unavailable ranges machine # [ 0.087080] ACPI: PM-Timer IO Port: 0x608 machine # [ 0.087097] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) machine # [ 0.087133] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 machine # [ 0.087136] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) machine # [ 0.087138] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) machine # [ 0.087139] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) machine # [ 0.087140] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) machine # [ 0.087141] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) machine # [ 0.087143] ACPI: Using ACPI (MADT) for SMP configuration information machine # [ 0.087145] ACPI: HPET id: 0x8086a201 base: 0xfed00000 machine # [ 0.087150] TSC deadline timer available machine # [ 0.087155] CPU topo: Max. logical packages: 1 machine # [ 0.087155] CPU topo: Max. logical dies: 1 machine # [ 0.087156] CPU topo: Max. dies per package: 1 machine # [ 0.087159] CPU topo: Max. threads per core: 1 machine # [ 0.087160] CPU topo: Num. cores per package: 4 machine # [ 0.087160] CPU topo: Num. threads per package: 4 machine # [ 0.087160] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs machine # [ 0.087186] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() machine # [ 0.087202] kvm-guest: KVM setup pv remote TLB flush machine # [ 0.087205] kvm-guest: setup PV sched yield machine # [ 0.087216] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] machine # [ 0.087217] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] machine # [ 0.087218] PM: hibernation: Registered nosave memory: [mem 0x7ffd8000-0xffffffff] machine # [ 0.087220] [mem 0xc0000000-0xfed1bfff] available for PCI devices machine # [ 0.087222] Booting paravirtualized kernel on KVM machine # [ 0.087226] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns machine # [ 0.091788] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 machine # [ 0.094172] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288 machine # [ 0.094225] kvm-guest: PV spinlocks enabled machine # [ 0.094226] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) machine # [ 0.094229] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/i5vsm9kabmwpf9hxpymdbjd6p1qrpzma-nixos-system-machine-test/init regInfo=/nix/store/yw49giy5qpc2hd0nfjzfqxq41xrby2ni-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.094329] Unknown kernel command line parameters "regInfo=/nix/store/yw49giy5qpc2hd0nfjzfqxq41xrby2ni-closure-info/registration", will be passed to user space. machine # [ 0.094343] random: crng init done machine # [ 0.094344] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes machine # [ 0.099242] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) machine # [ 0.101539] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) machine # [ 0.101620] software IO TLB: area num 4. machine # [ 0.183245] Fallback order for Node 0: 0 machine # [ 0.183254] Built 1 zonelists, mobility grouping on. Total pages: 1048438 machine # [ 0.183257] Policy zone: Normal machine # [ 0.185953] mem auto-init: stack:all(zero), heap alloc:on, heap free:off machine # [ 0.194123] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 machine # [ 0.204162] allocated 8388608 bytes of page_ext machine # [ 0.214833] ftrace: allocating 48787 entries in 192 pages machine # [ 0.214836] ftrace: allocated 192 pages with 2 groups machine # [ 0.215863] Dynamic Preempt: lazy machine # [ 0.216100] rcu: Preemptible hierarchical RCU implementation. machine # [ 0.216101] rcu: RCU event tracing is enabled. machine # [ 0.216101] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. machine # [ 0.216103] Trampoline variant of Tasks RCU enabled. machine # [ 0.216104] Rude variant of Tasks RCU enabled. machine # [ 0.216104] Tracing variant of Tasks RCU enabled. machine # [ 0.216104] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. machine # [ 0.216105] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 machine # [ 0.216135] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.216137] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.216138] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.220659] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16 machine # [ 0.220996] rcu: srcu_init: Setting srcu_struct sizes based on contention. machine # [ 0.221006] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns machine # [ 0.221132] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) machine # [ 0.224820] Console: colour VGA+ 80x25 machine # [ 0.224824] printk: legacy console [tty0] enabled machine # [ 0.256664] printk: legacy console [ttyS0] enabled machine # [ 0.369898] ACPI: Core revision 20250807 machine # [ 0.370832] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns machine # [ 0.372460] APIC: Switch to symmetric I/O mode setup machine # [ 0.373557] x2apic enabled machine # [ 0.374334] APIC: Switched APIC routing to: physical x2apic machine # [ 0.375290] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask() machine # [ 0.376599] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself() machine # [ 0.378157] kvm-guest: setup PV IPIs machine # [ 0.379823] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 machine # [ 0.380949] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.385390] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) machine # [ 0.387486] x86/cpu: User Mode Instruction Prevention (UMIP) activated machine # [ 0.388525] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 machine # [ 0.390165] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 machine # [ 0.391243] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto machine # [ 0.392387] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl machine # [ 0.394387] Transient Scheduler Attacks: Vulnerable: No microcode machine # [ 0.395386] Spectre V2 : Mitigation: Enhanced / Automatic IBRS machine # [ 0.396387] Speculative Return Stack Overflow: Mitigation: Safe RET machine # [ 0.397386] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization machine # [ 0.398395] Spectre V2 : Enabling IBPB for BPF machine # [ 0.399189] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier machine # [ 0.400388] active return thunk: srso_alias_return_thunk machine # [ 0.401420] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' machine # [ 0.402387] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' machine # [ 0.403386] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' machine # [ 0.405233] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' machine # [ 0.406386] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' machine # [ 0.407386] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' machine # [ 0.408386] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' machine # [ 0.409387] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 machine # [ 0.410386] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 machine # [ 0.412201] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 machine # [ 0.413212] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 machine # [ 0.414386] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 machine # [ 0.415386] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. machine # [ 0.446220] Freeing SMP alternatives memory: 44K machine # [ 0.447017] pid_max: default: 32768 minimum: 301 machine # [ 0.447489] LSM: initializing lsm=capability,landlock,yama,bpf,ima machine # [ 0.448498] landlock: Up and running. machine # [ 0.449883] Yama: becoming mindful. machine # [ 0.450610] LSM support for eBPF active machine # [ 0.451567] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.452469] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.455884] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) machine # [ 0.456991] Performance Events: Fam17h+ core perfctr, AMD PMU driver. machine # [ 0.457392] ... version: 2 machine # [ 0.458151] ... bit width: 48 machine # [ 0.458389] ... generic counters: 6 machine # [ 0.459171] ... generic bitmap: 000000000000003f machine # [ 0.460169] ... fixed-purpose counters: 0 machine # [ 0.460389] ... fixed-purpose bitmap: 0000000000000000 machine # [ 0.461389] ... value mask: 0000ffffffffffff machine # [ 0.462364] ... max period: 00007fffffffffff machine # [ 0.463209] ... global_ctrl mask: 000000000000003f machine # [ 0.464251] signal: max sigframe size: 3376 machine # [ 0.465066] rcu: Hierarchical SRCU implementation. machine # [ 0.465393] rcu: Max phase no-delay instances is 400. machine # [ 0.466468] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level machine # [ 0.472076] smp: Bringing up secondary CPUs ... machine # [ 0.472816] smpboot: x86: Booting SMP configuration: machine # [ 0.473393] .... node #0, CPUs: #1 #2 #3 machine # [ 0.475543] smp: Brought up 1 node, 4 CPUs machine # [ 0.477390] smpboot: Total of 4 processors activated (19200.09 BogoMIPS) machine # [ 0.478786] Memory: 3957820K/4193752K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 220856K reserved, 0K cma-reserved) machine # [ 0.479724] devtmpfs: initialized machine # [ 0.481041] x86/mm: Memory block size: 128MB machine # [ 0.483484] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.484479] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). machine # [ 0.485502] pinctrl core: initialized pinctrl subsystem machine # [ 0.486703] PM: RTC time: 04:41:54, date: 2026-09-23 machine # [ 0.491092] NET: Registered PF_NETLINK/PF_ROUTE protocol family machine # [ 0.492519] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations machine # [ 0.493452] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations machine # [ 0.495188] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations machine # [ 0.496402] audit: initializing netlink subsys (disabled) machine # [ 0.497417] audit: type=2000 audit(1790138515.599:1): state=initialized audit_enabled=0 res=1 machine # [ 0.497691] thermal_sys: Registered thermal governor 'fair_share' machine # [ 0.499390] thermal_sys: Registered thermal governor 'bang_bang' machine # [ 0.500389] thermal_sys: Registered thermal governor 'step_wise' machine # [ 0.501389] thermal_sys: Registered thermal governor 'user_space' machine # [ 0.502389] thermal_sys: Registered thermal governor 'power_allocator' machine # [ 0.503422] cpuidle: using governor menu machine # [ 0.505598] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 machine # [ 0.506715] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] machine # [ 0.507394] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry machine # [ 0.508404] PCI: Using configuration type 1 for base access machine # [ 0.509520] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. machine # [ 0.511653] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages machine # [ 0.513364] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page machine # [ 0.514268] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages machine # [ 0.515319] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page machine # [ 0.519324] ACPI: Added _OSI(Module Device) machine # [ 0.520189] ACPI: Added _OSI(Processor Device) machine # [ 0.520390] ACPI: Added _OSI(Processor Aggregator Device) machine # [ 0.524109] ACPI: 1 ACPI AML tables successfully acquired and loaded machine # [ 0.528719] ACPI: Interpreter enabled machine # [ 0.530102] ACPI: PM: (supports S0 S3 S4 S5) machine # [ 0.530391] ACPI: Using IOAPIC for interrupt routing machine # [ 0.531442] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug machine # [ 0.532392] PCI: Using E820 reservations for host bridge windows machine # [ 0.533587] ACPI: Enabled 2 GPEs in block 00 to 3F machine # [ 0.539125] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) machine # [ 0.540397] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] machine # [ 0.542506] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] machine # [ 0.543516] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] machine # [ 0.544857] PCI host bridge to bus 0000:00 machine # [ 0.546394] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] machine # [ 0.547389] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] machine # [ 0.548390] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] machine # [ 0.549389] pci_bus 0000:00: root bus resource [mem 0x80000000-0xafffffff window] machine # [ 0.550390] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] machine # [ 0.552389] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.553389] pci_bus 0000:00: root bus resource [bus 00-ff] machine # [ 0.554543] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint machine # [ 0.556905] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint machine # [ 0.571481] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] machine # [ 0.572401] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] machine # [ 0.573410] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] machine # [ 0.574747] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] machine # [ 0.577150] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.582407] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] machine # [ 0.583396] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] machine # [ 0.584410] pci 0000:00:02.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref] machine # [ 0.585395] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] machine # [ 0.586951] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.591406] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] machine # [ 0.592298] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] machine # [ 0.594213] pci 0000:00:03.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref] machine # [ 0.595946] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint machine # [ 0.600415] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] machine # [ 0.602072] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] machine # [ 0.603413] pci 0000:00:04.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref] machine # [ 0.605521] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.613414] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] machine # [ 0.617410] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] machine # [ 0.619448] pci 0000:00:05.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref] machine # [ 0.622409] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] machine # [ 0.626853] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint machine # [ 0.634474] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] machine # [ 0.637450] pci 0000:00:06.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref] machine # [ 0.640489] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.646444] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] machine # [ 0.648470] pci 0000:00:07.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref] machine # [ 0.652751] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.657295] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] machine # [ 0.669260] pci 0000:00:08.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref] machine # [ 0.671031] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.676435] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] machine # [ 0.677413] pci 0000:00:09.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref] machine # [ 0.680407] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint machine # [ 0.686515] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] machine # [ 0.688077] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] machine # [ 0.689411] pci 0000:00:0a.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref] machine # [ 0.690972] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.695430] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] machine # [ 0.696335] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] machine # [ 0.698439] pci 0000:00:0b.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref] machine # [ 0.699974] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.702202] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] machine # [ 0.703282] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.706272] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] machine # [ 0.707302] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.709115] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] machine # [ 0.710611] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint machine # [ 0.713099] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] machine # [ 0.714630] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint machine # [ 0.715713] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO machine # [ 0.717642] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint machine # [ 0.720437] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] machine # [ 0.721332] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] machine # [ 0.723605] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint machine # [ 0.725220] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] machine # [ 0.729413] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 machine # [ 0.730500] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 machine # [ 0.731493] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 machine # [ 0.732491] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 machine # [ 0.733489] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 machine # [ 0.734487] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 machine # [ 0.735495] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 machine # [ 0.736502] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 machine # [ 0.738424] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 machine # [ 0.739405] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 machine # [ 0.740402] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 machine # [ 0.741406] ACPI: PCI: Interrupt link GSID configured for IRQ 19 machine # [ 0.742398] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 machine # [ 0.743479] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 machine # [ 0.744225] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 machine # [ 0.745163] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 machine # [ 0.748623] iommu: Default domain type: Translated machine # [ 0.749017] iommu: DMA domain TLB invalidation policy: lazy mode machine # [ 0.750647] ACPI: bus type USB registered machine # [ 0.751459] usbcore: registered new interface driver usbfs machine # [ 0.752405] usbcore: registered new interface driver hub machine # [ 0.753332] usbcore: registered new device driver usb machine # [ 0.755339] NetLabel: Initializing machine # [ 0.755836] NetLabel: domain hash size = 128 machine # [ 0.756389] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO machine # [ 0.757412] NetLabel: unlabeled traffic allowed by default machine # [ 0.758396] PCI: Using ACPI for IRQ routing machine # [ 0.801670] pci 0000:00:01.0: vgaarb: setting as boot VGA device machine # [ 0.802385] pci 0000:00:01.0: vgaarb: bridge control possible machine # [ 0.802385] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none machine # [ 0.805399] vgaarb: loaded machine # [ 0.806206] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 machine # [ 0.807082] hpet0: 3 comparators, 64-bit 100.000000 MHz counter machine # [ 0.812390] clocksource: Switched to clocksource kvm-clock machine # [ 0.816743] VFS: Disk quotas dquot_6.6.0 machine # [ 0.817489] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) machine # [ 0.819121] pnp: PnP ACPI init machine # [ 0.820033] ACPI: IRQ 4 override to edge(!), high(!) machine # [ 0.821062] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved machine # [ 0.822685] pnp: PnP ACPI: found 5 devices machine # [ 0.832395] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns machine # [ 0.834282] clocksource: Switched to clocksource acpi_pm machine # [ 0.835420] NET: Registered PF_INET protocol family machine # [ 0.837106] IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear) machine # [ 0.854953] tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.856522] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) machine # [ 0.858005] TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear) machine # [ 0.859509] TCP bind hash table entries: 32768 (order: 8, 1048576 bytes, linear) machine # [ 0.860868] TCP: Hash tables configured (established 32768 bind 32768) machine # [ 0.862408] MPTCP token hash table entries: 4096 (order: 5, 98304 bytes, linear) machine # [ 0.863930] UDP hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.865270] UDP-Lite hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.866695] NET: Registered PF_UNIX/PF_LOCAL protocol family machine # [ 0.867686] NET: Registered PF_XDP protocol family machine # [ 0.868563] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] machine # [ 0.869657] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] machine # [ 0.870716] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] machine # [ 0.871874] pci_bus 0000:00: resource 7 [mem 0x80000000-0xafffffff window] machine # [ 0.873048] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] machine # [ 0.874211] pci_bus 0000:00: resource 9 [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.876215] ACPI: \_SB_.GSIA: Enabled at IRQ 16 machine # [ 0.879062] ACPI: \_SB_.GSIB: Enabled at IRQ 17 machine # [ 0.881697] ACPI: \_SB_.GSIC: Enabled at IRQ 18 machine # [ 0.884206] ACPI: \_SB_.GSID: Enabled at IRQ 19 machine # [ 0.886460] PCI: CLS 0 bytes, default 64 machine # [ 0.887428] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) machine # [ 0.887980] Trying to unpack rootfs image as initramfs... machine # [ 0.888554] software IO TLB: mapped [mem 0x000000007a371000-0x000000007e371000] (64MB) machine # [ 0.888690] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.912737] Initialise system trusted keyrings machine # [ 0.914061] workingset: timestamp_bits=40 max_order=20 bucket_order=0 machine # [ 0.925622] Key type asymmetric registered machine # [ 0.926367] Asymmetric key parser 'x509' registered machine # [ 0.927272] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) machine # [ 0.929084] io scheduler mq-deadline registered machine # [ 0.929916] io scheduler kyber registered machine # [ 0.938963] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled machine # [ 0.940400] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A machine # [ 0.942851] Linux agpgart interface v0.103 machine # [ 0.943742] ACPI: bus type drm_connector registered machine # [ 0.946981] usbcore: registered new interface driver usbserial_generic machine # [ 0.948154] usbserial: USB Serial support registered for generic machine # [ 0.949206] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. machine # [ 0.949206] Please enable it if your BIOS has the CPPC option. machine # [ 0.951557] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled machine # [ 0.953018] drop_monitor: Initializing network drop monitor service machine # [ 0.954275] NET: Registered PF_INET6 protocol family machine # [ 0.955974] Segment Routing with IPv6 machine # [ 0.956707] In-situ OAM (IOAM) with IPv6 machine # [ 0.958754] IPI shorthand broadcast: enabled machine # [ 0.963331] sched_clock: Marking stable (807010312, 155379838)->(982246538, -19856388) machine # [ 0.965263] registered taskstats version 1 machine # [ 0.966441] Loading compiled-in X.509 certificates machine # [ 0.976873] Demotion targets for Node 0: null machine # [ 0.977918] Key type .fscrypt registered machine # [ 0.978664] Key type fscrypt-provisioning registered machine # [ 0.979682] ima: No TPM chip found, activating TPM-bypass! machine # [ 0.980680] ima: Allocated hash algorithm: sha1 machine # [ 0.981518] ima: No architecture policies found machine # [ 0.982642] PM: Magic number: 10:302:667 machine # [ 0.984353] RAS: Correctable Errors collector initialized. machine # [ 0.988940] clk: Disabling unused clocks machine # [ 0.989906] PM: genpd: Disabling unused power domains machine # [ 1.194772] Freeing initrd memory: 29052K machine # [ 1.199055] Freeing unused decrypted memory: 2028K machine # [ 1.202004] Freeing unused kernel image (initmem) memory: 3652K machine # [ 1.203184] Write protecting the kernel read-only data: 32768k machine # [ 1.205366] Freeing unused kernel image (text/rodata gap) memory: 1184K machine # [ 1.207086] Freeing unused kernel image (rodata/data gap) memory: 720K machine # [ 1.258182] x86/mm: Checked W+X mappings: passed, no W+X pages found. machine # [ 1.259301] Run /init as init process machine # [ 1.274665] systemd[1]: Inserted module 'autofs4' machine # [ 1.298577] fuse: init (API version 7.45) machine # [ 1.307371] ACPI: \_SB_.GSIG: Enabled at IRQ 22 machine # [ 1.310574] ACPI: \_SB_.GSIH: Enabled at IRQ 23 machine # [ 1.314177] ACPI: \_SB_.GSIE: Enabled at IRQ 20 machine # [ 1.316563] ACPI: \_SB_.GSIF: Enabled at IRQ 21 machine # [ 1.321945] virtiofs virtio5: discovered new tag: nix-store machine # [ 1.323584] virtiofs virtio5: virtio_fs_setup_dax: No cache capability machine # [ 1.331176] virtiofs virtio6: discovered new tag: shared machine # [ 1.344019] virtiofs virtio6: virtio_fs_setup_dax: No cache capability machine # [ 1.347630] virtiofs virtio7: discovered new tag: xchg machine # [ 1.349095] virtiofs virtio7: virtio_fs_setup_dax: No cache capability machine # [ 1.380258] systemd[1]: Successfully made /usr/ read-only. machine # [ 1.719485] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 1.731884] systemd[1]: Detected virtualization kvm. machine # [ 1.734136] systemd[1]: Detected architecture x86-64. machine # [ 1.736343] systemd[1]: Running in initrd. machine # [ 1.739026] systemd[1]: Initializing machine ID from random generator. machine # [ 1.742100] systemd[1]: Hostname set to . machine # [ 1.863846] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 1.901545] systemd[1]: Queued start job for default target Initrd Default Target. machine # [ 1.911965] systemd[1]: Created slice Slice /system/modprobe. machine # [ 1.913229] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 1.914912] systemd[1]: Expecting device /dev/disk/by-label/nixos... machine # [ 1.916100] systemd[1]: Reached target Path Units. machine # [ 1.917003] systemd[1]: Reached target Slice Units. machine # [ 1.918074] systemd[1]: Reached target Swaps. machine # [ 1.918987] systemd[1]: Reached target Timer Units. machine # [ 1.920098] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 1.921447] systemd[1]: Listening on Journal Socket (/dev/log). machine # [ 1.922688] systemd[1]: Listening on Journal Sockets. machine # [ 1.923716] systemd[1]: Listening on udev Control Socket. machine # [ 1.924769] systemd[1]: Listening on udev Kernel Socket. machine # [ 1.925810] systemd[1]: Reached target Socket Units. machine # [ 1.927944] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 1.930031] systemd[1]: Starting Load Kernel Module configfs... machine # [ 1.933046] systemd[1]: Starting Journal Service... machine # [ 1.934888] systemd[1]: Starting Load Kernel Modules... machine # [ 1.937484] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 1.939987] systemd[1]: Starting Coldplug All udev Devices... machine # [ 1.943137] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 1.947777] systemd[1]: Finished Load Kernel Module configfs. machine # [ 1.949817] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config machine # [ 1.954968] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 1.960530] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 1.967726] systemd-journald[90]: Collecting audit messages is disabled. machine # [ 1.974264] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. machine # [ 1.976538] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev machine # [ 1.979097] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 1.981346] systemd[1]: Finished Load Kernel Modules. machine # [ 1.983661] systemd[1]: Starting Apply Kernel Variables... machine # [ 1.985461] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 2.000844] systemd[1]: Finished Apply Kernel Variables. machine # [ 2.007335] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 2.008757] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 2.010026] systemd[1]: Reached target Local File Systems. machine # [ 1.854840] systemd-modules-load[91]: Using 4 probe threads machine # [ 1.857077] systemd-modules-l[ 2.012336] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # oad[91]: Inserted module 'virtio_balloon' machine # [ 2.013911] systemd[1]: Started Journal Service. machine # [ 1.859185] systemd-modules-load[91]: Inserted module 'virtio_gpu' machine # [ 1.860617] systemd-modules-load[91]: Inserted module 'dm_mod' machine # [ 1.863789] systemd[1]: Starting Create System Files and Directories... machine # [ 1.878902] systemd[1]: Finished Create System Files and Directories. machine # [ 1.892526] systemd-udevd[105]: Using default interface naming scheme 'v261'. machine # [ 1.902649] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 1.925070] systemd[1]: Finished Coldplug All udev Devices. machine # [ 1.925978] systemd[1]: Reached target System Initialization. machine # [ 1.926811] systemd[1]: Reached target Basic System. machine # [ 2.154550] virtio_blk virtio2: 4/0/0 default/read/poll queues machine # [ 2.160320] virtio_blk virtio2: [vda] 33554432 512-byte logical blocks (17.2 GB/16.0 GiB) machine # [ 2.175770] uhci_hcd 0000:00:1d.0: UHCI Host Controller machine # [ 2.177055] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 1 machine # [ 2.178442] uhci_hcd 0000:00:1d.0: detected 2 ports machine # [ 2.181280] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 machine # [ 2.182644] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.183931] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.185075] usb usb1: Product: UHCI Host Controller machine # [ 2.185904] usb usb1: Manufacturer: Linux 6.18.52 uhci_hcd machine # [ 2.186836] usb usb1: SerialNumber: 0000:00:1d.0 machine # [ 2.200431] hub 1-0:1.0: USB hub found machine # [ 2.201105] hub 1-0:1.0: 2 ports detected machine # [ 2.224094] ehci-pci 0000:00:1d.7: EHCI Host Controller machine # [ 2.225535] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 2 machine # [ 2.226925] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 machine # [ 2.073576] systemd[1]: Starting Virtual Console Setup... machine # [ 2.235446] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 machine # [ 2.236345] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 machine # [ 2.237514] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.238616] usb usb2: Product: EHCI Host Controller machine # [ 2.239340] usb usb2: Manufacturer: Linux 6.18.52 ehci_hcd machine # [ 2.240143] usb usb2: SerialNumber: 0000:00:1d.7 machine # [ 2.241094] hub 2-0:1.0: USB hub found machine # [ 2.241790] hub 2-0:1.0: 6 ports detected machine # [ 2.100299] systemd-vconsole-setup[143]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 2.102091] systemd[1]: Finished Virtual Console Setup. machine # [ 2.264541] hub 1-0:1.0: USB hub found machine # [ 2.265170] hub 1-0:1.0: 2 ports detected machine # [ 2.266132] uhci_hcd 0000:00:1d.1: UHCI Host Controller machine # [ 2.268442] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 machine # [ 2.269643] uhci_hcd 0000:00:1d.1: detected 2 ports machine # [ 2.271363] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 machine # [ 2.272827] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 machine # [ 2.275542] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.277719] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.279135] usb usb3: Product: UHCI Host Controller machine # [ 2.279306] serio: i8042 KBD port at 0x60,0x64 irq 1 machine # [ 2.279416] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd machine # [ 2.279418] usb usb3: SerialNumber: 0000:00:1d.1 machine # [ 2.280251] serio: i8042 AUX port at 0x60,0x64 irq 12 machine # [ 2.280699] hub 3-0:1.0: USB hub found machine # [ 2.285096] hub 3-0:1.0: 2 ports detected machine # [ 2.287119] SCSI subsystem initialized machine # [ 2.287891] uhci_hcd 0000:00:1d.2: UHCI Host Controller machine # [ 2.289282] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 machine # [ 2.290787] uhci_hcd 0000:00:1d.2: detected 2 ports machine # [ 2.291601] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 machine # [ 2.292614] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.138162] (udev-worker)[122]: Network interface NamePolicy= disabled on kernel command line.[ 2.293881] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # machine # [ 2.295975] usb usb4: Product: UHCI Host Controller machine # [ 2.296803] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd machine # [ 2.297759] usb usb4: SerialNumber: 0000:00:1d.2 machine # [ 2.299515] hub 4-0:1.0: USB hub found machine # [ 2.300118] hub 4-0:1.0: 2 ports detected machine # [ 2.145934] (udev-worker)[124]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 2.148610] (udev-worker)[124]: Network interface NamePolicy= disabled on kernel command line. machine # [ 2.304181] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 machine # [ 2.150456] systemd[1]: Found device /dev/disk/by-label/nixos. machine # [ 2.152419] systemd[1]: Reached target Initrd Root Device. machine # [ 2.154127] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... machine # [ 2.329674] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode machine # [ 2.331056] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) machine # [ 2.331996] ahci 0000:00:1f.2: flags: 64bit ncq only machine # [ 2.179820] systemd-fsck[151][ 2.335091] scsi host0: ahci machine # : nixos: clean, 12/1048576 files, 109865/4194304 blocks machine # [ 2.336906] scsi host1: ahci machine # [ 2.338609] scsi host2: ahci machine # [ 2.184331] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. machine # [ 2.341539] scsi host3: ahci machine # [ 2.343137] scsi host4: ahci machine # [ 2.343986] scsi host5: ahci machine # [ 2.344843] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 50 lpm-pol 1 machine # [ 2.346405] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 50 lpm-pol 1 machine # [ 2.347699] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 50 lpm-pol 1 machine # [ 2.349109] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 50 lpm-pol 1 machine # [ 2.350285] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 50 lpm-pol 1 machine # [ 2.351570] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 50 lpm-pol 1 machine # [ 2.480522] usb 2-1: new high-speed USB device number 2 using ehci-pci machine # [ 2.609561] usb 2-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 machine # [ 2.612605] usb 2-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 machine # [ 2.615337] usb 2-1: Product: QEMU USB Tablet machine # [ 2.617012] usb 2-1: Manufacturer: QEMU machine # [ 2.618531] usb 2-1: SerialNumber: 28754-0000:00:1d.7-1 machine # [ 2.637646] hid: raw HID events driver (C) Jiri Kosina machine # [ 2.671168] ata4: SATA link down (SStatus 0 SControl 300) machine # [ 2.673555] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) machine # [ 2.676096] ata5: SATA link down (SStatus 0 SControl 300) machine # [ 2.677075] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 machine # [ 2.679136] ata3.00: applying bridge limits machine # [ 2.681018] ata2: SATA link down (SStatus 0 SControl 300) machine # [ 2.683270] ata1: SATA link down (SStatus 0 SControl 300) machine # [ 2.685462] ata3.00: configured for UDMA/100 machine # [ 2.687280] ata6: SATA link down (SStatus 0 SControl 300) machine # [ 2.694024] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 machine # [ 2.725437] usbcore: registered new interface driver usbhid machine # [ 2.727464] usbhid: USB HID core driver machine # [ 2.737759] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb2/2-1/2-1:1.0/0003:0627:0001.0001/input/input2 machine # [ 2.742158] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 machine # [ 2.758979] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray machine # [ 2.789779] cdrom: Uniform CD-ROM driver Revision: 3.20 machine # [ 2.790764] systemd[1]: Mounting /sysroot... machine # [ 3.076138] EXT4-fs (vda): mounted filesystem 8763d140-24b0-44d9-9fc9-07e1b064f2fe r/w with ordered data mode. Quota mode: none. machine # [ 2.927933] systemd[1]: Mounted /sysroot. machine # [ 2.929853] systemd[1]: Reached target Initrd Root File System. machine # [ 2.933627] systemd[1]: Mounting /sysroot/nix/.ro-store... machine # [ 2.935589] systemd[1]: Mounting /sysroot/nix/.rw-store... machine # [ 2.941527] systemd[1]: Mounting /sysroot/run... machine # [ 2.948303] systemd[1]: Mounting /sysroot/tmp/shared... machine # [ 2.952066] systemd[1]: Mounting /sysroot/tmp/xchg... machine # [ 2.955569] systemd[1]: Starting Mountpoints Configured in the Real Root... machine # [ 2.960318] systemd[1]: Mounted /sysroot/nix/.ro-store. machine # [ 2.961824] systemd[1]: Mounted /sysroot/nix/.rw-store. machine # [ 2.963328] systemd[1]: Mounted /sysroot/run. machine # [ 2.964620] systemd[1]: Mounted /sysroot/tmp/shared. machine # [ 2.966053] systemd[1]: Mounted /sysroot/tmp/xchg. machine # [ 2.967600] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 2.977902] systemd-sysroot-fstab-check[192]: /sysroot should be mounted in the initrd, will request daemon-reload. machine # [ 2.979474] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 2.980513] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 2.982145] systemd[1]: Reload requested from client PID 192 ('systemd-sysroot') (unit initrd-parse-etc.service)... machine # [ 2.983700] systemd[1]: Reloading... machine # [ 3.040527] systemd[1]: Reloading finished in 57 ms. machine # [ 3.067368] systemd-sysroot-fstab-check[192]: Requesting initrd-fs.target/start/replace... machine # [ 3.070271] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.072318] systemd-sysroot-fstab-check[192]: Requesting swap.target/start/replace... machine # [ 3.076259] systemd[1]: initrd-parse-etc.service: Deactivated successfully. machine # [ 3.083581] systemd[1]: Finished Mountpoints Configured in the Real Root. machine # [ 3.085893] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. machine # [ 3.096295] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.098678] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.789622] systemd[1]: Mounting /sysroot/nix/store... machine # [ 3.848993] systemd[1]: Mounted /sysroot/nix/store. machine # [ 3.850867] systemd[1]: Reached target Initrd File Systems. machine # [ 3.852717] systemd[1]: Starting Find NixOS closure... machine # [ 3.854463] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... machine # [ 3.880531] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. machine # [ 3.883179] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. machine # [ 3.896053] systemd[1]: Finished Find NixOS closure. machine # [ 3.897829] systemd[1]: Reached target Initrd Default Target. machine # [ 3.899801] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... machine # [ 3.937175] systemd[1]: Stopped target Initrd Default Target. machine # [ 3.939209] systemd[1]: Stopped target Basic System. machine # [ 3.940926] systemd[1]: Stopped target Initrd Root Device. machine # [ 3.942741] systemd[1]: Stopped target Path Units. machine # [ 3.944388] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. machine # [ 3.946826] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. machine # [ 3.949393] systemd[1]: Stopped target Slice Units. machine # [ 3.952517] systemd[1]: Stopped target Socket Units. machine # [ 3.954248] systemd[1]: Stopped target System Initialization. machine # [ 3.956542] systemd[1]: Stopped target Swaps. machine # [ 3.958172] systemd[1]: Stopped target Timer Units. machine # [ 3.959856] systemd[1]: dbus.socket: Deactivated successfully. machine # [ 3.961844] systemd[1]: Closed D-Bus System Message Bus Socket. machine # [ 3.963863] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. machine # [ 3.966384] systemd[1]: Stopped Find NixOS closure. machine # [ 3.968102] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.970216] systemd[1]: systemd-sysctl.service: Deactivated successfully. machine # [ 3.972471] systemd[1]: Stopped Apply Kernel Variables. machine # [ 3.974405] systemd[1]: systemd-modules-load.service: Deactivated successfully. machine # [ 3.976679] systemd[1]: Stopped Load Kernel Modules. machine # [ 3.978325] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. machine # [ 3.980469] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. machine # [ 3.982485] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. machine # [ 3.984369] systemd[1]: Stopped Create System Files and Directories. machine # [ 3.986048] systemd[1]: Stopped target Local File Systems. machine # [ 3.987575] systemd[1]: Stopped target Preparation for Local File Systems. machine # [ 3.989390] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. machine # [ 3.991241] systemd[1]: Stopped Coldplug All udev Devices. machine # [ 3.992674] systemd[1]: Stopping Rule-based Manager for Device Events and Files... machine # [ 3.994591] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 3.996465] systemd[1]: Stopped Virtual Console Setup. machine # [ 3.997839] systemd[1]: initrd-cleanup.service: Deactivated successfully. machine # [ 3.999628] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. machine # [ 4.001286] systemd[1]: systemd-udevd.service: Deactivated successfully. machine # [ 4.002217] systemd[1]: Stopped Rule-based Manager for Device Events and Files. machine # [ 4.003166] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. machine # [ 4.005112] systemd[1]: Closed udev Control Socket. machine # [ 4.005905] systemd[1]: Starting Cleanup udev Database... machine # [ 4.006718] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. machine # [ 4.007846] systemd[1]: Stopped Create Static Device Nodes in /dev. machine # [ 4.008747] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. machine # [ 4.009901] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. machine # [ 4.010893] systemd[1]: kmod-static-nodes.service: Deactivated successfully. machine # [ 4.011917] systemd[1]: Stopped Create List of Static Device Nodes. machine # [ 4.012761] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 4.013757] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 4.022675] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. machine # [ 4.023890] systemd[1]: Finished Cleanup udev Database. machine # [ 4.024805] systemd[1]: Reached target Switch Root. machine # [ 4.026627] systemd[1]: Starting NixOS Activation... machine # [ 4.179159] initrd-nixos-activation-start[237]: booting system configuration /nix/store/i5vsm9kabmwpf9hxpymdbjd6p1qrpzma-nixos-system-machine-test machine # [ 4.247367] initrd-nixos-activation-start[237]: running activation script... machine # [ 4.571205] initrd-nixos-activation-start[261]: setting up /etc... machine # [ 4.772422] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. machine # [ 4.773773] systemd[1]: Finished NixOS Activation. machine # [ 4.776318] systemd[1]: Starting Switch Root... machine # [ 4.798778] systemd[1]: Switching root. machine # [ 5.010992] systemd-journald[90]: Received SIGTERM from PID 1 (systemd). machine # [ 5.188055] NET: Registered PF_VSOCK protocol family machine # [ 5.577544] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 5.587898] systemd[1]: Detected virtualization kvm. machine # [ 5.589860] systemd[1]: Detected architecture x86-64. machine # [ 5.591919] systemd[1]: Detected first boot. machine # [ 5.596204] systemd[1]: Initializing machine ID from random generator. machine # [ 5.738483] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 5.821479] systemd[1]: Applying preset policy. machine # [ 6.030904] systemd[1]: Populated /etc with preset unit settings. machine # [ 6.242261] systemd[1]: initrd-switch-root.service: Deactivated successfully. machine # [ 6.243694] systemd[1]: Stopped initrd-switch-root.service. machine # [ 6.246259] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. machine # [ 6.249144] systemd[1]: Created slice Slice /system/getty. machine # [ 6.250735] systemd[1]: Created slice User and Session Slice. machine # [ 6.251773] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 6.253071] systemd[1]: Started Forward Password Requests to Wall Directory Watch. machine # [ 6.254209] systemd[1]: Expecting device /dev/hvc0... machine # [ 6.256442] systemd[1]: Expecting device /dev/ttyS0... machine # [ 6.257264] systemd[1]: Reached target Local Encrypted Volumes. machine # [ 6.258209] systemd[1]: Stopped target initrd-fs.target. machine # [ 6.259052] systemd[1]: Stopped target initrd-root-fs.target. machine # [ 6.259951] systemd[1]: Stopped target initrd-switch-root.target. machine # [ 6.260874] systemd[1]: Reached target Virtual Machines and Containers. machine # [ 6.261854] systemd[1]: Reached target Path Units. machine # [ 6.262596] systemd[1]: Reached target Remote File Systems. machine # [ 6.263409] systemd[1]: Reached target Slice Units. machine # [ 6.264143] systemd[1]: Reached target Swaps. machine # [ 6.266485] systemd[1]: Listening on Query the User Interactively for a Password. machine # [ 6.269221] systemd[1]: Listening on Process Core Dump Socket. machine # [ 6.271343] systemd[1]: Listening on Credential Encryption/Decryption. machine # [ 6.273592] systemd[1]: Listening on Factory Reset Management. machine # [ 6.274607] systemd[1]: Listening on Hostname Service Socket. machine # [ 6.278138] systemd[1]: Starting Journal Log Access Socket... machine # [ 6.279601] systemd[1]: Listening on Journal Audit Socket. machine # [ 6.282027] systemd[1]: Listening on Console Output Muting Service Socket. machine # [ 6.283283] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. machine # [ 6.284542] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.285926] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki machine # [ 6.290931] systemd[1]: Listening on Disk Repartitioning Service Socket. machine # [ 6.292203] systemd[1]: Listening on udev Control Socket. machine # [ 6.293185] systemd[1]: Listening on udev Varlink Socket. machine # [ 6.295918] systemd[1]: Mounting Huge Pages File System... machine # [ 6.298218] systemd[1]: Mounting POSIX Message Queue File System... machine # [ 6.300620] systemd[1]: Mounting Kernel Debug File System... machine # [ 6.303266] systemd[1]: Mounting Kernel Trace File System... machine # [ 6.307009] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 6.310278] systemd[1]: Starting Load Kernel Module configfs... machine # [ 6.312575] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm machine # [ 6.316178] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.320216] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.327854] systemd[1]: Mounting FUSE Control File System... machine # [ 6.328834] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.334408] systemd[1]: Starting Journal Service... machine # [ 6.336857] systemd[1]: Starting Load Kernel Modules... machine # [ 6.341691] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... machine # [ 6.346255] systemd[1]: Starting Remount Root and Kernel File Systems... machine # [ 6.347291] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.350692] systemd[1]: Starting Coldplug All udev Devices... machine # [ 6.353081] systemd[1]: Listening on Journal Log Access Socket. machine # [ 6.355579] systemd[1]: Mounted Huge Pages File System. machine # [ 6.356972] systemd[1]: Mounted POSIX Message Queue File System. machine # [ 6.358238] systemd[1]: Mounted Kernel Debug File System. machine # [ 6.359232] systemd[1]: Mounted Kernel Trace File System. machine # [ 6.364911] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 6.369582] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 6.376966] systemd[1]: Mounted FUSE Control File System. machine # [ 6.384423] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 6.385850] systemd[1]: Finished Load Kernel Module configfs. machine # [ 6.388999] systemd[1]: Mounting Kernel Configuration File System... machine # [ 6.400445] EXT4-fs (vda): re-mounted 8763d140-24b0-44d9-9fc9-07e1b064f2fe. machine # [ 6.402329] systemd-journald[331]: Collecting audit messages is enabled. machine # [ 6.406037] systemd[1]: Finished Remount Root and Kernel File Systems. machine # [ 6.407302] systemd[1]: Listening on Disk Image Download Service Socket. machine # [ 6.410872] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.414809] loop: module loaded machine # [ 6.416871] systemd[1]: Starting Load/Save OS Random Seed... machine # [ 6.417782] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.422465] systemd[1]: Mounted Kernel Configuration File System. machine # [ 6.274294] systemd[1]: Queued start job for default target M[ 6.429889] systemd[1]: Finished Load Kernel Modules. machine # ulti-User System. machine # [ 6.431128] systemd[1]: Started Journal Service. machine # [ 6.276131] systemd[1]: systemd-journald.service: Deactivated successfully. machine # [ 6.278175] systemd-modules-load[332]: Using 2 probe threads machine # [ 6.279190] systemd-modules-load[332]: Inserted module 'loop' machine # [ 6.280454] systemd-oomd[333]: No swap; memory pressure usage will be degraded machine # [ 6.282228] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. machine # [ 6.283309] systemd[1]: Starting Flush Journal to Persistent Storage... machine # [ 6.284403] systemd[1]: Starting Apply Kernel Variables... machine # [ 6.293928] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 6.295244] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 6.296682] systemd[1]: Finished Load/Save OS Random Seed. machine # [ 6.297526] systemd[1]: Reached target First Boot Complete. machine # [ 6.457666] systemd-journald[331]: Received client request to flush runtime journal. machine # [ 6.355839] systemd[1]: Finished Apply Kernel Variables. machine # [ 6.356831] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 6.357894] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 6.358991] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 6.360247] systemd[1]: Finished Flush Journal to Persistent Storage. machine # [ 6.361469] systemd-udevd[360]: Using default interface naming scheme 'v261'. machine # [ 6.392245] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 6.399068] systemd[1]: Finished Coldplug All udev Devices. machine # [ 6.465734] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.482515] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. machine # [ 6.491523] (udev-worker)[383]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.498849] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. machine # [ 6.516423] (udev-worker)[376]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 6.518708] (udev-worker)[376]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.538323] systemd[1]: Condition check resulted in Virtio network device being skipped. machine # [ 6.694861] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 machine # [ 6.540935] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.542740] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.545500] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.701433] ACPI: button: Power Button [PWRF] machine # [ 6.547439] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.549230] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.737726] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console machine # [ 6.738941] rtc_cmos PNP0B00:00: RTC can wake from S4 machine # [ 6.739503] rtc_cmos PNP0B00:00: registered as rtc0 machine # [ 6.739637] rtc_cmos PNP0B00:00: setting system clock to 2026-09-23T04:42:01 UTC (1790138521) machine # [ 6.739719] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs machine # [ 6.743081] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 machine # [ 6.752018] Console: switching to colour dummy device 80x25 machine # [ 6.756735] [drm] Found bochs VGA, ID 0xb0c5. machine # [ 6.756737] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. machine # [ 6.758402] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized machine # [ 6.762648] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic machine # [ 6.763426] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 machine # [ 6.766250] systemd-journald[331]: Time jumped backwards, rotating. machine # [ 6.780734] Console: switching to colour frame buffer device 160x50 machine # [ 6.782140] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device machine # [ 6.794043] parport_pc 00:02: reported by Plug and Play ACPI machine # [ 6.802673] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] machine # [ 6.806080] mousedev: PS/2 mouse device common for all mice machine # [ 6.818722] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 machine # [ 6.821383] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 machine # [ 6.824639] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt machine # [ 6.825504] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD machine # [ 6.881415] ppdev: user-space parallel port driver machine # [ 6.731367] systemd[1]: Starting Virtual Console Setup... machine # [ 6.921622] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) machine # [ 6.922995] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) machine # [ 6.775560] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 6.778046] systemd[1]: Stopped Virtual Console Setup. machine # [ 6.788262] systemd[1]: Starting Virtual Console Setup... machine # [ 6.992954] kvm_amd: TSC scaling supported machine # [ 6.993523] kvm_amd: Nested Virtualization enabled machine # [ 6.994116] kvm_amd: Nested Paging enabled machine # [ 6.994644] kvm_amd: LBR virtualization supported machine # [ 6.995164] kvm_amd: Virtual VMLOAD VMSAVE supported machine # [ 6.995822] kvm_amd: Virtual GIF supported machine # [ 6.996272] kvm_amd: Virtual NMI enabled machine # [ 7.081572] EDAC MC: Ver: 3.0.0 machine # [ 6.960468] systemd-vconsole-setup[405]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 6.964179] systemd[1]: Finished Virtual Console Setup. machine # [ 7.092094] systemd[1]: Mounting /run/wrappers... machine # [ 7.117701] systemd[1]: Mounted /run/wrappers. machine # [ 7.118764] systemd[1]: Reached target Local File Systems. machine # [ 7.120277] systemd[1]: Listening on Boot Loader Control Service Socket. machine # [ 7.123071] systemd[1]: Starting register-nix-paths.service... machine # [ 7.125762] systemd[1]: Starting Create SUID/SGID Wrappers... machine # [ 7.127559] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. machine # [ 7.130973] systemd[1]: Starting Save Transient machine-id to Disk... machine # [ 7.147827] systemd[1]: Starting Create System Files and Directories... machine # [ 7.239168] systemd[1]: Finished Create System Files and Directories. machine # [ 7.243079] systemd[1]: Starting Rebuild Journal Catalog... machine # [ 7.245066] systemd[1]: Starting Record System Boot/Shutdown in UTMP... machine # [ 7.277208] systemd[1]: Finished Record System Boot/Shutdown in UTMP. machine # [ 7.296323] systemd[1]: Finished Rebuild Journal Catalog. machine # [ 7.298217] systemd[1]: Starting Update is Completed... machine # [ 7.323526] systemd[1]: Finished Update is Completed. machine # [ 7.419074] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. machine # [ 7.420257] systemd[1]: Finished Create SUID/SGID Wrappers. machine # [ 7.972391] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. machine # [ 7.977672] systemd[1]: Finished Save Transient machine-id to Disk. machine # [ 8.083515] systemd[1]: Finished register-nix-paths.service. machine # [ 8.085915] systemd[1]: Reached target System Initialization. machine # [ 8.088213] systemd[1]: Started Discard unused filesystem blocks once a week. machine # [ 8.090866] systemd[1]: Started niks3 garbage collection timer. machine # [ 8.093500] systemd[1]: Started Daily Cleanup of Temporary Directories. machine # [ 8.096737] systemd[1]: Reached target Timer Units. machine # [ 8.099288] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 8.102325] systemd[1]: Listening on niks3 server socket. machine # [ 8.104976] systemd[1]: Listening on Nix Daemon Socket. machine # [ 8.107716] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. machine # [ 8.112835] systemd[1]: Reached target Socket Units. machine # [ 8.116187] systemd[1]: Reached target Basic System. machine # [ 8.121234] systemd[1]: Started backdoor.service. machine # [ 8.123592] systemd[1]: Starting Import lastlog data into lastlog2 database... machine # [ 8.129744] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 8.136175] systemd[1]: Starting Post-Boot Actions... machine # [ 8.138149] systemd[1]: Started Reset console on configuration changes. machine # [ 8.140996] systemd[1]: Starting resolvconf update... machine # [ 8.145553] systemd[1]: Started rustfs.service. machine # [ 8.147367] systemd[1]: Starting rustfs-bucket.service... machine # [ 8.149126] systemd[1]: Starting D-Bus System Message Bus... machine # [ 8.154716] systemd[1]: Finished Post-Boot Actions. machine # [ 8.157863] nsncd[488]: Sep 23 04:42:03.070 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 8.160264] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 8.162883] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 8.164570] systemd[1]: Reached target User and Group Name Lookups. machine # [ 8.165825] systemd[1]: Starting User Login Management... machine # connecting to host... machine # [ 8.201907] systemd[1]: Finished Import lastlog data into lastlog2 database. machine: Guest shell says: b'Spawning backdoor root shell...\n' machine: connected to guest root shell machine: (connecting took 8.86 seconds) machine: (finished: waiting for the VM to finish booting, in 9.16 seconds) machine # [ 8.227458] dbus-broker-launch[496]: Looking up NSS user entry for 'systemd-timesync'... machine # [ 8.234643] dbus-broker-launch[496]: NSS returned no entry for 'systemd-timesync' machine # [ 8.235284] dbus-broker-launch[496]: Invalid user-name in /nix/store/d3mrkr0v9x5sgbb0rb2pnsl0mysb1m4x-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" machine # [ 8.245226] systemd-logind[514]: New seat seat0. machine # [ 8.248709] systemd-logind[514]: Watching system buttons on /dev/input/event2 (Power Button) machine # [ 8.249104] systemd-logind[514]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) machine # [ 8.249572] systemd-logind[514]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) machine # [ 8.250062] systemd[1]: Started User Login Management. machine # [ 8.252467] systemd[1]: Starting linger-users.service... machine # [ 8.258450] systemd[1]: Started D-Bus System Message Bus. machine # [ 8.279080] systemd[1]: Stopped target Host and Network Name Lookups. machine # [ 8.279495] systemd[1]: Stopping Host and Network Name Lookups... machine # [ 8.280246] systemd[1]: Stopped target User and Group Name Lookups. machine # [ 8.280425] systemd[1]: Stopping User and Group Name Lookups... machine # [ 8.284887] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... machine # [ 8.286493] dbus-broker-launch[496]: Ready machine # [ 8.286870] systemd[1]: nscd.service: Deactivated successfully. machine # [ 8.287297] systemd[1]: Stopped Name Service Cache Daemon (nsncd). machine # [ 8.291205] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 8.291540] systemd[1]: linger-users.service: Deactivated successfully. machine # [ 8.292334] systemd[1]: Finished linger-users.service. machine # [ 8.325647] nsncd[591]: Sep 23 04:42:03.240 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 8.327920] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 8.328279] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 8.328805] systemd[1]: Reached target User and Group Name Lookups. machine # [ 8.336169] systemd[1]: Finished resolvconf update. machine # [ 8.337112] systemd[1]: Reached target Preparation for Network. machine # [ 8.339854] systemd[1]: Starting DHCP Client... machine # [ 8.341337] systemd[1]: Starting Address configuration of eth1... machine # [ 8.342687] systemd[1]: Starting Extra networking commands.... machine # [ 8.415329] network-addresses-eth1-start[622]: adding address 192.168.1.1/24... done machine # [ 8.422164] network-addresses-eth1-start[622]: adding address 2001:db8:1::1/64... done machine # [ 8.436744] systemd[1]: Finished Address configuration of eth1. machine # [ 8.438611] dhcpcd[630]: dhcpcd-10.3.2 starting machine # [ 8.446183] dhcpcd[673]: dev: loaded udev machine # [ 8.614589] 8021q: 802.1Q VLAN Support v1.8 machine # [ 8.615085] 8021q: adding VLAN 0 to HW filter on device eth1 machine # [ 8.473193] systemd[1]: Finished Extra networking commands.. machine # [ 8.474232] systemd[1]: Reached target Network. machine # [ 8.477204] systemd[1]: Starting PostgreSQL Server... machine # [ 8.479148] systemd[1]: Starting Permit User Sessions... machine # [ 8.484814] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. machine # [ 8.503874] systemd[1]: Finished Permit User Sessions. machine # [ 8.506847] systemd[1]: Started Getty on tty1. machine # [ 8.507624] systemd[1]: Reached target Login Prompts. machine # [ 8.722799] cfg80211: Loading compiled-in X.509 certificates for regulatory database machine # [ 8.738663] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' machine # [ 8.739547] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' machine # [ 8.741300] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 machine # [ 8.742746] cfg80211: failed to load regulatory.db machine # [ 8.600477] postgresql-pre-start[708]: The files belonging to this database system will be owned by user "postgres". machine # [ 8.600902] postgresql-pre-start[708]: This user must also own the server process. machine # [ 8.603750] postgresql-pre-start[708]: The database cluster will be initialized with locale "en_US.UTF-8". machine # [ 8.604088] postgresql-pre-start[708]: The default database encoding has accordingly been set to "UTF8". machine # [ 8.604583] postgresql-pre-start[708]: The default text search configuration will be set to "english". machine # [ 8.605256] postgresql-pre-start[708]: Data page checksums are enabled. machine # [ 8.605813] postgresql-pre-start[708]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok machine # [ 8.606447] postgresql-pre-start[708]: creating subdirectories ... ok machine # [ 8.607148] postgresql-pre-start[708]: selecting dynamic shared memory implementation ... posix machine # [ 8.798847] 8021q: adding VLAN 0 to HW filter on device eth0 machine # [ 8.645638] dhcpcd[673]: eth0: waiting for carrier machine # [ 8.645905] dhcpcd[673]: eth0: carrier acquired machine # [ 8.650741] dhcpcd[673]: DUID 00:01:00:01:32:46:15:1b:52:54:00:12:34:56 machine # [ 8.650893] dhcpcd[673]: eth0: IAID 00:12:34:56 machine # [ 8.651612] dhcpcd[673]: eth0: adding address fe80::5054:ff:fe12:3456 machine # [ 8.668553] postgresql-pre-start[708]: selecting default "max_connections" ... 100 machine # [ 8.714994] postgresql-pre-start[708]: selecting default "shared_buffers" ... 128MB machine # [ 9.446413] postgresql-pre-start[708]: selecting default time zone ... UTC machine # [ 9.448554] postgresql-pre-start[708]: creating configuration files ... ok machine # [ 9.451600] dhcpcd[673]: eth0: soliciting a DHCP lease machine # [ 9.619040] NET: Registered PF_PACKET protocol family machine # [ 9.471696] dhcpcd[673]: eth0: offered 10.0.2.15 from 10.0.2.2 machine # [ 9.476289] dhcpcd[673]: eth0: probing address 10.0.2.15/24 machine # [ 9.638829] postgresql-pre-start[708]: running bootstrap script ... ok machine # [ 10.085861] dhcpcd[673]: eth0: soliciting an IPv6 router machine # [ 10.086714] dhcpcd[673]: eth0: Router Advertisement from fe80::2 machine # [ 10.087358] dhcpcd[673]: eth0: adding address fec0::5054:ff:fe12:3456/64 machine # [ 10.088339] dhcpcd[673]: eth0: adding route to fec0::/64 machine # [ 10.089113] dhcpcd[673]: eth0: adding default route via fe80::2 machine # [ 10.105278] postgresql-pre-start[708]: performing post-bootstrap initialization ... ok machine # [ 10.290073] postgresql-pre-start[708]: syncing data to disk ... ok machine # [ 10.292413] postgresql-pre-start[708]: initdb: warning: enabling "trust" authentication for local connections machine # [ 10.295466] postgresql-pre-start[708]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. machine # [ 10.300314] postgresql-pre-start[708]: Success. You can now start the database server using: machine # [ 10.302963] postgresql-pre-start[708]: pg_ctl -D /var/lib/postgresql/18 -l logfile start machine # [ 10.454789] postgres[743]: [743] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit machine # [ 10.457321] postgres[743]: [743] LOG: listening on IPv6 address "::1", port 5432 machine # [ 10.459160] postgres[743]: [743] LOG: listening on IPv4 address "127.0.0.1", port 5432 machine # [ 10.462151] postgres[743]: [743] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" machine # [ 10.474037] postgres[761]: [761] LOG: database system was shut down at 2026-09-23 04:42:05 GMT machine # [ 10.480763] postgres[743]: [743] LOG: database system is ready to accept connections machine # [ 10.484841] systemd[1]: Started PostgreSQL Server. machine # [ 10.487663] systemd[1]: Starting PostgreSQL Setup Scripts... machine # [ 10.730100] postgresql-setup-start[772]: CREATE DATABASE machine # [ 10.765255] postgresql-setup-start[777]: CREATE ROLE machine # [ 10.793551] postgresql-setup-start[779]: ALTER DATABASE machine # [ 10.801273] systemd[1]: Finished PostgreSQL Setup Scripts. machine # [ 10.802274] systemd[1]: Reached target PostgreSQL. machine # [ 15.204211] dhcpcd[673]: eth0: leased 10.0.2.15 for 86400 seconds machine # [ 15.206591] dhcpcd[673]: eth0: adding route to 10.0.2.0/24 machine # [ 15.208694] dhcpcd[673]: eth0: adding default route via 10.0.2.2 machine # [ 15.320239] systemd[1]: Started DHCP Client. machine # [ 15.322050] systemd[1]: Reached target Network is Online. machine # [ 15.325163] systemd[1]: Starting k3s service... machine # [ 15.376093] k3s[879]: time="2026-09-23T04:42:10Z" level=info msg="Acquiring lock file /var/lib/rancher/k3s/data/.lock" machine # [ 15.376350] k3s[879]: time="2026-09-23T04:42:10Z" level=info msg="Preparing data dir /var/lib/rancher/k3s/data/05fb32d1d5d79ab4bf8f805d07e4a7dfb491001fd5137b587aa471efd4746099" machine # [ 16.538713] rustfs-bucket-start[889]: mb s3://farm machine # [ 16.545299] systemd[1]: Finished rustfs-bucket.service. machine # [ 17.459182] k3s[879]: time="2026-09-23T04:42:12Z" level=info msg="Starting k3s 1.35.8+k3s1 (e952d68a)" machine # [ 17.579112] k3s[879]: time="2026-09-23T04:42:12Z" level=info msg="Configuring sqlite3 database connection pooling: maxIdle=20, maxOpen=0, maxLifetime=0s, maxIdleTime=2m0s" machine # [ 17.579679] k3s[879]: time="2026-09-23T04:42:12Z" level=info msg="Kine built with sqlite from github.com/mattn/go-sqlite3 version 3.53.3" machine # [ 17.580926] k3s[879]: time="2026-09-23T04:42:12Z" level=info msg="Configuring database table schema and indexes, this may take a moment..." machine # [ 17.606265] k3s[879]: time="2026-09-23T04:42:12Z" level=info msg="Database tables and indexes are up to date" machine # [ 17.607093] k3s[879]: time="2026-09-23T04:42:12Z" level=info msg="Running startup VACUUM to reclaim disk space, this may take a moment..." machine # [ 17.610252] k3s[879]: time="2026-09-23T04:42:12Z" level=info msg="Startup VACUUM completed successfully" machine # [ 17.614594] k3s[879]: time="2026-09-23T04:42:12Z" level=info msg="Kine available at unix://kine.sock" machine # [ 17.615704] k3s[879]: time="2026-09-23T04:42:12Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 17.619614] k3s[879]: time="2026-09-23T04:42:12Z" level=info msg="Datastore connection validated successfully, proceeding with bootstrap data generation" machine # [ 17.621061] k3s[879]: time="2026-09-23T04:42:12Z" level=info msg="generated self-signed CA certificate CN=k3s-client-ca@1790138532: notBefore=2026-09-23 03:42:12.536155431 +0000 UTC notAfter=2036-09-20 03:42:12.536155431 +0000 UTC" machine # [ 17.622281] k3s[879]: time="2026-09-23T04:42:12Z" level=info msg="certificate CN=system:admin,O=system:masters signed by CN=k3s-client-ca@1790138532: notBefore=2026-09-23 03:42:12 +0000 UTC notAfter=2027-09-23 03:42:12 +0000 UTC" machine # [ 17.623501] k3s[879]: time="2026-09-23T04:42:12Z" level=info msg="certificate CN=system:k3s-supervisor,O=system:masters signed by CN=k3s-client-ca@1790138532: notBefore=2026-09-23 03:42:12 +0000 UTC notAfter=2027-09-23 03:42:12 +0000 UTC" machine # [ 17.624937] k3s[879]: time="2026-09-23T04:42:12Z" level=info msg="certificate CN=system:kube-controller-manager signed by CN=k3s-client-ca@1790138532: notBefore=2026-09-23 03:42:12 +0000 UTC notAfter=2027-09-23 03:42:12 +0000 UTC" machine # [ 17.626573] k3s[879]: time="2026-09-23T04:42:12Z" level=info msg="certificate CN=system:kube-scheduler signed by CN=k3s-client-ca@1790138532: notBefore=2026-09-23 03:42:12 +0000 UTC notAfter=2027-09-23 03:42:12 +0000 UTC" machine # [ 17.628064] k3s[879]: time="2026-09-23T04:42:12Z" level=info msg="certificate CN=system:apiserver,O=system:masters signed by CN=k3s-client-ca@1790138532: notBefore=2026-09-23 03:42:12 +0000 UTC notAfter=2027-09-23 03:42:12 +0000 UTC" machine # [ 17.629268] k3s[879]: time="2026-09-23T04:42:12Z" level=info msg="certificate CN=k3s-cloud-controller-manager signed by CN=k3s-client-ca@1790138532: notBefore=2026-09-23 03:42:12 +0000 UTC notAfter=2027-09-23 03:42:12 +0000 UTC" machine # [ 17.630419] k3s[879]: time="2026-09-23T04:42:12Z" level=info msg="generated self-signed CA certificate CN=k3s-server-ca@1790138532: notBefore=2026-09-23 03:42:12.543827915 +0000 UTC notAfter=2036-09-20 03:42:12.543827915 +0000 UTC" machine # [ 17.631938] k3s[879]: time="2026-09-23T04:42:12Z" level=info msg="certificate CN=kube-apiserver signed by CN=k3s-server-ca@1790138532: notBefore=2026-09-23 03:42:12 +0000 UTC notAfter=2027-09-23 03:42:12 +0000 UTC" machine # [ 17.633487] k3s[879]: time="2026-09-23T04:42:12Z" level=info msg="certificate CN=kube-scheduler signed by CN=k3s-server-ca@1790138532: notBefore=2026-09-23 03:42:12 +0000 UTC notAfter=2027-09-23 03:42:12 +0000 UTC" machine # [ 17.635063] k3s[879]: time="2026-09-23T04:42:12Z" level=info msg="certificate CN=kube-controller-manager signed by CN=k3s-server-ca@1790138532: notBefore=2026-09-23 03:42:12 +0000 UTC notAfter=2027-09-23 03:42:12 +0000 UTC" machine # [ 17.636283] k3s[879]: time="2026-09-23T04:42:12Z" level=info msg="generated self-signed CA certificate CN=k3s-request-header-ca@1790138532: notBefore=2026-09-23 03:42:12.547937934 +0000 UTC notAfter=2036-09-20 03:42:12.547937934 +0000 UTC" machine # [ 17.637448] k3s[879]: time="2026-09-23T04:42:12Z" level=info msg="certificate CN=system:auth-proxy signed by CN=k3s-request-header-ca@1790138532: notBefore=2026-09-23 03:42:12 +0000 UTC notAfter=2027-09-23 03:42:12 +0000 UTC" machine # [ 17.638943] k3s[879]: time="2026-09-23T04:42:12Z" level=info msg="generated self-signed CA certificate CN=etcd-server-ca@1790138532: notBefore=2026-09-23 03:42:12.549711903 +0000 UTC notAfter=2036-09-20 03:42:12.549711903 +0000 UTC" machine # [ 17.640477] k3s[879]: time="2026-09-23T04:42:12Z" level=info msg="certificate CN=etcd-client signed by CN=etcd-server-ca@1790138532: notBefore=2026-09-23 03:42:12 +0000 UTC notAfter=2027-09-23 03:42:12 +0000 UTC" machine # [ 17.642051] k3s[879]: time="2026-09-23T04:42:12Z" level=info msg="generated self-signed CA certificate CN=etcd-peer-ca@1790138532: notBefore=2026-09-23 03:42:12.551408487 +0000 UTC notAfter=2036-09-20 03:42:12.551408487 +0000 UTC" machine # [ 17.643224] k3s[879]: time="2026-09-23T04:42:12Z" level=info msg="certificate CN=etcd-peer signed by CN=etcd-peer-ca@1790138532: notBefore=2026-09-23 03:42:12 +0000 UTC notAfter=2027-09-23 03:42:12 +0000 UTC" machine # [ 17.644372] k3s[879]: time="2026-09-23T04:42:12Z" level=info msg="certificate CN=etcd-server signed by CN=etcd-server-ca@1790138532: notBefore=2026-09-23 03:42:12 +0000 UTC notAfter=2027-09-23 03:42:12 +0000 UTC" machine # [ 17.770324] k3s[879]: time="2026-09-23T04:42:12Z" level=info msg="certificate CN=k3s,O=k3s signed by CN=k3s-server-ca@1790138532: notBefore=2026-09-23 03:42:12 +0000 UTC notAfter=2027-09-23 03:42:12 +0000 UTC" machine # [ 17.771098] k3s[879]: time="2026-09-23T04:42:12Z" level=warning msg="dynamiclistener [::]:6443: no cached certificate available for preload - deferring certificate load until storage initialization or first client request" machine # [ 17.787068] k3s[879]: time="2026-09-23T04:42:12Z" level=info msg="Active TLS secret / (ver=) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__872_1c92_8ac0_9c98-297c07:fec0::872:1c92:8ac0:9c98 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=16130F5061D523B50CB4974359B55C46AC73C6DA]" machine # [ 18.752975] k3s[879]: time="2026-09-23T04:42:13Z" level=info msg="Password verified locally for node machine" machine # [ 18.753527] k3s[879]: time="2026-09-23T04:42:13Z" level=info msg="certificate CN=machine signed by CN=k3s-server-ca@1790138532: notBefore=2026-09-23 03:42:13 +0000 UTC notAfter=2027-09-23 03:42:13 +0000 UTC" machine # [ 19.024417] k3s[879]: time="2026-09-23T04:42:13Z" level=info msg="certificate CN=system:node:machine,O=system:nodes signed by CN=k3s-client-ca@1790138532: notBefore=2026-09-23 03:42:13 +0000 UTC notAfter=2027-09-23 03:42:13 +0000 UTC" machine # [ 19.127550] k3s[879]: time="2026-09-23T04:42:14Z" level=info msg="certificate CN=system:kube-proxy signed by CN=k3s-client-ca@1790138532: notBefore=2026-09-23 03:42:14 +0000 UTC notAfter=2027-09-23 03:42:14 +0000 UTC" machine # [ 19.250081] k3s[879]: time="2026-09-23T04:42:14Z" level=info msg="certificate CN=system:k3s-controller signed by CN=k3s-client-ca@1790138532: notBefore=2026-09-23 03:42:14 +0000 UTC notAfter=2027-09-23 03:42:14 +0000 UTC" machine # [ 19.338365] k3s[879]: time="2026-09-23T04:42:14Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:45148: runtime core not ready" machine # [ 19.448369] k3s[879]: time="2026-09-23T04:42:14Z" level=info msg="Module overlay was already loaded" machine # [ 19.684444] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. machine # [ 19.689033] Bridge firewalling registered machine # [ 19.545615] k3s[879]: time="2026-09-23T04:42:14Z" level=warning msg="Failed to load kernel module iptable_nat with modprobe" machine # [ 19.555741] k3s[879]: time="2026-09-23T04:42:14Z" level=warning msg="Failed to load kernel module iptable_filter with modprobe" machine # [ 19.567696] k3s[879]: time="2026-09-23T04:42:14Z" level=warning msg="Failed to load kernel module nft-expr-counter with modprobe" machine # [ 19.637173] k3s[879]: time="2026-09-23T04:42:14Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600" machine # [ 19.637428] k3s[879]: time="2026-09-23T04:42:14Z" level=info msg="Set sysctl 'net/ipv4/conf/all/forwarding' to 1" machine # [ 19.637851] k3s[879]: time="2026-09-23T04:42:14Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_max' to 131072" machine # [ 19.638571] k3s[879]: time="2026-09-23T04:42:14Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400" machine # [ 19.642194] k3s[879]: time="2026-09-23T04:42:14Z" level=info msg="Creating k3s-cert-monitor event broadcaster" machine # [ 19.643474] k3s[879]: time="2026-09-23T04:42:14Z" level=info msg="Connecting to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 19.644353] k3s[879]: time="2026-09-23T04:42:14Z" level=info msg="Saving cluster bootstrap data to datastore" machine # [ 19.648985] k3s[879]: time="2026-09-23T04:42:14Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 19.650818] k3s[879]: time="2026-09-23T04:42:14Z" level=info msg="Connection to etcd is ready" machine # [ 19.652196] k3s[879]: time="2026-09-23T04:42:14Z" level=info msg="ETCD server is now running" machine # [ 19.652470] k3s[879]: time="2026-09-23T04:42:14Z" level=info msg="Polling for API server readiness: GET /readyz failed: the server is currently unable to handle the request" machine # [ 19.652930] k3s[879]: time="2026-09-23T04:42:14Z" level=info msg="Handling backend connection request [machine]" machine # [ 19.653599] k3s[879]: time="2026-09-23T04:42:14Z" level=info msg="Connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 19.654076] k3s[879]: time="2026-09-23T04:42:14Z" level=info msg="Remotedialer connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 19.657251] k3s[879]: time="2026-09-23T04:42:14Z" level=info msg="Running kube-apiserver --advertise-port=6443 --allow-privileged=true --anonymous-auth=false --api-audiences=https://kubernetes.default.svc.cluster.local,k3s --authorization-mode=Node,RBAC --bind-address=127.0.0.1 --cert-dir=/var/lib/rancher/k3s/server/tls/temporary-certs --client-ca-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --egress-selector-config-file=/var/lib/rancher/k3s/server/etc/egress-selector-config.yaml --enable-admission-plugins=NodeRestriction --enable-aggregator-routing=true --enable-bootstrap-token-auth=true --etcd-servers=unix://kine.sock --kubelet-certificate-authority=/var/lib/rancher/k3s/server/tls/server-ca.crt --kubelet-client-certificate=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.crt --kubelet-client-key=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.key --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --profiling=false --proxy-client-cert-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt --proxy-client-key-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.key --requestheader-allowed-names=system:auth-proxy --requestheader-client-ca-file=/var/lib/rancher/k3s/server/tls/request-header-ca.crt --requestheader-extra-headers-prefix=X-Remote-Extra- --requestheader-group-headers=X-Remote-Group --requestheader-username-headers=X-Remote-User --secure-port=6444 --service-account-issuer=https://kubernetes.default.svc.cluster.local --service-account-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-account-signing-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --storage-backend=etcd3 --tls-cert-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --tls-private-key-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 19.661660] k3s[879]: time="2026-09-23T04:42:14Z" level=info msg="Running kube-scheduler --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --bind-address=127.0.0.1 --kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --leader-elect=false --profiling=false --secure-port=10259 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 19.662583] k3s[879]: time="2026-09-23T04:42:14Z" level=info msg="Running kube-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --bind-address=127.0.0.1 --cluster-cidr=10.42.0.0/16 --cluster-signing-kube-apiserver-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kube-apiserver-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kubelet-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-serving-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-kubelet-serving-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --cluster-signing-legacy-unknown-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-legacy-unknown-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --configure-cloud-routes=false --controllers=*,tokencleaner,-service,-route,-cloud-node-lifecycle --kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --leader-elect=false --profiling=false --root-ca-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --secure-port=10257 --service-account-private-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key --use-service-account-credentials=true" machine # [ 19.664077] k3s[879]: time="2026-09-23T04:42:14Z" level=info msg="Running cloud-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --bind-address=127.0.0.1 --cloud-config=/var/lib/rancher/k3s/server/etc/cloud-config.yaml --cloud-provider=k3s --cluster-cidr=10.42.0.0/16 --configure-cloud-routes=false --controllers=*,-route --kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --leader-elect=false --leader-elect-resource-name=k3s-cloud-controller-manager --node-status-update-frequency=1m0s --profiling=false" machine # [ 19.706691] k3s[879]: time="2026-09-23T04:42:14Z" level=info msg="Server node token is available at /var/lib/rancher/k3s/server/token" machine # [ 19.707545] k3s[879]: time="2026-09-23T04:42:14Z" level=info msg="To join server node to cluster: k3s server -s https://10.0.2.15:6443 -t ${SERVER_NODE_TOKEN}" machine # [ 19.708050] k3s[879]: time="2026-09-23T04:42:14Z" level=info msg="Agent node token is available at /var/lib/rancher/k3s/server/agent-token" machine # [ 19.708659] k3s[879]: time="2026-09-23T04:42:14Z" level=info msg="To join agent node to cluster: k3s agent -s https://10.0.2.15:6443 -t ${AGENT_NODE_TOKEN}" machine # [ 19.711095] k3s[879]: time="2026-09-23T04:42:14Z" level=info msg="Wrote kubeconfig /etc/rancher/k3s/k3s.yaml" machine # [ 19.711764] k3s[879]: time="2026-09-23T04:42:14Z" level=info msg="Run: k3s kubectl" machine # [ 19.712448] k3s[879]: I0923 04:42:14.584158 879 options.go:263] external host was not specified, using 10.0.2.15 machine # [ 19.712977] k3s[879]: time="2026-09-23T04:42:14Z" level=info msg="Logging containerd to /var/lib/rancher/k3s/agent/containerd/containerd.log" machine # [ 19.713676] k3s[879]: time="2026-09-23T04:42:14Z" level=info msg="Running containerd -c /var/lib/rancher/k3s/agent/etc/containerd/config.toml" machine # [ 19.714192] k3s[879]: I0923 04:42:14.589297 879 server.go:158] Version: v1.35.8+k3s1 machine # [ 19.714750] k3s[879]: I0923 04:42:14.589335 879 server.go:160] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 19.769889] k3s[879]: time="2026-09-23T04:42:14Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:45200: runtime core not ready" machine # [ 19.771108] k3s[879]: I0923 04:42:14.685202 879 shared_informer.go:349] "Waiting for caches to sync" controller="node_authorizer" machine # [ 19.777030] k3s[879]: I0923 04:42:14.692674 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 19.778969] k3s[879]: I0923 04:42:14.694588 879 plugins.go:157] Loaded 14 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,PodTopologyLabels,MutatingAdmissionPolicy,MutatingAdmissionWebhook. machine # [ 19.779163] k3s[879]: I0923 04:42:14.694861 879 plugins.go:160] Loaded 14 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,NodeDeclaredFeatureValidator,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. machine # [ 19.780085] k3s[879]: I0923 04:42:14.695771 879 instance.go:240] Using reconciler: lease machine # [ 19.788864] k3s[879]: I0923 04:42:14.704539 879 handler.go:304] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager machine # [ 19.789082] k3s[879]: W0923 04:42:14.704775 879 genericapiserver.go:787] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. machine # [ 19.791944] k3s[879]: I0923 04:42:14.707624 879 cidrallocator.go:198] starting ServiceCIDR Allocator Controller machine # [ 19.833564] k3s[879]: I0923 04:42:14.749191 879 handler.go:304] Adding GroupVersion v1 to ResourceManager machine # [ 19.834067] k3s[879]: I0923 04:42:14.749757 879 apis.go:112] API group "internal.apiserver.k8s.io" is not enabled, skipping. machine # [ 19.867525] k3s[879]: time="2026-09-23T04:42:14Z" level=info msg="Running kube-proxy --cluster-cidr=10.42.0.0/16 --conntrack-max-per-core=0 --conntrack-tcp-timeout-close-wait=0s --conntrack-tcp-timeout-established=0s --healthz-bind-address=127.0.0.1 --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubeproxy.kubeconfig --proxy-mode=iptables" machine # [ 19.876113] k3s[879]: I0923 04:42:14.791774 879 apis.go:112] API group "storagemigration.k8s.io" is not enabled, skipping. machine # [ 19.897948] k3s[879]: I0923 04:42:14.813521 879 handler.go:304] Adding GroupVersion authentication.k8s.io v1 to ResourceManager machine # [ 19.898305] k3s[879]: W0923 04:42:14.813549 879 genericapiserver.go:787] Skipping API authentication.k8s.io/v1beta1 because it has no resources. machine # [ 19.898806] k3s[879]: W0923 04:42:14.813561 879 genericapiserver.go:787] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. machine # [ 19.899619] k3s[879]: I0923 04:42:14.813802 879 handler.go:304] Adding GroupVersion authorization.k8s.io v1 to ResourceManager machine # [ 19.900200] k3s[879]: W0923 04:42:14.813816 879 genericapiserver.go:787] Skipping API authorization.k8s.io/v1beta1 because it has no resources. machine # [ 19.900886] k3s[879]: I0923 04:42:14.814237 879 handler.go:304] Adding GroupVersion autoscaling v2 to ResourceManager machine # [ 19.901739] k3s[879]: I0923 04:42:14.814559 879 handler.go:304] Adding GroupVersion autoscaling v1 to ResourceManager machine # [ 19.902203] k3s[879]: W0923 04:42:14.814575 879 genericapiserver.go:787] Skipping API autoscaling/v2beta1 because it has no resources. machine # [ 19.902926] k3s[879]: W0923 04:42:14.814586 879 genericapiserver.go:787] Skipping API autoscaling/v2beta2 because it has no resources. machine # [ 19.903794] k3s[879]: I0923 04:42:14.815216 879 handler.go:304] Adding GroupVersion batch v1 to ResourceManager machine # [ 19.904274] k3s[879]: W0923 04:42:14.815233 879 genericapiserver.go:787] Skipping API batch/v1beta1 because it has no resources. machine # [ 19.904979] k3s[879]: I0923 04:42:14.815660 879 handler.go:304] Adding GroupVersion certificates.k8s.io v1 to ResourceManager machine # [ 19.905278] k3s[879]: W0923 04:42:14.815678 879 genericapiserver.go:787] Skipping API certificates.k8s.io/v1beta1 because it has no resources. machine # [ 19.905920] k3s[879]: W0923 04:42:14.815689 879 genericapiserver.go:787] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. machine # [ 19.906600] k3s[879]: I0923 04:42:14.815975 879 handler.go:304] Adding GroupVersion coordination.k8s.io v1 to ResourceManager machine # [ 19.907286] k3s[879]: W0923 04:42:14.815989 879 genericapiserver.go:787] Skipping API coordination.k8s.io/v1beta1 because it has no resources. machine # [ 19.908016] k3s[879]: W0923 04:42:14.816000 879 genericapiserver.go:787] Skipping API coordination.k8s.io/v1alpha2 because it has no resources. machine # [ 19.908530] k3s[879]: I0923 04:42:14.816271 879 handler.go:304] Adding GroupVersion discovery.k8s.io v1 to ResourceManager machine # [ 19.909051] k3s[879]: W0923 04:42:14.816287 879 genericapiserver.go:787] Skipping API discovery.k8s.io/v1beta1 because it has no resources. machine # [ 19.909559] k3s[879]: I0923 04:42:14.817452 879 handler.go:304] Adding GroupVersion networking.k8s.io v1 to ResourceManager machine # [ 19.910049] k3s[879]: W0923 04:42:14.817470 879 genericapiserver.go:787] Skipping API networking.k8s.io/v1beta1 because it has no resources. machine # [ 19.910563] k3s[879]: I0923 04:42:14.817693 879 handler.go:304] Adding GroupVersion node.k8s.io v1 to ResourceManager machine # [ 19.911485] k3s[879]: W0923 04:42:14.817708 879 genericapiserver.go:787] Skipping API node.k8s.io/v1beta1 because it has no resources. machine # [ 19.911959] k3s[879]: W0923 04:42:14.817719 879 genericapiserver.go:787] Skipping API node.k8s.io/v1alpha1 because it has no resources. machine # [ 19.912307] k3s[879]: I0923 04:42:14.818101 879 handler.go:304] Adding GroupVersion policy v1 to ResourceManager machine # [ 19.912853] k3s[879]: W0923 04:42:14.818117 879 genericapiserver.go:787] Skipping API policy/v1beta1 because it has no resources. machine # [ 19.913583] k3s[879]: I0923 04:42:14.818909 879 handler.go:304] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager machine # [ 19.914462] k3s[879]: W0923 04:42:14.818927 879 genericapiserver.go:787] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. machine # [ 19.914982] k3s[879]: W0923 04:42:14.818940 879 genericapiserver.go:787] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. machine # [ 19.915873] k3s[879]: I0923 04:42:14.819164 879 handler.go:304] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager machine # [ 19.916592] k3s[879]: W0923 04:42:14.819177 879 genericapiserver.go:787] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. machine # [ 19.917138] k3s[879]: W0923 04:42:14.819188 879 genericapiserver.go:787] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. machine # [ 19.917278] k3s[879]: I0923 04:42:14.820344 879 handler.go:304] Adding GroupVersion storage.k8s.io v1 to ResourceManager machine # [ 19.917984] k3s[879]: W0923 04:42:14.820362 879 genericapiserver.go:787] Skipping API storage.k8s.io/v1beta1 because it has no resources. machine # [ 19.918316] k3s[879]: W0923 04:42:14.820384 879 genericapiserver.go:787] Skipping API storage.k8s.io/v1alpha1 because it has no resources. machine # [ 19.918979] k3s[879]: I0923 04:42:14.820954 879 handler.go:304] Adding GroupVersion flowcontrol.apiserver.k8s.io v1 to ResourceManager machine # [ 19.919277] k3s[879]: W0923 04:42:14.820969 879 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta3 because it has no resources. machine # [ 19.919818] k3s[879]: W0923 04:42:14.820979 879 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta2 because it has no resources. machine # [ 19.920510] k3s[879]: W0923 04:42:14.820990 879 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. machine # [ 19.921053] k3s[879]: I0923 04:42:14.823776 879 handler.go:304] Adding GroupVersion apps v1 to ResourceManager machine # [ 19.921562] k3s[879]: W0923 04:42:14.823794 879 genericapiserver.go:787] Skipping API apps/v1beta2 because it has no resources. machine # [ 19.922057] k3s[879]: W0923 04:42:14.823805 879 genericapiserver.go:787] Skipping API apps/v1beta1 because it has no resources. machine # [ 19.922541] k3s[879]: I0923 04:42:14.826495 879 handler.go:304] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager machine # [ 19.923039] k3s[879]: W0923 04:42:14.826514 879 genericapiserver.go:787] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. machine # [ 19.923587] k3s[879]: W0923 04:42:14.826526 879 genericapiserver.go:787] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. machine # [ 19.924088] k3s[879]: I0923 04:42:14.827266 879 handler.go:304] Adding GroupVersion events.k8s.io v1 to ResourceManager machine # [ 19.924754] k3s[879]: W0923 04:42:14.827282 879 genericapiserver.go:787] Skipping API events.k8s.io/v1beta1 because it has no resources. machine # [ 19.926452] k3s[879]: I0923 04:42:14.829794 879 handler.go:304] Adding GroupVersion resource.k8s.io v1 to ResourceManager machine # [ 19.927822] k3s[879]: W0923 04:42:14.829811 879 genericapiserver.go:787] Skipping API resource.k8s.io/v1beta2 because it has no resources. machine # [ 19.929540] k3s[879]: W0923 04:42:14.829824 879 genericapiserver.go:787] Skipping API resource.k8s.io/v1beta1 because it has no resources. machine # [ 19.930944] k3s[879]: W0923 04:42:14.829834 879 genericapiserver.go:787] Skipping API resource.k8s.io/v1alpha3 because it has no resources. machine # [ 19.932613] k3s[879]: I0923 04:42:14.833842 879 handler.go:304] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager machine # [ 19.934196] k3s[879]: W0923 04:42:14.833861 879 genericapiserver.go:787] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. machine # [ 20.264709] k3s[879]: I0923 04:42:15.180176 879 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 20.264963] k3s[879]: I0923 04:42:15.180338 879 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 20.265681] k3s[879]: I0923 04:42:15.180484 879 secure_serving.go:211] Serving securely on 127.0.0.1:6444 machine # [ 20.266182] k3s[879]: I0923 04:42:15.180646 879 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 20.266656] k3s[879]: I0923 04:42:15.180797 879 apiservice_controller.go:100] Starting APIServiceRegistrationController machine # [ 20.267141] k3s[879]: I0923 04:42:15.180811 879 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller machine # [ 20.274848] k3s[879]: I0923 04:42:15.190504 879 aggregator.go:185] waiting for initial CRD sync... machine # [ 20.275521] k3s[879]: I0923 04:42:15.190593 879 system_namespaces_controller.go:66] Starting system namespaces controller machine # [ 20.275990] k3s[879]: I0923 04:42:15.190821 879 customresource_discovery_controller.go:294] Starting DiscoveryController machine # [ 20.276710] k3s[879]: I0923 04:42:15.190878 879 apf_controller.go:377] Starting API Priority and Fairness config controller machine # [ 20.277281] k3s[879]: I0923 04:42:15.190995 879 controller.go:78] Starting OpenAPI AggregationController machine # [ 20.277791] k3s[879]: I0923 04:42:15.191031 879 controller.go:80] Starting OpenAPI V3 AggregationController machine # [ 20.278493] k3s[879]: I0923 04:42:15.191212 879 cluster_authentication_trust_controller.go:459] Starting cluster_authentication_trust_controller controller machine # [ 20.278968] k3s[879]: time="2026-09-23T04:42:15Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 20.279679] k3s[879]: I0923 04:42:15.191327 879 controller.go:90] Starting OpenAPI V3 controller machine # [ 20.280109] k3s[879]: I0923 04:42:15.191355 879 controller.go:113] "Deleting old lease on startup" lease="kube-system/apiserver-ik4pcwfs7qgdl76byc4pomgvia" machine # [ 20.280583] k3s[879]: I0923 04:42:15.191380 879 naming_controller.go:305] Starting NamingConditionController machine # [ 20.281076] k3s[879]: I0923 04:42:15.191466 879 nonstructuralschema_controller.go:202] Starting NonStructuralSchemaConditionController machine # [ 20.281582] k3s[879]: I0923 04:42:15.191494 879 apiapproval_controller.go:196] Starting KubernetesAPIApprovalPolicyConformantConditionController machine # [ 20.282103] k3s[879]: I0923 04:42:15.191522 879 crd_finalizer.go:273] Starting CRDFinalizer machine # [ 20.282307] k3s[879]: time="2026-09-23T04:42:15Z" level=info msg="Starting legacy_token_tracking_controller" logger=k3s machine # [ 20.282769] k3s[879]: time="2026-09-23T04:42:15Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 20.283481] k3s[879]: I0923 04:42:15.191946 879 crdregistration_controller.go:114] Starting crd-autoregister controller machine # [ 20.283987] k3s[879]: I0923 04:42:15.191960 879 shared_informer.go:349] "Waiting for caches to sync" controller="crd-autoregister" machine # [ 20.284735] k3s[879]: I0923 04:42:15.192066 879 controller.go:142] Starting OpenAPI controller machine # [ 20.285197] k3s[879]: I0923 04:42:15.192151 879 repairip.go:210] Starting ipallocator-repair-controller machine # [ 20.285748] k3s[879]: I0923 04:42:15.192163 879 shared_informer.go:349] "Waiting for caches to sync" controller="ipallocator-repair-controller" machine # [ 20.286434] k3s[879]: I0923 04:42:15.192510 879 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 20.286937] k3s[879]: I0923 04:42:15.192765 879 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 20.287643] k3s[879]: I0923 04:42:15.193270 879 default_servicecidr_controller.go:110] Starting kubernetes-service-cidr-controller machine # [ 20.288170] k3s[879]: I0923 04:42:15.193286 879 shared_informer.go:349] "Waiting for caches to sync" controller="kubernetes-service-cidr-controller" machine # [ 20.309306] k3s[879]: I0923 04:42:15.224919 879 dynamic_serving_content.go:135] "Starting controller" name="aggregator-proxy-cert::/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt::/var/lib/rancher/k3s/server/tls/client-auth-proxy.key" machine # [ 20.313099] k3s[879]: time="2026-09-23T04:42:15Z" level=info msg="Starting apiserver lease garbage collector" logger=k3s machine # [ 20.313473] k3s[879]: time="2026-09-23T04:42:15Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 20.314082] k3s[879]: I0923 04:42:15.228808 879 local_available_controller.go:156] Starting LocalAvailability controller machine # [ 20.314639] k3s[879]: I0923 04:42:15.228824 879 cache.go:32] Waiting for caches to sync for LocalAvailability controller machine # [ 20.315156] k3s[879]: I0923 04:42:15.228860 879 remote_available_controller.go:425] Starting RemoteAvailability controller machine # [ 20.315650] k3s[879]: I0923 04:42:15.228871 879 cache.go:32] Waiting for caches to sync for RemoteAvailability controller machine # [ 20.321149] k3s[879]: I0923 04:42:15.236796 879 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 20.365788] k3s[879]: I0923 04:42:15.281309 879 cache.go:39] Caches are synced for APIServiceRegistrationController controller machine # [ 20.366344] k3s[879]: I0923 04:42:15.281414 879 handler_discovery.go:451] Starting ResourceDiscoveryManager machine # [ 20.375721] k3s[879]: time="2026-09-23T04:42:15Z" level=info msg="Caches are synced" logger=k3s machine # [ 20.378605] k3s[879]: time="2026-09-23T04:42:15Z" level=info msg="Caches are synced" logger=k3s machine # [ 20.379226] k3s[879]: I0923 04:42:15.292609 879 shared_informer.go:356] "Caches are synced" controller="crd-autoregister" machine # [ 20.379968] k3s[879]: I0923 04:42:15.292658 879 aggregator.go:187] initial CRD sync complete... machine # [ 20.380705] k3s[879]: I0923 04:42:15.292671 879 autoregister_controller.go:144] Starting autoregister controller machine # [ 20.381538] k3s[879]: I0923 04:42:15.292683 879 cache.go:32] Waiting for caches to sync for autoregister controller machine # [ 20.382273] k3s[879]: I0923 04:42:15.292694 879 cache.go:39] Caches are synced for autoregister controller machine # [ 20.382895] k3s[879]: I0923 04:42:15.293512 879 shared_informer.go:356] "Caches are synced" controller="kubernetes-service-cidr-controller" machine # [ 20.383772] k3s[879]: I0923 04:42:15.293568 879 default_servicecidr_controller.go:169] Creating default ServiceCIDR with CIDRs: [10.43.0.0/16] machine # [ 20.401850] k3s[879]: E0923 04:42:15.317434 879 controller.go:201] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" machine # [ 20.413333] k3s[879]: I0923 04:42:15.328936 879 cache.go:39] Caches are synced for LocalAvailability controller machine # [ 20.431215] k3s[879]: time="2026-09-23T04:42:15Z" level=error msg="Error while syncing ConfigMap" configmap=kube-system/kube-apiserver-legacy-service-account-token-tracking error="namespaces \"kube-system\" not found" logger=k3s/UnhandledError machine # [ 20.494700] k3s[879]: time="2026-09-23T04:42:15Z" level=error msg="Error while syncing ConfigMap" configmap=kube-system/kube-apiserver-legacy-service-account-token-tracking error="namespaces \"kube-system\" not found" logger=k3s/UnhandledError machine # [ 20.565248] k3s[879]: time="2026-09-23T04:42:15Z" level=error msg="Error while syncing ConfigMap" configmap=kube-system/kube-apiserver-legacy-service-account-token-tracking error="namespaces \"kube-system\" not found" logger=k3s/UnhandledError machine # [ 20.645256] k3s[879]: time="2026-09-23T04:42:15Z" level=error msg="Error while syncing ConfigMap" configmap=kube-system/kube-apiserver-legacy-service-account-token-tracking error="namespaces \"kube-system\" not found" logger=k3s/UnhandledError machine # [ 20.666142] k3s[879]: E0923 04:42:15.581678 879 controller.go:201] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="400ms" machine # [ 20.672603] k3s[879]: I0923 04:42:15.588176 879 shared_informer.go:356] "Caches are synced" controller="node_authorizer" machine # [ 20.676192] k3s[879]: I0923 04:42:15.591786 879 apf_controller.go:382] Running API Priority and Fairness config worker machine # [ 20.677202] k3s[879]: I0923 04:42:15.591830 879 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process machine # [ 20.679196] k3s[879]: I0923 04:42:15.593250 879 shared_informer.go:356] "Caches are synced" controller="ipallocator-repair-controller" machine # [ 20.680390] k3s[879]: I0923 04:42:15.595073 879 shared_informer.go:377] "Caches are synced" machine # [ 20.681516] k3s[879]: I0923 04:42:15.595122 879 policy_source.go:248] refreshing policies machine # [ 20.693145] k3s[879]: I0923 04:42:15.608625 879 controller.go:667] quota admission added evaluator for: namespaces machine # [ 20.703177] k3s[879]: time="2026-09-23T04:42:15Z" level=info msg="containerd is now running" machine # [ 20.710131] k3s[879]: I0923 04:42:15.624549 879 default_servicecidr_controller.go:231] Setting default ServiceCIDR condition Ready to True machine # [ 20.710401] k3s[879]: I0923 04:42:15.624631 879 cidrallocator.go:302] created ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 20.717320] k3s[879]: time="2026-09-23T04:42:15Z" level=info msg="Caches are synced" logger=k3s machine # [ 20.725472] k3s[879]: I0923 04:42:15.641093 879 cache.go:39] Caches are synced for RemoteAvailability controller machine # [ 20.734983] k3s[879]: time="2026-09-23T04:42:15Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/k3s-airgap-images-amd64.tar.zst" machine # [ 20.737729] k3s[879]: I0923 04:42:15.653389 879 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 20.784446] k3s[879]: E0923 04:42:15.699671 879 controller.go:95] Unable to perform initial Kubernetes service initialization: namespaces "default" not found machine # [ 21.075091] k3s[879]: I0923 04:42:15.990579 879 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io machine # [ 21.287513] k3s[879]: I0923 04:42:16.203073 879 storage_scheduling.go:123] created PriorityClass system-node-critical with value 2000001000 machine # [ 21.295676] k3s[879]: I0923 04:42:16.211247 879 storage_scheduling.go:123] created PriorityClass system-cluster-critical with value 2000000000 machine # [ 21.296460] k3s[879]: I0923 04:42:16.211288 879 storage_scheduling.go:139] all system priority classes are created successfully or already exist. machine # [ 21.651342] k3s[879]: time="2026-09-23T04:42:16Z" level=info msg="Polling for API server readiness: GET /readyz failed: unknown" machine # [ 22.248868] k3s[879]: I0923 04:42:17.164112 879 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io machine # [ 22.291328] k3s[879]: I0923 04:42:17.206970 879 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io machine # [ 22.394117] k3s[879]: I0923 04:42:17.309646 879 alloc.go:329] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.43.0.1"} machine # [ 22.400149] k3s[879]: W0923 04:42:17.315721 879 lease.go:265] Resetting endpoints for master service "kubernetes" to [10.0.2.15] machine # [ 22.401544] k3s[879]: I0923 04:42:17.317216 879 controller.go:667] quota admission added evaluator for: endpoints machine # [ 22.407453] k3s[879]: I0923 04:42:17.323087 879 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io machine # [ 23.651462] k3s[879]: time="2026-09-23T04:42:18Z" level=info msg="Waiting for untainted node" machine # [ 23.652773] k3s[879]: time="2026-09-23T04:42:18Z" level=info msg="Creating k3s-supervisor event broadcaster" machine # [ 23.654090] k3s[879]: time="2026-09-23T04:42:18Z" level=info msg="Kube API server is now running" machine # [ 23.655317] k3s[879]: time="2026-09-23T04:42:18Z" level=info msg="k3s is up and running" machine # [ 23.656453] k3s[879]: time="2026-09-23T04:42:18Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Node and Certificate Authority certificates managed by k3s are OK" object=machine reason=CertificateExpirationOK type=Normal machine # [ 23.659534] systemd[1]: Started k3s service. machine # [ 23.660260] systemd[1]: Starting niks3 server... machine # [ 23.677288] k3s[879]: I0923 04:42:18.592962 879 controllermanager.go:189] "Starting" version="v1.35.8+k3s1" machine # [ 23.678771] k3s[879]: I0923 04:42:18.594466 879 controllermanager.go:191] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 23.688709] k3s[879]: I0923 04:42:18.604388 879 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 23.690437] k3s[879]: I0923 04:42:18.606128 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 23.691820] k3s[879]: I0923 04:42:18.604596 879 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 23.697191] k3s[879]: I0923 04:42:18.609540 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 23.698526] k3s[879]: I0923 04:42:18.604925 879 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 23.699960] k3s[879]: I0923 04:42:18.604506 879 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key" machine # [ 23.703558] k3s[879]: I0923 04:42:18.604617 879 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 23.705986] k3s[879]: I0923 04:42:18.609778 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 23.707466] k3s[879]: I0923 04:42:18.604604 879 secure_serving.go:211] Serving securely on 127.0.0.1:10257 machine # [ 23.708914] k3s[879]: I0923 04:42:18.618591 879 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="storageversion-garbage-collector-controller" requiredFeatureGates=["APIServerIdentity","StorageVersionAPI"] machine # [ 23.711752] k3s[879]: I0923 04:42:18.618633 879 controllermanager.go:579] "Warning: skipping controller" controller="storageversion-garbage-collector-controller" machine # [ 23.713783] k3s[879]: I0923 04:42:18.628105 879 controller.go:667] quota admission added evaluator for: serviceaccounts machine # [ 23.760102] k3s[879]: time="2026-09-23T04:42:18Z" level=info msg="Creating embedded CRD addons.k3s.cattle.io" machine # [ 23.765061] k3s[879]: time="2026-09-23T04:42:18Z" level=info msg="Creating embedded CRD etcdsnapshotfiles.k3s.cattle.io" machine # [ 23.768522] k3s[879]: I0923 04:42:18.684176 879 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" requiredFeatureGates=["ClusterTrustBundle"] machine # [ 23.771402] k3s[879]: I0923 04:42:18.684213 879 controllermanager.go:579] "Warning: skipping controller" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" machine # [ 23.773623] k3s[879]: time="2026-09-23T04:42:18Z" level=info msg="Creating embedded CRD helmchartconfigs.helm.cattle.io" machine # [ 23.781077] k3s[879]: I0923 04:42:18.696103 879 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 23.782752] k3s[879]: time="2026-09-23T04:42:18Z" level=info msg="Creating embedded CRD helmcharts.helm.cattle.io" machine # [ 23.785706] k3s[879]: I0923 04:42:18.701322 879 controllermanager.go:579] "Warning: skipping controller" controller="storage-version-migrator-controller" machine # [ 23.791920] k3s[879]: I0923 04:42:18.707569 879 shared_informer.go:377] "Caches are synced" machine # [ 23.793273] k3s[879]: I0923 04:42:18.708934 879 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 23.794871] k3s[879]: I0923 04:42:18.709652 879 shared_informer.go:377] "Caches are synced" machine # [ 23.796163] k3s[879]: I0923 04:42:18.711546 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 23.799785] k3s[879]: I0923 04:42:18.715200 879 shared_informer.go:377] "Caches are synced" machine # [ 23.809573] k3s[879]: I0923 04:42:18.725238 879 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 23.811141] k3s[879]: time="2026-09-23T04:42:18Z" level=info msg="Waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 23.824821] k3s[879]: I0923 04:42:18.740474 879 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 23.896304] k3s[879]: I0923 04:42:18.811925 879 shared_informer.go:377] "Caches are synced" machine: (finished: waiting for unit k3s.service, in 24.96 seconds) machine: waiting for success: kubectl get ns farm machine # Error from server (NotFound): namespaces "farm" not found machine # [ 24.258064] k3s[879]: I0923 04:42:19.173669 879 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="device-taint-eviction-controller" requiredFeatureGates=["DynamicResourceAllocation","DRADeviceTaints"] machine # [ 24.260896] k3s[879]: I0923 04:42:19.173705 879 controllermanager.go:579] "Warning: skipping controller" controller="device-taint-eviction-controller" machine # [ 24.319061] k3s[879]: time="2026-09-23T04:42:19Z" level=info msg="Done waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 24.320830] k3s[879]: time="2026-09-23T04:42:19Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-40.1.4+up40.1.0.tgz" machine # [ 24.322657] k3s[879]: time="2026-09-23T04:42:19Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-crd-40.1.4+up40.1.0.tgz" machine # [ 24.324582] k3s[879]: time="2026-09-23T04:42:19Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/ccm.yaml" machine # [ 24.326160] k3s[879]: time="2026-09-23T04:42:19Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/coredns.yaml" machine # [ 24.327801] k3s[879]: time="2026-09-23T04:42:19Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/local-storage.yaml" machine # [ 24.329475] k3s[879]: time="2026-09-23T04:42:19Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/rolebindings.yaml" machine # [ 24.331029] k3s[879]: time="2026-09-23T04:42:19Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/runtimes.yaml" machine # [ 24.332593] k3s[879]: time="2026-09-23T04:42:19Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/traefik.yaml" machine # [ 24.408265] k3s[879]: time="2026-09-23T04:42:19Z" level=info msg="Starting dynamiclistener CN filter node controller with SANs: [127.0.0.1 ::1 localhost machine 10.0.2.15 fec0::872:1c92:8ac0:9c98 10.43.0.1 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local]" machine # [ 24.408660] k3s[879]: time="2026-09-23T04:42:19Z" level=info msg="Tunnel server egress proxy mode: agent" machine # [ 24.457489] k3s[879]: I0923 04:42:19.373121 879 controllermanager.go:627] "Warning: controller is disabled" controller="selinux-warning-controller" machine # [ 24.770624] k3s[879]: I0923 04:42:19.685806 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="roles.rbac.authorization.k8s.io" machine # [ 24.770924] k3s[879]: I0923 04:42:19.685992 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="limitranges" machine # [ 24.771535] k3s[879]: I0923 04:42:19.686050 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="statefulsets.apps" machine # [ 24.772058] k3s[879]: I0923 04:42:19.686105 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="replicasets.apps" machine # [ 24.772541] k3s[879]: I0923 04:42:19.686163 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="cronjobs.batch" machine # [ 24.773881] k3s[879]: I0923 04:42:19.686218 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="jobs.batch" machine # [ 24.774767] k3s[879]: I0923 04:42:19.686276 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="poddisruptionbudgets.policy" machine # [ 24.775410] k3s[879]: I0923 04:42:19.686439 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="networkpolicies.networking.k8s.io" machine # [ 24.775957] k3s[879]: I0923 04:42:19.686497 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpointslices.discovery.k8s.io" machine # [ 24.777629] k3s[879]: I0923 04:42:19.686584 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmchartconfigs.helm.cattle.io" machine # [ 24.778534] k3s[879]: I0923 04:42:19.686646 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="resourceclaimtemplates.resource.k8s.io" machine # [ 24.779058] k3s[879]: I0923 04:42:19.686720 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="podtemplates" machine # [ 24.779528] k3s[879]: I0923 04:42:19.686834 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="daemonsets.apps" machine # [ 24.780242] k3s[879]: I0923 04:42:19.686929 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="horizontalpodautoscalers.autoscaling" machine # [ 24.780771] k3s[879]: I0923 04:42:19.686992 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="csistoragecapacities.storage.k8s.io" machine # [ 24.781504] k3s[879]: I0923 04:42:19.687026 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpoints" machine # [ 24.782166] k3s[879]: I0923 04:42:19.687079 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="controllerrevisions.apps" machine # [ 24.783073] k3s[879]: I0923 04:42:19.687119 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="ingresses.networking.k8s.io" machine # [ 24.783729] k3s[879]: I0923 04:42:19.687151 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="rolebindings.rbac.authorization.k8s.io" machine # [ 24.784699] k3s[879]: I0923 04:42:19.687207 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmcharts.helm.cattle.io" machine # [ 24.785395] k3s[879]: I0923 04:42:19.687242 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="addons.k3s.cattle.io" machine # [ 24.786149] k3s[879]: I0923 04:42:19.687326 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="deployments.apps" machine # [ 24.786937] k3s[879]: I0923 04:42:19.687380 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="serviceaccounts" machine # [ 24.787464] k3s[879]: I0923 04:42:19.687436 879 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="leases.coordination.k8s.io" machine # [ 24.788474] k3s[879]: time="2026-09-23T04:42:19Z" level=info msg="Creating new TLS secret for kube-system/k3s-serving (count: 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__872_1c92_8ac0_9c98-297c07:fec0::872:1c92:8ac0:9c98 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=16130F5061D523B50CB4974359B55C46AC73C6DA]" machine # [ 24.872590] k3s[879]: time="2026-09-23T04:42:19Z" level=info msg="Active TLS secret kube-system/k3s-serving (ver=234) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__872_1c92_8ac0_9c98-297c07:fec0::872:1c92:8ac0:9c98 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=16130F5061D523B50CB4974359B55C46AC73C6DA]" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 25.465515] k3s[879]: time="2026-09-23T04:42:20Z" level=info msg="Imported docker.io/rancher/klipper-helm:v0.13.3-build20260727" machine # [ 25.469168] k3s[879]: time="2026-09-23T04:42:20Z" level=info msg="Tagged docker.io/rancher/klipper-helm@sha256:5425a2b4613d2458dbdff99218e8d487ebb59c20e7a941f061c0777070f0aac1" machine # [ 25.469277] k3s[879]: time="2026-09-23T04:42:20Z" level=info msg="Imported docker.io/rancher/klipper-lb:v0.4.17" machine # [ 25.473104] k3s[879]: time="2026-09-23T04:42:20Z" level=info msg="Tagged docker.io/rancher/klipper-lb@sha256:910944bb0bd94f060a82a56ca1ea1c577d3e49b3473a093a47a985f32e92d94a" machine # [ 25.473611] k3s[879]: time="2026-09-23T04:42:20Z" level=info msg="Imported docker.io/rancher/local-path-provisioner:v0.0.37" machine # [ 25.478765] k3s[879]: time="2026-09-23T04:42:20Z" level=info msg="Tagged docker.io/rancher/local-path-provisioner@sha256:e757967a5ec338f6a9b371c5a9688bedaa8c3578ea3dd4db329ea0084be0a86f" machine # [ 25.481380] k3s[879]: time="2026-09-23T04:42:20Z" level=info msg="Imported docker.io/rancher/mirrored-coredns-coredns:1.14.6" machine # [ 25.486321] k3s[879]: time="2026-09-23T04:42:20Z" level=info msg="Tagged docker.io/rancher/mirrored-coredns-coredns@sha256:900f9c109f7a33545d3c811516e8376df9019147b750f5ce3e254468769176ea" machine # [ 25.486840] k3s[879]: time="2026-09-23T04:42:20Z" level=info msg="Imported docker.io/rancher/mirrored-library-busybox:1.37.0" machine # [ 25.494499] k3s[879]: time="2026-09-23T04:42:20Z" level=info msg="Tagged docker.io/rancher/mirrored-library-busybox@sha256:101b4afd76732482eff9b95cae5f94bcf295e521fbec4e01b69c5421f3f3f3e5" machine # [ 25.494929] k3s[879]: time="2026-09-23T04:42:20Z" level=info msg="Imported docker.io/rancher/mirrored-library-traefik:3.7.8" machine # [ 25.497472] k3s[879]: time="2026-09-23T04:42:20Z" level=info msg="Tagged docker.io/rancher/mirrored-library-traefik@sha256:4299bbed850421258fc5448c2e0e6ad350981d4d335a68de11b92448aedbefe5" machine # [ 25.497959] k3s[879]: time="2026-09-23T04:42:20Z" level=info msg="Imported docker.io/rancher/mirrored-metrics-server:v0.9.0" machine # [ 25.501984] k3s[879]: time="2026-09-23T04:42:20Z" level=info msg="Tagged docker.io/rancher/mirrored-metrics-server@sha256:d9862115e7c7881280d3d75ca26bda8ffc0fc213315979575bf23ce9826205c0" machine # [ 25.502229] k3s[879]: time="2026-09-23T04:42:20Z" level=info msg="Imported docker.io/rancher/mirrored-pause:3.10.2" machine # [ 25.504939] k3s[879]: time="2026-09-23T04:42:20Z" level=info msg="Tagged docker.io/rancher/mirrored-pause@sha256:f548e0e8e3dc1896ca956272154dde3314e8cc4fde0a57577ee9fa1c63f5baf4" machine # [ 25.515823] k3s[879]: time="2026-09-23T04:42:20Z" level=info msg="Starting k3s.cattle.io/v1, Kind=Addon controller" machine # [ 25.516070] k3s[879]: time="2026-09-23T04:42:20Z" level=info msg="Creating deploy event broadcaster" machine # [ 25.519709] k3s[879]: I0923 04:42:20.435203 879 controller.go:667] quota admission added evaluator for: addons.k3s.cattle.io machine # [ 25.520059] k3s[879]: time="2026-09-23T04:42:20Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 25.524068] k3s[879]: time="2026-09-23T04:42:20Z" level=info msg="Creating helm-controller event broadcaster" machine # [ 25.524363] k3s[879]: time="2026-09-23T04:42:20Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 25.533685] k3s[879]: time="2026-09-23T04:42:20Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=ApplyingManifest type=Normal machine # [ 25.537327] k3s[879]: time="2026-09-23T04:42:20Z" level=info msg="Cluster dns configmap has been set successfully" machine # [ 25.619223] k3s[879]: I0923 04:42:20.534860 879 range_allocator.go:113] "No Secondary Service CIDR provided. Skipping filtering out secondary service addresses" logger="node-ipam-controller" machine # [ 25.807193] k3s[879]: time="2026-09-23T04:42:20Z" level=info msg="Imported 8 images from /var/lib/rancher/k3s/agent/images/k3s-airgap-images-amd64.tar.zst in 5.072109443s" machine # [ 25.807614] k3s[879]: time="2026-09-23T04:42:20Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-client.tar" machine # [ 25.868481] k3s[879]: time="2026-09-23T04:42:20Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=AppliedManifest type=Normal machine # [ 25.881521] k3s[879]: time="2026-09-23T04:42:20Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=ApplyingManifest type=Normal machine # [ 26.312606] k3s[879]: time="2026-09-23T04:42:21Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=AppliedManifest type=Normal machine # [ 26.323356] k3s[879]: time="2026-09-23T04:42:21Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=ApplyingManifest type=Normal machine # [ 26.460211] k3s[879]: I0923 04:42:21.375816 879 controllermanager.go:627] "Warning: controller is disabled" controller="bootstrap-signer-controller" machine # [ 26.507147] k3s[879]: I0923 04:42:21.422762 879 node_lifecycle_controller.go:419] "Controller will reconcile labels" logger="node-lifecycle-controller" machine # [ 26.507651] k3s[879]: I0923 04:42:21.422818 879 controllermanager.go:627] "Warning: controller is disabled" controller="cloud-node-lifecycle-controller" machine # [ 26.522872] k3s[879]: time="2026-09-23T04:42:21Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine: (finished: waiting for success: kubectl get ns farm, in 2.54 seconds) machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key, in 0.14 seconds) machine: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key machine # [ 26.734237] k3s[879]: I0923 04:42:21.649695 879 serving.go:392] Generated self-signed cert in-memory machine # [ 26.738368] k3s[879]: time="2026-09-23T04:42:21Z" level=info msg="Starting rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding controller" machine # [ 26.744170] k3s[879]: time="2026-09-23T04:42:21Z" level=info msg="Starting batch/v1, Kind=Job controller" machine # [ 26.746742] k3s[879]: time="2026-09-23T04:42:21Z" level=info msg="Starting /v1, Kind=ServiceAccount controller" machine # [ 26.748190] k3s[879]: time="2026-09-23T04:42:21Z" level=info msg="Starting /v1, Kind=Secret controller" machine # [ 26.749580] k3s[879]: time="2026-09-23T04:42:21Z" level=info msg="Starting /v1, Kind=ConfigMap controller" machine # [ 26.751149] k3s[879]: time="2026-09-23T04:42:21Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChartConfig controller" machine # [ 26.752919] k3s[879]: time="2026-09-23T04:42:21Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChart controller" machine # [ 26.829041] k3s[879]: I0923 04:42:21.744255 879 serving.go:392] Generated self-signed cert in-memory machine: (finished: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key, in 0.15 seconds) machine: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine # [ 26.965143] k3s[879]: I0923 04:42:21.879863 879 controller.go:667] quota admission added evaluator for: deployments.apps machine: (finished: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.14 seconds) subtest: chart deploys and workers become Ready machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine # [ 27.071814] k3s[879]: I0923 04:42:21.987385 879 controllermanager.go:160] Version: v1.35.8+k3s1 machine # [ 27.075854] k3s[879]: I0923 04:42:21.991544 879 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 27.076239] k3s[879]: I0923 04:42:21.991922 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.079069] k3s[879]: I0923 04:42:21.991792 879 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 27.079522] k3s[879]: I0923 04:42:21.991735 879 secure_serving.go:211] Serving securely on 127.0.0.1:10258 machine # [ 27.080153] k3s[879]: I0923 04:42:21.991825 879 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 27.080613] k3s[879]: I0923 04:42:21.993406 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.081097] k3s[879]: I0923 04:42:21.991848 879 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 27.081581] k3s[879]: I0923 04:42:21.993448 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.085844] k3s[879]: time="2026-09-23T04:42:22Z" level=info msg="Creating service-lb-controller event broadcaster" machine # [ 27.105497] k3s[879]: I0923 04:42:22.021150 879 alloc.go:329] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.43.0.10"} machine # [ 27.106079] k3s[879]: E0923 04:42:22.021725 879 repairip.go:372] "Unhandled Error" err="the ClusterIP [IPv4]: 10.43.0.10 for Service kube-system/kube-dns is not allocated; repairing" logger="UnhandledError" machine # [ 27.107335] k3s[879]: time="2026-09-23T04:42:22Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=AppliedManifest type=Normal machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 27.277190] k3s[879]: I0923 04:42:22.192804 879 shared_informer.go:377] "Caches are synced" machine # [ 27.277905] k3s[879]: I0923 04:42:22.193596 879 shared_informer.go:377] "Caches are synced" machine # [ 27.278652] k3s[879]: I0923 04:42:22.193614 879 shared_informer.go:377] "Caches are synced" machine # [ 27.318428] k3s[879]: time="2026-09-23T04:42:22Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 27.322985] k3s[879]: time="2026-09-23T04:42:22Z" level=info msg="Starting /v1, Kind=Pod controller" machine # [ 27.327276] k3s[879]: time="2026-09-23T04:42:22Z" level=info msg="Starting apps/v1, Kind=DaemonSet controller" machine # [ 27.331940] k3s[879]: time="2026-09-23T04:42:22Z" level=info msg="Starting discovery.k8s.io/v1, Kind=EndpointSlice controller" machine # [ 27.332677] k3s[879]: I0923 04:42:22.246847 879 controllermanager.go:329] Started "cloud-node-lifecycle-controller" machine # [ 27.333558] k3s[879]: I0923 04:42:22.247081 879 node_lifecycle_controller.go:112] Sending events to api server machine # [ 27.334205] k3s[879]: I0923 04:42:22.247209 879 controllermanager.go:329] Started "service-lb-controller" machine # [ 27.334862] k3s[879]: W0923 04:42:22.247222 879 controllermanager.go:306] "node-route-controller" is disabled machine # [ 27.335627] k3s[879]: I0923 04:42:22.247383 879 controller.go:235] Starting service controller machine # [ 27.336241] k3s[879]: I0923 04:42:22.247392 879 controllermanager.go:329] Started "cloud-node-controller" machine # [ 27.336862] k3s[879]: I0923 04:42:22.247415 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.337284] k3s[879]: I0923 04:42:22.247544 879 node_controller.go:176] Sending events to api server. machine # [ 27.337900] k3s[879]: I0923 04:42:22.247593 879 node_controller.go:185] Waiting for informer caches to sync machine # [ 27.523518] k3s[879]: time="2026-09-23T04:42:22Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 27.532252] k3s[879]: I0923 04:42:22.447876 879 shared_informer.go:377] "Caches are synced" machine # [ 27.657161] k3s[879]: I0923 04:42:22.572523 879 controllermanager.go:627] "Warning: controller is disabled" controller="node-route-controller" machine # [ 27.757167] k3s[879]: time="2026-09-23T04:42:22Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" object=kube-system/local-storage reason=DeletingManifest type=Normal machine # [ 27.770863] k3s[879]: time="2026-09-23T04:42:22Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=ApplyingManifest type=Normal machine # [ 27.807127] k3s[879]: I0923 04:42:22.722765 879 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="podcertificaterequest-cleaner-controller" requiredFeatureGates=["PodCertificateRequest"] machine # [ 27.807294] k3s[879]: I0923 04:42:22.722798 879 controllermanager.go:579] "Warning: skipping controller" controller="podcertificaterequest-cleaner-controller" machine # [ 27.807955] k3s[879]: I0923 04:42:22.722812 879 controllermanager.go:627] "Warning: controller is disabled" controller="service-lb-controller" machine # [ 27.960108] k3s[879]: W0923 04:42:22.874682 879 probe.go:272] Flexvolume plugin directory at /usr/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating. machine # [ 27.962680] k3s[879]: I0923 04:42:22.878261 879 controller.go:667] quota admission added evaluator for: helmcharts.helm.cattle.io machine # [ 27.965940] k3s[879]: time="2026-09-23T04:42:22Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=AppliedManifest type=Normal machine # [ 27.978652] k3s[879]: time="2026-09-23T04:42:22Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=ApplyingManifest type=Normal machine # [ 28.115108] k3s[879]: time="2026-09-23T04:42:23Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Applying HelmChart from https://%{KUBERNETES_API}%/static/charts/nix-grpc-farm.tgz using Job kube-system/helm-install-nix-grpc-farm " object=kube-system/nix-grpc-farm reason=ApplyJob type=Normal machine # [ 28.136777] k3s[879]: I0923 04:42:23.052410 879 controller.go:667] quota admission added evaluator for: jobs.batch machine # [ 28.158692] k3s[879]: time="2026-09-23T04:42:23Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=AppliedManifest type=Normal machine # [ 28.167917] k3s[879]: time="2026-09-23T04:42:23Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=ApplyingManifest type=Normal machine # [ 28.269519] k3s[879]: I0923 04:42:23.185054 879 publisher.go:107] "Starting root CA cert publisher controller" machine # [ 28.271243] k3s[879]: I0923 04:42:23.185093 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.278894] k3s[879]: I0923 04:42:23.193826 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.280170] k3s[879]: I0923 04:42:23.193990 879 endpoints_controller.go:193] "Starting endpoint controller" machine # [ 28.281590] k3s[879]: I0923 04:42:23.194010 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.282962] k3s[879]: I0923 04:42:23.194104 879 job_controller.go:254] "Starting job controller" machine # [ 28.284233] k3s[879]: I0923 04:42:23.194152 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.285570] k3s[879]: I0923 04:42:23.194183 879 disruption.go:458] "Sending events to api server." machine # [ 28.286875] k3s[879]: I0923 04:42:23.194239 879 disruption.go:465] "Starting disruption controller" machine # [ 28.288234] k3s[879]: I0923 04:42:23.194249 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.289645] k3s[879]: I0923 04:42:23.194278 879 cleaner.go:83] "Starting CSR cleaner controller" machine # [ 28.290953] k3s[879]: I0923 04:42:23.194349 879 pv_protection_controller.go:81] "Starting PV protection controller" machine # [ 28.292477] k3s[879]: I0923 04:42:23.194382 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.293892] k3s[879]: I0923 04:42:23.194419 879 legacy_serviceaccount_token_cleaner.go:103] "Starting legacy service account token cleaner controller" machine # [ 28.295826] k3s[879]: I0923 04:42:23.194478 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.297111] k3s[879]: I0923 04:42:23.194560 879 daemon_controller.go:309] "Starting daemon sets controller" machine # [ 28.298716] k3s[879]: I0923 04:42:23.194579 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.300178] k3s[879]: I0923 04:42:23.197851 879 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-legacy-unknown" machine # [ 28.301967] k3s[879]: I0923 04:42:23.197912 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.303283] k3s[879]: I0923 04:42:23.197949 879 clusterroleaggregation_controller.go:194] "Starting ClusterRoleAggregator controller" machine # [ 28.304941] k3s[879]: I0923 04:42:23.197969 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.306269] k3s[879]: I0923 04:42:23.198066 879 controller.go:423] "Starting resource claim controller" machine # [ 28.307626] k3s[879]: I0923 04:42:23.198086 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.308994] k3s[879]: I0923 04:42:23.198205 879 replica_set.go:241] "Starting controller" name="replicationcontroller" machine # [ 28.310565] k3s[879]: I0923 04:42:23.198228 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.311855] k3s[879]: I0923 04:42:23.198266 879 tokencleaner.go:117] "Starting token cleaner controller" machine # [ 28.313168] k3s[879]: I0923 04:42:23.198315 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.314504] k3s[879]: I0923 04:42:23.198379 879 expand_controller.go:328] "Starting expand controller" machine # [ 28.315864] k3s[879]: I0923 04:42:23.198405 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.317116] k3s[879]: I0923 04:42:23.198443 879 controller.go:174] "Starting ephemeral volume controller" machine # [ 28.318502] k3s[879]: I0923 04:42:23.198464 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.319819] k3s[879]: I0923 04:42:23.198511 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.321167] k3s[879]: I0923 04:42:23.198833 879 namespace_controller.go:202] "Starting namespace controller" machine # [ 28.322621] k3s[879]: I0923 04:42:23.198848 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.323870] k3s[879]: I0923 04:42:23.198889 879 serviceaccounts_controller.go:117] "Starting service account controller" machine # [ 28.325321] k3s[879]: I0923 04:42:23.198916 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.326657] k3s[879]: I0923 04:42:23.198948 879 ttl_controller.go:127] "Starting TTL controller" machine # [ 28.327947] k3s[879]: I0923 04:42:23.198969 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.329296] k3s[879]: I0923 04:42:23.199055 879 node_ipam_controller.go:142] "Starting ipam controller" machine # [ 28.330629] k3s[879]: I0923 04:42:23.199076 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.331950] k3s[879]: I0923 04:42:23.199153 879 pv_controller_base.go:307] "Starting persistent volume controller" machine # [ 28.333410] k3s[879]: I0923 04:42:23.199201 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.334767] k3s[879]: I0923 04:42:23.199286 879 endpointslicemirroring_controller.go:226] "Starting EndpointSliceMirroring controller" machine # [ 28.336442] k3s[879]: I0923 04:42:23.199307 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.337744] k3s[879]: I0923 04:42:23.199498 879 taint_eviction.go:283] "Starting" controller="taint-eviction-controller" machine # [ 28.339282] k3s[879]: I0923 04:42:23.199580 879 taint_eviction.go:288] "Sending events to API server" machine # [ 28.340626] k3s[879]: I0923 04:42:23.199593 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.341952] k3s[879]: I0923 04:42:23.199667 879 deployment_controller.go:172] "Starting controller" controller="deployment" machine # [ 28.343478] k3s[879]: I0923 04:42:23.199688 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.344828] k3s[879]: I0923 04:42:23.199820 879 replica_set.go:241] "Starting controller" name="replicaset" machine # [ 28.346257] k3s[879]: I0923 04:42:23.199872 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.347560] k3s[879]: I0923 04:42:23.199966 879 node_lifecycle_controller.go:453] "Sending events to api server" machine # [ 28.348980] k3s[879]: I0923 04:42:23.200004 879 node_lifecycle_controller.go:460] "Starting node controller" machine # [ 28.350412] k3s[879]: I0923 04:42:23.200014 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.351734] k3s[879]: I0923 04:42:23.200045 879 ttlafterfinished_controller.go:112] "Starting TTL after finished controller" machine # [ 28.353325] k3s[879]: I0923 04:42:23.200066 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.354639] k3s[879]: I0923 04:42:23.200174 879 servicecidrs_controller.go:136] "Starting" controller="service-cidr-controller" machine # [ 28.356284] k3s[879]: I0923 04:42:23.200194 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.357581] k3s[879]: I0923 04:42:23.200293 879 endpointslice_controller.go:283] "Starting endpoint slice controller" machine # [ 28.359105] k3s[879]: I0923 04:42:23.200314 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.360440] k3s[879]: I0923 04:42:23.200358 879 gc_controller.go:98] "Starting GC controller" machine # [ 28.361676] k3s[879]: I0923 04:42:23.200389 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.363124] k3s[879]: I0923 04:42:23.200487 879 horizontal.go:204] "Starting HPA controller" machine # [ 28.363435] k3s[879]: I0923 04:42:23.200538 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.365567] k3s[879]: I0923 04:42:23.200633 879 stateful_set.go:180] "Starting stateful set controller" machine # [ 28.366183] k3s[879]: I0923 04:42:23.200653 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.366671] k3s[879]: I0923 04:42:23.200721 879 cronjob_controllerv2.go:143] "Starting cronjob controller v2" machine # [ 28.367168] k3s[879]: I0923 04:42:23.203780 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.367642] k3s[879]: I0923 04:42:23.203817 879 certificate_controller.go:120] "Starting certificate controller" name="csrapproving" machine # [ 28.368230] k3s[879]: I0923 04:42:23.203839 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.368710] k3s[879]: I0923 04:42:23.203896 879 pvc_protection_controller.go:166] "Starting PVC protection controller" machine # [ 28.369278] k3s[879]: I0923 04:42:23.203962 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.369831] k3s[879]: I0923 04:42:23.204042 879 attach_detach_controller.go:335] "Starting attach detach controller" machine # [ 28.370642] k3s[879]: I0923 04:42:23.204063 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.371561] k3s[879]: I0923 04:42:23.204094 879 vac_protection_controller.go:206] "Starting VAC protection controller" machine # [ 28.372137] k3s[879]: I0923 04:42:23.204118 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.372508] k3s[879]: I0923 04:42:23.205844 879 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-serving" machine # [ 28.373074] k3s[879]: I0923 04:42:23.205903 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.373455] k3s[879]: I0923 04:42:23.205977 879 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-client" machine # [ 28.374576] k3s[879]: I0923 04:42:23.205996 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.375527] k3s[879]: I0923 04:42:23.206032 879 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kube-apiserver-client" machine # [ 28.376499] k3s[879]: I0923 04:42:23.206051 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.377079] k3s[879]: I0923 04:42:23.206087 879 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 28.378086] k3s[879]: I0923 04:42:23.208845 879 resource_quota_controller.go:297] "Starting resource quota controller" machine # [ 28.379117] k3s[879]: I0923 04:42:23.208910 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.379981] k3s[879]: I0923 04:42:23.209058 879 garbagecollector.go:141] "Starting controller" controller="garbagecollector" machine # [ 28.380876] k3s[879]: I0923 04:42:23.209094 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.381791] k3s[879]: I0923 04:42:23.209878 879 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 28.382858] k3s[879]: I0923 04:42:23.210098 879 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 28.383752] k3s[879]: I0923 04:42:23.210336 879 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 28.384729] k3s[879]: I0923 04:42:23.210766 879 resource_quota_monitor.go:309] "QuotaMonitor running" machine # [ 28.385776] k3s[879]: I0923 04:42:23.211053 879 graph_builder.go:386] "Running" component="GraphBuilder" machine # [ 28.386698] k3s[879]: I0923 04:42:23.229388 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.387296] k3s[879]: time="2026-09-23T04:42:23Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=AppliedManifest type=Normal machine # [ 28.388145] k3s[879]: I0923 04:42:23.295042 879 shared_informer.go:377] "Caches are synced" machine # [ 28.388812] k3s[879]: I0923 04:42:23.298444 879 shared_informer.go:377] "Caches are synced" machine # [ 28.389639] k3s[879]: I0923 04:42:23.298513 879 shared_informer.go:377] "Caches are synced" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 28.430535] k3s[879]: I0923 04:42:23.345285 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.471952] k3s[879]: I0923 04:42:23.387606 879 shared_informer.go:377] "Caches are synced" machine # [ 28.475755] k3s[879]: time="2026-09-23T04:42:23Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/traefik.yaml\"" object=kube-system/traefik reason=DeletingManifest type=Normal machine # [ 28.479177] k3s[879]: I0923 04:42:23.394837 879 shared_informer.go:377] "Caches are synced" machine # [ 28.480552] k3s[879]: I0923 04:42:23.396233 879 shared_informer.go:377] "Caches are synced" machine # [ 28.482328] k3s[879]: I0923 04:42:23.398006 879 shared_informer.go:377] "Caches are synced" machine # [ 28.484615] k3s[879]: I0923 04:42:23.400296 879 shared_informer.go:377] "Caches are synced" machine # [ 28.486078] k3s[879]: I0923 04:42:23.401758 879 shared_informer.go:377] "Caches are synced" machine # [ 28.488072] k3s[879]: I0923 04:42:23.403574 879 shared_informer.go:377] "Caches are synced" machine # [ 28.489035] k3s[879]: I0923 04:42:23.404694 879 shared_informer.go:377] "Caches are synced" machine # [ 28.490387] k3s[879]: I0923 04:42:23.406064 879 shared_informer.go:377] "Caches are synced" machine # [ 28.490794] k3s[879]: I0923 04:42:23.406076 879 shared_informer.go:377] "Caches are synced" machine # [ 28.491500] k3s[879]: I0923 04:42:23.406109 879 shared_informer.go:377] "Caches are synced" machine # [ 28.493675] k3s[879]: I0923 04:42:23.409317 879 shared_informer.go:377] "Caches are synced" machine # [ 28.494138] k3s[879]: I0923 04:42:23.409387 879 shared_informer.go:377] "Caches are synced" machine # [ 28.494607] k3s[879]: I0923 04:42:23.409992 879 shared_informer.go:377] "Caches are synced" machine # [ 28.495181] k3s[879]: I0923 04:42:23.410150 879 shared_informer.go:377] "Caches are synced" machine # [ 28.495674] k3s[879]: I0923 04:42:23.410304 879 shared_informer.go:377] "Caches are synced" machine # [ 28.498988] k3s[879]: I0923 04:42:23.410343 879 shared_informer.go:377] "Caches are synced" machine # [ 28.499450] k3s[879]: I0923 04:42:23.414605 879 range_allocator.go:177] "Sending events to api server" machine # [ 28.499954] k3s[879]: I0923 04:42:23.414716 879 shared_informer.go:377] "Caches are synced" machine # [ 28.502426] k3s[879]: I0923 04:42:23.418101 879 shared_informer.go:377] "Caches are synced" machine # [ 28.503721] k3s[879]: I0923 04:42:23.419403 879 shared_informer.go:377] "Caches are synced" machine # [ 28.504164] k3s[879]: I0923 04:42:23.419453 879 shared_informer.go:377] "Caches are synced" machine # [ 28.505721] k3s[879]: I0923 04:42:23.421398 879 shared_informer.go:377] "Caches are synced" machine # [ 28.506139] k3s[879]: I0923 04:42:23.421437 879 shared_informer.go:377] "Caches are synced" machine # [ 28.508287] k3s[879]: I0923 04:42:23.423966 879 shared_informer.go:377] "Caches are synced" machine # [ 28.508585] k3s[879]: I0923 04:42:23.424026 879 shared_informer.go:377] "Caches are synced" machine # [ 28.512087] k3s[879]: I0923 04:42:23.426301 879 shared_informer.go:377] "Caches are synced" machine # [ 28.512608] k3s[879]: I0923 04:42:23.427184 879 shared_informer.go:377] "Caches are synced" machine # [ 28.513402] k3s[879]: I0923 04:42:23.427786 879 shared_informer.go:377] "Caches are synced" machine # [ 28.513499] k3s[879]: I0923 04:42:23.427839 879 shared_informer.go:377] "Caches are synced" machine # [ 28.516197] k3s[879]: I0923 04:42:23.431881 879 shared_informer.go:377] "Caches are synced" machine # [ 28.516515] k3s[879]: I0923 04:42:23.432216 879 shared_informer.go:377] "Caches are synced" machine # [ 28.518717] k3s[879]: I0923 04:42:23.434405 879 shared_informer.go:377] "Caches are synced" machine # [ 28.520266] k3s[879]: I0923 04:42:23.435890 879 range_allocator.go:181] "Starting range CIDR allocator" machine # [ 28.520680] k3s[879]: I0923 04:42:23.435914 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.521157] k3s[879]: I0923 04:42:23.435926 879 shared_informer.go:377] "Caches are synced" machine # [ 28.521670] k3s[879]: I0923 04:42:23.436202 879 shared_informer.go:377] "Caches are synced" machine # [ 28.526295] k3s[879]: time="2026-09-23T04:42:23Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 28.578855] k3s[879]: I0923 04:42:23.494410 879 shared_informer.go:377] "Caches are synced" machine # [ 28.579136] k3s[879]: I0923 04:42:23.494436 879 shared_informer.go:377] "Caches are synced" machine # [ 28.579666] k3s[879]: I0923 04:42:23.494468 879 shared_informer.go:377] "Caches are synced" machine # [ 28.584980] k3s[879]: I0923 04:42:23.500630 879 shared_informer.go:377] "Caches are synced" machine # [ 28.588852] k3s[879]: I0923 04:42:23.504415 879 shared_informer.go:377] "Caches are synced" machine # [ 28.614969] k3s[879]: I0923 04:42:23.530602 879 shared_informer.go:377] "Caches are synced" machine # [ 28.892385] k3s[879]: time="2026-09-23T04:42:23Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Deferred node password secret validation complete" object=machine reason=NodePasswordValidationComplete type=Normal machine # [ 29.017220] k3s[879]: I0923 04:42:23.932162 879 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 29.019529] k3s[879]: I0923 04:42:23.935169 879 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 29.062219] k3s[879]: I0923 04:42:23.977821 879 controller.go:667] quota admission added evaluator for: replicasets.apps machine # [ 29.281514] k3s[879]: time="2026-09-23T04:42:24Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Resumed synced Job kube-system/helm-install-nix-grpc-farm" object=kube-system/nix-grpc-farm reason=ResumeJob type=Normal machine # [ 29.523644] k3s[879]: time="2026-09-23T04:42:24Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 29.630140] k3s[879]: I0923 04:42:24.545442 879 shared_informer.go:377] "Caches are synced" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 29.694158] k3s[879]: I0923 04:42:24.609768 879 shared_informer.go:377] "Caches are synced" machine # [ 29.694426] k3s[879]: I0923 04:42:24.609826 879 garbagecollector.go:166] "Garbage collector: all resource monitors have synced" machine # [ 29.694834] k3s[879]: I0923 04:42:24.609839 879 garbagecollector.go:169] "Proceeding to collect garbage" machine # [ 30.314854] postgres[1195]: [1195] ERROR: relation "goose_db_version" does not exist at character 36 machine # [ 30.315312] postgres[1195]: [1195] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC machine # [ 30.336339] niks3-server[1187]: 2026/09/23 04:42:25 OK 20241026095416_initial_model.sql (9.74ms) machine # [ 30.339403] niks3-server[1187]: 2026/09/23 04:42:25 OK 20251210153512_drop_unused_gin_index.sql (3.23ms) machine # [ 30.344320] niks3-server[1187]: 2026/09/23 04:42:25 OK 20251218171726_add_pins.sql (4.85ms) machine # [ 30.351336] niks3-server[1187]: 2026/09/23 04:42:25 OK 20260628120000_add_object_size_and_stats.sql (4.39ms) machine # [ 30.355048] niks3-server[1187]: 2026/09/23 04:42:25 OK 20260905000000_add_claims.sql (3.68ms) machine # [ 30.358256] niks3-server[1187]: 2026/09/23 04:42:25 OK 20260920000000_drop_claims.sql (3.13ms) machine # [ 30.358610] niks3-server[1187]: 2026/09/23 04:42:25 goose: successfully migrated database to version: 20260920000000 machine # [ 30.361762] niks3-server[1187]: 2026/09/23 04:42:25 OK 1_commit_pending_closure.sql (3.34ms) machine # [ 30.367313] niks3-server[1187]: 2026/09/23 04:42:25 OK 2_object_stats_trigger.sql (5.58ms) machine # [ 30.367603] niks3-server[1187]: 2026/09/23 04:42:25 goose: up to current file version: 2 machine # [ 30.369898] niks3-server[1187]: 2026/09/23 04:42:25 INFO OIDC provider initialized name=kubernetes issuer=https://kubernetes.default.svc.cluster.local machine # [ 30.370250] niks3-server[1187]: 2026/09/23 04:42:25 INFO OIDC authentication enabled config=/nix/store/v0b0sqyzhrjsz48x3klf7b7vl89apzs0-niks3-oidc.json machine # [ 30.370780] niks3-server[1187]: 2026/09/23 04:42:25 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key machine # [ 30.396120] niks3-server[1187]: 2026/09/23 04:42:25 INFO Read proxy enabled — serving cache objects from S3 machine # [ 30.396774] niks3-server[1187]: 2026/09/23 04:42:25 INFO Using socket-activated listener address=0.0.0.0:5751 machine # [ 30.397940] niks3-server[1187]: 2026/09/23 04:42:25 INFO Starting HTTP server address=0.0.0.0:5751 machine # [ 30.398857] niks3-server[1187]: 2026/09/23 04:42:25 INFO systemd watchdog enabled interval=15s machine # [ 30.400051] systemd[1]: Started niks3 server. machine # [ 30.400370] systemd[1]: Reached target Multi-User System. machine # [ 30.403361] systemd[1]: Startup finished in 1.109s (kernel) + 3.890s (initrd) + 25.402s (userspace) = 30.403s. machine # [ 30.524795] k3s[879]: time="2026-09-23T04:42:25Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 31.526393] k3s[879]: time="2026-09-23T04:42:26Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 31.668251] k3s[879]: time="2026-09-23T04:42:26Z" level=info msg="Started tunnel to 10.0.2.15:6443" machine # [ 31.669638] k3s[879]: time="2026-09-23T04:42:26Z" level=info msg="Stopped tunnel to 127.0.0.1:6443" machine # [ 31.670951] k3s[879]: time="2026-09-23T04:42:26Z" level=info msg="Proxy done" err="context canceled" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 31.672779] k3s[879]: time="2026-09-23T04:42:26Z" level=info msg="Connecting to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 31.674356] k3s[879]: time="2026-09-23T04:42:26Z" level=info msg="error in remotedialer server [400]: websocket: close 1006 (abnormal closure): unexpected EOF" machine # [ 31.676238] k3s[879]: time="2026-09-23T04:42:26Z" level=info msg="Handling backend connection request [machine]" machine # [ 31.677644] k3s[879]: time="2026-09-23T04:42:26Z" level=info msg="Connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 31.679158] k3s[879]: time="2026-09-23T04:42:26Z" level=info msg="Remotedialer connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 32.523755] k3s[879]: time="2026-09-23T04:42:27Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 33.523893] k3s[879]: time="2026-09-23T04:42:28Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 33.666981] k3s[879]: time="2026-09-23T04:42:28Z" level=info msg="Imported docker.io/library/nix-grpc-farm-client:0.1.0-beta.3" machine # [ 33.671737] k3s[879]: time="2026-09-23T04:42:28Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-client@sha256:18eca57efa88527daf7b9c1455e4230faf6f90931f4cee2c49d901db7cb912bb" machine # [ 34.346024] k3s[879]: time="2026-09-23T04:42:29Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-client.tar in 8.538952855s" machine # [ 34.348448] k3s[879]: time="2026-09-23T04:42:29Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-lb.tar" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 34.525252] k3s[879]: time="2026-09-23T04:42:29Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 35.525309] k3s[879]: time="2026-09-23T04:42:30Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 36.218924] k3s[879]: time="2026-09-23T04:42:31Z" level=info msg="Imported docker.io/library/nix-grpc-farm-lb:0.1.0-beta.3" machine # [ 36.226066] k3s[879]: time="2026-09-23T04:42:31Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-lb@sha256:18ee6724be589622e1aee9d13c5121e7b2c992ca636c935ade90c66423e18f37" machine # [ 36.292695] k3s[879]: time="2026-09-23T04:42:31Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-lb.tar in 1.94639626s" machine # [ 36.294334] k3s[879]: time="2026-09-23T04:42:31Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm.tar" machine # [ 36.528355] k3s[879]: time="2026-09-23T04:42:31Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 36.743995] k3s[879]: time="2026-09-23T04:42:31Z" level=info msg="Running kubelet --cloud-provider=external --config-dir=/var/lib/rancher/k3s/agent/etc/kubelet.conf.d --containerd=/run/k3s/containerd/containerd.sock --eviction-hard=nodefs.available<1%,imagefs.available<1% --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubelet.kubeconfig --node-ip=10.0.2.15,fec0::872:1c92:8ac0:9c98 --node-labels= --read-only-port=0" machine # [ 36.756251] k3s[879]: Flag --containerd has been deprecated, This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed. machine # [ 36.763215] k3s[879]: I0923 04:42:31.674090 879 server.go:521] "Kubelet version" kubeletVersion="v1.35.8+k3s1" machine # [ 36.766506] k3s[879]: I0923 04:42:31.674158 879 server.go:523] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 36.769875] k3s[879]: I0923 04:42:31.674234 879 watchdog_linux.go:95] "Systemd watchdog is not enabled" machine # [ 36.772888] k3s[879]: I0923 04:42:31.674262 879 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." machine # [ 36.777675] k3s[879]: I0923 04:42:31.677622 879 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/agent/client-ca.crt" machine # [ 36.781993] k3s[879]: I0923 04:42:31.686818 879 server.go:1414] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" machine # [ 36.785285] k3s[879]: I0923 04:42:31.692062 879 server.go:771] "--cgroups-per-qos enabled, but --cgroup-root was not specified. Defaulting to /" machine # [ 36.788494] k3s[879]: I0923 04:42:31.692092 879 server.go:832] "NoSwap is set due to memorySwapBehavior not specified" memorySwapBehavior="" FailSwapOn=false machine # [ 36.791972] k3s[879]: I0923 04:42:31.692279 879 container_manager_linux.go:272] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] machine # [ 36.795520] k3s[879]: I0923 04:42:31.692311 879 container_manager_linux.go:277] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"machine","RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} machine # [ 36.810315] k3s[879]: I0923 04:42:31.692513 879 topology_manager.go:143] "Creating topology manager with none policy" machine # [ 36.811803] k3s[879]: I0923 04:42:31.692527 879 container_manager_linux.go:308] "Creating device plugin manager" machine # [ 36.813327] k3s[879]: I0923 04:42:31.692597 879 container_manager_linux.go:317] "Creating Dynamic Resource Allocation (DRA) manager" machine # [ 36.815285] k3s[879]: I0923 04:42:31.721657 879 state_mem.go:41] "Initialized" logger="CPUManager state memory" machine # [ 36.816967] k3s[879]: I0923 04:42:31.722075 879 kubelet.go:482] "Attempting to sync node with API server" machine # [ 36.818333] k3s[879]: I0923 04:42:31.722096 879 kubelet.go:383] "Adding static pod path" path="/var/lib/rancher/k3s/agent/pod-manifests" machine # [ 36.819985] k3s[879]: I0923 04:42:31.722128 879 kubelet.go:394] "Adding apiserver pod source" machine # [ 36.821688] k3s[879]: I0923 04:42:31.722146 879 apiserver.go:42] "Waiting for node sync before watching apiserver pods" machine # [ 36.823204] k3s[879]: I0923 04:42:31.723899 879 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="containerd" version="2.2.7-k3s1" apiVersion="v1" machine # [ 36.825465] k3s[879]: I0923 04:42:31.724697 879 kubelet.go:945] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" machine # [ 36.827910] k3s[879]: I0923 04:42:31.724722 879 kubelet.go:972] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" machine # [ 36.830537] k3s[879]: I0923 04:42:31.732801 879 server.go:1252] "Started kubelet" machine # [ 36.831693] k3s[879]: I0923 04:42:31.733201 879 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 machine # [ 36.833618] k3s[879]: I0923 04:42:31.733296 879 server_v1.go:49] "podresources" method="list" useActivePods=true machine # [ 36.835153] k3s[879]: I0923 04:42:31.733498 879 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" machine # [ 36.837213] k3s[879]: I0923 04:42:31.733052 879 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 machine # [ 36.838712] k3s[879]: I0923 04:42:31.739411 879 server.go:317] "Adding debug handlers to kubelet server" machine # [ 36.840142] k3s[879]: I0923 04:42:31.739964 879 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" machine # [ 36.841514] k3s[879]: I0923 04:42:31.740019 879 dynamic_serving_content.go:135] "Starting controller" name="kubelet-server-cert-files::/var/lib/rancher/k3s/agent/serving-kubelet.crt::/var/lib/rancher/k3s/agent/serving-kubelet.key" machine # [ 36.844230] k3s[879]: I0923 04:42:31.740374 879 volume_manager.go:311] "Starting Kubelet Volume Manager" machine # [ 36.845658] k3s[879]: E0923 04:42:31.741705 879 kubelet_node_status.go:392] "Error getting the current node from lister" err="node \"machine\" not found" machine # [ 36.847576] k3s[879]: I0923 04:42:31.743249 879 desired_state_of_world_populator.go:146] "Desired state populator starts to run" machine # [ 36.849187] k3s[879]: I0923 04:42:31.743324 879 reconciler.go:29] "Reconciler: start to sync state" machine # [ 36.850558] k3s[879]: I0923 04:42:31.746357 879 factory.go:223] Registration of the systemd container factory successfully machine # [ 36.852150] k3s[879]: I0923 04:42:31.746515 879 factory.go:221] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory machine # [ 36.855178] k3s[879]: E0923 04:42:31.752614 879 kubelet.go:1661] "Image garbage collection failed once. Stats initialization may not have completed yet" err="invalid capacity 0 on image filesystem" machine # [ 36.857856] k3s[879]: I0923 04:42:31.752950 879 factory.go:223] Registration of the containerd container factory successfully machine # [ 36.859549] k3s[879]: E0923 04:42:31.758388 879 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"machine\" not found" node="machine" machine # [ 36.862141] k3s[879]: I0923 04:42:31.771910 879 cpu_manager.go:225] "Starting" policy="none" machine # [ 36.864027] k3s[879]: I0923 04:42:31.771973 879 cpu_manager.go:226] "Reconciling" reconcilePeriod="10s" machine # [ 36.865824] k3s[879]: I0923 04:42:31.772001 879 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" machine # [ 36.873323] k3s[879]: I0923 04:42:31.789001 879 policy_none.go:50] "Start" machine # [ 36.874594] k3s[879]: I0923 04:42:31.790275 879 memory_manager.go:187] "Starting memorymanager" policy="None" machine # [ 36.876145] k3s[879]: I0923 04:42:31.790448 879 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" machine # [ 36.884731] k3s[879]: I0923 04:42:31.800402 879 policy_none.go:44] "Start" machine # [ 36.890123] systemd[1]: Created slice libcontainer container kubepods.slice. machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 36.904805] systemd[1]: Created slice libcontainer container kubepods-burstable.slice. machine # [ 36.908438] systemd[1]: Created slice libcontainer container kubepods-besteffort.slice. machine # [ 36.917453] k3s[879]: E0923 04:42:31.833094 879 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" machine # [ 36.921201] k3s[879]: I0923 04:42:31.833248 879 eviction_manager.go:194] "Eviction manager: starting control loop" machine # [ 36.921651] k3s[879]: I0923 04:42:31.833283 879 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" machine # [ 36.922171] k3s[879]: I0923 04:42:31.833787 879 plugin_manager.go:121] "Starting Kubelet Plugin Manager" machine # [ 36.922722] k3s[879]: E0923 04:42:31.836017 879 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="no imagefs label for configured runtime" machine # [ 36.923700] k3s[879]: E0923 04:42:31.836075 879 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"machine\" not found" machine # [ 36.964364] k3s[879]: I0923 04:42:31.879997 879 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" machine # [ 36.969420] k3s[879]: I0923 04:42:31.885036 879 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" machine # [ 36.971255] k3s[879]: I0923 04:42:31.885092 879 status_manager.go:249] "Starting to sync pod status with apiserver" machine # [ 36.971714] k3s[879]: I0923 04:42:31.885165 879 kubelet.go:2506] "Starting kubelet main sync loop" machine # [ 36.972219] k3s[879]: E0923 04:42:31.885232 879 kubelet.go:2530] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" machine # [ 37.020229] k3s[879]: I0923 04:42:31.935810 879 kubelet_node_status.go:74] "Attempting to register node" node="machine" machine # [ 37.026410] k3s[879]: I0923 04:42:31.942043 879 kubelet_node_status.go:77] "Successfully registered node" node="machine" machine # [ 37.026779] k3s[879]: E0923 04:42:31.942075 879 kubelet_node_status.go:474] "Error updating node status, will retry" err="error getting node \"machine\": node \"machine\" not found" machine # [ 37.027944] k3s[879]: I0923 04:42:31.943616 879 node_controller.go:429] Initializing node machine with cloud provider machine # [ 37.028758] k3s[879]: I0923 04:42:31.943681 879 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 37.029781] k3s[879]: E0923 04:42:31.943709 879 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 37.030500] k3s[879]: time="2026-09-23T04:42:31Z" level=info msg="Adding node OwnerReference to node-password secret machine.node-password.k3s" machine # [ 37.031168] k3s[879]: I0923 04:42:31.945658 879 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"machine\" does not exist" machine # [ 37.035773] k3s[879]: I0923 04:42:31.950860 879 node_controller.go:429] Initializing node machine with cloud provider machine # [ 37.036761] k3s[879]: I0923 04:42:31.950953 879 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 37.037869] k3s[879]: E0923 04:42:31.950981 879 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 37.044874] k3s[879]: I0923 04:42:31.960504 879 range_allocator.go:433] "Set node PodCIDR" node="machine" podCIDRs=["10.42.0.0/24"] machine # [ 37.045817] k3s[879]: time="2026-09-23T04:42:31Z" level=info msg="Synced coredns NodeHosts entries for machine" machine # [ 37.047443] k3s[879]: I0923 04:42:31.962305 879 node_controller.go:429] Initializing node machine with cloud provider machine # [ 37.048155] k3s[879]: I0923 04:42:31.962380 879 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 37.048316] k3s[879]: E0923 04:42:31.962401 879 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 37.048881] k3s[879]: I0923 04:42:31.963860 879 node_controller.go:429] Initializing node machine with cloud provider machine # [ 37.049572] k3s[879]: I0923 04:42:31.963931 879 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 37.050076] k3s[879]: E0923 04:42:31.963961 879 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 37.051499] k3s[879]: I0923 04:42:31.967169 879 node_controller.go:429] Initializing node machine with cloud provider machine # [ 37.052237] k3s[879]: I0923 04:42:31.967235 879 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 37.052702] k3s[879]: E0923 04:42:31.967260 879 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 37.062426] k3s[879]: I0923 04:42:31.978056 879 node_controller.go:429] Initializing node machine with cloud provider machine # [ 37.063277] k3s[879]: I0923 04:42:31.978118 879 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 37.063741] k3s[879]: E0923 04:42:31.978142 879 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 37.067856] k3s[879]: I0923 04:42:31.983477 879 node_controller.go:429] Initializing node machine with cloud provider machine # [ 37.068690] k3s[879]: I0923 04:42:31.983575 879 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 37.069144] k3s[879]: E0923 04:42:31.983603 879 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 37.087497] k3s[879]: I0923 04:42:32.003096 879 node_controller.go:429] Initializing node machine with cloud provider machine # [ 37.089240] k3s[879]: time="2026-09-23T04:42:32Z" level=info msg="Annotations and labels have been set successfully on node: machine" machine # [ 37.090839] k3s[879]: time="2026-09-23T04:42:32Z" level=info msg="Starting flannel with backend vxlan" machine # [ 37.093674] k3s[879]: I0923 04:42:32.009303 879 kuberuntime_manager.go:2095] "Updating runtime config through cri with podcidr" CIDR="10.42.0.0/24" machine # [ 37.097084] k3s[879]: I0923 04:42:32.010532 879 kubelet_network.go:47] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.42.0.0/24" machine # [ 37.100978] k3s[879]: I0923 04:42:32.016652 879 node_controller.go:474] Successfully initialized node machine with cloud provider machine # [ 37.101376] k3s[879]: I0923 04:42:32.017030 879 event.go:389] "Event occurred" object="machine" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="Synced" message="Node synced successfully" machine # [ 37.114490] k3s[879]: I0923 04:42:32.030138 879 server.go:173] "Starting Kubernetes Scheduler" version="v1.35.8+k3s1" machine # [ 37.114640] k3s[879]: I0923 04:42:32.030163 879 server.go:175] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 37.119214] k3s[879]: I0923 04:42:32.033704 879 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 37.119403] k3s[879]: I0923 04:42:32.033711 879 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 37.119930] k3s[879]: I0923 04:42:32.033764 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 37.120661] k3s[879]: I0923 04:42:32.033780 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 37.121162] k3s[879]: I0923 04:42:32.033768 879 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 37.121359] k3s[879]: I0923 04:42:32.033810 879 shared_informer.go:370] "Waiting for caches to sync" machine # [ 37.121883] k3s[879]: I0923 04:42:32.033871 879 secure_serving.go:211] Serving securely on 127.0.0.1:10259 machine # [ 37.122596] k3s[879]: I0923 04:42:32.033962 879 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 37.123143] k3s[879]: I0923 04:42:32.034778 879 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 37.162305] k3s[879]: time="2026-09-23T04:42:32Z" level=info msg="Flannel found PodCIDR assigned for node machine" machine # [ 37.162674] k3s[879]: time="2026-09-23T04:42:32Z" level=info msg="The interface eth0 with ipv4 address 10.0.2.15 will be used by flannel" machine # [ 37.163307] k3s[879]: I0923 04:42:32.078970 879 kube.go:139] Waiting 10m0s for node controller to sync machine # [ 37.164073] k3s[879]: I0923 04:42:32.079045 879 kube.go:537] Starting kube subnet manager machine # [ 37.204149] k3s[879]: I0923 04:42:32.119411 879 kubelet_node_status.go:427] "Fast updating node status as it just became ready" machine # [ 37.212228] k3s[879]: I0923 04:42:32.127865 879 topologycache.go:237] "Can't get CPU or zone information for node" node="machine" machine # [ 37.533248] k3s[879]: time="2026-09-23T04:42:32Z" level=info msg="Labels and annotations have been set successfully on node: machine" machine # [ 37.619161] k3s[879]: I0923 04:42:32.534651 879 shared_informer.go:377] "Caches are synced" machine # [ 37.619938] k3s[879]: I0923 04:42:32.534859 879 shared_informer.go:377] "Caches are synced" machine # [ 37.621439] k3s[879]: I0923 04:42:32.535270 879 shared_informer.go:377] "Caches are synced" machine # [ 37.663301] k3s[879]: time="2026-09-23T04:42:32Z" level=info msg="Tunnel authorizer set Kubelet Port 0.0.0.0:10250" machine # [ 37.808735] k3s[879]: I0923 04:42:32.724119 879 apiserver.go:52] "Watching apiserver" machine # [ 37.897099] k3s[879]: I0923 04:42:32.812500 879 server.go:218] "Successfully retrieved NodeIPs" NodeIPs=["10.0.2.15","fec0::872:1c92:8ac0:9c98"] machine # [ 37.897526] k3s[879]: E0923 04:42:32.812679 879 server.go:255] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`" machine # [ 37.935153] k3s[879]: I0923 04:42:32.850704 879 server.go:264] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4" machine # [ 37.936197] k3s[879]: I0923 04:42:32.850799 879 server_linux.go:136] "Using iptables Proxier" machine # [ 37.960732] k3s[879]: I0923 04:42:32.875868 879 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4" machine # [ 37.970175] k3s[879]: I0923 04:42:32.885826 879 server.go:529] "Version info" version="v1.35.8+k3s1" machine # [ 37.970333] k3s[879]: I0923 04:42:32.885859 879 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 37.971567] k3s[879]: I0923 04:42:32.886864 879 config.go:106] "Starting endpoint slice config controller" machine # [ 37.972555] k3s[879]: I0923 04:42:32.886901 879 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config" machine # [ 37.974696] k3s[879]: I0923 04:42:32.886936 879 config.go:403] "Starting serviceCIDR config controller" machine # [ 37.975692] k3s[879]: I0923 04:42:32.886958 879 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config" machine # [ 37.976526] k3s[879]: I0923 04:42:32.887161 879 config.go:200] "Starting service config controller" machine # [ 37.979076] k3s[879]: I0923 04:42:32.887177 879 shared_informer.go:349] "Waiting for caches to sync" controller="service config" machine # [ 37.980067] k3s[879]: I0923 04:42:32.887212 879 config.go:309] "Starting node config controller" machine # [ 37.980376] k3s[879]: I0923 04:42:32.888829 879 shared_informer.go:349] "Waiting for caches to sync" controller="node config" machine # [ 38.008270] systemd[1]: Created slice libcontainer container kubepods-burstable-podcc220cdc_8dc0_4ebe_8587_ae52422c4405.slice. machine # [ 38.030752] systemd[1]: Created slice libcontainer container kubepods-burstable-podb27f0e92_7d7a_44f0_8081_6ac366fefbc5.slice. machine # [ 38.032657] k3s[879]: I0923 04:42:32.947338 879 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" machine # [ 38.038194] k3s[879]: I0923 04:42:32.953857 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc220cdc-8dc0-4ebe-8587-ae52422c4405-custom-config-volume\") pod \"coredns-c5fdd76cf-qgtj7\" (UID: \"cc220cdc-8dc0-4ebe-8587-ae52422c4405\") " pod="kube-system/coredns-c5fdd76cf-qgtj7" machine # [ 38.042762] k3s[879]: I0923 04:42:32.953899 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/b27f0e92-7d7a-44f0-8081-6ac366fefbc5-klipper-helm\") pod \"helm-install-nix-grpc-farm-tws44\" (UID: \"b27f0e92-7d7a-44f0-8081-6ac366fefbc5\") " pod="kube-system/helm-install-nix-grpc-farm-tws44" machine # [ 38.047717] k3s[879]: I0923 04:42:32.953928 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/b27f0e92-7d7a-44f0-8081-6ac366fefbc5-klipper-cache\") pod \"helm-install-nix-grpc-farm-tws44\" (UID: \"b27f0e92-7d7a-44f0-8081-6ac366fefbc5\") " pod="kube-system/helm-install-nix-grpc-farm-tws44" machine # [ 38.048036] k3s[879]: I0923 04:42:32.953963 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"values\" (UniqueName: \"kubernetes.io/projected/b27f0e92-7d7a-44f0-8081-6ac366fefbc5-values\") pod \"helm-install-nix-grpc-farm-tws44\" (UID: \"b27f0e92-7d7a-44f0-8081-6ac366fefbc5\") " pod="kube-system/helm-install-nix-grpc-farm-tws44" machine # [ 38.048393] k3s[879]: I0923 04:42:32.953995 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"content\" (UniqueName: \"kubernetes.io/configmap/b27f0e92-7d7a-44f0-8081-6ac366fefbc5-content\") pod \"helm-install-nix-grpc-farm-tws44\" (UID: \"b27f0e92-7d7a-44f0-8081-6ac366fefbc5\") " pod="kube-system/helm-install-nix-grpc-farm-tws44" machine # [ 38.048879] k3s[879]: I0923 04:42:32.954025 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24vxs\" (UniqueName: \"kubernetes.io/projected/b27f0e92-7d7a-44f0-8081-6ac366fefbc5-kube-api-access-24vxs\") pod \"helm-install-nix-grpc-farm-tws44\" (UID: \"b27f0e92-7d7a-44f0-8081-6ac366fefbc5\") " pod="kube-system/helm-install-nix-grpc-farm-tws44" machine # [ 38.049763] k3s[879]: I0923 04:42:32.954051 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cc220cdc-8dc0-4ebe-8587-ae52422c4405-config-volume\") pod \"coredns-c5fdd76cf-qgtj7\" (UID: \"cc220cdc-8dc0-4ebe-8587-ae52422c4405\") " pod="kube-system/coredns-c5fdd76cf-qgtj7" machine # [ 38.050423] k3s[879]: I0923 04:42:32.954079 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6lfl\" (UniqueName: \"kubernetes.io/projected/cc220cdc-8dc0-4ebe-8587-ae52422c4405-kube-api-access-k6lfl\") pod \"coredns-c5fdd76cf-qgtj7\" (UID: \"cc220cdc-8dc0-4ebe-8587-ae52422c4405\") " pod="kube-system/coredns-c5fdd76cf-qgtj7" machine # [ 38.050908] k3s[879]: I0923 04:42:32.954132 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/b27f0e92-7d7a-44f0-8081-6ac366fefbc5-klipper-config\") pod \"helm-install-nix-grpc-farm-tws44\" (UID: \"b27f0e92-7d7a-44f0-8081-6ac366fefbc5\") " pod="kube-system/helm-install-nix-grpc-farm-tws44" machine # [ 38.051679] k3s[879]: I0923 04:42:32.954159 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b27f0e92-7d7a-44f0-8081-6ac366fefbc5-tmp\") pod \"helm-install-nix-grpc-farm-tws44\" (UID: \"b27f0e92-7d7a-44f0-8081-6ac366fefbc5\") " pod="kube-system/helm-install-nix-grpc-farm-tws44" machine # [ 38.076586] k3s[879]: I0923 04:42:32.992145 879 shared_informer.go:356] "Caches are synced" controller="node config" machine # [ 38.077501] k3s[879]: I0923 04:42:32.992211 879 shared_informer.go:356] "Caches are synced" controller="endpoint slice config" machine # [ 38.077981] k3s[879]: I0923 04:42:32.992249 879 shared_informer.go:356] "Caches are synced" controller="service config" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 38.163836] k3s[879]: I0923 04:42:33.079376 879 kube.go:163] Node controller sync successful machine # [ 38.164239] k3s[879]: I0923 04:42:33.079441 879 vxlan.go:128] VXLAN config: VNI=1 Port=0 GBP=false Learning=false DirectRouting=false machine # [ 38.166336] k3s[879]: I0923 04:42:33.081955 879 kube.go:704] List of node(machine) annotations: map[string]string{"alpha.kubernetes.io/provided-node-ip":"10.0.2.15,fec0::872:1c92:8ac0:9c98", "k3s.io/hostname":"machine", "k3s.io/internal-ip":"10.0.2.15,fec0::872:1c92:8ac0:9c98", "k3s.io/node-args":"[\"server\",\"--disable\",\"traefik\",\"--disable\",\"metrics-server\",\"--disable\",\"local-storage\",\"--kubelet-arg\",\"eviction-hard=nodefs.available\\u003c1%,imagefs.available\\u003c1%\"]", "k3s.io/node-config-hash":"EFXPOZ7ZWHRCLFNW4X4ZDPFQMSAOP3BLEIN2VE47TDRKQ4UIWKUQ====", "k3s.io/node-env":"{}", "node.alpha.kubernetes.io/ttl":"0", "volumes.kubernetes.io/controller-managed-attach-detach":"true"} machine # [ 38.190301] (udev-worker)[1335]: Network interface NamePolicy= disabled on kernel command line. machine # [ 38.201027] k3s[879]: I0923 04:42:33.115576 879 iptables.go:50] Starting flannel in iptables mode... machine # [ 38.201361] k3s[879]: time="2026-09-23T04:42:33Z" level=warning msg="no subnet found for key: FLANNEL_NETWORK in file: /run/flannel/subnet.env" machine # [ 38.201852] k3s[879]: time="2026-09-23T04:42:33Z" level=warning msg="no subnet found for key: FLANNEL_SUBNET in file: /run/flannel/subnet.env" machine # [ 38.202540] k3s[879]: time="2026-09-23T04:42:33Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_NETWORK in file: /run/flannel/subnet.env" machine # [ 38.203420] k3s[879]: time="2026-09-23T04:42:33Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_SUBNET in file: /run/flannel/subnet.env" machine # [ 38.203949] k3s[879]: I0923 04:42:33.115707 879 iptables.go:101] Current network or subnet (10.42.0.0/16, 10.42.0.0/24) is not equal to previous one (0.0.0.0/0, 0.0.0.0/0), trying to recycle old iptables rules machine # [ 38.204569] k3s[879]: I0923 04:42:33.116098 879 kube.go:558] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.42.0.0/24] machine # [ 38.230100] dhcpcd[673]: flannel.1: IAID fe:3c:e2:ba machine # [ 38.230974] dhcpcd[673]: flannel.1: adding address fe80::a859:feff:fe3c:e2ba machine # [ 38.267842] k3s[879]: I0923 04:42:33.183386 879 iptables.go:111] Setting up masking rules machine # [ 38.271921] k3s[879]: I0923 04:42:33.187590 879 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config" machine # [ 38.286245] k3s[879]: I0923 04:42:33.201899 879 iptables.go:212] Changing default FORWARD chain policy to ACCEPT machine # [ 38.296581] k3s[879]: time="2026-09-23T04:42:33Z" level=info msg="Wrote flannel subnet file to /run/flannel/subnet.env" machine # [ 38.297138] k3s[879]: time="2026-09-23T04:42:33Z" level=info msg="Running flannel backend" machine # [ 38.298080] k3s[879]: I0923 04:42:33.212284 879 vxlan_network.go:68] watching for new subnet leases machine # [ 38.298964] k3s[879]: I0923 04:42:33.212333 879 vxlan_network.go:115] starting vxlan device watcher machine # [ 38.385617] k3s[879]: I0923 04:42:33.300902 879 iptables.go:358] bootstrap done machine # [ 38.398484] (udev-worker)[1508]: Network interface NamePolicy= disabled on kernel command line. machine # [ 38.555482] cni0: port 1(veth55811ef0) entered blocking state machine # [ 38.556164] cni0: port 1(veth55811ef0) entered disabled state machine # [ 38.557554] veth55811ef0: entered allmulticast mode machine # [ 38.558200] veth55811ef0: entered promiscuous mode machine # [ 38.405201] ([ 38.560523] cni0: port 2(vethc91f3c8c) entered blocking state machine # udev-worker)[1401]: Network interface NamePolicy= disabled on ke[ 38.561908] cni0: port 2(vethc91f3c8c) entered disabled state machine # rnel command line. machine # [ 38.562950] vethc91f3c8c: entered allmulticast mode machine # [ 38.563728] vethc91f3c8c: entered promiscuous mode machine # [ 38.574204] cni0: port 2(vethc91f3c8c) entered blocking state machine # [ 38.574944] cni0: port 2(vethc91f3c8c) entered forwarding state machine # [ 38.587673] cni0: port 1(veth55811ef0) entered blocking state machine # [ 38.588363] cni0: port 1(veth55811ef0) entered forwarding state machine # [ 38.440940] dhcpcd[673]: vethc91f3c8c: IAID 0d:44:47:d5 machine # [ 38.441908] dhcpcd[673]: vethc91f3c8c: adding address fe80::3003:dff:fe44:47d5 machine # [ 38.459249] dhcpcd[673]: veth55811ef0: IAID 57:9c:d8:24 machine # [ 38.460123] dhcpcd[673]: veth55811ef0: adding address fe80::7c10:57ff:fe9c:d824 machine # [ 38.476497] k3s[879]: I0923 04:42:33.392130 879 iptables.go:358] bootstrap done machine # [ 38.508436] k3s[879]: I0923 04:42:33.424048 879 node_lifecycle_controller.go:1234] "Initializing eviction metric for zone" zone="" machine # [ 38.510950] k3s[879]: I0923 04:42:33.424220 879 node_lifecycle_controller.go:886] "Missing timestamp for Node. Assuming now as a timestamp" node="machine" machine # [ 38.511220] k3s[879]: I0923 04:42:33.426158 879 node_lifecycle_controller.go:1080] "Controller detected that zone is now in new state" zone="" newState="Normal" machine # [ 38.664781] systemd[1]: Started libcontainer container 9bec1955105c0302d9793916d14d53443ec2986aacbb9c83a90af94563299fd0. machine # [ 38.668598] systemd[1]: Started libcontainer container d724f22bdbce556498e1b1c2bd6c7574a5f07dcccba1a5125e2c3f5b8b740133. machine # [ 38.751679] dhcpcd[673]: veth55811ef0: soliciting a DHCP lease machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 39.514265] dhcpcd[673]: vethc91f3c8c: soliciting a DHCP lease machine # [ 39.702328] k3s[879]: time="2026-09-23T04:42:34Z" level=info msg="Starting network policy controller version v2.6.3-k3s1, built on 1970-01-01T01:01:01Z, go1.26.7" machine # [ 39.702512] k3s[879]: I0923 04:42:34.617667 879 network_policy_controller.go:164] Starting network policy controller machine # [ 39.750680] systemd[1]: Started libcontainer container e1da8e99487f4721aa7e8e885b75979f6e18e2ccbeaa98720f7ae0e77c83aef5. machine # [ 39.852435] dhcpcd[673]: flannel.1: soliciting a DHCP lease machine # [ 39.863346] systemd[1]: Started libcontainer container 1d8ab054ba6d7026914fbb69bdc058170e4ca1304ad468693c5d67badc20470f. machine # [ 39.968744] k3s[879]: I0923 04:42:34.884309 879 network_policy_controller.go:179] Starting network policy controller full sync goroutine machine # [ 40.028098] k3s[879]: I0923 04:42:34.943482 879 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/helm-install-nix-grpc-farm-tws44" podStartSLOduration=10.943450211 podStartE2EDuration="10.943450211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-23 04:42:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-23 04:42:34.930205511 +0000 UTC m=+22.691834855" watchObservedRunningTime="2026-09-23 04:42:34.943450211 +0000 UTC m=+22.705079555" machine # [ 40.137120] dhcpcd[673]: flannel.1: soliciting an IPv6 router machine # [ 40.557959] dhcpcd[673]: veth55811ef0: soliciting an IPv6 router machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 40.751105] dhcpcd[673]: vethc91f3c8c: soliciting an IPv6 router machine # [ 41.026569] k3s[879]: I0923 04:42:35.940796 879 alloc.go:329] "allocated clusterIPs" service="farm/nix-grpc-farm" clusterIPs={"IPv4":"10.43.221.37"} machine # [ 41.073785] systemd[1]: cri-containerd-1d8ab054ba6d7026914fbb69bdc058170e4ca1304ad468693c5d67badc20470f.scope: Deactivated successfully. machine # [ 41.074085] systemd[1]: cri-containerd-1d8ab054ba6d7026914fbb69bdc058170e4ca1304ad468693c5d67badc20470f.scope: Consumed 599ms CPU time over 1.208s wall clock time, 34.9M memory peak, 2.4M incoming IP traffic, 141K outgoing IP traffic. machine # [ 41.117103] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-1d8ab054ba6d7026914fbb69bdc058170e4ca1304ad468693c5d67badc20470f-rootfs.mount: Deactivated successfully. machine # [ 41.132030] k3s[879]: I0923 04:42:36.047468 879 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/coredns-c5fdd76cf-qgtj7" podStartSLOduration=12.047436611 podStartE2EDuration="12.047436611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-23 04:42:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-23 04:42:34.943877919 +0000 UTC m=+22.705507263" watchObservedRunningTime="2026-09-23 04:42:36.047436611 +0000 UTC m=+23.809065955" machine # [ 41.253848] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod06d54427_fe66_4d23_8850_b58ccd4e89c9.slice. machine # [ 41.266086] k3s[879]: I0923 04:42:36.179887 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/06d54427-fe66-4d23-8850-b58ccd4e89c9-build\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-l44xc\" (UID: \"06d54427-fe66-4d23-8850-b58ccd4e89c9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-l44xc" machine # [ 41.266588] k3s[879]: I0923 04:42:36.179935 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/06d54427-fe66-4d23-8850-b58ccd4e89c9-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-l44xc\" (UID: \"06d54427-fe66-4d23-8850-b58ccd4e89c9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-l44xc" machine # [ 41.267173] k3s[879]: I0923 04:42:36.179974 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/06d54427-fe66-4d23-8850-b58ccd4e89c9-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-l44xc\" (UID: \"06d54427-fe66-4d23-8850-b58ccd4e89c9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-l44xc" machine # [ 41.267683] k3s[879]: I0923 04:42:36.180010 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/06d54427-fe66-4d23-8850-b58ccd4e89c9-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-l44xc\" (UID: \"06d54427-fe66-4d23-8850-b58ccd4e89c9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-l44xc" machine # [ 41.268188] k3s[879]: I0923 04:42:36.180044 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/06d54427-fe66-4d23-8850-b58ccd4e89c9-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-l44xc\" (UID: \"06d54427-fe66-4d23-8850-b58ccd4e89c9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-l44xc" machine # [ 41.268719] k3s[879]: I0923 04:42:36.180075 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfwzf\" (UniqueName: \"kubernetes.io/projected/06d54427-fe66-4d23-8850-b58ccd4e89c9-kube-api-access-xfwzf\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-l44xc\" (UID: \"06d54427-fe66-4d23-8850-b58ccd4e89c9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-l44xc" machine # [ 41.269237] k3s[879]: I0923 04:42:36.180110 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/06d54427-fe66-4d23-8850-b58ccd4e89c9-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-l44xc\" (UID: \"06d54427-fe66-4d23-8850-b58ccd4e89c9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-l44xc" machine # [ 41.269732] k3s[879]: I0923 04:42:36.180138 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/06d54427-fe66-4d23-8850-b58ccd4e89c9-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-l44xc\" (UID: \"06d54427-fe66-4d23-8850-b58ccd4e89c9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-l44xc" machine # [ 41.340513] systemd[1]: Created slice libcontainer container kubepods-besteffort-podf17ca4ec_53d0_4375_ab70_b46686e53827.slice. machine # [ 41.365667] k3s[879]: I0923 04:42:36.281274 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/f17ca4ec-53d0-4375-ab70-b46686e53827-tls\") pod \"nix-grpc-farm-scheduler-64688b4568-mt5dt\" (UID: \"f17ca4ec-53d0-4375-ab70-b46686e53827\") " pod="farm/nix-grpc-farm-scheduler-64688b4568-mt5dt" machine # [ 41.366207] k3s[879]: I0923 04:42:36.281419 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f17ca4ec-53d0-4375-ab70-b46686e53827-ca\") pod \"nix-grpc-farm-scheduler-64688b4568-mt5dt\" (UID: \"f17ca4ec-53d0-4375-ab70-b46686e53827\") " pod="farm/nix-grpc-farm-scheduler-64688b4568-mt5dt" machine # [ 41.367115] k3s[879]: I0923 04:42:36.281479 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/f17ca4ec-53d0-4375-ab70-b46686e53827-niks3-token\") pod \"nix-grpc-farm-scheduler-64688b4568-mt5dt\" (UID: \"f17ca4ec-53d0-4375-ab70-b46686e53827\") " pod="farm/nix-grpc-farm-scheduler-64688b4568-mt5dt" machine # [ 41.367910] k3s[879]: I0923 04:42:36.281523 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/f17ca4ec-53d0-4375-ab70-b46686e53827-oidc\") pod \"nix-grpc-farm-scheduler-64688b4568-mt5dt\" (UID: \"f17ca4ec-53d0-4375-ab70-b46686e53827\") " pod="farm/nix-grpc-farm-scheduler-64688b4568-mt5dt" machine # [ 41.368503] k3s[879]: I0923 04:42:36.281562 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-596nq\" (UniqueName: \"kubernetes.io/projected/f17ca4ec-53d0-4375-ab70-b46686e53827-kube-api-access-596nq\") pod \"nix-grpc-farm-scheduler-64688b4568-mt5dt\" (UID: \"f17ca4ec-53d0-4375-ab70-b46686e53827\") " pod="farm/nix-grpc-farm-scheduler-64688b4568-mt5dt" machine # [ 41.413151] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod930bd5f4_1745_4ac8_8dfb_87cf4a40facc.slice. machine # [ 41.423362] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod2f75a522_7951_492c_bb0f_bbf377071da0.slice. machine # [ 41.466667] k3s[879]: I0923 04:42:36.382028 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/2f75a522-7951-492c-bb0f-bbf377071da0-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-b9skh\" (UID: \"2f75a522-7951-492c-bb0f-bbf377071da0\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-b9skh" machine # [ 41.466852] k3s[879]: I0923 04:42:36.382107 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/930bd5f4-1745-4ac8-8dfb-87cf4a40facc-config\") pod \"nix-grpc-farm-lb-775dbb5c7c-bpc2n\" (UID: \"930bd5f4-1745-4ac8-8dfb-87cf4a40facc\") " pod="farm/nix-grpc-farm-lb-775dbb5c7c-bpc2n" machine # [ 41.467505] k3s[879]: I0923 04:42:36.382133 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/930bd5f4-1745-4ac8-8dfb-87cf4a40facc-tmp\") pod \"nix-grpc-farm-lb-775dbb5c7c-bpc2n\" (UID: \"930bd5f4-1745-4ac8-8dfb-87cf4a40facc\") " pod="farm/nix-grpc-farm-lb-775dbb5c7c-bpc2n" machine # [ 41.467993] k3s[879]: I0923 04:42:36.382257 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/2f75a522-7951-492c-bb0f-bbf377071da0-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-b9skh\" (UID: \"2f75a522-7951-492c-bb0f-bbf377071da0\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-b9skh" machine # [ 41.468587] k3s[879]: I0923 04:42:36.382494 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/930bd5f4-1745-4ac8-8dfb-87cf4a40facc-tls-ca\") pod \"nix-grpc-farm-lb-775dbb5c7c-bpc2n\" (UID: \"930bd5f4-1745-4ac8-8dfb-87cf4a40facc\") " pod="farm/nix-grpc-farm-lb-775dbb5c7c-bpc2n" machine # [ 41.471116] k3s[879]: I0923 04:42:36.382908 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/2f75a522-7951-492c-bb0f-bbf377071da0-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-b9skh\" (UID: \"2f75a522-7951-492c-bb0f-bbf377071da0\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-b9skh" machine # [ 41.471716] k3s[879]: I0923 04:42:36.382951 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mr27\" (UniqueName: \"kubernetes.io/projected/2f75a522-7951-492c-bb0f-bbf377071da0-kube-api-access-5mr27\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-b9skh\" (UID: \"2f75a522-7951-492c-bb0f-bbf377071da0\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-b9skh" machine # [ 41.472452] k3s[879]: I0923 04:42:36.383104 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/930bd5f4-1745-4ac8-8dfb-87cf4a40facc-tls-lb\") pod \"nix-grpc-farm-lb-775dbb5c7c-bpc2n\" (UID: \"930bd5f4-1745-4ac8-8dfb-87cf4a40facc\") " pod="farm/nix-grpc-farm-lb-775dbb5c7c-bpc2n" machine # [ 41.472941] k3s[879]: I0923 04:42:36.383134 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/2f75a522-7951-492c-bb0f-bbf377071da0-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-b9skh\" (UID: \"2f75a522-7951-492c-bb0f-bbf377071da0\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-b9skh" machine # [ 41.473672] k3s[879]: I0923 04:42:36.383198 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/2f75a522-7951-492c-bb0f-bbf377071da0-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-b9skh\" (UID: \"2f75a522-7951-492c-bb0f-bbf377071da0\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-b9skh" machine # [ 41.474588] k3s[879]: I0923 04:42:36.383515 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/2f75a522-7951-492c-bb0f-bbf377071da0-build\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-b9skh\" (UID: \"2f75a522-7951-492c-bb0f-bbf377071da0\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-b9skh" machine # [ 41.475124] k3s[879]: I0923 04:42:36.383550 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2f75a522-7951-492c-bb0f-bbf377071da0-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-b9skh\" (UID: \"2f75a522-7951-492c-bb0f-bbf377071da0\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-b9skh" machine # [ 41.787293] cni0: port 3(veth8bef3ab4) entered blocking state machine # [ 41.787975] cni0: port 3(veth8bef3ab4) entered disabled state machine # [ 41.632066] (udev-worker)[1894]: Network interface NamePolicy= disabled on kernel command line. machine # [ 41.790398] veth8bef3ab4: entered allmulticast mode machine # [ 41.791151] veth8bef3ab4: entered promiscuous mode machine # [ 41.806065] cni0: port 3(veth8bef3ab4) entered blocking state machine # [ 41.806769] cni0: port 3(veth8bef3ab4) entered forwarding state machine # [ 41.707777] dhcpcd[673]: veth8bef3ab4: waiting for carrier machine # [ 41.708038] dhcpcd[673]: veth8bef3ab4: carrier acquired machine # [ 41.864568] cni0: port 4(vethe10baa11) entered blocking state machine # [ 41.866414] cni0: port 4(vethe10baa11) entered disabled state machine # [ 41.867078] vethe10baa11: entered allmulticast mode machine # [ 41.715163] d[ 41.870425] vethe10baa11: entered promiscuous mode machine # hcpcd[673]: veth8bef3ab4: IAID 24:52:11:14 machine # [ 41.715560] dhcpcd[673]: veth8bef3ab4: adding address fe80::b4bf:24ff:fe52:1114 machine # [ 41.888840] cni0: port 4(vethe10baa11) entered blocking state machine # [ 41.889536] cni0: port 4(vethe10baa11) entered forwarding state machine # [ 41.777445] dhcpcd[673]: vethe10baa11: waiting for carrier machine # [ 41.778457] dhcpcd[673]: vethe10baa11: carrier acquired machine # [ 41.788674] dhcpcd[673]: vethe10baa11: IAID 0b:b8:fb:34 machine # [ 41.789529] dhcpcd[673]: vethe10baa11: adding address fe80::acc3:bff:feb8:fb34 machine # [ 41.791251] dhcpcd[673]: veth8bef3ab4: soliciting a DHCP lease machine # [ 41.806892] ([ 41.962171] cni0: port 5(vethce0986e3) entered blocking state machine # udev-worker)[2077]: Network interface NamePolicy= disabled on kernel command line. machine # [ 41.967442] cni0: port 5(vethce0986e3) entered disabled state machine # [ 41.971444] vethce0986e3: entered allmulticast mode machine # [ 41.972148] vethce0986e3: entered promiscuous mode machine # [ 41.975113] cni0: port 6(vethbc257658) entered blocking state machine # [ 41.976177] cni0: port 6(vethbc257658) entered disabled state machine # [ 41.976988] vethbc257658: entered allmulticast mode machine # [ 41.980487] vethbc257658: entered promiscuous mode machine # [ 42.001194] cni0: port 5(vethce0986e3) entered blocking state machine # [ 42.001939] cni0: port 5(vethce0986e3) entered forwarding state machine # [ 42.007052] cni0: port 6(vethbc257658) entered blocking state machine # [ 42.007744] cni0: port 6(vethbc257658) entered forwarding state machine # [ 41.868113] dhcpcd[673]: vethce0986e3: waiting for carrier machine # [ 41.883756] dhcpcd[673]: vethbc257658: IAID db:ca:ee:3a machine # [ 41.883974] dhcpcd[673]: vethbc257658: adding address fe80::8088:dbff:feca:ee3a machine # [ 41.884617] dhcpcd[673]: vethbc257658: carrier lost machine # [ 41.888328] systemd[1]: Started libcontainer container e7ddfd6530be67d83600c36f4b807029b47ea9ed7bc91d6cd4b2da4cbdd75c77. machine # [ 41.927359] dhcpcd[673]: vethbc257658: deleting address fe80::8088:dbff:feca:ee3a machine # [ 41.928468] dhcpcd[673]: vethce0986e3: carrier acquired machine # [ 41.933619] systemd[1]: Started libcontainer container 8a8d46b502a956feb9e8ac4334f0b7d2c07d3ff0de4c3fee87f8931e3779bcda. machine # [ 41.935754] dhcpcd[673]: vethce0986e3: IAID 77:5d:07:9d machine # [ 41.936270] dhcpcd[673]: vethce0986e3: adding address fe80::c7b:77ff:fe5d:79d machine # [ 41.936910] dhcpcd[673]: vethbc257658: carrier acquired machine # [ 41.947070] dhcpcd[673]: vethbc257658: IAID db:ca:ee:3a machine # [ 41.947547] dhcpcd[673]: vethbc257658: adding address fe80::8088:dbff:feca:ee3a machine # [ 42.015867] k3s[879]: E0923 04:42:36.931250 879 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.3\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.3\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.3\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.3" machine # [ 42.016295] k3s[879]: E0923 04:42:36.931336 879 kuberuntime_image.go:43] "Failed to pull image" err="failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.3\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.3\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.3\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.3" machine # [ 42.016740] k3s[879]: E0923 04:42:36.931555 879 kuberuntime_manager.go:1674] "Unhandled Error" err="init container seed-store start failed in pod nix-grpc-farm-worker-x86-64-linux-cfb8578f6-l44xc_farm(06d54427-fe66-4d23-8850-b58ccd4e89c9): ErrImagePull: failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.3\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.3\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.3\": dial tcp: lookup registry-1.docker.io: no such host" logger="UnhandledError" machine # [ 42.035256] k3s[879]: E0923 04:42:36.931631 879 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.3\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.3\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.3\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-l44xc" podUID="06d54427-fe66-4d23-8850-b58ccd4e89c9" machine # [ 42.042608] systemd[1]: Started libcontainer container 4e2200649e7b0661c085400c423065a72c1af2e23bbc85319cd2e253ce708ce9. machine # [ 42.048792] systemd[1]: Started libcontainer container cbe2806c4dea26cba46f4a5b7e6355c4712134b564bb22c1cb18662bd3436cc6. machine # [ 42.087663] k3s[879]: E0923 04:42:37.003208 879 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.3\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.3\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.3\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.3" machine # [ 42.093458] k3s[879]: E0923 04:42:37.003261 879 kuberuntime_image.go:43] "Failed to pull image" err="failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.3\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.3\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.3\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.3" machine # [ 42.098586] k3s[879]: E0923 04:42:37.003479 879 kuberuntime_manager.go:1674] "Unhandled Error" err="container nix-grpc-daemon start failed in pod nix-grpc-farm-scheduler-64688b4568-mt5dt_farm(f17ca4ec-53d0-4375-ab70-b46686e53827): ErrImagePull: failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.3\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.3\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.3\": dial tcp: lookup registry-1.docker.io: no such host" logger="UnhandledError" machine # [ 42.105378] k3s[879]: E0923 04:42:37.003539 879 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nix-grpc-daemon\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.3\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.3\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.3\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-scheduler-64688b4568-mt5dt" podUID="f17ca4ec-53d0-4375-ab70-b46686e53827" machine # [ 42.153878] k3s[879]: E0923 04:42:37.069449 879 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.3\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.3\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.3\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.3" machine # [ 42.160452] k3s[879]: E0923 04:42:37.069501 879 kuberuntime_image.go:43] "Failed to pull image" err="failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.3\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.3\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.3\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.3" machine # [ 42.160830] k3s[879]: E0923 04:42:37.070109 879 kuberuntime_manager.go:1674] "Unhandled Error" err="init container seed-store start failed in pod nix-grpc-farm-worker-x86-64-linux-cfb8578f6-b9skh_farm(2f75a522-7951-492c-bb0f-bbf377071da0): ErrImagePull: failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.3\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.3\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.3\": dial tcp: lookup registry-1.docker.io: no such host" logger="UnhandledError" machine # [ 42.161272] k3s[879]: E0923 04:42:37.070190 879 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.3\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.3\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.3\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-b9skh" podUID="2f75a522-7951-492c-bb0f-bbf377071da0" machine # [ 42.624057] k3s[879]: time="2026-09-23T04:42:37Z" level=info msg="Imported docker.io/library/nix-grpc-farm:0.1.0-beta.3" machine # [ 42.628538] k3s[879]: time="2026-09-23T04:42:37Z" level=info msg="Tagged docker.io/library/nix-grpc-farm@sha256:d401b5b50468e9022fbfadd5afd6de69eb8d49f0d0670754558198612faf47db" machine # [ 42.668639] systemd[1]: Started libcontainer container 77f0b6dc8251307f2f514f12f4213afe311b501ab48320276c880a62d455e8bf. machine # [ 42.930770] k3s[879]: time="2026-09-23T04:42:37Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm.tar in 6.636510226s" machine # [ 43.006124] dhcpcd[673]: vethce0986e3: soliciting a DHCP lease machine # [ 43.083661] dhcpcd[673]: vethe10baa11: soliciting a DHCP lease machine # [ 43.093669] systemd[1]: cri-containerd-d724f22bdbce556498e1b1c2bd6c7574a5f07dcccba1a5125e2c3f5b8b740133.scope: Deactivated successfully. machine # [ 43.136572] dhcpcd[673]: veth8bef3ab4: soliciting an IPv6 router machine # [ 43.190971] dhcpcd[673]: vethbc257658: soliciting a DHCP lease machine # [ 43.354456] dhcpcd[673]: vethbc257658: soliciting an IPv6 router machine # [ 43.400363] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-d724f22bdbce556498e1b1c2bd6c7574a5f07dcccba1a5125e2c3f5b8b740133-rootfs.mount: Deactivated successfully. machine # [ 43.400684] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-d724f22bdbce556498e1b1c2bd6c7574a5f07dcccba1a5125e2c3f5b8b740133-shm.mount: Deactivated successfully. machine # [ 43.569907] cni0: port 1(veth55811ef0) entered disabled state machine # [ 43.414779] dhcpcd[673]: veth55811ef0: carrier lost machine # [ 43.572418] veth55811ef0 (unregistering): left allmulticast mode machine # [ 43.573174] veth55811ef0 (unregistering): left promiscuous mode machine # [ 43.574119] cni0: port 1(veth55811ef0) entered disabled state machine # [ 43.440916] systemd[1]: run-netns-cni\x2db03d7d48\x2ddb84\x2d87c6\x2d1865\x2df5f116a67445.mount: Deactivated successfully. machine # [ 43.452667] dhcpcd[673]: veth55811ef0: deleting address fe80::7c10:57ff:fe9c:d824 machine # [ 43.471765] k3s[879]: I0923 04:42:38.386833 879 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-775dbb5c7c-bpc2n" podStartSLOduration=2.386806559 podStartE2EDuration="2.386806559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-23 04:42:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-23 04:42:38.058451139 +0000 UTC m=+25.820080763" watchObservedRunningTime="2026-09-23 04:42:38.386806559 +0000 UTC m=+26.148435903" machine # [ 43.484127] k3s[879]: I0923 04:42:38.399499 879 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b27f0e92-7d7a-44f0-8081-6ac366fefbc5-values\" (UniqueName: \"kubernetes.io/projected/b27f0e92-7d7a-44f0-8081-6ac366fefbc5-values\") pod \"b27f0e92-7d7a-44f0-8081-6ac366fefbc5\" (UID: \"b27f0e92-7d7a-44f0-8081-6ac366fefbc5\") " machine # [ 43.490431] k3s[879]: I0923 04:42:38.399559 879 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b27f0e92-7d7a-44f0-8081-6ac366fefbc5-klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/b27f0e92-7d7a-44f0-8081-6ac366fefbc5-klipper-helm\") pod \"b27f0e92-7d7a-44f0-8081-6ac366fefbc5\" (UID: \"b27f0e92-7d7a-44f0-8081-6ac366fefbc5\") " machine # [ 43.495122] k3s[879]: I0923 04:42:38.399591 879 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b27f0e92-7d7a-44f0-8081-6ac366fefbc5-kube-api-access-24vxs\" (UniqueName: \"kubernetes.io/projected/b27f0e92-7d7a-44f0-8081-6ac366fefbc5-kube-api-access-24vxs\") pod \"b27f0e92-7d7a-44f0-8081-6ac366fefbc5\" (UID: \"b27f0e92-7d7a-44f0-8081-6ac366fefbc5\") " machine # [ 43.501710] k3s[879]: I0923 04:42:38.399621 879 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b27f0e92-7d7a-44f0-8081-6ac366fefbc5-klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/b27f0e92-7d7a-44f0-8081-6ac366fefbc5-klipper-cache\") pod \"b27f0e92-7d7a-44f0-8081-6ac366fefbc5\" (UID: \"b27f0e92-7d7a-44f0-8081-6ac366fefbc5\") " machine # [ 43.506343] k3s[879]: I0923 04:42:38.399661 879 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b27f0e92-7d7a-44f0-8081-6ac366fefbc5-content\" (UniqueName: \"kubernetes.io/configmap/b27f0e92-7d7a-44f0-8081-6ac366fefbc5-content\") pod \"b27f0e92-7d7a-44f0-8081-6ac366fefbc5\" (UID: \"b27f0e92-7d7a-44f0-8081-6ac366fefbc5\") " machine # [ 43.511194] k3s[879]: I0923 04:42:38.399694 879 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b27f0e92-7d7a-44f0-8081-6ac366fefbc5-tmp\" (UniqueName: \"kubernetes.io/empty-dir/b27f0e92-7d7a-44f0-8081-6ac366fefbc5-tmp\") pod \"b27f0e92-7d7a-44f0-8081-6ac366fefbc5\" (UID: \"b27f0e92-7d7a-44f0-8081-6ac366fefbc5\") " machine # [ 43.516106] k3s[879]: I0923 04:42:38.399725 879 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b27f0e92-7d7a-44f0-8081-6ac366fefbc5-klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/b27f0e92-7d7a-44f0-8081-6ac366fefbc5-klipper-config\") pod \"b27f0e92-7d7a-44f0-8081-6ac366fefbc5\" (UID: \"b27f0e92-7d7a-44f0-8081-6ac366fefbc5\") " machine # [ 43.521752] k3s[879]: I0923 04:42:38.405170 879 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b27f0e92-7d7a-44f0-8081-6ac366fefbc5-content" pod "b27f0e92-7d7a-44f0-8081-6ac366fefbc5" (UID: "b27f0e92-7d7a-44f0-8081-6ac366fefbc5"). InnerVolumeSpecName "content". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 43.527369] k3s[879]: I0923 04:42:38.411147 879 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b27f0e92-7d7a-44f0-8081-6ac366fefbc5-values" pod "b27f0e92-7d7a-44f0-8081-6ac366fefbc5" (UID: "b27f0e92-7d7a-44f0-8081-6ac366fefbc5"). InnerVolumeSpecName "values". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 43.527691] k3s[879]: I0923 04:42:38.411866 879 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b27f0e92-7d7a-44f0-8081-6ac366fefbc5-klipper-config" pod "b27f0e92-7d7a-44f0-8081-6ac366fefbc5" (UID: "b27f0e92-7d7a-44f0-8081-6ac366fefbc5"). InnerVolumeSpecName "klipper-config". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 43.528239] k3s[879]: I0923 04:42:38.416545 879 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b27f0e92-7d7a-44f0-8081-6ac366fefbc5-tmp" pod "b27f0e92-7d7a-44f0-8081-6ac366fefbc5" (UID: "b27f0e92-7d7a-44f0-8081-6ac366fefbc5"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 43.528815] k3s[879]: I0923 04:42:38.416483 879 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b27f0e92-7d7a-44f0-8081-6ac366fefbc5-kube-api-access-24vxs" pod "b27f0e92-7d7a-44f0-8081-6ac366fefbc5" (UID: "b27f0e92-7d7a-44f0-8081-6ac366fefbc5"). InnerVolumeSpecName "kube-api-access-24vxs". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 43.529586] k3s[879]: I0923 04:42:38.416958 879 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b27f0e92-7d7a-44f0-8081-6ac366fefbc5-klipper-cache" pod "b27f0e92-7d7a-44f0-8081-6ac366fefbc5" (UID: "b27f0e92-7d7a-44f0-8081-6ac366fefbc5"). InnerVolumeSpecName "klipper-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 43.530148] k3s[879]: I0923 04:42:38.417295 879 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b27f0e92-7d7a-44f0-8081-6ac366fefbc5-klipper-helm" pod "b27f0e92-7d7a-44f0-8081-6ac366fefbc5" (UID: "b27f0e92-7d7a-44f0-8081-6ac366fefbc5"). InnerVolumeSpecName "klipper-helm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 43.530735] systemd[1]: var-lib-kubelet-pods-b27f0e92\x2d7d7a\x2d44f0\x2d8081\x2d6ac366fefbc5-volumes-kubernetes.io\x7eprojected-values.mount: Deactivated successfully. machine # [ 43.531279] dhcpcd[673]: veth55811ef0: removing interface machine # [ 43.531790] systemd[1]: var-lib-kubelet-pods-b27f0e92\x2d7d7a\x2d44f0\x2d8081\x2d6ac366fefbc5-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dconfig.mount: Deactivated successfully. machine # [ 43.532474] systemd[1]: var-lib-kubelet-pods-b27f0e92\x2d7d7a\x2d44f0\x2d8081\x2d6ac366fefbc5-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dhelm.mount: Deactivated successfully. machine # [ 43.533084] systemd[1]: var-lib-kubelet-pods-b27f0e92\x2d7d7a\x2d44f0\x2d8081\x2d6ac366fefbc5-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 43.585114] k3s[879]: I0923 04:42:38.500280 879 reconciler_common.go:299] "Volume detached for volume \"content\" (UniqueName: \"kubernetes.io/configmap/b27f0e92-7d7a-44f0-8081-6ac366fefbc5-content\") on node \"machine\" DevicePath \"\"" machine # [ 43.585314] k3s[879]: I0923 04:42:38.500328 879 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b27f0e92-7d7a-44f0-8081-6ac366fefbc5-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 43.585689] k3s[879]: I0923 04:42:38.500344 879 reconciler_common.go:299] "Volume detached for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/b27f0e92-7d7a-44f0-8081-6ac366fefbc5-klipper-config\") on node \"machine\" DevicePath \"\"" machine # [ 43.586211] k3s[879]: I0923 04:42:38.500358 879 reconciler_common.go:299] "Volume detached for volume \"values\" (UniqueName: \"kubernetes.io/projected/b27f0e92-7d7a-44f0-8081-6ac366fefbc5-values\") on node \"machine\" DevicePath \"\"" machine # [ 43.586855] k3s[879]: I0923 04:42:38.500380 879 reconciler_common.go:299] "Volume detached for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/b27f0e92-7d7a-44f0-8081-6ac366fefbc5-klipper-helm\") on node \"machine\" DevicePath \"\"" machine # [ 43.587617] k3s[879]: I0923 04:42:38.500398 879 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24vxs\" (UniqueName: \"kubernetes.io/projected/b27f0e92-7d7a-44f0-8081-6ac366fefbc5-kube-api-access-24vxs\") on node \"machine\" DevicePath \"\"" machine # [ 43.589138] k3s[879]: I0923 04:42:38.500410 879 reconciler_common.go:299] "Volume detached for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/b27f0e92-7d7a-44f0-8081-6ac366fefbc5-klipper-cache\") on node \"machine\" DevicePath \"\"" machine # [ 44.028117] dhcpcd[673]: vethe10baa11: soliciting an IPv6 router machine # [ 44.067452] k3s[879]: I0923 04:42:38.983072 879 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d724f22bdbce556498e1b1c2bd6c7574a5f07dcccba1a5125e2c3f5b8b740133" machine # [ 44.078699] systemd[1]: Removed slice libcontainer container kubepods-burstable-podb27f0e92_7d7a_44f0_8081_6ac366fefbc5.slice. machine # [ 44.079172] systemd[1]: kubepods-burstable-podb27f0e92_7d7a_44f0_8081_6ac366fefbc5.slice: Consumed 631ms CPU time over 6.046s wall clock time, 35.2M memory peak, 2.4M incoming IP traffic, 141K outgoing IP traffic. machine # [ 44.402283] systemd[1]: var-lib-kubelet-pods-b27f0e92\x2d7d7a\x2d44f0\x2d8081\x2d6ac366fefbc5-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2d24vxs.mount: Deactivated successfully. machine # [ 44.403212] systemd[1]: var-lib-kubelet-pods-b27f0e92\x2d7d7a\x2d44f0\x2d8081\x2d6ac366fefbc5-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dcache.mount: Deactivated successfully. machine # [ 44.514735] dhcpcd[673]: vethc91f3c8c: probing for an IPv4LL address machine # [ 44.538683] dhcpcd[673]: vethce0986e3: soliciting an IPv6 router machine # [ 44.852895] dhcpcd[673]: flannel.1: probing for an IPv4LL address machine # [ 45.479358] k3s[879]: I0923 04:42:40.394582 879 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 18.58 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s machine # [ 46.789472] dhcpcd[673]: veth8bef3ab4: probing for an IPv4LL address machine # [ 48.007210] dhcpcd[673]: vethce0986e3: probing for an IPv4LL address machine # [ 48.084200] dhcpcd[673]: vethe10baa11: probing for an IPv4LL address machine # [ 48.192233] dhcpcd[673]: vethbc257658: probing for an IPv4LL address machine # [ 48.629432] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped1736051493.mount: Deactivated successfully. machine # [ 48.714431] dhcpcd[673]: vethc91f3c8c: using IPv4LL address 169.254.117.14 machine # [ 48.714695] dhcpcd[673]: vethc91f3c8c: adding route to 169.254.0.0/16 machine # [ 48.719285] systemd[1]: Started libcontainer container f3ccc8ec8ce51c6d4e7b7e6f9d3349d2d94eeb3bff8e249e6f818df145b296a5. machine # [ 48.764458] systemd[1]: Started libcontainer container 690442ff94c8bf639c7f7f20a12d644e51dab451cad166987c262233899cd12d. machine # [ 48.888192] systemd[1]: Started libcontainer container 8589ce76a41f714a9c283fcae4f1de989c7811099d0ff7aa8ee95504598f0c10. machine # [ 49.069058] niks3-server[1187]: 2026/09/23 04:42:43 INFO lead: acquired remote=10.42.0.5:48282 machine # [ 49.200319] k3s[879]: I0923 04:42:44.115562 879 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-scheduler-64688b4568-mt5dt" podStartSLOduration=7.116787603 podStartE2EDuration="8.115536047s" totalImagesPullingTime="998.748444ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-23 04:42:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-23 04:42:44.069663737 +0000 UTC m=+31.831293081" watchObservedRunningTime="2026-09-23 04:42:44.115536047 +0000 UTC m=+31.877165391" machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s, in 3.64 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s machine # [ 49.628169] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount27343647.mount: Deactivated successfully. machine # [ 49.628440] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount2015498270.mount: Deactivated successfully. machine # [ 49.628921] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped1082845579.mount: Deactivated successfully. machine # [ 49.977624] dhcpcd[673]: flannel.1: using IPv4LL address 169.254.56.228 machine # [ 49.977893] dhcpcd[673]: flannel.1: adding route to 169.254.0.0/16 machine # [ 50.674107] systemd[1]: cri-containerd-690442ff94c8bf639c7f7f20a12d644e51dab451cad166987c262233899cd12d.scope: Deactivated successfully. machine # [ 50.676685] systemd[1]: cri-containerd-690442ff94c8bf639c7f7f20a12d644e51dab451cad166987c262233899cd12d.scope: Consumed 764ms CPU time over 1.910s wall clock time, 412.4M memory peak, 98.1M read from disk, 192M written to disk. machine # [ 50.679843] systemd[1]: cri-containerd-8589ce76a41f714a9c283fcae4f1de989c7811099d0ff7aa8ee95504598f0c10.scope: Deactivated successfully. machine # [ 50.681852] systemd[1]: cri-containerd-8589ce76a41f714a9c283fcae4f1de989c7811099d0ff7aa8ee95504598f0c10.scope: Consumed 759ms CPU time over 1.793s wall clock time, 380.5M memory peak, 64.5M read from disk, 193.3M written to disk. machine # [ 50.741508] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-8589ce76a41f714a9c283fcae4f1de989c7811099d0ff7aa8ee95504598f0c10-rootfs.mount: Deactivated successfully. machine # [ 50.743970] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-690442ff94c8bf639c7f7f20a12d644e51dab451cad166987c262233899cd12d-rootfs.mount: Deactivated successfully. machine # [ 52.017551] dhcpcd[673]: veth8bef3ab4: using IPv4LL address 169.254.49.118 machine # [ 52.020457] dhcpcd[673]: veth8bef3ab4: adding route to 169.254.0.0/16 machine # [ 52.140537] dhcpcd[673]: flannel.1: no IPv6 Routers available machine # [ 52.342865] dhcpcd[673]: vethce0986e3: using IPv4LL address 169.254.202.242 machine # [ 52.344176] dhcpcd[673]: vethce0986e3: adding route to 169.254.0.0/16 machine # [ 52.409695] systemd[1]: Started libcontainer container 6afc92b2a5c29457ebd5d50ca2f7160ecacf74bc51640de06ffc246789a6f288. machine # [ 52.412158] systemd[1]: Started libcontainer container 2662af93b290c057b6f79a90217f86f5144ea4f41fa1897a132aca5901e8ce4a. machine # [ 52.571386] systemd[1]: Started libcontainer container 652101c6255c14d3a69b495c67aca9151f76747f2ec91a86481b3f8054be04d8. machine # [ 52.628548] systemd[1]: Started libcontainer container 5f81feafeb117f84f581da004b132c5957fcc0da5fda233e7986ad78d4f6da38. machine # [ 52.753655] dhcpcd[673]: vethc91f3c8c: no IPv6 Routers available machine # [ 52.847347] systemd[1]: Started libcontainer container cc894a1f69de64ad59a677ca702e20570cb56c4a86f8e577d6ef14c740f01903. machine # [ 52.866434] systemd[1]: Started libcontainer container da1a8cf78f8df356644b9818d88f24354e326edd63b05265df74f8d557115447. machine # [ 53.162196] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount1991111715.mount: Deactivated successfully. machine # [ 53.163216] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped829955845.mount: Deactivated successfully. machine # [ 53.169535] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount4132504954.mount: Deactivated successfully. machine # [ 53.171164] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped3863507600.mount: Deactivated successfully. machine # [ 53.186135] k3s[879]: I0923 04:42:48.100454 879 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-b9skh" podStartSLOduration=9.32271154 podStartE2EDuration="12.100404235s" totalImagesPullingTime="899.848165ms" totalInitContainerRuntime="1.87784453s" isStatefulPod=false podCreationTimestamp="2026-09-23 04:42:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-23 04:42:48.09579974 +0000 UTC m=+35.857432157" watchObservedRunningTime="2026-09-23 04:42:48.100404235 +0000 UTC m=+35.862036932" machine # [ 53.204321] k3s[879]: I0923 04:42:48.119823 879 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-l44xc" podStartSLOduration=9.295043219 podStartE2EDuration="12.119797203s" totalImagesPullingTime="1.071427514s" totalInitContainerRuntime="1.75332647s" isStatefulPod=false podCreationTimestamp="2026-09-23 04:42:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-23 04:42:48.119484314 +0000 UTC m=+35.881117569" watchObservedRunningTime="2026-09-23 04:42:48.119797203 +0000 UTC m=+35.881426547" machine # [ 53.299495] dhcpcd[673]: vethbc257658: using IPv4LL address 169.254.114.149 machine # [ 53.299742] dhcpcd[673]: vethbc257658: adding route to 169.254.0.0/16 machine # [ 53.895191] dhcpcd[673]: vethe10baa11: using IPv4LL address 169.254.174.1 machine # [ 53.896191] dhcpcd[673]: vethe10baa11: adding route to 169.254.0.0/16 machine # [ 55.140498] dhcpcd[673]: veth8bef3ab4: no IPv6 Routers available machine # [ 55.357720] dhcpcd[673]: vethbc257658: no IPv6 Routers available machine # [ 56.070365] dhcpcd[673]: vethe10baa11: no IPv6 Routers available machine # [ 56.543157] dhcpcd[673]: vethce0986e3: no IPv6 Routers available machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s, in 8.05 seconds) machine: waiting for unit niks3.service machine: (finished: waiting for unit niks3.service, in 0.06 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.31 seconds) machine: waiting for success: test $(curl -sf 10.42.0.6:9901/clusters | grep -c 'health_flags::healthy') -ge 3 machine: (finished: waiting for success: test $(curl -sf 10.42.0.6:9901/clusters | grep -c 'health_flags::healthy') -ge 3, in 1.15 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.20 seconds) machine: waiting for success: curl -sf http://10.42.0.5:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2' machine: (finished: waiting for success: curl -sf http://10.42.0.5:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2', in 0.04 seconds) (finished: subtest: chart deploys and workers become Ready, in 32.04 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}', in 0.21 seconds) machine: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt machine: (finished: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt, in 0.14 seconds) subtest: build through the balancer lands in the cache machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1 machine # [ 120.505816] niks3-server[1187]: 2026/09/23 04:43:55 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 120.536345] niks3-server[1187]: 2026/09/23 04:43:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign machine # [ 120.543655] niks3-server[1187]: 2026/09/23 04:43:55 INFO Signed narinfos id=1 count=1 machine # [ 120.544365] niks3-server[1187]: 2026/09/23 04:43:55 INFO Registered completed upload object_key=nar/0nzzbas7l8d37mridr7mg162smfjvn7lhs6am4crl4ydaxicigj8.nar.zst machine # [ 120.550544] niks3-server[1187]: 2026/09/23 04:43:55 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete machine # [ 120.550715] niks3-server[1187]: 2026/09/23 04:43:55 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.ls machine # [ 120.557164] niks3-server[1187]: 2026/09/23 04:43:55 INFO Completed upload id=1 machine # [ 120.558687] niks3-server[1187]: 2026/09/23 04:43:55 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.narinfo machine # [ 144.883527] niks3-server[1187]: 2026/09/23 04:44:19 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 144.905444] niks3-server[1187]: 2026/09/23 04:44:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign machine # [ 144.907255] niks3-server[1187]: 2026/09/23 04:44:19 INFO Signed narinfos id=2 count=1 machine # [ 144.913950] niks3-server[1187]: 2026/09/23 04:44:19 INFO Registered completed upload object_key=log/yz1sqzb72i8v6h2ass0v76ba8cncqj9r-k3s-a.drv machine # [ 144.915200] niks3-server[1187]: 2026/09/23 04:44:19 INFO Registered completed upload object_key=nar/1p7jh5nyz9n68k5f18ymmdpgr34mpnnch1njw7ki7b2b97qlfbjk.nar.zst machine # [ 144.920055] niks3-server[1187]: 2026/09/23 04:44:19 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete machine # [ 144.924143] niks3-server[1187]: 2026/09/23 04:44:19 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.narinfo machine # [ 144.926232] niks3-server[1187]: 2026/09/23 04:44:19 INFO Completed upload id=2 machine # [ 144.943209] niks3-server[1187]: 2026/09/23 04:44:19 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.ls machine # [ 145.004789] niks3-server[1187]: 2026/09/23 04:44:19 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 145.018037] niks3-server[1187]: 2026/09/23 04:44:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign machine # [ 145.018520] niks3-server[1187]: 2026/09/23 04:44:19 INFO Signed narinfos id=3 count=1 machine # [ 145.021620] niks3-server[1187]: 2026/09/23 04:44:19 INFO Registered completed upload object_key=nar/03a4ywhyr5knmbc93z4gyml5y8fvgb431xvlmfxrwsm8mrb0qgx2.nar.zst machine # [ 145.027275] niks3-server[1187]: 2026/09/23 04:44:19 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete machine # [ 145.029278] niks3-server[1187]: 2026/09/23 04:44:19 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.ls machine # [ 145.030453] niks3-server[1187]: 2026/09/23 04:44:19 INFO Completed upload id=3 machine # [ 145.032600] niks3-server[1187]: 2026/09/23 04:44:19 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.narinfo machine # [ 169.954101] niks3-server[1187]: 2026/09/23 04:44:44 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 169.978855] niks3-server[1187]: 2026/09/23 04:44:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign machine # [ 169.980798] niks3-server[1187]: 2026/09/23 04:44:44 INFO Registered completed upload object_key=nar/05qjsj5ff3a6vnxkhb6k5f3m446dcc206p7cd37w4v3mgi95d7kh.nar.zst machine # [ 169.984368] niks3-server[1187]: 2026/09/23 04:44:44 INFO Signed narinfos id=4 count=1 machine # [ 169.985656] niks3-server[1187]: 2026/09/23 04:44:44 INFO Registered completed upload object_key=log/zfq1xw9bmycqh35l0s44lmv65z4xc7br-k3s-b.drv machine # [ 169.987657] niks3-server[1187]: 2026/09/23 04:44:44 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.ls machine # [ 169.992143] niks3-server[1187]: 2026/09/23 04:44:44 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete machine # [ 169.994678] niks3-server[1187]: 2026/09/23 04:44:44 INFO Completed upload id=4 machine # [ 169.998735] niks3-server[1187]: 2026/09/23 04:44:44 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.narinfo machine # [ 170.064966] niks3-server[1187]: 2026/09/23 04:44:44 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 170.075766] niks3-server[1187]: 2026/09/23 04:44:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign machine # [ 170.077069] niks3-server[1187]: 2026/09/23 04:44:44 INFO Signed narinfos id=5 count=1 machine # [ 170.080332] niks3-server[1187]: 2026/09/23 04:44:44 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.ls machine # [ 170.082565] niks3-server[1187]: 2026/09/23 04:44:44 INFO Registered completed upload object_key=nar/0jyw88klkf3nwxpnj5m5lx3i1dv2idf3hcn6im7883hnldm3gvyq.nar.zst machine # [ 170.084448] niks3-server[1187]: 2026/09/23 04:44:45 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete machine # [ 170.086332] niks3-server[1187]: 2026/09/23 04:44:45 INFO Completed upload id=5 machine # [ 170.087754] niks3-server[1187]: 2026/09/23 04:44:45 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.narinfo machine # [ 194.606832] niks3-server[1187]: 2026/09/23 04:45:09 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 194.625870] niks3-server[1187]: 2026/09/23 04:45:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign machine # [ 194.628326] niks3-server[1187]: 2026/09/23 04:45:09 INFO Signed narinfos id=6 count=1 machine # [ 194.633832] niks3-server[1187]: 2026/09/23 04:45:09 INFO Registered completed upload object_key=nar/1q8vp5xqws560mpf8rxk8r8jhqrzibivh13x4wxy0cfqlzbk7cr5.nar.zst machine # [ 194.639334] niks3-server[1187]: 2026/09/23 04:45:09 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete machine # [ 194.643843] niks3-server[1187]: 2026/09/23 04:45:09 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.ls machine # [ 194.648263] niks3-server[1187]: 2026/09/23 04:45:09 INFO Registered completed upload object_key=log/n40czam6a4ldp1mh5fdmlcy07fv0akbm-k3s-top.drv machine # [ 194.653073] niks3-server[1187]: 2026/09/23 04:45:09 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.narinfo machine # [ 194.656365] niks3-server[1187]: 2026/09/23 04:45:09 INFO Completed upload id=6 machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1, in 136.33 seconds) machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath, in 0.19 seconds) machine: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine: (finished: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.02 seconds) machine: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine # copying 3 paths... machine # copying path '/nix/store/r95r891injj9ski5c4w89yxjvjy065mx-k3s-a' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/mrqsh0475wxsmnsvkk55g94v6g5nrcra-k3s-b' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top' from 'http://192.168.1.1:5751'... machine: (finished: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.22 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1 machine # [ 196.432516] niks3-server[1187]: 2026/09/23 04:45:11 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 196.456431] niks3-server[1187]: 2026/09/23 04:45:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign machine # [ 196.457742] niks3-server[1187]: 2026/09/23 04:45:11 INFO Signed narinfos id=7 count=1 machine # [ 196.459205] niks3-server[1187]: 2026/09/23 04:45:11 INFO Registered completed upload object_key=nar/1fr26arhri17j9bj6hyjzmmd74v730biz1gb3kqd194vjx3ccvp9.nar.zst machine # [ 196.462275] niks3-server[1187]: 2026/09/23 04:45:11 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.ls machine # [ 196.466890] niks3-server[1187]: 2026/09/23 04:45:11 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete machine # [ 196.468989] niks3-server[1187]: 2026/09/23 04:45:11 INFO Completed upload id=7 machine # [ 196.473727] niks3-server[1187]: 2026/09/23 04:45:11 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.narinfo machine # [ 221.797273] niks3-server[1187]: 2026/09/23 04:45:36 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 221.824227] niks3-server[1187]: 2026/09/23 04:45:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign machine # [ 221.826951] niks3-server[1187]: 2026/09/23 04:45:36 INFO Signed narinfos id=8 count=1 machine # [ 221.830893] niks3-server[1187]: 2026/09/23 04:45:36 INFO Registered completed upload object_key=nar/1hfc6x4x25k3b0fk091d3nb0k3mympfp05fkslcx19synp3ig0zd.nar.zst machine # [ 221.832956] niks3-server[1187]: 2026/09/23 04:45:36 INFO Registered completed upload object_key=log/pbpqsh50ar10fpasdqqx8xg3lmr5j8iz-k3s-a.drv machine # [ 221.836949] niks3-server[1187]: 2026/09/23 04:45:36 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.ls machine # [ 221.850557] niks3-server[1187]: 2026/09/23 04:45:36 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete machine # [ 221.854963] niks3-server[1187]: 2026/09/23 04:45:36 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.narinfo machine # [ 221.859132] niks3-server[1187]: 2026/09/23 04:45:36 INFO Completed upload id=8 machine # [ 221.925565] niks3-server[1187]: 2026/09/23 04:45:36 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 221.934485] niks3-server[1187]: 2026/09/23 04:45:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign machine # [ 221.937642] niks3-server[1187]: 2026/09/23 04:45:36 INFO Signed narinfos id=9 count=1 machine # [ 221.939680] niks3-server[1187]: 2026/09/23 04:45:36 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.ls machine # [ 221.940810] niks3-server[1187]: 2026/09/23 04:45:36 INFO Registered completed upload object_key=nar/0zzq2vgjln4shvh57091n14sam6wh6w06vja6lzb9ppcj4ffyx1n.nar.zst machine # [ 221.942864] niks3-server[1187]: 2026/09/23 04:45:36 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete machine # [ 221.946078] niks3-server[1187]: 2026/09/23 04:45:36 INFO Completed upload id=9 machine # [ 221.947099] niks3-server[1187]: 2026/09/23 04:45:36 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.narinfo machine # [ 246.869600] niks3-server[1187]: 2026/09/23 04:46:01 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 246.887428] niks3-server[1187]: 2026/09/23 04:46:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign machine # [ 246.888507] niks3-server[1187]: 2026/09/23 04:46:01 INFO Signed narinfos id=10 count=1 machine # [ 246.893348] niks3-server[1187]: 2026/09/23 04:46:01 INFO Registered completed upload object_key=nar/0hh3nqk95r6g32lhdmxw8cxjv694vbpx9876zkhcpg4r4qxni2ch.nar.zst machine # [ 246.895695] niks3-server[1187]: 2026/09/23 04:46:01 INFO Registered completed upload object_key=log/894h6wzw2l4w5f0hikj1k6q57jfnyi87-k3s-b.drv machine # [ 246.899043] niks3-server[1187]: 2026/09/23 04:46:01 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete machine # [ 246.904960] niks3-server[1187]: 2026/09/23 04:46:01 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.ls machine # [ 246.907209] niks3-server[1187]: 2026/09/23 04:46:01 INFO Completed upload id=10 machine # [ 246.909702] niks3-server[1187]: 2026/09/23 04:46:01 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.narinfo machine # [ 246.980055] niks3-server[1187]: 2026/09/23 04:46:01 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 246.994154] niks3-server[1187]: 2026/09/23 04:46:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign machine # [ 246.994956] niks3-server[1187]: 2026/09/23 04:46:01 INFO Signed narinfos id=11 count=1 machine # [ 247.000377] niks3-server[1187]: 2026/09/23 04:46:01 INFO Registered completed upload object_key=nar/0ingamx56k31lwiyxmnxmscjj4n3qfx6sr2kpaynsrwhwz1278iw.nar.zst machine # [ 247.002846] niks3-server[1187]: 2026/09/23 04:46:01 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete machine # [ 247.004939] niks3-server[1187]: 2026/09/23 04:46:01 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.ls machine # [ 247.007398] niks3-server[1187]: 2026/09/23 04:46:01 INFO Completed upload id=11 machine # [ 247.008557] niks3-server[1187]: 2026/09/23 04:46:01 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.narinfo machine # [ 271.706397] niks3-server[1187]: 2026/09/23 04:46:26 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 271.725693] niks3-server[1187]: 2026/09/23 04:46:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign machine # [ 271.730199] niks3-server[1187]: 2026/09/23 04:46:26 INFO Signed narinfos id=12 count=1 machine # [ 271.733281] niks3-server[1187]: 2026/09/23 04:46:26 INFO Registered completed upload object_key=nar/0v48x4sp58bvfra08axgkz7yl1n9nc4nirskyv1hwann4i7q277i.nar.zst machine # [ 271.738690] niks3-server[1187]: 2026/09/23 04:46:26 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.ls machine # [ 271.743117] niks3-server[1187]: 2026/09/23 04:46:26 INFO Registered completed upload object_key=log/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g-k3s-top.drv machine # [ 271.743280] niks3-server[1187]: 2026/09/23 04:46:26 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete machine # [ 271.744900] niks3-server[1187]: 2026/09/23 04:46:26 INFO Completed upload id=12 machine # [ 271.746849] niks3-server[1187]: 2026/09/23 04:46:26 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1, in 76.65 seconds) (finished: subtest: build through the balancer lands in the cache, in 213.42 seconds) subtest: a Job with the client image builds through the farm with its service account machine: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine: (finished: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.19 seconds) machine: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix machine: (finished: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix, in 0.16 seconds) machine: must succeed: kubectl apply -f /nix/store/lp0q6rjq0cw1vs9npm6c3ggx088f4vva-ci-job.json machine: (finished: must succeed: kubectl apply -f /nix/store/lp0q6rjq0cw1vs9npm6c3ggx088f4vva-ci-job.json, in 0.19 seconds) machine: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed' machine # [ 273.657602] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod8c485f42_ef6b_4904_aca2_cfdded7da5a0.slice. machine # [ 273.788732] k3s[879]: I0923 04:46:28.703938 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"job\" (UniqueName: \"kubernetes.io/configmap/8c485f42-ef6b-4904-aca2-cfdded7da5a0-job\") pod \"ci-zvcf6\" (UID: \"8c485f42-ef6b-4904-aca2-cfdded7da5a0\") " pod="ci/ci-zvcf6" machine # [ 273.792649] k3s[879]: I0923 04:46:28.704054 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/8c485f42-ef6b-4904-aca2-cfdded7da5a0-nix-grpc-farm\") pod \"ci-zvcf6\" (UID: \"8c485f42-ef6b-4904-aca2-cfdded7da5a0\") " pod="ci/ci-zvcf6" machine # [ 273.796605] k3s[879]: I0923 04:46:28.704127 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t88d\" (UniqueName: \"kubernetes.io/projected/8c485f42-ef6b-4904-aca2-cfdded7da5a0-kube-api-access-2t88d\") pod \"ci-zvcf6\" (UID: \"8c485f42-ef6b-4904-aca2-cfdded7da5a0\") " pod="ci/ci-zvcf6" machine # [ 275.063631] cni0: port 1(veth6fd36d15) entered blocking state machine # [ 275.065347] cni0: port 1(veth6fd36d15) entered disabled state machine # [ 275.067516] veth6fd36d15: entered allmulticast mode machine # [ 275.070146] veth6fd36d15: entered promiscuous mode machine # [ 275.089382] cni0: port 1(veth6fd36d15) entered blocking state machine # [ 275.090356] cni0: port 1(veth6fd36d15) entered forwarding state machine # [ 274.970700] (udev-worker)[4817]: Network interface NamePolicy= disabled on kernel command line. machine # [ 274.995419] dhcpcd[673]: veth6fd36d15: IAID e9:05:75:a2 machine # [ 274.995819] dhcpcd[673]: veth6fd36d15: adding address fe80::ec3c:e9ff:fe05:75a2 machine # [ 275.036547] systemd[1]: Started libcontainer container ca0bc3645d5e8bec7072c32bfc07d428f11e42ffe982b258982bbc962b6440b8. machine # [ 276.336756] dhcpcd[673]: veth6fd36d15: soliciting a DHCP lease machine # [ 276.843279] dhcpcd[673]: veth6fd36d15: soliciting an IPv6 router machine # [ 277.023592] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount3691235228.mount: Deactivated successfully. machine # [ 277.079325] systemd[1]: Started libcontainer container c3d0bae6596aec7ab8b4effd0a440700f6f44032fb7e21acf03296bc87f27188. machine # [ 278.376254] niks3-server[1187]: 2026/09/23 04:46:33 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 278.387686] niks3-server[1187]: 2026/09/23 04:46:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign machine # [ 278.389689] niks3-server[1187]: 2026/09/23 04:46:33 INFO Signed narinfos id=13 count=1 machine # [ 278.392650] niks3-server[1187]: 2026/09/23 04:46:33 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.ls machine # [ 278.394659] niks3-server[1187]: 2026/09/23 04:46:33 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete machine # [ 278.396612] niks3-server[1187]: 2026/09/23 04:46:33 INFO Registered completed upload object_key=nar/111g6dyibwcf2z7jhpn72rgja0qvjgpdiv9nc06g2dp7ih0a6kyq.nar.zst machine # [ 278.399127] niks3-server[1187]: 2026/09/23 04:46:33 INFO Completed upload id=13 machine # [ 278.400361] niks3-server[1187]: 2026/09/23 04:46:33 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.narinfo machine # [ 281.337502] dhcpcd[673]: veth6fd36d15: probing for an IPv4LL address machine # [ 286.836057] dhcpcd[673]: veth6fd36d15: using IPv4LL address 169.254.126.224 machine # [ 286.839068] dhcpcd[673]: veth6fd36d15: adding route to 169.254.0.0/16 machine # [ 288.847331] dhcpcd[673]: veth6fd36d15: no IPv6 Routers available machine # [ 303.320878] niks3-server[1187]: 2026/09/23 04:46:58 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 303.341541] niks3-server[1187]: 2026/09/23 04:46:58 INFO Registered completed upload object_key=nar/058kjd2vfl1r27b4d9ixvwf77d8rkr18a4v894kwx8lg0nwpajnr.nar.zst machine # [ 303.346703] niks3-server[1187]: 2026/09/23 04:46:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign machine # [ 303.348498] niks3-server[1187]: 2026/09/23 04:46:58 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.ls machine # [ 303.350055] niks3-server[1187]: 2026/09/23 04:46:58 INFO Signed narinfos id=14 count=1 machine # [ 303.357145] niks3-server[1187]: 2026/09/23 04:46:58 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete machine # [ 303.360116] niks3-server[1187]: 2026/09/23 04:46:58 INFO Completed upload id=14 machine # [ 303.361736] niks3-server[1187]: 2026/09/23 04:46:58 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.narinfo machine # [ 303.366121] niks3-server[1187]: 2026/09/23 04:46:58 INFO Registered completed upload object_key=log/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # [ 303.431479] niks3-server[1187]: 2026/09/23 04:46:58 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 303.442904] niks3-server[1187]: 2026/09/23 04:46:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign machine # [ 303.443980] niks3-server[1187]: 2026/09/23 04:46:58 INFO Signed narinfos id=15 count=1 machine # [ 303.447340] niks3-server[1187]: 2026/09/23 04:46:58 INFO Registered completed upload object_key=nar/138ynhcd5wxzz485x9qcq7xsargaklrf2li31ai69m5r46am35q6.nar.zst machine # [ 303.449660] niks3-server[1187]: 2026/09/23 04:46:58 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.ls machine # [ 303.451731] niks3-server[1187]: 2026/09/23 04:46:58 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete machine # [ 303.453708] niks3-server[1187]: 2026/09/23 04:46:58 INFO Completed upload id=15 machine # [ 310.574395] postgres[759]: [759] LOG: checkpoint starting: time machine # [ 328.575987] niks3-server[1187]: 2026/09/23 04:47:23 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 328.599938] niks3-server[1187]: 2026/09/23 04:47:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign machine # [ 328.601937] niks3-server[1187]: 2026/09/23 04:47:23 INFO Signed narinfos id=16 count=1 machine # [ 328.609682] niks3-server[1187]: 2026/09/23 04:47:23 INFO Registered completed upload object_key=nar/0n4lbdlp8w72fs3qbavl2lwrzbrn55i2b1vyglc89cc3pi8vbb1m.nar.zst machine # [ 328.612203] niks3-server[1187]: 2026/09/23 04:47:23 INFO Registered completed upload object_key=log/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # [ 328.614156] niks3-server[1187]: 2026/09/23 04:47:23 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.ls machine # [ 328.616422] niks3-server[1187]: 2026/09/23 04:47:23 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete machine # [ 328.621061] niks3-server[1187]: 2026/09/23 04:47:23 INFO Completed upload id=16 machine # [ 328.624553] niks3-server[1187]: 2026/09/23 04:47:23 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo machine # [ 328.694326] niks3-server[1187]: 2026/09/23 04:47:23 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 328.705731] niks3-server[1187]: 2026/09/23 04:47:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign machine # [ 328.708592] niks3-server[1187]: 2026/09/23 04:47:23 INFO Signed narinfos id=17 count=1 machine # [ 328.710295] niks3-server[1187]: 2026/09/23 04:47:23 INFO Registered completed upload object_key=nar/1f3gvnvqsm2pm3laixkxkg44kvjb251zqhszcfpp0a00h6x66ljs.nar.zst machine # [ 328.712756] niks3-server[1187]: 2026/09/23 04:47:23 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.ls machine # [ 328.718034] niks3-server[1187]: 2026/09/23 04:47:23 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete machine # [ 328.720190] niks3-server[1187]: 2026/09/23 04:47:23 INFO Completed upload id=17 machine # [ 328.721541] niks3-server[1187]: 2026/09/23 04:47:23 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.narinfo machine # [ 353.233479] niks3-server[1187]: 2026/09/23 04:47:48 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 353.252114] niks3-server[1187]: 2026/09/23 04:47:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign machine # [ 353.256655] niks3-server[1187]: 2026/09/23 04:47:48 INFO Signed narinfos id=18 count=1 machine # [ 353.261729] niks3-server[1187]: 2026/09/23 04:47:48 INFO Registered completed upload object_key=nar/1zwf0asrdv12q40fmqga5lx5330dvn9y4in4i9ficz9ij5lhvnf5.nar.zst machine # [ 353.263885] niks3-server[1187]: 2026/09/23 04:47:48 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.ls machine # [ 353.266223] niks3-server[1187]: 2026/09/23 04:47:48 INFO Registered completed upload object_key=log/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # [ 353.268578] niks3-server[1187]: 2026/09/23 04:47:48 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete machine # [ 353.271871] niks3-server[1187]: 2026/09/23 04:47:48 INFO Completed upload id=18 machine # [ 353.286278] niks3-server[1187]: 2026/09/23 04:47:48 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo machine # [ 355.972855] niks3-server[1187]: 2026/09/23 04:47:50 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 355.987880] niks3-server[1187]: 2026/09/23 04:47:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign machine # [ 355.990177] niks3-server[1187]: 2026/09/23 04:47:50 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.ls machine # [ 355.992714] niks3-server[1187]: 2026/09/23 04:47:50 INFO Signed narinfos id=19 count=1 machine # [ 355.994944] niks3-server[1187]: 2026/09/23 04:47:50 INFO Registered completed upload object_key=nar/0xiyqcsl8db7dnrq2gqnx5izavr51ma3dcdswrriaxfgj3qzk7xf.nar.zst machine # [ 355.998508] niks3-server[1187]: 2026/09/23 04:47:50 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete machine # [ 356.001936] niks3-server[1187]: 2026/09/23 04:47:50 INFO Completed upload id=19 machine # [ 356.005951] niks3-server[1187]: 2026/09/23 04:47:50 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.narinfo machine # [ 380.524251] niks3-server[1187]: 2026/09/23 04:48:15 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 380.547470] niks3-server[1187]: 2026/09/23 04:48:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign machine # [ 380.550767] niks3-server[1187]: 2026/09/23 04:48:15 INFO Signed narinfos id=20 count=1 machine # [ 380.554188] niks3-server[1187]: 2026/09/23 04:48:15 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.ls machine # [ 380.556244] niks3-server[1187]: 2026/09/23 04:48:15 INFO Registered completed upload object_key=log/fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # [ 380.566199] niks3-server[1187]: 2026/09/23 04:48:15 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete machine # [ 380.566876] niks3-server[1187]: 2026/09/23 04:48:15 INFO Registered completed upload object_key=nar/0p3l2z3riilylr2rxb1aq2blxdfxg55wbgp4gxkns93srbr4bwyq.nar.zst machine # [ 380.571843] niks3-server[1187]: 2026/09/23 04:48:15 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo machine # [ 380.578392] niks3-server[1187]: 2026/09/23 04:48:15 INFO Completed upload id=20 machine # [ 381.776278] systemd[1]: cri-containerd-c3d0bae6596aec7ab8b4effd0a440700f6f44032fb7e21acf03296bc87f27188.scope: Deactivated successfully. machine # [ 381.778580] systemd[1]: cri-containerd-c3d0bae6596aec7ab8b4effd0a440700f6f44032fb7e21acf03296bc87f27188.scope: Consumed 1.074s CPU time over 1min 44.695s wall clock time, 102M memory peak, 32.6M read from disk, 428K written to disk, 18.2K incoming IP traffic, 44.7K outgoing IP traffic. machine # [ 381.826780] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-c3d0bae6596aec7ab8b4effd0a440700f6f44032fb7e21acf03296bc87f27188-rootfs.mount: Deactivated successfully. machine # [ 383.729297] systemd[1]: cri-containerd-ca0bc3645d5e8bec7072c32bfc07d428f11e42ffe982b258982bbc962b6440b8.scope: Deactivated successfully. machine # [ 383.787543] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-ca0bc3645d5e8bec7072c32bfc07d428f11e42ffe982b258982bbc962b6440b8-rootfs.mount: Deactivated successfully. machine # [ 383.827859] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-ca0bc3645d5e8bec7072c32bfc07d428f11e42ffe982b258982bbc962b6440b8-shm.mount: Deactivated successfully. machine # [ 384.019595] cni0: port 1(veth6fd36d15) entered disabled state machine # [ 383.866524] dhcpcd[673]: veth6fd36d15: carrier lost machine # [ 384.022818] veth6fd36d15 (unregistering): left allmulticast mode machine # [ 384.023986] veth6fd36d15 (unregistering): left promiscuous mode machine # [ 384.025205] cni0: port 1(veth6fd36d15) entered disabled state machine # [ 383.893278] systemd[1]: run-netns-cni\x2d25cbe584\x2d0374\x2d2dfe\x2d8640\x2d62f6227bbbb1.mount: Deactivated successfully. machine # [ 383.902763] dhcpcd[673]: veth6fd36d15: deleting address fe80::ec3c:e9ff:fe05:75a2 machine # [ 383.906217] dhcpcd[673]: veth6fd36d15: deleting route to 169.254.0.0/16 machine # [ 383.971312] dhcpcd[673]: veth6fd36d15: removing interface machine # [ 384.015738] k3s[879]: I0923 04:48:18.930952 879 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8c485f42-ef6b-4904-aca2-cfdded7da5a0-nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/8c485f42-ef6b-4904-aca2-cfdded7da5a0-nix-grpc-farm\") pod \"8c485f42-ef6b-4904-aca2-cfdded7da5a0\" (UID: \"8c485f42-ef6b-4904-aca2-cfdded7da5a0\") " machine # [ 384.015919] k3s[879]: I0923 04:48:18.931069 879 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8c485f42-ef6b-4904-aca2-cfdded7da5a0-kube-api-access-2t88d\" (UniqueName: \"kubernetes.io/projected/8c485f42-ef6b-4904-aca2-cfdded7da5a0-kube-api-access-2t88d\") pod \"8c485f42-ef6b-4904-aca2-cfdded7da5a0\" (UID: \"8c485f42-ef6b-4904-aca2-cfdded7da5a0\") " machine # [ 384.016591] k3s[879]: I0923 04:48:18.931112 879 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8c485f42-ef6b-4904-aca2-cfdded7da5a0-job\" (UniqueName: \"kubernetes.io/configmap/8c485f42-ef6b-4904-aca2-cfdded7da5a0-job\") pod \"8c485f42-ef6b-4904-aca2-cfdded7da5a0\" (UID: \"8c485f42-ef6b-4904-aca2-cfdded7da5a0\") " machine # [ 384.017179] k3s[879]: I0923 04:48:18.931609 879 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c485f42-ef6b-4904-aca2-cfdded7da5a0-job" pod "8c485f42-ef6b-4904-aca2-cfdded7da5a0" (UID: "8c485f42-ef6b-4904-aca2-cfdded7da5a0"). InnerVolumeSpecName "job". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 384.021120] systemd[1]: var-lib-kubelet-pods-8c485f42\x2def6b\x2d4904\x2daca2\x2dcfdded7da5a0-volumes-kubernetes.io\x7eprojected-nix\x2dgrpc\x2dfarm.mount: Deactivated successfully. machine # [ 384.021773] systemd[1]: var-lib-kubelet-pods-8c485f42\x2def6b\x2d4904\x2daca2\x2dcfdded7da5a0-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2d2t88d.mount: Deactivated successfully. machine # [ 384.037075] k3s[879]: I0923 04:48:18.952684 879 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c485f42-ef6b-4904-aca2-cfdded7da5a0-kube-api-access-2t88d" pod "8c485f42-ef6b-4904-aca2-cfdded7da5a0" (UID: "8c485f42-ef6b-4904-aca2-cfdded7da5a0"). InnerVolumeSpecName "kube-api-access-2t88d". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 384.041911] k3s[879]: I0923 04:48:18.957539 879 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c485f42-ef6b-4904-aca2-cfdded7da5a0-nix-grpc-farm" pod "8c485f42-ef6b-4904-aca2-cfdded7da5a0" (UID: "8c485f42-ef6b-4904-aca2-cfdded7da5a0"). InnerVolumeSpecName "nix-grpc-farm". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 384.116089] k3s[879]: I0923 04:48:19.031667 879 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2t88d\" (UniqueName: \"kubernetes.io/projected/8c485f42-ef6b-4904-aca2-cfdded7da5a0-kube-api-access-2t88d\") on node \"machine\" DevicePath \"\"" machine # [ 384.116309] k3s[879]: I0923 04:48:19.031716 879 reconciler_common.go:299] "Volume detached for volume \"job\" (UniqueName: \"kubernetes.io/configmap/8c485f42-ef6b-4904-aca2-cfdded7da5a0-job\") on node \"machine\" DevicePath \"\"" machine # [ 384.117487] k3s[879]: I0923 04:48:19.031756 879 reconciler_common.go:299] "Volume detached for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/8c485f42-ef6b-4904-aca2-cfdded7da5a0-nix-grpc-farm\") on node \"machine\" DevicePath \"\"" machine # [ 384.715893] k3s[879]: I0923 04:48:19.631443 879 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ca0bc3645d5e8bec7072c32bfc07d428f11e42ffe982b258982bbc962b6440b8" machine # [ 384.732926] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod8c485f42_ef6b_4904_aca2_cfdded7da5a0.slice. machine # [ 384.734224] systemd[1]: kubepods-besteffort-pod8c485f42_ef6b_4904_aca2_cfdded7da5a0.slice: Consumed 1.106s CPU time over 1min 51.073s wall clock time, 102.2M memory peak, 32.6M read from disk, 632K written to disk, 18.2K incoming IP traffic, 44.7K outgoing IP traffic. machine: (finished: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed', in 112.32 seconds) machine: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1 machine: (finished: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1, in 0.18 seconds) machine # don't know how to build these paths: machine # /nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-a> machine/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-l44xc: building fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-b> machine/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-l44xc: building 1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-top> machine/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-l44xc: building rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # INFO:nix_fast_build.processes:run nix-eval-jobs --gc-roots-dir /tmp/tmpgy3iwy11/gcroots --force-recurse --max-memory-size 4096 --workers 4 --flake '.#checks' --check-cache-status machine # INFO:nix_fast_build.workers:builds: 0 machine # warning: Git tree '/tmp' is dirty machine # warning: Git tree '/tmp' is dirty machine # ▶ x86_64-linux.t started machine # INFO:nix_fast_build.workers:builds: 2 machine # ✔ x86_64-linux.t (26s) machine # x86_64-linux.t> machine/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-b9skh: building fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # warning: Git tree '/tmp' is dirty machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath, in 0.17 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null, in 0.04 seconds) (finished: subtest: a Job with the client image builds through the farm with its service account, in 113.53 seconds) subtest: a renewed balancer certificate is served without a rollout machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f - machine # Warning: resource secrets/farm-lb-tls is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically. machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f -, in 0.31 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}', in 0.99 seconds) machine: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-775dbb5c7c-bpc2n -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine # [ 387.915270] k3s[879]: E0923 04:48:22.830055 879 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:56242->127.0.0.1:10010: write tcp 127.0.0.1:56242->127.0.0.1:10010: write: connection reset by peer machine # [ 387.915727] k3s[879]: E0923 04:48:22.830217 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59334: use of closed network connection machine # [ 389.263603] k3s[879]: E0923 04:48:24.178707 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59366: use of closed network connection machine # [ 390.554404] k3s[879]: E0923 04:48:25.468891 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59378: use of closed network connection machine # [ 391.859303] k3s[879]: E0923 04:48:26.774420 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59396: use of closed network connection machine # [ 393.153058] k3s[879]: E0923 04:48:28.068118 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51496: use of closed network connection machine # [ 394.484697] k3s[879]: E0923 04:48:29.399291 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51528: use of closed network connection machine # [ 395.772957] k3s[879]: E0923 04:48:30.688067 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51572: use of closed network connection machine # [ 397.085504] k3s[879]: E0923 04:48:32.000804 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51590: use of closed network connection machine # [ 398.406591] k3s[879]: E0923 04:48:33.321899 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51628: use of closed network connection machine # [ 401.041941] k3s[879]: E0923 04:48:35.956700 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51686: use of closed network connection machine # [ 401.042237] k3s[879]: time="2026-09-23T04:48:35Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:42188->127.0.0.1:10250: write: connection reset by peer" machine # [ 402.341039] k3s[879]: E0923 04:48:37.256120 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51724: use of closed network connection machine # [ 403.666280] k3s[879]: E0923 04:48:38.581510 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55246: use of closed network connection machine # [ 404.991244] k3s[879]: E0923 04:48:39.906515 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55268: use of closed network connection machine # [ 406.304444] k3s[879]: E0923 04:48:41.219453 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55300: use of closed network connection machine: (finished: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-775dbb5c7c-bpc2n -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 18.68 seconds) machine: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine: (finished: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 0.05 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1 machine # [ 406.577733] niks3-server[1187]: 2026/09/23 04:48:41 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 406.589532] niks3-server[1187]: 2026/09/23 04:48:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign machine # [ 406.590629] niks3-server[1187]: 2026/09/23 04:48:41 INFO Signed narinfos id=21 count=1 machine # [ 406.599342] niks3-server[1187]: 2026/09/23 04:48:41 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.ls machine # [ 406.604917] niks3-server[1187]: 2026/09/23 04:48:41 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete machine # [ 406.609794] niks3-server[1187]: 2026/09/23 04:48:41 INFO Registered completed upload object_key=nar/0g42hgwa9jp9abmqxz90dkwxpybsznzbpsy35rm921mlk5sw56jq.nar.zst machine # [ 406.613965] niks3-server[1187]: 2026/09/23 04:48:41 INFO Completed upload id=21 machine # [ 406.616364] niks3-server[1187]: 2026/09/23 04:48:41 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.narinfo machine # [ 414.808095] postgres[759]: [759] LOG: checkpoint complete: wrote 1037 buffers (6.3%), wrote 3 SLRU buffers; 1 WAL file(s) added, 0 removed, 0 recycled; write=104.124 s, sync=0.069 s, total=104.234 s; sync files=364, longest=0.004 s, average=0.001 s; distance=4978 kB, estimate=4978 kB; lsn=0/1C72500, redo lsn=0/1C42C98 machine # [ 431.528689] niks3-server[1187]: 2026/09/23 04:49:06 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 431.541829] niks3-server[1187]: 2026/09/23 04:49:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign machine # [ 431.546226] niks3-server[1187]: 2026/09/23 04:49:06 INFO Signed narinfos id=22 count=1 machine # [ 431.550237] niks3-server[1187]: 2026/09/23 04:49:06 INFO Registered completed upload object_key=nar/1vxmmzwi16s4iri6dcmi9v62dpq1ys7wz15b497ncik3sd67nfzg.nar.zst machine # [ 431.553159] niks3-server[1187]: 2026/09/23 04:49:06 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete machine # [ 431.559892] niks3-server[1187]: 2026/09/23 04:49:06 INFO Registered completed upload object_key=log/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31-k3s-a.drv machine # [ 431.560978] niks3-server[1187]: 2026/09/23 04:49:06 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.ls machine # [ 431.563790] niks3-server[1187]: 2026/09/23 04:49:06 INFO Completed upload id=22 machine # [ 431.566502] niks3-server[1187]: 2026/09/23 04:49:06 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo machine # [ 431.638232] niks3-server[1187]: 2026/09/23 04:49:06 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 431.650285] niks3-server[1187]: 2026/09/23 04:49:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign machine # [ 431.654786] niks3-server[1187]: 2026/09/23 04:49:06 INFO Signed narinfos id=23 count=1 machine # [ 431.654895] niks3-server[1187]: 2026/09/23 04:49:06 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.ls machine # [ 431.657123] niks3-server[1187]: 2026/09/23 04:49:06 INFO Registered completed upload object_key=nar/0cbxkyxz068xc5mivh2h67kw6y01n1x28cbs11v1a03g8m4c71zm.nar.zst machine # [ 431.659300] niks3-server[1187]: 2026/09/23 04:49:06 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete machine # [ 431.662051] niks3-server[1187]: 2026/09/23 04:49:06 INFO Completed upload id=23 machine # [ 431.666346] niks3-server[1187]: 2026/09/23 04:49:06 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.narinfo machine # [ 456.382754] niks3-server[1187]: 2026/09/23 04:49:31 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 456.398901] niks3-server[1187]: 2026/09/23 04:49:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign machine # [ 456.401662] niks3-server[1187]: 2026/09/23 04:49:31 INFO Signed narinfos id=24 count=1 machine # [ 456.404238] niks3-server[1187]: 2026/09/23 04:49:31 INFO Registered completed upload object_key=nar/0khxywxb2r78vhpc5hsmha3ymgp910z0aka7550jmaqzs333rmzp.nar.zst machine # [ 456.406511] niks3-server[1187]: 2026/09/23 04:49:31 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.ls machine # [ 456.408938] niks3-server[1187]: 2026/09/23 04:49:31 INFO Registered completed upload object_key=log/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4-k3s-b.drv machine # [ 456.410434] niks3-server[1187]: 2026/09/23 04:49:31 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete machine # [ 456.412212] niks3-server[1187]: 2026/09/23 04:49:31 INFO Completed upload id=24 machine # [ 456.414340] niks3-server[1187]: 2026/09/23 04:49:31 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.narinfo machine # [ 456.498376] niks3-server[1187]: 2026/09/23 04:49:31 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 456.508991] niks3-server[1187]: 2026/09/23 04:49:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign machine # [ 456.513613] niks3-server[1187]: 2026/09/23 04:49:31 INFO Signed narinfos id=25 count=1 machine # [ 456.515647] niks3-server[1187]: 2026/09/23 04:49:31 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.ls machine # [ 456.516907] niks3-server[1187]: 2026/09/23 04:49:31 INFO Registered completed upload object_key=nar/04bim5f8bvjh25xncf5x40kb529khrlzcbc92qxvapgbc0bdfv2h.nar.zst machine # [ 456.530772] niks3-server[1187]: 2026/09/23 04:49:31 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete machine # [ 456.532971] niks3-server[1187]: 2026/09/23 04:49:31 INFO Completed upload id=25 machine # [ 456.535505] niks3-server[1187]: 2026/09/23 04:49:31 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.narinfo machine # [ 481.657543] niks3-server[1187]: 2026/09/23 04:49:56 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 481.683725] niks3-server[1187]: 2026/09/23 04:49:56 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.ls machine # [ 481.686769] niks3-server[1187]: 2026/09/23 04:49:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign machine # [ 481.688876] niks3-server[1187]: 2026/09/23 04:49:56 INFO Registered completed upload object_key=nar/11f7f1hixry25c2yc6np9hs10a2pwwqmymmrxxbswhdjabcyvv0s.nar.zst machine # [ 481.690373] niks3-server[1187]: 2026/09/23 04:49:56 INFO Signed narinfos id=26 count=1 machine # [ 481.697448] niks3-server[1187]: 2026/09/23 04:49:56 INFO Registered completed upload object_key=log/jz7biafi8rj5r3r392blyazw5mdpvy0d-k3s-top.drv machine # [ 481.701851] niks3-server[1187]: 2026/09/23 04:49:56 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete machine # [ 481.707036] niks3-server[1187]: 2026/09/23 04:49:56 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.narinfo machine # [ 481.712278] niks3-server[1187]: 2026/09/23 04:49:56 INFO Completed upload id=26 machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1, in 76.41 seconds) (finished: subtest: a renewed balancer certificate is served without a rollout, in 96.43 seconds) subtest: metrics carry build_info machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-cfb8578f6-b9skh -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-cfb8578f6-b9skh -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.18 seconds) machine: must succeed: curl -sf http://10.42.0.7:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-b9skh"' machine: (finished: must succeed: curl -sf http://10.42.0.7:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-b9skh"', in 0.04 seconds) (finished: subtest: metrics carry build_info, in 0.22 seconds) subtest: harmonia-gc frees space and the worker stays Ready machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-cfb8578f6-b9skh -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'' machine # [ 483.189393] k3s[879]: E0923 04:49:58.104693 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53294: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-cfb8578f6-b9skh -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'', in 0.20 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-cfb8578f6-b9skh -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done' machine # [ 483.456721] k3s[879]: E0923 04:49:58.372277 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53330: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-cfb8578f6-b9skh -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done', in 0.27 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-cfb8578f6-b9skh -c gc -- sh -c 'fallocate -l 11439198208 /nix/fill' machine # [ 483.671655] k3s[879]: E0923 04:49:58.587253 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53370: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-cfb8578f6-b9skh -c gc -- sh -c 'fallocate -l 11439198208 /nix/fill', in 0.21 seconds) machine: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-cfb8578f6-b9skh -c gc --since=30s | grep -q 'store paths deleted' machine: (finished: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-cfb8578f6-b9skh -c gc --since=30s | grep -q 'store paths deleted', in 10.18 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-cfb8578f6-b9skh -c gc -- sh -c 'rm /nix/fill' machine # [ 494.065774] k3s[879]: E0923 04:50:08.981079 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:49894: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-cfb8578f6-b9skh -c gc -- sh -c 'rm /nix/fill', in 0.22 seconds) machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-cfb8578f6-b9skh -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-cfb8578f6-b9skh -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}', in 0.16 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-cfb8578f6-b9skh -c gc -- sh -c 'command -v nix-daemon && command -v niks3' machine # [ 494.475678] k3s[879]: E0923 04:50:09.391199 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:49936: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-cfb8578f6-b9skh -c gc -- sh -c 'command -v nix-daemon && command -v niks3', in 0.25 seconds) (finished: subtest: harmonia-gc frees space and the worker stays Ready, in 11.49 seconds) subtest: losing the balancer mid-build: the client reconnects and the build succeeds machine: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1 machine # [ 494.501607] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1. machine # Running as unit: vialb.service; invocation ID: b95fe50512234b5ead71e48600e18ac2 machine: (finished: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1, in 0.02 seconds) machine: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'" machine # [ 494.632397] nix[9192]: don't know how to build these paths: machine # [ 494.633458] nix[9192]: /nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 494.665182] nix[9192]: copying 1 paths to '127.0.0.1:30051'... machine # [ 494.666240] nix[9192]: copying path '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' to '127.0.0.1:30051'... machine # [ 494.726922] niks3-server[1187]: 2026/09/23 04:50:09 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 494.741968] niks3-server[1187]: 2026/09/23 04:50:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign machine # [ 494.743105] niks3-server[1187]: 2026/09/23 04:50:09 INFO Signed narinfos id=27 count=1 machine # [ 494.747153] niks3-server[1187]: 2026/09/23 04:50:09 INFO Registered completed upload object_key=nar/0kkr2vb091wkq0cb0f1q92413dsfskh76wydp8mwysv7rawns0ar.nar.zst machine # [ 494.748158] niks3-server[1187]: 2026/09/23 04:50:09 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.ls machine # [ 494.753780] niks3-server[1187]: 2026/09/23 04:50:09 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete machine # [ 494.756056] niks3-server[1187]: 2026/09/23 04:50:09 INFO Completed upload id=27 machine # [ 494.758844] niks3-server[1187]: 2026/09/23 04:50:09 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.narinfo machine # [ 494.767332] nix[9192]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 494.767669] nix[9192]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-b9skh: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine: (finished: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'", in 1.06 seconds) machine: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false machine: (finished: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false, in 0.24 seconds) machine: waiting for success: ! systemctl is-active vialb machine # [ 495.832698] nix[9192]: scheduler at 127.0.0.1:30051: Stream removed (Socket closed), reconnecting machine # [ 495.833149] nix[9192]: d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv: Stream removed (Socket closed), asking the scheduler again machine # [ 495.853108] systemd[1]: cri-containerd-77f0b6dc8251307f2f514f12f4213afe311b501ab48320276c880a62d455e8bf.scope: Deactivated successfully. machine # [ 495.855660] systemd[1]: cri-containerd-77f0b6dc8251307f2f514f12f4213afe311b501ab48320276c880a62d455e8bf.scope: Consumed 4.457s CPU time over 7min 33.184s wall clock time, 51.4M memory peak, 29.6M read from disk, 718.9K incoming IP traffic, 683.9K outgoing IP traffic. machine # [ 495.885179] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-77f0b6dc8251307f2f514f12f4213afe311b501ab48320276c880a62d455e8bf-rootfs.mount: Deactivated successfully. machine # [ 495.917622] systemd[1]: cri-containerd-4e2200649e7b0661c085400c423065a72c1af2e23bbc85319cd2e253ce708ce9.scope: Deactivated successfully. machine # [ 495.947856] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-4e2200649e7b0661c085400c423065a72c1af2e23bbc85319cd2e253ce708ce9-rootfs.mount: Deactivated successfully. machine # [ 495.974532] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-4e2200649e7b0661c085400c423065a72c1af2e23bbc85319cd2e253ce708ce9-shm.mount: Deactivated successfully. machine # [ 496.162896] cni0: port 5(vethce0986e3) entered disabled state machine # [ 496.009894] dhcpcd[673]: vethce0986e3: carrier lost machine # [ 496.165557] vethce0986e3 (unregistering): left allmulticast mode machine # [ 496.166643] vethce0986e3 (unregistering): left promiscuous mode machine # [ 496.167480] cni0: port 5(vethce0986e3) entered disabled state machine # [ 496.030393] systemd[1]: run-netns-cni\x2db6afb8ae\x2d2acb\x2d3a4b\x2de9e1\x2daef8b9f9af63.mount: Deactivated successfully. machine # [ 496.042168] dhcpcd[673]: vethce0986e3: deleting address fe80::c7b:77ff:fe5d:79d machine # [ 496.046335] dhcpcd[673]: vethce0986e3: deleting route to 169.254.0.0/16 machine # [ 496.089154] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod253dc6c7_6936_458b_b110_bcfcb6581746.slice. machine # [ 496.130317] dhcpcd[673]: vethce0986e3: removing interface machine # [ 496.146148] k3s[879]: I0923 04:50:11.061486 879 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/930bd5f4-1745-4ac8-8dfb-87cf4a40facc-tls-ca\" (UniqueName: \"kubernetes.io/secret/930bd5f4-1745-4ac8-8dfb-87cf4a40facc-tls-ca\") pod \"930bd5f4-1745-4ac8-8dfb-87cf4a40facc\" (UID: \"930bd5f4-1745-4ac8-8dfb-87cf4a40facc\") " machine # [ 496.150826] k3s[879]: I0923 04:50:11.061540 879 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/930bd5f4-1745-4ac8-8dfb-87cf4a40facc-tmp\" (UniqueName: \"kubernetes.io/empty-dir/930bd5f4-1745-4ac8-8dfb-87cf4a40facc-tmp\") pod \"930bd5f4-1745-4ac8-8dfb-87cf4a40facc\" (UID: \"930bd5f4-1745-4ac8-8dfb-87cf4a40facc\") " machine # [ 496.155201] k3s[879]: I0923 04:50:11.061586 879 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/930bd5f4-1745-4ac8-8dfb-87cf4a40facc-tls-lb\" (UniqueName: \"kubernetes.io/secret/930bd5f4-1745-4ac8-8dfb-87cf4a40facc-tls-lb\") pod \"930bd5f4-1745-4ac8-8dfb-87cf4a40facc\" (UID: \"930bd5f4-1745-4ac8-8dfb-87cf4a40facc\") " machine # [ 496.160047] k3s[879]: I0923 04:50:11.061621 879 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/930bd5f4-1745-4ac8-8dfb-87cf4a40facc-config\" (UniqueName: \"kubernetes.io/configmap/930bd5f4-1745-4ac8-8dfb-87cf4a40facc-config\") pod \"930bd5f4-1745-4ac8-8dfb-87cf4a40facc\" (UID: \"930bd5f4-1745-4ac8-8dfb-87cf4a40facc\") " machine # [ 496.164720] k3s[879]: I0923 04:50:11.061690 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/253dc6c7-6936-458b-b110-bcfcb6581746-tls-lb\") pod \"nix-grpc-farm-lb-775dbb5c7c-d2bt4\" (UID: \"253dc6c7-6936-458b-b110-bcfcb6581746\") " pod="farm/nix-grpc-farm-lb-775dbb5c7c-d2bt4" machine # [ 496.169211] k3s[879]: I0923 04:50:11.061727 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/253dc6c7-6936-458b-b110-bcfcb6581746-config\") pod \"nix-grpc-farm-lb-775dbb5c7c-d2bt4\" (UID: \"253dc6c7-6936-458b-b110-bcfcb6581746\") " pod="farm/nix-grpc-farm-lb-775dbb5c7c-d2bt4" machine # [ 496.173581] k3s[879]: I0923 04:50:11.061780 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/253dc6c7-6936-458b-b110-bcfcb6581746-tls-ca\") pod \"nix-grpc-farm-lb-775dbb5c7c-d2bt4\" (UID: \"253dc6c7-6936-458b-b110-bcfcb6581746\") " pod="farm/nix-grpc-farm-lb-775dbb5c7c-d2bt4" machine # [ 496.177945] k3s[879]: I0923 04:50:11.061807 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/253dc6c7-6936-458b-b110-bcfcb6581746-tmp\") pod \"nix-grpc-farm-lb-775dbb5c7c-d2bt4\" (UID: \"253dc6c7-6936-458b-b110-bcfcb6581746\") " pod="farm/nix-grpc-farm-lb-775dbb5c7c-d2bt4" machine # [ 496.182539] systemd[1]: var-lib-kubelet-pods-930bd5f4\x2d1745\x2d4ac8\x2d8dfb\x2d87cf4a40facc-volume\x2dsubpaths-config-envoy-0.mount: Deactivated successfully. machine # [ 496.182932] k3s[879]: I0923 04:50:11.072283 879 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/930bd5f4-1745-4ac8-8dfb-87cf4a40facc-tmp" pod "930bd5f4-1745-4ac8-8dfb-87cf4a40facc" (UID: "930bd5f4-1745-4ac8-8dfb-87cf4a40facc"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 496.183567] k3s[879]: I0923 04:50:11.072428 879 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/930bd5f4-1745-4ac8-8dfb-87cf4a40facc-tls-ca" pod "930bd5f4-1745-4ac8-8dfb-87cf4a40facc" (UID: "930bd5f4-1745-4ac8-8dfb-87cf4a40facc"). InnerVolumeSpecName "tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 496.184124] k3s[879]: I0923 04:50:11.076946 879 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/930bd5f4-1745-4ac8-8dfb-87cf4a40facc-tls-lb" pod "930bd5f4-1745-4ac8-8dfb-87cf4a40facc" (UID: "930bd5f4-1745-4ac8-8dfb-87cf4a40facc"). InnerVolumeSpecName "tls-lb". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 496.184295] k3s[879]: I0923 04:50:11.081978 879 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/930bd5f4-1745-4ac8-8dfb-87cf4a40facc-config" pod "930bd5f4-1745-4ac8-8dfb-87cf4a40facc" (UID: "930bd5f4-1745-4ac8-8dfb-87cf4a40facc"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 496.184862] systemd[1]: var-lib-kubelet-pods-930bd5f4\x2d1745\x2d4ac8\x2d8dfb\x2d87cf4a40facc-volumes-kubernetes.io\x7esecret-tls\x2dca.mount: Deactivated successfully. machine # [ 496.244354] k3s[879]: I0923 04:50:11.159957 879 scope.go:122] "RemoveContainer" containerID="77f0b6dc8251307f2f514f12f4213afe311b501ab48320276c880a62d455e8bf" machine # [ 496.246958] k3s[879]: I0923 04:50:11.162637 879 reconciler_common.go:299] "Volume detached for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/930bd5f4-1745-4ac8-8dfb-87cf4a40facc-tls-ca\") on node \"machine\" DevicePath \"\"" machine # [ 496.251251] k3s[879]: I0923 04:50:11.162661 879 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/930bd5f4-1745-4ac8-8dfb-87cf4a40facc-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 496.254745] k3s[879]: I0923 04:50:11.162674 879 reconciler_common.go:299] "Volume detached for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/930bd5f4-1745-4ac8-8dfb-87cf4a40facc-tls-lb\") on node \"machine\" DevicePath \"\"" machine # [ 496.255125] k3s[879]: I0923 04:50:11.162688 879 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/930bd5f4-1745-4ac8-8dfb-87cf4a40facc-config\") on node \"machine\" DevicePath \"\"" machine # [ 496.255776] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod930bd5f4_1745_4ac8_8dfb_87cf4a40facc.slice. machine # [ 496.256664] systemd[1]: kubepods-besteffort-pod930bd5f4_1745_4ac8_8dfb_87cf4a40facc.slice: Consumed 4.487s CPU time over 7min 34.839s wall clock time, 51.7M memory peak, 29.6M read from disk, 718.9K incoming IP traffic, 683.9K outgoing IP traffic. machine # [ 496.265417] k3s[879]: I0923 04:50:11.180990 879 scope.go:122] "RemoveContainer" containerID="77f0b6dc8251307f2f514f12f4213afe311b501ab48320276c880a62d455e8bf" machine # [ 496.267712] k3s[879]: E0923 04:50:11.183211 879 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"77f0b6dc8251307f2f514f12f4213afe311b501ab48320276c880a62d455e8bf\": not found" containerID="77f0b6dc8251307f2f514f12f4213afe311b501ab48320276c880a62d455e8bf" machine # [ 496.268048] k3s[879]: I0923 04:50:11.183271 879 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"77f0b6dc8251307f2f514f12f4213afe311b501ab48320276c880a62d455e8bf"} err="failed to get container status \"77f0b6dc8251307f2f514f12f4213afe311b501ab48320276c880a62d455e8bf\": rpc error: code = NotFound desc = an error occurred when try to find container \"77f0b6dc8251307f2f514f12f4213afe311b501ab48320276c880a62d455e8bf\": not found" machine # [ 496.421684] ([ 496.574806] cni0: port 1(veth1b361ffb) entered blocking state machine # udev-worker)[9391]: Network interface NamePolicy= disabled on ke[ 496.576507] cni0: port 1(veth1b361ffb) entered disabled state machine # rnel command line. machine # [ 496.577927] veth1b361ffb: entered allmulticast mode machine # [ 496.579278] veth1b361ffb: entered promiscuous mode machine # [ 496.587889] cni0: port 1(veth1b361ffb) entered blocking state machine # [ 496.589321] cni0: port 1(veth1b361ffb) entered forwarding state machine # [ 496.451627] dhcpcd[673]: veth1b361ffb: IAID d1:fd:4d:b1 machine # [ 496.452564] dhcpcd[673]: veth1b361ffb: adding address fe80::4a8:d1ff:fefd:4db1 machine # [ 496.519384] systemd[1]: Started libcontainer container aa0bf406d519d5c3dbf8668d1a5e93b95f070f5bb0842fb3100f7623292a262c. machine # [ 496.641380] systemd[1]: Started libcontainer container b1b69aa4c41719f74d77ee098e4a26f4fc28eb4db6956a8124aa2da9fb874888. machine # [ 496.896587] systemd[1]: var-lib-kubelet-pods-930bd5f4\x2d1745\x2d4ac8\x2d8dfb\x2d87cf4a40facc-volume\x2dsubpaths-config-envoy-2.mount: Deactivated successfully. machine # [ 496.897042] systemd[1]: var-lib-kubelet-pods-930bd5f4\x2d1745\x2d4ac8\x2d8dfb\x2d87cf4a40facc-volume\x2dsubpaths-config-envoy-1.mount: Deactivated successfully. machine # [ 496.898223] systemd[1]: var-lib-kubelet-pods-930bd5f4\x2d1745\x2d4ac8\x2d8dfb\x2d87cf4a40facc-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 496.899405] systemd[1]: var-lib-kubelet-pods-930bd5f4\x2d1745\x2d4ac8\x2d8dfb\x2d87cf4a40facc-volumes-kubernetes.io\x7esecret-tls\x2dlb.mount: Deactivated successfully. machine # [ 496.979981] k3s[879]: I0923 04:50:11.895509 879 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="930bd5f4-1745-4ac8-8dfb-87cf4a40facc" path="/var/lib/kubelet/pods/930bd5f4-1745-4ac8-8dfb-87cf4a40facc/volumes" machine # [ 497.214982] dhcpcd[673]: veth1b361ffb: soliciting a DHCP lease machine # [ 497.312589] k3s[879]: I0923 04:50:12.227451 879 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-775dbb5c7c-d2bt4" podStartSLOduration=2.227401331 podStartE2EDuration="2.227401331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-23 04:50:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-23 04:50:12.202731715 +0000 UTC m=+479.964435650" watchObservedRunningTime="2026-09-23 04:50:12.227401331 +0000 UTC m=+479.989035145" machine # [ 498.335646] nix[9192]: scheduler at 127.0.0.1:30051: failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:30051: tcp handshaker shutdown, reconnecting machine # [ 498.601927] dhcpcd[673]: veth1b361ffb: soliciting an IPv6 router machine # [ 499.383730] nix[9192]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 499.384103] nix[9192]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-l44xc: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 502.216093] dhcpcd[673]: veth1b361ffb: probing for an IPv4LL address machine # [ 507.307775] dhcpcd[673]: veth1b361ffb: using IPv4LL address 169.254.87.67 machine # [ 507.310506] dhcpcd[673]: veth1b361ffb: adding route to 169.254.0.0/16 machine # [ 510.606660] dhcpcd[673]: veth1b361ffb: no IPv6 Routers available machine # [ 544.339285] niks3-server[1187]: 2026/09/23 04:50:59 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 544.363810] niks3-server[1187]: 2026/09/23 04:50:59 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.ls machine # [ 544.369699] niks3-server[1187]: 2026/09/23 04:50:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign machine # [ 544.372257] niks3-server[1187]: 2026/09/23 04:50:59 INFO Signed narinfos id=28 count=1 machine # [ 544.373518] niks3-server[1187]: 2026/09/23 04:50:59 INFO Registered completed upload object_key=log/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 544.377497] niks3-server[1187]: 2026/09/23 04:50:59 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete machine # [ 544.380667] niks3-server[1187]: 2026/09/23 04:50:59 INFO Completed upload id=28 machine # [ 544.382263] niks3-server[1187]: 2026/09/23 04:50:59 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.narinfo machine # [ 545.435250] systemd[1]: vialb.service: Deactivated successfully. machine # [ 545.436840] systemd[1]: vialb.service: Consumed 236ms CPU time over 50.933s wall clock time, 38.5M memory peak, 4K written to disk, 8.5K incoming IP traffic, 17.3K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active vialb, in 49.93 seconds) machine: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; }, in 0.03 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 0.27 seconds) (finished: subtest: losing the balancer mid-build: the client reconnects and the build succeeds, in 51.56 seconds) subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes machine: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 machine # [ 546.081793] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1. machine # Running as unit: slow.service; invocation ID: a60c5830332e4e9082070df1bbfc2f34 machine: (finished: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1, in 0.04 seconds) machine # [ 546.226440] nix[10213]: don't know how to build these paths: machine # [ 546.229602] nix[10213]: /nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 546.249310] nix[10213]: copying 1 paths to '127.0.0.1:30051'... machine # [ 546.251938] nix[10213]: copying path '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' to '127.0.0.1:30051'... machine # [ 546.295539] niks3-server[1187]: 2026/09/23 04:51:01 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 546.300857] k3s[879]: E0923 04:51:01.216236 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40860: use of closed network connection machine # command terminated with exit code 1 machine # [ 546.311320] niks3-server[1187]: 2026/09/23 04:51:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign machine # [ 546.312259] niks3-server[1187]: 2026/09/23 04:51:01 INFO Signed narinfos id=29 count=1 machine # [ 546.315606] niks3-server[1187]: 2026/09/23 04:51:01 INFO Registered completed upload object_key=nar/0wl2i9xpw0gwrx1xqdgx9ka4n503ky9qhl20pdrdlphn8d6lcx0i.nar.zst machine # [ 546.318550] niks3-server[1187]: 2026/09/23 04:51:01 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete machine # [ 546.319334] niks3-server[1187]: 2026/09/23 04:51:01 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.ls machine # [ 546.320860] niks3-server[1187]: 2026/09/23 04:51:01 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.narinfo machine # [ 546.326233] niks3-server[1187]: 2026/09/23 04:51:01 INFO Completed upload id=29 machine # [ 546.333877] nix[10213]: building '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' on 127.0.0.1:30051... machine # [ 546.334214] nix[10213]: slow-s1> machine/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-b9skh: building zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 546.503020] k3s[879]: E0923 04:51:01.418513 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40888: use of closed network connection machine # command terminated with exit code 1 machine # [ 547.774791] k3s[879]: E0923 04:51:02.689829 879 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:60302->127.0.0.1:10010: write tcp 127.0.0.1:60302->127.0.0.1:10010: write: broken pipe machine # command terminated with exit code 1 machine # [ 547.775575] k3s[879]: E0923 04:51:02.690169 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40912: use of closed network connection machine # [ 547.985938] k3s[879]: E0923 04:51:02.901567 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40930: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 549.285431] k3s[879]: E0923 04:51:04.200635 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40960: use of closed network connection machine # [ 549.484832] k3s[879]: E0923 04:51:04.400412 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41006: use of closed network connection machine # command terminated with exit code 1 machine # [ 550.749132] k3s[879]: E0923 04:51:05.664409 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41042: use of closed network connection machine # command terminated with exit code 1 machine # [ 550.937486] k3s[879]: E0923 04:51:05.853080 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41072: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 552.210496] k3s[879]: E0923 04:51:07.124808 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41098: use of closed network connection machine # [ 552.416665] k3s[879]: E0923 04:51:07.332277 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41120: use of closed network connection machine # command terminated with exit code 1 machine # [ 553.723530] k3s[879]: E0923 04:51:08.638836 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45122: use of closed network connection machine # command terminated with exit code 1 machine # [ 553.932294] k3s[879]: E0923 04:51:08.847890 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45160: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 555.203602] k3s[879]: time="2026-09-23T04:51:10Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:59290->127.0.0.1:10250: write: broken pipe" machine # [ 555.204418] k3s[879]: E0923 04:51:10.118503 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45198: use of closed network connection machine # [ 555.408231] k3s[879]: time="2026-09-23T04:51:10Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:59304->127.0.0.1:10250: write: broken pipe" machine # command terminated with exit code 1 machine # [ 555.408450] k3s[879]: E0923 04:51:10.323344 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45236: use of closed network connection machine # command terminated with exit code 1 machine # [ 556.702116] k3s[879]: E0923 04:51:11.617237 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45258: use of closed network connection machine # [ 556.910501] k3s[879]: E0923 04:51:11.826028 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45282: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 558.205779] k3s[879]: E0923 04:51:13.120850 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45294: use of closed network connection machine # [ 558.428835] k3s[879]: E0923 04:51:13.344463 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45330: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 559.737571] k3s[879]: E0923 04:51:14.651866 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45354: use of closed network connection machine # [ 559.949383] k3s[879]: E0923 04:51:14.864998 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45378: use of closed network connection machine # command terminated with exit code 1 machine # [ 561.239657] k3s[879]: E0923 04:51:16.154863 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45418: use of closed network connection machine # command terminated with exit code 1 machine # [ 561.453480] k3s[879]: time="2026-09-23T04:51:16Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:59378->127.0.0.1:10250: write: broken pipe" machine # [ 561.454081] k3s[879]: E0923 04:51:16.369096 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45434: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 562.748682] k3s[879]: E0923 04:51:17.663430 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45452: use of closed network connection machine # [ 562.990297] k3s[879]: E0923 04:51:17.905821 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59364: use of closed network connection machine # command terminated with exit code 1 machine # [ 564.301428] k3s[879]: E0923 04:51:19.216678 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59390: use of closed network connection machine # command terminated with exit code 1 machine # [ 564.508492] k3s[879]: E0923 04:51:19.424096 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59410: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 565.847117] k3s[879]: E0923 04:51:20.761769 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59430: use of closed network connection machine # [ 566.065564] k3s[879]: E0923 04:51:20.981128 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59446: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 567.357253] k3s[879]: E0923 04:51:22.272538 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59484: use of closed network connection machine # [ 567.566392] k3s[879]: E0923 04:51:22.482006 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59512: use of closed network connection machine # command terminated with exit code 1 machine # [ 568.880739] k3s[879]: E0923 04:51:23.795955 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59536: use of closed network connection machine # [ 568.881262] k3s[879]: E0923 04:51:23.796055 879 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:60056->127.0.0.1:10010: write tcp 127.0.0.1:60056->127.0.0.1:10010: write: broken pipe machine # command terminated with exit code 1 machine # [ 569.114833] k3s[879]: E0923 04:51:24.030418 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59566: use of closed network connection machine # command terminated with exit code 1 machine # [ 570.446059] k3s[879]: E0923 04:51:25.361390 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59596: use of closed network connection machine # command terminated with exit code 1 machine # [ 570.644095] k3s[879]: time="2026-09-23T04:51:25Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:47194->127.0.0.1:10250: write: broken pipe" machine # command terminated with exit code 1 machine # [ 570.644613] k3s[879]: E0923 04:51:25.560281 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59626: use of closed network connection machine # [ 571.916138] k3s[879]: E0923 04:51:26.831430 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59658: use of closed network connection machine # [ 572.121211] k3s[879]: E0923 04:51:27.036843 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59688: use of closed network connection machine: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-cfb8578f6-b9skh --wait=false machine: (finished: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-cfb8578f6-b9skh --wait=false, in 0.17 seconds) machine: must succeed: sleep 5.0 machine # [ 572.326346] systemd[1]: cri-containerd-da1a8cf78f8df356644b9818d88f24354e326edd63b05265df74f8d557115447.scope: Deactivated successfully. machine # [ 572.326597] systemd[1]: cri-containerd-da1a8cf78f8df356644b9818d88f24354e326edd63b05265df74f8d557115447.scope: Consumed 574ms CPU time over 8min 39.458s wall clock time, 13.4M memory peak, 5.3M read from disk. machine # [ 572.372309] k3s[879]: I0923 04:51:27.287802 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/753db43c-89e5-4e2b-b31d-5e8e4cf77ec9-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-n6p4z\" (UID: \"753db43c-89e5-4e2b-b31d-5e8e4cf77ec9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-n6p4z" machine # [ 572.377100] k3s[879]: I0923 04:51:27.287850 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/753db43c-89e5-4e2b-b31d-5e8e4cf77ec9-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-n6p4z\" (UID: \"753db43c-89e5-4e2b-b31d-5e8e4cf77ec9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-n6p4z" machine # [ 572.377584] k3s[879]: I0923 04:51:27.287879 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/753db43c-89e5-4e2b-b31d-5e8e4cf77ec9-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-n6p4z\" (UID: \"753db43c-89e5-4e2b-b31d-5e8e4cf77ec9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-n6p4z" machine # [ 572.378106] k3s[879]: I0923 04:51:27.287905 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/753db43c-89e5-4e2b-b31d-5e8e4cf77ec9-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-n6p4z\" (UID: \"753db43c-89e5-4e2b-b31d-5e8e4cf77ec9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-n6p4z" machine # [ 572.378643] k3s[879]: I0923 04:51:27.287948 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6xj8\" (UniqueName: \"kubernetes.io/projected/753db43c-89e5-4e2b-b31d-5e8e4cf77ec9-kube-api-access-p6xj8\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-n6p4z\" (UID: \"753db43c-89e5-4e2b-b31d-5e8e4cf77ec9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-n6p4z" machine # [ 572.380168] k3s[879]: I0923 04:51:27.287979 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/753db43c-89e5-4e2b-b31d-5e8e4cf77ec9-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-n6p4z\" (UID: \"753db43c-89e5-4e2b-b31d-5e8e4cf77ec9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-n6p4z" machine # [ 572.380929] k3s[879]: I0923 04:51:27.288006 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/753db43c-89e5-4e2b-b31d-5e8e4cf77ec9-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-n6p4z\" (UID: \"753db43c-89e5-4e2b-b31d-5e8e4cf77ec9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-n6p4z" machine # [ 572.381619] k3s[879]: I0923 04:51:27.288034 879 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/753db43c-89e5-4e2b-b31d-5e8e4cf77ec9-build\") pod \"nix-grpc-farm-worker-x86-64-linux-cfb8578f6-n6p4z\" (UID: \"753db43c-89e5-4e2b-b31d-5e8e4cf77ec9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-n6p4z" machine # [ 572.389493] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod753db43c_89e5_4e2b_b31d_5e8e4cf77ec9.slice. machine # [ 572.421472] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-da1a8cf78f8df356644b9818d88f24354e326edd63b05265df74f8d557115447-rootfs.mount: Deactivated successfully. machine # [ 572.917767] cni0: port 5(veth2d45d2f8) entered blocking state machine # [ 572.919215] cni0: port 5(veth2d45d2f8) entered disabled state machine # [ 572.920072] veth2d45d2f8: entered allmulticast mode machine # [ 572.921623] veth2d45d2f8: entered promiscuous mode machine # [ 572.941782] cni0: port 5(veth2d45d2f8) entered blocking state machine # [ 572.942978] cni0: port 5(veth2d45d2f8) entered forwarding state machine # [ 572.826566] (udev-worker)[11811]: Network interface NamePolicy= disabled on kernel command line. machine # [ 572.855751] dhcpcd[673]: veth2d45d2f8: IAID 2d:02:3f:b9 machine # [ 572.856707] dhcpcd[673]: veth2d45d2f8: adding address fe80::80ff:2dff:fe02:3fb9 machine # [ 572.894330] systemd[1]: Started libcontainer container 9a2c8f442f9e473af7db0d0848e7df25c9d4088b5adbad85492818ce98a545fc. machine # [ 573.203687] systemd[1]: Started libcontainer container a762ac07ee91dab20d7dfe72a37e83b7c4fb61b284d6b4dabe32cbc161ea0d12. machine # [ 574.377601] dhcpcd[673]: veth2d45d2f8: soliciting an IPv6 router machine # [ 574.836979] dhcpcd[673]: veth2d45d2f8: soliciting a DHCP lease machine # [ 576.217667] systemd[1]: cri-containerd-a762ac07ee91dab20d7dfe72a37e83b7c4fb61b284d6b4dabe32cbc161ea0d12.scope: Deactivated successfully. machine # [ 576.223698] systemd[1]: cri-containerd-a762ac07ee91dab20d7dfe72a37e83b7c4fb61b284d6b4dabe32cbc161ea0d12.scope: Consumed 1.305s CPU time over 3.013s wall clock time, 478.3M memory peak, 194.4M read from disk, 139.1M written to disk. machine # [ 576.276837] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-a762ac07ee91dab20d7dfe72a37e83b7c4fb61b284d6b4dabe32cbc161ea0d12-rootfs.mount: Deactivated successfully. machine # [ 576.724644] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped1840935980.mount: Deactivated successfully. machine # [ 576.927619] systemd[1]: Started libcontainer container 2e35f6a28accae0b22d986798df9d549a6d21e1193f01bab3fba247c4fd51898. machine # [ 577.146569] systemd[1]: Started libcontainer container 8076e3334480aa931f3958fe7ddce82f16ca7e8b54dbc052f70192696134a558. machine # [ 577.280215] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped377826385.mount: Deactivated successfully. machine # [ 577.296260] systemd[1]: Started libcontainer container db4d364b331d7822b2a3bae30bb91c650ad91008a659f41d52206a366379fb25. machine: (finished: must succeed: sleep 5.0, in 5.04 seconds) machine # [ 577.525839] k3s[879]: E0923 04:51:32.440990 879 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39134: use of closed network connection machine: waiting for success: ! systemctl is-active slow machine # [ 577.705653] k3s[879]: I0923 04:51:32.621148 879 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-cfb8578f6-n6p4z" podStartSLOduration=2.653964475 podStartE2EDuration="5.621102477s" totalImagesPullingTime="0s" totalInitContainerRuntime="2.967138002s" isStatefulPod=false podCreationTimestamp="2026-09-23 04:51:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-23 04:51:32.616180063 +0000 UTC m=+560.377814715" watchObservedRunningTime="2026-09-23 04:51:32.621102477 +0000 UTC m=+560.382734894" machine # [ 579.838244] dhcpcd[673]: veth2d45d2f8: probing for an IPv4LL address machine # [ 584.902916] dhcpcd[673]: veth2d45d2f8: using IPv4LL address 169.254.216.249 machine # [ 584.903418] dhcpcd[673]: veth2d45d2f8: adding route to 169.254.0.0/16 machine # [ 586.384174] dhcpcd[673]: veth2d45d2f8: no IPv6 Routers available machine # [ 590.704627] niks3-server[1187]: 2026/09/23 04:51:45 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 590.720968] niks3-server[1187]: 2026/09/23 04:51:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign machine # [ 590.725827] niks3-server[1187]: 2026/09/23 04:51:45 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.ls machine # [ 590.730564] niks3-server[1187]: 2026/09/23 04:51:45 INFO Signed narinfos id=30 count=1 machine # [ 590.733596] niks3-server[1187]: 2026/09/23 04:51:45 INFO Registered completed upload object_key=log/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 590.738328] niks3-server[1187]: 2026/09/23 04:51:45 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete machine # [ 590.747780] niks3-server[1187]: 2026/09/23 04:51:45 INFO Completed upload id=30 machine # [ 590.750134] niks3-server[1187]: 2026/09/23 04:51:45 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo machine # [ 590.779203] systemd[1]: slow.service: Deactivated successfully. machine # [ 590.779495] systemd[1]: slow.service: Consumed 182ms CPU time over 44.698s wall clock time, 38.3M memory peak, 4K written to disk, 5.4K incoming IP traffic, 11.7K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active slow, in 13.57 seconds) machine: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; } machine # [ 591.102442] systemd[1]: cri-containerd-5f81feafeb117f84f581da004b132c5957fcc0da5fda233e7986ad78d4f6da38.scope: Deactivated successfully. machine # [ 591.104642] systemd[1]: cri-containerd-5f81feafeb117f84f581da004b132c5957fcc0da5fda233e7986ad78d4f6da38.scope: Consumed 3.498s CPU time over 8min 58.473s wall clock time, 71M memory peak, 35.5M read from disk, 276.1K incoming IP traffic, 352K outgoing IP traffic. machine: (finished: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; }, in 0.04 seconds) machine: must fail: journalctl -u slow | grep -q 'asking the scheduler again' machine: (finished: must fail: journalctl -u slow | grep -q 'asking the scheduler again', in 0.02 seconds) machine: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath machine # [ 591.167942] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-5f81feafeb117f84f581da004b132c5957fcc0da5fda233e7986ad78d4f6da38-rootfs.mount: Deactivated successfully. machine: (finished: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath, in 0.12 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null, in 0.03 seconds) (finished: subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes, in 45.28 seconds) (finished: run the VM test script, in 592.27 seconds) test script finished in 592.31s cleanup kill QemuMachine (pid 45) machine # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) machine # [2026-09-23T04:51:46Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-09-23T04:51:46Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-09-23T04:51:46Z INFO virtiofsd] Client disconnected, shutting down (finished: cleanup, in 1.38 seconds) additionally exposed symbols: machine, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh