tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 1200.0 seconds run the VM test script machine: waiting for unit k3s.service machine: waiting for the VM to finish booting machine: starting vm machine # Disk image does not exist, creating the virtualisation disk image... machine: QEMU running (pid 45) machine # Formatting '/build/vm-state-machine/tmp.T9om84obFb', fmt=raw size=17179869184 machine # mke2fs 1.47.4 (6-Mar-2025) machine # Discarding device blocks: 0/4194304 done machine # Creating filesystem with 4194304 4k blocks and 1048576 inodes machine # Filesystem UUID: 5868db89-81e2-4374-95a4-0070043a261b machine # Superblock backups stored on blocks: machine # 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208, machine # 4096000 machine # machine # Allocating group tables: 0/128 done machine # Writing inode tables: 0/128 done machine # Creating journal (32768 blocks): done machine # Writing superblocks and filesystem accounting information: 0/128 done machine # machine # Virtualisation disk image created. machine # Starting virtiofs daemons... machine # [2026-10-05T11:55:29Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-10-05T11:55:29Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-10-05T11:55:29Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-10-05T11:55:29Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-10-05T11:55:29Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-10-05T11:55:29Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-10-05T11:55:29Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-10-05T11:55:29Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-10-05T11:55:29Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-10-05T11:55:29Z INFO virtiofsd] Client connected, servicing requests machine # [2026-10-05T11:55:29Z INFO virtiofsd] Client connected, servicing requests machine # [2026-10-05T11:55:29Z INFO virtiofsd] Client connected, servicing requests machine # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) machine # machine # machine # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+7EFCC730+7EF2C730 CA00 machine # Press Ctrl-B to configure iPXE (PCI 00:02.0)... machine # machine # machine # machine # machine # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 7EFCC730 7EF2C730 CB00 machine # Press Ctrl-B to configure iPXE (PCI 00:05.0)... machine # machine # machine # Booting from ROM... machine # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.53 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 21 13:06:06 UTC 2026 machine # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/vxh5dascm76zlqyzr9zd14lxfhwgw0cd-nixos-system-machine-test/init regInfo=/nix/.ro-store/kvyrng8vxc7ka90ffrgljblic7kmwzbz-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.000000] BIOS-provided physical RAM map: machine # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007ffd7fff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000007ffd8000-0x000000007fffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000017fffffff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved machine # [ 0.000000] NX (Execute Disable) protection: active machine # [ 0.000000] APIC: Static calls initialized machine # [ 0.000000] SMBIOS 2.8 present. machine # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 machine # [ 0.000000] DMI: Memory slots populated: 1/1 machine # [ 0.000000] Hypervisor detected: KVM machine # [ 0.000000] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 machine # [ 0.000000] kvm-clock: using sched offset of 481768402 cycles machine # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns machine # [ 0.000005] tsc: Detected 2400.012 MHz processor machine # [ 0.000804] last_pfn = 0x180000 max_arch_pfn = 0x10000000000 machine # [ 0.000830] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs machine # [ 0.000833] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT machine # [ 0.000871] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.002745] found SMP MP-table at [mem 0x000f5450-0x000f545f] machine # [ 0.002756] Using GB pages for direct mapping machine # [ 0.002824] RAMDISK: [mem 0x7e364000-0x7ffcffff] machine # [ 0.002831] ACPI: Early table checksum verification disabled machine # [ 0.002834] ACPI: RSDP 0x00000000000F5250 000014 (v00 BOCHS ) machine # [ 0.002837] ACPI: RSDT 0x000000007FFE2539 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002841] ACPI: FACP 0x000000007FFE2319 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002847] ACPI: DSDT 0x000000007FFE0040 0022D9 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002849] ACPI: FACS 0x000000007FFE0000 000040 machine # [ 0.002850] ACPI: APIC 0x000000007FFE240D 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002852] ACPI: HPET 0x000000007FFE249D 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002854] ACPI: MCFG 0x000000007FFE24D5 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002855] ACPI: WAET 0x000000007FFE2511 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002856] ACPI: Reserving FACP table memory at [mem 0x7ffe2319-0x7ffe240c] machine # [ 0.002857] ACPI: Reserving DSDT table memory at [mem 0x7ffe0040-0x7ffe2318] machine # [ 0.002858] ACPI: Reserving FACS table memory at [mem 0x7ffe0000-0x7ffe003f] machine # [ 0.002858] ACPI: Reserving APIC table memory at [mem 0x7ffe240d-0x7ffe249c] machine # [ 0.002859] ACPI: Reserving HPET table memory at [mem 0x7ffe249d-0x7ffe24d4] machine # [ 0.002859] ACPI: Reserving MCFG table memory at [mem 0x7ffe24d5-0x7ffe2510] machine # [ 0.002860] ACPI: Reserving WAET table memory at [mem 0x7ffe2511-0x7ffe2538] machine # [ 0.003094] No NUMA configuration found machine # [ 0.003094] Faking a node at [mem 0x0000000000000000-0x000000017fffffff] machine # [ 0.003097] NODE_DATA(0) allocated [mem 0x17fff8780-0x17fffdcff] machine # [ 0.005299] Zone ranges: machine # [ 0.005299] DMA [mem 0x0000000000001000-0x0000000000ffffff] machine # [ 0.005301] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] machine # [ 0.005302] Normal [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005303] Device empty machine # [ 0.005303] Movable zone start for each node machine # [ 0.005304] Early memory node ranges machine # [ 0.005304] node 0: [mem 0x0000000000001000-0x000000000009efff] machine # [ 0.005305] node 0: [mem 0x0000000000100000-0x000000007ffd7fff] machine # [ 0.005306] node 0: [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005307] Initmem setup node 0 [mem 0x0000000000001000-0x000000017fffffff] machine # [ 0.005326] On node 0, zone DMA: 1 pages in unavailable ranges machine # [ 0.005585] On node 0, zone DMA: 97 pages in unavailable ranges machine # [ 0.074672] On node 0, zone Normal: 40 pages in unavailable ranges machine # [ 0.075142] ACPI: PM-Timer IO Port: 0x608 machine # [ 0.075156] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) machine # [ 0.075185] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 machine # [ 0.075188] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) machine # [ 0.075190] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) machine # [ 0.075191] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) machine # [ 0.075192] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) machine # [ 0.075193] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) machine # [ 0.075196] ACPI: Using ACPI (MADT) for SMP configuration information machine # [ 0.075197] ACPI: HPET id: 0x8086a201 base: 0xfed00000 machine # [ 0.075201] TSC deadline timer available machine # [ 0.075206] CPU topo: Max. logical packages: 1 machine # [ 0.075206] CPU topo: Max. logical dies: 1 machine # [ 0.075207] CPU topo: Max. dies per package: 1 machine # [ 0.075210] CPU topo: Max. threads per core: 1 machine # [ 0.075211] CPU topo: Num. cores per package: 4 machine # [ 0.075211] CPU topo: Num. threads per package: 4 machine # [ 0.075212] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs machine # [ 0.075234] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() machine # [ 0.075250] kvm-guest: KVM setup pv remote TLB flush machine # [ 0.075252] kvm-guest: setup PV sched yield machine # [ 0.075261] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] machine # [ 0.075263] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] machine # [ 0.075264] PM: hibernation: Registered nosave memory: [mem 0x7ffd8000-0xffffffff] machine # [ 0.075265] [mem 0xc0000000-0xfed1bfff] available for PCI devices machine # [ 0.075267] Booting paravirtualized kernel on KVM machine # [ 0.075270] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns machine # [ 0.079732] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 machine # [ 0.081850] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288 machine # [ 0.081899] kvm-guest: PV spinlocks enabled machine # [ 0.081901] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) machine # [ 0.081904] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/vxh5dascm76zlqyzr9zd14lxfhwgw0cd-nixos-system-machine-test/init regInfo=/nix/.ro-store/kvyrng8vxc7ka90ffrgljblic7kmwzbz-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.082004] Unknown kernel command line parameters "regInfo=/nix/.ro-store/kvyrng8vxc7ka90ffrgljblic7kmwzbz-closure-info/registration", will be passed to user space. machine # [ 0.082017] random: crng init done machine # [ 0.082018] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes machine # [ 0.086370] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) machine # [ 0.088447] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) machine # [ 0.088517] software IO TLB: area num 4. machine # [ 0.159171] Fallback order for Node 0: 0 machine # [ 0.159178] Built 1 zonelists, mobility grouping on. Total pages: 1048438 machine # [ 0.159180] Policy zone: Normal machine # [ 0.161786] mem auto-init: stack:all(zero), heap alloc:on, heap free:off machine # [ 0.168332] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 machine # [ 0.177115] allocated 8388608 bytes of page_ext machine # [ 0.186833] ftrace: allocating 48798 entries in 192 pages machine # [ 0.186836] ftrace: allocated 192 pages with 2 groups machine # [ 0.187658] Dynamic Preempt: lazy machine # [ 0.187849] rcu: Preemptible hierarchical RCU implementation. machine # [ 0.187850] rcu: RCU event tracing is enabled. machine # [ 0.187850] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. machine # [ 0.187851] Trampoline variant of Tasks RCU enabled. machine # [ 0.187852] Rude variant of Tasks RCU enabled. machine # [ 0.187852] Tracing variant of Tasks RCU enabled. machine # [ 0.187853] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. machine # [ 0.187853] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 machine # [ 0.187878] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.187879] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.187881] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.192230] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16 machine # [ 0.192504] rcu: srcu_init: Setting srcu_struct sizes based on contention. machine # [ 0.192512] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns machine # [ 0.192623] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) machine # [ 0.196163] Console: colour VGA+ 80x25 machine # [ 0.196166] printk: legacy console [tty0] enabled machine # [ 0.227624] printk: legacy console [ttyS0] enabled machine # [ 0.339819] ACPI: Core revision 20250807 machine # [ 0.340761] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns machine # [ 0.342367] APIC: Switch to symmetric I/O mode setup machine # [ 0.343381] x2apic enabled machine # [ 0.344131] APIC: Switched APIC routing to: physical x2apic machine # [ 0.345083] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask() machine # [ 0.346312] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself() machine # [ 0.347843] kvm-guest: setup PV IPIs machine # [ 0.349397] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 machine # [ 0.350436] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.354727] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) machine # [ 0.355809] x86/cpu: User Mode Instruction Prevention (UMIP) activated machine # [ 0.357841] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 machine # [ 0.358724] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 machine # [ 0.359728] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto machine # [ 0.360724] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl machine # [ 0.362724] Transient Scheduler Attacks: Vulnerable: No microcode machine # [ 0.363724] Spectre V2 : Mitigation: Enhanced / Automatic IBRS machine # [ 0.364724] Speculative Return Stack Overflow: Mitigation: Safe RET machine # [ 0.365724] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization machine # [ 0.366730] Spectre V2 : Enabling IBPB for BPF machine # [ 0.367503] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier machine # [ 0.368724] active return thunk: srso_alias_return_thunk machine # [ 0.369744] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' machine # [ 0.370724] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' machine # [ 0.371724] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' machine # [ 0.372724] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' machine # [ 0.373724] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' machine # [ 0.374724] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' machine # [ 0.376594] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' machine # [ 0.377724] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 machine # [ 0.378724] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 machine # [ 0.379724] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 machine # [ 0.380724] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 machine # [ 0.381724] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 machine # [ 0.382724] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. machine # [ 0.412086] Freeing SMP alternatives memory: 44K machine # [ 0.412727] pid_max: default: 32768 minimum: 301 machine # [ 0.413810] LSM: initializing lsm=capability,landlock,yama,bpf,ima machine # [ 0.414823] landlock: Up and running. machine # [ 0.415473] Yama: becoming mindful. machine # [ 0.416394] LSM support for eBPF active machine # [ 0.416870] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.417799] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.421157] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) machine # [ 0.422295] Performance Events: Fam17h+ core perfctr, AMD PMU driver. machine # [ 0.422732] ... version: 2 machine # [ 0.423494] ... bit width: 48 machine # [ 0.423726] ... generic counters: 6 machine # [ 0.424466] ... generic bitmap: 000000000000003f machine # [ 0.424726] ... fixed-purpose counters: 0 machine # [ 0.425463] ... fixed-purpose bitmap: 0000000000000000 machine # [ 0.425726] ... value mask: 0000ffffffffffff machine # [ 0.426671] ... max period: 00007fffffffffff machine # [ 0.427466] ... global_ctrl mask: 000000000000003f machine # [ 0.427829] signal: max sigframe size: 3376 machine # [ 0.428645] rcu: Hierarchical SRCU implementation. machine # [ 0.429363] rcu: Max phase no-delay instances is 400. machine # [ 0.429944] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level machine # [ 0.435283] smp: Bringing up secondary CPUs ... machine # [ 0.436116] smpboot: x86: Booting SMP configuration: machine # [ 0.436729] .... node #0, CPUs: #1 #2 #3 machine # [ 0.439857] smp: Brought up 1 node, 4 CPUs machine # [ 0.441427] smpboot: Total of 4 processors activated (19200.09 BogoMIPS) machine # [ 0.442058] Memory: 3957836K/4193752K available (17259K kernel code, 2728K rwdata, 13652K rodata, 3656K init, 2968K bss, 220908K reserved, 0K cma-reserved) machine # [ 0.443727] devtmpfs: initialized machine # [ 0.444878] x86/mm: Memory block size: 128MB machine # [ 0.447784] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.448800] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). machine # [ 0.449825] pinctrl core: initialized pinctrl subsystem machine # [ 0.451082] PM: RTC time: 11:55:29, date: 2026-10-05 machine # [ 0.454773] NET: Registered PF_NETLINK/PF_ROUTE protocol family machine # [ 0.456523] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations machine # [ 0.457675] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations machine # [ 0.459265] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations machine # [ 0.459737] audit: initializing netlink subsys (disabled) machine # [ 0.460780] audit: type=2000 audit(1791201330.245:1): state=initialized audit_enabled=0 res=1 machine # [ 0.461038] thermal_sys: Registered thermal governor 'fair_share' machine # [ 0.462727] thermal_sys: Registered thermal governor 'bang_bang' machine # [ 0.463727] thermal_sys: Registered thermal governor 'step_wise' machine # [ 0.464727] thermal_sys: Registered thermal governor 'user_space' machine # [ 0.465726] thermal_sys: Registered thermal governor 'power_allocator' machine # [ 0.466743] cpuidle: using governor menu machine # [ 0.468925] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 machine # [ 0.469960] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] machine # [ 0.470729] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry machine # [ 0.471741] PCI: Using configuration type 1 for base access machine # [ 0.472823] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. machine # [ 0.476121] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages machine # [ 0.476728] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page machine # [ 0.477728] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages machine # [ 0.478727] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page machine # [ 0.483497] ACPI: Added _OSI(Module Device) machine # [ 0.485732] ACPI: Added _OSI(Processor Device) machine # [ 0.487735] ACPI: Added _OSI(Processor Aggregator Device) machine # [ 0.496270] ACPI: 1 ACPI AML tables successfully acquired and loaded machine # [ 0.503927] ACPI: Interpreter enabled machine # [ 0.504622] ACPI: PM: (supports S0 S3 S4 S5) machine # [ 0.505281] ACPI: Using IOAPIC for interrupt routing machine # [ 0.506109] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug machine # [ 0.509735] PCI: Using E820 reservations for host bridge windows machine # [ 0.512375] ACPI: Enabled 2 GPEs in block 00 to 3F machine # [ 0.525722] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) machine # [ 0.527743] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] machine # [ 0.532095] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] machine # [ 0.535047] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] machine # [ 0.538887] PCI host bridge to bus 0000:00 machine # [ 0.540740] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] machine # [ 0.543730] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] machine # [ 0.545731] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] machine # [ 0.547731] pci_bus 0000:00: root bus resource [mem 0x80000000-0xafffffff window] machine # [ 0.550730] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] machine # [ 0.552730] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.555731] pci_bus 0000:00: root bus resource [bus 00-ff] machine # [ 0.557131] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint machine # [ 0.560229] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint machine # [ 0.572787] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] machine # [ 0.574739] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] machine # [ 0.575748] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] machine # [ 0.576892] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] machine # [ 0.580768] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.592751] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] machine # [ 0.594749] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] machine # [ 0.597788] pci 0000:00:02.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref] machine # [ 0.600748] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] machine # [ 0.604150] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.613751] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] machine # [ 0.616747] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] machine # [ 0.618785] pci 0000:00:03.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref] machine # [ 0.623097] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint machine # [ 0.631746] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] machine # [ 0.633779] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] machine # [ 0.634749] pci 0000:00:04.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref] machine # [ 0.637537] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.641740] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] machine # [ 0.642734] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] machine # [ 0.643742] pci 0000:00:05.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref] machine # [ 0.644760] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] machine # [ 0.647457] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint machine # [ 0.650750] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] machine # [ 0.651748] pci 0000:00:06.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref] machine # [ 0.654283] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.656750] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] machine # [ 0.657748] pci 0000:00:07.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref] machine # [ 0.659271] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.663741] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] machine # [ 0.675586] pci 0000:00:08.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref] machine # [ 0.677333] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.679770] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] machine # [ 0.681749] pci 0000:00:09.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref] machine # [ 0.683303] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint machine # [ 0.686781] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] machine # [ 0.687676] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] machine # [ 0.688552] pci 0000:00:0a.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref] machine # [ 0.690271] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.694765] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] machine # [ 0.695680] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] machine # [ 0.697552] pci 0000:00:0b.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref] machine # [ 0.699361] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.701485] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] machine # [ 0.701934] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.705100] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] machine # [ 0.706933] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.708384] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] machine # [ 0.710400] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint machine # [ 0.712763] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] machine # [ 0.716868] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint machine # [ 0.720482] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO machine # [ 0.724345] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint machine # [ 0.734821] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] machine # [ 0.737813] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] machine # [ 0.740655] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint machine # [ 0.746786] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] machine # [ 0.756999] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 machine # [ 0.760016] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 machine # [ 0.761932] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 machine # [ 0.763957] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 machine # [ 0.766926] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 machine # [ 0.768926] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 machine # [ 0.770929] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 machine # [ 0.772947] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 machine # [ 0.774798] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 machine # [ 0.776756] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 machine # [ 0.778901] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 machine # [ 0.781786] ACPI: PCI: Interrupt link GSID configured for IRQ 19 machine # [ 0.783771] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 machine # [ 0.786765] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 machine # [ 0.788763] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 machine # [ 0.791771] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 machine # [ 0.797775] iommu: Default domain type: Translated machine # [ 0.799733] iommu: DMA domain TLB invalidation policy: lazy mode machine # [ 0.803224] ACPI: bus type USB registered machine # [ 0.804923] usbcore: registered new interface driver usbfs machine # [ 0.807762] usbcore: registered new interface driver hub machine # [ 0.809790] usbcore: registered new device driver usb machine # [ 0.814510] NetLabel: Initializing machine # [ 0.815732] NetLabel: domain hash size = 128 machine # [ 0.817731] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO machine # [ 0.820871] NetLabel: unlabeled traffic allowed by default machine # [ 0.821744] PCI: Using ACPI for IRQ routing machine # [ 0.866037] pci 0000:00:01.0: vgaarb: setting as boot VGA device machine # [ 0.866723] pci 0000:00:01.0: vgaarb: bridge control possible machine # [ 0.866723] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none machine # [ 0.868731] vgaarb: loaded machine # [ 0.869587] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 machine # [ 0.871413] hpet0: 3 comparators, 64-bit 100.000000 MHz counter machine # [ 0.876726] clocksource: Switched to clocksource kvm-clock machine # [ 0.878547] VFS: Disk quotas dquot_6.6.0 machine # [ 0.879329] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) machine # [ 0.880938] pnp: PnP ACPI init machine # [ 0.881807] ACPI: IRQ 4 override to edge(!), high(!) machine # [ 0.882788] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved machine # [ 0.884443] pnp: PnP ACPI: found 5 devices machine # [ 0.894267] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns machine # [ 0.895927] clocksource: Switched to clocksource acpi_pm machine # [ 0.896981] NET: Registered PF_INET protocol family machine # [ 0.898534] IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear) machine # [ 0.915951] tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.917519] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) machine # [ 0.918951] TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear) machine # [ 0.920432] TCP bind hash table entries: 32768 (order: 8, 1048576 bytes, linear) machine # [ 0.921818] TCP: Hash tables configured (established 32768 bind 32768) machine # [ 0.923015] MPTCP token hash table entries: 4096 (order: 5, 98304 bytes, linear) machine # [ 0.924525] UDP hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.925797] UDP-Lite hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.927158] NET: Registered PF_UNIX/PF_LOCAL protocol family machine # [ 0.928187] NET: Registered PF_XDP protocol family machine # [ 0.929100] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] machine # [ 0.930175] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] machine # [ 0.931268] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] machine # [ 0.932459] pci_bus 0000:00: resource 7 [mem 0x80000000-0xafffffff window] machine # [ 0.933634] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] machine # [ 0.934814] pci_bus 0000:00: resource 9 [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.936727] ACPI: \_SB_.GSIA: Enabled at IRQ 16 machine # [ 0.938862] ACPI: \_SB_.GSIB: Enabled at IRQ 17 machine # [ 0.940902] ACPI: \_SB_.GSIC: Enabled at IRQ 18 machine # [ 0.943058] ACPI: \_SB_.GSID: Enabled at IRQ 19 machine # [ 0.944943] PCI: CLS 0 bytes, default 64 machine # [ 0.945819] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) machine # [ 0.946534] Trying to unpack rootfs image as initramfs... machine # [ 0.946928] software IO TLB: mapped [mem 0x000000007a364000-0x000000007e364000] (64MB) machine # [ 0.949701] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.970542] Initialise system trusted keyrings machine # [ 0.971797] workingset: timestamp_bits=40 max_order=20 bucket_order=0 machine # [ 0.983043] Key type asymmetric registered machine # [ 0.983861] Asymmetric key parser 'x509' registered machine # [ 0.984834] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) machine # [ 0.986588] io scheduler mq-deadline registered machine # [ 0.987397] io scheduler kyber registered machine # [ 0.991752] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled machine # [ 0.993121] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A machine # [ 0.995651] Linux agpgart interface v0.103 machine # [ 0.996464] ACPI: bus type drm_connector registered machine # [ 0.999622] usbcore: registered new interface driver usbserial_generic machine # [ 1.000772] usbserial: USB Serial support registered for generic machine # [ 1.001802] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. machine # [ 1.001802] Please enable it if your BIOS has the CPPC option. machine # [ 1.004199] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled machine # [ 1.005710] drop_monitor: Initializing network drop monitor service machine # [ 1.006938] NET: Registered PF_INET6 protocol family machine # [ 1.008843] Segment Routing with IPv6 machine # [ 1.009546] In-situ OAM (IOAM) with IPv6 machine # [ 1.011535] IPI shorthand broadcast: enabled machine # [ 1.015897] sched_clock: Marking stable (862010611, 153211018)->(1036877336, -21655707) machine # [ 1.017888] registered taskstats version 1 machine # [ 1.018946] Loading compiled-in X.509 certificates machine # [ 1.029066] Demotion targets for Node 0: null machine # [ 1.030311] Key type .fscrypt registered machine # [ 1.031046] Key type fscrypt-provisioning registered machine # [ 1.032111] ima: No TPM chip found, activating TPM-bypass! machine # [ 1.033093] ima: Allocated hash algorithm: sha1 machine # [ 1.033936] ima: No architecture policies found machine # [ 1.034979] PM: Magic number: 14:456:933 machine # [ 1.036598] RAS: Correctable Errors collector initialized. machine # [ 1.041006] clk: Disabling unused clocks machine # [ 1.041739] PM: genpd: Disabling unused power domains machine # [ 1.227033] Freeing initrd memory: 29104K machine # [ 1.230738] Freeing unused decrypted memory: 2028K machine # [ 1.233525] Freeing unused kernel image (initmem) memory: 3656K machine # [ 1.234632] Write protecting the kernel read-only data: 32768k machine # [ 1.236785] Freeing unused kernel image (text/rodata gap) memory: 1172K machine # [ 1.238457] Freeing unused kernel image (rodata/data gap) memory: 684K machine # [ 1.289173] x86/mm: Checked W+X mappings: passed, no W+X pages found. machine # [ 1.290410] Run /init as init process machine # [ 1.304512] systemd[1]: Inserted module 'autofs4' machine # [ 1.330390] fuse: init (API version 7.45) machine # [ 1.339448] ACPI: \_SB_.GSIG: Enabled at IRQ 22 machine # [ 1.341838] ACPI: \_SB_.GSIH: Enabled at IRQ 23 machine # [ 1.344978] ACPI: \_SB_.GSIE: Enabled at IRQ 20 machine # [ 1.347086] ACPI: \_SB_.GSIF: Enabled at IRQ 21 machine # [ 1.352240] virtiofs virtio5: discovered new tag: nix-store machine # [ 1.353884] virtiofs virtio5: virtio_fs_setup_dax: No cache capability machine # [ 1.360685] virtiofs virtio6: discovered new tag: shared machine # [ 1.373744] virtiofs virtio6: virtio_fs_setup_dax: No cache capability machine # [ 1.377264] virtiofs virtio7: discovered new tag: xchg machine # [ 1.378779] virtiofs virtio7: virtio_fs_setup_dax: No cache capability machine # [ 1.401118] systemd[1]: Successfully made /usr/ read-only. machine # [ 1.736982] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 1.742182] systemd[1]: Detected virtualization kvm. machine # [ 1.743096] systemd[1]: Detected architecture x86-64. machine # [ 1.744024] systemd[1]: Running in initrd. machine # [ 1.745122] systemd[1]: Initializing machine ID from random generator. machine # [ 1.746416] systemd[1]: Hostname set to . machine # [ 1.845944] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 1.902910] systemd[1]: Queued start job for default target Initrd Default Target. machine # [ 1.912867] systemd[1]: Created slice Slice /system/modprobe. machine # [ 1.914123] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 1.915729] systemd[1]: Expecting device /dev/disk/by-label/nixos... machine # [ 1.917946] systemd[1]: Reached target Path Units. machine # [ 1.919714] systemd[1]: Reached target Slice Units. machine # [ 1.921471] systemd[1]: Reached target Swaps. machine # [ 1.923084] systemd[1]: Reached target Timer Units. machine # [ 1.925071] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 1.927531] systemd[1]: Listening on Journal Socket (/dev/log). machine # [ 1.929578] systemd[1]: Listening on Journal Sockets. machine # [ 1.930590] systemd[1]: Listening on udev Control Socket. machine # [ 1.931654] systemd[1]: Listening on udev Kernel Socket. machine # [ 1.932622] systemd[1]: Reached target Socket Units. machine # [ 1.934567] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 1.936620] systemd[1]: Starting Load Kernel Module configfs... machine # [ 1.939821] systemd[1]: Starting Journal Service... machine # [ 1.943464] systemd[1]: Starting Load Kernel Modules... machine # [ 1.944561] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 1.947239] systemd[1]: Starting Coldplug All udev Devices... machine # [ 1.949182] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 1.951175] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 1.952840] systemd[1]: Finished Load Kernel Module configfs. machine # [ 1.954440] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config machine # [ 1.957286] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 1.968387] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. machine # [ 1.972494] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev machine # [ 1.975096] systemd[1]: Finished Load Kernel Modules. machine # [ 1.976814] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 1.979385] systemd[1]: Starting Apply Kernel Variables... machine # [ 1.981959] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 1.982845] systemd-journald[89]: Collecting audit messages is disabled. machine # [ 1.993100] systemd[1]: Finished Apply Kernel Variables. machine # [ 1.994834] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 1.996202] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 1.997554] systemd[1]: Reached target Local File Systems. machine # [ 1.999540] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 2.032035] systemd[1]: Started Journal Service. machine # [ 1.878921] systemd-modules-load[90]: Using 4 probe threads machine # [ 1.881057] systemd-modules-load[90]: Inserted module 'virtio_balloon' machine # [ 1.882198] systemd-modules-load[90]: Inserted module 'virtio_gpu' machine # [ 1.883272] systemd-modules-load[90]: Inserted module 'dm_mod' machine # [ 1.884449] systemd-udevd[102]: Using default interface naming scheme 'v261'. machine # [ 1.885604] systemd[1]: Starting Create System Files and Directories... machine # [ 1.893624] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 1.900171] systemd[1]: Finished Create System Files and Directories. machine # [ 1.902937] systemd[1]: Finished Coldplug All udev Devices. machine # [ 1.904191] systemd[1]: Reached target System Initialization. machine # [ 1.905091] systemd[1]: Reached target Basic System. machine # [ 2.159616] virtio_blk virtio2: 4/0/0 default/read/poll queues machine # [ 2.161731] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 machine # [ 2.165803] virtio_blk virtio2: [vda] 33554432 512-byte logical blocks (17.2 GB/16.0 GiB) machine # [ 2.170319] serio: i8042 KBD port at 0x60,0x64 irq 1 machine # [ 2.171069] serio: i8042 AUX port at 0x60,0x64 irq 12 machine # [ 2.177404] uhci_hcd 0000:00:1d.0: UHCI Host Controller machine # [ 2.179248] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 1 machine # [ 2.180897] uhci_hcd 0000:00:1d.0: detected 2 ports machine # [ 2.181774] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 machine # [ 2.182840] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.184081] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.185314] usb usb1: Product: UHCI Host Controller machine # [ 2.186035] usb usb1: Manufacturer: Linux 6.18.53 uhci_hcd machine # [ 2.186906] usb usb1: SerialNumber: 0000:00:1d.0 machine # [ 2.203529] hub 1-0:1.0: USB hub found machine # [ 2.204199] hub 1-0:1.0: 2 ports detected machine # [ 2.212802] SCSI subsystem initialized machine # [ 2.215757] ehci-pci 0000:00:1d.7: EHCI Host Controller machine # [ 2.216878] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 2 machine # [ 2.064391] systemd[1]: Starting Virtual Console Setup... machine # [ 2.219577] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 machine # [ 2.227255] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 machine # [ 2.075295] systemd[1]: Found device /dev/disk/by-label/nixos. machine # [ 2.228193] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 machine # [ 2.076190] systemd[1]: Reached target Initrd Root Device. machine # [ 2.230169] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.078382] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... machine # [ 2.232888] usb usb2: Product: EHCI Host Controller machine # [ 2.233602] usb usb2: Manufacturer: Linux 6.18.53 ehci_hcd machine # [ 2.234394] usb usb2: SerialNumber: 0000:00:1d.7 machine # [ 2.234706] hub 2-0:1.0: USB hub found machine # [ 2.235854] hub 2-0:1.0: 6 ports detected machine # [ 2.089815] systemd-vconsole-setup[140]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 2.092059] systemd[1]: Finished Virtual Console Setup. machine # [ 2.097645] systemd-fsck[146]: nixos: clean, 12/1048576 files, 109865/4194304 blocks machine # [ 2.103200] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. machine # [ 2.257877] hub 1-0:1.0: USB hub found machine # [ 2.258810] hub 1-0:1.0: 2 ports detected machine # [ 2.259810] uhci_hcd 0000:00:1d.1: UHCI Host Controller machine # [ 2.260913] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 machine # [ 2.262054] uhci_hcd 0000:00:1d.1: detected 2 ports machine # [ 2.262922] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 machine # [ 2.264060] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.265475] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.265864] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 machine # [ 2.265879] usb usb3: Product: UHCI Host Controller machine # [ 2.268930] usb usb3: Manufacturer: Linux 6.18.53 uhci_hcd machine # [ 2.269891] usb usb3: SerialNumber: 0000:00:1d.1 machine # [ 2.270924] hub 3-0:1.0: USB hub found machine # [ 2.271563] hub 3-0:1.0: 2 ports detected machine # [ 2.120738] (udev-worker)[122]: Network interface NamePolicy=[ 2.274138] uhci_hcd 0000:00:1d.2: UHCI Host Controller machine # disabled on kernel command line. machine # [ 2.275559] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 machine # [ 2.276864] uhci_hcd 0000:00:1d.2: detected 2 ports machine # [ 2.125560] (udev-worker)[125]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 2.280235] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 machine # [ 2.128833] (udev-worker)[125]: Network inter[ 2.281980] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # face NamePolicy= disabled on kernel command line. machine # [ 2.283910] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.286271] usb usb4: Product: UHCI Host Controller machine # [ 2.287011] usb usb4: Manufacturer: Linux 6.18.53 uhci_hcd machine # [ 2.287937] usb usb4: SerialNumber: 0000:00:1d.2 machine # [ 2.290409] hub 4-0:1.0: USB hub found machine # [ 2.291062] hub 4-0:1.0: 2 ports detected machine # [ 2.303179] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode machine # [ 2.304442] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) machine # [ 2.305366] ahci 0000:00:1f.2: flags: 64bit ncq only machine # [ 2.307592] scsi host0: ahci machine # [ 2.308455] scsi host1: ahci machine # [ 2.309277] scsi host2: ahci machine # [ 2.310925] scsi host3: ahci machine # [ 2.312094] scsi host4: ahci machine # [ 2.312907] scsi host5: ahci machine # [ 2.313534] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 50 lpm-pol 1 machine # [ 2.314759] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 50 lpm-pol 1 machine # [ 2.316027] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 50 lpm-pol 1 machine # [ 2.317340] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 50 lpm-pol 1 machine # [ 2.318594] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 50 lpm-pol 1 machine # [ 2.319835] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 50 lpm-pol 1 machine # [ 2.473431] usb 2-1: new high-speed USB device number 2 using ehci-pci machine # [ 2.606962] usb 2-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 machine # [ 2.610069] usb 2-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 machine # [ 2.612820] usb 2-1: Product: QEMU USB Tablet machine # [ 2.614555] usb 2-1: Manufacturer: QEMU machine # [ 2.616057] usb 2-1: SerialNumber: 28754-0000:00:1d.7-1 machine # [ 2.634796] hid: raw HID events driver (C) Jiri Kosina machine # [ 2.639814] ata6: SATA link down (SStatus 0 SControl 300) machine # [ 2.640924] ata2: SATA link down (SStatus 0 SControl 300) machine # [ 2.643168] ata4: SATA link down (SStatus 0 SControl 300) machine # [ 2.644137] ata1: SATA link down (SStatus 0 SControl 300) machine # [ 2.645271] ata5: SATA link down (SStatus 0 SControl 300) machine # [ 2.647492] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) machine # [ 2.648527] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 machine # [ 2.649354] ata3.00: applying bridge limits machine # [ 2.650155] ata3.00: configured for UDMA/100 machine # [ 2.651365] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 machine # [ 2.673846] usbcore: registered new interface driver usbhid machine # [ 2.674750] usbhid: USB HID core driver machine # [ 2.685624] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb2/2-1/2-1:1.0/0003:0627:0001.0001/input/input2 machine # [ 2.689758] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 machine # [ 2.699617] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray machine # [ 2.729381] cdrom: Uniform CD-ROM driver Revision: 3.20 machine # [ 2.798420] systemd[1]: Mounting /sysroot... machine # [ 3.080613] EXT4-fs (vda): mounted filesystem 5868db89-81e2-4374-95a4-0070043a261b r/w with ordered data mode. Quota mode: none. machine # [ 2.930836] systemd[1]: Mounted /sysroot. machine # [ 2.932220] systemd[1]: Reached target Initrd Root File System. machine # [ 2.933561] systemd[1]: Mounting /sysroot/nix/.ro-store... machine # [ 2.934827] systemd[1]: Mounting /sysroot/nix/.rw-store... machine # [ 2.936376] systemd[1]: Mounting /sysroot/run... machine # [ 2.939153] systemd[1]: Mounting /sysroot/tmp/shared... machine # [ 2.953223] systemd[1]: Mounting /sysroot/tmp/xchg... machine # [ 2.954642] systemd[1]: Starting Mountpoints Configured in the Real Root... machine # [ 2.960643] systemd[1]: Mounted /sysroot/nix/.rw-store. machine # [ 2.964435] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 2.968656] systemd-sysroot-fstab-check[191]: /sysroot should be mounted in the initrd, will request daemon-reload. machine # [ 2.970198] systemd[1]: Mounted /sysroot/nix/.ro-store. machine # [ 2.971396] systemd[1]: Mounted /sysroot/run. machine # [ 2.972129] systemd[1]: Mounted /sysroot/tmp/shared. machine # [ 2.974945] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 2.976025] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 2.977696] systemd[1]: Mounted /sysroot/tmp/xchg. machine # [ 2.983644] systemd[1]: Reload requested from client PID 191 ('systemd-sysroot') (unit initrd-parse-etc.service)... machine # [ 2.985146] systemd[1]: Reloading... machine # [ 3.042567] systemd[1]: Reloading finished in 58 ms. machine # [ 3.064198] systemd-sysroot-fstab-check[191]: Requesting initrd-fs.target/start/replace... machine # [ 3.065463] systemd-sysroot-fstab-check[191]: Requesting swap.target/start/replace... machine # [ 3.066542] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.067885] systemd[1]: initrd-parse-etc.service: Deactivated successfully. machine # [ 3.068883] systemd[1]: Finished Mountpoints Configured in the Real Root. machine # [ 3.069838] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. machine # [ 3.100359] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.101451] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.799280] systemd[1]: Mounting /sysroot/nix/store... machine # [ 3.849171] systemd[1]: Mounted /sysroot/nix/store. machine # [ 3.851221] systemd[1]: Reached target Initrd File Systems. machine # [ 3.853272] systemd[1]: Starting Find NixOS closure... machine # [ 3.855283] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... machine # [ 3.877795] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. machine # [ 3.880578] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. machine # [ 3.891322] systemd[1]: Finished Find NixOS closure. machine # [ 3.893250] systemd[1]: Reached target Initrd Default Target. machine # [ 3.895278] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... machine # [ 3.934781] systemd[1]: Stopped target Initrd Default Target. machine # [ 3.936895] systemd[1]: Stopped target Basic System. machine # [ 3.938625] systemd[1]: Stopped target Initrd Root Device. machine # [ 3.940497] systemd[1]: Stopped target Path Units. machine # [ 3.942225] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. machine # [ 3.944768] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. machine # [ 3.947686] systemd[1]: Stopped target Slice Units. machine # [ 3.949622] systemd[1]: Stopped target Socket Units. machine # [ 3.951506] systemd[1]: Stopped target System Initialization. machine # [ 3.953528] systemd[1]: Stopped target Swaps. machine # [ 3.955355] systemd[1]: Stopped target Timer Units. machine # [ 3.957341] systemd[1]: dbus.socket: Deactivated successfully. machine # [ 3.959749] systemd[1]: Closed D-Bus System Message Bus Socket. machine # [ 3.963647] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. machine # [ 3.966234] systemd[1]: Stopped Find NixOS closure. machine # [ 3.968160] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.970215] systemd[1]: systemd-sysctl.service: Deactivated successfully. machine # [ 3.972552] systemd[1]: Stopped Apply Kernel Variables. machine # [ 3.974381] systemd[1]: systemd-modules-load.service: Deactivated successfully. machine # [ 3.976510] systemd[1]: Stopped Load Kernel Modules. machine # [ 3.978178] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. machine # [ 3.980440] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. machine # [ 3.982602] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. machine # [ 3.984684] systemd[1]: Stopped Create System Files and Directories. machine # [ 3.986449] systemd[1]: Stopped target Local File Systems. machine # [ 3.987943] systemd[1]: Stopped target Preparation for Local File Systems. machine # [ 3.989770] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. machine # [ 3.991687] systemd[1]: Stopped Coldplug All udev Devices. machine # [ 3.993178] systemd[1]: Stopping Rule-based Manager for Device Events and Files... machine # [ 3.994825] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 3.996126] systemd[1]: Stopped Virtual Console Setup. machine # [ 3.997132] systemd[1]: initrd-cleanup.service: Deactivated successfully. machine # [ 3.998339] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. machine # [ 3.999583] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 4.001075] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 4.002194] systemd[1]: systemd-udevd.service: Deactivated successfully. machine # [ 4.003328] systemd[1]: Stopped Rule-based Manager for Device Events and Files. machine # [ 4.004535] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. machine # [ 4.005663] systemd[1]: Closed udev Control Socket. machine # [ 4.006364] systemd[1]: Starting Cleanup udev Database... machine # [ 4.007182] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. machine # [ 4.008243] systemd[1]: Stopped Create Static Device Nodes in /dev. machine # [ 4.009137] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. machine # [ 4.010242] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. machine # [ 4.011266] systemd[1]: kmod-static-nodes.service: Deactivated successfully. machine # [ 4.012273] systemd[1]: Stopped Create List of Static Device Nodes. machine # [ 4.013285] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. machine # [ 4.014526] systemd[1]: Finished Cleanup udev Database. machine # [ 4.015388] systemd[1]: Reached target Switch Root. machine # [ 4.016188] systemd[1]: Starting NixOS Activation... machine # [ 4.155354] initrd-nixos-activation-start[238]: booting system configuration /nix/store/vxh5dascm76zlqyzr9zd14lxfhwgw0cd-nixos-system-machine-test machine # [ 4.213330] initrd-nixos-activation-start[238]: running activation script... machine # [ 4.506744] initrd-nixos-activation-start[261]: setting up /etc... machine # [ 4.646232] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. machine # [ 4.649251] systemd[1]: Finished NixOS Activation. machine # [ 4.653298] systemd[1]: Starting Switch Root... machine # [ 4.689810] systemd[1]: Switching root. machine # [ 4.904535] systemd-journald[89]: Received SIGTERM from PID 1 (systemd). machine # [ 5.025811] NET: Registered PF_VSOCK protocol family machine # [ 5.417388] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 5.427858] systemd[1]: Detected virtualization kvm. machine # [ 5.429858] systemd[1]: Detected architecture x86-64. machine # [ 5.431938] systemd[1]: Detected first boot. machine # [ 5.436964] systemd[1]: Initializing machine ID from random generator. machine # [ 5.613424] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 5.705855] systemd[1]: Applying preset policy. machine # [ 5.908834] systemd[1]: Populated /etc with preset unit settings. machine # [ 6.171180] systemd[1]: initrd-switch-root.service: Deactivated successfully. machine # [ 6.172666] systemd[1]: Stopped initrd-switch-root.service. machine # [ 6.174988] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. machine # [ 6.177457] systemd[1]: Created slice Slice /system/getty. machine # [ 6.178914] systemd[1]: Created slice User and Session Slice. machine # [ 6.179977] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 6.181417] systemd[1]: Started Forward Password Requests to Wall Directory Watch. machine # [ 6.182610] systemd[1]: Expecting device /dev/hvc0... machine # [ 6.183507] systemd[1]: Expecting device /dev/ttyS0... machine # [ 6.184333] systemd[1]: Reached target Local Encrypted Volumes. machine # [ 6.185668] systemd[1]: Stopped target initrd-fs.target. machine # [ 6.186519] systemd[1]: Stopped target initrd-root-fs.target. machine # [ 6.187351] systemd[1]: Stopped target initrd-switch-root.target. machine # [ 6.188335] systemd[1]: Reached target Virtual Machines and Containers. machine # [ 6.189389] systemd[1]: Reached target Path Units. machine # [ 6.190266] systemd[1]: Reached target Remote File Systems. machine # [ 6.191251] systemd[1]: Reached target Slice Units. machine # [ 6.192088] systemd[1]: Reached target Swaps. machine # [ 6.194479] systemd[1]: Listening on Query the User Interactively for a Password. machine # [ 6.197218] systemd[1]: Listening on Process Core Dump Socket. machine # [ 6.200546] systemd[1]: Listening on Credential Encryption/Decryption. machine # [ 6.205355] systemd[1]: Listening on Factory Reset Management. machine # [ 6.207720] systemd[1]: Listening on Hostname Service Socket. machine # [ 6.214594] systemd[1]: Starting Journal Log Access Socket... machine # [ 6.217710] systemd[1]: Listening on Journal Audit Socket. machine # [ 6.222526] systemd[1]: Listening on Console Output Muting Service Socket. machine # [ 6.225430] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. machine # [ 6.228377] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.231857] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki machine # [ 6.241535] systemd[1]: Listening on Disk Repartitioning Service Socket. machine # [ 6.244051] systemd[1]: Listening on udev Control Socket. machine # [ 6.245923] systemd[1]: Listening on udev Varlink Socket. machine # [ 6.250533] systemd[1]: Mounting Huge Pages File System... machine # [ 6.254752] systemd[1]: Mounting POSIX Message Queue File System... machine # [ 6.265399] systemd[1]: Mounting Kernel Debug File System... machine # [ 6.269532] systemd[1]: Mounting Kernel Trace File System... machine # [ 6.273340] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 6.280660] systemd[1]: Starting Load Kernel Module configfs... machine # [ 6.281626] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm machine # [ 6.283233] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.284993] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.289307] systemd[1]: Mounting FUSE Control File System... machine # [ 6.290322] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.296291] systemd[1]: Starting Journal Service... machine # [ 6.298722] systemd[1]: Starting Load Kernel Modules... machine # [ 6.301455] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... machine # [ 6.303820] systemd[1]: Starting Remount Root and Kernel File Systems... machine # [ 6.305044] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.309842] systemd[1]: Starting Coldplug All udev Devices... machine # [ 6.313743] systemd[1]: Listening on Journal Log Access Socket. machine # [ 6.316317] systemd[1]: Mounted Huge Pages File System. machine # [ 6.317553] systemd[1]: Mounted POSIX Message Queue File System. machine # [ 6.318696] systemd[1]: Mounted Kernel Debug File System. machine # [ 6.319822] systemd[1]: Mounted Kernel Trace File System. machine # [ 6.320868] systemd[1]: Mounted FUSE Control File System. machine # [ 6.327970] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 6.330487] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 6.336749] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 6.338264] systemd[1]: Finished Load Kernel Module configfs. machine # [ 6.343904] systemd[1]: Mounting Kernel Configuration File System... machine # [ 6.353293] EXT4-fs (vda): re-mounted 5868db89-81e2-4374-95a4-0070043a261b. machine # [ 6.355538] systemd-journald[331]: Collecting audit messages is enabled. machine # [ 6.361830] systemd[1]: Finished Remount Root and Kernel File Systems. machine # [ 6.363081] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. machine # [ 6.364519] systemd[1]: Listening on Disk Image Download Service Socket. machine # [ 6.365535] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.368743] systemd[1]: Starting Load/Save OS Random Seed... machine # [ 6.369637] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.373132] systemd[1]: Started Journal Service. machine # [ 6.221256] systemd[1]: Queued start job for default target Multi-User System. machine # [ 6.222645] systemd[1]: systemd-journald.service: Deactivated successfully. machine # [ 6.224084] systemd-modules-load[332]: Using 2 probe threads machine # [ 6.225286] s[ 6.378320] loop: module loaded machine # ystemd-oomd[333]: No swap; memory pressure usage will be degraded machine # [ 6.227246] systemd-modules-load[332]: Inserted module 'loop' machine # [ 6.228460] systemd[1]: Starting Flush Journal to Persistent Storage... machine # [ 6.229594] systemd[1]: Mounted Kernel Configuration File System. machine # [ 6.232540] systemd[1]: Finished Load Kernel Modules. machine # [ 6.239432] systemd[1]: Starting Apply Kernel Variables... machine # [ 6.407044] systemd-journald[331]: Received client request to flush runtime journal. machine # [ 6.309573] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 6.310919] systemd[1]: Finished Load/Save OS Random Seed. machine # [ 6.311904] systemd[1]: Reached target First Boot Complete. machine # [ 6.312781] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 6.313748] systemd[1]: Finished Apply Kernel Variables. machine # [ 6.314530] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 6.315462] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 6.316449] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 6.317595] systemd[1]: Finished Flush Journal to Persistent Storage. machine # [ 6.340608] systemd-udevd[359]: Using default interface naming scheme 'v261'. machine # [ 6.361395] systemd[1]: Finished Coldplug All udev Devices. machine # [ 6.377266] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 6.446539] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.465161] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. machine # [ 6.480607] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. machine # [ 6.482723] (udev-worker)[369]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.489852] (udev-worker)[373]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 6.492800] (udev-worker)[373]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.669521] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 machine # [ 6.518919] systemd[1]: Condition check resulted in Virtio network device being skipped. machine # [ 6.520197] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.522120] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.524507] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.526145] systemd[1]: Early[ 6.679279] ACPI: button: Power Button [PWRF] machine # TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.528080] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.682723] mousedev: PS/2 mouse device common for all mice machine # [ 6.683396] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console machine # [ 6.696474] Console: switching to colour dummy device 80x25 machine # [ 6.700528] [drm] Found bochs VGA, ID 0xb0c5. machine # [ 6.701092] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. machine # [ 6.702648] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic machine # [ 6.703839] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 machine # [ 6.732904] Console: switching to colour frame buffer device 160x50 machine # [ 6.734104] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device machine # [ 6.744500] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 machine # [ 6.749441] parport_pc 00:02: reported by Plug and Play ACPI machine # [ 6.750179] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] machine # [ 6.756031] rtc_cmos PNP0B00:00: RTC can wake from S4 machine # [ 6.757396] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized machine # [ 6.763478] rtc_cmos PNP0B00:00: registered as rtc0 machine # [ 6.764117] rtc_cmos PNP0B00:00: setting system clock to 2026-10-05T11:55:36 UTC (1791201336) machine # [ 6.765140] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs machine # [ 6.765894] systemd-journald[331]: Time jumped backwards, rotating. machine # [ 6.772336] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt machine # [ 6.773148] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD machine # [ 6.786102] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 machine # [ 6.790526] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 machine # [ 6.662083] systemd[1]: Starting Virtual Console Setup... machine # [ 6.835137] ppdev: user-space parallel port driver machine # [ 6.685634] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 6.689569] systemd[1]: Stopped Virtual Console Setup. machine # [ 6.702841] systemd[1]: Starting Virtual Console Setup... machine # [ 6.858035] iTCO_wdt iTCO_wdt.0.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) machine # [ 6.859522] iTCO_wdt iTCO_wdt.0.auto: initialized. heartbeat=30 sec (nowayout=0) machine # [ 6.985730] kvm_amd: TSC scaling supported machine # [ 6.986300] kvm_amd: Nested Virtualization enabled machine # [ 6.986800] kvm_amd: Nested Paging enabled machine # [ 6.987265] kvm_amd: LBR virtualization supported machine # [ 6.987772] kvm_amd: Virtual VMLOAD VMSAVE supported machine # [ 6.988347] kvm_amd: Virtual GIF supported machine # [ 6.988851] kvm_amd: Virtual NMI enabled machine # [ 7.047945] EDAC MC: Ver: 3.0.0 machine # [ 6.956047] systemd-vconsole-setup[405]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 6.959570] systemd[1]: Finished Virtual Console Setup. machine # [ 7.022864] systemd[1]: Mounting /run/wrappers... machine # [ 7.057456] systemd[1]: Mounted /run/wrappers. machine # [ 7.059314] systemd[1]: Reached target Local File Systems. machine # [ 7.061410] systemd[1]: Listening on Boot Loader Control Service Socket. machine # [ 7.064353] systemd[1]: Starting register-nix-paths.service... machine # [ 7.067362] systemd[1]: Starting Create SUID/SGID Wrappers... machine # [ 7.069458] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. machine # [ 7.072906] systemd[1]: Starting Save Transient machine-id to Disk... machine # [ 7.078330] systemd[1]: Starting Create System Files and Directories... machine # [ 7.160327] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. machine # [ 7.164692] systemd[1]: Finished Save Transient machine-id to Disk. machine # [ 7.166509] systemd[1]: Finished Create System Files and Directories. machine # [ 7.170736] systemd[1]: Starting Rebuild Journal Catalog... machine # [ 7.172591] systemd[1]: Starting Record System Boot/Shutdown in UTMP... machine # [ 7.205888] systemd[1]: Finished Record System Boot/Shutdown in UTMP. machine # [ 7.215174] systemd[1]: Finished Rebuild Journal Catalog. machine # [ 7.217607] systemd[1]: Starting Update is Completed... machine # [ 7.239245] systemd[1]: Finished Update is Completed. machine # [ 7.368077] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. machine # [ 7.369237] systemd[1]: Finished Create SUID/SGID Wrappers. machine # [ 7.576234] systemd[1]: Finished register-nix-paths.service. machine # [ 7.578036] systemd[1]: Reached target System Initialization. machine # [ 7.579645] systemd[1]: Started Discard unused filesystem blocks once a week. machine # [ 7.581645] systemd[1]: Started niks3 garbage collection timer. machine # [ 7.583267] systemd[1]: Started Daily Cleanup of Temporary Directories. machine # [ 7.585125] systemd[1]: Reached target Timer Units. machine # [ 7.586456] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 7.588238] systemd[1]: Listening on niks3 server socket. machine # [ 7.589840] systemd[1]: Listening on Nix Daemon Socket. machine # [ 7.591529] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. machine # [ 7.594238] systemd[1]: Reached target Socket Units. machine # [ 7.595883] systemd[1]: Reached target Basic System. machine # [ 7.597425] systemd[1]: Started backdoor.service. machine # [ 7.599391] systemd[1]: Starting Import lastlog data into lastlog2 database... machine # [ 7.607110] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 7.612216] systemd[1]: Starting Post-Boot Actions... machine # [ 7.616851] systemd[1]: Started Reset console on configuration changes. machine # [ 7.619657] systemd[1]: Starting resolvconf update... machine # [ 7.625398] systemd[1]: Started rustfs.service. machine # [ 7.628342] systemd[1]: Starting rustfs-bucket.service... machine # [ 7.633496] systemd[1]: Starting D-Bus System Message Bus... machine # connecting to host... machine # [ 7.645511] systemd[1]: Finished Post-Boot Actions. machine # [ 7.657135] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 7.664177] nsncd[488]: Oct 05 11:55:37.541 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 7.666249] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 7.667271] systemd[1]: Reached target User and Group Name Lookups. machine # [ 7.668225] systemd[1]: Starting User Login Management... machine: Guest shell says: b'Spawning backdoor root shell...\n' machine: connected to guest root shell machine # [ 7.672207] systemd[1]: Finished Import lastlog data into lastlog2 database. machine: (connecting took 8.32 seconds) machine: (finished: waiting for the VM to finish booting, in 8.52 seconds) machine # [ 7.727202] dbus-broker-launch[497]: Looking up NSS user entry for 'systemd-timesync'... machine # [ 7.736443] dbus-broker-launch[497]: NSS returned no entry for 'systemd-timesync' machine # [ 7.737563] dbus-broker-launch[497]: Invalid user-name in /nix/store/bcd7zqqxh9dkf34jz3fznsnn45xd36vp-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" machine # [ 7.741836] systemd-logind[516]: New seat seat0. machine # [ 7.746179] systemd-logind[516]: Watching system buttons on /dev/input/event2 (Power Button) machine # [ 7.749461] systemd-logind[516]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) machine # [ 7.750739] systemd-logind[516]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) machine # [ 7.752105] systemd[1]: Started User Login Management. machine # [ 7.753905] systemd[1]: Starting linger-users.service... machine # [ 7.760358] systemd[1]: Started D-Bus System Message Bus. machine # [ 7.778667] dbus-broker-launch[497]: Ready machine # [ 7.791691] systemd[1]: Stopped target Host and Network Name Lookups. machine # [ 7.792546] systemd[1]: Stopping Host and Network Name Lookups... machine # [ 7.793203] systemd[1]: Stopped target User and Group Name Lookups. machine # [ 7.793901] systemd[1]: Stopping User and Group Name Lookups... machine # [ 7.795219] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... machine # [ 7.796733] systemd[1]: nscd.service: Deactivated successfully. machine # [ 7.798092] systemd[1]: Stopped Name Service Cache Daemon (nsncd). machine # [ 7.800323] systemd[1]: linger-users.service: Deactivated successfully. machine # [ 7.801635] systemd[1]: Finished linger-users.service. machine # [ 7.810354] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 7.844356] nsncd[594]: Oct 05 11:55:37.732 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 7.845147] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 7.845716] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 7.846260] systemd[1]: Reached target User and Group Name Lookups. machine # [ 7.861374] systemd[1]: Finished resolvconf update. machine # [ 7.862187] systemd[1]: Reached target Preparation for Network. machine # [ 7.864237] systemd[1]: Starting DHCP Client... machine # [ 7.865613] systemd[1]: Starting Address configuration of eth1... machine # [ 7.867317] systemd[1]: Starting Extra networking commands.... machine # [ 7.919054] network-addresses-eth1-start[623]: adding address 192.168.1.1/24... done machine # [ 7.927333] network-addresses-eth1-start[623]: adding address 2001:db8:1::1/64... done machine # [ 7.938312] systemd[1]: Finished Address configuration of eth1. machine # [ 7.958323] dhcpcd[634]: dhcpcd-10.3.2 starting machine # [ 7.963618] dhcpcd[690]: dev: loaded udev machine # [ 7.974334] s[ 8.127264] 8021q: 802.1Q VLAN Support v1.8 machine # ystemd[1]: Finished Extra networking commands.. machine # [ 7.975682] systemd[1]: Reached target Network. machine # [ 8.129476] 8021q: adding VLAN 0 to HW filter on device eth1 machine # [ 7.978641] systemd[1]: Starting PostgreSQL Server... machine # [ 7.980041] systemd[1]: Starting Permit User Sessions... machine # [ 7.996859] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. machine # [ 8.009677] systemd[1]: Finished Permit User Sessions. machine # [ 8.011556] systemd[1]: Started Getty on tty1. machine # [ 8.012315] systemd[1]: Reached target Login Prompts. machine # [ 8.223694] cfg80211: Loading compiled-in X.509 certificates for regulatory database machine # [ 8.240838] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' machine # [ 8.242162] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' machine # [ 8.244410] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 machine # [ 8.245730] cfg80211: failed to load regulatory.db machine # [ 8.112282] postgresql-pre-start[706]: The files belonging to this database system will be owned by user "postgres". machine # [ 8.113104] postgresql-pre-start[706]: This user must also own the server process. machine # [ 8.113993] postgresql-pre-start[706]: The database cluster will be initialized with locale "en_US.UTF-8". machine # [ 8.114595] postgresql-pre-start[706]: The default database encoding has accordingly been set to "UTF8". machine # [ 8.115141] postgresql-pre-start[706]: The default text search configuration will be set to "english". machine # [ 8.115697] postgresql-pre-start[706]: Data page checksums are enabled. machine # [ 8.116282] postgresql-pre-start[706]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok machine # [ 8.116821] postgresql-pre-start[706]: creating subdirectories ... ok machine # [ 8.117531] postgresql-pre-start[706]: selecting dynamic shared memory implementation ... posix machine # [ 8.316743] 8021q: adding VLAN 0 to HW filter on device eth0 machine # [ 8.165205] dhcpcd[690]: eth0: waiting for carrier machine # [ 8.166040] dhcpcd[690]: eth0: carrier acquired machine # [ 8.175495] dhcpcd[690]: DUID 00:01:00:01:32:56:4c:ba:52:54:00:12:34:56 machine # [ 8.176515] dhcpcd[690]: eth0: IAID 00:12:34:56 machine # [ 8.177238] dhcpcd[690]: eth0: adding address fe80::5054:ff:fe12:3456 machine # [ 8.181619] postgresql-pre-start[706]: selecting default "max_connections" ... 100 machine # [ 8.228948] postgresql-pre-start[706]: selecting default "shared_buffers" ... 128MB machine # [ 8.961796] postgresql-pre-start[706]: selecting default time zone ... UTC machine # [ 8.964447] postgresql-pre-start[706]: creating configuration files ... ok machine # [ 9.149249] postgresql-pre-start[706]: running bootstrap script ... ok machine # [ 9.551640] postgresql-pre-start[706]: performing post-bootstrap initialization ... ok machine # [ 9.577978] dhcpcd[690]: eth0: soliciting a DHCP lease machine # [ 9.744442] NET: Registered PF_PACKET protocol family machine # [ 9.600488] dhcpcd[690]: eth0: offered 10.0.2.15 from 10.0.2.2 machine # [ 9.606475] dhcpcd[690]: eth0: probing address 10.0.2.15/24 machine # [ 9.727167] postgresql-pre-start[706]: syncing data to disk ... ok machine # [ 9.729389] postgresql-pre-start[706]: initdb: warning: enabling "trust" authentication for local connections machine # [ 9.732494] postgresql-pre-start[706]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. machine # [ 9.737302] postgresql-pre-start[706]: Success. You can now start the database server using: machine # [ 9.739956] postgresql-pre-start[706]: pg_ctl -D /var/lib/postgresql/18 -l logfile start machine # [ 9.871189] postgres[749]: [749] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit machine # [ 9.874728] postgres[749]: [749] LOG: listening on IPv6 address "::1", port 5432 machine # [ 9.875868] postgres[749]: [749] LOG: listening on IPv4 address "127.0.0.1", port 5432 machine # [ 9.881674] postgres[749]: [749] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" machine # [ 9.896792] postgres[762]: [762] LOG: database system was shut down at 2026-10-05 11:55:39 GMT machine # [ 9.909079] postgres[749]: [749] LOG: database system is ready to accept connections machine # [ 9.915501] systemd[1]: Started PostgreSQL Server. machine # [ 9.920362] systemd[1]: Starting PostgreSQL Setup Scripts... machine # [ 10.168667] postgresql-setup-start[778]: CREATE DATABASE machine # [ 10.210354] postgresql-setup-start[783]: CREATE ROLE machine # [ 10.229829] postgresql-setup-start[785]: ALTER DATABASE machine # [ 10.237680] systemd[1]: Finished PostgreSQL Setup Scripts. machine # [ 10.238892] systemd[1]: Reached target PostgreSQL. machine # [ 10.549630] dhcpcd[690]: eth0: soliciting an IPv6 router machine # [ 10.551402] dhcpcd[690]: eth0: Router Advertisement from fe80::2 machine # [ 10.553295] dhcpcd[690]: eth0: adding address fec0::5054:ff:fe12:3456/64 machine # [ 10.555173] dhcpcd[690]: eth0: adding route to fec0::/64 machine # [ 10.557149] dhcpcd[690]: eth0: adding default route via fe80::2 machine # [ 15.018244] dhcpcd[690]: eth0: leased 10.0.2.15 for 86400 seconds machine # [ 15.020507] dhcpcd[690]: eth0: adding route to 10.0.2.0/24 machine # [ 15.022379] dhcpcd[690]: eth0: adding default route via 10.0.2.2 machine # [ 15.168631] systemd[1]: Started DHCP Client. machine # [ 15.170877] systemd[1]: Reached target Network is Online. machine # [ 15.174227] systemd[1]: Starting k3s service... machine # [ 15.265325] k3s[885]: time="2026-10-05T11:55:45Z" level=info msg="Acquiring lock file /var/lib/rancher/k3s/data/.lock" machine # [ 15.267752] k3s[885]: time="2026-10-05T11:55:45Z" level=info msg="Preparing data dir /var/lib/rancher/k3s/data/53c81a1072dac7aebc0a3715f02f26b7ba95e9416f42c7f7aeed55ccb68af709" machine # [ 17.313398] k3s[885]: time="2026-10-05T11:55:47Z" level=info msg="Starting k3s 1.36.4+k3s1 (4dedb15b)" machine # [ 17.324847] k3s[885]: time="2026-10-05T11:55:47Z" level=info msg="Configuring sqlite3 database connection pooling: maxIdle=20, maxOpen=0, maxLifetime=0s, maxIdleTime=2m0s" machine # [ 17.326368] k3s[885]: time="2026-10-05T11:55:47Z" level=info msg="Kine built with sqlite from github.com/mattn/go-sqlite3 version 3.53.3" machine # [ 17.328182] k3s[885]: time="2026-10-05T11:55:47Z" level=info msg="Configuring database table schema and indexes, this may take a moment..." machine # [ 17.345742] k3s[885]: time="2026-10-05T11:55:47Z" level=info msg="Database tables and indexes are up to date" machine # [ 17.347205] k3s[885]: time="2026-10-05T11:55:47Z" level=info msg="Running startup VACUUM to reclaim disk space, this may take a moment..." machine # [ 17.354938] k3s[885]: time="2026-10-05T11:55:47Z" level=info msg="Startup VACUUM completed successfully" machine # [ 17.357643] k3s[885]: time="2026-10-05T11:55:47Z" level=info msg="Kine available at unix://kine.sock" machine # [ 17.358917] k3s[885]: time="2026-10-05T11:55:47Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 17.367699] k3s[885]: time="2026-10-05T11:55:47Z" level=info msg="Datastore connection validated successfully, proceeding with bootstrap data generation" machine # [ 17.371154] k3s[885]: time="2026-10-05T11:55:47Z" level=info msg="generated self-signed CA certificate CN=k3s-client-ca@1791201347: notBefore=2026-10-05 10:55:47.259559663 +0000 UTC notAfter=2036-10-02 10:55:47.259559663 +0000 UTC" machine # [ 17.375991] k3s[885]: time="2026-10-05T11:55:47Z" level=info msg="certificate CN=system:admin,O=system:masters signed by CN=k3s-client-ca@1791201347: notBefore=2026-10-05 10:55:47 +0000 UTC notAfter=2027-10-05 10:55:47 +0000 UTC" machine # [ 17.378957] k3s[885]: time="2026-10-05T11:55:47Z" level=info msg="certificate CN=system:k3s-supervisor,O=system:masters signed by CN=k3s-client-ca@1791201347: notBefore=2026-10-05 10:55:47 +0000 UTC notAfter=2027-10-05 10:55:47 +0000 UTC" machine # [ 17.379883] k3s[885]: time="2026-10-05T11:55:47Z" level=info msg="certificate CN=system:kube-controller-manager signed by CN=k3s-client-ca@1791201347: notBefore=2026-10-05 10:55:47 +0000 UTC notAfter=2027-10-05 10:55:47 +0000 UTC" machine # [ 17.380725] k3s[885]: time="2026-10-05T11:55:47Z" level=info msg="certificate CN=system:kube-scheduler signed by CN=k3s-client-ca@1791201347: notBefore=2026-10-05 10:55:47 +0000 UTC notAfter=2027-10-05 10:55:47 +0000 UTC" machine # [ 17.381437] k3s[885]: time="2026-10-05T11:55:47Z" level=info msg="certificate CN=system:apiserver,O=system:masters signed by CN=k3s-client-ca@1791201347: notBefore=2026-10-05 10:55:47 +0000 UTC notAfter=2027-10-05 10:55:47 +0000 UTC" machine # [ 17.382281] k3s[885]: time="2026-10-05T11:55:47Z" level=info msg="certificate CN=k3s-cloud-controller-manager signed by CN=k3s-client-ca@1791201347: notBefore=2026-10-05 10:55:47 +0000 UTC notAfter=2027-10-05 10:55:47 +0000 UTC" machine # [ 17.382978] k3s[885]: time="2026-10-05T11:55:47Z" level=info msg="generated self-signed CA certificate CN=k3s-server-ca@1791201347: notBefore=2026-10-05 10:55:47.270270801 +0000 UTC notAfter=2036-10-02 10:55:47.270270801 +0000 UTC" machine # [ 17.383695] k3s[885]: time="2026-10-05T11:55:47Z" level=info msg="certificate CN=kube-apiserver signed by CN=k3s-server-ca@1791201347: notBefore=2026-10-05 10:55:47 +0000 UTC notAfter=2027-10-05 10:55:47 +0000 UTC" machine # [ 17.384485] k3s[885]: time="2026-10-05T11:55:47Z" level=info msg="certificate CN=kube-scheduler signed by CN=k3s-server-ca@1791201347: notBefore=2026-10-05 10:55:47 +0000 UTC notAfter=2027-10-05 10:55:47 +0000 UTC" machine # [ 17.385288] k3s[885]: time="2026-10-05T11:55:47Z" level=info msg="certificate CN=kube-controller-manager signed by CN=k3s-server-ca@1791201347: notBefore=2026-10-05 10:55:47 +0000 UTC notAfter=2027-10-05 10:55:47 +0000 UTC" machine # [ 17.385920] k3s[885]: time="2026-10-05T11:55:47Z" level=info msg="generated self-signed CA certificate CN=k3s-request-header-ca@1791201347: notBefore=2026-10-05 10:55:47.271752274 +0000 UTC notAfter=2036-10-02 10:55:47.271752274 +0000 UTC" machine # [ 17.386568] k3s[885]: time="2026-10-05T11:55:47Z" level=info msg="certificate CN=system:auth-proxy signed by CN=k3s-request-header-ca@1791201347: notBefore=2026-10-05 10:55:47 +0000 UTC notAfter=2027-10-05 10:55:47 +0000 UTC" machine # [ 17.387252] k3s[885]: time="2026-10-05T11:55:47Z" level=info msg="generated self-signed CA certificate CN=etcd-server-ca@1791201347: notBefore=2026-10-05 10:55:47.272485328 +0000 UTC notAfter=2036-10-02 10:55:47.272485328 +0000 UTC" machine # [ 17.387947] k3s[885]: time="2026-10-05T11:55:47Z" level=info msg="certificate CN=etcd-client signed by CN=etcd-server-ca@1791201347: notBefore=2026-10-05 10:55:47 +0000 UTC notAfter=2027-10-05 10:55:47 +0000 UTC" machine # [ 17.388671] k3s[885]: time="2026-10-05T11:55:47Z" level=info msg="generated self-signed CA certificate CN=etcd-peer-ca@1791201347: notBefore=2026-10-05 10:55:47.273145747 +0000 UTC notAfter=2036-10-02 10:55:47.273145747 +0000 UTC" machine # [ 17.389483] k3s[885]: time="2026-10-05T11:55:47Z" level=info msg="certificate CN=etcd-peer signed by CN=etcd-peer-ca@1791201347: notBefore=2026-10-05 10:55:47 +0000 UTC notAfter=2027-10-05 10:55:47 +0000 UTC" machine # [ 17.390195] k3s[885]: time="2026-10-05T11:55:47Z" level=info msg="certificate CN=etcd-server signed by CN=etcd-server-ca@1791201347: notBefore=2026-10-05 10:55:47 +0000 UTC notAfter=2027-10-05 10:55:47 +0000 UTC" machine # [ 17.431313] k3s[885]: time="2026-10-05T11:55:47Z" level=info msg="certificate CN=k3s,O=k3s signed by CN=k3s-server-ca@1791201347: notBefore=2026-10-05 10:55:47 +0000 UTC notAfter=2027-10-05 10:55:47 +0000 UTC" machine # [ 17.432583] k3s[885]: time="2026-10-05T11:55:47Z" level=warning msg="dynamiclistener [::]:6443: no cached certificate available for preload - deferring certificate load until storage initialization or first client request" machine # [ 17.441867] k3s[885]: time="2026-10-05T11:55:47Z" level=info msg="Active TLS secret / (ver=) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__e89a_8f8e_54f_7d9c-cd8b8e:fec0::e89a:8f8e:54f:7d9c listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=720423ED4CAD642C9C0853F229427D83B5C2ADFB]" machine # [ 18.418901] k3s[885]: time="2026-10-05T11:55:48Z" level=info msg="Password verified locally for node machine" machine # [ 18.420333] k3s[885]: time="2026-10-05T11:55:48Z" level=info msg="certificate CN=machine signed by CN=k3s-server-ca@1791201347: notBefore=2026-10-05 10:55:48 +0000 UTC notAfter=2027-10-05 10:55:48 +0000 UTC" machine # [ 18.657679] k3s[885]: time="2026-10-05T11:55:48Z" level=info msg="certificate CN=system:node:machine,O=system:nodes signed by CN=k3s-client-ca@1791201347: notBefore=2026-10-05 10:55:48 +0000 UTC notAfter=2027-10-05 10:55:48 +0000 UTC" machine # [ 18.762213] k3s[885]: time="2026-10-05T11:55:48Z" level=info msg="certificate CN=system:kube-proxy signed by CN=k3s-client-ca@1791201347: notBefore=2026-10-05 10:55:48 +0000 UTC notAfter=2027-10-05 10:55:48 +0000 UTC" machine # [ 18.865513] k3s[885]: time="2026-10-05T11:55:48Z" level=info msg="certificate CN=system:k3s-controller signed by CN=k3s-client-ca@1791201347: notBefore=2026-10-05 10:55:48 +0000 UTC notAfter=2027-10-05 10:55:48 +0000 UTC" machine # [ 18.962493] k3s[885]: time="2026-10-05T11:55:48Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:56284: runtime core not ready" machine # [ 19.067967] k3s[885]: time="2026-10-05T11:55:48Z" level=info msg="Module overlay was already loaded" machine # [ 19.324461] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. machine # [ 19.329097] Bridge firewalling registered machine # [ 19.187848] k3s[885]: time="2026-10-05T11:55:49Z" level=warning msg="Failed to load kernel module iptable_nat with modprobe" machine # [ 19.199173] k3s[885]: time="2026-10-05T11:55:49Z" level=warning msg="Failed to load kernel module iptable_filter with modprobe" machine # [ 19.206252] k3s[885]: time="2026-10-05T11:55:49Z" level=warning msg="Failed to load kernel module nft-expr-counter with modprobe" machine # [ 19.239314] rustfs-bucket-start[921]: mb s3://farm machine # [ 19.251198] systemd[1]: Finished rustfs-bucket.service. machine # [ 19.266904] k3s[885]: time="2026-10-05T11:55:49Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_max' to 131072" machine # [ 19.268498] k3s[885]: time="2026-10-05T11:55:49Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400" machine # [ 19.270189] k3s[885]: time="2026-10-05T11:55:49Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600" machine # [ 19.271858] k3s[885]: time="2026-10-05T11:55:49Z" level=info msg="Set sysctl 'net/ipv4/conf/all/forwarding' to 1" machine # [ 19.273410] k3s[885]: time="2026-10-05T11:55:49Z" level=info msg="Connecting to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 19.275025] k3s[885]: time="2026-10-05T11:55:49Z" level=info msg="Creating k3s-cert-monitor event broadcaster" machine # [ 19.277060] k3s[885]: time="2026-10-05T11:55:49Z" level=info msg="Saving cluster bootstrap data to datastore" machine # [ 19.277551] k3s[885]: time="2026-10-05T11:55:49Z" level=info msg="Handling backend connection request [machine]" machine # [ 19.278078] k3s[885]: time="2026-10-05T11:55:49Z" level=info msg="Polling for API server readiness: GET /readyz failed: the server is currently unable to handle the request" machine # [ 19.278255] k3s[885]: time="2026-10-05T11:55:49Z" level=info msg="Connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 19.278779] k3s[885]: time="2026-10-05T11:55:49Z" level=info msg="Remotedialer connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 19.279629] k3s[885]: time="2026-10-05T11:55:49Z" level=info msg="Connection to etcd is ready" machine # [ 19.280158] k3s[885]: time="2026-10-05T11:55:49Z" level=info msg="ETCD server is now running" machine # [ 19.280671] k3s[885]: time="2026-10-05T11:55:49Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 19.281233] k3s[885]: time="2026-10-05T11:55:49Z" level=info msg="Running kube-apiserver --advertise-port=6443 --allow-privileged=true --anonymous-auth=false --api-audiences=https://kubernetes.default.svc.cluster.local,k3s --authorization-mode=Node,RBAC --bind-address=127.0.0.1 --cert-dir=/var/lib/rancher/k3s/server/tls/temporary-certs --client-ca-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --egress-selector-config-file=/var/lib/rancher/k3s/server/etc/egress-selector-config.yaml --enable-admission-plugins=NodeRestriction --enable-aggregator-routing=true --enable-bootstrap-token-auth=true --etcd-servers=unix://kine.sock --kubelet-certificate-authority=/var/lib/rancher/k3s/server/tls/server-ca.crt --kubelet-client-certificate=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.crt --kubelet-client-key=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.key --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --profiling=false --proxy-client-cert-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt --proxy-client-key-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.key --requestheader-allowed-names=system:auth-proxy --requestheader-client-ca-file=/var/lib/rancher/k3s/server/tls/request-header-ca.crt --requestheader-extra-headers-prefix=X-Remote-Extra- --requestheader-group-headers=X-Remote-Group --requestheader-username-headers=X-Remote-User --secure-port=6444 --service-account-issuer=https://kubernetes.default.svc.cluster.local --service-account-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-account-signing-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --storage-backend=etcd3 --tls-cert-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --tls-private-key-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 19.282893] k3s[885]: time="2026-10-05T11:55:49Z" level=info msg="Running kube-scheduler --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --bind-address=127.0.0.1 --kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --leader-elect=false --profiling=false --secure-port=10259 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 19.283712] k3s[885]: I1005 11:55:49.165978 885 options.go:263] external host was not specified, using 10.0.2.15 machine # [ 19.284215] k3s[885]: time="2026-10-05T11:55:49Z" level=info msg="Running kube-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --bind-address=127.0.0.1 --cluster-cidr=10.42.0.0/16 --cluster-signing-kube-apiserver-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kube-apiserver-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kubelet-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-serving-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-kubelet-serving-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --cluster-signing-legacy-unknown-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-legacy-unknown-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --configure-cloud-routes=false --controllers=*,tokencleaner,-service,-route,-cloud-node-lifecycle --kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --leader-elect=false --profiling=false --root-ca-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --secure-port=10257 --service-account-private-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key --use-service-account-credentials=true" machine # [ 19.328807] k3s[885]: I1005 11:55:49.168664 885 server.go:158] Version: v1.36.4+k3s1 machine # [ 19.332547] k3s[885]: I1005 11:55:49.168692 885 server.go:160] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 19.333220] k3s[885]: time="2026-10-05T11:55:49Z" level=info msg="Running cloud-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --bind-address=127.0.0.1 --cloud-config=/var/lib/rancher/k3s/server/etc/cloud-config.yaml --cloud-provider=k3s --cluster-cidr=10.42.0.0/16 --configure-cloud-routes=false --controllers=*,-route --kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --leader-elect=false --leader-elect-resource-name=k3s-cloud-controller-manager --node-status-update-frequency=1m0s --profiling=false" machine # [ 19.333714] k3s[885]: time="2026-10-05T11:55:49Z" level=info msg="Server node token is available at /var/lib/rancher/k3s/server/token" machine # [ 19.334211] k3s[885]: time="2026-10-05T11:55:49Z" level=info msg="To join server node to cluster: k3s server -s https://10.0.2.15:6443 -t ${SERVER_NODE_TOKEN}" machine # [ 19.334711] k3s[885]: time="2026-10-05T11:55:49Z" level=info msg="Agent node token is available at /var/lib/rancher/k3s/server/agent-token" machine # [ 19.335822] k3s[885]: time="2026-10-05T11:55:49Z" level=info msg="To join agent node to cluster: k3s agent -s https://10.0.2.15:6443 -t ${AGENT_NODE_TOKEN}" machine # [ 19.336940] k3s[885]: time="2026-10-05T11:55:49Z" level=info msg="Wrote kubeconfig /etc/rancher/k3s/k3s.yaml" machine # [ 19.337551] k3s[885]: time="2026-10-05T11:55:49Z" level=info msg="Run: k3s kubectl" machine # [ 19.338160] k3s[885]: time="2026-10-05T11:55:49Z" level=info msg="Logging containerd to /var/lib/rancher/k3s/agent/containerd/containerd.log" machine # [ 19.338723] k3s[885]: time="2026-10-05T11:55:49Z" level=info msg="Running containerd -c /var/lib/rancher/k3s/agent/etc/containerd/config.toml" machine # [ 19.349947] k3s[885]: I1005 11:55:49.238961 885 shared_informer.go:381] "Waiting for caches to sync" controller="node_authorizer" machine # [ 19.350688] k3s[885]: E1005 11:55:49.239058 885 options.go:205] The manifest file is empty, ignoring. machine # [ 19.374075] k3s[885]: I1005 11:55:49.262289 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 19.375791] k3s[885]: I1005 11:55:49.264837 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 19.378576] k3s[885]: I1005 11:55:49.267625 885 plugins.go:157] Loaded 15 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,PodGroupProtection,RuntimeClass,DefaultIngressClass,PodTopologyLabels,MutatingAdmissionPolicy,MutatingAdmissionWebhook. machine # [ 19.379271] k3s[885]: I1005 11:55:49.268330 885 plugins.go:160] Loaded 17 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,PodGroupWorkloadExists,NodeDeclaredFeatureValidator,JobValidation,PodResizeValidator,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. machine # [ 19.380256] k3s[885]: I1005 11:55:49.269310 885 instance.go:240] Using reconciler: lease machine # [ 19.389486] k3s[885]: I1005 11:55:49.278465 885 handler.go:304] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager machine # [ 19.391127] k3s[885]: W1005 11:55:49.278496 885 genericapiserver.go:798] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. machine # [ 19.392841] k3s[885]: I1005 11:55:49.280985 885 cidrallocator.go:198] starting ServiceCIDR Allocator Controller machine # [ 19.429318] k3s[885]: I1005 11:55:49.317995 885 handler.go:304] Adding GroupVersion v1 to ResourceManager machine # [ 19.430742] k3s[885]: I1005 11:55:49.318220 885 apis.go:112] API group "internal.apiserver.k8s.io" is not enabled, skipping. machine # [ 19.450961] k3s[885]: time="2026-10-05T11:55:49Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:56342: runtime core not ready" machine # [ 19.479904] k3s[885]: I1005 11:55:49.368938 885 apis.go:112] API group "storagemigration.k8s.io" is not enabled, skipping. machine # [ 19.512985] k3s[885]: I1005 11:55:49.402000 885 handler.go:304] Adding GroupVersion authentication.k8s.io v1 to ResourceManager machine # [ 19.514645] k3s[885]: W1005 11:55:49.402029 885 genericapiserver.go:798] Skipping API authentication.k8s.io/v1beta1 because it has no resources. machine # [ 19.516361] k3s[885]: W1005 11:55:49.402040 885 genericapiserver.go:798] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. machine # [ 19.518143] k3s[885]: I1005 11:55:49.402336 885 handler.go:304] Adding GroupVersion authorization.k8s.io v1 to ResourceManager machine # [ 19.519698] k3s[885]: W1005 11:55:49.402352 885 genericapiserver.go:798] Skipping API authorization.k8s.io/v1beta1 because it has no resources. machine # [ 19.521353] k3s[885]: I1005 11:55:49.402759 885 handler.go:304] Adding GroupVersion autoscaling v2 to ResourceManager machine # [ 19.522762] k3s[885]: I1005 11:55:49.403065 885 handler.go:304] Adding GroupVersion autoscaling v1 to ResourceManager machine # [ 19.524267] k3s[885]: I1005 11:55:49.403824 885 handler.go:304] Adding GroupVersion batch v1 to ResourceManager machine # [ 19.525743] k3s[885]: W1005 11:55:49.403844 885 genericapiserver.go:798] Skipping API batch/v1beta1 because it has no resources. machine # [ 19.527294] k3s[885]: I1005 11:55:49.404282 885 handler.go:304] Adding GroupVersion certificates.k8s.io v1 to ResourceManager machine # [ 19.528810] k3s[885]: W1005 11:55:49.404297 885 genericapiserver.go:798] Skipping API certificates.k8s.io/v1beta1 because it has no resources. machine # [ 19.530454] k3s[885]: W1005 11:55:49.404308 885 genericapiserver.go:798] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. machine # [ 19.532218] k3s[885]: I1005 11:55:49.404594 885 handler.go:304] Adding GroupVersion coordination.k8s.io v1 to ResourceManager machine # [ 19.533800] k3s[885]: W1005 11:55:49.404607 885 genericapiserver.go:798] Skipping API coordination.k8s.io/v1beta1 because it has no resources. machine # [ 19.535407] k3s[885]: W1005 11:55:49.404617 885 genericapiserver.go:798] Skipping API coordination.k8s.io/v1alpha2 because it has no resources. machine # [ 19.537192] k3s[885]: I1005 11:55:49.404907 885 handler.go:304] Adding GroupVersion discovery.k8s.io v1 to ResourceManager machine # [ 19.538677] k3s[885]: W1005 11:55:49.404922 885 genericapiserver.go:798] Skipping API discovery.k8s.io/v1beta1 because it has no resources. machine # [ 19.540378] k3s[885]: I1005 11:55:49.406081 885 handler.go:304] Adding GroupVersion networking.k8s.io v1 to ResourceManager machine # [ 19.541958] k3s[885]: W1005 11:55:49.406126 885 genericapiserver.go:798] Skipping API networking.k8s.io/v1beta1 because it has no resources. machine # [ 19.543695] k3s[885]: I1005 11:55:49.406493 885 handler.go:304] Adding GroupVersion node.k8s.io v1 to ResourceManager machine # [ 19.545132] k3s[885]: W1005 11:55:49.406512 885 genericapiserver.go:798] Skipping API node.k8s.io/v1beta1 because it has no resources. machine # [ 19.546733] k3s[885]: W1005 11:55:49.406525 885 genericapiserver.go:798] Skipping API node.k8s.io/v1alpha1 because it has no resources. machine # [ 19.548299] k3s[885]: I1005 11:55:49.407027 885 handler.go:304] Adding GroupVersion policy v1 to ResourceManager machine # [ 19.549662] k3s[885]: W1005 11:55:49.407049 885 genericapiserver.go:798] Skipping API policy/v1beta1 because it has no resources. machine # [ 19.551207] k3s[885]: I1005 11:55:49.407908 885 handler.go:304] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager machine # [ 19.552793] k3s[885]: W1005 11:55:49.407926 885 genericapiserver.go:798] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. machine # [ 19.554443] k3s[885]: W1005 11:55:49.407936 885 genericapiserver.go:798] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. machine # [ 19.556224] k3s[885]: I1005 11:55:49.408205 885 handler.go:304] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager machine # [ 19.557719] k3s[885]: W1005 11:55:49.408221 885 genericapiserver.go:798] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. machine # [ 19.559298] k3s[885]: W1005 11:55:49.408232 885 genericapiserver.go:798] Skipping API scheduling.k8s.io/v1alpha2 because it has no resources. machine # [ 19.560982] k3s[885]: I1005 11:55:49.409468 885 handler.go:304] Adding GroupVersion storage.k8s.io v1 to ResourceManager machine # [ 19.562430] k3s[885]: W1005 11:55:49.409488 885 genericapiserver.go:798] Skipping API storage.k8s.io/v1beta1 because it has no resources. machine # [ 19.564082] k3s[885]: W1005 11:55:49.409499 885 genericapiserver.go:798] Skipping API storage.k8s.io/v1alpha1 because it has no resources. machine # [ 19.565755] k3s[885]: I1005 11:55:49.410058 885 handler.go:304] Adding GroupVersion flowcontrol.apiserver.k8s.io v1 to ResourceManager machine # [ 19.567279] k3s[885]: W1005 11:55:49.410074 885 genericapiserver.go:798] Skipping API flowcontrol.apiserver.k8s.io/v1beta3 because it has no resources. machine # [ 19.568984] k3s[885]: W1005 11:55:49.410084 885 genericapiserver.go:798] Skipping API flowcontrol.apiserver.k8s.io/v1beta2 because it has no resources. machine # [ 19.570828] k3s[885]: W1005 11:55:49.410121 885 genericapiserver.go:798] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. machine # [ 19.572583] k3s[885]: I1005 11:55:49.411832 885 handler.go:304] Adding GroupVersion apps v1 to ResourceManager machine # [ 19.573879] k3s[885]: W1005 11:55:49.411850 885 genericapiserver.go:798] Skipping API apps/v1beta2 because it has no resources. machine # [ 19.575360] k3s[885]: W1005 11:55:49.411861 885 genericapiserver.go:798] Skipping API apps/v1beta1 because it has no resources. machine # [ 19.577065] k3s[885]: I1005 11:55:49.413055 885 handler.go:304] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager machine # [ 19.577713] k3s[885]: W1005 11:55:49.413079 885 genericapiserver.go:798] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. machine # [ 19.578216] k3s[885]: W1005 11:55:49.413090 885 genericapiserver.go:798] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. machine # [ 19.578686] k3s[885]: I1005 11:55:49.413433 885 handler.go:304] Adding GroupVersion events.k8s.io v1 to ResourceManager machine # [ 19.579191] k3s[885]: W1005 11:55:49.413449 885 genericapiserver.go:798] Skipping API events.k8s.io/v1beta1 because it has no resources. machine # [ 19.579684] k3s[885]: I1005 11:55:49.414374 885 handler.go:304] Adding GroupVersion resource.k8s.io v1 to ResourceManager machine # [ 19.580179] k3s[885]: W1005 11:55:49.414391 885 genericapiserver.go:798] Skipping API resource.k8s.io/v1beta2 because it has no resources. machine # [ 19.580671] k3s[885]: W1005 11:55:49.414402 885 genericapiserver.go:798] Skipping API resource.k8s.io/v1beta1 because it has no resources. machine # [ 19.581151] k3s[885]: W1005 11:55:49.414411 885 genericapiserver.go:798] Skipping API resource.k8s.io/v1alpha3 because it has no resources. machine # [ 19.581669] k3s[885]: I1005 11:55:49.416765 885 handler.go:304] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager machine # [ 19.582195] k3s[885]: W1005 11:55:49.416793 885 genericapiserver.go:798] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. machine # [ 19.582686] k3s[885]: time="2026-10-05T11:55:49Z" level=info msg="Running kube-proxy --cluster-cidr=10.42.0.0/16 --conntrack-max-per-core=0 --conntrack-tcp-timeout-close-wait=0s --conntrack-tcp-timeout-established=0s --healthz-bind-address=127.0.0.1 --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubeproxy.kubeconfig --proxy-mode=iptables" machine # [ 19.813102] k3s[885]: I1005 11:55:49.702054 885 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 19.813710] k3s[885]: I1005 11:55:49.702066 885 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 19.814197] k3s[885]: I1005 11:55:49.702401 885 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 19.814690] k3s[885]: I1005 11:55:49.702588 885 secure_serving.go:214] Serving securely on 127.0.0.1:6444 machine # [ 19.815174] k3s[885]: I1005 11:55:49.702707 885 aggregator.go:185] waiting for initial CRD sync... machine # [ 19.815643] k3s[885]: time="2026-10-05T11:55:49Z" level=info msg="Starting legacy_token_tracking_controller" logger=k3s machine # [ 19.819074] k3s[885]: time="2026-10-05T11:55:49Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 19.819720] k3s[885]: time="2026-10-05T11:55:49Z" level=info msg="Starting apiserver lease garbage collector" logger=k3s machine # [ 19.820155] k3s[885]: time="2026-10-05T11:55:49Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 19.820617] k3s[885]: I1005 11:55:49.704064 885 storage_readiness_hook.go:70] Storage is ready for all registered resources machine # [ 19.821152] k3s[885]: I1005 11:55:49.704123 885 controller.go:89] "Starting OpenAPI V3 AggregationController" machine # [ 19.821687] k3s[885]: I1005 11:55:49.704136 885 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 19.822186] k3s[885]: I1005 11:55:49.704689 885 local_available_controller.go:156] Starting LocalAvailability controller machine # [ 19.822681] k3s[885]: I1005 11:55:49.704705 885 cache.go:32] Waiting for caches to sync for LocalAvailability controller machine # [ 19.823190] k3s[885]: I1005 11:55:49.704792 885 apf_controller.go:377] Starting API Priority and Fairness config controller machine # [ 19.823686] k3s[885]: I1005 11:55:49.704832 885 dynamic_serving_content.go:135] "Starting controller" name="aggregator-proxy-cert::/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt::/var/lib/rancher/k3s/server/tls/client-auth-proxy.key" machine # [ 19.824165] k3s[885]: I1005 11:55:49.705050 885 cluster_authentication_trust_controller.go:459] Starting cluster_authentication_trust_controller controller machine # [ 19.824687] k3s[885]: time="2026-10-05T11:55:49Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 19.825194] k3s[885]: I1005 11:55:49.705229 885 controller.go:113] "Deleting old lease on startup" lease="kube-system/apiserver-ik4pcwfs7qgdl76byc4pomgvia" machine # [ 19.825708] k3s[885]: I1005 11:55:49.705464 885 controller.go:87] "Starting OpenAPI AggregationController" machine # [ 19.826203] k3s[885]: I1005 11:55:49.705654 885 customresource_discovery_controller.go:294] Starting DiscoveryController machine # [ 19.826706] k3s[885]: I1005 11:55:49.705746 885 system_namespaces_controller.go:66] Starting system namespaces controller machine # [ 19.827182] k3s[885]: I1005 11:55:49.706001 885 remote_available_controller.go:434] Starting RemoteAvailability controller machine # [ 19.827659] k3s[885]: I1005 11:55:49.706013 885 cache.go:32] Waiting for caches to sync for RemoteAvailability controller machine # [ 19.828179] k3s[885]: I1005 11:55:49.706061 885 apiservice_controller.go:100] Starting APIServiceRegistrationController machine # [ 19.828725] k3s[885]: I1005 11:55:49.706070 885 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller machine # [ 19.829209] k3s[885]: I1005 11:55:49.706690 885 crdregistration_controller.go:114] Starting crd-autoregister controller machine # [ 19.829699] k3s[885]: I1005 11:55:49.706704 885 shared_informer.go:381] "Waiting for caches to sync" controller="crd-autoregister" machine # [ 19.830204] k3s[885]: I1005 11:55:49.707637 885 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 19.830708] k3s[885]: I1005 11:55:49.707708 885 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 19.831188] k3s[885]: I1005 11:55:49.707921 885 repairip.go:210] Starting ipallocator-repair-controller machine # [ 19.831700] k3s[885]: I1005 11:55:49.707933 885 shared_informer.go:381] "Waiting for caches to sync" controller="ipallocator-repair-controller" machine # [ 19.832203] k3s[885]: I1005 11:55:49.708260 885 controller.go:142] Starting OpenAPI controller machine # [ 19.832725] k3s[885]: I1005 11:55:49.708322 885 controller.go:90] Starting OpenAPI V3 controller machine # [ 19.833228] k3s[885]: I1005 11:55:49.708361 885 naming_controller.go:305] Starting NamingConditionController machine # [ 19.833716] k3s[885]: I1005 11:55:49.708412 885 nonstructuralschema_controller.go:202] Starting NonStructuralSchemaConditionController machine # [ 19.834359] k3s[885]: I1005 11:55:49.708439 885 apiapproval_controller.go:196] Starting KubernetesAPIApprovalPolicyConformantConditionController machine # [ 19.834842] k3s[885]: time="2026-10-05T11:55:49Z" level=info msg="Starting CRDFinalizer" logger=k3s machine # [ 19.869076] k3s[885]: time="2026-10-05T11:55:49Z" level=info msg=Starting controller=kubernetes-service-cidr-controller logger=k3s machine # [ 19.870684] k3s[885]: time="2026-10-05T11:55:49Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 19.914928] k3s[885]: time="2026-10-05T11:55:49Z" level=info msg="Caches are synced" logger=k3s machine # [ 19.915649] k3s[885]: time="2026-10-05T11:55:49Z" level=info msg="Caches are synced" logger=k3s machine # [ 19.916615] k3s[885]: I1005 11:55:49.805655 885 cache.go:39] Caches are synced for LocalAvailability controller machine # [ 19.917123] k3s[885]: I1005 11:55:49.805740 885 apf_controller.go:382] Running API Priority and Fairness config worker machine # [ 19.917577] k3s[885]: I1005 11:55:49.805752 885 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process machine # [ 19.918058] k3s[885]: time="2026-10-05T11:55:49Z" level=info msg="Caches are synced" logger=k3s machine # [ 19.918541] k3s[885]: I1005 11:55:49.806254 885 cache.go:39] Caches are synced for APIServiceRegistrationController controller machine # [ 19.919074] k3s[885]: I1005 11:55:49.806519 885 cache.go:39] Caches are synced for RemoteAvailability controller machine # [ 19.919588] k3s[885]: I1005 11:55:49.806573 885 handler_discovery.go:459] Starting ResourceDiscoveryManager machine # [ 19.920128] k3s[885]: I1005 11:55:49.806763 885 shared_informer.go:388] "Caches are synced" controller="crd-autoregister" machine # [ 19.920651] k3s[885]: I1005 11:55:49.807863 885 aggregator.go:187] initial CRD sync complete... machine # [ 19.921147] k3s[885]: I1005 11:55:49.807882 885 autoregister_controller.go:144] Starting autoregister controller machine # [ 19.921658] k3s[885]: I1005 11:55:49.807894 885 cache.go:32] Waiting for caches to sync for autoregister controller machine # [ 19.922140] k3s[885]: I1005 11:55:49.807906 885 cache.go:39] Caches are synced for autoregister controller machine # [ 19.922644] k3s[885]: I1005 11:55:49.808029 885 shared_informer.go:388] "Caches are synced" controller="ipallocator-repair-controller" machine # [ 19.946245] k3s[885]: E1005 11:55:49.835276 885 controller.go:201] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" machine # [ 19.950357] k3s[885]: I1005 11:55:49.839329 885 shared_informer.go:388] "Caches are synced" controller="node_authorizer" machine # [ 19.969354] k3s[885]: time="2026-10-05T11:55:49Z" level=info msg="Caches are synced" logger=k3s machine # [ 19.969999] k3s[885]: time="2026-10-05T11:55:49Z" level=info msg="Creating default ServiceCIDR" CIDRs="[10.43.0.0/16]" logger=k3s machine # [ 19.972136] k3s[885]: time="2026-10-05T11:55:49Z" level=error msg="Error while syncing ConfigMap" configmap=kube-system/kube-apiserver-legacy-service-account-token-tracking error="namespaces \"kube-system\" not found" logger=k3s/UnhandledError machine # [ 19.973369] k3s[885]: E1005 11:55:49.862394 885 controller.go:95] Unable to perform initial Kubernetes service initialization: namespaces "default" not found machine # [ 19.974028] k3s[885]: I1005 11:55:49.862735 885 shared_informer.go:409] "Caches are synced" machine # [ 19.974488] k3s[885]: I1005 11:55:49.862786 885 policy_source.go:248] refreshing policies machine # [ 19.976033] k3s[885]: I1005 11:55:49.864904 885 shared_informer.go:409] "Caches are synced" machine # [ 19.976764] k3s[885]: I1005 11:55:49.864945 885 policy_source.go:248] refreshing policies machine # [ 19.985661] k3s[885]: time="2026-10-05T11:55:49Z" level=info msg="Setting default ServiceCIDR condition Ready to True" logger=k3s machine # [ 19.986460] k3s[885]: I1005 11:55:49.875264 885 cidrallocator.go:302] created ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 19.994689] k3s[885]: I1005 11:55:49.883726 885 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 20.150384] k3s[885]: I1005 11:55:50.039308 885 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io machine # [ 20.301136] k3s[885]: time="2026-10-05T11:55:50Z" level=info msg="containerd is now running" machine # [ 20.311286] k3s[885]: time="2026-10-05T11:55:50Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/avfxk2wil381mw0whld4ja3m1ic79vjx-nix-grpc-farm-client.tar" machine # [ 20.823413] k3s[885]: I1005 11:55:50.711552 885 storage_scheduling.go:137] created PriorityClass system-node-critical with value 2000001000 machine # [ 20.828640] k3s[885]: I1005 11:55:50.717640 885 storage_scheduling.go:137] created PriorityClass system-cluster-critical with value 2000000000 machine # [ 20.830444] k3s[885]: I1005 11:55:50.717671 885 storage_scheduling.go:153] all system priority classes are created successfully or already exist. machine # [ 21.278480] k3s[885]: time="2026-10-05T11:55:51Z" level=info msg="Polling for API server readiness: GET /readyz failed: unknown" machine # [ 21.926603] k3s[885]: I1005 11:55:51.815291 885 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io machine # [ 21.964727] k3s[885]: I1005 11:55:51.853529 885 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io machine # [ 22.083221] k3s[885]: I1005 11:55:51.972182 885 alloc.go:329] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.43.0.1"} machine # [ 22.088327] k3s[885]: W1005 11:55:51.977365 885 lease.go:265] Resetting endpoints for master service "kubernetes" to [10.0.2.15] machine # [ 22.090058] k3s[885]: I1005 11:55:51.978899 885 controller.go:667] quota admission added evaluator for: endpoints machine # [ 22.094304] k3s[885]: I1005 11:55:51.983337 885 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io machine # [ 23.282889] k3s[885]: time="2026-10-05T11:55:53Z" level=info msg="Kube API server is now running" machine # [ 23.284839] k3s[885]: time="2026-10-05T11:55:53Z" level=info msg="k3s is up and running" machine # [ 23.286320] k3s[885]: time="2026-10-05T11:55:53Z" level=info msg="Creating k3s-supervisor event broadcaster" machine # [ 23.287902] systemd[1]: Started k3s service. machine # [ 23.293165] systemd[1]: Starting niks3 server... machine # [ 23.294874] k3s[885]: time="2026-10-05T11:55:53Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Node and Certificate Authority certificates managed by k3s are OK" object=machine reason=CertificateExpirationOK type=Normal machine # [ 23.297294] k3s[885]: time="2026-10-05T11:55:53Z" level=info msg="Waiting for untainted node" machine # [ 23.316944] k3s[885]: E1005 11:55:53.205537 885 options.go:205] The manifest file is empty, ignoring. machine # [ 23.317825] k3s[885]: I1005 11:55:53.205814 885 controllermanager.go:204] "Starting" version="v1.36.4+k3s1" machine # [ 23.318665] k3s[885]: I1005 11:55:53.205831 885 controllermanager.go:206] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 23.322052] k3s[885]: I1005 11:55:53.210123 885 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 23.322896] k3s[885]: I1005 11:55:53.210223 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 23.323700] k3s[885]: I1005 11:55:53.210233 885 secure_serving.go:214] Serving securely on 127.0.0.1:10257 machine # [ 23.324229] k3s[885]: I1005 11:55:53.210270 885 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 23.324693] k3s[885]: I1005 11:55:53.210285 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 23.325428] k3s[885]: I1005 11:55:53.210311 885 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 23.325990] k3s[885]: I1005 11:55:53.210325 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 23.327435] k3s[885]: I1005 11:55:53.210315 885 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 23.328488] k3s[885]: I1005 11:55:53.210430 885 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key" machine # [ 23.334364] k3s[885]: I1005 11:55:53.222213 885 controller.go:667] quota admission added evaluator for: serviceaccounts machine # [ 23.337364] k3s[885]: W1005 11:55:53.226404 885 probe.go:275] Flexvolume plugin directory at /usr/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating. machine # [ 23.338458] k3s[885]: time="2026-10-05T11:55:53Z" level=info msg="Creating embedded CRD addons.k3s.cattle.io" machine # [ 23.343070] k3s[885]: time="2026-10-05T11:55:53Z" level=info msg="Creating embedded CRD etcdsnapshotfiles.k3s.cattle.io" machine # [ 23.351885] k3s[885]: I1005 11:55:53.240172 885 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="storageversion-garbage-collector-controller" requiredFeatureGates=["APIServerIdentity","StorageVersionAPI"] machine # [ 23.352660] k3s[885]: I1005 11:55:53.240221 885 controllermanager.go:641] "Warning: skipping controller" controller="storageversion-garbage-collector-controller" machine # [ 23.353160] k3s[885]: time="2026-10-05T11:55:53Z" level=info msg="Creating embedded CRD helmchartconfigs.helm.cattle.io" machine # [ 23.363980] k3s[885]: time="2026-10-05T11:55:53Z" level=info msg="Creating embedded CRD helmcharts.helm.cattle.io" machine # [ 23.378816] k3s[885]: I1005 11:55:53.267679 885 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 23.418286] k3s[885]: I1005 11:55:53.305435 885 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 23.423241] k3s[885]: I1005 11:55:53.312276 885 shared_informer.go:409] "Caches are synced" machine # [ 23.425858] k3s[885]: I1005 11:55:53.314905 885 shared_informer.go:409] "Caches are synced" machine # [ 23.427116] k3s[885]: I1005 11:55:53.316160 885 shared_informer.go:409] "Caches are synced" machine # [ 23.432512] k3s[885]: time="2026-10-05T11:55:53Z" level=info msg="Waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 23.448592] k3s[885]: time="2026-10-05T11:55:53Z" level=info msg="Done waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 23.449535] k3s[885]: time="2026-10-05T11:55:53Z" level=info msg="Waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 23.453129] k3s[885]: I1005 11:55:53.342144 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 23.457575] k3s[885]: I1005 11:55:53.346620 885 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 23.472778] k3s[885]: I1005 11:55:53.361291 885 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 23.514072] k3s[885]: I1005 11:55:53.403059 885 controllermanager.go:689] "Warning: controller is disabled" controller="selinux-warning-controller" machine: (finished: waiting for unit k3s.service, in 24.50 seconds) machine: waiting for success: kubectl get ns farm machine # [ 23.681730] k3s[885]: I1005 11:55:53.570736 885 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="podcertificaterequest-cleaner-controller" requiredFeatureGates=["PodCertificateRequest"] machine # [ 23.682575] k3s[885]: I1005 11:55:53.570767 885 controllermanager.go:641] "Warning: skipping controller" controller="podcertificaterequest-cleaner-controller" machine # [ 23.683031] k3s[885]: I1005 11:55:53.570780 885 controllermanager.go:689] "Warning: controller is disabled" controller="service-lb-controller" machine # [ 23.754525] k3s[885]: I1005 11:55:53.643474 885 shared_informer.go:409] "Caches are synced" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 23.962536] k3s[885]: time="2026-10-05T11:55:53Z" level=info msg="Done waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 23.963281] k3s[885]: time="2026-10-05T11:55:53Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-40.1.4+up40.1.0.tgz" machine # [ 23.963700] k3s[885]: time="2026-10-05T11:55:53Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-crd-40.1.4+up40.1.0.tgz" machine # [ 23.964152] k3s[885]: time="2026-10-05T11:55:53Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/ccm.yaml" machine # [ 23.964648] k3s[885]: time="2026-10-05T11:55:53Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/coredns.yaml" machine # [ 23.965401] k3s[885]: time="2026-10-05T11:55:53Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/local-storage.yaml" machine # [ 23.965890] k3s[885]: time="2026-10-05T11:55:53Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/rolebindings.yaml" machine # [ 23.966532] k3s[885]: time="2026-10-05T11:55:53Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/runtimes.yaml" machine # [ 23.967021] k3s[885]: time="2026-10-05T11:55:53Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/traefik.yaml" machine # [ 23.985281] k3s[885]: I1005 11:55:53.874268 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="networkpolicies.networking.k8s.io" machine # [ 23.986075] k3s[885]: I1005 11:55:53.874314 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="csistoragecapacities.storage.k8s.io" machine # [ 23.986435] k3s[885]: I1005 11:55:53.874343 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="resourceclaimtemplates.resource.k8s.io" machine # [ 23.986969] k3s[885]: I1005 11:55:53.874370 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="deployments.apps" machine # [ 23.987541] k3s[885]: I1005 11:55:53.874397 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="poddisruptionbudgets.policy" machine # [ 23.988480] k3s[885]: I1005 11:55:53.874430 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmchartconfigs.helm.cattle.io" machine # [ 23.989164] k3s[885]: I1005 11:55:53.874457 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpointslices.discovery.k8s.io" machine # [ 23.989661] k3s[885]: I1005 11:55:53.874500 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="podtemplates" machine # [ 23.990131] k3s[885]: I1005 11:55:53.874561 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="statefulsets.apps" machine # [ 23.990604] k3s[885]: I1005 11:55:53.874590 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="cronjobs.batch" machine # [ 23.991092] k3s[885]: I1005 11:55:53.874635 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="limitranges" machine # [ 23.991615] k3s[885]: I1005 11:55:53.874714 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="daemonsets.apps" machine # [ 23.992076] k3s[885]: I1005 11:55:53.874738 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="jobs.batch" machine # [ 23.992500] k3s[885]: I1005 11:55:53.874762 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="ingresses.networking.k8s.io" machine # [ 23.993020] k3s[885]: I1005 11:55:53.874788 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="roles.rbac.authorization.k8s.io" machine # [ 23.993448] k3s[885]: I1005 11:55:53.874823 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="controllerrevisions.apps" machine # [ 23.993938] k3s[885]: I1005 11:55:53.874847 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="horizontalpodautoscalers.autoscaling" machine # [ 23.994567] k3s[885]: I1005 11:55:53.874871 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="rolebindings.rbac.authorization.k8s.io" machine # [ 23.995031] k3s[885]: I1005 11:55:53.874894 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="leases.coordination.k8s.io" machine # [ 23.995453] k3s[885]: I1005 11:55:53.874919 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="addons.k3s.cattle.io" machine # [ 23.995986] k3s[885]: I1005 11:55:53.874948 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="serviceaccounts" machine # [ 23.996633] k3s[885]: I1005 11:55:53.874976 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpoints" machine # [ 23.997121] k3s[885]: I1005 11:55:53.875000 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="replicasets.apps" machine # [ 23.997615] k3s[885]: I1005 11:55:53.875025 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmcharts.helm.cattle.io" machine # [ 24.133551] k3s[885]: time="2026-10-05T11:55:54Z" level=info msg="Starting dynamiclistener CN filter node controller with SANs: [127.0.0.1 ::1 localhost machine 10.0.2.15 fec0::e89a:8f8e:54f:7d9c 10.43.0.1 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local]" machine # [ 24.134272] k3s[885]: time="2026-10-05T11:55:54Z" level=info msg="Tunnel server egress proxy mode: agent" machine # [ 24.431796] k3s[885]: I1005 11:55:54.320356 885 controllermanager.go:689] "Warning: controller is disabled" controller="node-route-controller" machine # [ 24.433604] k3s[885]: time="2026-10-05T11:55:54Z" level=info msg="Creating new TLS secret for kube-system/k3s-serving (count: 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__e89a_8f8e_54f_7d9c-cd8b8e:fec0::e89a:8f8e:54f:7d9c listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=720423ED4CAD642C9C0853F229427D83B5C2ADFB]" machine # [ 24.447401] k3s[885]: time="2026-10-05T11:55:54Z" level=info msg="Active TLS secret kube-system/k3s-serving (ver=238) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__e89a_8f8e_54f_7d9c-cd8b8e:fec0::e89a:8f8e:54f:7d9c listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=720423ED4CAD642C9C0853F229427D83B5C2ADFB]" machine # [ 24.582860] k3s[885]: I1005 11:55:54.471841 885 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="resourcepoolstatusrequest-controller" requiredFeatureGates=["DRAResourcePoolStatus"] machine # [ 24.583818] k3s[885]: I1005 11:55:54.471879 885 controllermanager.go:641] "Warning: skipping controller" controller="resourcepoolstatusrequest-controller" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 25.240191] k3s[885]: time="2026-10-05T11:55:55Z" level=info msg="Starting k3s.cattle.io/v1, Kind=Addon controller" machine # [ 25.241024] k3s[885]: time="2026-10-05T11:55:55Z" level=info msg="Creating deploy event broadcaster" machine # [ 25.246056] k3s[885]: time="2026-10-05T11:55:55Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 25.246691] k3s[885]: I1005 11:55:55.135092 885 controller.go:667] quota admission added evaluator for: addons.k3s.cattle.io machine # [ 25.247629] k3s[885]: time="2026-10-05T11:55:55Z" level=info msg="Creating helm-controller event broadcaster" machine # [ 25.249538] k3s[885]: time="2026-10-05T11:55:55Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 25.255053] k3s[885]: time="2026-10-05T11:55:55Z" level=info msg="Cluster dns configmap has been set successfully" machine # [ 25.258146] k3s[885]: time="2026-10-05T11:55:55Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=ApplyingManifest type=Normal machine # [ 25.332875] k3s[885]: I1005 11:55:55.221849 885 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" requiredFeatureGates=["ClusterTrustBundle"] machine # [ 25.333590] k3s[885]: I1005 11:55:55.221882 885 controllermanager.go:641] "Warning: skipping controller" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" machine # [ 25.486408] k3s[885]: time="2026-10-05T11:55:55Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=AppliedManifest type=Normal machine # [ 25.495762] k3s[885]: time="2026-10-05T11:55:55Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=ApplyingManifest type=Normal machine # [ 25.836590] k3s[885]: time="2026-10-05T11:55:55Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=AppliedManifest type=Normal machine # [ 25.844962] k3s[885]: time="2026-10-05T11:55:55Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=ApplyingManifest type=Normal machine # [ 25.880080] k3s[885]: I1005 11:55:55.769059 885 node_lifecycle_controller.go:402] "Controller will reconcile labels" logger="node-lifecycle-controller" machine # [ 25.881979] k3s[885]: I1005 11:55:55.769201 885 controllermanager.go:641] "Warning: skipping controller" controller="storage-version-migrator-controller" machine: (finished: waiting for success: kubectl get ns farm, in 2.54 seconds) machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key machine # [ 26.249456] k3s[885]: time="2026-10-05T11:55:56Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key, in 0.15 seconds) machine: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key machine # [ 26.359399] k3s[885]: I1005 11:55:56.247153 885 range_allocator.go:113] "No Secondary Service CIDR provided. Skipping filtering out secondary service addresses" logger="node-ipam-controller" machine # [ 26.418453] k3s[885]: I1005 11:55:56.307450 885 serving.go:417] Generated self-signed cert in-memory machine # [ 26.458064] k3s[885]: time="2026-10-05T11:55:56Z" level=info msg="Starting rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding controller" machine # [ 26.464276] k3s[885]: time="2026-10-05T11:55:56Z" level=info msg="Starting batch/v1, Kind=Job controller" machine # [ 26.465395] k3s[885]: time="2026-10-05T11:55:56Z" level=info msg="Starting /v1, Kind=Secret controller" machine # [ 26.466814] k3s[885]: time="2026-10-05T11:55:56Z" level=info msg="Starting /v1, Kind=ConfigMap controller" machine # [ 26.469102] k3s[885]: time="2026-10-05T11:55:56Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChart controller" machine # [ 26.469726] k3s[885]: time="2026-10-05T11:55:56Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChartConfig controller" machine # [ 26.470195] k3s[885]: time="2026-10-05T11:55:56Z" level=info msg="Starting /v1, Kind=ServiceAccount controller" machine # [ 26.485596] k3s[885]: I1005 11:55:56.374634 885 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="podgroup-protection-controller" requiredFeatureGates=["GenericWorkload"] machine # [ 26.486534] k3s[885]: I1005 11:55:56.375333 885 controllermanager.go:641] "Warning: skipping controller" controller="podgroup-protection-controller" machine # [ 26.497065] k3s[885]: I1005 11:55:56.384880 885 serving.go:417] Generated self-signed cert in-memory machine: (finished: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key, in 0.16 seconds) machine: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine # [ 26.585037] k3s[885]: I1005 11:55:56.473976 885 controllermanager.go:163] Version: v1.36.4+k3s1 machine # [ 26.588699] k3s[885]: I1005 11:55:56.477712 885 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 26.589508] k3s[885]: I1005 11:55:56.477776 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.590670] k3s[885]: I1005 11:55:56.479151 885 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 26.591448] k3s[885]: I1005 11:55:56.479183 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.592613] k3s[885]: I1005 11:55:56.481226 885 secure_serving.go:214] Serving securely on 127.0.0.1:10258 machine # [ 26.593221] k3s[885]: I1005 11:55:56.481776 885 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 26.596981] k3s[885]: I1005 11:55:56.477821 885 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 26.597666] k3s[885]: I1005 11:55:56.486046 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.601550] k3s[885]: time="2026-10-05T11:55:56Z" level=info msg="Creating service-lb-controller event broadcaster" machine # [ 26.663498] k3s[885]: I1005 11:55:56.552505 885 controller.go:667] quota admission added evaluator for: deployments.apps machine: (finished: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.15 seconds) subtest: chart deploys and workers become Ready machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine # [ 26.679571] k3s[885]: I1005 11:55:56.568558 885 controllermanager.go:689] "Warning: controller is disabled" controller="cloud-node-lifecycle-controller" machine # [ 26.689258] k3s[885]: I1005 11:55:56.578187 885 shared_informer.go:409] "Caches are synced" machine # [ 26.690634] k3s[885]: I1005 11:55:56.579663 885 shared_informer.go:409] "Caches are synced" machine # [ 26.697817] k3s[885]: I1005 11:55:56.586857 885 shared_informer.go:409] "Caches are synced" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 26.839154] k3s[885]: I1005 11:55:56.727706 885 alloc.go:329] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.43.0.10"} machine # [ 26.840217] k3s[885]: time="2026-10-05T11:55:56Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=AppliedManifest type=Normal machine # [ 26.876533] k3s[885]: time="2026-10-05T11:55:56Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 26.879355] k3s[885]: I1005 11:55:56.768351 885 controllermanager.go:689] "Warning: controller is disabled" controller="bootstrap-signer-controller" machine # [ 26.881530] k3s[885]: time="2026-10-05T11:55:56Z" level=info msg="Starting /v1, Kind=Pod controller" machine # [ 26.886331] k3s[885]: time="2026-10-05T11:55:56Z" level=info msg="Starting apps/v1, Kind=DaemonSet controller" machine # [ 26.892535] k3s[885]: time="2026-10-05T11:55:56Z" level=info msg="Starting discovery.k8s.io/v1, Kind=EndpointSlice controller" machine # [ 26.893230] k3s[885]: I1005 11:55:56.781787 885 controllermanager.go:338] Started "cloud-node-controller" machine # [ 26.893697] k3s[885]: I1005 11:55:56.781984 885 controllermanager.go:338] Started "cloud-node-lifecycle-controller" machine # [ 26.894249] k3s[885]: I1005 11:55:56.782446 885 controllermanager.go:338] Started "service-lb-controller" machine # [ 26.894724] k3s[885]: W1005 11:55:56.782461 885 controllermanager.go:315] "node-route-controller" is disabled machine # [ 26.895532] k3s[885]: I1005 11:55:56.783042 885 node_controller.go:179] Sending events to api server. machine # [ 26.896484] k3s[885]: I1005 11:55:56.783151 885 node_lifecycle_controller.go:112] Sending events to api server machine # [ 26.897382] k3s[885]: I1005 11:55:56.783291 885 node_controller.go:188] Waiting for informer caches to sync machine # [ 26.898506] k3s[885]: I1005 11:55:56.783406 885 controller.go:235] Starting service controller machine # [ 26.901048] k3s[885]: I1005 11:55:56.783424 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.095079] k3s[885]: I1005 11:55:56.983746 885 shared_informer.go:409] "Caches are synced" machine # [ 27.249576] k3s[885]: time="2026-10-05T11:55:57Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 27.429785] k3s[885]: time="2026-10-05T11:55:57Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" object=kube-system/local-storage reason=DeletingManifest type=Normal machine # [ 27.441454] k3s[885]: time="2026-10-05T11:55:57Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=ApplyingManifest type=Normal machine # [ 27.533780] k3s[885]: I1005 11:55:57.422482 885 controller.go:667] quota admission added evaluator for: helmcharts.helm.cattle.io machine # [ 27.538287] k3s[885]: time="2026-10-05T11:55:57Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=AppliedManifest type=Normal machine # [ 27.544373] k3s[885]: time="2026-10-05T11:55:57Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=ApplyingManifest type=Normal machine # [ 27.624533] k3s[885]: time="2026-10-05T11:55:57Z" level=info msg="Imported docker.io/library/nix-grpc-farm-client:0.1.0" machine # [ 27.626760] k3s[885]: time="2026-10-05T11:55:57Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-client@sha256:a10ede5ad033fa3bc3d556ecfc6295828a97e61bbfe8e1320a4ecdef4ffd8d10" machine # [ 27.684916] k3s[885]: time="2026-10-05T11:55:57Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Applying HelmChart from https://%{KUBERNETES_API}%/static/charts/nix-grpc-farm.tgz using Job kube-system/helm-install-nix-grpc-farm " object=kube-system/nix-grpc-farm reason=ApplyJob type=Normal machine # [ 27.702363] k3s[885]: I1005 11:55:57.591334 885 controller.go:667] quota admission added evaluator for: jobs.batch machine # [ 27.840230] k3s[885]: time="2026-10-05T11:55:57Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=AppliedManifest type=Normal machine # [ 27.857258] k3s[885]: time="2026-10-05T11:55:57Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=ApplyingManifest type=Normal machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 28.020195] k3s[885]: time="2026-10-05T11:55:57Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=AppliedManifest type=Normal machine # [ 28.037086] k3s[885]: I1005 11:55:57.925459 885 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-legacy-unknown" machine # [ 28.037793] k3s[885]: I1005 11:55:57.925494 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.038634] k3s[885]: I1005 11:55:57.926089 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.039240] k3s[885]: I1005 11:55:57.926213 885 attach_detach_controller.go:334] "Starting attach detach controller" machine # [ 28.039849] k3s[885]: I1005 11:55:57.926229 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.043662] k3s[885]: I1005 11:55:57.932702 885 expand_controller.go:328] "Starting expand controller" machine # [ 28.044392] k3s[885]: I1005 11:55:57.932759 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.046329] k3s[885]: I1005 11:55:57.935362 885 legacy_serviceaccount_token_cleaner.go:103] "Starting legacy service account token cleaner controller" machine # [ 28.047184] k3s[885]: I1005 11:55:57.935385 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.047931] k3s[885]: I1005 11:55:57.935432 885 namespace_controller.go:202] "Starting namespace controller" machine # [ 28.048549] k3s[885]: I1005 11:55:57.935464 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.052072] k3s[885]: I1005 11:55:57.941082 885 ttlafterfinished_controller.go:112] "Starting TTL after finished controller" machine # [ 28.052785] k3s[885]: I1005 11:55:57.941126 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.055369] k3s[885]: I1005 11:55:57.944174 885 controller.go:753] "Starting resource claim controller" machine # [ 28.056085] k3s[885]: I1005 11:55:57.944208 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.057603] k3s[885]: I1005 11:55:57.944276 885 device_taint_eviction.go:783] "Starting" controller="device-taint-eviction-controller" numWorkers=8 machine # [ 28.060119] k3s[885]: I1005 11:55:57.949143 885 stateful_set.go:234] "Starting stateful set controller" machine # [ 28.060825] k3s[885]: I1005 11:55:57.949167 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.062176] k3s[885]: I1005 11:55:57.951210 885 serviceaccounts_controller.go:117] "Starting service account controller" machine # [ 28.063639] k3s[885]: I1005 11:55:57.951983 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.064497] k3s[885]: I1005 11:55:57.952148 885 replica_set.go:285] "Starting controller" name="replicaset" machine # [ 28.065567] k3s[885]: I1005 11:55:57.952166 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.066416] k3s[885]: I1005 11:55:57.952211 885 certificate_controller.go:120] "Starting certificate controller" name="csrapproving" machine # [ 28.067196] k3s[885]: I1005 11:55:57.952230 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.068060] k3s[885]: I1005 11:55:57.952285 885 controller.go:174] "Starting ephemeral volume controller" machine # [ 28.068775] k3s[885]: I1005 11:55:57.952304 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.069485] k3s[885]: I1005 11:55:57.952415 885 endpointslicemirroring_controller.go:226] "Starting EndpointSliceMirroring controller" machine # [ 28.070463] k3s[885]: I1005 11:55:57.952444 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.071421] k3s[885]: I1005 11:55:57.952482 885 ttl_controller.go:127] "Starting TTL controller" machine # [ 28.072314] k3s[885]: I1005 11:55:57.952497 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.073196] k3s[885]: I1005 11:55:57.952530 885 clusterroleaggregation_controller.go:176] "Starting ClusterRoleAggregator controller" machine # [ 28.073811] k3s[885]: I1005 11:55:57.952544 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.074536] k3s[885]: I1005 11:55:57.952573 885 vac_protection_controller.go:206] "Starting VAC protection controller" machine # [ 28.075200] k3s[885]: I1005 11:55:57.952600 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.075483] k3s[885]: I1005 11:55:57.952715 885 publisher.go:107] "Starting root CA cert publisher controller" machine # [ 28.076264] k3s[885]: I1005 11:55:57.952729 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.076867] k3s[885]: I1005 11:55:57.952763 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.077575] k3s[885]: I1005 11:55:57.952800 885 taint_eviction.go:283] "Starting" controller="taint-eviction-controller" machine # [ 28.078219] k3s[885]: I1005 11:55:57.952852 885 taint_eviction.go:288] "Sending events to API server" machine # [ 28.078798] k3s[885]: I1005 11:55:57.952862 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.079395] k3s[885]: I1005 11:55:57.952942 885 endpoints_controller.go:193] "Starting endpoint controller" machine # [ 28.079963] k3s[885]: I1005 11:55:57.952955 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.080700] k3s[885]: I1005 11:55:57.953001 885 node_lifecycle_controller.go:436] "Sending events to api server" machine # [ 28.081242] k3s[885]: I1005 11:55:57.953026 885 node_lifecycle_controller.go:443] "Starting node controller" machine # [ 28.081820] k3s[885]: I1005 11:55:57.953036 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.082605] k3s[885]: I1005 11:55:57.953135 885 node_ipam_controller.go:142] "Starting ipam controller" machine # [ 28.083196] k3s[885]: I1005 11:55:57.953148 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.083765] k3s[885]: I1005 11:55:57.953229 885 endpointslice_controller.go:280] "Starting endpoint slice controller" machine # [ 28.084602] k3s[885]: I1005 11:55:57.953241 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.085138] k3s[885]: I1005 11:55:57.953308 885 replica_set.go:285] "Starting controller" name="replicationcontroller" machine # [ 28.085675] k3s[885]: I1005 11:55:57.953321 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.086291] k3s[885]: I1005 11:55:57.953360 885 gc_controller.go:98] "Starting GC controller" machine # [ 28.086817] k3s[885]: I1005 11:55:57.953372 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.087594] k3s[885]: I1005 11:55:57.953405 885 disruption.go:453] "Sending events to api server." machine # [ 28.088511] k3s[885]: I1005 11:55:57.953438 885 disruption.go:460] "Starting disruption controller" machine # [ 28.089023] k3s[885]: I1005 11:55:57.953448 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.089780] k3s[885]: I1005 11:55:57.953480 885 pvc_protection_controller.go:172] "Starting PVC protection controller" machine # [ 28.090520] k3s[885]: I1005 11:55:57.953492 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.091228] k3s[885]: I1005 11:55:57.953521 885 cleaner.go:83] "Starting CSR cleaner controller" machine # [ 28.091710] k3s[885]: I1005 11:55:57.953575 885 tokencleaner.go:117] "Starting token cleaner controller" machine # [ 28.092266] k3s[885]: I1005 11:55:57.953587 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.093144] k3s[885]: I1005 11:55:57.953657 885 daemon_controller.go:364] "Starting daemon sets controller" machine # [ 28.093835] k3s[885]: I1005 11:55:57.953669 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.094759] k3s[885]: I1005 11:55:57.953670 885 horizontal.go:204] "Starting HPA controller" machine # [ 28.095365] k3s[885]: I1005 11:55:57.953697 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.095909] k3s[885]: I1005 11:55:57.953785 885 cronjob_controllerv2.go:143] "Starting cronjob controller v2" machine # [ 28.096706] k3s[885]: I1005 11:55:57.953797 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.097277] k3s[885]: I1005 11:55:57.953871 885 pv_controller_base.go:318] "Starting persistent volume controller" machine # [ 28.097946] k3s[885]: I1005 11:55:57.953884 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.098461] k3s[885]: I1005 11:55:57.953918 885 pv_protection_controller.go:81] "Starting PV protection controller" machine # [ 28.099116] k3s[885]: I1005 11:55:57.953930 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.099424] k3s[885]: I1005 11:55:57.953997 885 deployment_controller.go:180] "Starting controller" controller="deployment" machine # [ 28.100072] k3s[885]: I1005 11:55:57.954011 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.100796] k3s[885]: I1005 11:55:57.954025 885 device_taint_eviction.go:823] "Sending events to api server" machine # [ 28.101471] k3s[885]: I1005 11:55:57.954054 885 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-serving" machine # [ 28.102141] k3s[885]: I1005 11:55:57.954066 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.102689] k3s[885]: I1005 11:55:57.954134 885 device_taint_eviction.go:1023] "Waiting" for="cache and event handler sync" machine # [ 28.103377] k3s[885]: I1005 11:55:57.954135 885 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-client" machine # [ 28.103914] k3s[885]: I1005 11:55:57.954150 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.104560] k3s[885]: I1005 11:55:57.954185 885 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kube-apiserver-client" machine # [ 28.104760] k3s[885]: I1005 11:55:57.954204 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.105597] k3s[885]: I1005 11:55:57.954205 885 job_controller.go:336] "Starting job controller" machine # [ 28.106185] k3s[885]: I1005 11:55:57.954221 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.106850] k3s[885]: I1005 11:55:57.954238 885 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 28.107690] k3s[885]: I1005 11:55:57.954406 885 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 28.109848] k3s[885]: I1005 11:55:57.954453 885 garbagecollector.go:141] "Starting controller" controller="garbagecollector" machine # [ 28.111567] k3s[885]: I1005 11:55:57.954455 885 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 28.156569] k3s[885]: I1005 11:55:57.954483 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.157185] k3s[885]: I1005 11:55:57.954539 885 servicecidrs_controller.go:137] "Starting" controller="service-cidr-controller" machine # [ 28.157715] k3s[885]: I1005 11:55:57.954552 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.158745] k3s[885]: I1005 11:55:57.954590 885 graph_builder.go:387] "Running" component="GraphBuilder" machine # [ 28.159334] k3s[885]: I1005 11:55:57.954627 885 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 28.161222] k3s[885]: I1005 11:55:57.954814 885 resource_quota_controller.go:297] "Starting resource quota controller" machine # [ 28.161907] k3s[885]: I1005 11:55:57.954830 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.162606] k3s[885]: I1005 11:55:57.954860 885 resource_quota_monitor.go:309] "QuotaMonitor running" machine # [ 28.163124] k3s[885]: time="2026-10-05T11:55:57Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nixos/avfxk2wil381mw0whld4ja3m1ic79vjx-nix-grpc-farm-client.tar in 7.789916035s" machine # [ 28.163579] k3s[885]: time="2026-10-05T11:55:57Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/djnarcp7bpn4whbzn22i5vvf30pdwipi-nix-grpc-farm-lb.tar" machine # [ 28.176444] k3s[885]: I1005 11:55:58.064894 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.179933] k3s[885]: I1005 11:55:58.068980 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.247598] k3s[885]: time="2026-10-05T11:55:58Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 28.375452] k3s[885]: time="2026-10-05T11:55:58Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/traefik.yaml\"" object=kube-system/traefik reason=DeletingManifest type=Normal machine # [ 28.378219] k3s[885]: I1005 11:55:58.267261 885 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.DeviceClass" machine # [ 28.382067] k3s[885]: I1005 11:55:58.270934 885 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceClaim" machine # [ 28.382705] k3s[885]: I1005 11:55:58.270977 885 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceClaim + event handler k8s.io/kubernetes/pkg/controller/devicetainteviction.(*Controller).Run" machine # [ 28.387055] k3s[885]: I1005 11:55:58.275972 885 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceSlice + event handler k8s.io/kubernetes/pkg/controller/devicetainteviction.(*Controller).Run" machine # [ 28.388478] k3s[885]: I1005 11:55:58.277379 885 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.Pod" machine # [ 28.390184] k3s[885]: I1005 11:55:58.277411 885 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.Pod + event handler k8s.io/kubernetes/pkg/controller/devicetainteviction.(*Controller).Run" machine # [ 28.390971] k3s[885]: I1005 11:55:58.278392 885 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceSlice" machine # [ 28.436799] k3s[885]: I1005 11:55:58.325804 885 shared_informer.go:409] "Caches are synced" machine # [ 28.438229] k3s[885]: I1005 11:55:58.327075 885 shared_informer.go:409] "Caches are synced" machine # [ 28.443717] k3s[885]: I1005 11:55:58.332757 885 shared_informer.go:409] "Caches are synced" machine # [ 28.444486] k3s[885]: I1005 11:55:58.332831 885 shared_informer.go:409] "Caches are synced" machine # [ 28.446705] k3s[885]: I1005 11:55:58.335754 885 shared_informer.go:409] "Caches are synced" machine # [ 28.447490] k3s[885]: I1005 11:55:58.335789 885 shared_informer.go:409] "Caches are synced" machine # [ 28.454344] k3s[885]: I1005 11:55:58.343165 885 shared_informer.go:409] "Caches are synced" machine # [ 28.455669] k3s[885]: I1005 11:55:58.344273 885 shared_informer.go:409] "Caches are synced" machine # [ 28.460849] k3s[885]: I1005 11:55:58.349874 885 shared_informer.go:409] "Caches are synced" machine # [ 28.463361] k3s[885]: I1005 11:55:58.352294 885 shared_informer.go:409] "Caches are synced" machine # [ 28.464488] k3s[885]: I1005 11:55:58.352318 885 shared_informer.go:409] "Caches are synced" machine # [ 28.465611] k3s[885]: I1005 11:55:58.352350 885 shared_informer.go:409] "Caches are synced" machine # [ 28.466797] k3s[885]: I1005 11:55:58.353393 885 shared_informer.go:409] "Caches are synced" machine # [ 28.467986] k3s[885]: I1005 11:55:58.353432 885 shared_informer.go:409] "Caches are synced" machine # [ 28.469160] k3s[885]: I1005 11:55:58.353461 885 shared_informer.go:409] "Caches are synced" machine # [ 28.470257] k3s[885]: I1005 11:55:58.353489 885 shared_informer.go:409] "Caches are synced" machine # [ 28.471388] k3s[885]: I1005 11:55:58.353498 885 shared_informer.go:409] "Caches are synced" machine # [ 28.472516] k3s[885]: I1005 11:55:58.353533 885 shared_informer.go:409] "Caches are synced" machine # [ 28.473655] k3s[885]: I1005 11:55:58.353575 885 shared_informer.go:409] "Caches are synced" machine # [ 28.474774] k3s[885]: I1005 11:55:58.353625 885 shared_informer.go:409] "Caches are synced" machine # [ 28.476090] k3s[885]: I1005 11:55:58.353670 885 shared_informer.go:409] "Caches are synced" machine # [ 28.476698] k3s[885]: I1005 11:55:58.353724 885 shared_informer.go:409] "Caches are synced" machine # [ 28.477171] k3s[885]: I1005 11:55:58.353793 885 shared_informer.go:409] "Caches are synced" machine # [ 28.477662] k3s[885]: I1005 11:55:58.353804 885 shared_informer.go:409] "Caches are synced" machine # [ 28.478232] k3s[885]: I1005 11:55:58.353834 885 shared_informer.go:409] "Caches are synced" machine # [ 28.478754] k3s[885]: I1005 11:55:58.353855 885 range_allocator.go:177] "Sending events to api server" machine # [ 28.479364] k3s[885]: I1005 11:55:58.353878 885 shared_informer.go:409] "Caches are synced" machine # [ 28.479894] k3s[885]: I1005 11:55:58.353888 885 range_allocator.go:181] "Starting range CIDR allocator" machine # [ 28.480531] k3s[885]: I1005 11:55:58.353900 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.481046] k3s[885]: I1005 11:55:58.353910 885 shared_informer.go:409] "Caches are synced" machine # [ 28.481529] k3s[885]: I1005 11:55:58.353921 885 shared_informer.go:409] "Caches are synced" machine # [ 28.482037] k3s[885]: I1005 11:55:58.353972 885 shared_informer.go:409] "Caches are synced" machine # [ 28.482503] k3s[885]: I1005 11:55:58.353998 885 shared_informer.go:409] "Caches are synced" machine # [ 28.483102] k3s[885]: I1005 11:55:58.354052 885 shared_informer.go:409] "Caches are synced" machine # [ 28.483636] k3s[885]: I1005 11:55:58.354066 885 shared_informer.go:409] "Caches are synced" machine # [ 28.484126] k3s[885]: I1005 11:55:58.354606 885 shared_informer.go:409] "Caches are synced" machine # [ 28.484607] k3s[885]: I1005 11:55:58.354893 885 shared_informer.go:409] "Caches are synced" machine # [ 28.485081] k3s[885]: I1005 11:55:58.355009 885 shared_informer.go:409] "Caches are synced" machine # [ 28.485568] k3s[885]: I1005 11:55:58.355042 885 shared_informer.go:409] "Caches are synced" machine # [ 28.486075] k3s[885]: I1005 11:55:58.355257 885 shared_informer.go:409] "Caches are synced" machine # [ 28.486562] k3s[885]: I1005 11:55:58.355560 885 shared_informer.go:409] "Caches are synced" machine # [ 28.487045] k3s[885]: I1005 11:55:58.355684 885 shared_informer.go:409] "Caches are synced" machine # [ 28.487571] k3s[885]: I1005 11:55:58.355727 885 shared_informer.go:409] "Caches are synced" machine # [ 28.488184] k3s[885]: I1005 11:55:58.358450 885 shared_informer.go:409] "Caches are synced" machine # [ 28.488738] k3s[885]: I1005 11:55:58.358632 885 shared_informer.go:409] "Caches are synced" machine # [ 28.489373] k3s[885]: I1005 11:55:58.370620 885 shared_informer.go:409] "Caches are synced" machine # [ 28.552136] k3s[885]: time="2026-10-05T11:55:58Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Deferred node password secret validation complete" object=machine reason=NodePasswordValidationComplete type=Normal machine # [ 28.784587] k3s[885]: I1005 11:55:58.673538 885 controller.go:667] quota admission added evaluator for: replicasets.apps machine # [ 28.985397] k3s[885]: I1005 11:55:58.874055 885 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 28.990931] k3s[885]: I1005 11:55:58.879952 885 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 29.059214] k3s[885]: time="2026-10-05T11:55:58Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Resumed synced Job kube-system/helm-install-nix-grpc-farm" object=kube-system/nix-grpc-farm reason=ResumeJob type=Normal machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 29.247889] k3s[885]: time="2026-10-05T11:55:59Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 29.376208] k3s[885]: I1005 11:55:59.265009 885 shared_informer.go:409] "Caches are synced" machine # [ 29.466527] k3s[885]: I1005 11:55:59.355501 885 shared_informer.go:409] "Caches are synced" machine # [ 29.467102] k3s[885]: I1005 11:55:59.355542 885 garbagecollector.go:166] "Garbage collector: all resource monitors have synced" machine # [ 29.467534] k3s[885]: I1005 11:55:59.355553 885 garbagecollector.go:169] "Proceeding to collect garbage" machine # [ 29.911981] k3s[885]: time="2026-10-05T11:55:59Z" level=info msg="Imported docker.io/library/nix-grpc-farm-lb:0.1.0" machine # [ 29.915884] k3s[885]: time="2026-10-05T11:55:59Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-lb@sha256:18ee6724be589622e1aee9d13c5121e7b2c992ca636c935ade90c66423e18f37" machine # [ 29.960965] k3s[885]: time="2026-10-05T11:55:59Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nixos/djnarcp7bpn4whbzn22i5vvf30pdwipi-nix-grpc-farm-lb.tar in 1.859637468s" machine # [ 29.963624] k3s[885]: time="2026-10-05T11:55:59Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/nywalrxw0a90pqlrajabviq1wjj4cqdk-nix-grpc-farm.tar" machine # [ 30.135663] niks3-server[1194]: 2026/10/05 11:56:00 INFO OIDC provider initialized name=kubernetes issuer=https://kubernetes.default.svc.cluster.local machine # [ 30.136304] niks3-server[1194]: 2026/10/05 11:56:00 INFO OIDC authentication enabled config=/nix/store/v0b0sqyzhrjsz48x3klf7b7vl89apzs0-niks3-oidc.json machine # [ 30.138045] niks3-server[1194]: 2026/10/05 11:56:00 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key machine # [ 30.168214] niks3-server[1194]: 2026/10/05 11:56:00 INFO Read proxy enabled — serving cache objects from S3 machine # [ 30.169080] niks3-server[1194]: 2026/10/05 11:56:00 INFO Using socket-activated listener address=0.0.0.0:5751 machine # [ 30.171487] niks3-server[1194]: 2026/10/05 11:56:00 INFO systemd watchdog enabled interval=15s machine # [ 30.173447] niks3-server[1194]: 2026/10/05 11:56:00 INFO Starting HTTP server address=0.0.0.0:5751 machine # [ 30.174964] systemd[1]: Started niks3 server. machine # [ 30.175814] systemd[1]: Reached target Multi-User System. machine # [ 30.176707] systemd[1]: Startup finished in 1.141s (kernel) + 3.685s (initrd) + 25.344s (userspace) = 30.172s. machine # [ 30.248649] k3s[885]: time="2026-10-05T11:56:00Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 31.251165] k3s[885]: time="2026-10-05T11:56:01Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 31.375964] k3s[885]: time="2026-10-05T11:56:01Z" level=info msg="Started tunnel to 10.0.2.15:6443" machine # [ 31.377399] k3s[885]: time="2026-10-05T11:56:01Z" level=info msg="Stopped tunnel to 127.0.0.1:6443" machine # [ 31.378356] k3s[885]: time="2026-10-05T11:56:01Z" level=info msg="Connecting to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 31.379266] k3s[885]: time="2026-10-05T11:56:01Z" level=info msg="Proxy done" err="context canceled" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 31.380182] k3s[885]: time="2026-10-05T11:56:01Z" level=info msg="error in remotedialer server [400]: websocket: close 1006 (abnormal closure): unexpected EOF" machine # [ 31.394289] k3s[885]: time="2026-10-05T11:56:01Z" level=info msg="Handling backend connection request [machine]" machine # [ 31.396814] k3s[885]: time="2026-10-05T11:56:01Z" level=info msg="Connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 31.397970] k3s[885]: time="2026-10-05T11:56:01Z" level=info msg="Remotedialer connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 32.251382] k3s[885]: time="2026-10-05T11:56:02Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 33.247600] k3s[885]: time="2026-10-05T11:56:03Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 34.248388] k3s[885]: time="2026-10-05T11:56:04Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 34.602318] k3s[885]: time="2026-10-05T11:56:04Z" level=info msg="Imported docker.io/library/nix-grpc-farm:0.1.0" machine # [ 34.607602] k3s[885]: time="2026-10-05T11:56:04Z" level=info msg="Tagged docker.io/library/nix-grpc-farm@sha256:b9746f9ef16afc579f50adaad38bb63f7178fbd8f1ae8bd041b024f2c4375457" machine # [ 34.996087] k3s[885]: time="2026-10-05T11:56:04Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nixos/nywalrxw0a90pqlrajabviq1wjj4cqdk-nix-grpc-farm.tar in 5.032461108s" machine # [ 35.000557] k3s[885]: time="2026-10-05T11:56:04Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/smddpgqzjvlqv3lx57wdzl7kma805fj0-k3s-airgap-images-amd64.tar.zst" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 35.249640] k3s[885]: time="2026-10-05T11:56:05Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 35.326896] k3s[885]: time="2026-10-05T11:56:05Z" level=info msg="Running kubelet --cloud-provider=external --config-dir=/var/lib/rancher/k3s/agent/etc/kubelet.conf.d --containerd=/run/k3s/containerd/containerd.sock --eviction-hard=nodefs.available<1%,imagefs.available<1% --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubelet.kubeconfig --node-ip=10.0.2.15,fec0::e89a:8f8e:54f:7d9c --node-labels= --read-only-port=0" machine # [ 35.332753] k3s[885]: Flag --containerd has been deprecated, This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed. machine # [ 35.344219] k3s[885]: I1005 11:56:05.233177 885 server.go:541] "Kubelet version" kubeletVersion="v1.36.4+k3s1" machine # [ 35.345190] k3s[885]: I1005 11:56:05.233253 885 server.go:543] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 35.345973] k3s[885]: I1005 11:56:05.233323 885 watchdog_linux.go:94] "Systemd watchdog is not enabled" machine # [ 35.346648] k3s[885]: I1005 11:56:05.233353 885 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." machine # [ 35.347627] k3s[885]: I1005 11:56:05.236594 885 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/agent/client-ca.crt" machine # [ 35.356385] k3s[885]: I1005 11:56:05.243901 885 server.go:1444] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" machine # [ 35.364163] k3s[885]: I1005 11:56:05.251675 885 server.go:804] "--cgroups-per-qos enabled, but --cgroup-root was not specified. Defaulting to /" machine # [ 35.364952] k3s[885]: I1005 11:56:05.251742 885 server.go:865] "NoSwap is set due to memorySwapBehavior not specified" memorySwapBehavior="" FailSwapOn=false machine # [ 35.365934] k3s[885]: I1005 11:56:05.252604 885 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] machine # [ 35.366669] k3s[885]: I1005 11:56:05.252651 885 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"machine","RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"MemoryReservationPolicy":"None","PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} machine # [ 35.367580] k3s[885]: I1005 11:56:05.253059 885 topology_manager.go:172] "Creating topology manager with none policy" machine # [ 35.368601] k3s[885]: I1005 11:56:05.253092 885 container_manager_linux.go:309] "Creating device plugin manager" machine # [ 35.369470] k3s[885]: I1005 11:56:05.253330 885 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" machine # [ 35.370149] k3s[885]: I1005 11:56:05.258325 885 state_mem.go:45] "Initialized" logger="CPUManager state memory" machine # [ 35.370824] k3s[885]: I1005 11:56:05.258666 885 kubelet.go:485] "Attempting to sync node with API server" machine # [ 35.371627] k3s[885]: I1005 11:56:05.258697 885 kubelet.go:386] "Adding static pod path" path="/var/lib/rancher/k3s/agent/pod-manifests" machine # [ 35.372427] k3s[885]: I1005 11:56:05.258759 885 kubelet.go:397] "Adding apiserver pod source" machine # [ 35.373139] k3s[885]: I1005 11:56:05.258785 885 apiserver.go:41] "Waiting for node sync before watching apiserver pods" machine # [ 35.375558] k3s[885]: I1005 11:56:05.264441 885 kuberuntime_manager.go:308] "Container runtime initialized" containerRuntime="containerd" version="2.3.4-k3s1.36" apiVersion="v1" machine # [ 35.377240] k3s[885]: I1005 11:56:05.265609 885 kubelet.go:1002] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" machine # [ 35.377740] k3s[885]: I1005 11:56:05.265665 885 kubelet.go:1029] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" machine # [ 35.401943] k3s[885]: I1005 11:56:05.290930 885 server.go:1280] "Started kubelet" machine # [ 35.403332] k3s[885]: I1005 11:56:05.292297 885 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 machine # [ 35.406143] k3s[885]: I1005 11:56:05.293532 885 server_v1.go:49] "podresources" method="list" useActivePods=true machine # [ 35.407169] k3s[885]: I1005 11:56:05.293898 885 server.go:264] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" machine # [ 35.407945] k3s[885]: I1005 11:56:05.291403 885 server.go:193] "Starting to listen" address="0.0.0.0" port=10250 machine # [ 35.410178] k3s[885]: I1005 11:56:05.299170 885 server.go:354] "Adding debug handlers to kubelet server" machine # [ 35.412319] k3s[885]: I1005 11:56:05.301332 885 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" machine # [ 35.413021] k3s[885]: I1005 11:56:05.301384 885 dynamic_serving_content.go:135] "Starting controller" name="kubelet-server-cert-files::/var/lib/rancher/k3s/agent/serving-kubelet.crt::/var/lib/rancher/k3s/agent/serving-kubelet.key" machine # [ 35.413617] k3s[885]: I1005 11:56:05.301415 885 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 35.414135] k3s[885]: I1005 11:56:05.302469 885 volume_manager.go:310] "Starting Kubelet Volume Manager" machine # [ 35.414696] k3s[885]: I1005 11:56:05.302780 885 desired_state_of_world_populator.go:146] "Desired state populator starts to run" machine # [ 35.415129] k3s[885]: I1005 11:56:05.302879 885 reconciler.go:29] "Reconciler: start to sync state" machine # [ 35.415635] k3s[885]: E1005 11:56:05.303675 885 kubelet_node_status.go:396] "Error getting the current node from lister" err="node \"machine\" not found" machine # [ 35.416139] k3s[885]: E1005 11:56:05.303759 885 kubelet.go:3516] "Unable to register mirror pod because node is not registered yet" err="node \"machine\" not found" node="machine" machine # [ 35.418916] k3s[885]: E1005 11:56:05.307938 885 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"machine\" not found" node="machine" machine # [ 35.430595] k3s[885]: I1005 11:56:05.319496 885 factory.go:222] Registration of the containerd container factory successfully machine # [ 35.431268] k3s[885]: I1005 11:56:05.319537 885 factory.go:222] Registration of the systemd container factory successfully machine # [ 35.431621] k3s[885]: I1005 11:56:05.319713 885 factory.go:220] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory machine # [ 35.436060] k3s[885]: E1005 11:56:05.322441 885 kubelet.go:1725] "Image garbage collection failed once. Stats initialization may not have completed yet" err="invalid capacity 0 on image filesystem" machine # [ 35.446668] k3s[885]: I1005 11:56:05.335707 885 cpu_manager.go:235] "Starting" policy="none" machine # [ 35.447034] k3s[885]: I1005 11:56:05.335726 885 cpu_manager.go:236] "Reconciling" reconcilePeriod="10s" machine # [ 35.447565] k3s[885]: I1005 11:56:05.335752 885 state_mem.go:45] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" machine # [ 35.453846] k3s[885]: I1005 11:56:05.342817 885 policy_none.go:50] "Start" machine # [ 35.454555] k3s[885]: I1005 11:56:05.342840 885 memory_manager.go:190] "Starting memorymanager" policy="None" machine # [ 35.454987] k3s[885]: I1005 11:56:05.342858 885 state_mem.go:40] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" machine # [ 35.460790] k3s[885]: I1005 11:56:05.349818 885 policy_none.go:44] "Start" machine # [ 35.467420] systemd[1]: Created slice libcontainer container kubepods.slice. machine # [ 35.481761] systemd[1]: Created slice libcontainer container kubepods-burstable.slice. machine # [ 35.485360] systemd[1]: Created slice libcontainer container kubepods-besteffort.slice. machine # [ 35.493331] k3s[885]: E1005 11:56:05.382328 885 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" machine # [ 35.494156] k3s[885]: I1005 11:56:05.382454 885 eviction_manager.go:194] "Eviction manager: starting control loop" machine # [ 35.495169] k3s[885]: I1005 11:56:05.382472 885 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" machine # [ 35.496089] k3s[885]: I1005 11:56:05.382891 885 plugin_manager.go:121] "Starting Kubelet Plugin Manager" machine # [ 35.497131] k3s[885]: E1005 11:56:05.385261 885 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="no imagefs label for configured runtime" machine # [ 35.498060] k3s[885]: E1005 11:56:05.385318 885 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"machine\" not found" machine # [ 35.514846] k3s[885]: E1005 11:56:05.403794 885 kubelet.go:3516] "Unable to register mirror pod because node is not registered yet" err="node \"machine\" not found" node="machine" machine # [ 35.595040] k3s[885]: I1005 11:56:05.484001 885 kubelet_node_status.go:75] "Attempting to register node" node="machine" machine # [ 35.603070] k3s[885]: I1005 11:56:05.489940 885 kubelet_node_status.go:78] "Successfully registered node" node="machine" machine # [ 35.603540] k3s[885]: E1005 11:56:05.489987 885 kubelet_node_status.go:479] "Error updating node status, will retry" err="error getting node \"machine\": node \"machine\" not found" machine # [ 35.604060] k3s[885]: I1005 11:56:05.490559 885 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"machine\" does not exist" machine # [ 35.604537] k3s[885]: time="2026-10-05T11:56:05Z" level=info msg="Adding node OwnerReference to node-password secret machine.node-password.k3s" machine # [ 35.605067] k3s[885]: I1005 11:56:05.492033 885 node_controller.go:432] Initializing node machine with cloud provider machine # [ 35.605643] k3s[885]: I1005 11:56:05.492090 885 node_controller.go:236] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 35.609154] k3s[885]: E1005 11:56:05.498178 885 node_controller.go:247] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 35.611025] k3s[885]: I1005 11:56:05.500051 885 node_controller.go:432] Initializing node machine with cloud provider machine # [ 35.611744] k3s[885]: I1005 11:56:05.500806 885 node_controller.go:236] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 35.613826] k3s[885]: E1005 11:56:05.501788 885 node_controller.go:247] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 35.614519] k3s[885]: I1005 11:56:05.500978 885 kuberuntime_manager.go:2172] "Updating runtime config through cri with podcidr" CIDR="10.42.0.0/24" machine # [ 35.618696] k3s[885]: I1005 11:56:05.507743 885 kubelet_network.go:48] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.42.0.0/24" machine # [ 35.620688] k3s[885]: I1005 11:56:05.509721 885 node_controller.go:432] Initializing node machine with cloud provider machine # [ 35.621475] k3s[885]: I1005 11:56:05.509779 885 node_controller.go:236] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 35.621962] k3s[885]: E1005 11:56:05.509797 885 node_controller.go:247] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 35.622680] k3s[885]: I1005 11:56:05.510873 885 node_controller.go:432] Initializing node machine with cloud provider machine # [ 35.623834] k3s[885]: I1005 11:56:05.510913 885 node_controller.go:236] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 35.624571] k3s[885]: E1005 11:56:05.510930 885 node_controller.go:247] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 35.625103] k3s[885]: I1005 11:56:05.509751 885 range_allocator.go:433] "Set node PodCIDR" node="machine" podCIDRs=["10.42.0.0/24"] machine # [ 35.629141] k3s[885]: I1005 11:56:05.518166 885 node_controller.go:432] Initializing node machine with cloud provider machine # [ 35.633418] k3s[885]: time="2026-10-05T11:56:05Z" level=info msg="Annotations and labels have been set successfully on node: machine" machine # [ 35.636055] k3s[885]: time="2026-10-05T11:56:05Z" level=info msg="Starting flannel with backend vxlan" machine # [ 35.649908] k3s[885]: I1005 11:56:05.538817 885 kubelet_network_linux.go:53] "Initialized iptables rules." protocol="IPv4" machine # [ 35.653911] k3s[885]: I1005 11:56:05.542671 885 node_controller.go:477] Successfully initialized node machine with cloud provider machine # [ 35.654526] k3s[885]: time="2026-10-05T11:56:05Z" level=info msg="Synced coredns NodeHosts entries for machine" machine # [ 35.655029] k3s[885]: I1005 11:56:05.543689 885 event.go:389] "Event occurred" object="machine" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="Synced" message="Node synced successfully" machine # [ 35.656397] k3s[885]: E1005 11:56:05.545435 885 options.go:205] The manifest file is empty, ignoring. machine # [ 35.657876] k3s[885]: I1005 11:56:05.546365 885 kubelet_network_linux.go:53] "Initialized iptables rules." protocol="IPv6" machine # [ 35.658504] k3s[885]: I1005 11:56:05.546390 885 status_manager.go:277] "Starting to sync pod status with apiserver" machine # [ 35.659035] k3s[885]: I1005 11:56:05.546428 885 kubelet.go:2622] "Starting kubelet main sync loop" machine # [ 35.659503] k3s[885]: E1005 11:56:05.546476 885 kubelet.go:2646] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" machine # [ 35.665449] k3s[885]: I1005 11:56:05.554362 885 server.go:176] "Starting Kubernetes Scheduler" version="v1.36.4+k3s1" machine # [ 35.666108] k3s[885]: I1005 11:56:05.554388 885 server.go:178] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 35.674563] k3s[885]: time="2026-10-05T11:56:05Z" level=info msg="Flannel found PodCIDR assigned for node machine" machine # [ 35.683345] k3s[885]: I1005 11:56:05.572385 885 secure_serving.go:214] Serving securely on 127.0.0.1:10259 machine # [ 35.684615] k3s[885]: I1005 11:56:05.572825 885 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 35.685478] k3s[885]: I1005 11:56:05.572853 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 35.686125] k3s[885]: I1005 11:56:05.572900 885 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 35.686519] k3s[885]: I1005 11:56:05.573019 885 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 35.687098] k3s[885]: time="2026-10-05T11:56:05Z" level=info msg="The interface eth0 with ipv4 address 10.0.2.15 will be used by flannel" machine # [ 35.692538] k3s[885]: I1005 11:56:05.576926 885 kube.go:139] Waiting 10m0s for node controller to sync machine # [ 35.693226] k3s[885]: I1005 11:56:05.577584 885 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 35.693897] k3s[885]: I1005 11:56:05.577605 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 35.694794] k3s[885]: I1005 11:56:05.577636 885 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 35.695379] k3s[885]: I1005 11:56:05.577650 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 35.696078] k3s[885]: I1005 11:56:05.578009 885 kube.go:537] Starting kube subnet manager machine # [ 35.754818] k3s[885]: I1005 11:56:05.643682 885 server.go:228] "Successfully retrieved NodeIPs" NodeIPs=["10.0.2.15","fec0::e89a:8f8e:54f:7d9c"] machine # [ 35.757055] k3s[885]: E1005 11:56:05.646061 885 server.go:265] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`" machine # [ 35.760646] k3s[885]: I1005 11:56:05.649669 885 kubelet_node_status.go:431] "Fast updating node status as it just became ready" machine # [ 35.769687] k3s[885]: I1005 11:56:05.658680 885 topologycache.go:237] "Can't get CPU or zone information for node" node="machine" machine # [ 35.784121] k3s[885]: I1005 11:56:05.673140 885 shared_informer.go:409] "Caches are synced" machine # [ 35.787964] k3s[885]: I1005 11:56:05.676984 885 server.go:274] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4" machine # [ 35.788536] k3s[885]: I1005 11:56:05.677038 885 server_linux.go:137] "Using iptables Proxier" machine # [ 35.789073] k3s[885]: I1005 11:56:05.677935 885 shared_informer.go:409] "Caches are synced" machine # [ 35.789515] k3s[885]: I1005 11:56:05.677939 885 shared_informer.go:409] "Caches are synced" machine # [ 35.830818] k3s[885]: I1005 11:56:05.719797 885 proxier.go:241] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4" machine # [ 35.846963] k3s[885]: I1005 11:56:05.735743 885 server.go:539] "Version info" version="v1.36.4+k3s1" machine # [ 35.848358] k3s[885]: I1005 11:56:05.735779 885 server.go:541] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 35.851147] k3s[885]: I1005 11:56:05.740058 885 config.go:403] "Starting serviceCIDR config controller" machine # [ 35.852805] k3s[885]: I1005 11:56:05.740293 885 shared_informer.go:381] "Waiting for caches to sync" controller="serviceCIDR config" machine # [ 35.857160] k3s[885]: I1005 11:56:05.740644 885 config.go:200] "Starting service config controller" machine # [ 35.858431] k3s[885]: I1005 11:56:05.740664 885 shared_informer.go:381] "Waiting for caches to sync" controller="service config" machine # [ 35.860033] k3s[885]: I1005 11:56:05.740695 885 config.go:106] "Starting endpoint slice config controller" machine # [ 35.861320] k3s[885]: I1005 11:56:05.740710 885 shared_informer.go:381] "Waiting for caches to sync" controller="endpoint slice config" machine # [ 35.862940] k3s[885]: I1005 11:56:05.741458 885 config.go:309] "Starting node config controller" machine # [ 35.864231] k3s[885]: I1005 11:56:05.741498 885 shared_informer.go:381] "Waiting for caches to sync" controller="node config" machine # [ 35.951923] k3s[885]: I1005 11:56:05.840903 885 shared_informer.go:388] "Caches are synced" controller="service config" machine # [ 35.953656] k3s[885]: I1005 11:56:05.842156 885 shared_informer.go:388] "Caches are synced" controller="node config" machine # [ 36.052285] k3s[885]: I1005 11:56:05.941037 885 shared_informer.go:388] "Caches are synced" controller="endpoint slice config" machine # [ 36.055427] k3s[885]: I1005 11:56:05.941182 885 shared_informer.go:388] "Caches are synced" controller="serviceCIDR config" machine # [ 36.253588] k3s[885]: time="2026-10-05T11:56:06Z" level=info msg="Labels and annotations have been set successfully on node: machine" machine # [ 36.291645] k3s[885]: time="2026-10-05T11:56:06Z" level=info msg="Tunnel authorizer set Kubelet Port 0.0.0.0:10250" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 36.371582] k3s[885]: I1005 11:56:06.260454 885 apiserver.go:51] "Watching apiserver" machine # [ 36.423105] systemd[1]: Created slice libcontainer container kubepods-burstable-pod4ab46f47_d6e7_4a0a_a39f_6948b944460c.slice. machine # [ 36.436555] systemd[1]: Created slice libcontainer container kubepods-burstable-pod3acdb32d_b2e2_48fd_8ad3_792ecd5de879.slice. machine # [ 36.448113] k3s[885]: I1005 11:56:06.336354 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/3acdb32d-b2e2-48fd-8ad3-792ecd5de879-klipper-helm\") pod \"helm-install-nix-grpc-farm-7pvh7\" (UID: \"3acdb32d-b2e2-48fd-8ad3-792ecd5de879\") " pod="kube-system/helm-install-nix-grpc-farm-7pvh7" machine # [ 36.448850] k3s[885]: I1005 11:56:06.336414 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/3acdb32d-b2e2-48fd-8ad3-792ecd5de879-klipper-cache\") pod \"helm-install-nix-grpc-farm-7pvh7\" (UID: \"3acdb32d-b2e2-48fd-8ad3-792ecd5de879\") " pod="kube-system/helm-install-nix-grpc-farm-7pvh7" machine # [ 36.449578] k3s[885]: I1005 11:56:06.336456 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"values\" (UniqueName: \"kubernetes.io/projected/3acdb32d-b2e2-48fd-8ad3-792ecd5de879-values\") pod \"helm-install-nix-grpc-farm-7pvh7\" (UID: \"3acdb32d-b2e2-48fd-8ad3-792ecd5de879\") " pod="kube-system/helm-install-nix-grpc-farm-7pvh7" machine # [ 36.449958] k3s[885]: I1005 11:56:06.336502 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slvqs\" (UniqueName: \"kubernetes.io/projected/3acdb32d-b2e2-48fd-8ad3-792ecd5de879-kube-api-access-slvqs\") pod \"helm-install-nix-grpc-farm-7pvh7\" (UID: \"3acdb32d-b2e2-48fd-8ad3-792ecd5de879\") " pod="kube-system/helm-install-nix-grpc-farm-7pvh7" machine # [ 36.450701] k3s[885]: I1005 11:56:06.336549 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/3acdb32d-b2e2-48fd-8ad3-792ecd5de879-klipper-config\") pod \"helm-install-nix-grpc-farm-7pvh7\" (UID: \"3acdb32d-b2e2-48fd-8ad3-792ecd5de879\") " pod="kube-system/helm-install-nix-grpc-farm-7pvh7" machine # [ 36.452070] k3s[885]: I1005 11:56:06.336579 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3acdb32d-b2e2-48fd-8ad3-792ecd5de879-tmp\") pod \"helm-install-nix-grpc-farm-7pvh7\" (UID: \"3acdb32d-b2e2-48fd-8ad3-792ecd5de879\") " pod="kube-system/helm-install-nix-grpc-farm-7pvh7" machine # [ 36.452693] k3s[885]: I1005 11:56:06.336607 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"content\" (UniqueName: \"kubernetes.io/configmap/3acdb32d-b2e2-48fd-8ad3-792ecd5de879-content\") pod \"helm-install-nix-grpc-farm-7pvh7\" (UID: \"3acdb32d-b2e2-48fd-8ad3-792ecd5de879\") " pod="kube-system/helm-install-nix-grpc-farm-7pvh7" machine # [ 36.453001] k3s[885]: I1005 11:56:06.336649 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4ab46f47-d6e7-4a0a-a39f-6948b944460c-config-volume\") pod \"coredns-54996dc9b4-lbrhl\" (UID: \"4ab46f47-d6e7-4a0a-a39f-6948b944460c\") " pod="kube-system/coredns-54996dc9b4-lbrhl" machine # [ 36.453589] k3s[885]: I1005 11:56:06.336682 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ab46f47-d6e7-4a0a-a39f-6948b944460c-custom-config-volume\") pod \"coredns-54996dc9b4-lbrhl\" (UID: \"4ab46f47-d6e7-4a0a-a39f-6948b944460c\") " pod="kube-system/coredns-54996dc9b4-lbrhl" machine # [ 36.455164] k3s[885]: I1005 11:56:06.336727 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l959s\" (UniqueName: \"kubernetes.io/projected/4ab46f47-d6e7-4a0a-a39f-6948b944460c-kube-api-access-l959s\") pod \"coredns-54996dc9b4-lbrhl\" (UID: \"4ab46f47-d6e7-4a0a-a39f-6948b944460c\") " pod="kube-system/coredns-54996dc9b4-lbrhl" machine # [ 36.515085] k3s[885]: I1005 11:56:06.403880 885 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" machine # [ 36.688643] k3s[885]: I1005 11:56:06.577656 885 kube.go:163] Node controller sync successful machine # [ 36.689972] k3s[885]: I1005 11:56:06.577771 885 vxlan.go:128] VXLAN config: VNI=1 Port=0 GBP=false Learning=false DirectRouting=false machine # [ 36.692520] k3s[885]: I1005 11:56:06.581467 885 kube.go:704] List of node(machine) annotations: map[string]string{"alpha.kubernetes.io/provided-node-ip":"10.0.2.15,fec0::e89a:8f8e:54f:7d9c", "k3s.io/hostname":"machine", "k3s.io/internal-ip":"10.0.2.15,fec0::e89a:8f8e:54f:7d9c", "k3s.io/node-args":"[\"server\",\"--disable\",\"traefik\",\"--disable\",\"metrics-server\",\"--disable\",\"local-storage\",\"--kubelet-arg\",\"eviction-hard=nodefs.available\\u003c1%,imagefs.available\\u003c1%\"]", "k3s.io/node-config-hash":"EFXPOZ7ZWHRCLFNW4X4ZDPFQMSAOP3BLEIN2VE47TDRKQ4UIWKUQ====", "k3s.io/node-env":"{}", "node.alpha.kubernetes.io/ttl":"0", "volumes.kubernetes.io/controller-managed-attach-detach":"true"} machine # [ 36.732302] k3s[885]: I1005 11:56:06.621277 885 kube.go:558] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.42.0.0/24] machine # [ 36.733246] k3s[885]: I1005 11:56:06.621445 885 iptables.go:50] Starting flannel in iptables mode... machine # [ 36.735304] k3s[885]: time="2026-10-05T11:56:06Z" level=warning msg="no subnet found for key: FLANNEL_NETWORK in file: /run/flannel/subnet.env" machine # [ 36.736028] k3s[885]: time="2026-10-05T11:56:06Z" level=warning msg="no subnet found for key: FLANNEL_SUBNET in file: /run/flannel/subnet.env" machine # [ 36.737322] k3s[885]: time="2026-10-05T11:56:06Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_NETWORK in file: /run/flannel/subnet.env" machine # [ 36.738412] k3s[885]: time="2026-10-05T11:56:06Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_SUBNET in file: /run/flannel/subnet.env" machine # [ 36.739146] k3s[885]: I1005 11:56:06.624352 885 iptables.go:101] Current network or subnet (10.42.0.0/16, 10.42.0.0/24) is not equal to previous one (0.0.0.0/0, 0.0.0.0/0), trying to recycle old iptables rules machine # [ 36.792267] (udev-worker)[1481]: Network interface NamePolicy= disabled on kernel command line. machine # [ 36.824264] dhcpcd[690]: flannel.1: IAID f5:41:24:13 machine # [ 36.825130] dhcpcd[690]: flannel.1: adding address fe80::dc65:f5ff:fe41:2413 machine # [ 36.843700] k3s[885]: I1005 11:56:06.732710 885 iptables.go:111] Setting up masking rules machine # [ 36.865549] k3s[885]: I1005 11:56:06.754570 885 iptables.go:212] Changing default FORWARD chain policy to ACCEPT machine # [ 36.874903] k3s[885]: E1005 11:56:06.763786 885 remote_runtime.go:237] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7ee503a6608f6cb9cb10f9b2787cd555ea88430a02e34acb4e99716356308d3f\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" machine # [ 36.875921] k3s[885]: E1005 11:56:06.763978 885 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7ee503a6608f6cb9cb10f9b2787cd555ea88430a02e34acb4e99716356308d3f\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-54996dc9b4-lbrhl" machine # [ 36.876552] k3s[885]: E1005 11:56:06.764014 885 kuberuntime_manager.go:1640] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"7ee503a6608f6cb9cb10f9b2787cd555ea88430a02e34acb4e99716356308d3f\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-54996dc9b4-lbrhl" machine # [ 36.877471] k3s[885]: time="2026-10-05T11:56:06Z" level=info msg="Wrote flannel subnet file to /run/flannel/subnet.env" machine # [ 36.878549] k3s[885]: time="2026-10-05T11:56:06Z" level=info msg="Running flannel backend" machine # [ 36.879549] k3s[885]: I1005 11:56:06.765542 885 vxlan_network.go:68] watching for new subnet leases machine # [ 36.880433] k3s[885]: I1005 11:56:06.765578 885 vxlan_network.go:115] starting vxlan device watcher machine # [ 36.892880] k3s[885]: E1005 11:56:06.781857 885 pod_workers.go:1338] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-54996dc9b4-lbrhl_kube-system(4ab46f47-d6e7-4a0a-a39f-6948b944460c)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-54996dc9b4-lbrhl_kube-system(4ab46f47-d6e7-4a0a-a39f-6948b944460c)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"7ee503a6608f6cb9cb10f9b2787cd555ea88430a02e34acb4e99716356308d3f\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-54996dc9b4-lbrhl" podUID="4ab46f47-d6e7-4a0a-a39f-6948b944460c" machine # [ 36.904082] k3s[885]: E1005 11:56:06.793046 885 remote_runtime.go:237] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"caccbf3a0ee46201a7c2b1976871cf21b739a39c7ba1bde38f72c3c56bb84f7e\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" machine # [ 36.904716] k3s[885]: E1005 11:56:06.793166 885 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"caccbf3a0ee46201a7c2b1976871cf21b739a39c7ba1bde38f72c3c56bb84f7e\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/helm-install-nix-grpc-farm-7pvh7" machine # [ 36.905346] k3s[885]: E1005 11:56:06.793263 885 kuberuntime_manager.go:1640] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"caccbf3a0ee46201a7c2b1976871cf21b739a39c7ba1bde38f72c3c56bb84f7e\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/helm-install-nix-grpc-farm-7pvh7" machine # [ 36.905985] k3s[885]: E1005 11:56:06.793365 885 pod_workers.go:1338] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"helm-install-nix-grpc-farm-7pvh7_kube-system(3acdb32d-b2e2-48fd-8ad3-792ecd5de879)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"helm-install-nix-grpc-farm-7pvh7_kube-system(3acdb32d-b2e2-48fd-8ad3-792ecd5de879)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"caccbf3a0ee46201a7c2b1976871cf21b739a39c7ba1bde38f72c3c56bb84f7e\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/helm-install-nix-grpc-farm-7pvh7" podUID="3acdb32d-b2e2-48fd-8ad3-792ecd5de879" machine # [ 36.947984] k3s[885]: I1005 11:56:06.836960 885 iptables.go:358] bootstrap done machine # [ 37.007388] k3s[885]: I1005 11:56:06.896388 885 iptables.go:358] bootstrap done machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 37.829505] dhcpcd[690]: flannel.1: soliciting a DHCP lease machine # [ 37.830295] k3s[885]: time="2026-10-05T11:56:07Z" level=info msg="Starting network policy controller version v2.6.3-k3s1, built on 1970-01-01T01:01:01Z, go1.26.7" machine # [ 37.830888] k3s[885]: I1005 11:56:07.718687 885 network_policy_controller.go:164] Starting network policy controller machine # [ 38.000938] k3s[885]: I1005 11:56:07.889919 885 network_policy_controller.go:179] Starting network policy controller full sync goroutine machine # [ 38.468913] k3s[885]: I1005 11:56:08.357863 885 node_lifecycle_controller.go:1217] "Initializing eviction metric for zone" zone="" machine # [ 38.470245] k3s[885]: I1005 11:56:08.357978 885 node_lifecycle_controller.go:869] "Missing timestamp for Node. Assuming now as a timestamp" node="machine" machine # [ 38.471514] k3s[885]: I1005 11:56:08.358066 885 node_lifecycle_controller.go:1063] "Controller detected that zone is now in new state" zone="" newState="Normal" machine # [ 38.626685] dhcpcd[690]: flannel.1: soliciting an IPv6 router machine # [ 38.629426] k3s[885]: time="2026-10-05T11:56:08Z" level=info msg="Imported docker.io/rancher/klipper-helm:v0.13.3-build20260727" machine # [ 38.633033] k3s[885]: time="2026-10-05T11:56:08Z" level=info msg="Tagged docker.io/rancher/klipper-helm@sha256:5425a2b4613d2458dbdff99218e8d487ebb59c20e7a941f061c0777070f0aac1" machine # [ 38.633726] k3s[885]: time="2026-10-05T11:56:08Z" level=info msg="Imported docker.io/rancher/klipper-lb:v0.4.17" machine # [ 38.636651] k3s[885]: time="2026-10-05T11:56:08Z" level=info msg="Tagged docker.io/rancher/klipper-lb@sha256:910944bb0bd94f060a82a56ca1ea1c577d3e49b3473a093a47a985f32e92d94a" machine # [ 38.637465] k3s[885]: time="2026-10-05T11:56:08Z" level=info msg="Imported docker.io/rancher/local-path-provisioner:v0.0.37" machine # [ 38.640496] k3s[885]: time="2026-10-05T11:56:08Z" level=info msg="Tagged docker.io/rancher/local-path-provisioner@sha256:e757967a5ec338f6a9b371c5a9688bedaa8c3578ea3dd4db329ea0084be0a86f" machine # [ 38.640948] k3s[885]: time="2026-10-05T11:56:08Z" level=info msg="Imported docker.io/rancher/mirrored-coredns-coredns:1.14.6" machine # [ 38.646670] k3s[885]: time="2026-10-05T11:56:08Z" level=info msg="Tagged docker.io/rancher/mirrored-coredns-coredns@sha256:900f9c109f7a33545d3c811516e8376df9019147b750f5ce3e254468769176ea" machine # [ 38.647484] k3s[885]: time="2026-10-05T11:56:08Z" level=info msg="Imported docker.io/rancher/mirrored-library-busybox:1.37.0" machine # [ 38.652682] k3s[885]: time="2026-10-05T11:56:08Z" level=info msg="Tagged docker.io/rancher/mirrored-library-busybox@sha256:101b4afd76732482eff9b95cae5f94bcf295e521fbec4e01b69c5421f3f3f3e5" machine # [ 38.653511] k3s[885]: time="2026-10-05T11:56:08Z" level=info msg="Imported docker.io/rancher/mirrored-library-traefik:3.7.8" machine # [ 38.657880] k3s[885]: time="2026-10-05T11:56:08Z" level=info msg="Tagged docker.io/rancher/mirrored-library-traefik@sha256:4299bbed850421258fc5448c2e0e6ad350981d4d335a68de11b92448aedbefe5" machine # [ 38.658541] k3s[885]: time="2026-10-05T11:56:08Z" level=info msg="Imported docker.io/rancher/mirrored-metrics-server:v0.9.0" machine # [ 38.665638] k3s[885]: time="2026-10-05T11:56:08Z" level=info msg="Tagged docker.io/rancher/mirrored-metrics-server@sha256:d9862115e7c7881280d3d75ca26bda8ffc0fc213315979575bf23ce9826205c0" machine # [ 38.666121] k3s[885]: time="2026-10-05T11:56:08Z" level=info msg="Imported docker.io/rancher/mirrored-pause:3.10.2" machine # [ 38.675307] k3s[885]: time="2026-10-05T11:56:08Z" level=info msg="Tagged docker.io/rancher/mirrored-pause@sha256:f548e0e8e3dc1896ca956272154dde3314e8cc4fde0a57577ee9fa1c63f5baf4" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 38.976584] k3s[885]: time="2026-10-05T11:56:08Z" level=info msg="Imported 8 images from /var/lib/rancher/k3s/agent/images/nixos/smddpgqzjvlqv3lx57wdzl7kma805fj0-k3s-airgap-images-amd64.tar.zst in 3.979628416s" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 42.830786] dhcpcd[690]: flannel.1: probing for an IPv4LL address machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 47.025995] dhcpcd[690]: flannel.1: using IPv4LL address 169.254.226.166 machine # [ 47.027673] dhcpcd[690]: flannel.1: adding route to 169.254.0.0/16 machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 48.859958] cni0: port 1(vethea52c191) entered blocking state machine # [ 48.860646] cni0: port 1(vethea52c191) entered disabled state machine # [ 48.861736] vethea52c191: entered allmulticast mode machine # [ 48.862549] vethea52c191: entered promiscuous mode machine # [ 48.871609] cni0: port 1(vethea52c191) entered blocking state machine # [ 48.872288] cni0: port 1(vethea52c191) entered forwarding state machine # [ 48.739483] (udev-worker)[1881]: Network interface NamePolicy= disabled on kernel command line. machine # [ 48.743742] (udev-worker)[1884]: Network interface NamePolicy= disabled on kernel command line. machine # [ 48.767996] dhcpcd[690]: vethea52c191: IAID a7:0e:63:b3 machine # [ 48.768720] dhcpcd[690]: vethea52c191: adding address fe80::6874:a7ff:fe0e:63b3 machine # [ 48.784428] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount1790251887.mount: Deactivated successfully. machine # [ 48.856555] systemd[1]: Started libcontainer container 333a7fa5dab700d32e574d0e9e3ac2c6d984b577d476c1507f7034eef5eb71be. machine # [ 49.732600] systemd[1]: Started libcontainer container c7cfebda639707f78df9a9f4bdc7b3d83c33e474275e2c1950b6678c46a2a9d4. machine # [ 49.813250] k3s[885]: I1005 11:56:19.701884 885 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/helm-install-nix-grpc-farm-7pvh7" podStartSLOduration=20.701861963 podStartE2EDuration="20.701861963s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-05 11:55:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-05 11:56:19.701716414 +0000 UTC m=+32.683014458" watchObservedRunningTime="2026-10-05 11:56:19.701861963 +0000 UTC m=+32.683160007" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 50.274694] dhcpcd[690]: vethea52c191: soliciting a DHCP lease machine # [ 50.336681] dhcpcd[690]: vethea52c191: soliciting an IPv6 router machine # [ 50.631815] dhcpcd[690]: flannel.1: no IPv6 Routers available machine # [ 50.803090] k3s[885]: I1005 11:56:20.691498 885 alloc.go:329] "allocated clusterIPs" service="farm/nix-grpc-farm" clusterIPs={"IPv4":"10.43.49.11"} machine # [ 50.846868] systemd[1]: cri-containerd-c7cfebda639707f78df9a9f4bdc7b3d83c33e474275e2c1950b6678c46a2a9d4.scope: Deactivated successfully. machine # [ 50.848765] systemd[1]: cri-containerd-c7cfebda639707f78df9a9f4bdc7b3d83c33e474275e2c1950b6678c46a2a9d4.scope: Consumed 707ms CPU time over 1.114s wall clock time, 32.8M memory peak, 2.6M incoming IP traffic, 151.6K outgoing IP traffic. machine # [ 50.886767] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-c7cfebda639707f78df9a9f4bdc7b3d83c33e474275e2c1950b6678c46a2a9d4-rootfs.mount: Deactivated successfully. machine # [ 51.034649] k3s[885]: E1005 11:56:20.923322 885 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-scheduler-7c7595b89b\" failed with read version: 458 is not as new as written version: 464 for group resource replicasets.apps" logger="UnhandledError" machine # [ 51.050168] k3s[885]: E1005 11:56:20.938582 885 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-lb-6b9475456\" failed with read version: 464 is not as new as written version: 468 for group resource replicasets.apps" logger="UnhandledError" machine # [ 51.050835] k3s[885]: E1005 11:56:20.939066 885 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658\" failed with read version: 464 is not as new as written version: 471 for group resource replicasets.apps" logger="UnhandledError" machine # [ 51.055969] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod9ec604cf_ec37_40d5_af96_1278ed2fc49d.slice. machine # [ 51.056687] k3s[885]: E1005 11:56:20.941811 885 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-scheduler-7c7595b89b\" failed with read version: 464 is not as new as written version: 472 for group resource replicasets.apps" logger="UnhandledError" machine # [ 51.057462] k3s[885]: E1005 11:56:20.946502 885 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-lb-6b9475456\" failed with read version: 464 is not as new as written version: 468 for group resource replicasets.apps" logger="UnhandledError" machine # [ 51.057925] k3s[885]: E1005 11:56:20.946592 885 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658\" failed with read version: 464 is not as new as written version: 471 for group resource replicasets.apps" logger="UnhandledError" machine # [ 51.058518] k3s[885]: E1005 11:56:20.946926 885 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-scheduler-7c7595b89b\" failed with read version: 464 is not as new as written version: 472 for group resource replicasets.apps" logger="UnhandledError" machine # [ 51.081345] k3s[885]: E1005 11:56:20.970152 885 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658\" failed with read version: 472 is not as new as written version: 478 for group resource replicasets.apps" logger="UnhandledError" machine # [ 51.082041] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod19ca7158_1589_41b2_bd51_569f5c05f11d.slice. machine # [ 51.097424] systemd[1]: Created slice libcontainer container kubepods-besteffort-podaff74d9f_1bd1_4cc8_9bfa_9f833bb8acc6.slice. machine # [ 51.111559] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod3c2dac77_367d_4f5d_8d15_18514389619f.slice. machine # [ 51.169186] k3s[885]: I1005 11:56:21.058207 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/9ec604cf-ec37-40d5-af96-1278ed2fc49d-build\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-q597q\" (UID: \"9ec604cf-ec37-40d5-af96-1278ed2fc49d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-q597q" machine # [ 51.169958] k3s[885]: I1005 11:56:21.058259 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19ca7158-1589-41b2-bd51-569f5c05f11d-tmp\") pod \"nix-grpc-farm-lb-6b9475456-4zs7x\" (UID: \"19ca7158-1589-41b2-bd51-569f5c05f11d\") " pod="farm/nix-grpc-farm-lb-6b9475456-4zs7x" machine # [ 51.170514] k3s[885]: I1005 11:56:21.058288 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/aff74d9f-1bd1-4cc8-9bfa-9f833bb8acc6-ca\") pod \"nix-grpc-farm-scheduler-7c7595b89b-ff9bg\" (UID: \"aff74d9f-1bd1-4cc8-9bfa-9f833bb8acc6\") " pod="farm/nix-grpc-farm-scheduler-7c7595b89b-ff9bg" machine # [ 51.171062] k3s[885]: I1005 11:56:21.058324 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/aff74d9f-1bd1-4cc8-9bfa-9f833bb8acc6-oidc\") pod \"nix-grpc-farm-scheduler-7c7595b89b-ff9bg\" (UID: \"aff74d9f-1bd1-4cc8-9bfa-9f833bb8acc6\") " pod="farm/nix-grpc-farm-scheduler-7c7595b89b-ff9bg" machine # [ 51.171531] k3s[885]: I1005 11:56:21.058400 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/3c2dac77-367d-4f5d-8d15-18514389619f-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-7kq4k\" (UID: \"3c2dac77-367d-4f5d-8d15-18514389619f\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-7kq4k" machine # [ 51.172033] k3s[885]: I1005 11:56:21.058503 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4phh\" (UniqueName: \"kubernetes.io/projected/3c2dac77-367d-4f5d-8d15-18514389619f-kube-api-access-l4phh\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-7kq4k\" (UID: \"3c2dac77-367d-4f5d-8d15-18514389619f\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-7kq4k" machine # [ 51.172602] k3s[885]: I1005 11:56:21.058531 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/9ec604cf-ec37-40d5-af96-1278ed2fc49d-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-q597q\" (UID: \"9ec604cf-ec37-40d5-af96-1278ed2fc49d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-q597q" machine # [ 51.173152] k3s[885]: I1005 11:56:21.058555 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsfbf\" (UniqueName: \"kubernetes.io/projected/aff74d9f-1bd1-4cc8-9bfa-9f833bb8acc6-kube-api-access-tsfbf\") pod \"nix-grpc-farm-scheduler-7c7595b89b-ff9bg\" (UID: \"aff74d9f-1bd1-4cc8-9bfa-9f833bb8acc6\") " pod="farm/nix-grpc-farm-scheduler-7c7595b89b-ff9bg" machine # [ 51.173682] k3s[885]: I1005 11:56:21.058599 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/3c2dac77-367d-4f5d-8d15-18514389619f-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-7kq4k\" (UID: \"3c2dac77-367d-4f5d-8d15-18514389619f\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-7kq4k" machine # [ 51.174153] k3s[885]: I1005 11:56:21.058706 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/9ec604cf-ec37-40d5-af96-1278ed2fc49d-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-q597q\" (UID: \"9ec604cf-ec37-40d5-af96-1278ed2fc49d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-q597q" machine # [ 51.174675] k3s[885]: I1005 11:56:21.058729 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/3c2dac77-367d-4f5d-8d15-18514389619f-build\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-7kq4k\" (UID: \"3c2dac77-367d-4f5d-8d15-18514389619f\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-7kq4k" machine # [ 51.175179] k3s[885]: I1005 11:56:21.058757 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/3c2dac77-367d-4f5d-8d15-18514389619f-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-7kq4k\" (UID: \"3c2dac77-367d-4f5d-8d15-18514389619f\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-7kq4k" machine # [ 51.178816] k3s[885]: I1005 11:56:21.058782 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/3c2dac77-367d-4f5d-8d15-18514389619f-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-7kq4k\" (UID: \"3c2dac77-367d-4f5d-8d15-18514389619f\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-7kq4k" machine # [ 51.183062] k3s[885]: I1005 11:56:21.059022 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/19ca7158-1589-41b2-bd51-569f5c05f11d-tls-lb\") pod \"nix-grpc-farm-lb-6b9475456-4zs7x\" (UID: \"19ca7158-1589-41b2-bd51-569f5c05f11d\") " pod="farm/nix-grpc-farm-lb-6b9475456-4zs7x" machine # [ 51.186975] k3s[885]: I1005 11:56:21.059071 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/19ca7158-1589-41b2-bd51-569f5c05f11d-tls-ca\") pod \"nix-grpc-farm-lb-6b9475456-4zs7x\" (UID: \"19ca7158-1589-41b2-bd51-569f5c05f11d\") " pod="farm/nix-grpc-farm-lb-6b9475456-4zs7x" machine # [ 51.190886] k3s[885]: I1005 11:56:21.059094 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/3c2dac77-367d-4f5d-8d15-18514389619f-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-7kq4k\" (UID: \"3c2dac77-367d-4f5d-8d15-18514389619f\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-7kq4k" machine # [ 51.233493] k3s[885]: I1005 11:56:21.059178 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/9ec604cf-ec37-40d5-af96-1278ed2fc49d-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-q597q\" (UID: \"9ec604cf-ec37-40d5-af96-1278ed2fc49d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-q597q" machine # [ 51.234118] k3s[885]: I1005 11:56:21.059214 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/9ec604cf-ec37-40d5-af96-1278ed2fc49d-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-q597q\" (UID: \"9ec604cf-ec37-40d5-af96-1278ed2fc49d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-q597q" machine # [ 51.234599] k3s[885]: I1005 11:56:21.059297 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9ec604cf-ec37-40d5-af96-1278ed2fc49d-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-q597q\" (UID: \"9ec604cf-ec37-40d5-af96-1278ed2fc49d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-q597q" machine # [ 51.235092] k3s[885]: I1005 11:56:21.059321 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/9ec604cf-ec37-40d5-af96-1278ed2fc49d-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-q597q\" (UID: \"9ec604cf-ec37-40d5-af96-1278ed2fc49d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-q597q" machine # [ 51.235536] k3s[885]: I1005 11:56:21.059343 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/19ca7158-1589-41b2-bd51-569f5c05f11d-config\") pod \"nix-grpc-farm-lb-6b9475456-4zs7x\" (UID: \"19ca7158-1589-41b2-bd51-569f5c05f11d\") " pod="farm/nix-grpc-farm-lb-6b9475456-4zs7x" machine # [ 51.236061] k3s[885]: I1005 11:56:21.059369 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/aff74d9f-1bd1-4cc8-9bfa-9f833bb8acc6-tls\") pod \"nix-grpc-farm-scheduler-7c7595b89b-ff9bg\" (UID: \"aff74d9f-1bd1-4cc8-9bfa-9f833bb8acc6\") " pod="farm/nix-grpc-farm-scheduler-7c7595b89b-ff9bg" machine # [ 51.236564] k3s[885]: I1005 11:56:21.059568 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/9ec604cf-ec37-40d5-af96-1278ed2fc49d-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-q597q\" (UID: \"9ec604cf-ec37-40d5-af96-1278ed2fc49d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-q597q" machine # [ 51.237056] k3s[885]: I1005 11:56:21.059619 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqgp8\" (UniqueName: \"kubernetes.io/projected/9ec604cf-ec37-40d5-af96-1278ed2fc49d-kube-api-access-cqgp8\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-q597q\" (UID: \"9ec604cf-ec37-40d5-af96-1278ed2fc49d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-q597q" machine # [ 51.237491] k3s[885]: I1005 11:56:21.059642 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/aff74d9f-1bd1-4cc8-9bfa-9f833bb8acc6-niks3-token\") pod \"nix-grpc-farm-scheduler-7c7595b89b-ff9bg\" (UID: \"aff74d9f-1bd1-4cc8-9bfa-9f833bb8acc6\") " pod="farm/nix-grpc-farm-scheduler-7c7595b89b-ff9bg" machine # [ 51.238036] k3s[885]: I1005 11:56:21.059723 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/3c2dac77-367d-4f5d-8d15-18514389619f-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-7kq4k\" (UID: \"3c2dac77-367d-4f5d-8d15-18514389619f\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-7kq4k" machine # [ 51.238482] k3s[885]: I1005 11:56:21.059748 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/3c2dac77-367d-4f5d-8d15-18514389619f-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-7kq4k\" (UID: \"3c2dac77-367d-4f5d-8d15-18514389619f\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-7kq4k" machine # [ 51.437702] (udev-worker)[1897]: Network interface NamePolicy= disabled on kernel command line. machine # [ 51.593305] cni0: port 2(vetha2a57c14) entered blocking state machine # [ 51.594287] cni0: port 2(vetha2a57c14) entered disabled state machine # [ 51.594982] vetha2a57c14: entered allmulticast mode machine # [ 51.596139] vetha2a57c14: entered promiscuous mode machine # [ 51.609559] cni0: port 2(vetha2a57c14) entered blocking state machine # [ 51.610267] cni0: port 2(vetha2a57c14) entered forwarding state machine # [ 51.626497] cni0: port 3(veth1bc8952a) entered blocking state machine # [ 51.627348] cni0: port 3(veth1bc8952a) entered disabled state machine # [ 51.627957] veth1bc8952a: entered allmulticast mode machine # [ 51.628980] veth1bc8952a: entered promiscuous mode machine # [ 51.480688] (udev-worker)[1900]: Network interface NamePolicy= disabled on kernel command line. machine # [ 51.637109] cni0: port 4(veth703c92e2) entered blocking state machine # [ 51.637767] cni0: port 4(veth703c92e2) entered disabled state machine # [ 51.640322] veth703c92e2: entered allmulticast mode machine # [ 51.640947] veth703c92e2: entered promiscuous mode machine # [ 51.653987] cni0: port 3(veth1bc8952a) entered blocking state machine # [ 51.654718] cni0: port 3(veth1bc8952a) entered forwarding state machine # [ 51.503916] dhcpcd[690]: vetha2a57c14: waiting for carrier machine # [ 51.669007] cni0: port 5(veth7fd05ba1) entered blocking state machine # [ 51.669839] cni0: port 5(veth7fd05ba1) entered disabled state machine # [ 51.671910] veth7fd05ba1: entered allmulticast mode machine # [ 51.672897] veth7fd05ba1: entered promiscuous mode machine # [ 51.673981] cni0: port 4(veth703c92e2) entered blocking state machine # [ 51.674682] cni0: port 4(veth703c92e2) entered forwarding state machine # [ 51.522500] dhcpcd[690]: veth1bc8952a: IAID d4:80:77:0f machine # [ 51.523269] dhcpcd[690]: veth1bc8952a: adding address fe80::c4f4:d4ff:fe80:770f machine # [ 51.688679] cni0: port 5(veth7fd05ba1) entered blocking state machine # [ 51.689642] cni0: port 5(veth7fd05ba1) entered forwarding state machine # [ 51.537422] dhcpcd[690]: veth703c92e2: IAID 26:5d:1f:e3 machine # [ 51.538208] dhcpcd[690]: veth703c92e2: adding address fe80::64af:26ff:fe5d:1fe3 machine # [ 51.551416] dhcpcd[690]: veth7fd05ba1: IAID de:f8:b3:43 machine # [ 51.552265] dhcpcd[690]: veth7fd05ba1: adding address fe80::d419:deff:fef8:b343 machine # [ 51.552983] dhcpcd[690]: vetha2a57c14: carrier acquired machine # [ 51.558471] dhcpcd[690]: vetha2a57c14: IAID d6:1c:b9:52 machine # [ 51.559435] dhcpcd[690]: vetha2a57c14: adding address fe80::98a6:d6ff:fe1c:b952 machine # [ 51.560822] dhcpcd[690]: veth1bc8952a: old hardware address: c6:f4:d4:80:77:0f machine # [ 51.561471] dhcpcd[690]: veth1bc8952a: new hardware address: 42:97:a4:46:fd:34 machine # [ 51.561972] dhcpcd[690]: veth1bc8952a: carrier lost machine # [ 51.585712] dhcpcd[690]: veth1bc8952a: deleting address fe80::c4f4:d4ff:fe80:770f machine # [ 51.586594] dhcpcd[690]: veth1bc8952a: old hardware address: 42:97:a4:46:fd:34 machine # [ 51.587087] dhcpcd[690]: veth1bc8952a: new hardware address: c6:f4:d4:80:77:0f machine # [ 51.587481] dhcpcd[690]: veth703c92e2: old hardware address: 66:af:26:5d:1f:e3 machine # [ 51.588199] dhcpcd[690]: veth703c92e2: new hardware address: b6:ce:b8:c0:26:3d machine # [ 51.589120] dhcpcd[690]: veth703c92e2: carrier lost machine # [ 51.616783] dhcpcd[690]: veth703c92e2: deleting address fe80::64af:26ff:fe5d:1fe3 machine # [ 51.618154] dhcpcd[690]: veth703c92e2: old hardware address: b6:ce:b8:c0:26:3d machine # [ 51.618862] dhcpcd[690]: veth703c92e2: new hardware address: 66:af:26:5d:1f:e3 machine # [ 51.620326] dhcpcd[690]: veth1bc8952a: carrier acquired machine # [ 51.624379] systemd[1]: Started libcontainer container 4bb49ab117ed6b6ac5be8354ea0695c6320a852c718d8213f71d896e86857273. machine # [ 51.630382] dhcpcd[690]: veth1bc8952a: IAID d4:80:77:0f machine # [ 51.631256] dhcpcd[690]: veth1bc8952a: adding address fe80::c4f4:d4ff:fe80:770f machine # [ 51.632425] dhcpcd[690]: veth7fd05ba1: old hardware address: d6:19:de:f8:b3:43 machine # [ 51.633528] dhcpcd[690]: veth7fd05ba1: new hardware address: f6:0b:50:fd:7a:58 machine # [ 51.634778] dhcpcd[690]: veth7fd05ba1: carrier lost machine # [ 51.665144] dhcpcd[690]: veth7fd05ba1: deleting address fe80::d419:deff:fef8:b343 machine # [ 51.666430] dhcpcd[690]: veth7fd05ba1: old hardware address: f6:0b:50:fd:7a:58 machine # [ 51.667564] dhcpcd[690]: veth7fd05ba1: new hardware address: d6:19:de:f8:b3:43 machine # [ 51.669592] dhcpcd[690]: veth703c92e2: carrier acquired machine # [ 51.672317] systemd[1]: Started libcontainer container b1e224857b1b1073749b3b4b216cbf4756667179a6aa2e19e6cff1e8b8a20761. machine # [ 51.674051] dhcpcd[690]: veth703c92e2: IAID 26:5d:1f:e3 machine # [ 51.674891] dhcpcd[690]: veth703c92e2: adding address fe80::64af:26ff:fe5d:1fe3 machine # [ 51.675957] dhcpcd[690]: veth7fd05ba1: carrier acquired machine # [ 51.681139] dhcpcd[690]: veth7fd05ba1: IAID de:f8:b3:43 machine # [ 51.681939] dhcpcd[690]: veth7fd05ba1: adding address fe80::d419:deff:fef8:b343 machine # [ 51.697798] systemd[1]: Started libcontainer container 6408fddf610d0e08f5fb23808fd18eb564d0dc4a679b151004fee058c7d7aa65. machine # [ 51.862986] cni0: port 6(veth963daded) entered blocking state machine # [ 51.863964] cni0: port 6(veth963daded) entered disabled state machine # [ 51.865125] veth963daded: entered allmulticast mode machine # [ 51.865859] veth963daded: entered promiscuous mode machine # [ 51.715499] systemd[1]: Started libcontainer container 60fe4e06f842f50a66403af16d52b698bd98aa26bdce7a99a7ba6d5cefafce09. machine # [ 51.882432] cni0: port 6(veth963daded) entered blocking state machine # [ 51.883180] cni0: port 6(veth963daded) entered forwarding state machine # [ 51.779802] (udev-worker)[2603]: Network interface NamePolicy= disabled on kernel command line. machine # [ 51.811652] dhcpcd[690]: veth963daded: IAID 92:c2:1d:3e machine # [ 51.812595] dhcpcd[690]: veth963daded: adding address fe80::cb7:92ff:fec2:1d3e machine # [ 51.925464] systemd[1]: Started libcontainer container 1c3e3b41506ab43132b6bda22e29cd6157eee324602d25d345ec7279e8c8c817. machine # [ 52.088311] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount1650085696.mount: Deactivated successfully. machine # [ 52.560592] dhcpcd[690]: veth703c92e2: soliciting a DHCP lease machine # [ 52.682602] dhcpcd[690]: veth7fd05ba1: soliciting a DHCP lease machine # [ 52.752308] systemd[1]: cri-containerd-333a7fa5dab700d32e574d0e9e3ac2c6d984b577d476c1507f7034eef5eb71be.scope: Deactivated successfully. machine # [ 52.785539] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-333a7fa5dab700d32e574d0e9e3ac2c6d984b577d476c1507f7034eef5eb71be-rootfs.mount: Deactivated successfully. machine # [ 53.072719] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-333a7fa5dab700d32e574d0e9e3ac2c6d984b577d476c1507f7034eef5eb71be-shm.mount: Deactivated successfully. machine # [ 53.261525] cni0: port 1(vethea52c191) entered disabled state machine # [ 53.109079] dhcpcd[690]: vethea52c191: carrier lost machine # [ 53.263423] vethea52c191 (unregistering): left allmulticast mode machine # [ 53.264313] vethea52c191 (unregistering): left promiscuous mode machine # [ 53.264980] cni0: port 1(vethea52c191) entered disabled state machine # [ 53.125953] systemd[1]: run-netns-cni\x2d5611eaf5\x2d4baf\x2d72dd\x2da1bc\x2dc6a4a7dab2bc.mount: Deactivated successfully. machine # [ 53.145918] dhcpcd[690]: vethea52c191: deleting address fe80::6874:a7ff:fe0e:63b3 machine # [ 53.182304] dhcpcd[690]: vethea52c191: removing interface machine # [ 53.204915] dhcpcd[690]: vetha2a57c14: soliciting a DHCP lease machine # [ 53.233381] systemd[1]: Started libcontainer container 9dabd35a0208d88b88988315b12cedaf0de02ee8faee87053d0dd655e40ffa98. machine # [ 53.274414] dhcpcd[690]: veth1bc8952a: soliciting an IPv6 router machine # [ 53.284747] k3s[885]: I1005 11:56:23.173493 885 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3acdb32d-b2e2-48fd-8ad3-792ecd5de879-tmp\" (UniqueName: \"kubernetes.io/empty-dir/3acdb32d-b2e2-48fd-8ad3-792ecd5de879-tmp\") pod \"3acdb32d-b2e2-48fd-8ad3-792ecd5de879\" (UID: \"3acdb32d-b2e2-48fd-8ad3-792ecd5de879\") " machine # [ 53.285723] k3s[885]: I1005 11:56:23.173537 885 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3acdb32d-b2e2-48fd-8ad3-792ecd5de879-klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/3acdb32d-b2e2-48fd-8ad3-792ecd5de879-klipper-config\") pod \"3acdb32d-b2e2-48fd-8ad3-792ecd5de879\" (UID: \"3acdb32d-b2e2-48fd-8ad3-792ecd5de879\") " machine # [ 53.286250] k3s[885]: I1005 11:56:23.173566 885 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3acdb32d-b2e2-48fd-8ad3-792ecd5de879-content\" (UniqueName: \"kubernetes.io/configmap/3acdb32d-b2e2-48fd-8ad3-792ecd5de879-content\") pod \"3acdb32d-b2e2-48fd-8ad3-792ecd5de879\" (UID: \"3acdb32d-b2e2-48fd-8ad3-792ecd5de879\") " machine # [ 53.286843] k3s[885]: I1005 11:56:23.173593 885 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3acdb32d-b2e2-48fd-8ad3-792ecd5de879-klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/3acdb32d-b2e2-48fd-8ad3-792ecd5de879-klipper-helm\") pod \"3acdb32d-b2e2-48fd-8ad3-792ecd5de879\" (UID: \"3acdb32d-b2e2-48fd-8ad3-792ecd5de879\") " machine # [ 53.287912] k3s[885]: I1005 11:56:23.174155 885 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3acdb32d-b2e2-48fd-8ad3-792ecd5de879-kube-api-access-slvqs\" (UniqueName: \"kubernetes.io/projected/3acdb32d-b2e2-48fd-8ad3-792ecd5de879-kube-api-access-slvqs\") pod \"3acdb32d-b2e2-48fd-8ad3-792ecd5de879\" (UID: \"3acdb32d-b2e2-48fd-8ad3-792ecd5de879\") " machine # [ 53.289144] k3s[885]: I1005 11:56:23.174201 885 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3acdb32d-b2e2-48fd-8ad3-792ecd5de879-klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/3acdb32d-b2e2-48fd-8ad3-792ecd5de879-klipper-cache\") pod \"3acdb32d-b2e2-48fd-8ad3-792ecd5de879\" (UID: \"3acdb32d-b2e2-48fd-8ad3-792ecd5de879\") " machine # [ 53.289884] k3s[885]: I1005 11:56:23.174235 885 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3acdb32d-b2e2-48fd-8ad3-792ecd5de879-values\" (UniqueName: \"kubernetes.io/projected/3acdb32d-b2e2-48fd-8ad3-792ecd5de879-values\") pod \"3acdb32d-b2e2-48fd-8ad3-792ecd5de879\" (UID: \"3acdb32d-b2e2-48fd-8ad3-792ecd5de879\") " machine # [ 53.290980] systemd[1]: var-lib-kubelet-pods-3acdb32d\x2db2e2\x2d48fd\x2d8ad3\x2d792ecd5de879-volumes-kubernetes.io\x7eprojected-values.mount: Deactivated successfully. machine # [ 53.291878] systemd[1]: var-lib-kubelet-pods-3acdb32d\x2db2e2\x2d48fd\x2d8ad3\x2d792ecd5de879-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dhelm.mount: Deactivated successfully. machine # [ 53.305576] k3s[885]: I1005 11:56:23.194380 885 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3acdb32d-b2e2-48fd-8ad3-792ecd5de879-content" pod "3acdb32d-b2e2-48fd-8ad3-792ecd5de879" (UID: "3acdb32d-b2e2-48fd-8ad3-792ecd5de879"). InnerVolumeSpecName "content". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 53.325893] k3s[885]: I1005 11:56:23.214870 885 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3acdb32d-b2e2-48fd-8ad3-792ecd5de879-klipper-cache" pod "3acdb32d-b2e2-48fd-8ad3-792ecd5de879" (UID: "3acdb32d-b2e2-48fd-8ad3-792ecd5de879"). InnerVolumeSpecName "klipper-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 53.326809] k3s[885]: I1005 11:56:23.214955 885 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3acdb32d-b2e2-48fd-8ad3-792ecd5de879-klipper-config" pod "3acdb32d-b2e2-48fd-8ad3-792ecd5de879" (UID: "3acdb32d-b2e2-48fd-8ad3-792ecd5de879"). InnerVolumeSpecName "klipper-config". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 53.327366] k3s[885]: I1005 11:56:23.215645 885 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3acdb32d-b2e2-48fd-8ad3-792ecd5de879-klipper-helm" pod "3acdb32d-b2e2-48fd-8ad3-792ecd5de879" (UID: "3acdb32d-b2e2-48fd-8ad3-792ecd5de879"). InnerVolumeSpecName "klipper-helm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 53.328040] k3s[885]: I1005 11:56:23.216424 885 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3acdb32d-b2e2-48fd-8ad3-792ecd5de879-kube-api-access-slvqs" pod "3acdb32d-b2e2-48fd-8ad3-792ecd5de879" (UID: "3acdb32d-b2e2-48fd-8ad3-792ecd5de879"). InnerVolumeSpecName "kube-api-access-slvqs". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 53.328668] k3s[885]: I1005 11:56:23.217293 885 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3acdb32d-b2e2-48fd-8ad3-792ecd5de879-values" pod "3acdb32d-b2e2-48fd-8ad3-792ecd5de879" (UID: "3acdb32d-b2e2-48fd-8ad3-792ecd5de879"). InnerVolumeSpecName "values". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 53.329830] k3s[885]: I1005 11:56:23.217338 885 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3acdb32d-b2e2-48fd-8ad3-792ecd5de879-tmp" pod "3acdb32d-b2e2-48fd-8ad3-792ecd5de879" (UID: "3acdb32d-b2e2-48fd-8ad3-792ecd5de879"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 53.336064] k3s[885]: I1005 11:56:23.224525 885 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-6b9475456-4zs7x" podStartSLOduration=3.224503807 podStartE2EDuration="3.224503807s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-05 11:56:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-05 11:56:23.222895502 +0000 UTC m=+36.204193267" watchObservedRunningTime="2026-10-05 11:56:23.224503807 +0000 UTC m=+36.205801572" machine # [ 53.381713] dhcpcd[690]: veth1bc8952a: soliciting a DHCP lease machine # [ 53.386779] k3s[885]: I1005 11:56:23.275707 885 reconciler_common.go:299] "Volume detached for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/3acdb32d-b2e2-48fd-8ad3-792ecd5de879-klipper-config\") on node \"machine\" DevicePath \"\"" machine # [ 53.387461] k3s[885]: I1005 11:56:23.275734 885 reconciler_common.go:299] "Volume detached for volume \"content\" (UniqueName: \"kubernetes.io/configmap/3acdb32d-b2e2-48fd-8ad3-792ecd5de879-content\") on node \"machine\" DevicePath \"\"" machine # [ 53.387983] k3s[885]: I1005 11:56:23.275748 885 reconciler_common.go:299] "Volume detached for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/3acdb32d-b2e2-48fd-8ad3-792ecd5de879-klipper-helm\") on node \"machine\" DevicePath \"\"" machine # [ 53.388915] k3s[885]: I1005 11:56:23.275761 885 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-slvqs\" (UniqueName: \"kubernetes.io/projected/3acdb32d-b2e2-48fd-8ad3-792ecd5de879-kube-api-access-slvqs\") on node \"machine\" DevicePath \"\"" machine # [ 53.389864] k3s[885]: I1005 11:56:23.275774 885 reconciler_common.go:299] "Volume detached for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/3acdb32d-b2e2-48fd-8ad3-792ecd5de879-klipper-cache\") on node \"machine\" DevicePath \"\"" machine # [ 53.390618] k3s[885]: I1005 11:56:23.275794 885 reconciler_common.go:299] "Volume detached for volume \"values\" (UniqueName: \"kubernetes.io/projected/3acdb32d-b2e2-48fd-8ad3-792ecd5de879-values\") on node \"machine\" DevicePath \"\"" machine # [ 53.391182] k3s[885]: I1005 11:56:23.275807 885 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3acdb32d-b2e2-48fd-8ad3-792ecd5de879-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 53.460537] systemd[1]: Started libcontainer container 89dab0836c327b74c93263452e756682551744360f009b95b4e29fa174e8d0c3. machine # [ 53.547106] k3s[885]: I1005 11:56:23.434583 885 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/coredns-54996dc9b4-lbrhl" podStartSLOduration=24.434544748 podStartE2EDuration="24.434544748s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-05 11:55:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-05 11:56:23.433736544 +0000 UTC m=+36.415034589" watchObservedRunningTime="2026-10-05 11:56:23.434544748 +0000 UTC m=+36.415842792" machine # [ 53.657816] dhcpcd[690]: vetha2a57c14: soliciting an IPv6 router machine # [ 53.670690] dhcpcd[690]: veth963daded: soliciting an IPv6 router machine # [ 53.672377] systemd[1]: Removed slice libcontainer container kubepods-burstable-pod3acdb32d_b2e2_48fd_8ad3_792ecd5de879.slice. machine # [ 53.673474] systemd[1]: kubepods-burstable-pod3acdb32d_b2e2_48fd_8ad3_792ecd5de879.slice: Consumed 735ms CPU time over 17.234s wall clock time, 33.1M memory peak, 2.6M incoming IP traffic, 151.6K outgoing IP traffic. machine # [ 53.685593] dhcpcd[690]: veth963daded: soliciting a DHCP lease machine # [ 53.745864] k3s[885]: E1005 11:56:23.634692 885 kubelet_pods.go:2193] "failed to read memory cgroup config for the pod" err="failed to read memory.max for cgroup /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3acdb32d_b2e2_48fd_8ad3_792ecd5de879.slice: openat2 /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3acdb32d_b2e2_48fd_8ad3_792ecd5de879.slice/memory.max: no such file or directory" podName="helm-install-nix-grpc-farm-7pvh7" machine # [ 53.753977] k3s[885]: E1005 11:56:23.634736 885 kubelet_pods.go:2198] "failed to read memory cgroup limits for the pod" err="failed to read cpu.max file for cgroup /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3acdb32d_b2e2_48fd_8ad3_792ecd5de879.slice: openat2 /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3acdb32d_b2e2_48fd_8ad3_792ecd5de879.slice/cpu.max: no such file or directory" podName="helm-install-nix-grpc-farm-7pvh7" machine # [ 53.759674] k3s[885]: I1005 11:56:23.639028 885 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="333a7fa5dab700d32e574d0e9e3ac2c6d984b577d476c1507f7034eef5eb71be" machine # [ 53.996706] dhcpcd[690]: veth7fd05ba1: soliciting an IPv6 router machine # [ 54.077941] systemd[1]: var-lib-kubelet-pods-3acdb32d\x2db2e2\x2d48fd\x2d8ad3\x2d792ecd5de879-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dslvqs.mount: Deactivated successfully. machine # [ 54.084441] systemd[1]: var-lib-kubelet-pods-3acdb32d\x2db2e2\x2d48fd\x2d8ad3\x2d792ecd5de879-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dconfig.mount: Deactivated successfully. machine # [ 54.090302] systemd[1]: var-lib-kubelet-pods-3acdb32d\x2db2e2\x2d48fd\x2d8ad3\x2d792ecd5de879-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dcache.mount: Deactivated successfully. machine # [ 54.096054] systemd[1]: var-lib-kubelet-pods-3acdb32d\x2db2e2\x2d48fd\x2d8ad3\x2d792ecd5de879-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 54.118184] dhcpcd[690]: veth703c92e2: soliciting an IPv6 router machine # [ 57.562357] dhcpcd[690]: veth703c92e2: probing for an IPv4LL address machine # [ 57.683355] dhcpcd[690]: veth7fd05ba1: probing for an IPv4LL address machine # [ 58.120788] systemd[1]: tmp-ovl\x2didmapped194758026.mount: Deactivated successfully. machine # [ 58.127274] systemd[1]: Started libcontainer container 6471b321ab265b812d31dbab46c1aa4ef0feed0d60c264b7b9a582afecc5acf2. machine # [ 58.130988] systemd[1]: Started libcontainer container 9b623582f524a257fa01529a40d8f711a5f95e9ddf22a7657f780380dee73ad0. machine # [ 58.166444] systemd[1]: tmp-ovl\x2didmapped2722575411.mount: Deactivated successfully. machine # [ 58.192416] systemd[1]: Started libcontainer container f88bed86b0f6103f639290c7fb2a2c77aab3cadd33bd703c83c826730911d41f. machine # [ 58.205153] dhcpcd[690]: vetha2a57c14: probing for an IPv4LL address machine # [ 58.210356] k3s[885]: I1005 11:56:28.096974 885 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-scheduler-7c7595b89b-ff9bg" podStartSLOduration=8.096951282 podStartE2EDuration="8.096951282s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-05 11:56:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-05 11:56:28.084053833 +0000 UTC m=+41.065351598" watchObservedRunningTime="2026-10-05 11:56:28.096951282 +0000 UTC m=+41.078249326" machine # [ 58.382780] dhcpcd[690]: veth1bc8952a: probing for an IPv4LL address machine # [ 58.477526] niks3-server[1194]: 2026/10/05 11:56:28 INFO lead: acquired remote=10.42.0.5:48790 machine # [ 58.686799] dhcpcd[690]: veth963daded: probing for an IPv4LL address machine # [ 60.551112] systemd[1]: cri-containerd-f88bed86b0f6103f639290c7fb2a2c77aab3cadd33bd703c83c826730911d41f.scope: Deactivated successfully. machine # [ 60.553794] systemd[1]: cri-containerd-f88bed86b0f6103f639290c7fb2a2c77aab3cadd33bd703c83c826730911d41f.scope: Consumed 927ms CPU time over 2.357s wall clock time, 346.4M memory peak, 77.2M read from disk, 226.5M written to disk. machine # [ 60.555952] systemd[1]: cri-containerd-9b623582f524a257fa01529a40d8f711a5f95e9ddf22a7657f780380dee73ad0.scope: Deactivated successfully. machine # [ 60.556601] systemd[1]: cri-containerd-9b623582f524a257fa01529a40d8f711a5f95e9ddf22a7657f780380dee73ad0.scope: Consumed 907ms CPU time over 2.421s wall clock time, 348.3M memory peak, 88M read from disk, 232M written to disk. machine # [ 60.615880] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-f88bed86b0f6103f639290c7fb2a2c77aab3cadd33bd703c83c826730911d41f-rootfs.mount: Deactivated successfully. machine # [ 60.623242] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-9b623582f524a257fa01529a40d8f711a5f95e9ddf22a7657f780380dee73ad0-rootfs.mount: Deactivated successfully. machine # error: timed out waiting for the condition machine # [ 61.934736] systemd[1]: tmp-ovl\x2didmapped3443352924.mount: Deactivated successfully. machine # [ 61.944412] systemd[1]: tmp-ovl\x2didmapped2819084019.mount: Deactivated successfully. machine # [ 61.950252] systemd[1]: Started libcontainer container 590b273d92f4bf0b3b8a1f6fd46024e4899f490954ce86b2d5574887bc091320. machine # [ 61.963436] systemd[1]: Started libcontainer container 4cf0628287659220fc5fde8dcc71d6539c662061a661f4752e24e1ea9e90f053. machine # [ 62.148319] systemd[1]: Started libcontainer container 6b461dd8c13cff75d9570acded8967083f7021f4d3511f6ac9023522cc33ae14. machine # [ 62.152737] systemd[1]: Started libcontainer container 7ff3692154697c6222b766136640aea0241c6593bbb328b5ab2e9035d71094a4. machine # [ 62.351401] systemd[1]: Started libcontainer container 740f5c4390c3c981f16dc7aeaa0ecc5cf9501f49f2d1e53c89212bdc444b69e8. machine # [ 62.354585] systemd[1]: Started libcontainer container 6e34a8cf36cae95b123f146c3009a96169a8d769fbce91245c80565c77a657cc. machine # [ 62.425575] k3s[885]: I1005 11:56:32.314294 885 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-q597q" podStartSLOduration=10.0181083 podStartE2EDuration="12.314270801s" totalImagesPullingTime="0s" totalInitContainerRuntime="2.296162501s" isStatefulPod=false podCreationTimestamp="2026-10-05 11:56:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-05 11:56:32.314211017 +0000 UTC m=+45.295509062" watchObservedRunningTime="2026-10-05 11:56:32.314270801 +0000 UTC m=+45.295568566" machine # [ 62.437251] k3s[885]: I1005 11:56:32.326256 885 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-7kq4k" podStartSLOduration=9.931267096 podStartE2EDuration="12.326236009s" totalImagesPullingTime="0s" totalInitContainerRuntime="2.394968913s" isStatefulPod=false podCreationTimestamp="2026-10-05 11:56:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-05 11:56:32.325556314 +0000 UTC m=+45.306854358" watchObservedRunningTime="2026-10-05 11:56:32.326236009 +0000 UTC m=+45.307533774" machine # [ 62.570215] dhcpcd[690]: veth703c92e2: using IPv4LL address 169.254.182.229 machine # [ 62.571054] dhcpcd[690]: veth703c92e2: adding route to 169.254.0.0/16 machine # [ 63.437551] dhcpcd[690]: vetha2a57c14: using IPv4LL address 169.254.7.241 machine # [ 63.440171] dhcpcd[690]: vetha2a57c14: adding route to 169.254.0.0/16 machine # [ 63.483178] dhcpcd[690]: veth963daded: using IPv4LL address 169.254.227.190 machine # [ 63.485623] dhcpcd[690]: veth963daded: adding route to 169.254.0.0/16 machine # [ 63.530291] dhcpcd[690]: veth1bc8952a: using IPv4LL address 169.254.5.216 machine # [ 63.532580] dhcpcd[690]: veth1bc8952a: adding route to 169.254.0.0/16 machine # [ 63.583143] dhcpcd[690]: veth7fd05ba1: using IPv4LL address 169.254.195.112 machine # [ 63.585223] dhcpcd[690]: veth7fd05ba1: adding route to 169.254.0.0/16 machine # [ 65.279276] dhcpcd[690]: veth1bc8952a: no IPv6 Routers available machine # [ 65.660542] dhcpcd[690]: vetha2a57c14: no IPv6 Routers available machine # [ 65.675664] dhcpcd[690]: veth963daded: no IPv6 Routers available machine # [ 66.000327] dhcpcd[690]: veth7fd05ba1: no IPv6 Routers available machine # [ 66.121075] dhcpcd[690]: veth703c92e2: no IPv6 Routers available machine # error: timed out waiting for the condition machine # error: timed out waiting for the condition machine # error: timed out waiting for the condition machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 73.18 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s, in 0.20 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s, in 0.17 seconds) machine: waiting for unit niks3.service machine: (finished: waiting for unit niks3.service, in 0.04 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.15 seconds) machine: waiting for success: test $(curl -sf 10.42.0.3:9901/clusters | grep -c 'health_flags::healthy') -ge 3 machine: (finished: waiting for success: test $(curl -sf 10.42.0.3:9901/clusters | grep -c 'health_flags::healthy') -ge 3, in 0.05 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.15 seconds) machine: waiting for success: curl -sf http://10.42.0.5:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2' machine: (finished: waiting for success: curl -sf http://10.42.0.5:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2', in 0.03 seconds) (finished: subtest: chart deploys and workers become Ready, in 73.98 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}', in 0.13 seconds) machine: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt machine: (finished: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt, in 0.12 seconds) subtest: build through the balancer lands in the cache machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1 machine # [ 162.222391] niks3-server[1194]: 2026/10/05 11:58:12 INFO Received push request method=POST path=/api/pushes machine # [ 162.254531] niks3-server[1194]: 2026/10/05 11:58:12 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign machine # [ 162.258859] niks3-server[1194]: 2026/10/05 11:58:12 INFO Signed narinfos id=1 count=1 machine # [ 162.264735] niks3-server[1194]: 2026/10/05 11:58:12 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.ls machine # [ 162.266331] niks3-server[1194]: 2026/10/05 11:58:12 INFO Registered completed upload object_key=nar/0nzzbas7l8d37mridr7mg162smfjvn7lhs6am4crl4ydaxicigj8.nar.zst machine # [ 162.268889] niks3-server[1194]: 2026/10/05 11:58:12 INFO Received complete push request method=POST path=/api/pushes/1/complete machine # [ 162.272753] niks3-server[1194]: 2026/10/05 11:58:12 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.narinfo machine # [ 186.989262] niks3-server[1194]: 2026/10/05 11:58:36 INFO Received push request method=POST path=/api/pushes machine # [ 187.013702] niks3-server[1194]: 2026/10/05 11:58:36 INFO Registered completed upload object_key=log/yz1sqzb72i8v6h2ass0v76ba8cncqj9r-k3s-a.drv machine # [ 187.015962] niks3-server[1194]: 2026/10/05 11:58:36 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign machine # [ 187.021556] niks3-server[1194]: 2026/10/05 11:58:36 INFO Registered completed upload object_key=nar/1p7jh5nyz9n68k5f18ymmdpgr34mpnnch1njw7ki7b2b97qlfbjk.nar.zst machine # [ 187.023189] niks3-server[1194]: 2026/10/05 11:58:36 INFO Signed narinfos id=2 count=1 machine # [ 187.028083] niks3-server[1194]: 2026/10/05 11:58:36 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.ls machine # [ 187.033653] niks3-server[1194]: 2026/10/05 11:58:36 INFO Received complete push request method=POST path=/api/pushes/2/complete machine # [ 187.099825] niks3-server[1194]: 2026/10/05 11:58:36 INFO Received push request method=POST path=/api/pushes machine # [ 187.111235] niks3-server[1194]: 2026/10/05 11:58:37 INFO Received sign narinfos request method=POST path=/api/pushes/3/sign machine # [ 187.112362] niks3-server[1194]: 2026/10/05 11:58:37 INFO Signed narinfos id=3 count=1 machine # [ 187.113499] niks3-server[1194]: 2026/10/05 11:58:37 INFO Registered completed upload object_key=nar/03a4ywhyr5knmbc93z4gyml5y8fvgb431xvlmfxrwsm8mrb0qgx2.nar.zst machine # [ 187.117339] niks3-server[1194]: 2026/10/05 11:58:37 INFO Received complete push request method=POST path=/api/pushes/3/complete machine # [ 187.118390] niks3-server[1194]: 2026/10/05 11:58:37 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.ls machine # [ 187.120248] niks3-server[1194]: 2026/10/05 11:58:37 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.narinfo machine # [ 212.240577] niks3-server[1194]: 2026/10/05 11:59:02 INFO Received push request method=POST path=/api/pushes machine # [ 212.260345] niks3-server[1194]: 2026/10/05 11:59:02 INFO Received sign narinfos request method=POST path=/api/pushes/4/sign machine # [ 212.262870] niks3-server[1194]: 2026/10/05 11:59:02 INFO Signed narinfos id=4 count=1 machine # [ 212.266749] niks3-server[1194]: 2026/10/05 11:59:02 INFO Registered completed upload object_key=nar/05qjsj5ff3a6vnxkhb6k5f3m446dcc206p7cd37w4v3mgi95d7kh.nar.zst machine # [ 212.269323] niks3-server[1194]: 2026/10/05 11:59:02 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.ls machine # [ 212.275383] niks3-server[1194]: 2026/10/05 11:59:02 INFO Received complete push request method=POST path=/api/pushes/4/complete machine # [ 212.277405] niks3-server[1194]: 2026/10/05 11:59:02 INFO Registered completed upload object_key=log/zfq1xw9bmycqh35l0s44lmv65z4xc7br-k3s-b.drv machine # [ 212.343954] niks3-server[1194]: 2026/10/05 11:59:02 INFO Received push request method=POST path=/api/pushes machine # [ 212.358302] niks3-server[1194]: 2026/10/05 11:59:02 INFO Received sign narinfos request method=POST path=/api/pushes/5/sign machine # [ 212.359406] niks3-server[1194]: 2026/10/05 11:59:02 INFO Signed narinfos id=5 count=1 machine # [ 212.363130] niks3-server[1194]: 2026/10/05 11:59:02 INFO Registered completed upload object_key=nar/0jyw88klkf3nwxpnj5m5lx3i1dv2idf3hcn6im7883hnldm3gvyq.nar.zst machine # [ 212.366432] niks3-server[1194]: 2026/10/05 11:59:02 INFO Received complete push request method=POST path=/api/pushes/5/complete machine # [ 212.374646] niks3-server[1194]: 2026/10/05 11:59:02 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.ls machine # [ 212.375347] niks3-server[1194]: 2026/10/05 11:59:02 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.narinfo machine # [ 236.661706] niks3-server[1194]: 2026/10/05 11:59:26 INFO Received push request method=POST path=/api/pushes machine # [ 236.680905] niks3-server[1194]: 2026/10/05 11:59:26 INFO Received sign narinfos request method=POST path=/api/pushes/6/sign machine # [ 236.681675] niks3-server[1194]: 2026/10/05 11:59:26 INFO Registered completed upload object_key=log/n40czam6a4ldp1mh5fdmlcy07fv0akbm-k3s-top.drv machine # [ 236.683058] niks3-server[1194]: 2026/10/05 11:59:26 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.ls machine # [ 236.685594] niks3-server[1194]: 2026/10/05 11:59:26 INFO Registered completed upload object_key=nar/1q8vp5xqws560mpf8rxk8r8jhqrzibivh13x4wxy0cfqlzbk7cr5.nar.zst machine # [ 236.697695] niks3-server[1194]: 2026/10/05 11:59:26 INFO Signed narinfos id=6 count=1 machine # [ 236.704410] niks3-server[1194]: 2026/10/05 11:59:26 INFO Received complete push request method=POST path=/api/pushes/6/complete machine # [ 236.709442] niks3-server[1194]: 2026/10/05 11:59:26 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1, in 136.87 seconds) machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath, in 0.14 seconds) machine: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine: (finished: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.01 seconds) machine: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine # copying 3 paths... machine # copying path '/nix/store/r95r891injj9ski5c4w89yxjvjy065mx-k3s-a' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/mrqsh0475wxsmnsvkk55g94v6g5nrcra-k3s-b' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top' from 'http://192.168.1.1:5751'... machine: (finished: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.15 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1 machine # [ 238.332109] niks3-server[1194]: 2026/10/05 11:59:28 INFO Received push request method=POST path=/api/pushes machine # [ 238.347387] niks3-server[1194]: 2026/10/05 11:59:28 INFO Received sign narinfos request method=POST path=/api/pushes/7/sign machine # [ 238.350397] niks3-server[1194]: 2026/10/05 11:59:28 INFO Signed narinfos id=7 count=1 machine # [ 238.352529] niks3-server[1194]: 2026/10/05 11:59:28 INFO Registered completed upload object_key=nar/1fr26arhri17j9bj6hyjzmmd74v730biz1gb3kqd194vjx3ccvp9.nar.zst machine # [ 238.354282] niks3-server[1194]: 2026/10/05 11:59:28 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.ls machine # [ 238.357048] niks3-server[1194]: 2026/10/05 11:59:28 INFO Received complete push request method=POST path=/api/pushes/7/complete machine # [ 238.358776] niks3-server[1194]: 2026/10/05 11:59:28 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.narinfo machine # [ 262.849501] niks3-server[1194]: 2026/10/05 11:59:52 INFO Received push request method=POST path=/api/pushes machine # [ 262.870220] niks3-server[1194]: 2026/10/05 11:59:52 INFO Received sign narinfos request method=POST path=/api/pushes/8/sign machine # [ 262.872711] niks3-server[1194]: 2026/10/05 11:59:52 INFO Registered completed upload object_key=nar/1hfc6x4x25k3b0fk091d3nb0k3mympfp05fkslcx19synp3ig0zd.nar.zst machine # [ 262.875481] niks3-server[1194]: 2026/10/05 11:59:52 INFO Signed narinfos id=8 count=1 machine # [ 262.876776] niks3-server[1194]: 2026/10/05 11:59:52 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.ls machine # [ 262.883618] niks3-server[1194]: 2026/10/05 11:59:52 INFO Received complete push request method=POST path=/api/pushes/8/complete machine # [ 262.888784] niks3-server[1194]: 2026/10/05 11:59:52 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.narinfo machine # [ 262.896529] niks3-server[1194]: 2026/10/05 11:59:52 INFO Registered completed upload object_key=log/pbpqsh50ar10fpasdqqx8xg3lmr5j8iz-k3s-a.drv machine # [ 262.951900] niks3-server[1194]: 2026/10/05 11:59:52 INFO Received push request method=POST path=/api/pushes machine # [ 262.969538] niks3-server[1194]: 2026/10/05 11:59:52 INFO Received sign narinfos request method=POST path=/api/pushes/9/sign machine # [ 262.970784] niks3-server[1194]: 2026/10/05 11:59:52 INFO Registered completed upload object_key=nar/0zzq2vgjln4shvh57091n14sam6wh6w06vja6lzb9ppcj4ffyx1n.nar.zst machine # [ 262.971892] niks3-server[1194]: 2026/10/05 11:59:52 INFO Signed narinfos id=9 count=1 machine # [ 262.975680] niks3-server[1194]: 2026/10/05 11:59:52 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.ls machine # [ 262.982056] niks3-server[1194]: 2026/10/05 11:59:52 INFO Received complete push request method=POST path=/api/pushes/9/complete machine # [ 262.985797] niks3-server[1194]: 2026/10/05 11:59:52 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.narinfo machine # [ 287.497537] niks3-server[1194]: 2026/10/05 12:00:17 INFO Received push request method=POST path=/api/pushes machine # [ 287.522396] niks3-server[1194]: 2026/10/05 12:00:17 INFO Received sign narinfos request method=POST path=/api/pushes/10/sign machine # [ 287.525982] niks3-server[1194]: 2026/10/05 12:00:17 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.ls machine # [ 287.528153] niks3-server[1194]: 2026/10/05 12:00:17 INFO Registered completed upload object_key=nar/0hh3nqk95r6g32lhdmxw8cxjv694vbpx9876zkhcpg4r4qxni2ch.nar.zst machine # [ 287.530053] niks3-server[1194]: 2026/10/05 12:00:17 INFO Registered completed upload object_key=log/894h6wzw2l4w5f0hikj1k6q57jfnyi87-k3s-b.drv machine # [ 287.538557] niks3-server[1194]: 2026/10/05 12:00:17 INFO Signed narinfos id=10 count=1 machine # [ 287.547983] niks3-server[1194]: 2026/10/05 12:00:17 INFO Received complete push request method=POST path=/api/pushes/10/complete machine # [ 287.553885] niks3-server[1194]: 2026/10/05 12:00:17 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.narinfo machine # [ 287.619453] niks3-server[1194]: 2026/10/05 12:00:17 INFO Received push request method=POST path=/api/pushes machine # [ 287.631021] niks3-server[1194]: 2026/10/05 12:00:17 INFO Received sign narinfos request method=POST path=/api/pushes/11/sign machine # [ 287.631894] niks3-server[1194]: 2026/10/05 12:00:17 INFO Signed narinfos id=11 count=1 machine # [ 287.633157] niks3-server[1194]: 2026/10/05 12:00:17 INFO Registered completed upload object_key=nar/0ingamx56k31lwiyxmnxmscjj4n3qfx6sr2kpaynsrwhwz1278iw.nar.zst machine # [ 287.638860] niks3-server[1194]: 2026/10/05 12:00:17 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.ls machine # [ 287.641956] niks3-server[1194]: 2026/10/05 12:00:17 INFO Received complete push request method=POST path=/api/pushes/11/complete machine # [ 287.645797] niks3-server[1194]: 2026/10/05 12:00:17 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.narinfo machine # [ 309.973490] postgres[760]: [760] LOG: checkpoint starting: time machine # [ 312.556473] niks3-server[1194]: 2026/10/05 12:00:42 INFO Received push request method=POST path=/api/pushes machine # [ 312.573750] niks3-server[1194]: 2026/10/05 12:00:42 INFO Received sign narinfos request method=POST path=/api/pushes/12/sign machine # [ 312.578308] niks3-server[1194]: 2026/10/05 12:00:42 INFO Signed narinfos id=12 count=1 machine # [ 312.582083] niks3-server[1194]: 2026/10/05 12:00:42 INFO Registered completed upload object_key=nar/0v48x4sp58bvfra08axgkz7yl1n9nc4nirskyv1hwann4i7q277i.nar.zst machine # [ 312.587167] niks3-server[1194]: 2026/10/05 12:00:42 INFO Registered completed upload object_key=log/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g-k3s-top.drv machine # [ 312.591939] niks3-server[1194]: 2026/10/05 12:00:42 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.ls machine # [ 312.594113] niks3-server[1194]: 2026/10/05 12:00:42 INFO Received complete push request method=POST path=/api/pushes/12/complete machine # [ 312.595480] niks3-server[1194]: 2026/10/05 12:00:42 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1, in 74.55 seconds) (finished: subtest: build through the balancer lands in the cache, in 211.72 seconds) subtest: a Job with the client image builds through the farm with its service account machine: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine: (finished: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.13 seconds) machine: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix machine: (finished: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix, in 0.12 seconds) machine: must succeed: kubectl apply -f /nix/store/pzq1y78ar0jx25hvv3v5qh4428dn7jnp-ci-job.json machine: (finished: must succeed: kubectl apply -f /nix/store/pzq1y78ar0jx25hvv3v5qh4428dn7jnp-ci-job.json, in 0.13 seconds) machine: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed' machine # [ 313.419338] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod7e4401be_09ae_4166_a6ae_c5b78b50a144.slice. machine # [ 313.552406] k3s[885]: I1005 12:00:43.441085 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dmzj\" (UniqueName: \"kubernetes.io/projected/7e4401be-09ae-4166-a6ae-c5b78b50a144-kube-api-access-9dmzj\") pod \"ci-7l4f8\" (UID: \"7e4401be-09ae-4166-a6ae-c5b78b50a144\") " pod="ci/ci-7l4f8" machine # [ 313.556420] k3s[885]: I1005 12:00:43.441166 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/7e4401be-09ae-4166-a6ae-c5b78b50a144-nix-grpc-farm\") pod \"ci-7l4f8\" (UID: \"7e4401be-09ae-4166-a6ae-c5b78b50a144\") " pod="ci/ci-7l4f8" machine # [ 313.560200] k3s[885]: I1005 12:00:43.441268 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"job\" (UniqueName: \"kubernetes.io/configmap/7e4401be-09ae-4166-a6ae-c5b78b50a144-job\") pod \"ci-7l4f8\" (UID: \"7e4401be-09ae-4166-a6ae-c5b78b50a144\") " pod="ci/ci-7l4f8" machine # [ 314.819594] cni0: port 1(veth46b8c6da) entered blocking state machine # [ 314.821485] cni0: port 1(veth46b8c6da) entered disabled state machine # [ 314.824188] veth46b8c6da: entered allmulticast mode machine # [ 314.826223] veth46b8c6da: entered promiscuous mode machine # [ 314.846480] cni0: port 1(veth46b8c6da) entered blocking state machine # [ 314.848467] cni0: port 1(veth46b8c6da) entered forwarding state machine # [ 314.735477] (udev-worker)[5214]: Network interface NamePolicy= disabled on kernel command line. machine # [ 314.758669] dhcpcd[690]: veth46b8c6da: IAID 9d:3c:d7:ec machine # [ 314.759515] dhcpcd[690]: veth46b8c6da: adding address fe80::7867:9dff:fe3c:d7ec machine # [ 314.784495] systemd[1]: Started libcontainer container 476f9a45d324f8298afa98d8b7eb31084eb4a2d83f97e1f1ccbc16b59c1b1f5f. machine # [ 315.108239] dhcpcd[690]: veth46b8c6da: soliciting a DHCP lease machine # [ 316.079093] dhcpcd[690]: veth46b8c6da: soliciting an IPv6 router machine # [ 316.739557] systemd[1]: Started libcontainer container e5185fce6efb669365c5c0a8c7c7b0636abd0ca19f7159868b2a4f01fa897d16. machine # [ 316.788983] k3s[885]: I1005 12:00:46.677714 885 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ci/ci-7l4f8" podStartSLOduration=3.677675898 podStartE2EDuration="3.677675898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-05 12:00:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-05 12:00:46.676731085 +0000 UTC m=+299.658028850" watchObservedRunningTime="2026-10-05 12:00:46.677675898 +0000 UTC m=+299.658973663" machine # [ 318.000239] niks3-server[1194]: 2026/10/05 12:00:47 INFO Received push request method=POST path=/api/pushes machine # [ 318.009054] niks3-server[1194]: 2026/10/05 12:00:47 INFO Received sign narinfos request method=POST path=/api/pushes/13/sign machine # [ 318.010072] niks3-server[1194]: 2026/10/05 12:00:47 INFO Signed narinfos id=13 count=1 machine # [ 318.013167] niks3-server[1194]: 2026/10/05 12:00:47 INFO Registered completed upload object_key=nar/111g6dyibwcf2z7jhpn72rgja0qvjgpdiv9nc06g2dp7ih0a6kyq.nar.zst machine # [ 318.015755] niks3-server[1194]: 2026/10/05 12:00:47 INFO Received complete push request method=POST path=/api/pushes/13/complete machine # [ 318.018188] niks3-server[1194]: 2026/10/05 12:00:47 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.ls machine # [ 318.020429] niks3-server[1194]: 2026/10/05 12:00:47 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.narinfo machine # [ 320.109518] dhcpcd[690]: veth46b8c6da: probing for an IPv4LL address machine # [ 324.335503] dhcpcd[690]: veth46b8c6da: using IPv4LL address 169.254.175.255 machine # [ 324.337423] dhcpcd[690]: veth46b8c6da: adding route to 169.254.0.0/16 machine # [ 328.084211] dhcpcd[690]: veth46b8c6da: no IPv6 Routers available machine # [ 342.933445] niks3-server[1194]: 2026/10/05 12:01:12 INFO Received push request method=POST path=/api/pushes machine # [ 342.954482] niks3-server[1194]: 2026/10/05 12:01:12 INFO Registered completed upload object_key=nar/058kjd2vfl1r27b4d9ixvwf77d8rkr18a4v894kwx8lg0nwpajnr.nar.zst machine # [ 342.959636] niks3-server[1194]: 2026/10/05 12:01:12 INFO Received sign narinfos request method=POST path=/api/pushes/14/sign machine # [ 342.963135] niks3-server[1194]: 2026/10/05 12:01:12 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.ls machine # [ 342.966339] niks3-server[1194]: 2026/10/05 12:01:12 INFO Signed narinfos id=14 count=1 machine # [ 342.968512] niks3-server[1194]: 2026/10/05 12:01:12 INFO Registered completed upload object_key=log/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # [ 342.976955] niks3-server[1194]: 2026/10/05 12:01:12 INFO Received complete push request method=POST path=/api/pushes/14/complete machine # [ 342.977923] niks3-server[1194]: 2026/10/05 12:01:12 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.narinfo machine # [ 343.040068] niks3-server[1194]: 2026/10/05 12:01:12 INFO Received push request method=POST path=/api/pushes machine # [ 343.052517] niks3-server[1194]: 2026/10/05 12:01:12 INFO Received sign narinfos request method=POST path=/api/pushes/15/sign machine # [ 343.053318] niks3-server[1194]: 2026/10/05 12:01:12 INFO Signed narinfos id=15 count=1 machine # [ 343.054640] niks3-server[1194]: 2026/10/05 12:01:12 INFO Registered completed upload object_key=nar/138ynhcd5wxzz485x9qcq7xsargaklrf2li31ai69m5r46am35q6.nar.zst machine # [ 343.056973] niks3-server[1194]: 2026/10/05 12:01:12 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.ls machine # [ 343.058843] niks3-server[1194]: 2026/10/05 12:01:12 INFO Received complete push request method=POST path=/api/pushes/15/complete machine # [ 343.062491] niks3-server[1194]: 2026/10/05 12:01:12 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.narinfo machine # [ 367.750416] niks3-server[1194]: 2026/10/05 12:01:37 INFO Received push request method=POST path=/api/pushes machine # [ 367.767185] niks3-server[1194]: 2026/10/05 12:01:37 INFO Received sign narinfos request method=POST path=/api/pushes/16/sign machine # [ 367.769679] niks3-server[1194]: 2026/10/05 12:01:37 INFO Signed narinfos id=16 count=1 machine # [ 367.772732] niks3-server[1194]: 2026/10/05 12:01:37 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.ls machine # [ 367.776088] niks3-server[1194]: 2026/10/05 12:01:37 INFO Registered completed upload object_key=nar/0n4lbdlp8w72fs3qbavl2lwrzbrn55i2b1vyglc89cc3pi8vbb1m.nar.zst machine # [ 367.778347] niks3-server[1194]: 2026/10/05 12:01:37 INFO Registered completed upload object_key=log/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # [ 367.780334] niks3-server[1194]: 2026/10/05 12:01:37 INFO Received complete push request method=POST path=/api/pushes/16/complete machine # [ 367.782232] niks3-server[1194]: 2026/10/05 12:01:37 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo machine # [ 367.836446] niks3-server[1194]: 2026/10/05 12:01:37 INFO Received push request method=POST path=/api/pushes machine # [ 367.845920] niks3-server[1194]: 2026/10/05 12:01:37 INFO Received sign narinfos request method=POST path=/api/pushes/17/sign machine # [ 367.847726] niks3-server[1194]: 2026/10/05 12:01:37 INFO Signed narinfos id=17 count=1 machine # [ 367.850857] niks3-server[1194]: 2026/10/05 12:01:37 INFO Registered completed upload object_key=nar/1f3gvnvqsm2pm3laixkxkg44kvjb251zqhszcfpp0a00h6x66ljs.nar.zst machine # [ 367.853145] niks3-server[1194]: 2026/10/05 12:01:37 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.ls machine # [ 367.854915] niks3-server[1194]: 2026/10/05 12:01:37 INFO Received complete push request method=POST path=/api/pushes/17/complete machine # [ 367.857888] niks3-server[1194]: 2026/10/05 12:01:37 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.narinfo machine # [ 392.760797] niks3-server[1194]: 2026/10/05 12:02:02 INFO Received push request method=POST path=/api/pushes machine # [ 392.779822] niks3-server[1194]: 2026/10/05 12:02:02 INFO Received sign narinfos request method=POST path=/api/pushes/18/sign machine # [ 392.781800] niks3-server[1194]: 2026/10/05 12:02:02 INFO Signed narinfos id=18 count=1 machine # [ 392.786511] niks3-server[1194]: 2026/10/05 12:02:02 INFO Registered completed upload object_key=nar/1zwf0asrdv12q40fmqga5lx5330dvn9y4in4i9ficz9ij5lhvnf5.nar.zst machine # [ 392.791564] niks3-server[1194]: 2026/10/05 12:02:02 INFO Received complete push request method=POST path=/api/pushes/18/complete machine # [ 392.793259] niks3-server[1194]: 2026/10/05 12:02:02 INFO Registered completed upload object_key=log/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # [ 392.795692] niks3-server[1194]: 2026/10/05 12:02:02 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.ls machine # [ 392.803252] niks3-server[1194]: 2026/10/05 12:02:02 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo machine # [ 394.383390] niks3-server[1194]: 2026/10/05 12:02:04 INFO Received push request method=POST path=/api/pushes machine # [ 394.397852] niks3-server[1194]: 2026/10/05 12:02:04 INFO Received sign narinfos request method=POST path=/api/pushes/19/sign machine # [ 394.400297] niks3-server[1194]: 2026/10/05 12:02:04 INFO Signed narinfos id=19 count=1 machine # [ 394.403414] niks3-server[1194]: 2026/10/05 12:02:04 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.ls machine # [ 394.405696] niks3-server[1194]: 2026/10/05 12:02:04 INFO Registered completed upload object_key=nar/0xiyqcsl8db7dnrq2gqnx5izavr51ma3dcdswrriaxfgj3qzk7xf.nar.zst machine # [ 394.408481] niks3-server[1194]: 2026/10/05 12:02:04 INFO Received complete push request method=POST path=/api/pushes/19/complete machine # [ 394.413052] niks3-server[1194]: 2026/10/05 12:02:04 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.narinfo machine # [ 413.978705] postgres[760]: [760] LOG: checkpoint complete: wrote 1037 buffers (6.3%), wrote 3 SLRU buffers; 1 WAL file(s) added, 0 removed, 0 recycled; write=103.889 s, sync=0.076 s, total=104.006 s; sync files=364, longest=0.006 s, average=0.001 s; distance=4976 kB, estimate=4976 kB; lsn=0/1C79810, redo lsn=0/1C420E8 machine # [ 419.335815] niks3-server[1194]: 2026/10/05 12:02:29 INFO Received push request method=POST path=/api/pushes machine # [ 419.356463] niks3-server[1194]: 2026/10/05 12:02:29 INFO Received sign narinfos request method=POST path=/api/pushes/20/sign machine # [ 419.358726] niks3-server[1194]: 2026/10/05 12:02:29 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.ls machine # [ 419.361577] niks3-server[1194]: 2026/10/05 12:02:29 INFO Signed narinfos id=20 count=1 machine # [ 419.362908] niks3-server[1194]: 2026/10/05 12:02:29 INFO Registered completed upload object_key=nar/0p3l2z3riilylr2rxb1aq2blxdfxg55wbgp4gxkns93srbr4bwyq.nar.zst machine # [ 419.365827] niks3-server[1194]: 2026/10/05 12:02:29 INFO Registered completed upload object_key=log/fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # [ 419.371860] niks3-server[1194]: 2026/10/05 12:02:29 INFO Received complete push request method=POST path=/api/pushes/20/complete machine # [ 419.376922] niks3-server[1194]: 2026/10/05 12:02:29 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo machine # [ 419.500509] systemd[1]: cri-containerd-e5185fce6efb669365c5c0a8c7c7b0636abd0ca19f7159868b2a4f01fa897d16.scope: Deactivated successfully. machine # [ 419.505857] systemd[1]: cri-containerd-e5185fce6efb669365c5c0a8c7c7b0636abd0ca19f7159868b2a4f01fa897d16.scope: Consumed 884ms CPU time over 1min 42.760s wall clock time, 80.9M memory peak, 11.1M read from disk, 412K written to disk, 18.2K incoming IP traffic, 44.8K outgoing IP traffic. machine # [ 419.556044] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-e5185fce6efb669365c5c0a8c7c7b0636abd0ca19f7159868b2a4f01fa897d16-rootfs.mount: Deactivated successfully. machine # [ 421.254443] systemd[1]: cri-containerd-476f9a45d324f8298afa98d8b7eb31084eb4a2d83f97e1f1ccbc16b59c1b1f5f.scope: Deactivated successfully. machine # [ 421.309065] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-476f9a45d324f8298afa98d8b7eb31084eb4a2d83f97e1f1ccbc16b59c1b1f5f-rootfs.mount: Deactivated successfully. machine # [ 421.349393] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-476f9a45d324f8298afa98d8b7eb31084eb4a2d83f97e1f1ccbc16b59c1b1f5f-shm.mount: Deactivated successfully. machine # [ 421.538402] cni0: port 1(veth46b8c6da) entered disabled state machine # [ 421.387584] dhcpcd[690]: veth46b8c6da: carrier lost machine # [ 421.541367] veth46b8c6da (unregistering): left allmulticast mode machine # [ 421.542434] veth46b8c6da (unregistering): left promiscuous mode machine # [ 421.543552] cni0: port 1(veth46b8c6da) entered disabled state machine # [ 421.414993] dhcpcd[690]: veth46b8c6da: deleting address fe80::7867:9dff:fe3c:d7ec machine # [ 421.417255] systemd[1]: run-netns-cni\x2d4609a16a\x2d3fa9\x2dc3a2\x2d4547\x2dc2a0fb3c558f.mount: Deactivated successfully. machine # [ 421.420462] dhcpcd[690]: veth46b8c6da: deleting route to 169.254.0.0/16 machine # [ 421.471963] k3s[885]: I1005 12:02:31.360673 885 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7e4401be-09ae-4166-a6ae-c5b78b50a144-kube-api-access-9dmzj\" (UniqueName: \"kubernetes.io/projected/7e4401be-09ae-4166-a6ae-c5b78b50a144-kube-api-access-9dmzj\") pod \"7e4401be-09ae-4166-a6ae-c5b78b50a144\" (UID: \"7e4401be-09ae-4166-a6ae-c5b78b50a144\") " machine # [ 421.472736] k3s[885]: I1005 12:02:31.360735 885 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7e4401be-09ae-4166-a6ae-c5b78b50a144-nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/7e4401be-09ae-4166-a6ae-c5b78b50a144-nix-grpc-farm\") pod \"7e4401be-09ae-4166-a6ae-c5b78b50a144\" (UID: \"7e4401be-09ae-4166-a6ae-c5b78b50a144\") " machine # [ 421.473508] k3s[885]: I1005 12:02:31.360770 885 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7e4401be-09ae-4166-a6ae-c5b78b50a144-job\" (UniqueName: \"kubernetes.io/configmap/7e4401be-09ae-4166-a6ae-c5b78b50a144-job\") pod \"7e4401be-09ae-4166-a6ae-c5b78b50a144\" (UID: \"7e4401be-09ae-4166-a6ae-c5b78b50a144\") " machine # [ 421.479155] systemd[1]: var-lib-kubelet-pods-7e4401be\x2d09ae\x2d4166\x2da6ae\x2dc5b78b50a144-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2d9dmzj.mount: Deactivated successfully. machine # [ 421.481898] systemd[1]: var-lib-kubelet-pods-7e4401be\x2d09ae\x2d4166\x2da6ae\x2dc5b78b50a144-volumes-kubernetes.io\x7eprojected-nix\x2dgrpc\x2dfarm.mount: Deactivated successfully. machine # [ 421.489027] k3s[885]: I1005 12:02:31.378012 885 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e4401be-09ae-4166-a6ae-c5b78b50a144-job" pod "7e4401be-09ae-4166-a6ae-c5b78b50a144" (UID: "7e4401be-09ae-4166-a6ae-c5b78b50a144"). InnerVolumeSpecName "job". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 421.490439] k3s[885]: I1005 12:02:31.379390 885 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e4401be-09ae-4166-a6ae-c5b78b50a144-kube-api-access-9dmzj" pod "7e4401be-09ae-4166-a6ae-c5b78b50a144" (UID: "7e4401be-09ae-4166-a6ae-c5b78b50a144"). InnerVolumeSpecName "kube-api-access-9dmzj". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 421.497749] dhcpcd[690]: veth46b8c6da: removing interface machine # [ 421.499201] k3s[885]: I1005 12:02:31.388181 885 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e4401be-09ae-4166-a6ae-c5b78b50a144-nix-grpc-farm" pod "7e4401be-09ae-4166-a6ae-c5b78b50a144" (UID: "7e4401be-09ae-4166-a6ae-c5b78b50a144"). InnerVolumeSpecName "nix-grpc-farm". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 421.572325] k3s[885]: I1005 12:02:31.461244 885 reconciler_common.go:299] "Volume detached for volume \"job\" (UniqueName: \"kubernetes.io/configmap/7e4401be-09ae-4166-a6ae-c5b78b50a144-job\") on node \"machine\" DevicePath \"\"" machine # [ 421.573134] k3s[885]: I1005 12:02:31.461283 885 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dmzj\" (UniqueName: \"kubernetes.io/projected/7e4401be-09ae-4166-a6ae-c5b78b50a144-kube-api-access-9dmzj\") on node \"machine\" DevicePath \"\"" machine # [ 421.573601] k3s[885]: I1005 12:02:31.461300 885 reconciler_common.go:299] "Volume detached for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/7e4401be-09ae-4166-a6ae-c5b78b50a144-nix-grpc-farm\") on node \"machine\" DevicePath \"\"" machine # [ 421.676675] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod7e4401be_09ae_4166_a6ae_c5b78b50a144.slice. machine # [ 421.680655] systemd[1]: kubepods-besteffort-pod7e4401be_09ae_4166_a6ae_c5b78b50a144.slice: Consumed 913ms CPU time over 1min 48.258s wall clock time, 81.2M memory peak, 11.1M read from disk, 616K written to disk, 18.2K incoming IP traffic, 44.8K outgoing IP traffic. machine # [ 422.236192] k3s[885]: I1005 12:02:32.125064 885 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="476f9a45d324f8298afa98d8b7eb31084eb4a2d83f97e1f1ccbc16b59c1b1f5f" machine # [ 422.241760] k3s[885]: E1005 12:02:32.125169 885 kubelet_pods.go:2193] "failed to read memory cgroup config for the pod" err="failed to read memory.max for cgroup /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7e4401be_09ae_4166_a6ae_c5b78b50a144.slice: openat2 /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7e4401be_09ae_4166_a6ae_c5b78b50a144.slice/memory.max: no such file or directory" podName="ci-7l4f8" machine # [ 422.254391] k3s[885]: E1005 12:02:32.125230 885 kubelet_pods.go:2198] "failed to read memory cgroup limits for the pod" err="failed to read cpu.max file for cgroup /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7e4401be_09ae_4166_a6ae_c5b78b50a144.slice: openat2 /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7e4401be_09ae_4166_a6ae_c5b78b50a144.slice/cpu.max: no such file or directory" podName="ci-7l4f8" machine: (finished: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed', in 109.30 seconds) machine: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1 machine: (finished: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1, in 0.14 seconds) machine # don't know how to build these paths: machine # /nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-a> machine/nix-grpc-farm-worker-x86-64-linux-7f47df8658-q597q: building fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-b> machine/nix-grpc-farm-worker-x86-64-linux-7f47df8658-q597q: building 1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-top> machine/nix-grpc-farm-worker-x86-64-linux-7f47df8658-q597q: building rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # INFO:nix_fast_build.processes:run nix-eval-jobs --gc-roots-dir /tmp/tmp0vfu_wl6/gcroots --force-recurse --max-memory-size 4096 --workers 4 --flake '.#checks' --check-cache-status machine # INFO:nix_fast_build.workers:builds: 0 machine # warning: Git tree '/tmp' is dirty machine # warning: Git tree '/tmp' is dirty machine # ▶ x86_64-linux.t started machine # INFO:nix_fast_build.workers:builds: 2 machine # ✔ x86_64-linux.t (26s) machine # x86_64-linux.t> machine/nix-grpc-farm-worker-x86-64-linux-7f47df8658-7kq4k: building fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # warning: Git tree '/tmp' is dirty machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath, in 0.12 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null, in 0.05 seconds) (finished: subtest: a Job with the client image builds through the farm with its service account, in 110.23 seconds) subtest: a renewed balancer certificate is served without a rollout machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f - machine # Warning: resource secrets/farm-lb-tls is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically. machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f -, in 0.28 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}', in 0.24 seconds) machine: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-6b9475456-4zs7x -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine # [ 423.632895] k3s[885]: E1005 12:02:33.521274 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:40546: use of closed network connection" machine # [ 424.889217] k3s[885]: E1005 12:02:34.777686 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:40560: use of closed network connection" machine # [ 426.201744] k3s[885]: E1005 12:02:36.090018 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:40576: use of closed network connection" machine # [ 427.496197] k3s[885]: E1005 12:02:37.384514 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:40584: use of closed network connection" machine # [ 428.765289] k3s[885]: E1005 12:02:38.653582 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:40586: use of closed network connection" machine # [ 430.022193] k3s[885]: E1005 12:02:39.910833 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:40598: use of closed network connection" machine # [ 431.295906] k3s[885]: E1005 12:02:41.184619 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:40608: use of closed network connection" machine # [ 432.615377] k3s[885]: E1005 12:02:42.503356 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:40618: use of closed network connection" machine # [ 433.903477] k3s[885]: E1005 12:02:43.792123 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:38556: use of closed network connection" machine # [ 435.197112] k3s[885]: E1005 12:02:45.085538 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:38572: use of closed network connection" machine # [ 436.488251] k3s[885]: E1005 12:02:46.376520 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:38576: use of closed network connection" machine # [ 437.777352] k3s[885]: E1005 12:02:47.666029 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:38578: use of closed network connection" machine # [ 439.074240] k3s[885]: E1005 12:02:48.962759 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:38590: use of closed network connection" machine # [ 440.382440] k3s[885]: E1005 12:02:50.270836 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:38594: use of closed network connection" machine # [ 441.715811] k3s[885]: E1005 12:02:51.604084 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:38606: use of closed network connection" machine # [ 443.008730] k3s[885]: E1005 12:02:52.897140 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39494: use of closed network connection" machine # [ 444.338304] k3s[885]: E1005 12:02:54.226968 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39502: use of closed network connection" machine # [ 445.630467] k3s[885]: E1005 12:02:55.518746 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39508: use of closed network connection" machine # [ 446.921871] k3s[885]: E1005 12:02:56.810529 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39514: use of closed network connection" machine # [ 448.226760] k3s[885]: E1005 12:02:58.115201 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39528: use of closed network connection" machine # [ 449.503833] k3s[885]: E1005 12:02:59.392498 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39532: use of closed network connection" machine # [ 450.799932] k3s[885]: E1005 12:03:00.688597 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39536: use of closed network connection" machine # [ 452.128377] k3s[885]: E1005 12:03:02.017043 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39550: use of closed network connection" machine # [ 453.408809] k3s[885]: E1005 12:03:03.297029 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:48216: use of closed network connection" machine # [ 454.691141] k3s[885]: E1005 12:03:04.579786 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:48232: use of closed network connection" machine # [ 455.980491] k3s[885]: E1005 12:03:05.868661 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:48248: use of closed network connection" machine # [ 457.242341] k3s[885]: E1005 12:03:07.131010 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:48250: use of closed network connection" machine # [ 458.546488] k3s[885]: E1005 12:03:08.434756 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:48264: use of closed network connection" machine # [ 459.826930] k3s[885]: E1005 12:03:09.715470 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:48270: use of closed network connection" machine # [ 461.145076] k3s[885]: E1005 12:03:11.033772 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:48282: use of closed network connection" machine # [ 462.419158] k3s[885]: E1005 12:03:12.307840 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:48288: use of closed network connection" machine # [ 463.694448] k3s[885]: E1005 12:03:13.582512 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39156: use of closed network connection" machine # [ 464.966088] k3s[885]: E1005 12:03:14.854705 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39162: use of closed network connection" machine # [ 466.250745] k3s[885]: E1005 12:03:16.139263 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39172: use of closed network connection" machine # [ 467.542339] k3s[885]: E1005 12:03:17.430984 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39182: use of closed network connection" machine # [ 468.839165] k3s[885]: E1005 12:03:18.727834 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39192: use of closed network connection" machine # [ 470.151274] k3s[885]: E1005 12:03:20.039540 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39202: use of closed network connection" machine # [ 471.425608] k3s[885]: E1005 12:03:21.313901 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39214: use of closed network connection" machine # [ 472.716363] k3s[885]: E1005 12:03:22.605010 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39228: use of closed network connection" machine # [ 474.037054] k3s[885]: E1005 12:03:23.925657 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:38694: use of closed network connection" machine # [ 474.037834] k3s[885]: time="2026-10-05T12:03:23Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:38694->127.0.0.1:10250: write: broken pipe" machine # [ 475.330966] k3s[885]: E1005 12:03:25.219671 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:38696: use of closed network connection" machine # [ 476.608521] k3s[885]: E1005 12:03:26.497223 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:38708: use of closed network connection" machine # [ 477.871461] k3s[885]: E1005 12:03:27.759891 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:38710: use of closed network connection" machine # [ 479.175316] k3s[885]: E1005 12:03:29.063969 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:38722: use of closed network connection" machine # [ 480.427891] k3s[885]: E1005 12:03:30.316205 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:38738: use of closed network connection" machine # [ 481.712573] k3s[885]: E1005 12:03:31.601297 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:38744: use of closed network connection" machine # [ 483.008405] k3s[885]: E1005 12:03:32.896381 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47772: use of closed network connection" machine # [ 484.287114] k3s[885]: E1005 12:03:34.175540 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47788: use of closed network connection" machine: (finished: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-6b9475456-4zs7x -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 60.91 seconds) machine: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine: (finished: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 0.04 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1 machine # [ 484.527852] niks3-server[1194]: 2026/10/05 12:03:34 INFO Received push request method=POST path=/api/pushes machine # [ 484.547298] niks3-server[1194]: 2026/10/05 12:03:34 INFO Registered completed upload object_key=nar/0g42hgwa9jp9abmqxz90dkwxpybsznzbpsy35rm921mlk5sw56jq.nar.zst machine # [ 484.548583] niks3-server[1194]: 2026/10/05 12:03:34 INFO Received sign narinfos request method=POST path=/api/pushes/21/sign machine # [ 484.549586] niks3-server[1194]: 2026/10/05 12:03:34 INFO Signed narinfos id=21 count=1 machine # [ 484.553930] niks3-server[1194]: 2026/10/05 12:03:34 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.ls machine # [ 484.557776] niks3-server[1194]: 2026/10/05 12:03:34 INFO Received complete push request method=POST path=/api/pushes/21/complete machine # [ 484.563835] niks3-server[1194]: 2026/10/05 12:03:34 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.narinfo machine # [ 509.684772] niks3-server[1194]: 2026/10/05 12:03:59 INFO Received push request method=POST path=/api/pushes machine # [ 509.704181] niks3-server[1194]: 2026/10/05 12:03:59 INFO Registered completed upload object_key=nar/1vxmmzwi16s4iri6dcmi9v62dpq1ys7wz15b497ncik3sd67nfzg.nar.zst machine # [ 509.706534] niks3-server[1194]: 2026/10/05 12:03:59 INFO Received sign narinfos request method=POST path=/api/pushes/22/sign machine # [ 509.708301] niks3-server[1194]: 2026/10/05 12:03:59 INFO Signed narinfos id=22 count=1 machine # [ 509.709496] niks3-server[1194]: 2026/10/05 12:03:59 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.ls machine # [ 509.711325] niks3-server[1194]: 2026/10/05 12:03:59 INFO Registered completed upload object_key=log/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31-k3s-a.drv machine # [ 509.713485] niks3-server[1194]: 2026/10/05 12:03:59 INFO Received complete push request method=POST path=/api/pushes/22/complete machine # [ 509.717315] niks3-server[1194]: 2026/10/05 12:03:59 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo machine # [ 509.781503] niks3-server[1194]: 2026/10/05 12:03:59 INFO Received push request method=POST path=/api/pushes machine # [ 509.790969] niks3-server[1194]: 2026/10/05 12:03:59 INFO Received sign narinfos request method=POST path=/api/pushes/23/sign machine # [ 509.792709] niks3-server[1194]: 2026/10/05 12:03:59 INFO Signed narinfos id=23 count=1 machine # [ 509.794761] niks3-server[1194]: 2026/10/05 12:03:59 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.ls machine # [ 509.796247] niks3-server[1194]: 2026/10/05 12:03:59 INFO Registered completed upload object_key=nar/0cbxkyxz068xc5mivh2h67kw6y01n1x28cbs11v1a03g8m4c71zm.nar.zst machine # [ 509.799345] niks3-server[1194]: 2026/10/05 12:03:59 INFO Received complete push request method=POST path=/api/pushes/23/complete machine # [ 509.802942] niks3-server[1194]: 2026/10/05 12:03:59 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.narinfo machine # [ 534.721470] niks3-server[1194]: 2026/10/05 12:04:24 INFO Received push request method=POST path=/api/pushes machine # [ 534.743356] niks3-server[1194]: 2026/10/05 12:04:24 INFO Received sign narinfos request method=POST path=/api/pushes/24/sign machine # [ 534.746219] niks3-server[1194]: 2026/10/05 12:04:24 INFO Signed narinfos id=24 count=1 machine # [ 534.747955] niks3-server[1194]: 2026/10/05 12:04:24 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.ls machine # [ 534.752750] niks3-server[1194]: 2026/10/05 12:04:24 INFO Registered completed upload object_key=log/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4-k3s-b.drv machine # [ 534.756202] niks3-server[1194]: 2026/10/05 12:04:24 INFO Received complete push request method=POST path=/api/pushes/24/complete machine # [ 534.758932] niks3-server[1194]: 2026/10/05 12:04:24 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.narinfo machine # [ 534.769489] niks3-server[1194]: 2026/10/05 12:04:24 INFO Registered completed upload object_key=nar/0khxywxb2r78vhpc5hsmha3ymgp910z0aka7550jmaqzs333rmzp.nar.zst machine # [ 534.828506] niks3-server[1194]: 2026/10/05 12:04:24 INFO Received push request method=POST path=/api/pushes machine # [ 534.845543] niks3-server[1194]: 2026/10/05 12:04:24 INFO Received sign narinfos request method=POST path=/api/pushes/25/sign machine # [ 534.847562] niks3-server[1194]: 2026/10/05 12:04:24 INFO Signed narinfos id=25 count=1 machine # [ 534.850830] niks3-server[1194]: 2026/10/05 12:04:24 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.ls machine # [ 534.852030] niks3-server[1194]: 2026/10/05 12:04:24 INFO Registered completed upload object_key=nar/04bim5f8bvjh25xncf5x40kb529khrlzcbc92qxvapgbc0bdfv2h.nar.zst machine # [ 534.854360] niks3-server[1194]: 2026/10/05 12:04:24 INFO Received complete push request method=POST path=/api/pushes/25/complete machine # [ 534.856872] niks3-server[1194]: 2026/10/05 12:04:24 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.narinfo machine # [ 559.562735] niks3-server[1194]: 2026/10/05 12:04:49 INFO Received push request method=POST path=/api/pushes machine # [ 559.579738] niks3-server[1194]: 2026/10/05 12:04:49 INFO Received sign narinfos request method=POST path=/api/pushes/26/sign machine # [ 559.582612] niks3-server[1194]: 2026/10/05 12:04:49 INFO Signed narinfos id=26 count=1 machine # [ 559.585083] niks3-server[1194]: 2026/10/05 12:04:49 INFO Registered completed upload object_key=nar/11f7f1hixry25c2yc6np9hs10a2pwwqmymmrxxbswhdjabcyvv0s.nar.zst machine # [ 559.586060] niks3-server[1194]: 2026/10/05 12:04:49 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.ls machine # [ 559.589953] niks3-server[1194]: 2026/10/05 12:04:49 INFO Registered completed upload object_key=log/jz7biafi8rj5r3r392blyazw5mdpvy0d-k3s-top.drv machine # [ 559.593872] niks3-server[1194]: 2026/10/05 12:04:49 INFO Received complete push request method=POST path=/api/pushes/26/complete machine # [ 559.598355] niks3-server[1194]: 2026/10/05 12:04:49 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1, in 75.28 seconds) (finished: subtest: a renewed balancer certificate is served without a rollout, in 136.77 seconds) subtest: metrics carry build_info machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-7f47df8658-7kq4k -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-7f47df8658-7kq4k -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.14 seconds) machine: must succeed: curl -sf http://10.42.0.6:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-7f47df8658-7kq4k"' machine: (finished: must succeed: curl -sf http://10.42.0.6:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-7f47df8658-7kq4k"', in 0.02 seconds) (finished: subtest: metrics carry build_info, in 0.16 seconds) subtest: harmonia-gc frees space and the worker stays Ready machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7f47df8658-7kq4k -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'' machine # [ 559.946375] k3s[885]: E1005 12:04:49.834981 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:50258: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7f47df8658-7kq4k -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'', in 0.16 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7f47df8658-7kq4k -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done' machine # [ 560.183743] k3s[885]: E1005 12:04:50.072724 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:50268: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7f47df8658-7kq4k -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done', in 0.24 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7f47df8658-7kq4k -c gc -- sh -c 'fallocate -l 11443748864 /nix/fill' machine # [ 560.362084] k3s[885]: E1005 12:04:50.250729 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:50274: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7f47df8658-7kq4k -c gc -- sh -c 'fallocate -l 11443748864 /nix/fill', in 0.18 seconds) machine: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-7f47df8658-7kq4k -c gc --since=30s | grep -q 'store paths deleted' machine: (finished: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-7f47df8658-7kq4k -c gc --since=30s | grep -q 'store paths deleted', in 2.56 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7f47df8658-7kq4k -c gc -- sh -c 'rm /nix/fill' machine # [ 563.097425] k3s[885]: E1005 12:04:52.986069 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:54078: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7f47df8658-7kq4k -c gc -- sh -c 'rm /nix/fill', in 0.17 seconds) machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-7f47df8658-7kq4k -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-7f47df8658-7kq4k -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}', in 0.12 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7f47df8658-7kq4k -c gc -- sh -c 'command -v nix-daemon && command -v niks3' machine # [ 563.381867] k3s[885]: E1005 12:04:53.270797 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:54084: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7f47df8658-7kq4k -c gc -- sh -c 'command -v nix-daemon && command -v niks3', in 0.17 seconds) (finished: subtest: harmonia-gc frees space and the worker stays Ready, in 3.60 seconds) subtest: losing the balancer mid-build: the client reconnects and the build succeeds machine: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1 machine # [ 563.405554] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1. machine # Running as unit: vialb.service; invocation ID: 7014e10069e14e1387503cabe8716e53 machine: (finished: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1, in 0.02 seconds) machine: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'" machine # [ 563.513422] nix[10873]: don't know how to build these paths: machine # [ 563.514437] nix[10873]: /nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 563.531199] nix[10873]: copying 1 paths to '127.0.0.1:30051'... machine # [ 563.532131] nix[10873]: copying path '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' to '127.0.0.1:30051'... machine # [ 563.575487] niks3-server[1194]: 2026/10/05 12:04:53 INFO Received push request method=POST path=/api/pushes machine # [ 563.588361] niks3-server[1194]: 2026/10/05 12:04:53 INFO Received sign narinfos request method=POST path=/api/pushes/27/sign machine # [ 563.589110] niks3-server[1194]: 2026/10/05 12:04:53 INFO Signed narinfos id=27 count=1 machine # [ 563.591737] niks3-server[1194]: 2026/10/05 12:04:53 INFO Registered completed upload object_key=nar/0kkr2vb091wkq0cb0f1q92413dsfskh76wydp8mwysv7rawns0ar.nar.zst machine # [ 563.595825] niks3-server[1194]: 2026/10/05 12:04:53 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.ls machine # [ 563.597947] niks3-server[1194]: 2026/10/05 12:04:53 INFO Received complete push request method=POST path=/api/pushes/27/complete machine # [ 563.601080] niks3-server[1194]: 2026/10/05 12:04:53 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.narinfo machine # [ 563.609590] nix[10873]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 563.610076] nix[10873]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-7f47df8658-7kq4k: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine: (finished: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'", in 1.06 seconds) machine: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false machine: (finished: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false, in 0.19 seconds) machine: waiting for success: ! systemctl is-active vialb machine # [ 564.675562] nix[10873]: d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv: Stream removed (Socket closed), asking the scheduler again machine # [ 564.676635] nix[10873]: scheduler at 127.0.0.1:30051: Stream removed (Socket closed), reconnecting machine # [ 564.699142] systemd[1]: cri-containerd-9dabd35a0208d88b88988315b12cedaf0de02ee8faee87053d0dd655e40ffa98.scope: Deactivated successfully. machine # [ 564.700744] systemd[1]: cri-containerd-9dabd35a0208d88b88988315b12cedaf0de02ee8faee87053d0dd655e40ffa98.scope: Consumed 5.099s CPU time over 8min 31.466s wall clock time, 54M memory peak, 32.3M read from disk, 621.8K incoming IP traffic, 759.2K outgoing IP traffic. machine # [ 564.733574] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-9dabd35a0208d88b88988315b12cedaf0de02ee8faee87053d0dd655e40ffa98-rootfs.mount: Deactivated successfully. machine # [ 564.760556] systemd[1]: cri-containerd-4bb49ab117ed6b6ac5be8354ea0695c6320a852c718d8213f71d896e86857273.scope: Deactivated successfully. machine # [ 564.788847] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod88ee8f3e_083a_4033_8417_99f7b46e779d.slice. machine # [ 564.798586] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-4bb49ab117ed6b6ac5be8354ea0695c6320a852c718d8213f71d896e86857273-rootfs.mount: Deactivated successfully. machine # [ 564.823815] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-4bb49ab117ed6b6ac5be8354ea0695c6320a852c718d8213f71d896e86857273-shm.mount: Deactivated successfully. machine # [ 565.009432] cni0: port 2(vetha2a57c14) entered disabled state machine # [ 564.858642] dhcpcd[690]: vetha2a57c14: carrier lost machine # [ 565.011712] vetha2a57c14 (unregistering): left allmulticast mode machine # [ 565.013009] vetha2a57c14 (unregistering): left promiscuous mode machine # [ 565.014226] cni0: port 2(vetha2a57c14) entered disabled state machine # [ 564.891254] dhcpcd[690]: vetha2a57c14: deleting address fe80::98a6:d6ff:fe1c:b952 machine # [ 564.894120] systemd[1]: run-netns-cni\x2d3109475f\x2d2bdb\x2d747a\x2d6699\x2d1373610fdeeb.mount: Deactivated successfully. machine # [ 564.895831] dhcpcd[690]: vetha2a57c14: deleting route to 169.254.0.0/16 machine # [ 564.948756] k3s[885]: I1005 12:04:54.837477 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/88ee8f3e-083a-4033-8417-99f7b46e779d-config\") pod \"nix-grpc-farm-lb-6b9475456-hhb9k\" (UID: \"88ee8f3e-083a-4033-8417-99f7b46e779d\") " pod="farm/nix-grpc-farm-lb-6b9475456-hhb9k" machine # [ 564.953076] k3s[885]: I1005 12:04:54.837516 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/88ee8f3e-083a-4033-8417-99f7b46e779d-tls-lb\") pod \"nix-grpc-farm-lb-6b9475456-hhb9k\" (UID: \"88ee8f3e-083a-4033-8417-99f7b46e779d\") " pod="farm/nix-grpc-farm-lb-6b9475456-hhb9k" machine # [ 564.957338] k3s[885]: I1005 12:04:54.837546 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/88ee8f3e-083a-4033-8417-99f7b46e779d-tmp\") pod \"nix-grpc-farm-lb-6b9475456-hhb9k\" (UID: \"88ee8f3e-083a-4033-8417-99f7b46e779d\") " pod="farm/nix-grpc-farm-lb-6b9475456-hhb9k" machine # [ 564.961203] k3s[885]: I1005 12:04:54.837569 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/88ee8f3e-083a-4033-8417-99f7b46e779d-tls-ca\") pod \"nix-grpc-farm-lb-6b9475456-hhb9k\" (UID: \"88ee8f3e-083a-4033-8417-99f7b46e779d\") " pod="farm/nix-grpc-farm-lb-6b9475456-hhb9k" machine # [ 564.969286] dhcpcd[690]: vetha2a57c14: removing interface machine # [ 565.049291] k3s[885]: I1005 12:04:54.938289 885 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/19ca7158-1589-41b2-bd51-569f5c05f11d-tmp\" (UniqueName: \"kubernetes.io/empty-dir/19ca7158-1589-41b2-bd51-569f5c05f11d-tmp\") pod \"19ca7158-1589-41b2-bd51-569f5c05f11d\" (UID: \"19ca7158-1589-41b2-bd51-569f5c05f11d\") " machine # [ 565.050067] k3s[885]: I1005 12:04:54.938334 885 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/19ca7158-1589-41b2-bd51-569f5c05f11d-tls-lb\" (UniqueName: \"kubernetes.io/secret/19ca7158-1589-41b2-bd51-569f5c05f11d-tls-lb\") pod \"19ca7158-1589-41b2-bd51-569f5c05f11d\" (UID: \"19ca7158-1589-41b2-bd51-569f5c05f11d\") " machine # [ 565.050797] k3s[885]: I1005 12:04:54.938369 885 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/19ca7158-1589-41b2-bd51-569f5c05f11d-tls-ca\" (UniqueName: \"kubernetes.io/secret/19ca7158-1589-41b2-bd51-569f5c05f11d-tls-ca\") pod \"19ca7158-1589-41b2-bd51-569f5c05f11d\" (UID: \"19ca7158-1589-41b2-bd51-569f5c05f11d\") " machine # [ 565.051500] k3s[885]: I1005 12:04:54.938400 885 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/19ca7158-1589-41b2-bd51-569f5c05f11d-config\" (UniqueName: \"kubernetes.io/configmap/19ca7158-1589-41b2-bd51-569f5c05f11d-config\") pod \"19ca7158-1589-41b2-bd51-569f5c05f11d\" (UID: \"19ca7158-1589-41b2-bd51-569f5c05f11d\") " machine # [ 565.058313] systemd[1]: var-lib-kubelet-pods-19ca7158\x2d1589\x2d41b2\x2dbd51\x2d569f5c05f11d-volume\x2dsubpaths-config-envoy-0.mount: Deactivated successfully. machine # [ 565.059036] systemd[1]: var-lib-kubelet-pods-19ca7158\x2d1589\x2d41b2\x2dbd51\x2d569f5c05f11d-volumes-kubernetes.io\x7esecret-tls\x2dca.mount: Deactivated successfully. machine # [ 565.059822] systemd[1]: var-lib-kubelet-pods-19ca7158\x2d1589\x2d41b2\x2dbd51\x2d569f5c05f11d-volumes-kubernetes.io\x7esecret-tls\x2dlb.mount: Deactivated successfully. machine # [ 565.060437] systemd[1]: var-lib-kubelet-pods-19ca7158\x2d1589\x2d41b2\x2dbd51\x2d569f5c05f11d-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 565.073190] k3s[885]: I1005 12:04:54.962209 885 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19ca7158-1589-41b2-bd51-569f5c05f11d-tls-lb" pod "19ca7158-1589-41b2-bd51-569f5c05f11d" (UID: "19ca7158-1589-41b2-bd51-569f5c05f11d"). InnerVolumeSpecName "tls-lb". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 565.075868] k3s[885]: I1005 12:04:54.964880 885 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19ca7158-1589-41b2-bd51-569f5c05f11d-tls-ca" pod "19ca7158-1589-41b2-bd51-569f5c05f11d" (UID: "19ca7158-1589-41b2-bd51-569f5c05f11d"). InnerVolumeSpecName "tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 565.076733] k3s[885]: I1005 12:04:54.965084 885 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19ca7158-1589-41b2-bd51-569f5c05f11d-tmp" pod "19ca7158-1589-41b2-bd51-569f5c05f11d" (UID: "19ca7158-1589-41b2-bd51-569f5c05f11d"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 565.092746] k3s[885]: I1005 12:04:54.981731 885 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19ca7158-1589-41b2-bd51-569f5c05f11d-config" pod "19ca7158-1589-41b2-bd51-569f5c05f11d" (UID: "19ca7158-1589-41b2-bd51-569f5c05f11d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 565.270602] cni0: port 1(veth105c437c) entered blocking state machine # [ 565.271739] cni0: port 1(veth105c437c) entered disabled state machine # [ 565.272831] veth105c437c: entered allmulticast mode machine # [ 565.273831] veth105c437c: entered promiscuous mode machine # [ 565.125163] (udev-worker)[11096]: Network interface NamePolicy= disabled on kernel command line. machine # [ 565.280679] cni0: port 1(veth105c437c) entered blocking state machine # [ 565.281877] cni0: port 1(veth105c437c) entered forwarding state machine # [ 565.152798] dhcpcd[690]: veth105c437c: IAID 75:95:1c:cb machine # [ 565.153753] dhcpcd[690]: veth105c437c: adding address fe80::fc11:75ff:fe95:1ccb machine # [ 565.172961] k3s[885]: I1005 12:04:55.061963 885 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19ca7158-1589-41b2-bd51-569f5c05f11d-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 565.176080] k3s[885]: I1005 12:04:55.061999 885 reconciler_common.go:299] "Volume detached for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/19ca7158-1589-41b2-bd51-569f5c05f11d-tls-lb\") on node \"machine\" DevicePath \"\"" machine # [ 565.176934] k3s[885]: I1005 12:04:55.062011 885 reconciler_common.go:299] "Volume detached for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/19ca7158-1589-41b2-bd51-569f5c05f11d-tls-ca\") on node \"machine\" DevicePath \"\"" machine # [ 565.177703] k3s[885]: I1005 12:04:55.062025 885 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/19ca7158-1589-41b2-bd51-569f5c05f11d-config\") on node \"machine\" DevicePath \"\"" machine # [ 565.212326] systemd[1]: Started libcontainer container 6ba1268967a06d0d7f48fcbaf246100e814b1fcd598f339ef8e51f4b1fb19a26. machine # [ 565.290870] dhcpcd[690]: veth105c437c: soliciting a DHCP lease machine # [ 565.334310] systemd[1]: Started libcontainer container ea670ff186e10b736049f552d8bacb10e236e2db2deadb7b54938b748a94f768. machine # [ 565.680074] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod19ca7158_1589_41b2_bd51_569f5c05f11d.slice. machine # [ 565.681581] systemd[1]: kubepods-besteffort-pod19ca7158_1589_41b2_bd51_569f5c05f11d.slice: Consumed 5.128s CPU time over 8min 34.597s wall clock time, 54.3M memory peak, 32.3M read from disk, 621.8K incoming IP traffic, 759.2K outgoing IP traffic. machine # [ 565.747644] systemd[1]: var-lib-kubelet-pods-19ca7158\x2d1589\x2d41b2\x2dbd51\x2d569f5c05f11d-volume\x2dsubpaths-config-envoy-3.mount: Deactivated successfully. machine # [ 565.749321] systemd[1]: var-lib-kubelet-pods-19ca7158\x2d1589\x2d41b2\x2dbd51\x2d569f5c05f11d-volume\x2dsubpaths-config-envoy-2.mount: Deactivated successfully. machine # [ 565.750490] systemd[1]: var-lib-kubelet-pods-19ca7158\x2d1589\x2d41b2\x2dbd51\x2d569f5c05f11d-volume\x2dsubpaths-config-envoy-1.mount: Deactivated successfully. machine # [ 565.823464] k3s[885]: E1005 12:04:55.712364 885 kubelet_pods.go:2193] "failed to read memory cgroup config for the pod" err="failed to read memory.max for cgroup /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod19ca7158_1589_41b2_bd51_569f5c05f11d.slice: openat2 /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod19ca7158_1589_41b2_bd51_569f5c05f11d.slice/memory.max: no such file or directory" podName="nix-grpc-farm-lb-6b9475456-4zs7x" machine # [ 565.825346] k3s[885]: I1005 12:04:55.712398 885 scope.go:122] "RemoveContainer" containerID="9dabd35a0208d88b88988315b12cedaf0de02ee8faee87053d0dd655e40ffa98" machine # [ 565.827431] k3s[885]: E1005 12:04:55.712474 885 kubelet_pods.go:2198] "failed to read memory cgroup limits for the pod" err="failed to read cpu.max file for cgroup /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod19ca7158_1589_41b2_bd51_569f5c05f11d.slice: openat2 /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod19ca7158_1589_41b2_bd51_569f5c05f11d.slice/cpu.max: no such file or directory" podName="nix-grpc-farm-lb-6b9475456-4zs7x" machine # [ 565.853141] k3s[885]: I1005 12:04:55.741852 885 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-6b9475456-hhb9k" podStartSLOduration=1.741810836 podStartE2EDuration="1.741810836s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-05 12:04:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-05 12:04:55.294878056 +0000 UTC m=+548.276176100" watchObservedRunningTime="2026-10-05 12:04:55.741810836 +0000 UTC m=+548.723113630" machine # [ 567.126183] dhcpcd[690]: veth105c437c: soliciting an IPv6 router machine # [ 567.179550] nix[10873]: scheduler at 127.0.0.1:30051: failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:30051: tcp handshaker shutdown, reconnecting machine # [ 567.669437] k3s[885]: I1005 12:04:57.557620 885 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="19ca7158-1589-41b2-bd51-569f5c05f11d" path="/var/lib/kubelet/pods/19ca7158-1589-41b2-bd51-569f5c05f11d/volumes" machine # [ 568.224327] nix[10873]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 568.227842] nix[10873]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-7f47df8658-q597q: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 570.293219] dhcpcd[690]: veth105c437c: probing for an IPv4LL address machine # [ 575.721688] dhcpcd[690]: veth105c437c: using IPv4LL address 169.254.177.182 machine # [ 575.724278] dhcpcd[690]: veth105c437c: adding route to 169.254.0.0/16 machine # [ 579.132107] dhcpcd[690]: veth105c437c: no IPv6 Routers available machine # [ 610.072601] postgres[760]: [760] LOG: checkpoint starting: time machine # [ 612.910425] postgres[760]: [760] LOG: checkpoint complete: wrote 28 buffers (0.2%), wrote 1 SLRU buffers; 0 WAL file(s) added, 0 removed, 0 recycled; write=2.815 s, sync=0.009 s, total=2.838 s; sync files=25, longest=0.003 s, average=0.001 s; distance=285 kB, estimate=4506 kB; lsn=0/1C89708, redo lsn=0/1C89678 machine # [ 613.563399] niks3-server[1194]: 2026/10/05 12:05:43 INFO Received push request method=POST path=/api/pushes machine # [ 613.583728] niks3-server[1194]: 2026/10/05 12:05:43 INFO Received sign narinfos request method=POST path=/api/pushes/28/sign machine # [ 613.584537] niks3-server[1194]: 2026/10/05 12:05:43 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.ls machine # [ 613.590312] niks3-server[1194]: 2026/10/05 12:05:43 INFO Signed narinfos id=28 count=1 machine # [ 613.596555] niks3-server[1194]: 2026/10/05 12:05:43 INFO Registered completed upload object_key=log/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 613.601229] niks3-server[1194]: 2026/10/05 12:05:43 INFO Received complete push request method=POST path=/api/pushes/28/complete machine # [ 613.604252] niks3-server[1194]: 2026/10/05 12:05:43 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.narinfo machine # [ 613.654567] systemd[1]: vialb.service: Deactivated successfully. machine # [ 613.656281] systemd[1]: vialb.service: Consumed 182ms CPU time over 50.248s wall clock time, 38.7M memory peak, 4K written to disk, 8.5K incoming IP traffic, 17.1K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active vialb, in 49.86 seconds) machine: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; }, in 0.04 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 0.20 seconds) (finished: subtest: losing the balancer mid-build: the client reconnects and the build succeeds, in 51.36 seconds) subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes machine: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 machine # [ 614.766692] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1. machine # Running as unit: slow.service; invocation ID: 5cc55a334ac9491b8d13bf25237d2a46 machine: (finished: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1, in 0.02 seconds) machine # [ 614.888772] nix[11876]: don't know how to build these paths: machine # [ 614.889849] nix[11876]: /nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 614.911770] nix[11876]: copying 1 paths to '127.0.0.1:30051'... machine # [ 614.912445] nix[11876]: copying path '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' to '127.0.0.1:30051'... machine # [ 614.948726] niks3-server[1194]: 2026/10/05 12:05:44 INFO Received push request method=POST path=/api/pushes machine # [ 614.960347] niks3-server[1194]: 2026/10/05 12:05:44 INFO Received sign narinfos request method=POST path=/api/pushes/29/sign machine # [ 614.962540] k3s[885]: E1005 12:05:44.851213 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52286: use of closed network connection" machine # command terminated with exit code 1 machine # [ 614.965764] niks3-server[1194]: 2026/10/05 12:05:44 INFO Signed narinfos id=29 count=1 machine # [ 614.968422] niks3-server[1194]: 2026/10/05 12:05:44 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.ls machine # [ 614.970365] niks3-server[1194]: 2026/10/05 12:05:44 INFO Registered completed upload object_key=nar/0wl2i9xpw0gwrx1xqdgx9ka4n503ky9qhl20pdrdlphn8d6lcx0i.nar.zst machine # [ 614.974832] niks3-server[1194]: 2026/10/05 12:05:44 INFO Received complete push request method=POST path=/api/pushes/29/complete machine # [ 614.978197] niks3-server[1194]: 2026/10/05 12:05:44 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.narinfo machine # [ 614.987131] nix[11876]: building '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' on 127.0.0.1:30051... machine # [ 614.987872] nix[11876]: slow-s1> machine/nix-grpc-farm-worker-x86-64-linux-7f47df8658-7kq4k: building zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 615.141524] k3s[885]: E1005 12:05:45.030461 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52296: use of closed network connection" machine # command terminated with exit code 1 machine # [ 616.403900] k3s[885]: E1005 12:05:46.292596 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52308: use of closed network connection" machine # command terminated with exit code 1 machine # [ 616.607314] k3s[885]: E1005 12:05:46.496072 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52324: use of closed network connection" machine # command terminated with exit code 1 machine # [ 617.853189] k3s[885]: E1005 12:05:47.741849 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52326: use of closed network connection" machine # command terminated with exit code 1 machine # [ 618.027840] k3s[885]: E1005 12:05:47.916832 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52342: use of closed network connection" machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 619.297508] k3s[885]: E1005 12:05:49.183428 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52352: use of closed network connection" machine # [ 619.466174] k3s[885]: E1005 12:05:49.355161 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52366: use of closed network connection" machine # command terminated with exit code 1 machine # [ 619.892072] k3s[885]: I1005 12:05:49.780930 885 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 620.701546] k3s[885]: E1005 12:05:50.590265 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52382: use of closed network connection" machine # command terminated with exit code 1 machine # [ 620.876809] k3s[885]: E1005 12:05:50.765799 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52390: use of closed network connection" machine # command terminated with exit code 1 machine # [ 622.177115] k3s[885]: E1005 12:05:52.065533 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52406: use of closed network connection" machine # command terminated with exit code 1 machine # [ 622.351088] k3s[885]: E1005 12:05:52.240062 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52418: use of closed network connection" machine # command terminated with exit code 1 machine # [ 623.641492] k3s[885]: E1005 12:05:53.530167 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:60086: use of closed network connection" machine # command terminated with exit code 1 machine # [ 623.830048] k3s[885]: E1005 12:05:53.718950 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:60102: use of closed network connection" machine # command terminated with exit code 1 machine # [ 625.055254] k3s[885]: E1005 12:05:54.943921 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:60118: use of closed network connection" machine # command terminated with exit code 1 machine # [ 625.220452] k3s[885]: E1005 12:05:55.109457 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:60132: use of closed network connection" machine # command terminated with exit code 1 machine # [ 626.487391] k3s[885]: E1005 12:05:56.376022 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:60144: use of closed network connection" machine # command terminated with exit code 1 machine # [ 626.676056] k3s[885]: E1005 12:05:56.564940 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:60156: use of closed network connection" machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 627.942257] k3s[885]: E1005 12:05:57.829957 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:60164: use of closed network connection" machine # [ 628.109691] k3s[885]: E1005 12:05:57.998688 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:60166: use of closed network connection" machine # command terminated with exit code 1 machine # [ 629.390257] k3s[885]: E1005 12:05:59.278848 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:60182: use of closed network connection" machine # command terminated with exit code 1 machine # [ 629.575855] k3s[885]: E1005 12:05:59.464840 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:60190: use of closed network connection" machine # command terminated with exit code 1 machine # [ 630.874937] k3s[885]: E1005 12:06:00.763677 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:60198: use of closed network connection" machine # command terminated with exit code 1 machine # [ 631.123457] k3s[885]: E1005 12:06:01.012447 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:60210: use of closed network connection" machine # command terminated with exit code 1 machine # [ 632.393371] k3s[885]: E1005 12:06:02.281870 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:60214: use of closed network connection" machine # command terminated with exit code 1 machine # [ 632.565983] k3s[885]: E1005 12:06:02.454964 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:60216: use of closed network connection" machine # command terminated with exit code 1 machine # [ 633.822877] k3s[885]: E1005 12:06:03.711575 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52714: use of closed network connection" machine # command terminated with exit code 1 machine # [ 634.025692] k3s[885]: E1005 12:06:03.914677 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52718: use of closed network connection" machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 635.331187] k3s[885]: E1005 12:06:05.218900 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52730: use of closed network connection" machine # [ 635.530127] k3s[885]: E1005 12:06:05.418978 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52736: use of closed network connection" machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 636.833918] k3s[885]: E1005 12:06:06.721795 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52748: use of closed network connection" machine # [ 637.017864] k3s[885]: E1005 12:06:06.906861 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52764: use of closed network connection" machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 638.202211] k3s[885]: E1005 12:06:08.090198 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52776: use of closed network connection" machine # [ 638.365765] k3s[885]: E1005 12:06:08.254757 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52790: use of closed network connection" machine # command terminated with exit code 1 machine # [ 639.583546] k3s[885]: E1005 12:06:09.472237 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52794: use of closed network connection" machine # [ 639.759641] k3s[885]: E1005 12:06:09.648272 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52802: use of closed network connection" machine: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-7f47df8658-7kq4k --wait=false machine: (finished: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-7f47df8658-7kq4k --wait=false, in 0.15 seconds) machine: must succeed: sleep 5.0 machine # [ 639.957187] systemd[1]: cri-containerd-740f5c4390c3c981f16dc7aeaa0ecc5cf9501f49f2d1e53c89212bdc444b69e8.scope: Deactivated successfully. machine # [ 639.957938] systemd[1]: cri-containerd-740f5c4390c3c981f16dc7aeaa0ecc5cf9501f49f2d1e53c89212bdc444b69e8.scope: Consumed 560ms CPU time over 9min 37.604s wall clock time, 13.4M memory peak, 5.3M read from disk. machine # [ 639.986397] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-740f5c4390c3c981f16dc7aeaa0ecc5cf9501f49f2d1e53c89212bdc444b69e8-rootfs.mount: Deactivated successfully. machine # [ 640.409241] k3s[885]: E1005 12:06:10.297880 885 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658\" failed with read version: 895 is not as new as written version: 898 for group resource replicasets.apps" logger="UnhandledError" machine # [ 640.415133] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod56e50233_38f9_4e0e_8502_476b49aa4e1d.slice. machine # [ 640.418115] k3s[885]: E1005 12:06:10.306978 885 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658\" failed with read version: 895 is not as new as written version: 898 for group resource replicasets.apps" logger="UnhandledError" machine # [ 640.558480] k3s[885]: I1005 12:06:10.447454 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/56e50233-38f9-4e0e-8502-476b49aa4e1d-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-vgvkz\" (UID: \"56e50233-38f9-4e0e-8502-476b49aa4e1d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-vgvkz" machine # [ 640.565330] k3s[885]: I1005 12:06:10.447503 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/56e50233-38f9-4e0e-8502-476b49aa4e1d-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-vgvkz\" (UID: \"56e50233-38f9-4e0e-8502-476b49aa4e1d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-vgvkz" machine # [ 640.573027] k3s[885]: I1005 12:06:10.447530 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tcv8\" (UniqueName: \"kubernetes.io/projected/56e50233-38f9-4e0e-8502-476b49aa4e1d-kube-api-access-8tcv8\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-vgvkz\" (UID: \"56e50233-38f9-4e0e-8502-476b49aa4e1d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-vgvkz" machine # [ 640.577858] k3s[885]: I1005 12:06:10.447561 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/56e50233-38f9-4e0e-8502-476b49aa4e1d-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-vgvkz\" (UID: \"56e50233-38f9-4e0e-8502-476b49aa4e1d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-vgvkz" machine # [ 640.582197] k3s[885]: I1005 12:06:10.447587 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/56e50233-38f9-4e0e-8502-476b49aa4e1d-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-vgvkz\" (UID: \"56e50233-38f9-4e0e-8502-476b49aa4e1d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-vgvkz" machine # [ 640.586703] k3s[885]: I1005 12:06:10.447613 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/56e50233-38f9-4e0e-8502-476b49aa4e1d-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-vgvkz\" (UID: \"56e50233-38f9-4e0e-8502-476b49aa4e1d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-vgvkz" machine # [ 640.591207] k3s[885]: I1005 12:06:10.447640 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/56e50233-38f9-4e0e-8502-476b49aa4e1d-build\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-vgvkz\" (UID: \"56e50233-38f9-4e0e-8502-476b49aa4e1d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-vgvkz" machine # [ 640.595611] k3s[885]: I1005 12:06:10.447665 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/56e50233-38f9-4e0e-8502-476b49aa4e1d-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-vgvkz\" (UID: \"56e50233-38f9-4e0e-8502-476b49aa4e1d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-vgvkz" machine # [ 640.599915] k3s[885]: I1005 12:06:10.447693 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/56e50233-38f9-4e0e-8502-476b49aa4e1d-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-vgvkz\" (UID: \"56e50233-38f9-4e0e-8502-476b49aa4e1d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-vgvkz" machine # [ 640.952107] cni0: port 2(vetheae64d47) entered blocking state machine # [ 640.954297] cni0: port 2(vetheae64d47) entered disabled state machine # [ 640.958055] vetheae64d47: entered allmulticast mode machine # [ 640.962347] vetheae64d47: entered promiscuous mode machine # [ 640.983345] cni0: port 2(vetheae64d47) entered blocking state machine # [ 640.984211] cni0: port 2(vetheae64d47) entered forwarding state machine # [ 640.866470] (udev-worker)[13532]: Network interface NamePolicy= disabled on kernel command line. machine # [ 640.891418] dhcpcd[690]: vetheae64d47: IAID 98:cb:87:04 machine # [ 640.892299] dhcpcd[690]: vetheae64d47: adding address fe80::1816:98ff:fecb:8704 machine # [ 640.926327] systemd[1]: Started libcontainer container 718bbc3f63350b2413412488cedcd7a92e1740cfeb6c51495173378c4575f26d. machine # [ 641.100288] systemd[1]: tmp-ovl\x2didmapped3313104471.mount: Deactivated successfully. machine # [ 641.119269] systemd[1]: Started libcontainer container 4b455991a75bd2c2d796dc25f194592b766f460bf9a4a5c9b6cf48467a607ec1. machine # [ 642.535383] dhcpcd[690]: vetheae64d47: soliciting a DHCP lease machine # [ 642.816268] dhcpcd[690]: vetheae64d47: soliciting an IPv6 router machine # [ 643.711464] systemd[1]: cri-containerd-4b455991a75bd2c2d796dc25f194592b766f460bf9a4a5c9b6cf48467a607ec1.scope: Deactivated successfully. machine # [ 643.715601] systemd[1]: cri-containerd-4b455991a75bd2c2d796dc25f194592b766f460bf9a4a5c9b6cf48467a607ec1.scope: Consumed 1.118s CPU time over 2.593s wall clock time, 445.1M memory peak, 161M read from disk, 84.3M written to disk. machine # [ 643.767371] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-4b455991a75bd2c2d796dc25f194592b766f460bf9a4a5c9b6cf48467a607ec1-rootfs.mount: Deactivated successfully. machine # [ 644.326895] systemd[1]: tmp-ovl\x2didmapped1461948507.mount: Deactivated successfully. machine # [ 644.344282] systemd[1]: Started libcontainer container f6c6aa4c6c2a4bb2221b729221bacc491d3348d5646d1717b8160f2e9e04f843. machine # [ 644.496142] systemd[1]: Started libcontainer container 972f2e4b5d74eba976acc626ffcbb0a1d5cd78aee6b9f2a49a66139a92827316. machine # [ 644.691428] systemd[1]: Started libcontainer container 868ec05f5bd4cfc12ddc4a394a20f49c3fc4da6561d7b6ba8517eb7d25867fd2. machine # [ 644.757499] k3s[885]: I1005 12:06:14.645963 885 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-vgvkz" podStartSLOduration=2.080000178 podStartE2EDuration="4.645937469s" totalImagesPullingTime="0s" totalInitContainerRuntime="2.565937291s" isStatefulPod=false podCreationTimestamp="2026-10-05 12:06:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-05 12:06:14.643963475 +0000 UTC m=+627.625261240" watchObservedRunningTime="2026-10-05 12:06:14.645937469 +0000 UTC m=+627.627235234" machine: (finished: must succeed: sleep 5.0, in 5.03 seconds) machine # [ 645.124572] k3s[885]: E1005 12:06:15.013519 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:57166: use of closed network connection" machine: waiting for success: ! systemctl is-active slow machine # [ 647.537116] dhcpcd[690]: vetheae64d47: probing for an IPv4LL address machine # [ 653.239205] dhcpcd[690]: vetheae64d47: using IPv4LL address 169.254.207.194 machine # [ 653.241074] dhcpcd[690]: vetheae64d47: adding route to 169.254.0.0/16 machine # [ 654.820913] dhcpcd[690]: vetheae64d47: no IPv6 Routers available machine # [ 659.529779] niks3-server[1194]: 2026/10/05 12:06:29 INFO Received push request method=POST path=/api/pushes machine # [ 659.552835] niks3-server[1194]: 2026/10/05 12:06:29 INFO Received sign narinfos request method=POST path=/api/pushes/30/sign machine # [ 659.555434] niks3-server[1194]: 2026/10/05 12:06:29 INFO Signed narinfos id=30 count=1 machine # [ 659.558426] niks3-server[1194]: 2026/10/05 12:06:29 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.ls machine # [ 659.560645] niks3-server[1194]: 2026/10/05 12:06:29 INFO Registered completed upload object_key=log/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 659.569585] niks3-server[1194]: 2026/10/05 12:06:29 INFO Received complete push request method=POST path=/api/pushes/30/complete machine # [ 659.573278] niks3-server[1194]: 2026/10/05 12:06:29 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo machine # [ 659.602533] systemd[1]: slow.service: Deactivated successfully. machine # [ 659.603519] systemd[1]: slow.service: Consumed 140ms CPU time over 44.836s wall clock time, 38.6M memory peak, 24K read from disk, 4K written to disk, 5.3K incoming IP traffic, 11.5K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active slow, in 14.57 seconds) machine: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; }, in 0.02 seconds) machine: must fail: journalctl -u slow | grep -q 'asking the scheduler again' machine: (finished: must fail: journalctl -u slow | grep -q 'asking the scheduler again', in 0.01 seconds) machine: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath, in 0.12 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null, in 0.04 seconds) (finished: subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes, in 45.15 seconds) (finished: run the VM test script, in 660.74 seconds) test script finished in 660.78s cleanup kill QemuMachine (pid 45) machine # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) machine # [2026-10-05T12:06:30Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-10-05T12:06:30Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-10-05T12:06:30Z INFO virtiofsd] Client disconnected, shutting down (finished: cleanup, in 1.07 seconds) additionally exposed symbols: machine, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh