tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 1200.0 seconds run the VM test script machine: waiting for unit k3s.service machine: waiting for the VM to finish booting machine: starting vm machine: QEMU running (pid 45) machine # Disk image does not exist, creating the virtualisation disk image... machine # Formatting '/build/vm-state-machine/tmp.0ZEyNQ94yK', fmt=raw size=17179869184 machine # mke2fs 1.47.4 (6-Mar-2025) machine # Discarding device blocks: 0/4194304 done machine # Creating filesystem with 4194304 4k blocks and 1048576 inodes machine # Filesystem UUID: db501d62-fc15-428d-be55-cabc5f37d36d machine # Superblock backups stored on blocks: machine # 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208, machine # 4096000 machine # machine # Allocating group tables: 0/128 done machine # Writing inode tables: 0/128 done machine # Creating journal (32768 blocks): done machine # Writing superblocks and filesystem accounting information: 0/128 done machine # machine # Virtualisation disk image created. machine # Starting virtiofs daemons... machine # [2026-10-05T04:24:27Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-10-05T04:24:27Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-10-05T04:24:27Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-10-05T04:24:27Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-10-05T04:24:27Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-10-05T04:24:27Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-10-05T04:24:27Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-10-05T04:24:27Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-10-05T04:24:27Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-10-05T04:24:27Z INFO virtiofsd] Client connected, servicing requests machine # [2026-10-05T04:24:27Z INFO virtiofsd] Client connected, servicing requests machine # [2026-10-05T04:24:27Z INFO virtiofsd] Client connected, servicing requests machine # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) machine # machine # machine # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+7EFCC730+7EF2C730 CA00 machine # Press Ctrl-B to configure iPXE (PCI 00:02.0)... machine # machine # machine # machine # machine # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 7EFCC730 7EF2C730 CB00 machine # Press Ctrl-B to configure iPXE (PCI 00:05.0)... machine # machine # machine # Booting from ROM... machine # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.53 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 21 13:06:06 UTC 2026 machine # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/fs96pxakbi48i64pjlwwmqihjv5cdxwq-nixos-system-machine-test/init regInfo=/nix/.ro-store/g2y0r09j13lxjy7pxb60m5i3ynhjmvml-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.000000] BIOS-provided physical RAM map: machine # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007ffd7fff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000007ffd8000-0x000000007fffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000017fffffff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved machine # [ 0.000000] NX (Execute Disable) protection: active machine # [ 0.000000] APIC: Static calls initialized machine # [ 0.000000] SMBIOS 2.8 present. machine # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 machine # [ 0.000000] DMI: Memory slots populated: 1/1 machine # [ 0.000000] Hypervisor detected: KVM machine # [ 0.000000] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 machine # [ 0.000000] kvm-clock: using sched offset of 522600588 cycles machine # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns machine # [ 0.000004] tsc: Detected 2400.012 MHz processor machine # [ 0.000804] last_pfn = 0x180000 max_arch_pfn = 0x10000000000 machine # [ 0.000831] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs machine # [ 0.000833] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT machine # [ 0.000871] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.002727] found SMP MP-table at [mem 0x000f5450-0x000f545f] machine # [ 0.002738] Using GB pages for direct mapping machine # [ 0.002850] RAMDISK: [mem 0x7e364000-0x7ffcffff] machine # [ 0.002856] ACPI: Early table checksum verification disabled machine # [ 0.002859] ACPI: RSDP 0x00000000000F5250 000014 (v00 BOCHS ) machine # [ 0.002862] ACPI: RSDT 0x000000007FFE2539 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002867] ACPI: FACP 0x000000007FFE2319 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002873] ACPI: DSDT 0x000000007FFE0040 0022D9 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002875] ACPI: FACS 0x000000007FFE0000 000040 machine # [ 0.002877] ACPI: APIC 0x000000007FFE240D 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002878] ACPI: HPET 0x000000007FFE249D 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002880] ACPI: MCFG 0x000000007FFE24D5 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002881] ACPI: WAET 0x000000007FFE2511 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002883] ACPI: Reserving FACP table memory at [mem 0x7ffe2319-0x7ffe240c] machine # [ 0.002884] ACPI: Reserving DSDT table memory at [mem 0x7ffe0040-0x7ffe2318] machine # [ 0.002884] ACPI: Reserving FACS table memory at [mem 0x7ffe0000-0x7ffe003f] machine # [ 0.002885] ACPI: Reserving APIC table memory at [mem 0x7ffe240d-0x7ffe249c] machine # [ 0.002885] ACPI: Reserving HPET table memory at [mem 0x7ffe249d-0x7ffe24d4] machine # [ 0.002886] ACPI: Reserving MCFG table memory at [mem 0x7ffe24d5-0x7ffe2510] machine # [ 0.002886] ACPI: Reserving WAET table memory at [mem 0x7ffe2511-0x7ffe2538] machine # [ 0.003109] No NUMA configuration found machine # [ 0.003110] Faking a node at [mem 0x0000000000000000-0x000000017fffffff] machine # [ 0.003113] NODE_DATA(0) allocated [mem 0x17fff8780-0x17fffdcff] machine # [ 0.005429] Zone ranges: machine # [ 0.005430] DMA [mem 0x0000000000001000-0x0000000000ffffff] machine # [ 0.005431] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] machine # [ 0.005432] Normal [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005433] Device empty machine # [ 0.005434] Movable zone start for each node machine # [ 0.005434] Early memory node ranges machine # [ 0.005435] node 0: [mem 0x0000000000001000-0x000000000009efff] machine # [ 0.005436] node 0: [mem 0x0000000000100000-0x000000007ffd7fff] machine # [ 0.005437] node 0: [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005437] Initmem setup node 0 [mem 0x0000000000001000-0x000000017fffffff] machine # [ 0.005456] On node 0, zone DMA: 1 pages in unavailable ranges machine # [ 0.005725] On node 0, zone DMA: 97 pages in unavailable ranges machine # [ 0.079202] On node 0, zone Normal: 40 pages in unavailable ranges machine # [ 0.079675] ACPI: PM-Timer IO Port: 0x608 machine # [ 0.079689] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) machine # [ 0.079718] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 machine # [ 0.079721] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) machine # [ 0.079723] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) machine # [ 0.079724] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) machine # [ 0.079725] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) machine # [ 0.079726] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) machine # [ 0.079729] ACPI: Using ACPI (MADT) for SMP configuration information machine # [ 0.079730] ACPI: HPET id: 0x8086a201 base: 0xfed00000 machine # [ 0.079735] TSC deadline timer available machine # [ 0.079739] CPU topo: Max. logical packages: 1 machine # [ 0.079740] CPU topo: Max. logical dies: 1 machine # [ 0.079740] CPU topo: Max. dies per package: 1 machine # [ 0.079744] CPU topo: Max. threads per core: 1 machine # [ 0.079744] CPU topo: Num. cores per package: 4 machine # [ 0.079745] CPU topo: Num. threads per package: 4 machine # [ 0.079745] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs machine # [ 0.079768] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() machine # [ 0.079783] kvm-guest: KVM setup pv remote TLB flush machine # [ 0.079786] kvm-guest: setup PV sched yield machine # [ 0.079796] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] machine # [ 0.079798] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] machine # [ 0.079799] PM: hibernation: Registered nosave memory: [mem 0x7ffd8000-0xffffffff] machine # [ 0.079800] [mem 0xc0000000-0xfed1bfff] available for PCI devices machine # [ 0.079802] Booting paravirtualized kernel on KVM machine # [ 0.079805] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns machine # [ 0.084265] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 machine # [ 0.086814] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288 machine # [ 0.086866] kvm-guest: PV spinlocks enabled machine # [ 0.086867] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) machine # [ 0.086870] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/fs96pxakbi48i64pjlwwmqihjv5cdxwq-nixos-system-machine-test/init regInfo=/nix/.ro-store/g2y0r09j13lxjy7pxb60m5i3ynhjmvml-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.086964] Unknown kernel command line parameters "regInfo=/nix/.ro-store/g2y0r09j13lxjy7pxb60m5i3ynhjmvml-closure-info/registration", will be passed to user space. machine # [ 0.086985] random: crng init done machine # [ 0.086986] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes machine # [ 0.091328] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) machine # [ 0.093498] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) machine # [ 0.093573] software IO TLB: area num 4. machine # [ 0.169122] Fallback order for Node 0: 0 machine # [ 0.169129] Built 1 zonelists, mobility grouping on. Total pages: 1048438 machine # [ 0.169131] Policy zone: Normal machine # [ 0.171653] mem auto-init: stack:all(zero), heap alloc:on, heap free:off machine # [ 0.178490] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 machine # [ 0.187796] allocated 8388608 bytes of page_ext machine # [ 0.197780] ftrace: allocating 48798 entries in 192 pages machine # [ 0.197782] ftrace: allocated 192 pages with 2 groups machine # [ 0.198628] Dynamic Preempt: lazy machine # [ 0.198816] rcu: Preemptible hierarchical RCU implementation. machine # [ 0.198816] rcu: RCU event tracing is enabled. machine # [ 0.198817] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. machine # [ 0.198818] Trampoline variant of Tasks RCU enabled. machine # [ 0.198819] Rude variant of Tasks RCU enabled. machine # [ 0.198819] Tracing variant of Tasks RCU enabled. machine # [ 0.198820] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. machine # [ 0.198820] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 machine # [ 0.198846] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.198848] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.198849] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.203192] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16 machine # [ 0.203481] rcu: srcu_init: Setting srcu_struct sizes based on contention. machine # [ 0.203489] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns machine # [ 0.203604] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) machine # [ 0.207200] Console: colour VGA+ 80x25 machine # [ 0.207203] printk: legacy console [tty0] enabled machine # [ 0.238805] printk: legacy console [ttyS0] enabled machine # [ 0.351735] ACPI: Core revision 20250807 machine # [ 0.352661] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns machine # [ 0.354276] APIC: Switch to symmetric I/O mode setup machine # [ 0.355279] x2apic enabled machine # [ 0.356080] APIC: Switched APIC routing to: physical x2apic machine # [ 0.357064] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask() machine # [ 0.358392] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself() machine # [ 0.359915] kvm-guest: setup PV IPIs machine # [ 0.361547] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 machine # [ 0.362618] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.366978] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) machine # [ 0.369045] x86/cpu: User Mode Instruction Prevention (UMIP) activated machine # [ 0.370138] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 machine # [ 0.370967] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 machine # [ 0.371970] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto machine # [ 0.373967] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl machine # [ 0.374967] Transient Scheduler Attacks: Vulnerable: No microcode machine # [ 0.375967] Spectre V2 : Mitigation: Enhanced / Automatic IBRS machine # [ 0.376967] Speculative Return Stack Overflow: Mitigation: Safe RET machine # [ 0.377966] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization machine # [ 0.378974] Spectre V2 : Enabling IBPB for BPF machine # [ 0.379809] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier machine # [ 0.380967] active return thunk: srso_alias_return_thunk machine # [ 0.381976] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' machine # [ 0.382967] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' machine # [ 0.383967] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' machine # [ 0.384967] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' machine # [ 0.386967] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' machine # [ 0.387967] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' machine # [ 0.388967] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' machine # [ 0.389967] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 machine # [ 0.390967] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 machine # [ 0.392780] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 machine # [ 0.393778] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 machine # [ 0.394763] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 machine # [ 0.395767] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. machine # [ 0.426110] Freeing SMP alternatives memory: 44K machine # [ 0.426970] pid_max: default: 32768 minimum: 301 machine # [ 0.427970] LSM: initializing lsm=capability,landlock,yama,bpf,ima machine # [ 0.429070] landlock: Up and running. machine # [ 0.429734] Yama: becoming mindful. machine # [ 0.430653] LSM support for eBPF active machine # [ 0.431118] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.433011] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.435626] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) machine # [ 0.436549] Performance Events: Fam17h+ core perfctr, AMD PMU driver. machine # [ 0.436972] ... version: 2 machine # [ 0.437749] ... bit width: 48 machine # [ 0.437970] ... generic counters: 6 machine # [ 0.438754] ... generic bitmap: 000000000000003f machine # [ 0.438982] ... fixed-purpose counters: 0 machine # [ 0.439770] ... fixed-purpose bitmap: 0000000000000000 machine # [ 0.440746] ... value mask: 0000ffffffffffff machine # [ 0.440969] ... max period: 00007fffffffffff machine # [ 0.441940] ... global_ctrl mask: 000000000000003f machine # [ 0.442823] signal: max sigframe size: 3376 machine # [ 0.443642] rcu: Hierarchical SRCU implementation. machine # [ 0.443973] rcu: Max phase no-delay instances is 400. machine # [ 0.445043] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level machine # [ 0.450539] smp: Bringing up secondary CPUs ... machine # [ 0.451362] smpboot: x86: Booting SMP configuration: machine # [ 0.451972] .... node #0, CPUs: #1 #2 #3 machine # [ 0.455003] smp: Brought up 1 node, 4 CPUs machine # [ 0.456519] smpboot: Total of 4 processors activated (19200.09 BogoMIPS) machine # [ 0.457203] Memory: 3957856K/4193752K available (17259K kernel code, 2728K rwdata, 13652K rodata, 3656K init, 2968K bss, 220908K reserved, 0K cma-reserved) machine # [ 0.458388] devtmpfs: initialized machine # [ 0.459224] x86/mm: Memory block size: 128MB machine # [ 0.461220] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.463048] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). machine # [ 0.464060] pinctrl core: initialized pinctrl subsystem machine # [ 0.465242] PM: RTC time: 04:24:28, date: 2026-10-05 machine # [ 0.468871] NET: Registered PF_NETLINK/PF_ROUTE protocol family machine # [ 0.470642] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations machine # [ 0.471003] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations machine # [ 0.472544] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations machine # [ 0.472980] audit: initializing netlink subsys (disabled) machine # [ 0.473990] audit: type=2000 audit(1791174268.645:1): state=initialized audit_enabled=0 res=1 machine # [ 0.474197] thermal_sys: Registered thermal governor 'fair_share' machine # [ 0.474971] thermal_sys: Registered thermal governor 'bang_bang' machine # [ 0.475969] thermal_sys: Registered thermal governor 'step_wise' machine # [ 0.476969] thermal_sys: Registered thermal governor 'user_space' machine # [ 0.477970] thermal_sys: Registered thermal governor 'power_allocator' machine # [ 0.478996] cpuidle: using governor menu machine # [ 0.481155] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 machine # [ 0.482293] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] machine # [ 0.482973] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry machine # [ 0.483983] PCI: Using configuration type 1 for base access machine # [ 0.485127] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. machine # [ 0.487138] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages machine # [ 0.487971] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page machine # [ 0.488970] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages machine # [ 0.489971] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page machine # [ 0.493503] ACPI: Added _OSI(Module Device) machine # [ 0.493972] ACPI: Added _OSI(Processor Device) machine # [ 0.494699] ACPI: Added _OSI(Processor Aggregator Device) machine # [ 0.498701] ACPI: 1 ACPI AML tables successfully acquired and loaded machine # [ 0.502271] ACPI: Interpreter enabled machine # [ 0.503518] ACPI: PM: (supports S0 S3 S4 S5) machine # [ 0.503971] ACPI: Using IOAPIC for interrupt routing machine # [ 0.504916] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug machine # [ 0.505978] PCI: Using E820 reservations for host bridge windows machine # [ 0.506966] ACPI: Enabled 2 GPEs in block 00 to 3F machine # [ 0.512403] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) machine # [ 0.512977] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] machine # [ 0.515060] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] machine # [ 0.516096] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] machine # [ 0.517490] PCI host bridge to bus 0000:00 machine # [ 0.517975] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] machine # [ 0.518970] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] machine # [ 0.520970] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] machine # [ 0.521970] pci_bus 0000:00: root bus resource [mem 0x80000000-0xafffffff window] machine # [ 0.522969] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] machine # [ 0.523970] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.525970] pci_bus 0000:00: root bus resource [bus 00-ff] machine # [ 0.527046] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint machine # [ 0.528439] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint machine # [ 0.543056] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] machine # [ 0.543981] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] machine # [ 0.544974] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] machine # [ 0.546297] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] machine # [ 0.548702] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.554009] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] machine # [ 0.554960] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] machine # [ 0.555753] pci 0000:00:02.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref] machine # [ 0.556976] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] machine # [ 0.558539] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.563281] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] machine # [ 0.564619] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] machine # [ 0.565992] pci 0000:00:03.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref] machine # [ 0.567548] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint machine # [ 0.575018] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] machine # [ 0.578006] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] machine # [ 0.580030] pci 0000:00:04.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref] machine # [ 0.587101] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.598012] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] machine # [ 0.599992] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] machine # [ 0.603030] pci 0000:00:05.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref] machine # [ 0.605990] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] machine # [ 0.610368] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint machine # [ 0.618022] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] machine # [ 0.621018] pci 0000:00:06.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref] machine # [ 0.624047] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.630025] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] machine # [ 0.632018] pci 0000:00:07.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref] machine # [ 0.636440] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.645032] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] machine # [ 0.676037] pci 0000:00:08.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref] machine # [ 0.681224] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.689024] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] machine # [ 0.692030] pci 0000:00:09.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref] machine # [ 0.695078] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint machine # [ 0.703017] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] machine # [ 0.704987] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] machine # [ 0.707024] pci 0000:00:0a.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref] machine # [ 0.709618] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.714015] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] machine # [ 0.714975] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] machine # [ 0.715992] pci 0000:00:0b.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref] machine # [ 0.718585] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.720740] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] machine # [ 0.721172] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.723961] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] machine # [ 0.724912] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.727634] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] machine # [ 0.729230] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint machine # [ 0.731729] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] machine # [ 0.732192] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint machine # [ 0.734290] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO machine # [ 0.735225] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint machine # [ 0.738638] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] machine # [ 0.739976] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] machine # [ 0.741280] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint machine # [ 0.743681] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] machine # [ 0.747079] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 machine # [ 0.748080] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 machine # [ 0.750105] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 machine # [ 0.751071] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 machine # [ 0.752072] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 machine # [ 0.753069] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 machine # [ 0.754069] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 machine # [ 0.755068] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 machine # [ 0.756014] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 machine # [ 0.756987] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 machine # [ 0.757982] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 machine # [ 0.759986] ACPI: PCI: Interrupt link GSID configured for IRQ 19 machine # [ 0.760949] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 machine # [ 0.761720] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 machine # [ 0.761982] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 machine # [ 0.762976] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 machine # [ 0.766278] iommu: Default domain type: Translated machine # [ 0.766973] iommu: DMA domain TLB invalidation policy: lazy mode machine # [ 0.768293] ACPI: bus type USB registered machine # [ 0.769034] usbcore: registered new interface driver usbfs machine # [ 0.769986] usbcore: registered new interface driver hub machine # [ 0.770961] usbcore: registered new device driver usb machine # [ 0.772849] NetLabel: Initializing machine # [ 0.774401] NetLabel: domain hash size = 128 machine # [ 0.774970] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO machine # [ 0.775942] NetLabel: unlabeled traffic allowed by default machine # [ 0.776709] PCI: Using ACPI for IRQ routing machine # [ 0.821000] pci 0000:00:01.0: vgaarb: setting as boot VGA device machine # [ 0.821966] pci 0000:00:01.0: vgaarb: bridge control possible machine # [ 0.821966] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none machine # [ 0.823977] vgaarb: loaded machine # [ 0.824723] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 machine # [ 0.825969] hpet0: 3 comparators, 64-bit 100.000000 MHz counter machine # [ 0.831079] clocksource: Switched to clocksource kvm-clock machine # [ 0.835533] VFS: Disk quotas dquot_6.6.0 machine # [ 0.836282] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) machine # [ 0.837946] pnp: PnP ACPI init machine # [ 0.838773] ACPI: IRQ 4 override to edge(!), high(!) machine # [ 0.839744] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved machine # [ 0.841307] pnp: PnP ACPI: found 5 devices machine # [ 0.851065] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns machine # [ 0.852625] clocksource: Switched to clocksource acpi_pm machine # [ 0.853637] NET: Registered PF_INET protocol family machine # [ 0.855160] IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear) machine # [ 0.872934] tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.874402] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) machine # [ 0.875797] TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear) machine # [ 0.877198] TCP bind hash table entries: 32768 (order: 8, 1048576 bytes, linear) machine # [ 0.878532] TCP: Hash tables configured (established 32768 bind 32768) machine # [ 0.879831] MPTCP token hash table entries: 4096 (order: 5, 98304 bytes, linear) machine # [ 0.881259] UDP hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.882543] UDP-Lite hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.883856] NET: Registered PF_UNIX/PF_LOCAL protocol family machine # [ 0.884834] NET: Registered PF_XDP protocol family machine # [ 0.885706] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] machine # [ 0.886744] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] machine # [ 0.887775] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] machine # [ 0.888902] pci_bus 0000:00: resource 7 [mem 0x80000000-0xafffffff window] machine # [ 0.890016] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] machine # [ 0.891101] pci_bus 0000:00: resource 9 [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.893095] ACPI: \_SB_.GSIA: Enabled at IRQ 16 machine # [ 0.895237] ACPI: \_SB_.GSIB: Enabled at IRQ 17 machine # [ 0.897373] ACPI: \_SB_.GSIC: Enabled at IRQ 18 machine # [ 0.899419] ACPI: \_SB_.GSID: Enabled at IRQ 19 machine # [ 0.901213] PCI: CLS 0 bytes, default 64 machine # [ 0.902043] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) machine # [ 0.902649] Trying to unpack rootfs image as initramfs... machine # [ 0.903082] software IO TLB: mapped [mem 0x000000007a364000-0x000000007e364000] (64MB) machine # [ 0.905856] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.926441] Initialise system trusted keyrings machine # [ 0.927781] workingset: timestamp_bits=40 max_order=20 bucket_order=0 machine # [ 0.938942] Key type asymmetric registered machine # [ 0.939702] Asymmetric key parser 'x509' registered machine # [ 0.940603] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) machine # [ 0.942266] io scheduler mq-deadline registered machine # [ 0.943053] io scheduler kyber registered machine # [ 0.947330] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled machine # [ 0.948656] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A machine # [ 0.951091] Linux agpgart interface v0.103 machine # [ 0.951886] ACPI: bus type drm_connector registered machine # [ 0.954502] usbcore: registered new interface driver usbserial_generic machine # [ 0.955596] usbserial: USB Serial support registered for generic machine # [ 0.956619] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. machine # [ 0.956619] Please enable it if your BIOS has the CPPC option. machine # [ 0.958896] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled machine # [ 0.960244] drop_monitor: Initializing network drop monitor service machine # [ 0.961503] NET: Registered PF_INET6 protocol family machine # [ 0.963389] Segment Routing with IPv6 machine # [ 0.964066] In-situ OAM (IOAM) with IPv6 machine # [ 0.966078] IPI shorthand broadcast: enabled machine # [ 0.970500] sched_clock: Marking stable (816011263, 154477192)->(994639777, -24151322) machine # [ 0.972325] registered taskstats version 1 machine # [ 0.973365] Loading compiled-in X.509 certificates machine # [ 0.983391] Demotion targets for Node 0: null machine # [ 0.984640] Key type .fscrypt registered machine # [ 0.985377] Key type fscrypt-provisioning registered machine # [ 0.986378] ima: No TPM chip found, activating TPM-bypass! machine # [ 0.987323] ima: Allocated hash algorithm: sha1 machine # [ 0.988118] ima: No architecture policies found machine # [ 0.989277] PM: Magic number: 14:196:413 machine # [ 0.990931] RAS: Correctable Errors collector initialized. machine # [ 0.995428] clk: Disabling unused clocks machine # [ 0.996144] PM: genpd: Disabling unused power domains machine # [ 1.189698] Freeing initrd memory: 29104K machine # [ 1.193603] Freeing unused decrypted memory: 2028K machine # [ 1.196452] Freeing unused kernel image (initmem) memory: 3656K machine # [ 1.197619] Write protecting the kernel read-only data: 32768k machine # [ 1.199798] Freeing unused kernel image (text/rodata gap) memory: 1172K machine # [ 1.201390] Freeing unused kernel image (rodata/data gap) memory: 684K machine # [ 1.252412] x86/mm: Checked W+X mappings: passed, no W+X pages found. machine # [ 1.253576] Run /init as init process machine # [ 1.267945] systemd[1]: Inserted module 'autofs4' machine # [ 1.294045] fuse: init (API version 7.45) machine # [ 1.303141] ACPI: \_SB_.GSIG: Enabled at IRQ 22 machine # [ 1.305628] ACPI: \_SB_.GSIH: Enabled at IRQ 23 machine # [ 1.308805] ACPI: \_SB_.GSIE: Enabled at IRQ 20 machine # [ 1.311202] ACPI: \_SB_.GSIF: Enabled at IRQ 21 machine # [ 1.316270] virtiofs virtio5: discovered new tag: nix-store machine # [ 1.317838] virtiofs virtio5: virtio_fs_setup_dax: No cache capability machine # [ 1.326540] virtiofs virtio6: discovered new tag: shared machine # [ 1.339797] virtiofs virtio6: virtio_fs_setup_dax: No cache capability machine # [ 1.343717] virtiofs virtio7: discovered new tag: xchg machine # [ 1.345255] virtiofs virtio7: virtio_fs_setup_dax: No cache capability machine # [ 1.372932] systemd[1]: Successfully made /usr/ read-only. machine # [ 1.709058] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 1.714408] systemd[1]: Detected virtualization kvm. machine # [ 1.715353] systemd[1]: Detected architecture x86-64. machine # [ 1.716293] systemd[1]: Running in initrd. machine # [ 1.717528] systemd[1]: Initializing machine ID from random generator. machine # [ 1.718862] systemd[1]: Hostname set to . machine # [ 1.820395] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 1.865355] systemd[1]: Queued start job for default target Initrd Default Target. machine # [ 1.875275] systemd[1]: Created slice Slice /system/modprobe. machine # [ 1.876572] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 1.878058] systemd[1]: Expecting device /dev/disk/by-label/nixos... machine # [ 1.879235] systemd[1]: Reached target Path Units. machine # [ 1.880114] systemd[1]: Reached target Slice Units. machine # [ 1.881044] systemd[1]: Reached target Swaps. machine # [ 1.881879] systemd[1]: Reached target Timer Units. machine # [ 1.882922] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 1.884205] systemd[1]: Listening on Journal Socket (/dev/log). machine # [ 1.885416] systemd[1]: Listening on Journal Sockets. machine # [ 1.886512] systemd[1]: Listening on udev Control Socket. machine # [ 1.887596] systemd[1]: Listening on udev Kernel Socket. machine # [ 1.888644] systemd[1]: Reached target Socket Units. machine # [ 1.890835] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 1.893122] systemd[1]: Starting Load Kernel Module configfs... machine # [ 1.896268] systemd[1]: Starting Journal Service... machine # [ 1.898227] systemd[1]: Starting Load Kernel Modules... machine # [ 1.900579] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 1.909587] systemd[1]: Starting Coldplug All udev Devices... machine # [ 1.919679] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 1.922807] systemd[1]: Finished Load Kernel Module configfs. machine # [ 1.924988] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 1.926507] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config machine # [ 1.929525] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 1.939877] systemd-journald[89]: Collecting audit messages is disabled. machine # [ 1.954419] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. machine # [ 1.957595] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 1.960221] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev machine # [ 1.962011] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 1.976054] systemd[1]: Finished Load Kernel Modules. machine # [ 1.978106] systemd[1]: Starting Apply Kernel Variables... machine # [ 1.983357] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 1.984747] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 1.986097] systemd[1]: Reached target Local File Systems. machine # [ 1.841511] systemd-modules-load[90]: Using 4 probe threads machine # [ 1.842960] systemd-modules-load[90]: Inserted module 'virtio_balloon' machine # [ 1.844137] systemd-modules-load[90]: Inserted module 'virtio_gpu' machine # [ 1.845229] systemd-modules-load[90]: Inserted module 'dm_mod' machine # [ 2.001204] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 2.002653] systemd[1]: Started Journal Service. machine # [ 1.851127] systemd[1]: Finished Apply Kernel Variables. machine # [ 1.856791] systemd[1]: Starting Create System Files and Directories... machine # [ 1.868460] systemd[1]: Finished Create System Files and Directories. machine # [ 1.875463] systemd-udevd[101]: Using default interface naming scheme 'v261'. machine # [ 1.882534] systemd[1]: Finished Coldplug All udev Devices. machine # [ 1.888507] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 1.889720] systemd[1]: Reached target System Initialization. machine # [ 1.890576] systemd[1]: Reached target Basic System. machine # [ 2.164895] uhci_hcd 0000:00:1d.0: UHCI Host Controller machine # [ 2.165772] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 1 machine # [ 2.167317] virtio_blk virtio2: 4/0/0 default/read/poll queues machine # [ 2.167719] uhci_hcd 0000:00:1d.0: detected 2 ports machine # [ 2.169243] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 machine # [ 2.170461] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.171804] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.172948] usb usb1: Product: UHCI Host Controller machine # [ 2.173751] usb usb1: Manufacturer: Linux 6.18.53 uhci_hcd machine # [ 2.174597] usb usb1: SerialNumber: 0000:00:1d.0 machine # [ 2.176598] hub 1-0:1.0: USB hub found machine # [ 2.176655] virtio_blk virtio2: [vda] 33554432 512-byte logical blocks (17.2 GB/16.0 GiB) machine # [ 2.176819] hub 1-0:1.0: 2 ports detected machine # [ 2.176850] SCSI subsystem initialized machine # [ 2.182747] ehci-pci 0000:00:1d.7: EHCI Host Controller machine # [ 2.184610] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 2 machine # [ 2.186072] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 machine # [ 2.192701] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 machine # [ 2.193699] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 machine # [ 2.194938] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.196272] usb usb2: Product: EHCI Host Controller machine # [ 2.196983] usb usb2: Manufacturer: Linux 6.18.53 ehci_hcd machine # [ 2.197854] usb usb2: SerialNumber: 0000:00:1d.7 machine # [ 2.209661] hub 2-0:1.0: USB hub found machine # [ 2.210497] hub 2-0:1.0: 6 ports detected machine # [ 2.240732] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 machine # [ 2.242727] serio: i8042 KBD port at 0x60,0x64 irq 1 machine # [ 2.243532] serio: i8042 AUX port at 0x60,0x64 irq 12 machine # [ 2.095222] (udev-worker)[128]: Network interface NamePolicy= disabled on kernel command line. machine # [ 2.100845] systemd[1]: Starting Virtual Console Setup... machine # [ 2.260600] hub 1-0:1.0: USB hub found machine # [ 2.261264] hub 1-0:1.0: 2 ports detected machine # [ 2.262418] uhci_hcd 0000:00:1d.1: UHCI Host Controller machine # [ 2.263267] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 machine # [ 2.264432] uhci_hcd 0000:00:1d.1: detected 2 ports machine # [ 2.266156] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 machine # [ 2.269990] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 machine # [ 2.117966] (udev-worker)[115]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 2.120984] (udev-worker)[115]: Network interface NamePolicy= disabled on kernel command line. machine # [ 2.275961] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.278030] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.124887] systemd-vconsole-setup[144]: 2.279753] usb usb3: Product: UHCI Host Controller machine # 1;39mConfiguration of first virtual console was skipped, ignoring remaining ones. machine # [ 2.279755] usb usb3: Manufacturer: Linux 6.18.53 uhci_hcd machine # [ 2.279756] usb usb3: SerialNumber: 0000:00:1d.1 machine # [ 2.279964] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode machine # [ 2.279970] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) machine # [ 2.279972] ahci 0000:00:1f.2: flags: 64bit ncq only machine # [ 2.281107] hub 3-0:1.0: USB hub found machine # [ 2.285933] scsi host0: ahci machine # [ 2.134534] s[ 2.286684] hub 3-0:1.0: 2 ports detected machine # ystemd[1]: Finished Virtual Console Setup. machine # [ 2.292215] uhci_hcd 0000:00:1d.2: UHCI Host Controller machine # [ 2.292967] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 machine # [ 2.293055] scsi host1: ahci machine # [ 2.139921] s[ 2.293295] uhci_hcd 0000:00:1d.2: detected 2 ports machine # ystemd[1]: Found device /dev/disk/by-label/nixos. machine # [ 2.295707] scsi host2: ahci machine # [ 2.296337] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 machine # [ 2.142309] systemd[1]: Reached target Initrd Root Device. machine # [ 2.144368] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... machine # [ 2.298499] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.298560] scsi host3: ahci machine # [ 2.298849] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.300270] scsi host4: ahci machine # [ 2.300367] usb usb4: Product: UHCI Host Controller machine # [ 2.301520] scsi host5: ahci machine # [ 2.301674] usb usb4: Manufacturer: Linux 6.18.53 uhci_hcd machine # [ 2.301930] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 50 lpm-pol 1 machine # [ 2.302056] usb usb4: SerialNumber: 0000:00:1d.2 machine # [ 2.302415] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 50 lpm-pol 1 machine # [ 2.302805] hub 4-0:1.0: USB hub found machine # [ 2.303048] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 50 lpm-pol 1 machine # [ 2.303245] hub 4-0:1.0: 2 ports detected machine # [ 2.303614] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 50 lpm-pol 1 machine # [ 2.312786] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 50 lpm-pol 1 machine # [ 2.314269] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 50 lpm-pol 1 machine # [ 2.170780] systemd-fsck[172]: nixos: clean, 12/1048576 files, 109865/4194304 blocks machine # [ 2.173846] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. machine # [ 2.461682] usb 2-1: new high-speed USB device number 2 using ehci-pci machine # [ 2.596036] usb 2-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 machine # [ 2.599103] usb 2-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 machine # [ 2.601854] usb 2-1: Product: QEMU USB Tablet machine # [ 2.603517] usb 2-1: Manufacturer: QEMU machine # [ 2.605016] usb 2-1: SerialNumber: 28754-0000:00:1d.7-1 machine # [ 2.628596] ata1: SATA link down (SStatus 0 SControl 300) machine # [ 2.629694] ata4: SATA link down (SStatus 0 SControl 300) machine # [ 2.630796] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) machine # [ 2.633235] ata5: SATA link down (SStatus 0 SControl 300) machine # [ 2.634089] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 machine # [ 2.636283] ata3.00: applying bridge limits machine # [ 2.638170] ata2: SATA link down (SStatus 0 SControl 300) machine # [ 2.639214] ata6: SATA link down (SStatus 0 SControl 300) machine # [ 2.640175] ata3.00: configured for UDMA/100 machine # [ 2.642659] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 machine # [ 2.643316] hid: raw HID events driver (C) Jiri Kosina machine # [ 2.683122] usbcore: registered new interface driver usbhid machine # [ 2.685263] usbhid: USB HID core driver machine # [ 2.695885] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb2/2-1/2-1:1.0/0003:0627:0001.0001/input/input2 machine # [ 2.699600] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 machine # [ 2.707037] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray machine # [ 2.751973] cdrom: Uniform CD-ROM driver Revision: 3.20 machine # [ 2.759805] systemd[1]: Mounting /sysroot... machine # [ 3.056243] EXT4-fs (vda): mounted filesystem db501d62-fc15-428d-be55-cabc5f37d36d r/w with ordered data mode. Quota mode: none. machine # [ 2.917764] systemd[1]: Mounted /sysroot. machine # [ 2.919084] systemd[1]: Reached target Initrd Root File System. machine # [ 2.922133] systemd[1]: Mounting /sysroot/nix/.ro-store... machine # [ 2.923866] systemd[1]: Mounting /sysroot/nix/.rw-store... machine # [ 2.926404] systemd[1]: Mounting /sysroot/run... machine # [ 2.928392] systemd[1]: Mounting /sysroot/tmp/shared... machine # [ 2.942180] systemd[1]: Mounting /sysroot/tmp/xchg... machine # [ 2.945510] systemd[1]: Starting Mountpoints Configured in the Real Root... machine # [ 2.948621] systemd[1]: Mounted /sysroot/nix/.ro-store. machine # [ 2.950252] systemd[1]: Mounted /sysroot/nix/.rw-store. machine # [ 2.951645] systemd[1]: Mounted /sysroot/run. machine # [ 2.953337] systemd[1]: Mounted /sysroot/tmp/shared. machine # [ 2.963530] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 2.969351] systemd[1]: Mounted /sysroot/tmp/xchg. machine # [ 2.974488] systemd-sysroot-fstab-check[192]: /sysroot should be mounted in the initrd, will request daemon-reload. machine # [ 2.975996] systemd[1]: Reload requested from client PID 192 ('systemd-sysroot') (unit initrd-parse-etc.service)... machine # [ 2.977629] systemd[1]: Reloading... machine # [ 3.032735] systemd[1]: Reloading finished in 56 ms. machine # [ 3.053440] systemd-sysroot-fstab-check[192]: Requesting initrd-fs.target/start/replace... machine # [ 3.054836] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.055980] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.056898] systemd-sysroot-fstab-check[192]: Requesting swap.target/start/replace... machine # [ 3.058033] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.059088] systemd[1]: initrd-parse-etc.service: Deactivated successfully. machine # [ 3.060140] systemd[1]: Finished Mountpoints Configured in the Real Root. machine # [ 3.061141] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. machine # [ 3.080120] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.081547] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.760815] systemd[1]: Mounting /sysroot/nix/store... machine # [ 3.811602] systemd[1]: Mounted /sysroot/nix/store. machine # [ 3.814508] systemd[1]: Reached target Initrd File Systems. machine # [ 3.818383] systemd[1]: Starting Find NixOS closure... machine # [ 3.821801] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... machine # [ 3.853855] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. machine # [ 3.857623] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. machine # [ 3.871916] systemd[1]: Finished Find NixOS closure. machine # [ 3.873728] systemd[1]: Reached target Initrd Default Target. machine # [ 3.876200] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... machine # [ 3.905942] systemd[1]: Stopped target Initrd Default Target. machine # [ 3.908254] systemd[1]: Stopped target Basic System. machine # [ 3.910258] systemd[1]: Stopped target Initrd Root Device. machine # [ 3.912329] systemd[1]: Stopped target Path Units. machine # [ 3.914240] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. machine # [ 3.917690] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. machine # [ 3.922377] systemd[1]: Stopped target Slice Units. machine # [ 3.924309] systemd[1]: Stopped target Socket Units. machine # [ 3.926238] systemd[1]: Stopped target System Initialization. machine # [ 3.930255] systemd[1]: Stopped target Swaps. machine # [ 3.932148] systemd[1]: Stopped target Timer Units. machine # [ 3.934229] systemd[1]: dbus.socket: Deactivated successfully. machine # [ 3.936529] systemd[1]: Closed D-Bus System Message Bus Socket. machine # [ 3.939190] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. machine # [ 3.941773] systemd[1]: Stopped Find NixOS closure. machine # [ 3.943583] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.945427] systemd[1]: systemd-sysctl.service: Deactivated successfully. machine # [ 3.947391] systemd[1]: Stopped Apply Kernel Variables. machine # [ 3.948923] systemd[1]: systemd-modules-load.service: Deactivated successfully. machine # [ 3.950962] systemd[1]: Stopped Load Kernel Modules. machine # [ 3.952511] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. machine # [ 3.954717] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. machine # [ 3.956990] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. machine # [ 3.959270] systemd[1]: Stopped Create System Files and Directories. machine # [ 3.961215] systemd[1]: Stopped target Local File Systems. machine # [ 3.962576] systemd[1]: Stopped target Preparation for Local File Systems. machine # [ 3.963608] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. machine # [ 3.964647] systemd[1]: Stopped Coldplug All udev Devices. machine # [ 3.965444] systemd[1]: Stopping Rule-based Manager for Device Events and Files... machine # [ 3.966540] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 3.967622] systemd[1]: Stopped Virtual Console Setup. machine # [ 3.968403] systemd[1]: initrd-cleanup.service: Deactivated successfully. machine # [ 3.969426] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. machine # [ 3.970419] systemd[1]: systemd-udevd.service: Deactivated successfully. machine # [ 3.971419] systemd[1]: Stopped Rule-based Manager for Device Events and Files. machine # [ 3.972499] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. machine # [ 3.973632] systemd[1]: Closed udev Control Socket. machine # [ 3.974414] systemd[1]: Starting Cleanup udev Database... machine # [ 3.975294] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. machine # [ 3.976466] systemd[1]: Stopped Create Static Device Nodes in /dev. machine # [ 3.977423] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. machine # [ 3.978593] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. machine # [ 3.979833] systemd[1]: kmod-static-nodes.service: Deactivated successfully. machine # [ 3.980921] systemd[1]: Stopped Create List of Static Device Nodes. machine # [ 3.981849] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.982941] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.983883] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. machine # [ 3.985061] systemd[1]: Finished Cleanup udev Database. machine # [ 3.986054] systemd[1]: Reached target Switch Root. machine # [ 3.986832] systemd[1]: Starting NixOS Activation... machine # [ 4.097679] initrd-nixos-activation-start[239]: booting system configuration /nix/store/fs96pxakbi48i64pjlwwmqihjv5cdxwq-nixos-system-machine-test machine # [ 4.154407] initrd-nixos-activation-start[239]: running activation script... machine # [ 4.478186] initrd-nixos-activation-start[262]: setting up /etc... machine # [ 4.618057] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. machine # [ 4.620861] systemd[1]: Finished NixOS Activation. machine # [ 4.622726] systemd[1]: Starting Switch Root... machine # [ 4.657170] systemd[1]: Switching root. machine # [ 4.873442] systemd-journald[89]: Received SIGTERM from PID 1 (systemd). machine # [ 4.972183] NET: Registered PF_VSOCK protocol family machine # [ 5.354430] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 5.364706] systemd[1]: Detected virtualization kvm. machine # [ 5.366581] systemd[1]: Detected architecture x86-64. machine # [ 5.368628] systemd[1]: Detected first boot. machine # [ 5.373025] systemd[1]: Initializing machine ID from random generator. machine # [ 5.515229] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 5.605018] systemd[1]: Applying preset policy. machine # [ 5.800044] systemd[1]: Populated /etc with preset unit settings. machine # [ 6.059120] systemd[1]: initrd-switch-root.service: Deactivated successfully. machine # [ 6.062659] systemd[1]: Stopped initrd-switch-root.service. machine # [ 6.067296] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. machine # [ 6.072948] systemd[1]: Created slice Slice /system/getty. machine # [ 6.076406] systemd[1]: Created slice User and Session Slice. machine # [ 6.078814] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 6.081949] systemd[1]: Started Forward Password Requests to Wall Directory Watch. machine # [ 6.084787] systemd[1]: Expecting device /dev/hvc0... machine # [ 6.086673] systemd[1]: Expecting device /dev/ttyS0... machine # [ 6.088659] systemd[1]: Reached target Local Encrypted Volumes. machine # [ 6.090862] systemd[1]: Stopped target initrd-fs.target. machine # [ 6.092828] systemd[1]: Stopped target initrd-root-fs.target. machine # [ 6.095035] systemd[1]: Stopped target initrd-switch-root.target. machine # [ 6.097652] systemd[1]: Reached target Virtual Machines and Containers. machine # [ 6.100068] systemd[1]: Reached target Path Units. machine # [ 6.102096] systemd[1]: Reached target Remote File Systems. machine # [ 6.104266] systemd[1]: Reached target Slice Units. machine # [ 6.106237] systemd[1]: Reached target Swaps. machine # [ 6.110982] systemd[1]: Listening on Query the User Interactively for a Password. machine # [ 6.116273] systemd[1]: Listening on Process Core Dump Socket. machine # [ 6.120010] systemd[1]: Listening on Credential Encryption/Decryption. machine # [ 6.123979] systemd[1]: Listening on Factory Reset Management. machine # [ 6.125910] systemd[1]: Listening on Hostname Service Socket. machine # [ 6.130815] systemd[1]: Starting Journal Log Access Socket... machine # [ 6.132209] systemd[1]: Listening on Journal Audit Socket. machine # [ 6.134532] systemd[1]: Listening on Console Output Muting Service Socket. machine # [ 6.135759] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. machine # [ 6.136970] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.138435] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki machine # [ 6.143712] systemd[1]: Listening on Disk Repartitioning Service Socket. machine # [ 6.144829] systemd[1]: Listening on udev Control Socket. machine # [ 6.145804] systemd[1]: Listening on udev Varlink Socket. machine # [ 6.148666] systemd[1]: Mounting Huge Pages File System... machine # [ 6.151058] systemd[1]: Mounting POSIX Message Queue File System... machine # [ 6.153748] systemd[1]: Mounting Kernel Debug File System... machine # [ 6.168562] systemd[1]: Mounting Kernel Trace File System... machine # [ 6.174662] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 6.182355] systemd[1]: Starting Load Kernel Module configfs... machine # [ 6.184734] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm machine # [ 6.188545] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.192732] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.200667] systemd[1]: Mounting FUSE Control File System... machine # [ 6.202609] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.215374] systemd[1]: Starting Journal Service... machine # [ 6.222186] systemd[1]: Starting Load Kernel Modules... machine # [ 6.228588] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... machine # [ 6.235141] systemd[1]: Starting Remount Root and Kernel File Systems... machine # [ 6.236128] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.240054] systemd[1]: Starting Coldplug All udev Devices... machine # [ 6.243034] systemd[1]: Listening on Journal Log Access Socket. machine # [ 6.244116] systemd[1]: Mounted Huge Pages File System. machine # [ 6.245170] systemd[1]: Mounted POSIX Message Queue File System. machine # [ 6.247037] systemd[1]: Mounted Kernel Debug File System. machine # [ 6.248097] systemd[1]: Mounted Kernel Trace File System. machine # [ 6.249718] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 6.251082] systemd[1]: Mounted FUSE Control File System. machine # [ 6.254842] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 6.264081] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 6.265873] systemd[1]: Finished Load Kernel Module configfs. machine # [ 6.268741] systemd[1]: Mounting Kernel Configuration File System... machine # [ 6.281370] systemd-journald[333]: Collecting audit messages is enabled. machine # [ 6.287514] EXT4-fs (vda): re-mounted db501d62-fc15-428d-be55-cabc5f37d36d. machine # [ 6.292423] systemd[1]: Finished Remount Root and Kernel File Systems. machine # [ 6.293819] systemd[1]: Listening on Disk Image Download Service Socket. machine # [ 6.295575] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.145440] systemd[1]: Queued start job for default target Multi-User System[ 6.300162] systemd[1]: Starting Load/Save OS Random Seed... machine # . machine # [ 6.147423] systemd[1]: systemd-journald.serv[ 6.301593] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # ice: Deactivated successfully. machine # [ 6.304050] systemd[1]: Started Journal Service. machine # [ 6.149840] systemd-modules-load[334]: Using 2 probe threads machine # [ 6.151411] systemd[1]: Mounted Kernel Configuration File System. machine # [ 6.152761] systemd-oomd[335]: No swap; memory pressure usage will be degraded machine # [ 6.309603] loop: module loaded machine # [ 6.155860] systemd-modules-load[334]: Inserted module 'loop' machine # [ 6.158296] systemd[1]: Starting Flush Journal to Persistent Storage... machine # [ 6.159518] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. machine # [ 6.160575] systemd[1]: Finished Load Kernel Modules. machine # [ 6.166732] systemd[1]: Starting Apply Kernel Variables... machine # [ 6.177831] systemd[1]: Finished Load/Save OS Random Seed. machine # [ 6.178671] systemd[1]: Reached target First Boot Complete. machine # [ 6.181502] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 6.183145] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 6.338991] systemd-journald[333]: Received client request to flush runtime journal. machine # [ 6.235465] systemd[1]: Finished Apply Kernel Variables. machine # [ 6.236536] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 6.237625] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 6.238587] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 6.239667] systemd[1]: Finished Flush Journal to Persistent Storage. machine # [ 6.258129] systemd-udevd[361]: Using default interface naming scheme 'v261'. machine # [ 6.273824] systemd[1]: Finished Coldplug All udev Devices. machine # [ 6.294128] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 6.366810] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.379225] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. machine # [ 6.396145] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. machine # [ 6.399663] (udev-worker)[379]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.407450] (udev-worker)[375]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 6.409858] (udev-worker)[375]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.433882] systemd[1]: Condition check resulted in Virtio network device being skipped. machine # [ 6.435199] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.436714] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.438927] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.440764] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.442264] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.606187] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console machine # [ 6.607411] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 machine # [ 6.610067] mousedev: PS/2 mouse device common for all mice machine # [ 6.618632] ACPI: button: Power Button [PWRF] machine # [ 6.618742] Console: switching to colour dummy device 80x25 machine # [ 6.621845] [drm] Found bochs VGA, ID 0xb0c5. machine # [ 6.621846] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. machine # [ 6.622581] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized machine # [ 6.624106] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic machine # [ 6.624836] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 machine # [ 6.634179] Console: switching to colour frame buffer device 160x50 machine # [ 6.635362] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device machine # [ 6.640258] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 machine # [ 6.673143] parport_pc 00:02: reported by Plug and Play ACPI machine # [ 6.674028] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] machine # [ 6.681772] rtc_cmos PNP0B00:00: RTC can wake from S4 machine # [ 6.686592] rtc_cmos PNP0B00:00: registered as rtc0 machine # [ 6.687246] rtc_cmos PNP0B00:00: setting system clock to 2026-10-05T04:24:34 UTC (1791174274) machine # [ 6.688881] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs machine # [ 6.692644] systemd-journald[333]: Time jumped backwards, rotating. machine # [ 6.702553] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 machine # [ 6.726768] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 machine # [ 6.730911] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt machine # [ 6.731772] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD machine # [ 6.599072] systemd[1]: Starting Virtual Console Setup... machine # [ 6.622103] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 6.629063] systemd[1]: Stopped Virtual Console Setup. machine # [ 6.634269] systemd[1]: Starting Virtual Console Setup... machine # [ 6.827122] iTCO_wdt iTCO_wdt.0.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) machine # [ 6.827208] ppdev: user-space parallel port driver machine # [ 6.829116] iTCO_wdt iTCO_wdt.0.auto: initialized. heartbeat=30 sec (nowayout=0) machine # [ 6.853555] kvm_amd: TSC scaling supported machine # [ 6.854039] kvm_amd: Nested Virtualization enabled machine # [ 6.854653] kvm_amd: Nested Paging enabled machine # [ 6.855121] kvm_amd: LBR virtualization supported machine # [ 6.855688] kvm_amd: Virtual VMLOAD VMSAVE supported machine # [ 6.856258] kvm_amd: Virtual GIF supported machine # [ 6.856772] kvm_amd: Virtual NMI enabled machine # [ 6.916023] EDAC MC: Ver: 3.0.0 machine # [ 6.825288] systemd-vconsole-setup[407]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 6.827754] systemd[1]: Finished Virtual Console Setup. machine # [ 6.908812] systemd[1]: Mounting /run/wrappers... machine # [ 6.945129] systemd[1]: Mounted /run/wrappers. machine # [ 6.946969] systemd[1]: Reached target Local File Systems. machine # [ 6.949121] systemd[1]: Listening on Boot Loader Control Service Socket. machine # [ 6.952092] systemd[1]: Starting register-nix-paths.service... machine # [ 6.955363] systemd[1]: Starting Create SUID/SGID Wrappers... machine # [ 6.957470] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. machine # [ 6.960952] systemd[1]: Starting Save Transient machine-id to Disk... machine # [ 6.968069] systemd[1]: Starting Create System Files and Directories... machine # [ 7.027712] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. machine # [ 7.031677] systemd[1]: Finished Save Transient machine-id to Disk. machine # [ 7.059034] systemd[1]: Finished Create System Files and Directories. machine # [ 7.061639] systemd[1]: Starting Rebuild Journal Catalog... machine # [ 7.063085] systemd[1]: Starting Record System Boot/Shutdown in UTMP... machine # [ 7.088161] systemd[1]: Finished Record System Boot/Shutdown in UTMP. machine # [ 7.101690] systemd[1]: Finished Rebuild Journal Catalog. machine # [ 7.103475] systemd[1]: Starting Update is Completed... machine # [ 7.128572] systemd[1]: Finished Update is Completed. machine # [ 7.240717] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. machine # [ 7.241837] systemd[1]: Finished Create SUID/SGID Wrappers. machine # [ 7.485308] systemd[1]: Finished register-nix-paths.service. machine # [ 7.487579] systemd[1]: Reached target System Initialization. machine # [ 7.489740] systemd[1]: Started Discard unused filesystem blocks once a week. machine # [ 7.492331] systemd[1]: Started niks3 garbage collection timer. machine # [ 7.494583] systemd[1]: Started Daily Cleanup of Temporary Directories. machine # [ 7.496947] systemd[1]: Reached target Timer Units. machine # [ 7.498851] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 7.501256] systemd[1]: Listening on niks3 server socket. machine # [ 7.503334] systemd[1]: Listening on Nix Daemon Socket. machine # [ 7.505377] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. machine # [ 7.508364] systemd[1]: Reached target Socket Units. machine # [ 7.510312] systemd[1]: Reached target Basic System. machine # [ 7.512290] systemd[1]: Started backdoor.service. machine # [ 7.514215] systemd[1]: Starting Import lastlog data into lastlog2 database... machine # [ 7.516747] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 7.519250] systemd[1]: Starting Post-Boot Actions... machine # [ 7.521246] systemd[1]: Started Reset console on configuration changes. machine # [ 7.524596] systemd[1]: Starting resolvconf update... machine # [ 7.528119] systemd[1]: Started rustfs.service. machine # [ 7.533161] systemd[1]: Starting rustfs-bucket.service... machine # [ 7.542057] systemd[1]: Starting D-Bus System Message Bus... machine # [ 7.562054] systemd[1]: Finished Post-Boot Actions. machine # connecting to host... machine # [ 7.577844] systemd[1]: Finished Import lastlog data into lastlog2 database. machine # [ 7.579165] nsncd[490]: Oct 05 04:24:35.545 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 7.581414] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 7.582379] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 7.583391] systemd[1]: Reached target User and Group Name Lookups. machine # [ 7.586479] systemd[1]: Starting User Login Management... machine: Guest shell says: b'Spawning backdoor root shell...\n' machine: connected to guest root shell machine: (connecting took 8.32 seconds) machine: (finished: waiting for the VM to finish booting, in 8.52 seconds) machine # [ 7.636642] dbus-broker-launch[497]: Looking up NSS user entry for 'systemd-timesync'... machine # [ 7.644941] dbus-broker-launch[497]: NSS returned no entry for 'systemd-timesync' machine # [ 7.646088] dbus-broker-launch[497]: Invalid user-name in /nix/store/bcd7zqqxh9dkf34jz3fznsnn45xd36vp-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" machine # [ 7.654056] systemd-logind[521]: New seat seat0. machine # [ 7.654832] systemd[1]: Started D-Bus System Message Bus. machine # [ 7.657759] systemd-logind[521]: Watching system buttons on /dev/input/event2 (Power Button) machine # [ 7.658312] systemd-logind[521]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) machine # [ 7.658922] systemd-logind[521]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) machine # [ 7.660781] systemd[1]: Started User Login Management. machine # [ 7.665125] systemd[1]: Starting linger-users.service... machine # [ 7.671458] dbus-broker-launch[497]: Ready machine # [ 7.694133] systemd[1]: linger-users.service: Deactivated successfully. machine # [ 7.695466] systemd[1]: Finished linger-users.service. machine # [ 7.701931] systemd[1]: Stopped target Host and Network Name Lookups. machine # [ 7.703036] systemd[1]: Stopping Host and Network Name Lookups... machine # [ 7.703859] systemd[1]: Stopped target User and Group Name Lookups. machine # [ 7.704538] systemd[1]: Stopping User and Group Name Lookups... machine # [ 7.705682] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... machine # [ 7.706475] systemd[1]: nscd.service: Deactivated successfully. machine # [ 7.707194] systemd[1]: Stopped Name Service Cache Daemon (nsncd). machine # [ 7.707681] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 7.735901] nsncd[596]: Oct 05 04:24:35.702 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 7.738065] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 7.738702] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 7.739275] systemd[1]: Reached target User and Group Name Lookups. machine # [ 7.755490] systemd[1]: Finished resolvconf update. machine # [ 7.755995] systemd[1]: Reached target Preparation for Network. machine # [ 7.758253] systemd[1]: Starting DHCP Client... machine # [ 7.760333] systemd[1]: Starting Address configuration of eth1... machine # [ 7.761664] systemd[1]: Starting Extra networking commands.... machine # [ 7.838055] network-addresses-eth1-start[622]: adding address 192.168.1.1/24... done machine # [ 7.848638] network-addresses-eth1-start[622]: adding address 2001:db8:1::1/64... done machine # [ 7.861173] dhcpcd[633]: dhcpcd-10.3.2 starting machine # [ 7.862244] systemd[1]: Finished Address configuration of eth1. machine # [ 7.869481] dhcpcd[683]: dev: loaded udev machine # [ 8.036639] 8021q: 802.1Q VLAN Support v1.8 machine # [ 8.039634] 8021q: adding VLAN 0 to HW filter on device eth1 machine # [ 7.889530] systemd[1]: Finished Extra networking commands.. machine # [ 7.891090] systemd[1]: Reached target Network. machine # [ 7.894489] systemd[1]: Starting PostgreSQL Server... machine # [ 7.897276] systemd[1]: Starting Permit User Sessions... machine # [ 7.904631] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. machine # [ 7.923403] systemd[1]: Finished Permit User Sessions. machine # [ 7.925807] systemd[1]: Started Getty on tty1. machine # [ 7.926692] systemd[1]: Reached target Login Prompts. machine # [ 8.134820] cfg80211: Loading compiled-in X.509 certificates for regulatory database machine # [ 8.151833] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' machine # [ 8.153057] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' machine # [ 8.154936] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 machine # [ 8.156214] cfg80211: failed to load regulatory.db machine # [ 8.034375] postgresql-pre-start[712]: The files belonging to this database system will be owned by user "postgres". machine # [ 8.035218] postgresql-pre-start[712]: This user must also own the server process. machine # [ 8.038399] postgresql-pre-start[712]: The database cluster will be initialized with locale "en_US.UTF-8". machine # [ 8.039040] postgresql-pre-start[712]: The default database encoding has accordingly been set to "UTF8". machine # [ 8.039481] postgresql-pre-start[712]: The default text search configuration will be set to "english". machine # [ 8.039969] postgresql-pre-start[712]: Data page checksums are enabled. machine # [ 8.040644] postgresql-pre-start[712]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok machine # [ 8.041181] postgresql-pre-start[712]: creating subdirectories ... ok machine # [ 8.041800] postgresql-pre-start[712]: selecting dynamic shared memory implementation ... posix machine # [ 8.201885] 8021q: adding VLAN 0 to HW filter on device eth0 machine # [ 8.049488] dhcpcd[683]: eth0: waiting for carrier machine # [ 8.050197] dhcpcd[683]: eth0: carrier acquired machine # [ 8.058574] dhcpcd[683]: DUID 00:01:00:01:32:55:e3:04:52:54:00:12:34:56 machine # [ 8.059156] dhcpcd[683]: eth0: IAID 00:12:34:56 machine # [ 8.059637] dhcpcd[683]: eth0: adding address fe80::5054:ff:fe12:3456 machine # [ 8.118489] postgresql-pre-start[712]: selecting default "max_connections" ... 100 machine # [ 8.174631] postgresql-pre-start[712]: selecting default "shared_buffers" ... 128MB machine # [ 8.893616] postgresql-pre-start[712]: selecting default time zone ... UTC machine # [ 8.895926] postgresql-pre-start[712]: creating configuration files ... ok machine # [ 9.077877] postgresql-pre-start[712]: running bootstrap script ... ok machine # [ 9.375058] dhcpcd[683]: eth0: soliciting a DHCP lease machine # [ 9.546860] NET: Registered PF_PACKET protocol family machine # [ 9.401815] dhcpcd[683]: eth0: offered 10.0.2.15 from 10.0.2.2 machine # [ 9.408265] dhcpcd[683]: eth0: probing address 10.0.2.15/24 machine # [ 9.544914] postgresql-pre-start[712]: performing post-bootstrap initialization ... ok machine # [ 9.698518] postgresql-pre-start[712]: syncing data to disk ... ok machine # [ 9.699956] postgresql-pre-start[712]: initdb: warning: enabling "trust" authentication for local connections machine # [ 9.701934] postgresql-pre-start[712]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. machine # [ 9.703504] postgresql-pre-start[712]: Success. You can now start the database server using: machine # [ 9.705079] postgresql-pre-start[712]: pg_ctl -D /var/lib/postgresql/18 -l logfile start machine # [ 9.863457] postgres[750]: [750] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit machine # [ 9.867529] postgres[750]: [750] LOG: listening on IPv6 address "::1", port 5432 machine # [ 9.870403] postgres[750]: [750] LOG: listening on IPv4 address "127.0.0.1", port 5432 machine # [ 9.873411] postgres[750]: [750] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" machine # [ 9.884546] postgres[768]: [768] LOG: database system was shut down at 2026-10-05 04:24:37 GMT machine # [ 9.893975] postgres[750]: [750] LOG: database system is ready to accept connections machine # [ 9.901874] systemd[1]: Started PostgreSQL Server. machine # [ 9.905735] systemd[1]: Starting PostgreSQL Setup Scripts... machine # [ 10.098119] dhcpcd[683]: eth0: soliciting an IPv6 router machine # [ 10.100332] dhcpcd[683]: eth0: Router Advertisement from fe80::2 machine # [ 10.102486] dhcpcd[683]: eth0: adding address fec0::5054:ff:fe12:3456/64 machine # [ 10.104709] dhcpcd[683]: eth0: adding route to fec0::/64 machine # [ 10.106648] dhcpcd[683]: eth0: adding default route via fe80::2 machine # [ 10.179831] postgresql-setup-start[779]: CREATE DATABASE machine # [ 10.218087] postgresql-setup-start[784]: CREATE ROLE machine # [ 10.234544] postgresql-setup-start[786]: ALTER DATABASE machine # [ 10.239883] systemd[1]: Finished PostgreSQL Setup Scripts. machine # [ 10.241505] systemd[1]: Reached target PostgreSQL. machine # [ 14.141796] dhcpcd[683]: eth0: leased 10.0.2.15 for 86400 seconds machine # [ 14.144122] dhcpcd[683]: eth0: adding route to 10.0.2.0/24 machine # [ 14.146148] dhcpcd[683]: eth0: adding default route via 10.0.2.2 machine # [ 14.282154] systemd[1]: Started DHCP Client. machine # [ 14.283842] systemd[1]: Reached target Network is Online. machine # [ 14.286709] systemd[1]: Starting k3s service... machine # [ 14.361080] k3s[885]: time="2026-10-05T04:24:42Z" level=info msg="Acquiring lock file /var/lib/rancher/k3s/data/.lock" machine # [ 14.364589] k3s[885]: time="2026-10-05T04:24:42Z" level=info msg="Preparing data dir /var/lib/rancher/k3s/data/53c81a1072dac7aebc0a3715f02f26b7ba95e9416f42c7f7aeed55ccb68af709" machine # [ 16.438966] k3s[885]: time="2026-10-05T04:24:44Z" level=info msg="Starting k3s 1.36.4+k3s1 (4dedb15b)" machine # [ 16.452272] k3s[885]: time="2026-10-05T04:24:44Z" level=info msg="Configuring sqlite3 database connection pooling: maxIdle=20, maxOpen=0, maxLifetime=0s, maxIdleTime=2m0s" machine # [ 16.457530] k3s[885]: time="2026-10-05T04:24:44Z" level=info msg="Kine built with sqlite from github.com/mattn/go-sqlite3 version 3.53.3" machine # [ 16.461667] k3s[885]: time="2026-10-05T04:24:44Z" level=info msg="Configuring database table schema and indexes, this may take a moment..." machine # [ 16.471633] k3s[885]: time="2026-10-05T04:24:44Z" level=info msg="Database tables and indexes are up to date" machine # [ 16.475424] k3s[885]: time="2026-10-05T04:24:44Z" level=info msg="Running startup VACUUM to reclaim disk space, this may take a moment..." machine # [ 16.476956] k3s[885]: time="2026-10-05T04:24:44Z" level=info msg="Startup VACUUM completed successfully" machine # [ 16.478506] k3s[885]: time="2026-10-05T04:24:44Z" level=info msg="Kine available at unix://kine.sock" machine # [ 16.480072] k3s[885]: time="2026-10-05T04:24:44Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 16.482857] k3s[885]: time="2026-10-05T04:24:44Z" level=info msg="Datastore connection validated successfully, proceeding with bootstrap data generation" machine # [ 16.485184] k3s[885]: time="2026-10-05T04:24:44Z" level=info msg="generated self-signed CA certificate CN=k3s-client-ca@1791174284: notBefore=2026-10-05 03:24:44.451070595 +0000 UTC notAfter=2036-10-02 03:24:44.451070595 +0000 UTC" machine # [ 16.486269] k3s[885]: time="2026-10-05T04:24:44Z" level=info msg="certificate CN=system:admin,O=system:masters signed by CN=k3s-client-ca@1791174284: notBefore=2026-10-05 03:24:44 +0000 UTC notAfter=2027-10-05 03:24:44 +0000 UTC" machine # [ 16.487568] k3s[885]: time="2026-10-05T04:24:44Z" level=info msg="certificate CN=system:k3s-supervisor,O=system:masters signed by CN=k3s-client-ca@1791174284: notBefore=2026-10-05 03:24:44 +0000 UTC notAfter=2027-10-05 03:24:44 +0000 UTC" machine # [ 16.489087] k3s[885]: time="2026-10-05T04:24:44Z" level=info msg="certificate CN=system:kube-controller-manager signed by CN=k3s-client-ca@1791174284: notBefore=2026-10-05 03:24:44 +0000 UTC notAfter=2027-10-05 03:24:44 +0000 UTC" machine # [ 16.490225] k3s[885]: time="2026-10-05T04:24:44Z" level=info msg="certificate CN=system:kube-scheduler signed by CN=k3s-client-ca@1791174284: notBefore=2026-10-05 03:24:44 +0000 UTC notAfter=2027-10-05 03:24:44 +0000 UTC" machine # [ 16.491423] k3s[885]: time="2026-10-05T04:24:44Z" level=info msg="certificate CN=system:apiserver,O=system:masters signed by CN=k3s-client-ca@1791174284: notBefore=2026-10-05 03:24:44 +0000 UTC notAfter=2027-10-05 03:24:44 +0000 UTC" machine # [ 16.492889] k3s[885]: time="2026-10-05T04:24:44Z" level=info msg="certificate CN=k3s-cloud-controller-manager signed by CN=k3s-client-ca@1791174284: notBefore=2026-10-05 03:24:44 +0000 UTC notAfter=2027-10-05 03:24:44 +0000 UTC" machine # [ 16.494481] k3s[885]: time="2026-10-05T04:24:44Z" level=info msg="generated self-signed CA certificate CN=k3s-server-ca@1791174284: notBefore=2026-10-05 03:24:44.458164514 +0000 UTC notAfter=2036-10-02 03:24:44.458164514 +0000 UTC" machine # [ 16.495793] k3s[885]: time="2026-10-05T04:24:44Z" level=info msg="certificate CN=kube-apiserver signed by CN=k3s-server-ca@1791174284: notBefore=2026-10-05 03:24:44 +0000 UTC notAfter=2027-10-05 03:24:44 +0000 UTC" machine # [ 16.496989] k3s[885]: time="2026-10-05T04:24:44Z" level=info msg="certificate CN=kube-scheduler signed by CN=k3s-server-ca@1791174284: notBefore=2026-10-05 03:24:44 +0000 UTC notAfter=2027-10-05 03:24:44 +0000 UTC" machine # [ 16.498252] k3s[885]: time="2026-10-05T04:24:44Z" level=info msg="certificate CN=kube-controller-manager signed by CN=k3s-server-ca@1791174284: notBefore=2026-10-05 03:24:44 +0000 UTC notAfter=2027-10-05 03:24:44 +0000 UTC" machine # [ 16.499752] k3s[885]: time="2026-10-05T04:24:44Z" level=info msg="generated self-signed CA certificate CN=k3s-request-header-ca@1791174284: notBefore=2026-10-05 03:24:44.461530584 +0000 UTC notAfter=2036-10-02 03:24:44.461530584 +0000 UTC" machine # [ 16.500990] k3s[885]: time="2026-10-05T04:24:44Z" level=info msg="certificate CN=system:auth-proxy signed by CN=k3s-request-header-ca@1791174284: notBefore=2026-10-05 03:24:44 +0000 UTC notAfter=2027-10-05 03:24:44 +0000 UTC" machine # [ 16.501997] k3s[885]: time="2026-10-05T04:24:44Z" level=info msg="generated self-signed CA certificate CN=etcd-server-ca@1791174284: notBefore=2026-10-05 03:24:44.462930203 +0000 UTC notAfter=2036-10-02 03:24:44.462930203 +0000 UTC" machine # [ 16.503226] k3s[885]: time="2026-10-05T04:24:44Z" level=info msg="certificate CN=etcd-client signed by CN=etcd-server-ca@1791174284: notBefore=2026-10-05 03:24:44 +0000 UTC notAfter=2027-10-05 03:24:44 +0000 UTC" machine # [ 16.504163] k3s[885]: time="2026-10-05T04:24:44Z" level=info msg="generated self-signed CA certificate CN=etcd-peer-ca@1791174284: notBefore=2026-10-05 03:24:44.464340159 +0000 UTC notAfter=2036-10-02 03:24:44.464340159 +0000 UTC" machine # [ 16.504777] k3s[885]: time="2026-10-05T04:24:44Z" level=info msg="certificate CN=etcd-peer signed by CN=etcd-peer-ca@1791174284: notBefore=2026-10-05 03:24:44 +0000 UTC notAfter=2027-10-05 03:24:44 +0000 UTC" machine # [ 16.506069] k3s[885]: time="2026-10-05T04:24:44Z" level=info msg="certificate CN=etcd-server signed by CN=etcd-server-ca@1791174284: notBefore=2026-10-05 03:24:44 +0000 UTC notAfter=2027-10-05 03:24:44 +0000 UTC" machine # [ 16.598992] k3s[885]: time="2026-10-05T04:24:44Z" level=info msg="certificate CN=k3s,O=k3s signed by CN=k3s-server-ca@1791174284: notBefore=2026-10-05 03:24:44 +0000 UTC notAfter=2027-10-05 03:24:44 +0000 UTC" machine # [ 16.600269] k3s[885]: time="2026-10-05T04:24:44Z" level=warning msg="dynamiclistener [::]:6443: no cached certificate available for preload - deferring certificate load until storage initialization or first client request" machine # [ 16.612501] k3s[885]: time="2026-10-05T04:24:44Z" level=info msg="Active TLS secret / (ver=) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__830b_fd05_4aac_463c-ceaad7:fec0::830b:fd05:4aac:463c listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=112B857880A301EAA85135123B4A8C5CCCD2675D]" machine # [ 17.571435] k3s[885]: time="2026-10-05T04:24:45Z" level=info msg="Password verified locally for node machine" machine # [ 17.573391] k3s[885]: time="2026-10-05T04:24:45Z" level=info msg="certificate CN=machine signed by CN=k3s-server-ca@1791174284: notBefore=2026-10-05 03:24:45 +0000 UTC notAfter=2027-10-05 03:24:45 +0000 UTC" machine # [ 17.835592] k3s[885]: time="2026-10-05T04:24:45Z" level=info msg="certificate CN=system:node:machine,O=system:nodes signed by CN=k3s-client-ca@1791174284: notBefore=2026-10-05 03:24:45 +0000 UTC notAfter=2027-10-05 03:24:45 +0000 UTC" machine # [ 17.910067] k3s[885]: time="2026-10-05T04:24:45Z" level=info msg="certificate CN=system:kube-proxy signed by CN=k3s-client-ca@1791174284: notBefore=2026-10-05 03:24:45 +0000 UTC notAfter=2027-10-05 03:24:45 +0000 UTC" machine # [ 18.013412] k3s[885]: time="2026-10-05T04:24:45Z" level=info msg="certificate CN=system:k3s-controller signed by CN=k3s-client-ca@1791174284: notBefore=2026-10-05 03:24:45 +0000 UTC notAfter=2027-10-05 03:24:45 +0000 UTC" machine # [ 18.119197] k3s[885]: time="2026-10-05T04:24:46Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:45866: runtime core not ready" machine # [ 18.218888] k3s[885]: time="2026-10-05T04:24:46Z" level=info msg="Module overlay was already loaded" machine # [ 18.440643] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. machine # [ 18.445700] Bridge firewalling registered machine # [ 18.301806] k3s[885]: time="2026-10-05T04:24:46Z" level=warning msg="Failed to load kernel module iptable_nat with modprobe" machine # [ 18.311363] k3s[885]: time="2026-10-05T04:24:46Z" level=warning msg="Failed to load kernel module iptable_filter with modprobe" machine # [ 18.319254] k3s[885]: time="2026-10-05T04:24:46Z" level=warning msg="Failed to load kernel module nft-expr-counter with modprobe" machine # [ 18.387108] k3s[885]: time="2026-10-05T04:24:46Z" level=info msg="Set sysctl 'net/ipv4/conf/all/forwarding' to 1" machine # [ 18.388308] k3s[885]: time="2026-10-05T04:24:46Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_max' to 131072" machine # [ 18.389061] k3s[885]: time="2026-10-05T04:24:46Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400" machine # [ 18.389914] k3s[885]: time="2026-10-05T04:24:46Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600" machine # [ 18.390848] k3s[885]: time="2026-10-05T04:24:46Z" level=info msg="Creating k3s-cert-monitor event broadcaster" machine # [ 18.391623] k3s[885]: time="2026-10-05T04:24:46Z" level=info msg="Connecting to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 18.392549] k3s[885]: time="2026-10-05T04:24:46Z" level=info msg="Saving cluster bootstrap data to datastore" machine # [ 18.393519] k3s[885]: time="2026-10-05T04:24:46Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 18.394524] k3s[885]: time="2026-10-05T04:24:46Z" level=info msg="Connection to etcd is ready" machine # [ 18.395296] k3s[885]: time="2026-10-05T04:24:46Z" level=info msg="ETCD server is now running" machine # [ 18.396159] k3s[885]: time="2026-10-05T04:24:46Z" level=info msg="Running kube-apiserver --advertise-port=6443 --allow-privileged=true --anonymous-auth=false --api-audiences=https://kubernetes.default.svc.cluster.local,k3s --authorization-mode=Node,RBAC --bind-address=127.0.0.1 --cert-dir=/var/lib/rancher/k3s/server/tls/temporary-certs --client-ca-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --egress-selector-config-file=/var/lib/rancher/k3s/server/etc/egress-selector-config.yaml --enable-admission-plugins=NodeRestriction --enable-aggregator-routing=true --enable-bootstrap-token-auth=true --etcd-servers=unix://kine.sock --kubelet-certificate-authority=/var/lib/rancher/k3s/server/tls/server-ca.crt --kubelet-client-certificate=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.crt --kubelet-client-key=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.key --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --profiling=false --proxy-client-cert-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt --proxy-client-key-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.key --requestheader-allowed-names=system:auth-proxy --requestheader-client-ca-file=/var/lib/rancher/k3s/server/tls/request-header-ca.crt --requestheader-extra-headers-prefix=X-Remote-Extra- --requestheader-group-headers=X-Remote-Group --requestheader-username-headers=X-Remote-User --secure-port=6444 --service-account-issuer=https://kubernetes.default.svc.cluster.local --service-account-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-account-signing-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --storage-backend=etcd3 --tls-cert-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --tls-private-key-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 18.397740] k3s[885]: time="2026-10-05T04:24:46Z" level=info msg="Running kube-scheduler --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --bind-address=127.0.0.1 --kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --leader-elect=false --profiling=false --secure-port=10259 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 18.398662] k3s[885]: time="2026-10-05T04:24:46Z" level=info msg="Running kube-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --bind-address=127.0.0.1 --cluster-cidr=10.42.0.0/16 --cluster-signing-kube-apiserver-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kube-apiserver-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kubelet-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-serving-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-kubelet-serving-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --cluster-signing-legacy-unknown-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-legacy-unknown-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --configure-cloud-routes=false --controllers=*,tokencleaner,-service,-route,-cloud-node-lifecycle --kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --leader-elect=false --profiling=false --root-ca-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --secure-port=10257 --service-account-private-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key --use-service-account-credentials=true" machine # [ 18.406549] k3s[885]: time="2026-10-05T04:24:46Z" level=info msg="Running cloud-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --bind-address=127.0.0.1 --cloud-config=/var/lib/rancher/k3s/server/etc/cloud-config.yaml --cloud-provider=k3s --cluster-cidr=10.42.0.0/16 --configure-cloud-routes=false --controllers=*,-route --kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --leader-elect=false --leader-elect-resource-name=k3s-cloud-controller-manager --node-status-update-frequency=1m0s --profiling=false" machine # [ 18.414135] k3s[885]: time="2026-10-05T04:24:46Z" level=info msg="Server node token is available at /var/lib/rancher/k3s/server/token" machine # [ 18.415605] k3s[885]: time="2026-10-05T04:24:46Z" level=info msg="To join server node to cluster: k3s server -s https://10.0.2.15:6443 -t ${SERVER_NODE_TOKEN}" machine # [ 18.417509] k3s[885]: time="2026-10-05T04:24:46Z" level=info msg="Agent node token is available at /var/lib/rancher/k3s/server/agent-token" machine # [ 18.418686] k3s[885]: time="2026-10-05T04:24:46Z" level=info msg="To join agent node to cluster: k3s agent -s https://10.0.2.15:6443 -t ${AGENT_NODE_TOKEN}" machine # [ 18.420683] k3s[885]: time="2026-10-05T04:24:46Z" level=info msg="Wrote kubeconfig /etc/rancher/k3s/k3s.yaml" machine # [ 18.421869] k3s[885]: time="2026-10-05T04:24:46Z" level=info msg="Run: k3s kubectl" machine # [ 18.422661] k3s[885]: I1005 04:24:46.365536 885 options.go:263] external host was not specified, using 10.0.2.15 machine # [ 18.424118] k3s[885]: I1005 04:24:46.367927 885 server.go:158] Version: v1.36.4+k3s1 machine # [ 18.424960] k3s[885]: I1005 04:24:46.367954 885 server.go:160] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 18.426460] k3s[885]: time="2026-10-05T04:24:46Z" level=info msg="Polling for API server readiness: GET /readyz failed: the server is currently unable to handle the request" machine # [ 18.428154] k3s[885]: time="2026-10-05T04:24:46Z" level=info msg="Handling backend connection request [machine]" machine # [ 18.429610] k3s[885]: time="2026-10-05T04:24:46Z" level=info msg="Connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 18.430799] k3s[885]: time="2026-10-05T04:24:46Z" level=info msg="Remotedialer connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 18.432430] k3s[885]: time="2026-10-05T04:24:46Z" level=info msg="Logging containerd to /var/lib/rancher/k3s/agent/containerd/containerd.log" machine # [ 18.433700] k3s[885]: time="2026-10-05T04:24:46Z" level=info msg="Running containerd -c /var/lib/rancher/k3s/agent/etc/containerd/config.toml" machine # [ 18.489261] k3s[885]: I1005 04:24:46.456282 885 shared_informer.go:381] "Waiting for caches to sync" controller="node_authorizer" machine # [ 18.490975] k3s[885]: E1005 04:24:46.456593 885 options.go:205] The manifest file is empty, ignoring. machine # [ 18.493371] k3s[885]: I1005 04:24:46.460515 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 18.496663] k3s[885]: I1005 04:24:46.463819 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 18.498304] k3s[885]: I1005 04:24:46.465467 885 plugins.go:157] Loaded 15 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,PodGroupProtection,RuntimeClass,DefaultIngressClass,PodTopologyLabels,MutatingAdmissionPolicy,MutatingAdmissionWebhook. machine # [ 18.498939] k3s[885]: I1005 04:24:46.465492 885 plugins.go:160] Loaded 17 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,PodGroupWorkloadExists,NodeDeclaredFeatureValidator,JobValidation,PodResizeValidator,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. machine # [ 18.499566] k3s[885]: I1005 04:24:46.465846 885 instance.go:240] Using reconciler: lease machine # [ 18.503470] k3s[885]: I1005 04:24:46.470633 885 handler.go:304] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager machine # [ 18.504230] k3s[885]: W1005 04:24:46.470658 885 genericapiserver.go:798] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. machine # [ 18.506105] k3s[885]: I1005 04:24:46.473284 885 cidrallocator.go:198] starting ServiceCIDR Allocator Controller machine # [ 18.518706] k3s[885]: time="2026-10-05T04:24:46Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:45922: runtime core not ready" machine # [ 18.549086] k3s[885]: I1005 04:24:46.515970 885 handler.go:304] Adding GroupVersion v1 to ResourceManager machine # [ 18.549581] k3s[885]: I1005 04:24:46.516159 885 apis.go:112] API group "internal.apiserver.k8s.io" is not enabled, skipping. machine # [ 18.589367] k3s[885]: I1005 04:24:46.553457 885 apis.go:112] API group "storagemigration.k8s.io" is not enabled, skipping. machine # [ 18.608972] k3s[885]: time="2026-10-05T04:24:46Z" level=info msg="Running kube-proxy --cluster-cidr=10.42.0.0/16 --conntrack-max-per-core=0 --conntrack-tcp-timeout-close-wait=0s --conntrack-tcp-timeout-established=0s --healthz-bind-address=127.0.0.1 --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubeproxy.kubeconfig --proxy-mode=iptables" machine # [ 18.623068] k3s[885]: I1005 04:24:46.590217 885 handler.go:304] Adding GroupVersion authentication.k8s.io v1 to ResourceManager machine # [ 18.623839] k3s[885]: W1005 04:24:46.591030 885 genericapiserver.go:798] Skipping API authentication.k8s.io/v1beta1 because it has no resources. machine # [ 18.624863] k3s[885]: W1005 04:24:46.591406 885 genericapiserver.go:798] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. machine # [ 18.625594] k3s[885]: I1005 04:24:46.591660 885 handler.go:304] Adding GroupVersion authorization.k8s.io v1 to ResourceManager machine # [ 18.626178] k3s[885]: W1005 04:24:46.591676 885 genericapiserver.go:798] Skipping API authorization.k8s.io/v1beta1 because it has no resources. machine # [ 18.626904] k3s[885]: I1005 04:24:46.594091 885 handler.go:304] Adding GroupVersion autoscaling v2 to ResourceManager machine # [ 18.628313] k3s[885]: I1005 04:24:46.595478 885 handler.go:304] Adding GroupVersion autoscaling v1 to ResourceManager machine # [ 18.629354] k3s[885]: I1005 04:24:46.596261 885 handler.go:304] Adding GroupVersion batch v1 to ResourceManager machine # [ 18.629898] k3s[885]: W1005 04:24:46.596280 885 genericapiserver.go:798] Skipping API batch/v1beta1 because it has no resources. machine # [ 18.630592] k3s[885]: I1005 04:24:46.596732 885 handler.go:304] Adding GroupVersion certificates.k8s.io v1 to ResourceManager machine # [ 18.631133] k3s[885]: W1005 04:24:46.596769 885 genericapiserver.go:798] Skipping API certificates.k8s.io/v1beta1 because it has no resources. machine # [ 18.631632] k3s[885]: W1005 04:24:46.596780 885 genericapiserver.go:798] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. machine # [ 18.632158] k3s[885]: I1005 04:24:46.597052 885 handler.go:304] Adding GroupVersion coordination.k8s.io v1 to ResourceManager machine # [ 18.632632] k3s[885]: W1005 04:24:46.597067 885 genericapiserver.go:798] Skipping API coordination.k8s.io/v1beta1 because it has no resources. machine # [ 18.633174] k3s[885]: W1005 04:24:46.597077 885 genericapiserver.go:798] Skipping API coordination.k8s.io/v1alpha2 because it has no resources. machine # [ 18.633667] k3s[885]: I1005 04:24:46.597400 885 handler.go:304] Adding GroupVersion discovery.k8s.io v1 to ResourceManager machine # [ 18.634199] k3s[885]: W1005 04:24:46.597432 885 genericapiserver.go:798] Skipping API discovery.k8s.io/v1beta1 because it has no resources. machine # [ 18.634697] k3s[885]: I1005 04:24:46.599085 885 handler.go:304] Adding GroupVersion networking.k8s.io v1 to ResourceManager machine # [ 18.635389] k3s[885]: W1005 04:24:46.599105 885 genericapiserver.go:798] Skipping API networking.k8s.io/v1beta1 because it has no resources. machine # [ 18.635945] k3s[885]: I1005 04:24:46.599478 885 handler.go:304] Adding GroupVersion node.k8s.io v1 to ResourceManager machine # [ 18.636620] k3s[885]: W1005 04:24:46.599493 885 genericapiserver.go:798] Skipping API node.k8s.io/v1beta1 because it has no resources. machine # [ 18.637173] k3s[885]: W1005 04:24:46.599505 885 genericapiserver.go:798] Skipping API node.k8s.io/v1alpha1 because it has no resources. machine # [ 18.637629] k3s[885]: I1005 04:24:46.599834 885 handler.go:304] Adding GroupVersion policy v1 to ResourceManager machine # [ 18.638172] k3s[885]: W1005 04:24:46.599849 885 genericapiserver.go:798] Skipping API policy/v1beta1 because it has no resources. machine # [ 18.638626] k3s[885]: I1005 04:24:46.600685 885 handler.go:304] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager machine # [ 18.639193] k3s[885]: W1005 04:24:46.600702 885 genericapiserver.go:798] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. machine # [ 18.639664] k3s[885]: W1005 04:24:46.600715 885 genericapiserver.go:798] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. machine # [ 18.640168] k3s[885]: I1005 04:24:46.600958 885 handler.go:304] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager machine # [ 18.640662] k3s[885]: W1005 04:24:46.600974 885 genericapiserver.go:798] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. machine # [ 18.641197] k3s[885]: W1005 04:24:46.600985 885 genericapiserver.go:798] Skipping API scheduling.k8s.io/v1alpha2 because it has no resources. machine # [ 18.641741] k3s[885]: I1005 04:24:46.602172 885 handler.go:304] Adding GroupVersion storage.k8s.io v1 to ResourceManager machine # [ 18.642249] k3s[885]: W1005 04:24:46.602191 885 genericapiserver.go:798] Skipping API storage.k8s.io/v1beta1 because it has no resources. machine # [ 18.642740] k3s[885]: W1005 04:24:46.602202 885 genericapiserver.go:798] Skipping API storage.k8s.io/v1alpha1 because it has no resources. machine # [ 18.643437] k3s[885]: I1005 04:24:46.602797 885 handler.go:304] Adding GroupVersion flowcontrol.apiserver.k8s.io v1 to ResourceManager machine # [ 18.643977] k3s[885]: W1005 04:24:46.602815 885 genericapiserver.go:798] Skipping API flowcontrol.apiserver.k8s.io/v1beta3 because it has no resources. machine # [ 18.644625] k3s[885]: W1005 04:24:46.602826 885 genericapiserver.go:798] Skipping API flowcontrol.apiserver.k8s.io/v1beta2 because it has no resources. machine # [ 18.645182] k3s[885]: W1005 04:24:46.602836 885 genericapiserver.go:798] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. machine # [ 18.645628] k3s[885]: I1005 04:24:46.604647 885 handler.go:304] Adding GroupVersion apps v1 to ResourceManager machine # [ 18.646208] k3s[885]: W1005 04:24:46.604667 885 genericapiserver.go:798] Skipping API apps/v1beta2 because it has no resources. machine # [ 18.646659] k3s[885]: W1005 04:24:46.604678 885 genericapiserver.go:798] Skipping API apps/v1beta1 because it has no resources. machine # [ 18.647394] k3s[885]: I1005 04:24:46.606016 885 handler.go:304] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager machine # [ 18.647921] k3s[885]: W1005 04:24:46.606035 885 genericapiserver.go:798] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. machine # [ 18.648557] k3s[885]: W1005 04:24:46.606045 885 genericapiserver.go:798] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. machine # [ 18.649100] k3s[885]: I1005 04:24:46.606334 885 handler.go:304] Adding GroupVersion events.k8s.io v1 to ResourceManager machine # [ 18.649587] k3s[885]: W1005 04:24:46.606352 885 genericapiserver.go:798] Skipping API events.k8s.io/v1beta1 because it has no resources. machine # [ 18.650157] k3s[885]: I1005 04:24:46.607276 885 handler.go:304] Adding GroupVersion resource.k8s.io v1 to ResourceManager machine # [ 18.650603] k3s[885]: W1005 04:24:46.607315 885 genericapiserver.go:798] Skipping API resource.k8s.io/v1beta2 because it has no resources. machine # [ 18.651992] k3s[885]: W1005 04:24:46.607328 885 genericapiserver.go:798] Skipping API resource.k8s.io/v1beta1 because it has no resources. machine # [ 18.653628] k3s[885]: W1005 04:24:46.607337 885 genericapiserver.go:798] Skipping API resource.k8s.io/v1alpha3 because it has no resources. machine # [ 18.655191] k3s[885]: I1005 04:24:46.610323 885 handler.go:304] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager machine # [ 18.656639] k3s[885]: W1005 04:24:46.610341 885 genericapiserver.go:798] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. machine # [ 18.764498] rustfs-bucket-start[938]: mb s3://farm machine # [ 18.769332] systemd[1]: Finished rustfs-bucket.service. machine # [ 19.008213] k3s[885]: I1005 04:24:46.974897 885 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 19.008759] k3s[885]: I1005 04:24:46.975046 885 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 19.009408] k3s[885]: I1005 04:24:46.975259 885 secure_serving.go:214] Serving securely on 127.0.0.1:6444 machine # [ 19.009957] k3s[885]: I1005 04:24:46.975396 885 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 19.010620] k3s[885]: I1005 04:24:46.975269 885 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 19.014195] k3s[885]: I1005 04:24:46.981374 885 controller.go:113] "Deleting old lease on startup" lease="kube-system/apiserver-ik4pcwfs7qgdl76byc4pomgvia" machine # [ 19.019057] k3s[885]: I1005 04:24:46.986221 885 dynamic_serving_content.go:135] "Starting controller" name="aggregator-proxy-cert::/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt::/var/lib/rancher/k3s/server/tls/client-auth-proxy.key" machine # [ 19.019812] k3s[885]: I1005 04:24:46.986278 885 apiservice_controller.go:100] Starting APIServiceRegistrationController machine # [ 19.020255] k3s[885]: I1005 04:24:46.987449 885 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller machine # [ 19.020828] k3s[885]: I1005 04:24:46.988021 885 crdregistration_controller.go:114] Starting crd-autoregister controller machine # [ 19.021454] k3s[885]: I1005 04:24:46.988644 885 shared_informer.go:381] "Waiting for caches to sync" controller="crd-autoregister" machine # [ 19.021967] k3s[885]: I1005 04:24:46.986983 885 aggregator.go:185] waiting for initial CRD sync... machine # [ 19.030724] k3s[885]: I1005 04:24:46.995879 885 cluster_authentication_trust_controller.go:459] Starting cluster_authentication_trust_controller controller machine # [ 19.031478] k3s[885]: time="2026-10-05T04:24:46Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 19.031976] k3s[885]: time="2026-10-05T04:24:46Z" level=info msg="Starting apiserver lease garbage collector" logger=k3s machine # [ 19.032656] k3s[885]: time="2026-10-05T04:24:46Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 19.033385] k3s[885]: I1005 04:24:46.996349 885 storage_readiness_hook.go:70] Storage is ready for all registered resources machine # [ 19.033903] k3s[885]: I1005 04:24:46.996352 885 controller.go:89] "Starting OpenAPI V3 AggregationController" machine # [ 19.034554] k3s[885]: I1005 04:24:46.996388 885 local_available_controller.go:156] Starting LocalAvailability controller machine # [ 19.035142] k3s[885]: I1005 04:24:46.996402 885 cache.go:32] Waiting for caches to sync for LocalAvailability controller machine # [ 19.035634] k3s[885]: I1005 04:24:46.996449 885 controller.go:87] "Starting OpenAPI AggregationController" machine # [ 19.036189] k3s[885]: I1005 04:24:46.996505 885 apf_controller.go:377] Starting API Priority and Fairness config controller machine # [ 19.036641] k3s[885]: I1005 04:24:46.996595 885 remote_available_controller.go:434] Starting RemoteAvailability controller machine # [ 19.037265] k3s[885]: I1005 04:24:46.996605 885 cache.go:32] Waiting for caches to sync for RemoteAvailability controller machine # [ 19.037948] k3s[885]: I1005 04:24:46.996687 885 system_namespaces_controller.go:66] Starting system namespaces controller machine # [ 19.038590] k3s[885]: I1005 04:24:46.997042 885 customresource_discovery_controller.go:294] Starting DiscoveryController machine # [ 19.039131] k3s[885]: time="2026-10-05T04:24:46Z" level=info msg="Starting legacy_token_tracking_controller" logger=k3s machine # [ 19.039617] k3s[885]: time="2026-10-05T04:24:46Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 19.040236] k3s[885]: I1005 04:24:47.001468 885 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 19.040658] k3s[885]: I1005 04:24:47.001595 885 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 19.041203] k3s[885]: I1005 04:24:47.002093 885 repairip.go:210] Starting ipallocator-repair-controller machine # [ 19.041741] k3s[885]: I1005 04:24:47.002107 885 shared_informer.go:381] "Waiting for caches to sync" controller="ipallocator-repair-controller" machine # [ 19.042354] k3s[885]: time="2026-10-05T04:24:47Z" level=info msg=Starting controller=kubernetes-service-cidr-controller logger=k3s machine # [ 19.042902] k3s[885]: time="2026-10-05T04:24:47Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 19.043393] k3s[885]: I1005 04:24:47.002535 885 controller.go:142] Starting OpenAPI controller machine # [ 19.043917] k3s[885]: I1005 04:24:47.002629 885 controller.go:90] Starting OpenAPI V3 controller machine # [ 19.044553] k3s[885]: I1005 04:24:47.002660 885 naming_controller.go:305] Starting NamingConditionController machine # [ 19.045107] k3s[885]: I1005 04:24:47.002721 885 nonstructuralschema_controller.go:202] Starting NonStructuralSchemaConditionController machine # [ 19.045537] k3s[885]: I1005 04:24:47.002751 885 apiapproval_controller.go:196] Starting KubernetesAPIApprovalPolicyConformantConditionController machine # [ 19.046075] k3s[885]: time="2026-10-05T04:24:47Z" level=info msg="Starting CRDFinalizer" logger=k3s machine # [ 19.090098] k3s[885]: I1005 04:24:47.057219 885 shared_informer.go:388] "Caches are synced" controller="node_authorizer" machine # [ 19.094414] k3s[885]: I1005 04:24:47.061572 885 shared_informer.go:409] "Caches are synced" machine # [ 19.095038] k3s[885]: I1005 04:24:47.061607 885 policy_source.go:248] refreshing policies machine # [ 19.097747] k3s[885]: I1005 04:24:47.064905 885 shared_informer.go:409] "Caches are synced" machine # [ 19.098483] k3s[885]: I1005 04:24:47.064929 885 policy_source.go:248] refreshing policies machine # [ 19.121106] k3s[885]: I1005 04:24:47.088184 885 cache.go:39] Caches are synced for APIServiceRegistrationController controller machine # [ 19.124482] k3s[885]: I1005 04:24:47.088291 885 handler_discovery.go:459] Starting ResourceDiscoveryManager machine # [ 19.125111] k3s[885]: I1005 04:24:47.089408 885 shared_informer.go:388] "Caches are synced" controller="crd-autoregister" machine # [ 19.125603] k3s[885]: I1005 04:24:47.089474 885 aggregator.go:187] initial CRD sync complete... machine # [ 19.126130] k3s[885]: I1005 04:24:47.089487 885 autoregister_controller.go:144] Starting autoregister controller machine # [ 19.126614] k3s[885]: I1005 04:24:47.089500 885 cache.go:32] Waiting for caches to sync for autoregister controller machine # [ 19.127168] k3s[885]: I1005 04:24:47.089511 885 cache.go:39] Caches are synced for autoregister controller machine # [ 19.132269] k3s[885]: time="2026-10-05T04:24:47Z" level=info msg="Caches are synced" logger=k3s machine # [ 19.133335] k3s[885]: time="2026-10-05T04:24:47Z" level=info msg="Caches are synced" logger=k3s machine # [ 19.134091] k3s[885]: time="2026-10-05T04:24:47Z" level=info msg="Caches are synced" logger=k3s machine # [ 19.134541] k3s[885]: I1005 04:24:47.100860 885 cache.go:39] Caches are synced for LocalAvailability controller machine # [ 19.135146] k3s[885]: I1005 04:24:47.100907 885 apf_controller.go:382] Running API Priority and Fairness config worker machine # [ 19.135644] k3s[885]: I1005 04:24:47.100924 885 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process machine # [ 19.136204] k3s[885]: I1005 04:24:47.101139 885 cache.go:39] Caches are synced for RemoteAvailability controller machine # [ 19.136761] k3s[885]: I1005 04:24:47.102168 885 shared_informer.go:388] "Caches are synced" controller="ipallocator-repair-controller" machine # [ 19.137383] k3s[885]: time="2026-10-05T04:24:47Z" level=info msg="Caches are synced" logger=k3s machine # [ 19.137916] k3s[885]: time="2026-10-05T04:24:47Z" level=info msg="Creating default ServiceCIDR" CIDRs="[10.43.0.0/16]" logger=k3s machine # [ 19.145418] k3s[885]: I1005 04:24:47.112547 885 cidrallocator.go:302] created ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 19.147161] k3s[885]: I1005 04:24:47.112890 885 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io machine # [ 19.148795] k3s[885]: time="2026-10-05T04:24:47Z" level=info msg="Setting default ServiceCIDR condition Ready to True" logger=k3s machine # [ 19.155614] k3s[885]: I1005 04:24:47.122768 885 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 19.190540] k3s[885]: I1005 04:24:47.157680 885 alloc.go:329] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.43.0.1"} machine # [ 19.198387] k3s[885]: W1005 04:24:47.165502 885 lease.go:265] Resetting endpoints for master service "kubernetes" to [10.0.2.15] machine # [ 19.199694] k3s[885]: I1005 04:24:47.166864 885 controller.go:667] quota admission added evaluator for: endpoints machine # [ 19.208676] k3s[885]: I1005 04:24:47.175811 885 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io machine # [ 19.217102] k3s[885]: E1005 04:24:47.184062 885 controller.go:102] Error removing old endpoints from kubernetes service: no API server IP addresses were listed in storage, refusing to erase all endpoints for the kubernetes Service machine # [ 19.437714] k3s[885]: time="2026-10-05T04:24:47Z" level=info msg="containerd is now running" machine # [ 19.447963] k3s[885]: time="2026-10-05T04:24:47Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/4v14fxahlxhgjlfn1jf5zd1cj1prhvgs-nix-grpc-farm-client.tar" machine # [ 20.018978] k3s[885]: I1005 04:24:47.985419 885 storage_scheduling.go:137] created PriorityClass system-node-critical with value 2000001000 machine # [ 20.024255] k3s[885]: I1005 04:24:47.991357 885 storage_scheduling.go:137] created PriorityClass system-cluster-critical with value 2000000000 machine # [ 20.026186] k3s[885]: I1005 04:24:47.991404 885 storage_scheduling.go:153] all system priority classes are created successfully or already exist. machine # [ 20.394739] k3s[885]: time="2026-10-05T04:24:48Z" level=info msg="Polling for API server readiness: GET /readyz failed: unknown" machine # [ 21.175980] k3s[885]: I1005 04:24:49.142780 885 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io machine # [ 21.217703] k3s[885]: I1005 04:24:49.184610 885 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io machine # [ 22.409128] k3s[885]: time="2026-10-05T04:24:50Z" level=info msg="Kube API server is now running" machine # [ 22.413543] k3s[885]: time="2026-10-05T04:24:50Z" level=info msg="k3s is up and running" machine # [ 22.415640] k3s[885]: time="2026-10-05T04:24:50Z" level=info msg="Creating k3s-supervisor event broadcaster" machine # [ 22.419544] systemd[1]: Started k3s service. machine # [ 22.421274] k3s[885]: time="2026-10-05T04:24:50Z" level=info msg="Waiting for untainted node" machine # [ 22.424991] k3s[885]: time="2026-10-05T04:24:50Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Node and Certificate Authority certificates managed by k3s are OK" object=machine reason=CertificateExpirationOK type=Normal machine # [ 22.430601] systemd[1]: Starting niks3 server... machine # [ 22.446081] k3s[885]: E1005 04:24:50.413117 885 options.go:205] The manifest file is empty, ignoring. machine # [ 22.447584] k3s[885]: I1005 04:24:50.414535 885 controllermanager.go:204] "Starting" version="v1.36.4+k3s1" machine # [ 22.448932] k3s[885]: I1005 04:24:50.414557 885 controllermanager.go:206] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 22.451506] k3s[885]: I1005 04:24:50.418664 885 secure_serving.go:214] Serving securely on 127.0.0.1:10257 machine # [ 22.452852] k3s[885]: I1005 04:24:50.418944 885 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key" machine: (finished: waiting for unit k3s.service, in 23.37 seconds) machine # [ 22.455956] k3s[885]: I1005 04:24:50.419059 885 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine: waiting for success: kubectl get ns farm machine # [ 22.458624] k3s[885]: I1005 04:24:50.419076 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 22.459881] k3s[885]: I1005 04:24:50.419264 885 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 22.462048] k3s[885]: I1005 04:24:50.419287 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 22.463302] k3s[885]: I1005 04:24:50.419316 885 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 22.465643] k3s[885]: I1005 04:24:50.419330 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 22.467040] k3s[885]: I1005 04:24:50.420622 885 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 22.468482] k3s[885]: I1005 04:24:50.432399 885 controller.go:667] quota admission added evaluator for: serviceaccounts machine # [ 22.470067] k3s[885]: I1005 04:24:50.435096 885 controllermanager.go:641] "Warning: skipping controller" controller="storage-version-migrator-controller" machine # [ 22.472348] k3s[885]: time="2026-10-05T04:24:50Z" level=info msg="Creating embedded CRD addons.k3s.cattle.io" machine # [ 22.474937] k3s[885]: time="2026-10-05T04:24:50Z" level=info msg="Creating embedded CRD etcdsnapshotfiles.k3s.cattle.io" machine # [ 22.481100] k3s[885]: time="2026-10-05T04:24:50Z" level=info msg="Creating embedded CRD helmchartconfigs.helm.cattle.io" machine # [ 22.488069] k3s[885]: time="2026-10-05T04:24:50Z" level=info msg="Creating embedded CRD helmcharts.helm.cattle.io" machine # [ 22.502829] k3s[885]: I1005 04:24:50.469539 885 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 22.522531] k3s[885]: I1005 04:24:50.489686 885 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 22.524056] k3s[885]: time="2026-10-05T04:24:50Z" level=info msg="Waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 22.531767] k3s[885]: time="2026-10-05T04:24:50Z" level=info msg="Done waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 22.532614] k3s[885]: time="2026-10-05T04:24:50Z" level=info msg="Waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 22.533504] k3s[885]: I1005 04:24:50.500605 885 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 22.546057] k3s[885]: I1005 04:24:50.513201 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 22.549162] k3s[885]: I1005 04:24:50.516335 885 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 22.552954] k3s[885]: I1005 04:24:50.519253 885 shared_informer.go:409] "Caches are synced" machine # [ 22.553583] k3s[885]: I1005 04:24:50.519408 885 shared_informer.go:409] "Caches are synced" machine # [ 22.554122] k3s[885]: I1005 04:24:50.519466 885 shared_informer.go:409] "Caches are synced" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 23.046704] k3s[885]: time="2026-10-05T04:24:51Z" level=info msg="Done waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 23.048452] k3s[885]: time="2026-10-05T04:24:51Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-40.1.4+up40.1.0.tgz" machine # [ 23.050308] k3s[885]: time="2026-10-05T04:24:51Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-crd-40.1.4+up40.1.0.tgz" machine # [ 23.052195] k3s[885]: time="2026-10-05T04:24:51Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/ccm.yaml" machine # [ 23.053854] k3s[885]: time="2026-10-05T04:24:51Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/coredns.yaml" machine # [ 23.055446] k3s[885]: time="2026-10-05T04:24:51Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/local-storage.yaml" machine # [ 23.057119] k3s[885]: time="2026-10-05T04:24:51Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/rolebindings.yaml" machine # [ 23.058756] k3s[885]: time="2026-10-05T04:24:51Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/runtimes.yaml" machine # [ 23.060328] k3s[885]: time="2026-10-05T04:24:51Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/traefik.yaml" machine # [ 23.482737] k3s[885]: I1005 04:24:51.449462 885 range_allocator.go:113] "No Secondary Service CIDR provided. Skipping filtering out secondary service addresses" logger="node-ipam-controller" machine # [ 23.483565] k3s[885]: time="2026-10-05T04:24:51Z" level=info msg="Starting dynamiclistener CN filter node controller with SANs: [127.0.0.1 ::1 localhost machine 10.0.2.15 fec0::830b:fd05:4aac:463c 10.43.0.1 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local]" machine # [ 23.484238] k3s[885]: time="2026-10-05T04:24:51Z" level=info msg="Tunnel server egress proxy mode: agent" machine # [ 23.487059] k3s[885]: I1005 04:24:51.452274 885 node_lifecycle_controller.go:402] "Controller will reconcile labels" logger="node-lifecycle-controller" machine # [ 23.492713] k3s[885]: I1005 04:24:51.459844 885 controllermanager.go:689] "Warning: controller is disabled" controller="selinux-warning-controller" machine # [ 23.518082] k3s[885]: I1005 04:24:51.484073 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="podtemplates" machine # [ 23.520232] k3s[885]: I1005 04:24:51.484172 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="leases.coordination.k8s.io" machine # [ 23.522595] k3s[885]: I1005 04:24:51.484268 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="serviceaccounts" machine # [ 23.524892] k3s[885]: I1005 04:24:51.484314 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="statefulsets.apps" machine # [ 23.527108] k3s[885]: I1005 04:24:51.484356 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="controllerrevisions.apps" machine # [ 23.529372] k3s[885]: I1005 04:24:51.484411 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="horizontalpodautoscalers.autoscaling" machine # [ 23.531822] k3s[885]: I1005 04:24:51.484479 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="cronjobs.batch" machine # [ 23.534122] k3s[885]: I1005 04:24:51.484530 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpointslices.discovery.k8s.io" machine # [ 23.536491] k3s[885]: I1005 04:24:51.484621 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="limitranges" machine # [ 23.538567] k3s[885]: I1005 04:24:51.484779 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="replicasets.apps" machine # [ 23.540762] k3s[885]: I1005 04:24:51.484846 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="resourceclaimtemplates.resource.k8s.io" machine # [ 23.543214] k3s[885]: I1005 04:24:51.484901 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmcharts.helm.cattle.io" machine # [ 23.545546] k3s[885]: I1005 04:24:51.484969 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="jobs.batch" machine # [ 23.547734] k3s[885]: I1005 04:24:51.485009 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmchartconfigs.helm.cattle.io" machine # [ 23.550044] k3s[885]: I1005 04:24:51.485085 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpoints" machine # [ 23.552237] k3s[885]: I1005 04:24:51.485152 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="roles.rbac.authorization.k8s.io" machine # [ 23.554631] k3s[885]: I1005 04:24:51.485214 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="rolebindings.rbac.authorization.k8s.io" machine # [ 23.557085] k3s[885]: I1005 04:24:51.485666 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="deployments.apps" machine # [ 23.559230] k3s[885]: I1005 04:24:51.485716 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="ingresses.networking.k8s.io" machine # [ 23.561555] k3s[885]: I1005 04:24:51.485821 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="daemonsets.apps" machine # [ 23.563836] k3s[885]: I1005 04:24:51.485869 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="csistoragecapacities.storage.k8s.io" machine # [ 23.566301] k3s[885]: I1005 04:24:51.486140 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="addons.k3s.cattle.io" machine # [ 23.568550] k3s[885]: I1005 04:24:51.486201 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="networkpolicies.networking.k8s.io" machine # [ 23.571064] k3s[885]: I1005 04:24:51.486264 885 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="poddisruptionbudgets.policy" machine # [ 23.573408] k3s[885]: I1005 04:24:51.513459 885 shared_informer.go:409] "Caches are synced" machine # [ 23.598799] k3s[885]: time="2026-10-05T04:24:51Z" level=info msg="Creating new TLS secret for kube-system/k3s-serving (count: 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__830b_fd05_4aac_463c-ceaad7:fec0::830b:fd05:4aac:463c listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=112B857880A301EAA85135123B4A8C5CCCD2675D]" machine # [ 23.608261] k3s[885]: time="2026-10-05T04:24:51Z" level=info msg="Active TLS secret kube-system/k3s-serving (ver=235) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__830b_fd05_4aac_463c-ceaad7:fec0::830b:fd05:4aac:463c listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=112B857880A301EAA85135123B4A8C5CCCD2675D]" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 24.686782] k3s[885]: I1005 04:24:52.653583 885 controllermanager.go:689] "Warning: controller is disabled" controller="bootstrap-signer-controller" machine # [ 24.692235] k3s[885]: time="2026-10-05T04:24:52Z" level=info msg="Starting k3s.cattle.io/v1, Kind=Addon controller" machine # [ 24.693792] k3s[885]: time="2026-10-05T04:24:52Z" level=info msg="Creating deploy event broadcaster" machine # [ 24.696307] k3s[885]: time="2026-10-05T04:24:52Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 24.697595] k3s[885]: I1005 04:24:52.663252 885 controller.go:667] quota admission added evaluator for: addons.k3s.cattle.io machine # [ 24.699240] k3s[885]: time="2026-10-05T04:24:52Z" level=info msg="Creating helm-controller event broadcaster" machine # [ 24.700638] k3s[885]: time="2026-10-05T04:24:52Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 24.702456] k3s[885]: time="2026-10-05T04:24:52Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=ApplyingManifest type=Normal machine # [ 24.709913] k3s[885]: time="2026-10-05T04:24:52Z" level=info msg="Cluster dns configmap has been set successfully" machine # [ 24.988154] k3s[885]: I1005 04:24:52.954369 885 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="storageversion-garbage-collector-controller" requiredFeatureGates=["APIServerIdentity","StorageVersionAPI"] machine # [ 24.991126] k3s[885]: I1005 04:24:52.954420 885 controllermanager.go:641] "Warning: skipping controller" controller="storageversion-garbage-collector-controller" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 25.137827] k3s[885]: I1005 04:24:53.104895 885 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="podgroup-protection-controller" requiredFeatureGates=["GenericWorkload"] machine # [ 25.138831] k3s[885]: I1005 04:24:53.104927 885 controllermanager.go:641] "Warning: skipping controller" controller="podgroup-protection-controller" machine # [ 25.146583] k3s[885]: time="2026-10-05T04:24:53Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=AppliedManifest type=Normal machine # [ 25.163062] k3s[885]: time="2026-10-05T04:24:53Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=ApplyingManifest type=Normal machine # [ 25.444156] k3s[885]: time="2026-10-05T04:24:53Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=AppliedManifest type=Normal machine # [ 25.454051] k3s[885]: time="2026-10-05T04:24:53Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=ApplyingManifest type=Normal machine # [ 25.576721] k3s[885]: I1005 04:24:53.543827 885 serving.go:417] Generated self-signed cert in-memory machine # [ 25.690808] k3s[885]: I1005 04:24:53.657594 885 serving.go:417] Generated self-signed cert in-memory machine # [ 25.699297] k3s[885]: time="2026-10-05T04:24:53Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 25.761563] k3s[885]: I1005 04:24:53.728698 885 controllermanager.go:163] Version: v1.36.4+k3s1 machine # [ 25.765241] k3s[885]: I1005 04:24:53.732402 885 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 25.765871] k3s[885]: I1005 04:24:53.732429 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 25.766544] k3s[885]: I1005 04:24:53.732470 885 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 25.767051] k3s[885]: I1005 04:24:53.732485 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 25.767485] k3s[885]: I1005 04:24:53.732701 885 secure_serving.go:214] Serving securely on 127.0.0.1:10258 machine # [ 25.767690] k3s[885]: I1005 04:24:53.733090 885 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 25.768389] k3s[885]: I1005 04:24:53.733424 885 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 25.769438] k3s[885]: I1005 04:24:53.733461 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 25.770638] k3s[885]: time="2026-10-05T04:24:53Z" level=info msg="Creating service-lb-controller event broadcaster" machine # [ 25.806697] k3s[885]: time="2026-10-05T04:24:53Z" level=info msg="Starting rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding controller" machine # [ 25.811444] k3s[885]: time="2026-10-05T04:24:53Z" level=info msg="Starting /v1, Kind=ConfigMap controller" machine # [ 25.812154] k3s[885]: time="2026-10-05T04:24:53Z" level=info msg="Starting /v1, Kind=ServiceAccount controller" machine # [ 25.812604] k3s[885]: time="2026-10-05T04:24:53Z" level=info msg="Starting batch/v1, Kind=Job controller" machine # [ 25.813139] k3s[885]: time="2026-10-05T04:24:53Z" level=info msg="Starting /v1, Kind=Secret controller" machine # [ 25.815745] k3s[885]: time="2026-10-05T04:24:53Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChartConfig controller" machine # [ 25.816655] k3s[885]: time="2026-10-05T04:24:53Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChart controller" machine # [ 25.965457] k3s[885]: I1005 04:24:53.932519 885 shared_informer.go:409] "Caches are synced" machine # [ 25.967046] k3s[885]: I1005 04:24:53.934169 885 shared_informer.go:409] "Caches are synced" machine # [ 25.978446] k3s[885]: I1005 04:24:53.945566 885 shared_informer.go:409] "Caches are synced" machine # [ 26.151099] k3s[885]: time="2026-10-05T04:24:54Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 26.155549] k3s[885]: time="2026-10-05T04:24:54Z" level=info msg="Starting /v1, Kind=Pod controller" machine # [ 26.160879] k3s[885]: time="2026-10-05T04:24:54Z" level=info msg="Starting apps/v1, Kind=DaemonSet controller" machine # [ 26.167471] k3s[885]: time="2026-10-05T04:24:54Z" level=info msg="Starting discovery.k8s.io/v1, Kind=EndpointSlice controller" machine # [ 26.169576] k3s[885]: I1005 04:24:54.136758 885 controllermanager.go:338] Started "service-lb-controller" machine # [ 26.171189] k3s[885]: W1005 04:24:54.137688 885 controllermanager.go:315] "node-route-controller" is disabled machine # [ 26.171850] k3s[885]: I1005 04:24:54.137714 885 controller.go:235] Starting service controller machine # [ 26.172557] k3s[885]: I1005 04:24:54.137742 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 26.172737] k3s[885]: I1005 04:24:54.137896 885 controllermanager.go:338] Started "cloud-node-controller" machine # [ 26.173727] k3s[885]: I1005 04:24:54.138003 885 controllermanager.go:338] Started "cloud-node-lifecycle-controller" machine # [ 26.174430] k3s[885]: I1005 04:24:54.138014 885 node_controller.go:179] Sending events to api server. machine # [ 26.174956] k3s[885]: I1005 04:24:54.138060 885 node_controller.go:188] Waiting for informer caches to sync machine # [ 26.175581] k3s[885]: I1005 04:24:54.138189 885 node_lifecycle_controller.go:112] Sending events to api server machine # [ 26.244158] k3s[885]: I1005 04:24:54.210463 885 controller.go:667] quota admission added evaluator for: deployments.apps machine: (finished: waiting for success: kubectl get ns farm, in 3.79 seconds) machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key machine # [ 26.270777] k3s[885]: I1005 04:24:54.237899 885 shared_informer.go:409] "Caches are synced" machine # [ 26.337295] k3s[885]: I1005 04:24:54.304392 885 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="podcertificaterequest-cleaner-controller" requiredFeatureGates=["PodCertificateRequest"] machine # [ 26.338087] k3s[885]: I1005 04:24:54.304426 885 controllermanager.go:641] "Warning: skipping controller" controller="podcertificaterequest-cleaner-controller" machine # [ 26.338779] k3s[885]: I1005 04:24:54.304439 885 controllermanager.go:689] "Warning: controller is disabled" controller="service-lb-controller" machine # [ 26.339585] k3s[885]: I1005 04:24:54.304450 885 controllermanager.go:689] "Warning: controller is disabled" controller="node-route-controller" machine # [ 26.340566] k3s[885]: I1005 04:24:54.304460 885 controllermanager.go:689] "Warning: controller is disabled" controller="cloud-node-lifecycle-controller" machine # [ 26.407658] k3s[885]: I1005 04:24:54.374768 885 alloc.go:329] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.43.0.10"} machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key, in 0.15 seconds) machine: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key machine # [ 26.409909] k3s[885]: time="2026-10-05T04:24:54Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=AppliedManifest type=Normal machine: (finished: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key, in 0.15 seconds) machine: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine # [ 26.699444] k3s[885]: time="2026-10-05T04:24:54Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine: (finished: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.15 seconds) subtest: chart deploys and workers become Ready machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine # [ 26.744398] k3s[885]: time="2026-10-05T04:24:54Z" level=info msg="Imported docker.io/library/nix-grpc-farm-client:0.1.0" machine # [ 26.747639] k3s[885]: time="2026-10-05T04:24:54Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-client@sha256:9c3dcc833a5ba1552c4cc4f19c1a2e6583b06db84654f9c6be1bb8a45f18e2bf" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 26.936815] k3s[885]: I1005 04:24:54.903513 885 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" requiredFeatureGates=["ClusterTrustBundle"] machine # [ 26.937528] k3s[885]: I1005 04:24:54.903545 885 controllermanager.go:641] "Warning: skipping controller" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" machine # [ 26.938051] k3s[885]: time="2026-10-05T04:24:54Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" object=kube-system/local-storage reason=DeletingManifest type=Normal machine # [ 26.945095] k3s[885]: time="2026-10-05T04:24:54Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=ApplyingManifest type=Normal machine # [ 27.090545] k3s[885]: I1005 04:24:55.057495 885 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="resourcepoolstatusrequest-controller" requiredFeatureGates=["DRAResourcePoolStatus"] machine # [ 27.091608] k3s[885]: I1005 04:24:55.057552 885 controllermanager.go:641] "Warning: skipping controller" controller="resourcepoolstatusrequest-controller" machine # [ 27.094275] k3s[885]: I1005 04:24:55.061385 885 controller.go:667] quota admission added evaluator for: helmcharts.helm.cattle.io machine # [ 27.105106] k3s[885]: time="2026-10-05T04:24:55Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=AppliedManifest type=Normal machine # [ 27.117979] k3s[885]: time="2026-10-05T04:24:55Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=ApplyingManifest type=Normal machine # [ 27.190990] k3s[885]: time="2026-10-05T04:24:55Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nixos/4v14fxahlxhgjlfn1jf5zd1cj1prhvgs-nix-grpc-farm-client.tar in 7.743154227s" machine # [ 27.191600] k3s[885]: time="2026-10-05T04:24:55Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/5kp7vafqw9fq3l1i0yrcvwh42vjrvs8s-nix-grpc-farm.tar" machine # [ 27.239843] k3s[885]: W1005 04:24:55.205508 885 probe.go:275] Flexvolume plugin directory at /usr/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating. machine # [ 27.244973] k3s[885]: time="2026-10-05T04:24:55Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Applying HelmChart from https://%{KUBERNETES_API}%/static/charts/nix-grpc-farm.tgz using Job kube-system/helm-install-nix-grpc-farm " object=kube-system/nix-grpc-farm reason=ApplyJob type=Normal machine # [ 27.274655] k3s[885]: I1005 04:24:55.241793 885 controller.go:667] quota admission added evaluator for: jobs.batch machine # [ 27.296906] k3s[885]: I1005 04:24:55.264067 885 taint_eviction.go:283] "Starting" controller="taint-eviction-controller" machine # [ 27.298379] k3s[885]: I1005 04:24:55.265562 885 taint_eviction.go:288] "Sending events to API server" machine # [ 27.299097] k3s[885]: I1005 04:24:55.266288 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.302299] k3s[885]: I1005 04:24:55.269476 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.309447] k3s[885]: I1005 04:24:55.276472 885 servicecidrs_controller.go:137] "Starting" controller="service-cidr-controller" machine # [ 27.310128] k3s[885]: I1005 04:24:55.276500 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.311356] k3s[885]: I1005 04:24:55.278082 885 job_controller.go:336] "Starting job controller" machine # [ 27.311988] k3s[885]: I1005 04:24:55.278119 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.314897] k3s[885]: I1005 04:24:55.278170 885 disruption.go:453] "Sending events to api server." machine # [ 27.315536] k3s[885]: I1005 04:24:55.278258 885 disruption.go:460] "Starting disruption controller" machine # [ 27.316104] k3s[885]: I1005 04:24:55.278269 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.316542] k3s[885]: I1005 04:24:55.278305 885 tokencleaner.go:117] "Starting token cleaner controller" machine # [ 27.317094] k3s[885]: I1005 04:24:55.278326 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.317506] k3s[885]: I1005 04:24:55.278445 885 node_ipam_controller.go:142] "Starting ipam controller" machine # [ 27.318040] k3s[885]: I1005 04:24:55.278461 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.318528] k3s[885]: I1005 04:24:55.279371 885 node_lifecycle_controller.go:436] "Sending events to api server" machine # [ 27.318995] k3s[885]: I1005 04:24:55.279421 885 node_lifecycle_controller.go:443] "Starting node controller" machine # [ 27.319512] k3s[885]: I1005 04:24:55.279432 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.319715] k3s[885]: I1005 04:24:55.279481 885 ttlafterfinished_controller.go:112] "Starting TTL after finished controller" machine # [ 27.320394] k3s[885]: I1005 04:24:55.279505 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.320930] k3s[885]: I1005 04:24:55.279827 885 namespace_controller.go:202] "Starting namespace controller" machine # [ 27.321806] k3s[885]: I1005 04:24:55.279841 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.322618] k3s[885]: I1005 04:24:55.280043 885 certificate_controller.go:120] "Starting certificate controller" name="csrapproving" machine # [ 27.323651] k3s[885]: I1005 04:24:55.280058 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.324594] k3s[885]: I1005 04:24:55.280088 885 pv_protection_controller.go:81] "Starting PV protection controller" machine # [ 27.325420] k3s[885]: I1005 04:24:55.280103 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.325753] k3s[885]: I1005 04:24:55.280220 885 controller.go:753] "Starting resource claim controller" machine # [ 27.326549] k3s[885]: I1005 04:24:55.280266 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.327418] k3s[885]: I1005 04:24:55.280356 885 endpointslicemirroring_controller.go:226] "Starting EndpointSliceMirroring controller" machine # [ 27.328416] k3s[885]: I1005 04:24:55.280370 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.329398] k3s[885]: I1005 04:24:55.280409 885 gc_controller.go:98] "Starting GC controller" machine # [ 27.330404] k3s[885]: I1005 04:24:55.280460 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.331433] k3s[885]: I1005 04:24:55.280548 885 pv_controller_base.go:318] "Starting persistent volume controller" machine # [ 27.332429] k3s[885]: I1005 04:24:55.280563 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.333494] k3s[885]: I1005 04:24:55.280613 885 expand_controller.go:328] "Starting expand controller" machine # [ 27.334059] k3s[885]: I1005 04:24:55.280644 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.334888] k3s[885]: I1005 04:24:55.280686 885 pvc_protection_controller.go:172] "Starting PVC protection controller" machine # [ 27.335575] k3s[885]: I1005 04:24:55.280700 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.336436] k3s[885]: I1005 04:24:55.280805 885 endpoints_controller.go:193] "Starting endpoint controller" machine # [ 27.337460] k3s[885]: I1005 04:24:55.280820 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.338489] k3s[885]: I1005 04:24:55.280854 885 serviceaccounts_controller.go:117] "Starting service account controller" machine # [ 27.339562] k3s[885]: I1005 04:24:55.280869 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.340590] k3s[885]: I1005 04:24:55.280970 885 stateful_set.go:234] "Starting stateful set controller" machine # [ 27.341463] k3s[885]: I1005 04:24:55.280993 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.342132] k3s[885]: I1005 04:24:55.281021 885 cleaner.go:83] "Starting CSR cleaner controller" machine # [ 27.342965] k3s[885]: I1005 04:24:55.281085 885 clusterroleaggregation_controller.go:176] "Starting ClusterRoleAggregator controller" machine # [ 27.343848] k3s[885]: I1005 04:24:55.281101 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.344693] k3s[885]: I1005 04:24:55.281145 885 vac_protection_controller.go:206] "Starting VAC protection controller" machine # [ 27.345657] k3s[885]: I1005 04:24:55.281159 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.372138] k3s[885]: I1005 04:24:55.336538 885 device_taint_eviction.go:783] "Starting" controller="device-taint-eviction-controller" numWorkers=8 machine # [ 27.372862] k3s[885]: I1005 04:24:55.336737 885 legacy_serviceaccount_token_cleaner.go:103] "Starting legacy service account token cleaner controller" machine # [ 27.373476] k3s[885]: I1005 04:24:55.336762 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.374181] k3s[885]: I1005 04:24:55.336796 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.374722] k3s[885]: I1005 04:24:55.336908 885 endpointslice_controller.go:280] "Starting endpoint slice controller" machine # [ 27.375400] k3s[885]: I1005 04:24:55.336923 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.375925] k3s[885]: I1005 04:24:55.337023 885 deployment_controller.go:180] "Starting controller" controller="deployment" machine # [ 27.376543] k3s[885]: I1005 04:24:55.337039 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.377084] k3s[885]: I1005 04:24:55.337123 885 horizontal.go:204] "Starting HPA controller" machine # [ 27.377547] k3s[885]: I1005 04:24:55.337137 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.377709] k3s[885]: I1005 04:24:55.337205 885 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-legacy-unknown" machine # [ 27.378374] k3s[885]: I1005 04:24:55.337253 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.378915] k3s[885]: I1005 04:24:55.337355 885 daemon_controller.go:364] "Starting daemon sets controller" machine # [ 27.379758] k3s[885]: I1005 04:24:55.337370 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.380406] k3s[885]: I1005 04:24:55.337455 885 replica_set.go:285] "Starting controller" name="replicaset" machine # [ 27.380936] k3s[885]: I1005 04:24:55.337470 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.381704] k3s[885]: I1005 04:24:55.337505 885 ttl_controller.go:127] "Starting TTL controller" machine # [ 27.382551] k3s[885]: I1005 04:24:55.337519 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.383093] k3s[885]: I1005 04:24:55.337552 885 publisher.go:107] "Starting root CA cert publisher controller" machine # [ 27.383574] k3s[885]: I1005 04:24:55.337582 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.384382] k3s[885]: I1005 04:24:55.337619 885 controller.go:174] "Starting ephemeral volume controller" machine # [ 27.385210] k3s[885]: I1005 04:24:55.337633 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.385874] k3s[885]: I1005 04:24:55.337725 885 attach_detach_controller.go:334] "Starting attach detach controller" machine # [ 27.386579] k3s[885]: I1005 04:24:55.337740 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.387478] k3s[885]: I1005 04:24:55.339001 885 resource_quota_controller.go:297] "Starting resource quota controller" machine # [ 27.388461] k3s[885]: I1005 04:24:55.339021 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.389504] k3s[885]: I1005 04:24:55.339137 885 garbagecollector.go:141] "Starting controller" controller="garbagecollector" machine # [ 27.390067] k3s[885]: I1005 04:24:55.339178 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.411585] k3s[885]: I1005 04:24:55.378689 885 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-serving" machine # [ 27.413518] k3s[885]: I1005 04:24:55.378723 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.414925] k3s[885]: I1005 04:24:55.378789 885 replica_set.go:285] "Starting controller" name="replicationcontroller" machine # [ 27.416607] k3s[885]: I1005 04:24:55.378807 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.418036] k3s[885]: I1005 04:24:55.379127 885 cronjob_controllerv2.go:143] "Starting cronjob controller v2" machine # [ 27.419470] k3s[885]: I1005 04:24:55.379144 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.420935] k3s[885]: I1005 04:24:55.379382 885 device_taint_eviction.go:823] "Sending events to api server" machine # [ 27.422549] k3s[885]: I1005 04:24:55.379391 885 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-client" machine # [ 27.424657] k3s[885]: I1005 04:24:55.379419 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.425911] k3s[885]: I1005 04:24:55.379492 885 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 27.428634] k3s[885]: I1005 04:24:55.379666 885 resource_quota_monitor.go:309] "QuotaMonitor running" machine # [ 27.430115] k3s[885]: I1005 04:24:55.379799 885 device_taint_eviction.go:1023] "Waiting" for="cache and event handler sync" machine # [ 27.431796] k3s[885]: I1005 04:24:55.379901 885 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 27.434759] k3s[885]: I1005 04:24:55.379962 885 graph_builder.go:387] "Running" component="GraphBuilder" machine # [ 27.436175] k3s[885]: I1005 04:24:55.381973 885 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 27.439124] k3s[885]: I1005 04:24:55.382090 885 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 27.442027] k3s[885]: I1005 04:24:55.382190 885 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kube-apiserver-client" machine # [ 27.444059] k3s[885]: I1005 04:24:55.382204 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.445418] k3s[885]: I1005 04:24:55.393430 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.446887] k3s[885]: I1005 04:24:55.410550 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.494561] k3s[885]: time="2026-10-05T04:24:55Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=AppliedManifest type=Normal machine # [ 27.499134] k3s[885]: I1005 04:24:55.462393 885 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.DeviceClass" machine # [ 27.504640] k3s[885]: time="2026-10-05T04:24:55Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=ApplyingManifest type=Normal machine # [ 27.510543] k3s[885]: I1005 04:24:55.477656 885 shared_informer.go:409] "Caches are synced" machine # [ 27.511825] k3s[885]: I1005 04:24:55.478999 885 shared_informer.go:409] "Caches are synced" machine # [ 27.512457] k3s[885]: I1005 04:24:55.479192 885 shared_informer.go:409] "Caches are synced" machine # [ 27.512910] k3s[885]: I1005 04:24:55.479294 885 shared_informer.go:409] "Caches are synced" machine # [ 27.513605] k3s[885]: I1005 04:24:55.480592 885 shared_informer.go:409] "Caches are synced" machine # [ 27.514151] k3s[885]: I1005 04:24:55.480655 885 shared_informer.go:409] "Caches are synced" machine # [ 27.514597] k3s[885]: I1005 04:24:55.480690 885 shared_informer.go:409] "Caches are synced" machine # [ 27.515167] k3s[885]: I1005 04:24:55.480872 885 shared_informer.go:409] "Caches are synced" machine # [ 27.515633] k3s[885]: I1005 04:24:55.482135 885 shared_informer.go:409] "Caches are synced" machine # [ 27.517991] k3s[885]: I1005 04:24:55.485152 885 shared_informer.go:409] "Caches are synced" machine # [ 27.535063] k3s[885]: I1005 04:24:55.501359 885 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.Pod" machine # [ 27.537154] k3s[885]: I1005 04:24:55.501397 885 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.Pod + event handler k8s.io/kubernetes/pkg/controller/devicetainteviction.(*Controller).Run" machine # [ 27.537790] k3s[885]: I1005 04:24:55.502190 885 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceSlice + event handler k8s.io/kubernetes/pkg/controller/devicetainteviction.(*Controller).Run" machine # [ 27.538736] k3s[885]: I1005 04:24:55.502741 885 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceSlice" machine # [ 27.539398] k3s[885]: I1005 04:24:55.502888 885 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceClaim" machine # [ 27.539980] k3s[885]: I1005 04:24:55.502934 885 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceClaim + event handler k8s.io/kubernetes/pkg/controller/devicetainteviction.(*Controller).Run" machine # [ 27.570468] k3s[885]: I1005 04:24:55.537595 885 shared_informer.go:409] "Caches are synced" machine # [ 27.571286] k3s[885]: I1005 04:24:55.537617 885 shared_informer.go:409] "Caches are synced" machine # [ 27.571710] k3s[885]: I1005 04:24:55.537652 885 shared_informer.go:409] "Caches are synced" machine # [ 27.572268] k3s[885]: I1005 04:24:55.537684 885 shared_informer.go:409] "Caches are synced" machine # [ 27.572769] k3s[885]: I1005 04:24:55.537727 885 shared_informer.go:409] "Caches are synced" machine # [ 27.573479] k3s[885]: I1005 04:24:55.538112 885 shared_informer.go:409] "Caches are synced" machine # [ 27.574164] k3s[885]: I1005 04:24:55.538169 885 shared_informer.go:409] "Caches are synced" machine # [ 27.574660] k3s[885]: I1005 04:24:55.538200 885 shared_informer.go:409] "Caches are synced" machine # [ 27.575375] k3s[885]: I1005 04:24:55.538325 885 shared_informer.go:409] "Caches are synced" machine # [ 27.575932] k3s[885]: I1005 04:24:55.538366 885 shared_informer.go:409] "Caches are synced" machine # [ 27.576617] k3s[885]: I1005 04:24:55.538669 885 shared_informer.go:409] "Caches are synced" machine # [ 27.577230] k3s[885]: I1005 04:24:55.538850 885 shared_informer.go:409] "Caches are synced" machine # [ 27.577732] k3s[885]: I1005 04:24:55.539323 885 shared_informer.go:409] "Caches are synced" machine # [ 27.584564] k3s[885]: I1005 04:24:55.551682 885 shared_informer.go:409] "Caches are synced" machine # [ 27.586080] k3s[885]: I1005 04:24:55.551808 885 shared_informer.go:409] "Caches are synced" machine # [ 27.593444] k3s[885]: I1005 04:24:55.560618 885 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 27.597194] k3s[885]: I1005 04:24:55.564375 885 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 27.611659] k3s[885]: I1005 04:24:55.578823 885 shared_informer.go:409] "Caches are synced" machine # [ 27.612426] k3s[885]: I1005 04:24:55.578835 885 shared_informer.go:409] "Caches are synced" machine # [ 27.612918] k3s[885]: I1005 04:24:55.578883 885 range_allocator.go:177] "Sending events to api server" machine # [ 27.613599] k3s[885]: I1005 04:24:55.578913 885 range_allocator.go:181] "Starting range CIDR allocator" machine # [ 27.615060] k3s[885]: I1005 04:24:55.581345 885 shared_informer.go:409] "Caches are synced" machine # [ 27.615531] k3s[885]: I1005 04:24:55.581712 885 shared_informer.go:409] "Caches are synced" machine # [ 27.616068] k3s[885]: I1005 04:24:55.581745 885 shared_informer.go:409] "Caches are synced" machine # [ 27.616504] k3s[885]: I1005 04:24:55.581827 885 shared_informer.go:409] "Caches are synced" machine # [ 27.617054] k3s[885]: I1005 04:24:55.581869 885 shared_informer.go:409] "Caches are synced" machine # [ 27.617512] k3s[885]: I1005 04:24:55.581904 885 shared_informer.go:409] "Caches are synced" machine # [ 27.618107] k3s[885]: I1005 04:24:55.582011 885 shared_informer.go:409] "Caches are synced" machine # [ 27.618585] k3s[885]: I1005 04:24:55.582116 885 shared_informer.go:409] "Caches are synced" machine # [ 27.619134] k3s[885]: I1005 04:24:55.582167 885 shared_informer.go:409] "Caches are synced" machine # [ 27.626137] k3s[885]: I1005 04:24:55.592793 885 shared_informer.go:409] "Caches are synced" machine # [ 27.626711] k3s[885]: I1005 04:24:55.592843 885 shared_informer.go:409] "Caches are synced" machine # [ 27.627207] k3s[885]: I1005 04:24:55.592907 885 shared_informer.go:409] "Caches are synced" machine # [ 27.627656] k3s[885]: I1005 04:24:55.593121 885 shared_informer.go:409] "Caches are synced" machine # [ 27.629379] k3s[885]: I1005 04:24:55.593267 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.629704] k3s[885]: I1005 04:24:55.593285 885 shared_informer.go:409] "Caches are synced" machine # [ 27.632418] k3s[885]: I1005 04:24:55.599583 885 shared_informer.go:409] "Caches are synced" machine # [ 27.635041] k3s[885]: I1005 04:24:55.602181 885 shared_informer.go:409] "Caches are synced" machine # [ 27.649529] k3s[885]: time="2026-10-05T04:24:55Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=AppliedManifest type=Normal machine # [ 27.698920] k3s[885]: time="2026-10-05T04:24:55Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 27.711849] k3s[885]: time="2026-10-05T04:24:55Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/traefik.yaml\"" object=kube-system/traefik reason=DeletingManifest type=Normal machine # [ 27.712478] k3s[885]: time="2026-10-05T04:24:55Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Deferred node password secret validation complete" object=machine reason=NodePasswordValidationComplete type=Normal machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 28.040025] k3s[885]: I1005 04:24:56.007049 885 controller.go:667] quota admission added evaluator for: replicasets.apps machine # [ 28.219170] k3s[885]: time="2026-10-05T04:24:56Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Resumed synced Job kube-system/helm-install-nix-grpc-farm" object=kube-system/nix-grpc-farm reason=ResumeJob type=Normal machine # [ 28.543960] k3s[885]: I1005 04:24:56.511076 885 shared_informer.go:409] "Caches are synced" machine # [ 28.573885] k3s[885]: I1005 04:24:56.540273 885 shared_informer.go:409] "Caches are synced" machine # [ 28.575446] k3s[885]: I1005 04:24:56.540312 885 garbagecollector.go:166] "Garbage collector: all resource monitors have synced" machine # [ 28.576876] k3s[885]: I1005 04:24:56.540333 885 garbagecollector.go:169] "Proceeding to collect garbage" machine # [ 28.702502] k3s[885]: time="2026-10-05T04:24:56Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 29.115228] postgres[1208]: [1208] ERROR: relation "goose_db_version" does not exist at character 36 machine # [ 29.115774] postgres[1208]: [1208] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC machine # [ 29.136964] niks3-server[1184]: 2026/10/05 04:24:57 OK 20241026095416_initial_model.sql (8.63ms) machine # [ 29.138663] niks3-server[1184]: 2026/10/05 04:24:57 OK 20251210153512_drop_unused_gin_index.sql (2.35ms) machine # [ 29.142491] niks3-server[1184]: 2026/10/05 04:24:57 OK 20251218171726_add_pins.sql (3.09ms) machine # [ 29.146402] niks3-server[1184]: 2026/10/05 04:24:57 OK 20260628120000_add_object_size_and_stats.sql (3.38ms) machine # [ 29.150029] niks3-server[1184]: 2026/10/05 04:24:57 OK 20260905000000_add_claims.sql (3.92ms) machine # [ 29.153983] niks3-server[1184]: 2026/10/05 04:24:57 OK 20260920000000_drop_claims.sql (3.13ms) machine # [ 29.157105] niks3-server[1184]: 2026/10/05 04:24:57 OK 20260923120000_add_pushes.sql (3.1ms) machine # [ 29.157799] niks3-server[1184]: 2026/10/05 04:24:57 goose: successfully migrated database to version: 20260923120000 machine # [ 29.162189] niks3-server[1184]: 2026/10/05 04:24:57 OK 1_commit_pending_closure.sql (4.96ms) machine # [ 29.165043] niks3-server[1184]: 2026/10/05 04:24:57 OK 2_object_stats_trigger.sql (2.74ms) machine # [ 29.166571] niks3-server[1184]: 2026/10/05 04:24:57 OK 3_commit_push.sql (1.43ms) machine # [ 29.167488] niks3-server[1184]: 2026/10/05 04:24:57 goose: up to current file version: 3 machine # [ 29.172146] niks3-server[1184]: 2026/10/05 04:24:57 INFO OIDC provider initialized name=kubernetes issuer=https://kubernetes.default.svc.cluster.local machine # [ 29.173035] niks3-server[1184]: 2026/10/05 04:24:57 INFO OIDC authentication enabled config=/nix/store/v0b0sqyzhrjsz48x3klf7b7vl89apzs0-niks3-oidc.json machine # [ 29.174480] niks3-server[1184]: 2026/10/05 04:24:57 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 29.212108] niks3-server[1184]: 2026/10/05 04:24:57 INFO Read proxy enabled — serving cache objects from S3 machine # [ 29.212974] niks3-server[1184]: 2026/10/05 04:24:57 INFO Using socket-activated listener address=0.0.0.0:5751 machine # [ 29.213566] niks3-server[1184]: 2026/10/05 04:24:57 INFO systemd watchdog enabled interval=15s machine # [ 29.214289] systemd[1]: Started niks3 server. machine # [ 29.214747] systemd[1]: Reached target Multi-User System. machine # [ 29.215456] systemd[1]: Startup finished in 1.103s (kernel) + 3.684s (initrd) + 24.426s (userspace) = 29.214s. machine # [ 29.218273] niks3-server[1184]: 2026/10/05 04:24:57 INFO Starting HTTP server address=0.0.0.0:5751 machine # [ 29.702963] k3s[885]: time="2026-10-05T04:24:57Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 30.700164] k3s[885]: time="2026-10-05T04:24:58Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 31.513636] k3s[885]: time="2026-10-05T04:24:59Z" level=info msg="Started tunnel to 10.0.2.15:6443" machine # [ 31.514635] k3s[885]: time="2026-10-05T04:24:59Z" level=info msg="Stopped tunnel to 127.0.0.1:6443" machine # [ 31.515090] k3s[885]: time="2026-10-05T04:24:59Z" level=info msg="Proxy done" err="context canceled" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 31.515551] k3s[885]: time="2026-10-05T04:24:59Z" level=info msg="Connecting to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 31.515762] k3s[885]: time="2026-10-05T04:24:59Z" level=info msg="error in remotedialer server [400]: websocket: close 1006 (abnormal closure): unexpected EOF" machine # [ 31.522124] k3s[885]: time="2026-10-05T04:24:59Z" level=info msg="Handling backend connection request [machine]" machine # [ 31.523576] k3s[885]: time="2026-10-05T04:24:59Z" level=info msg="Connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 31.524263] k3s[885]: time="2026-10-05T04:24:59Z" level=info msg="Remotedialer connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 31.699220] k3s[885]: time="2026-10-05T04:24:59Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 32.109672] k3s[885]: time="2026-10-05T04:25:00Z" level=info msg="Imported docker.io/library/nix-grpc-farm:0.1.0" machine # [ 32.113381] k3s[885]: time="2026-10-05T04:25:00Z" level=info msg="Tagged docker.io/library/nix-grpc-farm@sha256:62b0b7c0e36bc5e060902f41fd80b7baec3fdc056b137820d6017eeb824c41a9" machine # [ 32.482871] k3s[885]: time="2026-10-05T04:25:00Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nixos/5kp7vafqw9fq3l1i0yrcvwh42vjrvs8s-nix-grpc-farm.tar in 5.291231706s" machine # [ 32.485275] k3s[885]: time="2026-10-05T04:25:00Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/djnarcp7bpn4whbzn22i5vvf30pdwipi-nix-grpc-farm-lb.tar" machine # [ 32.700224] k3s[885]: time="2026-10-05T04:25:00Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 33.699236] k3s[885]: time="2026-10-05T04:25:01Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 34.263372] k3s[885]: time="2026-10-05T04:25:02Z" level=info msg="Imported docker.io/library/nix-grpc-farm-lb:0.1.0" machine # [ 34.266666] k3s[885]: time="2026-10-05T04:25:02Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-lb@sha256:18ee6724be589622e1aee9d13c5121e7b2c992ca636c935ade90c66423e18f37" machine # [ 34.322616] k3s[885]: time="2026-10-05T04:25:02Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nixos/djnarcp7bpn4whbzn22i5vvf30pdwipi-nix-grpc-farm-lb.tar in 1.837634392s" machine # [ 34.323917] k3s[885]: time="2026-10-05T04:25:02Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/smddpgqzjvlqv3lx57wdzl7kma805fj0-k3s-airgap-images-amd64.tar.zst" machine # [ 34.467855] k3s[885]: time="2026-10-05T04:25:02Z" level=info msg="Running kubelet --cloud-provider=external --config-dir=/var/lib/rancher/k3s/agent/etc/kubelet.conf.d --containerd=/run/k3s/containerd/containerd.sock --eviction-hard=nodefs.available<1%,imagefs.available<1% --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubelet.kubeconfig --node-ip=10.0.2.15,fec0::830b:fd05:4aac:463c --node-labels= --read-only-port=0" machine # [ 34.473826] k3s[885]: Flag --containerd has been deprecated, This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed. machine # [ 34.486812] k3s[885]: I1005 04:25:02.453925 885 server.go:541] "Kubelet version" kubeletVersion="v1.36.4+k3s1" machine # [ 34.487694] k3s[885]: I1005 04:25:02.453953 885 server.go:543] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 34.488508] k3s[885]: I1005 04:25:02.453980 885 watchdog_linux.go:94] "Systemd watchdog is not enabled" machine # [ 34.489503] k3s[885]: I1005 04:25:02.453992 885 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." machine # [ 34.495478] k3s[885]: I1005 04:25:02.461966 885 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/agent/client-ca.crt" machine # [ 34.502514] k3s[885]: I1005 04:25:02.469584 885 server.go:1444] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" machine # [ 34.511422] k3s[885]: I1005 04:25:02.478504 885 server.go:804] "--cgroups-per-qos enabled, but --cgroup-root was not specified. Defaulting to /" machine # [ 34.512636] k3s[885]: I1005 04:25:02.478565 885 server.go:865] "NoSwap is set due to memorySwapBehavior not specified" memorySwapBehavior="" FailSwapOn=false machine # [ 34.513676] k3s[885]: I1005 04:25:02.478960 885 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] machine # [ 34.515350] k3s[885]: I1005 04:25:02.479003 885 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"machine","RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"MemoryReservationPolicy":"None","PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} machine # [ 34.516159] k3s[885]: I1005 04:25:02.479371 885 topology_manager.go:172] "Creating topology manager with none policy" machine # [ 34.516585] k3s[885]: I1005 04:25:02.479398 885 container_manager_linux.go:309] "Creating device plugin manager" machine # [ 34.517176] k3s[885]: I1005 04:25:02.479539 885 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" machine # [ 34.538837] k3s[885]: I1005 04:25:02.505946 885 state_mem.go:45] "Initialized" logger="CPUManager state memory" machine # [ 34.539839] k3s[885]: I1005 04:25:02.506272 885 kubelet.go:485] "Attempting to sync node with API server" machine # [ 34.540638] k3s[885]: I1005 04:25:02.506292 885 kubelet.go:386] "Adding static pod path" path="/var/lib/rancher/k3s/agent/pod-manifests" machine # [ 34.541949] k3s[885]: I1005 04:25:02.506323 885 kubelet.go:397] "Adding apiserver pod source" machine # [ 34.542776] k3s[885]: I1005 04:25:02.506340 885 apiserver.go:41] "Waiting for node sync before watching apiserver pods" machine # [ 34.543792] k3s[885]: I1005 04:25:02.508520 885 kuberuntime_manager.go:308] "Container runtime initialized" containerRuntime="containerd" version="2.3.4-k3s1.36" apiVersion="v1" machine # [ 34.544789] k3s[885]: I1005 04:25:02.510786 885 kubelet.go:1002] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" machine # [ 34.546931] k3s[885]: I1005 04:25:02.510854 885 kubelet.go:1029] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" machine # [ 34.557840] k3s[885]: I1005 04:25:02.523034 885 server.go:1280] "Started kubelet" machine # [ 34.558917] k3s[885]: I1005 04:25:02.523082 885 server.go:193] "Starting to listen" address="0.0.0.0" port=10250 machine # [ 34.560204] k3s[885]: I1005 04:25:02.523194 885 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 machine # [ 34.561201] k3s[885]: I1005 04:25:02.523310 885 server_v1.go:49] "podresources" method="list" useActivePods=true machine # [ 34.562262] k3s[885]: I1005 04:25:02.523591 885 server.go:264] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" machine # [ 34.563436] k3s[885]: I1005 04:25:02.523975 885 server.go:354] "Adding debug handlers to kubelet server" machine # [ 34.565559] k3s[885]: I1005 04:25:02.526605 885 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" machine # [ 34.566502] k3s[885]: I1005 04:25:02.527200 885 dynamic_serving_content.go:135] "Starting controller" name="kubelet-server-cert-files::/var/lib/rancher/k3s/agent/serving-kubelet.crt::/var/lib/rancher/k3s/agent/serving-kubelet.key" machine # [ 34.567611] k3s[885]: I1005 04:25:02.527319 885 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 34.568678] k3s[885]: E1005 04:25:02.532869 885 kubelet.go:1725] "Image garbage collection failed once. Stats initialization may not have completed yet" err="invalid capacity 0 on image filesystem" machine # [ 34.569759] k3s[885]: E1005 04:25:02.535803 885 kubelet_node_status.go:396] "Error getting the current node from lister" err="node \"machine\" not found" machine # [ 34.570633] k3s[885]: I1005 04:25:02.535998 885 volume_manager.go:310] "Starting Kubelet Volume Manager" machine # [ 34.571753] k3s[885]: I1005 04:25:02.536319 885 desired_state_of_world_populator.go:146] "Desired state populator starts to run" machine # [ 34.574855] k3s[885]: E1005 04:25:02.537275 885 kubelet.go:3516] "Unable to register mirror pod because node is not registered yet" err="node \"machine\" not found" node="machine" machine # [ 34.575718] k3s[885]: I1005 04:25:02.536766 885 reconciler.go:29] "Reconciler: start to sync state" machine # [ 34.576498] k3s[885]: I1005 04:25:02.541108 885 factory.go:222] Registration of the systemd container factory successfully machine # [ 34.577076] k3s[885]: I1005 04:25:02.541262 885 factory.go:220] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory machine # [ 34.577469] k3s[885]: I1005 04:25:02.543543 885 factory.go:222] Registration of the containerd container factory successfully machine # [ 34.580785] k3s[885]: E1005 04:25:02.547949 885 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"machine\" not found" node="machine" machine # [ 34.587507] k3s[885]: I1005 04:25:02.554387 885 cpu_manager.go:235] "Starting" policy="none" machine # [ 34.588531] k3s[885]: I1005 04:25:02.554406 885 cpu_manager.go:236] "Reconciling" reconcilePeriod="10s" machine # [ 34.588694] k3s[885]: I1005 04:25:02.554427 885 state_mem.go:45] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" machine # [ 34.592832] k3s[885]: I1005 04:25:02.560005 885 policy_none.go:50] "Start" machine # [ 34.593500] k3s[885]: I1005 04:25:02.560032 885 memory_manager.go:190] "Starting memorymanager" policy="None" machine # [ 34.594049] k3s[885]: I1005 04:25:02.560050 885 state_mem.go:40] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" machine # [ 34.600122] k3s[885]: I1005 04:25:02.567292 885 policy_none.go:44] "Start" machine # [ 34.605551] systemd[1]: Created slice libcontainer container kubepods.slice. machine # [ 34.608036] k3s[885]: I1005 04:25:02.574421 885 kubelet_network_linux.go:53] "Initialized iptables rules." protocol="IPv6" machine # [ 34.616787] systemd[1]: Created slice libcontainer container kubepods-burstable.slice. machine # [ 34.621228] systemd[1]: Created slice libcontainer container kubepods-besteffort.slice. machine # [ 34.627669] k3s[885]: E1005 04:25:02.594698 885 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" machine # [ 34.628539] k3s[885]: I1005 04:25:02.595028 885 eviction_manager.go:194] "Eviction manager: starting control loop" machine # [ 34.629087] k3s[885]: I1005 04:25:02.595077 885 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" machine # [ 34.629588] k3s[885]: I1005 04:25:02.595476 885 plugin_manager.go:121] "Starting Kubelet Plugin Manager" machine # [ 34.630135] k3s[885]: E1005 04:25:02.597005 885 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="no imagefs label for configured runtime" machine # [ 34.630581] k3s[885]: E1005 04:25:02.597044 885 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"machine\" not found" machine # [ 34.670352] k3s[885]: E1005 04:25:02.637481 885 kubelet.go:3516] "Unable to register mirror pod because node is not registered yet" err="node \"machine\" not found" node="machine" machine # [ 34.673507] k3s[885]: I1005 04:25:02.640649 885 kubelet_network_linux.go:53] "Initialized iptables rules." protocol="IPv4" machine # [ 34.674281] k3s[885]: I1005 04:25:02.640693 885 status_manager.go:277] "Starting to sync pod status with apiserver" machine # [ 34.674727] k3s[885]: I1005 04:25:02.640736 885 kubelet.go:2622] "Starting kubelet main sync loop" machine # [ 34.677579] k3s[885]: E1005 04:25:02.644756 885 kubelet.go:2646] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" machine # [ 34.699186] k3s[885]: time="2026-10-05T04:25:02Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 34.729458] k3s[885]: I1005 04:25:02.696577 885 kubelet_node_status.go:75] "Attempting to register node" node="machine" machine # [ 34.735061] k3s[885]: I1005 04:25:02.702073 885 node_controller.go:432] Initializing node machine with cloud provider machine # [ 34.736613] k3s[885]: I1005 04:25:02.702130 885 node_controller.go:236] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 34.739237] k3s[885]: E1005 04:25:02.702151 885 node_controller.go:247] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 34.742193] k3s[885]: I1005 04:25:02.702160 885 kubelet_node_status.go:78] "Successfully registered node" node="machine" machine # [ 34.743759] k3s[885]: E1005 04:25:02.702200 885 kubelet_node_status.go:479] "Error updating node status, will retry" err="error getting node \"machine\": node \"machine\" not found" machine # [ 34.746172] k3s[885]: time="2026-10-05T04:25:02Z" level=info msg="Adding node OwnerReference to node-password secret machine.node-password.k3s" machine # [ 34.748104] k3s[885]: I1005 04:25:02.707364 885 node_controller.go:432] Initializing node machine with cloud provider machine # [ 34.750212] k3s[885]: I1005 04:25:02.707442 885 node_controller.go:236] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 34.752728] k3s[885]: E1005 04:25:02.707461 885 node_controller.go:247] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 34.755828] k3s[885]: I1005 04:25:02.708151 885 node_controller.go:432] Initializing node machine with cloud provider machine # [ 34.757404] k3s[885]: I1005 04:25:02.709334 885 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"machine\" does not exist" machine # [ 34.760917] k3s[885]: time="2026-10-05T04:25:02Z" level=info msg="Annotations and labels have been set successfully on node: machine" machine # [ 34.762703] k3s[885]: time="2026-10-05T04:25:02Z" level=info msg="Starting flannel with backend vxlan" machine # [ 34.763478] k3s[885]: I1005 04:25:02.718379 885 range_allocator.go:433] "Set node PodCIDR" node="machine" podCIDRs=["10.42.0.0/24"] machine # [ 34.764046] k3s[885]: time="2026-10-05T04:25:02Z" level=info msg="Synced coredns NodeHosts entries for machine" machine # [ 34.764555] k3s[885]: I1005 04:25:02.725188 885 kuberuntime_manager.go:2172] "Updating runtime config through cri with podcidr" CIDR="10.42.0.0/24" machine # [ 34.765133] k3s[885]: I1005 04:25:02.728029 885 kubelet_network.go:48] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.42.0.0/24" machine # [ 34.777052] k3s[885]: time="2026-10-05T04:25:02Z" level=info msg="Flannel found PodCIDR assigned for node machine" machine # [ 34.777689] k3s[885]: time="2026-10-05T04:25:02Z" level=info msg="The interface eth0 with ipv4 address 10.0.2.15 will be used by flannel" machine # [ 34.778260] k3s[885]: I1005 04:25:02.745169 885 kube.go:139] Waiting 10m0s for node controller to sync machine # [ 34.778681] k3s[885]: I1005 04:25:02.745266 885 kube.go:537] Starting kube subnet manager machine # [ 34.840581] k3s[885]: I1005 04:25:02.806134 885 node_controller.go:477] Successfully initialized node machine with cloud provider machine # [ 34.841132] k3s[885]: I1005 04:25:02.806391 885 event.go:389] "Event occurred" object="machine" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="Synced" message="Node synced successfully" machine # [ 34.841566] k3s[885]: E1005 04:25:02.806564 885 options.go:205] The manifest file is empty, ignoring. machine # [ 34.848736] k3s[885]: I1005 04:25:02.815897 885 server.go:176] "Starting Kubernetes Scheduler" version="v1.36.4+k3s1" machine # [ 34.849190] k3s[885]: I1005 04:25:02.815924 885 server.go:178] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 34.853108] k3s[885]: I1005 04:25:02.820264 885 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 34.853549] k3s[885]: I1005 04:25:02.820295 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 34.853756] k3s[885]: I1005 04:25:02.820340 885 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 34.854425] k3s[885]: I1005 04:25:02.820360 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 34.854968] k3s[885]: I1005 04:25:02.820389 885 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 34.855660] k3s[885]: I1005 04:25:02.820406 885 shared_informer.go:402] "Waiting for caches to sync" machine # [ 34.858078] k3s[885]: I1005 04:25:02.820603 885 secure_serving.go:214] Serving securely on 127.0.0.1:10259 machine # [ 34.858639] k3s[885]: I1005 04:25:02.820710 885 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 34.859228] k3s[885]: I1005 04:25:02.820810 885 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 34.953423] k3s[885]: I1005 04:25:02.920486 885 shared_informer.go:409] "Caches are synced" machine # [ 34.954873] k3s[885]: I1005 04:25:02.920546 885 shared_informer.go:409] "Caches are synced" machine # [ 34.955515] k3s[885]: I1005 04:25:02.920550 885 shared_informer.go:409] "Caches are synced" machine # [ 34.975090] k3s[885]: I1005 04:25:02.942202 885 kubelet_node_status.go:431] "Fast updating node status as it just became ready" machine # [ 34.984873] k3s[885]: I1005 04:25:02.952017 885 topologycache.go:237] "Can't get CPU or zone information for node" node="machine" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 35.420065] k3s[885]: time="2026-10-05T04:25:03Z" level=info msg="Tunnel authorizer set Kubelet Port 0.0.0.0:10250" machine # [ 35.540839] k3s[885]: I1005 04:25:03.507861 885 apiserver.go:51] "Watching apiserver" machine # [ 35.547038] k3s[885]: I1005 04:25:03.514012 885 server.go:228] "Successfully retrieved NodeIPs" NodeIPs=["10.0.2.15","fec0::830b:fd05:4aac:463c"] machine # [ 35.552238] k3s[885]: E1005 04:25:03.519356 885 server.go:265] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`" machine # [ 35.576073] k3s[885]: I1005 04:25:03.542854 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stvnt\" (UniqueName: \"kubernetes.io/projected/628fc940-aefe-47da-adf3-dbd049b5eb4c-kube-api-access-stvnt\") pod \"helm-install-nix-grpc-farm-zxknb\" (UID: \"628fc940-aefe-47da-adf3-dbd049b5eb4c\") " pod="kube-system/helm-install-nix-grpc-farm-zxknb" machine # [ 35.576855] k3s[885]: I1005 04:25:03.542937 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-config-volume\" (UniqueName: \"kubernetes.io/configmap/84e7f307-8758-4230-9b6d-b66429699007-custom-config-volume\") pod \"coredns-54996dc9b4-qfm95\" (UID: \"84e7f307-8758-4230-9b6d-b66429699007\") " pod="kube-system/coredns-54996dc9b4-qfm95" machine # [ 35.578020] k3s[885]: I1005 04:25:03.543015 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkkc8\" (UniqueName: \"kubernetes.io/projected/84e7f307-8758-4230-9b6d-b66429699007-kube-api-access-lkkc8\") pod \"coredns-54996dc9b4-qfm95\" (UID: \"84e7f307-8758-4230-9b6d-b66429699007\") " pod="kube-system/coredns-54996dc9b4-qfm95" machine # [ 35.578805] k3s[885]: I1005 04:25:03.543103 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/628fc940-aefe-47da-adf3-dbd049b5eb4c-klipper-helm\") pod \"helm-install-nix-grpc-farm-zxknb\" (UID: \"628fc940-aefe-47da-adf3-dbd049b5eb4c\") " pod="kube-system/helm-install-nix-grpc-farm-zxknb" machine # [ 35.581493] k3s[885]: I1005 04:25:03.543132 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/628fc940-aefe-47da-adf3-dbd049b5eb4c-klipper-cache\") pod \"helm-install-nix-grpc-farm-zxknb\" (UID: \"628fc940-aefe-47da-adf3-dbd049b5eb4c\") " pod="kube-system/helm-install-nix-grpc-farm-zxknb" machine # [ 35.584221] k3s[885]: I1005 04:25:03.543310 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/628fc940-aefe-47da-adf3-dbd049b5eb4c-tmp\") pod \"helm-install-nix-grpc-farm-zxknb\" (UID: \"628fc940-aefe-47da-adf3-dbd049b5eb4c\") " pod="kube-system/helm-install-nix-grpc-farm-zxknb" machine # [ 35.584849] k3s[885]: I1005 04:25:03.543485 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"values\" (UniqueName: \"kubernetes.io/projected/628fc940-aefe-47da-adf3-dbd049b5eb4c-values\") pod \"helm-install-nix-grpc-farm-zxknb\" (UID: \"628fc940-aefe-47da-adf3-dbd049b5eb4c\") " pod="kube-system/helm-install-nix-grpc-farm-zxknb" machine # [ 35.586078] k3s[885]: I1005 04:25:03.543541 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"content\" (UniqueName: \"kubernetes.io/configmap/628fc940-aefe-47da-adf3-dbd049b5eb4c-content\") pod \"helm-install-nix-grpc-farm-zxknb\" (UID: \"628fc940-aefe-47da-adf3-dbd049b5eb4c\") " pod="kube-system/helm-install-nix-grpc-farm-zxknb" machine # [ 35.586979] k3s[885]: I1005 04:25:03.543629 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/84e7f307-8758-4230-9b6d-b66429699007-config-volume\") pod \"coredns-54996dc9b4-qfm95\" (UID: \"84e7f307-8758-4230-9b6d-b66429699007\") " pod="kube-system/coredns-54996dc9b4-qfm95" machine # [ 35.587928] k3s[885]: I1005 04:25:03.543653 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/628fc940-aefe-47da-adf3-dbd049b5eb4c-klipper-config\") pod \"helm-install-nix-grpc-farm-zxknb\" (UID: \"628fc940-aefe-47da-adf3-dbd049b5eb4c\") " pod="kube-system/helm-install-nix-grpc-farm-zxknb" machine # [ 35.589906] systemd[1]: Created slice libcontainer container kubepods-burstable-pod628fc940_aefe_47da_adf3_dbd049b5eb4c.slice. machine # [ 35.638925] k3s[885]: I1005 04:25:03.606069 885 server.go:274] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4" machine # [ 35.639586] k3s[885]: I1005 04:25:03.606105 885 server_linux.go:137] "Using iptables Proxier" machine # [ 35.640476] systemd[1]: Created slice libcontainer container kubepods-burstable-pod84e7f307_8758_4230_9b6d_b66429699007.slice. machine # [ 35.656214] k3s[885]: I1005 04:25:03.623361 885 proxier.go:241] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4" machine # [ 35.669574] k3s[885]: I1005 04:25:03.636676 885 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" machine # [ 35.671475] k3s[885]: I1005 04:25:03.638610 885 server.go:539] "Version info" version="v1.36.4+k3s1" machine # [ 35.673052] k3s[885]: I1005 04:25:03.638638 885 server.go:541] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 35.673759] k3s[885]: I1005 04:25:03.639987 885 config.go:200] "Starting service config controller" machine # [ 35.674462] k3s[885]: I1005 04:25:03.640005 885 shared_informer.go:381] "Waiting for caches to sync" controller="service config" machine # [ 35.675203] k3s[885]: I1005 04:25:03.640035 885 config.go:106] "Starting endpoint slice config controller" machine # [ 35.675867] k3s[885]: I1005 04:25:03.640046 885 shared_informer.go:381] "Waiting for caches to sync" controller="endpoint slice config" machine # [ 35.676653] k3s[885]: I1005 04:25:03.640072 885 config.go:403] "Starting serviceCIDR config controller" machine # [ 35.677558] k3s[885]: I1005 04:25:03.640083 885 shared_informer.go:381] "Waiting for caches to sync" controller="serviceCIDR config" machine # [ 35.678428] k3s[885]: I1005 04:25:03.640393 885 config.go:309] "Starting node config controller" machine # [ 35.679145] k3s[885]: I1005 04:25:03.640410 885 shared_informer.go:381] "Waiting for caches to sync" controller="node config" machine # [ 35.705941] k3s[885]: time="2026-10-05T04:25:03Z" level=info msg="Labels and annotations have been set successfully on node: machine" machine # [ 35.773670] k3s[885]: I1005 04:25:03.740784 885 shared_informer.go:388] "Caches are synced" controller="node config" machine # [ 35.778711] k3s[885]: I1005 04:25:03.745836 885 kube.go:163] Node controller sync successful machine # [ 35.779560] k3s[885]: I1005 04:25:03.745927 885 vxlan.go:128] VXLAN config: VNI=1 Port=0 GBP=false Learning=false DirectRouting=false machine # [ 35.782577] k3s[885]: I1005 04:25:03.749690 885 kube.go:704] List of node(machine) annotations: map[string]string{"alpha.kubernetes.io/provided-node-ip":"10.0.2.15,fec0::830b:fd05:4aac:463c", "k3s.io/hostname":"machine", "k3s.io/internal-ip":"10.0.2.15,fec0::830b:fd05:4aac:463c", "k3s.io/node-args":"[\"server\",\"--disable\",\"traefik\",\"--disable\",\"metrics-server\",\"--disable\",\"local-storage\",\"--kubelet-arg\",\"eviction-hard=nodefs.available\\u003c1%,imagefs.available\\u003c1%\"]", "k3s.io/node-config-hash":"EFXPOZ7ZWHRCLFNW4X4ZDPFQMSAOP3BLEIN2VE47TDRKQ4UIWKUQ====", "k3s.io/node-env":"{}", "node.alpha.kubernetes.io/ttl":"0", "volumes.kubernetes.io/controller-managed-attach-detach":"true"} machine # [ 35.805799] (udev-worker)[1267]: Network interface NamePolicy= disabled on kernel command line. machine # [ 35.812138] k3s[885]: I1005 04:25:03.779274 885 kube.go:558] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.42.0.0/24] machine # [ 35.814396] k3s[885]: I1005 04:25:03.781476 885 iptables.go:50] Starting flannel in iptables mode... machine # [ 35.815151] k3s[885]: time="2026-10-05T04:25:03Z" level=warning msg="no subnet found for key: FLANNEL_NETWORK in file: /run/flannel/subnet.env" machine # [ 35.815756] k3s[885]: time="2026-10-05T04:25:03Z" level=warning msg="no subnet found for key: FLANNEL_SUBNET in file: /run/flannel/subnet.env" machine # [ 35.816592] k3s[885]: time="2026-10-05T04:25:03Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_NETWORK in file: /run/flannel/subnet.env" machine # [ 35.817479] k3s[885]: time="2026-10-05T04:25:03Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_SUBNET in file: /run/flannel/subnet.env" machine # [ 35.818127] k3s[885]: I1005 04:25:03.781579 885 iptables.go:101] Current network or subnet (10.42.0.0/16, 10.42.0.0/24) is not equal to previous one (0.0.0.0/0, 0.0.0.0/0), trying to recycle old iptables rules machine # [ 35.835959] dhcpcd[683]: flannel.1: IAID 25:5e:13:49 machine # [ 35.836991] dhcpcd[683]: flannel.1: adding address fe80::e03c:25ff:fe5e:1349 machine # [ 35.861816] k3s[885]: I1005 04:25:03.828965 885 iptables.go:111] Setting up masking rules machine # [ 35.873166] k3s[885]: I1005 04:25:03.840304 885 iptables.go:212] Changing default FORWARD chain policy to ACCEPT machine # [ 35.873916] k3s[885]: I1005 04:25:03.840388 885 shared_informer.go:388] "Caches are synced" controller="serviceCIDR config" machine # [ 35.874509] k3s[885]: I1005 04:25:03.840427 885 shared_informer.go:388] "Caches are synced" controller="endpoint slice config" machine # [ 35.874693] k3s[885]: I1005 04:25:03.840425 885 shared_informer.go:388] "Caches are synced" controller="service config" machine # [ 35.880523] k3s[885]: time="2026-10-05T04:25:03Z" level=info msg="Wrote flannel subnet file to /run/flannel/subnet.env" machine # [ 35.881228] k3s[885]: time="2026-10-05T04:25:03Z" level=info msg="Running flannel backend" machine # [ 35.881678] k3s[885]: I1005 04:25:03.847783 885 vxlan_network.go:68] watching for new subnet leases machine # [ 35.882226] k3s[885]: I1005 04:25:03.847819 885 vxlan_network.go:115] starting vxlan device watcher machine # [ 35.926718] k3s[885]: I1005 04:25:03.893689 885 iptables.go:358] bootstrap done machine # [ 36.014352] dhcpcd[683]: flannel.1: soliciting a DHCP lease machine # [ 36.019123] (udev-worker)[1359]: Network interface NamePolicy= disabled on kernel command line. machine # [ 36.026061] k3s[885]: I1005 04:25:03.993202 885 iptables.go:358] bootstrap done machine # [ 36.194875] cni0: port 1(vethd82a5743) entered blocking state machine # [ 36.195728] cni0: port 1(vethd82a5743) entered disabled state machine # [ 36.196541] vethd82a5743: entered allmulticast mode machine # [ 36.197516] vethd82a5743: entered promiscuous mode machine # [ 36.199491] cni0: port 2(vethfb1eeb54) entered blocking state machine # [ 36.200198] cni0: port 2(vethfb1eeb54) entered disabled state machine # [ 36.201144] vethfb1eeb54: entered allmulticast mode machine # [ 36.202124] vethfb1eeb54: entered promiscuous mode machine # [ 36.047983] (udev-worker)[1477]: Network interface NamePolicy= disabled on kernel command line. machine # [ 36.051394] (udev-worker)[1478]: Network interface NamePolicy= disabled on kernel command line. machine # [ 36.212848] cni0: port 1(vethd82a5743) entered blocking state machine # [ 36.213549] cni0: port 1(vethd82a5743) entered forwarding state machine # [ 36.218462] cni0: port 2(vethfb1eeb54) entered blocking state machine # [ 36.219133] cni0: port 2(vethfb1eeb54) entered forwarding state machine # [ 36.080887] dhcpcd[683]: vethd82a5743: IAID 0a:f4:8a:c4 machine # [ 36.081928] dhcpcd[683]: vethd82a5743: adding address fe80::fcb0:aff:fef4:8ac4 machine # [ 36.094716] dhcpcd[683]: vethfb1eeb54: IAID 9b:68:d4:49 machine # [ 36.095547] dhcpcd[683]: vethfb1eeb54: adding address fe80::a091:9bff:fe68:d449 machine # [ 36.329491] cni0: port 2(vethfb1eeb54) entered disabled state machine # [ 36.175254] dhcpcd[683]: vethfb1eeb54: carrier lost machine # [ 36.331220] vethfb1eeb54 (unregistering): left allmulticast mode machine # [ 36.332200] vethfb1eeb54 (unregistering): left promiscuous mode machine # [ 36.333133] cni0: port 2(vethfb1eeb54) entered disabled state machine # [ 36.337261] cni0: port 1(vethd82a5743) entered disabled state machine # [ 36.338532] vethd82a5743 (unregistering): left allmulticast mode machine # [ 36.339228] vethd82a5743 (unregistering): left promiscuous mode machine # [ 36.340065] cni0: port 1(vethd82a5743) entered disabled state machine # [ 36.204229] dhcpcd[683]: vethfb1eeb54: deleting address fe80::a091:9bff:fe68:d449 machine # [ 36.205050] dhcpcd[683]: vethfb1eeb54: removing interface machine # [ 36.218625] dhcpcd[683]: vethd82a5743: removing interface machine # [ 36.230174] dhcpcd[683]: vethd82a5743: deleting address fe80::fcb0:aff:fef4:8ac4 machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 36.327708] k3s[885]: E1005 04:25:04.294828 885 remote_runtime.go:237] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to pull image \"rancher/mirrored-pause:3.10.2\": failed to pull and unpack image \"docker.io/rancher/mirrored-pause:3.10.2\": failed to resolve reference \"docker.io/rancher/mirrored-pause:3.10.2\": failed to do request: Head \"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\": dial tcp: lookup registry-1.docker.io: no such host" machine # [ 36.328599] k3s[885]: E1005 04:25:04.294945 885 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to pull image \"rancher/mirrored-pause:3.10.2\": failed to pull and unpack image \"docker.io/rancher/mirrored-pause:3.10.2\": failed to resolve reference \"docker.io/rancher/mirrored-pause:3.10.2\": failed to do request: Head \"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\": dial tcp: lookup registry-1.docker.io: no such host" pod="kube-system/helm-install-nix-grpc-farm-zxknb" machine # [ 36.329113] k3s[885]: E1005 04:25:04.294973 885 kuberuntime_manager.go:1640] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to pull image \"rancher/mirrored-pause:3.10.2\": failed to pull and unpack image \"docker.io/rancher/mirrored-pause:3.10.2\": failed to resolve reference \"docker.io/rancher/mirrored-pause:3.10.2\": failed to do request: Head \"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\": dial tcp: lookup registry-1.docker.io: no such host" pod="kube-system/helm-install-nix-grpc-farm-zxknb" machine # [ 36.329562] k3s[885]: E1005 04:25:04.295055 885 pod_workers.go:1338] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"helm-install-nix-grpc-farm-zxknb_kube-system(628fc940-aefe-47da-adf3-dbd049b5eb4c)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"helm-install-nix-grpc-farm-zxknb_kube-system(628fc940-aefe-47da-adf3-dbd049b5eb4c)\\\": rpc error: code = Unknown desc = failed to pull image \\\"rancher/mirrored-pause:3.10.2\\\": failed to pull and unpack image \\\"docker.io/rancher/mirrored-pause:3.10.2\\\": failed to resolve reference \\\"docker.io/rancher/mirrored-pause:3.10.2\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="kube-system/helm-install-nix-grpc-farm-zxknb" podUID="628fc940-aefe-47da-adf3-dbd049b5eb4c" machine # [ 36.367670] k3s[885]: E1005 04:25:04.334780 885 remote_runtime.go:237] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to pull image \"rancher/mirrored-pause:3.10.2\": failed to pull and unpack image \"docker.io/rancher/mirrored-pause:3.10.2\": failed to resolve reference \"docker.io/rancher/mirrored-pause:3.10.2\": failed to do request: Head \"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\": dial tcp: lookup registry-1.docker.io: no such host" machine # [ 36.374362] k3s[885]: E1005 04:25:04.334850 885 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to pull image \"rancher/mirrored-pause:3.10.2\": failed to pull and unpack image \"docker.io/rancher/mirrored-pause:3.10.2\": failed to resolve reference \"docker.io/rancher/mirrored-pause:3.10.2\": failed to do request: Head \"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\": dial tcp: lookup registry-1.docker.io: no such host" pod="kube-system/coredns-54996dc9b4-qfm95" machine # [ 36.375090] k3s[885]: E1005 04:25:04.334880 885 kuberuntime_manager.go:1640] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to pull image \"rancher/mirrored-pause:3.10.2\": failed to pull and unpack image \"docker.io/rancher/mirrored-pause:3.10.2\": failed to resolve reference \"docker.io/rancher/mirrored-pause:3.10.2\": failed to do request: Head \"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\": dial tcp: lookup registry-1.docker.io: no such host" pod="kube-system/coredns-54996dc9b4-qfm95" machine # [ 36.375495] k3s[885]: E1005 04:25:04.334976 885 pod_workers.go:1338] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-54996dc9b4-qfm95_kube-system(84e7f307-8758-4230-9b6d-b66429699007)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-54996dc9b4-qfm95_kube-system(84e7f307-8758-4230-9b6d-b66429699007)\\\": rpc error: code = Unknown desc = failed to pull image \\\"rancher/mirrored-pause:3.10.2\\\": failed to pull and unpack image \\\"docker.io/rancher/mirrored-pause:3.10.2\\\": failed to resolve reference \\\"docker.io/rancher/mirrored-pause:3.10.2\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="kube-system/coredns-54996dc9b4-qfm95" podUID="84e7f307-8758-4230-9b6d-b66429699007" machine # [ 36.881433] k3s[885]: time="2026-10-05T04:25:04Z" level=info msg="Starting network policy controller version v2.6.3-k3s1, built on 1970-01-01T01:01:01Z, go1.26.7" machine # [ 36.882288] k3s[885]: I1005 04:25:04.848284 885 network_policy_controller.go:164] Starting network policy controller machine # [ 37.139432] k3s[885]: I1005 04:25:05.106476 885 network_policy_controller.go:179] Starting network policy controller full sync goroutine machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 37.615745] k3s[885]: I1005 04:25:05.582586 885 node_lifecycle_controller.go:1217] "Initializing eviction metric for zone" zone="" machine # [ 37.616996] k3s[885]: I1005 04:25:05.582806 885 node_lifecycle_controller.go:869] "Missing timestamp for Node. Assuming now as a timestamp" node="machine" machine # [ 37.617951] k3s[885]: I1005 04:25:05.583065 885 node_lifecycle_controller.go:1063] "Controller detected that zone is now in new state" zone="" newState="Normal" machine # [ 37.878490] k3s[885]: time="2026-10-05T04:25:05Z" level=info msg="Imported docker.io/rancher/klipper-helm:v0.13.3-build20260727" machine # [ 37.883239] k3s[885]: time="2026-10-05T04:25:05Z" level=info msg="Tagged docker.io/rancher/klipper-helm@sha256:5425a2b4613d2458dbdff99218e8d487ebb59c20e7a941f061c0777070f0aac1" machine # [ 37.887415] k3s[885]: time="2026-10-05T04:25:05Z" level=info msg="Imported docker.io/rancher/klipper-lb:v0.4.17" machine # [ 37.890374] k3s[885]: time="2026-10-05T04:25:05Z" level=info msg="Tagged docker.io/rancher/klipper-lb@sha256:910944bb0bd94f060a82a56ca1ea1c577d3e49b3473a093a47a985f32e92d94a" machine # [ 37.893733] k3s[885]: time="2026-10-05T04:25:05Z" level=info msg="Imported docker.io/rancher/local-path-provisioner:v0.0.37" machine # [ 37.895349] k3s[885]: time="2026-10-05T04:25:05Z" level=info msg="Tagged docker.io/rancher/local-path-provisioner@sha256:e757967a5ec338f6a9b371c5a9688bedaa8c3578ea3dd4db329ea0084be0a86f" machine # [ 37.897771] k3s[885]: time="2026-10-05T04:25:05Z" level=info msg="Imported docker.io/rancher/mirrored-coredns-coredns:1.14.6" machine # [ 37.899369] k3s[885]: time="2026-10-05T04:25:05Z" level=info msg="Tagged docker.io/rancher/mirrored-coredns-coredns@sha256:900f9c109f7a33545d3c811516e8376df9019147b750f5ce3e254468769176ea" machine # [ 37.901727] k3s[885]: time="2026-10-05T04:25:05Z" level=info msg="Imported docker.io/rancher/mirrored-library-busybox:1.37.0" machine # [ 37.906831] k3s[885]: time="2026-10-05T04:25:05Z" level=info msg="Tagged docker.io/rancher/mirrored-library-busybox@sha256:101b4afd76732482eff9b95cae5f94bcf295e521fbec4e01b69c5421f3f3f3e5" machine # [ 37.909455] k3s[885]: time="2026-10-05T04:25:05Z" level=info msg="Imported docker.io/rancher/mirrored-library-traefik:3.7.8" machine # [ 37.910277] k3s[885]: time="2026-10-05T04:25:05Z" level=info msg="Tagged docker.io/rancher/mirrored-library-traefik@sha256:4299bbed850421258fc5448c2e0e6ad350981d4d335a68de11b92448aedbefe5" machine # [ 37.910874] k3s[885]: time="2026-10-05T04:25:05Z" level=info msg="Imported docker.io/rancher/mirrored-metrics-server:v0.9.0" machine # [ 37.917081] k3s[885]: time="2026-10-05T04:25:05Z" level=info msg="Tagged docker.io/rancher/mirrored-metrics-server@sha256:d9862115e7c7881280d3d75ca26bda8ffc0fc213315979575bf23ce9826205c0" machine # [ 37.917798] k3s[885]: time="2026-10-05T04:25:05Z" level=info msg="Imported docker.io/rancher/mirrored-pause:3.10.2" machine # [ 37.922105] k3s[885]: time="2026-10-05T04:25:05Z" level=info msg="Tagged docker.io/rancher/mirrored-pause@sha256:f548e0e8e3dc1896ca956272154dde3314e8cc4fde0a57577ee9fa1c63f5baf4" machine # [ 38.092775] dhcpcd[683]: flannel.1: soliciting an IPv6 router machine # [ 38.187647] k3s[885]: time="2026-10-05T04:25:06Z" level=info msg="Imported 8 images from /var/lib/rancher/k3s/agent/images/nixos/smddpgqzjvlqv3lx57wdzl7kma805fj0-k3s-airgap-images-amd64.tar.zst in 3.864564909s" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 41.016331] dhcpcd[683]: flannel.1: probing for an IPv4LL address machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 46.090791] dhcpcd[683]: flannel.1: using IPv4LL address 169.254.19.100 machine # [ 46.092433] dhcpcd[683]: flannel.1: adding route to 169.254.0.0/16 machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 48.890245] cni0: port 1(veth7e4f2fd1) entered blocking state machine # [ 48.892075] cni0: port 1(veth7e4f2fd1) entered disabled state machine # [ 48.893743] veth7e4f2fd1: entered allmulticast mode machine # [ 48.895461] veth7e4f2fd1: entered promiscuous mode machine # [ 48.911054] cni0: port 1(veth7e4f2fd1) entered blocking state machine # [ 48.912318] cni0: port 1(veth7e4f2fd1) entered forwarding state machine # [ 48.804170] (udev-worker)[2018]: Network interface NamePolicy= disabled on kernel command line. machine # [ 48.826584] dhcpcd[683]: veth7e4f2fd1: IAID 74:08:0f:da machine # [ 48.827522] dhcpcd[683]: veth7e4f2fd1: adding address fe80::7846:74ff:fe08:fda machine # [ 48.842462] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount410795616.mount: Deactivated successfully. machine # [ 48.911458] systemd[1]: Started libcontainer container 89081f6318724c996b513c833bac8bddbb0de1bd744b0939ef94d5b3c433a28e. machine # [ 49.357318] dhcpcd[683]: veth7e4f2fd1: soliciting a DHCP lease machine # [ 49.725300] systemd[1]: Started libcontainer container f23ffcc669386c7cd936884b3801bde02e22d8c1af78ddded0f46b90bed1727c. machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 50.128937] dhcpcd[683]: flannel.1: no IPv6 Routers available machine # [ 50.500932] dhcpcd[683]: veth7e4f2fd1: soliciting an IPv6 router machine # [ 50.870191] cni0: port 2(vetha6328ff1) entered blocking state machine # [ 50.871784] cni0: port 2(vetha6328ff1) entered disabled state machine # [ 50.873374] vetha6328ff1: entered allmulticast mode machine # [ 50.874978] vetha6328ff1: entered promiscuous mode machine # [ 50.723897] (udev-worker)[2027]: Network interface NamePolicy= disabled on kernel command line. machine # [ 50.890917] cni0: port 2(vetha6328ff1) entered blocking state machine # [ 50.892443] cni0: port 2(vetha6328ff1) entered forwarding state machine # [ 50.768790] dhcpcd[683]: vetha6328ff1: IAID 97:c1:9e:4b machine # [ 50.769726] dhcpcd[683]: vetha6328ff1: adding address fe80::9885:97ff:fec1:9e4b machine # [ 50.771171] k3s[885]: I1005 04:25:18.736387 885 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/coredns-54996dc9b4-qfm95" podStartSLOduration=22.736364672 podStartE2EDuration="22.736364672s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-05 04:24:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-05 04:25:17.761039875 +0000 UTC m=+33.508140278" watchObservedRunningTime="2026-10-05 04:25:18.736364672 +0000 UTC m=+34.483443563" machine # [ 50.837589] systemd[1]: Started libcontainer container 1525bca781029599fd5ff051c210b110263601dd5b4b1002ea1702ea0be36427. machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 51.012922] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount2136135387.mount: Deactivated successfully. machine # [ 51.713528] systemd[1]: Started libcontainer container a1310785e7fb22e55b3da2143f6b34a392967980dc11c448d554a7082d2ab825. machine # [ 51.810394] k3s[885]: I1005 04:25:19.776737 885 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/helm-install-nix-grpc-farm-zxknb" podStartSLOduration=23.776715052 podStartE2EDuration="23.776715052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-05 04:24:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-05 04:25:19.776576207 +0000 UTC m=+35.523655378" watchObservedRunningTime="2026-10-05 04:25:19.776715052 +0000 UTC m=+35.523793664" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 52.156878] dhcpcd[683]: vetha6328ff1: soliciting a DHCP lease machine # [ 53.008425] k3s[885]: I1005 04:25:20.974883 885 alloc.go:329] "allocated clusterIPs" service="farm/nix-grpc-farm" clusterIPs={"IPv4":"10.43.207.59"} machine # [ 53.033975] dhcpcd[683]: vetha6328ff1: soliciting an IPv6 router machine # [ 53.048337] systemd[1]: cri-containerd-a1310785e7fb22e55b3da2143f6b34a392967980dc11c448d554a7082d2ab825.scope: Deactivated successfully. machine # [ 53.052068] systemd[1]: cri-containerd-a1310785e7fb22e55b3da2143f6b34a392967980dc11c448d554a7082d2ab825.scope: Consumed 753ms CPU time over 1.336s wall clock time, 34M memory peak, 2.6M incoming IP traffic, 144.4K outgoing IP traffic. machine # [ 53.095736] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-a1310785e7fb22e55b3da2143f6b34a392967980dc11c448d554a7082d2ab825-rootfs.mount: Deactivated successfully. machine # [ 53.124987] k3s[885]: E1005 04:25:21.092121 885 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-scheduler-586f48856c\" failed with read version: 478 is not as new as written version: 479 for group resource replicasets.apps" logger="UnhandledError" machine # [ 53.167189] systemd[1]: Created slice libcontainer container kubepods-besteffort-podf128ea48_1f2a_4675_bbb6_2229e84373ea.slice. machine # [ 53.196683] k3s[885]: I1005 04:25:21.157640 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/f128ea48-1f2a-4675-bbb6-2229e84373ea-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-6tc7m\" (UID: \"f128ea48-1f2a-4675-bbb6-2229e84373ea\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-6tc7m" machine # [ 53.239149] k3s[885]: I1005 04:25:21.157716 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/f128ea48-1f2a-4675-bbb6-2229e84373ea-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-6tc7m\" (UID: \"f128ea48-1f2a-4675-bbb6-2229e84373ea\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-6tc7m" machine # [ 53.247214] k3s[885]: I1005 04:25:21.157773 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f128ea48-1f2a-4675-bbb6-2229e84373ea-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-6tc7m\" (UID: \"f128ea48-1f2a-4675-bbb6-2229e84373ea\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-6tc7m" machine # [ 53.252417] k3s[885]: I1005 04:25:21.157809 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxtmk\" (UniqueName: \"kubernetes.io/projected/f128ea48-1f2a-4675-bbb6-2229e84373ea-kube-api-access-lxtmk\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-6tc7m\" (UID: \"f128ea48-1f2a-4675-bbb6-2229e84373ea\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-6tc7m" machine # [ 53.257319] k3s[885]: I1005 04:25:21.157869 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/2fcdad72-3ef6-4811-8c17-853679f11bf6-tls-lb\") pod \"nix-grpc-farm-lb-5845f9d694-whq5r\" (UID: \"2fcdad72-3ef6-4811-8c17-853679f11bf6\") " pod="farm/nix-grpc-farm-lb-5845f9d694-whq5r" machine # [ 53.261653] k3s[885]: I1005 04:25:21.157895 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/f128ea48-1f2a-4675-bbb6-2229e84373ea-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-6tc7m\" (UID: \"f128ea48-1f2a-4675-bbb6-2229e84373ea\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-6tc7m" machine # [ 53.266429] k3s[885]: I1005 04:25:21.157919 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fcdad72-3ef6-4811-8c17-853679f11bf6-tmp\") pod \"nix-grpc-farm-lb-5845f9d694-whq5r\" (UID: \"2fcdad72-3ef6-4811-8c17-853679f11bf6\") " pod="farm/nix-grpc-farm-lb-5845f9d694-whq5r" machine # [ 53.270637] k3s[885]: I1005 04:25:21.157978 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/2fcdad72-3ef6-4811-8c17-853679f11bf6-tls-ca\") pod \"nix-grpc-farm-lb-5845f9d694-whq5r\" (UID: \"2fcdad72-3ef6-4811-8c17-853679f11bf6\") " pod="farm/nix-grpc-farm-lb-5845f9d694-whq5r" machine # [ 53.274768] k3s[885]: I1005 04:25:21.158004 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/f128ea48-1f2a-4675-bbb6-2229e84373ea-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-6tc7m\" (UID: \"f128ea48-1f2a-4675-bbb6-2229e84373ea\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-6tc7m" machine # [ 53.279431] k3s[885]: I1005 04:25:21.158057 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/f128ea48-1f2a-4675-bbb6-2229e84373ea-build\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-6tc7m\" (UID: \"f128ea48-1f2a-4675-bbb6-2229e84373ea\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-6tc7m" machine # [ 53.284053] k3s[885]: I1005 04:25:21.158086 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/f128ea48-1f2a-4675-bbb6-2229e84373ea-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-6tc7m\" (UID: \"f128ea48-1f2a-4675-bbb6-2229e84373ea\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-6tc7m" machine # [ 53.288567] k3s[885]: I1005 04:25:21.158139 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2fcdad72-3ef6-4811-8c17-853679f11bf6-config\") pod \"nix-grpc-farm-lb-5845f9d694-whq5r\" (UID: \"2fcdad72-3ef6-4811-8c17-853679f11bf6\") " pod="farm/nix-grpc-farm-lb-5845f9d694-whq5r" machine # [ 53.293026] k3s[885]: I1005 04:25:21.158164 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/f128ea48-1f2a-4675-bbb6-2229e84373ea-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-6tc7m\" (UID: \"f128ea48-1f2a-4675-bbb6-2229e84373ea\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-6tc7m" machine # [ 53.297932] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod2fcdad72_3ef6_4811_8c17_853679f11bf6.slice. machine # [ 53.402953] systemd[1]: Created slice libcontainer container kubepods-besteffort-podd0dc285d_a9d0_4f0d_a7b8_dd944d8c6b43.slice. machine # [ 53.421721] systemd[1]: Created slice libcontainer container kubepods-besteffort-poda46821ec_20ee_4f2a_9038_d75f246c3f31.slice. machine # [ 53.605098] cni0: port 3(veth14d45eeb) entered blocking state machine # [ 53.605865] cni0: port 3(veth14d45eeb) entered disabled state machine # [ 53.606701] veth14d45eeb: entered allmulticast mode machine # [ 53.607505] veth14d45eeb: entered promiscuous mode machine # [ 53.617006] cni0: port 3(veth14d45eeb) entered blocking state machine # [ 53.617816] cni0: port 3(veth14d45eeb) entered forwarding state machine # [ 53.638679] cni0: port 4(vethfc2fd0b9) entered blocking state machine # [ 53.639645] cni0: port 4(vethfc2fd0b9) entered disabled state machine # [ 53.640625] vethfc2fd0b9: entered allmulticast mode machine # [ 53.641492] vethfc2fd0b9: entered promiscuous mode machine # [ 53.492854] k3s[885]: I1005 04:25:21.459947 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/a46821ec-20ee-4f2a-9038-d75f246c3f31-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-czxdq\" (UID: \"a46821ec-20ee-4f2a-9038-d75f246c3f31\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-czxdq" machine # [ 53.497762] k3s[885]: I1005 04:25:21.460254 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/d0dc285d-a9d0-4f0d-a7b8-dd944d8c6b43-tls\") pod \"nix-grpc-farm-scheduler-586f48856c-qb2lm\" (UID: \"d0dc285d-a9d0-4f0d-a7b8-dd944d8c6b43\") " pod="farm/nix-grpc-farm-scheduler-586f48856c-qb2lm" machine # [ 53.498514] k3s[885]: I1005 04:25:21.460300 885 rec[ 53.656665] cni0: port 4(vethfc2fd0b9) entered blocking state machine # onciler_common.go:251] "operationExecutor.Verify[ 53.658127] cni0: port 4(vethfc2fd0b9) entered forwarding state machine # ControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/a46821ec-20ee-4f2a-9038-d75f246c3f31-build\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-czxdq\" (UID: \"a46821ec-20ee-4f2a-9038-d75f246c3f31\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-czxdq" machine # [ 53.499163] k3s[885]: I1005 04:25:21.460356 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/a46821ec-20ee-4f2a-9038-d75f246c3f31-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-czxdq\" (UID: \"a46821ec-20ee-4f2a-9038-d75f246c3f31\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-czxdq" machine # [ 53.499363] k3s[885]: I1005 04:25:21.460460 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-566v7\" (UniqueName: \"kubernetes.io/projected/d0dc285d-a9d0-4f0d-a7b8-dd944d8c6b43-kube-api-access-566v7\") pod \"nix-grpc-farm-scheduler-586f48856c-qb2lm\" (UID: \"d0dc285d-a9d0-4f0d-a7b8-dd944d8c6b43\") " pod="farm/nix-grpc-farm-scheduler-586f48856c-qb2lm" machine # [ 53.499885] k3s[885]: I1005 04:25:21.460826 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d0dc285d-a9d0-4f0d-a7b8-dd944d8c6b43-ca\") pod \"nix-grpc-farm-scheduler-586f48856c-qb2lm\" (UID: \"d0dc285d-a9d0-4f0d-a7b8-dd944d8c6b43\") " pod="farm/nix-grpc-farm-scheduler-586f48856c-qb2lm" machine # [ 53.500725] k3s[885]: I1005 04:25:21.461167 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/d0dc285d-a9d0-4f0d-a7b8-dd944d8c6b43-oidc\") pod \"nix-grpc-farm-scheduler-586f48856c-qb2lm\" (UID: \"d0dc285d-a9d0-4f0d-a7b8-dd944d8c6b43\") " pod="farm/nix-grpc-farm-scheduler-586f48856c-qb2lm" machine # [ 53.501445] k3s[885]: I1005 04:25:21.461332 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/d0dc285d-a9d0-4f0d-a7b8-dd944d8c6b43-niks3-token\") pod \"nix-grpc-farm-scheduler-586f48856c-qb2lm\" (UID: \"d0dc285d-a9d0-4f0d-a7b8-dd944d8c6b43\") " pod="farm/nix-grpc-farm-scheduler-586f48856c-qb2lm" machine # [ 53.502050] k3s[885]: I1005 04:25:21.461388 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/a46821ec-20ee-4f2a-9038-d75f246c3f31-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-czxdq\" (UID: \"a46821ec-20ee-4f2a-9038-d75f246c3f31\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-czxdq" machine # [ 53.505528] k3s[885]: I1005 04:25:21.461415 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a46821ec-20ee-4f2a-9038-d75f246c3f31-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-czxdq\" (UID: \"a46821ec-20ee-4f2a-9038-d75f246c3f31\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-czxdq" machine # [ 53.506497] k3s[885]: I1005 04:25:21.461521 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/a46821ec-20ee-4f2a-9038-d75f246c3f31-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-czxdq\" (UID: \"a46821ec-20ee-4f2a-9038-d75f246c3f31\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-czxdq" machine # [ 53.508096] k3s[885]: I1005 04:25:21.461602 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/a46821ec-20ee-4f2a-9038-d75f246c3f31-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-czxdq\" (UID: \"a46821ec-20ee-4f2a-9038-d75f246c3f31\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-czxdq" machine # [ 53.508835] k3s[885]: I1005 04:25:21.461697 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/a46821ec-20ee-4f2a-9038-d75f246c3f31-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-czxdq\" (UID: \"a46821ec-20ee-4f2a-9038-d75f246c3f31\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-czxdq" machine # [ 53.509649] k3s[885]: I1005 04:25:21.461818 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62c2q\" (UniqueName: \"kubernetes.io/projected/a46821ec-20ee-4f2a-9038-d75f246c3f31-kube-api-access-62c2q\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-czxdq\" (UID: \"a46821ec-20ee-4f2a-9038-d75f246c3f31\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-czxdq" machine # [ 53.558877] (udev-worker)[2568]: Network interface NamePolicy= disabled on kernel command line. machine # [ 53.559816] (udev-worker)[2565]: Network interface NamePolicy= disabled on kernel command line. machine # [ 53.590037] dhcpcd[683]: veth14d45eeb: IAID bd:ad:bb:47 machine # [ 53.590805] dhcpcd[683]: veth14d45eeb: adding address fe80::e4de:bdff:fead:bb47 machine # [ 53.600334] systemd[1]: Started libcontainer container b40bf816e600f0621e6e08069dcd721b776d4bf788bd2bdb6307a77cf0182333. machine # [ 53.608253] dhcpcd[683]: vethfc2fd0b9: IAID 68:ac:46:5c machine # [ 53.609253] dhcpcd[683]: vethfc2fd0b9: adding address fe80::acff:68ff:feac:465c machine # [ 53.679900] systemd[1]: Started libcontainer container b6cdb99451f229d8ebdfc7f72aa2fbe5d119e494929ab0674f0456227a51adbc. machine # [ 53.972806] cni0: port 5(veth729b830f) entered blocking state machine # [ 53.973878] cni0: port 5(veth729b830f) entered disabled state machine # [ 53.975242] veth729b830f: entered allmulticast mode machine # [ 53.976387] veth729b830f: entered promiscuous mode machine # [ 53.987351] cni0: port 5(veth729b830f) entered blocking state machine # [ 53.988658] cni0: port 5(veth729b830f) entered forwarding state machine # [ 54.005302] cni0: port 6(veth89be5a36) entered blocking state machine # [ 54.006483] cni0: port 6(veth89be5a36) entered disabled state machine # [ 53.853273] dhcpcd[683]: veth729b830f: IAID 85:d6:af:57[ 54.008017] veth89be5a36: entered allmulticast mode machine # machine # [ 54.009118] veth89be5a36: entered promiscuous mode machine # [ 53.855137] dhcpcd[683]: veth729b830f: adding address fe80::c4fe:85ff:fed6:af57 machine # [ 54.018096] cni0: port 6(veth89be5a36) entered blocking state machine # [ 54.019362] cni0: port 6(veth89be5a36) entered forwarding state machine # [ 53.881620] dhcpcd[683]: veth89be5a36: IAID ba:e5:0a:20 machine # [ 53.882563] dhcpcd[683]: veth89be5a36: adding address fe80::140b:baff:fee5:a20 machine # [ 54.008378] systemd[1]: Started libcontainer container dd00f7c24656a9a3d4ddd1764697d94f691354081208d0cbb761fddf0c2db1dc. machine # [ 54.038189] systemd[1]: Started libcontainer container 46295fabfcea867e9633b7f831c3f4d2b1ccccdbe3b76cec8854dc807b80dd5e. machine # [ 54.124780] dhcpcd[683]: vethfc2fd0b9: soliciting a DHCP lease machine # [ 54.189127] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount530588907.mount: Deactivated successfully. machine # [ 54.358522] dhcpcd[683]: veth7e4f2fd1: probing for an IPv4LL address machine # [ 54.577028] systemd[1]: Started libcontainer container 7193e2f03bddfb09f20881fda4d2f98ce64600512312288b9c8f6d7669a3474c. machine # [ 54.663108] dhcpcd[683]: veth729b830f: soliciting a DHCP lease machine # [ 54.669355] dhcpcd[683]: veth14d45eeb: soliciting a DHCP lease machine # [ 54.807146] systemd[1]: cri-containerd-1525bca781029599fd5ff051c210b110263601dd5b4b1002ea1702ea0be36427.scope: Deactivated successfully. machine # [ 54.812810] k3s[885]: I1005 04:25:22.779715 885 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-5845f9d694-whq5r" podStartSLOduration=1.779695039 podStartE2EDuration="1.779695039s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-05 04:25:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-05 04:25:22.772850314 +0000 UTC m=+38.519928926" watchObservedRunningTime="2026-10-05 04:25:22.779695039 +0000 UTC m=+38.526773651" machine # [ 55.035641] dhcpcd[683]: veth89be5a36: soliciting a DHCP lease machine # [ 55.096517] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-1525bca781029599fd5ff051c210b110263601dd5b4b1002ea1702ea0be36427-rootfs.mount: Deactivated successfully. machine # [ 55.225031] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-1525bca781029599fd5ff051c210b110263601dd5b4b1002ea1702ea0be36427-shm.mount: Deactivated successfully. machine # [ 55.235665] dhcpcd[683]: veth14d45eeb: soliciting an IPv6 router machine # [ 55.258763] d[ 55.412749] cni0: port 2(vetha6328ff1) entered disabled state machine # hcpcd[683]: vetha6328ff1: carrier lost machine # [ 55.414785] vetha6328ff1 (unregistering): left allmulticast mode machine # [ 55.415848] vetha6328ff1 (unregistering): left promiscuous mode machine # [ 55.416790] cni0: port 2(vetha6328ff1) entered disabled state machine # [ 55.287126] systemd[1]: run-netns-cni\x2d20028279\x2d4431\x2d8c39\x2d754f\x2d64f262139b65.mount: Deactivated successfully. machine # [ 55.295501] dhcpcd[683]: vetha6328ff1: deleting address fe80::9885:97ff:fec1:9e4b machine # [ 55.333320] dhcpcd[683]: vetha6328ff1: removing interface machine # [ 55.412145] k3s[885]: I1005 04:25:23.379267 885 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/628fc940-aefe-47da-adf3-dbd049b5eb4c-kube-api-access-stvnt\" (UniqueName: \"kubernetes.io/projected/628fc940-aefe-47da-adf3-dbd049b5eb4c-kube-api-access-stvnt\") pod \"628fc940-aefe-47da-adf3-dbd049b5eb4c\" (UID: \"628fc940-aefe-47da-adf3-dbd049b5eb4c\") " machine # [ 55.412967] k3s[885]: I1005 04:25:23.379317 885 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/628fc940-aefe-47da-adf3-dbd049b5eb4c-values\" (UniqueName: \"kubernetes.io/projected/628fc940-aefe-47da-adf3-dbd049b5eb4c-values\") pod \"628fc940-aefe-47da-adf3-dbd049b5eb4c\" (UID: \"628fc940-aefe-47da-adf3-dbd049b5eb4c\") " machine # [ 55.413680] k3s[885]: I1005 04:25:23.379351 885 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/628fc940-aefe-47da-adf3-dbd049b5eb4c-klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/628fc940-aefe-47da-adf3-dbd049b5eb4c-klipper-config\") pod \"628fc940-aefe-47da-adf3-dbd049b5eb4c\" (UID: \"628fc940-aefe-47da-adf3-dbd049b5eb4c\") " machine # [ 55.414278] k3s[885]: I1005 04:25:23.379382 885 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/628fc940-aefe-47da-adf3-dbd049b5eb4c-tmp\" (UniqueName: \"kubernetes.io/empty-dir/628fc940-aefe-47da-adf3-dbd049b5eb4c-tmp\") pod \"628fc940-aefe-47da-adf3-dbd049b5eb4c\" (UID: \"628fc940-aefe-47da-adf3-dbd049b5eb4c\") " machine # [ 55.415059] k3s[885]: I1005 04:25:23.381888 885 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/628fc940-aefe-47da-adf3-dbd049b5eb4c-content\" (UniqueName: \"kubernetes.io/configmap/628fc940-aefe-47da-adf3-dbd049b5eb4c-content\") pod \"628fc940-aefe-47da-adf3-dbd049b5eb4c\" (UID: \"628fc940-aefe-47da-adf3-dbd049b5eb4c\") " machine # [ 55.415681] k3s[885]: I1005 04:25:23.381936 885 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/628fc940-aefe-47da-adf3-dbd049b5eb4c-klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/628fc940-aefe-47da-adf3-dbd049b5eb4c-klipper-helm\") pod \"628fc940-aefe-47da-adf3-dbd049b5eb4c\" (UID: \"628fc940-aefe-47da-adf3-dbd049b5eb4c\") " machine # [ 55.416257] k3s[885]: I1005 04:25:23.381968 885 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/628fc940-aefe-47da-adf3-dbd049b5eb4c-klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/628fc940-aefe-47da-adf3-dbd049b5eb4c-klipper-cache\") pod \"628fc940-aefe-47da-adf3-dbd049b5eb4c\" (UID: \"628fc940-aefe-47da-adf3-dbd049b5eb4c\") " machine # [ 55.434638] dhcpcd[683]: vethfc2fd0b9: soliciting an IPv6 router machine # [ 55.447584] k3s[885]: I1005 04:25:23.414553 885 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/628fc940-aefe-47da-adf3-dbd049b5eb4c-values" pod "628fc940-aefe-47da-adf3-dbd049b5eb4c" (UID: "628fc940-aefe-47da-adf3-dbd049b5eb4c"). InnerVolumeSpecName "values". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 55.448755] k3s[885]: I1005 04:25:23.414612 885 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/628fc940-aefe-47da-adf3-dbd049b5eb4c-tmp" pod "628fc940-aefe-47da-adf3-dbd049b5eb4c" (UID: "628fc940-aefe-47da-adf3-dbd049b5eb4c"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 55.449412] k3s[885]: I1005 04:25:23.415787 885 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/628fc940-aefe-47da-adf3-dbd049b5eb4c-kube-api-access-stvnt" pod "628fc940-aefe-47da-adf3-dbd049b5eb4c" (UID: "628fc940-aefe-47da-adf3-dbd049b5eb4c"). InnerVolumeSpecName "kube-api-access-stvnt". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 55.450024] systemd[1]: var-lib-kubelet-pods-628fc940\x2daefe\x2d47da\x2dadf3\x2ddbd049b5eb4c-volumes-kubernetes.io\x7eprojected-values.mount: Deactivated successfully. machine # [ 55.450525] k3s[885]: I1005 04:25:23.416953 885 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/628fc940-aefe-47da-adf3-dbd049b5eb4c-klipper-helm" pod "628fc940-aefe-47da-adf3-dbd049b5eb4c" (UID: "628fc940-aefe-47da-adf3-dbd049b5eb4c"). InnerVolumeSpecName "klipper-helm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 55.451220] systemd[1]: var-lib-kubelet-pods-628fc940\x2daefe\x2d47da\x2dadf3\x2ddbd049b5eb4c-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dstvnt.mount: Deactivated successfully. machine # [ 55.451935] dhcpcd[683]: veth729b830f: soliciting an IPv6 router machine # [ 55.452588] systemd[1]: var-lib-kubelet-pods-628fc940\x2daefe\x2d47da\x2dadf3\x2ddbd049b5eb4c-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 55.453423] systemd[1]: var-lib-kubelet-pods-628fc940\x2daefe\x2d47da\x2dadf3\x2ddbd049b5eb4c-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dhelm.mount: Deactivated successfully. machine # [ 55.454142] systemd[1]: var-lib-kubelet-pods-628fc940\x2daefe\x2d47da\x2dadf3\x2ddbd049b5eb4c-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dconfig.mount: Deactivated successfully. machine # [ 55.474077] k3s[885]: I1005 04:25:23.414835 885 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/628fc940-aefe-47da-adf3-dbd049b5eb4c-content" pod "628fc940-aefe-47da-adf3-dbd049b5eb4c" (UID: "628fc940-aefe-47da-adf3-dbd049b5eb4c"). InnerVolumeSpecName "content". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 55.478318] k3s[885]: I1005 04:25:23.445477 885 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/628fc940-aefe-47da-adf3-dbd049b5eb4c-klipper-config" pod "628fc940-aefe-47da-adf3-dbd049b5eb4c" (UID: "628fc940-aefe-47da-adf3-dbd049b5eb4c"). InnerVolumeSpecName "klipper-config". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 55.478899] k3s[885]: I1005 04:25:23.445897 885 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/628fc940-aefe-47da-adf3-dbd049b5eb4c-klipper-cache" pod "628fc940-aefe-47da-adf3-dbd049b5eb4c" (UID: "628fc940-aefe-47da-adf3-dbd049b5eb4c"). InnerVolumeSpecName "klipper-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 55.515280] k3s[885]: I1005 04:25:23.482417 885 reconciler_common.go:299] "Volume detached for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/628fc940-aefe-47da-adf3-dbd049b5eb4c-klipper-helm\") on node \"machine\" DevicePath \"\"" machine # [ 55.516042] k3s[885]: I1005 04:25:23.482446 885 reconciler_common.go:299] "Volume detached for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/628fc940-aefe-47da-adf3-dbd049b5eb4c-klipper-cache\") on node \"machine\" DevicePath \"\"" machine # [ 55.516531] k3s[885]: I1005 04:25:23.482462 885 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stvnt\" (UniqueName: \"kubernetes.io/projected/628fc940-aefe-47da-adf3-dbd049b5eb4c-kube-api-access-stvnt\") on node \"machine\" DevicePath \"\"" machine # [ 55.517112] k3s[885]: I1005 04:25:23.482476 885 reconciler_common.go:299] "Volume detached for volume \"values\" (UniqueName: \"kubernetes.io/projected/628fc940-aefe-47da-adf3-dbd049b5eb4c-values\") on node \"machine\" DevicePath \"\"" machine # [ 55.517840] k3s[885]: I1005 04:25:23.482491 885 reconciler_common.go:299] "Volume detached for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/628fc940-aefe-47da-adf3-dbd049b5eb4c-klipper-config\") on node \"machine\" DevicePath \"\"" machine # [ 55.518574] k3s[885]: I1005 04:25:23.482504 885 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/628fc940-aefe-47da-adf3-dbd049b5eb4c-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 55.519132] k3s[885]: I1005 04:25:23.482516 885 reconciler_common.go:299] "Volume detached for volume \"content\" (UniqueName: \"kubernetes.io/configmap/628fc940-aefe-47da-adf3-dbd049b5eb4c-content\") on node \"machine\" DevicePath \"\"" machine # [ 55.795100] k3s[885]: I1005 04:25:23.761119 885 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1525bca781029599fd5ff051c210b110263601dd5b4b1002ea1702ea0be36427" machine # [ 55.805795] systemd[1]: Removed slice libcontainer container kubepods-burstable-pod628fc940_aefe_47da_adf3_dbd049b5eb4c.slice. machine # [ 55.809560] systemd[1]: kubepods-burstable-pod628fc940_aefe_47da_adf3_dbd049b5eb4c.slice: Consumed 781ms CPU time over 20.220s wall clock time, 34.2M memory peak, 2.6M incoming IP traffic, 144.4K outgoing IP traffic. machine # [ 56.098300] systemd[1]: var-lib-kubelet-pods-628fc940\x2daefe\x2d47da\x2dadf3\x2ddbd049b5eb4c-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dcache.mount: Deactivated successfully. machine # [ 56.269592] dhcpcd[683]: veth89be5a36: soliciting an IPv6 router machine # [ 58.956482] dhcpcd[683]: veth7e4f2fd1: using IPv4LL address 169.254.251.76 machine # [ 58.959533] dhcpcd[683]: veth7e4f2fd1: adding route to 169.254.0.0/16 machine # [ 59.125230] dhcpcd[683]: vethfc2fd0b9: probing for an IPv4LL address machine # [ 59.663692] dhcpcd[683]: veth729b830f: probing for an IPv4LL address machine # [ 59.669712] dhcpcd[683]: veth14d45eeb: probing for an IPv4LL address machine # [ 60.039919] dhcpcd[683]: veth89be5a36: probing for an IPv4LL address machine # [ 61.069509] systemd[1]: tmp-ovl\x2didmapped2064198619.mount: Deactivated successfully. machine # [ 61.083391] systemd[1]: Started libcontainer container 880f56d8a93c9a3637bb75ad494172ae79c6ee38f99a227ff808527bd72a8414. machine # [ 61.218306] systemd[1]: Started libcontainer container 2f82471db6eebf6dd85d113787dbcabcb000dd30f05c8d9c650dcef6806686e4. machine # [ 61.272541] systemd[1]: Started libcontainer container 803fc3fcc8e607077bc277b2f3779866dfc655e1ed40c20dcf2b40c491746316. machine # [ 61.407447] k3s[885]: I1005 04:25:29.374033 885 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-scheduler-586f48856c-qb2lm" podStartSLOduration=8.374011076 podStartE2EDuration="8.374011076s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-05 04:25:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-05 04:25:29.262508915 +0000 UTC m=+45.009587527" watchObservedRunningTime="2026-10-05 04:25:29.374011076 +0000 UTC m=+45.121089688" machine # [ 61.538116] niks3-server[1184]: 2026/10/05 04:25:29 INFO lead: acquired remote=10.42.0.8:36304 machine # [ 62.062655] systemd[1]: tmp-ovl\x2didmapped1142692795.mount: Deactivated successfully. machine # [ 62.504572] dhcpcd[683]: veth7e4f2fd1: no IPv6 Routers available machine # [ 63.086146] systemd[1]: cri-containerd-803fc3fcc8e607077bc277b2f3779866dfc655e1ed40c20dcf2b40c491746316.scope: Deactivated successfully. machine # [ 63.087039] systemd[1]: cri-containerd-803fc3fcc8e607077bc277b2f3779866dfc655e1ed40c20dcf2b40c491746316.scope: Consumed 731ms CPU time over 1.812s wall clock time, 409.2M memory peak, 96.9M read from disk, 240.4M written to disk. machine # [ 63.097367] systemd[1]: cri-containerd-880f56d8a93c9a3637bb75ad494172ae79c6ee38f99a227ff808527bd72a8414.scope: Deactivated successfully. machine # [ 63.101733] systemd[1]: cri-containerd-880f56d8a93c9a3637bb75ad494172ae79c6ee38f99a227ff808527bd72a8414.scope: Consumed 758ms CPU time over 2.014s wall clock time, 367.6M memory peak, 119.9M read from disk, 236.4M written to disk. machine # [ 63.134320] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-803fc3fcc8e607077bc277b2f3779866dfc655e1ed40c20dcf2b40c491746316-rootfs.mount: Deactivated successfully. machine # [ 63.144853] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-880f56d8a93c9a3637bb75ad494172ae79c6ee38f99a227ff808527bd72a8414-rootfs.mount: Deactivated successfully. machine # error: timed out waiting for the condition machine # [ 63.967173] dhcpcd[683]: vethfc2fd0b9: using IPv4LL address 169.254.36.109 machine # [ 63.968640] dhcpcd[683]: vethfc2fd0b9: adding route to 169.254.0.0/16 machine # [ 64.000315] systemd[1]: Started libcontainer container 83ae543a5fd8a13133aea2d3daec361fff12dd112620166658f2b7168917e6c0. machine # [ 64.003222] systemd[1]: Started libcontainer container a095e16029c5e8ba18c2f6d3dcff5e97638016bf48b079060a374ab759a134ed. machine # [ 64.139471] systemd[1]: tmp-ovl\x2didmapped1759792389.mount: Deactivated successfully. machine # [ 64.374443] systemd[1]: Started libcontainer container b897c98df790f5521f013a98c7f5acc6b4088e0e26594c88c0da632dfb8c7002. machine # [ 64.377773] systemd[1]: Started libcontainer container dd268776d07512a902fa48614e0c61fc8446d60bb2eb7b4fead65bf90c914cf4. machine # [ 64.448581] dhcpcd[683]: veth14d45eeb: using IPv4LL address 169.254.34.181 machine # [ 64.450179] dhcpcd[683]: veth14d45eeb: adding route to 169.254.0.0/16 machine # [ 64.595319] systemd[1]: Started libcontainer container c9180fa64201e4e83f5afdc54a08692b60bf59abfff0a57a5614e0b5fda26711. machine # [ 64.611255] systemd[1]: Started libcontainer container e7c50a20ea9de6107008552b7b075946e317ab759c0b6e0e8e376751973ebfc6. machine # [ 64.690224] k3s[885]: I1005 04:25:32.656989 885 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-6tc7m" podStartSLOduration=9.675596612 podStartE2EDuration="11.656967987s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.981371375s" isStatefulPod=false podCreationTimestamp="2026-10-05 04:25:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-05 04:25:32.640980481 +0000 UTC m=+48.388059093" watchObservedRunningTime="2026-10-05 04:25:32.656967987 +0000 UTC m=+48.404046599" machine # [ 64.838539] dhcpcd[683]: veth729b830f: using IPv4LL address 169.254.53.221 machine # [ 64.839617] dhcpcd[683]: veth729b830f: adding route to 169.254.0.0/16 machine # [ 65.097933] dhcpcd[683]: veth89be5a36: using IPv4LL address 169.254.146.134 machine # [ 65.099622] dhcpcd[683]: veth89be5a36: adding route to 169.254.0.0/16 machine # [ 65.148765] systemd[1]: tmp-ovl\x2didmapped3157034736.mount: Deactivated successfully. machine # [ 66.814770] k3s[885]: I1005 04:25:34.779941 885 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-czxdq" podStartSLOduration=12.062967632 podStartE2EDuration="13.779899812s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.71693218s" isStatefulPod=false podCreationTimestamp="2026-10-05 04:25:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-05 04:25:32.657350159 +0000 UTC m=+48.404428771" watchObservedRunningTime="2026-10-05 04:25:34.779899812 +0000 UTC m=+50.526982894" machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 40.19 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s, in 0.20 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s machine # [ 67.238707] dhcpcd[683]: veth14d45eeb: no IPv6 Routers available machine # [ 67.438163] dhcpcd[683]: vethfc2fd0b9: no IPv6 Routers available machine # [ 67.453274] dhcpcd[683]: veth729b830f: no IPv6 Routers available machine # [ 68.270898] dhcpcd[683]: veth89be5a36: no IPv6 Routers available machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s, in 1.83 seconds) machine: waiting for unit niks3.service machine: (finished: waiting for unit niks3.service, in 0.03 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.53 seconds) machine: waiting for success: test $(curl -sf 10.42.0.6:9901/clusters | grep -c 'health_flags::healthy') -ge 3 machine: (finished: waiting for success: test $(curl -sf 10.42.0.6:9901/clusters | grep -c 'health_flags::healthy') -ge 3, in 0.09 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.21 seconds) machine: waiting for success: curl -sf http://10.42.0.8:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2' machine: (finished: waiting for success: curl -sf http://10.42.0.8:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2', in 0.03 seconds) (finished: subtest: chart deploys and workers become Ready, in 43.11 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}', in 0.14 seconds) machine: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt machine: (finished: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt, in 0.12 seconds) subtest: build through the balancer lands in the cache machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1 machine # [ 107.147567] niks3-server[1184]: 2026/10/05 04:26:15 INFO Received push request method=POST path=/api/pushes machine # [ 107.176883] niks3-server[1184]: 2026/10/05 04:26:15 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign machine # [ 107.185254] niks3-server[1184]: 2026/10/05 04:26:15 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.ls machine # [ 107.186550] niks3-server[1184]: 2026/10/05 04:26:15 INFO Registered completed upload object_key=nar/0nzzbas7l8d37mridr7mg162smfjvn7lhs6am4crl4ydaxicigj8.nar.zst machine # [ 107.196230] niks3-server[1184]: 2026/10/05 04:26:15 INFO Signed narinfos id=1 count=1 machine # [ 107.204736] niks3-server[1184]: 2026/10/05 04:26:15 INFO Received complete push request method=POST path=/api/pushes/1/complete machine # [ 107.208380] niks3-server[1184]: 2026/10/05 04:26:15 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.narinfo machine # [ 132.312826] niks3-server[1184]: 2026/10/05 04:26:40 INFO Received push request method=POST path=/api/pushes machine # [ 132.330300] niks3-server[1184]: 2026/10/05 04:26:40 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign machine # [ 132.335401] niks3-server[1184]: 2026/10/05 04:26:40 INFO Signed narinfos id=2 count=1 machine # [ 132.337321] niks3-server[1184]: 2026/10/05 04:26:40 INFO Registered completed upload object_key=log/yz1sqzb72i8v6h2ass0v76ba8cncqj9r-k3s-a.drv machine # [ 132.340111] niks3-server[1184]: 2026/10/05 04:26:40 INFO Registered completed upload object_key=nar/1p7jh5nyz9n68k5f18ymmdpgr34mpnnch1njw7ki7b2b97qlfbjk.nar.zst machine # [ 132.341739] niks3-server[1184]: 2026/10/05 04:26:40 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.ls machine # [ 132.350034] niks3-server[1184]: 2026/10/05 04:26:40 INFO Received complete push request method=POST path=/api/pushes/2/complete machine # [ 132.355503] niks3-server[1184]: 2026/10/05 04:26:40 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.narinfo machine # [ 132.421698] niks3-server[1184]: 2026/10/05 04:26:40 INFO Received push request method=POST path=/api/pushes machine # [ 132.432409] niks3-server[1184]: 2026/10/05 04:26:40 INFO Received sign narinfos request method=POST path=/api/pushes/3/sign machine # [ 132.434263] niks3-server[1184]: 2026/10/05 04:26:40 INFO Signed narinfos id=3 count=1 machine # [ 132.435513] niks3-server[1184]: 2026/10/05 04:26:40 INFO Registered completed upload object_key=nar/03a4ywhyr5knmbc93z4gyml5y8fvgb431xvlmfxrwsm8mrb0qgx2.nar.zst machine # [ 132.439665] niks3-server[1184]: 2026/10/05 04:26:40 INFO Received complete push request method=POST path=/api/pushes/3/complete machine # [ 132.443159] niks3-server[1184]: 2026/10/05 04:26:40 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.narinfo machine # [ 132.449895] niks3-server[1184]: 2026/10/05 04:26:40 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.ls machine # [ 157.749694] niks3-server[1184]: 2026/10/05 04:27:05 INFO Received push request method=POST path=/api/pushes machine # [ 157.763947] niks3-server[1184]: 2026/10/05 04:27:05 INFO Received sign narinfos request method=POST path=/api/pushes/4/sign machine # [ 157.768622] niks3-server[1184]: 2026/10/05 04:27:05 INFO Registered completed upload object_key=log/zfq1xw9bmycqh35l0s44lmv65z4xc7br-k3s-b.drv machine # [ 157.771466] niks3-server[1184]: 2026/10/05 04:27:05 INFO Signed narinfos id=4 count=1 machine # [ 157.773834] niks3-server[1184]: 2026/10/05 04:27:05 INFO Registered completed upload object_key=nar/05qjsj5ff3a6vnxkhb6k5f3m446dcc206p7cd37w4v3mgi95d7kh.nar.zst machine # [ 157.776983] niks3-server[1184]: 2026/10/05 04:27:05 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.ls machine # [ 157.779323] niks3-server[1184]: 2026/10/05 04:27:05 INFO Received complete push request method=POST path=/api/pushes/4/complete machine # [ 157.786844] niks3-server[1184]: 2026/10/05 04:27:05 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.narinfo machine # [ 157.849223] niks3-server[1184]: 2026/10/05 04:27:05 INFO Received push request method=POST path=/api/pushes machine # [ 157.857307] niks3-server[1184]: 2026/10/05 04:27:05 INFO Received sign narinfos request method=POST path=/api/pushes/5/sign machine # [ 157.860600] niks3-server[1184]: 2026/10/05 04:27:05 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.ls machine # [ 157.861962] niks3-server[1184]: 2026/10/05 04:27:05 INFO Signed narinfos id=5 count=1 machine # [ 157.863188] niks3-server[1184]: 2026/10/05 04:27:05 INFO Registered completed upload object_key=nar/0jyw88klkf3nwxpnj5m5lx3i1dv2idf3hcn6im7883hnldm3gvyq.nar.zst machine # [ 157.875162] niks3-server[1184]: 2026/10/05 04:27:05 INFO Received complete push request method=POST path=/api/pushes/5/complete machine # [ 157.883916] niks3-server[1184]: 2026/10/05 04:27:05 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.narinfo machine # [ 182.594563] niks3-server[1184]: 2026/10/05 04:27:30 INFO Received push request method=POST path=/api/pushes machine # [ 182.614432] niks3-server[1184]: 2026/10/05 04:27:30 INFO Registered completed upload object_key=nar/1q8vp5xqws560mpf8rxk8r8jhqrzibivh13x4wxy0cfqlzbk7cr5.nar.zst machine # [ 182.616890] niks3-server[1184]: 2026/10/05 04:27:30 INFO Received sign narinfos request method=POST path=/api/pushes/6/sign machine # [ 182.620150] niks3-server[1184]: 2026/10/05 04:27:30 INFO Signed narinfos id=6 count=1 machine # [ 182.620857] niks3-server[1184]: 2026/10/05 04:27:30 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.ls machine # [ 182.624203] niks3-server[1184]: 2026/10/05 04:27:30 INFO Registered completed upload object_key=log/n40czam6a4ldp1mh5fdmlcy07fv0akbm-k3s-top.drv machine # [ 182.626285] niks3-server[1184]: 2026/10/05 04:27:30 INFO Received complete push request method=POST path=/api/pushes/6/complete machine # [ 182.629232] niks3-server[1184]: 2026/10/05 04:27:30 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1, in 112.60 seconds) machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath, in 0.12 seconds) machine: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine: (finished: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.01 seconds) machine: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine # copying 3 paths... machine # copying path '/nix/store/r95r891injj9ski5c4w89yxjvjy065mx-k3s-a' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/mrqsh0475wxsmnsvkk55g94v6g5nrcra-k3s-b' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top' from 'http://192.168.1.1:5751'... machine: (finished: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.18 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1 machine # [ 207.520119] niks3-server[1184]: 2026/10/05 04:27:55 INFO Received push request method=POST path=/api/pushes machine # [ 207.542843] niks3-server[1184]: 2026/10/05 04:27:55 INFO Received sign narinfos request method=POST path=/api/pushes/7/sign machine # [ 207.543976] niks3-server[1184]: 2026/10/05 04:27:55 INFO Signed narinfos id=7 count=1 machine # [ 207.545415] niks3-server[1184]: 2026/10/05 04:27:55 INFO Registered completed upload object_key=nar/1fr26arhri17j9bj6hyjzmmd74v730biz1gb3kqd194vjx3ccvp9.nar.zst machine # [ 207.552060] niks3-server[1184]: 2026/10/05 04:27:55 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.ls machine # [ 207.555731] niks3-server[1184]: 2026/10/05 04:27:55 INFO Received complete push request method=POST path=/api/pushes/7/complete machine # [ 207.561087] niks3-server[1184]: 2026/10/05 04:27:55 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.narinfo machine # [ 232.277667] niks3-server[1184]: 2026/10/05 04:28:20 INFO Received push request method=POST path=/api/pushes machine # [ 232.302491] niks3-server[1184]: 2026/10/05 04:28:20 INFO Registered completed upload object_key=log/pbpqsh50ar10fpasdqqx8xg3lmr5j8iz-k3s-a.drv machine # [ 232.307351] niks3-server[1184]: 2026/10/05 04:28:20 INFO Received sign narinfos request method=POST path=/api/pushes/8/sign machine # [ 232.311422] niks3-server[1184]: 2026/10/05 04:28:20 INFO Signed narinfos id=8 count=1 machine # [ 232.314137] niks3-server[1184]: 2026/10/05 04:28:20 INFO Registered completed upload object_key=nar/1hfc6x4x25k3b0fk091d3nb0k3mympfp05fkslcx19synp3ig0zd.nar.zst machine # [ 232.319172] niks3-server[1184]: 2026/10/05 04:28:20 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.ls machine # [ 232.328307] niks3-server[1184]: 2026/10/05 04:28:20 INFO Received complete push request method=POST path=/api/pushes/8/complete machine # [ 232.330328] niks3-server[1184]: 2026/10/05 04:28:20 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.narinfo machine # [ 232.387698] niks3-server[1184]: 2026/10/05 04:28:20 INFO Received push request method=POST path=/api/pushes machine # [ 232.398942] niks3-server[1184]: 2026/10/05 04:28:20 INFO Received sign narinfos request method=POST path=/api/pushes/9/sign machine # [ 232.400784] niks3-server[1184]: 2026/10/05 04:28:20 INFO Signed narinfos id=9 count=1 machine # [ 232.402410] niks3-server[1184]: 2026/10/05 04:28:20 INFO Registered completed upload object_key=nar/0zzq2vgjln4shvh57091n14sam6wh6w06vja6lzb9ppcj4ffyx1n.nar.zst machine # [ 232.405601] niks3-server[1184]: 2026/10/05 04:28:20 INFO Received complete push request method=POST path=/api/pushes/9/complete machine # [ 232.409840] niks3-server[1184]: 2026/10/05 04:28:20 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.narinfo machine # [ 257.120079] niks3-server[1184]: 2026/10/05 04:28:45 INFO Received push request method=POST path=/api/pushes machine # [ 257.143296] niks3-server[1184]: 2026/10/05 04:28:45 INFO Received sign narinfos request method=POST path=/api/pushes/10/sign machine # [ 257.148891] niks3-server[1184]: 2026/10/05 04:28:45 INFO Signed narinfos id=10 count=1 machine # [ 257.151943] niks3-server[1184]: 2026/10/05 04:28:45 INFO Registered completed upload object_key=log/894h6wzw2l4w5f0hikj1k6q57jfnyi87-k3s-b.drv machine # [ 257.156393] niks3-server[1184]: 2026/10/05 04:28:45 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.ls machine # [ 257.160350] niks3-server[1184]: 2026/10/05 04:28:45 INFO Registered completed upload object_key=nar/0hh3nqk95r6g32lhdmxw8cxjv694vbpx9876zkhcpg4r4qxni2ch.nar.zst machine # [ 257.164699] niks3-server[1184]: 2026/10/05 04:28:45 INFO Received complete push request method=POST path=/api/pushes/10/complete machine # [ 257.168325] niks3-server[1184]: 2026/10/05 04:28:45 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.narinfo machine # [ 257.231263] niks3-server[1184]: 2026/10/05 04:28:45 INFO Received push request method=POST path=/api/pushes machine # [ 257.242409] niks3-server[1184]: 2026/10/05 04:28:45 INFO Received sign narinfos request method=POST path=/api/pushes/11/sign machine # [ 257.245608] niks3-server[1184]: 2026/10/05 04:28:45 INFO Signed narinfos id=11 count=1 machine # [ 257.247883] niks3-server[1184]: 2026/10/05 04:28:45 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.ls machine # [ 257.249796] niks3-server[1184]: 2026/10/05 04:28:45 INFO Registered completed upload object_key=nar/0ingamx56k31lwiyxmnxmscjj4n3qfx6sr2kpaynsrwhwz1278iw.nar.zst machine # [ 257.255232] niks3-server[1184]: 2026/10/05 04:28:45 INFO Received complete push request method=POST path=/api/pushes/11/complete machine # [ 257.260329] niks3-server[1184]: 2026/10/05 04:28:45 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.narinfo machine # [ 281.973264] niks3-server[1184]: 2026/10/05 04:29:09 INFO Received push request method=POST path=/api/pushes machine # [ 281.987650] niks3-server[1184]: 2026/10/05 04:29:09 INFO Received sign narinfos request method=POST path=/api/pushes/12/sign machine # [ 281.992165] niks3-server[1184]: 2026/10/05 04:29:09 INFO Signed narinfos id=12 count=1 machine # [ 281.993862] niks3-server[1184]: 2026/10/05 04:29:09 INFO Registered completed upload object_key=nar/0v48x4sp58bvfra08axgkz7yl1n9nc4nirskyv1hwann4i7q277i.nar.zst machine # [ 281.996221] niks3-server[1184]: 2026/10/05 04:29:09 INFO Registered completed upload object_key=log/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g-k3s-top.drv machine # [ 281.999602] niks3-server[1184]: 2026/10/05 04:29:09 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.ls machine # [ 282.003792] niks3-server[1184]: 2026/10/05 04:29:09 INFO Received complete push request method=POST path=/api/pushes/12/complete machine # [ 282.010225] niks3-server[1184]: 2026/10/05 04:29:09 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1, in 99.08 seconds) (finished: subtest: build through the balancer lands in the cache, in 211.98 seconds) subtest: a Job with the client image builds through the farm with its service account machine: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine: (finished: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.20 seconds) machine: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix machine: (finished: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix, in 0.13 seconds) machine: must succeed: kubectl apply -f /nix/store/pzq1y78ar0jx25hvv3v5qh4428dn7jnp-ci-job.json machine: (finished: must succeed: kubectl apply -f /nix/store/pzq1y78ar0jx25hvv3v5qh4428dn7jnp-ci-job.json, in 0.16 seconds) machine: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed' machine # [ 283.523805] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod7c5834b2_c70b_44c7_8459_9dede46f1d7c.slice. machine # [ 283.553673] k3s[885]: I1005 04:29:11.520158 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/7c5834b2-c70b-44c7-8459-9dede46f1d7c-nix-grpc-farm\") pod \"ci-h66n8\" (UID: \"7c5834b2-c70b-44c7-8459-9dede46f1d7c\") " pod="ci/ci-h66n8" machine # [ 283.555250] k3s[885]: I1005 04:29:11.520273 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"job\" (UniqueName: \"kubernetes.io/configmap/7c5834b2-c70b-44c7-8459-9dede46f1d7c-job\") pod \"ci-h66n8\" (UID: \"7c5834b2-c70b-44c7-8459-9dede46f1d7c\") " pod="ci/ci-h66n8" machine # [ 283.556412] k3s[885]: I1005 04:29:11.520329 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgtx5\" (UniqueName: \"kubernetes.io/projected/7c5834b2-c70b-44c7-8459-9dede46f1d7c-kube-api-access-qgtx5\") pod \"ci-h66n8\" (UID: \"7c5834b2-c70b-44c7-8459-9dede46f1d7c\") " pod="ci/ci-h66n8" machine # [ 284.933718] cni0: port 2(veth1e768f96) entered blocking state machine # [ 284.935810] cni0: port 2(veth1e768f96) entered disabled state machine # [ 284.937767] veth1e768f96: entered allmulticast mode machine # [ 284.939598] veth1e768f96: entered promiscuous mode machine # [ 284.953654] cni0: port 2(veth1e768f96) entered blocking state machine # [ 284.955680] cni0: port 2(veth1e768f96) entered forwarding state machine # [ 284.834504] (udev-worker)[5224]: Network interface NamePolicy= disabled on kernel command line. machine # [ 284.861528] dhcpcd[683]: veth1e768f96: IAID ae:15:b6:d2 machine # [ 284.862250] dhcpcd[683]: veth1e768f96: adding address fe80::fcf3:aeff:fe15:b6d2 machine # [ 284.890416] systemd[1]: Started libcontainer container d2e121cbff443d415c7e18e8ac4b8e66e2c34b5d984af05ab2552848bf9e7225. machine # [ 285.322248] dhcpcd[683]: veth1e768f96: soliciting a DHCP lease machine # [ 287.004108] dhcpcd[683]: veth1e768f96: soliciting an IPv6 router machine # [ 287.091809] systemd[1]: Started libcontainer container 98e4b104f180ac49466afb8b9e15858fb790b1ff6eb80c836e5603b1b17d50a9. machine # [ 287.172204] k3s[885]: I1005 04:29:15.138955 885 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ci/ci-h66n8" podStartSLOduration=4.138930055 podStartE2EDuration="4.138930055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-05 04:29:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-05 04:29:15.137689953 +0000 UTC m=+270.884768845" watchObservedRunningTime="2026-10-05 04:29:15.138930055 +0000 UTC m=+270.886008946" machine # [ 288.535756] niks3-server[1184]: 2026/10/05 04:29:16 INFO Received push request method=POST path=/api/pushes machine # [ 288.544917] niks3-server[1184]: 2026/10/05 04:29:16 INFO Received sign narinfos request method=POST path=/api/pushes/13/sign machine # [ 288.545977] niks3-server[1184]: 2026/10/05 04:29:16 INFO Signed narinfos id=13 count=1 machine # [ 288.549861] niks3-server[1184]: 2026/10/05 04:29:16 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.ls machine # [ 288.550949] niks3-server[1184]: 2026/10/05 04:29:16 INFO Registered completed upload object_key=nar/111g6dyibwcf2z7jhpn72rgja0qvjgpdiv9nc06g2dp7ih0a6kyq.nar.zst machine # [ 288.553460] niks3-server[1184]: 2026/10/05 04:29:16 INFO Received complete push request method=POST path=/api/pushes/13/complete machine # [ 288.557780] niks3-server[1184]: 2026/10/05 04:29:16 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.narinfo machine # [ 290.323831] dhcpcd[683]: veth1e768f96: probing for an IPv4LL address machine # [ 295.108229] dhcpcd[683]: veth1e768f96: using IPv4LL address 169.254.133.19 machine # [ 295.110709] dhcpcd[683]: veth1e768f96: adding route to 169.254.0.0/16 machine # [ 299.010954] dhcpcd[683]: veth1e768f96: no IPv6 Routers available machine # [ 309.977336] postgres[766]: [766] LOG: checkpoint starting: time machine # [ 313.267216] niks3-server[1184]: 2026/10/05 04:29:41 INFO Received push request method=POST path=/api/pushes machine # [ 313.287907] niks3-server[1184]: 2026/10/05 04:29:41 INFO Received sign narinfos request method=POST path=/api/pushes/14/sign machine # [ 313.292474] niks3-server[1184]: 2026/10/05 04:29:41 INFO Signed narinfos id=14 count=1 machine # [ 313.295717] niks3-server[1184]: 2026/10/05 04:29:41 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.ls machine # [ 313.299864] niks3-server[1184]: 2026/10/05 04:29:41 INFO Registered completed upload object_key=nar/058kjd2vfl1r27b4d9ixvwf77d8rkr18a4v894kwx8lg0nwpajnr.nar.zst machine # [ 313.304632] niks3-server[1184]: 2026/10/05 04:29:41 INFO Registered completed upload object_key=log/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # [ 313.309219] niks3-server[1184]: 2026/10/05 04:29:41 INFO Received complete push request method=POST path=/api/pushes/14/complete machine # [ 313.313554] niks3-server[1184]: 2026/10/05 04:29:41 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.narinfo machine # [ 313.380412] niks3-server[1184]: 2026/10/05 04:29:41 INFO Received push request method=POST path=/api/pushes machine # [ 313.391408] niks3-server[1184]: 2026/10/05 04:29:41 INFO Received sign narinfos request method=POST path=/api/pushes/15/sign machine # [ 313.393240] niks3-server[1184]: 2026/10/05 04:29:41 INFO Registered completed upload object_key=nar/138ynhcd5wxzz485x9qcq7xsargaklrf2li31ai69m5r46am35q6.nar.zst machine # [ 313.394412] niks3-server[1184]: 2026/10/05 04:29:41 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.ls machine # [ 313.401562] niks3-server[1184]: 2026/10/05 04:29:41 INFO Signed narinfos id=15 count=1 machine # [ 313.407189] niks3-server[1184]: 2026/10/05 04:29:41 INFO Received complete push request method=POST path=/api/pushes/15/complete machine # [ 313.409960] niks3-server[1184]: 2026/10/05 04:29:41 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.narinfo machine # [ 338.316312] niks3-server[1184]: 2026/10/05 04:30:06 INFO Received push request method=POST path=/api/pushes machine # [ 338.334640] niks3-server[1184]: 2026/10/05 04:30:06 INFO Received sign narinfos request method=POST path=/api/pushes/16/sign machine # [ 338.338220] niks3-server[1184]: 2026/10/05 04:30:06 INFO Registered completed upload object_key=nar/0n4lbdlp8w72fs3qbavl2lwrzbrn55i2b1vyglc89cc3pi8vbb1m.nar.zst machine # [ 338.340522] niks3-server[1184]: 2026/10/05 04:30:06 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.ls machine # [ 338.342186] niks3-server[1184]: 2026/10/05 04:30:06 INFO Registered completed upload object_key=log/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # [ 338.344691] niks3-server[1184]: 2026/10/05 04:30:06 INFO Signed narinfos id=16 count=1 machine # [ 338.351255] niks3-server[1184]: 2026/10/05 04:30:06 INFO Received complete push request method=POST path=/api/pushes/16/complete machine # [ 338.356593] niks3-server[1184]: 2026/10/05 04:30:06 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo machine # [ 338.419948] niks3-server[1184]: 2026/10/05 04:30:06 INFO Received push request method=POST path=/api/pushes machine # [ 338.428543] niks3-server[1184]: 2026/10/05 04:30:06 INFO Received sign narinfos request method=POST path=/api/pushes/17/sign machine # [ 338.429192] niks3-server[1184]: 2026/10/05 04:30:06 INFO Signed narinfos id=17 count=1 machine # [ 338.432567] niks3-server[1184]: 2026/10/05 04:30:06 INFO Registered completed upload object_key=nar/1f3gvnvqsm2pm3laixkxkg44kvjb251zqhszcfpp0a00h6x66ljs.nar.zst machine # [ 338.434288] niks3-server[1184]: 2026/10/05 04:30:06 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.ls machine # [ 338.436058] niks3-server[1184]: 2026/10/05 04:30:06 INFO Received complete push request method=POST path=/api/pushes/17/complete machine # [ 338.439387] niks3-server[1184]: 2026/10/05 04:30:06 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.narinfo machine # [ 363.138280] niks3-server[1184]: 2026/10/05 04:30:31 INFO Received push request method=POST path=/api/pushes machine # [ 363.157721] niks3-server[1184]: 2026/10/05 04:30:31 INFO Received sign narinfos request method=POST path=/api/pushes/18/sign machine # [ 363.160693] niks3-server[1184]: 2026/10/05 04:30:31 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.ls machine # [ 363.163259] niks3-server[1184]: 2026/10/05 04:30:31 INFO Signed narinfos id=18 count=1 machine # [ 363.164824] niks3-server[1184]: 2026/10/05 04:30:31 INFO Registered completed upload object_key=log/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # [ 363.166792] niks3-server[1184]: 2026/10/05 04:30:31 INFO Registered completed upload object_key=nar/1zwf0asrdv12q40fmqga5lx5330dvn9y4in4i9ficz9ij5lhvnf5.nar.zst machine # [ 363.169306] niks3-server[1184]: 2026/10/05 04:30:31 INFO Received complete push request method=POST path=/api/pushes/18/complete machine # [ 363.171567] niks3-server[1184]: 2026/10/05 04:30:31 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo machine # [ 366.008762] niks3-server[1184]: 2026/10/05 04:30:33 INFO Received push request method=POST path=/api/pushes machine # [ 366.026714] niks3-server[1184]: 2026/10/05 04:30:33 INFO Received sign narinfos request method=POST path=/api/pushes/19/sign machine # [ 366.030583] niks3-server[1184]: 2026/10/05 04:30:33 INFO Signed narinfos id=19 count=1 machine # [ 366.035418] niks3-server[1184]: 2026/10/05 04:30:34 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.ls machine # [ 366.038770] niks3-server[1184]: 2026/10/05 04:30:34 INFO Registered completed upload object_key=nar/0xiyqcsl8db7dnrq2gqnx5izavr51ma3dcdswrriaxfgj3qzk7xf.nar.zst machine # [ 366.042475] niks3-server[1184]: 2026/10/05 04:30:34 INFO Received complete push request method=POST path=/api/pushes/19/complete machine # [ 366.046860] niks3-server[1184]: 2026/10/05 04:30:34 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.narinfo machine # [ 391.146704] niks3-server[1184]: 2026/10/05 04:30:59 INFO Received push request method=POST path=/api/pushes machine # [ 391.163501] niks3-server[1184]: 2026/10/05 04:30:59 INFO Received sign narinfos request method=POST path=/api/pushes/20/sign machine # [ 391.165719] niks3-server[1184]: 2026/10/05 04:30:59 INFO Signed narinfos id=20 count=1 machine # [ 391.169888] niks3-server[1184]: 2026/10/05 04:30:59 INFO Registered completed upload object_key=log/fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # [ 391.172959] niks3-server[1184]: 2026/10/05 04:30:59 INFO Registered completed upload object_key=nar/0p3l2z3riilylr2rxb1aq2blxdfxg55wbgp4gxkns93srbr4bwyq.nar.zst machine # [ 391.174788] niks3-server[1184]: 2026/10/05 04:30:59 INFO Received complete push request method=POST path=/api/pushes/20/complete machine # [ 391.175963] niks3-server[1184]: 2026/10/05 04:30:59 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.ls machine # [ 391.182184] niks3-server[1184]: 2026/10/05 04:30:59 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo machine # [ 391.309136] systemd[1]: cri-containerd-98e4b104f180ac49466afb8b9e15858fb790b1ff6eb80c836e5603b1b17d50a9.scope: Deactivated successfully. machine # [ 391.310976] systemd[1]: cri-containerd-98e4b104f180ac49466afb8b9e15858fb790b1ff6eb80c836e5603b1b17d50a9.scope: Consumed 1.102s CPU time over 1min 44.218s wall clock time, 124.3M memory peak, 55.2M read from disk, 412K written to disk, 18.3K incoming IP traffic, 44.9K outgoing IP traffic. machine # [ 391.357055] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-98e4b104f180ac49466afb8b9e15858fb790b1ff6eb80c836e5603b1b17d50a9-rootfs.mount: Deactivated successfully. machine # [ 393.190577] systemd[1]: cri-containerd-d2e121cbff443d415c7e18e8ac4b8e66e2c34b5d984af05ab2552848bf9e7225.scope: Deactivated successfully. machine # [ 393.251989] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-d2e121cbff443d415c7e18e8ac4b8e66e2c34b5d984af05ab2552848bf9e7225-rootfs.mount: Deactivated successfully. machine # [ 393.294772] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-d2e121cbff443d415c7e18e8ac4b8e66e2c34b5d984af05ab2552848bf9e7225-shm.mount: Deactivated successfully. machine # [ 393.488456] cni0: port 2(veth1e768f96) entered disabled state machine # [ 393.335363] dhcpcd[683]: veth1e768f96: carrier lost machine # [ 393.490671] veth1e768f96 (unregistering): left allmulticast mode machine # [ 393.491945] veth1e768f96 (unregistering): left promiscuous mode machine # [ 393.492967] cni0: port 2(veth1e768f96) entered disabled state machine # [ 393.358030] systemd[1]: run-netns-cni\x2d9d8cd06a\x2d061b\x2da767\x2d4333\x2d982227bc398c.mount: Deactivated successfully. machine # [ 393.360860] dhcpcd[683]: veth1e768f96: deleting address fe80::fcf3:aeff:fe15:b6d2 machine # [ 393.364319] dhcpcd[683]: veth1e768f96: deleting route to 169.254.0.0/16 machine # [ 393.412659] k3s[885]: I1005 04:31:01.379523 885 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7c5834b2-c70b-44c7-8459-9dede46f1d7c-job\" (UniqueName: \"kubernetes.io/configmap/7c5834b2-c70b-44c7-8459-9dede46f1d7c-job\") pod \"7c5834b2-c70b-44c7-8459-9dede46f1d7c\" (UID: \"7c5834b2-c70b-44c7-8459-9dede46f1d7c\") " machine # [ 393.416891] k3s[885]: I1005 04:31:01.379601 885 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7c5834b2-c70b-44c7-8459-9dede46f1d7c-nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/7c5834b2-c70b-44c7-8459-9dede46f1d7c-nix-grpc-farm\") pod \"7c5834b2-c70b-44c7-8459-9dede46f1d7c\" (UID: \"7c5834b2-c70b-44c7-8459-9dede46f1d7c\") " machine # [ 393.421339] k3s[885]: I1005 04:31:01.379753 885 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7c5834b2-c70b-44c7-8459-9dede46f1d7c-kube-api-access-qgtx5\" (UniqueName: \"kubernetes.io/projected/7c5834b2-c70b-44c7-8459-9dede46f1d7c-kube-api-access-qgtx5\") pod \"7c5834b2-c70b-44c7-8459-9dede46f1d7c\" (UID: \"7c5834b2-c70b-44c7-8459-9dede46f1d7c\") " machine # [ 393.425966] k3s[885]: I1005 04:31:01.379959 885 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c5834b2-c70b-44c7-8459-9dede46f1d7c-job" pod "7c5834b2-c70b-44c7-8459-9dede46f1d7c" (UID: "7c5834b2-c70b-44c7-8459-9dede46f1d7c"). InnerVolumeSpecName "job". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 393.429878] systemd[1]: var-lib-kubelet-pods-7c5834b2\x2dc70b\x2d44c7\x2d8459\x2d9dede46f1d7c-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dqgtx5.mount: Deactivated successfully. machine # [ 393.432203] k3s[885]: I1005 04:31:01.389072 885 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c5834b2-c70b-44c7-8459-9dede46f1d7c-kube-api-access-qgtx5" pod "7c5834b2-c70b-44c7-8459-9dede46f1d7c" (UID: "7c5834b2-c70b-44c7-8459-9dede46f1d7c"). InnerVolumeSpecName "kube-api-access-qgtx5". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 393.436790] k3s[885]: I1005 04:31:01.389379 885 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c5834b2-c70b-44c7-8459-9dede46f1d7c-nix-grpc-farm" pod "7c5834b2-c70b-44c7-8459-9dede46f1d7c" (UID: "7c5834b2-c70b-44c7-8459-9dede46f1d7c"). InnerVolumeSpecName "nix-grpc-farm". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 393.441495] systemd[1]: var-lib-kubelet-pods-7c5834b2\x2dc70b\x2d44c7\x2d8459\x2d9dede46f1d7c-volumes-kubernetes.io\x7eprojected-nix\x2dgrpc\x2dfarm.mount: Deactivated successfully. machine # [ 393.443652] dhcpcd[683]: veth1e768f96: removing interface machine # [ 393.513606] k3s[885]: I1005 04:31:01.480723 885 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgtx5\" (UniqueName: \"kubernetes.io/projected/7c5834b2-c70b-44c7-8459-9dede46f1d7c-kube-api-access-qgtx5\") on node \"machine\" DevicePath \"\"" machine # [ 393.514470] k3s[885]: I1005 04:31:01.480760 885 reconciler_common.go:299] "Volume detached for volume \"job\" (UniqueName: \"kubernetes.io/configmap/7c5834b2-c70b-44c7-8459-9dede46f1d7c-job\") on node \"machine\" DevicePath \"\"" machine # [ 393.514964] k3s[885]: I1005 04:31:01.480775 885 reconciler_common.go:299] "Volume detached for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/7c5834b2-c70b-44c7-8459-9dede46f1d7c-nix-grpc-farm\") on node \"machine\" DevicePath \"\"" machine # [ 394.173602] k3s[885]: I1005 04:31:02.140642 885 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d2e121cbff443d415c7e18e8ac4b8e66e2c34b5d984af05ab2552848bf9e7225" machine # [ 394.190064] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod7c5834b2_c70b_44c7_8459_9dede46f1d7c.slice. machine # [ 394.191722] systemd[1]: kubepods-besteffort-pod7c5834b2_c70b_44c7_8459_9dede46f1d7c.slice: Consumed 1.132s CPU time over 1min 50.664s wall clock time, 124.6M memory peak, 55.2M read from disk, 616K written to disk, 18.3K incoming IP traffic, 44.9K outgoing IP traffic. machine: (finished: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed', in 112.21 seconds) machine: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1 machine: (finished: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1, in 0.14 seconds) machine # don't know how to build these paths: machine # /nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-a> machine/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-czxdq: building fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-b> machine/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-czxdq: building 1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-top> machine/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-czxdq: building rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # INFO:nix_fast_build.processes:run nix-eval-jobs --gc-roots-dir /tmp/tmp9win72y4/gcroots --force-recurse --max-memory-size 4096 --workers 4 --flake '.#checks' --check-cache-status machine # INFO:nix_fast_build.workers:builds: 0 machine # warning: Git tree '/tmp' is dirty machine # warning: Git tree '/tmp' is dirty machine # ▶ x86_64-linux.t started machine # INFO:nix_fast_build.workers:builds: 2 machine # ✔ x86_64-linux.t (26s) machine # x86_64-linux.t> machine/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-6tc7m: building fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # warning: Git tree '/tmp' is dirty machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath, in 0.19 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null, in 0.05 seconds) (finished: subtest: a Job with the client image builds through the farm with its service account, in 113.31 seconds) subtest: a renewed balancer certificate is served without a rollout machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f - machine # Warning: resource secrets/farm-lb-tls is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically. machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f -, in 0.28 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}', in 0.85 seconds) machine: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-5845f9d694-whq5r -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine # [ 396.740759] k3s[885]: E1005 04:31:04.707594 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:44626: use of closed network connection" machine # [ 398.026773] k3s[885]: E1005 04:31:05.993165 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:44632: use of closed network connection" machine # [ 399.343315] k3s[885]: E1005 04:31:07.309222 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:44634: use of closed network connection" machine # [ 400.642731] k3s[885]: E1005 04:31:08.609550 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:44638: use of closed network connection" machine # [ 401.934450] k3s[885]: E1005 04:31:09.901224 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:44640: use of closed network connection" machine # [ 403.236892] k3s[885]: E1005 04:31:11.202879 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45944: use of closed network connection" machine # [ 404.560107] k3s[885]: E1005 04:31:12.526629 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45956: use of closed network connection" machine # [ 405.867525] k3s[885]: E1005 04:31:13.834270 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45968: use of closed network connection" machine # [ 407.165798] k3s[885]: E1005 04:31:15.132594 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45980: use of closed network connection" machine # [ 408.495314] k3s[885]: E1005 04:31:16.462018 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45988: use of closed network connection" machine # [ 409.809059] k3s[885]: E1005 04:31:17.775614 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45990: use of closed network connection" machine # [ 411.104780] k3s[885]: E1005 04:31:19.071557 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:46006: use of closed network connection" machine # [ 412.413615] k3s[885]: E1005 04:31:20.380377 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:46014: use of closed network connection" machine # [ 413.706850] k3s[885]: E1005 04:31:21.673436 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47478: use of closed network connection" machine # [ 413.987496] postgres[766]: [766] LOG: checkpoint complete: wrote 1037 buffers (6.3%), wrote 3 SLRU buffers; 1 WAL file(s) added, 0 removed, 0 recycled; write=103.907 s, sync=0.066 s, total=104.011 s; sync files=364, longest=0.004 s, average=0.001 s; distance=4978 kB, estimate=4978 kB; lsn=0/1C74EA0, redo lsn=0/1C42A78 machine # [ 414.983480] k3s[885]: E1005 04:31:22.950140 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47488: use of closed network connection" machine # [ 416.291431] k3s[885]: E1005 04:31:24.258190 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47500: use of closed network connection" machine # [ 417.579968] k3s[885]: E1005 04:31:25.546584 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47506: use of closed network connection" machine # [ 418.847180] k3s[885]: E1005 04:31:26.813971 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47510: use of closed network connection" machine # [ 420.187488] k3s[885]: E1005 04:31:28.153989 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47514: use of closed network connection" machine # [ 421.491136] k3s[885]: E1005 04:31:29.457911 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47520: use of closed network connection" machine # [ 422.776180] k3s[885]: E1005 04:31:30.742875 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47522: use of closed network connection" machine # [ 424.072583] k3s[885]: E1005 04:31:32.038814 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:60666: use of closed network connection" machine # [ 425.354466] k3s[885]: E1005 04:31:33.320848 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:60682: use of closed network connection" machine # [ 426.641802] k3s[885]: E1005 04:31:34.608597 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:60684: use of closed network connection" machine # [ 427.938574] k3s[885]: E1005 04:31:35.905287 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:60686: use of closed network connection" machine # [ 429.237301] k3s[885]: E1005 04:31:37.203808 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:60700: use of closed network connection" machine # [ 430.531842] k3s[885]: E1005 04:31:38.498655 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:60716: use of closed network connection" machine # [ 431.843526] k3s[885]: E1005 04:31:39.810297 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:60720: use of closed network connection" machine # [ 433.119772] k3s[885]: E1005 04:31:41.086038 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:60196: use of closed network connection" machine # [ 434.424177] k3s[885]: E1005 04:31:42.390899 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:60210: use of closed network connection" machine # [ 435.696839] k3s[885]: E1005 04:31:43.663658 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:60216: use of closed network connection" machine # [ 436.979502] k3s[885]: E1005 04:31:44.946104 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:60224: use of closed network connection" machine # [ 438.304332] k3s[885]: E1005 04:31:46.270822 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:60232: use of closed network connection" machine: (finished: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-5845f9d694-whq5r -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 41.82 seconds) machine: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine: (finished: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 0.04 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1 machine # [ 438.573098] niks3-server[1184]: 2026/10/05 04:31:46 INFO Received push request method=POST path=/api/pushes machine # [ 438.588121] niks3-server[1184]: 2026/10/05 04:31:46 INFO Received sign narinfos request method=POST path=/api/pushes/21/sign machine # [ 438.591566] niks3-server[1184]: 2026/10/05 04:31:46 INFO Signed narinfos id=21 count=1 machine # [ 438.593565] niks3-server[1184]: 2026/10/05 04:31:46 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.ls machine # [ 438.595823] niks3-server[1184]: 2026/10/05 04:31:46 INFO Registered completed upload object_key=nar/0g42hgwa9jp9abmqxz90dkwxpybsznzbpsy35rm921mlk5sw56jq.nar.zst machine # [ 438.603152] niks3-server[1184]: 2026/10/05 04:31:46 INFO Received complete push request method=POST path=/api/pushes/21/complete machine # [ 438.606964] niks3-server[1184]: 2026/10/05 04:31:46 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.narinfo machine # [ 463.926173] niks3-server[1184]: 2026/10/05 04:32:11 INFO Received push request method=POST path=/api/pushes machine # [ 463.945624] niks3-server[1184]: 2026/10/05 04:32:11 INFO Received sign narinfos request method=POST path=/api/pushes/22/sign machine # [ 463.946738] niks3-server[1184]: 2026/10/05 04:32:11 INFO Signed narinfos id=22 count=1 machine # [ 463.949617] niks3-server[1184]: 2026/10/05 04:32:11 INFO Registered completed upload object_key=log/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31-k3s-a.drv machine # [ 463.951121] niks3-server[1184]: 2026/10/05 04:32:11 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.ls machine # [ 463.952968] niks3-server[1184]: 2026/10/05 04:32:11 INFO Registered completed upload object_key=nar/1vxmmzwi16s4iri6dcmi9v62dpq1ys7wz15b497ncik3sd67nfzg.nar.zst machine # [ 463.969357] niks3-server[1184]: 2026/10/05 04:32:11 INFO Received complete push request method=POST path=/api/pushes/22/complete machine # [ 463.973914] niks3-server[1184]: 2026/10/05 04:32:11 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo machine # [ 464.050857] niks3-server[1184]: 2026/10/05 04:32:12 INFO Received push request method=POST path=/api/pushes machine # [ 464.064516] niks3-server[1184]: 2026/10/05 04:32:12 INFO Received sign narinfos request method=POST path=/api/pushes/23/sign machine # [ 464.067987] niks3-server[1184]: 2026/10/05 04:32:12 INFO Signed narinfos id=23 count=1 machine # [ 464.070431] niks3-server[1184]: 2026/10/05 04:32:12 INFO Registered completed upload object_key=nar/0cbxkyxz068xc5mivh2h67kw6y01n1x28cbs11v1a03g8m4c71zm.nar.zst machine # [ 464.074593] niks3-server[1184]: 2026/10/05 04:32:12 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.ls machine # [ 464.077481] niks3-server[1184]: 2026/10/05 04:32:12 INFO Received complete push request method=POST path=/api/pushes/23/complete machine # [ 464.079455] niks3-server[1184]: 2026/10/05 04:32:12 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.narinfo machine # [ 488.989817] niks3-server[1184]: 2026/10/05 04:32:36 INFO Received push request method=POST path=/api/pushes machine # [ 489.007817] niks3-server[1184]: 2026/10/05 04:32:36 INFO Received sign narinfos request method=POST path=/api/pushes/24/sign machine # [ 489.009499] niks3-server[1184]: 2026/10/05 04:32:36 INFO Signed narinfos id=24 count=1 machine # [ 489.010967] niks3-server[1184]: 2026/10/05 04:32:36 INFO Registered completed upload object_key=log/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4-k3s-b.drv machine # [ 489.013237] niks3-server[1184]: 2026/10/05 04:32:36 INFO Registered completed upload object_key=nar/0khxywxb2r78vhpc5hsmha3ymgp910z0aka7550jmaqzs333rmzp.nar.zst machine # [ 489.015686] niks3-server[1184]: 2026/10/05 04:32:36 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.ls machine # [ 489.021048] niks3-server[1184]: 2026/10/05 04:32:36 INFO Received complete push request method=POST path=/api/pushes/24/complete machine # [ 489.028038] niks3-server[1184]: 2026/10/05 04:32:36 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.narinfo machine # [ 489.094539] niks3-server[1184]: 2026/10/05 04:32:37 INFO Received push request method=POST path=/api/pushes machine # [ 489.105463] niks3-server[1184]: 2026/10/05 04:32:37 INFO Received sign narinfos request method=POST path=/api/pushes/25/sign machine # [ 489.107827] niks3-server[1184]: 2026/10/05 04:32:37 INFO Signed narinfos id=25 count=1 machine # [ 489.109227] niks3-server[1184]: 2026/10/05 04:32:37 INFO Registered completed upload object_key=nar/04bim5f8bvjh25xncf5x40kb529khrlzcbc92qxvapgbc0bdfv2h.nar.zst machine # [ 489.111420] niks3-server[1184]: 2026/10/05 04:32:37 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.ls machine # [ 489.113327] niks3-server[1184]: 2026/10/05 04:32:37 INFO Received complete push request method=POST path=/api/pushes/25/complete machine # [ 489.117086] niks3-server[1184]: 2026/10/05 04:32:37 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.narinfo machine # [ 513.632811] niks3-server[1184]: 2026/10/05 04:33:01 INFO Received push request method=POST path=/api/pushes machine # [ 513.649329] niks3-server[1184]: 2026/10/05 04:33:01 INFO Received sign narinfos request method=POST path=/api/pushes/26/sign machine # [ 513.653645] niks3-server[1184]: 2026/10/05 04:33:01 INFO Signed narinfos id=26 count=1 machine # [ 513.656570] niks3-server[1184]: 2026/10/05 04:33:01 INFO Registered completed upload object_key=log/jz7biafi8rj5r3r392blyazw5mdpvy0d-k3s-top.drv machine # [ 513.660993] niks3-server[1184]: 2026/10/05 04:33:01 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.ls machine # [ 513.665432] niks3-server[1184]: 2026/10/05 04:33:01 INFO Registered completed upload object_key=nar/11f7f1hixry25c2yc6np9hs10a2pwwqmymmrxxbswhdjabcyvv0s.nar.zst machine # [ 513.671137] niks3-server[1184]: 2026/10/05 04:33:01 INFO Received complete push request method=POST path=/api/pushes/26/complete machine # [ 513.675197] niks3-server[1184]: 2026/10/05 04:33:01 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1, in 75.35 seconds) (finished: subtest: a renewed balancer certificate is served without a rollout, in 118.34 seconds) subtest: metrics carry build_info machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-76f879b8c5-6tc7m -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-76f879b8c5-6tc7m -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.14 seconds) machine: must succeed: curl -sf http://10.42.0.7:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-6tc7m"' machine: (finished: must succeed: curl -sf http://10.42.0.7:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-6tc7m"', in 0.03 seconds) (finished: subtest: metrics carry build_info, in 0.17 seconds) subtest: harmonia-gc frees space and the worker stays Ready machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-76f879b8c5-6tc7m -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'' machine # [ 514.044063] k3s[885]: E1005 04:33:02.010694 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:38562: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-76f879b8c5-6tc7m -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'', in 0.17 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-76f879b8c5-6tc7m -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done' machine # [ 514.296366] k3s[885]: E1005 04:33:02.263210 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:38568: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-76f879b8c5-6tc7m -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done', in 0.25 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-76f879b8c5-6tc7m -c gc -- sh -c 'fallocate -l 11444432896 /nix/fill' machine # [ 514.480519] k3s[885]: E1005 04:33:02.447534 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:38582: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-76f879b8c5-6tc7m -c gc -- sh -c 'fallocate -l 11444432896 /nix/fill', in 0.18 seconds) machine: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-76f879b8c5-6tc7m -c gc --since=30s | grep -q 'store paths deleted' machine: (finished: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-76f879b8c5-6tc7m -c gc --since=30s | grep -q 'store paths deleted', in 1.35 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-76f879b8c5-6tc7m -c gc -- sh -c 'rm /nix/fill' machine # [ 516.029679] k3s[885]: E1005 04:33:03.996406 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:38588: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-76f879b8c5-6tc7m -c gc -- sh -c 'rm /nix/fill', in 0.20 seconds) machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-76f879b8c5-6tc7m -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-76f879b8c5-6tc7m -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}', in 0.12 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-76f879b8c5-6tc7m -c gc -- sh -c 'command -v nix-daemon && command -v niks3' machine # [ 516.314818] k3s[885]: E1005 04:33:04.281544 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:38602: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-76f879b8c5-6tc7m -c gc -- sh -c 'command -v nix-daemon && command -v niks3', in 0.16 seconds) (finished: subtest: harmonia-gc frees space and the worker stays Ready, in 2.44 seconds) subtest: losing the balancer mid-build: the client reconnects and the build succeeds machine: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1 machine # [ 516.337892] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1. machine # Running as unit: vialb.service; invocation ID: a268168e809f4452a6a05485022c3d9b machine: (finished: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1, in 0.02 seconds) machine: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'" machine # [ 516.453531] nix[10252]: don't know how to build these paths: machine # [ 516.454755] nix[10252]: /nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 516.474068] nix[10252]: copying 1 paths to '127.0.0.1:30051'... machine # [ 516.476097] nix[10252]: copying path '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' to '127.0.0.1:30051'... machine # [ 516.521760] niks3-server[1184]: 2026/10/05 04:33:04 INFO Received push request method=POST path=/api/pushes machine # [ 516.536182] niks3-server[1184]: 2026/10/05 04:33:04 INFO Received sign narinfos request method=POST path=/api/pushes/27/sign machine # [ 516.538572] niks3-server[1184]: 2026/10/05 04:33:04 INFO Signed narinfos id=27 count=1 machine # [ 516.539871] niks3-server[1184]: 2026/10/05 04:33:04 INFO Registered completed upload object_key=nar/0kkr2vb091wkq0cb0f1q92413dsfskh76wydp8mwysv7rawns0ar.nar.zst machine # [ 516.542252] niks3-server[1184]: 2026/10/05 04:33:04 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.ls machine # [ 516.545647] niks3-server[1184]: 2026/10/05 04:33:04 INFO Received complete push request method=POST path=/api/pushes/27/complete machine # [ 516.550890] niks3-server[1184]: 2026/10/05 04:33:04 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.narinfo machine # [ 516.558034] nix[10252]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 516.559596] nix[10252]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-6tc7m: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine: (finished: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'", in 1.06 seconds) machine: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false machine: (finished: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false, in 0.24 seconds) machine: waiting for success: ! systemctl is-active vialb machine # [ 517.659472] nix[10252]: scheduler at 127.0.0.1:30051: Stream removed (Socket closed), reconnecting machine # [ 517.661102] nix[10252]: d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv: Stream removed (Socket closed), asking the scheduler again machine # [ 517.682570] systemd[1]: cri-containerd-7193e2f03bddfb09f20881fda4d2f98ce64600512312288b9c8f6d7669a3474c.scope: Deactivated successfully. machine # [ 517.684471] systemd[1]: cri-containerd-7193e2f03bddfb09f20881fda4d2f98ce64600512312288b9c8f6d7669a3474c.scope: Consumed 4.493s CPU time over 7min 43.106s wall clock time, 54.5M memory peak, 32.2M read from disk, 603.3K incoming IP traffic, 738.4K outgoing IP traffic. machine # [ 517.725338] systemd[1]: Created slice libcontainer container kubepods-besteffort-podb79f2f08_add7_4d89_905c_d85f38e76aac.slice. machine # [ 517.746072] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-7193e2f03bddfb09f20881fda4d2f98ce64600512312288b9c8f6d7669a3474c-rootfs.mount: Deactivated successfully. machine # [ 517.747092] k3s[885]: E1005 04:33:05.712342 885 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-lb-5845f9d694\" failed with read version: 802 is not as new as written version: 804 for group resource replicasets.apps" logger="UnhandledError" machine # [ 517.791543] k3s[885]: I1005 04:33:05.758525 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/b79f2f08-add7-4d89-905c-d85f38e76aac-tls-lb\") pod \"nix-grpc-farm-lb-5845f9d694-dvzg4\" (UID: \"b79f2f08-add7-4d89-905c-d85f38e76aac\") " pod="farm/nix-grpc-farm-lb-5845f9d694-dvzg4" machine # [ 517.792497] k3s[885]: I1005 04:33:05.758576 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b79f2f08-add7-4d89-905c-d85f38e76aac-tmp\") pod \"nix-grpc-farm-lb-5845f9d694-dvzg4\" (UID: \"b79f2f08-add7-4d89-905c-d85f38e76aac\") " pod="farm/nix-grpc-farm-lb-5845f9d694-dvzg4" machine # [ 517.793412] k3s[885]: I1005 04:33:05.758609 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/b79f2f08-add7-4d89-905c-d85f38e76aac-tls-ca\") pod \"nix-grpc-farm-lb-5845f9d694-dvzg4\" (UID: \"b79f2f08-add7-4d89-905c-d85f38e76aac\") " pod="farm/nix-grpc-farm-lb-5845f9d694-dvzg4" machine # [ 517.793975] k3s[885]: I1005 04:33:05.758636 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b79f2f08-add7-4d89-905c-d85f38e76aac-config\") pod \"nix-grpc-farm-lb-5845f9d694-dvzg4\" (UID: \"b79f2f08-add7-4d89-905c-d85f38e76aac\") " pod="farm/nix-grpc-farm-lb-5845f9d694-dvzg4" machine # [ 517.808585] systemd[1]: cri-containerd-b40bf816e600f0621e6e08069dcd721b776d4bf788bd2bdb6307a77cf0182333.scope: Deactivated successfully. machine # [ 517.836754] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-b40bf816e600f0621e6e08069dcd721b776d4bf788bd2bdb6307a77cf0182333-rootfs.mount: Deactivated successfully. machine # [ 517.862150] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-b40bf816e600f0621e6e08069dcd721b776d4bf788bd2bdb6307a77cf0182333-shm.mount: Deactivated successfully. machine # [ 518.047625] cni0: port 3(veth14d45eeb) entered disabled state machine # [ 517.895626] dhcpcd[683]: veth14d45eeb: carrier lost machine # [ 518.051025] veth14d45eeb (unregistering): left allmulticast mode machine # [ 518.052641] veth14d45eeb (unregistering): left promiscuous mode machine # [ 518.054136] cni0: port 3(veth14d45eeb) entered disabled state machine # [ 517.930235] dhcpcd[683]: veth14d45eeb: deleting address fe80::e4de:bdff:fead:bb47 machine # [ 517.935206] dhcpcd[683]: veth14d45eeb: deleting route to 169.254.0.0/16 machine # [ 517.993304] k3s[885]: I1005 04:33:05.960443 885 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2fcdad72-3ef6-4811-8c17-853679f11bf6-tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fcdad72-3ef6-4811-8c17-853679f11bf6-tmp\") pod \"2fcdad72-3ef6-4811-8c17-853679f11bf6\" (UID: \"2fcdad72-3ef6-4811-8c17-853679f11bf6\") " machine # [ 517.993921] k3s[885]: I1005 04:33:05.960500 885 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2fcdad72-3ef6-4811-8c17-853679f11bf6-tls-ca\" (UniqueName: \"kubernetes.io/secret/2fcdad72-3ef6-4811-8c17-853679f11bf6-tls-ca\") pod \"2fcdad72-3ef6-4811-8c17-853679f11bf6\" (UID: \"2fcdad72-3ef6-4811-8c17-853679f11bf6\") " machine # [ 517.994833] k3s[885]: I1005 04:33:05.960531 885 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2fcdad72-3ef6-4811-8c17-853679f11bf6-config\" (UniqueName: \"kubernetes.io/configmap/2fcdad72-3ef6-4811-8c17-853679f11bf6-config\") pod \"2fcdad72-3ef6-4811-8c17-853679f11bf6\" (UID: \"2fcdad72-3ef6-4811-8c17-853679f11bf6\") " machine # [ 517.995554] k3s[885]: I1005 04:33:05.960561 885 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2fcdad72-3ef6-4811-8c17-853679f11bf6-tls-lb\" (UniqueName: \"kubernetes.io/secret/2fcdad72-3ef6-4811-8c17-853679f11bf6-tls-lb\") pod \"2fcdad72-3ef6-4811-8c17-853679f11bf6\" (UID: \"2fcdad72-3ef6-4811-8c17-853679f11bf6\") " machine # [ 518.011061] k3s[885]: I1005 04:33:05.978190 885 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fcdad72-3ef6-4811-8c17-853679f11bf6-tls-ca" pod "2fcdad72-3ef6-4811-8c17-853679f11bf6" (UID: "2fcdad72-3ef6-4811-8c17-853679f11bf6"). InnerVolumeSpecName "tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 518.011768] dhcpcd[683]: veth14d45eeb: removing interface machine # [ 518.012479] k3s[885]: I1005 04:33:05.978952 885 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fcdad72-3ef6-4811-8c17-853679f11bf6-tls-lb" pod "2fcdad72-3ef6-4811-8c17-853679f11bf6" (UID: "2fcdad72-3ef6-4811-8c17-853679f11bf6"). InnerVolumeSpecName "tls-lb". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 518.019960] k3s[885]: I1005 04:33:05.978297 885 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fcdad72-3ef6-4811-8c17-853679f11bf6-tmp" pod "2fcdad72-3ef6-4811-8c17-853679f11bf6" (UID: "2fcdad72-3ef6-4811-8c17-853679f11bf6"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 518.028597] k3s[885]: I1005 04:33:05.995752 885 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fcdad72-3ef6-4811-8c17-853679f11bf6-config" pod "2fcdad72-3ef6-4811-8c17-853679f11bf6" (UID: "2fcdad72-3ef6-4811-8c17-853679f11bf6"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 518.221844] cni0: port 2(veth974f3a05) entered blocking state machine # [ 518.222858] cni0: port 2(veth974f3a05) entered disabled state machine # [ 518.223777] veth974f3a05: entered allmulticast mode machine # [ 518.224603] veth974f3a05: entered promiscuous mode machine # [ 518.073935] (udev-worker)[10475]: Network interface NamePolicy= disabled on kernel command line. machine # [ 518.231761] cni0: port 2(veth974f3a05) entered blocking state machine # [ 518.232972] cni0: port 2(veth974f3a05) entered forwarding state machine # [ 518.094824] k3s[885]: I1005 04:33:06.061163 885 reconciler_common.go:299] "Volume detached for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/2fcdad72-3ef6-4811-8c17-853679f11bf6-tls-ca\") on node \"machine\" DevicePath \"\"" machine # [ 518.095460] k3s[885]: I1005 04:33:06.062007 885 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2fcdad72-3ef6-4811-8c17-853679f11bf6-config\") on node \"machine\" DevicePath \"\"" machine # [ 518.095944] k3s[885]: I1005 04:33:06.062020 885 reconciler_common.go:299] "Volume detached for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/2fcdad72-3ef6-4811-8c17-853679f11bf6-tls-lb\") on node \"machine\" DevicePath \"\"" machine # [ 518.096626] k3s[885]: I1005 04:33:06.062034 885 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fcdad72-3ef6-4811-8c17-853679f11bf6-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 518.113891] dhcpcd[683]: veth974f3a05: IAID c8:bd:17:6a machine # [ 518.114586] dhcpcd[683]: veth974f3a05: adding address fe80::f872:c8ff:febd:176a machine # [ 518.165291] systemd[1]: Started libcontainer container 53805b2a8c69c3cc7fc4a176e32b53aaf32d284dedb7c831055eebf1883e6d22. machine # [ 518.277382] systemd[1]: Started libcontainer container f61326ccc0de32339df3b1fde2f20d6203638b9d5894e87546989b94da2b6112. machine # [ 518.348090] k3s[885]: I1005 04:33:06.315077 885 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-5845f9d694-dvzg4" podStartSLOduration=1.315056324 podStartE2EDuration="1.315056324s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-05 04:33:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-05 04:33:06.314816629 +0000 UTC m=+502.061895241" watchObservedRunningTime="2026-10-05 04:33:06.315056324 +0000 UTC m=+502.062134936" machine # [ 518.697579] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod2fcdad72_3ef6_4811_8c17_853679f11bf6.slice. machine # [ 518.699360] systemd[1]: kubepods-besteffort-pod2fcdad72_3ef6_4811_8c17_853679f11bf6.slice: Consumed 4.525s CPU time over 7min 45.492s wall clock time, 54.8M memory peak, 32.2M read from disk, 603.3K incoming IP traffic, 738.4K outgoing IP traffic. machine # [ 518.719075] k3s[885]: E1005 04:33:06.686068 885 kubelet_pods.go:2193] "failed to read memory cgroup config for the pod" err="failed to read memory.max for cgroup /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2fcdad72_3ef6_4811_8c17_853679f11bf6.slice: openat2 /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2fcdad72_3ef6_4811_8c17_853679f11bf6.slice/memory.max: no such file or directory" podName="nix-grpc-farm-lb-5845f9d694-whq5r" machine # [ 518.720563] k3s[885]: I1005 04:33:06.686118 885 scope.go:122] "RemoveContainer" containerID="7193e2f03bddfb09f20881fda4d2f98ce64600512312288b9c8f6d7669a3474c" machine # [ 518.724062] k3s[885]: E1005 04:33:06.686204 885 kubelet_pods.go:2198] "failed to read memory cgroup limits for the pod" err="failed to read cpu.max file for cgroup /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2fcdad72_3ef6_4811_8c17_853679f11bf6.slice: openat2 /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2fcdad72_3ef6_4811_8c17_853679f11bf6.slice/cpu.max: no such file or directory" podName="nix-grpc-farm-lb-5845f9d694-whq5r" machine # [ 518.752909] k3s[885]: I1005 04:33:06.719764 885 scope.go:122] "RemoveContainer" containerID="7193e2f03bddfb09f20881fda4d2f98ce64600512312288b9c8f6d7669a3474c" machine # [ 518.755591] k3s[885]: E1005 04:33:06.722666 885 remote_runtime.go:569] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"7193e2f03bddfb09f20881fda4d2f98ce64600512312288b9c8f6d7669a3474c\": not found" containerID="7193e2f03bddfb09f20881fda4d2f98ce64600512312288b9c8f6d7669a3474c" machine # [ 518.756635] k3s[885]: I1005 04:33:06.722706 885 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"7193e2f03bddfb09f20881fda4d2f98ce64600512312288b9c8f6d7669a3474c"} err="failed to get container status \"7193e2f03bddfb09f20881fda4d2f98ce64600512312288b9c8f6d7669a3474c\": rpc error: code = NotFound desc = an error occurred when try to find container \"7193e2f03bddfb09f20881fda4d2f98ce64600512312288b9c8f6d7669a3474c\": not found" machine # [ 518.759591] systemd[1]: var-lib-kubelet-pods-2fcdad72\x2d3ef6\x2d4811\x2d8c17\x2d853679f11bf6-volume\x2dsubpaths-config-envoy-2.mount: Deactivated successfully. machine # [ 518.760356] systemd[1]: var-lib-kubelet-pods-2fcdad72\x2d3ef6\x2d4811\x2d8c17\x2d853679f11bf6-volume\x2dsubpaths-config-envoy-1.mount: Deactivated successfully. machine # [ 518.760969] systemd[1]: var-lib-kubelet-pods-2fcdad72\x2d3ef6\x2d4811\x2d8c17\x2d853679f11bf6-volume\x2dsubpaths-config-envoy-0.mount: Deactivated successfully. machine # [ 518.761661] systemd[1]: run-netns-cni\x2d72d4aec1\x2de482\x2dc04f\x2d114d\x2d36efe9f6f289.mount: Deactivated successfully. machine # [ 518.762267] systemd[1]: var-lib-kubelet-pods-2fcdad72\x2d3ef6\x2d4811\x2d8c17\x2d853679f11bf6-volumes-kubernetes.io\x7esecret-tls\x2dlb.mount: Deactivated successfully. machine # [ 518.762997] systemd[1]: var-lib-kubelet-pods-2fcdad72\x2d3ef6\x2d4811\x2d8c17\x2d853679f11bf6-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 518.763509] systemd[1]: var-lib-kubelet-pods-2fcdad72\x2d3ef6\x2d4811\x2d8c17\x2d853679f11bf6-volumes-kubernetes.io\x7esecret-tls\x2dca.mount: Deactivated successfully. machine # [ 519.603704] dhcpcd[683]: veth974f3a05: soliciting a DHCP lease machine # [ 519.962834] dhcpcd[683]: veth974f3a05: soliciting an IPv6 router machine # [ 520.161755] nix[10252]: scheduler at 127.0.0.1:30051: failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:30051: tcp handshaker shutdown, reconnecting machine # [ 520.682989] k3s[885]: I1005 04:33:08.649382 885 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2fcdad72-3ef6-4811-8c17-853679f11bf6" path="/var/lib/kubelet/pods/2fcdad72-3ef6-4811-8c17-853679f11bf6/volumes" machine # [ 521.211715] nix[10252]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 521.215224] nix[10252]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-czxdq: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 524.604861] dhcpcd[683]: veth974f3a05: probing for an IPv4LL address machine # [ 529.927306] dhcpcd[683]: veth974f3a05: using IPv4LL address 169.254.132.55 machine # [ 529.929980] dhcpcd[683]: veth974f3a05: adding route to 169.254.0.0/16 machine # [ 531.966554] dhcpcd[683]: veth974f3a05: no IPv6 Routers available machine # [ 565.955686] niks3-server[1184]: 2026/10/05 04:33:53 INFO Received push request method=POST path=/api/pushes machine # [ 565.973898] niks3-server[1184]: 2026/10/05 04:33:53 INFO Received sign narinfos request method=POST path=/api/pushes/28/sign machine # [ 565.976930] niks3-server[1184]: 2026/10/05 04:33:53 INFO Signed narinfos id=28 count=1 machine # [ 565.979282] niks3-server[1184]: 2026/10/05 04:33:53 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.ls machine # [ 565.981453] niks3-server[1184]: 2026/10/05 04:33:53 INFO Registered completed upload object_key=log/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 565.987118] niks3-server[1184]: 2026/10/05 04:33:53 INFO Received complete push request method=POST path=/api/pushes/28/complete machine # [ 565.992857] niks3-server[1184]: 2026/10/05 04:33:53 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.narinfo machine # [ 566.026371] systemd[1]: vialb.service: Deactivated successfully. machine # [ 566.028080] systemd[1]: vialb.service: Consumed 194ms CPU time over 49.688s wall clock time, 38.5M memory peak, 4K written to disk, 8.6K incoming IP traffic, 17.4K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active vialb, in 48.93 seconds) machine: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; }, in 0.03 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 0.90 seconds) (finished: subtest: losing the balancer mid-build: the client reconnects and the build succeeds, in 51.19 seconds) subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes machine: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 machine # [ 567.543617] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1. machine # Running as unit: slow.service; invocation ID: 0cba7757a0bd4dce8380e50a985a6c55 machine: (finished: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1, in 0.04 seconds) machine # [ 567.698184] nix[11213]: don't know how to build these paths: machine # [ 567.698728] nix[11213]: /nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 567.725139] nix[11213]: copying 1 paths to '127.0.0.1:30051'... machine # [ 567.727131] nix[11213]: copying path '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' to '127.0.0.1:30051'... machine # [ 567.755697] k3s[885]: E1005 04:33:55.722521 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45058: use of closed network connection" machine # command terminated with exit code 1 machine # [ 567.765897] niks3-server[1184]: 2026/10/05 04:33:55 INFO Received push request method=POST path=/api/pushes machine # [ 567.783303] niks3-server[1184]: 2026/10/05 04:33:55 INFO Registered completed upload object_key=nar/0wl2i9xpw0gwrx1xqdgx9ka4n503ky9qhl20pdrdlphn8d6lcx0i.nar.zst machine # [ 567.786163] niks3-server[1184]: 2026/10/05 04:33:55 INFO Received sign narinfos request method=POST path=/api/pushes/29/sign machine # [ 567.787088] niks3-server[1184]: 2026/10/05 04:33:55 INFO Signed narinfos id=29 count=1 machine # [ 567.789919] niks3-server[1184]: 2026/10/05 04:33:55 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.ls machine # [ 567.794785] niks3-server[1184]: 2026/10/05 04:33:55 INFO Received complete push request method=POST path=/api/pushes/29/complete machine # [ 567.800401] niks3-server[1184]: 2026/10/05 04:33:55 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.narinfo machine # [ 567.807162] nix[11213]: building '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' on 127.0.0.1:30051... machine # [ 567.808601] nix[11213]: slow-s1> machine/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-6tc7m: building zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 567.953262] k3s[885]: E1005 04:33:55.920373 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45070: use of closed network connection" machine # command terminated with exit code 1 machine # [ 569.247888] k3s[885]: E1005 04:33:57.214722 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45072: use of closed network connection" machine # command terminated with exit code 1 machine # [ 569.441425] k3s[885]: E1005 04:33:57.408522 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45080: use of closed network connection" machine # command terminated with exit code 1 machine # [ 570.682791] k3s[885]: E1005 04:33:58.649606 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45082: use of closed network connection" machine # command terminated with exit code 1 machine # [ 570.852441] k3s[885]: E1005 04:33:58.819450 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45098: use of closed network connection" machine # command terminated with exit code 1 machine # [ 572.108819] k3s[885]: E1005 04:34:00.075648 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45108: use of closed network connection" machine # command terminated with exit code 1 machine # [ 572.281744] k3s[885]: E1005 04:34:00.248867 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45118: use of closed network connection" machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 573.564476] k3s[885]: E1005 04:34:01.531272 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:48564: use of closed network connection" machine # [ 573.772369] k3s[885]: E1005 04:34:01.739475 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:48566: use of closed network connection" machine # command terminated with exit code 1 machine # [ 574.989458] k3s[885]: E1005 04:34:02.956211 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:48580: use of closed network connection" machine # command terminated with exit code 1 machine # [ 575.188585] k3s[885]: E1005 04:34:03.155706 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:48588: use of closed network connection" machine # command terminated with exit code 1 machine # [ 576.492808] k3s[885]: E1005 04:34:04.459617 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:48602: use of closed network connection" machine # command terminated with exit code 1 machine # [ 576.672270] k3s[885]: E1005 04:34:04.639369 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:48608: use of closed network connection" machine # command terminated with exit code 1 machine # [ 577.944039] k3s[885]: E1005 04:34:05.910849 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:48610: use of closed network connection" machine # command terminated with exit code 1 machine # [ 578.159818] k3s[885]: E1005 04:34:06.126800 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:48616: use of closed network connection" machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 579.448351] k3s[885]: E1005 04:34:07.414054 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:48628: use of closed network connection" machine # [ 579.645098] k3s[885]: E1005 04:34:07.612171 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:48638: use of closed network connection" machine # command terminated with exit code 1 machine # [ 580.909811] k3s[885]: E1005 04:34:08.876387 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:48650: use of closed network connection" machine # command terminated with exit code 1 machine # [ 581.090785] k3s[885]: E1005 04:34:09.057861 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:48664: use of closed network connection" machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 582.398600] k3s[885]: E1005 04:34:10.364866 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:48676: use of closed network connection" machine # [ 582.586295] k3s[885]: E1005 04:34:10.553383 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:48688: use of closed network connection" machine # command terminated with exit code 1 machine # [ 583.874933] k3s[885]: E1005 04:34:11.841779 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47466: use of closed network connection" machine # command terminated with exit code 1 machine # [ 584.056584] k3s[885]: E1005 04:34:12.023697 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47468: use of closed network connection" machine # command terminated with exit code 1 machine # [ 585.326968] k3s[885]: E1005 04:34:13.293796 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47470: use of closed network connection" machine # command terminated with exit code 1 machine # [ 585.521985] k3s[885]: E1005 04:34:13.489094 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47486: use of closed network connection" machine # command terminated with exit code 1 machine # [ 586.771791] k3s[885]: E1005 04:34:14.738618 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47490: use of closed network connection" machine # command terminated with exit code 1 machine # [ 586.942790] k3s[885]: E1005 04:34:14.909895 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47496: use of closed network connection" machine # command terminated with exit code 1 machine # [ 588.216583] k3s[885]: E1005 04:34:16.183273 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47498: use of closed network connection" machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 588.403140] k3s[885]: E1005 04:34:16.369899 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47512: use of closed network connection" machine # [ 589.662079] k3s[885]: E1005 04:34:17.628904 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47516: use of closed network connection" machine # command terminated with exit code 1 machine # [ 589.848656] k3s[885]: E1005 04:34:17.815767 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47524: use of closed network connection" machine # command terminated with exit code 1 machine # [ 591.112197] k3s[885]: E1005 04:34:19.078864 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47534: use of closed network connection" machine # command terminated with exit code 1 machine # [ 591.284074] k3s[885]: E1005 04:34:19.250875 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47544: use of closed network connection" machine # command terminated with exit code 1 machine # [ 592.530278] k3s[885]: E1005 04:34:20.497086 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47548: use of closed network connection" machine # [ 592.699475] k3s[885]: E1005 04:34:20.666580 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47558: use of closed network connection" machine: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-76f879b8c5-6tc7m --wait=false machine: (finished: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-76f879b8c5-6tc7m --wait=false, in 0.15 seconds) machine: must succeed: sleep 5.0 machine # [ 592.898832] systemd[1]: cri-containerd-c9180fa64201e4e83f5afdc54a08692b60bf59abfff0a57a5614e0b5fda26711.scope: Deactivated successfully. machine # [ 592.900625] systemd[1]: cri-containerd-c9180fa64201e4e83f5afdc54a08692b60bf59abfff0a57a5614e0b5fda26711.scope: Consumed 549ms CPU time over 8min 48.303s wall clock time, 13.4M memory peak, 5.3M read from disk. machine # [ 592.928190] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-c9180fa64201e4e83f5afdc54a08692b60bf59abfff0a57a5614e0b5fda26711-rootfs.mount: Deactivated successfully. machine # [ 593.540893] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod50cee5f4_2169_4757_a28a_4817188eefc9.slice. machine # [ 593.699686] k3s[885]: I1005 04:34:21.666501 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/50cee5f4-2169-4757-a28a-4817188eefc9-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-8q5dw\" (UID: \"50cee5f4-2169-4757-a28a-4817188eefc9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-8q5dw" machine # [ 593.704219] k3s[885]: I1005 04:34:21.666550 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/50cee5f4-2169-4757-a28a-4817188eefc9-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-8q5dw\" (UID: \"50cee5f4-2169-4757-a28a-4817188eefc9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-8q5dw" machine # [ 593.708546] k3s[885]: I1005 04:34:21.666588 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/50cee5f4-2169-4757-a28a-4817188eefc9-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-8q5dw\" (UID: \"50cee5f4-2169-4757-a28a-4817188eefc9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-8q5dw" machine # [ 593.712782] k3s[885]: I1005 04:34:21.666613 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/50cee5f4-2169-4757-a28a-4817188eefc9-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-8q5dw\" (UID: \"50cee5f4-2169-4757-a28a-4817188eefc9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-8q5dw" machine # [ 593.717122] k3s[885]: I1005 04:34:21.666795 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwwdg\" (UniqueName: \"kubernetes.io/projected/50cee5f4-2169-4757-a28a-4817188eefc9-kube-api-access-rwwdg\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-8q5dw\" (UID: \"50cee5f4-2169-4757-a28a-4817188eefc9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-8q5dw" machine # [ 593.721780] k3s[885]: I1005 04:34:21.666907 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/50cee5f4-2169-4757-a28a-4817188eefc9-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-8q5dw\" (UID: \"50cee5f4-2169-4757-a28a-4817188eefc9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-8q5dw" machine # [ 593.726753] k3s[885]: I1005 04:34:21.666992 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/50cee5f4-2169-4757-a28a-4817188eefc9-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-8q5dw\" (UID: \"50cee5f4-2169-4757-a28a-4817188eefc9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-8q5dw" machine # [ 593.731155] k3s[885]: I1005 04:34:21.667265 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/50cee5f4-2169-4757-a28a-4817188eefc9-build\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-8q5dw\" (UID: \"50cee5f4-2169-4757-a28a-4817188eefc9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-8q5dw" machine # [ 593.735628] k3s[885]: I1005 04:34:21.667330 885 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/50cee5f4-2169-4757-a28a-4817188eefc9-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-8q5dw\" (UID: \"50cee5f4-2169-4757-a28a-4817188eefc9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-8q5dw" machine # [ 594.073518] cni0: port 3(vethcf611fb8) entered blocking state machine # [ 594.074444] cni0: port 3(vethcf611fb8) entered disabled state machine # [ 594.077136] vethcf611fb8: entered allmulticast mode machine # [ 594.078353] vethcf611fb8: entered promiscuous mode machine # [ 594.095882] cni0: port 3(vethcf611fb8) entered blocking state machine # [ 594.097844] cni0: port 3(vethcf611fb8) entered forwarding state machine # [ 593.982118] (udev-worker)[12877]: Network interface NamePolicy= disabled on kernel command line. machine # [ 594.010965] dhcpcd[683]: vethcf611fb8: IAID cd:9f:77:ee machine # [ 594.011656] dhcpcd[683]: vethcf611fb8: adding address fe80::b88a:cdff:fe9f:77ee machine # [ 594.020203] systemd[1]: tmp-ovl\x2didmapped2946820576.mount: Deactivated successfully. machine # [ 594.036285] systemd[1]: Started libcontainer container 4350ca76a3ec89bb7a97e49fdf19b5800481a0800346417dc8b03307bec43af5. machine # [ 594.221365] systemd[1]: Started libcontainer container 756214055d64f752f11a2ca507a247e1612066dda7aeef715bc007a92f5c824a. machine # [ 594.514290] dhcpcd[683]: vethcf611fb8: soliciting a DHCP lease machine # [ 596.037629] dhcpcd[683]: vethcf611fb8: soliciting an IPv6 router machine # [ 597.061774] systemd[1]: cri-containerd-756214055d64f752f11a2ca507a247e1612066dda7aeef715bc007a92f5c824a.scope: Deactivated successfully. machine # [ 597.065093] systemd[1]: cri-containerd-756214055d64f752f11a2ca507a247e1612066dda7aeef715bc007a92f5c824a.scope: Consumed 1.197s CPU time over 2.842s wall clock time, 493.7M memory peak, 201.7M read from disk, 152.5M written to disk. machine # [ 597.120756] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-756214055d64f752f11a2ca507a247e1612066dda7aeef715bc007a92f5c824a-rootfs.mount: Deactivated successfully. machine: (finished: must succeed: sleep 5.0, in 5.03 seconds) machine # [ 598.132558] k3s[885]: E1005 04:34:26.098086 885 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:35694: use of closed network connection" machine: waiting for success: ! systemctl is-active slow machine # [ 598.201327] systemd[1]: tmp-ovl\x2didmapped2239577314.mount: Deactivated successfully. machine # [ 598.217352] systemd[1]: Started libcontainer container dae1615ae8326fd1d2161bafc50c8755ae086f36f3731af9e820e7cc6a50d29f. machine # [ 598.380368] systemd[1]: Started libcontainer container aacf7fb9f7abad5299a182cf820dc2f3f9228148d66902cec59846ac1cdad315. machine # [ 598.564451] systemd[1]: Started libcontainer container 81f95ec33f2ee45b2e7bfb445cce27e4a97ee2013e560c5633c1f8d4bb6086ce. machine # [ 598.629304] k3s[885]: I1005 04:34:26.596423 885 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-8q5dw" podStartSLOduration=2.770548563 podStartE2EDuration="5.596401011s" totalImagesPullingTime="0s" totalInitContainerRuntime="2.825852448s" isStatefulPod=false podCreationTimestamp="2026-10-05 04:34:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-05 04:34:26.596260211 +0000 UTC m=+582.343338823" watchObservedRunningTime="2026-10-05 04:34:26.596401011 +0000 UTC m=+582.343479623" machine # [ 599.208934] systemd[1]: tmp-ovl\x2didmapped3575872712.mount: Deactivated successfully. machine # [ 599.515992] dhcpcd[683]: vethcf611fb8: probing for an IPv4LL address machine # [ 604.478265] dhcpcd[683]: vethcf611fb8: using IPv4LL address 169.254.218.40 machine # [ 604.481746] dhcpcd[683]: vethcf611fb8: adding route to 169.254.0.0/16 machine # [ 608.041627] dhcpcd[683]: vethcf611fb8: no IPv6 Routers available machine # [ 610.080622] postgres[766]: [766] LOG: checkpoint starting: time machine # [ 612.351457] niks3-server[1184]: 2026/10/05 04:34:40 INFO Received push request method=POST path=/api/pushes machine # [ 612.373639] niks3-server[1184]: 2026/10/05 04:34:40 INFO Received sign narinfos request method=POST path=/api/pushes/30/sign machine # [ 612.375121] niks3-server[1184]: 2026/10/05 04:34:40 INFO Signed narinfos id=30 count=1 machine # [ 612.380090] niks3-server[1184]: 2026/10/05 04:34:40 INFO Registered completed upload object_key=log/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 612.382299] niks3-server[1184]: 2026/10/05 04:34:40 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.ls machine # [ 612.389397] niks3-server[1184]: 2026/10/05 04:34:40 INFO Received complete push request method=POST path=/api/pushes/30/complete machine # [ 612.395758] niks3-server[1184]: 2026/10/05 04:34:40 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo machine # [ 613.019845] postgres[766]: [766] LOG: checkpoint complete: wrote 29 buffers (0.2%), wrote 1 SLRU buffers; 0 WAL file(s) added, 0 removed, 0 recycled; write=2.915 s, sync=0.010 s, total=2.940 s; sync files=24, longest=0.003 s, average=0.001 s; distance=265 kB, estimate=4507 kB; lsn=0/1C92580, redo lsn=0/1C84E98 machine # [ 613.453251] systemd[1]: slow.service: Deactivated successfully. machine # [ 613.455778] systemd[1]: slow.service: Consumed 190ms CPU time over 45.909s wall clock time, 42.6M memory peak, 4K written to disk, 5.4K incoming IP traffic, 11.6K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active slow, in 15.66 seconds) machine: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; }, in 0.03 seconds) machine: must fail: journalctl -u slow | grep -q 'asking the scheduler again' machine: (finished: must fail: journalctl -u slow | grep -q 'asking the scheduler again', in 0.03 seconds) machine: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath machine # [ 613.982877] systemd[1]: cri-containerd-dd268776d07512a902fa48614e0c61fc8446d60bb2eb7b4fead65bf90c914cf4.scope: Deactivated successfully. machine # [ 613.985715] systemd[1]: cri-containerd-dd268776d07512a902fa48614e0c61fc8446d60bb2eb7b4fead65bf90c914cf4.scope: Consumed 3.163s CPU time over 9min 9.605s wall clock time, 85.4M memory peak, 46M read from disk, 8K written to disk, 277.2K incoming IP traffic, 358.3K outgoing IP traffic. machine: (finished: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath, in 0.18 seconds) machine # [ 614.039071] systemd[1]: cri-containerd-a095e16029c5e8ba18c2f6d3dcff5e97638016bf48b079060a374ab759a134ed.scope: Deactivated successfully. machine: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null machine # [ 614.041893] systemd[1]: cri-containerd-a095e16029c5e8ba18c2f6d3dcff5e97638016bf48b079060a374ab759a134ed.scope: Consumed 22.359s CPU time over 9min 10.036s wall clock time, 38.7M memory peak, 21.2M read from disk, 1.1M written to disk, 48.5K incoming IP traffic, 33K outgoing IP traffic. machine # [ 614.047364] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-dd268776d07512a902fa48614e0c61fc8446d60bb2eb7b4fead65bf90c914cf4-rootfs.mount: Deactivated successfully. machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null, in 0.05 seconds) (finished: subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes, in 46.58 seconds) (finished: run the VM test script, in 614.99 seconds) machine # [ 614.090959] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-a095e16029c5e8ba18c2f6d3dcff5e97638016bf48b079060a374ab759a134ed-rootfs.mount: Deactivated successfully. machine # [ 614.109754] systemd[1]: cri-containerd-b6cdb99451f229d8ebdfc7f72aa2fbe5d119e494929ab0674f0456227a51adbc.scope: Deactivated successfully. test script finished in 615.03s cleanup kill QemuMachine (pid 45) machine # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) machine # [2026-10-05T04:34:42Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-10-05T04:34:42Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-10-05T04:34:42Z INFO virtiofsd] Client disconnected, shutting down (finished: cleanup, in 1.06 seconds) additionally exposed symbols: machine, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh