vm-test-run-nix-grpc-farm-k3s
checks.x86_64-linux.k3s
· build #580
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 1200.0 seconds6run the VM test script7machine: waiting for unit k3s.service8machine: waiting for the VM to finish booting9machine: starting vm10machine # Disk image does not exist, creating the virtualisation disk image...11machine: QEMU running (pid 45)12machine # Formatting '/build/vm-state-machine/tmp.l56Q66Wv4x', fmt=raw size=1717986918413machine # mke2fs 1.47.4 (6-Mar-2025)14machine # Discarding device blocks: 0/4194304 done15machine # Creating filesystem with 4194304 4k blocks and 1048576 inodes16machine # Filesystem UUID: 649c6464-e368-41ee-8345-057e42654e0617machine # Superblock backups stored on blocks:18machine # 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208,19machine # 409600020machine # 21machine # Allocating group tables: 0/128 done22machine # Writing inode tables: 0/128 done23machine # Creating journal (32768 blocks): done24machine # Writing superblocks and filesystem accounting information: 0/128 done25machine # 26machine # Virtualisation disk image created.27machine # Starting virtiofs daemons...28machine # [2026-09-28T16:27:08Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)29machine # [2026-09-28T16:27:08Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether30machine # [2026-09-28T16:27:08Z INFO virtiofsd] Waiting for vhost-user socket connection...31machine # [2026-09-28T16:27:08Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)32machine # [2026-09-28T16:27:08Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether33machine # [2026-09-28T16:27:08Z INFO virtiofsd] Waiting for vhost-user socket connection...34machine # [2026-09-28T16:27:08Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)35machine # [2026-09-28T16:27:08Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether36machine # [2026-09-28T16:27:08Z INFO virtiofsd] Waiting for vhost-user socket connection...37machine # [2026-09-28T16:27:08Z INFO virtiofsd] Client connected, servicing requests38machine # [2026-09-28T16:27:08Z INFO virtiofsd] Client connected, servicing requests39machine # [2026-09-28T16:27:08Z INFO virtiofsd] Client connected, servicing requests40machine # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)41machine # 42machine # 43machine # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+7EFCC730+7EF2C730 CA0044machine # Press Ctrl-B to configure iPXE (PCI 00:02.0)...45machine # 46machine # 47machine # 48machine # 49machine # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 7EFCC730 7EF2C730 CB0050machine # Press Ctrl-B to configure iPXE (PCI 00:05.0)...51machine # 52machine # 53machine # Booting from ROM...54machine # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 202655machine # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/h8z0qymwsv7vg08gsapnpwfzx4868zhy-nixos-system-machine-test/init regInfo=/nix/store/zcq8qspz6696ixpjlv1m5j67jc45hhs4-closure-info/registration console=ttyS0,115200n8 console=tty056machine # [ 0.000000] BIOS-provided physical RAM map:57machine # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable58machine # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved59machine # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved60machine # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007ffd7fff] usable61machine # [ 0.000000] BIOS-e820: [mem 0x000000007ffd8000-0x000000007fffffff] reserved62machine # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved63machine # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved64machine # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved65machine # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved66machine # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000017fffffff] usable67machine # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved68machine # [ 0.000000] NX (Execute Disable) protection: active69machine # [ 0.000000] APIC: Static calls initialized70machine # [ 0.000000] SMBIOS 2.8 present.71machine # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201472machine # [ 0.000000] DMI: Memory slots populated: 1/173machine # [ 0.000000] Hypervisor detected: KVM74machine # [ 0.000000] last_pfn = 0x7ffd8 max_arch_pfn = 0x1000000000075machine # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0076machine # [ 0.000000] kvm-clock: using sched offset of 468319600 cycles77machine # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns78machine # [ 0.000005] tsc: Detected 2400.012 MHz processor79machine # [ 0.000810] last_pfn = 0x180000 max_arch_pfn = 0x1000000000080machine # [ 0.000836] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs81machine # [ 0.000839] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT82machine # [ 0.000877] last_pfn = 0x7ffd8 max_arch_pfn = 0x1000000000083machine # [ 0.002718] found SMP MP-table at [mem 0x000f5450-0x000f545f]84machine # [ 0.002729] Using GB pages for direct mapping85machine # [ 0.002829] RAMDISK: [mem 0x7e371000-0x7ffcffff]86machine # [ 0.002836] ACPI: Early table checksum verification disabled87machine # [ 0.002839] ACPI: RSDP 0x00000000000F5250 000014 (v00 BOCHS )88machine # [ 0.002843] ACPI: RSDT 0x000000007FFE2539 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)89machine # [ 0.002846] ACPI: FACP 0x000000007FFE2319 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)90machine # [ 0.002853] ACPI: DSDT 0x000000007FFE0040 0022D9 (v01 BOCHS BXPC 00000001 BXPC 00000001)91machine # [ 0.002855] ACPI: FACS 0x000000007FFE0000 00004092machine # [ 0.002857] ACPI: APIC 0x000000007FFE240D 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)93machine # [ 0.002858] ACPI: HPET 0x000000007FFE249D 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)94machine # [ 0.002860] ACPI: MCFG 0x000000007FFE24D5 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)95machine # [ 0.002861] ACPI: WAET 0x000000007FFE2511 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)96machine # [ 0.002863] ACPI: Reserving FACP table memory at [mem 0x7ffe2319-0x7ffe240c]97machine # [ 0.002864] ACPI: Reserving DSDT table memory at [mem 0x7ffe0040-0x7ffe2318]98machine # [ 0.002864] ACPI: Reserving FACS table memory at [mem 0x7ffe0000-0x7ffe003f]99machine # [ 0.002865] ACPI: Reserving APIC table memory at [mem 0x7ffe240d-0x7ffe249c]100machine # [ 0.002865] ACPI: Reserving HPET table memory at [mem 0x7ffe249d-0x7ffe24d4]101machine # [ 0.002866] ACPI: Reserving MCFG table memory at [mem 0x7ffe24d5-0x7ffe2510]102machine # [ 0.002866] ACPI: Reserving WAET table memory at [mem 0x7ffe2511-0x7ffe2538]103machine # [ 0.003086] No NUMA configuration found104machine # [ 0.003087] Faking a node at [mem 0x0000000000000000-0x000000017fffffff]105machine # [ 0.003089] NODE_DATA(0) allocated [mem 0x17fff8780-0x17fffdcff]106machine # [ 0.005256] Zone ranges:107machine # [ 0.005256] DMA [mem 0x0000000000001000-0x0000000000ffffff]108machine # [ 0.005258] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]109machine # [ 0.005259] Normal [mem 0x0000000100000000-0x000000017fffffff]110machine # [ 0.005260] Device empty111machine # [ 0.005261] Movable zone start for each node112machine # [ 0.005262] Early memory node ranges113machine # [ 0.005262] node 0: [mem 0x0000000000001000-0x000000000009efff]114machine # [ 0.005263] node 0: [mem 0x0000000000100000-0x000000007ffd7fff]115machine # [ 0.005264] node 0: [mem 0x0000000100000000-0x000000017fffffff]116machine # [ 0.005265] Initmem setup node 0 [mem 0x0000000000001000-0x000000017fffffff]117machine # [ 0.005285] On node 0, zone DMA: 1 pages in unavailable ranges118machine # [ 0.005534] On node 0, zone DMA: 97 pages in unavailable ranges119machine # [ 0.072634] On node 0, zone Normal: 40 pages in unavailable ranges120machine # [ 0.073115] ACPI: PM-Timer IO Port: 0x608121machine # [ 0.073130] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])122machine # [ 0.073160] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23123machine # [ 0.073162] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)124machine # [ 0.073164] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)125machine # [ 0.073165] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)126machine # [ 0.073166] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)127machine # [ 0.073167] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)128machine # [ 0.073169] ACPI: Using ACPI (MADT) for SMP configuration information129machine # [ 0.073170] ACPI: HPET id: 0x8086a201 base: 0xfed00000130machine # [ 0.073175] TSC deadline timer available131machine # [ 0.073179] CPU topo: Max. logical packages: 1132machine # [ 0.073180] CPU topo: Max. logical dies: 1133machine # [ 0.073180] CPU topo: Max. dies per package: 1134machine # [ 0.073183] CPU topo: Max. threads per core: 1135machine # [ 0.073184] CPU topo: Num. cores per package: 4136machine # [ 0.073185] CPU topo: Num. threads per package: 4137machine # [ 0.073185] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs138machine # [ 0.073208] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()139machine # [ 0.073223] kvm-guest: KVM setup pv remote TLB flush140machine # [ 0.073225] kvm-guest: setup PV sched yield141machine # [ 0.073235] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]142machine # [ 0.073236] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]143machine # [ 0.073237] PM: hibernation: Registered nosave memory: [mem 0x7ffd8000-0xffffffff]144machine # [ 0.073238] [mem 0xc0000000-0xfed1bfff] available for PCI devices145machine # [ 0.073240] Booting paravirtualized kernel on KVM146machine # [ 0.073243] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns147machine # [ 0.077761] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1148machine # [ 0.079881] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288149machine # [ 0.079929] kvm-guest: PV spinlocks enabled150machine # [ 0.079931] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)151machine # [ 0.079934] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/h8z0qymwsv7vg08gsapnpwfzx4868zhy-nixos-system-machine-test/init regInfo=/nix/store/zcq8qspz6696ixpjlv1m5j67jc45hhs4-closure-info/registration console=ttyS0,115200n8 console=tty0152machine # [ 0.080025] Unknown kernel command line parameters "regInfo=/nix/store/zcq8qspz6696ixpjlv1m5j67jc45hhs4-closure-info/registration", will be passed to user space.153machine # [ 0.080038] random: crng init done154machine # [ 0.080039] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes155machine # [ 0.084207] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)156machine # [ 0.086232] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)157machine # [ 0.086301] software IO TLB: area num 4.158machine # [ 0.155170] Fallback order for Node 0: 0159machine # [ 0.155178] Built 1 zonelists, mobility grouping on. Total pages: 1048438160machine # [ 0.155179] Policy zone: Normal161machine # [ 0.157691] mem auto-init: stack:all(zero), heap alloc:on, heap free:off162machine # [ 0.164122] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1163machine # [ 0.172582] allocated 8388608 bytes of page_ext164machine # [ 0.182314] ftrace: allocating 48787 entries in 192 pages165machine # [ 0.182316] ftrace: allocated 192 pages with 2 groups166machine # [ 0.183121] Dynamic Preempt: lazy167machine # [ 0.183294] rcu: Preemptible hierarchical RCU implementation.168machine # [ 0.183294] rcu: RCU event tracing is enabled.169machine # [ 0.183295] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.170machine # [ 0.183296] Trampoline variant of Tasks RCU enabled.171machine # [ 0.183297] Rude variant of Tasks RCU enabled.172machine # [ 0.183297] Tracing variant of Tasks RCU enabled.173machine # [ 0.183298] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.174machine # [ 0.183298] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4175machine # [ 0.183317] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.176machine # [ 0.183318] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.177machine # [ 0.183319] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.178machine # [ 0.187639] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16179machine # [ 0.187916] rcu: srcu_init: Setting srcu_struct sizes based on contention.180machine # [ 0.187924] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns181machine # [ 0.188033] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)182machine # [ 0.191617] Console: colour VGA+ 80x25183machine # [ 0.191620] printk: legacy console [tty0] enabled184machine # [ 0.223192] printk: legacy console [ttyS0] enabled185machine # [ 0.335316] ACPI: Core revision 20250807186machine # [ 0.336286] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns187machine # [ 0.337886] APIC: Switch to symmetric I/O mode setup188machine # [ 0.338958] x2apic enabled189machine # [ 0.339704] APIC: Switched APIC routing to: physical x2apic190machine # [ 0.340680] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()191machine # [ 0.342000] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()192machine # [ 0.343531] kvm-guest: setup PV IPIs193machine # [ 0.345130] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1194machine # [ 0.346199] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns195machine # [ 0.350572] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)196machine # [ 0.352655] x86/cpu: User Mode Instruction Prevention (UMIP) activated197machine # [ 0.353686] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127198machine # [ 0.354569] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0199machine # [ 0.355572] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto200machine # [ 0.357569] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl201machine # [ 0.358570] Transient Scheduler Attacks: Vulnerable: No microcode202machine # [ 0.360569] Spectre V2 : Mitigation: Enhanced / Automatic IBRS203machine # [ 0.361560] Speculative Return Stack Overflow: Mitigation: Safe RET204machine # [ 0.362407] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization205machine # [ 0.363575] Spectre V2 : Enabling IBPB for BPF206machine # [ 0.364570] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier207machine # [ 0.365569] active return thunk: srso_alias_return_thunk208machine # [ 0.367287] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'209machine # [ 0.368569] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'210machine # [ 0.369569] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'211machine # [ 0.370569] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'212machine # [ 0.371569] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'213machine # [ 0.372569] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'214machine # [ 0.373569] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'215machine # [ 0.375569] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256216machine # [ 0.376569] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64217machine # [ 0.377569] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512218machine # [ 0.378569] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024219machine # [ 0.379569] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8220machine # [ 0.380573] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.221machine # [ 0.410063] Freeing SMP alternatives memory: 44K222machine # [ 0.410572] pid_max: default: 32768 minimum: 301223machine # [ 0.411656] LSM: initializing lsm=capability,landlock,yama,bpf,ima224machine # [ 0.412666] landlock: Up and running.225machine # [ 0.413570] Yama: becoming mindful.226machine # [ 0.414783] LSM support for eBPF active227machine # [ 0.415720] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear)228machine # [ 0.416638] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear)229machine # [ 0.419766] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)230machine # [ 0.421129] Performance Events: Fam17h+ core perfctr, AMD PMU driver.231machine # [ 0.421578] ... version: 2232machine # [ 0.422364] ... bit width: 48233machine # [ 0.422571] ... generic counters: 6234machine # [ 0.423308] ... generic bitmap: 000000000000003f235machine # [ 0.423571] ... fixed-purpose counters: 0236machine # [ 0.424355] ... fixed-purpose bitmap: 0000000000000000237machine # [ 0.424571] ... value mask: 0000ffffffffffff238machine # [ 0.425561] ... max period: 00007fffffffffff239machine # [ 0.426340] ... global_ctrl mask: 000000000000003f240machine # [ 0.426688] signal: max sigframe size: 3376241machine # [ 0.427541] rcu: Hierarchical SRCU implementation.242machine # [ 0.428245] rcu: Max phase no-delay instances is 400.243machine # [ 0.428745] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level244machine # [ 0.434113] smp: Bringing up secondary CPUs ...245machine # [ 0.434989] smpboot: x86: Booting SMP configuration:246machine # [ 0.435575] .... node #0, CPUs: #1 #2 #3247machine # [ 0.438669] smp: Brought up 1 node, 4 CPUs248machine # [ 0.440289] smpboot: Total of 4 processors activated (19200.09 BogoMIPS)249machine # [ 0.440909] Memory: 3957848K/4193752K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 220856K reserved, 0K cma-reserved)250machine # [ 0.442572] devtmpfs: initialized251machine # [ 0.443654] x86/mm: Memory block size: 128MB252machine # [ 0.446732] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)253machine # [ 0.448616] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).254machine # [ 0.449682] pinctrl core: initialized pinctrl subsystem255machine # [ 0.450870] PM: RTC time: 16:27:08, date: 2026-09-28256machine # [ 0.454650] NET: Registered PF_NETLINK/PF_ROUTE protocol family257machine # [ 0.456378] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations258machine # [ 0.457572] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations259machine # [ 0.459137] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations260machine # [ 0.459582] audit: initializing netlink subsys (disabled)261machine # [ 0.460633] audit: type=2000 audit(1790612829.262:1): state=initialized audit_enabled=0 res=1262machine # [ 0.460820] thermal_sys: Registered thermal governor 'fair_share'263machine # [ 0.462572] thermal_sys: Registered thermal governor 'bang_bang'264machine # [ 0.463571] thermal_sys: Registered thermal governor 'step_wise'265machine # [ 0.464571] thermal_sys: Registered thermal governor 'user_space'266machine # [ 0.465563] thermal_sys: Registered thermal governor 'power_allocator'267machine # [ 0.466378] cpuidle: using governor menu268machine # [ 0.468772] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5269machine # [ 0.469844] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]270machine # [ 0.470575] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry271machine # [ 0.471584] PCI: Using configuration type 1 for base access272machine # [ 0.472734] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.273machine # [ 0.476636] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages274machine # [ 0.477573] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page275machine # [ 0.478573] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages276machine # [ 0.479571] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page277machine # [ 0.485473] ACPI: Added _OSI(Module Device)278machine # [ 0.486578] ACPI: Added _OSI(Processor Device)279machine # [ 0.488578] ACPI: Added _OSI(Processor Aggregator Device)280machine # [ 0.497304] ACPI: 1 ACPI AML tables successfully acquired and loaded281machine # [ 0.503681] ACPI: Interpreter enabled282machine # [ 0.504378] ACPI: PM: (supports S0 S3 S4 S5)283machine # [ 0.505578] ACPI: Using IOAPIC for interrupt routing284machine # [ 0.507829] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug285machine # [ 0.511577] PCI: Using E820 reservations for host bridge windows286machine # [ 0.515223] ACPI: Enabled 2 GPEs in block 00 to 3F287machine # [ 0.527240] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])288machine # [ 0.530588] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]289machine # [ 0.533773] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]290machine # [ 0.536827] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]291machine # [ 0.540412] PCI host bridge to bus 0000:00292machine # [ 0.541582] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]293machine # [ 0.543576] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]294machine # [ 0.545576] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]295machine # [ 0.548576] pci_bus 0000:00: root bus resource [mem 0x80000000-0xafffffff window]296machine # [ 0.550575] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]297machine # [ 0.553575] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe07ffffffff window]298machine # [ 0.555572] pci_bus 0000:00: root bus resource [bus 00-ff]299machine # [ 0.556730] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint300machine # [ 0.558044] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint301machine # [ 0.569667] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]302machine # [ 0.571634] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]303machine # [ 0.573635] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]304machine # [ 0.577315] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]305machine # [ 0.582806] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint306machine # [ 0.593614] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f]307machine # [ 0.596594] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]308machine # [ 0.599632] pci 0000:00:02.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]309machine # [ 0.602593] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]310machine # [ 0.605928] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint311machine # [ 0.616614] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f]312machine # [ 0.618626] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]313machine # [ 0.621631] pci 0000:00:03.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]314machine # [ 0.625709] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint315machine # [ 0.634393] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f]316machine # [ 0.635588] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]317machine # [ 0.637619] pci 0000:00:04.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]318machine # [ 0.642975] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint319machine # [ 0.655625] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f]320machine # [ 0.658600] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]321machine # [ 0.661685] pci 0000:00:05.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]322machine # [ 0.664600] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref]323machine # [ 0.669417] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint324machine # [ 0.678640] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]325machine # [ 0.681642] pci 0000:00:06.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]326machine # [ 0.686595] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint327machine # [ 0.694636] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]328machine # [ 0.697675] pci 0000:00:07.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]329machine # [ 0.703199] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint330machine # [ 0.712643] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]331machine # [ 0.743637] pci 0000:00:08.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]332machine # [ 0.748112] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint333machine # [ 0.754629] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]334machine # [ 0.756618] pci 0000:00:09.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]335machine # [ 0.760649] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint336machine # [ 0.768627] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf]337machine # [ 0.769588] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]338machine # [ 0.771618] pci 0000:00:0a.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]339machine # [ 0.774996] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint340machine # [ 0.782619] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f]341machine # [ 0.785594] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]342machine # [ 0.787631] pci 0000:00:0b.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]343machine # [ 0.792060] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint344machine # [ 0.799667] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f]345machine # [ 0.802081] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint346machine # [ 0.807664] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf]347machine # [ 0.811115] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint348machine # [ 0.816512] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df]349machine # [ 0.819328] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint350machine # [ 0.824438] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]351machine # [ 0.827014] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint352machine # [ 0.831195] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO353machine # [ 0.834174] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint354machine # [ 0.841384] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff]355machine # [ 0.842620] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]356machine # [ 0.844046] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint357machine # [ 0.847602] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]358machine # [ 0.852006] ACPI: PCI: Interrupt link LNKA configured for IRQ 10359machine # [ 0.852685] ACPI: PCI: Interrupt link LNKB configured for IRQ 10360machine # [ 0.853685] ACPI: PCI: Interrupt link LNKC configured for IRQ 11361machine # [ 0.855674] ACPI: PCI: Interrupt link LNKD configured for IRQ 11362machine # [ 0.856673] ACPI: PCI: Interrupt link LNKE configured for IRQ 10363machine # [ 0.857689] ACPI: PCI: Interrupt link LNKF configured for IRQ 10364machine # [ 0.858679] ACPI: PCI: Interrupt link LNKG configured for IRQ 11365machine # [ 0.859669] ACPI: PCI: Interrupt link LNKH configured for IRQ 11366machine # [ 0.860609] ACPI: PCI: Interrupt link GSIA configured for IRQ 16367machine # [ 0.861584] ACPI: PCI: Interrupt link GSIB configured for IRQ 17368machine # [ 0.863584] ACPI: PCI: Interrupt link GSIC configured for IRQ 18369machine # [ 0.864592] ACPI: PCI: Interrupt link GSID configured for IRQ 19370machine # [ 0.865585] ACPI: PCI: Interrupt link GSIE configured for IRQ 20371machine # [ 0.866586] ACPI: PCI: Interrupt link GSIF configured for IRQ 21372machine # [ 0.867584] ACPI: PCI: Interrupt link GSIG configured for IRQ 22373machine # [ 0.868584] ACPI: PCI: Interrupt link GSIH configured for IRQ 23374machine # [ 0.871613] iommu: Default domain type: Translated375machine # [ 0.872480] iommu: DMA domain TLB invalidation policy: lazy mode376machine # [ 0.873956] ACPI: bus type USB registered377machine # [ 0.874645] usbcore: registered new interface driver usbfs378machine # [ 0.875607] usbcore: registered new interface driver hub379machine # [ 0.876551] usbcore: registered new device driver usb380machine # [ 0.878600] NetLabel: Initializing381machine # [ 0.879283] NetLabel: domain hash size = 128382machine # [ 0.880572] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO383machine # [ 0.881617] NetLabel: unlabeled traffic allowed by default384machine # [ 0.882584] PCI: Using ACPI for IRQ routing385machine # [ 0.926735] pci 0000:00:01.0: vgaarb: setting as boot VGA device386machine # [ 0.927568] pci 0000:00:01.0: vgaarb: bridge control possible387machine # [ 0.927568] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none388machine # [ 0.929585] vgaarb: loaded389machine # [ 0.930388] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0390machine # [ 0.931312] hpet0: 3 comparators, 64-bit 100.000000 MHz counter391machine # [ 0.938570] clocksource: Switched to clocksource kvm-clock392machine # [ 0.942339] VFS: Disk quotas dquot_6.6.0393machine # [ 0.943118] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)394machine # [ 0.944740] pnp: PnP ACPI init395machine # [ 0.945567] ACPI: IRQ 4 override to edge(!), high(!)396machine # [ 0.946602] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved397machine # [ 0.948219] pnp: PnP ACPI: found 5 devices398machine # [ 0.958373] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns399machine # [ 0.960028] clocksource: Switched to clocksource acpi_pm400machine # [ 0.961092] NET: Registered PF_INET protocol family401machine # [ 0.962726] IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear)402machine # [ 0.979763] tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear)403machine # [ 0.981398] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)404machine # [ 0.982820] TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear)405machine # [ 0.985369] TCP bind hash table entries: 32768 (order: 8, 1048576 bytes, linear)406machine # [ 0.986763] TCP: Hash tables configured (established 32768 bind 32768)407machine # [ 0.987982] MPTCP token hash table entries: 4096 (order: 5, 98304 bytes, linear)408machine # [ 0.989334] UDP hash table entries: 2048 (order: 5, 131072 bytes, linear)409machine # [ 0.990622] UDP-Lite hash table entries: 2048 (order: 5, 131072 bytes, linear)410machine # [ 0.992036] NET: Registered PF_UNIX/PF_LOCAL protocol family411machine # [ 0.993089] NET: Registered PF_XDP protocol family412machine # [ 0.994010] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]413machine # [ 0.995096] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]414machine # [ 0.996177] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]415machine # [ 0.997321] pci_bus 0000:00: resource 7 [mem 0x80000000-0xafffffff window]416machine # [ 0.998547] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]417machine # [ 0.999763] pci_bus 0000:00: resource 9 [mem 0xe0000000000-0xe07ffffffff window]418machine # [ 1.001748] ACPI: \_SB_.GSIA: Enabled at IRQ 16419machine # [ 1.004317] ACPI: \_SB_.GSIB: Enabled at IRQ 17420machine # [ 1.006604] ACPI: \_SB_.GSIC: Enabled at IRQ 18421machine # [ 1.008957] ACPI: \_SB_.GSID: Enabled at IRQ 19422machine # [ 1.010812] PCI: CLS 0 bytes, default 64423machine # [ 1.011783] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)424machine # [ 1.012291] Trying to unpack rootfs image as initramfs...425machine # [ 1.012923] software IO TLB: mapped [mem 0x000000007a371000-0x000000007e371000] (64MB)426machine # [ 1.013058] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns427machine # [ 1.036171] Initialise system trusted keyrings428machine # [ 1.037369] workingset: timestamp_bits=40 max_order=20 bucket_order=0429machine # [ 1.049071] Key type asymmetric registered430machine # [ 1.049882] Asymmetric key parser 'x509' registered431machine # [ 1.050823] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)432machine # [ 1.052617] io scheduler mq-deadline registered433machine # [ 1.053485] io scheduler kyber registered434machine # [ 1.057103] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled435machine # [ 1.058455] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A436machine # [ 1.060901] Linux agpgart interface v0.103437machine # [ 1.061741] ACPI: bus type drm_connector registered438machine # [ 1.065019] usbcore: registered new interface driver usbserial_generic439machine # [ 1.066184] usbserial: USB Serial support registered for generic440machine # [ 1.067218] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.441machine # [ 1.067218] Please enable it if your BIOS has the CPPC option.442machine # [ 1.069674] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled443machine # [ 1.071172] drop_monitor: Initializing network drop monitor service444machine # [ 1.072385] NET: Registered PF_INET6 protocol family445machine # [ 1.074148] Segment Routing with IPv6446machine # [ 1.074898] In-situ OAM (IOAM) with IPv6447machine # [ 1.076910] IPI shorthand broadcast: enabled448machine # [ 1.081436] sched_clock: Marking stable (927018033, 153643936)->(1101195314, -20533345)449machine # [ 1.083395] registered taskstats version 1450machine # [ 1.084456] Loading compiled-in X.509 certificates451machine # [ 1.094472] Demotion targets for Node 0: null452machine # [ 1.095668] Key type .fscrypt registered453machine # [ 1.096379] Key type fscrypt-provisioning registered454machine # [ 1.097408] ima: No TPM chip found, activating TPM-bypass!455machine # [ 1.098340] ima: Allocated hash algorithm: sha1456machine # [ 1.099205] ima: No architecture policies found457machine # [ 1.100302] PM: Magic number: 10:746:490458machine # [ 1.101080] acpi PNP0F13:00: hash matches459machine # [ 1.102698] RAS: Correctable Errors collector initialized.460machine # [ 1.107221] clk: Disabling unused clocks461machine # [ 1.107957] PM: genpd: Disabling unused power domains462machine # [ 1.290059] Freeing initrd memory: 29052K463machine # [ 1.293769] Freeing unused decrypted memory: 2028K464machine # [ 1.296500] Freeing unused kernel image (initmem) memory: 3652K465machine # [ 1.297637] Write protecting the kernel read-only data: 32768k466machine # [ 1.299778] Freeing unused kernel image (text/rodata gap) memory: 1184K467machine # [ 1.301463] Freeing unused kernel image (rodata/data gap) memory: 720K468machine # [ 1.353897] x86/mm: Checked W+X mappings: passed, no W+X pages found.469machine # [ 1.355049] Run /init as init process470machine # [ 1.368973] systemd[1]: Inserted module 'autofs4'471machine # [ 1.395253] fuse: init (API version 7.45)472machine # [ 1.403982] ACPI: \_SB_.GSIG: Enabled at IRQ 22473machine # [ 1.406590] ACPI: \_SB_.GSIH: Enabled at IRQ 23474machine # [ 1.409991] ACPI: \_SB_.GSIE: Enabled at IRQ 20475machine # [ 1.412503] ACPI: \_SB_.GSIF: Enabled at IRQ 21476machine # [ 1.417736] virtiofs virtio5: discovered new tag: nix-store477machine # [ 1.419407] virtiofs virtio5: virtio_fs_setup_dax: No cache capability478machine # [ 1.438113] virtiofs virtio6: discovered new tag: shared479machine # [ 1.439689] virtiofs virtio6: virtio_fs_setup_dax: No cache capability480machine # [ 1.443074] virtiofs virtio7: discovered new tag: xchg481machine # [ 1.444618] virtiofs virtio7: virtio_fs_setup_dax: No cache capability482machine # [ 1.470557] systemd[1]: Successfully made /usr/ read-only.483machine # [ 1.806386] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)484machine # [ 1.811637] systemd[1]: Detected virtualization kvm.485machine # [ 1.812545] systemd[1]: Detected architecture x86-64.486machine # [ 1.813444] systemd[1]: Running in initrd.487machine # [ 1.814538] systemd[1]: Initializing machine ID from random generator.488machine # [ 1.815817] systemd[1]: Hostname set to <machine>.489machine # [ 1.921179] systemd[1]: bpf-restrict-fs: LSM BPF program attached490machine # [ 1.964349] systemd[1]: Queued start job for default target Initrd Default Target.491machine # [ 1.973216] systemd[1]: Created slice Slice /system/modprobe.492machine # [ 1.974401] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.493machine # [ 1.975897] systemd[1]: Expecting device /dev/disk/by-label/nixos...494machine # [ 1.977081] systemd[1]: Reached target Path Units.495machine # [ 1.978016] systemd[1]: Reached target Slice Units.496machine # [ 1.978950] systemd[1]: Reached target Swaps.497machine # [ 1.979828] systemd[1]: Reached target Timer Units.498machine # [ 1.980909] systemd[1]: Listening on D-Bus System Message Bus Socket.499machine # [ 1.982188] systemd[1]: Listening on Journal Socket (/dev/log).500machine # [ 1.983358] systemd[1]: Listening on Journal Sockets.501machine # [ 1.984372] systemd[1]: Listening on udev Control Socket.502machine # [ 1.985395] systemd[1]: Listening on udev Kernel Socket.503machine # [ 1.986355] systemd[1]: Reached target Socket Units.504machine # [ 1.988326] systemd[1]: Starting Create List of Static Device Nodes...505machine # [ 1.990505] systemd[1]: Starting Load Kernel Module configfs...506machine # [ 1.993471] systemd[1]: Starting Journal Service...507machine # [ 1.995293] systemd[1]: Starting Load Kernel Modules...508machine # [ 1.997731] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os509machine # [ 2.001616] systemd[1]: Starting Coldplug All udev Devices...510machine # [ 2.010776] systemd[1]: Finished Create List of Static Device Nodes.511machine # [ 2.018879] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...512machine # [ 2.022993] systemd[1]: modprobe@configfs.service: Deactivated successfully.513machine # [ 2.031340] systemd[1]: Finished Load Kernel Module configfs.514machine # [ 2.036104] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config515machine # [ 2.039464] systemd-journald[89]: Collecting audit messages is disabled.516machine # [ 2.049744] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.517machine # [ 2.051461] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.518machine # [ 2.052545] systemd[1]: Starting Create Static Device Nodes in /dev...519machine # [ 2.059068] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev520machine # [ 2.064958] systemd[1]: Finished Load Kernel Modules.521machine # [ 2.069743] systemd[1]: Starting Apply Kernel Variables...522machine # [ 2.090165] systemd[1]: Finished Create Static Device Nodes in /dev.523machine # [ 1.936648] systemd-modules-l[ 2.091576] systemd[1]: Started Journal Service.524machine # oad[91]: Using 4 probe threads525machine # [ 1.940035] systemd-modules-load[91]: Inserted module 'virtio_balloon'526machine # [ 1.941767] systemd-modules-load[91]: Inserted module 'virtio_gpu'527machine # [ 1.945681] systemd-modules-load[91]: Inserted module 'dm_mod'528machine # [ 1.947169] systemd[1]: Reached target Preparation for Local File Systems.529machine # [ 1.948873] systemd[1]: Reached target Local File Systems.530machine # [ 1.950370] systemd[1]: Starting Create System Files and Directories...531machine # [ 1.952101] systemd[1]: Starting Rule-based Manager for Device Events and Files...532machine # [ 1.961640] systemd[1]: Finished Apply Kernel Variables.533machine # [ 1.964437] systemd[1]: Finished Create System Files and Directories.534machine # [ 1.972781] systemd[1]: Finished Coldplug All udev Devices.535machine # [ 1.975253] systemd-udevd[103]: Using default interface naming scheme 'v261'.536machine # [ 1.985415] systemd[1]: Started Rule-based Manager for Device Events and Files.537machine # [ 1.986539] systemd[1]: Reached target System Initialization.538machine # [ 1.987382] systemd[1]: Reached target Basic System.539machine # [ 2.242785] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12540machine # [ 2.245900] serio: i8042 KBD port at 0x60,0x64 irq 1541machine # [ 2.246758] serio: i8042 AUX port at 0x60,0x64 irq 12542machine # [ 2.262287] uhci_hcd 0000:00:1d.0: UHCI Host Controller543machine # [ 2.264090] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 1544machine # [ 2.264802] virtio_blk virtio2: 4/0/0 default/read/poll queues545machine # [ 2.267202] uhci_hcd 0000:00:1d.0: detected 2 ports546machine # [ 2.269825] virtio_blk virtio2: [vda] 33554432 512-byte logical blocks (17.2 GB/16.0 GiB)547machine # [ 2.272854] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180548machine # [ 2.274092] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18549machine # [ 2.275556] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1550machine # [ 2.276729] usb usb1: Product: UHCI Host Controller551machine # [ 2.277489] usb usb1: Manufacturer: Linux 6.18.52 uhci_hcd552machine # [ 2.278394] usb usb1: SerialNumber: 0000:00:1d.0553machine # [ 2.280511] SCSI subsystem initialized554machine # [ 2.280533] hub 1-0:1.0: USB hub found555machine # [ 2.282084] hub 1-0:1.0: 2 ports detected556machine # [ 2.284852] uhci_hcd 0000:00:1d.1: UHCI Host Controller557machine # [ 2.285626] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 2558machine # [ 2.287948] uhci_hcd 0000:00:1d.1: detected 2 ports559machine # [ 2.290844] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0560machine # [ 2.292264] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18561machine # [ 2.294292] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1562machine # [ 2.297166] usb usb2: Product: UHCI Host Controller563machine # [ 2.297912] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd564machine # [ 2.298920] usb usb2: SerialNumber: 0000:00:1d.1565machine # [ 2.303486] hub 2-0:1.0: USB hub found566machine # [ 2.305604] hub 2-0:1.0: 2 ports detected567machine # [ 2.160044] systemd[1]: Starting Virtual Console Setup...568machine # [ 2.173371] systemd[1]: Found device /dev/disk/by-label/nixos.569machine # [ 2.174410] systemd[1]: Reached target Initrd Root Device.570machine # [ 2.175289] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...571machine # [ 2.177216] systemd-vconsole-setup[143]: Configuration of first virtual console was skipped, ignoring remaining ones.572machine # [ 2.178785] systemd[1]: Finished Virtual Console Setup.573machine # [ 2.356918] ehci-pci 0000:00:1d.7: EHCI Host Controller574machine # [ 2.358275] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 3575machine # [ 2.360076] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000576machine # [ 2.211234] systemd-fsck[150]: nixos: clean, 12/1048576 files, 109865/4194304 blocks577machine # [ 2.366683] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00578machine # [ 2.367979] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18579machine # [ 2.216440] systemd[1]: Finished File System Check on /dev/di[ 2.369924] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1580machine # sk/by-label/nixos.581machine # [ 2.372163] usb usb3: Product: EHCI Host Controller582machine # [ 2.373273] usb usb3: Manufacturer: Linux 6.18.52 ehci_hcd583machine # [ 2.374190] usb usb3: SerialNumber: 0000:00:1d.7584machine # [ 2.375323] hub 3-0:1.0: USB hub found585machine # [ 2.376068] hub 3-0:1.0: 6 ports detected586machine # [ 2.397788] hub 1-0:1.0: USB hub found587machine # [ 2.398423] hub 1-0:1.0: 2 ports detected588machine # [ 2.419838] hub 2-0:1.0: USB hub found589machine # [ 2.420498] hub 2-0:1.0: 2 ports detected590machine # [ 2.421358] uhci_hcd 0000:00:1d.2: UHCI Host Controller591machine # [ 2.422760] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4592machine # [ 2.425133] uhci_hcd 0000:00:1d.2: detected 2 ports593machine # [ 2.427977] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0594machine # [ 2.430141] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0595machine # [ 2.277949] (udev-worker)[125[ 2.431688] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18596machine # ]: Network interface NamePolicy= disabled on ker[ 2.433686] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1597machine # nel command line.[ 2.435586] usb usb4: Product: UHCI Host Controller598machine # 599machine # [ 2.436549] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd600machine # [ 2.437540] usb usb4: SerialNumber: 0000:00:1d.2601machine # [ 2.284852] (udev-worker)[127]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredi[ 2.441136] hub 4-0:1.0: USB hub found602machine # ctable interface name.603machine # [ 2.442438] hub 4-0:1.0: 2 ports detected604machine # [ 2.290681] (udev-worker)[127]: Network interface NamePolicy= disabled on kernel command line.605machine # [ 2.457875] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode606machine # [ 2.459177] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f)607machine # [ 2.460138] ahci 0000:00:1f.2: flags: 64bit ncq only608machine # [ 2.465494] scsi host0: ahci609machine # [ 2.466395] scsi host1: ahci610machine # [ 2.467847] scsi host2: ahci611machine # [ 2.468710] scsi host3: ahci612machine # [ 2.469803] scsi host4: ahci613machine # [ 2.470544] scsi host5: ahci614machine # [ 2.471220] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 50 lpm-pol 1615machine # [ 2.472481] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 50 lpm-pol 1616machine # [ 2.473713] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 50 lpm-pol 1617machine # [ 2.474926] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 50 lpm-pol 1618machine # [ 2.476136] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 50 lpm-pol 1619machine # [ 2.477530] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 50 lpm-pol 1620machine # [ 2.612970] usb 3-1: new high-speed USB device number 2 using ehci-pci621machine # [ 2.744312] usb 3-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00622machine # [ 2.746959] usb 3-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10623machine # [ 2.749146] usb 3-1: Product: QEMU USB Tablet624machine # [ 2.750670] usb 3-1: Manufacturer: QEMU625machine # [ 2.751905] usb 3-1: SerialNumber: 28754-0000:00:1d.7-1626machine # [ 2.785140] hid: raw HID events driver (C) Jiri Kosina627machine # [ 2.795860] ata6: SATA link down (SStatus 0 SControl 300)628machine # [ 2.798244] ata1: SATA link down (SStatus 0 SControl 300)629machine # [ 2.800937] ata5: SATA link down (SStatus 0 SControl 300)630machine # [ 2.803233] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300)631machine # [ 2.805833] ata2: SATA link down (SStatus 0 SControl 300)632machine # [ 2.808160] ata4: SATA link down (SStatus 0 SControl 300)633machine # [ 2.810397] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100634machine # [ 2.812472] ata3.00: applying bridge limits635machine # [ 2.814344] ata3.00: configured for UDMA/100636machine # [ 2.817002] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5637machine # [ 2.849411] usbcore: registered new interface driver usbhid638machine # [ 2.851502] usbhid: USB HID core driver639machine # [ 2.861569] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb3/3-1/3-1:1.0/0003:0627:0001.0001/input/input2640machine # [ 2.865294] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0641machine # [ 2.889180] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray642machine # [ 2.926145] cdrom: Uniform CD-ROM driver Revision: 3.20643machine # [ 2.858712] systemd[1]: Mounting /sysroot...644machine # [ 3.157244] EXT4-fs (vda): mounted filesystem 649c6464-e368-41ee-8345-057e42654e06 r/w with ordered data mode. Quota mode: none.645machine # [ 3.036182] systemd[1]: Mounted /sysroot.646machine # [ 3.037596] systemd[1]: Reached target Initrd Root File System.647machine # [ 3.039260] systemd[1]: Mounting /sysroot/nix/.ro-store...648machine # [ 3.040824] systemd[1]: Mounting /sysroot/nix/.rw-store...649machine # [ 3.042602] systemd[1]: Mounting /sysroot/run...650machine # [ 3.045559] systemd[1]: Mounting /sysroot/tmp/shared...651machine # [ 3.047473] systemd[1]: Mounting /sysroot/tmp/xchg...652machine # [ 3.055326] systemd[1]: Starting Mountpoints Configured in the Real Root...653machine # [ 3.065285] systemd[1]: Mounted /sysroot/nix/.rw-store.654machine # [ 3.066248] systemd[1]: Mounted /sysroot/run.655machine # [ 3.067457] systemd[1]: Mounted /sysroot/tmp/xchg.656machine # [ 3.069187] systemd[1]: Mounted /sysroot/nix/.ro-store.657machine # [ 3.070089] systemd[1]: Mounted /sysroot/tmp/shared.658machine # [ 3.071089] systemd-sysroot-fstab-check[193]: /sysroot should be mounted in the initrd, will request daemon-reload.659machine # [ 3.075664] systemd[1]: Starting rw-sysroot-nix-store.service...660machine # [ 3.076640] systemd[1]: Reload requested from client PID 193 ('systemd-sysroot') (unit initrd-parse-etc.service)...661machine # [ 3.078730] systemd[1]: Reloading...662machine # [ 3.130369] systemd[1]: Reloading finished in 54 ms.663machine # [ 3.156294] systemd-sysroot-fstab-check[193]: Requesting initrd-fs.target/start/replace...664machine # [ 3.158998] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.665machine # [ 3.161646] systemd[1]: Finished rw-sysroot-nix-store.service.666machine # [ 3.163976] systemd-sysroot-fstab-check[193]: Requesting swap.target/start/replace...667machine # [ 3.166698] systemd[1]: Starting rw-sysroot-nix-store.service...668machine # [ 3.168875] systemd[1]: initrd-parse-etc.service: Deactivated successfully.669machine # [ 3.171403] systemd[1]: Finished Mountpoints Configured in the Real Root.670machine # [ 3.173819] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.671machine # [ 3.186914] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.672machine # [ 3.189746] systemd[1]: Finished rw-sysroot-nix-store.service.673machine # [ 3.858833] systemd[1]: Mounting /sysroot/nix/store...674machine # [ 3.909107] systemd[1]: Mounted /sysroot/nix/store.675machine # [ 3.911150] systemd[1]: Reached target Initrd File Systems.676machine # [ 3.913249] systemd[1]: Starting Find NixOS closure...677machine # [ 3.915206] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...678machine # [ 3.947553] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.679machine # [ 3.950491] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.680machine # [ 3.960367] systemd[1]: Finished Find NixOS closure.681machine # [ 3.962314] systemd[1]: Reached target Initrd Default Target.682machine # [ 3.964362] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...683machine # [ 3.990352] systemd[1]: Stopped target Initrd Default Target.684machine # [ 3.992500] systemd[1]: Stopped target Basic System.685machine # [ 3.994379] systemd[1]: Stopped target Initrd Root Device.686machine # [ 3.996410] systemd[1]: Stopped target Path Units.687machine # [ 3.998277] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.688machine # [ 4.000882] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.689machine # [ 4.003638] systemd[1]: Stopped target Slice Units.690machine # [ 4.005584] systemd[1]: Stopped target Socket Units.691machine # [ 4.007674] systemd[1]: Stopped target System Initialization.692machine # [ 4.010687] systemd[1]: Stopped target Swaps.693machine # [ 4.012421] systemd[1]: Stopped target Timer Units.694machine # [ 4.014409] systemd[1]: dbus.socket: Deactivated successfully.695machine # [ 4.016545] systemd[1]: Closed D-Bus System Message Bus Socket.696machine # [ 4.018858] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.697machine # [ 4.021550] systemd[1]: Stopped Find NixOS closure.698machine # [ 4.023465] systemd[1]: Starting rw-sysroot-nix-store.service...699machine # [ 4.025365] systemd[1]: systemd-sysctl.service: Deactivated successfully.700machine # [ 4.027273] systemd[1]: Stopped Apply Kernel Variables.701machine # [ 4.028799] systemd[1]: systemd-modules-load.service: Deactivated successfully.702machine # [ 4.030789] systemd[1]: Stopped Load Kernel Modules.703machine # [ 4.032295] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.704machine # [ 4.034479] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.705machine # [ 4.036975] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.706machine # [ 4.039100] systemd[1]: Stopped Create System Files and Directories.707machine # [ 4.040952] systemd[1]: Stopped target Local File Systems.708machine # [ 4.042476] systemd[1]: Stopped target Preparation for Local File Systems.709machine # [ 4.043459] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.710machine # [ 4.044488] systemd[1]: Stopped Coldplug All udev Devices.711machine # [ 4.045330] systemd[1]: Stopping Rule-based Manager for Device Events and Files...712machine # [ 4.046385] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.713machine # [ 4.047420] systemd[1]: Stopped Virtual Console Setup.714machine # [ 4.048194] systemd[1]: initrd-cleanup.service: Deactivated successfully.715machine # [ 4.049165] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.716machine # [ 4.050101] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.717machine # [ 4.051117] systemd[1]: Finished rw-sysroot-nix-store.service.718machine # [ 4.051951] systemd[1]: systemd-udevd.service: Deactivated successfully.719machine # [ 4.052897] systemd[1]: Stopped Rule-based Manager for Device Events and Files.720machine # [ 4.054343] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.721machine # [ 4.055954] systemd[1]: Closed udev Control Socket.722machine # [ 4.057521] systemd[1]: Starting Cleanup udev Database...723machine # [ 4.058752] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.724machine # [ 4.060257] systemd[1]: Stopped Create Static Device Nodes in /dev.725machine # [ 4.061567] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.726machine # [ 4.063208] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.727machine # [ 4.064647] systemd[1]: kmod-static-nodes.service: Deactivated successfully.728machine # [ 4.066105] systemd[1]: Stopped Create List of Static Device Nodes.729machine # [ 4.076962] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.730machine # [ 4.078537] systemd[1]: Finished Cleanup udev Database.731machine # [ 4.079677] systemd[1]: Reached target Switch Root.732machine # [ 4.081149] systemd[1]: Starting NixOS Activation...733machine # [ 4.237369] initrd-nixos-activation-start[238]: booting system configuration /nix/store/h8z0qymwsv7vg08gsapnpwfzx4868zhy-nixos-system-machine-test734machine # [ 4.304702] initrd-nixos-activation-start[238]: running activation script...735machine # [ 4.637628] initrd-nixos-activation-start[261]: setting up /etc...736machine # [ 4.780446] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.737machine # [ 4.783136] systemd[1]: Finished NixOS Activation.738machine # [ 4.784766] systemd[1]: Starting Switch Root...739machine # [ 4.807228] systemd[1]: Switching root.740machine # [ 5.029694] systemd-journald[89]: Received SIGTERM from PID 1 (systemd).741machine # [ 5.132584] NET: Registered PF_VSOCK protocol family742machine # [ 5.506223] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)743machine # [ 5.516492] systemd[1]: Detected virtualization kvm.744machine # [ 5.518415] systemd[1]: Detected architecture x86-64.745machine # [ 5.520431] systemd[1]: Detected first boot.746machine # [ 5.525174] systemd[1]: Initializing machine ID from random generator.747machine # [ 5.674601] systemd[1]: bpf-restrict-fs: LSM BPF program attached748machine # [ 5.766953] systemd[1]: Applying preset policy.749machine # [ 5.966205] systemd[1]: Populated /etc with preset unit settings.750machine # [ 6.201489] systemd[1]: initrd-switch-root.service: Deactivated successfully.751machine # [ 6.202933] systemd[1]: Stopped initrd-switch-root.service.752machine # [ 6.205073] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.753machine # [ 6.207645] systemd[1]: Created slice Slice /system/getty.754machine # [ 6.209127] systemd[1]: Created slice User and Session Slice.755machine # [ 6.210182] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.756machine # [ 6.211580] systemd[1]: Started Forward Password Requests to Wall Directory Watch.757machine # [ 6.212783] systemd[1]: Expecting device /dev/hvc0...758machine # [ 6.213611] systemd[1]: Expecting device /dev/ttyS0...759machine # [ 6.214507] systemd[1]: Reached target Local Encrypted Volumes.760machine # [ 6.215534] systemd[1]: Stopped target initrd-fs.target.761machine # [ 6.216433] systemd[1]: Stopped target initrd-root-fs.target.762machine # [ 6.217323] systemd[1]: Stopped target initrd-switch-root.target.763machine # [ 6.218334] systemd[1]: Reached target Virtual Machines and Containers.764machine # [ 6.219452] systemd[1]: Reached target Path Units.765machine # [ 6.220245] systemd[1]: Reached target Remote File Systems.766machine # [ 6.221166] systemd[1]: Reached target Slice Units.767machine # [ 6.221966] systemd[1]: Reached target Swaps.768machine # [ 6.224129] systemd[1]: Listening on Query the User Interactively for a Password.769machine # [ 6.226900] systemd[1]: Listening on Process Core Dump Socket.770machine # [ 6.228963] systemd[1]: Listening on Credential Encryption/Decryption.771machine # [ 6.231115] systemd[1]: Listening on Factory Reset Management.772machine # [ 6.232092] systemd[1]: Listening on Hostname Service Socket.773machine # [ 6.235343] systemd[1]: Starting Journal Log Access Socket...774machine # [ 6.236819] systemd[1]: Listening on Journal Audit Socket.775machine # [ 6.239308] systemd[1]: Listening on Console Output Muting Service Socket.776machine # [ 6.240739] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.777machine # [ 6.241983] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os778machine # [ 6.243490] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki779machine # [ 6.248720] systemd[1]: Listening on Disk Repartitioning Service Socket.780machine # [ 6.249884] systemd[1]: Listening on udev Control Socket.781machine # [ 6.250848] systemd[1]: Listening on udev Varlink Socket.782machine # [ 6.253380] systemd[1]: Mounting Huge Pages File System...783machine # [ 6.255601] systemd[1]: Mounting POSIX Message Queue File System...784machine # [ 6.262423] systemd[1]: Mounting Kernel Debug File System...785machine # [ 6.267158] systemd[1]: Mounting Kernel Trace File System...786machine # [ 6.272226] systemd[1]: Starting Create List of Static Device Nodes...787machine # [ 6.277122] systemd[1]: Starting Load Kernel Module configfs...788machine # [ 6.278890] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm789machine # [ 6.281476] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore790machine # [ 6.283183] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse791machine # [ 6.286685] systemd[1]: Mounting FUSE Control File System...792machine # [ 6.287610] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67793machine # [ 6.293920] systemd[1]: Starting Journal Service...794machine # [ 6.301990] systemd[1]: Starting Load Kernel Modules...795machine # [ 6.308769] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...796machine # [ 6.314043] systemd[1]: Starting Remount Root and Kernel File Systems...797machine # [ 6.315166] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os798machine # [ 6.318951] systemd[1]: Starting Coldplug All udev Devices...799machine # [ 6.321538] systemd[1]: Listening on Journal Log Access Socket.800machine # [ 6.322753] systemd[1]: Mounted Huge Pages File System.801machine # [ 6.323932] systemd[1]: Mounted POSIX Message Queue File System.802machine # [ 6.325048] systemd[1]: Mounted Kernel Debug File System.803machine # [ 6.326092] systemd[1]: Mounted Kernel Trace File System.804machine # [ 6.327724] systemd[1]: Finished Create List of Static Device Nodes.805machine # [ 6.329024] systemd[1]: Mounted FUSE Control File System.806machine # [ 6.331770] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...807machine # [ 6.339071] systemd[1]: modprobe@configfs.service: Deactivated successfully.808machine # [ 6.340538] systemd[1]: Finished Load Kernel Module configfs.809machine # [ 6.343082] systemd-journald[333]: Collecting audit messages is enabled.810machine # [ 6.346730] systemd[1]: Mounting Kernel Configuration File System...811machine # [ 6.356327] loop: module loaded812machine # [ 6.206876] systemd[1]: Queue[ 6.360390] systemd[1]: Finished Load Kernel Modules.813machine # d start job for default target Multi-User System.814machine # [ 6.361774] systemd[1]: Started Journal Service.815machine # [ 6.208978] systemd[1]: systemd-journald.service: Deactivated successfully.816machine # [ 6.210565] systemd-modules-load[334]: Using 2 probe threads817machine # [ 6.211791] systemd-modules-load[334]: Inserted module 'loop'818machine # [ 6.213842] systemd[1]: Starting Apply Kernel Variables...819machine # [ 6.378227] EXT4-fs (vda): re-mounted 649c6464-e368-41ee-8345-057e42654e06.820machine # [ 6.228431] systemd[1]: Finished Remount Root and Kernel File Systems.821machine # [ 6.230394] systemd[1]: Mounted Kernel Configuration File System.822machine # [ 6.232419] systemd-oomd[336]: No swap; memory pressure usage will be degraded823machine # [ 6.234151] systemd[1]: Listening on Disk Image Download Service Socket.824machine # [ 6.235406] systemd[1]: Starting Flush Journal to Persistent Storage...825machine # [ 6.236607] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore826machine # [ 6.240068] systemd[1]: Starting Load/Save OS Random Seed...827machine # [ 6.240952] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os828machine # [ 6.242237] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.829machine # [ 6.253422] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.830machine # [ 6.409519] systemd-journald[333]: Received client request to flush runtime journal.831machine # [ 6.313532] systemd[1]: Starting Create Static Device Nodes in /dev...832machine # [ 6.315149] systemd[1]: Finished Apply Kernel Variables.833machine # [ 6.316153] systemd[1]: Finished Load/Save OS Random Seed.834machine # [ 6.317185] systemd[1]: Reached target First Boot Complete.835machine # [ 6.318117] systemd[1]: Finished Create Static Device Nodes in /dev.836machine # [ 6.319146] systemd[1]: Reached target Preparation for Local File Systems.837machine # [ 6.320188] systemd[1]: Starting Rule-based Manager for Device Events and Files...838machine # [ 6.321264] systemd[1]: Finished Flush Journal to Persistent Storage.839machine # [ 6.324553] systemd-udevd[362]: Using default interface naming scheme 'v261'.840machine # [ 6.355048] systemd[1]: Started Rule-based Manager for Device Events and Files.841machine # [ 6.365974] systemd[1]: Finished Coldplug All udev Devices.842machine # [ 6.428634] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse843machine # [ 6.443972] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.844machine # [ 6.458992] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.845machine # [ 6.460359] (udev-worker)[379]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.846machine # [ 6.463046] (udev-worker)[379]: Network interface NamePolicy= disabled on kernel command line.847machine # [ 6.464471] (udev-worker)[369]: Network interface NamePolicy= disabled on kernel command line.848machine # [ 6.488986] systemd[1]: Condition check resulted in Virtio network device being skipped.849machine # [ 6.491192] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore850machine # [ 6.493198] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67851machine # [ 6.496705] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore852machine # [ 6.499435] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os853machine # [ 6.500766] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os854machine # [ 6.658101] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3855machine # [ 6.660259] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console856machine # [ 6.675710] Console: switching to colour dummy device 80x25857machine # [ 6.676608] [drm] Found bochs VGA, ID 0xb0c5.858machine # [ 6.677464] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.859machine # [ 6.681348] ACPI: button: Power Button [PWRF]860machine # [ 6.682479] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic861machine # [ 6.682512] rtc_cmos PNP0B00:00: RTC can wake from S4862machine # [ 6.683315] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0863machine # [ 6.688301] rtc_cmos PNP0B00:00: registered as rtc0864machine # [ 6.688414] rtc_cmos PNP0B00:00: setting system clock to 2026-09-28T16:27:15 UTC (1790612835)865machine # [ 6.688496] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs866machine # [ 6.690165] mousedev: PS/2 mouse device common for all mice867machine # [ 6.696324] parport_pc 00:02: reported by Plug and Play ACPI868machine # [ 6.696469] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]869machine # [ 6.700595] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4870machine # [ 6.703070] Console: switching to colour frame buffer device 160x50871machine # [ 6.710808] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device872machine # [ 6.732176] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized873machine # [ 6.741848] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6874machine # [ 6.752298] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5875machine # [ 6.755718] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt876machine # [ 6.766218] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD877machine # [ 6.639808] systemd[1]: Starting Virtual Console Setup...878machine # [ 6.671458] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.879machine # [ 6.674186] systemd[1]: Stopped Virtual Console Setup.880machine # [ 6.679612] systemd[1]: Starting Virtual Console Setup...881machine # [ 6.854716] ppdev: user-space parallel port driver882machine # [ 6.860277] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660)883machine # [ 6.861650] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0)884machine # [ 6.880988] kvm_amd: TSC scaling supported885machine # [ 6.881528] kvm_amd: Nested Virtualization enabled886machine # [ 6.882096] kvm_amd: Nested Paging enabled887machine # [ 6.882577] kvm_amd: LBR virtualization supported888machine # [ 6.883220] kvm_amd: Virtual VMLOAD VMSAVE supported889machine # [ 6.883853] kvm_amd: Virtual GIF supported890machine # [ 6.884279] kvm_amd: Virtual NMI enabled891machine # [ 6.971383] EDAC MC: Ver: 3.0.0892machine # [ 6.846582] systemd-vconsole-setup[406]: Configuration of first virtual console was skipped, ignoring remaining ones.893machine # [ 6.849655] systemd[1]: Finished Virtual Console Setup.894machine # [ 7.052837] systemd[1]: Mounting /run/wrappers...895machine # [ 7.086505] systemd[1]: Mounted /run/wrappers.896machine # [ 7.088439] systemd[1]: Reached target Local File Systems.897machine # [ 7.090542] systemd[1]: Listening on Boot Loader Control Service Socket.898machine # [ 7.093082] systemd[1]: Starting register-nix-paths.service...899machine # [ 7.095852] systemd[1]: Starting Create SUID/SGID Wrappers...900machine # [ 7.098095] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.901machine # [ 7.101350] systemd[1]: Starting Save Transient machine-id to Disk...902machine # [ 7.108878] systemd[1]: Starting Create System Files and Directories...903machine # [ 7.174126] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.904machine # [ 7.178184] systemd[1]: Finished Save Transient machine-id to Disk.905machine # [ 7.180758] systemd[1]: Finished Create System Files and Directories.906machine # [ 7.185411] systemd[1]: Starting Rebuild Journal Catalog...907machine # [ 7.187229] systemd[1]: Starting Record System Boot/Shutdown in UTMP...908machine # [ 7.214634] systemd[1]: Finished Record System Boot/Shutdown in UTMP.909machine # [ 7.226232] systemd[1]: Finished Rebuild Journal Catalog.910machine # [ 7.227928] systemd[1]: Starting Update is Completed...911machine # [ 7.245197] systemd[1]: Finished Update is Completed.912machine # [ 7.346832] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.913machine # [ 7.348088] systemd[1]: Finished Create SUID/SGID Wrappers.914machine # [ 7.545691] systemd[1]: Finished register-nix-paths.service.915machine # [ 7.547304] systemd[1]: Reached target System Initialization.916machine # [ 7.548584] systemd[1]: Started Discard unused filesystem blocks once a week.917machine # [ 7.550127] systemd[1]: Started niks3 garbage collection timer.918machine # [ 7.551458] systemd[1]: Started Daily Cleanup of Temporary Directories.919machine # [ 7.552860] systemd[1]: Reached target Timer Units.920machine # [ 7.554103] systemd[1]: Listening on D-Bus System Message Bus Socket.921machine # [ 7.558957] systemd[1]: Listening on niks3 server socket.922machine # [ 7.559954] systemd[1]: Listening on Nix Daemon Socket.923machine # [ 7.560748] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.924machine # [ 7.561951] systemd[1]: Reached target Socket Units.925machine # [ 7.562690] systemd[1]: Reached target Basic System.926machine # [ 7.563894] systemd[1]: Started backdoor.service.927machine # [ 7.566928] systemd[1]: Starting Import lastlog data into lastlog2 database...928machine # [ 7.570354] systemd[1]: Starting Name Service Cache Daemon (nsncd)...929machine # [ 7.576342] systemd[1]: Starting Post-Boot Actions...930machine # [ 7.581696] systemd[1]: Started Reset console on configuration changes.931machine # [ 7.585158] systemd[1]: Starting resolvconf update...932machine # [ 7.587973] systemd[1]: Started rustfs.service.933machine # [ 7.592354] systemd[1]: Starting rustfs-bucket.service...934machine # [ 7.606994] systemd[1]: Starting D-Bus System Message Bus...935machine # connecting to host...936machine # [ 7.624717] systemd[1]: Finished Post-Boot Actions.937machine: Guest shell says: b'Spawning backdoor root shell...\n'938machine # [ 7.630639] systemd[1]: Started Name Service Cache Daemon (nsncd).939machine: connected to guest root shell940machine # [ 7.633569] systemd[1]: Reached target Host and Network Name Lookups.941machine: (connecting took 8.26 seconds)942machine # [ 7.634471] nsncd[491]: Sep 28 16:27:16.595 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"943machine: (finished: waiting for the VM to finish booting, in 8.51 seconds)944machine # [ 7.635177] systemd[1]: Reached target User and Group Name Lookups.945machine # [ 7.639176] systemd[1]: Starting User Login Management...946machine # [ 7.640747] systemd[1]: Finished Import lastlog data into lastlog2 database.947machine # [ 7.677715] dbus-broker-launch[501]: Looking up NSS user entry for 'systemd-timesync'...948machine # [ 7.693130] dbus-broker-launch[501]: NSS returned no entry for 'systemd-timesync'949machine # [ 7.693821] dbus-broker-launch[501]: Invalid user-name in /nix/store/p2xx54aham1m5mjbij0xy0q881n6jvrj-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"950machine # [ 7.708566] systemd-logind[522]: New seat seat0.951machine # [ 7.710938] systemd-logind[522]: Watching system buttons on /dev/input/event2 (Power Button)952machine # [ 7.711971] systemd-logind[522]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)953machine # [ 7.712658] systemd-logind[522]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)954machine # [ 7.713223] systemd[1]: Started D-Bus System Message Bus.955machine # [ 7.713706] systemd[1]: Started User Login Management.956machine # [ 7.714397] systemd[1]: Starting linger-users.service...957machine # [ 7.723681] systemd[1]: Stopped target Host and Network Name Lookups.958machine # [ 7.725263] systemd[1]: Stopping Host and Network Name Lookups...959machine # [ 7.726509] systemd[1]: Stopped target User and Group Name Lookups.960machine # [ 7.728751] systemd[1]: Stopping User and Group Name Lookups...961machine # [ 7.730335] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...962machine # [ 7.731225] systemd[1]: nscd.service: Deactivated successfully.963machine # [ 7.732184] systemd[1]: Stopped Name Service Cache Daemon (nsncd).964machine # [ 7.733542] dbus-broker-launch[501]: Ready965machine # [ 7.735358] systemd[1]: Starting Name Service Cache Daemon (nsncd)...966machine # [ 7.751344] systemd[1]: linger-users.service: Deactivated successfully.967machine # [ 7.751922] systemd[1]: Finished linger-users.service.968machine # [ 7.768369] nsncd[594]: Sep 28 16:27:16.732 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"969machine # [ 7.770511] systemd[1]: Started Name Service Cache Daemon (nsncd).970machine # [ 7.771418] systemd[1]: Reached target Host and Network Name Lookups.971machine # [ 7.771945] systemd[1]: Reached target User and Group Name Lookups.972machine # [ 7.782084] systemd[1]: Finished resolvconf update.973machine # [ 7.782741] systemd[1]: Reached target Preparation for Network.974machine # [ 7.785122] systemd[1]: Starting DHCP Client...975machine # [ 7.786672] systemd[1]: Starting Address configuration of eth1...976machine # [ 7.788531] systemd[1]: Starting Extra networking commands....977machine # [ 7.845221] network-addresses-eth1-start[624]: adding address 192.168.1.1/24... done978machine # [ 7.852901] network-addresses-eth1-start[624]: adding address 2001:db8:1::1/64... done979machine # [ 7.871432] systemd[1]: Finished Address configuration of eth1.980machine # [ 7.882223] dhcpcd[635]: dhcpcd-10.3.2 starting981machine # [ 7.887204] dhcpcd[684]: dev: loaded udev982machine # [ 8.052353] 8021q: 802.1Q VLAN Support v1.8983machine # [ 8.053512] 8021q: adding VLAN 0 to HW filter on device eth1984machine # [ 7.904676] systemd[1]: Finished Extra networking commands..985machine # [ 7.905888] systemd[1]: Reached target Network.986machine # [ 7.909390] systemd[1]: Starting PostgreSQL Server...987machine # [ 7.911629] systemd[1]: Starting Permit User Sessions...988machine # [ 7.918201] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.989machine # [ 7.933220] systemd[1]: Finished Permit User Sessions.990machine # [ 7.935944] systemd[1]: Started Getty on tty1.991machine # [ 7.937438] systemd[1]: Reached target Login Prompts.992machine # [ 8.146768] cfg80211: Loading compiled-in X.509 certificates for regulatory database993machine # [ 8.169187] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'994machine # [ 8.170417] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'995machine # [ 8.172265] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2996machine # [ 8.173507] cfg80211: failed to load regulatory.db997machine # [ 8.040668] postgresql-pre-start[710]: The files belonging to this database system will be owned by user "postgres".998machine # [ 8.041295] postgresql-pre-start[710]: This user must also own the server process.999machine # [ 8.044782] postgresql-pre-start[710]: The database cluster will be initialized with locale "en_US.UTF-8".1000machine # [ 8.045460] postgresql-pre-start[710]: The default database encoding has accordingly been set to "UTF8".1001machine # [ 8.045809] postgresql-pre-start[710]: The default text search configuration will be set to "english".1002machine # [ 8.046568] postgresql-pre-start[710]: Data page checksums are enabled.1003machine # [ 8.047185] postgresql-pre-start[710]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok1004machine # [ 8.047814] postgresql-pre-start[710]: creating subdirectories ... ok1005machine # [ 8.048563] postgresql-pre-start[710]: selecting dynamic shared memory implementation ... posix1006machine # [ 8.217822] 8021q: adding VLAN 0 to HW filter on device eth01007machine # [ 8.066214] dhcpcd[684]: eth0: waiting for carrier1008machine # [ 8.066930] dhcpcd[684]: eth0: carrier acquired1009machine # [ 8.075882] dhcpcd[684]: DUID 00:01:00:01:32:4d:51:e5:52:54:00:12:34:561010machine # [ 8.076668] dhcpcd[684]: eth0: IAID 00:12:34:561011machine # [ 8.077218] dhcpcd[684]: eth0: adding address fe80::5054:ff:fe12:34561012machine # [ 8.103936] postgresql-pre-start[710]: selecting default "max_connections" ... 1001013machine # [ 8.149682] postgresql-pre-start[710]: selecting default "shared_buffers" ... 128MB1014machine # [ 8.355385] dhcpcd[684]: eth0: soliciting a DHCP lease1015machine # [ 8.518700] NET: Registered PF_PACKET protocol family1016machine # [ 8.378819] dhcpcd[684]: eth0: offered 10.0.2.15 from 10.0.2.21017machine # [ 8.391206] dhcpcd[684]: eth0: probing address 10.0.2.15/241018machine # [ 8.876214] postgresql-pre-start[710]: selecting default time zone ... UTC1019machine # [ 8.878076] postgresql-pre-start[710]: creating configuration files ... ok1020machine # [ 9.056898] postgresql-pre-start[710]: running bootstrap script ... ok1021machine # [ 9.247976] dhcpcd[684]: eth0: soliciting an IPv6 router1022machine # [ 9.248556] dhcpcd[684]: eth0: Router Advertisement from fe80::21023machine # [ 9.248688] dhcpcd[684]: eth0: adding address fec0::5054:ff:fe12:3456/641024machine # [ 9.248910] dhcpcd[684]: eth0: adding route to fec0::/641025machine # [ 9.249407] dhcpcd[684]: eth0: adding default route via fe80::21026machine # [ 9.432811] postgresql-pre-start[710]: performing post-bootstrap initialization ... ok1027machine # [ 9.601203] postgresql-pre-start[710]: syncing data to disk ... ok1028machine # [ 9.602437] postgresql-pre-start[710]: initdb: warning: enabling "trust" authentication for local connections1029machine # [ 9.603467] postgresql-pre-start[710]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1030machine # [ 9.604632] postgresql-pre-start[710]: Success. You can now start the database server using:1031machine # [ 9.605775] postgresql-pre-start[710]: pg_ctl -D /var/lib/postgresql/18 -l logfile start1032machine # [ 9.714326] postgres[748]: [748] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1033machine # [ 9.718838] postgres[748]: [748] LOG: listening on IPv6 address "::1", port 54321034machine # [ 9.720083] postgres[748]: [748] LOG: listening on IPv4 address "127.0.0.1", port 54321035machine # [ 9.721882] postgres[748]: [748] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1036machine # [ 9.733980] postgres[757]: [757] LOG: database system was shut down at 2026-09-28 16:27:18 GMT1037machine # [ 9.745649] postgres[748]: [748] LOG: database system is ready to accept connections1038machine # [ 9.749796] systemd[1]: Started PostgreSQL Server.1039machine # [ 9.755475] systemd[1]: Starting PostgreSQL Setup Scripts...1040machine # [ 9.992647] postgresql-setup-start[776]: CREATE DATABASE1041machine # [ 10.040541] postgresql-setup-start[782]: CREATE ROLE1042machine # [ 10.065514] postgresql-setup-start[784]: ALTER DATABASE1043machine # [ 10.071540] systemd[1]: Finished PostgreSQL Setup Scripts.1044machine # [ 10.072784] systemd[1]: Reached target PostgreSQL.1045machine # [ 13.588202] dhcpcd[684]: eth0: leased 10.0.2.15 for 86400 seconds1046machine # [ 13.589513] dhcpcd[684]: eth0: adding route to 10.0.2.0/241047machine # [ 13.590234] dhcpcd[684]: eth0: adding default route via 10.0.2.21048machine # [ 13.717492] systemd[1]: Started DHCP Client.1049machine # [ 13.719772] systemd[1]: Reached target Network is Online.1050machine # [ 13.723127] systemd[1]: Starting k3s service...1051machine # [ 13.799901] k3s[875]: time="2026-09-28T16:27:22Z" level=info msg="Acquiring lock file /var/lib/rancher/k3s/data/.lock"1052machine # [ 13.801436] k3s[875]: time="2026-09-28T16:27:22Z" level=info msg="Preparing data dir /var/lib/rancher/k3s/data/05fb32d1d5d79ab4bf8f805d07e4a7dfb491001fd5137b587aa471efd4746099"1053machine # [ 15.938247] k3s[875]: time="2026-09-28T16:27:24Z" level=info msg="Starting k3s 1.35.8+k3s1 (e952d68a)"1054machine # [ 15.955115] k3s[875]: time="2026-09-28T16:27:24Z" level=info msg="Configuring sqlite3 database connection pooling: maxIdle=20, maxOpen=0, maxLifetime=0s, maxIdleTime=2m0s"1055machine # [ 15.960110] k3s[875]: time="2026-09-28T16:27:24Z" level=info msg="Kine built with sqlite from github.com/mattn/go-sqlite3 version 3.53.3"1056machine # [ 15.961515] k3s[875]: time="2026-09-28T16:27:24Z" level=info msg="Configuring database table schema and indexes, this may take a moment..."1057machine # [ 15.982282] k3s[875]: time="2026-09-28T16:27:24Z" level=info msg="Database tables and indexes are up to date"1058machine # [ 15.984174] k3s[875]: time="2026-09-28T16:27:24Z" level=info msg="Running startup VACUUM to reclaim disk space, this may take a moment..."1059machine # [ 15.993195] k3s[875]: time="2026-09-28T16:27:24Z" level=info msg="Startup VACUUM completed successfully"1060machine # [ 15.996304] k3s[875]: time="2026-09-28T16:27:24Z" level=info msg="Kine available at unix://kine.sock"1061machine # [ 15.998198] k3s[875]: time="2026-09-28T16:27:24Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]"1062machine # [ 16.006305] k3s[875]: time="2026-09-28T16:27:24Z" level=info msg="Datastore connection validated successfully, proceeding with bootstrap data generation"1063machine # [ 16.008242] k3s[875]: time="2026-09-28T16:27:24Z" level=info msg="generated self-signed CA certificate CN=k3s-client-ca@1790612844: notBefore=2026-09-28 15:27:24.972445798 +0000 UTC notAfter=2036-09-25 15:27:24.972445798 +0000 UTC"1064machine # [ 16.009377] k3s[875]: time="2026-09-28T16:27:24Z" level=info msg="certificate CN=system:admin,O=system:masters signed by CN=k3s-client-ca@1790612844: notBefore=2026-09-28 15:27:24 +0000 UTC notAfter=2027-09-28 15:27:24 +0000 UTC"1065machine # [ 16.010584] k3s[875]: time="2026-09-28T16:27:24Z" level=info msg="certificate CN=system:k3s-supervisor,O=system:masters signed by CN=k3s-client-ca@1790612844: notBefore=2026-09-28 15:27:24 +0000 UTC notAfter=2027-09-28 15:27:24 +0000 UTC"1066machine # [ 16.012149] k3s[875]: time="2026-09-28T16:27:24Z" level=info msg="certificate CN=system:kube-controller-manager signed by CN=k3s-client-ca@1790612844: notBefore=2026-09-28 15:27:24 +0000 UTC notAfter=2027-09-28 15:27:24 +0000 UTC"1067machine # [ 16.012859] k3s[875]: time="2026-09-28T16:27:24Z" level=info msg="certificate CN=system:kube-scheduler signed by CN=k3s-client-ca@1790612844: notBefore=2026-09-28 15:27:24 +0000 UTC notAfter=2027-09-28 15:27:24 +0000 UTC"1068machine # [ 16.014431] k3s[875]: time="2026-09-28T16:27:24Z" level=info msg="certificate CN=system:apiserver,O=system:masters signed by CN=k3s-client-ca@1790612844: notBefore=2026-09-28 15:27:24 +0000 UTC notAfter=2027-09-28 15:27:24 +0000 UTC"1069machine # [ 16.015965] k3s[875]: time="2026-09-28T16:27:24Z" level=info msg="certificate CN=k3s-cloud-controller-manager signed by CN=k3s-client-ca@1790612844: notBefore=2026-09-28 15:27:24 +0000 UTC notAfter=2027-09-28 15:27:24 +0000 UTC"1070machine # [ 16.017972] k3s[875]: time="2026-09-28T16:27:24Z" level=info msg="generated self-signed CA certificate CN=k3s-server-ca@1790612844: notBefore=2026-09-28 15:27:24.979920212 +0000 UTC notAfter=2036-09-25 15:27:24.979920212 +0000 UTC"1071machine # [ 16.019335] k3s[875]: time="2026-09-28T16:27:24Z" level=info msg="certificate CN=kube-apiserver signed by CN=k3s-server-ca@1790612844: notBefore=2026-09-28 15:27:24 +0000 UTC notAfter=2027-09-28 15:27:24 +0000 UTC"1072machine # [ 16.019951] k3s[875]: time="2026-09-28T16:27:24Z" level=info msg="certificate CN=kube-scheduler signed by CN=k3s-server-ca@1790612844: notBefore=2026-09-28 15:27:24 +0000 UTC notAfter=2027-09-28 15:27:24 +0000 UTC"1073machine # [ 16.020944] k3s[875]: time="2026-09-28T16:27:24Z" level=info msg="certificate CN=kube-controller-manager signed by CN=k3s-server-ca@1790612844: notBefore=2026-09-28 15:27:24 +0000 UTC notAfter=2027-09-28 15:27:24 +0000 UTC"1074machine # [ 16.022217] k3s[875]: time="2026-09-28T16:27:24Z" level=info msg="generated self-signed CA certificate CN=k3s-request-header-ca@1790612844: notBefore=2026-09-28 15:27:24.983752822 +0000 UTC notAfter=2036-09-25 15:27:24.983752822 +0000 UTC"1075machine # [ 16.023189] k3s[875]: time="2026-09-28T16:27:24Z" level=info msg="certificate CN=system:auth-proxy signed by CN=k3s-request-header-ca@1790612844: notBefore=2026-09-28 15:27:24 +0000 UTC notAfter=2027-09-28 15:27:24 +0000 UTC"1076machine # [ 16.024068] k3s[875]: time="2026-09-28T16:27:24Z" level=info msg="generated self-signed CA certificate CN=etcd-server-ca@1790612844: notBefore=2026-09-28 15:27:24.985504441 +0000 UTC notAfter=2036-09-25 15:27:24.985504441 +0000 UTC"1077machine # [ 16.025080] k3s[875]: time="2026-09-28T16:27:24Z" level=info msg="certificate CN=etcd-client signed by CN=etcd-server-ca@1790612844: notBefore=2026-09-28 15:27:24 +0000 UTC notAfter=2027-09-28 15:27:24 +0000 UTC"1078machine # [ 16.025630] k3s[875]: time="2026-09-28T16:27:24Z" level=info msg="generated self-signed CA certificate CN=etcd-peer-ca@1790612844: notBefore=2026-09-28 15:27:24.987195438 +0000 UTC notAfter=2036-09-25 15:27:24.987195438 +0000 UTC"1079machine # [ 16.026566] k3s[875]: time="2026-09-28T16:27:24Z" level=info msg="certificate CN=etcd-peer signed by CN=etcd-peer-ca@1790612844: notBefore=2026-09-28 15:27:24 +0000 UTC notAfter=2027-09-28 15:27:24 +0000 UTC"1080machine # [ 16.027820] k3s[875]: time="2026-09-28T16:27:24Z" level=info msg="certificate CN=etcd-server signed by CN=etcd-server-ca@1790612844: notBefore=2026-09-28 15:27:24 +0000 UTC notAfter=2027-09-28 15:27:24 +0000 UTC"1081machine # [ 16.089219] k3s[875]: time="2026-09-28T16:27:25Z" level=info msg="certificate CN=k3s,O=k3s signed by CN=k3s-server-ca@1790612844: notBefore=2026-09-28 15:27:25 +0000 UTC notAfter=2027-09-28 15:27:25 +0000 UTC"1082machine # [ 16.090555] k3s[875]: time="2026-09-28T16:27:25Z" level=warning msg="dynamiclistener [::]:6443: no cached certificate available for preload - deferring certificate load until storage initialization or first client request"1083machine # [ 16.099641] k3s[875]: time="2026-09-28T16:27:25Z" level=info msg="Active TLS secret / (ver=) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__c4c5_e68f_e56e_8e4a-f18c00:fec0::c4c5:e68f:e56e:8e4a listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=CF7B01353344884E1E7A1D37C445E5FE378DD9C4]"1084machine # [ 16.279632] rustfs-bucket-start[905]: mb s3://farm1085machine # [ 16.289564] systemd[1]: Finished rustfs-bucket.service.1086machine # [ 16.939473] k3s[875]: time="2026-09-28T16:27:25Z" level=info msg="Password verified locally for node machine"1087machine # [ 16.940494] k3s[875]: time="2026-09-28T16:27:25Z" level=info msg="certificate CN=machine signed by CN=k3s-server-ca@1790612844: notBefore=2026-09-28 15:27:25 +0000 UTC notAfter=2027-09-28 15:27:25 +0000 UTC"1088machine # [ 17.207759] k3s[875]: time="2026-09-28T16:27:26Z" level=info msg="certificate CN=system:node:machine,O=system:nodes signed by CN=k3s-client-ca@1790612844: notBefore=2026-09-28 15:27:26 +0000 UTC notAfter=2027-09-28 15:27:26 +0000 UTC"1089machine # [ 17.279157] k3s[875]: time="2026-09-28T16:27:26Z" level=info msg="certificate CN=system:kube-proxy signed by CN=k3s-client-ca@1790612844: notBefore=2026-09-28 15:27:26 +0000 UTC notAfter=2027-09-28 15:27:26 +0000 UTC"1090machine # [ 17.379154] k3s[875]: time="2026-09-28T16:27:26Z" level=info msg="certificate CN=system:k3s-controller signed by CN=k3s-client-ca@1790612844: notBefore=2026-09-28 15:27:26 +0000 UTC notAfter=2027-09-28 15:27:26 +0000 UTC"1091machine # [ 17.481365] k3s[875]: time="2026-09-28T16:27:26Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:57354: runtime core not ready"1092machine # [ 17.563227] k3s[875]: time="2026-09-28T16:27:26Z" level=info msg="Module overlay was already loaded"1093machine # [ 17.803305] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this.1094machine # [ 17.807509] Bridge firewalling registered1095machine # [ 17.662784] k3s[875]: time="2026-09-28T16:27:26Z" level=warning msg="Failed to load kernel module iptable_nat with modprobe"1096machine # [ 17.672565] k3s[875]: time="2026-09-28T16:27:26Z" level=warning msg="Failed to load kernel module iptable_filter with modprobe"1097machine # [ 17.680567] k3s[875]: time="2026-09-28T16:27:26Z" level=warning msg="Failed to load kernel module nft-expr-counter with modprobe"1098machine # [ 17.745467] k3s[875]: time="2026-09-28T16:27:26Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600"1099machine # [ 17.747258] k3s[875]: time="2026-09-28T16:27:26Z" level=info msg="Set sysctl 'net/ipv4/conf/all/forwarding' to 1"1100machine # [ 17.748642] k3s[875]: time="2026-09-28T16:27:26Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_max' to 131072"1101machine # [ 17.750110] k3s[875]: time="2026-09-28T16:27:26Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400"1102machine # [ 17.751838] k3s[875]: time="2026-09-28T16:27:26Z" level=info msg="Creating k3s-cert-monitor event broadcaster"1103machine # [ 17.753227] k3s[875]: time="2026-09-28T16:27:26Z" level=info msg="Connecting to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect"1104machine # [ 17.754912] k3s[875]: time="2026-09-28T16:27:26Z" level=info msg="Saving cluster bootstrap data to datastore"1105machine # [ 17.756284] k3s[875]: time="2026-09-28T16:27:26Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]"1106machine # [ 17.757912] k3s[875]: time="2026-09-28T16:27:26Z" level=info msg="Polling for API server readiness: GET /readyz failed: the server is currently unable to handle the request"1107machine # [ 17.759961] k3s[875]: time="2026-09-28T16:27:26Z" level=info msg="Connection to etcd is ready"1108machine # [ 17.761161] k3s[875]: time="2026-09-28T16:27:26Z" level=info msg="ETCD server is now running"1109machine # [ 17.762308] k3s[875]: time="2026-09-28T16:27:26Z" level=info msg="Handling backend connection request [machine]"1110machine # [ 17.763755] k3s[875]: time="2026-09-28T16:27:26Z" level=info msg="Connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect"1111machine # [ 17.765235] k3s[875]: time="2026-09-28T16:27:26Z" level=info msg="Remotedialer connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect"1112machine # [ 17.767132] k3s[875]: time="2026-09-28T16:27:26Z" level=info msg="Running kube-apiserver --advertise-port=6443 --allow-privileged=true --anonymous-auth=false --api-audiences=https://kubernetes.default.svc.cluster.local,k3s --authorization-mode=Node,RBAC --bind-address=127.0.0.1 --cert-dir=/var/lib/rancher/k3s/server/tls/temporary-certs --client-ca-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --egress-selector-config-file=/var/lib/rancher/k3s/server/etc/egress-selector-config.yaml --enable-admission-plugins=NodeRestriction --enable-aggregator-routing=true --enable-bootstrap-token-auth=true --etcd-servers=unix://kine.sock --kubelet-certificate-authority=/var/lib/rancher/k3s/server/tls/server-ca.crt --kubelet-client-certificate=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.crt --kubelet-client-key=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.key --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --profiling=false --proxy-client-cert-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt --proxy-client-key-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.key --requestheader-allowed-names=system:auth-proxy --requestheader-client-ca-file=/var/lib/rancher/k3s/server/tls/request-header-ca.crt --requestheader-extra-headers-prefix=X-Remote-Extra- --requestheader-group-headers=X-Remote-Group --requestheader-username-headers=X-Remote-User --secure-port=6444 --service-account-issuer=https://kubernetes.default.svc.cluster.local --service-account-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-account-signing-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --storage-backend=etcd3 --tls-cert-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --tls-private-key-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key"1113machine # [ 17.789746] k3s[875]: time="2026-09-28T16:27:26Z" level=info msg="Running kube-scheduler --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --bind-address=127.0.0.1 --kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --leader-elect=false --profiling=false --secure-port=10259 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key"1114machine # [ 17.795821] k3s[875]: I0928 16:27:26.725416 875 options.go:263] external host was not specified, using 10.0.2.151115machine # [ 17.797770] k3s[875]: time="2026-09-28T16:27:26Z" level=info msg="Running kube-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --bind-address=127.0.0.1 --cluster-cidr=10.42.0.0/16 --cluster-signing-kube-apiserver-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kube-apiserver-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kubelet-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-serving-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-kubelet-serving-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --cluster-signing-legacy-unknown-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-legacy-unknown-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --configure-cloud-routes=false --controllers=*,tokencleaner,-service,-route,-cloud-node-lifecycle --kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --leader-elect=false --profiling=false --root-ca-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --secure-port=10257 --service-account-private-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key --use-service-account-credentials=true"1116machine # [ 17.816308] k3s[875]: I0928 16:27:26.727489 875 server.go:158] Version: v1.35.8+k3s11117machine # [ 17.817504] k3s[875]: I0928 16:27:26.727517 875 server.go:160] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""1118machine # [ 17.818928] k3s[875]: time="2026-09-28T16:27:26Z" level=info msg="Running cloud-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --bind-address=127.0.0.1 --cloud-config=/var/lib/rancher/k3s/server/etc/cloud-config.yaml --cloud-provider=k3s --cluster-cidr=10.42.0.0/16 --configure-cloud-routes=false --controllers=*,-route --kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --leader-elect=false --leader-elect-resource-name=k3s-cloud-controller-manager --node-status-update-frequency=1m0s --profiling=false"1119machine # [ 17.826164] k3s[875]: time="2026-09-28T16:27:26Z" level=info msg="Server node token is available at /var/lib/rancher/k3s/server/token"1120machine # [ 17.827731] k3s[875]: time="2026-09-28T16:27:26Z" level=info msg="To join server node to cluster: k3s server -s https://10.0.2.15:6443 -t ${SERVER_NODE_TOKEN}"1121machine # [ 17.829525] k3s[875]: time="2026-09-28T16:27:26Z" level=info msg="Agent node token is available at /var/lib/rancher/k3s/server/agent-token"1122machine # [ 17.831126] k3s[875]: time="2026-09-28T16:27:26Z" level=info msg="To join agent node to cluster: k3s agent -s https://10.0.2.15:6443 -t ${AGENT_NODE_TOKEN}"1123machine # [ 17.832825] k3s[875]: time="2026-09-28T16:27:26Z" level=info msg="Wrote kubeconfig /etc/rancher/k3s/k3s.yaml"1124machine # [ 17.834103] k3s[875]: time="2026-09-28T16:27:26Z" level=info msg="Run: k3s kubectl"1125machine # [ 17.835139] k3s[875]: time="2026-09-28T16:27:26Z" level=info msg="Logging containerd to /var/lib/rancher/k3s/agent/containerd/containerd.log"1126machine # [ 17.836729] k3s[875]: time="2026-09-28T16:27:26Z" level=info msg="Running containerd -c /var/lib/rancher/k3s/agent/etc/containerd/config.toml"1127machine # [ 17.838444] k3s[875]: time="2026-09-28T16:27:26Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:57420: runtime core not ready"1128machine # [ 17.940771] k3s[875]: time="2026-09-28T16:27:26Z" level=info msg="Running kube-proxy --cluster-cidr=10.42.0.0/16 --conntrack-max-per-core=0 --conntrack-tcp-timeout-close-wait=0s --conntrack-tcp-timeout-established=0s --healthz-bind-address=127.0.0.1 --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubeproxy.kubeconfig --proxy-mode=iptables"1129machine # [ 18.024846] k3s[875]: I0928 16:27:26.989875 875 shared_informer.go:349] "Waiting for caches to sync" controller="node_authorizer"1130machine # [ 18.029587] k3s[875]: I0928 16:27:26.994711 875 shared_informer.go:370] "Waiting for caches to sync"1131machine # [ 18.033398] k3s[875]: I0928 16:27:26.997654 875 plugins.go:157] Loaded 14 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,PodTopologyLabels,MutatingAdmissionPolicy,MutatingAdmissionWebhook.1132machine # [ 18.039365] k3s[875]: I0928 16:27:26.997673 875 plugins.go:160] Loaded 14 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,NodeDeclaredFeatureValidator,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota.1133machine # [ 18.044216] k3s[875]: I0928 16:27:26.997983 875 instance.go:240] Using reconciler: lease1134machine # [ 18.045431] k3s[875]: I0928 16:27:27.004563 875 handler.go:304] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager1135machine # [ 18.047071] k3s[875]: W0928 16:27:27.004595 875 genericapiserver.go:787] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources.1136machine # [ 18.048856] k3s[875]: I0928 16:27:27.007577 875 cidrallocator.go:198] starting ServiceCIDR Allocator Controller1137machine # [ 18.085020] k3s[875]: I0928 16:27:27.050126 875 handler.go:304] Adding GroupVersion v1 to ResourceManager1138machine # [ 18.085671] k3s[875]: I0928 16:27:27.050387 875 apis.go:112] API group "internal.apiserver.k8s.io" is not enabled, skipping.1139machine # [ 18.107114] k3s[875]: I0928 16:27:27.072285 875 apis.go:112] API group "storagemigration.k8s.io" is not enabled, skipping.1140machine # [ 18.135375] k3s[875]: I0928 16:27:27.100502 875 handler.go:304] Adding GroupVersion authentication.k8s.io v1 to ResourceManager1141machine # [ 18.135930] k3s[875]: W0928 16:27:27.100532 875 genericapiserver.go:787] Skipping API authentication.k8s.io/v1beta1 because it has no resources.1142machine # [ 18.136516] k3s[875]: W0928 16:27:27.100543 875 genericapiserver.go:787] Skipping API authentication.k8s.io/v1alpha1 because it has no resources.1143machine # [ 18.137053] k3s[875]: I0928 16:27:27.100866 875 handler.go:304] Adding GroupVersion authorization.k8s.io v1 to ResourceManager1144machine # [ 18.137455] k3s[875]: W0928 16:27:27.100881 875 genericapiserver.go:787] Skipping API authorization.k8s.io/v1beta1 because it has no resources.1145machine # [ 18.137957] k3s[875]: I0928 16:27:27.101455 875 handler.go:304] Adding GroupVersion autoscaling v2 to ResourceManager1146machine # [ 18.138557] k3s[875]: I0928 16:27:27.101986 875 handler.go:304] Adding GroupVersion autoscaling v1 to ResourceManager1147machine # [ 18.139081] k3s[875]: W0928 16:27:27.102003 875 genericapiserver.go:787] Skipping API autoscaling/v2beta1 because it has no resources.1148machine # [ 18.139519] k3s[875]: W0928 16:27:27.102014 875 genericapiserver.go:787] Skipping API autoscaling/v2beta2 because it has no resources.1149machine # [ 18.140069] k3s[875]: I0928 16:27:27.103027 875 handler.go:304] Adding GroupVersion batch v1 to ResourceManager1150machine # [ 18.140474] k3s[875]: W0928 16:27:27.103045 875 genericapiserver.go:787] Skipping API batch/v1beta1 because it has no resources.1151machine # [ 18.140981] k3s[875]: I0928 16:27:27.103549 875 handler.go:304] Adding GroupVersion certificates.k8s.io v1 to ResourceManager1152machine # [ 18.141582] k3s[875]: W0928 16:27:27.103566 875 genericapiserver.go:787] Skipping API certificates.k8s.io/v1beta1 because it has no resources.1153machine # [ 18.142092] k3s[875]: W0928 16:27:27.103577 875 genericapiserver.go:787] Skipping API certificates.k8s.io/v1alpha1 because it has no resources.1154machine # [ 18.142527] k3s[875]: I0928 16:27:27.103929 875 handler.go:304] Adding GroupVersion coordination.k8s.io v1 to ResourceManager1155machine # [ 18.143057] k3s[875]: W0928 16:27:27.103945 875 genericapiserver.go:787] Skipping API coordination.k8s.io/v1beta1 because it has no resources.1156machine # [ 18.143488] k3s[875]: W0928 16:27:27.103956 875 genericapiserver.go:787] Skipping API coordination.k8s.io/v1alpha2 because it has no resources.1157machine # [ 18.143996] k3s[875]: I0928 16:27:27.104317 875 handler.go:304] Adding GroupVersion discovery.k8s.io v1 to ResourceManager1158machine # [ 18.144451] k3s[875]: W0928 16:27:27.104334 875 genericapiserver.go:787] Skipping API discovery.k8s.io/v1beta1 because it has no resources.1159machine # [ 18.144988] k3s[875]: I0928 16:27:27.105719 875 handler.go:304] Adding GroupVersion networking.k8s.io v1 to ResourceManager1160machine # [ 18.145553] k3s[875]: W0928 16:27:27.105736 875 genericapiserver.go:787] Skipping API networking.k8s.io/v1beta1 because it has no resources.1161machine # [ 18.146068] k3s[875]: I0928 16:27:27.106030 875 handler.go:304] Adding GroupVersion node.k8s.io v1 to ResourceManager1162machine # [ 18.146652] k3s[875]: W0928 16:27:27.106045 875 genericapiserver.go:787] Skipping API node.k8s.io/v1beta1 because it has no resources.1163machine # [ 18.147172] k3s[875]: W0928 16:27:27.106056 875 genericapiserver.go:787] Skipping API node.k8s.io/v1alpha1 because it has no resources.1164machine # [ 18.147603] k3s[875]: I0928 16:27:27.106520 875 handler.go:304] Adding GroupVersion policy v1 to ResourceManager1165machine # [ 18.148127] k3s[875]: W0928 16:27:27.106537 875 genericapiserver.go:787] Skipping API policy/v1beta1 because it has no resources.1166machine # [ 18.148565] k3s[875]: I0928 16:27:27.107517 875 handler.go:304] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager1167machine # [ 18.149089] k3s[875]: W0928 16:27:27.107534 875 genericapiserver.go:787] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources.1168machine # [ 18.149537] k3s[875]: W0928 16:27:27.107545 875 genericapiserver.go:787] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources.1169machine # [ 18.150062] k3s[875]: I0928 16:27:27.107794 875 handler.go:304] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager1170machine # [ 18.150501] k3s[875]: W0928 16:27:27.107807 875 genericapiserver.go:787] Skipping API scheduling.k8s.io/v1beta1 because it has no resources.1171machine # [ 18.151024] k3s[875]: W0928 16:27:27.107818 875 genericapiserver.go:787] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources.1172machine # [ 18.151469] k3s[875]: I0928 16:27:27.109449 875 handler.go:304] Adding GroupVersion storage.k8s.io v1 to ResourceManager1173machine # [ 18.151995] k3s[875]: W0928 16:27:27.109478 875 genericapiserver.go:787] Skipping API storage.k8s.io/v1beta1 because it has no resources.1174machine # [ 18.152433] k3s[875]: W0928 16:27:27.109490 875 genericapiserver.go:787] Skipping API storage.k8s.io/v1alpha1 because it has no resources.1175machine # [ 18.152950] k3s[875]: I0928 16:27:27.110055 875 handler.go:304] Adding GroupVersion flowcontrol.apiserver.k8s.io v1 to ResourceManager1176machine # [ 18.153543] k3s[875]: W0928 16:27:27.110071 875 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta3 because it has no resources.1177machine # [ 18.154074] k3s[875]: W0928 16:27:27.110082 875 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta2 because it has no resources.1178machine # [ 18.154513] k3s[875]: W0928 16:27:27.110093 875 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources.1179machine # [ 18.155064] k3s[875]: I0928 16:27:27.111799 875 handler.go:304] Adding GroupVersion apps v1 to ResourceManager1180machine # [ 18.155469] k3s[875]: W0928 16:27:27.111817 875 genericapiserver.go:787] Skipping API apps/v1beta2 because it has no resources.1181machine # [ 18.155970] k3s[875]: W0928 16:27:27.111829 875 genericapiserver.go:787] Skipping API apps/v1beta1 because it has no resources.1182machine # [ 18.156571] k3s[875]: I0928 16:27:27.112730 875 handler.go:304] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager1183machine # [ 18.157087] k3s[875]: W0928 16:27:27.112747 875 genericapiserver.go:787] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources.1184machine # [ 18.157522] k3s[875]: W0928 16:27:27.112758 875 genericapiserver.go:787] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources.1185machine # [ 18.158976] k3s[875]: I0928 16:27:27.113035 875 handler.go:304] Adding GroupVersion events.k8s.io v1 to ResourceManager1186machine # [ 18.160370] k3s[875]: W0928 16:27:27.113050 875 genericapiserver.go:787] Skipping API events.k8s.io/v1beta1 because it has no resources.1187machine # [ 18.161627] k3s[875]: I0928 16:27:27.113976 875 handler.go:304] Adding GroupVersion resource.k8s.io v1 to ResourceManager1188machine # [ 18.163070] k3s[875]: W0928 16:27:27.113993 875 genericapiserver.go:787] Skipping API resource.k8s.io/v1beta2 because it has no resources.1189machine # [ 18.164621] k3s[875]: W0928 16:27:27.114005 875 genericapiserver.go:787] Skipping API resource.k8s.io/v1beta1 because it has no resources.1190machine # [ 18.165917] k3s[875]: W0928 16:27:27.114016 875 genericapiserver.go:787] Skipping API resource.k8s.io/v1alpha3 because it has no resources.1191machine # [ 18.167459] k3s[875]: I0928 16:27:27.116202 875 handler.go:304] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager1192machine # [ 18.168714] k3s[875]: W0928 16:27:27.116220 875 genericapiserver.go:787] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources.1193machine # [ 18.489792] k3s[875]: I0928 16:27:27.454658 875 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt"1194machine # [ 18.490503] k3s[875]: I0928 16:27:27.454748 875 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key"1195machine # [ 18.490945] k3s[875]: I0928 16:27:27.454821 875 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt"1196machine # [ 18.491538] k3s[875]: I0928 16:27:27.454937 875 secure_serving.go:211] Serving securely on 127.0.0.1:64441197machine # [ 18.492139] k3s[875]: I0928 16:27:27.455019 875 tlsconfig.go:243] "Starting DynamicServingCertificateController"1198machine # [ 18.492646] k3s[875]: I0928 16:27:27.455153 875 aggregator.go:185] waiting for initial CRD sync...1199machine # [ 18.493153] k3s[875]: I0928 16:27:27.455177 875 controller.go:78] Starting OpenAPI AggregationController1200machine # [ 18.493585] k3s[875]: I0928 16:27:27.455397 875 customresource_discovery_controller.go:294] Starting DiscoveryController1201machine # [ 18.494229] k3s[875]: I0928 16:27:27.455454 875 system_namespaces_controller.go:66] Starting system namespaces controller1202machine # [ 18.495420] k3s[875]: I0928 16:27:27.460334 875 dynamic_serving_content.go:135] "Starting controller" name="aggregator-proxy-cert::/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt::/var/lib/rancher/k3s/server/tls/client-auth-proxy.key"1203machine # [ 18.496138] k3s[875]: I0928 16:27:27.460453 875 remote_available_controller.go:425] Starting RemoteAvailability controller1204machine # [ 18.496549] k3s[875]: I0928 16:27:27.460468 875 cache.go:32] Waiting for caches to sync for RemoteAvailability controller1205machine # [ 18.497081] k3s[875]: I0928 16:27:27.460508 875 apiservice_controller.go:100] Starting APIServiceRegistrationController1206machine # [ 18.497514] k3s[875]: I0928 16:27:27.460519 875 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller1207machine # [ 18.513109] k3s[875]: time="2026-09-28T16:27:27Z" level=info msg="Starting apiserver lease garbage collector" logger=k3s1208machine # [ 18.513730] k3s[875]: time="2026-09-28T16:27:27Z" level=info msg="Waiting for caches to sync" logger=k3s1209machine # [ 18.515101] k3s[875]: time="2026-09-28T16:27:27Z" level=info msg="Starting legacy_token_tracking_controller" logger=k3s1210machine # [ 18.515729] k3s[875]: time="2026-09-28T16:27:27Z" level=info msg="Waiting for caches to sync" logger=k3s1211machine # [ 18.516366] k3s[875]: I0928 16:27:27.475867 875 crdregistration_controller.go:114] Starting crd-autoregister controller1212machine # [ 18.516868] k3s[875]: I0928 16:27:27.475883 875 shared_informer.go:349] "Waiting for caches to sync" controller="crd-autoregister"1213machine # [ 18.517473] k3s[875]: I0928 16:27:27.475950 875 controller.go:142] Starting OpenAPI controller1214machine # [ 18.517966] k3s[875]: I0928 16:27:27.475997 875 controller.go:90] Starting OpenAPI V3 controller1215machine # [ 18.518575] k3s[875]: I0928 16:27:27.476019 875 naming_controller.go:305] Starting NamingConditionController1216machine # [ 18.519080] k3s[875]: I0928 16:27:27.476069 875 nonstructuralschema_controller.go:202] Starting NonStructuralSchemaConditionController1217machine # [ 18.519519] k3s[875]: I0928 16:27:27.476092 875 apiapproval_controller.go:196] Starting KubernetesAPIApprovalPolicyConformantConditionController1218machine # [ 18.520043] k3s[875]: I0928 16:27:27.476113 875 crd_finalizer.go:273] Starting CRDFinalizer1219machine # [ 18.520470] k3s[875]: I0928 16:27:27.476174 875 repairip.go:210] Starting ipallocator-repair-controller1220machine # [ 18.520973] k3s[875]: I0928 16:27:27.476184 875 shared_informer.go:349] "Waiting for caches to sync" controller="ipallocator-repair-controller"1221machine # [ 18.521576] k3s[875]: I0928 16:27:27.476541 875 local_available_controller.go:156] Starting LocalAvailability controller1222machine # [ 18.522086] k3s[875]: I0928 16:27:27.476558 875 cache.go:32] Waiting for caches to sync for LocalAvailability controller1223machine # [ 18.522520] k3s[875]: I0928 16:27:27.476622 875 controller.go:113] "Deleting old lease on startup" lease="kube-system/apiserver-ik4pcwfs7qgdl76byc4pomgvia"1224machine # [ 18.523038] k3s[875]: I0928 16:27:27.476911 875 default_servicecidr_controller.go:110] Starting kubernetes-service-cidr-controller1225machine # [ 18.523471] k3s[875]: I0928 16:27:27.476927 875 shared_informer.go:349] "Waiting for caches to sync" controller="kubernetes-service-cidr-controller"1226machine # [ 18.523995] k3s[875]: I0928 16:27:27.479669 875 apf_controller.go:377] Starting API Priority and Fairness config controller1227machine # [ 18.539124] k3s[875]: I0928 16:27:27.503356 875 controller.go:80] Starting OpenAPI V3 AggregationController1228machine # [ 18.541217] k3s[875]: I0928 16:27:27.506217 875 cluster_authentication_trust_controller.go:459] Starting cluster_authentication_trust_controller controller1229machine # [ 18.541829] k3s[875]: time="2026-09-28T16:27:27Z" level=info msg="Waiting for caches to sync" logger=k3s1230machine # [ 18.542413] k3s[875]: I0928 16:27:27.506356 875 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt"1231machine # [ 18.542944] k3s[875]: I0928 16:27:27.506438 875 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt"1232machine # [ 18.596171] k3s[875]: I0928 16:27:27.561277 875 cache.go:39] Caches are synced for APIServiceRegistrationController controller1233machine # [ 18.596756] k3s[875]: I0928 16:27:27.561317 875 cache.go:39] Caches are synced for RemoteAvailability controller1234machine # [ 18.597205] k3s[875]: I0928 16:27:27.561337 875 handler_discovery.go:451] Starting ResourceDiscoveryManager1235machine # [ 18.611467] k3s[875]: time="2026-09-28T16:27:27Z" level=info msg="Caches are synced" logger=k3s1236machine # [ 18.612248] k3s[875]: time="2026-09-28T16:27:27Z" level=info msg="Caches are synced" logger=k3s1237machine # [ 18.612743] k3s[875]: I0928 16:27:27.576742 875 shared_informer.go:356] "Caches are synced" controller="ipallocator-repair-controller"1238machine # [ 18.613398] k3s[875]: I0928 16:27:27.576862 875 cache.go:39] Caches are synced for LocalAvailability controller1239machine # [ 18.613908] k3s[875]: I0928 16:27:27.577125 875 shared_informer.go:356] "Caches are synced" controller="kubernetes-service-cidr-controller"1240machine # [ 18.614524] k3s[875]: I0928 16:27:27.577151 875 default_servicecidr_controller.go:169] Creating default ServiceCIDR with CIDRs: [10.43.0.0/16]1241machine # [ 18.619254] k3s[875]: I0928 16:27:27.584427 875 apf_controller.go:382] Running API Priority and Fairness config worker1242machine # [ 18.619925] k3s[875]: I0928 16:27:27.584450 875 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process1243machine # [ 18.624947] k3s[875]: I0928 16:27:27.590057 875 shared_informer.go:356] "Caches are synced" controller="node_authorizer"1244machine # [ 18.628863] k3s[875]: E0928 16:27:27.593960 875 controller.go:201] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms"1245machine # [ 18.631215] k3s[875]: I0928 16:27:27.596280 875 shared_informer.go:377] "Caches are synced"1246machine # [ 18.632078] k3s[875]: I0928 16:27:27.596388 875 policy_source.go:248] refreshing policies1247machine # [ 18.638580] k3s[875]: I0928 16:27:27.603676 875 shared_informer.go:356] "Caches are synced" controller="crd-autoregister"1248machine # [ 18.639435] k3s[875]: I0928 16:27:27.603768 875 aggregator.go:187] initial CRD sync complete...1249machine # [ 18.640133] k3s[875]: I0928 16:27:27.603783 875 autoregister_controller.go:144] Starting autoregister controller1250machine # [ 18.640758] k3s[875]: I0928 16:27:27.603798 875 cache.go:32] Waiting for caches to sync for autoregister controller1251machine # [ 18.641389] k3s[875]: I0928 16:27:27.603809 875 cache.go:39] Caches are synced for autoregister controller1252machine # [ 18.645235] k3s[875]: time="2026-09-28T16:27:27Z" level=info msg="Caches are synced" logger=k3s1253machine # [ 18.654806] k3s[875]: I0928 16:27:27.619463 875 controller.go:667] quota admission added evaluator for: namespaces1254machine # [ 18.671068] k3s[875]: E0928 16:27:27.635288 875 controller.go:95] Unable to perform initial Kubernetes service initialization: namespaces "default" not found1255machine # [ 18.717566] k3s[875]: I0928 16:27:27.682676 875 default_servicecidr_controller.go:231] Setting default ServiceCIDR condition Ready to True1256machine # [ 18.719177] k3s[875]: I0928 16:27:27.684321 875 cidrallocator.go:302] created ClusterIP allocator for Service CIDR 10.43.0.0/161257machine # [ 18.723907] k3s[875]: I0928 16:27:27.689005 875 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/161258machine # [ 18.775366] k3s[875]: time="2026-09-28T16:27:27Z" level=info msg="containerd is now running"1259machine # [ 18.782022] k3s[875]: time="2026-09-28T16:27:27Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/k3s-airgap-images-amd64.tar.zst"1260machine # [ 18.832651] k3s[875]: I0928 16:27:27.797764 875 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io1261machine # [ 19.502759] k3s[875]: I0928 16:27:28.467453 875 storage_scheduling.go:123] created PriorityClass system-node-critical with value 20000010001262machine # [ 19.505761] k3s[875]: I0928 16:27:28.470911 875 storage_scheduling.go:123] created PriorityClass system-cluster-critical with value 20000000001263machine # [ 19.507558] k3s[875]: I0928 16:27:28.470934 875 storage_scheduling.go:139] all system priority classes are created successfully or already exist.1264machine # [ 19.755795] k3s[875]: time="2026-09-28T16:27:28Z" level=info msg="Polling for API server readiness: GET /readyz failed: unknown"1265machine # [ 20.582373] k3s[875]: I0928 16:27:29.546984 875 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io1266machine # [ 20.622284] k3s[875]: I0928 16:27:29.587420 875 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io1267machine # [ 20.677161] k3s[875]: I0928 16:27:29.642206 875 alloc.go:329] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.43.0.1"}1268machine # [ 20.681833] k3s[875]: W0928 16:27:29.647006 875 lease.go:265] Resetting endpoints for master service "kubernetes" to [10.0.2.15]1269machine # [ 20.683428] k3s[875]: I0928 16:27:29.648350 875 controller.go:667] quota admission added evaluator for: endpoints1270machine # [ 20.687415] k3s[875]: I0928 16:27:29.652576 875 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io1271machine # [ 21.761739] k3s[875]: time="2026-09-28T16:27:30Z" level=info msg="Kube API server is now running"1272machine # [ 21.765101] k3s[875]: time="2026-09-28T16:27:30Z" level=info msg="k3s is up and running"1273machine # [ 21.767981] k3s[875]: time="2026-09-28T16:27:30Z" level=info msg="Waiting for untainted node"1274machine # [ 21.771120] k3s[875]: time="2026-09-28T16:27:30Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Node and Certificate Authority certificates managed by k3s are OK" object=machine reason=CertificateExpirationOK type=Normal1275machine # [ 21.779380] systemd[1]: Started k3s service.1276machine # [ 21.783697] systemd[1]: Starting niks3 server...1277machine # [ 21.785286] k3s[875]: time="2026-09-28T16:27:30Z" level=info msg="Creating k3s-supervisor event broadcaster"1278machine # [ 21.791535] k3s[875]: I0928 16:27:30.756665 875 controllermanager.go:189] "Starting" version="v1.35.8+k3s1"1279machine # [ 21.795470] k3s[875]: I0928 16:27:30.760443 875 controllermanager.go:191] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""1280machine # [ 21.801216] k3s[875]: I0928 16:27:30.766365 875 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController1281machine # [ 21.803157] k3s[875]: I0928 16:27:30.767563 875 shared_informer.go:370] "Waiting for caches to sync"1282machine # [ 21.804467] k3s[875]: I0928 16:27:30.766395 875 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"1283machine # [ 21.806729] k3s[875]: I0928 16:27:30.767836 875 shared_informer.go:370] "Waiting for caches to sync"1284machine # [ 21.807990] k3s[875]: I0928 16:27:30.766419 875 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"1285machine # [ 21.810389] k3s[875]: I0928 16:27:30.767875 875 shared_informer.go:370] "Waiting for caches to sync"1286machine # [ 21.811682] k3s[875]: I0928 16:27:30.766281 875 secure_serving.go:211] Serving securely on 127.0.0.1:102571287machine # [ 21.813443] k3s[875]: I0928 16:27:30.766462 875 tlsconfig.go:243] "Starting DynamicServingCertificateController"1288machine # [ 21.814944] k3s[875]: I0928 16:27:30.766367 875 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key"1289machine # [ 21.818412] k3s[875]: I0928 16:27:30.783034 875 controller.go:667] quota admission added evaluator for: serviceaccounts1290machine # [ 21.856641] k3s[875]: I0928 16:27:30.821763 875 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" requiredFeatureGates=["ClusterTrustBundle"]1291machine # [ 21.859612] k3s[875]: I0928 16:27:30.821802 875 controllermanager.go:579] "Warning: skipping controller" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller"1292machine # [ 21.864858] k3s[875]: time="2026-09-28T16:27:30Z" level=info msg="Creating embedded CRD addons.k3s.cattle.io"1293machine # [ 21.866308] k3s[875]: I0928 16:27:30.829990 875 node_lifecycle_controller.go:419] "Controller will reconcile labels" logger="node-lifecycle-controller"1294machine # [ 21.868178] k3s[875]: I0928 16:27:30.830075 875 controllermanager.go:627] "Warning: controller is disabled" controller="service-lb-controller"1295machine # [ 21.869906] k3s[875]: I0928 16:27:30.832177 875 shared_informer.go:370] "Waiting for caches to sync"1296machine # [ 21.871214] k3s[875]: time="2026-09-28T16:27:30Z" level=info msg="Creating embedded CRD etcdsnapshotfiles.k3s.cattle.io"1297machine # [ 21.872820] k3s[875]: time="2026-09-28T16:27:30Z" level=info msg="Creating embedded CRD helmchartconfigs.helm.cattle.io"1298machine # [ 21.879447] k3s[875]: time="2026-09-28T16:27:30Z" level=info msg="Creating embedded CRD helmcharts.helm.cattle.io"1299machine # [ 21.888808] k3s[875]: I0928 16:27:30.853453 875 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager1300machine # [ 21.895295] k3s[875]: time="2026-09-28T16:27:30Z" level=info msg="Waiting for CRD etcdsnapshotfiles.k3s.cattle.io to become available"1301machine # [ 21.903532] k3s[875]: I0928 16:27:30.867898 875 shared_informer.go:377] "Caches are synced"1302machine # [ 21.904471] k3s[875]: I0928 16:27:30.867944 875 shared_informer.go:377] "Caches are synced"1303machine # [ 21.904923] k3s[875]: I0928 16:27:30.868519 875 shared_informer.go:377] "Caches are synced"1304machine # [ 21.905601] k3s[875]: I0928 16:27:30.869421 875 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager1305machine # [ 21.908831] k3s[875]: I0928 16:27:30.873640 875 controllermanager.go:627] "Warning: controller is disabled" controller="bootstrap-signer-controller"1306machine # [ 21.915265] k3s[875]: I0928 16:27:30.880316 875 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager1307machine # [ 21.927173] k3s[875]: I0928 16:27:30.892332 875 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager1308machine # [ 21.967398] k3s[875]: I0928 16:27:30.932523 875 shared_informer.go:377] "Caches are synced"1309machine # [ 22.031723] k3s[875]: time="2026-09-28T16:27:30Z" level=info msg="Imported docker.io/rancher/klipper-helm:v0.13.3-build20260727"1310machine # [ 22.035433] k3s[875]: time="2026-09-28T16:27:31Z" level=info msg="Tagged docker.io/rancher/klipper-helm@sha256:5425a2b4613d2458dbdff99218e8d487ebb59c20e7a941f061c0777070f0aac1"1311machine # [ 22.036315] k3s[875]: time="2026-09-28T16:27:31Z" level=info msg="Imported docker.io/rancher/klipper-lb:v0.4.17"1312machine # [ 22.042919] k3s[875]: time="2026-09-28T16:27:31Z" level=info msg="Tagged docker.io/rancher/klipper-lb@sha256:910944bb0bd94f060a82a56ca1ea1c577d3e49b3473a093a47a985f32e92d94a"1313machine # [ 22.043713] k3s[875]: time="2026-09-28T16:27:31Z" level=info msg="Imported docker.io/rancher/local-path-provisioner:v0.0.37"1314machine # [ 22.052166] k3s[875]: time="2026-09-28T16:27:31Z" level=info msg="Tagged docker.io/rancher/local-path-provisioner@sha256:e757967a5ec338f6a9b371c5a9688bedaa8c3578ea3dd4db329ea0084be0a86f"1315machine # [ 22.052939] k3s[875]: time="2026-09-28T16:27:31Z" level=info msg="Imported docker.io/rancher/mirrored-coredns-coredns:1.14.6"1316machine # [ 22.056474] k3s[875]: time="2026-09-28T16:27:31Z" level=info msg="Tagged docker.io/rancher/mirrored-coredns-coredns@sha256:900f9c109f7a33545d3c811516e8376df9019147b750f5ce3e254468769176ea"1317machine # [ 22.057272] k3s[875]: time="2026-09-28T16:27:31Z" level=info msg="Imported docker.io/rancher/mirrored-library-busybox:1.37.0"1318machine # [ 22.063587] k3s[875]: time="2026-09-28T16:27:31Z" level=info msg="Tagged docker.io/rancher/mirrored-library-busybox@sha256:101b4afd76732482eff9b95cae5f94bcf295e521fbec4e01b69c5421f3f3f3e5"1319machine # [ 22.064475] k3s[875]: time="2026-09-28T16:27:31Z" level=info msg="Imported docker.io/rancher/mirrored-library-traefik:3.7.8"1320machine # [ 22.068196] k3s[875]: time="2026-09-28T16:27:31Z" level=info msg="Tagged docker.io/rancher/mirrored-library-traefik@sha256:4299bbed850421258fc5448c2e0e6ad350981d4d335a68de11b92448aedbefe5"1321machine # [ 22.068849] k3s[875]: time="2026-09-28T16:27:31Z" level=info msg="Imported docker.io/rancher/mirrored-metrics-server:v0.9.0"1322machine # [ 22.074178] k3s[875]: time="2026-09-28T16:27:31Z" level=info msg="Tagged docker.io/rancher/mirrored-metrics-server@sha256:d9862115e7c7881280d3d75ca26bda8ffc0fc213315979575bf23ce9826205c0"1323machine # [ 22.074550] k3s[875]: time="2026-09-28T16:27:31Z" level=info msg="Imported docker.io/rancher/mirrored-pause:3.10.2"1324machine # [ 22.076662] k3s[875]: time="2026-09-28T16:27:31Z" level=info msg="Tagged docker.io/rancher/mirrored-pause@sha256:f548e0e8e3dc1896ca956272154dde3314e8cc4fde0a57577ee9fa1c63f5baf4"1325machine # [ 22.362291] k3s[875]: time="2026-09-28T16:27:31Z" level=info msg="Imported 8 images from /var/lib/rancher/k3s/agent/images/k3s-airgap-images-amd64.tar.zst in 3.580363147s"1326machine # [ 22.363950] k3s[875]: time="2026-09-28T16:27:31Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-client.tar"1327machine # [ 22.407031] k3s[875]: time="2026-09-28T16:27:31Z" level=info msg="Done waiting for CRD etcdsnapshotfiles.k3s.cattle.io to become available"1328machine # [ 22.407733] k3s[875]: time="2026-09-28T16:27:31Z" level=info msg="Waiting for CRD helmchartconfigs.helm.cattle.io to become available"1329machine # [ 22.412070] k3s[875]: time="2026-09-28T16:27:31Z" level=info msg="Done waiting for CRD helmchartconfigs.helm.cattle.io to become available"1330machine # [ 22.412712] k3s[875]: time="2026-09-28T16:27:31Z" level=info msg="Waiting for CRD helmcharts.helm.cattle.io to become available"1331machine # [ 22.420329] k3s[875]: time="2026-09-28T16:27:31Z" level=info msg="Done waiting for CRD helmcharts.helm.cattle.io to become available"1332machine: (finished: waiting for unit k3s.service, in 23.29 seconds)1333machine # [ 22.422220] k3s[875]: time="2026-09-28T16:27:31Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-40.1.4+up40.1.0.tgz"1334machine: waiting for success: kubectl get ns farm1335machine # [ 22.424927] k3s[875]: time="2026-09-28T16:27:31Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-crd-40.1.4+up40.1.0.tgz"1336machine # [ 22.427446] k3s[875]: time="2026-09-28T16:27:31Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/ccm.yaml"1337machine # [ 22.428489] k3s[875]: time="2026-09-28T16:27:31Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/coredns.yaml"1338machine # [ 22.429455] k3s[875]: time="2026-09-28T16:27:31Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/local-storage.yaml"1339machine # [ 22.430140] k3s[875]: time="2026-09-28T16:27:31Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/rolebindings.yaml"1340machine # [ 22.431043] k3s[875]: time="2026-09-28T16:27:31Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/runtimes.yaml"1341machine # [ 22.431958] k3s[875]: time="2026-09-28T16:27:31Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/traefik.yaml"1342machine # [ 22.564915] k3s[875]: I0928 16:27:31.530042 875 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="storageversion-garbage-collector-controller" requiredFeatureGates=["APIServerIdentity","StorageVersionAPI"]1343machine # [ 22.566324] k3s[875]: I0928 16:27:31.530077 875 controllermanager.go:579] "Warning: skipping controller" controller="storageversion-garbage-collector-controller"1344machine # [ 22.566975] k3s[875]: time="2026-09-28T16:27:31Z" level=info msg="Starting dynamiclistener CN filter node controller with SANs: [127.0.0.1 ::1 localhost machine 10.0.2.15 fec0::c4c5:e68f:e56e:8e4a 10.43.0.1 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local]"1345machine # [ 22.567868] k3s[875]: time="2026-09-28T16:27:31Z" level=info msg="Tunnel server egress proxy mode: agent"1346machine # Error from server (NotFound): namespaces "farm" not found1347machine # [ 22.865520] k3s[875]: I0928 16:27:31.830283 875 controllermanager.go:627] "Warning: controller is disabled" controller="selinux-warning-controller"1348machine # [ 23.091234] k3s[875]: time="2026-09-28T16:27:32Z" level=info msg="Creating new TLS secret for kube-system/k3s-serving (count: 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__c4c5_e68f_e56e_8e4a-f18c00:fec0::c4c5:e68f:e56e:8e4a listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=CF7B01353344884E1E7A1D37C445E5FE378DD9C4]"1349machine # [ 23.109315] k3s[875]: time="2026-09-28T16:27:32Z" level=info msg="Active TLS secret kube-system/k3s-serving (ver=236) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__c4c5_e68f_e56e_8e4a-f18c00:fec0::c4c5:e68f:e56e:8e4a listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=CF7B01353344884E1E7A1D37C445E5FE378DD9C4]"1350machine # [ 23.366268] k3s[875]: I0928 16:27:32.331325 875 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="device-taint-eviction-controller" requiredFeatureGates=["DynamicResourceAllocation","DRADeviceTaints"]1351machine # [ 23.368369] k3s[875]: I0928 16:27:32.331402 875 controllermanager.go:579] "Warning: skipping controller" controller="device-taint-eviction-controller"1352machine # Error from server (NotFound): namespaces "farm" not found1353machine # [ 23.777176] k3s[875]: time="2026-09-28T16:27:32Z" level=info msg="Starting k3s.cattle.io/v1, Kind=Addon controller"1354machine # [ 23.778261] k3s[875]: time="2026-09-28T16:27:32Z" level=info msg="Creating deploy event broadcaster"1355machine # [ 23.781690] k3s[875]: I0928 16:27:32.746809 875 controller.go:667] quota admission added evaluator for: addons.k3s.cattle.io1356machine # [ 23.784096] k3s[875]: time="2026-09-28T16:27:32Z" level=info msg="Starting /v1, Kind=Node controller"1357machine # [ 23.786025] k3s[875]: time="2026-09-28T16:27:32Z" level=info msg="Creating helm-controller event broadcaster"1358machine # [ 23.790949] k3s[875]: time="2026-09-28T16:27:32Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=ApplyingManifest type=Normal1359machine # [ 23.792114] k3s[875]: time="2026-09-28T16:27:32Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found"1360machine # [ 23.802767] k3s[875]: time="2026-09-28T16:27:32Z" level=info msg="Cluster dns configmap has been set successfully"1361machine # [ 24.124111] k3s[875]: time="2026-09-28T16:27:33Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=AppliedManifest type=Normal1362machine # [ 24.138314] k3s[875]: time="2026-09-28T16:27:33Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=ApplyingManifest type=Normal1363machine # [ 24.470447] k3s[875]: time="2026-09-28T16:27:33Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=AppliedManifest type=Normal1364machine # [ 24.486834] k3s[875]: time="2026-09-28T16:27:33Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=ApplyingManifest type=Normal1365machine # [ 24.792082] k3s[875]: time="2026-09-28T16:27:33Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found"1366machine # [ 24.871665] k3s[875]: W0928 16:27:33.835172 875 probe.go:272] Flexvolume plugin directory at /usr/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating.1367machine # [ 24.872513] k3s[875]: I0928 16:27:33.835671 875 controllermanager.go:579] "Warning: skipping controller" controller="storage-version-migrator-controller"1368machine # [ 24.918330] k3s[875]: I0928 16:27:33.883404 875 serving.go:392] Generated self-signed cert in-memory1369machine: (finished: waiting for success: kubectl get ns farm, in 2.55 seconds)1370machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key1371machine # [ 25.016284] k3s[875]: I0928 16:27:33.981424 875 controllermanager.go:627] "Warning: controller is disabled" controller="node-route-controller"1372machine # [ 25.079677] k3s[875]: I0928 16:27:34.044734 875 serving.go:392] Generated self-signed cert in-memory1373machine # [ 25.105066] k3s[875]: time="2026-09-28T16:27:34Z" level=info msg="Starting rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding controller"1374machine # [ 25.110048] k3s[875]: time="2026-09-28T16:27:34Z" level=info msg="Starting /v1, Kind=Secret controller"1375machine # [ 25.110684] k3s[875]: time="2026-09-28T16:27:34Z" level=info msg="Starting /v1, Kind=ServiceAccount controller"1376machine # [ 25.111212] k3s[875]: time="2026-09-28T16:27:34Z" level=info msg="Starting /v1, Kind=ConfigMap controller"1377machine # [ 25.111686] k3s[875]: time="2026-09-28T16:27:34Z" level=info msg="Starting batch/v1, Kind=Job controller"1378machine # [ 25.115040] k3s[875]: time="2026-09-28T16:27:34Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChartConfig controller"1379machine # [ 25.115712] k3s[875]: time="2026-09-28T16:27:34Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChart controller"1380machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key, in 0.15 seconds)1381machine: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key1382machine # [ 25.189133] k3s[875]: I0928 16:27:34.153977 875 controllermanager.go:160] Version: v1.35.8+k3s11383machine # [ 25.191742] k3s[875]: I0928 16:27:34.156908 875 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController1384machine # [ 25.193248] k3s[875]: I0928 16:27:34.156949 875 shared_informer.go:370] "Waiting for caches to sync"1385machine # [ 25.193695] k3s[875]: I0928 16:27:34.156907 875 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"1386machine # [ 25.195718] k3s[875]: I0928 16:27:34.160291 875 shared_informer.go:370] "Waiting for caches to sync"1387machine # [ 25.196559] k3s[875]: I0928 16:27:34.159007 875 secure_serving.go:211] Serving securely on 127.0.0.1:102581388machine # [ 25.197144] k3s[875]: I0928 16:27:34.159028 875 tlsconfig.go:243] "Starting DynamicServingCertificateController"1389machine # [ 25.197703] k3s[875]: I0928 16:27:34.156930 875 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"1390machine # [ 25.198843] k3s[875]: I0928 16:27:34.161330 875 shared_informer.go:370] "Waiting for caches to sync"1391machine # [ 25.199767] k3s[875]: time="2026-09-28T16:27:34Z" level=info msg="Creating service-lb-controller event broadcaster"1392machine # [ 25.210870] k3s[875]: I0928 16:27:34.176016 875 controller.go:667] quota admission added evaluator for: deployments.apps1393machine: (finished: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key, in 0.16 seconds)1394machine: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt1395machine # [ 25.292846] k3s[875]: I0928 16:27:34.257980 875 shared_informer.go:377] "Caches are synced"1396machine # [ 25.295227] k3s[875]: I0928 16:27:34.260360 875 shared_informer.go:377] "Caches are synced"1397machine # [ 25.296445] k3s[875]: I0928 16:27:34.261615 875 shared_informer.go:377] "Caches are synced"1398machine # [ 25.324806] k3s[875]: I0928 16:27:34.289951 875 alloc.go:329] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.43.0.10"}1399machine # [ 25.325948] k3s[875]: time="2026-09-28T16:27:34Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=AppliedManifest type=Normal1400machine: (finished: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.15 seconds)1401subtest: chart deploys and workers become Ready1402machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s1403machine # [ 25.469569] k3s[875]: I0928 16:27:34.434638 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="controllerrevisions.apps"1404machine # [ 25.472234] k3s[875]: I0928 16:27:34.434680 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="horizontalpodautoscalers.autoscaling"1405machine # [ 25.474939] k3s[875]: I0928 16:27:34.434711 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="ingresses.networking.k8s.io"1406machine # [ 25.477608] k3s[875]: I0928 16:27:34.434771 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmchartconfigs.helm.cattle.io"1407machine # [ 25.480192] k3s[875]: I0928 16:27:34.434805 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpoints"1408machine # [ 25.482363] k3s[875]: I0928 16:27:34.434840 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="addons.k3s.cattle.io"1409machine # [ 25.484577] k3s[875]: I0928 16:27:34.434882 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="serviceaccounts"1410machine # [ 25.486884] k3s[875]: I0928 16:27:34.434917 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="replicasets.apps"1411machine # [ 25.489101] k3s[875]: I0928 16:27:34.434938 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="jobs.batch"1412machine # [ 25.491202] k3s[875]: I0928 16:27:34.434963 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="poddisruptionbudgets.policy"1413machine # [ 25.493516] k3s[875]: I0928 16:27:34.435008 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="limitranges"1414machine # [ 25.495812] k3s[875]: I0928 16:27:34.435031 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="networkpolicies.networking.k8s.io"1415machine # [ 25.498238] k3s[875]: I0928 16:27:34.435054 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpointslices.discovery.k8s.io"1416machine # [ 25.500568] k3s[875]: I0928 16:27:34.435077 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="podtemplates"1417machine # [ 25.502854] k3s[875]: I0928 16:27:34.435098 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="deployments.apps"1418machine # [ 25.505122] k3s[875]: I0928 16:27:34.435119 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="roles.rbac.authorization.k8s.io"1419machine # [ 25.507375] k3s[875]: I0928 16:27:34.435153 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="cronjobs.batch"1420machine # [ 25.509449] k3s[875]: I0928 16:27:34.435177 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="csistoragecapacities.storage.k8s.io"1421machine # [ 25.511932] k3s[875]: I0928 16:27:34.435200 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="rolebindings.rbac.authorization.k8s.io"1422machine # [ 25.514434] k3s[875]: I0928 16:27:34.435252 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="leases.coordination.k8s.io"1423machine # [ 25.516863] k3s[875]: I0928 16:27:34.435325 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="daemonsets.apps"1424machine # [ 25.519293] k3s[875]: I0928 16:27:34.435350 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="statefulsets.apps"1425machine # [ 25.520260] k3s[875]: I0928 16:27:34.435373 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="resourceclaimtemplates.resource.k8s.io"1426machine # [ 25.520905] k3s[875]: I0928 16:27:34.435398 875 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmcharts.helm.cattle.io"1427machine # [ 25.521419] k3s[875]: I0928 16:27:34.435419 875 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="podcertificaterequest-cleaner-controller" requiredFeatureGates=["PodCertificateRequest"]1428machine # [ 25.521779] k3s[875]: I0928 16:27:34.435435 875 controllermanager.go:579] "Warning: skipping controller" controller="podcertificaterequest-cleaner-controller"1429machine # [ 25.530407] k3s[875]: time="2026-09-28T16:27:34Z" level=info msg="Starting /v1, Kind=Node controller"1430machine # [ 25.535350] k3s[875]: time="2026-09-28T16:27:34Z" level=info msg="Starting /v1, Kind=Pod controller"1431machine # [ 25.541389] k3s[875]: time="2026-09-28T16:27:34Z" level=info msg="Starting apps/v1, Kind=DaemonSet controller"1432machine # [ 25.549216] k3s[875]: time="2026-09-28T16:27:34Z" level=info msg="Starting discovery.k8s.io/v1, Kind=EndpointSlice controller"1433machine # [ 25.550836] k3s[875]: I0928 16:27:34.514539 875 controllermanager.go:329] Started "cloud-node-controller"1434machine # [ 25.552179] k3s[875]: I0928 16:27:34.514657 875 controllermanager.go:329] Started "cloud-node-lifecycle-controller"1435machine # [ 25.553701] k3s[875]: I0928 16:27:34.514693 875 node_controller.go:176] Sending events to api server.1436machine # [ 25.555057] k3s[875]: I0928 16:27:34.514749 875 node_controller.go:185] Waiting for informer caches to sync1437machine # [ 25.556401] k3s[875]: I0928 16:27:34.514821 875 node_lifecycle_controller.go:112] Sending events to api server1438machine # [ 25.557827] k3s[875]: I0928 16:27:34.514963 875 controllermanager.go:329] Started "service-lb-controller"1439machine # [ 25.559179] k3s[875]: W0928 16:27:34.514977 875 controllermanager.go:306] "node-route-controller" is disabled1440machine # [ 25.560654] k3s[875]: I0928 16:27:34.515414 875 controller.go:235] Starting service controller1441machine # [ 25.561936] k3s[875]: I0928 16:27:34.515437 875 shared_informer.go:370] "Waiting for caches to sync"1442machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found1443machine # [ 25.787676] k3s[875]: time="2026-09-28T16:27:34Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found"1444machine # [ 26.006050] k3s[875]: I0928 16:27:34.971150 875 range_allocator.go:113] "No Secondary Service CIDR provided. Skipping filtering out secondary service addresses" logger="node-ipam-controller"1445machine # [ 26.006471] k3s[875]: I0928 16:27:34.971208 875 controllermanager.go:627] "Warning: controller is disabled" controller="cloud-node-lifecycle-controller"1446machine # [ 26.050535] k3s[875]: I0928 16:27:35.015586 875 shared_informer.go:377] "Caches are synced"1447machine # [ 26.368709] k3s[875]: I0928 16:27:35.333447 875 replica_set.go:241] "Starting controller" name="replicationcontroller"1448machine # [ 26.369269] k3s[875]: I0928 16:27:35.333484 875 shared_informer.go:370] "Waiting for caches to sync"1449machine # [ 26.369772] k3s[875]: I0928 16:27:35.334106 875 endpointslice_controller.go:283] "Starting endpoint slice controller"1450machine # [ 26.370403] k3s[875]: I0928 16:27:35.334131 875 shared_informer.go:370] "Waiting for caches to sync"1451machine # [ 26.370923] k3s[875]: I0928 16:27:35.334222 875 daemon_controller.go:309] "Starting daemon sets controller"1452machine # [ 26.371831] k3s[875]: I0928 16:27:35.334383 875 shared_informer.go:370] "Waiting for caches to sync"1453machine # [ 26.372679] k3s[875]: I0928 16:27:35.334927 875 ttlafterfinished_controller.go:112] "Starting TTL after finished controller"1454machine # [ 26.373758] k3s[875]: I0928 16:27:35.334942 875 shared_informer.go:370] "Waiting for caches to sync"1455machine # [ 26.374769] k3s[875]: I0928 16:27:35.335023 875 controller.go:423] "Starting resource claim controller"1456machine # [ 26.375361] k3s[875]: I0928 16:27:35.335037 875 shared_informer.go:370] "Waiting for caches to sync"1457machine # [ 26.376244] k3s[875]: I0928 16:27:35.335202 875 clusterroleaggregation_controller.go:194] "Starting ClusterRoleAggregator controller"1458machine # [ 26.376923] k3s[875]: I0928 16:27:35.335214 875 shared_informer.go:370] "Waiting for caches to sync"1459machine # [ 26.377599] k3s[875]: I0928 16:27:35.335273 875 pv_protection_controller.go:81] "Starting PV protection controller"1460machine # [ 26.378182] k3s[875]: I0928 16:27:35.335289 875 shared_informer.go:370] "Waiting for caches to sync"1461machine # [ 26.378690] k3s[875]: I0928 16:27:35.335335 875 legacy_serviceaccount_token_cleaner.go:103] "Starting legacy service account token cleaner controller"1462machine # [ 26.379411] k3s[875]: I0928 16:27:35.335348 875 shared_informer.go:370] "Waiting for caches to sync"1463machine # [ 26.379974] k3s[875]: I0928 16:27:35.335413 875 servicecidrs_controller.go:136] "Starting" controller="service-cidr-controller"1464machine # [ 26.380644] k3s[875]: I0928 16:27:35.335427 875 shared_informer.go:370] "Waiting for caches to sync"1465machine # [ 26.381202] k3s[875]: I0928 16:27:35.335458 875 serviceaccounts_controller.go:117] "Starting service account controller"1466machine # [ 26.381715] k3s[875]: I0928 16:27:35.335470 875 shared_informer.go:370] "Waiting for caches to sync"1467machine # [ 26.382415] k3s[875]: I0928 16:27:35.335531 875 replica_set.go:241] "Starting controller" name="replicaset"1468machine # [ 26.383039] k3s[875]: I0928 16:27:35.335545 875 shared_informer.go:370] "Waiting for caches to sync"1469machine # [ 26.383522] k3s[875]: I0928 16:27:35.335573 875 disruption.go:458] "Sending events to api server."1470machine # [ 26.384133] k3s[875]: I0928 16:27:35.335599 875 disruption.go:465] "Starting disruption controller"1471machine # [ 26.384630] k3s[875]: I0928 16:27:35.335609 875 shared_informer.go:370] "Waiting for caches to sync"1472machine # [ 26.385186] k3s[875]: I0928 16:27:35.335645 875 shared_informer.go:370] "Waiting for caches to sync"1473machine # [ 26.385673] k3s[875]: I0928 16:27:35.335681 875 namespace_controller.go:202] "Starting namespace controller"1474machine # [ 26.386210] k3s[875]: I0928 16:27:35.335693 875 shared_informer.go:370] "Waiting for caches to sync"1475machine # [ 26.386671] k3s[875]: I0928 16:27:35.335727 875 tokencleaner.go:117] "Starting token cleaner controller"1476machine # [ 26.387404] k3s[875]: I0928 16:27:35.335740 875 shared_informer.go:370] "Waiting for caches to sync"1477machine # [ 26.387957] k3s[875]: I0928 16:27:35.335809 875 pv_controller_base.go:307] "Starting persistent volume controller"1478machine # [ 26.388623] k3s[875]: I0928 16:27:35.335822 875 shared_informer.go:370] "Waiting for caches to sync"1479machine # [ 26.389143] k3s[875]: I0928 16:27:35.335862 875 publisher.go:107] "Starting root CA cert publisher controller"1480machine # [ 26.389673] k3s[875]: I0928 16:27:35.335876 875 shared_informer.go:370] "Waiting for caches to sync"1481machine # [ 26.390205] k3s[875]: I0928 16:27:35.335912 875 taint_eviction.go:283] "Starting" controller="taint-eviction-controller"1482machine # [ 26.390731] k3s[875]: I0928 16:27:35.335955 875 taint_eviction.go:288] "Sending events to API server"1483machine # [ 26.391472] k3s[875]: I0928 16:27:35.335965 875 shared_informer.go:370] "Waiting for caches to sync"1484machine # [ 26.392053] k3s[875]: I0928 16:27:35.336027 875 endpointslicemirroring_controller.go:226] "Starting EndpointSliceMirroring controller"1485machine # [ 26.392501] k3s[875]: I0928 16:27:35.336040 875 shared_informer.go:370] "Waiting for caches to sync"1486machine # [ 26.393068] k3s[875]: I0928 16:27:35.336102 875 stateful_set.go:180] "Starting stateful set controller"1487machine # [ 26.393553] k3s[875]: I0928 16:27:35.336114 875 shared_informer.go:370] "Waiting for caches to sync"1488machine # [ 26.394111] k3s[875]: I0928 16:27:35.336156 875 certificate_controller.go:120] "Starting certificate controller" name="csrapproving"1489machine # [ 26.394614] k3s[875]: I0928 16:27:35.336169 875 shared_informer.go:370] "Waiting for caches to sync"1490machine # [ 26.394803] k3s[875]: I0928 16:27:35.336197 875 cleaner.go:83] "Starting CSR cleaner controller"1491machine # [ 26.395475] k3s[875]: I0928 16:27:35.336316 875 attach_detach_controller.go:335] "Starting attach detach controller"1492machine # [ 26.396045] k3s[875]: I0928 16:27:35.336329 875 shared_informer.go:370] "Waiting for caches to sync"1493machine # [ 26.396553] k3s[875]: I0928 16:27:35.336357 875 ttl_controller.go:127] "Starting TTL controller"1494machine # [ 26.397128] k3s[875]: I0928 16:27:35.336369 875 shared_informer.go:370] "Waiting for caches to sync"1495machine # [ 26.397656] k3s[875]: I0928 16:27:35.336398 875 gc_controller.go:98] "Starting GC controller"1496machine # [ 26.398201] k3s[875]: I0928 16:27:35.336410 875 shared_informer.go:370] "Waiting for caches to sync"1497machine # [ 26.398667] k3s[875]: I0928 16:27:35.336649 875 node_ipam_controller.go:142] "Starting ipam controller"1498machine # [ 26.399216] k3s[875]: I0928 16:27:35.336663 875 shared_informer.go:370] "Waiting for caches to sync"1499machine # [ 26.399720] k3s[875]: I0928 16:27:35.336691 875 expand_controller.go:328] "Starting expand controller"1500machine # [ 26.400454] k3s[875]: I0928 16:27:35.336704 875 shared_informer.go:370] "Waiting for caches to sync"1501machine # [ 26.400785] k3s[875]: I0928 16:27:35.336732 875 pvc_protection_controller.go:166] "Starting PVC protection controller"1502machine # [ 26.401466] k3s[875]: I0928 16:27:35.336745 875 shared_informer.go:370] "Waiting for caches to sync"1503machine # [ 26.402058] k3s[875]: I0928 16:27:35.336786 875 controller.go:174] "Starting ephemeral volume controller"1504machine # [ 26.402519] k3s[875]: I0928 16:27:35.336830 875 shared_informer.go:370] "Waiting for caches to sync"1505machine # [ 26.403112] k3s[875]: I0928 16:27:35.336899 875 endpoints_controller.go:193] "Starting endpoint controller"1506machine # [ 26.403571] k3s[875]: I0928 16:27:35.336911 875 shared_informer.go:370] "Waiting for caches to sync"1507machine # [ 26.404141] k3s[875]: I0928 16:27:35.337075 875 horizontal.go:204] "Starting HPA controller"1508machine # [ 26.404578] k3s[875]: I0928 16:27:35.337088 875 shared_informer.go:370] "Waiting for caches to sync"1509machine # [ 26.404817] k3s[875]: I0928 16:27:35.340721 875 shared_informer.go:370] "Waiting for caches to sync"1510machine # [ 26.405405] k3s[875]: I0928 16:27:35.340816 875 job_controller.go:254] "Starting job controller"1511machine # [ 26.405744] k3s[875]: I0928 16:27:35.340830 875 shared_informer.go:370] "Waiting for caches to sync"1512machine # [ 26.406457] k3s[875]: I0928 16:27:35.340906 875 deployment_controller.go:172] "Starting controller" controller="deployment"1513machine # [ 26.407690] k3s[875]: I0928 16:27:35.340920 875 shared_informer.go:370] "Waiting for caches to sync"1514machine # [ 26.408640] k3s[875]: I0928 16:27:35.340991 875 cronjob_controllerv2.go:143] "Starting cronjob controller v2"1515machine # [ 26.410031] k3s[875]: I0928 16:27:35.341003 875 shared_informer.go:370] "Waiting for caches to sync"1516machine # [ 26.411052] k3s[875]: I0928 16:27:35.341048 875 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-legacy-unknown"1517machine # [ 26.412745] k3s[875]: I0928 16:27:35.341062 875 shared_informer.go:370] "Waiting for caches to sync"1518machine # [ 26.414127] k3s[875]: I0928 16:27:35.341094 875 vac_protection_controller.go:206] "Starting VAC protection controller"1519machine # [ 26.415401] k3s[875]: I0928 16:27:35.341106 875 shared_informer.go:370] "Waiting for caches to sync"1520machine # [ 26.416505] k3s[875]: I0928 16:27:35.341160 875 node_lifecycle_controller.go:453] "Sending events to api server"1521machine # [ 26.417502] k3s[875]: I0928 16:27:35.341184 875 node_lifecycle_controller.go:460] "Starting node controller"1522machine # [ 26.418686] k3s[875]: I0928 16:27:35.341194 875 shared_informer.go:370] "Waiting for caches to sync"1523machine # [ 26.419933] k3s[875]: I0928 16:27:35.341980 875 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-serving"1524machine # [ 26.421592] k3s[875]: I0928 16:27:35.341996 875 shared_informer.go:370] "Waiting for caches to sync"1525machine # [ 26.422884] k3s[875]: I0928 16:27:35.342027 875 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-client"1526machine # [ 26.424429] k3s[875]: I0928 16:27:35.342040 875 shared_informer.go:370] "Waiting for caches to sync"1527machine # [ 26.425591] k3s[875]: I0928 16:27:35.342072 875 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kube-apiserver-client"1528machine # [ 26.427069] k3s[875]: I0928 16:27:35.342085 875 shared_informer.go:370] "Waiting for caches to sync"1529machine # [ 26.428204] k3s[875]: I0928 16:27:35.344525 875 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key"1530machine # [ 26.430600] k3s[875]: I0928 16:27:35.345075 875 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key"1531machine # [ 26.470421] k3s[875]: I0928 16:27:35.345252 875 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key"1532machine # [ 26.471122] k3s[875]: I0928 16:27:35.345323 875 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key"1533machine # [ 26.471648] k3s[875]: I0928 16:27:35.349033 875 garbagecollector.go:141] "Starting controller" controller="garbagecollector"1534machine # [ 26.472215] k3s[875]: I0928 16:27:35.349064 875 shared_informer.go:370] "Waiting for caches to sync"1535machine # [ 26.472703] k3s[875]: I0928 16:27:35.349176 875 resource_quota_controller.go:297] "Starting resource quota controller"1536machine # [ 26.473398] k3s[875]: I0928 16:27:35.349189 875 shared_informer.go:370] "Waiting for caches to sync"1537machine # [ 26.473779] k3s[875]: I0928 16:27:35.349312 875 graph_builder.go:386] "Running" component="GraphBuilder"1538machine # [ 26.474476] k3s[875]: I0928 16:27:35.349338 875 resource_quota_monitor.go:309] "QuotaMonitor running"1539machine # [ 26.475030] k3s[875]: I0928 16:27:35.369510 875 shared_informer.go:370] "Waiting for caches to sync"1540machine # [ 26.475539] k3s[875]: I0928 16:27:35.440003 875 shared_informer.go:370] "Waiting for caches to sync"1541machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found1542machine # [ 26.786443] k3s[875]: time="2026-09-28T16:27:35Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found"1543machine # [ 27.031092] k3s[875]: time="2026-09-28T16:27:35Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" object=kube-system/local-storage reason=DeletingManifest type=Normal1544machine # [ 27.039735] k3s[875]: time="2026-09-28T16:27:36Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=ApplyingManifest type=Normal1545machine # [ 27.068505] k3s[875]: I0928 16:27:36.033660 875 shared_informer.go:377] "Caches are synced"1546machine # [ 27.069099] k3s[875]: I0928 16:27:36.034282 875 shared_informer.go:377] "Caches are synced"1547machine # [ 27.069678] k3s[875]: I0928 16:27:36.034452 875 shared_informer.go:377] "Caches are synced"1548machine # [ 27.074063] k3s[875]: I0928 16:27:36.036482 875 shared_informer.go:377] "Caches are synced"1549machine # [ 27.074643] k3s[875]: I0928 16:27:36.036549 875 shared_informer.go:377] "Caches are synced"1550machine # [ 27.075222] k3s[875]: I0928 16:27:36.036588 875 shared_informer.go:377] "Caches are synced"1551machine # [ 27.075669] k3s[875]: I0928 16:27:36.036656 875 shared_informer.go:377] "Caches are synced"1552machine # [ 27.076351] k3s[875]: I0928 16:27:36.037193 875 shared_informer.go:377] "Caches are synced"1553machine # [ 27.076922] k3s[875]: I0928 16:27:36.037257 875 shared_informer.go:377] "Caches are synced"1554machine # [ 27.077593] k3s[875]: I0928 16:27:36.037291 875 shared_informer.go:377] "Caches are synced"1555machine # [ 27.078123] k3s[875]: I0928 16:27:36.037516 875 shared_informer.go:377] "Caches are synced"1556machine # [ 27.078624] k3s[875]: I0928 16:27:36.037729 875 shared_informer.go:377] "Caches are synced"1557machine # [ 27.079238] k3s[875]: I0928 16:27:36.037948 875 shared_informer.go:377] "Caches are synced"1558machine # [ 27.079719] k3s[875]: I0928 16:27:36.037978 875 shared_informer.go:377] "Caches are synced"1559machine # [ 27.080382] k3s[875]: I0928 16:27:36.038006 875 shared_informer.go:377] "Caches are synced"1560machine # [ 27.080918] k3s[875]: I0928 16:27:36.038043 875 shared_informer.go:377] "Caches are synced"1561machine # [ 27.081579] k3s[875]: I0928 16:27:36.038084 875 shared_informer.go:377] "Caches are synced"1562machine # [ 27.082326] k3s[875]: I0928 16:27:36.038124 875 shared_informer.go:377] "Caches are synced"1563machine # [ 27.082821] k3s[875]: I0928 16:27:36.038323 875 shared_informer.go:377] "Caches are synced"1564machine # [ 27.083900] k3s[875]: I0928 16:27:36.038547 875 shared_informer.go:377] "Caches are synced"1565machine # [ 27.084508] k3s[875]: I0928 16:27:36.038591 875 shared_informer.go:377] "Caches are synced"1566machine # [ 27.085093] k3s[875]: I0928 16:27:36.038677 875 shared_informer.go:377] "Caches are synced"1567machine # [ 27.085553] k3s[875]: I0928 16:27:36.038706 875 shared_informer.go:377] "Caches are synced"1568machine # [ 27.085758] k3s[875]: I0928 16:27:36.038739 875 shared_informer.go:377] "Caches are synced"1569machine # [ 27.088089] k3s[875]: I0928 16:27:36.038833 875 shared_informer.go:377] "Caches are synced"1570machine # [ 27.088663] k3s[875]: I0928 16:27:36.042030 875 shared_informer.go:377] "Caches are synced"1571machine # [ 27.089184] k3s[875]: I0928 16:27:36.042072 875 range_allocator.go:177] "Sending events to api server"1572machine # [ 27.089663] k3s[875]: I0928 16:27:36.042108 875 range_allocator.go:181] "Starting range CIDR allocator"1573machine # [ 27.090213] k3s[875]: I0928 16:27:36.042119 875 shared_informer.go:370] "Waiting for caches to sync"1574machine # [ 27.090736] k3s[875]: I0928 16:27:36.042129 875 shared_informer.go:377] "Caches are synced"1575machine # [ 27.091586] k3s[875]: I0928 16:27:36.042216 875 shared_informer.go:377] "Caches are synced"1576machine # [ 27.092033] k3s[875]: I0928 16:27:36.042275 875 shared_informer.go:377] "Caches are synced"1577machine # [ 27.092526] k3s[875]: I0928 16:27:36.042316 875 shared_informer.go:377] "Caches are synced"1578machine # [ 27.093658] k3s[875]: I0928 16:27:36.049340 875 shared_informer.go:377] "Caches are synced"1579machine # [ 27.094120] k3s[875]: I0928 16:27:36.052002 875 shared_informer.go:377] "Caches are synced"1580machine # [ 27.111440] k3s[875]: I0928 16:27:36.074501 875 shared_informer.go:377] "Caches are synced"1581machine # [ 27.112150] k3s[875]: I0928 16:27:36.074585 875 shared_informer.go:377] "Caches are synced"1582machine # [ 27.112638] k3s[875]: I0928 16:27:36.074635 875 shared_informer.go:377] "Caches are synced"1583machine # [ 27.113193] k3s[875]: I0928 16:27:36.075266 875 shared_informer.go:377] "Caches are synced"1584machine # [ 27.113692] k3s[875]: I0928 16:27:36.075304 875 shared_informer.go:377] "Caches are synced"1585machine # [ 27.114361] k3s[875]: I0928 16:27:36.075351 875 shared_informer.go:377] "Caches are synced"1586machine # [ 27.114874] k3s[875]: I0928 16:27:36.075380 875 shared_informer.go:377] "Caches are synced"1587machine # [ 27.115493] k3s[875]: I0928 16:27:36.075449 875 shared_informer.go:377] "Caches are synced"1588machine # [ 27.116023] k3s[875]: I0928 16:27:36.075509 875 shared_informer.go:377] "Caches are synced"1589machine # [ 27.116499] k3s[875]: I0928 16:27:36.075558 875 shared_informer.go:377] "Caches are synced"1590machine # [ 27.117057] k3s[875]: I0928 16:27:36.079430 875 shared_informer.go:377] "Caches are synced"1591machine # [ 27.117528] k3s[875]: I0928 16:27:36.080906 875 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/161592machine # [ 27.122491] k3s[875]: I0928 16:27:36.087644 875 controller.go:667] quota admission added evaluator for: helmcharts.helm.cattle.io1593machine # [ 27.124086] k3s[875]: time="2026-09-28T16:27:36Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Deferred node password secret validation complete" object=machine reason=NodePasswordValidationComplete type=Normal1594machine # [ 27.132598] k3s[875]: I0928 16:27:36.097757 875 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/161595machine # [ 27.135919] k3s[875]: time="2026-09-28T16:27:36Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=AppliedManifest type=Normal1596machine # [ 27.156063] k3s[875]: time="2026-09-28T16:27:36Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=ApplyingManifest type=Normal1597machine # [ 27.268335] k3s[875]: I0928 16:27:36.233406 875 controller.go:667] quota admission added evaluator for: replicasets.apps1598machine # [ 27.276118] k3s[875]: time="2026-09-28T16:27:36Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Applying HelmChart from https://%{KUBERNETES_API}%/static/charts/nix-grpc-farm.tgz using Job kube-system/helm-install-nix-grpc-farm " object=kube-system/nix-grpc-farm reason=ApplyJob type=Normal1599machine # [ 27.294410] k3s[875]: I0928 16:27:36.259511 875 controller.go:667] quota admission added evaluator for: jobs.batch1600machine # [ 27.479797] k3s[875]: time="2026-09-28T16:27:36Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=AppliedManifest type=Normal1601machine # [ 27.481765] k3s[875]: time="2026-09-28T16:27:36Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Resumed synced Job kube-system/helm-install-nix-grpc-farm" object=kube-system/nix-grpc-farm reason=ResumeJob type=Normal1602machine # [ 27.489761] k3s[875]: time="2026-09-28T16:27:36Z" level=error msg="error syncing 'kube-system/nix-grpc-farm': handler helm-controller-chart-registration: failed to resume job: the server rejected our request due to an error in our request, requeuing"1603machine # [ 27.495544] k3s[875]: time="2026-09-28T16:27:36Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=ApplyingManifest type=Normal1604machine # [ 27.575567] k3s[875]: I0928 16:27:36.540551 875 shared_informer.go:377] "Caches are synced"1605machine # [ 27.584453] k3s[875]: I0928 16:27:36.549616 875 shared_informer.go:377] "Caches are synced"1606machine # [ 27.585121] k3s[875]: I0928 16:27:36.549646 875 garbagecollector.go:166] "Garbage collector: all resource monitors have synced"1607machine # [ 27.585629] k3s[875]: I0928 16:27:36.549657 875 garbagecollector.go:169] "Proceeding to collect garbage"1608machine # [ 27.787714] k3s[875]: time="2026-09-28T16:27:36Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found"1609machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found1610machine # [ 28.073093] k3s[875]: time="2026-09-28T16:27:37Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=AppliedManifest type=Normal1611machine # [ 28.424165] postgres[1191]: [1191] ERROR: relation "goose_db_version" does not exist at character 361612machine # [ 28.425602] postgres[1191]: [1191] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC1613machine # [ 28.447916] niks3-server[1182]: 2026/09/28 16:27:37 OK 20241026095416_initial_model.sql (12.26ms)1614machine # [ 28.451904] niks3-server[1182]: 2026/09/28 16:27:37 OK 20251210153512_drop_unused_gin_index.sql (3.08ms)1615machine # [ 28.455302] niks3-server[1182]: 2026/09/28 16:27:37 OK 20251218171726_add_pins.sql (4.13ms)1616machine # [ 28.458576] niks3-server[1182]: 2026/09/28 16:27:37 OK 20260628120000_add_object_size_and_stats.sql (3.23ms)1617machine # [ 28.462370] niks3-server[1182]: 2026/09/28 16:27:37 OK 20260905000000_add_claims.sql (3.73ms)1618machine # [ 28.467064] niks3-server[1182]: 2026/09/28 16:27:37 OK 20260920000000_drop_claims.sql (3.84ms)1619machine # [ 28.468482] niks3-server[1182]: 2026/09/28 16:27:37 OK 20260923120000_add_pushes.sql (2.17ms)1620machine # [ 28.469379] niks3-server[1182]: 2026/09/28 16:27:37 goose: successfully migrated database to version: 202609231200001621machine # [ 28.472513] niks3-server[1182]: 2026/09/28 16:27:37 OK 1_commit_pending_closure.sql (3.19ms)1622machine # [ 28.474312] niks3-server[1182]: 2026/09/28 16:27:37 OK 2_object_stats_trigger.sql (1.73ms)1623machine # [ 28.476146] niks3-server[1182]: 2026/09/28 16:27:37 OK 3_commit_push.sql (1.67ms)1624machine # [ 28.477315] niks3-server[1182]: 2026/09/28 16:27:37 goose: up to current file version: 31625machine # [ 28.480550] niks3-server[1182]: 2026/09/28 16:27:37 INFO OIDC provider initialized name=kubernetes issuer=https://kubernetes.default.svc.cluster.local1626machine # [ 28.481327] niks3-server[1182]: 2026/09/28 16:27:37 INFO OIDC authentication enabled config=/nix/store/v0b0sqyzhrjsz48x3klf7b7vl89apzs0-niks3-oidc.json1627machine # [ 28.482608] niks3-server[1182]: 2026/09/28 16:27:37 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key1628machine # [ 28.514053] niks3-server[1182]: 2026/09/28 16:27:37 INFO Read proxy enabled — serving cache objects from S31629machine # [ 28.515172] niks3-server[1182]: 2026/09/28 16:27:37 INFO Using socket-activated listener address=0.0.0.0:57511630machine # [ 28.515771] niks3-server[1182]: 2026/09/28 16:27:37 INFO systemd watchdog enabled interval=15s1631machine # [ 28.516451] niks3-server[1182]: 2026/09/28 16:27:37 INFO Starting HTTP server address=0.0.0.0:57511632machine # [ 28.517334] systemd[1]: Started niks3 server.1633machine # [ 28.517892] systemd[1]: Reached target Multi-User System.1634machine # [ 28.518516] systemd[1]: Startup finished in 1.206s (kernel) + 3.744s (initrd) + 23.566s (userspace) = 28.517s.1635machine # [ 28.790265] k3s[875]: time="2026-09-28T16:27:37Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found"1636machine # [ 28.926174] k3s[875]: time="2026-09-28T16:27:37Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/traefik.yaml\"" object=kube-system/traefik reason=DeletingManifest type=Normal1637machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found1638machine # [ 29.123028] k3s[875]: time="2026-09-28T16:27:38Z" level=info msg="Imported docker.io/library/nix-grpc-farm-client:0.1.0-beta.4"1639machine # [ 29.125972] k3s[875]: time="2026-09-28T16:27:38Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-client@sha256:08dc4ea710883282b28c151ccc3f4d00681287aef6ae1caf7960e454ec652101"1640machine # [ 29.581742] k3s[875]: time="2026-09-28T16:27:38Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-client.tar in 7.217834388s"1641machine # [ 29.586482] k3s[875]: time="2026-09-28T16:27:38Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-lb.tar"1642machine # [ 29.788695] k3s[875]: time="2026-09-28T16:27:38Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found"1643machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found1644machine # [ 30.788107] k3s[875]: time="2026-09-28T16:27:39Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found"1645machine # [ 31.006407] k3s[875]: time="2026-09-28T16:27:39Z" level=info msg="Started tunnel to 10.0.2.15:6443"1646machine # [ 31.008306] k3s[875]: time="2026-09-28T16:27:39Z" level=info msg="Connecting to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect"1647machine # [ 31.009435] k3s[875]: time="2026-09-28T16:27:39Z" level=info msg="Proxy done" err="context canceled" url="wss://127.0.0.1:6443/v1-k3s/connect"1648machine # [ 31.010985] k3s[875]: time="2026-09-28T16:27:39Z" level=info msg="Stopped tunnel to 127.0.0.1:6443"1649machine # [ 31.012899] k3s[875]: time="2026-09-28T16:27:39Z" level=info msg="error in remotedialer server [400]: websocket: close 1006 (abnormal closure): unexpected EOF"1650machine # [ 31.024025] k3s[875]: time="2026-09-28T16:27:39Z" level=info msg="Handling backend connection request [machine]"1651machine # [ 31.026735] k3s[875]: time="2026-09-28T16:27:39Z" level=info msg="Connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect"1652machine # [ 31.027659] k3s[875]: time="2026-09-28T16:27:39Z" level=info msg="Remotedialer connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect"1653machine # [ 31.059713] k3s[875]: time="2026-09-28T16:27:40Z" level=info msg="Imported docker.io/library/nix-grpc-farm-lb:0.1.0-beta.4"1654machine # [ 31.066273] k3s[875]: time="2026-09-28T16:27:40Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-lb@sha256:18ee6724be589622e1aee9d13c5121e7b2c992ca636c935ade90c66423e18f37"1655machine # [ 31.131507] k3s[875]: time="2026-09-28T16:27:40Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-lb.tar in 1.545206164s"1656machine # [ 31.133534] k3s[875]: time="2026-09-28T16:27:40Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm.tar"1657machine # [ 31.299091] k3s[875]: time="2026-09-28T16:27:40Z" level=info msg="Running kubelet --cloud-provider=external --config-dir=/var/lib/rancher/k3s/agent/etc/kubelet.conf.d --containerd=/run/k3s/containerd/containerd.sock --eviction-hard=nodefs.available<1%,imagefs.available<1% --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubelet.kubeconfig --node-ip=10.0.2.15,fec0::c4c5:e68f:e56e:8e4a --node-labels= --read-only-port=0"1658machine # [ 31.300411] k3s[875]: Flag --containerd has been deprecated, This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed.1659machine # [ 31.313833] k3s[875]: I0928 16:27:40.278918 875 server.go:521] "Kubelet version" kubeletVersion="v1.35.8+k3s1"1660machine # [ 31.315075] k3s[875]: I0928 16:27:40.279023 875 server.go:523] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""1661machine # [ 31.315964] k3s[875]: I0928 16:27:40.279072 875 watchdog_linux.go:95] "Systemd watchdog is not enabled"1662machine # [ 31.316876] k3s[875]: I0928 16:27:40.279150 875 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."1663machine # [ 31.318302] k3s[875]: I0928 16:27:40.283317 875 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/agent/client-ca.crt"1664machine # [ 31.323730] k3s[875]: I0928 16:27:40.288867 875 server.go:1414] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"1665machine # [ 31.328629] k3s[875]: I0928 16:27:40.293788 875 server.go:771] "--cgroups-per-qos enabled, but --cgroup-root was not specified. Defaulting to /"1666machine # [ 31.329656] k3s[875]: I0928 16:27:40.294729 875 server.go:832] "NoSwap is set due to memorySwapBehavior not specified" memorySwapBehavior="" FailSwapOn=false1667machine # [ 31.330679] k3s[875]: I0928 16:27:40.294973 875 container_manager_linux.go:272] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]1668machine # [ 31.331926] k3s[875]: I0928 16:27:40.294998 875 container_manager_linux.go:277] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"machine","RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}1669machine # [ 31.332752] k3s[875]: I0928 16:27:40.295253 875 topology_manager.go:143] "Creating topology manager with none policy"1670machine # [ 31.333520] k3s[875]: I0928 16:27:40.295270 875 container_manager_linux.go:308] "Creating device plugin manager"1671machine # [ 31.334442] k3s[875]: I0928 16:27:40.295345 875 container_manager_linux.go:317] "Creating Dynamic Resource Allocation (DRA) manager"1672machine # [ 31.355648] k3s[875]: I0928 16:27:40.320802 875 state_mem.go:41] "Initialized" logger="CPUManager state memory"1673machine # [ 31.356555] k3s[875]: I0928 16:27:40.321077 875 kubelet.go:482] "Attempting to sync node with API server"1674machine # [ 31.357083] k3s[875]: I0928 16:27:40.321096 875 kubelet.go:383] "Adding static pod path" path="/var/lib/rancher/k3s/agent/pod-manifests"1675machine # [ 31.357548] k3s[875]: I0928 16:27:40.321130 875 kubelet.go:394] "Adding apiserver pod source"1676machine # [ 31.358141] k3s[875]: I0928 16:27:40.321146 875 apiserver.go:42] "Waiting for node sync before watching apiserver pods"1677machine # [ 31.362728] k3s[875]: I0928 16:27:40.325189 875 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="containerd" version="2.2.7-k3s1" apiVersion="v1"1678machine # [ 31.363585] k3s[875]: I0928 16:27:40.325794 875 kubelet.go:945] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"1679machine # [ 31.364106] k3s[875]: I0928 16:27:40.325819 875 kubelet.go:972] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"1680machine # [ 31.369831] k3s[875]: I0928 16:27:40.334960 875 server.go:1252] "Started kubelet"1681machine # [ 31.371488] k3s[875]: I0928 16:27:40.336648 875 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=101682machine # [ 31.373372] k3s[875]: I0928 16:27:40.336713 875 server_v1.go:49] "podresources" method="list" useActivePods=true1683machine # [ 31.374964] k3s[875]: I0928 16:27:40.336872 875 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"1684machine # [ 31.376883] k3s[875]: I0928 16:27:40.336921 875 server.go:182] "Starting to listen" address="0.0.0.0" port=102501685machine # [ 31.378300] k3s[875]: I0928 16:27:40.337789 875 server.go:317] "Adding debug handlers to kubelet server"1686machine # [ 31.379671] k3s[875]: I0928 16:27:40.338017 875 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"1687machine # [ 31.381216] k3s[875]: I0928 16:27:40.342309 875 dynamic_serving_content.go:135] "Starting controller" name="kubelet-server-cert-files::/var/lib/rancher/k3s/agent/serving-kubelet.crt::/var/lib/rancher/k3s/agent/serving-kubelet.key"1688machine # [ 31.384190] k3s[875]: I0928 16:27:40.344627 875 volume_manager.go:311] "Starting Kubelet Volume Manager"1689machine # [ 31.385737] k3s[875]: E0928 16:27:40.344938 875 kubelet_node_status.go:392] "Error getting the current node from lister" err="node \"machine\" not found"1690machine # [ 31.387758] k3s[875]: I0928 16:27:40.347325 875 factory.go:221] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory1691machine # [ 31.390484] k3s[875]: I0928 16:27:40.355169 875 factory.go:223] Registration of the containerd container factory successfully1692machine # [ 31.392072] k3s[875]: I0928 16:27:40.355184 875 factory.go:223] Registration of the systemd container factory successfully1693machine # [ 31.393621] k3s[875]: E0928 16:27:40.356720 875 kubelet.go:1661] "Image garbage collection failed once. Stats initialization may not have completed yet" err="invalid capacity 0 on image filesystem"1694machine # [ 31.396389] k3s[875]: I0928 16:27:40.361569 875 desired_state_of_world_populator.go:146] "Desired state populator starts to run"1695machine # [ 31.398090] k3s[875]: I0928 16:27:40.361629 875 reconciler.go:29] "Reconciler: start to sync state"1696machine # [ 31.402238] k3s[875]: E0928 16:27:40.367393 875 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"machine\" not found" node="machine"1697machine # [ 31.409534] k3s[875]: I0928 16:27:40.374551 875 cpu_manager.go:225] "Starting" policy="none"1698machine # [ 31.410965] k3s[875]: I0928 16:27:40.374574 875 cpu_manager.go:226] "Reconciling" reconcilePeriod="10s"1699machine # [ 31.412463] k3s[875]: I0928 16:27:40.374600 875 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"1700machine # [ 31.415385] k3s[875]: I0928 16:27:40.380555 875 policy_none.go:50] "Start"1701machine # [ 31.416446] k3s[875]: I0928 16:27:40.380579 875 memory_manager.go:187] "Starting memorymanager" policy="None"1702machine # [ 31.418032] k3s[875]: I0928 16:27:40.380610 875 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"1703machine # [ 31.422495] k3s[875]: I0928 16:27:40.387668 875 policy_none.go:44] "Start"1704machine # [ 31.427248] systemd[1]: Created slice libcontainer container kubepods.slice.1705machine # [ 31.442151] systemd[1]: Created slice libcontainer container kubepods-burstable.slice.1706machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found1707machine # [ 31.445954] systemd[1]: Created slice libcontainer container kubepods-besteffort.slice.1708machine # [ 31.453575] k3s[875]: E0928 16:27:40.418713 875 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"1709machine # [ 31.455738] k3s[875]: I0928 16:27:40.420881 875 eviction_manager.go:194] "Eviction manager: starting control loop"1710machine # [ 31.456472] k3s[875]: I0928 16:27:40.420916 875 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"1711machine # [ 31.457070] k3s[875]: I0928 16:27:40.421323 875 plugin_manager.go:121] "Starting Kubelet Plugin Manager"1712machine # [ 31.458908] k3s[875]: E0928 16:27:40.423679 875 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="no imagefs label for configured runtime"1713machine # [ 31.459584] k3s[875]: E0928 16:27:40.423721 875 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"machine\" not found"1714machine # [ 31.495878] k3s[875]: I0928 16:27:40.461011 875 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"1715machine # [ 31.500645] k3s[875]: I0928 16:27:40.465750 875 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"1716machine # [ 31.501568] k3s[875]: I0928 16:27:40.465818 875 status_manager.go:249] "Starting to sync pod status with apiserver"1717machine # [ 31.502219] k3s[875]: I0928 16:27:40.465873 875 kubelet.go:2506] "Starting kubelet main sync loop"1718machine # [ 31.502741] k3s[875]: E0928 16:27:40.465928 875 kubelet.go:2530] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"1719machine # [ 31.558632] k3s[875]: I0928 16:27:40.523753 875 kubelet_node_status.go:74] "Attempting to register node" node="machine"1720machine # [ 31.566124] k3s[875]: I0928 16:27:40.530939 875 node_controller.go:429] Initializing node machine with cloud provider1721machine # [ 31.566740] k3s[875]: I0928 16:27:40.530953 875 kubelet_node_status.go:77] "Successfully registered node" node="machine"1722machine # [ 31.567412] k3s[875]: E0928 16:27:40.530980 875 kubelet_node_status.go:474] "Error updating node status, will retry" err="error getting node \"machine\": node \"machine\" not found"1723machine # [ 31.567977] k3s[875]: I0928 16:27:40.531001 875 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing1724machine # [ 31.568589] k3s[875]: E0928 16:27:40.531032 875 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError"1725machine # [ 31.569184] k3s[875]: I0928 16:27:40.531381 875 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"machine\" does not exist"1726machine # [ 31.581073] k3s[875]: I0928 16:27:40.544714 875 node_controller.go:429] Initializing node machine with cloud provider1727machine # [ 31.581716] k3s[875]: I0928 16:27:40.544777 875 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing1728machine # [ 31.582364] k3s[875]: E0928 16:27:40.544798 875 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError"1729machine # [ 31.582899] k3s[875]: time="2026-09-28T16:27:40Z" level=info msg="Adding node OwnerReference to node-password secret machine.node-password.k3s"1730machine # [ 31.590627] k3s[875]: I0928 16:27:40.555758 875 node_controller.go:429] Initializing node machine with cloud provider1731machine # [ 31.591503] k3s[875]: I0928 16:27:40.555856 875 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing1732machine # [ 31.592212] k3s[875]: E0928 16:27:40.555875 875 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError"1733machine # [ 31.600085] k3s[875]: time="2026-09-28T16:27:40Z" level=info msg="Annotations and labels have been set successfully on node: machine"1734machine # [ 31.600750] k3s[875]: time="2026-09-28T16:27:40Z" level=info msg="Starting flannel with backend vxlan"1735machine # [ 31.608345] k3s[875]: I0928 16:27:40.573517 875 range_allocator.go:433] "Set node PodCIDR" node="machine" podCIDRs=["10.42.0.0/24"]1736machine # [ 31.609143] k3s[875]: I0928 16:27:40.573771 875 node_controller.go:429] Initializing node machine with cloud provider1737machine # [ 31.617906] k3s[875]: time="2026-09-28T16:27:40Z" level=info msg="Synced coredns NodeHosts entries for machine"1738machine # [ 31.636263] k3s[875]: E0928 16:27:40.601412 875 range_allocator.go:438] "Failed to update node PodCIDR after multiple attempts" err="failed to patch node CIDR: Node \"machine\" is invalid: [spec.podCIDRs: Invalid value: [\"10.42.1.0/24\",\"10.42.0.0/24\"]: may specify no more than one CIDR for each IP family, spec.podCIDRs: Forbidden: node updates may not change podCIDR except from \"\" to valid]" node="machine" podCIDRs=["10.42.1.0/24"]1739machine # [ 31.641098] k3s[875]: E0928 16:27:40.602334 875 range_allocator.go:444] "CIDR assignment for node failed. Releasing allocated CIDR" err="failed to patch node CIDR: Node \"machine\" is invalid: [spec.podCIDRs: Invalid value: [\"10.42.1.0/24\",\"10.42.0.0/24\"]: may specify no more than one CIDR for each IP family, spec.podCIDRs: Forbidden: node updates may not change podCIDR except from \"\" to valid]" node="machine"1740machine # [ 31.641709] k3s[875]: E0928 16:27:40.602416 875 range_allocator.go:257] "Error processing node work item" err="error syncing 'machine': failed to patch node CIDR: Node \"machine\" is invalid: [spec.podCIDRs: Invalid value: [\"10.42.1.0/24\",\"10.42.0.0/24\"]: may specify no more than one CIDR for each IP family, spec.podCIDRs: Forbidden: node updates may not change podCIDR except from \"\" to valid], requeuing" logger="UnhandledError"1741machine # [ 31.652918] k3s[875]: time="2026-09-28T16:27:40Z" level=info msg="Flannel found PodCIDR assigned for node machine"1742machine # [ 31.664541] k3s[875]: time="2026-09-28T16:27:40Z" level=info msg="The interface eth0 with ipv4 address 10.0.2.15 will be used by flannel"1743machine # [ 31.666107] k3s[875]: I0928 16:27:40.631286 875 kube.go:139] Waiting 10m0s for node controller to sync1744machine # [ 31.666915] k3s[875]: I0928 16:27:40.631983 875 kube.go:537] Starting kube subnet manager1745machine # [ 31.703603] k3s[875]: I0928 16:27:40.668766 875 node_controller.go:474] Successfully initialized node machine with cloud provider1746machine # [ 31.705346] k3s[875]: I0928 16:27:40.670509 875 event.go:389] "Event occurred" object="machine" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="Synced" message="Node synced successfully"1747machine # [ 31.713158] k3s[875]: I0928 16:27:40.678305 875 server.go:173] "Starting Kubernetes Scheduler" version="v1.35.8+k3s1"1748machine # [ 31.713800] k3s[875]: I0928 16:27:40.678332 875 server.go:175] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""1749machine # [ 31.717268] k3s[875]: I0928 16:27:40.682445 875 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController1750machine # [ 31.717941] k3s[875]: I0928 16:27:40.682473 875 shared_informer.go:370] "Waiting for caches to sync"1751machine # [ 31.718540] k3s[875]: I0928 16:27:40.682601 875 secure_serving.go:211] Serving securely on 127.0.0.1:102591752machine # [ 31.719548] k3s[875]: I0928 16:27:40.682677 875 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key"1753machine # [ 31.720391] k3s[875]: I0928 16:27:40.682769 875 tlsconfig.go:243] "Starting DynamicServingCertificateController"1754machine # [ 31.720926] k3s[875]: I0928 16:27:40.683292 875 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"1755machine # [ 31.721557] k3s[875]: I0928 16:27:40.683323 875 shared_informer.go:370] "Waiting for caches to sync"1756machine # [ 31.728543] k3s[875]: I0928 16:27:40.682517 875 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"1757machine # [ 31.729206] k3s[875]: I0928 16:27:40.693712 875 shared_informer.go:370] "Waiting for caches to sync"1758machine # [ 31.735604] k3s[875]: I0928 16:27:40.700781 875 kuberuntime_manager.go:2095] "Updating runtime config through cri with podcidr" CIDR="10.42.0.0/24"1759machine # [ 31.739332] k3s[875]: I0928 16:27:40.704297 875 kubelet_network.go:47] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.42.0.0/24"1760machine # [ 31.795402] k3s[875]: time="2026-09-28T16:27:40Z" level=info msg="Labels and annotations have been set successfully on node: machine"1761machine # [ 31.817925] k3s[875]: I0928 16:27:40.782984 875 shared_informer.go:377] "Caches are synced"1762machine # [ 31.819350] k3s[875]: I0928 16:27:40.784199 875 shared_informer.go:377] "Caches are synced"1763machine # [ 31.833351] k3s[875]: I0928 16:27:40.798503 875 shared_informer.go:377] "Caches are synced"1764machine # [ 31.843995] k3s[875]: I0928 16:27:40.809162 875 kubelet_node_status.go:427] "Fast updating node status as it just became ready"1765machine # [ 31.968209] k3s[875]: I0928 16:27:40.933303 875 server.go:218] "Successfully retrieved NodeIPs" NodeIPs=["10.0.2.15","fec0::c4c5:e68f:e56e:8e4a"]1766machine # [ 31.968785] k3s[875]: E0928 16:27:40.933407 875 server.go:255] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"1767machine # [ 31.986678] k3s[875]: I0928 16:27:40.951817 875 server.go:264] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"1768machine # [ 31.987426] k3s[875]: I0928 16:27:40.951876 875 server_linux.go:136] "Using iptables Proxier"1769machine # [ 32.001709] k3s[875]: I0928 16:27:40.966852 875 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"1770machine # [ 32.009029] k3s[875]: I0928 16:27:40.974151 875 server.go:529] "Version info" version="v1.35.8+k3s1"1771machine # [ 32.009694] k3s[875]: I0928 16:27:40.974181 875 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""1772machine # [ 32.010373] k3s[875]: I0928 16:27:40.975370 875 config.go:200] "Starting service config controller"1773machine # [ 32.010892] k3s[875]: I0928 16:27:40.975388 875 shared_informer.go:349] "Waiting for caches to sync" controller="service config"1774machine # [ 32.011598] k3s[875]: I0928 16:27:40.975428 875 config.go:106] "Starting endpoint slice config controller"1775machine # [ 32.012110] k3s[875]: I0928 16:27:40.975440 875 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config"1776machine # [ 32.012562] k3s[875]: I0928 16:27:40.975468 875 config.go:403] "Starting serviceCIDR config controller"1777machine # [ 32.013092] k3s[875]: I0928 16:27:40.975480 875 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config"1778machine # [ 32.013555] k3s[875]: I0928 16:27:40.975967 875 config.go:309] "Starting node config controller"1779machine # [ 32.014072] k3s[875]: I0928 16:27:40.975982 875 shared_informer.go:349] "Waiting for caches to sync" controller="node config"1780machine # [ 32.014547] k3s[875]: I0928 16:27:40.975993 875 shared_informer.go:356] "Caches are synced" controller="node config"1781machine # [ 32.110841] k3s[875]: I0928 16:27:41.075836 875 node_lifecycle_controller.go:1234] "Initializing eviction metric for zone" zone=""1782machine # [ 32.112504] k3s[875]: I0928 16:27:41.076024 875 node_lifecycle_controller.go:886] "Missing timestamp for Node. Assuming now as a timestamp" node="machine"1783machine # [ 32.114082] k3s[875]: I0928 16:27:41.076150 875 node_lifecycle_controller.go:1080] "Controller detected that zone is now in new state" zone="" newState="Normal"1784machine # [ 32.210965] k3s[875]: I0928 16:27:41.175976 875 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config"1785machine # [ 32.213093] k3s[875]: I0928 16:27:41.176056 875 shared_informer.go:356] "Caches are synced" controller="service config"1786machine # [ 32.213828] k3s[875]: I0928 16:27:41.176077 875 shared_informer.go:356] "Caches are synced" controller="endpoint slice config"1787machine # [ 32.357823] k3s[875]: I0928 16:27:41.322593 875 apiserver.go:52] "Watching apiserver"1788machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found1789machine # [ 32.667050] k3s[875]: I0928 16:27:41.632165 875 kube.go:163] Node controller sync successful1790machine # [ 32.667629] k3s[875]: I0928 16:27:41.632255 875 vxlan.go:128] VXLAN config: VNI=1 Port=0 GBP=false Learning=false DirectRouting=false1791machine # [ 32.670080] k3s[875]: I0928 16:27:41.635177 875 kube.go:704] List of node(machine) annotations: map[string]string{"alpha.kubernetes.io/provided-node-ip":"10.0.2.15,fec0::c4c5:e68f:e56e:8e4a", "k3s.io/hostname":"machine", "k3s.io/internal-ip":"10.0.2.15,fec0::c4c5:e68f:e56e:8e4a", "k3s.io/node-args":"[\"server\",\"--disable\",\"traefik\",\"--disable\",\"metrics-server\",\"--disable\",\"local-storage\",\"--kubelet-arg\",\"eviction-hard=nodefs.available\\u003c1%,imagefs.available\\u003c1%\"]", "k3s.io/node-config-hash":"EFXPOZ7ZWHRCLFNW4X4ZDPFQMSAOP3BLEIN2VE47TDRKQ4UIWKUQ====", "k3s.io/node-env":"{}", "node.alpha.kubernetes.io/ttl":"0", "volumes.kubernetes.io/controller-managed-attach-detach":"true"}1792machine # [ 32.699777] (udev-worker)[1230]: Network interface NamePolicy= disabled on kernel command line.1793machine # [ 32.705495] k3s[875]: I0928 16:27:41.670607 875 kube.go:558] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.42.0.0/24]1794machine # [ 32.707528] k3s[875]: I0928 16:27:41.671533 875 iptables.go:50] Starting flannel in iptables mode...1795machine # [ 32.708983] k3s[875]: time="2026-09-28T16:27:41Z" level=warning msg="no subnet found for key: FLANNEL_NETWORK in file: /run/flannel/subnet.env"1796machine # [ 32.710717] k3s[875]: time="2026-09-28T16:27:41Z" level=warning msg="no subnet found for key: FLANNEL_SUBNET in file: /run/flannel/subnet.env"1797machine # [ 32.712387] k3s[875]: time="2026-09-28T16:27:41Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_NETWORK in file: /run/flannel/subnet.env"1798machine # [ 32.714205] k3s[875]: time="2026-09-28T16:27:41Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_SUBNET in file: /run/flannel/subnet.env"1799machine # [ 32.715879] k3s[875]: I0928 16:27:41.671627 875 iptables.go:101] Current network or subnet (10.42.0.0/16, 10.42.0.0/24) is not equal to previous one (0.0.0.0/0, 0.0.0.0/0), trying to recycle old iptables rules1800machine # [ 32.732941] systemd[1]: Created slice libcontainer container kubepods-burstable-pod8044bf76_745b_4c7c_8b49_d91821861682.slice.1801machine # [ 32.736072] dhcpcd[684]: flannel.1: IAID fc:b2:5d:851802machine # [ 32.736770] dhcpcd[684]: flannel.1: adding address fe80::e412:fcff:feb2:5d851803machine # [ 32.741812] systemd[1]: Created slice libcontainer container kubepods-burstable-pod00c67c66_2efc_4093_afcb_bcd25f2c2525.slice.1804machine # [ 32.769186] k3s[875]: time="2026-09-28T16:27:41Z" level=info msg="Tunnel authorizer set Kubelet Port 0.0.0.0:10250"1805machine # [ 32.782935] k3s[875]: I0928 16:27:41.748089 875 iptables.go:111] Setting up masking rules1806machine # [ 32.794410] k3s[875]: I0928 16:27:41.759569 875 iptables.go:212] Changing default FORWARD chain policy to ACCEPT1807machine # [ 32.797415] k3s[875]: I0928 16:27:41.762310 875 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"1808machine # [ 32.803074] k3s[875]: time="2026-09-28T16:27:41Z" level=info msg="Wrote flannel subnet file to /run/flannel/subnet.env"1809machine # [ 32.803916] k3s[875]: time="2026-09-28T16:27:41Z" level=info msg="Running flannel backend"1810machine # [ 32.804553] k3s[875]: I0928 16:27:41.768269 875 vxlan_network.go:68] watching for new subnet leases1811machine # [ 32.805163] k3s[875]: I0928 16:27:41.768313 875 vxlan_network.go:115] starting vxlan device watcher1812machine # [ 32.805669] k3s[875]: I0928 16:27:41.769211 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwfxp\" (UniqueName: \"kubernetes.io/projected/00c67c66-2efc-4093-afcb-bcd25f2c2525-kube-api-access-gwfxp\") pod \"helm-install-nix-grpc-farm-lcrdq\" (UID: \"00c67c66-2efc-4093-afcb-bcd25f2c2525\") " pod="kube-system/helm-install-nix-grpc-farm-lcrdq"1813machine # [ 32.806451] k3s[875]: I0928 16:27:41.769279 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8044bf76-745b-4c7c-8b49-d91821861682-config-volume\") pod \"coredns-c5fdd76cf-8rqsb\" (UID: \"8044bf76-745b-4c7c-8b49-d91821861682\") " pod="kube-system/coredns-c5fdd76cf-8rqsb"1814machine # [ 32.807095] k3s[875]: I0928 16:27:41.769311 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/00c67c66-2efc-4093-afcb-bcd25f2c2525-klipper-helm\") pod \"helm-install-nix-grpc-farm-lcrdq\" (UID: \"00c67c66-2efc-4093-afcb-bcd25f2c2525\") " pod="kube-system/helm-install-nix-grpc-farm-lcrdq"1815machine # [ 32.807601] k3s[875]: I0928 16:27:41.769340 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/00c67c66-2efc-4093-afcb-bcd25f2c2525-klipper-cache\") pod \"helm-install-nix-grpc-farm-lcrdq\" (UID: \"00c67c66-2efc-4093-afcb-bcd25f2c2525\") " pod="kube-system/helm-install-nix-grpc-farm-lcrdq"1816machine # [ 32.808301] k3s[875]: I0928 16:27:41.769369 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/00c67c66-2efc-4093-afcb-bcd25f2c2525-klipper-config\") pod \"helm-install-nix-grpc-farm-lcrdq\" (UID: \"00c67c66-2efc-4093-afcb-bcd25f2c2525\") " pod="kube-system/helm-install-nix-grpc-farm-lcrdq"1817machine # [ 32.808860] k3s[875]: I0928 16:27:41.769397 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"content\" (UniqueName: \"kubernetes.io/configmap/00c67c66-2efc-4093-afcb-bcd25f2c2525-content\") pod \"helm-install-nix-grpc-farm-lcrdq\" (UID: \"00c67c66-2efc-4093-afcb-bcd25f2c2525\") " pod="kube-system/helm-install-nix-grpc-farm-lcrdq"1818machine # [ 32.809406] k3s[875]: I0928 16:27:41.769421 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-config-volume\" (UniqueName: \"kubernetes.io/configmap/8044bf76-745b-4c7c-8b49-d91821861682-custom-config-volume\") pod \"coredns-c5fdd76cf-8rqsb\" (UID: \"8044bf76-745b-4c7c-8b49-d91821861682\") " pod="kube-system/coredns-c5fdd76cf-8rqsb"1819machine # [ 32.809976] k3s[875]: I0928 16:27:41.769452 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-295mw\" (UniqueName: \"kubernetes.io/projected/8044bf76-745b-4c7c-8b49-d91821861682-kube-api-access-295mw\") pod \"coredns-c5fdd76cf-8rqsb\" (UID: \"8044bf76-745b-4c7c-8b49-d91821861682\") " pod="kube-system/coredns-c5fdd76cf-8rqsb"1820machine # [ 32.810373] k3s[875]: I0928 16:27:41.769483 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00c67c66-2efc-4093-afcb-bcd25f2c2525-tmp\") pod \"helm-install-nix-grpc-farm-lcrdq\" (UID: \"00c67c66-2efc-4093-afcb-bcd25f2c2525\") " pod="kube-system/helm-install-nix-grpc-farm-lcrdq"1821machine # [ 32.810931] k3s[875]: I0928 16:27:41.769511 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"values\" (UniqueName: \"kubernetes.io/projected/00c67c66-2efc-4093-afcb-bcd25f2c2525-values\") pod \"helm-install-nix-grpc-farm-lcrdq\" (UID: \"00c67c66-2efc-4093-afcb-bcd25f2c2525\") " pod="kube-system/helm-install-nix-grpc-farm-lcrdq"1822machine # [ 32.838830] k3s[875]: I0928 16:27:41.803947 875 iptables.go:358] bootstrap done1823machine # [ 32.849163] dhcpcd[684]: flannel.1: soliciting a DHCP lease1824machine # [ 32.874134] k3s[875]: I0928 16:27:41.839217 875 iptables.go:358] bootstrap done1825machine # [ 33.100309] (udev-worker)[1405]: Network interface NamePolicy= disabled on kernel command lin[ 33.254785] cni0: port 1(veth1eadf193) entered blocking state1826machine # e.1827machine # [ 33.255849] cni0: port 1(veth1eadf193) entered disabled state1828machine # [ 33.256876] veth1eadf193: entered allmulticast mode1829machine # [ 33.257880] veth1eadf193: entered promiscuous mode1830machine # [ 33.259235] cni0: port 2(vethca20d1db) entered blocking state1831machine # [ 33.106091] (udev-worker)[1505]: Network inte[ 33.260376] cni0: port 2(vethca20d1db) entered disabled state1832machine # rface NamePolicy= disabled on kernel command lin[ 33.261583] vethca20d1db: entered allmulticast mode1833machine # e.1834machine # [ 33.262468] vethca20d1db: entered promiscuous mode1835machine # [ 33.273252] cni0: port 1(veth1eadf193) entered blocking state1836machine # [ 33.273937] cni0: port 1(veth1eadf193) entered forwarding state1837machine # [ 33.276365] cni0: port 2(vethca20d1db) entered blocking state1838machine # [ 33.277067] cni0: port 2(vethca20d1db) entered forwarding state1839machine # [ 33.151126] dhcpcd[684]: vethca20d1db: waiting for carrier1840machine # [ 33.162042] dhcpcd[684]: veth1eadf193: IAID 5b:6b:05:751841machine # [ 33.162550] dhcpcd[684]: veth1eadf193: adding address fe80::8821:5bff:fe6b:5751842machine # [ 33.163675] dhcpcd[684]: vethca20d1db: carrier acquired1843machine # [ 33.165890] dhcpcd[684]: vethca20d1db: IAID 93:4b:4a:a51844machine # [ 33.167407] dhcpcd[684]: vethca20d1db: adding address fe80::64a1:93ff:fe4b:4aa51845machine # [ 33.308319] systemd[1]: Started libcontainer container 9d0bfc6a569f4ffc1b23ac75303ea219e36d39de3ff22283e81d817636cf3bd6.1846machine # [ 33.342382] systemd[1]: Started libcontainer container 28a6112c68a2602f722fbf06d62ea9f64d21835f71727e575ec3ec471fbc2677.1847machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found1848machine # [ 33.874303] dhcpcd[684]: veth1eadf193: soliciting a DHCP lease1849machine # [ 34.101567] k3s[875]: time="2026-09-28T16:27:43Z" level=info msg="Starting network policy controller version v2.6.3-k3s1, built on 1970-01-01T01:01:01Z, go1.26.7"1850machine # [ 34.102447] k3s[875]: I0928 16:27:43.066300 875 network_policy_controller.go:164] Starting network policy controller1851machine # [ 34.261154] dhcpcd[684]: vethca20d1db: soliciting a DHCP lease1852machine # [ 34.330289] k3s[875]: I0928 16:27:43.294210 875 network_policy_controller.go:179] Starting network policy controller full sync goroutine1853machine # [ 34.352047] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount3076900136.mount: Deactivated successfully.1854machine # [ 34.395363] systemd[1]: Started libcontainer container cb89bda400c7640baca2c3b6be68ea0bef84f1b75975bce559e71302cbaeef07.1855machine # [ 34.453850] dhcpcd[684]: flannel.1: soliciting an IPv6 router1856machine # [ 34.504640] dhcpcd[684]: vethca20d1db: soliciting an IPv6 router1857machine # [ 34.563371] systemd[1]: Started libcontainer container f034bbe37937eff8d8bea640d8b2dcbc4da5a0e0cfabe6dd9cbbb6fb13313189.1858machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found1859machine # [ 35.192504] dhcpcd[684]: veth1eadf193: soliciting an IPv6 router1860machine # [ 35.392046] k3s[875]: I0928 16:27:44.356836 875 alloc.go:329] "allocated clusterIPs" service="farm/nix-grpc-farm" clusterIPs={"IPv4":"10.43.241.101"}1861machine # [ 35.436864] systemd[1]: cri-containerd-f034bbe37937eff8d8bea640d8b2dcbc4da5a0e0cfabe6dd9cbbb6fb13313189.scope: Deactivated successfully.1862machine # [ 35.438516] systemd[1]: cri-containerd-f034bbe37937eff8d8bea640d8b2dcbc4da5a0e0cfabe6dd9cbbb6fb13313189.scope: Consumed 569ms CPU time over 873ms wall clock time, 32.8M memory peak, 2.4M incoming IP traffic, 149.3K outgoing IP traffic.1863machine # [ 35.467139] k3s[875]: I0928 16:27:44.431537 875 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/coredns-c5fdd76cf-8rqsb" podStartSLOduration=8.431514197 podStartE2EDuration="8.431514197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-28 16:27:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-28 16:27:43.506626537 +0000 UTC m=+18.773509760" watchObservedRunningTime="2026-09-28 16:27:44.431514197 +0000 UTC m=+19.698397141"1864machine # [ 35.514094] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-f034bbe37937eff8d8bea640d8b2dcbc4da5a0e0cfabe6dd9cbbb6fb13313189-rootfs.mount: Deactivated successfully.1865machine # [ 35.514966] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod932853d1_d1e0_4753_ab3e_f48dd08df9c2.slice.1866machine # [ 35.521703] k3s[875]: I0928 16:27:44.486777 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/932853d1-d1e0-4753-ab3e-f48dd08df9c2-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5\" (UID: \"932853d1-d1e0-4753-ab3e-f48dd08df9c2\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5"1867machine # [ 35.523575] k3s[875]: I0928 16:27:44.486856 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/932853d1-d1e0-4753-ab3e-f48dd08df9c2-build\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5\" (UID: \"932853d1-d1e0-4753-ab3e-f48dd08df9c2\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5"1868machine # [ 35.525342] k3s[875]: I0928 16:27:44.489110 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/932853d1-d1e0-4753-ab3e-f48dd08df9c2-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5\" (UID: \"932853d1-d1e0-4753-ab3e-f48dd08df9c2\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5"1869machine # [ 35.526079] k3s[875]: I0928 16:27:44.489172 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/932853d1-d1e0-4753-ab3e-f48dd08df9c2-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5\" (UID: \"932853d1-d1e0-4753-ab3e-f48dd08df9c2\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5"1870machine # [ 35.526583] k3s[875]: I0928 16:27:44.489361 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/932853d1-d1e0-4753-ab3e-f48dd08df9c2-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5\" (UID: \"932853d1-d1e0-4753-ab3e-f48dd08df9c2\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5"1871machine # [ 35.526765] k3s[875]: I0928 16:27:44.489424 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/932853d1-d1e0-4753-ab3e-f48dd08df9c2-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5\" (UID: \"932853d1-d1e0-4753-ab3e-f48dd08df9c2\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5"1872machine # [ 35.528088] k3s[875]: I0928 16:27:44.489528 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/932853d1-d1e0-4753-ab3e-f48dd08df9c2-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5\" (UID: \"932853d1-d1e0-4753-ab3e-f48dd08df9c2\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5"1873machine # [ 35.528875] k3s[875]: I0928 16:27:44.489581 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/932853d1-d1e0-4753-ab3e-f48dd08df9c2-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5\" (UID: \"932853d1-d1e0-4753-ab3e-f48dd08df9c2\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5"1874machine # [ 35.530172] k3s[875]: I0928 16:27:44.489609 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhg7h\" (UniqueName: \"kubernetes.io/projected/932853d1-d1e0-4753-ab3e-f48dd08df9c2-kube-api-access-xhg7h\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5\" (UID: \"932853d1-d1e0-4753-ab3e-f48dd08df9c2\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5"1875machine # [ 35.579261] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod2abddca4_2911_4503_bf02_4a196440e344.slice.1876machine # [ 35.599022] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod791e79c1_dfa4_4e06_a169_4e6111ed915c.slice.1877machine # [ 35.626744] k3s[875]: I0928 16:27:44.591876 875 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/helm-install-nix-grpc-farm-lcrdq" podStartSLOduration=8.591852732 podStartE2EDuration="8.591852732s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-28 16:27:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-28 16:27:44.543572014 +0000 UTC m=+19.810455238" watchObservedRunningTime="2026-09-28 16:27:44.591852732 +0000 UTC m=+19.858735676"1878machine # [ 35.628080] k3s[875]: I0928 16:27:44.592220 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/80f57522-ccd5-485a-b7a5-8bc9eb14300a-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-x65jw\" (UID: \"80f57522-ccd5-485a-b7a5-8bc9eb14300a\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-x65jw"1879machine # [ 35.629280] k3s[875]: I0928 16:27:44.593374 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/791e79c1-dfa4-4e06-a169-4e6111ed915c-tls\") pod \"nix-grpc-farm-scheduler-c5d75967-gjhh7\" (UID: \"791e79c1-dfa4-4e06-a169-4e6111ed915c\") " pod="farm/nix-grpc-farm-scheduler-c5d75967-gjhh7"1880machine # [ 35.629849] k3s[875]: I0928 16:27:44.593411 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/791e79c1-dfa4-4e06-a169-4e6111ed915c-ca\") pod \"nix-grpc-farm-scheduler-c5d75967-gjhh7\" (UID: \"791e79c1-dfa4-4e06-a169-4e6111ed915c\") " pod="farm/nix-grpc-farm-scheduler-c5d75967-gjhh7"1881machine # [ 35.630513] k3s[875]: I0928 16:27:44.593476 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/80f57522-ccd5-485a-b7a5-8bc9eb14300a-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-x65jw\" (UID: \"80f57522-ccd5-485a-b7a5-8bc9eb14300a\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-x65jw"1882machine # [ 35.631195] k3s[875]: I0928 16:27:44.593514 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/80f57522-ccd5-485a-b7a5-8bc9eb14300a-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-x65jw\" (UID: \"80f57522-ccd5-485a-b7a5-8bc9eb14300a\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-x65jw"1883machine # [ 35.631992] k3s[875]: I0928 16:27:44.593576 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/80f57522-ccd5-485a-b7a5-8bc9eb14300a-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-x65jw\" (UID: \"80f57522-ccd5-485a-b7a5-8bc9eb14300a\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-x65jw"1884machine # [ 35.632709] k3s[875]: I0928 16:27:44.593658 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2abddca4-2911-4503-bf02-4a196440e344-tmp\") pod \"nix-grpc-farm-lb-75b44f88dd-r9tls\" (UID: \"2abddca4-2911-4503-bf02-4a196440e344\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-r9tls"1885machine # [ 35.633408] k3s[875]: I0928 16:27:44.593683 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b55sp\" (UniqueName: \"kubernetes.io/projected/791e79c1-dfa4-4e06-a169-4e6111ed915c-kube-api-access-b55sp\") pod \"nix-grpc-farm-scheduler-c5d75967-gjhh7\" (UID: \"791e79c1-dfa4-4e06-a169-4e6111ed915c\") " pod="farm/nix-grpc-farm-scheduler-c5d75967-gjhh7"1886machine # [ 35.633957] k3s[875]: I0928 16:27:44.593710 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbv9b\" (UniqueName: \"kubernetes.io/projected/80f57522-ccd5-485a-b7a5-8bc9eb14300a-kube-api-access-mbv9b\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-x65jw\" (UID: \"80f57522-ccd5-485a-b7a5-8bc9eb14300a\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-x65jw"1887machine # [ 35.634628] k3s[875]: I0928 16:27:44.593885 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2abddca4-2911-4503-bf02-4a196440e344-config\") pod \"nix-grpc-farm-lb-75b44f88dd-r9tls\" (UID: \"2abddca4-2911-4503-bf02-4a196440e344\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-r9tls"1888machine # [ 35.635192] k3s[875]: I0928 16:27:44.593950 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/791e79c1-dfa4-4e06-a169-4e6111ed915c-niks3-token\") pod \"nix-grpc-farm-scheduler-c5d75967-gjhh7\" (UID: \"791e79c1-dfa4-4e06-a169-4e6111ed915c\") " pod="farm/nix-grpc-farm-scheduler-c5d75967-gjhh7"1889machine # [ 35.638022] k3s[875]: I0928 16:27:44.594044 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/80f57522-ccd5-485a-b7a5-8bc9eb14300a-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-x65jw\" (UID: \"80f57522-ccd5-485a-b7a5-8bc9eb14300a\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-x65jw"1890machine # [ 35.642671] k3s[875]: I0928 16:27:44.594304 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/2abddca4-2911-4503-bf02-4a196440e344-tls-lb\") pod \"nix-grpc-farm-lb-75b44f88dd-r9tls\" (UID: \"2abddca4-2911-4503-bf02-4a196440e344\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-r9tls"1891machine # [ 35.646545] k3s[875]: I0928 16:27:44.594334 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/2abddca4-2911-4503-bf02-4a196440e344-tls-ca\") pod \"nix-grpc-farm-lb-75b44f88dd-r9tls\" (UID: \"2abddca4-2911-4503-bf02-4a196440e344\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-r9tls"1892machine # [ 35.650549] k3s[875]: I0928 16:27:44.594448 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/791e79c1-dfa4-4e06-a169-4e6111ed915c-oidc\") pod \"nix-grpc-farm-scheduler-c5d75967-gjhh7\" (UID: \"791e79c1-dfa4-4e06-a169-4e6111ed915c\") " pod="farm/nix-grpc-farm-scheduler-c5d75967-gjhh7"1893machine # [ 35.654515] k3s[875]: I0928 16:27:44.594477 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/80f57522-ccd5-485a-b7a5-8bc9eb14300a-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-x65jw\" (UID: \"80f57522-ccd5-485a-b7a5-8bc9eb14300a\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-x65jw"1894machine # [ 35.658955] k3s[875]: I0928 16:27:44.594540 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/80f57522-ccd5-485a-b7a5-8bc9eb14300a-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-x65jw\" (UID: \"80f57522-ccd5-485a-b7a5-8bc9eb14300a\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-x65jw"1895machine # [ 35.698598] k3s[875]: I0928 16:27:44.594565 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/80f57522-ccd5-485a-b7a5-8bc9eb14300a-build\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-x65jw\" (UID: \"80f57522-ccd5-485a-b7a5-8bc9eb14300a\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-x65jw"1896machine # [ 35.715686] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod80f57522_ccd5_485a_b7a5_8bc9eb14300a.slice.1897machine # [ 36.090924] cni0: port 3(veth6b54cd8a) entered blocking state1898machine # [ 36.091877] cni0: port 3(veth6b54cd8a) entered disabled state1899machine # [ 36.092820] veth6b54cd8a: entered allmulticast mode1900machine # [ 36.093672] veth6b54cd8a: entered promiscuous mode1901machine # [ 35.944610] (udev-worker)[1669]: Network interface NamePolicy= disabled on kernel command line.1902machine # [ 36.106627] cni0: port 3(veth6b54cd8a) entered blocking state1903machine # [ 36.107349] cni0: port 3(veth6b54cd8a) entered forwarding state1904machine # [ 35.963983] (udev-worker)[2041]: Network interface NamePolicy= disabled on kernel command line.1905machine # [ 36.122343] cni0: port 4(veth4473bd23) entered blocking state1906machine # [ 36.124273] cni0: port 4(veth4473bd23) entered disabled state1907machine # [ 36.126102] veth4473bd23: entered allmulticast mode1908machine # [ 36.127400] veth4473bd23: entered promiscuous mode1909machine # [ 36.128770] cni0: port 5(veth4075250e) entered blocking state1910machine # [ 36.131547] cni0: port 5(veth4075250e) entered disabled state1911machine # [ 36.132225] veth4075250e: entered allmulticast mode1912machine # [ 36.132945] veth4075250e: entered promiscuous mode1913machine # [ 35.982737] (udev-worker)[2055]: Network interface NamePolicy= disabled on kernel command line.1914machine # [ 35.992421] dhcpcd[684]: veth6b54cd8a: IAID 75:19:b9:4e1915machine # [ 35.993217] dhcpcd[684]: veth6b54cd8a: adding address fe80::b881:75ff:fe19:b9[ 36.147459] cni0: port 4(veth4473bd23) entered blocking state1916machine # 4e1917machine # [ 36.148358] cni0: port 4(veth4473bd23) entered forwarding state1918machine # [ 36.158322] cni0: port 5(veth4075250e) entered blocking state1919machine # [ 36.159074] cni0: port 5(veth4075250e) entered forwarding state1920machine # [ 36.039254] dhcpcd[684]: veth4473bd23: waiting for carrier1921machine # [ 36.066577] dhcpcd[684]: veth4075250e: IAID b4:57:0d:1b1922machine # [ 36.067428] dhcpcd[684]: veth4075250e: adding address fe80::6c61:b4ff:fe57:d1b1923machine # [ 36.068518] dhcpcd[684]: veth4075250e: carrier lost1924machine # [ 36.102226] dhcpcd[684]: veth4075250e: deleting address fe80::6c61:b4ff:fe57:d1b1925machine # [ 36.102910] dhcpcd[684]: veth4473bd23: carrier acquired1926machine # [ 36.109787] dhcpcd[684]: veth4473bd23: IAID b3:97:fc:1c1927machine # [ 36.110889] dhcpcd[684]: veth4473bd23: adding address fe80::5031:b3ff:fe97:fc1c1928machine # [ 36.112193] dhcpcd[684]: veth4075250e: carrier acquired1929machine # [ 36.115515] dhcpcd[684]: veth4075250e: IAID b4:57:0d:1b1930machine # [ 36.116509] dhcpcd[684]: veth4075250e: adding address fe80::6c61:b4ff:fe57:d1b1931machine # [ 36.123765] (udev-worker)[2065]: Network interface NamePolicy= disabled on kernel command line.1932machine # [ 36.125421] s[ 36.279047] cni0: port 6(veth0cee83f3) entered blocking state1933machine # ystemd[1]: Started libcontainer container 759befa578f093396971df1a9f2ce413f3a4ed8cd98c5b7987079e2f20dba1ba.1934machine # [ 36.282937] cni0: port 6(veth0cee83f3) entered disabled state1935machine # [ 36.283917] veth0cee83f3: entered allmulticast mode1936machine # [ 36.285006] veth0cee83f3: entered promiscuous mode1937machine # [ 36.308492] cni0: port 6(veth0cee83f3) entered blocking state1938machine # [ 36.309196] cni0: port 6(veth0cee83f3) entered forwarding state1939machine # [ 36.189931] dhcpcd[684]: veth0cee83f3: waiting for carrier1940machine # [ 36.190922] dhcpcd[684]: veth0cee83f3: carrier acquired1941machine # [ 36.197208] dhcpcd[684]: veth0cee83f3: IAID 8d:88:42:141942machine # [ 36.197976] dhcpcd[684]: veth0cee83f3: adding address fe80::18f6:8dff:fe88:42141943machine # [ 36.231445] systemd[1]: Started libcontainer container 79034697cc42bc8fb93d4eab0533c92c8b83ef87955c75101be6c09910bca194.1944machine # [ 36.236221] systemd[1]: Started libcontainer container 8bb488149f56166ddc79ff45ebb261545a395ff4480ad278faae87f985328450.1945machine # [ 36.331152] k3s[875]: E0928 16:27:45.296193 875 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.4"1946machine # [ 36.331583] k3s[875]: E0928 16:27:45.296380 875 kuberuntime_image.go:43] "Failed to pull image" err="failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.4"1947machine # [ 36.343252] k3s[875]: E0928 16:27:45.308083 875 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.4"1948machine # [ 36.344159] k3s[875]: E0928 16:27:45.308129 875 kuberuntime_image.go:43] "Failed to pull image" err="failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.4"1949machine # [ 36.344568] k3s[875]: E0928 16:27:45.308190 875 kuberuntime_manager.go:1674] "Unhandled Error" err="container nix-grpc-daemon start failed in pod nix-grpc-farm-scheduler-c5d75967-gjhh7_farm(791e79c1-dfa4-4e06-a169-4e6111ed915c): ErrImagePull: failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" logger="UnhandledError"1950machine # [ 36.345251] k3s[875]: E0928 16:27:45.308305 875 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nix-grpc-daemon\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-scheduler-c5d75967-gjhh7" podUID="791e79c1-dfa4-4e06-a169-4e6111ed915c"1951machine # [ 36.345816] k3s[875]: E0928 16:27:45.308364 875 kuberuntime_manager.go:1674] "Unhandled Error" err="init container seed-store start failed in pod nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5_farm(932853d1-d1e0-4753-ab3e-f48dd08df9c2): ErrImagePull: failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" logger="UnhandledError"1952machine # [ 36.346459] k3s[875]: E0928 16:27:45.309895 875 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5" podUID="932853d1-d1e0-4753-ab3e-f48dd08df9c2"1953machine # [ 36.387531] systemd[1]: Started libcontainer container b4ea3eb1d3b685c3ee1accd80236aa92e6a894663c81a42c1d3bb1af9facc62f.1954machine # [ 36.505641] k3s[875]: E0928 16:27:45.470420 875 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.4"1955machine # [ 36.506355] k3s[875]: E0928 16:27:45.470480 875 kuberuntime_image.go:43] "Failed to pull image" err="failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.4"1956machine # [ 36.508964] k3s[875]: E0928 16:27:45.474056 875 kuberuntime_manager.go:1674] "Unhandled Error" err="init container seed-store start failed in pod nix-grpc-farm-worker-x86-64-linux-795755579b-x65jw_farm(80f57522-ccd5-485a-b7a5-8bc9eb14300a): ErrImagePull: failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" logger="UnhandledError"1957machine # [ 36.509670] k3s[875]: E0928 16:27:45.474128 875 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-x65jw" podUID="80f57522-ccd5-485a-b7a5-8bc9eb14300a"1958machine # [ 36.562084] k3s[875]: E0928 16:27:45.526284 875 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nix-grpc-daemon\" with ImagePullBackOff: \"Back-off pulling image \\\"nix-grpc-farm:0.1.0-beta.4\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-scheduler-c5d75967-gjhh7" podUID="791e79c1-dfa4-4e06-a169-4e6111ed915c"1959machine # [ 36.576298] k3s[875]: E0928 16:27:45.541406 875 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ImagePullBackOff: \"Back-off pulling image \\\"nix-grpc-farm:0.1.0-beta.4\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-x65jw" podUID="80f57522-ccd5-485a-b7a5-8bc9eb14300a"1960machine # [ 36.581626] k3s[875]: E0928 16:27:45.546775 875 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ImagePullBackOff: \"Back-off pulling image \\\"nix-grpc-farm:0.1.0-beta.4\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5" podUID="932853d1-d1e0-4753-ab3e-f48dd08df9c2"1961machine # [ 36.714437] k3s[875]: time="2026-09-28T16:27:45Z" level=info msg="Imported docker.io/library/nix-grpc-farm:0.1.0-beta.4"1962machine # [ 36.720771] k3s[875]: time="2026-09-28T16:27:45Z" level=info msg="Tagged docker.io/library/nix-grpc-farm@sha256:56a8f6001443a2aa1547002b6f40b3c8ff989cdf42dc1f8d523552dbff5c20df"1963machine # [ 36.852517] dhcpcd[684]: veth6b54cd8a: soliciting a DHCP lease1964machine # [ 36.857495] systemd[1]: Started libcontainer container 05c76cacfb0a596301532a8388e807db2352e6483bf8e66ef629bb6a08e50d09.1965machine # [ 37.122630] k3s[875]: time="2026-09-28T16:27:46Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm.tar in 5.989044976s"1966machine # [ 37.409948] dhcpcd[684]: veth4075250e: soliciting an IPv6 router1967machine # [ 37.416640] dhcpcd[684]: veth4075250e: soliciting a DHCP lease1968machine # [ 37.611500] systemd[1]: cri-containerd-9d0bfc6a569f4ffc1b23ac75303ea219e36d39de3ff22283e81d817636cf3bd6.scope: Deactivated successfully.1969machine # [ 37.658134] dhcpcd[684]: veth4473bd23: soliciting an IPv6 router1970machine # [ 37.659372] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-9d0bfc6a569f4ffc1b23ac75303ea219e36d39de3ff22283e81d817636cf3bd6-rootfs.mount: Deactivated successfully.1971machine # [ 37.777563] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-9d0bfc6a569f4ffc1b23ac75303ea219e36d39de3ff22283e81d817636cf3bd6-shm.mount: Deactivated successfully.1972machine # [ 37.960329] cni0: port 2(vethca20d1db) entered disabled state1973machine # [ 37.807090] dhcpcd[684]: vethca20d1db: carrier lost1974machine # [ 37.961944] vethca20d1db (unregistering): left allmulticast mode1975machine # [ 37.962715] vethca20d1db (unregistering): left promiscuous mode1976machine # [ 37.963445] cni0: port 2(vethca20d1db) entered disabled state1977machine # [ 37.827237] systemd[1]: run-netns-cni\x2d9ea94124\x2d27e6\x2d8110\x2d9e8a\x2d061fbcbfdf69.mount: Deactivated successfully.1978machine # [ 37.831466] dhcpcd[684]: vethca20d1db: deleting address fe80::64a1:93ff:fe4b:4aa51979machine # [ 37.851875] k3s[875]: I0928 16:27:46.816732 875 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-75b44f88dd-r9tls" podStartSLOduration=2.816709522 podStartE2EDuration="2.816709522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-28 16:27:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-28 16:27:46.579836679 +0000 UTC m=+21.846741414" watchObservedRunningTime="2026-09-28 16:27:46.816709522 +0000 UTC m=+22.083592466"1980machine # [ 37.870220] dhcpcd[684]: flannel.1: probing for an IPv4LL address1981machine # [ 37.874244] dhcpcd[684]: veth4473bd23: soliciting a DHCP lease1982machine # [ 37.878303] dhcpcd[684]: vethca20d1db: removing interface1983machine # [ 37.963381] k3s[875]: I0928 16:27:46.928400 875 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/00c67c66-2efc-4093-afcb-bcd25f2c2525-values\" (UniqueName: \"kubernetes.io/projected/00c67c66-2efc-4093-afcb-bcd25f2c2525-values\") pod \"00c67c66-2efc-4093-afcb-bcd25f2c2525\" (UID: \"00c67c66-2efc-4093-afcb-bcd25f2c2525\") "1984machine # [ 37.964494] k3s[875]: I0928 16:27:46.928461 875 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/00c67c66-2efc-4093-afcb-bcd25f2c2525-klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/00c67c66-2efc-4093-afcb-bcd25f2c2525-klipper-config\") pod \"00c67c66-2efc-4093-afcb-bcd25f2c2525\" (UID: \"00c67c66-2efc-4093-afcb-bcd25f2c2525\") "1985machine # [ 37.965138] k3s[875]: I0928 16:27:46.928494 875 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/00c67c66-2efc-4093-afcb-bcd25f2c2525-klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/00c67c66-2efc-4093-afcb-bcd25f2c2525-klipper-helm\") pod \"00c67c66-2efc-4093-afcb-bcd25f2c2525\" (UID: \"00c67c66-2efc-4093-afcb-bcd25f2c2525\") "1986machine # [ 37.965608] k3s[875]: I0928 16:27:46.928523 875 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/00c67c66-2efc-4093-afcb-bcd25f2c2525-tmp\" (UniqueName: \"kubernetes.io/empty-dir/00c67c66-2efc-4093-afcb-bcd25f2c2525-tmp\") pod \"00c67c66-2efc-4093-afcb-bcd25f2c2525\" (UID: \"00c67c66-2efc-4093-afcb-bcd25f2c2525\") "1987machine # [ 37.966449] k3s[875]: I0928 16:27:46.928553 875 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/00c67c66-2efc-4093-afcb-bcd25f2c2525-content\" (UniqueName: \"kubernetes.io/configmap/00c67c66-2efc-4093-afcb-bcd25f2c2525-content\") pod \"00c67c66-2efc-4093-afcb-bcd25f2c2525\" (UID: \"00c67c66-2efc-4093-afcb-bcd25f2c2525\") "1988machine # [ 37.971076] k3s[875]: I0928 16:27:46.928583 875 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/00c67c66-2efc-4093-afcb-bcd25f2c2525-kube-api-access-gwfxp\" (UniqueName: \"kubernetes.io/projected/00c67c66-2efc-4093-afcb-bcd25f2c2525-kube-api-access-gwfxp\") pod \"00c67c66-2efc-4093-afcb-bcd25f2c2525\" (UID: \"00c67c66-2efc-4093-afcb-bcd25f2c2525\") "1989machine # [ 37.971941] k3s[875]: I0928 16:27:46.928612 875 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/00c67c66-2efc-4093-afcb-bcd25f2c2525-klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/00c67c66-2efc-4093-afcb-bcd25f2c2525-klipper-cache\") pod \"00c67c66-2efc-4093-afcb-bcd25f2c2525\" (UID: \"00c67c66-2efc-4093-afcb-bcd25f2c2525\") "1990machine # [ 37.972479] k3s[875]: I0928 16:27:46.929724 875 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00c67c66-2efc-4093-afcb-bcd25f2c2525-content" pod "00c67c66-2efc-4093-afcb-bcd25f2c2525" (UID: "00c67c66-2efc-4093-afcb-bcd25f2c2525"). InnerVolumeSpecName "content". PluginName "kubernetes.io/configmap", VolumeGIDValue ""1991machine # [ 37.997954] systemd[1]: var-lib-kubelet-pods-00c67c66\x2d2efc\x2d4093\x2dafcb\x2dbcd25f2c2525-volumes-kubernetes.io\x7eprojected-values.mount: Deactivated successfully.1992machine # [ 37.998710] k3s[875]: I0928 16:27:46.962184 875 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00c67c66-2efc-4093-afcb-bcd25f2c2525-tmp" pod "00c67c66-2efc-4093-afcb-bcd25f2c2525" (UID: "00c67c66-2efc-4093-afcb-bcd25f2c2525"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""1993machine # [ 37.999435] k3s[875]: I0928 16:27:46.962421 875 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00c67c66-2efc-4093-afcb-bcd25f2c2525-values" pod "00c67c66-2efc-4093-afcb-bcd25f2c2525" (UID: "00c67c66-2efc-4093-afcb-bcd25f2c2525"). InnerVolumeSpecName "values". PluginName "kubernetes.io/projected", VolumeGIDValue ""1994machine # [ 37.999996] k3s[875]: I0928 16:27:46.962505 875 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00c67c66-2efc-4093-afcb-bcd25f2c2525-klipper-config" pod "00c67c66-2efc-4093-afcb-bcd25f2c2525" (UID: "00c67c66-2efc-4093-afcb-bcd25f2c2525"). InnerVolumeSpecName "klipper-config". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""1995machine # [ 38.000496] k3s[875]: I0928 16:27:46.962540 875 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00c67c66-2efc-4093-afcb-bcd25f2c2525-kube-api-access-gwfxp" pod "00c67c66-2efc-4093-afcb-bcd25f2c2525" (UID: "00c67c66-2efc-4093-afcb-bcd25f2c2525"). InnerVolumeSpecName "kube-api-access-gwfxp". PluginName "kubernetes.io/projected", VolumeGIDValue ""1996machine # [ 38.001089] k3s[875]: I0928 16:27:46.963333 875 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00c67c66-2efc-4093-afcb-bcd25f2c2525-klipper-helm" pod "00c67c66-2efc-4093-afcb-bcd25f2c2525" (UID: "00c67c66-2efc-4093-afcb-bcd25f2c2525"). InnerVolumeSpecName "klipper-helm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""1997machine # [ 38.001585] systemd[1]: var-lib-kubelet-pods-00c67c66\x2d2efc\x2d4093\x2dafcb\x2dbcd25f2c2525-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dgwfxp.mount: Deactivated successfully.1998machine # [ 38.002199] systemd[1]: var-lib-kubelet-pods-00c67c66\x2d2efc\x2d4093\x2dafcb\x2dbcd25f2c2525-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully.1999machine # [ 38.002665] systemd[1]: var-lib-kubelet-pods-00c67c66\x2d2efc\x2d4093\x2dafcb\x2dbcd25f2c2525-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dconfig.mount: Deactivated successfully.2000machine # [ 38.003229] systemd[1]: var-lib-kubelet-pods-00c67c66\x2d2efc\x2d4093\x2dafcb\x2dbcd25f2c2525-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dhelm.mount: Deactivated successfully.2001machine # [ 38.031226] k3s[875]: I0928 16:27:46.996368 875 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00c67c66-2efc-4093-afcb-bcd25f2c2525-klipper-cache" pod "00c67c66-2efc-4093-afcb-bcd25f2c2525" (UID: "00c67c66-2efc-4093-afcb-bcd25f2c2525"). InnerVolumeSpecName "klipper-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""2002machine # [ 38.031729] systemd[1]: var-lib-kubelet-pods-00c67c66\x2d2efc\x2d4093\x2dafcb\x2dbcd25f2c2525-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dcache.mount: Deactivated successfully.2003machine # [ 38.063992] k3s[875]: I0928 16:27:47.029044 875 reconciler_common.go:299] "Volume detached for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/00c67c66-2efc-4093-afcb-bcd25f2c2525-klipper-cache\") on node \"machine\" DevicePath \"\""2004machine # [ 38.065054] k3s[875]: I0928 16:27:47.029096 875 reconciler_common.go:299] "Volume detached for volume \"values\" (UniqueName: \"kubernetes.io/projected/00c67c66-2efc-4093-afcb-bcd25f2c2525-values\") on node \"machine\" DevicePath \"\""2005machine # [ 38.065750] k3s[875]: I0928 16:27:47.029110 875 reconciler_common.go:299] "Volume detached for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/00c67c66-2efc-4093-afcb-bcd25f2c2525-klipper-config\") on node \"machine\" DevicePath \"\""2006machine # [ 38.066592] k3s[875]: I0928 16:27:47.029122 875 reconciler_common.go:299] "Volume detached for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/00c67c66-2efc-4093-afcb-bcd25f2c2525-klipper-helm\") on node \"machine\" DevicePath \"\""2007machine # [ 38.066833] k3s[875]: I0928 16:27:47.029134 875 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00c67c66-2efc-4093-afcb-bcd25f2c2525-tmp\") on node \"machine\" DevicePath \"\""2008machine # [ 38.067680] k3s[875]: I0928 16:27:47.029149 875 reconciler_common.go:299] "Volume detached for volume \"content\" (UniqueName: \"kubernetes.io/configmap/00c67c66-2efc-4093-afcb-bcd25f2c2525-content\") on node \"machine\" DevicePath \"\""2009machine # [ 38.068491] k3s[875]: I0928 16:27:47.029165 875 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwfxp\" (UniqueName: \"kubernetes.io/projected/00c67c66-2efc-4093-afcb-bcd25f2c2525-kube-api-access-gwfxp\") on node \"machine\" DevicePath \"\""2010machine # [ 38.107757] dhcpcd[684]: veth0cee83f3: soliciting a DHCP lease2011machine # [ 38.259756] dhcpcd[684]: veth0cee83f3: soliciting an IPv6 router2012machine # [ 38.497144] dhcpcd[684]: veth6b54cd8a: soliciting an IPv6 router2013machine # [ 38.596798] k3s[875]: I0928 16:27:47.561507 875 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"2014machine # [ 38.598289] k3s[875]: I0928 16:27:47.561626 875 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d0bfc6a569f4ffc1b23ac75303ea219e36d39de3ff22283e81d817636cf3bd6"2015machine # [ 38.612629] systemd[1]: Removed slice libcontainer container kubepods-burstable-pod00c67c66_2efc_4093_afcb_bcd25f2c2525.slice.2016machine # [ 38.616637] systemd[1]: kubepods-burstable-pod00c67c66_2efc_4093_afcb_bcd25f2c2525.slice: Consumed 603ms CPU time over 5.869s wall clock time, 33M memory peak, 2.4M incoming IP traffic, 149.3K outgoing IP traffic.2017machine # [ 38.875408] dhcpcd[684]: veth1eadf193: probing for an IPv4LL address2018machine # [ 40.469948] k3s[875]: I0928 16:27:49.434290 875 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"2019machine # [ 41.854411] dhcpcd[684]: veth6b54cd8a: probing for an IPv4LL address2020machine # [ 42.417177] dhcpcd[684]: veth4075250e: probing for an IPv4LL address2021machine # [ 42.876368] dhcpcd[684]: veth4473bd23: probing for an IPv4LL address2022machine # [ 42.922870] dhcpcd[684]: flannel.1: using IPv4LL address 169.254.245.1382023machine # [ 42.925371] dhcpcd[684]: flannel.1: adding route to 169.254.0.0/162024machine # [ 43.108698] dhcpcd[684]: veth0cee83f3: probing for an IPv4LL address2025machine # [ 43.991854] dhcpcd[684]: veth1eadf193: using IPv4LL address 169.254.100.962026machine # [ 43.994439] dhcpcd[684]: veth1eadf193: adding route to 169.254.0.0/162027machine # error: timed out waiting for the condition2028machine # [ 46.458747] dhcpcd[684]: flannel.1: no IPv6 Routers available2029machine # [ 47.059413] dhcpcd[684]: veth4075250e: using IPv4LL address 169.254.141.622030machine # [ 47.061967] dhcpcd[684]: veth4075250e: adding route to 169.254.0.0/162031machine # [ 47.102590] dhcpcd[684]: veth6b54cd8a: using IPv4LL address 169.254.159.522032machine # [ 47.105163] dhcpcd[684]: veth6b54cd8a: adding route to 169.254.0.0/162033machine # [ 47.195121] dhcpcd[684]: veth1eadf193: no IPv6 Routers available2034machine # [ 47.933858] dhcpcd[684]: veth0cee83f3: using IPv4LL address 169.254.138.1192035machine # [ 47.936553] dhcpcd[684]: veth0cee83f3: adding route to 169.254.0.0/162036machine # [ 48.008606] dhcpcd[684]: veth4473bd23: using IPv4LL address 169.254.104.2232037machine # [ 48.011237] dhcpcd[684]: veth4473bd23: adding route to 169.254.0.0/162038machine # [ 48.545946] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount3097341483.mount: Deactivated successfully.2039machine # [ 49.412877] dhcpcd[684]: veth4075250e: no IPv6 Routers available2040machine # [ 49.662032] dhcpcd[684]: veth4473bd23: no IPv6 Routers available2041machine # [ 50.319941] dhcpcd[684]: segfault at 5f007341b ip 00005f0066ca7cb3 sp 00007ffd07519d88 error 4 in dhcpcd[38cb3,5f0066c78000+40000] likely on CPU 2 (core 2, socket 0)2042machine # [ 50.325017] Code: 45 ae 01 e9 0f fe ff ff 0f 1f 80 00 00 00 00 c6 45 af 01 e9 ff fd ff ff e8 fa 05 fd ff 66 2e 0f 1f 84 00 00 00 00 00 48 8b 07 <48> 8b 80 50 03 00 00 48 85 c0 74 31 90 48 8b 00 48 85 c0 74 1e 482043machine # [ 50.189128] systemd-coredump[2716]: Process 684 (dhcpcd) of user 999 terminated abnormally with signal 11/SEGV, processing...2044machine # [ 50.198487] systemd[1]: Created slice Slice /system/systemd-coredump.2045machine # [ 50.201823] systemd[1]: Started Process Core Dump (PID 2716/UID 0).2046machine # [ 50.381598] systemd-coredump[2717]: Process 684 (dhcpcd) of user 999 dumped core.2047machine # 2048machine # Module udev.so without build-id.2049machine # Module dhcpcd without build-id.2050machine # Stack trace of thread 684:2051machine # #0 0x00005f0066ca7cb3 ipv6nd_expire (dhcpcd + 0x38cb3)2052machine # #1 0x00005f0066c8106a eloop_start (dhcpcd + 0x1206a)2053machine # #2 0x00005f0066c79300 main (dhcpcd + 0xa300)2054machine # #3 0x000071ac6c23a285 __libc_start_call_main (libc.so.6 + 0x2b285)2055machine # #4 0x000071ac6c23a338 __libc_start_main@@GLIBC_2.34 (libc.so.6 + 0x2b338)2056machine # #5 0x00005f0066c7a365 _start (dhcpcd + 0xb365)2057machine # ELF object binary architecture: AMD x86-642058machine # 2059machine # [ 50.399686] systemd[1]: systemd-coredump@0-1-2716_2717-0.service: Deactivated successfully.2060machine # [ 50.478272] systemd[1]: dhcpcd.service: Main process exited, code=dumped, status=11/SEGV2061machine # [ 50.482446] systemd[1]: dhcpcd.service: Failed with result 'core-dump'.2062machine # [ 50.486246] systemd[1]: dhcpcd.service: Consumed 573ms CPU time over 42.693s wall clock time, 6.5M memory peak, 8K written to disk, 96B incoming IP traffic, 1.3K outgoing IP traffic.2063machine # [ 50.731337] systemd[1]: dhcpcd.service: Scheduled restart job, restart counter is at 1.2064machine # [ 50.737805] systemd[1]: Starting DHCP Client...2065machine # [ 50.785849] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped2442096823.mount: Deactivated successfully.2066machine # [ 50.845956] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped1860999635.mount: Deactivated successfully.2067machine # [ 50.910155] dhcpcd[2731]: dhcpcd-10.3.2 starting2068machine # [ 50.912243] dhcpcd[2762]: dev: loaded udev2069machine # [ 50.912985] dhcpcd[2762]: DUID 00:01:00:01:32:4d:51:e5:52:54:00:12:34:562070machine # [ 50.915279] systemd[1]: Started libcontainer container 87be9547d84bd4c750875fd3268e39b5ede30fac5909341560067a414ebd5a32.2071machine # [ 50.995719] systemd[1]: Started libcontainer container 4ded523a72cc44d6cc5cdaa19359c7dfe749d1ee06292e56009f32b6740e6d9a.2072machine # [ 51.004915] dhcpcd[2762]: eth0: IAID 00:12:34:562073machine # [ 51.005612] dhcpcd[2762]: flannel.1: IAID fc:b2:5d:852074machine # [ 51.005909] dhcpcd[2762]: veth1eadf193: IAID 5b:6b:05:752075machine # [ 51.006651] dhcpcd[2762]: veth6b54cd8a: IAID 75:19:b9:4e2076machine # [ 51.007928] dhcpcd[2762]: veth4473bd23: IAID b3:97:fc:1c2077machine # [ 51.008586] dhcpcd[2762]: veth4075250e: IAID b4:57:0d:1b2078machine # [ 51.009155] dhcpcd[2762]: veth0cee83f3: IAID 8d:88:42:142079machine # [ 51.116847] niks3-server[1182]: 2026/09/28 16:28:00 INFO lead: acquired remote=10.42.0.6:546402080machine # [ 51.131589] dhcpcd[2762]: veth4473bd23: soliciting an IPv6 router2081machine # [ 51.194054] dhcpcd[2762]: flannel.1: soliciting an IPv6 router2082machine # [ 51.294613] dhcpcd[2762]: veth0cee83f3: soliciting an IPv6 router2083machine # [ 51.437644] dhcpcd[2762]: veth6b54cd8a: soliciting an IPv6 router2084machine # [ 51.689448] k3s[875]: I0928 16:28:00.654120 875 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-scheduler-c5d75967-gjhh7" podStartSLOduration=2.460383508 podStartE2EDuration="16.654082706s" totalImagesPullingTime="14.193699198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-28 16:27:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-28 16:28:00.652509601 +0000 UTC m=+35.919392824" watchObservedRunningTime="2026-09-28 16:28:00.654082706 +0000 UTC m=+35.920968723"2085machine # [ 51.756193] dhcpcd[2762]: veth6b54cd8a: soliciting a DHCP lease2086machine # [ 51.761542] dhcpcd[2762]: veth1eadf193: soliciting an IPv6 router2087machine # [ 51.776872] dhcpcd[2762]: veth1eadf193: soliciting a DHCP lease2088machine # [ 51.785498] systemd[1]: Started libcontainer container 845c58883d14401b1146a12b5f88953a2a3db1197d293251d6d71015087e8620.2089machine # [ 51.789488] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount2599200221.mount: Deactivated successfully.2090machine # [ 51.905500] dhcpcd[2762]: veth4075250e: soliciting an IPv6 router2091machine # [ 51.999645] dhcpcd[2762]: eth0: soliciting an IPv6 router2092machine # [ 52.001109] dhcpcd[2762]: eth0: Router Advertisement from fe80::22093machine # [ 52.002346] dhcpcd[2762]: eth0: adding address fec0::5054:ff:fe12:3456/642094machine # [ 52.040598] dhcpcd[2762]: veth4075250e: soliciting a DHCP lease2095machine # [ 52.340397] systemd[1]: cri-containerd-87be9547d84bd4c750875fd3268e39b5ede30fac5909341560067a414ebd5a32.scope: Deactivated successfully.2096machine # [ 52.341386] systemd[1]: cri-containerd-87be9547d84bd4c750875fd3268e39b5ede30fac5909341560067a414ebd5a32.scope: Consumed 686ms CPU time over 1.424s wall clock time, 304.4M memory peak, 40.5M read from disk, 240.6M written to disk.2097machine # [ 52.404713] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-87be9547d84bd4c750875fd3268e39b5ede30fac5909341560067a414ebd5a32-rootfs.mount: Deactivated successfully.2098machine # [ 52.447968] dhcpcd[2762]: veth0cee83f3: soliciting a DHCP lease2099machine # [ 52.611465] dhcpcd[2762]: veth4473bd23: soliciting a DHCP lease2100machine # [ 52.715903] systemd[1]: cri-containerd-845c58883d14401b1146a12b5f88953a2a3db1197d293251d6d71015087e8620.scope: Deactivated successfully.2101machine # [ 52.717399] systemd[1]: cri-containerd-845c58883d14401b1146a12b5f88953a2a3db1197d293251d6d71015087e8620.scope: Consumed 595ms CPU time over 930ms wall clock time, 356.8M memory peak, 56M read from disk, 224.2M written to disk.2102machine # [ 52.767784] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-845c58883d14401b1146a12b5f88953a2a3db1197d293251d6d71015087e8620-rootfs.mount: Deactivated successfully.2103machine # [ 52.817320] dhcpcd[2762]: eth0: rebinding lease of 10.0.2.152104machine # [ 52.829467] dhcpcd[2762]: eth0: leased 10.0.2.15 for 86400 seconds2105machine # [ 52.831357] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped950611990.mount: Deactivated successfully.2106machine # [ 52.834131] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount3844395890.mount: Deactivated successfully.2107machine # [ 52.864314] systemd[1]: Started DHCP Client.2108machine # [ 52.901519] dhcpcd[2762]: flannel.1: soliciting a DHCP lease2109machine # [ 52.953437] systemd[1]: Started libcontainer container e5c534f6032cc96f1249d1cf00e017078730184feb347a8c8141cfada9cdfa06.2110machine # [ 53.110298] systemd[1]: Started libcontainer container 961eef82524f2f3a22916dc72bd011e4312cb04ff63215f3d2c815e4e0eea866.2111machine # [ 53.306552] systemd[1]: Started libcontainer container 283518d715ca3fa18694f39bf5eea58a3beb22871d29c98deab12ada93486574.2112machine # [ 53.751629] k3s[875]: I0928 16:28:02.716060 875 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5" podStartSLOduration=5.164852652 podStartE2EDuration="18.716024377s" totalImagesPullingTime="12.173288223s" totalInitContainerRuntime="1.377883502s" isStatefulPod=false podCreationTimestamp="2026-09-28 16:27:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-28 16:28:02.715451958 +0000 UTC m=+37.982337975" watchObservedRunningTime="2026-09-28 16:28:02.716024377 +0000 UTC m=+37.982910115"2113machine # [ 53.797263] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount3928262939.mount: Deactivated successfully.2114machine # [ 53.799422] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped2847764516.mount: Deactivated successfully.2115machine # [ 53.825436] systemd[1]: tmp-ovl\x2didmapped4112730979.mount: Deactivated successfully.2116machine # [ 53.840519] systemd[1]: Started libcontainer container c37846c27ec5cc30e270d3d02abe1a8c9b1cb8926d806a35c8e6f3ef140908f1.2117machine # [ 53.998491] systemd[1]: Started libcontainer container aa45e30d0c7c2d7c2901eed84b044e891c6910ee35f6a9801318ceb4613d0a26.2118machine # [ 54.301704] systemd[1]: Started libcontainer container e9b585d1cf51bb2ad5cf46d95b0a8554c77b7d624259575220156aa7d8864f22.2119machine # [ 54.796200] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped3910764363.mount: Deactivated successfully.2120machine # [ 54.847151] k3s[875]: I0928 16:28:03.811456 875 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-x65jw" podStartSLOduration=3.876145568 podStartE2EDuration="19.811432872s" totalImagesPullingTime="15.037282669s" totalInitContainerRuntime="898.004635ms" isStatefulPod=false podCreationTimestamp="2026-09-28 16:27:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-28 16:28:03.715762332 +0000 UTC m=+38.982651423" watchObservedRunningTime="2026-09-28 16:28:03.811432872 +0000 UTC m=+39.078316095"2121machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 30.15 seconds)2122machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s2123machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s, in 0.21 seconds)2124machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s2125machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s, in 1.99 seconds)2126machine: waiting for unit niks3.service2127machine: (finished: waiting for unit niks3.service, in 0.05 seconds)2128machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}'2129machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.23 seconds)2130machine: waiting for success: test $(curl -sf 10.42.0.4:9901/clusters | grep -c 'health_flags::healthy') -ge 32131machine # [ 61.410294] dhcpcd[2762]: veth6b54cd8a: using IPv4LL address 169.254.159.522132machine # [ 61.412847] dhcpcd[2762]: flannel.1: adding route to 169.254.0.0/162133machine # [ 61.415240] dhcpcd[2762]: veth1eadf193: adding route to 169.254.0.0/162134machine # [ 61.417454] dhcpcd[2762]: veth6b54cd8a: adding route to 169.254.0.0/162135machine # [ 61.419674] dhcpcd[2762]: veth4473bd23: adding route to 169.254.0.0/162136machine # [ 61.421943] dhcpcd[2762]: veth4075250e: adding route to 169.254.0.0/162137machine # [ 61.424194] dhcpcd[2762]: veth0cee83f3: adding route to 169.254.0.0/162138machine # [ 61.835335] dhcpcd[2762]: veth1eadf193: using IPv4LL address 169.254.100.962139machine # [ 62.186809] dhcpcd[2762]: veth4075250e: using IPv4LL address 169.254.141.622140machine # [ 63.000891] dhcpcd[2762]: veth4473bd23: using IPv4LL address 169.254.104.2232141machine # [ 63.047554] dhcpcd[2762]: flannel.1: using IPv4LL address 169.254.245.1382142machine # [ 63.131952] dhcpcd[2762]: veth0cee83f3: using IPv4LL address 169.254.138.1192143machine # [ 63.175872] dhcpcd[2762]: veth4473bd23: no IPv6 Routers available2144machine # [ 63.196205] dhcpcd[2762]: flannel.1: no IPv6 Routers available2145machine # [ 63.296730] dhcpcd[2762]: veth0cee83f3: no IPv6 Routers available2146machine # [ 63.439985] dhcpcd[2762]: veth6b54cd8a: no IPv6 Routers available2147machine # [ 63.763605] dhcpcd[2762]: veth1eadf193: no IPv6 Routers available2148machine # [ 63.909189] dhcpcd[2762]: veth4075250e: no IPv6 Routers available2149machine: (finished: waiting for success: test $(curl -sf 10.42.0.4:9901/clusters | grep -c 'health_flags::healthy') -ge 3, in 14.87 seconds)2150machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}'2151machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.23 seconds)2152machine: waiting for success: curl -sf http://10.42.0.6:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2'2153machine: (finished: waiting for success: curl -sf http://10.42.0.6:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2', in 0.06 seconds)2154(finished: subtest: chart deploys and workers become Ready, in 47.81 seconds)2155machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}'2156machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}', in 0.18 seconds)2157machine: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt2158machine: (finished: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt, in 0.14 seconds)2159subtest: build through the balancer lands in the cache2160machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&12161machine # [ 134.815885] niks3-server[1182]: 2026/09/28 16:29:23 INFO Received push request method=POST path=/api/pushes2162machine # [ 134.845191] niks3-server[1182]: 2026/09/28 16:29:23 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign2163machine # [ 134.854108] niks3-server[1182]: 2026/09/28 16:29:23 INFO Signed narinfos id=1 count=12164machine # [ 134.862920] niks3-server[1182]: 2026/09/28 16:29:23 INFO Registered completed upload object_key=nar/0nzzbas7l8d37mridr7mg162smfjvn7lhs6am4crl4ydaxicigj8.nar.zst2165machine # [ 134.867304] niks3-server[1182]: 2026/09/28 16:29:23 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.ls2166machine # [ 134.869242] niks3-server[1182]: 2026/09/28 16:29:23 INFO Received complete push request method=POST path=/api/pushes/1/complete2167machine # [ 134.875793] niks3-server[1182]: 2026/09/28 16:29:23 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.narinfo2168machine # [ 159.601835] niks3-server[1182]: 2026/09/28 16:29:48 INFO Received push request method=POST path=/api/pushes2169machine # [ 159.626357] niks3-server[1182]: 2026/09/28 16:29:48 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign2170machine # [ 159.631340] niks3-server[1182]: 2026/09/28 16:29:48 INFO Signed narinfos id=2 count=12171machine # [ 159.635650] niks3-server[1182]: 2026/09/28 16:29:48 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.ls2172machine # [ 159.639969] niks3-server[1182]: 2026/09/28 16:29:48 INFO Registered completed upload object_key=nar/1p7jh5nyz9n68k5f18ymmdpgr34mpnnch1njw7ki7b2b97qlfbjk.nar.zst2173machine # [ 159.644837] niks3-server[1182]: 2026/09/28 16:29:48 INFO Registered completed upload object_key=log/yz1sqzb72i8v6h2ass0v76ba8cncqj9r-k3s-a.drv2174machine # [ 159.649590] niks3-server[1182]: 2026/09/28 16:29:48 INFO Received complete push request method=POST path=/api/pushes/2/complete2175machine # [ 159.653322] niks3-server[1182]: 2026/09/28 16:29:48 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.narinfo2176machine # [ 159.724738] niks3-server[1182]: 2026/09/28 16:29:48 INFO Received push request method=POST path=/api/pushes2177machine # [ 159.740197] niks3-server[1182]: 2026/09/28 16:29:48 INFO Received sign narinfos request method=POST path=/api/pushes/3/sign2178machine # [ 159.742225] niks3-server[1182]: 2026/09/28 16:29:48 INFO Signed narinfos id=3 count=12179machine # [ 159.743490] niks3-server[1182]: 2026/09/28 16:29:48 INFO Registered completed upload object_key=nar/03a4ywhyr5knmbc93z4gyml5y8fvgb431xvlmfxrwsm8mrb0qgx2.nar.zst2180machine # [ 159.746231] niks3-server[1182]: 2026/09/28 16:29:48 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.ls2181machine # [ 159.748958] niks3-server[1182]: 2026/09/28 16:29:48 INFO Received complete push request method=POST path=/api/pushes/3/complete2182machine # [ 159.753510] niks3-server[1182]: 2026/09/28 16:29:48 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.narinfo2183machine # [ 184.268357] niks3-server[1182]: 2026/09/28 16:30:13 INFO Received push request method=POST path=/api/pushes2184machine # [ 184.289426] niks3-server[1182]: 2026/09/28 16:30:13 INFO Registered completed upload object_key=log/zfq1xw9bmycqh35l0s44lmv65z4xc7br-k3s-b.drv2185machine # [ 184.291591] niks3-server[1182]: 2026/09/28 16:30:13 INFO Registered completed upload object_key=nar/05qjsj5ff3a6vnxkhb6k5f3m446dcc206p7cd37w4v3mgi95d7kh.nar.zst2186machine # [ 184.299266] niks3-server[1182]: 2026/09/28 16:30:13 INFO Received sign narinfos request method=POST path=/api/pushes/4/sign2187machine # [ 184.303828] niks3-server[1182]: 2026/09/28 16:30:13 INFO Signed narinfos id=4 count=12188machine # [ 184.307128] niks3-server[1182]: 2026/09/28 16:30:13 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.ls2189machine # [ 184.313631] niks3-server[1182]: 2026/09/28 16:30:13 INFO Received complete push request method=POST path=/api/pushes/4/complete2190machine # [ 184.317585] niks3-server[1182]: 2026/09/28 16:30:13 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.narinfo2191machine # [ 184.390505] niks3-server[1182]: 2026/09/28 16:30:13 INFO Received push request method=POST path=/api/pushes2192machine # [ 184.404788] niks3-server[1182]: 2026/09/28 16:30:13 INFO Received sign narinfos request method=POST path=/api/pushes/5/sign2193machine # [ 184.408797] niks3-server[1182]: 2026/09/28 16:30:13 INFO Signed narinfos id=5 count=12194machine # [ 184.411822] niks3-server[1182]: 2026/09/28 16:30:13 INFO Registered completed upload object_key=nar/0jyw88klkf3nwxpnj5m5lx3i1dv2idf3hcn6im7883hnldm3gvyq.nar.zst2195machine # [ 184.413521] niks3-server[1182]: 2026/09/28 16:30:13 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.ls2196machine # [ 184.416686] niks3-server[1182]: 2026/09/28 16:30:13 INFO Received complete push request method=POST path=/api/pushes/5/complete2197machine # [ 184.422162] niks3-server[1182]: 2026/09/28 16:30:13 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.narinfo2198machine # [ 209.735518] niks3-server[1182]: 2026/09/28 16:30:38 INFO Received push request method=POST path=/api/pushes2199machine # [ 209.758986] niks3-server[1182]: 2026/09/28 16:30:38 INFO Received sign narinfos request method=POST path=/api/pushes/6/sign2200machine # [ 209.761977] niks3-server[1182]: 2026/09/28 16:30:38 INFO Signed narinfos id=6 count=12201machine # [ 209.767725] niks3-server[1182]: 2026/09/28 16:30:38 INFO Registered completed upload object_key=log/n40czam6a4ldp1mh5fdmlcy07fv0akbm-k3s-top.drv2202machine # [ 209.770389] niks3-server[1182]: 2026/09/28 16:30:38 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.ls2203machine # [ 209.772381] niks3-server[1182]: 2026/09/28 16:30:38 INFO Registered completed upload object_key=nar/1q8vp5xqws560mpf8rxk8r8jhqrzibivh13x4wxy0cfqlzbk7cr5.nar.zst2204machine # [ 209.784057] niks3-server[1182]: 2026/09/28 16:30:38 INFO Received complete push request method=POST path=/api/pushes/6/complete2205machine # [ 209.787433] niks3-server[1182]: 2026/09/28 16:30:38 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.narinfo2206machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1, in 136.26 seconds)2207machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath2208machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath, in 0.14 seconds)2209machine: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top2210machine: (finished: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.01 seconds)2211machine: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top2212machine # copying 3 paths...2213machine # copying path '/nix/store/r95r891injj9ski5c4w89yxjvjy065mx-k3s-a' from 'http://192.168.1.1:5751'...2214machine # copying path '/nix/store/mrqsh0475wxsmnsvkk55g94v6g5nrcra-k3s-b' from 'http://192.168.1.1:5751'...2215machine # copying path '/nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top' from 'http://192.168.1.1:5751'...2216machine: (finished: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.17 seconds)2217machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&12218machine # [ 210.464934] niks3-server[1182]: 2026/09/28 16:30:39 INFO Received push request method=POST path=/api/pushes2219machine # [ 210.492238] niks3-server[1182]: 2026/09/28 16:30:39 INFO Registered completed upload object_key=nar/1fr26arhri17j9bj6hyjzmmd74v730biz1gb3kqd194vjx3ccvp9.nar.zst2220machine # [ 210.496978] niks3-server[1182]: 2026/09/28 16:30:39 INFO Received sign narinfos request method=POST path=/api/pushes/7/sign2221machine # [ 210.498361] niks3-server[1182]: 2026/09/28 16:30:39 INFO Signed narinfos id=7 count=12222machine # [ 210.503326] niks3-server[1182]: 2026/09/28 16:30:39 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.ls2223machine # [ 210.509200] niks3-server[1182]: 2026/09/28 16:30:39 INFO Received complete push request method=POST path=/api/pushes/7/complete2224machine # [ 210.512947] niks3-server[1182]: 2026/09/28 16:30:39 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.narinfo2225machine # [ 235.031301] niks3-server[1182]: 2026/09/28 16:31:03 INFO Received push request method=POST path=/api/pushes2226machine # [ 235.053648] niks3-server[1182]: 2026/09/28 16:31:04 INFO Received sign narinfos request method=POST path=/api/pushes/8/sign2227machine # [ 235.056971] niks3-server[1182]: 2026/09/28 16:31:04 INFO Signed narinfos id=8 count=12228machine # [ 235.060428] niks3-server[1182]: 2026/09/28 16:31:04 INFO Registered completed upload object_key=log/pbpqsh50ar10fpasdqqx8xg3lmr5j8iz-k3s-a.drv2229machine # [ 235.063236] niks3-server[1182]: 2026/09/28 16:31:04 INFO Registered completed upload object_key=nar/1hfc6x4x25k3b0fk091d3nb0k3mympfp05fkslcx19synp3ig0zd.nar.zst2230machine # [ 235.068586] niks3-server[1182]: 2026/09/28 16:31:04 INFO Received complete push request method=POST path=/api/pushes/8/complete2231machine # [ 235.073591] niks3-server[1182]: 2026/09/28 16:31:04 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.narinfo2232machine # [ 235.081081] niks3-server[1182]: 2026/09/28 16:31:04 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.ls2233machine # [ 235.140329] niks3-server[1182]: 2026/09/28 16:31:04 INFO Received push request method=POST path=/api/pushes2234machine # [ 235.150805] niks3-server[1182]: 2026/09/28 16:31:04 INFO Received sign narinfos request method=POST path=/api/pushes/9/sign2235machine # [ 235.154403] niks3-server[1182]: 2026/09/28 16:31:04 INFO Signed narinfos id=9 count=12236machine # [ 235.154717] niks3-server[1182]: 2026/09/28 16:31:04 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.ls2237machine # [ 235.155479] niks3-server[1182]: 2026/09/28 16:31:04 INFO Registered completed upload object_key=nar/0zzq2vgjln4shvh57091n14sam6wh6w06vja6lzb9ppcj4ffyx1n.nar.zst2238machine # [ 235.165433] niks3-server[1182]: 2026/09/28 16:31:04 INFO Received complete push request method=POST path=/api/pushes/9/complete2239machine # [ 235.170140] niks3-server[1182]: 2026/09/28 16:31:04 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.narinfo2240machine # [ 259.676200] niks3-server[1182]: 2026/09/28 16:31:28 INFO Received push request method=POST path=/api/pushes2241machine # [ 259.692088] niks3-server[1182]: 2026/09/28 16:31:28 INFO Received sign narinfos request method=POST path=/api/pushes/10/sign2242machine # [ 259.695790] niks3-server[1182]: 2026/09/28 16:31:28 INFO Signed narinfos id=10 count=12243machine # [ 259.698528] niks3-server[1182]: 2026/09/28 16:31:28 INFO Registered completed upload object_key=log/894h6wzw2l4w5f0hikj1k6q57jfnyi87-k3s-b.drv2244machine # [ 259.701164] niks3-server[1182]: 2026/09/28 16:31:28 INFO Registered completed upload object_key=nar/0hh3nqk95r6g32lhdmxw8cxjv694vbpx9876zkhcpg4r4qxni2ch.nar.zst2245machine # [ 259.704169] niks3-server[1182]: 2026/09/28 16:31:28 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.ls2246machine # [ 259.708329] niks3-server[1182]: 2026/09/28 16:31:28 INFO Received complete push request method=POST path=/api/pushes/10/complete2247machine # [ 259.714826] niks3-server[1182]: 2026/09/28 16:31:28 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.narinfo2248machine # [ 259.780326] niks3-server[1182]: 2026/09/28 16:31:28 INFO Received push request method=POST path=/api/pushes2249machine # [ 259.790298] niks3-server[1182]: 2026/09/28 16:31:28 INFO Received sign narinfos request method=POST path=/api/pushes/11/sign2250machine # [ 259.791182] niks3-server[1182]: 2026/09/28 16:31:28 INFO Signed narinfos id=11 count=12251machine # [ 259.795296] niks3-server[1182]: 2026/09/28 16:31:28 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.ls2252machine # [ 259.798596] niks3-server[1182]: 2026/09/28 16:31:28 INFO Registered completed upload object_key=nar/0ingamx56k31lwiyxmnxmscjj4n3qfx6sr2kpaynsrwhwz1278iw.nar.zst2253machine # [ 259.800704] niks3-server[1182]: 2026/09/28 16:31:28 INFO Received complete push request method=POST path=/api/pushes/11/complete2254machine # [ 259.805770] niks3-server[1182]: 2026/09/28 16:31:28 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.narinfo2255machine # [ 284.724463] niks3-server[1182]: 2026/09/28 16:31:53 INFO Received push request method=POST path=/api/pushes2256machine # [ 284.742406] niks3-server[1182]: 2026/09/28 16:31:53 INFO Received sign narinfos request method=POST path=/api/pushes/12/sign2257machine # [ 284.745915] niks3-server[1182]: 2026/09/28 16:31:53 INFO Signed narinfos id=12 count=12258machine # [ 284.748835] niks3-server[1182]: 2026/09/28 16:31:53 INFO Registered completed upload object_key=log/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g-k3s-top.drv2259machine # [ 284.750659] niks3-server[1182]: 2026/09/28 16:31:53 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.ls2260machine # [ 284.752445] niks3-server[1182]: 2026/09/28 16:31:53 INFO Registered completed upload object_key=nar/0v48x4sp58bvfra08axgkz7yl1n9nc4nirskyv1hwann4i7q277i.nar.zst2261machine # [ 284.759203] niks3-server[1182]: 2026/09/28 16:31:53 INFO Received complete push request method=POST path=/api/pushes/12/complete2262machine # [ 284.769663] niks3-server[1182]: 2026/09/28 16:31:53 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.narinfo2263machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1, in 75.69 seconds)2264(finished: subtest: build through the balancer lands in the cache, in 212.26 seconds)2265subtest: a Job with the client image builds through the farm with its service account2266machine: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt2267machine: (finished: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.23 seconds)2268machine: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix2269machine: (finished: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix, in 0.14 seconds)2270machine: must succeed: kubectl apply -f /nix/store/4qg21n7g16x8lyv0fhhdx9dx3lxqkcdn-ci-job.json2271machine: (finished: must succeed: kubectl apply -f /nix/store/4qg21n7g16x8lyv0fhhdx9dx3lxqkcdn-ci-job.json, in 0.17 seconds)2272machine: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed'2273machine # [ 286.750527] systemd[1]: Created slice libcontainer container kubepods-besteffort-podb47cff35_98d4_491a_8ec0_8a61a8f22802.slice.2274machine # [ 286.789194] k3s[875]: I0928 16:31:55.753638 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5b7q\" (UniqueName: \"kubernetes.io/projected/b47cff35-98d4-491a-8ec0-8a61a8f22802-kube-api-access-s5b7q\") pod \"ci-szjqc\" (UID: \"b47cff35-98d4-491a-8ec0-8a61a8f22802\") " pod="ci/ci-szjqc"2275machine # [ 286.790265] k3s[875]: I0928 16:31:55.753743 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/b47cff35-98d4-491a-8ec0-8a61a8f22802-nix-grpc-farm\") pod \"ci-szjqc\" (UID: \"b47cff35-98d4-491a-8ec0-8a61a8f22802\") " pod="ci/ci-szjqc"2276machine # [ 286.791838] k3s[875]: I0928 16:31:55.753856 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"job\" (UniqueName: \"kubernetes.io/configmap/b47cff35-98d4-491a-8ec0-8a61a8f22802-job\") pod \"ci-szjqc\" (UID: \"b47cff35-98d4-491a-8ec0-8a61a8f22802\") " pod="ci/ci-szjqc"2277machine # [ 287.252713] cni0: port 2(vethba28b59a) entered blocking state2278machine # [ 287.255295] cni0: port 2(vethba28b59a) entered disabled state2279machine # [ 287.257977] vethba28b59a: entered allmulticast mode2280machine # [ 287.260834] vethba28b59a: entered promiscuous mode2281machine # [ 287.278659] cni0: port 2(vethba28b59a) entered blocking state2282machine # [ 287.280679] cni0: port 2(vethba28b59a) entered forwarding state2283machine # [ 287.160501] (udev-worker)[4984]: Network interface NamePolicy= disabled on kernel command line.2284machine # [ 287.184380] dhcpcd[2762]: vethba28b59a: IAID 27:1a:3d:7e2285machine # [ 287.185294] dhcpcd[2762]: vethba28b59a: adding address fe80::2824:27ff:fe1a:3d7e2286machine # [ 287.218243] systemd[1]: Started libcontainer container 898572da69f83ad5253b521d24d948f3cee0b98cd403ad1675f8230eaf83198a.2287machine # [ 288.231637] dhcpcd[2762]: vethba28b59a: soliciting an IPv6 router2288machine # [ 288.759364] dhcpcd[2762]: vethba28b59a: soliciting a DHCP lease2289machine # [ 289.522412] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount2785187634.mount: Deactivated successfully.2290machine # [ 289.562304] systemd[1]: Started libcontainer container 9d95859989e2452d74a0c454275dd418a2d33aaccf11259e0755814f6ffdab01.2291machine # [ 290.881143] niks3-server[1182]: 2026/09/28 16:31:59 INFO Received push request method=POST path=/api/pushes2292machine # [ 290.894824] niks3-server[1182]: 2026/09/28 16:31:59 INFO Received sign narinfos request method=POST path=/api/pushes/13/sign2293machine # [ 290.896118] niks3-server[1182]: 2026/09/28 16:31:59 INFO Signed narinfos id=13 count=12294machine # [ 290.899186] niks3-server[1182]: 2026/09/28 16:31:59 INFO Registered completed upload object_key=nar/111g6dyibwcf2z7jhpn72rgja0qvjgpdiv9nc06g2dp7ih0a6kyq.nar.zst2295machine # [ 290.906623] niks3-server[1182]: 2026/09/28 16:31:59 INFO Received complete push request method=POST path=/api/pushes/13/complete2296machine # [ 290.910234] niks3-server[1182]: 2026/09/28 16:31:59 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.ls2297machine # [ 290.913475] niks3-server[1182]: 2026/09/28 16:31:59 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.narinfo2298machine # [ 293.762156] dhcpcd[2762]: vethba28b59a: probing for an IPv4LL address2299machine # [ 297.842339] dhcpcd[2762]: vethba28b59a: using IPv4LL address 169.254.128.2352300machine # [ 297.845074] dhcpcd[2762]: vethba28b59a: adding route to 169.254.0.0/162301machine # [ 300.235282] dhcpcd[2762]: vethba28b59a: no IPv6 Routers available2302machine # [ 309.798568] postgres[755]: [755] LOG: checkpoint starting: time2303machine # [ 315.430897] niks3-server[1182]: 2026/09/28 16:32:24 INFO Received push request method=POST path=/api/pushes2304machine # [ 315.453465] niks3-server[1182]: 2026/09/28 16:32:24 INFO Received sign narinfos request method=POST path=/api/pushes/14/sign2305machine # [ 315.457934] niks3-server[1182]: 2026/09/28 16:32:24 INFO Signed narinfos id=14 count=12306machine # [ 315.459730] niks3-server[1182]: 2026/09/28 16:32:24 INFO Registered completed upload object_key=nar/058kjd2vfl1r27b4d9ixvwf77d8rkr18a4v894kwx8lg0nwpajnr.nar.zst2307machine # [ 315.463262] niks3-server[1182]: 2026/09/28 16:32:24 INFO Registered completed upload object_key=log/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv2308machine # [ 315.469353] niks3-server[1182]: 2026/09/28 16:32:24 INFO Received complete push request method=POST path=/api/pushes/14/complete2309machine # [ 315.477081] niks3-server[1182]: 2026/09/28 16:32:24 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.ls2310machine # [ 315.477698] niks3-server[1182]: 2026/09/28 16:32:24 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.narinfo2311machine # [ 315.540562] niks3-server[1182]: 2026/09/28 16:32:24 INFO Received push request method=POST path=/api/pushes2312machine # [ 315.550795] niks3-server[1182]: 2026/09/28 16:32:24 INFO Received sign narinfos request method=POST path=/api/pushes/15/sign2313machine # [ 315.553076] niks3-server[1182]: 2026/09/28 16:32:24 INFO Signed narinfos id=15 count=12314machine # [ 315.559476] niks3-server[1182]: 2026/09/28 16:32:24 INFO Received complete push request method=POST path=/api/pushes/15/complete2315machine # [ 315.562076] niks3-server[1182]: 2026/09/28 16:32:24 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.ls2316machine # [ 315.564101] niks3-server[1182]: 2026/09/28 16:32:24 INFO Registered completed upload object_key=nar/138ynhcd5wxzz485x9qcq7xsargaklrf2li31ai69m5r46am35q6.nar.zst2317machine # [ 315.567898] niks3-server[1182]: 2026/09/28 16:32:24 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.narinfo2318machine # [ 340.083882] niks3-server[1182]: 2026/09/28 16:32:49 INFO Received push request method=POST path=/api/pushes2319machine # [ 340.101560] niks3-server[1182]: 2026/09/28 16:32:49 INFO Received sign narinfos request method=POST path=/api/pushes/16/sign2320machine # [ 340.103878] niks3-server[1182]: 2026/09/28 16:32:49 INFO Signed narinfos id=16 count=12321machine # [ 340.107877] niks3-server[1182]: 2026/09/28 16:32:49 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.ls2322machine # [ 340.110318] niks3-server[1182]: 2026/09/28 16:32:49 INFO Registered completed upload object_key=log/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv2323machine # [ 340.113971] niks3-server[1182]: 2026/09/28 16:32:49 INFO Received complete push request method=POST path=/api/pushes/16/complete2324machine # [ 340.116286] niks3-server[1182]: 2026/09/28 16:32:49 INFO Registered completed upload object_key=nar/0n4lbdlp8w72fs3qbavl2lwrzbrn55i2b1vyglc89cc3pi8vbb1m.nar.zst2325machine # [ 340.124095] niks3-server[1182]: 2026/09/28 16:32:49 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo2326machine # [ 340.188075] niks3-server[1182]: 2026/09/28 16:32:49 INFO Received push request method=POST path=/api/pushes2327machine # [ 340.199856] niks3-server[1182]: 2026/09/28 16:32:49 INFO Received sign narinfos request method=POST path=/api/pushes/17/sign2328machine # [ 340.203103] niks3-server[1182]: 2026/09/28 16:32:49 INFO Signed narinfos id=17 count=12329machine # [ 340.206069] niks3-server[1182]: 2026/09/28 16:32:49 INFO Registered completed upload object_key=nar/1f3gvnvqsm2pm3laixkxkg44kvjb251zqhszcfpp0a00h6x66ljs.nar.zst2330machine # [ 340.208450] niks3-server[1182]: 2026/09/28 16:32:49 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.ls2331machine # [ 340.212219] niks3-server[1182]: 2026/09/28 16:32:49 INFO Received complete push request method=POST path=/api/pushes/17/complete2332machine # [ 340.216443] niks3-server[1182]: 2026/09/28 16:32:49 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.narinfo2333machine # [ 365.104236] niks3-server[1182]: 2026/09/28 16:33:14 INFO Received push request method=POST path=/api/pushes2334machine # [ 365.120828] niks3-server[1182]: 2026/09/28 16:33:14 INFO Received sign narinfos request method=POST path=/api/pushes/18/sign2335machine # [ 365.125640] niks3-server[1182]: 2026/09/28 16:33:14 INFO Signed narinfos id=18 count=12336machine # [ 365.129471] niks3-server[1182]: 2026/09/28 16:33:14 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.ls2337machine # [ 365.131582] niks3-server[1182]: 2026/09/28 16:33:14 INFO Registered completed upload object_key=log/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv2338machine # [ 365.134953] niks3-server[1182]: 2026/09/28 16:33:14 INFO Registered completed upload object_key=nar/1zwf0asrdv12q40fmqga5lx5330dvn9y4in4i9ficz9ij5lhvnf5.nar.zst2339machine # [ 365.142042] niks3-server[1182]: 2026/09/28 16:33:14 INFO Received complete push request method=POST path=/api/pushes/18/complete2340machine # [ 365.147535] niks3-server[1182]: 2026/09/28 16:33:14 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo2341machine # [ 366.714592] niks3-server[1182]: 2026/09/28 16:33:15 INFO Received push request method=POST path=/api/pushes2342machine # [ 366.724805] niks3-server[1182]: 2026/09/28 16:33:15 INFO Received sign narinfos request method=POST path=/api/pushes/19/sign2343machine # [ 366.727366] niks3-server[1182]: 2026/09/28 16:33:15 INFO Signed narinfos id=19 count=12344machine # [ 366.731400] niks3-server[1182]: 2026/09/28 16:33:15 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.ls2345machine # [ 366.733263] niks3-server[1182]: 2026/09/28 16:33:15 INFO Registered completed upload object_key=nar/0xiyqcsl8db7dnrq2gqnx5izavr51ma3dcdswrriaxfgj3qzk7xf.nar.zst2346machine # [ 366.735656] niks3-server[1182]: 2026/09/28 16:33:15 INFO Received complete push request method=POST path=/api/pushes/19/complete2347machine # [ 366.738904] niks3-server[1182]: 2026/09/28 16:33:15 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.narinfo2348machine # [ 391.451742] niks3-server[1182]: 2026/09/28 16:33:40 INFO Received push request method=POST path=/api/pushes2349machine # [ 391.475788] niks3-server[1182]: 2026/09/28 16:33:40 INFO Received sign narinfos request method=POST path=/api/pushes/20/sign2350machine # [ 391.479132] niks3-server[1182]: 2026/09/28 16:33:40 INFO Signed narinfos id=20 count=12351machine # [ 391.482396] niks3-server[1182]: 2026/09/28 16:33:40 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.ls2352machine # [ 391.486208] niks3-server[1182]: 2026/09/28 16:33:40 INFO Registered completed upload object_key=log/fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv2353machine # [ 391.489458] niks3-server[1182]: 2026/09/28 16:33:40 INFO Registered completed upload object_key=nar/0p3l2z3riilylr2rxb1aq2blxdfxg55wbgp4gxkns93srbr4bwyq.nar.zst2354machine # [ 391.493535] niks3-server[1182]: 2026/09/28 16:33:40 INFO Received complete push request method=POST path=/api/pushes/20/complete2355machine # [ 391.500806] niks3-server[1182]: 2026/09/28 16:33:40 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo2356machine # [ 392.667748] systemd[1]: cri-containerd-9d95859989e2452d74a0c454275dd418a2d33aaccf11259e0755814f6ffdab01.scope: Deactivated successfully.2357machine # [ 392.669774] systemd[1]: cri-containerd-9d95859989e2452d74a0c454275dd418a2d33aaccf11259e0755814f6ffdab01.scope: Consumed 940ms CPU time over 1min 43.106s wall clock time, 94.2M memory peak, 24.7M read from disk, 428K written to disk, 18.3K incoming IP traffic, 44.8K outgoing IP traffic.2358machine # [ 392.727947] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-9d95859989e2452d74a0c454275dd418a2d33aaccf11259e0755814f6ffdab01-rootfs.mount: Deactivated successfully.2359machine # [ 394.143352] systemd[1]: cri-containerd-898572da69f83ad5253b521d24d948f3cee0b98cd403ad1675f8230eaf83198a.scope: Deactivated successfully.2360machine # [ 394.200408] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-898572da69f83ad5253b521d24d948f3cee0b98cd403ad1675f8230eaf83198a-rootfs.mount: Deactivated successfully.2361machine # [ 394.234754] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-898572da69f83ad5253b521d24d948f3cee0b98cd403ad1675f8230eaf83198a-shm.mount: Deactivated successfully.2362machine # [ 394.421555] cni0: port 2(vethba28b59a) entered disabled state2363machine # [ 394.269933] dhcpcd[2762]: vethba28b59a: carrier lost2364machine # [ 394.424174] vethba28b59a (unregistering): left allmulticast mode2365machine # [ 394.425291] vethba28b59a (unregistering): left promiscuous mode2366machine # [ 394.426312] cni0: port 2(vethba28b59a) entered disabled state2367machine # [ 394.293025] dhcpcd[2762]: vethba28b59a: deleting address fe80::2824:27ff:fe1a:3d7e2368machine # [ 394.294467] systemd[1]: run-netns-cni\x2d2d972c7f\x2da266\x2dea70\x2d486c\x2d6c494631061b.mount: Deactivated successfully.2369machine # [ 394.296188] dhcpcd[2762]: vethba28b59a: deleting route to 169.254.0.0/162370machine # [ 394.359298] dhcpcd[2762]: vethba28b59a: removing interface2371machine # [ 394.442500] k3s[875]: I0928 16:33:43.406898 875 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b47cff35-98d4-491a-8ec0-8a61a8f22802-job\" (UniqueName: \"kubernetes.io/configmap/b47cff35-98d4-491a-8ec0-8a61a8f22802-job\") pod \"b47cff35-98d4-491a-8ec0-8a61a8f22802\" (UID: \"b47cff35-98d4-491a-8ec0-8a61a8f22802\") "2372machine # [ 394.443589] k3s[875]: I0928 16:33:43.406989 875 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b47cff35-98d4-491a-8ec0-8a61a8f22802-kube-api-access-s5b7q\" (UniqueName: \"kubernetes.io/projected/b47cff35-98d4-491a-8ec0-8a61a8f22802-kube-api-access-s5b7q\") pod \"b47cff35-98d4-491a-8ec0-8a61a8f22802\" (UID: \"b47cff35-98d4-491a-8ec0-8a61a8f22802\") "2373machine # [ 394.444508] k3s[875]: I0928 16:33:43.407020 875 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b47cff35-98d4-491a-8ec0-8a61a8f22802-nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/b47cff35-98d4-491a-8ec0-8a61a8f22802-nix-grpc-farm\") pod \"b47cff35-98d4-491a-8ec0-8a61a8f22802\" (UID: \"b47cff35-98d4-491a-8ec0-8a61a8f22802\") "2374machine # [ 394.445405] k3s[875]: I0928 16:33:43.407423 875 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b47cff35-98d4-491a-8ec0-8a61a8f22802-job" pod "b47cff35-98d4-491a-8ec0-8a61a8f22802" (UID: "b47cff35-98d4-491a-8ec0-8a61a8f22802"). InnerVolumeSpecName "job". PluginName "kubernetes.io/configmap", VolumeGIDValue ""2375machine # [ 394.448080] systemd[1]: var-lib-kubelet-pods-b47cff35\x2d98d4\x2d491a\x2d8ec0\x2d8a61a8f22802-volumes-kubernetes.io\x7eprojected-nix\x2dgrpc\x2dfarm.mount: Deactivated successfully.2376machine # [ 394.449565] systemd[1]: var-lib-kubelet-pods-b47cff35\x2d98d4\x2d491a\x2d8ec0\x2d8a61a8f22802-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2ds5b7q.mount: Deactivated successfully.2377machine # [ 394.463162] k3s[875]: I0928 16:33:43.428283 875 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b47cff35-98d4-491a-8ec0-8a61a8f22802-kube-api-access-s5b7q" pod "b47cff35-98d4-491a-8ec0-8a61a8f22802" (UID: "b47cff35-98d4-491a-8ec0-8a61a8f22802"). InnerVolumeSpecName "kube-api-access-s5b7q". PluginName "kubernetes.io/projected", VolumeGIDValue ""2378machine # [ 394.463873] k3s[875]: I0928 16:33:43.428349 875 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b47cff35-98d4-491a-8ec0-8a61a8f22802-nix-grpc-farm" pod "b47cff35-98d4-491a-8ec0-8a61a8f22802" (UID: "b47cff35-98d4-491a-8ec0-8a61a8f22802"). InnerVolumeSpecName "nix-grpc-farm". PluginName "kubernetes.io/projected", VolumeGIDValue ""2379machine # [ 394.543163] k3s[875]: I0928 16:33:43.508178 875 reconciler_common.go:299] "Volume detached for volume \"job\" (UniqueName: \"kubernetes.io/configmap/b47cff35-98d4-491a-8ec0-8a61a8f22802-job\") on node \"machine\" DevicePath \"\""2380machine # [ 394.544847] k3s[875]: I0928 16:33:43.508319 875 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5b7q\" (UniqueName: \"kubernetes.io/projected/b47cff35-98d4-491a-8ec0-8a61a8f22802-kube-api-access-s5b7q\") on node \"machine\" DevicePath \"\""2381machine # [ 394.545796] k3s[875]: I0928 16:33:43.508357 875 reconciler_common.go:299] "Volume detached for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/b47cff35-98d4-491a-8ec0-8a61a8f22802-nix-grpc-farm\") on node \"machine\" DevicePath \"\""2382machine # [ 395.130360] k3s[875]: I0928 16:33:44.095410 875 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="898572da69f83ad5253b521d24d948f3cee0b98cd403ad1675f8230eaf83198a"2383machine # [ 395.153160] systemd[1]: Removed slice libcontainer container kubepods-besteffort-podb47cff35_98d4_491a_8ec0_8a61a8f22802.slice.2384machine # [ 395.157196] systemd[1]: kubepods-besteffort-podb47cff35_98d4_491a_8ec0_8a61a8f22802.slice: Consumed 970ms CPU time over 1min 48.400s wall clock time, 94.4M memory peak, 24.7M read from disk, 632K written to disk, 18.3K incoming IP traffic, 44.8K outgoing IP traffic.2385machine: (finished: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed', in 109.61 seconds)2386machine: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 12387machine: (finished: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1, in 0.17 seconds)2388machine # don't know how to build these paths:2389machine # /nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv2390machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'...2391machine # copying path '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' to 'nix-grpc-farm.farm.svc:50051'...2392machine # building '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' on nix-grpc-farm.farm.svc:50051...2393machine # k3s-a> machine/nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5: building fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv2394machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'...2395machine # copying path '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' to 'nix-grpc-farm.farm.svc:50051'...2396machine # building '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' on nix-grpc-farm.farm.svc:50051...2397machine # k3s-b> machine/nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5: building 1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv2398machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'...2399machine # copying path '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' to 'nix-grpc-farm.farm.svc:50051'...2400machine # building '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' on nix-grpc-farm.farm.svc:50051...2401machine # k3s-top> machine/nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5: building rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv2402machine # INFO:nix_fast_build.processes:run nix-eval-jobs --gc-roots-dir /tmp/tmpej9xhtc1/gcroots --force-recurse --max-memory-size 4096 --workers 4 --flake '.#checks' --check-cache-status2403machine # INFO:nix_fast_build.workers:builds: 02404machine # warning: Git tree '/tmp' is dirty2405machine # warning: Git tree '/tmp' is dirty2406machine # ▶ x86_64-linux.t started2407machine # INFO:nix_fast_build.workers:builds: 22408machine # ✔ x86_64-linux.t (26s)2409machine # x86_64-linux.t> machine/nix-grpc-farm-worker-x86-64-linux-795755579b-x65jw: building fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv2410machine # warning: Git tree '/tmp' is dirty2411machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath2412machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath, in 0.15 seconds)2413machine: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null2414machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null, in 0.05 seconds)2415(finished: subtest: a Job with the client image builds through the farm with its service account, in 110.83 seconds)2416subtest: a renewed balancer certificate is served without a rollout2417machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f -2418machine # Warning: resource secrets/farm-lb-tls is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically.2419machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f -, in 0.27 seconds)2420machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}'2421machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}', in 0.17 seconds)2422machine: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-75b44f88dd-r9tls -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example2423machine # [ 397.317903] k3s[875]: E0928 16:33:46.282733 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:50088: use of closed network connection2424machine # [ 398.581885] k3s[875]: E0928 16:33:47.546185 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:50114: use of closed network connection2425machine # [ 399.859413] k3s[875]: E0928 16:33:48.823451 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:50150: use of closed network connection2426machine # [ 399.864233] k3s[875]: time="2026-09-28T16:33:48Z" level=warning msg="Proxy error: read failed: read tcp 127.0.0.1:34142->127.0.0.1:10250: read: connection reset by peer"2427machine # [ 399.868798] k3s[875]: E0928 16:33:48.823501 875 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:52994->127.0.0.1:10010: write tcp 127.0.0.1:52994->127.0.0.1:10010: write: broken pipe2428machine # [ 401.147329] k3s[875]: E0928 16:33:50.111834 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:50172: use of closed network connection2429machine # [ 403.747453] k3s[875]: E0928 16:33:52.712169 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54288: use of closed network connection2430machine # [ 405.044719] k3s[875]: E0928 16:33:54.009564 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54306: use of closed network connection2431machine # [ 407.580234] k3s[875]: E0928 16:33:56.544932 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54360: use of closed network connection2432machine # [ 408.847426] k3s[875]: E0928 16:33:57.812111 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54396: use of closed network connection2433machine # [ 410.133992] k3s[875]: E0928 16:33:59.098715 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54430: use of closed network connection2434machine # [ 411.408357] k3s[875]: E0928 16:34:00.372726 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54450: use of closed network connection2435machine # [ 411.409142] k3s[875]: E0928 16:34:00.373181 875 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:46384->127.0.0.1:10010: write tcp 127.0.0.1:46384->127.0.0.1:10010: write: broken pipe2436machine # [ 411.409700] k3s[875]: time="2026-09-28T16:34:00Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:35062->127.0.0.1:10250: write: connection reset by peer"2437machine # [ 412.719044] k3s[875]: E0928 16:34:01.683859 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54486: use of closed network connection2438machine # [ 413.809754] postgres[755]: [755] LOG: checkpoint complete: wrote 1037 buffers (6.3%), wrote 3 SLRU buffers; 1 WAL file(s) added, 0 removed, 0 recycled; write=103.911 s, sync=0.064 s, total=104.012 s; sync files=364, longest=0.004 s, average=0.001 s; distance=4978 kB, estimate=4978 kB; lsn=0/1C74DF8, redo lsn=0/1C42B902439machine # [ 415.311602] k3s[875]: E0928 16:34:04.276086 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:34182: use of closed network connection2440machine # [ 416.581833] k3s[875]: E0928 16:34:05.546293 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:34204: use of closed network connection2441machine # [ 417.871651] k3s[875]: E0928 16:34:06.836135 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:34234: use of closed network connection2442machine # [ 419.181749] k3s[875]: E0928 16:34:08.146129 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:34252: use of closed network connection2443machine # [ 420.452395] k3s[875]: E0928 16:34:09.416958 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:34262: use of closed network connection2444machine # [ 421.719843] k3s[875]: E0928 16:34:10.684157 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:34300: use of closed network connection2445machine # [ 421.720681] k3s[875]: time="2026-09-28T16:34:10Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:59844->127.0.0.1:10250: write: broken pipe"2446machine # [ 424.288990] k3s[875]: E0928 16:34:13.253793 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43470: use of closed network connection2447machine # [ 425.580202] k3s[875]: time="2026-09-28T16:34:14Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:54584->127.0.0.1:10250: write: connection reset by peer"2448machine # [ 426.852812] k3s[875]: E0928 16:34:15.817558 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43534: use of closed network connection2449machine # [ 428.146872] k3s[875]: E0928 16:34:17.111402 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43554: use of closed network connection2450machine # [ 429.437646] k3s[875]: E0928 16:34:18.402294 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43586: use of closed network connection2451machine # [ 430.710912] k3s[875]: E0928 16:34:19.675503 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43602: use of closed network connection2452machine # [ 431.972723] k3s[875]: E0928 16:34:20.937467 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43640: use of closed network connection2453machine # [ 433.246748] k3s[875]: E0928 16:34:22.211160 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:48850: use of closed network connection2454machine # [ 434.529053] k3s[875]: E0928 16:34:23.493820 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:48878: use of closed network connection2455machine: (finished: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-75b44f88dd-r9tls -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 38.73 seconds)2456machine: waiting for success: openssl s_client -connect 127.0.0.1:30051 </dev/null 2>/dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example2457machine: (finished: waiting for success: openssl s_client -connect 127.0.0.1:30051 </dev/null 2>/dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 0.04 seconds)2458machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&12459machine # [ 436.035392] niks3-server[1182]: 2026/09/28 16:34:25 INFO Received push request method=POST path=/api/pushes2460machine # [ 436.049462] niks3-server[1182]: 2026/09/28 16:34:25 INFO Received sign narinfos request method=POST path=/api/pushes/21/sign2461machine # [ 436.053538] niks3-server[1182]: 2026/09/28 16:34:25 INFO Signed narinfos id=21 count=12462machine # [ 436.056325] niks3-server[1182]: 2026/09/28 16:34:25 INFO Registered completed upload object_key=nar/0g42hgwa9jp9abmqxz90dkwxpybsznzbpsy35rm921mlk5sw56jq.nar.zst2463machine # [ 436.058972] niks3-server[1182]: 2026/09/28 16:34:25 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.ls2464machine # [ 436.064958] niks3-server[1182]: 2026/09/28 16:34:25 INFO Received complete push request method=POST path=/api/pushes/21/complete2465machine # [ 436.070607] niks3-server[1182]: 2026/09/28 16:34:25 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.narinfo2466machine # [ 460.981898] niks3-server[1182]: 2026/09/28 16:34:49 INFO Received push request method=POST path=/api/pushes2467machine # [ 460.998409] niks3-server[1182]: 2026/09/28 16:34:49 INFO Received sign narinfos request method=POST path=/api/pushes/22/sign2468machine # [ 460.999668] niks3-server[1182]: 2026/09/28 16:34:49 INFO Signed narinfos id=22 count=12469machine # [ 461.005539] niks3-server[1182]: 2026/09/28 16:34:49 INFO Registered completed upload object_key=nar/1vxmmzwi16s4iri6dcmi9v62dpq1ys7wz15b497ncik3sd67nfzg.nar.zst2470machine # [ 461.010933] niks3-server[1182]: 2026/09/28 16:34:49 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.ls2471machine # [ 461.012780] niks3-server[1182]: 2026/09/28 16:34:49 INFO Received complete push request method=POST path=/api/pushes/22/complete2472machine # [ 461.016191] niks3-server[1182]: 2026/09/28 16:34:49 INFO Registered completed upload object_key=log/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31-k3s-a.drv2473machine # [ 461.018189] niks3-server[1182]: 2026/09/28 16:34:49 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo2474machine # [ 461.104349] niks3-server[1182]: 2026/09/28 16:34:50 INFO Received push request method=POST path=/api/pushes2475machine # [ 461.115603] niks3-server[1182]: 2026/09/28 16:34:50 INFO Received sign narinfos request method=POST path=/api/pushes/23/sign2476machine # [ 461.117451] niks3-server[1182]: 2026/09/28 16:34:50 INFO Signed narinfos id=23 count=12477machine # [ 461.121583] niks3-server[1182]: 2026/09/28 16:34:50 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.ls2478machine # [ 461.123606] niks3-server[1182]: 2026/09/28 16:34:50 INFO Registered completed upload object_key=nar/0cbxkyxz068xc5mivh2h67kw6y01n1x28cbs11v1a03g8m4c71zm.nar.zst2479machine # [ 461.126035] niks3-server[1182]: 2026/09/28 16:34:50 INFO Received complete push request method=POST path=/api/pushes/23/complete2480machine # [ 461.129414] niks3-server[1182]: 2026/09/28 16:34:50 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.narinfo2481machine # [ 486.245188] niks3-server[1182]: 2026/09/28 16:35:15 INFO Received push request method=POST path=/api/pushes2482machine # [ 486.263611] niks3-server[1182]: 2026/09/28 16:35:15 INFO Registered completed upload object_key=nar/0khxywxb2r78vhpc5hsmha3ymgp910z0aka7550jmaqzs333rmzp.nar.zst2483machine # [ 486.265315] niks3-server[1182]: 2026/09/28 16:35:15 INFO Received sign narinfos request method=POST path=/api/pushes/24/sign2484machine # [ 486.266879] niks3-server[1182]: 2026/09/28 16:35:15 INFO Signed narinfos id=24 count=12485machine # [ 486.268987] niks3-server[1182]: 2026/09/28 16:35:15 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.ls2486machine # [ 486.274792] niks3-server[1182]: 2026/09/28 16:35:15 INFO Received complete push request method=POST path=/api/pushes/24/complete2487machine # [ 486.281284] niks3-server[1182]: 2026/09/28 16:35:15 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.narinfo2488machine # [ 486.294328] niks3-server[1182]: 2026/09/28 16:35:15 INFO Registered completed upload object_key=log/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4-k3s-b.drv2489machine # [ 486.357686] niks3-server[1182]: 2026/09/28 16:35:15 INFO Received push request method=POST path=/api/pushes2490machine # [ 486.368980] niks3-server[1182]: 2026/09/28 16:35:15 INFO Received sign narinfos request method=POST path=/api/pushes/25/sign2491machine # [ 486.372308] niks3-server[1182]: 2026/09/28 16:35:15 INFO Signed narinfos id=25 count=12492machine # [ 486.373684] niks3-server[1182]: 2026/09/28 16:35:15 INFO Registered completed upload object_key=nar/04bim5f8bvjh25xncf5x40kb529khrlzcbc92qxvapgbc0bdfv2h.nar.zst2493machine # [ 486.376024] niks3-server[1182]: 2026/09/28 16:35:15 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.ls2494machine # [ 486.377795] niks3-server[1182]: 2026/09/28 16:35:15 INFO Received complete push request method=POST path=/api/pushes/25/complete2495machine # [ 486.381971] niks3-server[1182]: 2026/09/28 16:35:15 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.narinfo2496machine # [ 510.885815] niks3-server[1182]: 2026/09/28 16:35:39 INFO Received push request method=POST path=/api/pushes2497machine # [ 510.905862] niks3-server[1182]: 2026/09/28 16:35:39 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.ls2498machine # [ 510.907461] niks3-server[1182]: 2026/09/28 16:35:39 INFO Registered completed upload object_key=nar/11f7f1hixry25c2yc6np9hs10a2pwwqmymmrxxbswhdjabcyvv0s.nar.zst2499machine # [ 510.911686] niks3-server[1182]: 2026/09/28 16:35:39 INFO Received sign narinfos request method=POST path=/api/pushes/26/sign2500machine # [ 510.914285] niks3-server[1182]: 2026/09/28 16:35:39 INFO Signed narinfos id=26 count=12501machine # [ 510.918843] niks3-server[1182]: 2026/09/28 16:35:39 INFO Registered completed upload object_key=log/jz7biafi8rj5r3r392blyazw5mdpvy0d-k3s-top.drv2502machine # [ 510.925853] niks3-server[1182]: 2026/09/28 16:35:39 INFO Received complete push request method=POST path=/api/pushes/26/complete2503machine # [ 510.932446] niks3-server[1182]: 2026/09/28 16:35:39 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.narinfo2504machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1, in 76.11 seconds)2505(finished: subtest: a renewed balancer certificate is served without a rollout, in 115.32 seconds)2506subtest: metrics carry build_info2507machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5 -o jsonpath='{.items[0].status.podIP}{.status.podIP}'2508machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5 -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.24 seconds)2509machine: must succeed: curl -sf http://10.42.0.5:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5"'2510machine: (finished: must succeed: curl -sf http://10.42.0.5:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5"', in 0.03 seconds)2511(finished: subtest: metrics carry build_info, in 0.27 seconds)2512subtest: harmonia-gc frees space and the worker stays Ready2513machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5 -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"''2514machine # [ 512.437432] k3s[875]: E0928 16:35:41.402283 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56516: use of closed network connection2515machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5 -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'', in 0.19 seconds)2516machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5 -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done'2517machine # [ 512.693972] k3s[875]: E0928 16:35:41.658950 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56556: use of closed network connection2518machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5 -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done', in 0.26 seconds)2519machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5 -c gc -- sh -c 'fallocate -l 11442458624 /nix/fill'2520machine # [ 512.915048] k3s[875]: E0928 16:35:41.880070 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56592: use of closed network connection2521machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5 -c gc -- sh -c 'fallocate -l 11442458624 /nix/fill', in 0.22 seconds)2522machine: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5 -c gc --since=30s | grep -q 'store paths deleted'2523machine: (finished: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5 -c gc --since=30s | grep -q 'store paths deleted', in 1.37 seconds)2524machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5 -c gc -- sh -c 'rm /nix/fill'2525machine # [ 514.506326] k3s[875]: E0928 16:35:43.470569 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:42954: use of closed network connection2526machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5 -c gc -- sh -c 'rm /nix/fill', in 0.22 seconds)2527machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5 -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}'2528machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5 -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}', in 0.12 seconds)2529machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5 -c gc -- sh -c 'command -v nix-daemon && command -v niks3'2530machine # [ 514.804882] k3s[875]: E0928 16:35:43.769871 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43002: use of closed network connection2531machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5 -c gc -- sh -c 'command -v nix-daemon && command -v niks3', in 0.18 seconds)2532(finished: subtest: harmonia-gc frees space and the worker stays Ready, in 2.56 seconds)2533subtest: losing the balancer mid-build: the client reconnects and the build succeeds2534machine: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb12535machine # [ 514.829063] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1.2536machine # Running as unit: vialb.service; invocation ID: 80e648d413954676837e3aace795c1b02537machine: (finished: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1, in 0.02 seconds)2538machine: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'"2539machine # [ 514.941252] nix[9916]: don't know how to build these paths:2540machine # [ 514.942526] nix[9916]: /nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv2541machine # [ 514.967186] nix[9916]: copying 1 paths to '127.0.0.1:30051'...2542machine # [ 514.973300] nix[9916]: copying path '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' to '127.0.0.1:30051'...2543machine # [ 515.016040] niks3-server[1182]: 2026/09/28 16:35:43 INFO Received push request method=POST path=/api/pushes2544machine # [ 515.029944] niks3-server[1182]: 2026/09/28 16:35:43 INFO Received sign narinfos request method=POST path=/api/pushes/27/sign2545machine # [ 515.032431] niks3-server[1182]: 2026/09/28 16:35:43 INFO Signed narinfos id=27 count=12546machine # [ 515.035686] niks3-server[1182]: 2026/09/28 16:35:44 INFO Registered completed upload object_key=nar/0kkr2vb091wkq0cb0f1q92413dsfskh76wydp8mwysv7rawns0ar.nar.zst2547machine # [ 515.037463] niks3-server[1182]: 2026/09/28 16:35:44 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.ls2548machine # [ 515.042596] niks3-server[1182]: 2026/09/28 16:35:44 INFO Received complete push request method=POST path=/api/pushes/27/complete2549machine # [ 515.047370] niks3-server[1182]: 2026/09/28 16:35:44 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.narinfo2550machine # [ 515.056400] nix[9916]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051...2551machine # [ 515.057692] nix[9916]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-795755579b-x65jw: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv2552machine: (finished: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'", in 1.06 seconds)2553machine: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false2554machine: (finished: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false, in 0.25 seconds)2555machine: waiting for success: ! systemctl is-active vialb2556machine # [ 516.148104] k3s[875]: I0928 16:35:45.110491 875 endpointslice_controller.go:361] "Error syncing endpoint slices for service, retrying" key="farm/nix-grpc-farm" err="EndpointSlice informer cache is out of date"2557machine # [ 516.153288] nix[9916]: scheduler at 127.0.0.1:30051: Stream removed (Socket closed), reconnecting2558machine # [ 516.157091] nix[9916]: d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv: Stream removed (Socket closed), asking the scheduler again2559machine # [ 516.175200] systemd[1]: cri-containerd-05c76cacfb0a596301532a8388e807db2352e6483bf8e66ef629bb6a08e50d09.scope: Deactivated successfully.2560machine # [ 516.175963] systemd[1]: cri-containerd-05c76cacfb0a596301532a8388e807db2352e6483bf8e66ef629bb6a08e50d09.scope: Consumed 4.496s CPU time over 7min 59.317s wall clock time, 63.1M memory peak, 40.8M read from disk, 621.2K incoming IP traffic, 774.8K outgoing IP traffic.2561machine # [ 516.204372] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-05c76cacfb0a596301532a8388e807db2352e6483bf8e66ef629bb6a08e50d09-rootfs.mount: Deactivated successfully.2562machine # [ 516.246244] systemd[1]: cri-containerd-759befa578f093396971df1a9f2ce413f3a4ed8cd98c5b7987079e2f20dba1ba.scope: Deactivated successfully.2563machine # [ 516.273394] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-759befa578f093396971df1a9f2ce413f3a4ed8cd98c5b7987079e2f20dba1ba-rootfs.mount: Deactivated successfully.2564machine # [ 516.297521] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-759befa578f093396971df1a9f2ce413f3a4ed8cd98c5b7987079e2f20dba1ba-shm.mount: Deactivated successfully.2565machine # [ 516.479840] cni0: port 3(veth6b54cd8a) entered disabled state2566machine # [ 516.328667] dhcpcd[2762]: veth6b54cd8a: carrier lost2567machine # [ 516.482539] veth6b54cd8a (unregistering): left allmulticast mode2568machine # [ 516.483618] veth6b54cd8a (unregistering): left promiscuous mode2569machine # [ 516.484694] cni0: port 3(veth6b54cd8a) entered disabled state2570machine # [ 516.350209] systemd[1]: run-netns-cni\x2d2366eb2f\x2dd623\x2db099\x2ddbfb\x2d71128e9ece0b.mount: Deactivated successfully.2571machine # [ 516.359246] dhcpcd[2762]: veth6b54cd8a: deleting route to 169.254.0.0/162572machine # [ 516.407373] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod233ff7ef_d4cf_4372_ade1_272b8da1c13d.slice.2573machine # [ 516.429250] dhcpcd[2762]: veth6b54cd8a: removing interface2574machine # [ 516.465864] k3s[875]: I0928 16:35:45.430997 875 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2abddca4-2911-4503-bf02-4a196440e344-tls-ca\" (UniqueName: \"kubernetes.io/secret/2abddca4-2911-4503-bf02-4a196440e344-tls-ca\") pod \"2abddca4-2911-4503-bf02-4a196440e344\" (UID: \"2abddca4-2911-4503-bf02-4a196440e344\") "2575machine # [ 516.470646] k3s[875]: I0928 16:35:45.431039 875 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2abddca4-2911-4503-bf02-4a196440e344-config\" (UniqueName: \"kubernetes.io/configmap/2abddca4-2911-4503-bf02-4a196440e344-config\") pod \"2abddca4-2911-4503-bf02-4a196440e344\" (UID: \"2abddca4-2911-4503-bf02-4a196440e344\") "2576machine # [ 516.474902] k3s[875]: I0928 16:35:45.431070 875 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2abddca4-2911-4503-bf02-4a196440e344-tls-lb\" (UniqueName: \"kubernetes.io/secret/2abddca4-2911-4503-bf02-4a196440e344-tls-lb\") pod \"2abddca4-2911-4503-bf02-4a196440e344\" (UID: \"2abddca4-2911-4503-bf02-4a196440e344\") "2577machine # [ 516.479192] k3s[875]: I0928 16:35:45.431104 875 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2abddca4-2911-4503-bf02-4a196440e344-tmp\" (UniqueName: \"kubernetes.io/empty-dir/2abddca4-2911-4503-bf02-4a196440e344-tmp\") pod \"2abddca4-2911-4503-bf02-4a196440e344\" (UID: \"2abddca4-2911-4503-bf02-4a196440e344\") "2578machine # [ 516.483719] systemd[1]: var-lib-kubelet-pods-2abddca4\x2d2911\x2d4503\x2dbf02\x2d4a196440e344-volume\x2dsubpaths-config-envoy-0.mount: Deactivated successfully.2579machine # [ 516.485796] k3s[875]: I0928 16:35:45.445735 875 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2abddca4-2911-4503-bf02-4a196440e344-tls-lb" pod "2abddca4-2911-4503-bf02-4a196440e344" (UID: "2abddca4-2911-4503-bf02-4a196440e344"). InnerVolumeSpecName "tls-lb". PluginName "kubernetes.io/secret", VolumeGIDValue ""2580machine # [ 516.489854] k3s[875]: I0928 16:35:45.446191 875 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2abddca4-2911-4503-bf02-4a196440e344-tmp" pod "2abddca4-2911-4503-bf02-4a196440e344" (UID: "2abddca4-2911-4503-bf02-4a196440e344"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""2581machine # [ 516.493992] k3s[875]: I0928 16:35:45.446342 875 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2abddca4-2911-4503-bf02-4a196440e344-tls-ca" pod "2abddca4-2911-4503-bf02-4a196440e344" (UID: "2abddca4-2911-4503-bf02-4a196440e344"). InnerVolumeSpecName "tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""2582machine # [ 516.498084] systemd[1]: var-lib-kubelet-pods-2abddca4\x2d2911\x2d4503\x2dbf02\x2d4a196440e344-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully.2583machine # [ 516.500034] k3s[875]: I0928 16:35:45.456688 875 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2abddca4-2911-4503-bf02-4a196440e344-config" pod "2abddca4-2911-4503-bf02-4a196440e344" (UID: "2abddca4-2911-4503-bf02-4a196440e344"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""2584machine # [ 516.504227] systemd[1]: var-lib-kubelet-pods-2abddca4\x2d2911\x2d4503\x2dbf02\x2d4a196440e344-volumes-kubernetes.io\x7esecret-tls\x2dca.mount: Deactivated successfully.2585machine # [ 516.506217] systemd[1]: var-lib-kubelet-pods-2abddca4\x2d2911\x2d4503\x2dbf02\x2d4a196440e344-volumes-kubernetes.io\x7esecret-tls\x2dlb.mount: Deactivated successfully.2586machine # [ 516.566274] k3s[875]: I0928 16:35:45.531399 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/233ff7ef-d4cf-4372-ade1-272b8da1c13d-tls-lb\") pod \"nix-grpc-farm-lb-75b44f88dd-pprhl\" (UID: \"233ff7ef-d4cf-4372-ade1-272b8da1c13d\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-pprhl"2587machine # [ 516.570630] k3s[875]: I0928 16:35:45.531453 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/233ff7ef-d4cf-4372-ade1-272b8da1c13d-config\") pod \"nix-grpc-farm-lb-75b44f88dd-pprhl\" (UID: \"233ff7ef-d4cf-4372-ade1-272b8da1c13d\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-pprhl"2588machine # [ 516.571461] k3s[875]: I0928 16:35:45.531478 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/233ff7ef-d4cf-4372-ade1-272b8da1c13d-tmp\") pod \"nix-grpc-farm-lb-75b44f88dd-pprhl\" (UID: \"233ff7ef-d4cf-4372-ade1-272b8da1c13d\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-pprhl"2589machine # [ 516.572190] k3s[875]: I0928 16:35:45.531508 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/233ff7ef-d4cf-4372-ade1-272b8da1c13d-tls-ca\") pod \"nix-grpc-farm-lb-75b44f88dd-pprhl\" (UID: \"233ff7ef-d4cf-4372-ade1-272b8da1c13d\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-pprhl"2590machine # [ 516.572683] k3s[875]: I0928 16:35:45.531866 875 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2abddca4-2911-4503-bf02-4a196440e344-tmp\") on node \"machine\" DevicePath \"\""2591machine # [ 516.573386] k3s[875]: I0928 16:35:45.531882 875 reconciler_common.go:299] "Volume detached for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/2abddca4-2911-4503-bf02-4a196440e344-tls-ca\") on node \"machine\" DevicePath \"\""2592machine # [ 516.574448] k3s[875]: I0928 16:35:45.531976 875 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2abddca4-2911-4503-bf02-4a196440e344-config\") on node \"machine\" DevicePath \"\""2593machine # [ 516.575175] k3s[875]: I0928 16:35:45.531989 875 reconciler_common.go:299] "Volume detached for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/2abddca4-2911-4503-bf02-4a196440e344-tls-lb\") on node \"machine\" DevicePath \"\""2594machine # [ 516.622901] k3s[875]: I0928 16:35:45.587510 875 scope.go:122] "RemoveContainer" containerID="05c76cacfb0a596301532a8388e807db2352e6483bf8e66ef629bb6a08e50d09"2595machine # [ 516.630297] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod2abddca4_2911_4503_bf02_4a196440e344.slice.2596machine # [ 516.631505] systemd[1]: kubepods-besteffort-pod2abddca4_2911_4503_bf02_4a196440e344.slice: Consumed 4.527s CPU time over 8min 1.050s wall clock time, 63.4M memory peak, 40.8M read from disk, 621.2K incoming IP traffic, 774.8K outgoing IP traffic.2597machine # [ 516.637588] k3s[875]: I0928 16:35:45.602746 875 scope.go:122] "RemoveContainer" containerID="05c76cacfb0a596301532a8388e807db2352e6483bf8e66ef629bb6a08e50d09"2598machine # [ 516.640481] k3s[875]: E0928 16:35:45.605620 875 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"05c76cacfb0a596301532a8388e807db2352e6483bf8e66ef629bb6a08e50d09\": not found" containerID="05c76cacfb0a596301532a8388e807db2352e6483bf8e66ef629bb6a08e50d09"2599machine # [ 516.641231] k3s[875]: I0928 16:35:45.605655 875 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"05c76cacfb0a596301532a8388e807db2352e6483bf8e66ef629bb6a08e50d09"} err="failed to get container status \"05c76cacfb0a596301532a8388e807db2352e6483bf8e66ef629bb6a08e50d09\": rpc error: code = NotFound desc = an error occurred when try to find container \"05c76cacfb0a596301532a8388e807db2352e6483bf8e66ef629bb6a08e50d09\": not found"2600machine # [ 516.886863] cni0: port 2(veth283a3da7) entered blocking state2601machine # [ 516.888062] cni0: port 2(veth283a3da7) entered disabled state2602machine # [ 516.889239] veth283a3da7: entered allmulticast mode2603machine # [ 516.890274] veth283a3da7: entered promiscuous mode2604machine # [ 516.740850] (udev-worker)[10091]: Network interface NamePolicy= disabled on kernel command line.2605machine # [ 516.898950] cni0: port 2(veth283a3da7) entered blocking state2606machine # [ 516.900240] cni0: port 2(veth283a3da7) entered forwarding state2607machine # [ 516.767536] dhcpcd[2762]: veth283a3da7: IAID f5:eb:71:3f2608machine # [ 516.768277] dhcpcd[2762]: veth283a3da7: adding address fe80::83f:f5ff:feeb:713f2609machine # [ 516.833461] systemd[1]: Started libcontainer container d091e11a981e9efdc08f07ac53cfc7d1f96c49cae6b51a9e9387c4b0f4669d84.2610machine # [ 516.942960] dhcpcd[2762]: veth283a3da7: soliciting a DHCP lease2611machine # [ 516.956304] systemd[1]: Started libcontainer container 1007373548d80b9056ac23087d231516faf623c4d78538b439f9adee738983f0.2612machine # [ 517.224501] systemd[1]: var-lib-kubelet-pods-2abddca4\x2d2911\x2d4503\x2dbf02\x2d4a196440e344-volume\x2dsubpaths-config-envoy-2.mount: Deactivated successfully.2613machine # [ 517.226177] systemd[1]: var-lib-kubelet-pods-2abddca4\x2d2911\x2d4503\x2dbf02\x2d4a196440e344-volume\x2dsubpaths-config-envoy-1.mount: Deactivated successfully.2614machine # [ 517.519760] k3s[875]: I0928 16:35:46.483494 875 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2abddca4-2911-4503-bf02-4a196440e344" path="/var/lib/kubelet/pods/2abddca4-2911-4503-bf02-4a196440e344/volumes"2615machine # [ 517.658685] k3s[875]: I0928 16:35:46.621667 875 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-75b44f88dd-pprhl" podStartSLOduration=1.621631042 podStartE2EDuration="1.621631042s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-28 16:35:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-28 16:35:46.620808591 +0000 UTC m=+501.887696564" watchObservedRunningTime="2026-09-28 16:35:46.621631042 +0000 UTC m=+501.888518735"2616machine # [ 518.293191] dhcpcd[2762]: veth283a3da7: soliciting an IPv6 router2617machine # [ 518.660588] nix[9916]: scheduler at 127.0.0.1:30051: failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:30051: tcp handshaker shutdown, reconnecting2618machine # [ 519.709902] nix[9916]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051...2619machine # [ 519.711074] nix[9916]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-795755579b-sljw5: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv2620machine # [ 521.944353] dhcpcd[2762]: veth283a3da7: probing for an IPv4LL address2621machine # [ 527.015313] dhcpcd[2762]: veth283a3da7: using IPv4LL address 169.254.205.1112622machine # [ 527.017818] dhcpcd[2762]: veth283a3da7: adding route to 169.254.0.0/162623machine # [ 530.297853] dhcpcd[2762]: veth283a3da7: no IPv6 Routers available2624machine # [ 564.452868] niks3-server[1182]: 2026/09/28 16:36:33 INFO Received push request method=POST path=/api/pushes2625machine # [ 564.467873] niks3-server[1182]: 2026/09/28 16:36:33 INFO Received sign narinfos request method=POST path=/api/pushes/28/sign2626machine # [ 564.469676] niks3-server[1182]: 2026/09/28 16:36:33 INFO Signed narinfos id=28 count=12627machine # [ 564.473979] niks3-server[1182]: 2026/09/28 16:36:33 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.ls2628machine # [ 564.480813] niks3-server[1182]: 2026/09/28 16:36:33 INFO Registered completed upload object_key=log/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv2629machine # [ 564.483194] niks3-server[1182]: 2026/09/28 16:36:33 INFO Received complete push request method=POST path=/api/pushes/28/complete2630machine # [ 564.493969] niks3-server[1182]: 2026/09/28 16:36:33 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.narinfo2631machine # [ 565.550644] systemd[1]: vialb.service: Deactivated successfully.2632machine # [ 565.552929] systemd[1]: vialb.service: Consumed 215ms CPU time over 50.720s wall clock time, 40.8M memory peak, 4K written to disk, 8.6K incoming IP traffic, 17.4K outgoing IP traffic.2633machine: (finished: waiting for success: ! systemctl is-active vialb, in 49.93 seconds)2634machine: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; }2635machine: (finished: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; }, in 0.03 seconds)2636machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s2637machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 0.26 seconds)2638(finished: subtest: losing the balancer mid-build: the client reconnects and the build succeeds, in 51.55 seconds)2639subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes2640machine: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s12641machine # [ 566.392583] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1.2642machine # Running as unit: slow.service; invocation ID: b32e493e61664ab0a11f9d334ace92482643machine: (finished: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1, in 0.04 seconds)2644machine # [ 566.529556] nix[10838]: don't know how to build these paths:2645machine # [ 566.530937] nix[10838]: /nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv2646machine # [ 566.555645] nix[10838]: copying 1 paths to '127.0.0.1:30051'...2647machine # [ 566.556577] nix[10838]: copying path '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' to '127.0.0.1:30051'...2648machine # [ 566.595852] niks3-server[1182]: 2026/09/28 16:36:35 INFO Received push request method=POST path=/api/pushes2649machine # [ 566.608441] niks3-server[1182]: 2026/09/28 16:36:35 INFO Received sign narinfos request method=POST path=/api/pushes/29/sign2650machine # [ 566.610443] niks3-server[1182]: 2026/09/28 16:36:35 INFO Signed narinfos id=29 count=12651machine # [ 566.613214] niks3-server[1182]: 2026/09/28 16:36:35 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.ls2652machine # [ 566.614282] k3s[875]: E0928 16:36:35.578348 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:52346: use of closed network connection2653machine # command terminated with exit code 12654machine # [ 566.617400] niks3-server[1182]: 2026/09/28 16:36:35 INFO Registered completed upload object_key=nar/0wl2i9xpw0gwrx1xqdgx9ka4n503ky9qhl20pdrdlphn8d6lcx0i.nar.zst2655machine # [ 566.620556] niks3-server[1182]: 2026/09/28 16:36:35 INFO Received complete push request method=POST path=/api/pushes/29/complete2656machine # [ 566.625254] niks3-server[1182]: 2026/09/28 16:36:35 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.narinfo2657machine # [ 566.632344] nix[10838]: building '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' on 127.0.0.1:30051...2658machine # [ 566.633155] nix[10838]: slow-s1> machine/nix-grpc-farm-worker-x86-64-linux-795755579b-x65jw: building zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv2659machine # [ 566.801508] k3s[875]: E0928 16:36:35.766625 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:52364: use of closed network connection2660machine # command terminated with exit code 12661machine # command terminated with exit code 12662machine # [ 568.080516] k3s[875]: E0928 16:36:37.044316 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:52388: use of closed network connection2663machine # [ 568.245196] k3s[875]: E0928 16:36:37.210175 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:52410: use of closed network connection2664machine # command terminated with exit code 12665machine # [ 569.537773] k3s[875]: E0928 16:36:38.502624 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:52432: use of closed network connection2666machine # command terminated with exit code 12667machine # [ 569.718311] k3s[875]: E0928 16:36:38.683432 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:52470: use of closed network connection2668machine # command terminated with exit code 12669machine # command terminated with exit code 12670machine # [ 571.008553] k3s[875]: E0928 16:36:39.973022 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:52494: use of closed network connection2671machine # command terminated with exit code 12672machine # [ 571.188114] k3s[875]: E0928 16:36:40.152885 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:52516: use of closed network connection2673machine # command terminated with exit code 12674machine # [ 572.424604] k3s[875]: E0928 16:36:41.389457 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:52554: use of closed network connection2675machine # [ 572.585598] k3s[875]: E0928 16:36:41.550716 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:52574: use of closed network connection2676machine # command terminated with exit code 12677machine # command terminated with exit code 12678machine # [ 573.844406] k3s[875]: E0928 16:36:42.809253 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:47732: use of closed network connection2679machine # [ 574.005210] k3s[875]: E0928 16:36:42.970346 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:47762: use of closed network connection2680machine # command terminated with exit code 12681machine # [ 575.311788] k3s[875]: E0928 16:36:44.276550 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:47782: use of closed network connection2682machine # command terminated with exit code 12683machine # [ 575.487824] k3s[875]: time="2026-09-28T16:36:44Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:52388->127.0.0.1:10250: write: connection reset by peer"2684machine # command terminated with exit code 12685machine # [ 575.488534] k3s[875]: E0928 16:36:44.452881 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:47808: use of closed network connection2686machine # [ 576.751442] k3s[875]: E0928 16:36:45.716296 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:47834: use of closed network connection2687machine # command terminated with exit code 12688machine # [ 576.925516] k3s[875]: E0928 16:36:45.890627 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:47850: use of closed network connection2689machine # command terminated with exit code 12690machine # command terminated with exit code 12691machine # [ 578.185211] k3s[875]: E0928 16:36:47.149503 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:47868: use of closed network connection2692machine # [ 578.364859] k3s[875]: E0928 16:36:47.329993 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:47900: use of closed network connection2693machine # command terminated with exit code 12694machine # command terminated with exit code 12695machine # [ 579.666123] k3s[875]: E0928 16:36:48.630663 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:47934: use of closed network connection2696machine # [ 579.874628] k3s[875]: E0928 16:36:48.839703 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:47960: use of closed network connection2697machine # command terminated with exit code 12698machine # command terminated with exit code 12699machine # [ 581.137517] k3s[875]: E0928 16:36:50.101732 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:47974: use of closed network connection2700machine # [ 581.314546] k3s[875]: E0928 16:36:50.279645 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:48004: use of closed network connection2701machine # command terminated with exit code 12702machine # [ 582.635215] k3s[875]: E0928 16:36:51.599923 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:48048: use of closed network connection2703machine # command terminated with exit code 12704machine # [ 582.805604] k3s[875]: E0928 16:36:51.770731 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:48068: use of closed network connection2705machine # command terminated with exit code 12706machine # [ 584.080400] k3s[875]: E0928 16:36:53.044974 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53054: use of closed network connection2707machine # command terminated with exit code 12708machine # command terminated with exit code 12709machine # [ 584.255731] k3s[875]: E0928 16:36:53.220602 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53090: use of closed network connection2710machine # command terminated with exit code 12711machine # [ 585.563316] k3s[875]: E0928 16:36:54.526489 875 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:47658->127.0.0.1:10010: write tcp 127.0.0.1:47658->127.0.0.1:10010: write: broken pipe2712machine # [ 585.564043] k3s[875]: E0928 16:36:54.526642 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53120: use of closed network connection2713machine # [ 585.564554] k3s[875]: time="2026-09-28T16:36:54Z" level=warning msg="Proxy error: read failed: read tcp 127.0.0.1:36126->127.0.0.1:10250: read: connection reset by peer"2714machine # [ 585.741594] k3s[875]: E0928 16:36:54.706695 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53144: use of closed network connection2715machine # command terminated with exit code 12716machine # command terminated with exit code 12717machine # [ 587.032375] k3s[875]: E0928 16:36:55.996864 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53178: use of closed network connection2718machine # [ 587.217706] k3s[875]: E0928 16:36:56.182821 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53212: use of closed network connection2719machine # command terminated with exit code 12720machine # command terminated with exit code 12721machine # [ 588.506630] k3s[875]: E0928 16:36:57.471478 875 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:47696->127.0.0.1:10010: write tcp 127.0.0.1:47696->127.0.0.1:10010: write: broken pipe2722machine # [ 588.507970] k3s[875]: E0928 16:36:57.471522 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53240: use of closed network connection2723machine # command terminated with exit code 12724machine # [ 589.948669] k3s[875]: E0928 16:36:58.913374 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53294: use of closed network connection2725machine # command terminated with exit code 12726machine # command terminated with exit code 12727machine # [ 590.130431] k3s[875]: E0928 16:36:59.095575 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53330: use of closed network connection2728machine # command terminated with exit code 12729machine # [ 591.388876] k3s[875]: E0928 16:37:00.353626 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53338: use of closed network connection2730machine # [ 591.563172] k3s[875]: E0928 16:37:00.528304 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53360: use of closed network connection2731machine # command terminated with exit code 12732machine # [ 591.733227] k3s[875]: E0928 16:37:00.698072 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:53386: use of closed network connection2733machine: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-795755579b-x65jw --wait=false2734machine: (finished: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-795755579b-x65jw --wait=false, in 0.15 seconds)2735machine: must succeed: sleep 5.02736machine # [ 592.111668] systemd[1]: cri-containerd-e9b585d1cf51bb2ad5cf46d95b0a8554c77b7d624259575220156aa7d8864f22.scope: Deactivated successfully.2737machine # [ 592.112652] systemd[1]: cri-containerd-e9b585d1cf51bb2ad5cf46d95b0a8554c77b7d624259575220156aa7d8864f22.scope: Consumed 447ms CPU time over 8min 57.809s wall clock time, 7M memory peak, 5.1M read from disk.2738machine # [ 592.117978] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod73774482_b888_469d_a38c_5ec6959d303e.slice.2739machine # [ 592.152268] k3s[875]: I0928 16:37:01.117420 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/73774482-b888-469d-a38c-5ec6959d303e-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-jrq9q\" (UID: \"73774482-b888-469d-a38c-5ec6959d303e\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-jrq9q"2740machine # [ 592.152850] k3s[875]: I0928 16:37:01.117464 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/73774482-b888-469d-a38c-5ec6959d303e-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-jrq9q\" (UID: \"73774482-b888-469d-a38c-5ec6959d303e\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-jrq9q"2741machine # [ 592.154813] k3s[875]: I0928 16:37:01.117490 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/73774482-b888-469d-a38c-5ec6959d303e-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-jrq9q\" (UID: \"73774482-b888-469d-a38c-5ec6959d303e\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-jrq9q"2742machine # [ 592.156359] k3s[875]: I0928 16:37:01.117515 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/73774482-b888-469d-a38c-5ec6959d303e-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-jrq9q\" (UID: \"73774482-b888-469d-a38c-5ec6959d303e\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-jrq9q"2743machine # [ 592.157097] k3s[875]: I0928 16:37:01.117540 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/73774482-b888-469d-a38c-5ec6959d303e-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-jrq9q\" (UID: \"73774482-b888-469d-a38c-5ec6959d303e\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-jrq9q"2744machine # [ 592.157745] k3s[875]: I0928 16:37:01.117563 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/73774482-b888-469d-a38c-5ec6959d303e-build\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-jrq9q\" (UID: \"73774482-b888-469d-a38c-5ec6959d303e\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-jrq9q"2745machine # [ 592.158565] k3s[875]: I0928 16:37:01.117588 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/73774482-b888-469d-a38c-5ec6959d303e-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-jrq9q\" (UID: \"73774482-b888-469d-a38c-5ec6959d303e\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-jrq9q"2746machine # [ 592.159390] k3s[875]: I0928 16:37:01.117684 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zgpg\" (UniqueName: \"kubernetes.io/projected/73774482-b888-469d-a38c-5ec6959d303e-kube-api-access-4zgpg\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-jrq9q\" (UID: \"73774482-b888-469d-a38c-5ec6959d303e\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-jrq9q"2747machine # [ 592.160130] k3s[875]: I0928 16:37:01.117713 875 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/73774482-b888-469d-a38c-5ec6959d303e-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-jrq9q\" (UID: \"73774482-b888-469d-a38c-5ec6959d303e\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-jrq9q"2748machine # [ 592.160782] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-e9b585d1cf51bb2ad5cf46d95b0a8554c77b7d624259575220156aa7d8864f22-rootfs.mount: Deactivated successfully.2749machine # [ 592.643874] cni0: port 3(vethd873c91a) entered blocking state2750machine # [ 592.646209] cni0: port 3(vethd873c91a) entered disabled state2751machine # [ 592.648556] vethd873c91a: entered allmulticast mode2752machine # [ 592.651794] vethd873c91a: entered promiscuous mode2753machine # [ 592.669340] cni0: port 3(vethd873c91a) entered blocking state2754machine # [ 592.670371] cni0: port 3(vethd873c91a) entered forwarding state2755machine # [ 592.540181] (udev-worker)[12585]: Network interface NamePolicy= disabled on kernel command line.2756machine # [ 592.565435] dhcpcd[2762]: vethd873c91a: IAID d9:58:b4:b12757machine # [ 592.566498] dhcpcd[2762]: vethd873c91a: adding address fe80::3c5f:d9ff:fe58:b4b12758machine # [ 592.615281] systemd[1]: Started libcontainer container a5c8b78f2a2d83b17908ee6bded96da6b7894a6c53385271b2b3a0c76aee3516.2759machine # [ 592.908669] systemd[1]: Started libcontainer container 19349f2bcc508bd55b9caf9bea5bb427af9920d1b50b57451db844290765ee85.2760machine # [ 594.075972] dhcpcd[2762]: vethd873c91a: soliciting a DHCP lease2761machine # [ 594.396785] dhcpcd[2762]: vethd873c91a: soliciting an IPv6 router2762machine # [ 595.034342] systemd[1]: cri-containerd-19349f2bcc508bd55b9caf9bea5bb427af9920d1b50b57451db844290765ee85.scope: Deactivated successfully.2763machine # [ 595.039329] systemd[1]: cri-containerd-19349f2bcc508bd55b9caf9bea5bb427af9920d1b50b57451db844290765ee85.scope: Consumed 950ms CPU time over 2.123s wall clock time, 397.9M memory peak, 108.8M read from disk, 176.6M written to disk.2764machine # [ 595.113509] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-19349f2bcc508bd55b9caf9bea5bb427af9920d1b50b57451db844290765ee85-rootfs.mount: Deactivated successfully.2765machine # [ 596.041088] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount2197608605.mount: Deactivated successfully.2766machine # [ 596.043115] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped4114248887.mount: Deactivated successfully.2767machine # [ 596.116170] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount2927670418.mount: Deactivated successfully.2768machine # [ 596.118279] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped1947383031.mount: Deactivated successfully.2769machine # [ 596.172265] systemd[1]: tmp-ovl\x2didmapped24507661.mount: Deactivated successfully.2770machine # [ 596.191282] systemd[1]: Started libcontainer container 6ae472e08e52551985b93536dd816f4f9c98457685f63fb7e1cee6d8df15e830.2771machine # [ 596.344335] systemd[1]: Started libcontainer container 2de73893dc84ab479bab92664c8079a1dc8d8b30673959325692c9737b2f9682.2772machine # [ 596.480327] systemd[1]: Started libcontainer container fcb2b9b6574f189453a26e7ed5c1088e2d5afd8548b88faf2d361d1871a54048.2773machine: (finished: must succeed: sleep 5.0, in 5.02 seconds)2774machine # [ 597.117579] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped3320101818.mount: Deactivated successfully.2775machine # [ 597.260028] k3s[875]: E0928 16:37:06.224855 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33072: use of closed network connection2776machine # command terminated with exit code 12777machine # [ 597.430834] k3s[875]: E0928 16:37:06.395562 875 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33106: use of closed network connection2778machine: waiting for success: ! systemctl is-active slow2779machine # [ 597.448099] k3s[875]: I0928 16:37:06.411934 875 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-jrq9q" podStartSLOduration=3.316033814 podStartE2EDuration="5.411911362s" totalImagesPullingTime="0s" totalInitContainerRuntime="2.095877548s" isStatefulPod=false podCreationTimestamp="2026-09-28 16:37:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-28 16:37:05.987853835 +0000 UTC m=+581.254741808" watchObservedRunningTime="2026-09-28 16:37:06.411911362 +0000 UTC m=+581.678794306"2780machine # [ 599.076805] dhcpcd[2762]: vethd873c91a: probing for an IPv4LL address2781machine # [ 604.334649] dhcpcd[2762]: vethd873c91a: using IPv4LL address 169.254.64.2012782machine # [ 604.337377] dhcpcd[2762]: vethd873c91a: adding route to 169.254.0.0/162783machine # [ 606.399911] dhcpcd[2762]: vethd873c91a: no IPv6 Routers available2784machine # [ 609.909949] postgres[755]: [755] LOG: checkpoint starting: time2785machine # [ 611.574848] niks3-server[1182]: 2026/09/28 16:37:20 INFO Received push request method=POST path=/api/pushes2786machine # [ 611.588880] niks3-server[1182]: 2026/09/28 16:37:20 INFO Received sign narinfos request method=POST path=/api/pushes/30/sign2787machine # [ 611.591288] niks3-server[1182]: 2026/09/28 16:37:20 INFO Signed narinfos id=30 count=12788machine # [ 611.596224] niks3-server[1182]: 2026/09/28 16:37:20 INFO Registered completed upload object_key=log/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv2789machine # [ 611.598379] niks3-server[1182]: 2026/09/28 16:37:20 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.ls2790machine # [ 611.611180] niks3-server[1182]: 2026/09/28 16:37:20 INFO Received complete push request method=POST path=/api/pushes/30/complete2791machine # [ 611.621128] niks3-server[1182]: 2026/09/28 16:37:20 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo2792machine # [ 612.622824] systemd[1]: cri-containerd-aa45e30d0c7c2d7c2901eed84b044e891c6910ee35f6a9801318ceb4613d0a26.scope: Deactivated successfully.2793machine # [ 612.628288] systemd[1]: cri-containerd-aa45e30d0c7c2d7c2901eed84b044e891c6910ee35f6a9801318ceb4613d0a26.scope: Consumed 3.242s CPU time over 9min 18.623s wall clock time, 70M memory peak, 36.3M read from disk, 8K written to disk, 279.4K incoming IP traffic, 345.5K outgoing IP traffic.2794machine # [ 612.676949] systemd[1]: slow.service: Deactivated successfully.2795machine # [ 612.679447] systemd[1]: slow.service: Consumed 166ms CPU time over 46.284s wall clock time, 42.3M memory peak, 4K written to disk, 5.3K incoming IP traffic, 11.5K outgoing IP traffic.2796machine # [ 612.698904] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-aa45e30d0c7c2d7c2901eed84b044e891c6910ee35f6a9801318ceb4613d0a26-rootfs.mount: Deactivated successfully.2797machine # [ 612.950434] postgres[755]: [755] LOG: checkpoint complete: wrote 30 buffers (0.2%), wrote 1 SLRU buffers; 0 WAL file(s) added, 0 removed, 0 recycled; write=3.013 s, sync=0.009 s, total=3.041 s; sync files=24, longest=0.004 s, average=0.001 s; distance=264 kB, estimate=4507 kB; lsn=0/1C92368, redo lsn=0/1C84D502798machine: (finished: waiting for success: ! systemctl is-active slow, in 15.61 seconds)2799machine: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; }2800machine: (finished: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; }, in 0.04 seconds)2801machine: must fail: journalctl -u slow | grep -q 'asking the scheduler again'2802machine: (finished: must fail: journalctl -u slow | grep -q 'asking the scheduler again', in 0.03 seconds)2803machine: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath2804machine # [ 613.245371] systemd[1]: cri-containerd-c37846c27ec5cc30e270d3d02abe1a8c9b1cb8926d806a35c8e6f3ef140908f1.scope: Deactivated successfully.2805machine # [ 613.247812] systemd[1]: cri-containerd-c37846c27ec5cc30e270d3d02abe1a8c9b1cb8926d806a35c8e6f3ef140908f1.scope: Consumed 22.132s CPU time over 9min 19.405s wall clock time, 37.5M memory peak, 19.6M read from disk, 1.1M written to disk, 49.8K incoming IP traffic, 34.4K outgoing IP traffic.2806machine: (finished: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath, in 0.15 seconds)2807machine: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null2808machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null, in 0.03 seconds)2809(finished: subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes, in 46.93 seconds)2810(finished: run the VM test script, in 614.16 seconds)2811machine # [ 613.300400] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-c37846c27ec5cc30e270d3d02abe1a8c9b1cb8926d806a35c8e6f3ef140908f1-rootfs.mount: Deactivated successfully.2812machine # [ 613.327114] systemd[1]: cri-containerd-b4ea3eb1d3b685c3ee1accd80236aa92e6a894663c81a42c1d3bb1af9facc62f.scope: Deactivated successfully.2813test script finished in 614.20s2814cleanup2815kill QemuMachine (pid 45)2816machine # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14)2817machine # [2026-09-28T16:37:22Z INFO virtiofsd] Client disconnected, shutting down2818machine # [2026-09-28T16:37:22Z INFO virtiofsd] Client disconnected, shutting down2819machine # [2026-09-28T16:37:22Z INFO virtiofsd] Client disconnected, shutting down2820(finished: cleanup, in 1.04 seconds)2821additionally exposed symbols:2822 machine,2823 vlan1,2824 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh