vm-test-run-nix-grpc-farm-k3s
checks.x86_64-linux.k3s
· build #586
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.01 seconds)5Test will time out and terminate in 1200.0 seconds6run the VM test script7machine: waiting for unit k3s.service8machine: waiting for the VM to finish booting9machine: starting vm10machine: QEMU running (pid 45)11machine # Disk image does not exist, creating the virtualisation disk image...12machine # Formatting '/build/vm-state-machine/tmp.yaoNGhzFbD', fmt=raw size=1717986918413machine # mke2fs 1.47.4 (6-Mar-2025)14machine # Discarding device blocks: 0/4194304 done15machine # Creating filesystem with 4194304 4k blocks and 1048576 inodes16machine # Filesystem UUID: a0f9247e-7de3-4a4e-bc81-eed34c62727b17machine # Superblock backups stored on blocks:18machine # 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208,19machine # 409600020machine # 21machine # Allocating group tables: 0/128 done22machine # Writing inode tables: 0/128 done23machine # Creating journal (32768 blocks): done24machine # Writing superblocks and filesystem accounting information: 0/128 done25machine # 26machine # Virtualisation disk image created.27machine # Starting virtiofs daemons...28machine # [2026-09-30T09:10:40Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)29machine # [2026-09-30T09:10:40Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether30machine # [2026-09-30T09:10:40Z INFO virtiofsd] Waiting for vhost-user socket connection...31machine # [2026-09-30T09:10:40Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)32machine # [2026-09-30T09:10:40Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether33machine # [2026-09-30T09:10:40Z INFO virtiofsd] Waiting for vhost-user socket connection...34machine # [2026-09-30T09:10:40Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)35machine # [2026-09-30T09:10:40Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether36machine # [2026-09-30T09:10:40Z INFO virtiofsd] Waiting for vhost-user socket connection...37machine # [2026-09-30T09:10:40Z INFO virtiofsd] Client connected, servicing requests38machine # [2026-09-30T09:10:40Z INFO virtiofsd] Client connected, servicing requests39machine # [2026-09-30T09:10:40Z INFO virtiofsd] Client connected, servicing requests40machine # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)41machine # 42machine # 43machine # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+7EFCC730+7EF2C730 CA0044machine # Press Ctrl-B to configure iPXE (PCI 00:02.0)...45machine # 46machine # 47machine # 48machine # 49machine # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 7EFCC730 7EF2C730 CB0050machine # Press Ctrl-B to configure iPXE (PCI 00:05.0)...51machine # 52machine # 53machine # Booting from ROM...54machine # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.53 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 21 13:06:06 UTC 202655machine # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/vymjrh888c94hbnp2caxf098iqy391ib-nixos-system-machine-test/init regInfo=/nix/.ro-store/lhk781clq86rfq3p0yqhmygbkjbcjrb5-closure-info/registration console=ttyS0,115200n8 console=tty056machine # [ 0.000000] BIOS-provided physical RAM map:57machine # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable58machine # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved59machine # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved60machine # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007ffd7fff] usable61machine # [ 0.000000] BIOS-e820: [mem 0x000000007ffd8000-0x000000007fffffff] reserved62machine # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved63machine # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved64machine # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved65machine # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved66machine # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000017fffffff] usable67machine # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved68machine # [ 0.000000] NX (Execute Disable) protection: active69machine # [ 0.000000] APIC: Static calls initialized70machine # [ 0.000000] SMBIOS 2.8 present.71machine # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201472machine # [ 0.000000] DMI: Memory slots populated: 1/173machine # [ 0.000000] Hypervisor detected: KVM74machine # [ 0.000000] last_pfn = 0x7ffd8 max_arch_pfn = 0x1000000000075machine # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0076machine # [ 0.000000] kvm-clock: using sched offset of 484099231 cycles77machine # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns78machine # [ 0.000005] tsc: Detected 2400.012 MHz processor79machine # [ 0.000811] last_pfn = 0x180000 max_arch_pfn = 0x1000000000080machine # [ 0.000837] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs81machine # [ 0.000840] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT82machine # [ 0.000877] last_pfn = 0x7ffd8 max_arch_pfn = 0x1000000000083machine # [ 0.002740] found SMP MP-table at [mem 0x000f5450-0x000f545f]84machine # [ 0.002751] Using GB pages for direct mapping85machine # [ 0.002863] RAMDISK: [mem 0x7e364000-0x7ffcffff]86machine # [ 0.002871] ACPI: Early table checksum verification disabled87machine # [ 0.002874] ACPI: RSDP 0x00000000000F5250 000014 (v00 BOCHS )88machine # [ 0.002878] ACPI: RSDT 0x000000007FFE2539 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)89machine # [ 0.002882] ACPI: FACP 0x000000007FFE2319 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)90machine # [ 0.002889] ACPI: DSDT 0x000000007FFE0040 0022D9 (v01 BOCHS BXPC 00000001 BXPC 00000001)91machine # [ 0.002891] ACPI: FACS 0x000000007FFE0000 00004092machine # [ 0.002892] ACPI: APIC 0x000000007FFE240D 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)93machine # [ 0.002894] ACPI: HPET 0x000000007FFE249D 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)94machine # [ 0.002895] ACPI: MCFG 0x000000007FFE24D5 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)95machine # [ 0.002897] ACPI: WAET 0x000000007FFE2511 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)96machine # [ 0.002898] ACPI: Reserving FACP table memory at [mem 0x7ffe2319-0x7ffe240c]97machine # [ 0.002899] ACPI: Reserving DSDT table memory at [mem 0x7ffe0040-0x7ffe2318]98machine # [ 0.002900] ACPI: Reserving FACS table memory at [mem 0x7ffe0000-0x7ffe003f]99machine # [ 0.002900] ACPI: Reserving APIC table memory at [mem 0x7ffe240d-0x7ffe249c]100machine # [ 0.002901] ACPI: Reserving HPET table memory at [mem 0x7ffe249d-0x7ffe24d4]101machine # [ 0.002901] ACPI: Reserving MCFG table memory at [mem 0x7ffe24d5-0x7ffe2510]102machine # [ 0.002902] ACPI: Reserving WAET table memory at [mem 0x7ffe2511-0x7ffe2538]103machine # [ 0.003119] No NUMA configuration found104machine # [ 0.003119] Faking a node at [mem 0x0000000000000000-0x000000017fffffff]105machine # [ 0.003122] NODE_DATA(0) allocated [mem 0x17fff8780-0x17fffdcff]106machine # [ 0.005452] Zone ranges:107machine # [ 0.005453] DMA [mem 0x0000000000001000-0x0000000000ffffff]108machine # [ 0.005454] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]109machine # [ 0.005455] Normal [mem 0x0000000100000000-0x000000017fffffff]110machine # [ 0.005456] Device empty111machine # [ 0.005457] Movable zone start for each node112machine # [ 0.005457] Early memory node ranges113machine # [ 0.005458] node 0: [mem 0x0000000000001000-0x000000000009efff]114machine # [ 0.005459] node 0: [mem 0x0000000000100000-0x000000007ffd7fff]115machine # [ 0.005460] node 0: [mem 0x0000000100000000-0x000000017fffffff]116machine # [ 0.005461] Initmem setup node 0 [mem 0x0000000000001000-0x000000017fffffff]117machine # [ 0.005481] On node 0, zone DMA: 1 pages in unavailable ranges118machine # [ 0.005748] On node 0, zone DMA: 97 pages in unavailable ranges119machine # [ 0.078335] On node 0, zone Normal: 40 pages in unavailable ranges120machine # [ 0.078798] ACPI: PM-Timer IO Port: 0x608121machine # [ 0.078812] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])122machine # [ 0.078840] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23123machine # [ 0.078843] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)124machine # [ 0.078845] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)125machine # [ 0.078846] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)126machine # [ 0.078847] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)127machine # [ 0.078848] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)128machine # [ 0.078851] ACPI: Using ACPI (MADT) for SMP configuration information129machine # [ 0.078852] ACPI: HPET id: 0x8086a201 base: 0xfed00000130machine # [ 0.078857] TSC deadline timer available131machine # [ 0.078861] CPU topo: Max. logical packages: 1132machine # [ 0.078862] CPU topo: Max. logical dies: 1133machine # [ 0.078863] CPU topo: Max. dies per package: 1134machine # [ 0.078866] CPU topo: Max. threads per core: 1135machine # [ 0.078867] CPU topo: Num. cores per package: 4136machine # [ 0.078867] CPU topo: Num. threads per package: 4137machine # [ 0.078868] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs138machine # [ 0.078893] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()139machine # [ 0.078909] kvm-guest: KVM setup pv remote TLB flush140machine # [ 0.078912] kvm-guest: setup PV sched yield141machine # [ 0.078922] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]142machine # [ 0.078923] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]143machine # [ 0.078924] PM: hibernation: Registered nosave memory: [mem 0x7ffd8000-0xffffffff]144machine # [ 0.078926] [mem 0xc0000000-0xfed1bfff] available for PCI devices145machine # [ 0.078927] Booting paravirtualized kernel on KVM146machine # [ 0.078931] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns147machine # [ 0.083410] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1148machine # [ 0.085610] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288149machine # [ 0.085654] kvm-guest: PV spinlocks enabled150machine # [ 0.085655] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)151machine # [ 0.085658] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/vymjrh888c94hbnp2caxf098iqy391ib-nixos-system-machine-test/init regInfo=/nix/.ro-store/lhk781clq86rfq3p0yqhmygbkjbcjrb5-closure-info/registration console=ttyS0,115200n8 console=tty0152machine # [ 0.085753] Unknown kernel command line parameters "regInfo=/nix/.ro-store/lhk781clq86rfq3p0yqhmygbkjbcjrb5-closure-info/registration", will be passed to user space.153machine # [ 0.085766] random: crng init done154machine # [ 0.085767] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes155machine # [ 0.090336] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)156machine # [ 0.092495] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)157machine # [ 0.092572] software IO TLB: area num 4.158machine # [ 0.167270] Fallback order for Node 0: 0159machine # [ 0.167278] Built 1 zonelists, mobility grouping on. Total pages: 1048438160machine # [ 0.167280] Policy zone: Normal161machine # [ 0.170117] mem auto-init: stack:all(zero), heap alloc:on, heap free:off162machine # [ 0.176983] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1163machine # [ 0.186171] allocated 8388608 bytes of page_ext164machine # [ 0.196151] ftrace: allocating 48798 entries in 192 pages165machine # [ 0.196154] ftrace: allocated 192 pages with 2 groups166machine # [ 0.197004] Dynamic Preempt: lazy167machine # [ 0.197161] rcu: Preemptible hierarchical RCU implementation.168machine # [ 0.197162] rcu: RCU event tracing is enabled.169machine # [ 0.197162] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.170machine # [ 0.197164] Trampoline variant of Tasks RCU enabled.171machine # [ 0.197164] Rude variant of Tasks RCU enabled.172machine # [ 0.197165] Tracing variant of Tasks RCU enabled.173machine # [ 0.197166] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.174machine # [ 0.197166] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4175machine # [ 0.197187] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.176machine # [ 0.197188] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.177machine # [ 0.197190] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.178machine # [ 0.201586] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16179machine # [ 0.201857] rcu: srcu_init: Setting srcu_struct sizes based on contention.180machine # [ 0.201864] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns181machine # [ 0.201977] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)182machine # [ 0.205568] Console: colour VGA+ 80x25183machine # [ 0.205572] printk: legacy console [tty0] enabled184machine # [ 0.237177] printk: legacy console [ttyS0] enabled185machine # [ 0.350709] ACPI: Core revision 20250807186machine # [ 0.351588] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns187machine # [ 0.353214] APIC: Switch to symmetric I/O mode setup188machine # [ 0.354302] x2apic enabled189machine # [ 0.355052] APIC: Switched APIC routing to: physical x2apic190machine # [ 0.356022] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()191machine # [ 0.357384] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()192machine # [ 0.358901] kvm-guest: setup PV IPIs193machine # [ 0.360522] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1194machine # [ 0.361603] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns195machine # [ 0.366167] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)196machine # [ 0.368252] x86/cpu: User Mode Instruction Prevention (UMIP) activated197machine # [ 0.369357] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127198machine # [ 0.370932] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0199machine # [ 0.372013] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto200machine # [ 0.373165] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl201machine # [ 0.375164] Transient Scheduler Attacks: Vulnerable: No microcode202machine # [ 0.376164] Spectre V2 : Mitigation: Enhanced / Automatic IBRS203machine # [ 0.377164] Speculative Return Stack Overflow: Mitigation: Safe RET204machine # [ 0.378164] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization205machine # [ 0.379171] Spectre V2 : Enabling IBPB for BPF206machine # [ 0.380759] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier207machine # [ 0.382165] active return thunk: srso_alias_return_thunk208machine # [ 0.383186] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'209machine # [ 0.384164] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'210machine # [ 0.385164] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'211machine # [ 0.386994] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'212machine # [ 0.388002] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'213machine # [ 0.389164] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'214machine # [ 0.390164] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'215machine # [ 0.391165] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256216machine # [ 0.392164] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64217machine # [ 0.393164] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512218machine # [ 0.394973] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024219machine # [ 0.395967] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8220machine # [ 0.396962] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.221machine # [ 0.427144] Freeing SMP alternatives memory: 44K222machine # [ 0.427777] pid_max: default: 32768 minimum: 301223machine # [ 0.428850] LSM: initializing lsm=capability,landlock,yama,bpf,ima224machine # [ 0.429264] landlock: Up and running.225machine # [ 0.430642] Yama: becoming mindful.226machine # [ 0.431378] LSM support for eBPF active227machine # [ 0.432320] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear)228machine # [ 0.433242] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear)229machine # [ 0.436476] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)230machine # [ 0.437786] Performance Events: Fam17h+ core perfctr, AMD PMU driver.231machine # [ 0.438173] ... version: 2232machine # [ 0.438956] ... bit width: 48233machine # [ 0.439166] ... generic counters: 6234machine # [ 0.439945] ... generic bitmap: 000000000000003f235machine # [ 0.440167] ... fixed-purpose counters: 0236machine # [ 0.440910] ... fixed-purpose bitmap: 0000000000000000237machine # [ 0.441166] ... value mask: 0000ffffffffffff238machine # [ 0.442137] ... max period: 00007fffffffffff239machine # [ 0.442942] ... global_ctrl mask: 000000000000003f240machine # [ 0.443271] signal: max sigframe size: 3376241machine # [ 0.444114] rcu: Hierarchical SRCU implementation.242machine # [ 0.444838] rcu: Max phase no-delay instances is 400.243machine # [ 0.445388] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level244machine # [ 0.450769] smp: Bringing up secondary CPUs ...245machine # [ 0.451565] smpboot: x86: Booting SMP configuration:246machine # [ 0.452175] .... node #0, CPUs: #1 #2 #3247machine # [ 0.455288] smp: Brought up 1 node, 4 CPUs248machine # [ 0.456924] smpboot: Total of 4 processors activated (19200.09 BogoMIPS)249machine # [ 0.457709] Memory: 3957824K/4193752K available (17259K kernel code, 2728K rwdata, 13652K rodata, 3656K init, 2968K bss, 220912K reserved, 0K cma-reserved)250machine # [ 0.459167] devtmpfs: initialized251machine # [ 0.460391] x86/mm: Memory block size: 128MB252machine # [ 0.463263] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)253machine # [ 0.464252] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).254machine # [ 0.465270] pinctrl core: initialized pinctrl subsystem255machine # [ 0.466531] PM: RTC time: 09:10:40, date: 2026-09-30256machine # [ 0.470368] NET: Registered PF_NETLINK/PF_ROUTE protocol family257machine # [ 0.471976] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations258machine # [ 0.473179] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations259machine # [ 0.474727] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations260machine # [ 0.475180] audit: initializing netlink subsys (disabled)261machine # [ 0.476197] audit: type=2000 audit(1790759441.195:1): state=initialized audit_enabled=0 res=1262machine # [ 0.476427] thermal_sys: Registered thermal governor 'fair_share'263machine # [ 0.478167] thermal_sys: Registered thermal governor 'bang_bang'264machine # [ 0.479167] thermal_sys: Registered thermal governor 'step_wise'265machine # [ 0.480166] thermal_sys: Registered thermal governor 'user_space'266machine # [ 0.481166] thermal_sys: Registered thermal governor 'power_allocator'267machine # [ 0.482181] cpuidle: using governor menu268machine # [ 0.484368] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5269machine # [ 0.485396] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]270machine # [ 0.486170] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry271machine # [ 0.487180] PCI: Using configuration type 1 for base access272machine # [ 0.488323] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.273machine # [ 0.490497] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages274machine # [ 0.492076] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page275machine # [ 0.493081] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages276machine # [ 0.494086] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page277machine # [ 0.499550] ACPI: Added _OSI(Module Device)278machine # [ 0.501178] ACPI: Added _OSI(Processor Device)279machine # [ 0.503173] ACPI: Added _OSI(Processor Aggregator Device)280machine # [ 0.511962] ACPI: 1 ACPI AML tables successfully acquired and loaded281machine # [ 0.517645] ACPI: Interpreter enabled282machine # [ 0.518733] ACPI: PM: (supports S0 S3 S4 S5)283machine # [ 0.519168] ACPI: Using IOAPIC for interrupt routing284machine # [ 0.520223] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug285machine # [ 0.521168] PCI: Using E820 reservations for host bridge windows286machine # [ 0.522371] ACPI: Enabled 2 GPEs in block 00 to 3F287machine # [ 0.527787] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])288machine # [ 0.529175] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]289machine # [ 0.531259] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]290machine # [ 0.532294] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]291machine # [ 0.533624] PCI host bridge to bus 0000:00292machine # [ 0.534172] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]293machine # [ 0.536167] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]294machine # [ 0.537167] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]295machine # [ 0.538167] pci_bus 0000:00: root bus resource [mem 0x80000000-0xafffffff window]296machine # [ 0.539167] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]297machine # [ 0.541189] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe07ffffffff window]298machine # [ 0.542169] pci_bus 0000:00: root bus resource [bus 00-ff]299machine # [ 0.543269] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint300machine # [ 0.545646] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint301machine # [ 0.559255] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]302machine # [ 0.561179] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]303machine # [ 0.562189] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]304machine # [ 0.563343] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]305machine # [ 0.564911] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint306machine # [ 0.570213] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f]307machine # [ 0.571097] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]308machine # [ 0.571960] pci 0000:00:02.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]309machine # [ 0.573177] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]310machine # [ 0.574711] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint311machine # [ 0.582546] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f]312machine # [ 0.585190] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]313machine # [ 0.587228] pci 0000:00:03.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]314machine # [ 0.592154] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint315machine # [ 0.605202] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f]316machine # [ 0.607189] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]317machine # [ 0.610227] pci 0000:00:04.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]318machine # [ 0.614557] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint319machine # [ 0.625194] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f]320machine # [ 0.627189] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]321machine # [ 0.629252] pci 0000:00:05.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]322machine # [ 0.632183] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref]323machine # [ 0.635254] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint324machine # [ 0.641813] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]325machine # [ 0.643214] pci 0000:00:06.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]326machine # [ 0.646858] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint327machine # [ 0.650214] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]328machine # [ 0.652190] pci 0000:00:07.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]329machine # [ 0.653714] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint330machine # [ 0.656180] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]331machine # [ 0.669973] pci 0000:00:08.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]332machine # [ 0.671722] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint333machine # [ 0.675212] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]334machine # [ 0.676217] pci 0000:00:09.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]335machine # [ 0.678753] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint336machine # [ 0.683226] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf]337machine # [ 0.685174] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]338machine # [ 0.686189] pci 0000:00:0a.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]339machine # [ 0.687758] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint340machine # [ 0.691207] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f]341machine # [ 0.692139] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]342machine # [ 0.694015] pci 0000:00:0b.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]343machine # [ 0.695725] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint344machine # [ 0.698066] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f]345machine # [ 0.699093] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint346machine # [ 0.702008] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf]347machine # [ 0.703142] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint348machine # [ 0.705615] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df]349machine # [ 0.707405] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint350machine # [ 0.709224] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]351machine # [ 0.713787] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint352machine # [ 0.717931] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO353machine # [ 0.721789] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint354machine # [ 0.731264] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff]355machine # [ 0.733189] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]356machine # [ 0.736985] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint357machine # [ 0.743261] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]358machine # [ 0.753437] ACPI: PCI: Interrupt link LNKA configured for IRQ 10359machine # [ 0.756452] ACPI: PCI: Interrupt link LNKB configured for IRQ 10360machine # [ 0.758719] ACPI: PCI: Interrupt link LNKC configured for IRQ 11361machine # [ 0.761423] ACPI: PCI: Interrupt link LNKD configured for IRQ 11362machine # [ 0.764364] ACPI: PCI: Interrupt link LNKE configured for IRQ 10363machine # [ 0.766367] ACPI: PCI: Interrupt link LNKF configured for IRQ 10364machine # [ 0.768367] ACPI: PCI: Interrupt link LNKG configured for IRQ 11365machine # [ 0.770376] ACPI: PCI: Interrupt link LNKH configured for IRQ 11366machine # [ 0.773291] ACPI: PCI: Interrupt link GSIA configured for IRQ 16367machine # [ 0.775202] ACPI: PCI: Interrupt link GSIB configured for IRQ 17368machine # [ 0.777438] ACPI: PCI: Interrupt link GSIC configured for IRQ 18369machine # [ 0.779204] ACPI: PCI: Interrupt link GSID configured for IRQ 19370machine # [ 0.781205] ACPI: PCI: Interrupt link GSIE configured for IRQ 20371machine # [ 0.784206] ACPI: PCI: Interrupt link GSIF configured for IRQ 21372machine # [ 0.786213] ACPI: PCI: Interrupt link GSIG configured for IRQ 22373machine # [ 0.789204] ACPI: PCI: Interrupt link GSIH configured for IRQ 23374machine # [ 0.795188] iommu: Default domain type: Translated375machine # [ 0.797172] iommu: DMA domain TLB invalidation policy: lazy mode376machine # [ 0.800740] ACPI: bus type USB registered377machine # [ 0.802329] usbcore: registered new interface driver usbfs378machine # [ 0.804202] usbcore: registered new interface driver hub379machine # [ 0.807233] usbcore: registered new device driver usb380machine # [ 0.811883] NetLabel: Initializing381machine # [ 0.813172] NetLabel: domain hash size = 128382machine # [ 0.815171] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO383machine # [ 0.817290] NetLabel: unlabeled traffic allowed by default384machine # [ 0.819200] PCI: Using ACPI for IRQ routing385machine # [ 0.878488] pci 0000:00:01.0: vgaarb: setting as boot VGA device386machine # [ 0.879163] pci 0000:00:01.0: vgaarb: bridge control possible387machine # [ 0.879163] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none388machine # [ 0.882176] vgaarb: loaded389machine # [ 0.883038] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0390machine # [ 0.883804] hpet0: 3 comparators, 64-bit 100.000000 MHz counter391machine # [ 0.888433] clocksource: Switched to clocksource kvm-clock392machine # [ 0.890136] VFS: Disk quotas dquot_6.6.0393machine # [ 0.890894] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)394machine # [ 0.892600] pnp: PnP ACPI init395machine # [ 0.893537] ACPI: IRQ 4 override to edge(!), high(!)396machine # [ 0.894567] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved397machine # [ 0.896248] pnp: PnP ACPI: found 5 devices398machine # [ 0.907963] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns399machine # [ 0.911811] clocksource: Switched to clocksource acpi_pm400machine # [ 0.914504] NET: Registered PF_INET protocol family401machine # [ 0.918136] IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear)402machine # [ 0.946647] tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear)403machine # [ 0.948213] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)404machine # [ 0.949670] TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear)405machine # [ 0.952231] TCP bind hash table entries: 32768 (order: 8, 1048576 bytes, linear)406machine # [ 0.953622] TCP: Hash tables configured (established 32768 bind 32768)407machine # [ 0.954875] MPTCP token hash table entries: 4096 (order: 5, 98304 bytes, linear)408machine # [ 0.956267] UDP hash table entries: 2048 (order: 5, 131072 bytes, linear)409machine # [ 0.957533] UDP-Lite hash table entries: 2048 (order: 5, 131072 bytes, linear)410machine # [ 0.958921] NET: Registered PF_UNIX/PF_LOCAL protocol family411machine # [ 0.959949] NET: Registered PF_XDP protocol family412machine # [ 0.960815] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]413machine # [ 0.961922] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]414machine # [ 0.963005] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]415machine # [ 0.964197] pci_bus 0000:00: resource 7 [mem 0x80000000-0xafffffff window]416machine # [ 0.965388] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]417machine # [ 0.966602] pci_bus 0000:00: resource 9 [mem 0xe0000000000-0xe07ffffffff window]418machine # [ 0.968585] ACPI: \_SB_.GSIA: Enabled at IRQ 16419machine # [ 0.970941] ACPI: \_SB_.GSIB: Enabled at IRQ 17420machine # [ 0.973056] ACPI: \_SB_.GSIC: Enabled at IRQ 18421machine # [ 0.975228] ACPI: \_SB_.GSID: Enabled at IRQ 19422machine # [ 0.977089] PCI: CLS 0 bytes, default 64423machine # [ 0.978010] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)424machine # [ 0.978637] Trying to unpack rootfs image as initramfs...425machine # [ 0.979125] software IO TLB: mapped [mem 0x000000007a364000-0x000000007e364000] (64MB)426machine # [ 0.981925] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns427machine # [ 1.002595] Initialise system trusted keyrings428machine # [ 1.003848] workingset: timestamp_bits=40 max_order=20 bucket_order=0429machine # [ 1.015262] Key type asymmetric registered430machine # [ 1.016055] Asymmetric key parser 'x509' registered431machine # [ 1.016980] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)432machine # [ 1.018824] io scheduler mq-deadline registered433machine # [ 1.019667] io scheduler kyber registered434machine # [ 1.024946] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled435machine # [ 1.026365] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A436machine # [ 1.028840] Linux agpgart interface v0.103437machine # [ 1.029643] ACPI: bus type drm_connector registered438machine # [ 1.032929] usbcore: registered new interface driver usbserial_generic439machine # [ 1.034098] usbserial: USB Serial support registered for generic440machine # [ 1.035176] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.441machine # [ 1.035176] Please enable it if your BIOS has the CPPC option.442machine # [ 1.037573] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled443machine # [ 1.039096] drop_monitor: Initializing network drop monitor service444machine # [ 1.040399] NET: Registered PF_INET6 protocol family445machine # [ 1.042095] Segment Routing with IPv6446machine # [ 1.042784] In-situ OAM (IOAM) with IPv6447machine # [ 1.044635] IPI shorthand broadcast: enabled448machine # [ 1.049383] sched_clock: Marking stable (894014680, 155299799)->(1072696276, -23381797)449machine # [ 1.051364] registered taskstats version 1450machine # [ 1.052474] Loading compiled-in X.509 certificates451machine # [ 1.062937] Demotion targets for Node 0: null452machine # [ 1.064133] Key type .fscrypt registered453machine # [ 1.064927] Key type fscrypt-provisioning registered454machine # [ 1.066055] ima: No TPM chip found, activating TPM-bypass!455machine # [ 1.067048] ima: Allocated hash algorithm: sha1456machine # [ 1.067929] ima: No architecture policies found457machine # [ 1.069015] PM: Magic number: 10:842:172458machine # [ 1.070636] RAS: Correctable Errors collector initialized.459machine # [ 1.075289] clk: Disabling unused clocks460machine # [ 1.076047] PM: genpd: Disabling unused power domains461machine # [ 1.272156] Freeing initrd memory: 29104K462machine # [ 1.275870] Freeing unused decrypted memory: 2028K463machine # [ 1.278676] Freeing unused kernel image (initmem) memory: 3656K464machine # [ 1.279799] Write protecting the kernel read-only data: 32768k465machine # [ 1.281924] Freeing unused kernel image (text/rodata gap) memory: 1172K466machine # [ 1.283571] Freeing unused kernel image (rodata/data gap) memory: 684K467machine # [ 1.346543] x86/mm: Checked W+X mappings: passed, no W+X pages found.468machine # [ 1.347688] Run /init as init process469machine # [ 1.361853] systemd[1]: Inserted module 'autofs4'470machine # [ 1.388638] fuse: init (API version 7.45)471machine # [ 1.397737] ACPI: \_SB_.GSIG: Enabled at IRQ 22472machine # [ 1.400160] ACPI: \_SB_.GSIH: Enabled at IRQ 23473machine # [ 1.403424] ACPI: \_SB_.GSIE: Enabled at IRQ 20474machine # [ 1.405636] ACPI: \_SB_.GSIF: Enabled at IRQ 21475machine # [ 1.410793] virtiofs virtio5: discovered new tag: nix-store476machine # [ 1.412437] virtiofs virtio5: virtio_fs_setup_dax: No cache capability477machine # [ 1.419702] virtiofs virtio6: discovered new tag: shared478machine # [ 1.432621] virtiofs virtio6: virtio_fs_setup_dax: No cache capability479machine # [ 1.436466] virtiofs virtio7: discovered new tag: xchg480machine # [ 1.437943] virtiofs virtio7: virtio_fs_setup_dax: No cache capability481machine # [ 1.464576] systemd[1]: Successfully made /usr/ read-only.482machine # [ 1.801253] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)483machine # [ 1.812990] systemd[1]: Detected virtualization kvm.484machine # [ 1.815241] systemd[1]: Detected architecture x86-64.485machine # [ 1.817500] systemd[1]: Running in initrd.486machine # [ 1.819951] systemd[1]: Initializing machine ID from random generator.487machine # [ 1.822928] systemd[1]: Hostname set to <machine>.488machine # [ 1.925756] systemd[1]: bpf-restrict-fs: LSM BPF program attached489machine # [ 1.967023] systemd[1]: Queued start job for default target Initrd Default Target.490machine # [ 1.974888] systemd[1]: Created slice Slice /system/modprobe.491machine # [ 1.976152] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.492machine # [ 1.977648] systemd[1]: Expecting device /dev/disk/by-label/nixos...493machine # [ 1.978800] systemd[1]: Reached target Path Units.494machine # [ 1.979724] systemd[1]: Reached target Slice Units.495machine # [ 1.980631] systemd[1]: Reached target Swaps.496machine # [ 1.981495] systemd[1]: Reached target Timer Units.497machine # [ 1.982537] systemd[1]: Listening on D-Bus System Message Bus Socket.498machine # [ 1.983825] systemd[1]: Listening on Journal Socket (/dev/log).499machine # [ 1.984999] systemd[1]: Listening on Journal Sockets.500machine # [ 1.986027] systemd[1]: Listening on udev Control Socket.501machine # [ 1.987103] systemd[1]: Listening on udev Kernel Socket.502machine # [ 1.988112] systemd[1]: Reached target Socket Units.503machine # [ 1.990233] systemd[1]: Starting Create List of Static Device Nodes...504machine # [ 1.992523] systemd[1]: Starting Load Kernel Module configfs...505machine # [ 1.995637] systemd[1]: Starting Journal Service...506machine # [ 1.998063] systemd[1]: Starting Load Kernel Modules...507machine # [ 2.000970] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os508machine # [ 2.012294] systemd[1]: Starting Coldplug All udev Devices...509machine # [ 2.027603] systemd[1]: modprobe@configfs.service: Deactivated successfully.510machine # [ 2.032570] systemd[1]: Finished Load Kernel Module configfs.511machine # [ 2.037970] systemd[1]: Finished Create List of Static Device Nodes.512machine # [ 2.042263] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config513machine # [ 2.050015] systemd-journald[88]: Collecting audit messages is disabled.514machine # [ 2.051537] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...515machine # [ 2.056167] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.516machine # [ 2.058529] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev517machine # [ 2.062995] systemd[1]: Finished Load Kernel Modules.518machine # [ 2.068466] systemd[1]: Starting Apply Kernel Variables...519machine # [ 2.081794] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.520machine # [ 2.085387] systemd[1]: Starting Create Static Device Nodes in /dev...521machine # [ 2.091780] systemd[1]: Finished Apply Kernel Variables.522machine # [ 2.093036] systemd[1]: Started Journal Service.523machine # [ 1.936655] systemd-modules-load[89]: Using 4 probe threads524machine # [ 1.939821] systemd-modules-load[89]: Inserted module 'virtio_balloon'525machine # [ 1.941415] systemd-modules-load[89]: Inserted module 'virtio_gpu'526machine # [ 1.942659] systemd-modules-load[89]: Inserted module 'dm_mod'527machine # [ 1.947502] systemd[1]: Finished Create Static Device Nodes in /dev.528machine # [ 1.948523] systemd[1]: Reached target Preparation for Local File Systems.529machine # [ 1.949529] systemd[1]: Reached target Local File Systems.530machine # [ 1.950310] systemd[1]: Starting Create System Files and Directories...531machine # [ 1.951251] systemd[1]: Starting Rule-based Manager for Device Events and Files...532machine # [ 1.962260] systemd[1]: Finished Create System Files and Directories.533machine # [ 1.971793] systemd-udevd[109]: Using default interface naming scheme 'v261'.534machine # [ 1.978893] systemd[1]: Finished Coldplug All udev Devices.535machine # [ 1.983621] systemd[1]: Started Rule-based Manager for Device Events and Files.536machine # [ 1.984895] systemd[1]: Reached target System Initialization.537machine # [ 1.985804] systemd[1]: Reached target Basic System.538machine # [ 2.242761] uhci_hcd 0000:00:1d.0: UHCI Host Controller539machine # [ 2.245773] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 1540machine # [ 2.246979] uhci_hcd 0000:00:1d.0: detected 2 ports541machine # [ 2.248116] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180542machine # [ 2.249252] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18543machine # [ 2.251155] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1544machine # [ 2.252489] usb usb1: Product: UHCI Host Controller545machine # [ 2.253372] usb usb1: Manufacturer: Linux 6.18.53 uhci_hcd546machine # [ 2.254478] usb usb1: SerialNumber: 0000:00:1d.0547machine # [ 2.255583] hub 1-0:1.0: USB hub found548machine # [ 2.256370] hub 1-0:1.0: 2 ports detected549machine # [ 2.260986] virtio_blk virtio2: 4/0/0 default/read/poll queues550machine # [ 2.284899] SCSI subsystem initialized551machine # [ 2.287269] virtio_blk virtio2: [vda] 33554432 512-byte logical blocks (17.2 GB/16.0 GiB)552machine # [ 2.295593] ehci-pci 0000:00:1d.7: EHCI Host Controller553machine # [ 2.296484] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 2554machine # [ 2.297914] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000555machine # [ 2.304336] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00556machine # [ 2.305647] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18557machine # [ 2.306902] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1558machine # [ 2.308018] usb usb2: Product: EHCI Host Controller559machine # [ 2.308740] usb usb2: Manufacturer: Linux 6.18.53 ehci_hcd560machine # [ 2.309539] usb usb2: SerialNumber: 0000:00:1d.7561machine # [ 2.310952] hub 2-0:1.0: USB hub found562machine # [ 2.156808] systemd[1]: Starting Virtual Console Setup...563machine # [ 2.312943] hub 2-0:1.0: 6 ports detected564machine # [ 2.179605] systemd-vconsole-setup[141]: Configuration of first virtual console was skipped, ignoring remaining ones.565machine # [ 2.337438] hub 1-0:1.0: USB hub found566machine # [ 2.182334] systemd[1]: Finished Virtual Console Setup.567machine # [ 2.338092] hub 1-0:1.0: 2 ports detected568machine # [ 2.339598] uhci_hcd 0000:00:1d.1: UHCI Host Controller569machine # [ 2.340467] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3570machine # [ 2.342256] uhci_hcd 0000:00:1d.1: detected 2 ports571machine # [ 2.343872] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0572machine # [ 2.190219] (udev-worker)[138]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.573machine # [ 2.345341] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12574machine # [ 2.193114] (udev-worker)[138]: Network interface NamePolicy= disabled on kernel command line.575machine # [ 2.346382] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18576machine # [ 2.195118] (udev-worker)[119]: Network interface NamePolicy= disabled on kernel command line.577machine # [ 2.346386] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1578machine # [ 2.346388] usb usb3: Product: UHCI Host Controller579machine # [ 2.346389] usb usb3: Manufacturer: Linux 6.18.53 uhci_hcd580machine # [ 2.346390] usb usb3: SerialNumber: 0000:00:1d.1581machine # [ 2.347720] hub 3-0:1.0: USB hub found582machine # [ 2.352072] hub 3-0:1.0: 2 ports detected583machine # [ 2.358745] uhci_hcd 0000:00:1d.2: UHCI Host Controller584machine # [ 2.361354] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4585machine # [ 2.363132] uhci_hcd 0000:00:1d.2: detected 2 ports586machine # [ 2.364124] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0587machine # [ 2.364211] serio: i8042 KBD port at 0x60,0x64 irq 1588machine # [ 2.364520] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18589machine # [ 2.364980] serio: i8042 AUX port at 0x60,0x64 irq 12590machine # [ 2.365630] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1591machine # [ 2.369493] usb usb4: Product: UHCI Host Controller592machine # [ 2.370408] usb usb4: Manufacturer: Linux 6.18.53 uhci_hcd593machine # [ 2.371277] usb usb4: SerialNumber: 0000:00:1d.2594machine # [ 2.373980] hub 4-0:1.0: USB hub found595machine # [ 2.374651] hub 4-0:1.0: 2 ports detected596machine # [ 2.219907] systemd[1]: Found device /dev/disk/by-label/nixos.597machine # [ 2.221611] systemd[1]: Reached target Initrd Root Device.598machine # [ 2.223683] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...599machine # [ 2.385796] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0600machine # [ 2.386610] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode601machine # [ 2.388508] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f)602machine # [ 2.389683] ahci 0000:00:1f.2: flags: 64bit ncq only603machine # [ 2.397486] scsi host0: ahci604machine # [ 2.398884] scsi host1: ahci605machine # [ 2.401927] scsi host2: ahci606machine # [ 2.403701] scsi host3: ahci607machine # [ 2.405120] scsi host4: ahci608machine # [ 2.406319] scsi host5: ahci609machine # [ 2.406976] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 50 lpm-pol 1610machine # [ 2.252813] systemd-fsck[160]: nixos: clean, 12/1048576 files, 109865/4194304 blocks611machine # [ 2.408344] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 50 lpm-pol 1612machine # [ 2.410508] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 50 lpm-pol 1613machine # [ 2.411777] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 50 lpm-pol 1614machine # [ 2.411783] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 50 lpm-pol 1615machine # [ 2.411788] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 50 lpm-pol 1616machine # [ 2.261282] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.617machine # [ 2.556522] usb 2-1: new high-speed USB device number 2 using ehci-pci618machine # [ 2.687633] usb 2-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00619machine # [ 2.690639] usb 2-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10620machine # [ 2.693343] usb 2-1: Product: QEMU USB Tablet621machine # [ 2.695008] usb 2-1: Manufacturer: QEMU622machine # [ 2.696553] usb 2-1: SerialNumber: 28754-0000:00:1d.7-1623machine # [ 2.731892] ata4: SATA link down (SStatus 0 SControl 300)624machine # [ 2.733388] hid: raw HID events driver (C) Jiri Kosina625machine # [ 2.734257] ata6: SATA link down (SStatus 0 SControl 300)626machine # [ 2.739019] ata5: SATA link down (SStatus 0 SControl 300)627machine # [ 2.741404] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300)628machine # [ 2.743940] ata2: SATA link down (SStatus 0 SControl 300)629machine # [ 2.746046] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100630machine # [ 2.748132] ata3.00: applying bridge limits631machine # [ 2.749997] ata1: SATA link down (SStatus 0 SControl 300)632machine # [ 2.752263] ata3.00: configured for UDMA/100633machine # [ 2.754909] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5634machine # [ 2.786776] usbcore: registered new interface driver usbhid635machine # [ 2.788970] usbhid: USB HID core driver636machine # [ 2.799355] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb2/2-1/2-1:1.0/0003:0627:0001.0001/input/input2637machine # [ 2.803531] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0638machine # [ 2.824935] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray639machine # [ 2.853730] cdrom: Uniform CD-ROM driver Revision: 3.20640machine # [ 2.864217] systemd[1]: Mounting /sysroot...641machine # [ 3.154000] EXT4-fs (vda): mounted filesystem a0f9247e-7de3-4a4e-bc81-eed34c62727b r/w with ordered data mode. Quota mode: none.642machine # [ 3.005953] systemd[1]: Mounted /sysroot.643machine # [ 3.006960] systemd[1]: Reached target Initrd Root File System.644machine # [ 3.011285] systemd[1]: Mounting /sysroot/nix/.ro-store...645machine # [ 3.013316] systemd[1]: Mounting /sysroot/nix/.rw-store...646machine # [ 3.016623] systemd[1]: Mounting /sysroot/run...647machine # [ 3.025092] systemd[1]: Mounting /sysroot/tmp/shared...648machine # [ 3.030611] systemd[1]: Mounting /sysroot/tmp/xchg...649machine # [ 3.033655] systemd[1]: Starting Mountpoints Configured in the Real Root...650machine # [ 3.040249] systemd[1]: Mounted /sysroot/nix/.ro-store.651machine # [ 3.041103] systemd[1]: Mounted /sysroot/nix/.rw-store.652machine # [ 3.041897] systemd[1]: Mounted /sysroot/run.653machine # [ 3.042557] systemd[1]: Mounted /sysroot/tmp/xchg.654machine # [ 3.047227] systemd[1]: Starting rw-sysroot-nix-store.service...655machine # [ 3.055838] systemd-sysroot-fstab-check[193]: /sysroot should be mounted in the initrd, will request daemon-reload.656machine # [ 3.059437] systemd[1]: Mounted /sysroot/tmp/shared.657machine # [ 3.060426] systemd[1]: Reload requested from client PID 193 ('systemd-sysroot') (unit initrd-parse-etc.service)...658machine # [ 3.061971] systemd[1]: Reloading...659machine # [ 3.117396] systemd[1]: Reloading finished in 56 ms.660machine # [ 3.142217] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.661machine # [ 3.144811] systemd[1]: Finished rw-sysroot-nix-store.service.662machine # [ 3.146958] systemd-sysroot-fstab-check[193]: Requesting initrd-fs.target/start/replace...663machine # [ 3.149972] systemd-sysroot-fstab-check[193]: Requesting swap.target/start/replace...664machine # [ 3.152704] systemd[1]: Starting rw-sysroot-nix-store.service...665machine # [ 3.154889] systemd[1]: initrd-parse-etc.service: Deactivated successfully.666machine # [ 3.157382] systemd[1]: Finished Mountpoints Configured in the Real Root.667machine # [ 3.159738] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.668machine # [ 3.174827] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.669machine # [ 3.177594] systemd[1]: Finished rw-sysroot-nix-store.service.670machine # [ 3.864274] systemd[1]: Mounting /sysroot/nix/store...671machine # [ 3.919321] systemd[1]: Mounted /sysroot/nix/store.672machine # [ 3.921291] systemd[1]: Reached target Initrd File Systems.673machine # [ 3.923269] systemd[1]: Starting Find NixOS closure...674machine # [ 3.925405] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...675machine # [ 3.956147] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.676machine # [ 3.958977] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.677machine # [ 3.975939] systemd[1]: Finished Find NixOS closure.678machine # [ 3.977828] systemd[1]: Reached target Initrd Default Target.679machine # [ 3.979852] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...680machine # [ 4.017162] systemd[1]: Stopped target Initrd Default Target.681machine # [ 4.019276] systemd[1]: Stopped target Basic System.682machine # [ 4.021163] systemd[1]: Stopped target Initrd Root Device.683machine # [ 4.023077] systemd[1]: Stopped target Path Units.684machine # [ 4.024824] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.685machine # [ 4.027478] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.686machine # [ 4.030213] systemd[1]: Stopped target Slice Units.687machine # [ 4.032102] systemd[1]: Stopped target Socket Units.688machine # [ 4.033879] systemd[1]: Stopped target System Initialization.689machine # [ 4.036301] systemd[1]: Stopped target Swaps.690machine # [ 4.038553] systemd[1]: Stopped target Timer Units.691machine # [ 4.041891] systemd[1]: dbus.socket: Deactivated successfully.692machine # [ 4.044587] systemd[1]: Closed D-Bus System Message Bus Socket.693machine # [ 4.046918] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.694machine # [ 4.049601] systemd[1]: Stopped Find NixOS closure.695machine # [ 4.051510] systemd[1]: Starting rw-sysroot-nix-store.service...696machine # [ 4.053783] systemd[1]: systemd-sysctl.service: Deactivated successfully.697machine # [ 4.055999] systemd[1]: Stopped Apply Kernel Variables.698machine # [ 4.057721] systemd[1]: systemd-modules-load.service: Deactivated successfully.699machine # [ 4.059832] systemd[1]: Stopped Load Kernel Modules.700machine # [ 4.061469] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.701machine # [ 4.063561] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.702machine # [ 4.065559] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.703machine # [ 4.067426] systemd[1]: Stopped Create System Files and Directories.704machine # [ 4.069147] systemd[1]: Stopped target Local File Systems.705machine # [ 4.070648] systemd[1]: Stopped target Preparation for Local File Systems.706machine # [ 4.072454] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.707machine # [ 4.074431] systemd[1]: Stopped Coldplug All udev Devices.708machine # [ 4.075456] systemd[1]: Stopping Rule-based Manager for Device Events and Files...709machine # [ 4.076799] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.710machine # [ 4.078063] systemd[1]: Stopped Virtual Console Setup.711machine # [ 4.079103] systemd[1]: initrd-cleanup.service: Deactivated successfully.712machine # [ 4.080329] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.713machine # [ 4.081604] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.714machine # [ 4.082875] systemd[1]: Finished rw-sysroot-nix-store.service.715machine # [ 4.083928] systemd[1]: systemd-udevd.service: Deactivated successfully.716machine # [ 4.085095] systemd[1]: Stopped Rule-based Manager for Device Events and Files.717machine # [ 4.086331] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.718machine # [ 4.087575] systemd[1]: Closed udev Control Socket.719machine # [ 4.088511] systemd[1]: Starting Cleanup udev Database...720machine # [ 4.089476] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.721machine # [ 4.090860] systemd[1]: Stopped Create Static Device Nodes in /dev.722machine # [ 4.091995] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.723machine # [ 4.093388] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.724machine # [ 4.094554] systemd[1]: kmod-static-nodes.service: Deactivated successfully.725machine # [ 4.095472] systemd[1]: Stopped Create List of Static Device Nodes.726machine # [ 4.121095] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.727machine # [ 4.122480] systemd[1]: Finished Cleanup udev Database.728machine # [ 4.123449] systemd[1]: Reached target Switch Root.729machine # [ 4.124767] systemd[1]: Starting NixOS Activation...730machine # [ 4.275125] initrd-nixos-activation-start[240]: booting system configuration /nix/store/vymjrh888c94hbnp2caxf098iqy391ib-nixos-system-machine-test731machine # [ 4.336859] initrd-nixos-activation-start[240]: running activation script...732machine # [ 4.666138] initrd-nixos-activation-start[263]: setting up /etc...733machine # [ 4.818659] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.734machine # [ 4.819839] systemd[1]: Finished NixOS Activation.735machine # [ 4.822213] systemd[1]: Starting Switch Root...736machine # [ 4.840767] systemd[1]: Switching root.737machine # [ 5.057434] systemd-journald[88]: Received SIGTERM from PID 1 (systemd).738machine # [ 5.211539] NET: Registered PF_VSOCK protocol family739machine # [ 5.590399] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)740machine # [ 5.630333] systemd[1]: Detected virtualization kvm.741machine # [ 5.632326] systemd[1]: Detected architecture x86-64.742machine # [ 5.634394] systemd[1]: Detected first boot.743machine # [ 5.638652] systemd[1]: Initializing machine ID from random generator.744machine # [ 5.783206] systemd[1]: bpf-restrict-fs: LSM BPF program attached745machine # [ 5.863878] systemd[1]: Applying preset policy.746machine # [ 6.054378] systemd[1]: Populated /etc with preset unit settings.747machine # [ 6.319561] systemd[1]: initrd-switch-root.service: Deactivated successfully.748machine # [ 6.323136] systemd[1]: Stopped initrd-switch-root.service.749machine # [ 6.327882] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.750machine # [ 6.333628] systemd[1]: Created slice Slice /system/getty.751machine # [ 6.337189] systemd[1]: Created slice User and Session Slice.752machine # [ 6.339562] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.753machine # [ 6.342712] systemd[1]: Started Forward Password Requests to Wall Directory Watch.754machine # [ 6.345579] systemd[1]: Expecting device /dev/hvc0...755machine # [ 6.347463] systemd[1]: Expecting device /dev/ttyS0...756machine # [ 6.349414] systemd[1]: Reached target Local Encrypted Volumes.757machine # [ 6.351546] systemd[1]: Stopped target initrd-fs.target.758machine # [ 6.353485] systemd[1]: Stopped target initrd-root-fs.target.759machine # [ 6.355565] systemd[1]: Stopped target initrd-switch-root.target.760machine # [ 6.357845] systemd[1]: Reached target Virtual Machines and Containers.761machine # [ 6.360338] systemd[1]: Reached target Path Units.762machine # [ 6.362405] systemd[1]: Reached target Remote File Systems.763machine # [ 6.364521] systemd[1]: Reached target Slice Units.764machine # [ 6.366456] systemd[1]: Reached target Swaps.765machine # [ 6.370754] systemd[1]: Listening on Query the User Interactively for a Password.766machine # [ 6.376220] systemd[1]: Listening on Process Core Dump Socket.767machine # [ 6.381141] systemd[1]: Listening on Credential Encryption/Decryption.768machine # [ 6.385730] systemd[1]: Listening on Factory Reset Management.769machine # [ 6.387871] systemd[1]: Listening on Hostname Service Socket.770machine # [ 6.394213] systemd[1]: Starting Journal Log Access Socket...771machine # [ 6.396951] systemd[1]: Listening on Journal Audit Socket.772machine # [ 6.401299] systemd[1]: Listening on Console Output Muting Service Socket.773machine # [ 6.402639] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.774machine # [ 6.403949] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os775machine # [ 6.405505] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki776machine # [ 6.411252] systemd[1]: Listening on Disk Repartitioning Service Socket.777machine # [ 6.412388] systemd[1]: Listening on udev Control Socket.778machine # [ 6.413485] systemd[1]: Listening on udev Varlink Socket.779machine # [ 6.416354] systemd[1]: Mounting Huge Pages File System...780machine # [ 6.419038] systemd[1]: Mounting POSIX Message Queue File System...781machine # [ 6.421611] systemd[1]: Mounting Kernel Debug File System...782machine # [ 6.424459] systemd[1]: Mounting Kernel Trace File System...783machine # [ 6.429789] systemd[1]: Starting Create List of Static Device Nodes...784machine # [ 6.435566] systemd[1]: Starting Load Kernel Module configfs...785machine # [ 6.437819] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm786machine # [ 6.441446] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore787machine # [ 6.445429] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse788machine # [ 6.452194] systemd[1]: Mounting FUSE Control File System...789machine # [ 6.454485] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67790machine # [ 6.464875] systemd[1]: Starting Journal Service...791machine # [ 6.470795] systemd[1]: Starting Load Kernel Modules...792machine # [ 6.475501] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...793machine # [ 6.480646] systemd[1]: Starting Remount Root and Kernel File Systems...794machine # [ 6.482683] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os795machine # [ 6.487793] systemd[1]: Starting Coldplug All udev Devices...796machine # [ 6.490454] systemd[1]: Listening on Journal Log Access Socket.797machine # [ 6.491534] systemd[1]: Mounted Huge Pages File System.798machine # [ 6.492482] systemd[1]: Mounted POSIX Message Queue File System.799machine # [ 6.493551] systemd[1]: Mounted Kernel Debug File System.800machine # [ 6.494634] systemd[1]: Mounted Kernel Trace File System.801machine # [ 6.496029] systemd[1]: Finished Create List of Static Device Nodes.802machine # [ 6.497358] systemd[1]: modprobe@configfs.service: Deactivated successfully.803machine # [ 6.498902] systemd[1]: Finished Load Kernel Module configfs.804machine # [ 6.500163] systemd[1]: Mounted FUSE Control File System.805machine # [ 6.503063] systemd[1]: Mounting Kernel Configuration File System...806machine # [ 6.505470] systemd-journald[333]: Collecting audit messages is enabled.807machine # [ 6.506851] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...808machine # [ 6.513176] loop: module loaded809machine # [ 6.514338] EXT4-fs (vda): re-mounted a0f9247e-7de3-4a4e-bc81-eed34c62727b.810machine # [ 6.520575] systemd[1]: Finished Load Kernel Modules.811machine # [ 6.523360] systemd[1]: Starting Apply Kernel Variables...812machine # [ 6.368507] systemd[1]: Queued start job for default target Multi-User System.813machine # [ 6.524374] systemd[1]: Started Journal Service.814machine # [ 6.370343] systemd[1]: systemd-journald.service: Deactivated successfully.815machine # [ 6.371667] systemd-modules-load[334]: Using 2 probe threads816machine # [ 6.372606] systemd-modules-load[334]: Inserted module 'loop'817machine # [ 6.373741] systemd[1]: Finished Remount Root and Kernel File Systems.818machine # [ 6.376329] systemd[1]: Listening on Disk Image Download Service Socket.819machine # [ 6.377965] systemd[1]: Starting Flush Journal to Persistent Storage...820machine # [ 6.382043] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore821machine # [ 6.384592] systemd[1]: Starting Load/Save OS Random Seed...822machine # [ 6.386143] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os823machine # [ 6.388208] systemd[1]: Mounted Kernel Configuration File System.824machine # [ 6.392876] systemd-oomd[335]: No swap; memory pressure usage will be degraded825machine # [ 6.394360] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.826machine # [ 6.556105] systemd-journald[333]: Received client request to flush runtime journal.827machine # [ 6.457750] systemd[1]: Finished Load/Save OS Random Seed.828machine # [ 6.458882] systemd[1]: Reached target First Boot Complete.829machine # [ 6.459854] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.830machine # [ 6.460926] systemd[1]: Finished Apply Kernel Variables.831machine # [ 6.461777] systemd[1]: Starting Create Static Device Nodes in /dev...832machine # [ 6.462718] systemd[1]: Finished Flush Journal to Persistent Storage.833machine # [ 6.465771] systemd[1]: Finished Create Static Device Nodes in /dev.834machine # [ 6.466599] systemd[1]: Reached target Preparation for Local File Systems.835machine # [ 6.467760] systemd[1]: Starting Rule-based Manager for Device Events and Files...836machine # [ 6.509888] systemd[1]: Finished Coldplug All udev Devices.837machine # [ 6.516093] systemd-udevd[365]: Using default interface naming scheme 'v261'.838machine # [ 6.547941] systemd[1]: Started Rule-based Manager for Device Events and Files.839machine # [ 6.619379] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse840machine # [ 6.637637] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.841machine # [ 6.659286] (udev-worker)[380]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.842machine # [ 6.662208] (udev-worker)[380]: Network interface NamePolicy= disabled on kernel command line.843machine # [ 6.669396] (udev-worker)[375]: Network interface NamePolicy= disabled on kernel command line.844machine # [ 6.673676] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.845machine # [ 6.677219] systemd[1]: Condition check resulted in Virtio network device being skipped.846machine # [ 6.678763] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore847machine # [ 6.680899] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67848machine # [ 6.685699] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore849machine # [ 6.687343] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os850machine # [ 6.688780] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os851machine # [ 6.857759] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console852machine # [ 6.870836] Console: switching to colour dummy device 80x25853machine # [ 6.871895] [drm] Found bochs VGA, ID 0xb0c5.854machine # [ 6.871897] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.855machine # [ 6.874701] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3856machine # [ 6.876147] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized857machine # [ 6.878179] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic858machine # [ 6.879527] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0859machine # [ 6.883196] ACPI: button: Power Button [PWRF]860machine # [ 6.888959] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4861machine # [ 6.902227] Console: switching to colour frame buffer device 160x50862machine # [ 6.904126] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device863machine # [ 6.925016] mousedev: PS/2 mouse device common for all mice864machine # [ 6.931247] rtc_cmos PNP0B00:00: RTC can wake from S4865machine # [ 6.938591] rtc_cmos PNP0B00:00: registered as rtc0866machine # [ 6.939235] rtc_cmos PNP0B00:00: setting system clock to 2026-09-30T09:10:47 UTC (1790759447)867machine # [ 6.940554] systemd-journald[333]: Time jumped backwards, rotating.868machine # [ 6.942392] parport_pc 00:02: reported by Plug and Play ACPI869machine # [ 6.942519] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs870machine # [ 6.944106] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]871machine # [ 6.954796] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt872machine # [ 6.955604] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD873machine # [ 6.965869] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6874machine # [ 6.975639] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5875machine # [ 6.849405] systemd[1]: Starting Virtual Console Setup...876machine # [ 6.873722] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.877machine # [ 6.874982] systemd[1]: Stopped Virtual Console Setup.878machine # [ 6.878904] systemd[1]: Starting Virtual Console Setup...879machine # [ 7.045677] ppdev: user-space parallel port driver880machine # [ 7.058306] iTCO_wdt iTCO_wdt.0.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660)881machine # [ 7.059717] iTCO_wdt iTCO_wdt.0.auto: initialized. heartbeat=30 sec (nowayout=0)882machine # [ 7.074502] kvm_amd: TSC scaling supported883machine # [ 7.075008] kvm_amd: Nested Virtualization enabled884machine # [ 7.075622] kvm_amd: Nested Paging enabled885machine # [ 7.076088] kvm_amd: LBR virtualization supported886machine # [ 7.076620] kvm_amd: Virtual VMLOAD VMSAVE supported887machine # [ 7.077175] kvm_amd: Virtual GIF supported888machine # [ 7.077686] kvm_amd: Virtual NMI enabled889machine # [ 7.140658] EDAC MC: Ver: 3.0.0890machine # [ 7.029697] systemd-vconsole-setup[407]: Configuration of first virtual console was skipped, ignoring remaining ones.891machine # [ 7.033181] systemd[1]: Finished Virtual Console Setup.892machine # [ 7.166948] systemd[1]: Mounting /run/wrappers...893machine # [ 7.209291] systemd[1]: Mounted /run/wrappers.894machine # [ 7.211105] systemd[1]: Reached target Local File Systems.895machine # [ 7.214728] systemd[1]: Listening on Boot Loader Control Service Socket.896machine # [ 7.217776] systemd[1]: Starting register-nix-paths.service...897machine # [ 7.220394] systemd[1]: Starting Create SUID/SGID Wrappers...898machine # [ 7.222325] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.899machine # [ 7.226804] systemd[1]: Starting Save Transient machine-id to Disk...900machine # [ 7.230653] systemd[1]: Starting Create System Files and Directories...901machine # [ 7.335188] systemd[1]: Finished Create System Files and Directories.902machine # [ 7.338915] systemd[1]: Starting Rebuild Journal Catalog...903machine # [ 7.341398] systemd[1]: Starting Record System Boot/Shutdown in UTMP...904machine # [ 7.367501] systemd[1]: Finished Record System Boot/Shutdown in UTMP.905machine # [ 7.379717] systemd[1]: Finished Rebuild Journal Catalog.906machine # [ 7.384332] systemd[1]: Starting Update is Completed...907machine # [ 7.395916] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.908machine # [ 7.397966] systemd[1]: Finished Save Transient machine-id to Disk.909machine # [ 7.410521] systemd[1]: Finished Update is Completed.910machine # [ 7.510728] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.911machine # [ 7.511968] systemd[1]: Finished Create SUID/SGID Wrappers.912machine # [ 7.767499] systemd[1]: Finished register-nix-paths.service.913machine # [ 7.768984] systemd[1]: Reached target System Initialization.914machine # [ 7.770383] systemd[1]: Started Discard unused filesystem blocks once a week.915machine # [ 7.771887] systemd[1]: Started niks3 garbage collection timer.916machine # [ 7.773275] systemd[1]: Started Daily Cleanup of Temporary Directories.917machine # [ 7.774714] systemd[1]: Reached target Timer Units.918machine # [ 7.775915] systemd[1]: Listening on D-Bus System Message Bus Socket.919machine # [ 7.781895] systemd[1]: Listening on niks3 server socket.920machine # [ 7.783293] systemd[1]: Listening on Nix Daemon Socket.921machine # [ 7.784607] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.922machine # [ 7.786371] systemd[1]: Reached target Socket Units.923machine # [ 7.787703] systemd[1]: Reached target Basic System.924machine # [ 7.788921] systemd[1]: Started backdoor.service.925machine # [ 7.791426] systemd[1]: Starting Import lastlog data into lastlog2 database...926machine # [ 7.795149] systemd[1]: Starting Name Service Cache Daemon (nsncd)...927machine # [ 7.801562] systemd[1]: Starting Post-Boot Actions...928machine # [ 7.804849] systemd[1]: Started Reset console on configuration changes.929machine # [ 7.806388] systemd[1]: Starting resolvconf update...930machine # [ 7.809878] systemd[1]: Started rustfs.service.931machine # [ 7.815294] systemd[1]: Starting rustfs-bucket.service...932machine # [ 7.825073] systemd[1]: Starting D-Bus System Message Bus...933machine # [ 7.848946] systemd[1]: Finished Post-Boot Actions.934machine # connecting to host...935machine # [ 7.858227] systemd[1]: Started Name Service Cache Daemon (nsncd).936machine # [ 7.859749] nsncd[491]: Sep 30 09:10:48.572 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"937machine # [ 7.860411] systemd[1]: Reached target Host and Network Name Lookups.938machine # [ 7.861109] systemd[1]: Reached target User and Group Name Lookups.939machine # [ 7.861739] systemd[1]: Starting User Login Management...940machine # [ 7.882938] systemd[1]: Finished Import lastlog data into lastlog2 database.941machine: Guest shell says: b'Spawning backdoor root shell...\n'942machine: connected to guest root shell943machine: (connecting took 8.53 seconds)944machine: (finished: waiting for the VM to finish booting, in 8.87 seconds)945machine # [ 7.902473] dbus-broker-launch[498]: Looking up NSS user entry for 'systemd-timesync'...946machine # [ 7.909484] dbus-broker-launch[498]: NSS returned no entry for 'systemd-timesync'947machine # [ 7.910564] dbus-broker-launch[498]: Invalid user-name in /nix/store/g7pg57y182bsrh126xs4av309lnxhndq-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"948machine # [ 7.924462] systemd-logind[522]: New seat seat0.949machine # [ 7.928935] systemd[1]: Started D-Bus System Message Bus.950machine # [ 7.929608] systemd-logind[522]: Watching system buttons on /dev/input/event2 (Power Button)951machine # [ 7.930291] systemd-logind[522]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)952machine # [ 7.932755] systemd-logind[522]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)953machine # [ 7.934987] systemd[1]: Started User Login Management.954machine # [ 7.936672] systemd[1]: Starting linger-users.service...955machine # [ 7.945040] dbus-broker-launch[498]: Ready956machine # [ 7.958201] systemd[1]: Stopped target Host and Network Name Lookups.957machine # [ 7.959141] systemd[1]: Stopping Host and Network Name Lookups...958machine # [ 7.959630] systemd[1]: Stopped target User and Group Name Lookups.959machine # [ 7.960651] systemd[1]: Stopping User and Group Name Lookups...960machine # [ 7.961348] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...961machine # [ 7.964457] systemd[1]: nscd.service: Deactivated successfully.962machine # [ 7.965769] systemd[1]: Stopped Name Service Cache Daemon (nsncd).963machine # [ 7.970214] systemd[1]: Starting Name Service Cache Daemon (nsncd)...964machine # [ 7.970732] systemd[1]: linger-users.service: Deactivated successfully.965machine # [ 7.971237] systemd[1]: Finished linger-users.service.966machine # [ 7.998296] nsncd[595]: Sep 30 09:10:48.713 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"967machine # [ 7.999084] systemd[1]: Started Name Service Cache Daemon (nsncd).968machine # [ 7.999595] systemd[1]: Reached target Host and Network Name Lookups.969machine # [ 8.000118] systemd[1]: Reached target User and Group Name Lookups.970machine # [ 8.013184] systemd[1]: Finished resolvconf update.971machine # [ 8.014048] systemd[1]: Reached target Preparation for Network.972machine # [ 8.015832] systemd[1]: Starting DHCP Client...973machine # [ 8.017142] systemd[1]: Starting Address configuration of eth1...974machine # [ 8.018658] systemd[1]: Starting Extra networking commands....975machine # [ 8.076171] network-addresses-eth1-start[625]: adding address 192.168.1.1/24... done976machine # [ 8.090488] network-addresses-eth1-start[625]: adding address 2001:db8:1::1/64... done977machine # [ 8.101733] dhcpcd[634]: dhcpcd-10.3.2 starting978machine # [ 8.103183] systemd[1]: Finished Address configuration of eth1.979machine # [ 8.107773] dhcpcd[673]: dev: loaded udev980machine # [ 8.278864] 8021q: 802.1Q VLAN Support v1.8981machine # [ 8.279675] 8021q: adding VLAN 0 to HW filter on device eth1982machine # [ 8.139895] systemd[1]: Finished Extra networking commands..983machine # [ 8.141070] systemd[1]: Reached target Network.984machine # [ 8.141780] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.985machine # [ 8.144441] systemd[1]: Starting PostgreSQL Server...986machine # [ 8.146868] systemd[1]: Starting Permit User Sessions...987machine # [ 8.173957] systemd[1]: Finished Permit User Sessions.988machine # [ 8.175744] systemd[1]: Started Getty on tty1.989machine # [ 8.177449] systemd[1]: Reached target Login Prompts.990machine # [ 8.380208] cfg80211: Loading compiled-in X.509 certificates for regulatory database991machine # [ 8.397423] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'992machine # [ 8.398629] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'993machine # [ 8.401072] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2994machine # [ 8.402300] cfg80211: failed to load regulatory.db995machine # [ 8.260626] postgresql-pre-start[711]: The files belonging to this database system will be owned by user "postgres".996machine # [ 8.261567] postgresql-pre-start[711]: This user must also own the server process.997machine # [ 8.265937] postgresql-pre-start[711]: The database cluster will be initialized with locale "en_US.UTF-8".998machine # [ 8.266599] postgresql-pre-start[711]: The default database encoding has accordingly been set to "UTF8".999machine # [ 8.267114] postgresql-pre-start[711]: The default text search configuration will be set to "english".1000machine # [ 8.267575] postgresql-pre-start[711]: Data page checksums are enabled.1001machine # [ 8.268153] postgresql-pre-start[711]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok1002machine # [ 8.271950] postgresql-pre-start[711]: creating subdirectories ... ok1003machine # [ 8.272597] postgresql-pre-start[711]: selecting dynamic shared memory implementation ... posix1004machine # [ 8.448580] 8021q: adding VLAN 0 to HW filter on device eth01005machine # [ 8.294974] dhcpcd[673]: eth0: waiting for carrier1006machine # [ 8.296085] dhcpcd[673]: eth0: carrier acquired1007machine # [ 8.306625] dhcpcd[673]: DUID 00:01:00:01:32:4f:8e:99:52:54:00:12:34:561008machine # [ 8.307904] dhcpcd[673]: eth0: IAID 00:12:34:561009machine # [ 8.308571] dhcpcd[673]: eth0: adding address fe80::5054:ff:fe12:34561010machine # [ 8.337482] postgresql-pre-start[711]: selecting default "max_connections" ... 1001011machine # [ 8.389621] postgresql-pre-start[711]: selecting default "shared_buffers" ... 128MB1012machine # [ 9.097339] postgresql-pre-start[711]: selecting default time zone ... UTC1013machine # [ 9.099804] postgresql-pre-start[711]: creating configuration files ... ok1014machine # [ 9.265880] postgresql-pre-start[711]: running bootstrap script ... ok1015machine # [ 9.508139] dhcpcd[673]: eth0: soliciting a DHCP lease1016machine # [ 9.682967] NET: Registered PF_PACKET protocol family1017machine # [ 9.543400] dhcpcd[673]: eth0: offered 10.0.2.15 from 10.0.2.21018machine # [ 9.549346] dhcpcd[673]: eth0: probing address 10.0.2.15/241019machine # [ 9.676726] postgresql-pre-start[711]: performing post-bootstrap initialization ... ok1020machine # [ 9.880650] postgresql-pre-start[711]: syncing data to disk ... ok1021machine # [ 9.882122] postgresql-pre-start[711]: initdb: warning: enabling "trust" authentication for local connections1022machine # [ 9.883850] postgresql-pre-start[711]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1023machine # [ 9.884629] postgresql-pre-start[711]: Success. You can now start the database server using:1024machine # [ 9.885446] postgresql-pre-start[711]: pg_ctl -D /var/lib/postgresql/18 -l logfile start1025machine # [ 9.993938] postgres[748]: [748] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1026machine # [ 9.997611] postgres[748]: [748] LOG: listening on IPv6 address "::1", port 54321027machine # [ 9.998725] postgres[748]: [748] LOG: listening on IPv4 address "127.0.0.1", port 54321028machine # [ 10.003407] postgres[748]: [748] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1029machine # [ 10.015441] postgres[757]: [757] LOG: database system was shut down at 2026-09-30 09:10:50 GMT1030machine # [ 10.023289] postgres[748]: [748] LOG: database system is ready to accept connections1031machine # [ 10.028700] systemd[1]: Started PostgreSQL Server.1032machine # [ 10.031550] systemd[1]: Starting PostgreSQL Setup Scripts...1033machine # [ 10.196521] dhcpcd[673]: eth0: soliciting an IPv6 router1034machine # [ 10.197630] dhcpcd[673]: eth0: Router Advertisement from fe80::21035machine # [ 10.198667] dhcpcd[673]: eth0: adding address fec0::5054:ff:fe12:3456/641036machine # [ 10.199948] dhcpcd[673]: eth0: adding route to fec0::/641037machine # [ 10.201122] dhcpcd[673]: eth0: adding default route via fe80::21038machine # [ 10.262967] postgresql-setup-start[777]: CREATE DATABASE1039machine # [ 10.314266] postgresql-setup-start[782]: CREATE ROLE1040machine # [ 10.339381] postgresql-setup-start[784]: ALTER DATABASE1041machine # [ 10.346841] systemd[1]: Finished PostgreSQL Setup Scripts.1042machine # [ 10.348939] systemd[1]: Reached target PostgreSQL.1043machine # [ 15.407703] dhcpcd[673]: eth0: leased 10.0.2.15 for 86400 seconds1044machine # [ 15.409390] dhcpcd[673]: eth0: adding route to 10.0.2.0/241045machine # [ 15.411060] dhcpcd[673]: eth0: adding default route via 10.0.2.21046machine # [ 15.516350] systemd[1]: Started DHCP Client.1047machine # [ 15.518184] systemd[1]: Reached target Network is Online.1048machine # [ 15.520284] systemd[1]: Starting k3s service...1049machine # [ 15.596899] k3s[893]: time="2026-09-30T09:10:56Z" level=info msg="Acquiring lock file /var/lib/rancher/k3s/data/.lock"1050machine # [ 15.600701] k3s[893]: time="2026-09-30T09:10:56Z" level=info msg="Preparing data dir /var/lib/rancher/k3s/data/53c81a1072dac7aebc0a3715f02f26b7ba95e9416f42c7f7aeed55ccb68af709"1051machine # [ 16.542345] rustfs-bucket-start[899]: mb s3://farm1052machine # [ 16.545753] systemd[1]: Finished rustfs-bucket.service.1053machine # [ 17.521760] k3s[893]: time="2026-09-30T09:10:58Z" level=info msg="Starting k3s 1.36.4+k3s1 (4dedb15b)"1054machine # [ 17.537350] k3s[893]: time="2026-09-30T09:10:58Z" level=info msg="Configuring sqlite3 database connection pooling: maxIdle=20, maxOpen=0, maxLifetime=0s, maxIdleTime=2m0s"1055machine # [ 17.542318] k3s[893]: time="2026-09-30T09:10:58Z" level=info msg="Kine built with sqlite from github.com/mattn/go-sqlite3 version 3.53.3"1056machine # [ 17.545752] k3s[893]: time="2026-09-30T09:10:58Z" level=info msg="Configuring database table schema and indexes, this may take a moment..."1057machine # [ 17.549746] k3s[893]: time="2026-09-30T09:10:58Z" level=info msg="Database tables and indexes are up to date"1058machine # [ 17.552365] k3s[893]: time="2026-09-30T09:10:58Z" level=info msg="Running startup VACUUM to reclaim disk space, this may take a moment..."1059machine # [ 17.555483] k3s[893]: time="2026-09-30T09:10:58Z" level=info msg="Startup VACUUM completed successfully"1060machine # [ 17.557821] k3s[893]: time="2026-09-30T09:10:58Z" level=info msg="Kine available at unix://kine.sock"1061machine # [ 17.560128] k3s[893]: time="2026-09-30T09:10:58Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]"1062machine # [ 17.562974] k3s[893]: time="2026-09-30T09:10:58Z" level=info msg="Datastore connection validated successfully, proceeding with bootstrap data generation"1063machine # [ 17.565270] k3s[893]: time="2026-09-30T09:10:58Z" level=info msg="generated self-signed CA certificate CN=k3s-client-ca@1790759458: notBefore=2026-09-30 08:10:58.274782827 +0000 UTC notAfter=2036-09-27 08:10:58.274782827 +0000 UTC"1064machine # [ 17.567696] k3s[893]: time="2026-09-30T09:10:58Z" level=info msg="certificate CN=system:admin,O=system:masters signed by CN=k3s-client-ca@1790759458: notBefore=2026-09-30 08:10:58 +0000 UTC notAfter=2027-09-30 08:10:58 +0000 UTC"1065machine # [ 17.570065] k3s[893]: time="2026-09-30T09:10:58Z" level=info msg="certificate CN=system:k3s-supervisor,O=system:masters signed by CN=k3s-client-ca@1790759458: notBefore=2026-09-30 08:10:58 +0000 UTC notAfter=2027-09-30 08:10:58 +0000 UTC"1066machine # [ 17.572508] k3s[893]: time="2026-09-30T09:10:58Z" level=info msg="certificate CN=system:kube-controller-manager signed by CN=k3s-client-ca@1790759458: notBefore=2026-09-30 08:10:58 +0000 UTC notAfter=2027-09-30 08:10:58 +0000 UTC"1067machine # [ 17.574943] k3s[893]: time="2026-09-30T09:10:58Z" level=info msg="certificate CN=system:kube-scheduler signed by CN=k3s-client-ca@1790759458: notBefore=2026-09-30 08:10:58 +0000 UTC notAfter=2027-09-30 08:10:58 +0000 UTC"1068machine # [ 17.577243] k3s[893]: time="2026-09-30T09:10:58Z" level=info msg="certificate CN=system:apiserver,O=system:masters signed by CN=k3s-client-ca@1790759458: notBefore=2026-09-30 08:10:58 +0000 UTC notAfter=2027-09-30 08:10:58 +0000 UTC"1069machine # [ 17.579757] k3s[893]: time="2026-09-30T09:10:58Z" level=info msg="certificate CN=k3s-cloud-controller-manager signed by CN=k3s-client-ca@1790759458: notBefore=2026-09-30 08:10:58 +0000 UTC notAfter=2027-09-30 08:10:58 +0000 UTC"1070machine # [ 17.582198] k3s[893]: time="2026-09-30T09:10:58Z" level=info msg="generated self-signed CA certificate CN=k3s-server-ca@1790759458: notBefore=2026-09-30 08:10:58.279221659 +0000 UTC notAfter=2036-09-27 08:10:58.279221659 +0000 UTC"1071machine # [ 17.584630] k3s[893]: time="2026-09-30T09:10:58Z" level=info msg="certificate CN=kube-apiserver signed by CN=k3s-server-ca@1790759458: notBefore=2026-09-30 08:10:58 +0000 UTC notAfter=2027-09-30 08:10:58 +0000 UTC"1072machine # [ 17.587042] k3s[893]: time="2026-09-30T09:10:58Z" level=info msg="certificate CN=kube-scheduler signed by CN=k3s-server-ca@1790759458: notBefore=2026-09-30 08:10:58 +0000 UTC notAfter=2027-09-30 08:10:58 +0000 UTC"1073machine # [ 17.589342] k3s[893]: time="2026-09-30T09:10:58Z" level=info msg="certificate CN=kube-controller-manager signed by CN=k3s-server-ca@1790759458: notBefore=2026-09-30 08:10:58 +0000 UTC notAfter=2027-09-30 08:10:58 +0000 UTC"1074machine # [ 17.591952] k3s[893]: time="2026-09-30T09:10:58Z" level=info msg="generated self-signed CA certificate CN=k3s-request-header-ca@1790759458: notBefore=2026-09-30 08:10:58.280993951 +0000 UTC notAfter=2036-09-27 08:10:58.280993951 +0000 UTC"1075machine # [ 17.594948] k3s[893]: time="2026-09-30T09:10:58Z" level=info msg="certificate CN=system:auth-proxy signed by CN=k3s-request-header-ca@1790759458: notBefore=2026-09-30 08:10:58 +0000 UTC notAfter=2027-09-30 08:10:58 +0000 UTC"1076machine # [ 17.597442] k3s[893]: time="2026-09-30T09:10:58Z" level=info msg="generated self-signed CA certificate CN=etcd-server-ca@1790759458: notBefore=2026-09-30 08:10:58.281965304 +0000 UTC notAfter=2036-09-27 08:10:58.281965304 +0000 UTC"1077machine # [ 17.599961] k3s[893]: time="2026-09-30T09:10:58Z" level=info msg="certificate CN=etcd-client signed by CN=etcd-server-ca@1790759458: notBefore=2026-09-30 08:10:58 +0000 UTC notAfter=2027-09-30 08:10:58 +0000 UTC"1078machine # [ 17.602380] k3s[893]: time="2026-09-30T09:10:58Z" level=info msg="generated self-signed CA certificate CN=etcd-peer-ca@1790759458: notBefore=2026-09-30 08:10:58.282740821 +0000 UTC notAfter=2036-09-27 08:10:58.282740821 +0000 UTC"1079machine # [ 17.604926] k3s[893]: time="2026-09-30T09:10:58Z" level=info msg="certificate CN=etcd-peer signed by CN=etcd-peer-ca@1790759458: notBefore=2026-09-30 08:10:58 +0000 UTC notAfter=2027-09-30 08:10:58 +0000 UTC"1080machine # [ 17.607182] k3s[893]: time="2026-09-30T09:10:58Z" level=info msg="certificate CN=etcd-server signed by CN=etcd-server-ca@1790759458: notBefore=2026-09-30 08:10:58 +0000 UTC notAfter=2027-09-30 08:10:58 +0000 UTC"1081machine # [ 17.609493] k3s[893]: time="2026-09-30T09:10:58Z" level=info msg="certificate CN=k3s,O=k3s signed by CN=k3s-server-ca@1790759458: notBefore=2026-09-30 08:10:58 +0000 UTC notAfter=2027-09-30 08:10:58 +0000 UTC"1082machine # [ 17.611915] k3s[893]: time="2026-09-30T09:10:58Z" level=warning msg="dynamiclistener [::]:6443: no cached certificate available for preload - deferring certificate load until storage initialization or first client request"1083machine # [ 17.614355] k3s[893]: time="2026-09-30T09:10:58Z" level=info msg="Active TLS secret / (ver=) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__d1f1_69b2_979a_597a-30e64e:fec0::d1f1:69b2:979a:597a listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=9120D27B787AB1207F3FB551E0538CA7BF670374]"1084machine # [ 18.549303] k3s[893]: time="2026-09-30T09:10:59Z" level=info msg="Password verified locally for node machine"1085machine # [ 18.550839] k3s[893]: time="2026-09-30T09:10:59Z" level=info msg="certificate CN=machine signed by CN=k3s-server-ca@1790759458: notBefore=2026-09-30 08:10:59 +0000 UTC notAfter=2027-09-30 08:10:59 +0000 UTC"1086machine # [ 18.820312] k3s[893]: time="2026-09-30T09:10:59Z" level=info msg="certificate CN=system:node:machine,O=system:nodes signed by CN=k3s-client-ca@1790759458: notBefore=2026-09-30 08:10:59 +0000 UTC notAfter=2027-09-30 08:10:59 +0000 UTC"1087machine # [ 18.921953] k3s[893]: time="2026-09-30T09:10:59Z" level=info msg="certificate CN=system:kube-proxy signed by CN=k3s-client-ca@1790759458: notBefore=2026-09-30 08:10:59 +0000 UTC notAfter=2027-09-30 08:10:59 +0000 UTC"1088machine # [ 19.031093] k3s[893]: time="2026-09-30T09:10:59Z" level=info msg="certificate CN=system:k3s-controller signed by CN=k3s-client-ca@1790759458: notBefore=2026-09-30 08:10:59 +0000 UTC notAfter=2027-09-30 08:10:59 +0000 UTC"1089machine # [ 19.117979] k3s[893]: time="2026-09-30T09:10:59Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:58358: runtime core not ready"1090machine # [ 19.222048] k3s[893]: time="2026-09-30T09:10:59Z" level=info msg="Module overlay was already loaded"1091machine # [ 19.453326] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this.1092machine # [ 19.457898] Bridge firewalling registered1093machine # [ 19.316252] k3s[893]: time="2026-09-30T09:11:00Z" level=warning msg="Failed to load kernel module iptable_nat with modprobe"1094machine # [ 19.324842] k3s[893]: time="2026-09-30T09:11:00Z" level=warning msg="Failed to load kernel module iptable_filter with modprobe"1095machine # [ 19.334666] k3s[893]: time="2026-09-30T09:11:00Z" level=warning msg="Failed to load kernel module nft-expr-counter with modprobe"1096machine # [ 19.408589] k3s[893]: time="2026-09-30T09:11:00Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_max' to 131072"1097machine # [ 19.410205] k3s[893]: time="2026-09-30T09:11:00Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400"1098machine # [ 19.411784] k3s[893]: time="2026-09-30T09:11:00Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600"1099machine # [ 19.413404] k3s[893]: time="2026-09-30T09:11:00Z" level=info msg="Set sysctl 'net/ipv4/conf/all/forwarding' to 1"1100machine # [ 19.414815] k3s[893]: time="2026-09-30T09:11:00Z" level=info msg="Connecting to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect"1101machine # [ 19.416335] k3s[893]: time="2026-09-30T09:11:00Z" level=info msg="Creating k3s-cert-monitor event broadcaster"1102machine # [ 19.417669] k3s[893]: time="2026-09-30T09:11:00Z" level=info msg="Saving cluster bootstrap data to datastore"1103machine # [ 19.419174] k3s[893]: time="2026-09-30T09:11:00Z" level=info msg="Handling backend connection request [machine]"1104machine # [ 19.420581] k3s[893]: time="2026-09-30T09:11:00Z" level=info msg="Connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect"1105machine # [ 19.422086] k3s[893]: time="2026-09-30T09:11:00Z" level=info msg="Remotedialer connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect"1106machine # [ 19.423713] k3s[893]: time="2026-09-30T09:11:00Z" level=info msg="Polling for API server readiness: GET /readyz failed: the server is currently unable to handle the request"1107machine # [ 19.425658] k3s[893]: time="2026-09-30T09:11:00Z" level=info msg="Connection to etcd is ready"1108machine # [ 19.426774] k3s[893]: time="2026-09-30T09:11:00Z" level=info msg="ETCD server is now running"1109machine # [ 19.427962] k3s[893]: time="2026-09-30T09:11:00Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]"1110machine # [ 19.429565] k3s[893]: time="2026-09-30T09:11:00Z" level=info msg="Running kube-apiserver --advertise-port=6443 --allow-privileged=true --anonymous-auth=false --api-audiences=https://kubernetes.default.svc.cluster.local,k3s --authorization-mode=Node,RBAC --bind-address=127.0.0.1 --cert-dir=/var/lib/rancher/k3s/server/tls/temporary-certs --client-ca-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --egress-selector-config-file=/var/lib/rancher/k3s/server/etc/egress-selector-config.yaml --enable-admission-plugins=NodeRestriction --enable-aggregator-routing=true --enable-bootstrap-token-auth=true --etcd-servers=unix://kine.sock --kubelet-certificate-authority=/var/lib/rancher/k3s/server/tls/server-ca.crt --kubelet-client-certificate=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.crt --kubelet-client-key=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.key --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --profiling=false --proxy-client-cert-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt --proxy-client-key-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.key --requestheader-allowed-names=system:auth-proxy --requestheader-client-ca-file=/var/lib/rancher/k3s/server/tls/request-header-ca.crt --requestheader-extra-headers-prefix=X-Remote-Extra- --requestheader-group-headers=X-Remote-Group --requestheader-username-headers=X-Remote-User --secure-port=6444 --service-account-issuer=https://kubernetes.default.svc.cluster.local --service-account-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-account-signing-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --storage-backend=etcd3 --tls-cert-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --tls-private-key-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key"1111machine # [ 19.451850] k3s[893]: time="2026-09-30T09:11:00Z" level=info msg="Running kube-scheduler --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --bind-address=127.0.0.1 --kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --leader-elect=false --profiling=false --secure-port=10259 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key"1112machine # [ 19.458404] k3s[893]: time="2026-09-30T09:11:00Z" level=info msg="Running kube-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --bind-address=127.0.0.1 --cluster-cidr=10.42.0.0/16 --cluster-signing-kube-apiserver-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kube-apiserver-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kubelet-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-serving-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-kubelet-serving-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --cluster-signing-legacy-unknown-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-legacy-unknown-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --configure-cloud-routes=false --controllers=*,tokencleaner,-service,-route,-cloud-node-lifecycle --kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --leader-elect=false --profiling=false --root-ca-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --secure-port=10257 --service-account-private-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key --use-service-account-credentials=true"1113machine # [ 19.475510] k3s[893]: time="2026-09-30T09:11:00Z" level=info msg="Running cloud-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --bind-address=127.0.0.1 --cloud-config=/var/lib/rancher/k3s/server/etc/cloud-config.yaml --cloud-provider=k3s --cluster-cidr=10.42.0.0/16 --configure-cloud-routes=false --controllers=*,-route --kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --leader-elect=false --leader-elect-resource-name=k3s-cloud-controller-manager --node-status-update-frequency=1m0s --profiling=false"1114machine # [ 19.482574] k3s[893]: I0930 09:11:00.140859 893 options.go:263] external host was not specified, using 10.0.2.151115machine # [ 19.483922] k3s[893]: time="2026-09-30T09:11:00Z" level=info msg="Server node token is available at /var/lib/rancher/k3s/server/token"1116machine # [ 19.485476] k3s[893]: time="2026-09-30T09:11:00Z" level=info msg="To join server node to cluster: k3s server -s https://10.0.2.15:6443 -t ${SERVER_NODE_TOKEN}"1117machine # [ 19.489073] k3s[893]: time="2026-09-30T09:11:00Z" level=info msg="Agent node token is available at /var/lib/rancher/k3s/server/agent-token"1118machine # [ 19.490651] k3s[893]: time="2026-09-30T09:11:00Z" level=info msg="To join agent node to cluster: k3s agent -s https://10.0.2.15:6443 -t ${AGENT_NODE_TOKEN}"1119machine # [ 19.492314] k3s[893]: time="2026-09-30T09:11:00Z" level=info msg="Wrote kubeconfig /etc/rancher/k3s/k3s.yaml"1120machine # [ 19.493522] k3s[893]: time="2026-09-30T09:11:00Z" level=info msg="Run: k3s kubectl"1121machine # [ 19.494485] k3s[893]: I0930 09:11:00.145017 893 server.go:158] Version: v1.36.4+k3s11122machine # [ 19.495524] k3s[893]: I0930 09:11:00.145100 893 server.go:160] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""1123machine # [ 19.496944] k3s[893]: time="2026-09-30T09:11:00Z" level=info msg="Logging containerd to /var/lib/rancher/k3s/agent/containerd/containerd.log"1124machine # [ 19.498494] k3s[893]: time="2026-09-30T09:11:00Z" level=info msg="Running containerd -c /var/lib/rancher/k3s/agent/etc/containerd/config.toml"1125machine # [ 19.500104] k3s[893]: time="2026-09-30T09:11:00Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:58420: runtime core not ready"1126machine # [ 19.507631] k3s[893]: I0930 09:11:00.223624 893 shared_informer.go:381] "Waiting for caches to sync" controller="node_authorizer"1127machine # [ 19.509170] k3s[893]: E0930 09:11:00.223758 893 options.go:205] The manifest file is empty, ignoring.1128machine # [ 19.528402] k3s[893]: I0930 09:11:00.244390 893 shared_informer.go:402] "Waiting for caches to sync"1129machine # [ 19.529724] k3s[893]: I0930 09:11:00.245670 893 plugins.go:157] Loaded 15 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,PodGroupProtection,RuntimeClass,DefaultIngressClass,PodTopologyLabels,MutatingAdmissionPolicy,MutatingAdmissionWebhook.1130machine # [ 19.534276] k3s[893]: I0930 09:11:00.245693 893 plugins.go:160] Loaded 17 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,PodGroupWorkloadExists,NodeDeclaredFeatureValidator,JobValidation,PodResizeValidator,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota.1131machine # [ 19.534924] k3s[893]: I0930 09:11:00.245967 893 instance.go:240] Using reconciler: lease1132machine # [ 19.535348] k3s[893]: I0930 09:11:00.246171 893 shared_informer.go:402] "Waiting for caches to sync"1133machine # [ 19.535870] k3s[893]: I0930 09:11:00.251832 893 handler.go:304] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager1134machine # [ 19.536468] k3s[893]: W0930 09:11:00.251855 893 genericapiserver.go:798] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources.1135machine # [ 19.540814] k3s[893]: I0930 09:11:00.255335 893 cidrallocator.go:198] starting ServiceCIDR Allocator Controller1136machine # [ 19.575193] k3s[893]: I0930 09:11:00.290863 893 handler.go:304] Adding GroupVersion v1 to ResourceManager1137machine # [ 19.575896] k3s[893]: I0930 09:11:00.291045 893 apis.go:112] API group "internal.apiserver.k8s.io" is not enabled, skipping.1138machine # [ 19.606487] k3s[893]: I0930 09:11:00.322472 893 apis.go:112] API group "storagemigration.k8s.io" is not enabled, skipping.1139machine # [ 19.607788] k3s[893]: time="2026-09-30T09:11:00Z" level=info msg="Running kube-proxy --cluster-cidr=10.42.0.0/16 --conntrack-max-per-core=0 --conntrack-tcp-timeout-close-wait=0s --conntrack-tcp-timeout-established=0s --healthz-bind-address=127.0.0.1 --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubeproxy.kubeconfig --proxy-mode=iptables"1140machine # [ 19.642075] k3s[893]: I0930 09:11:00.357972 893 handler.go:304] Adding GroupVersion authentication.k8s.io v1 to ResourceManager1141machine # [ 19.642766] k3s[893]: W0930 09:11:00.358004 893 genericapiserver.go:798] Skipping API authentication.k8s.io/v1beta1 because it has no resources.1142machine # [ 19.643395] k3s[893]: W0930 09:11:00.358016 893 genericapiserver.go:798] Skipping API authentication.k8s.io/v1alpha1 because it has no resources.1143machine # [ 19.647217] k3s[893]: I0930 09:11:00.363135 893 handler.go:304] Adding GroupVersion authorization.k8s.io v1 to ResourceManager1144machine # [ 19.647878] k3s[893]: W0930 09:11:00.363157 893 genericapiserver.go:798] Skipping API authorization.k8s.io/v1beta1 because it has no resources.1145machine # [ 19.648368] k3s[893]: I0930 09:11:00.364169 893 handler.go:304] Adding GroupVersion autoscaling v2 to ResourceManager1146machine # [ 19.649097] k3s[893]: I0930 09:11:00.365083 893 handler.go:304] Adding GroupVersion autoscaling v1 to ResourceManager1147machine # [ 19.651102] k3s[893]: I0930 09:11:00.366801 893 handler.go:304] Adding GroupVersion batch v1 to ResourceManager1148machine # [ 19.651769] k3s[893]: W0930 09:11:00.366822 893 genericapiserver.go:798] Skipping API batch/v1beta1 because it has no resources.1149machine # [ 19.655044] k3s[893]: I0930 09:11:00.368617 893 handler.go:304] Adding GroupVersion certificates.k8s.io v1 to ResourceManager1150machine # [ 19.655686] k3s[893]: W0930 09:11:00.368648 893 genericapiserver.go:798] Skipping API certificates.k8s.io/v1beta1 because it has no resources.1151machine # [ 19.656175] k3s[893]: W0930 09:11:00.368660 893 genericapiserver.go:798] Skipping API certificates.k8s.io/v1alpha1 because it has no resources.1152machine # [ 19.656722] k3s[893]: I0930 09:11:00.372715 893 handler.go:304] Adding GroupVersion coordination.k8s.io v1 to ResourceManager1153machine # [ 19.657195] k3s[893]: W0930 09:11:00.372735 893 genericapiserver.go:798] Skipping API coordination.k8s.io/v1beta1 because it has no resources.1154machine # [ 19.657701] k3s[893]: W0930 09:11:00.372747 893 genericapiserver.go:798] Skipping API coordination.k8s.io/v1alpha2 because it has no resources.1155machine # [ 19.658238] k3s[893]: I0930 09:11:00.373272 893 handler.go:304] Adding GroupVersion discovery.k8s.io v1 to ResourceManager1156machine # [ 19.658706] k3s[893]: W0930 09:11:00.373288 893 genericapiserver.go:798] Skipping API discovery.k8s.io/v1beta1 because it has no resources.1157machine # [ 19.659254] k3s[893]: I0930 09:11:00.374952 893 handler.go:304] Adding GroupVersion networking.k8s.io v1 to ResourceManager1158machine # [ 19.659738] k3s[893]: W0930 09:11:00.374971 893 genericapiserver.go:798] Skipping API networking.k8s.io/v1beta1 because it has no resources.1159machine # [ 19.660397] k3s[893]: I0930 09:11:00.375337 893 handler.go:304] Adding GroupVersion node.k8s.io v1 to ResourceManager1160machine # [ 19.660921] k3s[893]: W0930 09:11:00.375352 893 genericapiserver.go:798] Skipping API node.k8s.io/v1beta1 because it has no resources.1161machine # [ 19.661643] k3s[893]: W0930 09:11:00.375362 893 genericapiserver.go:798] Skipping API node.k8s.io/v1alpha1 because it has no resources.1162machine # [ 19.662103] k3s[893]: I0930 09:11:00.375858 893 handler.go:304] Adding GroupVersion policy v1 to ResourceManager1163machine # [ 19.662571] k3s[893]: W0930 09:11:00.375874 893 genericapiserver.go:798] Skipping API policy/v1beta1 because it has no resources.1164machine # [ 19.663106] k3s[893]: I0930 09:11:00.376839 893 handler.go:304] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager1165machine # [ 19.663564] k3s[893]: W0930 09:11:00.376857 893 genericapiserver.go:798] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources.1166machine # [ 19.664136] k3s[893]: W0930 09:11:00.376868 893 genericapiserver.go:798] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources.1167machine # [ 19.664660] k3s[893]: I0930 09:11:00.377169 893 handler.go:304] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager1168machine # [ 19.665161] k3s[893]: W0930 09:11:00.377183 893 genericapiserver.go:798] Skipping API scheduling.k8s.io/v1beta1 because it has no resources.1169machine # [ 19.665658] k3s[893]: W0930 09:11:00.377193 893 genericapiserver.go:798] Skipping API scheduling.k8s.io/v1alpha2 because it has no resources.1170machine # [ 19.666150] k3s[893]: I0930 09:11:00.378552 893 handler.go:304] Adding GroupVersion storage.k8s.io v1 to ResourceManager1171machine # [ 19.666618] k3s[893]: W0930 09:11:00.378575 893 genericapiserver.go:798] Skipping API storage.k8s.io/v1beta1 because it has no resources.1172machine # [ 19.667122] k3s[893]: W0930 09:11:00.378586 893 genericapiserver.go:798] Skipping API storage.k8s.io/v1alpha1 because it has no resources.1173machine # [ 19.667652] k3s[893]: I0930 09:11:00.379257 893 handler.go:304] Adding GroupVersion flowcontrol.apiserver.k8s.io v1 to ResourceManager1174machine # [ 19.668132] k3s[893]: W0930 09:11:00.379274 893 genericapiserver.go:798] Skipping API flowcontrol.apiserver.k8s.io/v1beta3 because it has no resources.1175machine # [ 19.668648] k3s[893]: W0930 09:11:00.379285 893 genericapiserver.go:798] Skipping API flowcontrol.apiserver.k8s.io/v1beta2 because it has no resources.1176machine # [ 19.669145] k3s[893]: W0930 09:11:00.379295 893 genericapiserver.go:798] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources.1177machine # [ 19.669665] k3s[893]: I0930 09:11:00.381230 893 handler.go:304] Adding GroupVersion apps v1 to ResourceManager1178machine # [ 19.670195] k3s[893]: W0930 09:11:00.381246 893 genericapiserver.go:798] Skipping API apps/v1beta2 because it has no resources.1179machine # [ 19.670701] k3s[893]: W0930 09:11:00.381257 893 genericapiserver.go:798] Skipping API apps/v1beta1 because it has no resources.1180machine # [ 19.671240] k3s[893]: I0930 09:11:00.382657 893 handler.go:304] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager1181machine # [ 19.671733] k3s[893]: W0930 09:11:00.382673 893 genericapiserver.go:798] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources.1182machine # [ 19.672403] k3s[893]: W0930 09:11:00.382684 893 genericapiserver.go:798] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources.1183machine # [ 19.673154] k3s[893]: I0930 09:11:00.383144 893 handler.go:304] Adding GroupVersion events.k8s.io v1 to ResourceManager1184machine # [ 19.673697] k3s[893]: W0930 09:11:00.383159 893 genericapiserver.go:798] Skipping API events.k8s.io/v1beta1 because it has no resources.1185machine # [ 19.674421] k3s[893]: I0930 09:11:00.384148 893 handler.go:304] Adding GroupVersion resource.k8s.io v1 to ResourceManager1186machine # [ 19.674933] k3s[893]: W0930 09:11:00.384164 893 genericapiserver.go:798] Skipping API resource.k8s.io/v1beta2 because it has no resources.1187machine # [ 19.675554] k3s[893]: W0930 09:11:00.384175 893 genericapiserver.go:798] Skipping API resource.k8s.io/v1beta1 because it has no resources.1188machine # [ 19.676109] k3s[893]: W0930 09:11:00.384185 893 genericapiserver.go:798] Skipping API resource.k8s.io/v1alpha3 because it has no resources.1189machine # [ 19.676533] k3s[893]: I0930 09:11:00.386678 893 handler.go:304] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager1190machine # [ 19.677070] k3s[893]: W0930 09:11:00.386699 893 genericapiserver.go:798] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources.1191machine # [ 20.005245] k3s[893]: I0930 09:11:00.721111 893 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt"1192machine # [ 20.005652] k3s[893]: I0930 09:11:00.721113 893 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt"1193machine # [ 20.006196] k3s[893]: I0930 09:11:00.721479 893 secure_serving.go:214] Serving securely on 127.0.0.1:64441194machine # [ 20.006668] k3s[893]: I0930 09:11:00.721520 893 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key"1195machine # [ 20.007201] k3s[893]: I0930 09:11:00.721743 893 tlsconfig.go:243] "Starting DynamicServingCertificateController"1196machine # [ 20.007686] k3s[893]: I0930 09:11:00.721924 893 system_namespaces_controller.go:66] Starting system namespaces controller1197machine # [ 20.008157] k3s[893]: I0930 09:11:00.721977 893 remote_available_controller.go:434] Starting RemoteAvailability controller1198machine # [ 20.008654] k3s[893]: I0930 09:11:00.721989 893 cache.go:32] Waiting for caches to sync for RemoteAvailability controller1199machine # [ 20.021176] k3s[893]: I0930 09:11:00.734194 893 dynamic_serving_content.go:135] "Starting controller" name="aggregator-proxy-cert::/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt::/var/lib/rancher/k3s/server/tls/client-auth-proxy.key"1200machine # [ 20.022116] k3s[893]: I0930 09:11:00.734296 893 apf_controller.go:377] Starting API Priority and Fairness config controller1201machine # [ 20.022902] k3s[893]: I0930 09:11:00.734348 893 apiservice_controller.go:100] Starting APIServiceRegistrationController1202machine # [ 20.023747] k3s[893]: I0930 09:11:00.734359 893 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller1203machine # [ 20.024408] k3s[893]: I0930 09:11:00.734362 893 controller.go:89] "Starting OpenAPI V3 AggregationController"1204machine # [ 20.025150] k3s[893]: I0930 09:11:00.734670 893 cluster_authentication_trust_controller.go:459] Starting cluster_authentication_trust_controller controller1205machine # [ 20.026167] k3s[893]: I0930 09:11:00.734727 893 storage_readiness_hook.go:70] Storage is ready for all registered resources1206machine # [ 20.027260] k3s[893]: time="2026-09-30T09:11:00Z" level=info msg="Starting apiserver lease garbage collector" logger=k3s1207machine # [ 20.027949] k3s[893]: time="2026-09-30T09:11:00Z" level=info msg="Waiting for caches to sync" logger=k3s1208machine # [ 20.028606] k3s[893]: I0930 09:11:00.735156 893 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt"1209machine # [ 20.029481] k3s[893]: I0930 09:11:00.735349 893 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt"1210machine # [ 20.030276] k3s[893]: time="2026-09-30T09:11:00Z" level=info msg=Starting controller=kubernetes-service-cidr-controller logger=k3s1211machine # [ 20.030945] k3s[893]: time="2026-09-30T09:11:00Z" level=info msg="Waiting for caches to sync" logger=k3s1212machine # [ 20.031616] k3s[893]: I0930 09:11:00.735530 893 controller.go:87] "Starting OpenAPI AggregationController"1213machine # [ 20.035087] k3s[893]: I0930 09:11:00.735626 893 controller.go:113] "Deleting old lease on startup" lease="kube-system/apiserver-ik4pcwfs7qgdl76byc4pomgvia"1214machine # [ 20.035760] k3s[893]: I0930 09:11:00.735886 893 aggregator.go:185] waiting for initial CRD sync...1215machine # [ 20.036389] k3s[893]: I0930 09:11:00.736115 893 local_available_controller.go:156] Starting LocalAvailability controller1216machine # [ 20.036930] k3s[893]: I0930 09:11:00.736130 893 cache.go:32] Waiting for caches to sync for LocalAvailability controller1217machine # [ 20.037590] k3s[893]: I0930 09:11:00.736132 893 customresource_discovery_controller.go:294] Starting DiscoveryController1218machine # [ 20.038175] k3s[893]: time="2026-09-30T09:11:00Z" level=info msg="Starting legacy_token_tracking_controller" logger=k3s1219machine # [ 20.038673] k3s[893]: time="2026-09-30T09:11:00Z" level=info msg="Waiting for caches to sync" logger=k3s1220machine # [ 20.039157] k3s[893]: time="2026-09-30T09:11:00Z" level=info msg="Waiting for caches to sync" logger=k3s1221machine # [ 20.039664] k3s[893]: I0930 09:11:00.736454 893 crdregistration_controller.go:114] Starting crd-autoregister controller1222machine # [ 20.041093] k3s[893]: I0930 09:11:00.736469 893 shared_informer.go:381] "Waiting for caches to sync" controller="crd-autoregister"1223machine # [ 20.041784] k3s[893]: I0930 09:11:00.737408 893 controller.go:142] Starting OpenAPI controller1224machine # [ 20.042414] k3s[893]: I0930 09:11:00.737469 893 controller.go:90] Starting OpenAPI V3 controller1225machine # [ 20.042906] k3s[893]: I0930 09:11:00.737518 893 naming_controller.go:305] Starting NamingConditionController1226machine # [ 20.043518] k3s[893]: I0930 09:11:00.737642 893 nonstructuralschema_controller.go:202] Starting NonStructuralSchemaConditionController1227machine # [ 20.044089] k3s[893]: I0930 09:11:00.737672 893 apiapproval_controller.go:196] Starting KubernetesAPIApprovalPolicyConformantConditionController1228machine # [ 20.044529] k3s[893]: time="2026-09-30T09:11:00Z" level=info msg="Starting CRDFinalizer" logger=k3s1229machine # [ 20.045064] k3s[893]: I0930 09:11:00.748641 893 repairip.go:210] Starting ipallocator-repair-controller1230machine # [ 20.045518] k3s[893]: I0930 09:11:00.748681 893 shared_informer.go:381] "Waiting for caches to sync" controller="ipallocator-repair-controller"1231machine # [ 20.106115] k3s[893]: I0930 09:11:00.822049 893 cache.go:39] Caches are synced for RemoteAvailability controller1232machine # [ 20.107968] k3s[893]: I0930 09:11:00.823914 893 shared_informer.go:388] "Caches are synced" controller="node_authorizer"1233machine # [ 20.119282] k3s[893]: I0930 09:11:00.835237 893 cache.go:39] Caches are synced for APIServiceRegistrationController controller1234machine # [ 20.119983] k3s[893]: I0930 09:11:00.835289 893 apf_controller.go:382] Running API Priority and Fairness config worker1235machine # [ 20.120682] k3s[893]: I0930 09:11:00.835307 893 handler_discovery.go:459] Starting ResourceDiscoveryManager1236machine # [ 20.121179] k3s[893]: I0930 09:11:00.835313 893 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process1237machine # [ 20.121757] k3s[893]: time="2026-09-30T09:11:00Z" level=info msg="Caches are synced" logger=k3s1238machine # [ 20.125955] k3s[893]: time="2026-09-30T09:11:00Z" level=info msg="Caches are synced" logger=k3s1239machine # [ 20.126531] k3s[893]: time="2026-09-30T09:11:00Z" level=info msg="Creating default ServiceCIDR" CIDRs="[10.43.0.0/16]" logger=k3s1240machine # [ 20.127084] k3s[893]: I0930 09:11:00.836282 893 cache.go:39] Caches are synced for LocalAvailability controller1241machine # [ 20.127569] k3s[893]: I0930 09:11:00.836777 893 shared_informer.go:388] "Caches are synced" controller="crd-autoregister"1242machine # [ 20.128130] k3s[893]: I0930 09:11:00.836870 893 aggregator.go:187] initial CRD sync complete...1243machine # [ 20.128643] k3s[893]: I0930 09:11:00.836883 893 autoregister_controller.go:144] Starting autoregister controller1244machine # [ 20.129163] k3s[893]: I0930 09:11:00.836895 893 cache.go:32] Waiting for caches to sync for autoregister controller1245machine # [ 20.129638] k3s[893]: I0930 09:11:00.836907 893 cache.go:39] Caches are synced for autoregister controller1246machine # [ 20.130133] k3s[893]: time="2026-09-30T09:11:00Z" level=info msg="Caches are synced" logger=k3s1247machine # [ 20.130615] k3s[893]: time="2026-09-30T09:11:00Z" level=info msg="Caches are synced" logger=k3s1248machine # [ 20.137645] k3s[893]: I0930 09:11:00.853644 893 shared_informer.go:409] "Caches are synced"1249machine # [ 20.138440] k3s[893]: I0930 09:11:00.853682 893 policy_source.go:248] refreshing policies1250machine # [ 20.138970] k3s[893]: I0930 09:11:00.854005 893 shared_informer.go:409] "Caches are synced"1251machine # [ 20.139630] k3s[893]: I0930 09:11:00.854043 893 policy_source.go:248] refreshing policies1252machine # [ 20.141887] k3s[893]: I0930 09:11:00.853645 893 shared_informer.go:388] "Caches are synced" controller="ipallocator-repair-controller"1253machine # [ 20.152342] k3s[893]: E0930 09:11:00.868340 893 controller.go:201] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms"1254machine # [ 20.196779] k3s[893]: E0930 09:11:00.912748 893 controller.go:95] Unable to perform initial Kubernetes service initialization: namespaces "default" not found1255machine # [ 20.225081] k3s[893]: I0930 09:11:00.940841 893 cidrallocator.go:302] created ClusterIP allocator for Service CIDR 10.43.0.0/161256machine # [ 20.225594] k3s[893]: time="2026-09-30T09:11:00Z" level=info msg="Setting default ServiceCIDR condition Ready to True" logger=k3s1257machine # [ 20.229051] k3s[893]: I0930 09:11:00.945028 893 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/161258machine # [ 20.359266] k3s[893]: I0930 09:11:01.075013 893 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io1259machine # [ 20.439223] k3s[893]: time="2026-09-30T09:11:01Z" level=info msg="containerd is now running"1260machine # [ 20.452321] k3s[893]: time="2026-09-30T09:11:01Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/ahp8g797d3p1pgw27qf6r9f48360m65s-nix-grpc-farm-client.tar"1261machine # [ 21.025157] k3s[893]: I0930 09:11:01.740750 893 storage_scheduling.go:137] created PriorityClass system-node-critical with value 20000010001262machine # [ 21.028673] k3s[893]: I0930 09:11:01.744682 893 storage_scheduling.go:137] created PriorityClass system-cluster-critical with value 20000000001263machine # [ 21.029467] k3s[893]: I0930 09:11:01.744699 893 storage_scheduling.go:153] all system priority classes are created successfully or already exist.1264machine # [ 21.417868] k3s[893]: time="2026-09-30T09:11:02Z" level=info msg="Polling for API server readiness: GET /readyz failed: unknown"1265machine # [ 22.149736] k3s[893]: I0930 09:11:02.865364 893 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io1266machine # [ 22.189143] k3s[893]: I0930 09:11:02.905102 893 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io1267machine # [ 22.306324] k3s[893]: I0930 09:11:03.022248 893 alloc.go:329] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.43.0.1"}1268machine # [ 22.311130] k3s[893]: W0930 09:11:03.027128 893 lease.go:265] Resetting endpoints for master service "kubernetes" to [10.0.2.15]1269machine # [ 22.312620] k3s[893]: I0930 09:11:03.028607 893 controller.go:667] quota admission added evaluator for: endpoints1270machine # [ 22.317559] k3s[893]: I0930 09:11:03.033537 893 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io1271machine # [ 23.425756] k3s[893]: time="2026-09-30T09:11:04Z" level=info msg="Waiting for untainted node"1272machine # [ 23.427472] k3s[893]: time="2026-09-30T09:11:04Z" level=info msg="Kube API server is now running"1273machine # [ 23.432205] k3s[893]: time="2026-09-30T09:11:04Z" level=info msg="k3s is up and running"1274machine # [ 23.433515] k3s[893]: time="2026-09-30T09:11:04Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Node and Certificate Authority certificates managed by k3s are OK" object=machine reason=CertificateExpirationOK type=Normal1275machine # [ 23.435142] systemd[1]: Started k3s service.1276machine # [ 23.436644] systemd[1]: Starting niks3 server...1277machine # [ 23.444109] k3s[893]: time="2026-09-30T09:11:04Z" level=info msg="Creating k3s-supervisor event broadcaster"1278machine # [ 23.450271] k3s[893]: E0930 09:11:04.166238 893 options.go:205] The manifest file is empty, ignoring.1279machine # [ 23.451563] k3s[893]: I0930 09:11:04.166560 893 controllermanager.go:204] "Starting" version="v1.36.4+k3s1"1280machine # [ 23.452055] k3s[893]: I0930 09:11:04.166577 893 controllermanager.go:206] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""1281machine # [ 23.455062] k3s[893]: I0930 09:11:04.170506 893 secure_serving.go:214] Serving securely on 127.0.0.1:102571282machine # [ 23.455725] k3s[893]: I0930 09:11:04.170528 893 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController1283machine # [ 23.456461] k3s[893]: I0930 09:11:04.170555 893 shared_informer.go:402] "Waiting for caches to sync"1284machine # [ 23.456824] k3s[893]: I0930 09:11:04.170607 893 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"1285machine # [ 23.461323] k3s[893]: I0930 09:11:04.170624 893 shared_informer.go:402] "Waiting for caches to sync"1286machine # [ 23.462026] k3s[893]: I0930 09:11:04.170959 893 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key"1287machine # [ 23.462588] k3s[893]: I0930 09:11:04.170972 893 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"1288machine # [ 23.463167] k3s[893]: I0930 09:11:04.170988 893 shared_informer.go:402] "Waiting for caches to sync"1289machine # [ 23.463692] k3s[893]: I0930 09:11:04.171044 893 tlsconfig.go:243] "Starting DynamicServingCertificateController"1290machine # [ 23.468422] k3s[893]: I0930 09:11:04.184230 893 controllermanager.go:689] "Warning: controller is disabled" controller="bootstrap-signer-controller"1291machine # [ 23.475110] k3s[893]: I0930 09:11:04.191100 893 controller.go:667] quota admission added evaluator for: serviceaccounts1292machine # [ 23.477892] k3s[893]: I0930 09:11:04.193868 893 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" requiredFeatureGates=["ClusterTrustBundle"]1293machine # [ 23.478576] k3s[893]: I0930 09:11:04.193902 893 controllermanager.go:641] "Warning: skipping controller" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller"1294machine # [ 23.490383] k3s[893]: time="2026-09-30T09:11:04Z" level=info msg="Creating embedded CRD addons.k3s.cattle.io"1295machine # [ 23.498513] k3s[893]: time="2026-09-30T09:11:04Z" level=info msg="Creating embedded CRD etcdsnapshotfiles.k3s.cattle.io"1296machine # [ 23.508375] k3s[893]: time="2026-09-30T09:11:04Z" level=info msg="Creating embedded CRD helmchartconfigs.helm.cattle.io"1297machine # [ 23.515086] k3s[893]: time="2026-09-30T09:11:04Z" level=info msg="Creating embedded CRD helmcharts.helm.cattle.io"1298machine # [ 23.554199] k3s[893]: I0930 09:11:04.270048 893 shared_informer.go:402] "Waiting for caches to sync"1299machine # [ 23.555886] k3s[893]: I0930 09:11:04.270635 893 shared_informer.go:409] "Caches are synced"1300machine # [ 23.557184] k3s[893]: I0930 09:11:04.271125 893 shared_informer.go:409] "Caches are synced"1301machine # [ 23.558407] k3s[893]: I0930 09:11:04.271733 893 shared_informer.go:409] "Caches are synced"1302machine # [ 23.574068] k3s[893]: I0930 09:11:04.287887 893 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager1303machine # [ 23.589977] k3s[893]: time="2026-09-30T09:11:04Z" level=info msg="Waiting for CRD etcdsnapshotfiles.k3s.cattle.io to become available"1304machine # [ 23.600426] k3s[893]: I0930 09:11:04.316418 893 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager1305machine # [ 23.603850] k3s[893]: time="2026-09-30T09:11:04Z" level=info msg="Done waiting for CRD etcdsnapshotfiles.k3s.cattle.io to become available"1306machine # [ 23.605515] k3s[893]: time="2026-09-30T09:11:04Z" level=info msg="Waiting for CRD helmchartconfigs.helm.cattle.io to become available"1307machine # [ 23.607136] k3s[893]: time="2026-09-30T09:11:04Z" level=info msg="Done waiting for CRD helmchartconfigs.helm.cattle.io to become available"1308machine # [ 23.608828] k3s[893]: time="2026-09-30T09:11:04Z" level=info msg="Waiting for CRD helmcharts.helm.cattle.io to become available"1309machine # [ 23.610409] k3s[893]: I0930 09:11:04.324301 893 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager1310machine # [ 23.622073] k3s[893]: I0930 09:11:04.338050 893 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager1311machine # [ 23.636738] k3s[893]: I0930 09:11:04.352713 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="ingresses.networking.k8s.io"1312machine # [ 23.640515] k3s[893]: I0930 09:11:04.352790 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="podtemplates"1313machine # [ 23.641146] k3s[893]: I0930 09:11:04.352825 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="cronjobs.batch"1314machine # [ 23.641678] k3s[893]: I0930 09:11:04.352863 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmcharts.helm.cattle.io"1315machine # [ 23.642201] k3s[893]: I0930 09:11:04.352912 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpoints"1316machine # [ 23.642755] k3s[893]: I0930 09:11:04.352939 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="networkpolicies.networking.k8s.io"1317machine # [ 23.643416] k3s[893]: I0930 09:11:04.352964 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="roles.rbac.authorization.k8s.io"1318machine # [ 23.643924] k3s[893]: I0930 09:11:04.353021 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="statefulsets.apps"1319machine # [ 23.644574] k3s[893]: I0930 09:11:04.353047 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="replicasets.apps"1320machine # [ 23.645141] k3s[893]: I0930 09:11:04.353094 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="rolebindings.rbac.authorization.k8s.io"1321machine # [ 23.645636] k3s[893]: I0930 09:11:04.353132 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="serviceaccounts"1322machine # [ 23.646165] k3s[893]: I0930 09:11:04.353157 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="jobs.batch"1323machine # [ 23.646689] k3s[893]: I0930 09:11:04.353181 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="resourceclaimtemplates.resource.k8s.io"1324machine # [ 23.647223] k3s[893]: I0930 09:11:04.353208 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="poddisruptionbudgets.policy"1325machine # [ 23.647771] k3s[893]: I0930 09:11:04.353233 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="csistoragecapacities.storage.k8s.io"1326machine # [ 23.648433] k3s[893]: I0930 09:11:04.353258 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="daemonsets.apps"1327machine # [ 23.648808] k3s[893]: I0930 09:11:04.353282 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="deployments.apps"1328machine # [ 23.649471] k3s[893]: I0930 09:11:04.353310 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="horizontalpodautoscalers.autoscaling"1329machine # [ 23.650061] k3s[893]: I0930 09:11:04.353347 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmchartconfigs.helm.cattle.io"1330machine # [ 23.650544] k3s[893]: I0930 09:11:04.353371 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpointslices.discovery.k8s.io"1331machine # [ 23.651131] k3s[893]: I0930 09:11:04.353399 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="addons.k3s.cattle.io"1332machine # [ 23.651653] k3s[893]: I0930 09:11:04.353431 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="limitranges"1333machine # [ 23.652148] k3s[893]: I0930 09:11:04.353471 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="controllerrevisions.apps"1334machine # [ 23.652698] k3s[893]: I0930 09:11:04.353500 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="leases.coordination.k8s.io"1335machine # [ 23.654473] k3s[893]: I0930 09:11:04.370453 893 shared_informer.go:409] "Caches are synced"1336machine # [ 23.668475] k3s[893]: I0930 09:11:04.384259 893 controllermanager.go:641] "Warning: skipping controller" controller="storage-version-migrator-controller"1337machine # [ 23.669165] k3s[893]: I0930 09:11:04.384286 893 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="podgroup-protection-controller" requiredFeatureGates=["GenericWorkload"]1338machine # [ 23.669671] k3s[893]: I0930 09:11:04.384301 893 controllermanager.go:641] "Warning: skipping controller" controller="podgroup-protection-controller"1339machine # [ 23.670214] k3s[893]: I0930 09:11:04.384314 893 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="podcertificaterequest-cleaner-controller" requiredFeatureGates=["PodCertificateRequest"]1340machine # [ 23.670775] k3s[893]: I0930 09:11:04.384324 893 controllermanager.go:641] "Warning: skipping controller" controller="podcertificaterequest-cleaner-controller"1341machine # [ 23.672921] k3s[893]: I0930 09:11:04.388905 893 node_lifecycle_controller.go:402] "Controller will reconcile labels" logger="node-lifecycle-controller"1342machine # [ 23.723228] k3s[893]: I0930 09:11:04.439115 893 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="resourcepoolstatusrequest-controller" requiredFeatureGates=["DRAResourcePoolStatus"]1343machine # [ 23.724214] k3s[893]: I0930 09:11:04.439145 893 controllermanager.go:641] "Warning: skipping controller" controller="resourcepoolstatusrequest-controller"1344machine: (finished: waiting for unit k3s.service, in 24.77 seconds)1345machine: waiting for success: kubectl get ns farm1346machine # [ 23.873770] k3s[893]: I0930 09:11:04.589733 893 controllermanager.go:689] "Warning: controller is disabled" controller="selinux-warning-controller"1347machine # Error from server (NotFound): namespaces "farm" not found1348machine # [ 24.117572] k3s[893]: time="2026-09-30T09:11:04Z" level=info msg="Done waiting for CRD helmcharts.helm.cattle.io to become available"1349machine # [ 24.118485] k3s[893]: time="2026-09-30T09:11:04Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-40.1.4+up40.1.0.tgz"1350machine # [ 24.118685] k3s[893]: time="2026-09-30T09:11:04Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-crd-40.1.4+up40.1.0.tgz"1351machine # [ 24.119156] k3s[893]: time="2026-09-30T09:11:04Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/ccm.yaml"1352machine # [ 24.119717] k3s[893]: time="2026-09-30T09:11:04Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/coredns.yaml"1353machine # [ 24.120406] k3s[893]: time="2026-09-30T09:11:04Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/local-storage.yaml"1354machine # [ 24.120921] k3s[893]: time="2026-09-30T09:11:04Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/rolebindings.yaml"1355machine # [ 24.121639] k3s[893]: time="2026-09-30T09:11:04Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/runtimes.yaml"1356machine # [ 24.122184] k3s[893]: time="2026-09-30T09:11:04Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/traefik.yaml"1357machine # [ 24.325978] k3s[893]: time="2026-09-30T09:11:05Z" level=info msg="Starting dynamiclistener CN filter node controller with SANs: [127.0.0.1 ::1 localhost machine 10.0.2.15 fec0::d1f1:69b2:979a:597a 10.43.0.1 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local]"1358machine # [ 24.326754] k3s[893]: time="2026-09-30T09:11:05Z" level=info msg="Tunnel server egress proxy mode: agent"1359machine # [ 24.589270] k3s[893]: time="2026-09-30T09:11:05Z" level=info msg="Creating new TLS secret for kube-system/k3s-serving (count: 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__d1f1_69b2_979a_597a-30e64e:fec0::d1f1:69b2:979a:597a listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=9120D27B787AB1207F3FB551E0538CA7BF670374]"1360machine # [ 24.606429] k3s[893]: time="2026-09-30T09:11:05Z" level=info msg="Active TLS secret kube-system/k3s-serving (ver=237) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__d1f1_69b2_979a_597a-30e64e:fec0::d1f1:69b2:979a:597a listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=9120D27B787AB1207F3FB551E0538CA7BF670374]"1361machine # Error from server (NotFound): namespaces "farm" not found1362machine # [ 25.433513] k3s[893]: time="2026-09-30T09:11:06Z" level=info msg="Starting k3s.cattle.io/v1, Kind=Addon controller"1363machine # [ 25.434121] k3s[893]: time="2026-09-30T09:11:06Z" level=info msg="Creating deploy event broadcaster"1364machine # [ 25.436053] k3s[893]: I0930 09:11:06.152028 893 controller.go:667] quota admission added evaluator for: addons.k3s.cattle.io1365machine # [ 25.437596] k3s[893]: time="2026-09-30T09:11:06Z" level=info msg="Starting /v1, Kind=Node controller"1366machine # [ 25.438627] k3s[893]: time="2026-09-30T09:11:06Z" level=info msg="Creating helm-controller event broadcaster"1367machine # [ 25.444068] k3s[893]: time="2026-09-30T09:11:06Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found"1368machine # [ 25.444746] k3s[893]: time="2026-09-30T09:11:06Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=ApplyingManifest type=Normal1369machine # [ 25.451527] k3s[893]: time="2026-09-30T09:11:06Z" level=info msg="Cluster dns configmap has been set successfully"1370machine # Error from server (NotFound): namespaces "farm" not found1371machine # [ 26.441042] k3s[893]: time="2026-09-30T09:11:07Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found"1372machine # [ 26.560099] k3s[893]: I0930 09:11:07.275188 893 range_allocator.go:113] "No Secondary Service CIDR provided. Skipping filtering out secondary service addresses" logger="node-ipam-controller"1373machine # [ 26.562440] k3s[893]: I0930 09:11:07.275278 893 controllermanager.go:689] "Warning: controller is disabled" controller="service-lb-controller"1374machine # [ 26.564215] k3s[893]: I0930 09:11:07.275295 893 controllermanager.go:689] "Warning: controller is disabled" controller="node-route-controller"1375machine # [ 26.565910] k3s[893]: I0930 09:11:07.275310 893 controllermanager.go:689] "Warning: controller is disabled" controller="cloud-node-lifecycle-controller"1376machine # [ 26.585669] k3s[893]: time="2026-09-30T09:11:07Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=AppliedManifest type=Normal1377machine # [ 26.599328] k3s[893]: time="2026-09-30T09:11:07Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=ApplyingManifest type=Normal1378machine # [ 26.649634] k3s[893]: time="2026-09-30T09:11:07Z" level=info msg="Starting rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding controller"1379machine # [ 26.655056] k3s[893]: time="2026-09-30T09:11:07Z" level=info msg="Starting batch/v1, Kind=Job controller"1380machine # [ 26.656401] k3s[893]: time="2026-09-30T09:11:07Z" level=info msg="Starting /v1, Kind=ConfigMap controller"1381machine # [ 26.657782] k3s[893]: time="2026-09-30T09:11:07Z" level=info msg="Starting /v1, Kind=Secret controller"1382machine # [ 26.659058] k3s[893]: time="2026-09-30T09:11:07Z" level=info msg="Starting /v1, Kind=ServiceAccount controller"1383machine # [ 26.660421] k3s[893]: time="2026-09-30T09:11:07Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChart controller"1384machine # [ 26.661925] k3s[893]: time="2026-09-30T09:11:07Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChartConfig controller"1385machine # [ 26.929458] k3s[893]: time="2026-09-30T09:11:07Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=AppliedManifest type=Normal1386machine # [ 26.944246] k3s[893]: time="2026-09-30T09:11:07Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=ApplyingManifest type=Normal1387machine # [ 27.441615] k3s[893]: time="2026-09-30T09:11:08Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found"1388machine # [ 27.487622] k3s[893]: time="2026-09-30T09:11:08Z" level=info msg="Imported docker.io/library/nix-grpc-farm-client:0.1.0-beta.4"1389machine # [ 27.493527] k3s[893]: time="2026-09-30T09:11:08Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-client@sha256:ffecc52017c49b2f2341bdd3e99e87a8b2fe9a714486a071477b3b4bbef6a8fb"1390machine: (finished: waiting for success: kubectl get ns farm, in 3.70 seconds)1391machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key1392machine # [ 27.628530] k3s[893]: I0930 09:11:08.344448 893 controller.go:667] quota admission added evaluator for: deployments.apps1393machine # [ 27.637460] k3s[893]: I0930 09:11:08.353459 893 serving.go:417] Generated self-signed cert in-memory1394machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key, in 0.17 seconds)1395machine: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key1396machine # [ 27.784577] k3s[893]: I0930 09:11:08.500465 893 serving.go:417] Generated self-signed cert in-memory1397machine: (finished: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key, in 0.14 seconds)1398machine: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt1399machine # [ 27.813748] k3s[893]: I0930 09:11:08.529666 893 alloc.go:329] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.43.0.10"}1400machine # [ 27.816773] k3s[893]: time="2026-09-30T09:11:08Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=AppliedManifest type=Normal1401machine # [ 27.902544] k3s[893]: I0930 09:11:08.618220 893 controllermanager.go:163] Version: v1.36.4+k3s11402machine # [ 27.905476] k3s[893]: I0930 09:11:08.621464 893 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController1403machine # [ 27.906190] k3s[893]: I0930 09:11:08.621481 893 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"1404machine # [ 27.906739] k3s[893]: I0930 09:11:08.621521 893 shared_informer.go:402] "Waiting for caches to sync"1405machine # [ 27.907380] k3s[893]: I0930 09:11:08.621516 893 shared_informer.go:402] "Waiting for caches to sync"1406machine # [ 27.907941] k3s[893]: I0930 09:11:08.621737 893 secure_serving.go:214] Serving securely on 127.0.0.1:102581407machine # [ 27.911640] k3s[893]: I0930 09:11:08.621872 893 tlsconfig.go:243] "Starting DynamicServingCertificateController"1408machine # [ 27.912247] k3s[893]: I0930 09:11:08.621494 893 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"1409machine # [ 27.912717] k3s[893]: I0930 09:11:08.624195 893 shared_informer.go:402] "Waiting for caches to sync"1410machine # [ 27.915327] k3s[893]: time="2026-09-30T09:11:08Z" level=info msg="Creating service-lb-controller event broadcaster"1411machine # [ 27.961605] k3s[893]: time="2026-09-30T09:11:08Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nixos/ahp8g797d3p1pgw27qf6r9f48360m65s-nix-grpc-farm-client.tar in 7.509567276s"1412machine # [ 27.965118] k3s[893]: time="2026-09-30T09:11:08Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/if20jbcicwv9y92klzcxk35m5bcz2ql0-nix-grpc-farm-lb.tar"1413machine: (finished: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.19 seconds)1414subtest: chart deploys and workers become Ready1415machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s1416machine # [ 28.006740] k3s[893]: I0930 09:11:08.722713 893 shared_informer.go:409] "Caches are synced"1417machine # [ 28.007577] k3s[893]: I0930 09:11:08.722891 893 shared_informer.go:409] "Caches are synced"1418machine # [ 28.008959] k3s[893]: I0930 09:11:08.724910 893 shared_informer.go:409] "Caches are synced"1419machine # [ 28.023797] k3s[893]: W0930 09:11:08.738519 893 probe.go:275] Flexvolume plugin directory at /usr/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating.1420machine # [ 28.024449] k3s[893]: I0930 09:11:08.738923 893 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="storageversion-garbage-collector-controller" requiredFeatureGates=["APIServerIdentity","StorageVersionAPI"]1421machine # [ 28.024993] k3s[893]: I0930 09:11:08.738942 893 controllermanager.go:641] "Warning: skipping controller" controller="storageversion-garbage-collector-controller"1422machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found1423machine # [ 28.177081] k3s[893]: I0930 09:11:08.892113 893 deployment_controller.go:180] "Starting controller" controller="deployment"1424machine # [ 28.177859] k3s[893]: I0930 09:11:08.892145 893 shared_informer.go:402] "Waiting for caches to sync"1425machine # [ 28.178513] k3s[893]: I0930 09:11:08.893348 893 cleaner.go:83] "Starting CSR cleaner controller"1426machine # [ 28.178962] k3s[893]: I0930 09:11:08.893425 893 gc_controller.go:98] "Starting GC controller"1427machine # [ 28.179689] k3s[893]: I0930 09:11:08.893439 893 shared_informer.go:402] "Waiting for caches to sync"1428machine # [ 28.180349] k3s[893]: I0930 09:11:08.893438 893 servicecidrs_controller.go:137] "Starting" controller="service-cidr-controller"1429machine # [ 28.180912] k3s[893]: I0930 09:11:08.893461 893 shared_informer.go:402] "Waiting for caches to sync"1430machine # [ 28.181525] k3s[893]: I0930 09:11:08.893474 893 serviceaccounts_controller.go:117] "Starting service account controller"1431machine # [ 28.182082] k3s[893]: I0930 09:11:08.893487 893 shared_informer.go:402] "Waiting for caches to sync"1432machine # [ 28.182639] k3s[893]: I0930 09:11:08.893716 893 replica_set.go:285] "Starting controller" name="replicaset"1433machine # [ 28.183152] k3s[893]: I0930 09:11:08.893730 893 shared_informer.go:402] "Waiting for caches to sync"1434machine # [ 28.183674] k3s[893]: I0930 09:11:08.893770 893 horizontal.go:204] "Starting HPA controller"1435machine # [ 28.184201] k3s[893]: I0930 09:11:08.893784 893 shared_informer.go:402] "Waiting for caches to sync"1436machine # [ 28.184719] k3s[893]: I0930 09:11:08.893848 893 cronjob_controllerv2.go:143] "Starting cronjob controller v2"1437machine # [ 28.185379] k3s[893]: I0930 09:11:08.893860 893 shared_informer.go:402] "Waiting for caches to sync"1438machine # [ 28.185894] k3s[893]: I0930 09:11:08.893907 893 ttl_controller.go:127] "Starting TTL controller"1439machine # [ 28.186527] k3s[893]: I0930 09:11:08.893922 893 shared_informer.go:402] "Waiting for caches to sync"1440machine # [ 28.187093] k3s[893]: I0930 09:11:08.893975 893 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-legacy-unknown"1441machine # [ 28.187601] k3s[893]: I0930 09:11:08.893988 893 shared_informer.go:402] "Waiting for caches to sync"1442machine # [ 28.188092] k3s[893]: I0930 09:11:08.894357 893 node_ipam_controller.go:142] "Starting ipam controller"1443machine # [ 28.188571] k3s[893]: I0930 09:11:08.894374 893 shared_informer.go:402] "Waiting for caches to sync"1444machine # [ 28.189174] k3s[893]: I0930 09:11:08.894416 893 clusterroleaggregation_controller.go:176] "Starting ClusterRoleAggregator controller"1445machine # [ 28.189682] k3s[893]: I0930 09:11:08.894428 893 shared_informer.go:402] "Waiting for caches to sync"1446machine # [ 28.190174] k3s[893]: I0930 09:11:08.894464 893 pvc_protection_controller.go:172] "Starting PVC protection controller"1447machine # [ 28.190711] k3s[893]: I0930 09:11:08.894478 893 shared_informer.go:402] "Waiting for caches to sync"1448machine # [ 28.191379] k3s[893]: I0930 09:11:08.894512 893 pv_protection_controller.go:81] "Starting PV protection controller"1449machine # [ 28.191934] k3s[893]: I0930 09:11:08.894526 893 shared_informer.go:402] "Waiting for caches to sync"1450machine # [ 28.192662] k3s[893]: I0930 09:11:08.894614 893 endpoints_controller.go:193] "Starting endpoint controller"1451machine # [ 28.193103] k3s[893]: I0930 09:11:08.894627 893 shared_informer.go:402] "Waiting for caches to sync"1452machine # [ 28.193563] k3s[893]: I0930 09:11:08.894689 893 endpointslicemirroring_controller.go:226] "Starting EndpointSliceMirroring controller"1453machine # [ 28.194072] k3s[893]: I0930 09:11:08.894701 893 shared_informer.go:402] "Waiting for caches to sync"1454machine # [ 28.194516] k3s[893]: I0930 09:11:08.894760 893 daemon_controller.go:364] "Starting daemon sets controller"1455machine # [ 28.195066] k3s[893]: I0930 09:11:08.894774 893 shared_informer.go:402] "Waiting for caches to sync"1456machine # [ 28.195509] k3s[893]: I0930 09:11:08.894844 893 job_controller.go:336] "Starting job controller"1457machine # [ 28.196060] k3s[893]: I0930 09:11:08.894859 893 shared_informer.go:402] "Waiting for caches to sync"1458machine # [ 28.196506] k3s[893]: I0930 09:11:08.894899 893 expand_controller.go:328] "Starting expand controller"1459machine # [ 28.197050] k3s[893]: I0930 09:11:08.894912 893 shared_informer.go:402] "Waiting for caches to sync"1460machine # [ 28.197550] k3s[893]: I0930 09:11:08.894942 893 vac_protection_controller.go:206] "Starting VAC protection controller"1461machine # [ 28.198101] k3s[893]: I0930 09:11:08.894954 893 shared_informer.go:402] "Waiting for caches to sync"1462machine # [ 28.198636] k3s[893]: I0930 09:11:08.894997 893 controller.go:174] "Starting ephemeral volume controller"1463machine # [ 28.199143] k3s[893]: I0930 09:11:08.895010 893 shared_informer.go:402] "Waiting for caches to sync"1464machine # [ 28.199666] k3s[893]: I0930 09:11:08.895039 893 legacy_serviceaccount_token_cleaner.go:103] "Starting legacy service account token cleaner controller"1465machine # [ 28.200203] k3s[893]: I0930 09:11:08.895052 893 shared_informer.go:402] "Waiting for caches to sync"1466machine # [ 28.200712] k3s[893]: I0930 09:11:08.895100 893 namespace_controller.go:202] "Starting namespace controller"1467machine # [ 28.201375] k3s[893]: I0930 09:11:08.895114 893 shared_informer.go:402] "Waiting for caches to sync"1468machine # [ 28.201911] k3s[893]: I0930 09:11:08.895144 893 disruption.go:453] "Sending events to api server."1469machine # [ 28.202546] k3s[893]: I0930 09:11:08.895172 893 disruption.go:460] "Starting disruption controller"1470machine # [ 28.203105] k3s[893]: I0930 09:11:08.895182 893 shared_informer.go:402] "Waiting for caches to sync"1471machine # [ 28.203558] k3s[893]: I0930 09:11:08.895254 893 stateful_set.go:234] "Starting stateful set controller"1472machine # [ 28.204124] k3s[893]: I0930 09:11:08.895267 893 shared_informer.go:402] "Waiting for caches to sync"1473machine # [ 28.204651] k3s[893]: I0930 09:11:08.895328 893 garbagecollector.go:141] "Starting controller" controller="garbagecollector"1474machine # [ 28.205167] k3s[893]: I0930 09:11:08.895355 893 shared_informer.go:402] "Waiting for caches to sync"1475machine # [ 28.205693] k3s[893]: I0930 09:11:08.895415 893 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-serving"1476machine # [ 28.206221] k3s[893]: I0930 09:11:08.895427 893 shared_informer.go:402] "Waiting for caches to sync"1477machine # [ 28.206745] k3s[893]: I0930 09:11:08.895461 893 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-client"1478machine # [ 28.207387] k3s[893]: I0930 09:11:08.895472 893 shared_informer.go:402] "Waiting for caches to sync"1479machine # [ 28.207933] k3s[893]: I0930 09:11:08.895502 893 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kube-apiserver-client"1480machine # [ 28.208577] k3s[893]: I0930 09:11:08.895515 893 shared_informer.go:402] "Waiting for caches to sync"1481machine # [ 28.209084] k3s[893]: I0930 09:11:08.895547 893 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key"1482machine # [ 28.209547] k3s[893]: I0930 09:11:08.895720 893 graph_builder.go:387] "Running" component="GraphBuilder"1483machine # [ 28.210411] k3s[893]: I0930 09:11:08.895745 893 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key"1484machine # [ 28.250062] k3s[893]: I0930 09:11:08.895803 893 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key"1485machine # [ 28.250630] k3s[893]: I0930 09:11:08.895863 893 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key"1486machine # [ 28.251146] k3s[893]: I0930 09:11:08.898307 893 shared_informer.go:402] "Waiting for caches to sync"1487machine # [ 28.251653] k3s[893]: I0930 09:11:08.898347 893 tokencleaner.go:117] "Starting token cleaner controller"1488machine # [ 28.252177] k3s[893]: I0930 09:11:08.898360 893 shared_informer.go:402] "Waiting for caches to sync"1489machine # [ 28.252696] k3s[893]: I0930 09:11:08.898434 893 controller.go:753] "Starting resource claim controller"1490machine # [ 28.253213] k3s[893]: I0930 09:11:08.898447 893 shared_informer.go:402] "Waiting for caches to sync"1491machine # [ 28.253746] k3s[893]: I0930 09:11:08.898476 893 shared_informer.go:402] "Waiting for caches to sync"1492machine # [ 28.254395] k3s[893]: I0930 09:11:08.898509 893 taint_eviction.go:283] "Starting" controller="taint-eviction-controller"1493machine # [ 28.254950] k3s[893]: I0930 09:11:08.898550 893 taint_eviction.go:288] "Sending events to API server"1494machine # [ 28.255609] k3s[893]: I0930 09:11:08.898559 893 shared_informer.go:402] "Waiting for caches to sync"1495machine # [ 28.256143] k3s[893]: I0930 09:11:08.898622 893 endpointslice_controller.go:280] "Starting endpoint slice controller"1496machine # [ 28.256643] k3s[893]: I0930 09:11:08.898634 893 shared_informer.go:402] "Waiting for caches to sync"1497machine # [ 28.257187] k3s[893]: I0930 09:11:08.898830 893 certificate_controller.go:120] "Starting certificate controller" name="csrapproving"1498machine # [ 28.257674] k3s[893]: I0930 09:11:08.898843 893 shared_informer.go:402] "Waiting for caches to sync"1499machine # [ 28.258221] k3s[893]: I0930 09:11:08.898875 893 ttlafterfinished_controller.go:112] "Starting TTL after finished controller"1500machine # [ 28.258743] k3s[893]: I0930 09:11:08.898887 893 shared_informer.go:402] "Waiting for caches to sync"1501machine # [ 28.259423] k3s[893]: I0930 09:11:08.898921 893 publisher.go:107] "Starting root CA cert publisher controller"1502machine # [ 28.259953] k3s[893]: I0930 09:11:08.898933 893 shared_informer.go:402] "Waiting for caches to sync"1503machine # [ 28.260663] k3s[893]: I0930 09:11:08.898981 893 node_lifecycle_controller.go:436] "Sending events to api server"1504machine # [ 28.261193] k3s[893]: I0930 09:11:08.899012 893 node_lifecycle_controller.go:443] "Starting node controller"1505machine # [ 28.261706] k3s[893]: I0930 09:11:08.899021 893 shared_informer.go:402] "Waiting for caches to sync"1506machine # [ 28.262340] k3s[893]: I0930 09:11:08.899110 893 pv_controller_base.go:318] "Starting persistent volume controller"1507machine # [ 28.262876] k3s[893]: I0930 09:11:08.899147 893 shared_informer.go:402] "Waiting for caches to sync"1508machine # [ 28.266154] k3s[893]: I0930 09:11:08.979399 893 replica_set.go:285] "Starting controller" name="replicationcontroller"1509machine # [ 28.266747] k3s[893]: I0930 09:11:08.979438 893 shared_informer.go:402] "Waiting for caches to sync"1510machine # [ 28.267418] k3s[893]: I0930 09:11:08.979627 893 resource_quota_controller.go:297] "Starting resource quota controller"1511machine # [ 28.267916] k3s[893]: I0930 09:11:08.979642 893 shared_informer.go:402] "Waiting for caches to sync"1512machine # [ 28.268649] k3s[893]: I0930 09:11:08.980229 893 resource_quota_monitor.go:309] "QuotaMonitor running"1513machine # [ 28.269183] k3s[893]: I0930 09:11:08.899177 893 device_taint_eviction.go:783] "Starting" controller="device-taint-eviction-controller" numWorkers=81514machine # [ 28.269768] k3s[893]: I0930 09:11:08.980614 893 attach_detach_controller.go:334] "Starting attach detach controller"1515machine # [ 28.270378] k3s[893]: I0930 09:11:08.980632 893 shared_informer.go:402] "Waiting for caches to sync"1516machine # [ 28.270912] k3s[893]: I0930 09:11:08.981575 893 device_taint_eviction.go:823] "Sending events to api server"1517machine # [ 28.296900] k3s[893]: I0930 09:11:09.012879 893 device_taint_eviction.go:1023] "Waiting" for="cache and event handler sync"1518machine # [ 28.304300] k3s[893]: time="2026-09-30T09:11:09Z" level=info msg="Starting /v1, Kind=Node controller"1519machine # [ 28.316751] k3s[893]: time="2026-09-30T09:11:09Z" level=info msg="Starting /v1, Kind=Pod controller"1520machine # [ 28.319228] k3s[893]: I0930 09:11:09.035213 893 shared_informer.go:402] "Waiting for caches to sync"1521machine # [ 28.323615] k3s[893]: time="2026-09-30T09:11:09Z" level=info msg="Starting apps/v1, Kind=DaemonSet controller"1522machine # [ 28.328054] k3s[893]: I0930 09:11:09.043874 893 controllermanager.go:338] Started "cloud-node-controller"1523machine # [ 28.328672] k3s[893]: I0930 09:11:09.043996 893 controllermanager.go:338] Started "cloud-node-lifecycle-controller"1524machine # [ 28.329230] k3s[893]: time="2026-09-30T09:11:09Z" level=info msg="Starting discovery.k8s.io/v1, Kind=EndpointSlice controller"1525machine # [ 28.329702] k3s[893]: I0930 09:11:09.045153 893 node_controller.go:179] Sending events to api server.1526machine # [ 28.333116] k3s[893]: I0930 09:11:09.045223 893 node_controller.go:188] Waiting for informer caches to sync1527machine # [ 28.333947] k3s[893]: I0930 09:11:09.045349 893 node_lifecycle_controller.go:112] Sending events to api server1528machine # [ 28.334665] k3s[893]: I0930 09:11:09.046552 893 controllermanager.go:338] Started "service-lb-controller"1529machine # [ 28.335162] k3s[893]: W0930 09:11:09.046571 893 controllermanager.go:315] "node-route-controller" is disabled1530machine # [ 28.335705] k3s[893]: I0930 09:11:09.047032 893 controller.go:235] Starting service controller1531machine # [ 28.336402] k3s[893]: I0930 09:11:09.047081 893 shared_informer.go:402] "Waiting for caches to sync"1532machine # [ 28.346734] k3s[893]: I0930 09:11:09.062685 893 shared_informer.go:402] "Waiting for caches to sync"1533machine # [ 28.440598] k3s[893]: time="2026-09-30T09:11:09Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found"1534machine # [ 28.578304] k3s[893]: I0930 09:11:09.293939 893 shared_informer.go:409] "Caches are synced"1535machine # [ 28.578676] k3s[893]: I0930 09:11:09.294036 893 shared_informer.go:409] "Caches are synced"1536machine # [ 28.579227] k3s[893]: I0930 09:11:09.294411 893 shared_informer.go:409] "Caches are synced"1537machine # [ 28.579691] k3s[893]: I0930 09:11:09.294446 893 range_allocator.go:177] "Sending events to api server"1538machine # [ 28.582079] k3s[893]: I0930 09:11:09.294541 893 shared_informer.go:409] "Caches are synced"1539machine # [ 28.582786] k3s[893]: I0930 09:11:09.294572 893 shared_informer.go:409] "Caches are synced"1540machine # [ 28.583413] k3s[893]: I0930 09:11:09.294689 893 range_allocator.go:181] "Starting range CIDR allocator"1541machine # [ 28.583946] k3s[893]: I0930 09:11:09.294699 893 shared_informer.go:402] "Waiting for caches to sync"1542machine # [ 28.584702] k3s[893]: I0930 09:11:09.294709 893 shared_informer.go:409] "Caches are synced"1543machine # [ 28.587963] k3s[893]: I0930 09:11:09.295815 893 shared_informer.go:409] "Caches are synced"1544machine # [ 28.588649] k3s[893]: I0930 09:11:09.295965 893 shared_informer.go:409] "Caches are synced"1545machine # [ 28.589205] k3s[893]: I0930 09:11:09.295993 893 shared_informer.go:409] "Caches are synced"1546machine # [ 28.589739] k3s[893]: I0930 09:11:09.297572 893 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceSlice + event handler k8s.io/kubernetes/pkg/controller/devicetainteviction.(*Controller).Run"1547machine # [ 28.591096] k3s[893]: I0930 09:11:09.297954 893 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceClaim"1548machine # [ 28.591700] k3s[893]: I0930 09:11:09.297979 893 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceClaim + event handler k8s.io/kubernetes/pkg/controller/devicetainteviction.(*Controller).Run"1549machine # [ 28.592375] k3s[893]: I0930 09:11:09.298927 893 shared_informer.go:409] "Caches are synced"1550machine # [ 28.592959] k3s[893]: I0930 09:11:09.299016 893 shared_informer.go:409] "Caches are synced"1551machine # [ 28.594179] k3s[893]: I0930 09:11:09.299094 893 shared_informer.go:409] "Caches are synced"1552machine # [ 28.594715] k3s[893]: time="2026-09-30T09:11:09Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" object=kube-system/local-storage reason=DeletingManifest type=Normal1553machine # [ 28.595365] k3s[893]: I0930 09:11:09.301940 893 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceSlice"1554machine # [ 28.595942] k3s[893]: I0930 09:11:09.302013 893 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.DeviceClass"1555machine # [ 28.597838] k3s[893]: I0930 09:11:09.306568 893 shared_informer.go:409] "Caches are synced"1556machine # [ 28.602975] k3s[893]: time="2026-09-30T09:11:09Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=ApplyingManifest type=Normal1557machine # [ 28.607974] k3s[893]: I0930 09:11:09.323544 893 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/161558machine # [ 28.611578] k3s[893]: I0930 09:11:09.327564 893 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/161559machine # [ 28.612717] k3s[893]: I0930 09:11:09.328731 893 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.Pod"1560machine # [ 28.613694] k3s[893]: I0930 09:11:09.329535 893 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.Pod + event handler k8s.io/kubernetes/pkg/controller/devicetainteviction.(*Controller).Run"1561machine # [ 28.620847] k3s[893]: I0930 09:11:09.336854 893 shared_informer.go:409] "Caches are synced"1562machine # [ 28.631294] k3s[893]: I0930 09:11:09.347306 893 shared_informer.go:409] "Caches are synced"1563machine # [ 28.646973] k3s[893]: time="2026-09-30T09:11:09Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Deferred node password secret validation complete" object=machine reason=NodePasswordValidationComplete type=Normal1564machine # [ 28.663707] k3s[893]: I0930 09:11:09.379520 893 shared_informer.go:409] "Caches are synced"1565machine # [ 28.664199] k3s[893]: I0930 09:11:09.379738 893 shared_informer.go:409] "Caches are synced"1566machine # [ 28.664839] k3s[893]: I0930 09:11:09.380835 893 shared_informer.go:409] "Caches are synced"1567machine # [ 28.676697] k3s[893]: I0930 09:11:09.392382 893 shared_informer.go:409] "Caches are synced"1568machine # [ 28.678173] k3s[893]: I0930 09:11:09.394173 893 shared_informer.go:409] "Caches are synced"1569machine # [ 28.679404] k3s[893]: I0930 09:11:09.394207 893 shared_informer.go:409] "Caches are synced"1570machine # [ 28.680684] k3s[893]: I0930 09:11:09.394227 893 shared_informer.go:409] "Caches are synced"1571machine # [ 28.681929] k3s[893]: I0930 09:11:09.394311 893 shared_informer.go:409] "Caches are synced"1572machine # [ 28.683190] k3s[893]: I0930 09:11:09.394485 893 shared_informer.go:409] "Caches are synced"1573machine # [ 28.684393] k3s[893]: I0930 09:11:09.394526 893 shared_informer.go:409] "Caches are synced"1574machine # [ 28.685778] k3s[893]: I0930 09:11:09.395080 893 shared_informer.go:409] "Caches are synced"1575machine # [ 28.686398] k3s[893]: I0930 09:11:09.395128 893 shared_informer.go:409] "Caches are synced"1576machine # [ 28.686889] k3s[893]: I0930 09:11:09.395303 893 shared_informer.go:409] "Caches are synced"1577machine # [ 28.687715] k3s[893]: I0930 09:11:09.395430 893 shared_informer.go:409] "Caches are synced"1578machine # [ 28.688221] k3s[893]: I0930 09:11:09.395494 893 shared_informer.go:409] "Caches are synced"1579machine # [ 28.688836] k3s[893]: I0930 09:11:09.395605 893 shared_informer.go:409] "Caches are synced"1580machine # [ 28.689710] k3s[893]: I0930 09:11:09.395663 893 shared_informer.go:409] "Caches are synced"1581machine # [ 28.690211] k3s[893]: I0930 09:11:09.395702 893 shared_informer.go:409] "Caches are synced"1582machine # [ 28.690725] k3s[893]: I0930 09:11:09.395734 893 shared_informer.go:409] "Caches are synced"1583machine # [ 28.691176] k3s[893]: I0930 09:11:09.395826 893 shared_informer.go:409] "Caches are synced"1584machine # [ 28.691717] k3s[893]: I0930 09:11:09.395868 893 shared_informer.go:409] "Caches are synced"1585machine # [ 28.692280] k3s[893]: I0930 09:11:09.398634 893 shared_informer.go:409] "Caches are synced"1586machine # [ 28.692727] k3s[893]: I0930 09:11:09.398691 893 shared_informer.go:409] "Caches are synced"1587machine # [ 28.693362] k3s[893]: I0930 09:11:09.398746 893 shared_informer.go:409] "Caches are synced"1588machine # [ 28.693924] k3s[893]: I0930 09:11:09.398789 893 shared_informer.go:409] "Caches are synced"1589machine # [ 28.694649] k3s[893]: I0930 09:11:09.398817 893 shared_informer.go:409] "Caches are synced"1590machine # [ 28.695179] k3s[893]: I0930 09:11:09.399251 893 shared_informer.go:409] "Caches are synced"1591machine # [ 28.695515] k3s[893]: I0930 09:11:09.399595 893 shared_informer.go:409] "Caches are synced"1592machine # [ 28.695587] k3s[893]: I0930 09:11:09.399781 893 shared_informer.go:409] "Caches are synced"1593machine # [ 28.696142] k3s[893]: I0930 09:11:09.410761 893 controller.go:667] quota admission added evaluator for: replicasets.apps1594machine # [ 28.699918] k3s[893]: I0930 09:11:09.415911 893 controller.go:667] quota admission added evaluator for: helmcharts.helm.cattle.io1595machine # [ 28.705053] k3s[893]: time="2026-09-30T09:11:09Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=AppliedManifest type=Normal1596machine # [ 28.713921] k3s[893]: time="2026-09-30T09:11:09Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=ApplyingManifest type=Normal1597machine # [ 28.887080] k3s[893]: time="2026-09-30T09:11:09Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Applying HelmChart from https://%{KUBERNETES_API}%/static/charts/nix-grpc-farm.tgz using Job kube-system/helm-install-nix-grpc-farm " object=kube-system/nix-grpc-farm reason=ApplyJob type=Normal1598machine # [ 28.909337] k3s[893]: I0930 09:11:09.625282 893 controller.go:667] quota admission added evaluator for: jobs.batch1599machine # [ 29.086878] k3s[893]: time="2026-09-30T09:11:09Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=AppliedManifest type=Normal1600machine # [ 29.103067] k3s[893]: time="2026-09-30T09:11:09Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=ApplyingManifest type=Normal1601machine # [ 29.293566] k3s[893]: E0930 09:11:10.009518 893 replica_set.go:640] "Unhandled Error" err="sync \"kube-system/coredns-54996dc9b4\" failed with read version: 297 is not as new as written version: 350 for group resource replicasets.apps" logger="UnhandledError"1602machine # [ 29.300682] k3s[893]: E0930 09:11:10.016667 893 replica_set.go:640] "Unhandled Error" err="sync \"kube-system/coredns-54996dc9b4\" failed with read version: 350 is not as new as written version: 353 for group resource replicasets.apps" logger="UnhandledError"1603machine # [ 29.324571] k3s[893]: time="2026-09-30T09:11:10Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=AppliedManifest type=Normal1604machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found1605machine # [ 29.440944] k3s[893]: time="2026-09-30T09:11:10Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found"1606machine # [ 29.560476] k3s[893]: time="2026-09-30T09:11:10Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/traefik.yaml\"" object=kube-system/traefik reason=DeletingManifest type=Normal1607machine # [ 29.570734] k3s[893]: time="2026-09-30T09:11:10Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Resumed synced Job kube-system/helm-install-nix-grpc-farm" object=kube-system/nix-grpc-farm reason=ResumeJob type=Normal1608machine # [ 29.579797] k3s[893]: I0930 09:11:10.295498 893 shared_informer.go:409] "Caches are synced"1609machine # [ 29.580435] k3s[893]: I0930 09:11:10.296453 893 garbagecollector.go:166] "Garbage collector: all resource monitors have synced"1610machine # [ 29.580927] k3s[893]: I0930 09:11:10.296951 893 garbagecollector.go:169] "Proceeding to collect garbage"1611machine # [ 29.647279] k3s[893]: I0930 09:11:10.363251 893 shared_informer.go:409] "Caches are synced"1612machine # [ 29.669479] k3s[893]: time="2026-09-30T09:11:10Z" level=info msg="Imported docker.io/library/nix-grpc-farm-lb:0.1.0-beta.4"1613machine # [ 29.674661] k3s[893]: time="2026-09-30T09:11:10Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-lb@sha256:18ee6724be589622e1aee9d13c5121e7b2c992ca636c935ade90c66423e18f37"1614machine # [ 29.719576] k3s[893]: time="2026-09-30T09:11:10Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nixos/if20jbcicwv9y92klzcxk35m5bcz2ql0-nix-grpc-farm-lb.tar in 1.754938966s"1615machine # [ 29.720131] k3s[893]: time="2026-09-30T09:11:10Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/smddpgqzjvlqv3lx57wdzl7kma805fj0-k3s-airgap-images-amd64.tar.zst"1616machine # [ 30.243410] postgres[1199]: [1199] ERROR: relation "goose_db_version" does not exist at character 361617machine # [ 30.245358] postgres[1199]: [1199] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC1618machine # [ 30.266309] niks3-server[1191]: 2026/09/30 09:11:10 OK 20241026095416_initial_model.sql (10.32ms)1619machine # [ 30.267827] niks3-server[1191]: 2026/09/30 09:11:10 OK 20251210153512_drop_unused_gin_index.sql (2.33ms)1620machine # [ 30.271264] niks3-server[1191]: 2026/09/30 09:11:10 OK 20251218171726_add_pins.sql (3.41ms)1621machine # [ 30.274568] niks3-server[1191]: 2026/09/30 09:11:10 OK 20260628120000_add_object_size_and_stats.sql (3.23ms)1622machine # [ 30.277905] niks3-server[1191]: 2026/09/30 09:11:10 OK 20260905000000_add_claims.sql (3.3ms)1623machine # [ 30.280869] niks3-server[1191]: 2026/09/30 09:11:10 OK 20260920000000_drop_claims.sql (2.81ms)1624machine # [ 30.282529] niks3-server[1191]: 2026/09/30 09:11:10 OK 20260923120000_add_pushes.sql (1.62ms)1625machine # [ 30.283711] niks3-server[1191]: 2026/09/30 09:11:10 goose: successfully migrated database to version: 202609231200001626machine # [ 30.285841] niks3-server[1191]: 2026/09/30 09:11:11 OK 1_commit_pending_closure.sql (3.15ms)1627machine # [ 30.287762] niks3-server[1191]: 2026/09/30 09:11:11 OK 2_object_stats_trigger.sql (1.86ms)1628machine # [ 30.291401] niks3-server[1191]: 2026/09/30 09:11:11 OK 3_commit_push.sql (3.49ms)1629machine # [ 30.292141] niks3-server[1191]: 2026/09/30 09:11:11 goose: up to current file version: 31630machine # [ 30.297520] niks3-server[1191]: 2026/09/30 09:11:11 INFO OIDC provider initialized name=kubernetes issuer=https://kubernetes.default.svc.cluster.local1631machine # [ 30.299413] niks3-server[1191]: 2026/09/30 09:11:11 INFO OIDC authentication enabled config=/nix/store/v0b0sqyzhrjsz48x3klf7b7vl89apzs0-niks3-oidc.json1632machine # [ 30.300064] niks3-server[1191]: 2026/09/30 09:11:11 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key1633machine # [ 30.330507] niks3-server[1191]: 2026/09/30 09:11:11 INFO Read proxy enabled — serving cache objects from S31634machine # [ 30.331684] niks3-server[1191]: 2026/09/30 09:11:11 INFO Using socket-activated listener address=0.0.0.0:57511635machine # [ 30.332730] niks3-server[1191]: 2026/09/30 09:11:11 INFO systemd watchdog enabled interval=15s1636machine # [ 30.334330] niks3-server[1191]: 2026/09/30 09:11:11 INFO Starting HTTP server address=0.0.0.0:57511637machine # [ 30.335085] systemd[1]: Started niks3 server.1638machine # [ 30.335724] systemd[1]: Reached target Multi-User System.1639machine # [ 30.336289] systemd[1]: Startup finished in 1.196s (kernel) + 3.825s (initrd) + 25.310s (userspace) = 30.332s.1640machine # [ 30.440316] k3s[893]: time="2026-09-30T09:11:11Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found"1641machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found1642machine # [ 31.441477] k3s[893]: time="2026-09-30T09:11:12Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found"1643machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found1644machine # [ 32.440084] k3s[893]: time="2026-09-30T09:11:13Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found"1645machine # [ 32.560994] k3s[893]: time="2026-09-30T09:11:13Z" level=info msg="Started tunnel to 10.0.2.15:6443"1646machine # [ 32.562556] k3s[893]: time="2026-09-30T09:11:13Z" level=info msg="Stopped tunnel to 127.0.0.1:6443"1647machine # [ 32.564448] k3s[893]: time="2026-09-30T09:11:13Z" level=info msg="Proxy done" err="context canceled" url="wss://127.0.0.1:6443/v1-k3s/connect"1648machine # [ 32.565123] k3s[893]: time="2026-09-30T09:11:13Z" level=info msg="Connecting to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect"1649machine # [ 32.565952] k3s[893]: time="2026-09-30T09:11:13Z" level=info msg="error in remotedialer server [400]: websocket: close 1006 (abnormal closure): unexpected EOF"1650machine # [ 32.578102] k3s[893]: time="2026-09-30T09:11:13Z" level=info msg="Handling backend connection request [machine]"1651machine # [ 32.579629] k3s[893]: time="2026-09-30T09:11:13Z" level=info msg="Connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect"1652machine # [ 32.581088] k3s[893]: time="2026-09-30T09:11:13Z" level=info msg="Remotedialer connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect"1653machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found1654machine # [ 32.912055] k3s[893]: time="2026-09-30T09:11:13Z" level=info msg="Imported docker.io/rancher/klipper-helm:v0.13.3-build20260727"1655machine # [ 32.919236] k3s[893]: time="2026-09-30T09:11:13Z" level=info msg="Tagged docker.io/rancher/klipper-helm@sha256:5425a2b4613d2458dbdff99218e8d487ebb59c20e7a941f061c0777070f0aac1"1656machine # [ 32.921595] k3s[893]: time="2026-09-30T09:11:13Z" level=info msg="Imported docker.io/rancher/klipper-lb:v0.4.17"1657machine # [ 32.923175] k3s[893]: time="2026-09-30T09:11:13Z" level=info msg="Tagged docker.io/rancher/klipper-lb@sha256:910944bb0bd94f060a82a56ca1ea1c577d3e49b3473a093a47a985f32e92d94a"1658machine # [ 32.925491] k3s[893]: time="2026-09-30T09:11:13Z" level=info msg="Imported docker.io/rancher/local-path-provisioner:v0.0.37"1659machine # [ 32.927184] k3s[893]: time="2026-09-30T09:11:13Z" level=info msg="Tagged docker.io/rancher/local-path-provisioner@sha256:e757967a5ec338f6a9b371c5a9688bedaa8c3578ea3dd4db329ea0084be0a86f"1660machine # [ 32.929548] k3s[893]: time="2026-09-30T09:11:13Z" level=info msg="Imported docker.io/rancher/mirrored-coredns-coredns:1.14.6"1661machine # [ 32.931271] k3s[893]: time="2026-09-30T09:11:13Z" level=info msg="Tagged docker.io/rancher/mirrored-coredns-coredns@sha256:900f9c109f7a33545d3c811516e8376df9019147b750f5ce3e254468769176ea"1662machine # [ 32.933546] k3s[893]: time="2026-09-30T09:11:13Z" level=info msg="Imported docker.io/rancher/mirrored-library-busybox:1.37.0"1663machine # [ 32.935501] k3s[893]: time="2026-09-30T09:11:13Z" level=info msg="Tagged docker.io/rancher/mirrored-library-busybox@sha256:101b4afd76732482eff9b95cae5f94bcf295e521fbec4e01b69c5421f3f3f3e5"1664machine # [ 32.938085] k3s[893]: time="2026-09-30T09:11:13Z" level=info msg="Imported docker.io/rancher/mirrored-library-traefik:3.7.8"1665machine # [ 32.941556] k3s[893]: time="2026-09-30T09:11:13Z" level=info msg="Tagged docker.io/rancher/mirrored-library-traefik@sha256:4299bbed850421258fc5448c2e0e6ad350981d4d335a68de11b92448aedbefe5"1666machine # [ 32.944198] k3s[893]: time="2026-09-30T09:11:13Z" level=info msg="Imported docker.io/rancher/mirrored-metrics-server:v0.9.0"1667machine # [ 32.945149] k3s[893]: time="2026-09-30T09:11:13Z" level=info msg="Tagged docker.io/rancher/mirrored-metrics-server@sha256:d9862115e7c7881280d3d75ca26bda8ffc0fc213315979575bf23ce9826205c0"1668machine # [ 32.945639] k3s[893]: time="2026-09-30T09:11:13Z" level=info msg="Imported docker.io/rancher/mirrored-pause:3.10.2"1669machine # [ 32.949842] k3s[893]: time="2026-09-30T09:11:13Z" level=info msg="Tagged docker.io/rancher/mirrored-pause@sha256:f548e0e8e3dc1896ca956272154dde3314e8cc4fde0a57577ee9fa1c63f5baf4"1670machine # [ 33.206833] k3s[893]: time="2026-09-30T09:11:13Z" level=info msg="Imported 8 images from /var/lib/rancher/k3s/agent/images/nixos/smddpgqzjvlqv3lx57wdzl7kma805fj0-k3s-airgap-images-amd64.tar.zst in 3.486865789s"1671machine # [ 33.207586] k3s[893]: time="2026-09-30T09:11:13Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/y1hnjafq2ajj5g6jllm4jw5r60h26wyp-nix-grpc-farm.tar"1672machine # [ 33.442845] k3s[893]: time="2026-09-30T09:11:14Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found"1673machine # [ 33.463238] k3s[893]: time="2026-09-30T09:11:14Z" level=info msg="Running kubelet --cloud-provider=external --config-dir=/var/lib/rancher/k3s/agent/etc/kubelet.conf.d --containerd=/run/k3s/containerd/containerd.sock --eviction-hard=nodefs.available<1%,imagefs.available<1% --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubelet.kubeconfig --node-ip=10.0.2.15,fec0::d1f1:69b2:979a:597a --node-labels= --read-only-port=0"1674machine # [ 33.475157] k3s[893]: Flag --containerd has been deprecated, This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed.1675machine # [ 33.494533] k3s[893]: I0930 09:11:14.210424 893 server.go:541] "Kubelet version" kubeletVersion="v1.36.4+k3s1"1676machine # [ 33.495898] k3s[893]: I0930 09:11:14.210467 893 server.go:543] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""1677machine # [ 33.497145] k3s[893]: I0930 09:11:14.210512 893 watchdog_linux.go:94] "Systemd watchdog is not enabled"1678machine # [ 33.498117] k3s[893]: I0930 09:11:14.210534 893 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."1679machine # [ 33.508647] k3s[893]: I0930 09:11:14.224550 893 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/agent/client-ca.crt"1680machine # [ 33.516494] k3s[893]: I0930 09:11:14.232413 893 server.go:1444] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"1681machine # [ 33.527503] k3s[893]: I0930 09:11:14.243430 893 server.go:804] "--cgroups-per-qos enabled, but --cgroup-root was not specified. Defaulting to /"1682machine # [ 33.528572] k3s[893]: I0930 09:11:14.243483 893 server.go:865] "NoSwap is set due to memorySwapBehavior not specified" memorySwapBehavior="" FailSwapOn=false1683machine # [ 33.529186] k3s[893]: I0930 09:11:14.243833 893 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]1684machine # [ 33.530271] k3s[893]: I0930 09:11:14.243873 893 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"machine","RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"MemoryReservationPolicy":"None","PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}1685machine # [ 33.531085] k3s[893]: I0930 09:11:14.244203 893 topology_manager.go:172] "Creating topology manager with none policy"1686machine # [ 33.531934] k3s[893]: I0930 09:11:14.244230 893 container_manager_linux.go:309] "Creating device plugin manager"1687machine # [ 33.532699] k3s[893]: I0930 09:11:14.244351 893 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"1688machine # [ 33.534772] k3s[893]: I0930 09:11:14.250725 893 state_mem.go:45] "Initialized" logger="CPUManager state memory"1689machine # [ 33.535748] k3s[893]: I0930 09:11:14.251141 893 kubelet.go:485] "Attempting to sync node with API server"1690machine # [ 33.536650] k3s[893]: I0930 09:11:14.251171 893 kubelet.go:386] "Adding static pod path" path="/var/lib/rancher/k3s/agent/pod-manifests"1691machine # [ 33.537635] k3s[893]: I0930 09:11:14.251213 893 kubelet.go:397] "Adding apiserver pod source"1692machine # [ 33.538857] k3s[893]: I0930 09:11:14.251244 893 apiserver.go:41] "Waiting for node sync before watching apiserver pods"1693machine # [ 33.540813] k3s[893]: I0930 09:11:14.256812 893 kuberuntime_manager.go:308] "Container runtime initialized" containerRuntime="containerd" version="2.3.4-k3s1.36" apiVersion="v1"1694machine # [ 33.542552] k3s[893]: I0930 09:11:14.258539 893 kubelet.go:1002] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"1695machine # [ 33.543123] k3s[893]: I0930 09:11:14.258603 893 kubelet.go:1029] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"1696machine # [ 33.566506] k3s[893]: I0930 09:11:14.282221 893 server.go:1280] "Started kubelet"1697machine # [ 33.567184] k3s[893]: I0930 09:11:14.282930 893 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=101698machine # [ 33.567608] k3s[893]: I0930 09:11:14.283016 893 server_v1.go:49] "podresources" method="list" useActivePods=true1699machine # [ 33.568180] k3s[893]: I0930 09:11:14.283380 893 server.go:264] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"1700machine # [ 33.570319] k3s[893]: I0930 09:11:14.284780 893 server.go:193] "Starting to listen" address="0.0.0.0" port=102501701machine # [ 33.571519] k3s[893]: I0930 09:11:14.285812 893 server.go:354] "Adding debug handlers to kubelet server"1702machine # [ 33.572753] k3s[893]: I0930 09:11:14.286919 893 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"1703machine # [ 33.573742] k3s[893]: I0930 09:11:14.287348 893 dynamic_serving_content.go:135] "Starting controller" name="kubelet-server-cert-files::/var/lib/rancher/k3s/agent/serving-kubelet.crt::/var/lib/rancher/k3s/agent/serving-kubelet.key"1704machine # [ 33.574659] k3s[893]: I0930 09:11:14.287445 893 tlsconfig.go:243] "Starting DynamicServingCertificateController"1705machine # [ 33.575143] k3s[893]: E0930 09:11:14.290129 893 kubelet_node_status.go:396] "Error getting the current node from lister" err="node \"machine\" not found"1706machine # [ 33.575605] k3s[893]: I0930 09:11:14.290219 893 volume_manager.go:310] "Starting Kubelet Volume Manager"1707machine # [ 33.576113] k3s[893]: I0930 09:11:14.290688 893 desired_state_of_world_populator.go:146] "Desired state populator starts to run"1708machine # [ 33.576679] k3s[893]: I0930 09:11:14.290797 893 reconciler.go:29] "Reconciler: start to sync state"1709machine # [ 33.577358] k3s[893]: E0930 09:11:14.293282 893 kubelet.go:3516] "Unable to register mirror pod because node is not registered yet" err="node \"machine\" not found" node="machine"1710machine # [ 33.581378] k3s[893]: E0930 09:11:14.297365 893 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"machine\" not found" node="machine"1711machine # [ 33.593501] k3s[893]: I0930 09:11:14.309102 893 factory.go:222] Registration of the containerd container factory successfully1712machine # [ 33.594204] k3s[893]: I0930 09:11:14.309129 893 factory.go:222] Registration of the systemd container factory successfully1713machine # [ 33.594786] k3s[893]: I0930 09:11:14.309254 893 factory.go:220] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory1714machine # [ 33.610801] k3s[893]: I0930 09:11:14.326795 893 cpu_manager.go:235] "Starting" policy="none"1715machine # [ 33.611498] k3s[893]: I0930 09:11:14.326812 893 cpu_manager.go:236] "Reconciling" reconcilePeriod="10s"1716machine # [ 33.611888] k3s[893]: I0930 09:11:14.326851 893 state_mem.go:45] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"1717machine # [ 33.616857] k3s[893]: I0930 09:11:14.332835 893 policy_none.go:50] "Start"1718machine # [ 33.617404] k3s[893]: I0930 09:11:14.332855 893 memory_manager.go:190] "Starting memorymanager" policy="None"1719machine # [ 33.617888] k3s[893]: I0930 09:11:14.332871 893 state_mem.go:40] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"1720machine # [ 33.624575] k3s[893]: I0930 09:11:14.340519 893 policy_none.go:44] "Start"1721machine # [ 33.629398] systemd[1]: Created slice libcontainer container kubepods.slice.1722machine # [ 33.641784] systemd[1]: Created slice libcontainer container kubepods-burstable.slice.1723machine # [ 33.646722] systemd[1]: Created slice libcontainer container kubepods-besteffort.slice.1724machine # [ 33.656268] k3s[893]: E0930 09:11:14.372256 893 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"1725machine # [ 33.656789] k3s[893]: I0930 09:11:14.372389 893 eviction_manager.go:194] "Eviction manager: starting control loop"1726machine # [ 33.657473] k3s[893]: I0930 09:11:14.372407 893 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"1727machine # [ 33.657673] k3s[893]: I0930 09:11:14.372760 893 plugin_manager.go:121] "Starting Kubelet Plugin Manager"1728machine # [ 33.664592] k3s[893]: E0930 09:11:14.380550 893 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="no imagefs label for configured runtime"1729machine # [ 33.665261] k3s[893]: E0930 09:11:14.380588 893 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"machine\" not found"1730machine # [ 33.667052] k3s[893]: I0930 09:11:14.382963 893 kubelet_network_linux.go:53] "Initialized iptables rules." protocol="IPv4"1731machine # [ 33.672871] k3s[893]: I0930 09:11:14.388674 893 kubelet_network_linux.go:53] "Initialized iptables rules." protocol="IPv6"1732machine # [ 33.673960] k3s[893]: I0930 09:11:14.388710 893 status_manager.go:277] "Starting to sync pod status with apiserver"1733machine # [ 33.674703] k3s[893]: I0930 09:11:14.388752 893 kubelet.go:2622] "Starting kubelet main sync loop"1734machine # [ 33.675759] k3s[893]: E0930 09:11:14.388801 893 kubelet.go:2646] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"1735machine # [ 33.677444] k3s[893]: E0930 09:11:14.393453 893 kubelet.go:3516] "Unable to register mirror pod because node is not registered yet" err="node \"machine\" not found" node="machine"1736machine # [ 33.757833] k3s[893]: I0930 09:11:14.473758 893 kubelet_node_status.go:75] "Attempting to register node" node="machine"1737machine # [ 33.765064] k3s[893]: time="2026-09-30T09:11:14Z" level=info msg="Adding node OwnerReference to node-password secret machine.node-password.k3s"1738machine # [ 33.765688] k3s[893]: I0930 09:11:14.480497 893 node_controller.go:432] Initializing node machine with cloud provider1739machine # [ 33.766141] k3s[893]: I0930 09:11:14.480544 893 node_controller.go:236] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing1740machine # [ 33.766649] k3s[893]: E0930 09:11:14.480567 893 node_controller.go:247] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError"1741machine # [ 33.767431] k3s[893]: I0930 09:11:14.483436 893 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"machine\" does not exist"1742machine # [ 33.769623] k3s[893]: I0930 09:11:14.485600 893 node_controller.go:432] Initializing node machine with cloud provider1743machine # [ 33.769727] k3s[893]: I0930 09:11:14.485651 893 node_controller.go:236] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing1744machine # [ 33.770389] k3s[893]: E0930 09:11:14.485670 893 node_controller.go:247] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError"1745machine # [ 33.771252] k3s[893]: I0930 09:11:14.487263 893 node_controller.go:432] Initializing node machine with cloud provider1746machine # [ 33.773123] k3s[893]: time="2026-09-30T09:11:14Z" level=info msg="Annotations and labels have been set successfully on node: machine"1747machine # [ 33.777055] k3s[893]: time="2026-09-30T09:11:14Z" level=info msg="Starting flannel with backend vxlan"1748machine # [ 33.785211] k3s[893]: I0930 09:11:14.501206 893 kubelet_node_status.go:78] "Successfully registered node" node="machine"1749machine # [ 33.787335] k3s[893]: time="2026-09-30T09:11:14Z" level=info msg="Synced coredns NodeHosts entries for machine"1750machine # [ 33.793159] k3s[893]: I0930 09:11:14.509076 893 range_allocator.go:433] "Set node PodCIDR" node="machine" podCIDRs=["10.42.0.0/24"]1751machine # [ 33.804469] k3s[893]: E0930 09:11:14.520452 893 range_allocator.go:438] "Failed to update node PodCIDR after multiple attempts" err="failed to patch node CIDR: Node \"machine\" is invalid: [spec.podCIDRs: Invalid value: [\"10.42.1.0/24\",\"10.42.0.0/24\"]: may specify no more than one CIDR for each IP family, spec.podCIDRs: Forbidden: node updates may not change podCIDR except from \"\" to valid]" node="machine" podCIDRs=["10.42.1.0/24"]1752machine # [ 33.804951] k3s[893]: E0930 09:11:14.520500 893 range_allocator.go:444] "CIDR assignment for node failed. Releasing allocated CIDR" err="failed to patch node CIDR: Node \"machine\" is invalid: [spec.podCIDRs: Invalid value: [\"10.42.1.0/24\",\"10.42.0.0/24\"]: may specify no more than one CIDR for each IP family, spec.podCIDRs: Forbidden: node updates may not change podCIDR except from \"\" to valid]" node="machine"1753machine # [ 33.813676] k3s[893]: time="2026-09-30T09:11:14Z" level=info msg="Flannel found PodCIDR assigned for node machine"1754machine # [ 33.814501] k3s[893]: time="2026-09-30T09:11:14Z" level=info msg="The interface eth0 with ipv4 address 10.0.2.15 will be used by flannel"1755machine # [ 33.815173] k3s[893]: I0930 09:11:14.530265 893 kube.go:139] Waiting 10m0s for node controller to sync1756machine # [ 33.815686] k3s[893]: I0930 09:11:14.530343 893 kube.go:537] Starting kube subnet manager1757machine # [ 33.816425] k3s[893]: I0930 09:11:14.530751 893 kuberuntime_manager.go:2172] "Updating runtime config through cri with podcidr" CIDR="10.42.0.0/24"1758machine # [ 33.816913] k3s[893]: I0930 09:11:14.532931 893 kubelet_network.go:48] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.42.0.0/24"1759machine # [ 33.821525] k3s[893]: E0930 09:11:14.537528 893 range_allocator.go:257] "Error processing node work item" err="error syncing 'machine': failed to patch node CIDR: Node \"machine\" is invalid: [spec.podCIDRs: Invalid value: [\"10.42.1.0/24\",\"10.42.0.0/24\"]: may specify no more than one CIDR for each IP family, spec.podCIDRs: Forbidden: node updates may not change podCIDR except from \"\" to valid], requeuing" logger="UnhandledError"1760machine # [ 33.891430] k3s[893]: I0930 09:11:14.607407 893 node_controller.go:477] Successfully initialized node machine with cloud provider1761machine # [ 33.892508] k3s[893]: E0930 09:11:14.608204 893 options.go:205] The manifest file is empty, ignoring.1762machine # [ 33.893852] k3s[893]: I0930 09:11:14.609856 893 event.go:389] "Event occurred" object="machine" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="Synced" message="Node synced successfully"1763machine # [ 33.904357] k3s[893]: I0930 09:11:14.620359 893 server.go:176] "Starting Kubernetes Scheduler" version="v1.36.4+k3s1"1764machine # [ 33.905140] k3s[893]: I0930 09:11:14.621160 893 server.go:178] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""1765machine # [ 33.910355] k3s[893]: I0930 09:11:14.626365 893 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController1766machine # [ 33.911238] k3s[893]: I0930 09:11:14.627254 893 shared_informer.go:402] "Waiting for caches to sync"1767machine # [ 33.911844] k3s[893]: I0930 09:11:14.626539 893 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"1768machine # [ 33.912462] k3s[893]: I0930 09:11:14.628486 893 shared_informer.go:402] "Waiting for caches to sync"1769machine # [ 33.913020] k3s[893]: I0930 09:11:14.626561 893 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"1770machine # [ 33.913490] k3s[893]: I0930 09:11:14.629513 893 shared_informer.go:402] "Waiting for caches to sync"1771machine # [ 33.919838] k3s[893]: I0930 09:11:14.635829 893 secure_serving.go:214] Serving securely on 127.0.0.1:102591772machine # [ 33.921969] k3s[893]: I0930 09:11:14.637957 893 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key"1773machine # [ 33.922614] k3s[893]: I0930 09:11:14.638344 893 tlsconfig.go:243] "Starting DynamicServingCertificateController"1774machine # [ 33.925055] k3s[893]: I0930 09:11:14.640466 893 kubelet_node_status.go:431] "Fast updating node status as it just became ready"1775machine # [ 33.942912] k3s[893]: I0930 09:11:14.658900 893 topologycache.go:237] "Can't get CPU or zone information for node" node="machine"1776machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found1777machine # [ 34.432471] k3s[893]: time="2026-09-30T09:11:15Z" level=info msg="Tunnel authorizer set Kubelet Port 0.0.0.0:10250"1778machine # [ 34.452131] k3s[893]: time="2026-09-30T09:11:15Z" level=info msg="Labels and annotations have been set successfully on node: machine"1779machine # [ 34.512370] k3s[893]: I0930 09:11:15.228269 893 shared_informer.go:409] "Caches are synced"1780machine # [ 34.515352] k3s[893]: I0930 09:11:15.229398 893 shared_informer.go:409] "Caches are synced"1781machine # [ 34.517573] k3s[893]: I0930 09:11:15.230663 893 shared_informer.go:409] "Caches are synced"1782machine # [ 34.537532] k3s[893]: I0930 09:11:15.253435 893 apiserver.go:51] "Watching apiserver"1783machine # [ 34.580598] k3s[893]: I0930 09:11:15.295627 893 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"1784machine # [ 34.583879] k3s[893]: I0930 09:11:15.295873 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3481ae27-f668-4a4c-8b39-1cb4115dbe26-config-volume\") pod \"coredns-54996dc9b4-tx6k2\" (UID: \"3481ae27-f668-4a4c-8b39-1cb4115dbe26\") " pod="kube-system/coredns-54996dc9b4-tx6k2"1785machine # [ 34.592394] k3s[893]: I0930 09:11:15.295937 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-config-volume\" (UniqueName: \"kubernetes.io/configmap/3481ae27-f668-4a4c-8b39-1cb4115dbe26-custom-config-volume\") pod \"coredns-54996dc9b4-tx6k2\" (UID: \"3481ae27-f668-4a4c-8b39-1cb4115dbe26\") " pod="kube-system/coredns-54996dc9b4-tx6k2"1786machine # [ 34.601242] k3s[893]: I0930 09:11:15.295989 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzgjk\" (UniqueName: \"kubernetes.io/projected/3481ae27-f668-4a4c-8b39-1cb4115dbe26-kube-api-access-tzgjk\") pod \"coredns-54996dc9b4-tx6k2\" (UID: \"3481ae27-f668-4a4c-8b39-1cb4115dbe26\") " pod="kube-system/coredns-54996dc9b4-tx6k2"1787machine # [ 34.606352] k3s[893]: I0930 09:11:15.296037 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/8051ea51-bc98-4227-9a5c-d287c5adcd0f-klipper-helm\") pod \"helm-install-nix-grpc-farm-qhfr7\" (UID: \"8051ea51-bc98-4227-9a5c-d287c5adcd0f\") " pod="kube-system/helm-install-nix-grpc-farm-qhfr7"1788machine # [ 34.610888] k3s[893]: I0930 09:11:15.300839 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8051ea51-bc98-4227-9a5c-d287c5adcd0f-tmp\") pod \"helm-install-nix-grpc-farm-qhfr7\" (UID: \"8051ea51-bc98-4227-9a5c-d287c5adcd0f\") " pod="kube-system/helm-install-nix-grpc-farm-qhfr7"1789machine # [ 34.615413] k3s[893]: I0930 09:11:15.300870 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"content\" (UniqueName: \"kubernetes.io/configmap/8051ea51-bc98-4227-9a5c-d287c5adcd0f-content\") pod \"helm-install-nix-grpc-farm-qhfr7\" (UID: \"8051ea51-bc98-4227-9a5c-d287c5adcd0f\") " pod="kube-system/helm-install-nix-grpc-farm-qhfr7"1790machine # [ 34.619956] k3s[893]: I0930 09:11:15.300900 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/8051ea51-bc98-4227-9a5c-d287c5adcd0f-klipper-cache\") pod \"helm-install-nix-grpc-farm-qhfr7\" (UID: \"8051ea51-bc98-4227-9a5c-d287c5adcd0f\") " pod="kube-system/helm-install-nix-grpc-farm-qhfr7"1791machine # [ 34.624479] k3s[893]: I0930 09:11:15.300924 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/8051ea51-bc98-4227-9a5c-d287c5adcd0f-klipper-config\") pod \"helm-install-nix-grpc-farm-qhfr7\" (UID: \"8051ea51-bc98-4227-9a5c-d287c5adcd0f\") " pod="kube-system/helm-install-nix-grpc-farm-qhfr7"1792machine # [ 34.629100] k3s[893]: I0930 09:11:15.300951 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"values\" (UniqueName: \"kubernetes.io/projected/8051ea51-bc98-4227-9a5c-d287c5adcd0f-values\") pod \"helm-install-nix-grpc-farm-qhfr7\" (UID: \"8051ea51-bc98-4227-9a5c-d287c5adcd0f\") " pod="kube-system/helm-install-nix-grpc-farm-qhfr7"1793machine # [ 34.633556] k3s[893]: I0930 09:11:15.300979 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7cvt\" (UniqueName: \"kubernetes.io/projected/8051ea51-bc98-4227-9a5c-d287c5adcd0f-kube-api-access-b7cvt\") pod \"helm-install-nix-grpc-farm-qhfr7\" (UID: \"8051ea51-bc98-4227-9a5c-d287c5adcd0f\") " pod="kube-system/helm-install-nix-grpc-farm-qhfr7"1794machine # [ 34.638792] systemd[1]: Created slice libcontainer container kubepods-burstable-pod3481ae27_f668_4a4c_8b39_1cb4115dbe26.slice.1795machine # [ 34.640617] systemd[1]: Created slice libcontainer container kubepods-burstable-pod8051ea51_bc98_4227_9a5c_d287c5adcd0f.slice.1796machine # [ 34.655146] k3s[893]: I0930 09:11:15.371093 893 server.go:228] "Successfully retrieved NodeIPs" NodeIPs=["10.0.2.15","fec0::d1f1:69b2:979a:597a"]1797machine # [ 34.657417] k3s[893]: E0930 09:11:15.373369 893 server.go:265] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"1798machine # [ 34.678875] k3s[893]: I0930 09:11:15.394839 893 server.go:274] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"1799machine # [ 34.679683] k3s[893]: I0930 09:11:15.394880 893 server_linux.go:137] "Using iptables Proxier"1800machine # [ 34.698079] k3s[893]: I0930 09:11:15.413973 893 proxier.go:241] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"1801machine # [ 34.710919] k3s[893]: I0930 09:11:15.426904 893 server.go:539] "Version info" version="v1.36.4+k3s1"1802machine # [ 34.711726] k3s[893]: I0930 09:11:15.426936 893 server.go:541] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""1803machine # [ 34.713119] k3s[893]: I0930 09:11:15.428143 893 config.go:106] "Starting endpoint slice config controller"1804machine # [ 34.714045] k3s[893]: I0930 09:11:15.428198 893 shared_informer.go:381] "Waiting for caches to sync" controller="endpoint slice config"1805machine # [ 34.714920] k3s[893]: I0930 09:11:15.428347 893 config.go:309] "Starting node config controller"1806machine # [ 34.715761] k3s[893]: I0930 09:11:15.428365 893 shared_informer.go:381] "Waiting for caches to sync" controller="node config"1807machine # [ 34.716714] k3s[893]: I0930 09:11:15.428379 893 shared_informer.go:388] "Caches are synced" controller="node config"1808machine # [ 34.717522] k3s[893]: I0930 09:11:15.428684 893 config.go:200] "Starting service config controller"1809machine # [ 34.718413] k3s[893]: I0930 09:11:15.428700 893 config.go:403] "Starting serviceCIDR config controller"1810machine # [ 34.719182] k3s[893]: I0930 09:11:15.428715 893 shared_informer.go:381] "Waiting for caches to sync" controller="serviceCIDR config"1811machine # [ 34.719909] k3s[893]: I0930 09:11:15.428703 893 shared_informer.go:381] "Waiting for caches to sync" controller="service config"1812machine # [ 34.815315] k3s[893]: I0930 09:11:15.531032 893 kube.go:163] Node controller sync successful1813machine # [ 34.816094] k3s[893]: I0930 09:11:15.531150 893 vxlan.go:128] VXLAN config: VNI=1 Port=0 GBP=false Learning=false DirectRouting=false1814machine # [ 34.818727] k3s[893]: I0930 09:11:15.534706 893 kube.go:704] List of node(machine) annotations: map[string]string{"alpha.kubernetes.io/provided-node-ip":"10.0.2.15,fec0::d1f1:69b2:979a:597a", "k3s.io/hostname":"machine", "k3s.io/internal-ip":"10.0.2.15,fec0::d1f1:69b2:979a:597a", "k3s.io/node-args":"[\"server\",\"--disable\",\"traefik\",\"--disable\",\"metrics-server\",\"--disable\",\"local-storage\",\"--kubelet-arg\",\"eviction-hard=nodefs.available\\u003c1%,imagefs.available\\u003c1%\"]", "k3s.io/node-config-hash":"EFXPOZ7ZWHRCLFNW4X4ZDPFQMSAOP3BLEIN2VE47TDRKQ4UIWKUQ====", "k3s.io/node-env":"{}", "node.alpha.kubernetes.io/ttl":"0", "volumes.kubernetes.io/controller-managed-attach-detach":"true"}1815machine # [ 34.841055] (udev-worker)[1283]: Network interface NamePolicy= disabled on kernel command line.1816machine # [ 34.847872] k3s[893]: I0930 09:11:15.563513 893 iptables.go:50] Starting flannel in iptables mode...1817machine # [ 34.848473] k3s[893]: time="2026-09-30T09:11:15Z" level=warning msg="no subnet found for key: FLANNEL_NETWORK in file: /run/flannel/subnet.env"1818machine # [ 34.849023] k3s[893]: time="2026-09-30T09:11:15Z" level=warning msg="no subnet found for key: FLANNEL_SUBNET in file: /run/flannel/subnet.env"1819machine # [ 34.849499] k3s[893]: time="2026-09-30T09:11:15Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_NETWORK in file: /run/flannel/subnet.env"1820machine # [ 34.851086] k3s[893]: time="2026-09-30T09:11:15Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_SUBNET in file: /run/flannel/subnet.env"1821machine # [ 34.851639] k3s[893]: I0930 09:11:15.563616 893 iptables.go:101] Current network or subnet (10.42.0.0/16, 10.42.0.0/24) is not equal to previous one (0.0.0.0/0, 0.0.0.0/0), trying to recycle old iptables rules1822machine # [ 34.859661] k3s[893]: I0930 09:11:15.575655 893 kube.go:558] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.42.0.0/24]1823machine # [ 34.881654] dhcpcd[673]: flannel.1: IAID eb:85:d8:f31824machine # [ 34.882230] dhcpcd[673]: flannel.1: adding address fe80::8027:ebff:fe85:d8f31825machine # [ 34.912665] k3s[893]: I0930 09:11:15.628622 893 shared_informer.go:388] "Caches are synced" controller="endpoint slice config"1826machine # [ 34.913516] k3s[893]: I0930 09:11:15.628993 893 iptables.go:111] Setting up masking rules1827machine # [ 34.914061] k3s[893]: I0930 09:11:15.629285 893 shared_informer.go:388] "Caches are synced" controller="service config"1828machine # [ 34.914572] k3s[893]: I0930 09:11:15.629414 893 shared_informer.go:388] "Caches are synced" controller="serviceCIDR config"1829machine # [ 34.923637] k3s[893]: I0930 09:11:15.639617 893 iptables.go:212] Changing default FORWARD chain policy to ACCEPT1830machine # [ 34.933553] k3s[893]: time="2026-09-30T09:11:15Z" level=info msg="Wrote flannel subnet file to /run/flannel/subnet.env"1831machine # [ 34.934309] k3s[893]: time="2026-09-30T09:11:15Z" level=info msg="Running flannel backend"1832machine # [ 34.935583] k3s[893]: I0930 09:11:15.649534 893 vxlan_network.go:68] watching for new subnet leases1833machine # [ 34.936498] k3s[893]: I0930 09:11:15.649572 893 vxlan_network.go:115] starting vxlan device watcher1834machine # [ 35.145747] cni0: port 1(vetha05d2b7c) entered blocking state1835machine # [ 35.147204] cni0: port 1(vetha05d2b7c) entered disabled state1836machine # [ 35.147957] vetha05d2b7c: entered allmulticast mode1837machine # [ 35.149083] vetha05d2b7c: entered promiscuous mode1838machine # [ 35.151807] cni0: port 2(veth37a2a4a7) entered blocking state1839machine # [ 34.996884] ([ 35.152575] cni0: port 2(veth37a2a4a7) entered disabled state1840machine # udev-worker)[1423]: Network interface NamePolicy= disabled on kernel command line.1841machine # [ 34.999746] (udev-worker)[1425]: Network interface NamePolicy[ 35.155470] veth37a2a4a7: entered allmulticast mode1842machine # = disabled on kernel command line.1843machine # [ 35.156874] veth37a2a4a7: entered promiscuous mode1844machine # [ 35.165378] cni0: port 1(vetha05d2b7c) entered blocking state1845machine # [ 35.166048] cni0: port 1(vetha05d2b7c) entered forwarding state1846machine # [ 35.171521] cni0: port 2(veth37a2a4a7) entered blocking state1847machine # [ 35.172219] cni0: port 2(veth37a2a4a7) entered forwarding state1848machine # [ 35.018197] k3s[893]: I0930 09:11:15.734194 893 iptables.go:358] bootstrap done1849machine # [ 35.037192] dhcpcd[673]: vetha05d2b7c: IAID 31:32:17:6d1850machine # [ 35.037953] dhcpcd[673]: vetha05d2b7c: adding address fe80::2c5d:31ff:fe32:176d1851machine # [ 35.050676] dhcpcd[673]: veth37a2a4a7: IAID 72:be:73:9e1852machine # [ 35.051472] dhcpcd[673]: veth37a2a4a7: adding address fe80::c493:72ff:febe:739e1853machine # [ 35.094930] k3s[893]: I0930 09:11:15.810897 893 iptables.go:358] bootstrap done1854machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found1855machine # [ 35.217979] dhcpcd[673]: vetha05d2b7c: soliciting a DHCP lease1856machine # [ 35.223312] systemd[1]: Started libcontainer container 012c4da0481928ccc80c98822e2af9eb5fc55ca1491702feb4ce998366fe6754.1857machine # [ 35.227398] systemd[1]: Started libcontainer container f4bdc488c80da4f739c4c1f70d1141a0c47c12167dca015d426b958e8e153684.1858machine # [ 35.528091] dhcpcd[673]: veth37a2a4a7: soliciting a DHCP lease1859machine # [ 35.604468] dhcpcd[673]: flannel.1: soliciting a DHCP lease1860machine # [ 35.911830] k3s[893]: time="2026-09-30T09:11:16Z" level=info msg="Starting network policy controller version v2.6.3-k3s1, built on 1970-01-01T01:01:01Z, go1.26.7"1861machine # [ 35.913910] k3s[893]: I0930 09:11:16.626312 893 network_policy_controller.go:164] Starting network policy controller1862machine # [ 36.115091] k3s[893]: I0930 09:11:16.831023 893 network_policy_controller.go:179] Starting network policy controller full sync goroutine1863machine # [ 36.254883] systemd[1]: Started libcontainer container cec97b43900135520daffc31cf10d8fd480e60afc012e8c553916e4bb4e3e9d1.1864machine # [ 36.334627] k3s[893]: I0930 09:11:17.050554 893 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/coredns-54996dc9b4-tx6k2" podStartSLOduration=8.050534212 podStartE2EDuration="8.050534212s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-30 09:11:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 09:11:17.047620993 +0000 UTC m=+18.946605783" watchObservedRunningTime="2026-09-30 09:11:17.050534212 +0000 UTC m=+18.949518723"1865machine # [ 36.401454] systemd[1]: Started libcontainer container 967efb03b5aaacb5f35431d4572b3ed8afa884c6c105baac5b9364f92cc04fe6.1866machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found1867machine # [ 36.709103] k3s[893]: I0930 09:11:17.424533 893 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/helm-install-nix-grpc-farm-qhfr7" podStartSLOduration=7.424512469 podStartE2EDuration="7.424512469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-30 09:11:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 09:11:17.223384951 +0000 UTC m=+19.122369462" watchObservedRunningTime="2026-09-30 09:11:17.424512469 +0000 UTC m=+19.323496980"1868machine # [ 37.002597] k3s[893]: I0930 09:11:17.718177 893 alloc.go:329] "allocated clusterIPs" service="farm/nix-grpc-farm" clusterIPs={"IPv4":"10.43.13.142"}1869machine # [ 37.020085] dhcpcd[673]: vetha05d2b7c: soliciting an IPv6 router1870machine # [ 37.047178] systemd[1]: cri-containerd-967efb03b5aaacb5f35431d4572b3ed8afa884c6c105baac5b9364f92cc04fe6.scope: Deactivated successfully.1871machine # [ 37.048177] systemd[1]: cri-containerd-967efb03b5aaacb5f35431d4572b3ed8afa884c6c105baac5b9364f92cc04fe6.scope: Consumed 565ms CPU time over 644ms wall clock time, 33.2M memory peak, 2.6M incoming IP traffic, 149.1K outgoing IP traffic.1872machine # [ 37.073399] dhcpcd[673]: veth37a2a4a7: soliciting an IPv6 router1873machine # [ 37.098902] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-967efb03b5aaacb5f35431d4572b3ed8afa884c6c105baac5b9364f92cc04fe6-rootfs.mount: Deactivated successfully.1874machine # [ 37.287719] dhcpcd[673]: flannel.1: soliciting an IPv6 router1875machine # [ 37.548159] k3s[893]: E0930 09:11:18.262745 893 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-scheduler-55cccf6d96\" failed with read version: 445 is not as new as written version: 464 for group resource replicasets.apps" logger="UnhandledError"1876machine # [ 37.551979] k3s[893]: E0930 09:11:18.267974 893 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-scheduler-55cccf6d96\" failed with read version: 461 is not as new as written version: 464 for group resource replicasets.apps" logger="UnhandledError"1877machine # [ 37.580289] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod7477ebf2_36f9_41a2_8835_bd50d60da8d3.slice.1878machine # [ 37.601547] systemd[1]: Created slice libcontainer container kubepods-besteffort-podaa9c277f_ac4b_471a_a8f0_6de9cbf83412.slice.1879machine # [ 37.607157] k3s[893]: I0930 09:11:18.323162 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/0b0c8596-fffc-4b8c-9bd8-0cbb61a9c762-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bkxj8\" (UID: \"0b0c8596-fffc-4b8c-9bd8-0cbb61a9c762\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bkxj8"1880machine # [ 37.607720] k3s[893]: I0930 09:11:18.323736 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/0b0c8596-fffc-4b8c-9bd8-0cbb61a9c762-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bkxj8\" (UID: \"0b0c8596-fffc-4b8c-9bd8-0cbb61a9c762\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bkxj8"1881machine # [ 37.609071] k3s[893]: I0930 09:11:18.324329 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/0b0c8596-fffc-4b8c-9bd8-0cbb61a9c762-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bkxj8\" (UID: \"0b0c8596-fffc-4b8c-9bd8-0cbb61a9c762\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bkxj8"1882machine # [ 37.609762] k3s[893]: I0930 09:11:18.324376 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/7477ebf2-36f9-41a2-8835-bd50d60da8d3-tls-lb\") pod \"nix-grpc-farm-lb-5877cc8b4f-mjhbp\" (UID: \"7477ebf2-36f9-41a2-8835-bd50d60da8d3\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-mjhbp"1883machine # [ 37.610391] k3s[893]: I0930 09:11:18.324406 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/54ee40a6-7864-401e-b1c3-8392eb29c712-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g\" (UID: \"54ee40a6-7864-401e-b1c3-8392eb29c712\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g"1884machine # [ 37.610936] k3s[893]: I0930 09:11:18.324430 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/54ee40a6-7864-401e-b1c3-8392eb29c712-build\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g\" (UID: \"54ee40a6-7864-401e-b1c3-8392eb29c712\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g"1885machine # [ 37.612524] k3s[893]: I0930 09:11:18.324453 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/aa9c277f-ac4b-471a-a8f0-6de9cbf83412-oidc\") pod \"nix-grpc-farm-scheduler-55cccf6d96-skplc\" (UID: \"aa9c277f-ac4b-471a-a8f0-6de9cbf83412\") " pod="farm/nix-grpc-farm-scheduler-55cccf6d96-skplc"1886machine # [ 37.613061] k3s[893]: I0930 09:11:18.324476 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/0b0c8596-fffc-4b8c-9bd8-0cbb61a9c762-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bkxj8\" (UID: \"0b0c8596-fffc-4b8c-9bd8-0cbb61a9c762\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bkxj8"1887machine # [ 37.613556] k3s[893]: I0930 09:11:18.324498 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7477ebf2-36f9-41a2-8835-bd50d60da8d3-tmp\") pod \"nix-grpc-farm-lb-5877cc8b4f-mjhbp\" (UID: \"7477ebf2-36f9-41a2-8835-bd50d60da8d3\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-mjhbp"1888machine # [ 37.614120] k3s[893]: I0930 09:11:18.324525 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/0b0c8596-fffc-4b8c-9bd8-0cbb61a9c762-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bkxj8\" (UID: \"0b0c8596-fffc-4b8c-9bd8-0cbb61a9c762\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bkxj8"1889machine # [ 37.614562] k3s[893]: I0930 09:11:18.324547 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/aa9c277f-ac4b-471a-a8f0-6de9cbf83412-tls\") pod \"nix-grpc-farm-scheduler-55cccf6d96-skplc\" (UID: \"aa9c277f-ac4b-471a-a8f0-6de9cbf83412\") " pod="farm/nix-grpc-farm-scheduler-55cccf6d96-skplc"1890machine # [ 37.615955] k3s[893]: I0930 09:11:18.324570 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/54ee40a6-7864-401e-b1c3-8392eb29c712-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g\" (UID: \"54ee40a6-7864-401e-b1c3-8392eb29c712\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g"1891machine # [ 37.616611] k3s[893]: I0930 09:11:18.324601 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/54ee40a6-7864-401e-b1c3-8392eb29c712-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g\" (UID: \"54ee40a6-7864-401e-b1c3-8392eb29c712\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g"1892machine # [ 37.620474] k3s[893]: I0930 09:11:18.324625 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/54ee40a6-7864-401e-b1c3-8392eb29c712-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g\" (UID: \"54ee40a6-7864-401e-b1c3-8392eb29c712\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g"1893machine # [ 37.624569] k3s[893]: I0930 09:11:18.324650 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/aa9c277f-ac4b-471a-a8f0-6de9cbf83412-niks3-token\") pod \"nix-grpc-farm-scheduler-55cccf6d96-skplc\" (UID: \"aa9c277f-ac4b-471a-a8f0-6de9cbf83412\") " pod="farm/nix-grpc-farm-scheduler-55cccf6d96-skplc"1894machine # [ 37.628967] k3s[893]: I0930 09:11:18.324675 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/0b0c8596-fffc-4b8c-9bd8-0cbb61a9c762-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bkxj8\" (UID: \"0b0c8596-fffc-4b8c-9bd8-0cbb61a9c762\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bkxj8"1895machine # [ 37.633491] k3s[893]: I0930 09:11:18.324699 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ckxg\" (UniqueName: \"kubernetes.io/projected/0b0c8596-fffc-4b8c-9bd8-0cbb61a9c762-kube-api-access-7ckxg\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bkxj8\" (UID: \"0b0c8596-fffc-4b8c-9bd8-0cbb61a9c762\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bkxj8"1896machine # [ 37.637935] k3s[893]: I0930 09:11:18.324729 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/54ee40a6-7864-401e-b1c3-8392eb29c712-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g\" (UID: \"54ee40a6-7864-401e-b1c3-8392eb29c712\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g"1897machine # [ 37.677290] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod54ee40a6_7864_401e_b1c3_8392eb29c712.slice.1898machine # [ 37.678056] k3s[893]: I0930 09:11:18.324752 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/54ee40a6-7864-401e-b1c3-8392eb29c712-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g\" (UID: \"54ee40a6-7864-401e-b1c3-8392eb29c712\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g"1899machine # [ 37.678428] k3s[893]: I0930 09:11:18.324778 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2r6m\" (UniqueName: \"kubernetes.io/projected/54ee40a6-7864-401e-b1c3-8392eb29c712-kube-api-access-c2r6m\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g\" (UID: \"54ee40a6-7864-401e-b1c3-8392eb29c712\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g"1900machine # [ 37.678946] k3s[893]: I0930 09:11:18.324800 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/aa9c277f-ac4b-471a-a8f0-6de9cbf83412-ca\") pod \"nix-grpc-farm-scheduler-55cccf6d96-skplc\" (UID: \"aa9c277f-ac4b-471a-a8f0-6de9cbf83412\") " pod="farm/nix-grpc-farm-scheduler-55cccf6d96-skplc"1901machine # [ 37.679650] k3s[893]: I0930 09:11:18.324827 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0b0c8596-fffc-4b8c-9bd8-0cbb61a9c762-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bkxj8\" (UID: \"0b0c8596-fffc-4b8c-9bd8-0cbb61a9c762\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bkxj8"1902machine # [ 37.680228] k3s[893]: I0930 09:11:18.324853 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7477ebf2-36f9-41a2-8835-bd50d60da8d3-config\") pod \"nix-grpc-farm-lb-5877cc8b4f-mjhbp\" (UID: \"7477ebf2-36f9-41a2-8835-bd50d60da8d3\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-mjhbp"1903machine # [ 37.680747] k3s[893]: I0930 09:11:18.324879 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/7477ebf2-36f9-41a2-8835-bd50d60da8d3-tls-ca\") pod \"nix-grpc-farm-lb-5877cc8b4f-mjhbp\" (UID: \"7477ebf2-36f9-41a2-8835-bd50d60da8d3\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-mjhbp"1904machine # [ 37.681410] k3s[893]: I0930 09:11:18.324908 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/0b0c8596-fffc-4b8c-9bd8-0cbb61a9c762-build\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bkxj8\" (UID: \"0b0c8596-fffc-4b8c-9bd8-0cbb61a9c762\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bkxj8"1905machine # [ 37.681972] k3s[893]: I0930 09:11:18.324936 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/54ee40a6-7864-401e-b1c3-8392eb29c712-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g\" (UID: \"54ee40a6-7864-401e-b1c3-8392eb29c712\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g"1906machine # [ 37.682657] k3s[893]: I0930 09:11:18.324960 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h2zc\" (UniqueName: \"kubernetes.io/projected/aa9c277f-ac4b-471a-a8f0-6de9cbf83412-kube-api-access-2h2zc\") pod \"nix-grpc-farm-scheduler-55cccf6d96-skplc\" (UID: \"aa9c277f-ac4b-471a-a8f0-6de9cbf83412\") " pod="farm/nix-grpc-farm-scheduler-55cccf6d96-skplc"1907machine # [ 37.757250] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod0b0c8596_fffc_4b8c_9bd8_0cbb61a9c762.slice.1908machine # [ 37.968678] cni0: port 3(veth62bcc118) entered blocking state1909machine # [ 37.969448] cni0: port 3(veth62bcc118) entered disabled state1910machine # [ 37.970073] veth62bcc118: entered allmulticast mode1911machine # [ 37.971041] veth62bcc118: entered promiscuous mode1912machine # [ 37.818370] (udev-worker)[1917]: Network interface NamePolicy= disabled on kernel command line.1913machine # [ 37.981310] cni0: port 3(veth62bcc118) entered blocking state1914machine # [ 37.982011] cni0: port 3(veth62bcc118) entered forwarding state1915machine # [ 37.857095] dhcpcd[673]: veth62bcc118: IAID 86:95:23:3c1916machine # [ 37.857619] dhcpcd[673]: veth62bcc118: adding address fe80::189d:86ff:fe95:233c1917machine # [ 38.083379] cni0: port 4(vethf8c156b6) entered blocking state1918machine # [ 37.928503] s[ 38.084075] cni0: port 4(vethf8c156b6) entered disabled state1919machine # ystemd[1]: Started libcontainer container 9642e0c045351f8e8936e946f5ea61c38cb2c0a08bb5bc9154e15476d384e780.1920machine # [ 38.087381] vethf8c156b6: entered allmulticast mode1921machine # [ 38.088081] vethf8c156b6: entered promiscuous mode1922machine # [ 37.935240] (udev-worker)[2022]: Network interface NamePolicy= disabled on kernel command line.1923machine # [ 38.097985] cni0: port 4(vethf8c156b6) entered blocking state1924machine # [ 38.098740] cni0: port 4(vethf8c156b6) entered forwarding state1925machine # [ 37.964479] dhcpcd[673]: vethf8c156b6: IAID 4e:8c:71:611926machine # [ 37.965186] dhcpcd[673]: vethf8c156b6: adding address fe80::cc94:4eff:fe8c:71611927machine # [ 38.020514] k3s[893]: E0930 09:11:18.736172 893 remote_image.go:250] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.4"1928machine # [ 38.021246] k3s[893]: E0930 09:11:18.736252 893 kuberuntime_image.go:43] "Failed to pull image" err="failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.4"1929machine # [ 38.021791] k3s[893]: E0930 09:11:18.736476 893 kuberuntime_manager.go:1760] "Unhandled Error" err="init container seed-store start failed in pod nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bkxj8_farm(0b0c8596-fffc-4b8c-9bd8-0cbb61a9c762): ErrImagePull: failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" logger="UnhandledError"1930machine # [ 38.022545] k3s[893]: E0930 09:11:18.736536 893 pod_workers.go:1338] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bkxj8" podUID="0b0c8596-fffc-4b8c-9bd8-0cbb61a9c762"1931machine # [ 38.218965] cni0: port 5(veth8a46ad31) entered blocking state1932machine # [ 38.221024] cni0: port 5(veth8a46ad31) entered disabled state1933machine # [ 38.222177] veth8a46ad31: entered allmulticast mode1934machine # [ 38.222926] veth8a46ad31: entered promiscuous mode1935machine # [ 38.079262] systemd[1]: Started libcontainer container e0cf794bb9a7199fb37d3c29d8d8fe9d0c4e4d35d8ed92f43f7dfd11e9c9773a.1936machine # [ 38.242521] cni0: port 5(veth8a46ad31) entered blocking state1937machine # [ 38.243289] cni0: port 5(veth8a46ad31) entered forwarding state1938machine # [ 38.281223] cni0: port 6(veth35a0ba08) entered blocking state1939machine # [ 38.126266] d[ 38.281873] cni0: port 6(veth35a0ba08) entered disabled state1940machine # hcpcd[673]: veth8a46ad31: waiting for carrier[ 38.283006] veth35a0ba08: entered allmulticast mode1941machine # 1942machine # [ 38.283907] veth35a0ba08: entered promiscuous mode1943machine # [ 38.129628] dhcpcd[673]: veth8a46ad31: carrier acquired1944machine # [ 38.141826] dhcpcd[673]: veth8a46ad31: IAID 58:7e:41:401945machine # [ 38.142761] dhcpcd[673]: veth8a46ad31: adding address fe80::44c4:58ff:fe7e:41401946machine # [ 38.306159] cni0: port 6(veth35a0ba08) entered blocking state1947machine # [ 38.306853] cni0: port 6(veth35a0ba08) entered forwarding state1948machine # [ 38.178779] dhcpcd[673]: veth35a0ba08: waiting for carrier1949machine # [ 38.180514] dhcpcd[673]: veth35a0ba08: old hardware address: 22:97:44:cd:4d:c81950machine # [ 38.181101] dhcpcd[673]: veth35a0ba08: new hardware address: 72:9f:d2:08:3e:b91951machine # [ 38.181557] dhcpcd[673]: veth35a0ba08: old hardware address: 72:9f:d2:08:3e:b91952machine # [ 38.182694] dhcpcd[673]: veth35a0ba08: new hardware address: 22:97:44:cd:4d:c81953machine # [ 38.186099] dhcpcd[673]: veth35a0ba08: carrier acquired1954machine # [ 38.189772] dhcpcd[673]: veth35a0ba08: IAID 44:cd:4d:c81955machine # [ 38.190744] dhcpcd[673]: veth35a0ba08: adding address fe80::2097:44ff:fecd:4dc81956machine # [ 38.239282] systemd[1]: Started libcontainer container 8ef59428307b3cbb5baef70e0486afd58fb10fdb523efd7edd8dd06b1412f75d.1957machine # [ 38.284519] systemd[1]: Started libcontainer container 9fc4c8a4746c15bd2520f4717639d4e4965e9baf0fe1b083b61a30013e9784df.1958machine # [ 38.336155] k3s[893]: E0930 09:11:19.050274 893 remote_image.go:250] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.4"1959machine # [ 38.336740] k3s[893]: E0930 09:11:19.050332 893 kuberuntime_image.go:43] "Failed to pull image" err="failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.4"1960machine # [ 38.337203] k3s[893]: E0930 09:11:19.050568 893 kuberuntime_manager.go:1760] "Unhandled Error" err="container nix-grpc-daemon start failed in pod nix-grpc-farm-scheduler-55cccf6d96-skplc_farm(aa9c277f-ac4b-471a-a8f0-6de9cbf83412): ErrImagePull: failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" logger="UnhandledError"1961machine # [ 38.337770] k3s[893]: E0930 09:11:19.050644 893 pod_workers.go:1338] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nix-grpc-daemon\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-scheduler-55cccf6d96-skplc" podUID="aa9c277f-ac4b-471a-a8f0-6de9cbf83412"1962machine # [ 38.354693] dhcpcd[673]: veth62bcc118: soliciting a DHCP lease1963machine # [ 38.408398] k3s[893]: E0930 09:11:19.124329 893 remote_image.go:250] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.4"1964machine # [ 38.409189] k3s[893]: E0930 09:11:19.124377 893 kuberuntime_image.go:43] "Failed to pull image" err="failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.4"1965machine # [ 38.409950] k3s[893]: E0930 09:11:19.124589 893 kuberuntime_manager.go:1760] "Unhandled Error" err="init container seed-store start failed in pod nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g_farm(54ee40a6-7864-401e-b1c3-8392eb29c712): ErrImagePull: failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" logger="UnhandledError"1966machine # [ 38.410630] k3s[893]: E0930 09:11:19.124674 893 pod_workers.go:1338] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g" podUID="54ee40a6-7864-401e-b1c3-8392eb29c712"1967machine # [ 38.684294] k3s[893]: I0930 09:11:19.400221 893 node_lifecycle_controller.go:1217] "Initializing eviction metric for zone" zone=""1968machine # [ 38.685144] k3s[893]: I0930 09:11:19.400330 893 node_lifecycle_controller.go:869] "Missing timestamp for Node. Assuming now as a timestamp" node="machine"1969machine # [ 38.685590] k3s[893]: I0930 09:11:19.400422 893 node_lifecycle_controller.go:1063] "Controller detected that zone is now in new state" zone="" newState="Normal"1970machine # [ 38.731548] systemd[1]: Started libcontainer container 458643a49cfbbcb7e4db46f3535fc4c2f05728fba4339a9b4a14fb717a94f2f8.1971machine # [ 38.748601] k3s[893]: E0930 09:11:19.464230 893 pod_workers.go:1338] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ImagePullBackOff: \"Back-off pulling image \\\"nix-grpc-farm:0.1.0-beta.4\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g" podUID="54ee40a6-7864-401e-b1c3-8392eb29c712"1972machine # [ 38.753028] k3s[893]: E0930 09:11:19.466999 893 pod_workers.go:1338] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nix-grpc-daemon\" with ImagePullBackOff: \"Back-off pulling image \\\"nix-grpc-farm:0.1.0-beta.4\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-scheduler-55cccf6d96-skplc" podUID="aa9c277f-ac4b-471a-a8f0-6de9cbf83412"1973machine # [ 38.764104] k3s[893]: E0930 09:11:19.480096 893 pod_workers.go:1338] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ImagePullBackOff: \"Back-off pulling image \\\"nix-grpc-farm:0.1.0-beta.4\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bkxj8" podUID="0b0c8596-fffc-4b8c-9bd8-0cbb61a9c762"1974machine # [ 38.777733] systemd[1]: cri-containerd-012c4da0481928ccc80c98822e2af9eb5fc55ca1491702feb4ce998366fe6754.scope: Deactivated successfully.1975machine # [ 38.847053] k3s[893]: I0930 09:11:19.562996 893 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-5877cc8b4f-mjhbp" podStartSLOduration=1.5629585559999999 podStartE2EDuration="1.562958556s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-30 09:11:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 09:11:19.562290874 +0000 UTC m=+21.461275385" watchObservedRunningTime="2026-09-30 09:11:19.562958556 +0000 UTC m=+21.461958153"1976machine # [ 38.967957] k3s[893]: time="2026-09-30T09:11:19Z" level=info msg="Imported docker.io/library/nix-grpc-farm:0.1.0-beta.4"1977machine # [ 38.970582] k3s[893]: time="2026-09-30T09:11:19Z" level=info msg="Tagged docker.io/library/nix-grpc-farm@sha256:9830041d82f33e5a909478ed85a09014d43cfeabb7a5b89b45c751058415b487"1978machine # [ 39.163591] cni0: port 1(vetha05d2b7c) entered disabled state1979machine # [ 39.009158] dhcpcd[673]: vetha05d2b7c: carrier lost1980machine # [ 39.165680] vetha05d2b7c (unregistering): left allmulticast mode1981machine # [ 39.166618] vetha05d2b7c (unregistering): left promiscuous mode1982machine # [ 39.167377] cni0: port 1(vetha05d2b7c) entered disabled state1983machine # [ 39.037316] dhcpcd[673]: vetha05d2b7c: deleting address fe80::2c5d:31ff:fe32:176d1984machine # [ 39.073420] dhcpcd[673]: vetha05d2b7c: removing interface1985machine # [ 39.104700] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-012c4da0481928ccc80c98822e2af9eb5fc55ca1491702feb4ce998366fe6754-rootfs.mount: Deactivated successfully.1986machine # [ 39.105636] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-012c4da0481928ccc80c98822e2af9eb5fc55ca1491702feb4ce998366fe6754-shm.mount: Deactivated successfully.1987machine # [ 39.106555] systemd[1]: run-netns-cni\x2dd5964384\x2db5b5\x2dfeac\x2daa5d\x2d202264388fcf.mount: Deactivated successfully.1988machine # [ 39.135429] k3s[893]: I0930 09:11:19.851111 893 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8051ea51-bc98-4227-9a5c-d287c5adcd0f-klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/8051ea51-bc98-4227-9a5c-d287c5adcd0f-klipper-helm\") pod \"8051ea51-bc98-4227-9a5c-d287c5adcd0f\" (UID: \"8051ea51-bc98-4227-9a5c-d287c5adcd0f\") "1989machine # [ 39.136266] k3s[893]: I0930 09:11:19.851156 893 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8051ea51-bc98-4227-9a5c-d287c5adcd0f-klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/8051ea51-bc98-4227-9a5c-d287c5adcd0f-klipper-cache\") pod \"8051ea51-bc98-4227-9a5c-d287c5adcd0f\" (UID: \"8051ea51-bc98-4227-9a5c-d287c5adcd0f\") "1990machine # [ 39.137643] k3s[893]: I0930 09:11:19.851196 893 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8051ea51-bc98-4227-9a5c-d287c5adcd0f-content\" (UniqueName: \"kubernetes.io/configmap/8051ea51-bc98-4227-9a5c-d287c5adcd0f-content\") pod \"8051ea51-bc98-4227-9a5c-d287c5adcd0f\" (UID: \"8051ea51-bc98-4227-9a5c-d287c5adcd0f\") "1991machine # [ 39.138657] k3s[893]: I0930 09:11:19.851235 893 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8051ea51-bc98-4227-9a5c-d287c5adcd0f-values\" (UniqueName: \"kubernetes.io/projected/8051ea51-bc98-4227-9a5c-d287c5adcd0f-values\") pod \"8051ea51-bc98-4227-9a5c-d287c5adcd0f\" (UID: \"8051ea51-bc98-4227-9a5c-d287c5adcd0f\") "1992machine # [ 39.139452] k3s[893]: I0930 09:11:19.851268 893 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8051ea51-bc98-4227-9a5c-d287c5adcd0f-kube-api-access-b7cvt\" (UniqueName: \"kubernetes.io/projected/8051ea51-bc98-4227-9a5c-d287c5adcd0f-kube-api-access-b7cvt\") pod \"8051ea51-bc98-4227-9a5c-d287c5adcd0f\" (UID: \"8051ea51-bc98-4227-9a5c-d287c5adcd0f\") "1993machine # [ 39.144562] k3s[893]: I0930 09:11:19.851297 893 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8051ea51-bc98-4227-9a5c-d287c5adcd0f-tmp\" (UniqueName: \"kubernetes.io/empty-dir/8051ea51-bc98-4227-9a5c-d287c5adcd0f-tmp\") pod \"8051ea51-bc98-4227-9a5c-d287c5adcd0f\" (UID: \"8051ea51-bc98-4227-9a5c-d287c5adcd0f\") "1994machine # [ 39.145421] k3s[893]: I0930 09:11:19.851327 893 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8051ea51-bc98-4227-9a5c-d287c5adcd0f-klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/8051ea51-bc98-4227-9a5c-d287c5adcd0f-klipper-config\") pod \"8051ea51-bc98-4227-9a5c-d287c5adcd0f\" (UID: \"8051ea51-bc98-4227-9a5c-d287c5adcd0f\") "1995machine # [ 39.146044] systemd[1]: var-lib-kubelet-pods-8051ea51\x2dbc98\x2d4227\x2d9a5c\x2dd287c5adcd0f-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dhelm.mount: Deactivated successfully.1996machine # [ 39.148545] k3s[893]: I0930 09:11:19.864494 893 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8051ea51-bc98-4227-9a5c-d287c5adcd0f-content" pod "8051ea51-bc98-4227-9a5c-d287c5adcd0f" (UID: "8051ea51-bc98-4227-9a5c-d287c5adcd0f"). InnerVolumeSpecName "content". PluginName "kubernetes.io/configmap", VolumeGIDValue ""1997machine # [ 39.153168] systemd[1]: var-lib-kubelet-pods-8051ea51\x2dbc98\x2d4227\x2d9a5c\x2dd287c5adcd0f-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2db7cvt.mount: Deactivated successfully.1998machine # [ 39.153836] systemd[1]: var-lib-kubelet-pods-8051ea51\x2dbc98\x2d4227\x2d9a5c\x2dd287c5adcd0f-volumes-kubernetes.io\x7eprojected-values.mount: Deactivated successfully.1999machine # [ 39.154434] systemd[1]: var-lib-kubelet-pods-8051ea51\x2dbc98\x2d4227\x2d9a5c\x2dd287c5adcd0f-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully.2000machine # [ 39.155571] systemd[1]: var-lib-kubelet-pods-8051ea51\x2dbc98\x2d4227\x2d9a5c\x2dd287c5adcd0f-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dcache.mount: Deactivated successfully.2001machine # [ 39.183417] k3s[893]: I0930 09:11:19.899312 893 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8051ea51-bc98-4227-9a5c-d287c5adcd0f-tmp" pod "8051ea51-bc98-4227-9a5c-d287c5adcd0f" (UID: "8051ea51-bc98-4227-9a5c-d287c5adcd0f"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""2002machine # [ 39.184198] k3s[893]: I0930 09:11:19.899623 893 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8051ea51-bc98-4227-9a5c-d287c5adcd0f-klipper-helm" pod "8051ea51-bc98-4227-9a5c-d287c5adcd0f" (UID: "8051ea51-bc98-4227-9a5c-d287c5adcd0f"). InnerVolumeSpecName "klipper-helm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""2003machine # [ 39.184976] k3s[893]: I0930 09:11:19.899718 893 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8051ea51-bc98-4227-9a5c-d287c5adcd0f-klipper-cache" pod "8051ea51-bc98-4227-9a5c-d287c5adcd0f" (UID: "8051ea51-bc98-4227-9a5c-d287c5adcd0f"). InnerVolumeSpecName "klipper-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""2004machine # [ 39.185845] k3s[893]: I0930 09:11:19.899784 893 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8051ea51-bc98-4227-9a5c-d287c5adcd0f-values" pod "8051ea51-bc98-4227-9a5c-d287c5adcd0f" (UID: "8051ea51-bc98-4227-9a5c-d287c5adcd0f"). InnerVolumeSpecName "values". PluginName "kubernetes.io/projected", VolumeGIDValue ""2005machine # [ 39.186681] k3s[893]: I0930 09:11:19.900208 893 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8051ea51-bc98-4227-9a5c-d287c5adcd0f-kube-api-access-b7cvt" pod "8051ea51-bc98-4227-9a5c-d287c5adcd0f" (UID: "8051ea51-bc98-4227-9a5c-d287c5adcd0f"). InnerVolumeSpecName "kube-api-access-b7cvt". PluginName "kubernetes.io/projected", VolumeGIDValue ""2006machine # [ 39.189183] systemd[1]: var-lib-kubelet-pods-8051ea51\x2dbc98\x2d4227\x2d9a5c\x2dd287c5adcd0f-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dconfig.mount: Deactivated successfully.2007machine # [ 39.206126] k3s[893]: I0930 09:11:19.922089 893 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8051ea51-bc98-4227-9a5c-d287c5adcd0f-klipper-config" pod "8051ea51-bc98-4227-9a5c-d287c5adcd0f" (UID: "8051ea51-bc98-4227-9a5c-d287c5adcd0f"). InnerVolumeSpecName "klipper-config". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""2008machine # [ 39.235645] k3s[893]: I0930 09:11:19.951546 893 reconciler_common.go:299] "Volume detached for volume \"content\" (UniqueName: \"kubernetes.io/configmap/8051ea51-bc98-4227-9a5c-d287c5adcd0f-content\") on node \"machine\" DevicePath \"\""2009machine # [ 39.236550] k3s[893]: I0930 09:11:19.951575 893 reconciler_common.go:299] "Volume detached for volume \"values\" (UniqueName: \"kubernetes.io/projected/8051ea51-bc98-4227-9a5c-d287c5adcd0f-values\") on node \"machine\" DevicePath \"\""2010machine # [ 39.236749] k3s[893]: I0930 09:11:19.951602 893 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7cvt\" (UniqueName: \"kubernetes.io/projected/8051ea51-bc98-4227-9a5c-d287c5adcd0f-kube-api-access-b7cvt\") on node \"machine\" DevicePath \"\""2011machine # [ 39.237440] k3s[893]: I0930 09:11:19.951618 893 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8051ea51-bc98-4227-9a5c-d287c5adcd0f-tmp\") on node \"machine\" DevicePath \"\""2012machine # [ 39.238111] k3s[893]: I0930 09:11:19.951631 893 reconciler_common.go:299] "Volume detached for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/8051ea51-bc98-4227-9a5c-d287c5adcd0f-klipper-config\") on node \"machine\" DevicePath \"\""2013machine # [ 39.238971] k3s[893]: I0930 09:11:19.951643 893 reconciler_common.go:299] "Volume detached for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/8051ea51-bc98-4227-9a5c-d287c5adcd0f-klipper-helm\") on node \"machine\" DevicePath \"\""2014machine # [ 39.239718] k3s[893]: I0930 09:11:19.951656 893 reconciler_common.go:299] "Volume detached for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/8051ea51-bc98-4227-9a5c-d287c5adcd0f-klipper-cache\") on node \"machine\" DevicePath \"\""2015machine # [ 39.337893] k3s[893]: time="2026-09-30T09:11:20Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nixos/y1hnjafq2ajj5g6jllm4jw5r60h26wyp-nix-grpc-farm.tar in 6.130749578s"2016machine # [ 39.416702] dhcpcd[673]: veth62bcc118: soliciting an IPv6 router2017machine # [ 39.589860] dhcpcd[673]: vethf8c156b6: soliciting an IPv6 router2018machine # [ 39.695764] systemd[1]: Removed slice libcontainer container kubepods-burstable-pod8051ea51_bc98_4227_9a5c_d287c5adcd0f.slice.2019machine # [ 39.697593] systemd[1]: kubepods-burstable-pod8051ea51_bc98_4227_9a5c_d287c5adcd0f.slice: Consumed 598ms CPU time over 5.077s wall clock time, 33.8M memory peak, 2.6M incoming IP traffic, 149.2K outgoing IP traffic.2020machine # [ 39.762249] k3s[893]: I0930 09:11:20.477980 893 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"2021machine # [ 39.764222] k3s[893]: E0930 09:11:20.478117 893 kubelet_pods.go:2193] "failed to read memory cgroup config for the pod" err="failed to read memory.max for cgroup /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8051ea51_bc98_4227_9a5c_d287c5adcd0f.slice: openat2 /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8051ea51_bc98_4227_9a5c_d287c5adcd0f.slice/memory.max: no such file or directory" podName="helm-install-nix-grpc-farm-qhfr7"2022machine # [ 39.765398] k3s[893]: I0930 09:11:20.478132 893 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="012c4da0481928ccc80c98822e2af9eb5fc55ca1491702feb4ce998366fe6754"2023machine # [ 39.766931] k3s[893]: E0930 09:11:20.478208 893 kubelet_pods.go:2198] "failed to read memory cgroup limits for the pod" err="failed to read cpu.max file for cgroup /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8051ea51_bc98_4227_9a5c_d287c5adcd0f.slice: openat2 /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8051ea51_bc98_4227_9a5c_d287c5adcd0f.slice/cpu.max: no such file or directory" podName="helm-install-nix-grpc-farm-qhfr7"2024machine # [ 39.794972] dhcpcd[673]: vethf8c156b6: soliciting a DHCP lease2025machine # [ 40.041965] dhcpcd[673]: veth8a46ad31: soliciting a DHCP lease2026machine # [ 40.111623] dhcpcd[673]: veth8a46ad31: soliciting an IPv6 router2027machine # [ 40.179101] dhcpcd[673]: veth35a0ba08: soliciting a DHCP lease2028machine # [ 40.529708] dhcpcd[673]: veth37a2a4a7: probing for an IPv4LL address2029machine # [ 40.605727] dhcpcd[673]: flannel.1: probing for an IPv4LL address2030machine # [ 40.725772] dhcpcd[673]: veth35a0ba08: soliciting an IPv6 router2031machine # [ 43.356311] dhcpcd[673]: veth62bcc118: probing for an IPv4LL address2032machine # [ 44.796295] dhcpcd[673]: vethf8c156b6: probing for an IPv4LL address2033machine # [ 45.043128] dhcpcd[673]: veth8a46ad31: probing for an IPv4LL address2034machine # [ 45.152916] dhcpcd[673]: flannel.1: using IPv4LL address 169.254.180.1912035machine # [ 45.155179] dhcpcd[673]: flannel.1: adding route to 169.254.0.0/162036machine # [ 45.201081] dhcpcd[673]: veth35a0ba08: probing for an IPv4LL address2037machine # [ 45.291173] dhcpcd[673]: veth37a2a4a7: using IPv4LL address 169.254.17.52038machine # [ 45.293217] dhcpcd[673]: veth37a2a4a7: adding route to 169.254.0.0/162039machine # error: timed out waiting for the condition2040machine # [ 48.730289] dhcpcd[673]: veth62bcc118: using IPv4LL address 169.254.31.2542041machine # [ 48.732959] dhcpcd[673]: veth62bcc118: adding route to 169.254.0.0/162042machine # [ 49.078260] dhcpcd[673]: veth37a2a4a7: no IPv6 Routers available2043machine # [ 49.290958] dhcpcd[673]: flannel.1: no IPv6 Routers available2044machine # [ 49.452991] dhcpcd[673]: veth35a0ba08: using IPv4LL address 169.254.58.1972045machine # [ 49.455331] dhcpcd[673]: veth35a0ba08: adding route to 169.254.0.0/162046machine # [ 49.882860] dhcpcd[673]: vethf8c156b6: using IPv4LL address 169.254.113.2082047machine # [ 49.884456] dhcpcd[673]: vethf8c156b6: adding route to 169.254.0.0/162048machine # [ 50.085621] dhcpcd[673]: veth8a46ad31: using IPv4LL address 169.254.181.1002049machine # [ 50.086875] dhcpcd[673]: veth8a46ad31: adding route to 169.254.0.0/162050machine # [ 50.727841] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount2313931571.mount: Deactivated successfully.2051machine # [ 51.420650] dhcpcd[673]: veth62bcc118: no IPv6 Routers available2052machine # [ 51.592703] dhcpcd[673]: vethf8c156b6: no IPv6 Routers available2053machine # [ 52.113970] dhcpcd[673]: veth8a46ad31: no IPv6 Routers available2054machine # [ 52.728524] dhcpcd[673]: veth35a0ba08: no IPv6 Routers available2055machine # [ 54.979445] systemd[1]: tmp-ovl\x2didmapped4026015095.mount: Deactivated successfully.2056machine # [ 54.984237] systemd[1]: Started libcontainer container a3f622085b4a86d2966e6c546c804cacf01edb23a3db9b1e8d0ee7867b2f4cd3.2057machine # [ 55.008254] systemd[1]: Started libcontainer container 07bfa35b45004ec2025f8d5b376d8e7445597fe7f63225af2ab9a5cc7abce153.2058machine # [ 55.020244] systemd[1]: Started libcontainer container fdb2fb8bc7d7477fdb02e6d67d913ae682764e221d497f458ae7bf7b89b49511.2059machine # [ 55.063282] k3s[893]: I0930 09:11:35.778909 893 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-scheduler-55cccf6d96-skplc" podStartSLOduration=5.411661394 podStartE2EDuration="17.778889071s" totalImagesPullingTime="12.367227677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-30 09:11:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 09:11:35.778610264 +0000 UTC m=+37.677625226" watchObservedRunningTime="2026-09-30 09:11:35.778889071 +0000 UTC m=+37.677873582"2060machine # [ 55.169412] niks3-server[1191]: 2026/09/30 09:11:35 INFO lead: acquired remote=10.42.0.6:563602061machine # [ 55.963141] systemd[1]: tmp-ovl\x2didmapped648367338.mount: Deactivated successfully.2062machine # [ 56.996682] systemd[1]: cri-containerd-fdb2fb8bc7d7477fdb02e6d67d913ae682764e221d497f458ae7bf7b89b49511.scope: Deactivated successfully.2063machine # [ 56.999171] systemd[1]: cri-containerd-fdb2fb8bc7d7477fdb02e6d67d913ae682764e221d497f458ae7bf7b89b49511.scope: Consumed 836ms CPU time over 1.974s wall clock time, 346.1M memory peak, 70.3M read from disk, 249M written to disk.2064machine # [ 57.001174] systemd[1]: cri-containerd-07bfa35b45004ec2025f8d5b376d8e7445597fe7f63225af2ab9a5cc7abce153.scope: Deactivated successfully.2065machine # [ 57.002646] systemd[1]: cri-containerd-07bfa35b45004ec2025f8d5b376d8e7445597fe7f63225af2ab9a5cc7abce153.scope: Consumed 835ms CPU time over 1.991s wall clock time, 326.6M memory peak, 49.3M read from disk, 226.3M written to disk.2066machine # [ 57.050134] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-fdb2fb8bc7d7477fdb02e6d67d913ae682764e221d497f458ae7bf7b89b49511-rootfs.mount: Deactivated successfully.2067machine # [ 57.072242] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-07bfa35b45004ec2025f8d5b376d8e7445597fe7f63225af2ab9a5cc7abce153-rootfs.mount: Deactivated successfully.2068machine # [ 58.011505] systemd[1]: tmp-ovl\x2didmapped1876738645.mount: Deactivated successfully.2069machine # [ 58.028455] systemd[1]: Started libcontainer container c810c58bb4f26eeb0c6ca45bd730851ead434a3c63670483a886d72b5530d550.2070machine # [ 58.036310] systemd[1]: Started libcontainer container 042ebd86e6bbd4d8f1aeaa0ce095c9fa93e4b1776f881db712379cbd076770a6.2071machine # [ 58.224927] systemd[1]: tmp-ovl\x2didmapped3031687550.mount: Deactivated successfully.2072machine # [ 58.236271] systemd[1]: Started libcontainer container 5b532b28481c70227b5a8acba562c191cb3e2665e2063e0fc4f42aea9f18f70e.2073machine # [ 58.239869] systemd[1]: Started libcontainer container a4261c1be3a3400e55a9716bedae60bcfb45beab0f93e640ad169abd7d6a6401.2074machine # [ 58.427275] systemd[1]: Started libcontainer container 28370f6c823d84030206a123b8ae260c0963c69bb37ef8fc06ba582462159fab.2075machine # [ 58.430954] systemd[1]: Started libcontainer container e53b908b2fd90f91c627fab78f93383e637dc2227f124993d48bd995d4865739.2076machine # [ 58.514554] k3s[893]: I0930 09:11:39.230169 893 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g" podStartSLOduration=4.014647806 podStartE2EDuration="21.230145305s" totalImagesPullingTime="15.300205192s" totalInitContainerRuntime="1.915292307s" isStatefulPod=false podCreationTimestamp="2026-09-30 09:11:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 09:11:39.217999907 +0000 UTC m=+41.116984418" watchObservedRunningTime="2026-09-30 09:11:39.230145305 +0000 UTC m=+41.129129816"2077machine # [ 58.515175] k3s[893]: I0930 09:11:39.230326 893 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bkxj8" podStartSLOduration=6.608541444 podStartE2EDuration="21.230315718s" totalImagesPullingTime="12.673040846s" totalInitContainerRuntime="1.948733428s" isStatefulPod=false podCreationTimestamp="2026-09-30 09:11:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 09:11:39.229538524 +0000 UTC m=+41.128523035" watchObservedRunningTime="2026-09-30 09:11:39.230315718 +0000 UTC m=+41.129300508"2078machine # error: timed out waiting for the condition2079machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 32.88 seconds)2080machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s2081machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s, in 0.15 seconds)2082machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s2083machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s, in 0.15 seconds)2084machine: waiting for unit niks3.service2085machine: (finished: waiting for unit niks3.service, in 0.03 seconds)2086machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}'2087machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.36 seconds)2088machine: waiting for success: test $(curl -sf 10.42.0.5:9901/clusters | grep -c 'health_flags::healthy') -ge 32089machine: (finished: waiting for success: test $(curl -sf 10.42.0.5:9901/clusters | grep -c 'health_flags::healthy') -ge 3, in 4.31 seconds)2090machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}'2091machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.22 seconds)2092machine: waiting for success: curl -sf http://10.42.0.6:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2'2093machine: (finished: waiting for success: curl -sf http://10.42.0.6:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2', in 0.03 seconds)2094(finished: subtest: chart deploys and workers become Ready, in 38.13 seconds)2095machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}'2096machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}', in 0.13 seconds)2097machine: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt2098machine: (finished: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt, in 0.14 seconds)2099subtest: build through the balancer lands in the cache2100machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&12101machine # [ 128.294966] niks3-server[1191]: 2026/09/30 09:12:49 INFO Received push request method=POST path=/api/pushes2102machine # [ 128.320273] niks3-server[1191]: 2026/09/30 09:12:49 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign2103machine # [ 128.325657] niks3-server[1191]: 2026/09/30 09:12:49 INFO Signed narinfos id=1 count=12104machine # [ 128.335457] niks3-server[1191]: 2026/09/30 09:12:49 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.ls2105machine # [ 128.340050] niks3-server[1191]: 2026/09/30 09:12:49 INFO Received complete push request method=POST path=/api/pushes/1/complete2106machine # [ 128.342216] niks3-server[1191]: 2026/09/30 09:12:49 INFO Registered completed upload object_key=nar/0nzzbas7l8d37mridr7mg162smfjvn7lhs6am4crl4ydaxicigj8.nar.zst2107machine # [ 128.344410] niks3-server[1191]: 2026/09/30 09:12:49 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.narinfo2108machine # [ 153.878597] niks3-server[1191]: 2026/09/30 09:13:14 INFO Received push request method=POST path=/api/pushes2109machine # [ 153.899518] niks3-server[1191]: 2026/09/30 09:13:14 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign2110machine # [ 153.901822] niks3-server[1191]: 2026/09/30 09:13:14 INFO Signed narinfos id=2 count=12111machine # [ 153.905383] niks3-server[1191]: 2026/09/30 09:13:14 INFO Registered completed upload object_key=nar/1p7jh5nyz9n68k5f18ymmdpgr34mpnnch1njw7ki7b2b97qlfbjk.nar.zst2112machine # [ 153.908811] niks3-server[1191]: 2026/09/30 09:13:14 INFO Registered completed upload object_key=log/yz1sqzb72i8v6h2ass0v76ba8cncqj9r-k3s-a.drv2113machine # [ 153.910348] niks3-server[1191]: 2026/09/30 09:13:14 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.ls2114machine # [ 153.915359] niks3-server[1191]: 2026/09/30 09:13:14 INFO Received complete push request method=POST path=/api/pushes/2/complete2115machine # [ 153.924275] niks3-server[1191]: 2026/09/30 09:13:14 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.narinfo2116machine # [ 153.989648] niks3-server[1191]: 2026/09/30 09:13:14 INFO Received push request method=POST path=/api/pushes2117machine # [ 153.998910] niks3-server[1191]: 2026/09/30 09:13:14 INFO Received sign narinfos request method=POST path=/api/pushes/3/sign2118machine # [ 154.001095] niks3-server[1191]: 2026/09/30 09:13:14 INFO Signed narinfos id=3 count=12119machine # [ 154.002634] niks3-server[1191]: 2026/09/30 09:13:14 INFO Registered completed upload object_key=nar/03a4ywhyr5knmbc93z4gyml5y8fvgb431xvlmfxrwsm8mrb0qgx2.nar.zst2120machine # [ 154.004145] niks3-server[1191]: 2026/09/30 09:13:14 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.ls2121machine # [ 154.010562] niks3-server[1191]: 2026/09/30 09:13:14 INFO Received complete push request method=POST path=/api/pushes/3/complete2122machine # [ 154.014881] niks3-server[1191]: 2026/09/30 09:13:14 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.narinfo2123machine # [ 179.124283] niks3-server[1191]: 2026/09/30 09:13:39 INFO Received push request method=POST path=/api/pushes2124machine # [ 179.139996] niks3-server[1191]: 2026/09/30 09:13:39 INFO Received sign narinfos request method=POST path=/api/pushes/4/sign2125machine # [ 179.142594] niks3-server[1191]: 2026/09/30 09:13:39 INFO Signed narinfos id=4 count=12126machine # [ 179.145625] niks3-server[1191]: 2026/09/30 09:13:39 INFO Registered completed upload object_key=nar/05qjsj5ff3a6vnxkhb6k5f3m446dcc206p7cd37w4v3mgi95d7kh.nar.zst2127machine # [ 179.149187] niks3-server[1191]: 2026/09/30 09:13:39 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.ls2128machine # [ 179.151582] niks3-server[1191]: 2026/09/30 09:13:39 INFO Registered completed upload object_key=log/zfq1xw9bmycqh35l0s44lmv65z4xc7br-k3s-b.drv2129machine # [ 179.155694] niks3-server[1191]: 2026/09/30 09:13:39 INFO Received complete push request method=POST path=/api/pushes/4/complete2130machine # [ 179.161165] niks3-server[1191]: 2026/09/30 09:13:39 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.narinfo2131machine # [ 179.228558] niks3-server[1191]: 2026/09/30 09:13:39 INFO Received push request method=POST path=/api/pushes2132machine # [ 179.237424] niks3-server[1191]: 2026/09/30 09:13:39 INFO Received sign narinfos request method=POST path=/api/pushes/5/sign2133machine # [ 179.238692] niks3-server[1191]: 2026/09/30 09:13:39 INFO Signed narinfos id=5 count=12134machine # [ 179.241226] niks3-server[1191]: 2026/09/30 09:13:39 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.ls2135machine # [ 179.245391] niks3-server[1191]: 2026/09/30 09:13:39 INFO Registered completed upload object_key=nar/0jyw88klkf3nwxpnj5m5lx3i1dv2idf3hcn6im7883hnldm3gvyq.nar.zst2136machine # [ 179.247329] niks3-server[1191]: 2026/09/30 09:13:39 INFO Received complete push request method=POST path=/api/pushes/5/complete2137machine # [ 179.249653] niks3-server[1191]: 2026/09/30 09:13:39 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.narinfo2138machine # [ 203.957315] niks3-server[1191]: 2026/09/30 09:14:04 INFO Received push request method=POST path=/api/pushes2139machine # [ 203.975674] niks3-server[1191]: 2026/09/30 09:14:04 INFO Received sign narinfos request method=POST path=/api/pushes/6/sign2140machine # [ 203.977906] niks3-server[1191]: 2026/09/30 09:14:04 INFO Signed narinfos id=6 count=12141machine # [ 203.982719] niks3-server[1191]: 2026/09/30 09:14:04 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.ls2142machine # [ 203.986921] niks3-server[1191]: 2026/09/30 09:14:04 INFO Registered completed upload object_key=nar/1q8vp5xqws560mpf8rxk8r8jhqrzibivh13x4wxy0cfqlzbk7cr5.nar.zst2143machine # [ 203.991954] niks3-server[1191]: 2026/09/30 09:14:04 INFO Received complete push request method=POST path=/api/pushes/6/complete2144machine # [ 203.995858] niks3-server[1191]: 2026/09/30 09:14:04 INFO Registered completed upload object_key=log/n40czam6a4ldp1mh5fdmlcy07fv0akbm-k3s-top.drv2145machine # [ 204.000276] niks3-server[1191]: 2026/09/30 09:14:04 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.narinfo2146machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1, in 138.66 seconds)2147machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath2148machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath, in 0.15 seconds)2149machine: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top2150machine: (finished: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.01 seconds)2151machine: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top2152machine # copying 3 paths...2153machine # copying path '/nix/store/r95r891injj9ski5c4w89yxjvjy065mx-k3s-a' from 'http://192.168.1.1:5751'...2154machine # copying path '/nix/store/mrqsh0475wxsmnsvkk55g94v6g5nrcra-k3s-b' from 'http://192.168.1.1:5751'...2155machine # copying path '/nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top' from 'http://192.168.1.1:5751'...2156machine: (finished: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.20 seconds)2157machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&12158machine # [ 205.684094] niks3-server[1191]: 2026/09/30 09:14:06 INFO Received push request method=POST path=/api/pushes2159machine # [ 205.707928] niks3-server[1191]: 2026/09/30 09:14:06 INFO Received sign narinfos request method=POST path=/api/pushes/7/sign2160machine # [ 205.709916] niks3-server[1191]: 2026/09/30 09:14:06 INFO Signed narinfos id=7 count=12161machine # [ 205.717224] niks3-server[1191]: 2026/09/30 09:14:06 INFO Registered completed upload object_key=nar/1fr26arhri17j9bj6hyjzmmd74v730biz1gb3kqd194vjx3ccvp9.nar.zst2162machine # [ 205.720992] niks3-server[1191]: 2026/09/30 09:14:06 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.ls2163machine # [ 205.724514] niks3-server[1191]: 2026/09/30 09:14:06 INFO Received complete push request method=POST path=/api/pushes/7/complete2164machine # [ 205.730986] niks3-server[1191]: 2026/09/30 09:14:06 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.narinfo2165machine # [ 230.434627] niks3-server[1191]: 2026/09/30 09:14:31 INFO Received push request method=POST path=/api/pushes2166machine # [ 230.455203] niks3-server[1191]: 2026/09/30 09:14:31 INFO Received sign narinfos request method=POST path=/api/pushes/8/sign2167machine # [ 230.457686] niks3-server[1191]: 2026/09/30 09:14:31 INFO Registered completed upload object_key=log/pbpqsh50ar10fpasdqqx8xg3lmr5j8iz-k3s-a.drv2168machine # [ 230.459644] niks3-server[1191]: 2026/09/30 09:14:31 INFO Signed narinfos id=8 count=12169machine # [ 230.461206] niks3-server[1191]: 2026/09/30 09:14:31 INFO Registered completed upload object_key=nar/1hfc6x4x25k3b0fk091d3nb0k3mympfp05fkslcx19synp3ig0zd.nar.zst2170machine # [ 230.463350] niks3-server[1191]: 2026/09/30 09:14:31 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.ls2171machine # [ 230.467171] niks3-server[1191]: 2026/09/30 09:14:31 INFO Received complete push request method=POST path=/api/pushes/8/complete2172machine # [ 230.477855] niks3-server[1191]: 2026/09/30 09:14:31 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.narinfo2173machine # [ 230.547982] niks3-server[1191]: 2026/09/30 09:14:31 INFO Received push request method=POST path=/api/pushes2174machine # [ 230.558954] niks3-server[1191]: 2026/09/30 09:14:31 INFO Received sign narinfos request method=POST path=/api/pushes/9/sign2175machine # [ 230.560910] niks3-server[1191]: 2026/09/30 09:14:31 INFO Signed narinfos id=9 count=12176machine # [ 230.563667] niks3-server[1191]: 2026/09/30 09:14:31 INFO Registered completed upload object_key=nar/0zzq2vgjln4shvh57091n14sam6wh6w06vja6lzb9ppcj4ffyx1n.nar.zst2177machine # [ 230.564858] niks3-server[1191]: 2026/09/30 09:14:31 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.ls2178machine # [ 230.565969] niks3-server[1191]: 2026/09/30 09:14:31 INFO Received complete push request method=POST path=/api/pushes/9/complete2179machine # [ 230.569214] niks3-server[1191]: 2026/09/30 09:14:31 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.narinfo2180machine # [ 255.686503] niks3-server[1191]: 2026/09/30 09:14:56 INFO Received push request method=POST path=/api/pushes2181machine # [ 255.706260] niks3-server[1191]: 2026/09/30 09:14:56 INFO Received sign narinfos request method=POST path=/api/pushes/10/sign2182machine # [ 255.707811] niks3-server[1191]: 2026/09/30 09:14:56 INFO Registered completed upload object_key=nar/0hh3nqk95r6g32lhdmxw8cxjv694vbpx9876zkhcpg4r4qxni2ch.nar.zst2183machine # [ 255.709077] niks3-server[1191]: 2026/09/30 09:14:56 INFO Signed narinfos id=10 count=12184machine # [ 255.712960] niks3-server[1191]: 2026/09/30 09:14:56 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.ls2185machine # [ 255.715526] niks3-server[1191]: 2026/09/30 09:14:56 INFO Registered completed upload object_key=log/894h6wzw2l4w5f0hikj1k6q57jfnyi87-k3s-b.drv2186machine # [ 255.719718] niks3-server[1191]: 2026/09/30 09:14:56 INFO Received complete push request method=POST path=/api/pushes/10/complete2187machine # [ 255.724255] niks3-server[1191]: 2026/09/30 09:14:56 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.narinfo2188machine # [ 255.790376] niks3-server[1191]: 2026/09/30 09:14:56 INFO Received push request method=POST path=/api/pushes2189machine # [ 255.801350] niks3-server[1191]: 2026/09/30 09:14:56 INFO Received sign narinfos request method=POST path=/api/pushes/11/sign2190machine # [ 255.802858] niks3-server[1191]: 2026/09/30 09:14:56 INFO Signed narinfos id=11 count=12191machine # [ 255.806720] niks3-server[1191]: 2026/09/30 09:14:56 INFO Registered completed upload object_key=nar/0ingamx56k31lwiyxmnxmscjj4n3qfx6sr2kpaynsrwhwz1278iw.nar.zst2192machine # [ 255.808041] niks3-server[1191]: 2026/09/30 09:14:56 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.ls2193machine # [ 255.811542] niks3-server[1191]: 2026/09/30 09:14:56 INFO Received complete push request method=POST path=/api/pushes/11/complete2194machine # [ 255.815419] niks3-server[1191]: 2026/09/30 09:14:56 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.narinfo2195machine # [ 280.527575] niks3-server[1191]: 2026/09/30 09:15:21 INFO Received push request method=POST path=/api/pushes2196machine # [ 280.556553] niks3-server[1191]: 2026/09/30 09:15:21 INFO Received sign narinfos request method=POST path=/api/pushes/12/sign2197machine # [ 280.558267] niks3-server[1191]: 2026/09/30 09:15:21 INFO Signed narinfos id=12 count=12198machine # [ 280.561214] niks3-server[1191]: 2026/09/30 09:15:21 INFO Registered completed upload object_key=nar/0v48x4sp58bvfra08axgkz7yl1n9nc4nirskyv1hwann4i7q277i.nar.zst2199machine # [ 280.563942] niks3-server[1191]: 2026/09/30 09:15:21 INFO Registered completed upload object_key=log/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g-k3s-top.drv2200machine # [ 280.567853] niks3-server[1191]: 2026/09/30 09:15:21 INFO Received complete push request method=POST path=/api/pushes/12/complete2201machine # [ 280.572593] niks3-server[1191]: 2026/09/30 09:15:21 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.narinfo2202machine # [ 280.579382] niks3-server[1191]: 2026/09/30 09:15:21 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.ls2203machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1, in 75.18 seconds)2204(finished: subtest: build through the balancer lands in the cache, in 214.20 seconds)2205subtest: a Job with the client image builds through the farm with its service account2206machine: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt2207machine: (finished: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.16 seconds)2208machine: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix2209machine: (finished: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix, in 0.13 seconds)2210machine: must succeed: kubectl apply -f /nix/store/4qg21n7g16x8lyv0fhhdx9dx3lxqkcdn-ci-job.json2211machine: (finished: must succeed: kubectl apply -f /nix/store/4qg21n7g16x8lyv0fhhdx9dx3lxqkcdn-ci-job.json, in 0.16 seconds)2212machine: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed'2213machine # [ 281.595896] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod82f190b6_d1c9_42ad_80a5_b093be084e93.slice.2214machine # [ 281.729330] k3s[893]: I0930 09:15:22.444508 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/82f190b6-d1c9-42ad-80a5-b093be084e93-nix-grpc-farm\") pod \"ci-gfdjp\" (UID: \"82f190b6-d1c9-42ad-80a5-b093be084e93\") " pod="ci/ci-gfdjp"2215machine # [ 281.731153] k3s[893]: I0930 09:15:22.444616 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"job\" (UniqueName: \"kubernetes.io/configmap/82f190b6-d1c9-42ad-80a5-b093be084e93-job\") pod \"ci-gfdjp\" (UID: \"82f190b6-d1c9-42ad-80a5-b093be084e93\") " pod="ci/ci-gfdjp"2216machine # [ 281.732370] k3s[893]: I0930 09:15:22.444858 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87kck\" (UniqueName: \"kubernetes.io/projected/82f190b6-d1c9-42ad-80a5-b093be084e93-kube-api-access-87kck\") pod \"ci-gfdjp\" (UID: \"82f190b6-d1c9-42ad-80a5-b093be084e93\") " pod="ci/ci-gfdjp"2217machine # [ 282.701085] cni0: port 1(vethd288ea8d) entered blocking state2218machine # [ 282.702787] cni0: port 1(vethd288ea8d) entered disabled state2219machine # [ 282.705384] vethd288ea8d: entered allmulticast mode2220machine # [ 282.707659] vethd288ea8d: entered promiscuous mode2221machine # [ 282.726727] cni0: port 1(vethd288ea8d) entered blocking state2222machine # [ 282.729350] cni0: port 1(vethd288ea8d) entered forwarding state2223machine # [ 282.619836] (udev-worker)[4783]: Network interface NamePolicy= disabled on kernel command line.2224machine # [ 282.644238] dhcpcd[673]: vethd288ea8d: IAID fc:d5:9a:472225machine # [ 282.644921] dhcpcd[673]: vethd288ea8d: adding address fe80::3ca8:fcff:fed5:9a472226machine # [ 282.661456] systemd[1]: Started libcontainer container 950a3de30ff9f9f74a80b128f7332d6095560d353cb43004cef4123e8634dfa9.2227machine # [ 284.275656] dhcpcd[673]: vethd288ea8d: soliciting an IPv6 router2228machine # [ 284.326660] dhcpcd[673]: vethd288ea8d: soliciting a DHCP lease2229machine # [ 285.044496] systemd[1]: Started libcontainer container b52687c73fbecfd7758b1530d47eed038b2181e8a82a87b3816783d978290660.2230machine # [ 286.424144] niks3-server[1191]: 2026/09/30 09:15:27 INFO Received push request method=POST path=/api/pushes2231machine # [ 286.439352] niks3-server[1191]: 2026/09/30 09:15:27 INFO Received sign narinfos request method=POST path=/api/pushes/13/sign2232machine # [ 286.440905] niks3-server[1191]: 2026/09/30 09:15:27 INFO Signed narinfos id=13 count=12233machine # [ 286.445573] niks3-server[1191]: 2026/09/30 09:15:27 INFO Registered completed upload object_key=nar/111g6dyibwcf2z7jhpn72rgja0qvjgpdiv9nc06g2dp7ih0a6kyq.nar.zst2234machine # [ 286.448460] niks3-server[1191]: 2026/09/30 09:15:27 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.ls2235machine # [ 286.456505] niks3-server[1191]: 2026/09/30 09:15:27 INFO Received complete push request method=POST path=/api/pushes/13/complete2236machine # [ 286.463860] niks3-server[1191]: 2026/09/30 09:15:27 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.narinfo2237machine # [ 289.327794] dhcpcd[673]: vethd288ea8d: probing for an IPv4LL address2238machine # [ 293.888879] dhcpcd[673]: vethd288ea8d: using IPv4LL address 169.254.65.2402239machine # [ 293.891363] dhcpcd[673]: vethd288ea8d: adding route to 169.254.0.0/162240machine # [ 296.280239] dhcpcd[673]: vethd288ea8d: no IPv6 Routers available2241machine # [ 310.114208] postgres[755]: [755] LOG: checkpoint starting: time2242machine # [ 310.976496] niks3-server[1191]: 2026/09/30 09:15:51 INFO Received push request method=POST path=/api/pushes2243machine # [ 310.997224] niks3-server[1191]: 2026/09/30 09:15:51 INFO Received sign narinfos request method=POST path=/api/pushes/14/sign2244machine # [ 310.997567] niks3-server[1191]: 2026/09/30 09:15:51 INFO Registered completed upload object_key=nar/058kjd2vfl1r27b4d9ixvwf77d8rkr18a4v894kwx8lg0nwpajnr.nar.zst2245machine # [ 311.001465] niks3-server[1191]: 2026/09/30 09:15:51 INFO Signed narinfos id=14 count=12246machine # [ 311.003560] niks3-server[1191]: 2026/09/30 09:15:51 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.ls2247machine # [ 311.005828] niks3-server[1191]: 2026/09/30 09:15:51 INFO Registered completed upload object_key=log/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv2248machine # [ 311.013167] niks3-server[1191]: 2026/09/30 09:15:51 INFO Received complete push request method=POST path=/api/pushes/14/complete2249machine # [ 311.017847] niks3-server[1191]: 2026/09/30 09:15:51 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.narinfo2250machine # [ 311.083950] niks3-server[1191]: 2026/09/30 09:15:51 INFO Received push request method=POST path=/api/pushes2251machine # [ 311.093454] niks3-server[1191]: 2026/09/30 09:15:51 INFO Received sign narinfos request method=POST path=/api/pushes/15/sign2252machine # [ 311.094660] niks3-server[1191]: 2026/09/30 09:15:51 INFO Signed narinfos id=15 count=12253machine # [ 311.098897] niks3-server[1191]: 2026/09/30 09:15:51 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.ls2254machine # [ 311.101483] niks3-server[1191]: 2026/09/30 09:15:51 INFO Registered completed upload object_key=nar/138ynhcd5wxzz485x9qcq7xsargaklrf2li31ai69m5r46am35q6.nar.zst2255machine # [ 311.102185] niks3-server[1191]: 2026/09/30 09:15:51 INFO Received complete push request method=POST path=/api/pushes/15/complete2256machine # [ 311.105633] niks3-server[1191]: 2026/09/30 09:15:51 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.narinfo2257machine # [ 335.994914] niks3-server[1191]: 2026/09/30 09:16:16 INFO Received push request method=POST path=/api/pushes2258machine # [ 336.005377] niks3-server[1191]: 2026/09/30 09:16:16 INFO Received sign narinfos request method=POST path=/api/pushes/16/sign2259machine # [ 336.008732] niks3-server[1191]: 2026/09/30 09:16:16 INFO Signed narinfos id=16 count=12260machine # [ 336.011181] niks3-server[1191]: 2026/09/30 09:16:16 INFO Registered completed upload object_key=nar/0n4lbdlp8w72fs3qbavl2lwrzbrn55i2b1vyglc89cc3pi8vbb1m.nar.zst2261machine # [ 336.013121] niks3-server[1191]: 2026/09/30 09:16:16 INFO Registered completed upload object_key=log/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv2262machine # [ 336.014690] niks3-server[1191]: 2026/09/30 09:16:16 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.ls2263machine # [ 336.018915] niks3-server[1191]: 2026/09/30 09:16:16 INFO Received complete push request method=POST path=/api/pushes/16/complete2264machine # [ 336.024363] niks3-server[1191]: 2026/09/30 09:16:16 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo2265machine # [ 336.080439] niks3-server[1191]: 2026/09/30 09:16:16 INFO Received push request method=POST path=/api/pushes2266machine # [ 336.089146] niks3-server[1191]: 2026/09/30 09:16:16 INFO Received sign narinfos request method=POST path=/api/pushes/17/sign2267machine # [ 336.090576] niks3-server[1191]: 2026/09/30 09:16:16 INFO Signed narinfos id=17 count=12268machine # [ 336.092495] niks3-server[1191]: 2026/09/30 09:16:16 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.ls2269machine # [ 336.094657] niks3-server[1191]: 2026/09/30 09:16:16 INFO Registered completed upload object_key=nar/1f3gvnvqsm2pm3laixkxkg44kvjb251zqhszcfpp0a00h6x66ljs.nar.zst2270machine # [ 336.096939] niks3-server[1191]: 2026/09/30 09:16:16 INFO Received complete push request method=POST path=/api/pushes/17/complete2271machine # [ 336.101965] niks3-server[1191]: 2026/09/30 09:16:16 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.narinfo2272machine # [ 360.815269] niks3-server[1191]: 2026/09/30 09:16:41 INFO Received push request method=POST path=/api/pushes2273machine # [ 360.829892] niks3-server[1191]: 2026/09/30 09:16:41 INFO Received sign narinfos request method=POST path=/api/pushes/18/sign2274machine # [ 360.834148] niks3-server[1191]: 2026/09/30 09:16:41 INFO Signed narinfos id=18 count=12275machine # [ 360.837855] niks3-server[1191]: 2026/09/30 09:16:41 INFO Registered completed upload object_key=log/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv2276machine # [ 360.839406] niks3-server[1191]: 2026/09/30 09:16:41 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.ls2277machine # [ 360.841166] niks3-server[1191]: 2026/09/30 09:16:41 INFO Registered completed upload object_key=nar/1zwf0asrdv12q40fmqga5lx5330dvn9y4in4i9ficz9ij5lhvnf5.nar.zst2278machine # [ 360.849372] niks3-server[1191]: 2026/09/30 09:16:41 INFO Received complete push request method=POST path=/api/pushes/18/complete2279machine # [ 360.856372] niks3-server[1191]: 2026/09/30 09:16:41 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo2280machine # [ 363.575442] niks3-server[1191]: 2026/09/30 09:16:44 INFO Received push request method=POST path=/api/pushes2281machine # [ 363.593379] niks3-server[1191]: 2026/09/30 09:16:44 INFO Received sign narinfos request method=POST path=/api/pushes/19/sign2282machine # [ 363.597976] niks3-server[1191]: 2026/09/30 09:16:44 INFO Signed narinfos id=19 count=12283machine # [ 363.603968] niks3-server[1191]: 2026/09/30 09:16:44 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.ls2284machine # [ 363.606160] niks3-server[1191]: 2026/09/30 09:16:44 INFO Registered completed upload object_key=nar/0xiyqcsl8db7dnrq2gqnx5izavr51ma3dcdswrriaxfgj3qzk7xf.nar.zst2285machine # [ 363.612088] niks3-server[1191]: 2026/09/30 09:16:44 INFO Received complete push request method=POST path=/api/pushes/19/complete2286machine # [ 363.620384] niks3-server[1191]: 2026/09/30 09:16:44 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.narinfo2287machine # [ 388.320406] niks3-server[1191]: 2026/09/30 09:17:09 INFO Received push request method=POST path=/api/pushes2288machine # [ 388.339384] niks3-server[1191]: 2026/09/30 09:17:09 INFO Registered completed upload object_key=nar/0p3l2z3riilylr2rxb1aq2blxdfxg55wbgp4gxkns93srbr4bwyq.nar.zst2289machine # [ 388.342149] niks3-server[1191]: 2026/09/30 09:17:09 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.ls2290machine # [ 388.343061] niks3-server[1191]: 2026/09/30 09:17:09 INFO Received sign narinfos request method=POST path=/api/pushes/20/sign2291machine # [ 388.344690] niks3-server[1191]: 2026/09/30 09:17:09 INFO Signed narinfos id=20 count=12292machine # [ 388.347248] niks3-server[1191]: 2026/09/30 09:17:09 INFO Registered completed upload object_key=log/fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv2293machine # [ 388.348733] niks3-server[1191]: 2026/09/30 09:17:09 INFO Received complete push request method=POST path=/api/pushes/20/complete2294machine # [ 388.353760] niks3-server[1191]: 2026/09/30 09:17:09 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo2295machine # [ 388.475135] systemd[1]: cri-containerd-b52687c73fbecfd7758b1530d47eed038b2181e8a82a87b3816783d978290660.scope: Deactivated successfully.2296machine # [ 388.477401] systemd[1]: cri-containerd-b52687c73fbecfd7758b1530d47eed038b2181e8a82a87b3816783d978290660.scope: Consumed 1.033s CPU time over 1min 43.430s wall clock time, 120.3M memory peak, 50.8M read from disk, 428K written to disk, 18.3K incoming IP traffic, 44.8K outgoing IP traffic.2297machine # [ 388.520562] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-b52687c73fbecfd7758b1530d47eed038b2181e8a82a87b3816783d978290660-rootfs.mount: Deactivated successfully.2298machine # [ 390.193513] systemd[1]: cri-containerd-950a3de30ff9f9f74a80b128f7332d6095560d353cb43004cef4123e8634dfa9.scope: Deactivated successfully.2299machine # [ 390.254498] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-950a3de30ff9f9f74a80b128f7332d6095560d353cb43004cef4123e8634dfa9-rootfs.mount: Deactivated successfully.2300machine # [ 390.292044] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-950a3de30ff9f9f74a80b128f7332d6095560d353cb43004cef4123e8634dfa9-shm.mount: Deactivated successfully.2301machine # [ 390.492827] cni0: port 1(vethd288ea8d) entered disabled state2302machine # [ 390.340925] dhcpcd[673]: vethd288ea8d: carrier lost2303machine # [ 390.495661] vethd288ea8d (unregistering): left allmulticast mode2304machine # [ 390.496649] vethd288ea8d (unregistering): left promiscuous mode2305machine # [ 390.497676] cni0: port 1(vethd288ea8d) entered disabled state2306machine # [ 390.363490] systemd[1]: run-netns-cni\x2dab623e72\x2dae1e\x2d8cd2\x2dd7c1\x2d08d5cd58147d.mount: Deactivated successfully.2307machine # [ 390.369328] dhcpcd[673]: vethd288ea8d: deleting address fe80::3ca8:fcff:fed5:9a472308machine # [ 390.373238] dhcpcd[673]: vethd288ea8d: deleting route to 169.254.0.0/162309machine # [ 390.436292] dhcpcd[673]: vethd288ea8d: removing interface2310machine # [ 390.484757] k3s[893]: I0930 09:17:11.200322 893 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/82f190b6-d1c9-42ad-80a5-b093be084e93-job\" (UniqueName: \"kubernetes.io/configmap/82f190b6-d1c9-42ad-80a5-b093be084e93-job\") pod \"82f190b6-d1c9-42ad-80a5-b093be084e93\" (UID: \"82f190b6-d1c9-42ad-80a5-b093be084e93\") "2311machine # [ 390.485301] k3s[893]: I0930 09:17:11.200373 893 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/82f190b6-d1c9-42ad-80a5-b093be084e93-kube-api-access-87kck\" (UniqueName: \"kubernetes.io/projected/82f190b6-d1c9-42ad-80a5-b093be084e93-kube-api-access-87kck\") pod \"82f190b6-d1c9-42ad-80a5-b093be084e93\" (UID: \"82f190b6-d1c9-42ad-80a5-b093be084e93\") "2312machine # [ 390.485933] k3s[893]: I0930 09:17:11.200402 893 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/82f190b6-d1c9-42ad-80a5-b093be084e93-nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/82f190b6-d1c9-42ad-80a5-b093be084e93-nix-grpc-farm\") pod \"82f190b6-d1c9-42ad-80a5-b093be084e93\" (UID: \"82f190b6-d1c9-42ad-80a5-b093be084e93\") "2313machine # [ 390.486577] k3s[893]: I0930 09:17:11.200819 893 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82f190b6-d1c9-42ad-80a5-b093be084e93-job" pod "82f190b6-d1c9-42ad-80a5-b093be084e93" (UID: "82f190b6-d1c9-42ad-80a5-b093be084e93"). InnerVolumeSpecName "job". PluginName "kubernetes.io/configmap", VolumeGIDValue ""2314machine # [ 390.490889] systemd[1]: var-lib-kubelet-pods-82f190b6\x2dd1c9\x2d42ad\x2d80a5\x2db093be084e93-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2d87kck.mount: Deactivated successfully.2315machine # [ 390.505603] k3s[893]: I0930 09:17:11.221543 893 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82f190b6-d1c9-42ad-80a5-b093be084e93-kube-api-access-87kck" pod "82f190b6-d1c9-42ad-80a5-b093be084e93" (UID: "82f190b6-d1c9-42ad-80a5-b093be084e93"). InnerVolumeSpecName "kube-api-access-87kck". PluginName "kubernetes.io/projected", VolumeGIDValue ""2316machine # [ 390.507834] systemd[1]: var-lib-kubelet-pods-82f190b6\x2dd1c9\x2d42ad\x2d80a5\x2db093be084e93-volumes-kubernetes.io\x7eprojected-nix\x2dgrpc\x2dfarm.mount: Deactivated successfully.2317machine # [ 390.513918] k3s[893]: I0930 09:17:11.229899 893 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82f190b6-d1c9-42ad-80a5-b093be084e93-nix-grpc-farm" pod "82f190b6-d1c9-42ad-80a5-b093be084e93" (UID: "82f190b6-d1c9-42ad-80a5-b093be084e93"). InnerVolumeSpecName "nix-grpc-farm". PluginName "kubernetes.io/projected", VolumeGIDValue ""2318machine # [ 390.585307] k3s[893]: I0930 09:17:11.301262 893 reconciler_common.go:299] "Volume detached for volume \"job\" (UniqueName: \"kubernetes.io/configmap/82f190b6-d1c9-42ad-80a5-b093be084e93-job\") on node \"machine\" DevicePath \"\""2319machine # [ 390.585699] k3s[893]: I0930 09:17:11.301302 893 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87kck\" (UniqueName: \"kubernetes.io/projected/82f190b6-d1c9-42ad-80a5-b093be084e93-kube-api-access-87kck\") on node \"machine\" DevicePath \"\""2320machine # [ 390.586909] k3s[893]: I0930 09:17:11.301319 893 reconciler_common.go:299] "Volume detached for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/82f190b6-d1c9-42ad-80a5-b093be084e93-nix-grpc-farm\") on node \"machine\" DevicePath \"\""2321machine # [ 391.176369] k3s[893]: I0930 09:17:11.892234 893 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="950a3de30ff9f9f74a80b128f7332d6095560d353cb43004cef4123e8634dfa9"2322machine # [ 391.192550] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod82f190b6_d1c9_42ad_80a5_b093be084e93.slice.2323machine # [ 391.194190] systemd[1]: kubepods-besteffort-pod82f190b6_d1c9_42ad_80a5_b093be084e93.slice: Consumed 1.062s CPU time over 1min 49.595s wall clock time, 120.5M memory peak, 50.8M read from disk, 632K written to disk, 18.3K incoming IP traffic, 44.8K outgoing IP traffic.2324machine: (finished: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed', in 110.80 seconds)2325machine: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 12326machine: (finished: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1, in 0.15 seconds)2327machine # don't know how to build these paths:2328machine # /nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv2329machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'...2330machine # copying path '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' to 'nix-grpc-farm.farm.svc:50051'...2331machine # building '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' on nix-grpc-farm.farm.svc:50051...2332machine # k3s-a> machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g: building fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv2333machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'...2334machine # copying path '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' to 'nix-grpc-farm.farm.svc:50051'...2335machine # building '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' on nix-grpc-farm.farm.svc:50051...2336machine # k3s-b> machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g: building 1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv2337machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'...2338machine # copying path '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' to 'nix-grpc-farm.farm.svc:50051'...2339machine # building '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' on nix-grpc-farm.farm.svc:50051...2340machine # k3s-top> machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g: building rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv2341machine # INFO:nix_fast_build.processes:run nix-eval-jobs --gc-roots-dir /tmp/tmpwt3ia5ar/gcroots --force-recurse --max-memory-size 4096 --workers 4 --flake '.#checks' --check-cache-status2342machine # INFO:nix_fast_build.workers:builds: 02343machine # warning: Git tree '/tmp' is dirty2344machine # warning: Git tree '/tmp' is dirty2345machine # ▶ x86_64-linux.t started2346machine # INFO:nix_fast_build.workers:builds: 22347machine # ✔ x86_64-linux.t (25s)2348machine # x86_64-linux.t> machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bkxj8: building fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv2349machine # warning: Git tree '/tmp' is dirty2350machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath2351machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath, in 0.12 seconds)2352machine: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null2353machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null, in 0.03 seconds)2354(finished: subtest: a Job with the client image builds through the farm with its service account, in 111.86 seconds)2355subtest: a renewed balancer certificate is served without a rollout2356machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f -2357machine # Warning: resource secrets/farm-lb-tls is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically.2358machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f -, in 0.28 seconds)2359machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}'2360machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}', in 0.83 seconds)2361machine: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-5877cc8b4f-mjhbp -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example2362machine # [ 393.837289] k3s[893]: E0930 09:17:14.552917 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52602: use of closed network connection"2363machine # [ 395.109593] k3s[893]: E0930 09:17:15.825114 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52606: use of closed network connection"2364machine # [ 396.428527] k3s[893]: E0930 09:17:17.143649 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52622: use of closed network connection"2365machine # [ 397.735300] k3s[893]: E0930 09:17:18.450954 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52626: use of closed network connection"2366machine # [ 399.024900] k3s[893]: E0930 09:17:19.740555 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52630: use of closed network connection"2367machine # [ 400.320275] k3s[893]: E0930 09:17:21.035461 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52646: use of closed network connection"2368machine # [ 401.600742] k3s[893]: E0930 09:17:22.316403 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52662: use of closed network connection"2369machine # [ 402.881887] k3s[893]: E0930 09:17:23.597093 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52666: use of closed network connection"2370machine # [ 404.150827] k3s[893]: E0930 09:17:24.866040 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:55910: use of closed network connection"2371machine # [ 405.429619] k3s[893]: E0930 09:17:26.145135 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:55918: use of closed network connection"2372machine # [ 406.711728] k3s[893]: E0930 09:17:27.427138 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:55926: use of closed network connection"2373machine # [ 407.959575] k3s[893]: E0930 09:17:28.675215 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:55942: use of closed network connection"2374machine # [ 409.267675] k3s[893]: E0930 09:17:29.982773 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:55952: use of closed network connection"2375machine # [ 410.581673] k3s[893]: E0930 09:17:31.296513 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:55960: use of closed network connection"2376machine # [ 411.867586] k3s[893]: E0930 09:17:32.583227 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:55964: use of closed network connection"2377machine # [ 413.151995] k3s[893]: E0930 09:17:33.867659 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52944: use of closed network connection"2378machine # [ 414.119066] postgres[755]: [755] LOG: checkpoint complete: wrote 1037 buffers (6.3%), wrote 3 SLRU buffers; 1 WAL file(s) added, 0 removed, 0 recycled; write=103.901 s, sync=0.065 s, total=104.005 s; sync files=364, longest=0.004 s, average=0.001 s; distance=4978 kB, estimate=4978 kB; lsn=0/1C74CA0, redo lsn=0/1C42BC82379machine # [ 414.460393] k3s[893]: E0930 09:17:35.175808 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52956: use of closed network connection"2380machine # [ 415.755984] k3s[893]: E0930 09:17:36.471143 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52960: use of closed network connection"2381machine # [ 417.045437] k3s[893]: E0930 09:17:37.760480 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52974: use of closed network connection"2382machine # [ 418.347989] k3s[893]: E0930 09:17:39.063663 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52986: use of closed network connection"2383machine # [ 419.646941] k3s[893]: E0930 09:17:40.362246 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52990: use of closed network connection"2384machine # [ 420.925272] k3s[893]: E0930 09:17:41.640923 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:53000: use of closed network connection"2385machine # [ 422.208280] k3s[893]: E0930 09:17:42.923914 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:53010: use of closed network connection"2386machine # [ 423.506372] k3s[893]: E0930 09:17:44.221400 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51990: use of closed network connection"2387machine # [ 424.807244] k3s[893]: E0930 09:17:45.522872 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52000: use of closed network connection"2388machine # [ 426.058507] k3s[893]: E0930 09:17:46.773432 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52010: use of closed network connection"2389machine # [ 427.288169] k3s[893]: E0930 09:17:48.003793 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52020: use of closed network connection"2390machine # [ 428.581292] k3s[893]: E0930 09:17:49.296881 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52022: use of closed network connection"2391machine # [ 429.848916] k3s[893]: E0930 09:17:50.564581 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52026: use of closed network connection"2392machine # [ 431.139577] k3s[893]: E0930 09:17:51.855214 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52038: use of closed network connection"2393machine # [ 432.437496] k3s[893]: E0930 09:17:53.153140 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52040: use of closed network connection"2394machine # [ 433.727418] k3s[893]: E0930 09:17:54.442405 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:46224: use of closed network connection"2395machine # [ 435.014393] k3s[893]: E0930 09:17:55.729812 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:46238: use of closed network connection"2396machine # [ 436.290789] k3s[893]: E0930 09:17:57.006419 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:46248: use of closed network connection"2397machine # [ 437.579949] k3s[893]: E0930 09:17:58.294910 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:46258: use of closed network connection"2398machine # [ 438.846398] k3s[893]: E0930 09:17:59.561997 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:46268: use of closed network connection"2399machine # [ 440.123124] k3s[893]: E0930 09:18:00.838639 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:46276: use of closed network connection"2400machine # [ 441.398633] k3s[893]: E0930 09:18:02.114011 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:46292: use of closed network connection"2401machine # [ 442.691763] k3s[893]: E0930 09:18:03.407257 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:46300: use of closed network connection"2402machine # [ 443.986770] k3s[893]: E0930 09:18:04.701856 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:44246: use of closed network connection"2403machine # [ 445.266821] k3s[893]: E0930 09:18:05.982476 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:44260: use of closed network connection"2404machine # [ 446.568623] k3s[893]: E0930 09:18:07.283496 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:44276: use of closed network connection"2405machine # [ 447.857211] k3s[893]: E0930 09:18:08.572836 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:44286: use of closed network connection"2406machine # [ 449.175178] k3s[893]: E0930 09:18:09.890736 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:44288: use of closed network connection"2407machine # [ 450.458380] k3s[893]: E0930 09:18:11.174025 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:44296: use of closed network connection"2408machine # [ 451.747185] k3s[893]: E0930 09:18:12.462524 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:44312: use of closed network connection"2409machine # [ 453.019608] k3s[893]: E0930 09:18:13.735241 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:34122: use of closed network connection"2410machine # [ 454.313699] k3s[893]: E0930 09:18:15.029284 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:34134: use of closed network connection"2411machine # [ 455.593157] k3s[893]: E0930 09:18:16.308185 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:34138: use of closed network connection"2412machine # [ 456.896265] k3s[893]: E0930 09:18:17.611871 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:34154: use of closed network connection"2413machine # [ 458.168206] k3s[893]: E0930 09:18:18.882850 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:34168: use of closed network connection"2414machine # [ 459.447589] k3s[893]: E0930 09:18:20.163232 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:34170: use of closed network connection"2415machine # [ 460.740516] k3s[893]: E0930 09:18:21.456118 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:34184: use of closed network connection"2416machine # [ 461.998395] k3s[893]: E0930 09:18:22.713976 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:34198: use of closed network connection"2417machine # [ 463.265358] k3s[893]: E0930 09:18:23.980973 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:60012: use of closed network connection"2418machine # [ 464.581669] k3s[893]: E0930 09:18:25.297306 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:60024: use of closed network connection"2419machine # [ 465.843946] k3s[893]: E0930 09:18:26.559199 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:60026: use of closed network connection"2420machine # [ 467.124454] k3s[893]: E0930 09:18:27.840129 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:60040: use of closed network connection"2421machine # [ 468.430034] k3s[893]: E0930 09:18:29.145689 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:60042: use of closed network connection"2422machine # [ 469.696739] k3s[893]: E0930 09:18:30.412372 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:60050: use of closed network connection"2423machine: (finished: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-5877cc8b4f-mjhbp -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 76.14 seconds)2424machine: waiting for success: openssl s_client -connect 127.0.0.1:30051 </dev/null 2>/dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example2425machine: (finished: waiting for success: openssl s_client -connect 127.0.0.1:30051 </dev/null 2>/dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 0.04 seconds)2426machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&12427machine # [ 469.936823] niks3-server[1191]: 2026/09/30 09:18:30 INFO Received push request method=POST path=/api/pushes2428machine # [ 469.949675] niks3-server[1191]: 2026/09/30 09:18:30 INFO Received sign narinfos request method=POST path=/api/pushes/21/sign2429machine # [ 469.951637] niks3-server[1191]: 2026/09/30 09:18:30 INFO Registered completed upload object_key=nar/0g42hgwa9jp9abmqxz90dkwxpybsznzbpsy35rm921mlk5sw56jq.nar.zst2430machine # [ 469.953611] niks3-server[1191]: 2026/09/30 09:18:30 INFO Signed narinfos id=21 count=12431machine # [ 469.956410] niks3-server[1191]: 2026/09/30 09:18:30 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.ls2432machine # [ 469.959996] niks3-server[1191]: 2026/09/30 09:18:30 INFO Received complete push request method=POST path=/api/pushes/21/complete2433machine # [ 469.963523] niks3-server[1191]: 2026/09/30 09:18:30 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.narinfo2434machine # [ 494.470976] niks3-server[1191]: 2026/09/30 09:18:55 INFO Received push request method=POST path=/api/pushes2435machine # [ 494.491000] niks3-server[1191]: 2026/09/30 09:18:55 INFO Received sign narinfos request method=POST path=/api/pushes/22/sign2436machine # [ 494.492064] niks3-server[1191]: 2026/09/30 09:18:55 INFO Registered completed upload object_key=nar/1vxmmzwi16s4iri6dcmi9v62dpq1ys7wz15b497ncik3sd67nfzg.nar.zst2437machine # [ 494.492981] niks3-server[1191]: 2026/09/30 09:18:55 INFO Signed narinfos id=22 count=12438machine # [ 494.495356] niks3-server[1191]: 2026/09/30 09:18:55 INFO Registered completed upload object_key=log/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31-k3s-a.drv2439machine # [ 494.500132] niks3-server[1191]: 2026/09/30 09:18:55 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.ls2440machine # [ 494.501523] niks3-server[1191]: 2026/09/30 09:18:55 INFO Received complete push request method=POST path=/api/pushes/22/complete2441machine # [ 494.507694] niks3-server[1191]: 2026/09/30 09:18:55 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo2442machine # [ 494.577326] niks3-server[1191]: 2026/09/30 09:18:55 INFO Received push request method=POST path=/api/pushes2443machine # [ 494.586182] niks3-server[1191]: 2026/09/30 09:18:55 INFO Received sign narinfos request method=POST path=/api/pushes/23/sign2444machine # [ 494.589167] niks3-server[1191]: 2026/09/30 09:18:55 INFO Signed narinfos id=23 count=12445machine # [ 494.592910] niks3-server[1191]: 2026/09/30 09:18:55 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.ls2446machine # [ 494.594755] niks3-server[1191]: 2026/09/30 09:18:55 INFO Received complete push request method=POST path=/api/pushes/23/complete2447machine # [ 494.597069] niks3-server[1191]: 2026/09/30 09:18:55 INFO Registered completed upload object_key=nar/0cbxkyxz068xc5mivh2h67kw6y01n1x28cbs11v1a03g8m4c71zm.nar.zst2448machine # [ 494.598471] niks3-server[1191]: 2026/09/30 09:18:55 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.narinfo2449machine # [ 519.110234] niks3-server[1191]: 2026/09/30 09:19:19 INFO Received push request method=POST path=/api/pushes2450machine # [ 519.130962] niks3-server[1191]: 2026/09/30 09:19:19 INFO Registered completed upload object_key=nar/0khxywxb2r78vhpc5hsmha3ymgp910z0aka7550jmaqzs333rmzp.nar.zst2451machine # [ 519.137929] niks3-server[1191]: 2026/09/30 09:19:19 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.ls2452machine # [ 519.139654] niks3-server[1191]: 2026/09/30 09:19:19 INFO Received sign narinfos request method=POST path=/api/pushes/24/sign2453machine # [ 519.145076] niks3-server[1191]: 2026/09/30 09:19:19 INFO Signed narinfos id=24 count=12454machine # [ 519.151109] niks3-server[1191]: 2026/09/30 09:19:19 INFO Registered completed upload object_key=log/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4-k3s-b.drv2455machine # [ 519.156226] niks3-server[1191]: 2026/09/30 09:19:19 INFO Received complete push request method=POST path=/api/pushes/24/complete2456machine # [ 519.160085] niks3-server[1191]: 2026/09/30 09:19:19 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.narinfo2457machine # [ 519.228363] niks3-server[1191]: 2026/09/30 09:19:19 INFO Received push request method=POST path=/api/pushes2458machine # [ 519.240157] niks3-server[1191]: 2026/09/30 09:19:19 INFO Received sign narinfos request method=POST path=/api/pushes/25/sign2459machine # [ 519.241312] niks3-server[1191]: 2026/09/30 09:19:19 INFO Signed narinfos id=25 count=12460machine # [ 519.245971] niks3-server[1191]: 2026/09/30 09:19:19 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.ls2461machine # [ 519.248516] niks3-server[1191]: 2026/09/30 09:19:19 INFO Registered completed upload object_key=nar/04bim5f8bvjh25xncf5x40kb529khrlzcbc92qxvapgbc0bdfv2h.nar.zst2462machine # [ 519.249179] niks3-server[1191]: 2026/09/30 09:19:19 INFO Received complete push request method=POST path=/api/pushes/25/complete2463machine # [ 519.252688] niks3-server[1191]: 2026/09/30 09:19:19 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.narinfo2464machine # [ 544.366907] niks3-server[1191]: 2026/09/30 09:19:45 INFO Received push request method=POST path=/api/pushes2465machine # [ 544.385515] niks3-server[1191]: 2026/09/30 09:19:45 INFO Received sign narinfos request method=POST path=/api/pushes/26/sign2466machine # [ 544.390279] niks3-server[1191]: 2026/09/30 09:19:45 INFO Signed narinfos id=26 count=12467machine # [ 544.393876] niks3-server[1191]: 2026/09/30 09:19:45 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.ls2468machine # [ 544.398463] niks3-server[1191]: 2026/09/30 09:19:45 INFO Registered completed upload object_key=nar/11f7f1hixry25c2yc6np9hs10a2pwwqmymmrxxbswhdjabcyvv0s.nar.zst2469machine # [ 544.399741] niks3-server[1191]: 2026/09/30 09:19:45 INFO Registered completed upload object_key=log/jz7biafi8rj5r3r392blyazw5mdpvy0d-k3s-top.drv2470machine # [ 544.401488] niks3-server[1191]: 2026/09/30 09:19:45 INFO Received complete push request method=POST path=/api/pushes/26/complete2471machine # [ 544.410262] niks3-server[1191]: 2026/09/30 09:19:45 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.narinfo2472machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1, in 75.71 seconds)2473(finished: subtest: a renewed balancer certificate is served without a rollout, in 153.00 seconds)2474subtest: metrics carry build_info2475machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g -o jsonpath='{.items[0].status.podIP}{.status.podIP}'2476machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.22 seconds)2477machine: must succeed: curl -sf http://10.42.0.7:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g"'2478machine: (finished: must succeed: curl -sf http://10.42.0.7:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g"', in 0.03 seconds)2479(finished: subtest: metrics carry build_info, in 0.25 seconds)2480subtest: harmonia-gc frees space and the worker stays Ready2481machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"''2482machine # [ 545.888555] k3s[893]: E0930 09:19:46.604218 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:38926: use of closed network connection"2483machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'', in 0.18 seconds)2484machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done'2485machine # [ 546.132225] k3s[893]: E0930 09:19:46.848030 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:38940: use of closed network connection"2486machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done', in 0.24 seconds)2487machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g -c gc -- sh -c 'fallocate -l 11443441664 /nix/fill'2488machine # [ 546.352748] k3s[893]: E0930 09:19:47.068570 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:38952: use of closed network connection"2489machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g -c gc -- sh -c 'fallocate -l 11443441664 /nix/fill', in 0.22 seconds)2490machine: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g -c gc --since=30s | grep -q 'store paths deleted'2491machine: (finished: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g -c gc --since=30s | grep -q 'store paths deleted', in 3.82 seconds)2492machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g -c gc -- sh -c 'rm /nix/fill'2493machine # [ 550.339232] k3s[893]: E0930 09:19:51.054855 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:38966: use of closed network connection"2494machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g -c gc -- sh -c 'rm /nix/fill', in 0.16 seconds)2495machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}'2496machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}', in 0.12 seconds)2497machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g -c gc -- sh -c 'command -v nix-daemon && command -v niks3'2498machine # [ 550.619948] k3s[893]: E0930 09:19:51.335849 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:38980: use of closed network connection"2499machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g -c gc -- sh -c 'command -v nix-daemon && command -v niks3', in 0.16 seconds)2500(finished: subtest: harmonia-gc frees space and the worker stays Ready, in 4.91 seconds)2501subtest: losing the balancer mid-build: the client reconnects and the build succeeds2502machine: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb12503machine # [ 550.645155] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1.2504machine # Running as unit: vialb.service; invocation ID: 3225d3b9c4ea43bea58851f9392a84672505machine: (finished: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1, in 0.02 seconds)2506machine: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'"2507machine # [ 550.762472] nix[11044]: don't know how to build these paths:2508machine # [ 550.763484] nix[11044]: /nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv2509machine # [ 550.784653] nix[11044]: copying 1 paths to '127.0.0.1:30051'...2510machine # [ 550.785894] nix[11044]: copying path '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' to '127.0.0.1:30051'...2511machine # [ 550.834777] niks3-server[1191]: 2026/09/30 09:19:51 INFO Received push request method=POST path=/api/pushes2512machine # [ 550.844281] niks3-server[1191]: 2026/09/30 09:19:51 INFO Received sign narinfos request method=POST path=/api/pushes/27/sign2513machine # [ 550.846214] niks3-server[1191]: 2026/09/30 09:19:51 INFO Signed narinfos id=27 count=12514machine # [ 550.848629] niks3-server[1191]: 2026/09/30 09:19:51 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.ls2515machine # [ 550.850418] niks3-server[1191]: 2026/09/30 09:19:51 INFO Registered completed upload object_key=nar/0kkr2vb091wkq0cb0f1q92413dsfskh76wydp8mwysv7rawns0ar.nar.zst2516machine # [ 550.853213] niks3-server[1191]: 2026/09/30 09:19:51 INFO Received complete push request method=POST path=/api/pushes/27/complete2517machine # [ 550.856955] niks3-server[1191]: 2026/09/30 09:19:51 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.narinfo2518machine # [ 550.864216] nix[11044]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051...2519machine # [ 550.865973] nix[11044]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bkxj8: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv2520machine: (finished: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'", in 1.06 seconds)2521machine: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false2522machine: (finished: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false, in 0.24 seconds)2523machine: waiting for success: ! systemctl is-active vialb2524machine # [ 551.974418] nix[11044]: d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv: Stream removed (Socket closed), asking the scheduler again2525machine # [ 551.976467] nix[11044]: scheduler at 127.0.0.1:30051: Stream removed (Socket closed), reconnecting2526machine # [ 552.002435] systemd[1]: cri-containerd-458643a49cfbbcb7e4db46f3535fc4c2f05728fba4339a9b4a14fb717a94f2f8.scope: Deactivated successfully.2527machine # [ 552.004507] systemd[1]: cri-containerd-458643a49cfbbcb7e4db46f3535fc4c2f05728fba4339a9b4a14fb717a94f2f8.scope: Consumed 5.435s CPU time over 8min 33.272s wall clock time, 58.4M memory peak, 38M read from disk, 639.2K incoming IP traffic, 779.3K outgoing IP traffic.2528machine # [ 552.038584] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-458643a49cfbbcb7e4db46f3535fc4c2f05728fba4339a9b4a14fb717a94f2f8-rootfs.mount: Deactivated successfully.2529machine # [ 552.064769] systemd[1]: cri-containerd-e0cf794bb9a7199fb37d3c29d8d8fe9d0c4e4d35d8ed92f43f7dfd11e9c9773a.scope: Deactivated successfully.2530machine # [ 552.090491] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-e0cf794bb9a7199fb37d3c29d8d8fe9d0c4e4d35d8ed92f43f7dfd11e9c9773a-rootfs.mount: Deactivated successfully.2531machine # [ 552.113826] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-e0cf794bb9a7199fb37d3c29d8d8fe9d0c4e4d35d8ed92f43f7dfd11e9c9773a-shm.mount: Deactivated successfully.2532machine # [ 552.296278] cni0: port 4(vethf8c156b6) entered disabled state2533machine # [ 552.144079] dhcpcd[673]: vethf8c156b6: carrier lost2534machine # [ 552.298220] vethf8c156b6 (unregistering): left allmulticast mode2535machine # [ 552.299239] vethf8c156b6 (unregistering): left promiscuous mode2536machine # [ 552.300234] cni0: port 4(vethf8c156b6) entered disabled state2537machine # [ 552.167319] systemd[1]: run-netns-cni\x2da0217e19\x2d476c\x2dcf92\x2dbafa\x2d4490f69056ce.mount: Deactivated successfully.2538machine # [ 552.173848] dhcpcd[673]: vethf8c156b6: deleting address fe80::cc94:4eff:fe8c:71612539machine # [ 552.178845] dhcpcd[673]: vethf8c156b6: deleting route to 169.254.0.0/162540machine # [ 552.208893] k3s[893]: E0930 09:19:52.924615 893 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-lb-5877cc8b4f\" failed with read version: 804 is not as new as written version: 835 for group resource replicasets.apps" logger="UnhandledError"2541machine # [ 552.210557] k3s[893]: E0930 09:19:52.926166 893 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-lb-5877cc8b4f\" failed with read version: 804 is not as new as written version: 835 for group resource replicasets.apps" logger="UnhandledError"2542machine # [ 552.221315] k3s[893]: I0930 09:19:52.937273 893 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7477ebf2-36f9-41a2-8835-bd50d60da8d3-tmp\" (UniqueName: \"kubernetes.io/empty-dir/7477ebf2-36f9-41a2-8835-bd50d60da8d3-tmp\") pod \"7477ebf2-36f9-41a2-8835-bd50d60da8d3\" (UID: \"7477ebf2-36f9-41a2-8835-bd50d60da8d3\") "2543machine # [ 552.222065] k3s[893]: I0930 09:19:52.937332 893 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7477ebf2-36f9-41a2-8835-bd50d60da8d3-tls-ca\" (UniqueName: \"kubernetes.io/secret/7477ebf2-36f9-41a2-8835-bd50d60da8d3-tls-ca\") pod \"7477ebf2-36f9-41a2-8835-bd50d60da8d3\" (UID: \"7477ebf2-36f9-41a2-8835-bd50d60da8d3\") "2544machine # [ 552.222213] k3s[893]: I0930 09:19:52.937368 893 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7477ebf2-36f9-41a2-8835-bd50d60da8d3-tls-lb\" (UniqueName: \"kubernetes.io/secret/7477ebf2-36f9-41a2-8835-bd50d60da8d3-tls-lb\") pod \"7477ebf2-36f9-41a2-8835-bd50d60da8d3\" (UID: \"7477ebf2-36f9-41a2-8835-bd50d60da8d3\") "2545machine # [ 552.222747] k3s[893]: I0930 09:19:52.937394 893 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7477ebf2-36f9-41a2-8835-bd50d60da8d3-config\" (UniqueName: \"kubernetes.io/configmap/7477ebf2-36f9-41a2-8835-bd50d60da8d3-config\") pod \"7477ebf2-36f9-41a2-8835-bd50d60da8d3\" (UID: \"7477ebf2-36f9-41a2-8835-bd50d60da8d3\") "2546machine # [ 552.239464] k3s[893]: I0930 09:19:52.955352 893 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7477ebf2-36f9-41a2-8835-bd50d60da8d3-tls-lb" pod "7477ebf2-36f9-41a2-8835-bd50d60da8d3" (UID: "7477ebf2-36f9-41a2-8835-bd50d60da8d3"). InnerVolumeSpecName "tls-lb". PluginName "kubernetes.io/secret", VolumeGIDValue ""2547machine # [ 552.240576] k3s[893]: I0930 09:19:52.955751 893 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7477ebf2-36f9-41a2-8835-bd50d60da8d3-tmp" pod "7477ebf2-36f9-41a2-8835-bd50d60da8d3" (UID: "7477ebf2-36f9-41a2-8835-bd50d60da8d3"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""2548machine # [ 552.241549] k3s[893]: I0930 09:19:52.956291 893 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7477ebf2-36f9-41a2-8835-bd50d60da8d3-tls-ca" pod "7477ebf2-36f9-41a2-8835-bd50d60da8d3" (UID: "7477ebf2-36f9-41a2-8835-bd50d60da8d3"). InnerVolumeSpecName "tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""2549machine # [ 552.242666] systemd[1]: var-lib-kubelet-pods-7477ebf2\x2d36f9\x2d41a2\x2d8835\x2dbd50d60da8d3-volume\x2dsubpaths-config-envoy-0.mount: Deactivated successfully.2550machine # [ 552.243590] systemd[1]: var-lib-kubelet-pods-7477ebf2\x2d36f9\x2d41a2\x2d8835\x2dbd50d60da8d3-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully.2551machine # [ 552.244340] systemd[1]: var-lib-kubelet-pods-7477ebf2\x2d36f9\x2d41a2\x2d8835\x2dbd50d60da8d3-volumes-kubernetes.io\x7esecret-tls\x2dca.mount: Deactivated successfully.2552machine # [ 552.245244] systemd[1]: var-lib-kubelet-pods-7477ebf2\x2d36f9\x2d41a2\x2d8835\x2dbd50d60da8d3-volumes-kubernetes.io\x7esecret-tls\x2dlb.mount: Deactivated successfully.2553machine # [ 552.245706] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod6c51ea03_db59_467d_b7be_e70a88e88d10.slice.2554machine # [ 552.263345] dhcpcd[673]: vethf8c156b6: removing interface2555machine # [ 552.265777] k3s[893]: I0930 09:19:52.981696 893 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7477ebf2-36f9-41a2-8835-bd50d60da8d3-config" pod "7477ebf2-36f9-41a2-8835-bd50d60da8d3" (UID: "7477ebf2-36f9-41a2-8835-bd50d60da8d3"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""2556machine # [ 552.322514] k3s[893]: I0930 09:19:53.038471 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/6c51ea03-db59-467d-b7be-e70a88e88d10-tls-lb\") pod \"nix-grpc-farm-lb-5877cc8b4f-k527v\" (UID: \"6c51ea03-db59-467d-b7be-e70a88e88d10\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-k527v"2557machine # [ 552.323196] k3s[893]: I0930 09:19:53.038527 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6c51ea03-db59-467d-b7be-e70a88e88d10-config\") pod \"nix-grpc-farm-lb-5877cc8b4f-k527v\" (UID: \"6c51ea03-db59-467d-b7be-e70a88e88d10\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-k527v"2558machine # [ 552.323706] k3s[893]: I0930 09:19:53.038554 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/6c51ea03-db59-467d-b7be-e70a88e88d10-tls-ca\") pod \"nix-grpc-farm-lb-5877cc8b4f-k527v\" (UID: \"6c51ea03-db59-467d-b7be-e70a88e88d10\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-k527v"2559machine # [ 552.335151] k3s[893]: I0930 09:19:53.051115 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c51ea03-db59-467d-b7be-e70a88e88d10-tmp\") pod \"nix-grpc-farm-lb-5877cc8b4f-k527v\" (UID: \"6c51ea03-db59-467d-b7be-e70a88e88d10\") " pod="farm/nix-grpc-farm-lb-5877cc8b4f-k527v"2560machine # [ 552.335833] k3s[893]: I0930 09:19:53.051180 893 reconciler_common.go:299] "Volume detached for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/7477ebf2-36f9-41a2-8835-bd50d60da8d3-tls-ca\") on node \"machine\" DevicePath \"\""2561machine # [ 552.336522] k3s[893]: I0930 09:19:53.051195 893 reconciler_common.go:299] "Volume detached for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/7477ebf2-36f9-41a2-8835-bd50d60da8d3-tls-lb\") on node \"machine\" DevicePath \"\""2562machine # [ 552.337089] k3s[893]: I0930 09:19:53.051208 893 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7477ebf2-36f9-41a2-8835-bd50d60da8d3-config\") on node \"machine\" DevicePath \"\""2563machine # [ 552.337667] k3s[893]: I0930 09:19:53.051223 893 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7477ebf2-36f9-41a2-8835-bd50d60da8d3-tmp\") on node \"machine\" DevicePath \"\""2564machine # [ 552.732583] cni0: port 1(veth20303bc4) entered blocking state2565machine # [ 552.733569] cni0: port 1(veth20303bc4) entered disabled state2566machine # [ 552.734393] veth20303bc4: entered allmulticast mode2567machine # [ 552.735112] veth20303bc4: entered promiscuous mode2568machine # [ 552.584296] (udev-worker)[11217]: Network interface NamePolicy= disabled on kernel command line.2569machine # [ 552.746497] cni0: port 1(veth20303bc4) entered blocking state2570machine # [ 552.747381] cni0: port 1(veth20303bc4) entered forwarding state2571machine # [ 552.611032] dhcpcd[673]: veth20303bc4: IAID 8e:86:3b:932572machine # [ 552.611792] dhcpcd[673]: veth20303bc4: adding address fe80::6863:8eff:fe86:3b932573machine # [ 552.670293] systemd[1]: Started libcontainer container a29d2dd38f3c51101d0658fcfcd3ca7133646ab14d76951df1c7117784124c59.2574machine # [ 552.814474] systemd[1]: Started libcontainer container 4096b40b6b8ce7e565df2c96e0f7e82e0fbe1d0e39071605f9f3e3b363227e53.2575machine # [ 552.834131] k3s[893]: I0930 09:19:53.549929 893 scope.go:122] "RemoveContainer" containerID="458643a49cfbbcb7e4db46f3535fc4c2f05728fba4339a9b4a14fb717a94f2f8"2576machine # [ 552.843182] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod7477ebf2_36f9_41a2_8835_bd50d60da8d3.slice.2577machine # [ 552.845159] systemd[1]: kubepods-besteffort-pod7477ebf2_36f9_41a2_8835_bd50d60da8d3.slice: Consumed 5.466s CPU time over 8min 35.263s wall clock time, 58.7M memory peak, 38M read from disk, 639.2K incoming IP traffic, 779.3K outgoing IP traffic.2578machine # [ 552.846191] k3s[893]: I0930 09:19:53.562205 893 scope.go:122] "RemoveContainer" containerID="458643a49cfbbcb7e4db46f3535fc4c2f05728fba4339a9b4a14fb717a94f2f8"2579machine # [ 552.847571] k3s[893]: E0930 09:19:53.563426 893 remote_runtime.go:569] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"458643a49cfbbcb7e4db46f3535fc4c2f05728fba4339a9b4a14fb717a94f2f8\": not found" containerID="458643a49cfbbcb7e4db46f3535fc4c2f05728fba4339a9b4a14fb717a94f2f8"2580machine # [ 552.848431] k3s[893]: I0930 09:19:53.563459 893 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"458643a49cfbbcb7e4db46f3535fc4c2f05728fba4339a9b4a14fb717a94f2f8"} err="failed to get container status \"458643a49cfbbcb7e4db46f3535fc4c2f05728fba4339a9b4a14fb717a94f2f8\": rpc error: code = NotFound desc = an error occurred when try to find container \"458643a49cfbbcb7e4db46f3535fc4c2f05728fba4339a9b4a14fb717a94f2f8\": not found"2581machine # [ 552.903704] k3s[893]: I0930 09:19:53.619281 893 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-5877cc8b4f-k527v" podStartSLOduration=1.61925867 podStartE2EDuration="1.61925867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-30 09:19:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 09:19:53.618656358 +0000 UTC m=+535.517641428" watchObservedRunningTime="2026-09-30 09:19:53.61925867 +0000 UTC m=+535.518243460"2582machine # [ 553.046695] systemd[1]: var-lib-kubelet-pods-7477ebf2\x2d36f9\x2d41a2\x2d8835\x2dbd50d60da8d3-volume\x2dsubpaths-config-envoy-2.mount: Deactivated successfully.2583machine # [ 553.048752] systemd[1]: var-lib-kubelet-pods-7477ebf2\x2d36f9\x2d41a2\x2d8835\x2dbd50d60da8d3-volume\x2dsubpaths-config-envoy-1.mount: Deactivated successfully.2584machine # [ 553.680822] k3s[893]: I0930 09:19:54.395993 893 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7477ebf2-36f9-41a2-8835-bd50d60da8d3" path="/var/lib/kubelet/pods/7477ebf2-36f9-41a2-8835-bd50d60da8d3/volumes"2585machine # [ 553.701977] dhcpcd[673]: veth20303bc4: soliciting a DHCP lease2586machine # [ 554.394953] dhcpcd[673]: veth20303bc4: soliciting an IPv6 router2587machine # [ 554.478688] nix[11044]: scheduler at 127.0.0.1:30051: failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:30051: tcp handshaker shutdown, reconnecting2588machine # [ 555.530194] nix[11044]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051...2589machine # [ 555.532963] nix[11044]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-6g96g: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv2590machine # [ 558.702441] dhcpcd[673]: veth20303bc4: probing for an IPv4LL address2591machine # [ 563.384785] dhcpcd[673]: veth20303bc4: using IPv4LL address 169.254.75.1362592machine # [ 563.386506] dhcpcd[673]: veth20303bc4: adding route to 169.254.0.0/162593machine # [ 566.400112] dhcpcd[673]: veth20303bc4: no IPv6 Routers available2594machine # [ 600.446597] niks3-server[1191]: 2026/09/30 09:20:41 INFO Received push request method=POST path=/api/pushes2595machine # [ 600.468744] niks3-server[1191]: 2026/09/30 09:20:41 INFO Received sign narinfos request method=POST path=/api/pushes/28/sign2596machine # [ 600.473415] niks3-server[1191]: 2026/09/30 09:20:41 INFO Signed narinfos id=28 count=12597machine # [ 600.476631] niks3-server[1191]: 2026/09/30 09:20:41 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.ls2598machine # [ 600.480790] niks3-server[1191]: 2026/09/30 09:20:41 INFO Registered completed upload object_key=log/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv2599machine # [ 600.489281] niks3-server[1191]: 2026/09/30 09:20:41 INFO Received complete push request method=POST path=/api/pushes/28/complete2600machine # [ 600.489972] niks3-server[1191]: 2026/09/30 09:20:41 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.narinfo2601machine # [ 600.517265] systemd[1]: vialb.service: Deactivated successfully.2602machine # [ 600.518970] systemd[1]: vialb.service: Consumed 183ms CPU time over 49.871s wall clock time, 38.7M memory peak, 4K written to disk, 8.5K incoming IP traffic, 17.1K outgoing IP traffic.2603machine: (finished: waiting for success: ! systemctl is-active vialb, in 48.84 seconds)2604machine: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; }2605machine: (finished: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; }, in 0.03 seconds)2606machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s2607machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 0.20 seconds)2608(finished: subtest: losing the balancer mid-build: the client reconnects and the build succeeds, in 50.39 seconds)2609subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes2610machine: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s12611machine # [ 601.037798] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1.2612machine # Running as unit: slow.service; invocation ID: b408353f410649238c02bc520f6817ff2613machine: (finished: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1, in 0.02 seconds)2614machine # [ 601.157777] nix[12032]: don't know how to build these paths:2615machine # [ 601.158494] nix[12032]: /nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv2616machine # [ 601.183869] nix[12032]: copying 1 paths to '127.0.0.1:30051'...2617machine # [ 601.185725] nix[12032]: copying path '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' to '127.0.0.1:30051'...2618machine # [ 601.219792] k3s[893]: E0930 09:20:41.935472 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:40428: use of closed network connection"2619machine # [ 601.222078] niks3-server[1191]: 2026/09/30 09:20:41 INFO Received push request method=POST path=/api/pushes2620machine # command terminated with exit code 12621machine # [ 601.233799] niks3-server[1191]: 2026/09/30 09:20:41 INFO Received sign narinfos request method=POST path=/api/pushes/29/sign2622machine # [ 601.236024] niks3-server[1191]: 2026/09/30 09:20:41 INFO Signed narinfos id=29 count=12623machine # [ 601.237542] niks3-server[1191]: 2026/09/30 09:20:41 INFO Registered completed upload object_key=nar/0wl2i9xpw0gwrx1xqdgx9ka4n503ky9qhl20pdrdlphn8d6lcx0i.nar.zst2624machine # [ 601.240025] niks3-server[1191]: 2026/09/30 09:20:41 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.ls2625machine # [ 601.244774] niks3-server[1191]: 2026/09/30 09:20:41 INFO Received complete push request method=POST path=/api/pushes/29/complete2626machine # [ 601.249960] niks3-server[1191]: 2026/09/30 09:20:41 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.narinfo2627machine # [ 601.256930] nix[12032]: building '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' on 127.0.0.1:30051...2628machine # [ 601.257794] nix[12032]: slow-s1> machine/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bkxj8: building zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv2629machine # [ 601.410742] k3s[893]: E0930 09:20:42.126677 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:40434: use of closed network connection"2630machine # command terminated with exit code 12631machine # [ 602.661328] k3s[893]: E0930 09:20:43.376945 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:40436: use of closed network connection"2632machine # command terminated with exit code 12633machine # [ 602.829831] k3s[893]: E0930 09:20:43.545773 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:40442: use of closed network connection"2634machine # command terminated with exit code 12635machine # [ 604.082879] k3s[893]: E0930 09:20:44.798522 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:38548: use of closed network connection"2636machine # command terminated with exit code 12637machine # [ 604.249863] k3s[893]: E0930 09:20:44.965815 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:38558: use of closed network connection"2638machine # command terminated with exit code 12639machine # [ 605.494426] k3s[893]: E0930 09:20:46.210034 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:38568: use of closed network connection"2640machine # command terminated with exit code 12641machine # [ 605.664927] k3s[893]: E0930 09:20:46.380861 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:38582: use of closed network connection"2642machine # command terminated with exit code 12643machine # [ 606.929198] k3s[893]: E0930 09:20:47.644783 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:38594: use of closed network connection"2644machine # command terminated with exit code 12645machine # [ 607.107069] k3s[893]: E0930 09:20:47.823008 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:38608: use of closed network connection"2646machine # command terminated with exit code 12647machine # [ 608.354785] k3s[893]: E0930 09:20:49.070442 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:38620: use of closed network connection"2648machine # command terminated with exit code 12649machine # [ 608.534321] k3s[893]: E0930 09:20:49.250261 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:38622: use of closed network connection"2650machine # command terminated with exit code 12651machine # command terminated with exit code 12652machine # [ 609.797707] k3s[893]: E0930 09:20:50.513162 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:38638: use of closed network connection"2653machine # [ 609.969493] k3s[893]: E0930 09:20:50.685448 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:38650: use of closed network connection"2654machine # command terminated with exit code 12655machine # [ 610.186925] postgres[755]: [755] LOG: checkpoint starting: time2656machine # command terminated with exit code 12657machine # [ 611.257394] k3s[893]: E0930 09:20:51.972050 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:38662: use of closed network connection"2658machine # [ 611.429980] k3s[893]: E0930 09:20:52.145921 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:38666: use of closed network connection"2659machine # command terminated with exit code 12660machine # command terminated with exit code 12661machine # [ 612.711830] k3s[893]: E0930 09:20:53.427378 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:38680: use of closed network connection"2662machine # [ 612.818155] postgres[755]: [755] LOG: checkpoint complete: wrote 26 buffers (0.2%), wrote 1 SLRU buffers; 0 WAL file(s) added, 0 removed, 0 recycled; write=2.613 s, sync=0.005 s, total=2.632 s; sync files=22, longest=0.003 s, average=0.001 s; distance=242 kB, estimate=4505 kB; lsn=0/1C7F7B0, redo lsn=0/1C7F7582663machine # [ 612.884448] k3s[893]: E0930 09:20:53.600302 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:38684: use of closed network connection"2664machine # command terminated with exit code 12665machine # [ 614.178996] k3s[893]: E0930 09:20:54.894676 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:41664: use of closed network connection"2666machine # command terminated with exit code 12667machine # [ 614.382601] k3s[893]: E0930 09:20:55.098535 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:41670: use of closed network connection"2668machine # command terminated with exit code 12669machine # command terminated with exit code 12670machine # [ 615.620520] k3s[893]: E0930 09:20:56.336119 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:41672: use of closed network connection"2671machine # [ 615.805969] k3s[893]: E0930 09:20:56.521905 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:41684: use of closed network connection"2672machine # command terminated with exit code 12673machine # [ 617.091481] k3s[893]: E0930 09:20:57.806798 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:41686: use of closed network connection"2674machine # command terminated with exit code 12675machine # [ 617.289421] k3s[893]: E0930 09:20:58.005343 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:41702: use of closed network connection"2676machine # command terminated with exit code 12677machine # [ 618.577055] k3s[893]: E0930 09:20:59.292605 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:41704: use of closed network connection"2678machine # command terminated with exit code 12679machine # [ 618.755743] k3s[893]: E0930 09:20:59.471696 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:41720: use of closed network connection"2680machine # command terminated with exit code 12681machine # [ 620.047222] k3s[893]: E0930 09:21:00.762597 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:41726: use of closed network connection"2682machine # command terminated with exit code 12683machine # [ 620.090667] k3s[893]: I0930 09:21:00.806605 893 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/162684machine # [ 620.228908] k3s[893]: E0930 09:21:00.944848 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:41740: use of closed network connection"2685machine # command terminated with exit code 12686machine # [ 621.519602] k3s[893]: E0930 09:21:02.235241 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:41746: use of closed network connection"2687machine # command terminated with exit code 12688machine # [ 621.706062] k3s[893]: E0930 09:21:02.421959 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:41750: use of closed network connection"2689machine # command terminated with exit code 12690machine # [ 622.967286] k3s[893]: E0930 09:21:03.682843 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:34692: use of closed network connection"2691machine # command terminated with exit code 12692machine # [ 623.145973] k3s[893]: E0930 09:21:03.861933 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:34700: use of closed network connection"2693machine # command terminated with exit code 12694machine # [ 624.440598] k3s[893]: E0930 09:21:05.156236 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:34708: use of closed network connection"2695machine # command terminated with exit code 12696machine # [ 624.633054] k3s[893]: E0930 09:21:05.348973 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:34712: use of closed network connection"2697machine # command terminated with exit code 12698machine # [ 625.861326] k3s[893]: E0930 09:21:06.576981 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:34726: use of closed network connection"2699machine # command terminated with exit code 12700machine # [ 626.031897] k3s[893]: E0930 09:21:06.747842 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:34732: use of closed network connection"2701machine # [ 626.200344] k3s[893]: E0930 09:21:06.916235 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:34736: use of closed network connection"2702machine # command terminated with exit code 12703machine # [ 626.369832] k3s[893]: E0930 09:21:07.085786 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:34738: use of closed network connection"2704machine: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bkxj8 --wait=false2705machine: (finished: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-bkxj8 --wait=false, in 0.14 seconds)2706machine: must succeed: sleep 5.02707machine # [ 626.551724] systemd[1]: cri-containerd-e53b908b2fd90f91c627fab78f93383e637dc2227f124993d48bd995d4865739.scope: Deactivated successfully.2708machine # [ 626.554670] systemd[1]: cri-containerd-e53b908b2fd90f91c627fab78f93383e637dc2227f124993d48bd995d4865739.scope: Consumed 510ms CPU time over 9min 28.120s wall clock time, 13.4M memory peak, 6.4M read from disk.2709machine # [ 626.585789] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-e53b908b2fd90f91c627fab78f93383e637dc2227f124993d48bd995d4865739-rootfs.mount: Deactivated successfully.2710machine # [ 626.615033] k3s[893]: E0930 09:21:07.330291 893 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7\" failed with read version: 884 is not as new as written version: 899 for group resource replicasets.apps" logger="UnhandledError"2711machine # [ 626.623564] k3s[893]: E0930 09:21:07.339522 893 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7\" failed with read version: 899 is not as new as written version: 901 for group resource replicasets.apps" logger="UnhandledError"2712machine # [ 626.628840] systemd[1]: Created slice libcontainer container kubepods-besteffort-poded22ff8f_d702_4c68_8cc3_aa6351428e2c.slice.2713machine # [ 626.708769] k3s[893]: I0930 09:21:07.424709 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/ed22ff8f-d702-4c68-8cc3-aa6351428e2c-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-g8qzz\" (UID: \"ed22ff8f-d702-4c68-8cc3-aa6351428e2c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-g8qzz"2714machine # [ 626.713859] k3s[893]: I0930 09:21:07.424759 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/ed22ff8f-d702-4c68-8cc3-aa6351428e2c-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-g8qzz\" (UID: \"ed22ff8f-d702-4c68-8cc3-aa6351428e2c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-g8qzz"2715machine # [ 626.719089] k3s[893]: I0930 09:21:07.424784 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/ed22ff8f-d702-4c68-8cc3-aa6351428e2c-build\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-g8qzz\" (UID: \"ed22ff8f-d702-4c68-8cc3-aa6351428e2c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-g8qzz"2716machine # [ 626.724163] k3s[893]: I0930 09:21:07.424811 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/ed22ff8f-d702-4c68-8cc3-aa6351428e2c-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-g8qzz\" (UID: \"ed22ff8f-d702-4c68-8cc3-aa6351428e2c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-g8qzz"2717machine # [ 626.728988] k3s[893]: I0930 09:21:07.424837 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/ed22ff8f-d702-4c68-8cc3-aa6351428e2c-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-g8qzz\" (UID: \"ed22ff8f-d702-4c68-8cc3-aa6351428e2c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-g8qzz"2718machine # [ 626.733839] k3s[893]: I0930 09:21:07.424863 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jx78\" (UniqueName: \"kubernetes.io/projected/ed22ff8f-d702-4c68-8cc3-aa6351428e2c-kube-api-access-4jx78\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-g8qzz\" (UID: \"ed22ff8f-d702-4c68-8cc3-aa6351428e2c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-g8qzz"2719machine # [ 626.739208] k3s[893]: I0930 09:21:07.424890 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/ed22ff8f-d702-4c68-8cc3-aa6351428e2c-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-g8qzz\" (UID: \"ed22ff8f-d702-4c68-8cc3-aa6351428e2c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-g8qzz"2720machine # [ 626.744144] k3s[893]: I0930 09:21:07.424915 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/ed22ff8f-d702-4c68-8cc3-aa6351428e2c-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-g8qzz\" (UID: \"ed22ff8f-d702-4c68-8cc3-aa6351428e2c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-g8qzz"2721machine # [ 626.749103] k3s[893]: I0930 09:21:07.424941 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ed22ff8f-d702-4c68-8cc3-aa6351428e2c-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-g8qzz\" (UID: \"ed22ff8f-d702-4c68-8cc3-aa6351428e2c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-g8qzz"2722machine # [ 627.156750] cni0: port 4(veth94870e5b) entered blocking state2723machine # [ 627.158470] cni0: port 4(veth94870e5b) entered disabled state2724machine # [ 627.160971] veth94870e5b: entered allmulticast mode2725machine # [ 627.163195] veth94870e5b: entered promiscuous mode2726machine # [ 627.180454] cni0: port 4(veth94870e5b) entered blocking state2727machine # [ 627.182430] cni0: port 4(veth94870e5b) entered forwarding state2728machine # [ 627.058316] (udev-worker)[13700]: Network interface NamePolicy= disabled on kernel command line.2729machine # [ 627.086994] dhcpcd[673]: veth94870e5b: IAID b5:cd:4d:d12730machine # [ 627.087791] dhcpcd[673]: veth94870e5b: adding address fe80::342e:b5ff:fecd:4dd12731machine # [ 627.120262] systemd[1]: Started libcontainer container 67dd4aaa846c0a8ff506bbf2924341e0f5a3388bd064f8a1dbcfa8cbd61853f7.2732machine # [ 627.313641] systemd[1]: Started libcontainer container 9ff117c51a7761c73cdfdefa9b763b40bd06e7ef7ddf791e1dfbd6952ff73f79.2733machine # [ 627.369324] dhcpcd[673]: veth94870e5b: soliciting a DHCP lease2734machine # [ 628.893256] dhcpcd[673]: veth94870e5b: soliciting an IPv6 router2735machine # [ 629.940251] systemd[1]: cri-containerd-9ff117c51a7761c73cdfdefa9b763b40bd06e7ef7ddf791e1dfbd6952ff73f79.scope: Deactivated successfully.2736machine # [ 629.945057] systemd[1]: cri-containerd-9ff117c51a7761c73cdfdefa9b763b40bd06e7ef7ddf791e1dfbd6952ff73f79.scope: Consumed 1.122s CPU time over 2.625s wall clock time, 498.1M memory peak, 221.8M read from disk, 161.2M written to disk.2737machine # [ 629.999533] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-9ff117c51a7761c73cdfdefa9b763b40bd06e7ef7ddf791e1dfbd6952ff73f79-rootfs.mount: Deactivated successfully.2738machine # [ 631.334124] systemd[1]: tmp-ovl\x2didmapped47361929.mount: Deactivated successfully.2739machine # [ 631.358451] systemd[1]: Started libcontainer container c9245fed4eb5d0793efdf5514f951ac0523cc34db49a75ddc068a0af2d07293d.2740machine # [ 631.537314] systemd[1]: Started libcontainer container c1eebc4af178f8f78083ac5e8115cf3927f833ff248c8a480ed99fd88c547876.2741machine: (finished: must succeed: sleep 5.0, in 5.02 seconds)2742machine # [ 631.761313] k3s[893]: E0930 09:21:12.476882 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:34740: use of closed network connection"2743machine # command terminated with exit code 12744machine # [ 631.777329] systemd[1]: Started libcontainer container 7ff5bf3f7c0a7b759b49fd67af0f5a3c76817ac52e85cdf64eaee8624b700d33.2745machine # [ 631.960061] k3s[893]: I0930 09:21:12.675425 893 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-df8f6d5c7-g8qzz" podStartSLOduration=3.07001567 podStartE2EDuration="5.675406858s" totalImagesPullingTime="0s" totalInitContainerRuntime="2.605391188s" isStatefulPod=false podCreationTimestamp="2026-09-30 09:21:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-30 09:21:12.587301806 +0000 UTC m=+614.486286596" watchObservedRunningTime="2026-09-30 09:21:12.675406858 +0000 UTC m=+614.574391369"2746machine # [ 631.971929] k3s[893]: E0930 09:21:12.680147 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:34750: use of closed network connection"2747machine: waiting for success: ! systemctl is-active slow2748machine # [ 632.178574] systemd[1]: tmp-ovl\x2didmapped3652687008.mount: Deactivated successfully.2749machine # [ 632.370888] dhcpcd[673]: veth94870e5b: probing for an IPv4LL address2750machine # [ 638.036212] dhcpcd[673]: veth94870e5b: using IPv4LL address 169.254.11.182751machine # [ 638.038920] dhcpcd[673]: veth94870e5b: adding route to 169.254.0.0/162752machine # [ 640.897935] dhcpcd[673]: veth94870e5b: no IPv6 Routers available2753machine # [ 645.795276] niks3-server[1191]: 2026/09/30 09:21:26 INFO Received push request method=POST path=/api/pushes2754machine # [ 645.816667] niks3-server[1191]: 2026/09/30 09:21:26 INFO Received sign narinfos request method=POST path=/api/pushes/30/sign2755machine # [ 645.818821] niks3-server[1191]: 2026/09/30 09:21:26 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.ls2756machine # [ 645.821341] niks3-server[1191]: 2026/09/30 09:21:26 INFO Signed narinfos id=30 count=12757machine # [ 645.826123] niks3-server[1191]: 2026/09/30 09:21:26 INFO Registered completed upload object_key=log/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv2758machine # [ 645.829194] niks3-server[1191]: 2026/09/30 09:21:26 INFO Received complete push request method=POST path=/api/pushes/30/complete2759machine # [ 645.834200] niks3-server[1191]: 2026/09/30 09:21:26 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo2760machine # [ 645.868608] systemd[1]: slow.service: Deactivated successfully.2761machine # [ 645.869767] systemd[1]: slow.service: Consumed 147ms CPU time over 44.830s wall clock time, 40.4M memory peak, 4K written to disk, 5.3K incoming IP traffic, 11.5K outgoing IP traffic.2762machine: (finished: waiting for success: ! systemctl is-active slow, in 14.57 seconds)2763machine: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; }2764machine: (finished: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; }, in 0.03 seconds)2765machine: must fail: journalctl -u slow | grep -q 'asking the scheduler again'2766machine: (finished: must fail: journalctl -u slow | grep -q 'asking the scheduler again', in 0.02 seconds)2767machine: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath2768machine: (finished: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath, in 0.12 seconds)2769machine: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null2770machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null, in 0.04 seconds)2771(finished: subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes, in 45.75 seconds)2772(finished: run the VM test script, in 647.74 seconds)2773test script finished in 647.78s2774cleanup2775kill QemuMachine (pid 45)2776machine # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14)2777machine # [2026-09-30T09:21:27Z INFO virtiofsd] Client disconnected, shutting down2778machine # [2026-09-30T09:21:27Z INFO virtiofsd] Client disconnected, shutting down2779machine # [2026-09-30T09:21:27Z INFO virtiofsd] Client disconnected, shutting down2780(finished: cleanup, in 1.05 seconds)2781additionally exposed symbols:2782 machine,2783 vlan1,2784 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh