nixbot

builds

failed vm-test-run-nix-grpc-farm-k3s checks.x86_64-linux.k3s · build #204 · raw

1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 1200.0 seconds6run the VM test script7machine: waiting for unit k3s.service8machine: waiting for the VM to finish booting9machine: starting vm10machine: QEMU running (pid 45)11machine # Disk image does not exist, creating the virtualisation disk image...12machine # Formatting '/build/vm-state-machine/tmp.dpv9fUZVcn', fmt=raw size=1717986918413machine # mke2fs 1.47.4 (6-Mar-2025)14machine # Discarding device blocks: 0/4194304 done15machine # Creating filesystem with 4194304 4k blocks and 1048576 inodes16machine # Filesystem UUID: 4c44da02-d715-4338-8f8d-595adade1eda17machine # Superblock backups stored on blocks:18machine # 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208,19machine # 409600020machine # 21machine # Allocating group tables: 0/128 done22machine # Writing inode tables: 0/128 done23machine # Creating journal (32768 blocks): done24machine # Writing superblocks and filesystem accounting information: 0/128 done25machine # 26machine # Virtualisation disk image created.27machine # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)28machine # 29machine # 30machine # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+7EFCC730+7EF2C730 CA0031machine # Press Ctrl-B to configure iPXE (PCI 00:02.0)...32machine # 33machine # 34machine # 35machine # 36machine # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 7EFCC730 7EF2C730 CB0037machine # Press Ctrl-B to configure iPXE (PCI 00:08.0)...38machine # 39machine # 40machine # Booting from ROM...41machine # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 202642machine # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/4fzwjs7rc0a9690q2g4092shv11i0y1r-nixos-system-machine-test/init regInfo=/nix/store/hhfx1vny1kpznv93m22y0wv8kngqyc70-closure-info/registration console=ttyS0,115200n8 console=tty043machine # [ 0.000000] BIOS-provided physical RAM map:44machine # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable45machine # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved46machine # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved47machine # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007ffd7fff] usable48machine # [ 0.000000] BIOS-e820: [mem 0x000000007ffd8000-0x000000007fffffff] reserved49machine # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved50machine # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved51machine # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved52machine # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved53machine # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000017fffffff] usable54machine # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved55machine # [ 0.000000] NX (Execute Disable) protection: active56machine # [ 0.000000] APIC: Static calls initialized57machine # [ 0.000000] SMBIOS 2.8 present.58machine # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201459machine # [ 0.000000] DMI: Memory slots populated: 1/160machine # [ 0.000000] Hypervisor detected: KVM61machine # [ 0.000000] last_pfn = 0x7ffd8 max_arch_pfn = 0x1000000000062machine # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0063machine # [ 0.000001] kvm-clock: using sched offset of 493080606 cycles64machine # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns65machine # [ 0.000005] tsc: Detected 2400.012 MHz processor66machine # [ 0.000812] last_pfn = 0x180000 max_arch_pfn = 0x1000000000067machine # [ 0.000839] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs68machine # [ 0.000841] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT69machine # [ 0.000880] last_pfn = 0x7ffd8 max_arch_pfn = 0x1000000000070machine # [ 0.002736] found SMP MP-table at [mem 0x000f5450-0x000f545f]71machine # [ 0.002748] Using GB pages for direct mapping72machine # [ 0.002829] RAMDISK: [mem 0x7e367000-0x7ffcffff]73machine # [ 0.002839] ACPI: Early table checksum verification disabled74machine # [ 0.002842] ACPI: RSDP 0x00000000000F5250 000014 (v00 BOCHS )75machine # [ 0.002846] ACPI: RSDT 0x000000007FFE2539 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)76machine # [ 0.002850] ACPI: FACP 0x000000007FFE2319 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)77machine # [ 0.002857] ACPI: DSDT 0x000000007FFE0040 0022D9 (v01 BOCHS BXPC 00000001 BXPC 00000001)78machine # [ 0.002859] ACPI: FACS 0x000000007FFE0000 00004079machine # [ 0.002861] ACPI: APIC 0x000000007FFE240D 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)80machine # [ 0.002862] ACPI: HPET 0x000000007FFE249D 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)81machine # [ 0.002864] ACPI: MCFG 0x000000007FFE24D5 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)82machine # [ 0.002865] ACPI: WAET 0x000000007FFE2511 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)83machine # [ 0.002866] ACPI: Reserving FACP table memory at [mem 0x7ffe2319-0x7ffe240c]84machine # [ 0.002867] ACPI: Reserving DSDT table memory at [mem 0x7ffe0040-0x7ffe2318]85machine # [ 0.002868] ACPI: Reserving FACS table memory at [mem 0x7ffe0000-0x7ffe003f]86machine # [ 0.002869] ACPI: Reserving APIC table memory at [mem 0x7ffe240d-0x7ffe249c]87machine # [ 0.002869] ACPI: Reserving HPET table memory at [mem 0x7ffe249d-0x7ffe24d4]88machine # [ 0.002869] ACPI: Reserving MCFG table memory at [mem 0x7ffe24d5-0x7ffe2510]89machine # [ 0.002870] ACPI: Reserving WAET table memory at [mem 0x7ffe2511-0x7ffe2538]90machine # [ 0.003117] No NUMA configuration found91machine # [ 0.003118] Faking a node at [mem 0x0000000000000000-0x000000017fffffff]92machine # [ 0.003120] NODE_DATA(0) allocated [mem 0x17fffa780-0x17ffffcff]93machine # [ 0.005528] Zone ranges:94machine # [ 0.005529] DMA [mem 0x0000000000001000-0x0000000000ffffff]95machine # [ 0.005530] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]96machine # [ 0.005532] Normal [mem 0x0000000100000000-0x000000017fffffff]97machine # [ 0.005533] Device empty98machine # [ 0.005533] Movable zone start for each node99machine # [ 0.005534] Early memory node ranges100machine # [ 0.005534] node 0: [mem 0x0000000000001000-0x000000000009efff]101machine # [ 0.005535] node 0: [mem 0x0000000000100000-0x000000007ffd7fff]102machine # [ 0.005536] node 0: [mem 0x0000000100000000-0x000000017fffffff]103machine # [ 0.005537] Initmem setup node 0 [mem 0x0000000000001000-0x000000017fffffff]104machine # [ 0.005558] On node 0, zone DMA: 1 pages in unavailable ranges105machine # [ 0.005834] On node 0, zone DMA: 97 pages in unavailable ranges106machine # [ 0.080771] On node 0, zone Normal: 40 pages in unavailable ranges107machine # [ 0.081258] ACPI: PM-Timer IO Port: 0x608108machine # [ 0.081272] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])109machine # [ 0.081311] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23110machine # [ 0.081314] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)111machine # [ 0.081316] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)112machine # [ 0.081318] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)113machine # [ 0.081319] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)114machine # [ 0.081319] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)115machine # [ 0.081322] ACPI: Using ACPI (MADT) for SMP configuration information116machine # [ 0.081323] ACPI: HPET id: 0x8086a201 base: 0xfed00000117machine # [ 0.081328] TSC deadline timer available118machine # [ 0.081333] CPU topo: Max. logical packages: 1119machine # [ 0.081334] CPU topo: Max. logical dies: 1120machine # [ 0.081334] CPU topo: Max. dies per package: 1121machine # [ 0.081337] CPU topo: Max. threads per core: 1122machine # [ 0.081338] CPU topo: Num. cores per package: 4123machine # [ 0.081338] CPU topo: Num. threads per package: 4124machine # [ 0.081339] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs125machine # [ 0.081365] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()126machine # [ 0.081383] kvm-guest: KVM setup pv remote TLB flush127machine # [ 0.081386] kvm-guest: setup PV sched yield128machine # [ 0.081396] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]129machine # [ 0.081397] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]130machine # [ 0.081398] PM: hibernation: Registered nosave memory: [mem 0x7ffd8000-0xffffffff]131machine # [ 0.081400] [mem 0xc0000000-0xfed1bfff] available for PCI devices132machine # [ 0.081402] Booting paravirtualized kernel on KVM133machine # [ 0.081405] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns134machine # [ 0.085884] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1135machine # [ 0.088168] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288136machine # [ 0.088220] kvm-guest: PV spinlocks enabled137machine # [ 0.088222] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)138machine # [ 0.088225] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/4fzwjs7rc0a9690q2g4092shv11i0y1r-nixos-system-machine-test/init regInfo=/nix/store/hhfx1vny1kpznv93m22y0wv8kngqyc70-closure-info/registration console=ttyS0,115200n8 console=tty0139machine # [ 0.088330] Unknown kernel command line parameters "regInfo=/nix/store/hhfx1vny1kpznv93m22y0wv8kngqyc70-closure-info/registration", will be passed to user space.140machine # [ 0.088344] random: crng init done141machine # [ 0.088345] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes142machine # [ 0.092776] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)143machine # [ 0.095262] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)144machine # [ 0.095343] software IO TLB: area num 4.145machine # [ 0.173354] Fallback order for Node 0: 0146machine # [ 0.173362] Built 1 zonelists, mobility grouping on. Total pages: 1048438147machine # [ 0.173364] Policy zone: Normal148machine # [ 0.176002] mem auto-init: stack:all(zero), heap alloc:on, heap free:off149machine # [ 0.183441] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1150machine # [ 0.192975] allocated 8388608 bytes of page_ext151machine # [ 0.203285] ftrace: allocating 48731 entries in 192 pages152machine # [ 0.203286] ftrace: allocated 192 pages with 2 groups153machine # [ 0.204156] Dynamic Preempt: lazy154machine # [ 0.204351] rcu: Preemptible hierarchical RCU implementation.155machine # [ 0.204352] rcu: RCU event tracing is enabled.156machine # [ 0.204353] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.157machine # [ 0.204354] Trampoline variant of Tasks RCU enabled.158machine # [ 0.204355] Rude variant of Tasks RCU enabled.159machine # [ 0.204355] Tracing variant of Tasks RCU enabled.160machine # [ 0.204356] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.161machine # [ 0.204356] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4162machine # [ 0.204383] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163machine # [ 0.204385] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164machine # [ 0.204387] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.165machine # [ 0.208795] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16166machine # [ 0.209122] rcu: srcu_init: Setting srcu_struct sizes based on contention.167machine # [ 0.209132] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns168machine # [ 0.209253] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)169machine # [ 0.212874] Console: colour VGA+ 80x25170machine # [ 0.212878] printk: legacy console [tty0] enabled171machine # [ 0.244559] printk: legacy console [ttyS0] enabled172machine # [ 0.357103] ACPI: Core revision 20250807173machine # [ 0.358054] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns174machine # [ 0.359700] APIC: Switch to symmetric I/O mode setup175machine # [ 0.360763] x2apic enabled176machine # [ 0.361524] APIC: Switched APIC routing to: physical x2apic177machine # [ 0.362497] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()178machine # [ 0.363810] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()179machine # [ 0.365371] kvm-guest: setup PV IPIs180machine # [ 0.367010] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1181machine # [ 0.368076] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns182machine # [ 0.372428] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)183machine # [ 0.374513] x86/cpu: User Mode Instruction Prevention (UMIP) activated184machine # [ 0.375552] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127185machine # [ 0.376425] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0186machine # [ 0.377429] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto187machine # [ 0.379425] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl188machine # [ 0.380425] Transient Scheduler Attacks: Vulnerable: No microcode189machine # [ 0.381425] Spectre V2 : Mitigation: Enhanced / Automatic IBRS190machine # [ 0.382425] Speculative Return Stack Overflow: Mitigation: Safe RET191machine # [ 0.383425] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization192machine # [ 0.384433] Spectre V2 : Enabling IBPB for BPF193machine # [ 0.385425] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier194machine # [ 0.386425] active return thunk: srso_alias_return_thunk195machine # [ 0.388372] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'196machine # [ 0.389424] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'197machine # [ 0.390424] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'198machine # [ 0.391424] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'199machine # [ 0.392424] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'200machine # [ 0.393424] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'201machine # [ 0.394424] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'202machine # [ 0.396425] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256203machine # [ 0.397425] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64204machine # [ 0.398424] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512205machine # [ 0.399425] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024206machine # [ 0.400424] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8207machine # [ 0.401424] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.208machine # [ 0.430552] Freeing SMP alternatives memory: 44K209machine # [ 0.431408] pid_max: default: 32768 minimum: 301210machine # [ 0.432136] LSM: initializing lsm=capability,landlock,yama,bpf,ima211machine # [ 0.433509] landlock: Up and running.212machine # [ 0.434167] Yama: becoming mindful.213machine # [ 0.434644] LSM support for eBPF active214machine # [ 0.435593] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear)215machine # [ 0.436511] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear)216machine # [ 0.440358] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)217machine # [ 0.440972] Performance Events: Fam17h+ core perfctr, AMD PMU driver.218machine # [ 0.441429] ... version: 2219machine # [ 0.442180] ... bit width: 48220machine # [ 0.442427] ... generic counters: 6221machine # [ 0.443191] ... generic bitmap: 000000000000003f222machine # [ 0.443480] ... fixed-purpose counters: 0223machine # [ 0.444265] ... fixed-purpose bitmap: 0000000000000000224machine # [ 0.445182] ... value mask: 0000ffffffffffff225machine # [ 0.445427] ... max period: 00007fffffffffff226machine # [ 0.446385] ... global_ctrl mask: 000000000000003f227machine # [ 0.447319] signal: max sigframe size: 3376228machine # [ 0.448073] rcu: Hierarchical SRCU implementation.229machine # [ 0.448430] rcu: Max phase no-delay instances is 400.230machine # [ 0.449528] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level231machine # [ 0.455045] smp: Bringing up secondary CPUs ...232machine # [ 0.455846] smpboot: x86: Booting SMP configuration:233machine # [ 0.456436] .... node #0, CPUs: #1 #2 #3234machine # [ 0.459500] smp: Brought up 1 node, 4 CPUs235machine # [ 0.461194] smpboot: Total of 4 processors activated (19200.09 BogoMIPS)236machine # [ 0.461901] Memory: 3957556K/4193752K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 220888K reserved, 0K cma-reserved)237machine # [ 0.462802] devtmpfs: initialized238machine # [ 0.464178] x86/mm: Memory block size: 128MB239machine # [ 0.466443] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)240machine # [ 0.467510] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).241machine # [ 0.468522] pinctrl core: initialized pinctrl subsystem242machine # [ 0.469771] PM: RTC time: 21:50:17, date: 2026-09-19243machine # [ 0.473466] NET: Registered PF_NETLINK/PF_ROUTE protocol family244machine # [ 0.475254] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations245machine # [ 0.476428] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations246machine # [ 0.478015] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations247machine # [ 0.478439] audit: initializing netlink subsys (disabled)248machine # [ 0.479453] audit: type=2000 audit(1789854618.594:1): state=initialized audit_enabled=0 res=1249machine # [ 0.479668] thermal_sys: Registered thermal governor 'fair_share'250machine # [ 0.481427] thermal_sys: Registered thermal governor 'bang_bang'251machine # [ 0.482429] thermal_sys: Registered thermal governor 'step_wise'252machine # [ 0.483427] thermal_sys: Registered thermal governor 'user_space'253machine # [ 0.484427] thermal_sys: Registered thermal governor 'power_allocator'254machine # [ 0.485443] cpuidle: using governor menu255machine # [ 0.487657] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5256machine # [ 0.488693] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]257machine # [ 0.489430] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry258machine # [ 0.490442] PCI: Using configuration type 1 for base access259machine # [ 0.491628] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.260machine # [ 0.493905] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages261machine # [ 0.495334] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page262machine # [ 0.496316] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages263machine # [ 0.497329] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page264machine # [ 0.502170] ACPI: Added _OSI(Module Device)265machine # [ 0.504434] ACPI: Added _OSI(Processor Device)266machine # [ 0.506433] ACPI: Added _OSI(Processor Aggregator Device)267machine # [ 0.515135] ACPI: 1 ACPI AML tables successfully acquired and loaded268machine # [ 0.520952] ACPI: Interpreter enabled269machine # [ 0.521286] ACPI: PM: (supports S0 S3 S4 S5)270machine # [ 0.522977] ACPI: Using IOAPIC for interrupt routing271machine # [ 0.523641] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug272machine # [ 0.525429] PCI: Using E820 reservations for host bridge windows273machine # [ 0.526636] ACPI: Enabled 2 GPEs in block 00 to 3F274machine # [ 0.531996] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])275machine # [ 0.532436] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]276machine # [ 0.534534] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]277machine # [ 0.535557] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]278machine # [ 0.537963] PCI host bridge to bus 0000:00279machine # [ 0.538433] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]280machine # [ 0.539428] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]281machine # [ 0.540427] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]282machine # [ 0.542429] pci_bus 0000:00: root bus resource [mem 0x80000000-0xafffffff window]283machine # [ 0.543428] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]284machine # [ 0.544429] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe07ffffffff window]285machine # [ 0.546429] pci_bus 0000:00: root bus resource [bus 00-ff]286machine # [ 0.547583] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint287machine # [ 0.548942] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint288machine # [ 0.568520] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]289machine # [ 0.569440] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]290machine # [ 0.570450] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]291machine # [ 0.572618] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]292machine # [ 0.574257] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint293machine # [ 0.578466] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]294machine # [ 0.580455] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]295machine # [ 0.581450] pci 0000:00:02.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]296machine # [ 0.582505] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]297machine # [ 0.585513] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint298machine # [ 0.590463] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]299machine # [ 0.591350] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]300machine # [ 0.592459] pci 0000:00:03.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]301machine # [ 0.593999] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint302machine # [ 0.598460] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]303machine # [ 0.599388] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]304machine # [ 0.600202] pci 0000:00:04.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]305machine # [ 0.601907] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint306machine # [ 0.605462] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]307machine # [ 0.606347] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]308machine # [ 0.607245] pci 0000:00:05.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]309machine # [ 0.608975] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint310machine # [ 0.614461] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]311machine # [ 0.615369] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]312machine # [ 0.616251] pci 0000:00:06.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]313machine # [ 0.617988] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint314machine # [ 0.621463] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]315machine # [ 0.622382] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]316machine # [ 0.624450] pci 0000:00:07.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]317machine # [ 0.625984] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint318machine # [ 0.641458] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]319machine # [ 0.642397] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]320machine # [ 0.643258] pci 0000:00:08.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]321machine # [ 0.644434] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]322machine # [ 0.647032] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint323machine # [ 0.652650] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]324machine # [ 0.655491] pci 0000:00:09.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]325machine # [ 0.660819] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint326machine # [ 0.672486] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]327machine # [ 0.674450] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]328machine # [ 0.677490] pci 0000:00:0a.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]329machine # [ 0.681855] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint330machine # [ 0.690464] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]331machine # [ 0.692449] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]332machine # [ 0.695487] pci 0000:00:0b.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]333machine # [ 0.700254] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint334machine # [ 0.705021] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]335machine # [ 0.707826] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint336machine # [ 0.711527] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]337machine # [ 0.713826] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint338machine # [ 0.717481] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]339machine # [ 0.719318] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint340machine # [ 0.722375] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]341machine # [ 0.723434] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint342machine # [ 0.724737] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO343machine # [ 0.726683] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint344machine # [ 0.730775] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]345machine # [ 0.731434] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]346machine # [ 0.732738] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint347machine # [ 0.735152] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]348machine # [ 0.738580] ACPI: PCI: Interrupt link LNKA configured for IRQ 10349machine # [ 0.739548] ACPI: PCI: Interrupt link LNKB configured for IRQ 10350machine # [ 0.741537] ACPI: PCI: Interrupt link LNKC configured for IRQ 11351machine # [ 0.742532] ACPI: PCI: Interrupt link LNKD configured for IRQ 11352machine # [ 0.743527] ACPI: PCI: Interrupt link LNKE configured for IRQ 10353machine # [ 0.744528] ACPI: PCI: Interrupt link LNKF configured for IRQ 10354machine # [ 0.745527] ACPI: PCI: Interrupt link LNKG configured for IRQ 11355machine # [ 0.746539] ACPI: PCI: Interrupt link LNKH configured for IRQ 11356machine # [ 0.747466] ACPI: PCI: Interrupt link GSIA configured for IRQ 16357machine # [ 0.748442] ACPI: PCI: Interrupt link GSIB configured for IRQ 17358machine # [ 0.749435] ACPI: PCI: Interrupt link GSIC configured for IRQ 18359machine # [ 0.750432] ACPI: PCI: Interrupt link GSID configured for IRQ 19360machine # [ 0.751441] ACPI: PCI: Interrupt link GSIE configured for IRQ 20361machine # [ 0.752441] ACPI: PCI: Interrupt link GSIF configured for IRQ 21362machine # [ 0.753432] ACPI: PCI: Interrupt link GSIG configured for IRQ 22363machine # [ 0.754440] ACPI: PCI: Interrupt link GSIH configured for IRQ 23364machine # [ 0.757798] iommu: Default domain type: Translated365machine # [ 0.758030] iommu: DMA domain TLB invalidation policy: lazy mode366machine # [ 0.759672] ACPI: bus type USB registered367machine # [ 0.760507] usbcore: registered new interface driver usbfs368machine # [ 0.761494] usbcore: registered new interface driver hub369machine # [ 0.762428] usbcore: registered new device driver usb370machine # [ 0.764813] NetLabel: Initializing371machine # [ 0.765428] NetLabel: domain hash size = 128372machine # [ 0.766184] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO373machine # [ 0.767511] NetLabel: unlabeled traffic allowed by default374machine # [ 0.768433] PCI: Using ACPI for IRQ routing375machine # [ 0.811824] pci 0000:00:01.0: vgaarb: setting as boot VGA device376machine # [ 0.812423] pci 0000:00:01.0: vgaarb: bridge control possible377machine # [ 0.812423] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none378machine # [ 0.815436] vgaarb: loaded379machine # [ 0.816227] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0380machine # [ 0.817059] hpet0: 3 comparators, 64-bit 100.000000 MHz counter381machine # [ 0.821569] clocksource: Switched to clocksource kvm-clock382machine # [ 0.825479] VFS: Disk quotas dquot_6.6.0383machine # [ 0.826215] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)384machine # [ 0.827898] pnp: PnP ACPI init385machine # [ 0.828776] ACPI: IRQ 4 override to edge(!), high(!)386machine # [ 0.829785] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved387machine # [ 0.831325] pnp: PnP ACPI: found 6 devices388machine # [ 0.842102] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns389machine # [ 0.843690] clocksource: Switched to clocksource acpi_pm390machine # [ 0.844800] NET: Registered PF_INET protocol family391machine # [ 0.846271] IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear)392machine # [ 0.864788] tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear)393machine # [ 0.866270] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)394machine # [ 0.867686] TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear)395machine # [ 0.869081] TCP bind hash table entries: 32768 (order: 8, 1048576 bytes, linear)396machine # [ 0.870394] TCP: Hash tables configured (established 32768 bind 32768)397machine # [ 0.871579] MPTCP token hash table entries: 4096 (order: 5, 98304 bytes, linear)398machine # [ 0.872877] UDP hash table entries: 2048 (order: 5, 131072 bytes, linear)399machine # [ 0.874109] UDP-Lite hash table entries: 2048 (order: 5, 131072 bytes, linear)400machine # [ 0.875441] NET: Registered PF_UNIX/PF_LOCAL protocol family401machine # [ 0.876474] NET: Registered PF_XDP protocol family402machine # [ 0.877367] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]403machine # [ 0.878387] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]404machine # [ 0.879407] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]405machine # [ 0.880538] pci_bus 0000:00: resource 7 [mem 0x80000000-0xafffffff window]406machine # [ 0.881671] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]407machine # [ 0.882786] pci_bus 0000:00: resource 9 [mem 0xe0000000000-0xe07ffffffff window]408machine # [ 0.884748] ACPI: \_SB_.GSIA: Enabled at IRQ 16409machine # [ 0.886886] ACPI: \_SB_.GSIB: Enabled at IRQ 17410machine # [ 0.888962] ACPI: \_SB_.GSIC: Enabled at IRQ 18411machine # [ 0.890980] ACPI: \_SB_.GSID: Enabled at IRQ 19412machine # [ 0.892775] PCI: CLS 0 bytes, default 64413machine # [ 0.893645] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)414machine # [ 0.894374] Trying to unpack rootfs image as initramfs...415machine # [ 0.894762] software IO TLB: mapped [mem 0x000000007a367000-0x000000007e367000] (64MB)416machine # [ 0.897663] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns417machine # [ 0.918583] Initialise system trusted keyrings418machine # [ 0.919855] workingset: timestamp_bits=40 max_order=20 bucket_order=0419machine # [ 0.931380] Key type asymmetric registered420machine # [ 0.932169] Asymmetric key parser 'x509' registered421machine # [ 0.933144] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)422machine # [ 0.934868] io scheduler mq-deadline registered423machine # [ 0.935684] io scheduler kyber registered424machine # [ 0.939803] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled425machine # [ 0.941153] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A426machine # [ 0.943749] Linux agpgart interface v0.103427machine # [ 0.944588] ACPI: bus type drm_connector registered428machine # [ 0.947724] usbcore: registered new interface driver usbserial_generic429machine # [ 0.948860] usbserial: USB Serial support registered for generic430machine # [ 0.949867] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.431machine # [ 0.949867] Please enable it if your BIOS has the CPPC option.432machine # [ 0.952249] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled433machine # [ 0.953765] drop_monitor: Initializing network drop monitor service434machine # [ 0.955050] NET: Registered PF_INET6 protocol family435machine # [ 0.958000] Segment Routing with IPv6436machine # [ 0.958695] In-situ OAM (IOAM) with IPv6437machine # [ 0.960618] IPI shorthand broadcast: enabled438machine # [ 0.965044] sched_clock: Marking stable (810011314, 154292133)->(986075730, -21772283)439machine # [ 0.966937] registered taskstats version 1440machine # [ 0.967982] Loading compiled-in X.509 certificates441machine # [ 0.977963] Demotion targets for Node 0: null442machine # [ 0.979035] Key type .fscrypt registered443machine # [ 0.979750] Key type fscrypt-provisioning registered444machine # [ 0.980774] ima: No TPM chip found, activating TPM-bypass!445machine # [ 0.981748] ima: Allocated hash algorithm: sha1446machine # [ 0.982613] ima: No architecture policies found447machine # [ 0.983756] PM: Magic number: 10:463:854448machine # [ 0.985534] RAS: Correctable Errors collector initialized.449machine # [ 0.990087] clk: Disabling unused clocks450machine # [ 0.990816] PM: genpd: Disabling unused power domains451machine # [ 1.180604] Freeing initrd memory: 29092K452machine # [ 1.184628] Freeing unused decrypted memory: 2028K453machine # [ 1.187746] Freeing unused kernel image (initmem) memory: 3644K454machine # [ 1.188898] Write protecting the kernel read-only data: 32768k455machine # [ 1.191130] Freeing unused kernel image (text/rodata gap) memory: 1208K456machine # [ 1.192857] Freeing unused kernel image (rodata/data gap) memory: 752K457machine # [ 1.244068] x86/mm: Checked W+X mappings: passed, no W+X pages found.458machine # [ 1.245213] Run /init as init process459machine # [ 1.257271] systemd[1]: Inserted module 'autofs4'460machine # [ 1.283541] fuse: init (API version 7.45)461machine # [ 1.291061] ACPI: \_SB_.GSIG: Enabled at IRQ 22462machine # [ 1.293851] ACPI: \_SB_.GSIH: Enabled at IRQ 23463machine # [ 1.297113] ACPI: \_SB_.GSIE: Enabled at IRQ 20464machine # [ 1.299419] ACPI: \_SB_.GSIF: Enabled at IRQ 21465machine # [ 1.342622] systemd[1]: Successfully made /usr/ read-only.466machine # [ 1.679671] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)467machine # [ 1.691956] systemd[1]: Detected virtualization kvm.468machine # [ 1.694204] systemd[1]: Detected architecture x86-64.469machine # [ 1.696465] systemd[1]: Running in initrd.470machine # [ 1.698988] systemd[1]: Initializing machine ID from random generator.471machine # [ 1.701929] systemd[1]: Hostname set to <machine>.472machine # [ 1.822669] systemd[1]: bpf-restrict-fs: LSM BPF program attached473machine # [ 1.861113] systemd[1]: Queued start job for default target Initrd Default Target.474machine # [ 1.869910] systemd[1]: Created slice Slice /system/modprobe.475machine # [ 1.871096] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.476machine # [ 1.872583] systemd[1]: Expecting device /dev/disk/by-label/nixos...477machine # [ 1.873702] systemd[1]: Reached target Path Units.478machine # [ 1.874603] systemd[1]: Reached target Slice Units.479machine # [ 1.875506] systemd[1]: Reached target Swaps.480machine # [ 1.876348] systemd[1]: Reached target Timer Units.481machine # [ 1.877359] systemd[1]: Listening on D-Bus System Message Bus Socket.482machine # [ 1.878597] systemd[1]: Listening on Journal Socket (/dev/log).483machine # [ 1.879752] systemd[1]: Listening on Journal Sockets.484machine # [ 1.880756] systemd[1]: Listening on udev Control Socket.485machine # [ 1.881780] systemd[1]: Listening on udev Kernel Socket.486machine # [ 1.882771] systemd[1]: Reached target Socket Units.487machine # [ 1.884756] systemd[1]: Starting Create List of Static Device Nodes...488machine # [ 1.886885] systemd[1]: Starting Load Kernel Module 9pnet_virtio...489machine # [ 1.889017] systemd[1]: Starting Load Kernel Module configfs...490machine # [ 1.894383] systemd[1]: Starting Journal Service...491machine # [ 1.897376] systemd[1]: Starting Load Kernel Modules...492machine # [ 1.898413] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os493machine # [ 1.902388] systemd[1]: Starting Coldplug All udev Devices...494machine # [ 1.904480] systemd[1]: Finished Create List of Static Device Nodes.495machine # [ 1.914458] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...496machine # [ 1.916163] systemd[1]: modprobe@configfs.service: Deactivated successfully.497machine # [ 1.928353] systemd[1]: Finished Load Kernel Module configfs.498machine # [ 1.929340] systemd-journald[92]: Collecting audit messages is disabled.499machine # [ 1.929949] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config500machine # [ 1.945820] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.501machine # [ 1.946445] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.502machine # [ 1.949581] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev503machine # [ 1.955417] systemd[1]: Starting Create Static Device Nodes in /dev...504machine # [ 1.964512] systemd[1]: Finished Load Kernel Modules.505machine # [ 1.964630] netfs: FS-Cache loaded506machine # [ 1.968402] systemd[1]: Starting Apply Kernel Variables...507machine # [ 1.973308] 9pnet: Installing 9P2000 support508machine # [ 1.979417] systemd[1]: Finished Create Static Device Nodes in /dev.509machine # [ 1.980992] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.510machine # [ 1.982854] systemd[1]: Finished Load Kernel Module 9pnet_virtio.511machine # [ 1.984584] systemd[1]: Finished Apply Kernel Variables.512machine # [ 1.985932] systemd[1]: Reached target Preparation for Local File Systems.513machine # [ 1.987443] systemd[1]: Reached target Local File Systems.514machine # [ 1.989608] systemd[1]: Starting Rule-based Manager for Device Events and Files...515machine # [ 1.835405] systemd-modules-load[93]: Using 4 probe threads[ 1.991226] systemd[1]: Started Journal Service.516machine # 517machine # [ 1.838689] systemd-modules-load[93]: Inserted module 'virtio_balloon'518machine # [ 1.839790] systemd-modules-load[93]: Inserted module 'dm_mod'519machine # [ 1.840774] systemd-modules-load[93]: Inserted module 'virtio_gpu'520machine # [ 1.853123] systemd[1]: Starting Create System Files and Directories...521machine # [ 1.866842] systemd-udevd[105]: Using default interface naming scheme 'v261'.522machine # [ 1.874430] systemd[1]: Finished Coldplug All udev Devices.523machine # [ 1.877424] systemd[1]: Finished Create System Files and Directories.524machine # [ 1.878547] systemd[1]: Started Rule-based Manager for Device Events and Files.525machine # [ 1.879678] systemd[1]: Reached target System Initialization.526machine # [ 1.880509] systemd[1]: Reached target Basic System.527machine # [ 2.141807] virtio_blk virtio5: 4/0/0 default/read/poll queues528machine # [ 2.152420] virtio_blk virtio5: [vda] 33554432 512-byte logical blocks (17.2 GB/16.0 GiB)529machine # [ 2.160376] SCSI subsystem initialized530machine # [ 2.164081] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12531machine # [ 2.166958] serio: i8042 KBD port at 0x60,0x64 irq 1532machine # [ 2.167742] serio: i8042 AUX port at 0x60,0x64 irq 12533machine # [ 2.173746] uhci_hcd 0000:00:1d.0: UHCI Host Controller534machine # [ 2.174600] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 1535machine # [ 2.175823] uhci_hcd 0000:00:1d.0: detected 2 ports536machine # [ 2.176711] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c200537machine # [ 2.177840] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18538machine # [ 2.179674] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1539machine # [ 2.183110] usb usb1: Product: UHCI Host Controller540machine # [ 2.184543] usb usb1: Manufacturer: Linux 6.18.50 uhci_hcd541machine # [ 2.185441] usb usb1: SerialNumber: 0000:00:1d.0542machine # [ 2.201782] hub 1-0:1.0: USB hub found543machine # [ 2.202782] hub 1-0:1.0: 2 ports detected544machine # [ 2.057217] systemd[1]: Starting Virtual Console Setup...545machine # [ 2.059580] (udev-worker)[121]: Network interface NamePolicy= disabled on kernel command line.546machine # [ 2.064593] (udev-worker)[118]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.547machine # [ 2.066735] (udev-worker)[118]: Network interface NamePolicy= disabled on kernel command line.548machine # [ 2.225164] ehci-pci 0000:00:1d.7: EHCI Host Controller549machine # [ 2.226035] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 2550machine # [ 2.227507] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000551machine # [ 2.074107] systemd[1]: Found device /dev/disk/by-label/nixos.552machine # [ 2.075519] systemd[1]: Reached target Initrd Root Device.553machine # [ 2.076606] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...554machine # [ 2.235333] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00555machine # [ 2.236638] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18556machine # [ 2.237846] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1557machine # [ 2.239084] usb usb2: Product: EHCI Host Controller558machine # [ 2.085969] systemd-vconsole-setup[145]: Configuration of first virtual console was skipped, ignoring remaining ones.559machine # [ 2.240508] usb usb2: Manufacturer: Linux 6.18.50 ehci_hcd560machine # [ 2.242604] usb usb2: SerialNumber: 0000:00:1d.7561machine # [ 2.089434] systemd[1]: Finished Virtual Console Setup.[ 2.243631] hub 2-0:1.0: USB hub found562machine # 563machine # [ 2.245004] hub 2-0:1.0: 6 ports detected564machine # [ 2.103813] systemd-fsck[153]: nixos: clean, 12/1048576 files, 109865/4194304 blocks565machine # [ 2.108526] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.566machine # [ 2.266424] hub 1-0:1.0: USB hub found567machine # [ 2.267038] hub 1-0:1.0: 2 ports detected568machine # [ 2.268060] uhci_hcd 0000:00:1d.1: UHCI Host Controller569machine # [ 2.268987] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3570machine # [ 2.270411] uhci_hcd 0000:00:1d.1: detected 2 ports571machine # [ 2.271476] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c220572machine # [ 2.272888] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18573machine # [ 2.274425] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1574machine # [ 2.274592] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0575machine # [ 2.274783] usb usb3: Product: UHCI Host Controller576machine # [ 2.277962] usb usb3: Manufacturer: Linux 6.18.50 uhci_hcd577machine # [ 2.278838] usb usb3: SerialNumber: 0000:00:1d.1578machine # [ 2.280232] hub 3-0:1.0: USB hub found579machine # [ 2.281215] hub 3-0:1.0: 2 ports detected580machine # [ 2.284041] uhci_hcd 0000:00:1d.2: UHCI Host Controller581machine # [ 2.284872] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4582machine # [ 2.286045] uhci_hcd 0000:00:1d.2: detected 2 ports583machine # [ 2.287018] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c240584machine # [ 2.288313] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18585machine # [ 2.288464] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode586machine # [ 2.288663] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1587machine # [ 2.288999] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f)588machine # [ 2.289352] usb usb4: Product: UHCI Host Controller589machine # [ 2.289590] ahci 0000:00:1f.2: flags: 64bit ncq only590machine # [ 2.289781] usb usb4: Manufacturer: Linux 6.18.50 uhci_hcd591machine # [ 2.296052] scsi host0: ahci592machine # [ 2.296340] usb usb4: SerialNumber: 0000:00:1d.2593machine # [ 2.296766] scsi host1: ahci594machine # [ 2.297249] hub 4-0:1.0: USB hub found595machine # [ 2.298723] scsi host2: ahci596machine # [ 2.298748] hub 4-0:1.0: 2 ports detected597machine # [ 2.299798] scsi host3: ahci598machine # [ 2.301109] scsi host4: ahci599machine # [ 2.302644] scsi host5: ahci600machine # [ 2.303345] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1601machine # [ 2.304617] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1602machine # [ 2.305891] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1603machine # [ 2.307179] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1604machine # [ 2.308417] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1605machine # [ 2.309745] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1606machine # [ 2.484581] usb 2-1: new high-speed USB device number 2 using ehci-pci607machine # [ 2.614566] usb 2-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00608machine # [ 2.617629] usb 2-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10609machine # [ 2.620353] usb 2-1: Product: QEMU USB Tablet610machine # [ 2.622045] usb 2-1: Manufacturer: QEMU611machine # [ 2.623580] usb 2-1: SerialNumber: 28754-0000:00:1d.7-1612machine # [ 2.626642] ata5: SATA link down (SStatus 0 SControl 300)613machine # [ 2.627724] ata6: SATA link down (SStatus 0 SControl 300)614machine # [ 2.630232] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300)615machine # [ 2.631453] ata2: SATA link down (SStatus 0 SControl 300)616machine # [ 2.633616] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100617machine # [ 2.634537] ata3.00: applying bridge limits618machine # [ 2.635490] ata4: SATA link down (SStatus 0 SControl 300)619machine # [ 2.637852] ata1: SATA link down (SStatus 0 SControl 300)620machine # [ 2.640030] ata3.00: configured for UDMA/100621machine # [ 2.641450] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5622machine # [ 2.661636] hid: raw HID events driver (C) Jiri Kosina623machine # [ 2.676971] usbcore: registered new interface driver usbhid624machine # [ 2.679101] usbhid: USB HID core driver625machine # [ 2.689159] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb2/2-1/2-1:1.0/0003:0627:0001.0001/input/input2626machine # [ 2.693229] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0627machine # [ 2.724722] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray628machine # [ 2.754562] cdrom: Uniform CD-ROM driver Revision: 3.20629machine # [ 2.752393] systemd[1]: Mounting /sysroot...630machine # [ 3.040483] EXT4-fs (vda): mounted filesystem 4c44da02-d715-4338-8f8d-595adade1eda r/w with ordered data mode. Quota mode: none.631machine # [ 2.890156] systemd[1]: Mounted /sysroot.632machine # [ 2.892163] systemd[1]: Reached target Initrd Root File System.633machine # [ 2.894495] systemd[1]: Mounting /sysroot/nix/.ro-store...634machine # [ 2.896658] systemd[1]: Mounting /sysroot/nix/.rw-store...635machine # [ 2.898649] systemd[1]: Mounting /sysroot/run...636machine # [ 2.900449] systemd[1]: Mounting /sysroot/tmp/shared...637machine # [ 2.906275] systemd[1]: Mounting /sysroot/tmp/xchg...638machine # [ 2.910143] systemd[1]: Starting Mountpoints Configured in the Real Root...639machine # [ 2.912561] systemd[1]: Mounted /sysroot/nix/.rw-store.640machine # [ 2.914611] systemd[1]: Mounted /sysroot/run.641machine # [ 3.070811] 9p: Installing v9fs 9p2000 file system support642machine # [ 2.919798] systemd[1]: Starting rw-sysroot-nix-store.service...643machine # [ 2.922323] systemd-sysroot-fstab-check[196]: /sysroot should be mounted in the initrd, will request daemon-reload.644machine # [ 2.925534] systemd[1]: Reload requested from client PID 196 ('systemd-sysroot') (unit initrd-parse-etc.service)...645machine # [ 2.928345] systemd[1]: Reloading...646machine # [ 2.980876] systemd[1]: Reloading finished in 58 ms.647machine # [ 3.002538] systemd-sysroot-fstab-check[196]: Requesting initrd-fs.target/start/replace...648machine # [ 3.005115] systemd[1]: Mounted /sysroot/nix/.ro-store.649machine # [ 3.006711] systemd[1]: Mounted /sysroot/tmp/shared.650machine # [ 3.008216] systemd[1]: Mounted /sysroot/tmp/xchg.651machine # [ 3.009915] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.652machine # [ 3.012211] systemd[1]: Finished rw-sysroot-nix-store.service.653machine # [ 3.013986] systemd-sysroot-fstab-check[196]: Requesting swap.target/start/replace...654machine # [ 3.016306] systemd[1]: Starting rw-sysroot-nix-store.service...655machine # [ 3.020132] systemd[1]: initrd-parse-etc.service: Deactivated successfully.656machine # [ 3.022746] systemd[1]: Finished Mountpoints Configured in the Real Root.657machine # [ 3.024971] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.658machine # [ 3.029305] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.659machine # [ 3.031645] systemd[1]: Finished rw-sysroot-nix-store.service.660machine # [ 3.753619] systemd[1]: Mounting /sysroot/nix/store...661machine # [ 3.789363] systemd[1]: Mounted /sysroot/nix/store.662machine # [ 3.790629] systemd[1]: Reached target Initrd File Systems.663machine # [ 3.792663] systemd[1]: Starting Find NixOS closure...664machine # [ 3.794475] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...665machine # [ 3.821470] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.666machine # [ 3.824296] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.667machine # [ 3.839543] systemd[1]: Finished Find NixOS closure.668machine # [ 3.841553] systemd[1]: Reached target Initrd Default Target.669machine # [ 3.843642] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...670machine # [ 3.873106] systemd[1]: Stopped target Initrd Default Target.671machine # [ 3.875333] systemd[1]: Stopped target Basic System.672machine # [ 3.877294] systemd[1]: Stopped target Initrd Root Device.673machine # [ 3.879379] systemd[1]: Stopped target Path Units.674machine # [ 3.881276] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.675machine # [ 3.885158] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.676machine # [ 3.890439] systemd[1]: Stopped target Slice Units.677machine # [ 3.892466] systemd[1]: Stopped target Socket Units.678machine # [ 3.894541] systemd[1]: Stopped target System Initialization.679machine # [ 3.896625] systemd[1]: Stopped target Swaps.680machine # [ 3.898483] systemd[1]: Stopped target Timer Units.681machine # [ 3.900495] systemd[1]: dbus.socket: Deactivated successfully.682machine # [ 3.902910] systemd[1]: Closed D-Bus System Message Bus Socket.683machine # [ 3.905139] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.684machine # [ 3.907770] systemd[1]: Stopped Find NixOS closure.685machine # [ 3.909673] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio686machine # [ 3.912637] systemd[1]: Starting rw-sysroot-nix-store.service...687machine # [ 3.914358] systemd[1]: systemd-sysctl.service: Deactivated successfully.688machine # [ 3.916328] systemd[1]: Stopped Apply Kernel Variables.689machine # [ 3.917898] systemd[1]: systemd-modules-load.service: Deactivated successfully.690machine # [ 3.919903] systemd[1]: Stopped Load Kernel Modules.691machine # [ 3.921434] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.692machine # [ 3.923672] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.693machine # [ 3.925853] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.694machine # [ 3.928157] systemd[1]: Stopped Create System Files and Directories.695machine # [ 3.929168] systemd[1]: Stopped target Local File Systems.696machine # [ 3.930024] systemd[1]: Stopped target Preparation for Local File Systems.697machine # [ 3.931057] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.698machine # [ 3.932162] systemd[1]: Stopped Coldplug All udev Devices.699machine # [ 3.932968] systemd[1]: Stopping Rule-based Manager for Device Events and Files...700machine # [ 3.934129] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.701machine # [ 3.935227] systemd[1]: Stopped Virtual Console Setup.702machine # [ 3.936035] systemd[1]: initrd-cleanup.service: Deactivated successfully.703machine # [ 3.937075] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.704machine # [ 3.938046] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.705machine # [ 3.939359] systemd[1]: Finished rw-sysroot-nix-store.service.706machine # [ 3.940289] systemd[1]: systemd-udevd.service: Deactivated successfully.707machine # [ 3.941449] systemd[1]: Stopped Rule-based Manager for Device Events and Files.708machine # [ 3.942566] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.709machine # [ 3.943586] systemd[1]: Closed udev Control Socket.710machine # [ 3.944338] systemd[1]: Starting Cleanup udev Database...711machine # [ 3.945331] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.712machine # [ 3.946537] systemd[1]: Stopped Create Static Device Nodes in /dev.713machine # [ 3.947577] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.714machine # [ 3.948829] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.715machine # [ 3.949974] systemd[1]: kmod-static-nodes.service: Deactivated successfully.716machine # [ 3.951151] systemd[1]: Stopped Create List of Static Device Nodes.717machine # [ 3.952212] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.718machine # [ 3.953401] systemd[1]: Finished Cleanup udev Database.719machine # [ 3.954276] systemd[1]: Reached target Switch Root.720machine # [ 3.955153] systemd[1]: Starting NixOS Activation...721machine # [ 4.125218] initrd-nixos-activation-start[245]: booting system configuration /nix/store/4fzwjs7rc0a9690q2g4092shv11i0y1r-nixos-system-machine-test722machine # [ 4.190742] initrd-nixos-activation-start[245]: running activation script...723machine # [ 4.586755] initrd-nixos-activation-start[268]: setting up /etc...724machine # [ 4.865717] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.725machine # [ 4.868522] systemd[1]: Finished NixOS Activation.726machine # [ 4.870407] systemd[1]: Starting Switch Root...727machine # [ 4.886493] systemd[1]: Switching root.728machine # [ 5.107355] systemd-journald[92]: Received SIGTERM from PID 1 (systemd).729machine # [ 5.301889] NET: Registered PF_VSOCK protocol family730machine # [ 5.704752] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)731machine # [ 5.714880] systemd[1]: Detected virtualization kvm.732machine # [ 5.716789] systemd[1]: Detected architecture x86-64.733machine # [ 5.718797] systemd[1]: Detected first boot.734machine # [ 5.725859] systemd[1]: Initializing machine ID from random generator.735machine # [ 5.878312] systemd[1]: bpf-restrict-fs: LSM BPF program attached736machine # [ 5.991065] systemd[1]: Applying preset policy.737machine # [ 6.459595] systemd[1]: Populated /etc with preset unit settings.738machine # [ 6.932377] systemd[1]: initrd-switch-root.service: Deactivated successfully.739machine # [ 6.934119] systemd[1]: Stopped initrd-switch-root.service.740machine # [ 6.937417] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.741machine # [ 6.939883] systemd[1]: Created slice Slice /system/getty.742machine # [ 6.941510] systemd[1]: Created slice User and Session Slice.743machine # [ 6.942608] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.744machine # [ 6.944084] systemd[1]: Started Forward Password Requests to Wall Directory Watch.745machine # [ 6.945400] systemd[1]: Expecting device /dev/hvc0...746machine # [ 6.946243] systemd[1]: Expecting device /dev/ttyS0...747machine # [ 6.947161] systemd[1]: Reached target Local Encrypted Volumes.748machine # [ 6.948162] systemd[1]: Stopped target initrd-fs.target.749machine # [ 6.949075] systemd[1]: Stopped target initrd-root-fs.target.750machine # [ 6.950066] systemd[1]: Stopped target initrd-switch-root.target.751machine # [ 6.951127] systemd[1]: Reached target Virtual Machines and Containers.752machine # [ 6.952231] systemd[1]: Reached target Path Units.753machine # [ 6.953138] systemd[1]: Reached target Remote File Systems.754machine # [ 6.954131] systemd[1]: Reached target Slice Units.755machine # [ 6.955101] systemd[1]: Reached target Swaps.756machine # [ 6.959255] systemd[1]: Listening on Query the User Interactively for a Password.757machine # [ 6.963974] systemd[1]: Listening on Process Core Dump Socket.758machine # [ 6.969467] systemd[1]: Listening on Credential Encryption/Decryption.759machine # [ 6.974766] systemd[1]: Listening on Factory Reset Management.760machine # [ 6.977152] systemd[1]: Listening on Hostname Service Socket.761machine # [ 6.984888] systemd[1]: Starting Journal Log Access Socket...762machine # [ 6.988002] systemd[1]: Listening on Journal Audit Socket.763machine # [ 6.993588] systemd[1]: Listening on Console Output Muting Service Socket.764machine # [ 6.996744] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.765machine # [ 7.000126] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os766machine # [ 7.003541] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki767machine # [ 7.017705] systemd[1]: Listening on Disk Repartitioning Service Socket.768machine # [ 7.019824] systemd[1]: Listening on udev Control Socket.769machine # [ 7.021731] systemd[1]: Listening on udev Varlink Socket.770machine # [ 7.027447] systemd[1]: Mounting Huge Pages File System...771machine # [ 7.032994] systemd[1]: Mounting POSIX Message Queue File System...772machine # [ 7.050023] systemd[1]: Mounting Kernel Debug File System...773machine # [ 7.055935] systemd[1]: Mounting Kernel Trace File System...774machine # [ 7.060641] systemd[1]: Starting Create List of Static Device Nodes...775machine # [ 7.062401] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio776machine # [ 7.067148] systemd[1]: Starting Load Kernel Module configfs...777machine # [ 7.070101] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm778machine # [ 7.074215] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore779machine # [ 7.077711] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse780machine # [ 7.102532] systemd[1]: Mounting FUSE Control File System...781machine # [ 7.104762] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67782machine # [ 7.120393] systemd[1]: Starting Journal Service...783machine # [ 7.124291] systemd[1]: Starting Load Kernel Modules...784machine # [ 7.133799] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...785machine # [ 7.137743] systemd[1]: Starting Remount Root and Kernel File Systems...786machine # [ 7.139342] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os787machine # [ 7.143382] systemd[1]: Starting Coldplug All udev Devices...788machine # [ 7.147400] systemd[1]: Listening on Journal Log Access Socket.789machine # [ 7.149083] systemd[1]: Mounted Huge Pages File System.790machine # [ 7.150441] systemd[1]: Mounted POSIX Message Queue File System.791machine # [ 7.151895] systemd[1]: Mounted Kernel Debug File System.792machine # [ 7.153401] systemd[1]: Mounted Kernel Trace File System.793machine # [ 7.155374] systemd[1]: Finished Create List of Static Device Nodes.794machine # [ 7.156876] systemd[1]: Mounted FUSE Control File System.795machine # [ 7.160966] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...796machine # [ 7.163773] systemd[1]: modprobe@configfs.service: Deactivated successfully.797machine # [ 7.165809] systemd[1]: Finished Load Kernel Module configfs.798machine # [ 7.169389] systemd[1]: Mounting Kernel Configuration File System...799machine # [ 7.180173] systemd-journald[338]: Collecting audit messages is enabled.800machine # [ 7.189436] EXT4-fs (vda): re-mounted 4c44da02-d715-4338-8f8d-595adade1eda.801machine # [ 7.191239] loop: module loaded802machine # [ 7.195832] systemd[1]: Finished Remount Root and Kernel File Systems.803machine # [ 7.198099] systemd[1]: Finished Load Kernel Modules.804machine # [ 7.199969] systemd[1]: Mounted Kernel Configuration File System.805machine # [ 7.046978] systemd[1]: Queued start job for [ 7.201185] systemd[1]: Started Journal Service.806machine # default target Multi-User System.807machine # [ 7.048867] systemd[1]: systemd-journald.service: Deactivated successfully.808machine # [ 7.050154] systemd-modules-load[339]: Using 2 probe threads809machine # [ 7.051488] systemd-modules-load[339]: Inserted module 'loop'810machine # [ 7.052745] systemd[1]: Listening on Disk Image Download Service Socket.811machine # [ 7.054390] systemd[1]: Starting Flush Journal to Persistent Storage...812machine # [ 7.055764] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore813machine # [ 7.059887] systemd[1]: Starting Load/Save OS Random Seed...814machine # [ 7.062178] systemd[1]: Starting Apply Kernel Variables...815machine # [ 7.064099] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os816machine # [ 7.067570] systemd-oomd[341]: No swap; memory pressure usage will be degraded817machine # [ 7.076259] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.818machine # [ 7.243035] systemd-journald[338]: Received client request to flush runtime journal.819machine # [ 7.146132] systemd[1]: Finished Load/Save OS Random Seed.820machine # [ 7.147690] systemd[1]: Reached target First Boot Complete.821machine # [ 7.148881] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.822machine # [ 7.150490] systemd[1]: Starting Create Static Device Nodes in /dev...823machine # [ 7.151900] systemd[1]: Finished Apply Kernel Variables.824machine # [ 7.152638] systemd[1]: Finished Flush Journal to Persistent Storage.825machine # [ 7.179793] systemd[1]: Finished Create Static Device Nodes in /dev.826machine # [ 7.180966] systemd[1]: Reached target Preparation for Local File Systems.827machine # [ 7.183090] systemd[1]: Starting Rule-based Manager for Device Events and Files...828machine # [ 7.184203] systemd[1]: Finished Coldplug All udev Devices.829machine # [ 7.251549] systemd-udevd[370]: Using default interface naming scheme 'v261'.830machine # [ 7.357925] systemd[1]: Started Rule-based Manager for Device Events and Files.831machine # [ 7.425175] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse832machine # [ 7.442181] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.833machine # [ 7.448395] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.834machine # [ 7.471242] (udev-worker)[394]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.835machine # [ 7.474471] (udev-worker)[394]: Network interface NamePolicy= disabled on kernel command line.836machine # [ 7.476888] (udev-worker)[393]: Network interface NamePolicy= disabled on kernel command line.837machine # [ 7.508070] systemd[1]: Condition check resulted in Virtio network device being skipped.838machine # [ 7.665765] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3839machine # [ 7.511903] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore840machine # [ 7.515073] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-[ 7.669454] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console841machine # 9387-6d876050dc67842machine # [ 7.518525] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore843machine # [ 7.685375] Console: switching to colour dummy device 80x25844machine # [ 7.686189] [drm] Found bochs VGA, ID 0xb0c5.845machine # [ 7.686673] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.846machine # [ 7.536083] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os847machine # [ 7.537561] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os848machine # [ 7.692935] ACPI: button: Power Button [PWRF]849machine # [ 7.692948] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic850machine # [ 7.694588] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0851machine # [ 7.708969] Console: switching to colour frame buffer device 160x50852machine # [ 7.710397] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device853machine # [ 7.728357] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized854machine # [ 7.734655] parport_pc 00:02: reported by Plug and Play ACPI855machine # [ 7.734712] rtc_cmos 00:04: RTC can wake from S4856machine # [ 7.736066] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]857machine # [ 7.739707] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:09.0/virtio7/input/input4858machine # [ 7.741455] rtc_cmos 00:04: registered as rtc0859machine # [ 7.742019] rtc_cmos 00:04: setting system clock to 2026-09-19T21:50:25 UTC (1789854625)860machine # [ 7.744180] rtc_cmos 00:04: alarms up to one day, y3k, 242 bytes nvram, hpet irqs861machine # [ 7.747630] systemd-journald[338]: Time jumped backwards, rotating.862machine # [ 7.761475] mousedev: PS/2 mouse device common for all mice863machine # [ 7.793444] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6864machine # [ 7.794654] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt865machine # [ 7.796519] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5866machine # [ 7.796604] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD867machine # [ 7.672840] systemd[1]: Starting Virtual Console Setup...868machine # [ 7.840843] iTCO_wdt iTCO_wdt.0.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660)869machine # [ 7.842930] iTCO_wdt iTCO_wdt.0.auto: initialized. heartbeat=30 sec (nowayout=0)870machine # [ 7.871711] ppdev: user-space parallel port driver871machine # [ 7.728526] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.872machine # [ 7.729814] systemd[1]: Stopped Virtual Console Setup.873machine # [ 7.741416] systemd[1]: Starting Virtual Console Setup...874machine # [ 7.782052] systemd[1]: Mounting /run/wrappers...875machine # [ 7.948133] kvm_amd: TSC scaling supported876machine # [ 7.948808] kvm_amd: Nested Virtualization enabled877machine # [ 7.949421] kvm_amd: Nested Paging enabled878machine # [ 7.949964] kvm_amd: LBR virtualization supported879machine # [ 7.950685] kvm_amd: Virtual VMLOAD VMSAVE supported880machine # [ 7.951436] kvm_amd: Virtual GIF supported881machine # [ 7.952023] kvm_amd: Virtual NMI enabled882machine # [ 7.825665] systemd[1]: Mounted /run/wrappers.883machine # [ 7.827588] systemd[1]: Reached target Local File Systems.884machine # [ 7.828958] systemd[1]: Listening on Boot Loader Control Service Socket.885machine # [ 7.832187] systemd[1]: Starting register-nix-paths.service...886machine # [ 7.834674] systemd[1]: Starting Create SUID/SGID Wrappers...887machine # [ 7.837511] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.888machine # [ 7.845348] s[ 7.999499] EDAC MC: Ver: 3.0.0889machine # ystemd[1]: Starting Save Transient machine-id to Disk...890machine # [ 7.848460] systemd[1]: Starting Create System Files and Directories...891machine # [ 7.890328] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.892machine # [ 7.892726] systemd[1]: Finished Save Transient machine-id to Disk.893machine # [ 7.915770] systemd[1]: Finished Create System Files and Directories.894machine # [ 7.919101] systemd[1]: Starting Rebuild Journal Catalog...895machine # [ 7.923823] systemd[1]: Starting Record System Boot/Shutdown in UTMP...896machine # [ 7.954800] systemd[1]: Finished Record System Boot/Shutdown in UTMP.897machine # [ 7.983403] systemd[1]: Finished Rebuild Journal Catalog.898machine # [ 7.986354] systemd[1]: Starting Update is Completed...899machine # [ 8.015850] systemd[1]: Finished Update is Completed.900machine # [ 8.187487] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.901machine # [ 8.188881] systemd[1]: Finished Create SUID/SGID Wrappers.902machine # [ 8.190319] systemd-vconsole-setup[413]: Configuration of first virtual console was skipped, ignoring remaining ones.903machine # [ 8.192523] systemd[1]: Finished Virtual Console Setup.904machine # [ 8.869285] systemd[1]: Finished register-nix-paths.service.905machine # [ 8.870439] systemd[1]: Reached target System Initialization.906machine # [ 8.871381] systemd[1]: Started Discard unused filesystem blocks once a week.907machine # [ 8.872530] systemd[1]: Started niks3 garbage collection timer.908machine # [ 8.873523] systemd[1]: Started Daily Cleanup of Temporary Directories.909machine # [ 8.874542] systemd[1]: Reached target Timer Units.910machine # [ 8.875314] systemd[1]: Listening on D-Bus System Message Bus Socket.911machine # [ 8.877798] systemd[1]: Listening on niks3 server socket.912machine # [ 8.878683] systemd[1]: Listening on Nix Daemon Socket.913machine # [ 8.879495] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.914machine # [ 8.881063] systemd[1]: Reached target Socket Units.915machine # [ 8.881948] systemd[1]: Reached target Basic System.916machine # [ 8.882987] systemd[1]: Started backdoor.service.917machine # [ 8.884188] systemd[1]: Starting Import lastlog data into lastlog2 database...918machine # [ 8.886369] systemd[1]: Starting Name Service Cache Daemon (nsncd)...919machine # [ 8.898577] systemd[1]: Starting Post-Boot Actions...920machine # [ 8.900799] systemd[1]: Started Reset console on configuration changes.921machine # [ 8.904308] systemd[1]: Starting resolvconf update...922machine # [ 8.906530] systemd[1]: Started rustfs.service.923machine # [ 8.908507] systemd[1]: Starting rustfs-bucket.service...924machine # [ 8.914042] systemd[1]: Starting D-Bus System Message Bus...925machine # [ 8.943180] systemd[1]: Finished Post-Boot Actions.926machine # [ 8.954922] nsncd[496]: Sep 19 21:50:26.866 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"927machine # [ 8.958094] systemd[1]: Started Name Service Cache Daemon (nsncd).928machine # [ 8.960207] systemd[1]: Reached target Host and Network Name Lookups.929machine # [ 8.962136] systemd[1]: Reached target User and Group Name Lookups.930machine # connecting to host...931machine # [ 8.963788] systemd[1]: Starting User Login Management...932machine # [ 8.967979] systemd[1]: Finished Import lastlog data into lastlog2 database.933machine: Guest shell says: b'Spawning backdoor root shell...\n'934machine: connected to guest root shell935machine: (connecting took 9.65 seconds)936machine: (finished: waiting for the VM to finish booting, in 9.85 seconds)937machine # [ 9.011417] dbus-broker-launch[503]: Looking up NSS user entry for 'systemd-timesync'...938machine # [ 9.018054] systemd-logind[523]: New seat seat0.939machine # [ 9.021871] systemd-logind[523]: Watching system buttons on /dev/input/event2 (Power Button)940machine # [ 9.022098] systemd-logind[523]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)941machine # [ 9.022640] systemd-logind[523]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)942machine # [ 9.027273] systemd[1]: Started User Login Management.943machine # [ 9.030583] systemd[1]: Starting linger-users.service...944machine # [ 9.033614] dbus-broker-launch[503]: NSS returned no entry for 'systemd-timesync'945machine # [ 9.035316] dbus-broker-launch[503]: Invalid user-name in /nix/store/ndgnid3f88z2mgg8ra084q4cm8l9ixds-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"946machine # [ 9.053717] systemd[1]: Stopped target Host and Network Name Lookups.947machine # [ 9.054577] systemd[1]: Stopping Host and Network Name Lookups...948machine # [ 9.055419] systemd[1]: Stopped target User and Group Name Lookups.949machine # [ 9.056613] systemd[1]: Stopping User and Group Name Lookups...950machine # [ 9.057889] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...951machine # [ 9.061844] systemd[1]: nscd.service: Deactivated successfully.952machine # [ 9.063317] systemd[1]: Stopped Name Service Cache Daemon (nsncd).953machine # [ 9.064755] systemd[1]: Started D-Bus System Message Bus.954machine # [ 9.068328] systemd[1]: Starting Name Service Cache Daemon (nsncd)...955machine # [ 9.076158] systemd[1]: linger-users.service: Deactivated successfully.956machine # [ 9.080902] systemd[1]: Finished linger-users.service.957machine # [ 9.092392] dbus-broker-launch[503]: Ready958machine # [ 9.103411] nsncd[585]: Sep 19 21:50:27.015 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"959machine # [ 9.106588] systemd[1]: Started Name Service Cache Daemon (nsncd).960machine # [ 9.108561] systemd[1]: Reached target Host and Network Name Lookups.961machine # [ 9.108721] systemd[1]: Reached target User and Group Name Lookups.962machine # [ 9.123697] systemd[1]: Finished resolvconf update.963machine # [ 9.124636] systemd[1]: Reached target Preparation for Network.964machine # [ 9.127127] systemd[1]: Starting DHCP Client...965machine # [ 9.129419] systemd[1]: Starting Address configuration of eth1...966machine # [ 9.131204] systemd[1]: Starting Extra networking commands....967machine # [ 9.197644] network-addresses-eth1-start[616]: adding address 192.168.1.1/24... done968machine # [ 9.207816] network-addresses-eth1-start[616]: adding address 2001:db8:1::1/64... done969machine # [ 9.224084] systemd[1]: Finished Address configuration of eth1.970machine # [ 9.234890] dhcpcd[626]: dhcpcd-10.3.2 starting971machine # [ 9.243458] dhcpcd[678]: dev: loaded udev972machine # [ 9.254842] systemd[1]: Finished Extra networking commands..973machine # [ 9.255952] systemd[1]: Reached target Network.974machine # [ 9.258690] systemd[1]: Starting PostgreSQL Server...975machine # [ 9.260743] systemd[1]: Starting Permit User Sessions...976machine # [ 9.421476] 8021q: 802.1Q VLAN Support v1.8977machine # [ 9.422653] 8021q: adding VLAN 0 to HW filter on device eth1978machine # [ 9.295722] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.979machine # [ 9.299784] systemd[1]: Finished Permit User Sessions.980machine # [ 9.303515] systemd[1]: Started Getty on tty1.981machine # [ 9.303970] systemd[1]: Reached target Login Prompts.982machine # [ 9.533458] cfg80211: Loading compiled-in X.509 certificates for regulatory database983machine # [ 9.559063] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'984machine # [ 9.560522] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'985machine # [ 9.563078] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2986machine # [ 9.564437] cfg80211: failed to load regulatory.db987machine # [ 9.443874] postgresql-pre-start[704]: The files belonging to this database system will be owned by user "postgres".988machine # [ 9.444142] postgresql-pre-start[704]: This user must also own the server process.989machine # [ 9.453477] postgresql-pre-start[704]: The database cluster will be initialized with locale "en_US.UTF-8".990machine # [ 9.453801] postgresql-pre-start[704]: The default database encoding has accordingly been set to "UTF8".991machine # [ 9.454297] postgresql-pre-start[704]: The default text search configuration will be set to "english".992machine # [ 9.454993] postgresql-pre-start[704]: Data page checksums are enabled.993machine # [ 9.455314] postgresql-pre-start[704]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok994machine # [ 9.461667] postgresql-pre-start[704]: creating subdirectories ... ok995machine # [ 9.463275] postgresql-pre-start[704]: selecting dynamic shared memory implementation ... posix996machine # [ 9.624357] 8021q: adding VLAN 0 to HW filter on device eth0997machine # [ 9.471868] dhcpcd[678]: eth0: waiting for carrier998machine # [ 9.472078] dhcpcd[678]: eth0: carrier acquired999machine # [ 9.482636] dhcpcd[678]: DUID 00:01:00:01:32:41:c0:23:52:54:00:12:34:561000machine # [ 9.482803] dhcpcd[678]: eth0: IAID 00:12:34:561001machine # [ 9.483223] dhcpcd[678]: eth0: adding address fe80::5054:ff:fe12:34561002machine # [ 9.553619] postgresql-pre-start[704]: selecting default "max_connections" ... 1001003machine # [ 9.629284] postgresql-pre-start[704]: selecting default "shared_buffers" ... 128MB1004machine # [ 11.186665] dhcpcd[678]: eth0: soliciting a DHCP lease1005machine # [ 11.362309] NET: Registered PF_PACKET protocol family1006machine # [ 11.217293] dhcpcd[678]: eth0: offered 10.0.2.15 from 10.0.2.21007machine # [ 11.224787] dhcpcd[678]: eth0: probing address 10.0.2.15/241008machine # [ 11.424101] dhcpcd[678]: eth0: soliciting an IPv6 router1009machine # [ 11.424613] dhcpcd[678]: eth0: Router Advertisement from fe80::21010machine # [ 11.425560] dhcpcd[678]: eth0: adding address fec0::5054:ff:fe12:3456/641011machine # [ 11.425869] dhcpcd[678]: eth0: adding route to fec0::/641012machine # [ 11.426593] dhcpcd[678]: eth0: adding default route via fe80::21013machine # [ 12.052841] postgresql-pre-start[704]: selecting default time zone ... UTC1014machine # [ 12.058538] postgresql-pre-start[704]: creating configuration files ... ok1015machine # [ 12.350194] postgresql-pre-start[704]: running bootstrap script ... ok1016machine # [ 12.953668] postgresql-pre-start[704]: performing post-bootstrap initialization ... ok1017machine # [ 13.145314] postgresql-pre-start[704]: syncing data to disk ... ok1018machine # [ 13.145675] postgresql-pre-start[704]: initdb: warning: enabling "trust" authentication for local connections1019machine # [ 13.147253] postgresql-pre-start[704]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1020machine # [ 13.148409] postgresql-pre-start[704]: Success. You can now start the database server using:1021machine # [ 13.149915] postgresql-pre-start[704]: pg_ctl -D /var/lib/postgresql/18 -l logfile start1022machine # [ 13.373599] postgres[770]: [770] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1023machine # [ 13.379302] postgres[770]: [770] LOG: listening on IPv6 address "::1", port 54321024machine # [ 13.379462] postgres[770]: [770] LOG: listening on IPv4 address "127.0.0.1", port 54321025machine # [ 13.382763] postgres[770]: [770] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1026machine # [ 13.400117] postgres[785]: [785] LOG: database system was shut down at 2026-09-19 21:50:30 GMT1027machine # [ 13.410109] postgres[770]: [770] LOG: database system is ready to accept connections1028machine # [ 13.417746] systemd[1]: Started PostgreSQL Server.1029machine # [ 13.422455] systemd[1]: Starting PostgreSQL Setup Scripts...1030machine # [ 13.655742] postgresql-setup-start[804]: CREATE DATABASE1031machine # [ 13.697875] postgresql-setup-start[809]: CREATE ROLE1032machine # [ 13.724530] postgresql-setup-start[811]: ALTER DATABASE1033machine # [ 13.729206] systemd[1]: Finished PostgreSQL Setup Scripts.1034machine # [ 13.729415] systemd[1]: Reached target PostgreSQL.1035machine # [ 16.154735] dhcpcd[678]: eth0: leased 10.0.2.15 for 86400 seconds1036machine # [ 16.155446] dhcpcd[678]: eth0: adding route to 10.0.2.0/241037machine # [ 16.156359] dhcpcd[678]: eth0: adding default route via 10.0.2.21038machine # [ 16.329735] systemd[1]: Started DHCP Client.1039machine # [ 16.331482] systemd[1]: Reached target Network is Online.1040machine # [ 16.335167] systemd[1]: Starting k3s service...1041machine # [ 16.501484] k3s[888]: time="2026-09-19T21:50:34Z" level=info msg="Acquiring lock file /var/lib/rancher/k3s/data/.lock"1042machine # [ 16.502144] k3s[888]: time="2026-09-19T21:50:34Z" level=info msg="Preparing data dir /var/lib/rancher/k3s/data/76c98da5fd74d9a243cba8d533ae287fc547ab08ccd8c5ea4811608ce7075724"1043machine # [ 19.753024] rustfs-bucket-start[907]: mb s3://farm1044machine # [ 19.758190] systemd[1]: Finished rustfs-bucket.service.1045machine # [ 21.494679] k3s[888]: time="2026-09-19T21:50:39Z" level=info msg="Starting k3s 1.35.8+k3s1 (e952d68a)"1046machine # [ 21.505226] k3s[888]: time="2026-09-19T21:50:39Z" level=info msg="Configuring sqlite3 database connection pooling: maxIdle=20, maxOpen=0, maxLifetime=0s, maxIdleTime=2m0s"1047machine # [ 21.507759] k3s[888]: time="2026-09-19T21:50:39Z" level=info msg="Kine built with sqlite from github.com/mattn/go-sqlite3 version 3.53.3"1048machine # [ 21.509600] k3s[888]: time="2026-09-19T21:50:39Z" level=info msg="Configuring database table schema and indexes, this may take a moment..."1049machine # [ 21.518041] k3s[888]: time="2026-09-19T21:50:39Z" level=info msg="Database tables and indexes are up to date"1050machine # [ 21.519668] k3s[888]: time="2026-09-19T21:50:39Z" level=info msg="Running startup VACUUM to reclaim disk space, this may take a moment..."1051machine # [ 21.523021] k3s[888]: time="2026-09-19T21:50:39Z" level=info msg="Startup VACUUM completed successfully"1052machine # [ 21.525654] k3s[888]: time="2026-09-19T21:50:39Z" level=info msg="Kine available at unix://kine.sock"1053machine # [ 21.527051] k3s[888]: time="2026-09-19T21:50:39Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]"1054machine # [ 21.529886] k3s[888]: time="2026-09-19T21:50:39Z" level=info msg="Datastore connection validated successfully, proceeding with bootstrap data generation"1055machine # [ 21.531085] k3s[888]: time="2026-09-19T21:50:39Z" level=info msg="generated self-signed CA certificate CN=k3s-client-ca@1789854639: notBefore=2026-09-19 20:50:39.442805578 +0000 UTC notAfter=2036-09-16 20:50:39.442805578 +0000 UTC"1056machine # [ 21.532093] k3s[888]: time="2026-09-19T21:50:39Z" level=info msg="certificate CN=system:admin,O=system:masters signed by CN=k3s-client-ca@1789854639: notBefore=2026-09-19 20:50:39 +0000 UTC notAfter=2027-09-19 20:50:39 +0000 UTC"1057machine # [ 21.532997] k3s[888]: time="2026-09-19T21:50:39Z" level=info msg="certificate CN=system:k3s-supervisor,O=system:masters signed by CN=k3s-client-ca@1789854639: notBefore=2026-09-19 20:50:39 +0000 UTC notAfter=2027-09-19 20:50:39 +0000 UTC"1058machine # [ 21.533898] k3s[888]: time="2026-09-19T21:50:39Z" level=info msg="certificate CN=system:kube-controller-manager signed by CN=k3s-client-ca@1789854639: notBefore=2026-09-19 20:50:39 +0000 UTC notAfter=2027-09-19 20:50:39 +0000 UTC"1059machine # [ 21.534875] k3s[888]: time="2026-09-19T21:50:39Z" level=info msg="certificate CN=system:kube-scheduler signed by CN=k3s-client-ca@1789854639: notBefore=2026-09-19 20:50:39 +0000 UTC notAfter=2027-09-19 20:50:39 +0000 UTC"1060machine # [ 21.535894] k3s[888]: time="2026-09-19T21:50:39Z" level=info msg="certificate CN=system:apiserver,O=system:masters signed by CN=k3s-client-ca@1789854639: notBefore=2026-09-19 20:50:39 +0000 UTC notAfter=2027-09-19 20:50:39 +0000 UTC"1061machine # [ 21.536814] k3s[888]: time="2026-09-19T21:50:39Z" level=info msg="certificate CN=k3s-cloud-controller-manager signed by CN=k3s-client-ca@1789854639: notBefore=2026-09-19 20:50:39 +0000 UTC notAfter=2027-09-19 20:50:39 +0000 UTC"1062machine # [ 21.537756] k3s[888]: time="2026-09-19T21:50:39Z" level=info msg="generated self-signed CA certificate CN=k3s-server-ca@1789854639: notBefore=2026-09-19 20:50:39.448822544 +0000 UTC notAfter=2036-09-16 20:50:39.448822544 +0000 UTC"1063machine # [ 21.538602] k3s[888]: time="2026-09-19T21:50:39Z" level=info msg="certificate CN=kube-apiserver signed by CN=k3s-server-ca@1789854639: notBefore=2026-09-19 20:50:39 +0000 UTC notAfter=2027-09-19 20:50:39 +0000 UTC"1064machine # [ 21.539597] k3s[888]: time="2026-09-19T21:50:39Z" level=info msg="certificate CN=kube-scheduler signed by CN=k3s-server-ca@1789854639: notBefore=2026-09-19 20:50:39 +0000 UTC notAfter=2027-09-19 20:50:39 +0000 UTC"1065machine # [ 21.540284] k3s[888]: time="2026-09-19T21:50:39Z" level=info msg="certificate CN=kube-controller-manager signed by CN=k3s-server-ca@1789854639: notBefore=2026-09-19 20:50:39 +0000 UTC notAfter=2027-09-19 20:50:39 +0000 UTC"1066machine # [ 21.541074] k3s[888]: time="2026-09-19T21:50:39Z" level=info msg="generated self-signed CA certificate CN=k3s-request-header-ca@1789854639: notBefore=2026-09-19 20:50:39.451958417 +0000 UTC notAfter=2036-09-16 20:50:39.451958417 +0000 UTC"1067machine # [ 21.541927] k3s[888]: time="2026-09-19T21:50:39Z" level=info msg="certificate CN=system:auth-proxy signed by CN=k3s-request-header-ca@1789854639: notBefore=2026-09-19 20:50:39 +0000 UTC notAfter=2027-09-19 20:50:39 +0000 UTC"1068machine # [ 21.542676] k3s[888]: time="2026-09-19T21:50:39Z" level=info msg="generated self-signed CA certificate CN=etcd-server-ca@1789854639: notBefore=2026-09-19 20:50:39.453077554 +0000 UTC notAfter=2036-09-16 20:50:39.453077554 +0000 UTC"1069machine # [ 21.543686] k3s[888]: time="2026-09-19T21:50:39Z" level=info msg="certificate CN=etcd-client signed by CN=etcd-server-ca@1789854639: notBefore=2026-09-19 20:50:39 +0000 UTC notAfter=2027-09-19 20:50:39 +0000 UTC"1070machine # [ 21.544553] k3s[888]: time="2026-09-19T21:50:39Z" level=info msg="generated self-signed CA certificate CN=etcd-peer-ca@1789854639: notBefore=2026-09-19 20:50:39.453745795 +0000 UTC notAfter=2036-09-16 20:50:39.453745795 +0000 UTC"1071machine # [ 21.545293] k3s[888]: time="2026-09-19T21:50:39Z" level=info msg="certificate CN=etcd-peer signed by CN=etcd-peer-ca@1789854639: notBefore=2026-09-19 20:50:39 +0000 UTC notAfter=2027-09-19 20:50:39 +0000 UTC"1072machine # [ 21.546065] k3s[888]: time="2026-09-19T21:50:39Z" level=info msg="certificate CN=etcd-server signed by CN=etcd-server-ca@1789854639: notBefore=2026-09-19 20:50:39 +0000 UTC notAfter=2027-09-19 20:50:39 +0000 UTC"1073machine # [ 21.629021] k3s[888]: time="2026-09-19T21:50:39Z" level=info msg="certificate CN=k3s,O=k3s signed by CN=k3s-server-ca@1789854639: notBefore=2026-09-19 20:50:39 +0000 UTC notAfter=2027-09-19 20:50:39 +0000 UTC"1074machine # [ 21.632438] k3s[888]: time="2026-09-19T21:50:39Z" level=warning msg="dynamiclistener [::]:6443: no cached certificate available for preload - deferring certificate load until storage initialization or first client request"1075machine # [ 21.637444] k3s[888]: time="2026-09-19T21:50:39Z" level=info msg="Active TLS secret / (ver=) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__2747_9aec_a8ac_e17f-14f442:fec0::2747:9aec:a8ac:e17f listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=5171D4478E3E4C46CAA3D85A8E69611629200D0F]"1076machine # [ 22.579538] k3s[888]: time="2026-09-19T21:50:40Z" level=info msg="Password verified locally for node machine"1077machine # [ 22.580561] k3s[888]: time="2026-09-19T21:50:40Z" level=info msg="certificate CN=machine signed by CN=k3s-server-ca@1789854639: notBefore=2026-09-19 20:50:40 +0000 UTC notAfter=2027-09-19 20:50:40 +0000 UTC"1078machine # [ 22.867064] k3s[888]: time="2026-09-19T21:50:40Z" level=info msg="certificate CN=system:node:machine,O=system:nodes signed by CN=k3s-client-ca@1789854639: notBefore=2026-09-19 20:50:40 +0000 UTC notAfter=2027-09-19 20:50:40 +0000 UTC"1079machine # [ 22.946630] k3s[888]: time="2026-09-19T21:50:40Z" level=info msg="certificate CN=system:kube-proxy signed by CN=k3s-client-ca@1789854639: notBefore=2026-09-19 20:50:40 +0000 UTC notAfter=2027-09-19 20:50:40 +0000 UTC"1080machine # [ 23.022091] k3s[888]: time="2026-09-19T21:50:40Z" level=info msg="certificate CN=system:k3s-controller signed by CN=k3s-client-ca@1789854639: notBefore=2026-09-19 20:50:40 +0000 UTC notAfter=2027-09-19 20:50:40 +0000 UTC"1081machine # [ 23.104298] k3s[888]: time="2026-09-19T21:50:41Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:52884: runtime core not ready"1082machine # [ 23.186909] k3s[888]: time="2026-09-19T21:50:41Z" level=info msg="Module overlay was already loaded"1083machine # [ 23.462233] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this.1084machine # [ 23.471150] Bridge firewalling registered1085machine # [ 23.346094] k3s[888]: time="2026-09-19T21:50:41Z" level=warning msg="Failed to load kernel module iptable_nat with modprobe"1086machine # [ 23.366215] k3s[888]: time="2026-09-19T21:50:41Z" level=warning msg="Failed to load kernel module iptable_filter with modprobe"1087machine # [ 23.384666] k3s[888]: time="2026-09-19T21:50:41Z" level=warning msg="Failed to load kernel module nft-expr-counter with modprobe"1088machine # [ 23.483971] k3s[888]: time="2026-09-19T21:50:41Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600"1089machine # [ 23.484279] k3s[888]: time="2026-09-19T21:50:41Z" level=info msg="Set sysctl 'net/ipv4/conf/all/forwarding' to 1"1090machine # [ 23.484843] k3s[888]: time="2026-09-19T21:50:41Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_max' to 131072"1091machine # [ 23.485761] k3s[888]: time="2026-09-19T21:50:41Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400"1092machine # [ 23.489681] k3s[888]: time="2026-09-19T21:50:41Z" level=info msg="Creating k3s-cert-monitor event broadcaster"1093machine # [ 23.490799] k3s[888]: time="2026-09-19T21:50:41Z" level=info msg="Connecting to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect"1094machine # [ 23.491649] k3s[888]: time="2026-09-19T21:50:41Z" level=info msg="Saving cluster bootstrap data to datastore"1095machine # [ 23.493052] k3s[888]: time="2026-09-19T21:50:41Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]"1096machine # [ 23.494137] k3s[888]: time="2026-09-19T21:50:41Z" level=info msg="Connection to etcd is ready"1097machine # [ 23.495980] k3s[888]: time="2026-09-19T21:50:41Z" level=info msg="ETCD server is now running"1098machine # [ 23.497099] k3s[888]: time="2026-09-19T21:50:41Z" level=info msg="Polling for API server readiness: GET /readyz failed: the server is currently unable to handle the request"1099machine # [ 23.497838] k3s[888]: time="2026-09-19T21:50:41Z" level=info msg="Handling backend connection request [machine]"1100machine # [ 23.499050] k3s[888]: time="2026-09-19T21:50:41Z" level=info msg="Connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect"1101machine # [ 23.499899] k3s[888]: time="2026-09-19T21:50:41Z" level=info msg="Remotedialer connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect"1102machine # [ 23.501539] k3s[888]: time="2026-09-19T21:50:41Z" level=info msg="Running kube-apiserver --advertise-port=6443 --allow-privileged=true --anonymous-auth=false --api-audiences=https://kubernetes.default.svc.cluster.local,k3s --authorization-mode=Node,RBAC --bind-address=127.0.0.1 --cert-dir=/var/lib/rancher/k3s/server/tls/temporary-certs --client-ca-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --egress-selector-config-file=/var/lib/rancher/k3s/server/etc/egress-selector-config.yaml --enable-admission-plugins=NodeRestriction --enable-aggregator-routing=true --enable-bootstrap-token-auth=true --etcd-servers=unix://kine.sock --kubelet-certificate-authority=/var/lib/rancher/k3s/server/tls/server-ca.crt --kubelet-client-certificate=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.crt --kubelet-client-key=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.key --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --profiling=false --proxy-client-cert-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt --proxy-client-key-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.key --requestheader-allowed-names=system:auth-proxy --requestheader-client-ca-file=/var/lib/rancher/k3s/server/tls/request-header-ca.crt --requestheader-extra-headers-prefix=X-Remote-Extra- --requestheader-group-headers=X-Remote-Group --requestheader-username-headers=X-Remote-User --secure-port=6444 --service-account-issuer=https://kubernetes.default.svc.cluster.local --service-account-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-account-signing-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --storage-backend=etcd3 --tls-cert-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --tls-private-key-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key"1103machine # [ 23.505054] k3s[888]: time="2026-09-19T21:50:41Z" level=info msg="Running kube-scheduler --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --bind-address=127.0.0.1 --kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --leader-elect=false --profiling=false --secure-port=10259 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key"1104machine # [ 23.505810] k3s[888]: I0919 21:50:41.417354 888 options.go:263] external host was not specified, using 10.0.2.151105machine # [ 23.508256] k3s[888]: time="2026-09-19T21:50:41Z" level=info msg="Running kube-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --bind-address=127.0.0.1 --cluster-cidr=10.42.0.0/16 --cluster-signing-kube-apiserver-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kube-apiserver-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kubelet-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-serving-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-kubelet-serving-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --cluster-signing-legacy-unknown-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-legacy-unknown-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --configure-cloud-routes=false --controllers=*,tokencleaner,-service,-route,-cloud-node-lifecycle --kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --leader-elect=false --profiling=false --root-ca-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --secure-port=10257 --service-account-private-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key --use-service-account-credentials=true"1106machine # [ 23.565796] k3s[888]: I0919 21:50:41.422633 888 server.go:158] Version: v1.35.8+k3s11107machine # [ 23.566874] k3s[888]: I0919 21:50:41.422687 888 server.go:160] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""1108machine # [ 23.567736] k3s[888]: time="2026-09-19T21:50:41Z" level=info msg="Running cloud-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --bind-address=127.0.0.1 --cloud-config=/var/lib/rancher/k3s/server/etc/cloud-config.yaml --cloud-provider=k3s --cluster-cidr=10.42.0.0/16 --configure-cloud-routes=false --controllers=*,-route --kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --leader-elect=false --leader-elect-resource-name=k3s-cloud-controller-manager --node-status-update-frequency=1m0s --profiling=false"1109machine # [ 23.570083] k3s[888]: time="2026-09-19T21:50:41Z" level=info msg="Server node token is available at /var/lib/rancher/k3s/server/token"1110machine # [ 23.570586] k3s[888]: time="2026-09-19T21:50:41Z" level=info msg="To join server node to cluster: k3s server -s https://10.0.2.15:6443 -t ${SERVER_NODE_TOKEN}"1111machine # [ 23.571231] k3s[888]: time="2026-09-19T21:50:41Z" level=info msg="Agent node token is available at /var/lib/rancher/k3s/server/agent-token"1112machine # [ 23.571936] k3s[888]: time="2026-09-19T21:50:41Z" level=info msg="To join agent node to cluster: k3s agent -s https://10.0.2.15:6443 -t ${AGENT_NODE_TOKEN}"1113machine # [ 23.574610] k3s[888]: time="2026-09-19T21:50:41Z" level=info msg="Wrote kubeconfig /etc/rancher/k3s/k3s.yaml"1114machine # [ 23.575485] k3s[888]: time="2026-09-19T21:50:41Z" level=info msg="Run: k3s kubectl"1115machine # [ 23.578053] k3s[888]: time="2026-09-19T21:50:41Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:52934: runtime core not ready"1116machine # [ 23.603973] k3s[888]: time="2026-09-19T21:50:41Z" level=info msg="Logging containerd to /var/lib/rancher/k3s/agent/containerd/containerd.log"1117machine # [ 23.604677] k3s[888]: time="2026-09-19T21:50:41Z" level=info msg="Running containerd -c /var/lib/rancher/k3s/agent/etc/containerd/config.toml"1118machine # [ 23.666277] k3s[888]: I0919 21:50:41.578399 888 shared_informer.go:349] "Waiting for caches to sync" controller="node_authorizer"1119machine # [ 23.670076] k3s[888]: I0919 21:50:41.582216 888 shared_informer.go:370] "Waiting for caches to sync"1120machine # [ 23.672632] k3s[888]: I0919 21:50:41.584813 888 plugins.go:157] Loaded 14 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,PodTopologyLabels,MutatingAdmissionPolicy,MutatingAdmissionWebhook.1121machine # [ 23.672914] k3s[888]: I0919 21:50:41.584850 888 plugins.go:160] Loaded 14 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,NodeDeclaredFeatureValidator,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota.1122machine # [ 23.673561] k3s[888]: I0919 21:50:41.585168 888 instance.go:240] Using reconciler: lease1123machine # [ 23.689148] k3s[888]: I0919 21:50:41.601284 888 handler.go:304] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager1124machine # [ 23.689578] k3s[888]: W0919 21:50:41.601315 888 genericapiserver.go:787] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources.1125machine # [ 23.695177] k3s[888]: I0919 21:50:41.607358 888 cidrallocator.go:198] starting ServiceCIDR Allocator Controller1126machine # [ 23.715350] k3s[888]: time="2026-09-19T21:50:41Z" level=info msg="Running kube-proxy --cluster-cidr=10.42.0.0/16 --conntrack-max-per-core=0 --conntrack-tcp-timeout-close-wait=0s --conntrack-tcp-timeout-established=0s --healthz-bind-address=127.0.0.1 --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubeproxy.kubeconfig --proxy-mode=iptables"1127machine # [ 23.741127] k3s[888]: I0919 21:50:41.652976 888 handler.go:304] Adding GroupVersion v1 to ResourceManager1128machine # [ 23.741283] k3s[888]: I0919 21:50:41.653234 888 apis.go:112] API group "internal.apiserver.k8s.io" is not enabled, skipping.1129machine # [ 23.771355] k3s[888]: I0919 21:50:41.683542 888 apis.go:112] API group "storagemigration.k8s.io" is not enabled, skipping.1130machine # [ 23.809386] k3s[888]: I0919 21:50:41.721537 888 handler.go:304] Adding GroupVersion authentication.k8s.io v1 to ResourceManager1131machine # [ 23.809583] k3s[888]: W0919 21:50:41.721579 888 genericapiserver.go:787] Skipping API authentication.k8s.io/v1beta1 because it has no resources.1132machine # [ 23.810185] k3s[888]: W0919 21:50:41.721593 888 genericapiserver.go:787] Skipping API authentication.k8s.io/v1alpha1 because it has no resources.1133machine # [ 23.811333] k3s[888]: I0919 21:50:41.721907 888 handler.go:304] Adding GroupVersion authorization.k8s.io v1 to ResourceManager1134machine # [ 23.811688] k3s[888]: W0919 21:50:41.721922 888 genericapiserver.go:787] Skipping API authorization.k8s.io/v1beta1 because it has no resources.1135machine # [ 23.812840] k3s[888]: I0919 21:50:41.722630 888 handler.go:304] Adding GroupVersion autoscaling v2 to ResourceManager1136machine # [ 23.813514] k3s[888]: I0919 21:50:41.723170 888 handler.go:304] Adding GroupVersion autoscaling v1 to ResourceManager1137machine # [ 23.814184] k3s[888]: W0919 21:50:41.723186 888 genericapiserver.go:787] Skipping API autoscaling/v2beta1 because it has no resources.1138machine # [ 23.814816] k3s[888]: W0919 21:50:41.723197 888 genericapiserver.go:787] Skipping API autoscaling/v2beta2 because it has no resources.1139machine # [ 23.815712] k3s[888]: I0919 21:50:41.724123 888 handler.go:304] Adding GroupVersion batch v1 to ResourceManager1140machine # [ 23.816632] k3s[888]: W0919 21:50:41.724143 888 genericapiserver.go:787] Skipping API batch/v1beta1 because it has no resources.1141machine # [ 23.817221] k3s[888]: I0919 21:50:41.724720 888 handler.go:304] Adding GroupVersion certificates.k8s.io v1 to ResourceManager1142machine # [ 23.817823] k3s[888]: W0919 21:50:41.724736 888 genericapiserver.go:787] Skipping API certificates.k8s.io/v1beta1 because it has no resources.1143machine # [ 23.818900] k3s[888]: W0919 21:50:41.724747 888 genericapiserver.go:787] Skipping API certificates.k8s.io/v1alpha1 because it has no resources.1144machine # [ 23.820173] k3s[888]: I0919 21:50:41.725159 888 handler.go:304] Adding GroupVersion coordination.k8s.io v1 to ResourceManager1145machine # [ 23.821040] k3s[888]: W0919 21:50:41.725174 888 genericapiserver.go:787] Skipping API coordination.k8s.io/v1beta1 because it has no resources.1146machine # [ 23.821889] k3s[888]: W0919 21:50:41.725185 888 genericapiserver.go:787] Skipping API coordination.k8s.io/v1alpha2 because it has no resources.1147machine # [ 23.822694] k3s[888]: I0919 21:50:41.725577 888 handler.go:304] Adding GroupVersion discovery.k8s.io v1 to ResourceManager1148machine # [ 23.823334] k3s[888]: W0919 21:50:41.725595 888 genericapiserver.go:787] Skipping API discovery.k8s.io/v1beta1 because it has no resources.1149machine # [ 23.824282] k3s[888]: I0919 21:50:41.727067 888 handler.go:304] Adding GroupVersion networking.k8s.io v1 to ResourceManager1150machine # [ 23.824985] k3s[888]: W0919 21:50:41.727085 888 genericapiserver.go:787] Skipping API networking.k8s.io/v1beta1 because it has no resources.1151machine # [ 23.825694] k3s[888]: I0919 21:50:41.727403 888 handler.go:304] Adding GroupVersion node.k8s.io v1 to ResourceManager1152machine # [ 23.826581] k3s[888]: W0919 21:50:41.727416 888 genericapiserver.go:787] Skipping API node.k8s.io/v1beta1 because it has no resources.1153machine # [ 23.827224] k3s[888]: W0919 21:50:41.727426 888 genericapiserver.go:787] Skipping API node.k8s.io/v1alpha1 because it has no resources.1154machine # [ 23.828058] k3s[888]: I0919 21:50:41.727943 888 handler.go:304] Adding GroupVersion policy v1 to ResourceManager1155machine # [ 23.828665] k3s[888]: W0919 21:50:41.727959 888 genericapiserver.go:787] Skipping API policy/v1beta1 because it has no resources.1156machine # [ 23.829524] k3s[888]: I0919 21:50:41.729050 888 handler.go:304] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager1157machine # [ 23.829971] k3s[888]: W0919 21:50:41.729068 888 genericapiserver.go:787] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources.1158machine # [ 23.831025] k3s[888]: W0919 21:50:41.729080 888 genericapiserver.go:787] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources.1159machine # [ 23.831633] k3s[888]: I0919 21:50:41.729403 888 handler.go:304] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager1160machine # [ 23.832725] k3s[888]: W0919 21:50:41.729417 888 genericapiserver.go:787] Skipping API scheduling.k8s.io/v1beta1 because it has no resources.1161machine # [ 23.833590] k3s[888]: W0919 21:50:41.729453 888 genericapiserver.go:787] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources.1162machine # [ 23.834459] k3s[888]: I0919 21:50:41.730993 888 handler.go:304] Adding GroupVersion storage.k8s.io v1 to ResourceManager1163machine # [ 23.834704] k3s[888]: W0919 21:50:41.731012 888 genericapiserver.go:787] Skipping API storage.k8s.io/v1beta1 because it has no resources.1164machine # [ 23.835108] k3s[888]: W0919 21:50:41.731023 888 genericapiserver.go:787] Skipping API storage.k8s.io/v1alpha1 because it has no resources.1165machine # [ 23.836295] k3s[888]: I0919 21:50:41.731784 888 handler.go:304] Adding GroupVersion flowcontrol.apiserver.k8s.io v1 to ResourceManager1166machine # [ 23.836443] k3s[888]: W0919 21:50:41.731802 888 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta3 because it has no resources.1167machine # [ 23.837295] k3s[888]: W0919 21:50:41.731813 888 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta2 because it has no resources.1168machine # [ 23.838028] k3s[888]: W0919 21:50:41.731823 888 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources.1169machine # [ 23.839297] k3s[888]: I0919 21:50:41.734192 888 handler.go:304] Adding GroupVersion apps v1 to ResourceManager1170machine # [ 23.840215] k3s[888]: W0919 21:50:41.734210 888 genericapiserver.go:787] Skipping API apps/v1beta2 because it has no resources.1171machine # [ 23.841218] k3s[888]: W0919 21:50:41.734223 888 genericapiserver.go:787] Skipping API apps/v1beta1 because it has no resources.1172machine # [ 23.841372] k3s[888]: I0919 21:50:41.735443 888 handler.go:304] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager1173machine # [ 23.842495] k3s[888]: W0919 21:50:41.735458 888 genericapiserver.go:787] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources.1174machine # [ 23.843741] k3s[888]: W0919 21:50:41.735469 888 genericapiserver.go:787] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources.1175machine # [ 23.844383] k3s[888]: I0919 21:50:41.735783 888 handler.go:304] Adding GroupVersion events.k8s.io v1 to ResourceManager1176machine # [ 23.844885] k3s[888]: W0919 21:50:41.735796 888 genericapiserver.go:787] Skipping API events.k8s.io/v1beta1 because it has no resources.1177machine # [ 23.845555] k3s[888]: I0919 21:50:41.736965 888 handler.go:304] Adding GroupVersion resource.k8s.io v1 to ResourceManager1178machine # [ 23.846603] k3s[888]: W0919 21:50:41.736982 888 genericapiserver.go:787] Skipping API resource.k8s.io/v1beta2 because it has no resources.1179machine # [ 23.848154] k3s[888]: W0919 21:50:41.736993 888 genericapiserver.go:787] Skipping API resource.k8s.io/v1beta1 because it has no resources.1180machine # [ 23.849656] k3s[888]: W0919 21:50:41.737003 888 genericapiserver.go:787] Skipping API resource.k8s.io/v1alpha3 because it has no resources.1181machine # [ 23.851263] k3s[888]: I0919 21:50:41.741444 888 handler.go:304] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager1182machine # [ 23.852696] k3s[888]: W0919 21:50:41.741467 888 genericapiserver.go:787] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources.1183machine # [ 24.191195] k3s[888]: I0919 21:50:42.100856 888 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt"1184machine # [ 24.191411] k3s[888]: I0919 21:50:42.101155 888 secure_serving.go:211] Serving securely on 127.0.0.1:64441185machine # [ 24.192305] k3s[888]: I0919 21:50:42.101230 888 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt"1186machine # [ 24.192949] k3s[888]: I0919 21:50:42.101321 888 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key"1187machine # [ 24.193985] k3s[888]: I0919 21:50:42.101506 888 tlsconfig.go:243] "Starting DynamicServingCertificateController"1188machine # [ 24.195232] k3s[888]: I0919 21:50:42.101631 888 controller.go:113] "Deleting old lease on startup" lease="kube-system/apiserver-ik4pcwfs7qgdl76byc4pomgvia"1189machine # [ 24.195803] k3s[888]: I0919 21:50:42.102214 888 controller.go:80] Starting OpenAPI V3 AggregationController1190machine # [ 24.196031] k3s[888]: I0919 21:50:42.102336 888 apf_controller.go:377] Starting API Priority and Fairness config controller1191machine # [ 24.196407] k3s[888]: I0919 21:50:42.102429 888 aggregator.go:185] waiting for initial CRD sync...1192machine # [ 24.196907] k3s[888]: I0919 21:50:42.102576 888 cluster_authentication_trust_controller.go:459] Starting cluster_authentication_trust_controller controller1193machine # [ 24.197977] k3s[888]: time="2026-09-19T21:50:42Z" level=info msg="Waiting for caches to sync" logger=k3s1194machine # [ 24.198393] k3s[888]: I0919 21:50:42.102666 888 customresource_discovery_controller.go:294] Starting DiscoveryController1195machine # [ 24.199273] k3s[888]: I0919 21:50:42.102714 888 system_namespaces_controller.go:66] Starting system namespaces controller1196machine # [ 24.200073] k3s[888]: I0919 21:50:42.102783 888 dynamic_serving_content.go:135] "Starting controller" name="aggregator-proxy-cert::/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt::/var/lib/rancher/k3s/server/tls/client-auth-proxy.key"1197machine # [ 24.201737] k3s[888]: I0919 21:50:42.102850 888 apiservice_controller.go:100] Starting APIServiceRegistrationController1198machine # [ 24.202396] k3s[888]: I0919 21:50:42.102875 888 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller1199machine # [ 24.202928] k3s[888]: I0919 21:50:42.102935 888 local_available_controller.go:156] Starting LocalAvailability controller1200machine # [ 24.203608] k3s[888]: I0919 21:50:42.102950 888 cache.go:32] Waiting for caches to sync for LocalAvailability controller1201machine # [ 24.220781] k3s[888]: I0919 21:50:42.102993 888 remote_available_controller.go:425] Starting RemoteAvailability controller1202machine # [ 24.221230] k3s[888]: I0919 21:50:42.103004 888 cache.go:32] Waiting for caches to sync for RemoteAvailability controller1203machine # [ 24.221733] k3s[888]: time="2026-09-19T21:50:42Z" level=info msg="Starting legacy_token_tracking_controller" logger=k3s1204machine # [ 24.222413] k3s[888]: time="2026-09-19T21:50:42Z" level=info msg="Waiting for caches to sync" logger=k3s1205machine # [ 24.222976] k3s[888]: time="2026-09-19T21:50:42Z" level=info msg="Starting apiserver lease garbage collector" logger=k3s1206machine # [ 24.223587] k3s[888]: time="2026-09-19T21:50:42Z" level=info msg="Waiting for caches to sync" logger=k3s1207machine # [ 24.224113] k3s[888]: I0919 21:50:42.107612 888 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt"1208machine # [ 24.224567] k3s[888]: I0919 21:50:42.107983 888 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt"1209machine # [ 24.225101] k3s[888]: I0919 21:50:42.109129 888 repairip.go:210] Starting ipallocator-repair-controller1210machine # [ 24.225595] k3s[888]: I0919 21:50:42.109223 888 shared_informer.go:349] "Waiting for caches to sync" controller="ipallocator-repair-controller"1211machine # [ 24.226425] k3s[888]: I0919 21:50:42.110858 888 default_servicecidr_controller.go:110] Starting kubernetes-service-cidr-controller1212machine # [ 24.226948] k3s[888]: I0919 21:50:42.110878 888 shared_informer.go:349] "Waiting for caches to sync" controller="kubernetes-service-cidr-controller"1213machine # [ 24.227569] k3s[888]: I0919 21:50:42.110946 888 controller.go:78] Starting OpenAPI AggregationController1214machine # [ 24.246879] k3s[888]: I0919 21:50:42.159022 888 crdregistration_controller.go:114] Starting crd-autoregister controller1215machine # [ 24.247354] k3s[888]: I0919 21:50:42.159065 888 shared_informer.go:349] "Waiting for caches to sync" controller="crd-autoregister"1216machine # [ 24.248197] k3s[888]: I0919 21:50:42.159153 888 controller.go:142] Starting OpenAPI controller1217machine # [ 24.248994] k3s[888]: I0919 21:50:42.159218 888 controller.go:90] Starting OpenAPI V3 controller1218machine # [ 24.253678] k3s[888]: I0919 21:50:42.165877 888 naming_controller.go:305] Starting NamingConditionController1219machine # [ 24.255441] k3s[888]: I0919 21:50:42.167651 888 nonstructuralschema_controller.go:202] Starting NonStructuralSchemaConditionController1220machine # [ 24.256291] k3s[888]: I0919 21:50:42.167704 888 apiapproval_controller.go:196] Starting KubernetesAPIApprovalPolicyConformantConditionController1221machine # [ 24.259717] k3s[888]: I0919 21:50:42.171917 888 crd_finalizer.go:273] Starting CRDFinalizer1222machine # [ 24.290945] k3s[888]: I0919 21:50:42.203099 888 apf_controller.go:382] Running API Priority and Fairness config worker1223machine # [ 24.291153] k3s[888]: I0919 21:50:42.203131 888 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process1224machine # [ 24.291627] k3s[888]: time="2026-09-19T21:50:42Z" level=info msg="Caches are synced" logger=k3s1225machine # [ 24.293182] k3s[888]: I0919 21:50:42.205360 888 cache.go:39] Caches are synced for RemoteAvailability controller1226machine # [ 24.293739] k3s[888]: I0919 21:50:42.205470 888 cache.go:39] Caches are synced for LocalAvailability controller1227machine # [ 24.294367] k3s[888]: time="2026-09-19T21:50:42Z" level=info msg="Caches are synced" logger=k3s1228machine # [ 24.294910] k3s[888]: I0919 21:50:42.205884 888 cache.go:39] Caches are synced for APIServiceRegistrationController controller1229machine # [ 24.295611] k3s[888]: I0919 21:50:42.205957 888 handler_discovery.go:451] Starting ResourceDiscoveryManager1230machine # [ 24.298038] k3s[888]: I0919 21:50:42.210199 888 shared_informer.go:356] "Caches are synced" controller="ipallocator-repair-controller"1231machine # [ 24.305331] k3s[888]: time="2026-09-19T21:50:42Z" level=info msg="Caches are synced" logger=k3s1232machine # [ 24.307161] k3s[888]: I0919 21:50:42.217445 888 shared_informer.go:356] "Caches are synced" controller="kubernetes-service-cidr-controller"1233machine # [ 24.307570] k3s[888]: I0919 21:50:42.217514 888 default_servicecidr_controller.go:169] Creating default ServiceCIDR with CIDRs: [10.43.0.0/16]1234machine # [ 24.332251] k3s[888]: E0919 21:50:42.244404 888 controller.go:201] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms"1235machine # [ 24.346616] k3s[888]: E0919 21:50:42.258796 888 controller.go:95] Unable to perform initial Kubernetes service initialization: namespaces "default" not found1236machine # [ 24.350039] k3s[888]: I0919 21:50:42.259408 888 shared_informer.go:356] "Caches are synced" controller="crd-autoregister"1237machine # [ 24.350334] k3s[888]: I0919 21:50:42.259487 888 aggregator.go:187] initial CRD sync complete...1238machine # [ 24.350675] k3s[888]: I0919 21:50:42.259511 888 autoregister_controller.go:144] Starting autoregister controller1239machine # [ 24.351392] k3s[888]: I0919 21:50:42.259524 888 cache.go:32] Waiting for caches to sync for autoregister controller1240machine # [ 24.351935] k3s[888]: I0919 21:50:42.259536 888 cache.go:39] Caches are synced for autoregister controller1241machine # [ 24.352575] k3s[888]: time="2026-09-19T21:50:42Z" level=error msg="Error while syncing ConfigMap" configmap=kube-system/kube-apiserver-legacy-service-account-token-tracking error="namespaces \"kube-system\" not found" logger=k3s/UnhandledError1242machine # [ 24.366802] k3s[888]: I0919 21:50:42.278944 888 shared_informer.go:356] "Caches are synced" controller="node_authorizer"1243machine # [ 24.370733] k3s[888]: I0919 21:50:42.282914 888 shared_informer.go:377] "Caches are synced"1244machine # [ 24.370992] k3s[888]: I0919 21:50:42.282954 888 policy_source.go:248] refreshing policies1245machine # [ 24.396044] k3s[888]: I0919 21:50:42.307814 888 controller.go:667] quota admission added evaluator for: namespaces1246machine # [ 24.411114] k3s[888]: I0919 21:50:42.323221 888 default_servicecidr_controller.go:231] Setting default ServiceCIDR condition Ready to True1247machine # [ 24.413031] k3s[888]: I0919 21:50:42.323490 888 cidrallocator.go:302] created ClusterIP allocator for Service CIDR 10.43.0.0/161248machine # [ 24.418055] k3s[888]: I0919 21:50:42.329686 888 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/161249machine # [ 24.536683] k3s[888]: I0919 21:50:42.448790 888 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io1250machine # [ 24.615654] k3s[888]: time="2026-09-19T21:50:42Z" level=info msg="containerd is now running"1251machine # [ 24.627813] k3s[888]: time="2026-09-19T21:50:42Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/k3s-airgap-images-amd64.tar.zst"1252machine # [ 25.197739] k3s[888]: I0919 21:50:43.109771 888 storage_scheduling.go:123] created PriorityClass system-node-critical with value 20000010001253machine # [ 25.203378] k3s[888]: I0919 21:50:43.115557 888 storage_scheduling.go:123] created PriorityClass system-cluster-critical with value 20000000001254machine # [ 25.203716] k3s[888]: I0919 21:50:43.115594 888 storage_scheduling.go:139] all system priority classes are created successfully or already exist.1255machine # [ 25.490248] k3s[888]: time="2026-09-19T21:50:43Z" level=info msg="Polling for API server readiness: GET /readyz failed: unknown"1256machine # [ 26.125408] k3s[888]: I0919 21:50:44.037161 888 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io1257machine # [ 26.172186] k3s[888]: I0919 21:50:44.084342 888 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io1258machine # [ 26.257788] k3s[888]: I0919 21:50:44.169548 888 alloc.go:329] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.43.0.1"}1259machine # [ 26.263098] k3s[888]: W0919 21:50:44.175290 888 lease.go:265] Resetting endpoints for master service "kubernetes" to [10.0.2.15]1260machine # [ 26.265408] k3s[888]: I0919 21:50:44.176734 888 controller.go:667] quota admission added evaluator for: endpoints1261machine # [ 26.270344] k3s[888]: I0919 21:50:44.182474 888 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io1262machine # [ 27.493325] k3s[888]: time="2026-09-19T21:50:45Z" level=info msg="Waiting for untainted node"1263machine # [ 27.493793] k3s[888]: time="2026-09-19T21:50:45Z" level=info msg="Kube API server is now running"1264machine # [ 27.494468] k3s[888]: time="2026-09-19T21:50:45Z" level=info msg="k3s is up and running"1265machine # [ 27.497965] systemd[1]: Started k3s service.1266machine # [ 27.498509] k3s[888]: time="2026-09-19T21:50:45Z" level=info msg="Creating k3s-supervisor event broadcaster"1267machine # [ 27.500767] k3s[888]: time="2026-09-19T21:50:45Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Node and Certificate Authority certificates managed by k3s are OK" object=machine reason=CertificateExpirationOK type=Normal1268machine # [ 27.501102] systemd[1]: Starting niks3 server...1269machine # [ 27.513101] k3s[888]: I0919 21:50:45.425294 888 controllermanager.go:189] "Starting" version="v1.35.8+k3s1"1270machine # [ 27.513466] k3s[888]: I0919 21:50:45.425320 888 controllermanager.go:191] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""1271machine # [ 27.520375] k3s[888]: I0919 21:50:45.432587 888 secure_serving.go:211] Serving securely on 127.0.0.1:102571272machine # [ 27.520776] k3s[888]: I0919 21:50:45.432991 888 tlsconfig.go:243] "Starting DynamicServingCertificateController"1273machine # [ 27.521772] k3s[888]: I0919 21:50:45.433471 888 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController1274machine # [ 27.522565] k3s[888]: I0919 21:50:45.434048 888 shared_informer.go:370] "Waiting for caches to sync"1275machine # [ 27.523167] k3s[888]: I0919 21:50:45.433508 888 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key"1276machine # [ 27.523701] k3s[888]: I0919 21:50:45.433695 888 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"1277machine # [ 27.524264] k3s[888]: I0919 21:50:45.434629 888 shared_informer.go:370] "Waiting for caches to sync"1278machine # [ 27.525813] k3s[888]: I0919 21:50:45.433715 888 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"1279machine # [ 27.526536] k3s[888]: I0919 21:50:45.434699 888 shared_informer.go:370] "Waiting for caches to sync"1280machine # [ 27.528250] k3s[888]: I0919 21:50:45.440425 888 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="device-taint-eviction-controller" requiredFeatureGates=["DynamicResourceAllocation","DRADeviceTaints"]1281machine # [ 27.528897] k3s[888]: I0919 21:50:45.440462 888 controllermanager.go:579] "Warning: skipping controller" controller="device-taint-eviction-controller"1282machine # [ 27.534660] k3s[888]: I0919 21:50:45.446860 888 controller.go:667] quota admission added evaluator for: serviceaccounts1283machine # [ 27.545060] k3s[888]: time="2026-09-19T21:50:45Z" level=info msg="Creating embedded CRD addons.k3s.cattle.io"1284machine # [ 27.547984] k3s[888]: time="2026-09-19T21:50:45Z" level=info msg="Creating embedded CRD etcdsnapshotfiles.k3s.cattle.io"1285machine # [ 27.553646] k3s[888]: time="2026-09-19T21:50:45Z" level=info msg="Creating embedded CRD helmcharts.helm.cattle.io"1286machine # [ 27.561669] k3s[888]: I0919 21:50:45.473875 888 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager1287machine # [ 27.564716] k3s[888]: time="2026-09-19T21:50:45Z" level=info msg="Creating embedded CRD helmchartconfigs.helm.cattle.io"1288machine # [ 27.575737] k3s[888]: time="2026-09-19T21:50:45Z" level=info msg="Waiting for CRD etcdsnapshotfiles.k3s.cattle.io to become available"1289machine # [ 27.597705] k3s[888]: I0919 21:50:45.509890 888 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager1290machine # [ 27.607961] k3s[888]: I0919 21:50:45.519682 888 controllermanager.go:627] "Warning: controller is disabled" controller="node-route-controller"1291machine # [ 27.623438] k3s[888]: I0919 21:50:45.535638 888 shared_informer.go:377] "Caches are synced"1292machine # [ 27.623807] k3s[888]: I0919 21:50:45.535864 888 shared_informer.go:377] "Caches are synced"1293machine # [ 27.624441] k3s[888]: I0919 21:50:45.536023 888 shared_informer.go:377] "Caches are synced"1294machine # [ 27.628911] k3s[888]: I0919 21:50:45.541118 888 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager1295machine # [ 27.632451] k3s[888]: I0919 21:50:45.544558 888 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager1296machine # [ 27.659793] k3s[888]: I0919 21:50:45.571968 888 shared_informer.go:370] "Waiting for caches to sync"1297machine # [ 27.859994] k3s[888]: I0919 21:50:45.772063 888 shared_informer.go:377] "Caches are synced"1298machine # [ 28.084076] k3s[888]: I0919 21:50:45.996204 888 node_lifecycle_controller.go:419] "Controller will reconcile labels" logger="node-lifecycle-controller"1299machine # [ 28.089667] k3s[888]: time="2026-09-19T21:50:46Z" level=info msg="Done waiting for CRD etcdsnapshotfiles.k3s.cattle.io to become available"1300machine # [ 28.089980] k3s[888]: time="2026-09-19T21:50:46Z" level=info msg="Waiting for CRD helmcharts.helm.cattle.io to become available"1301machine # [ 28.098827] k3s[888]: time="2026-09-19T21:50:46Z" level=info msg="Done waiting for CRD helmcharts.helm.cattle.io to become available"1302machine # [ 28.100353] k3s[888]: time="2026-09-19T21:50:46Z" level=info msg="Waiting for CRD helmchartconfigs.helm.cattle.io to become available"1303machine # [ 28.102893] k3s[888]: time="2026-09-19T21:50:46Z" level=info msg="Done waiting for CRD helmchartconfigs.helm.cattle.io to become available"1304machine # [ 28.103184] k3s[888]: time="2026-09-19T21:50:46Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-40.1.4+up40.1.0.tgz"1305machine # [ 28.103912] k3s[888]: time="2026-09-19T21:50:46Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-crd-40.1.4+up40.1.0.tgz"1306machine # [ 28.104581] k3s[888]: time="2026-09-19T21:50:46Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/ccm.yaml"1307machine # [ 28.105134] k3s[888]: time="2026-09-19T21:50:46Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/coredns.yaml"1308machine # [ 28.112212] k3s[888]: time="2026-09-19T21:50:46Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/local-storage.yaml"1309machine # [ 28.112514] k3s[888]: time="2026-09-19T21:50:46Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/rolebindings.yaml"1310machine # [ 28.112967] k3s[888]: time="2026-09-19T21:50:46Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/runtimes.yaml"1311machine # [ 28.113794] k3s[888]: time="2026-09-19T21:50:46Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/traefik.yaml"1312machine # [ 28.241855] k3s[888]: W0919 21:50:46.153903 888 probe.go:272] Flexvolume plugin directory at /usr/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating.1313machine # [ 28.244450] k3s[888]: time="2026-09-19T21:50:46Z" level=info msg="Starting dynamiclistener CN filter node controller with SANs: [127.0.0.1 ::1 localhost machine 10.0.2.15 fec0::2747:9aec:a8ac:e17f 10.43.0.1 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local]"1314machine: (finished: waiting for unit k3s.service, in 29.11 seconds)1315machine # [ 28.244854] k3s[888]: time="2026-09-19T21:50:46Z" level=info msg="Tunnel server egress proxy mode: agent"1316??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.1317 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 391318machine: waiting for success: kubectl get ns farm1319??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.1320 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 391321machine # Error from server (NotFound): namespaces "farm" not found1322machine # [ 28.628095] k3s[888]: time="2026-09-19T21:50:46Z" level=info msg="Creating new TLS secret for kube-system/k3s-serving (count: 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__2747_9aec_a8ac_e17f-14f442:fec0::2747:9aec:a8ac:e17f listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=5171D4478E3E4C46CAA3D85A8E69611629200D0F]"1323machine # [ 28.650568] k3s[888]: time="2026-09-19T21:50:46Z" level=info msg="Active TLS secret kube-system/k3s-serving (ver=235) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__2747_9aec_a8ac_e17f-14f442:fec0::2747:9aec:a8ac:e17f listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=5171D4478E3E4C46CAA3D85A8E69611629200D0F]"1324machine # [ 28.687851] k3s[888]: I0919 21:50:46.599981 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="statefulsets.apps"1325machine # [ 28.688546] k3s[888]: I0919 21:50:46.600035 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="resourceclaimtemplates.resource.k8s.io"1326machine # [ 28.688977] k3s[888]: I0919 21:50:46.600061 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="deployments.apps"1327machine # [ 28.689640] k3s[888]: I0919 21:50:46.600089 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="horizontalpodautoscalers.autoscaling"1328machine # [ 28.690117] k3s[888]: I0919 21:50:46.600123 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="cronjobs.batch"1329machine # [ 28.690595] k3s[888]: I0919 21:50:46.600150 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="jobs.batch"1330machine # [ 28.691147] k3s[888]: I0919 21:50:46.600178 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="csistoragecapacities.storage.k8s.io"1331machine # [ 28.691597] k3s[888]: I0919 21:50:46.600207 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="limitranges"1332machine # [ 28.692125] k3s[888]: I0919 21:50:46.600231 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="controllerrevisions.apps"1333machine # [ 28.692581] k3s[888]: I0919 21:50:46.600282 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="daemonsets.apps"1334machine # [ 28.693099] k3s[888]: I0919 21:50:46.600311 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="networkpolicies.networking.k8s.io"1335machine # [ 28.693601] k3s[888]: I0919 21:50:46.600340 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="roles.rbac.authorization.k8s.io"1336machine # [ 28.694125] k3s[888]: I0919 21:50:46.600363 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="rolebindings.rbac.authorization.k8s.io"1337machine # [ 28.694587] k3s[888]: I0919 21:50:46.600415 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="serviceaccounts"1338machine # [ 28.695105] k3s[888]: I0919 21:50:46.600438 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="poddisruptionbudgets.policy"1339machine # [ 28.695593] k3s[888]: I0919 21:50:46.600504 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmchartconfigs.helm.cattle.io"1340machine # [ 28.696134] k3s[888]: I0919 21:50:46.600542 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="ingresses.networking.k8s.io"1341machine # [ 28.696583] k3s[888]: I0919 21:50:46.600580 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="addons.k3s.cattle.io"1342machine # [ 28.697079] k3s[888]: I0919 21:50:46.600603 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="podtemplates"1343machine # [ 28.697529] k3s[888]: I0919 21:50:46.600625 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="replicasets.apps"1344machine # [ 28.698040] k3s[888]: I0919 21:50:46.600649 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="leases.coordination.k8s.io"1345machine # [ 28.698484] k3s[888]: I0919 21:50:46.600676 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpointslices.discovery.k8s.io"1346machine # [ 28.698977] k3s[888]: I0919 21:50:46.600698 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmcharts.helm.cattle.io"1347machine # [ 28.699617] k3s[888]: I0919 21:50:46.600722 888 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpoints"1348machine # [ 29.283909] k3s[888]: I0919 21:50:47.195559 888 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" requiredFeatureGates=["ClusterTrustBundle"]1349machine # [ 29.284726] k3s[888]: I0919 21:50:47.195593 888 controllermanager.go:579] "Warning: skipping controller" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller"1350machine # [ 29.353893] k3s[888]: time="2026-09-19T21:50:47Z" level=info msg="Starting k3s.cattle.io/v1, Kind=Addon controller"1351machine # [ 29.354188] k3s[888]: time="2026-09-19T21:50:47Z" level=info msg="Creating deploy event broadcaster"1352machine # [ 29.359061] k3s[888]: I0919 21:50:47.270400 888 controller.go:667] quota admission added evaluator for: addons.k3s.cattle.io1353machine # [ 29.359357] k3s[888]: time="2026-09-19T21:50:47Z" level=info msg="Creating helm-controller event broadcaster"1354machine # [ 29.359882] k3s[888]: time="2026-09-19T21:50:47Z" level=info msg="Starting /v1, Kind=Node controller"1355machine # [ 29.363060] k3s[888]: time="2026-09-19T21:50:47Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found"1356machine # [ 29.369547] k3s[888]: time="2026-09-19T21:50:47Z" level=info msg="Cluster dns configmap has been set successfully"1357machine # [ 29.370881] k3s[888]: time="2026-09-19T21:50:47Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=ApplyingManifest type=Normal1358machine # [ 29.516582] k3s[888]: time="2026-09-19T21:50:47Z" level=info msg="Imported docker.io/rancher/klipper-helm:v0.13.3-build20260727"1359machine # [ 29.522551] k3s[888]: time="2026-09-19T21:50:47Z" level=info msg="Tagged docker.io/rancher/klipper-helm@sha256:5425a2b4613d2458dbdff99218e8d487ebb59c20e7a941f061c0777070f0aac1"1360machine # [ 29.522883] k3s[888]: time="2026-09-19T21:50:47Z" level=info msg="Imported docker.io/rancher/klipper-lb:v0.4.17"1361machine # [ 29.525752] k3s[888]: time="2026-09-19T21:50:47Z" level=info msg="Tagged docker.io/rancher/klipper-lb@sha256:910944bb0bd94f060a82a56ca1ea1c577d3e49b3473a093a47a985f32e92d94a"1362machine # [ 29.526304] k3s[888]: time="2026-09-19T21:50:47Z" level=info msg="Imported docker.io/rancher/local-path-provisioner:v0.0.37"1363machine # [ 29.533365] k3s[888]: time="2026-09-19T21:50:47Z" level=info msg="Tagged docker.io/rancher/local-path-provisioner@sha256:e757967a5ec338f6a9b371c5a9688bedaa8c3578ea3dd4db329ea0084be0a86f"1364machine # [ 29.536493] k3s[888]: time="2026-09-19T21:50:47Z" level=info msg="Imported docker.io/rancher/mirrored-coredns-coredns:1.14.6"1365machine # [ 29.539296] k3s[888]: time="2026-09-19T21:50:47Z" level=info msg="Tagged docker.io/rancher/mirrored-coredns-coredns@sha256:900f9c109f7a33545d3c811516e8376df9019147b750f5ce3e254468769176ea"1366machine # [ 29.539619] k3s[888]: time="2026-09-19T21:50:47Z" level=info msg="Imported docker.io/rancher/mirrored-library-busybox:1.37.0"1367machine # [ 29.545276] k3s[888]: time="2026-09-19T21:50:47Z" level=info msg="Tagged docker.io/rancher/mirrored-library-busybox@sha256:101b4afd76732482eff9b95cae5f94bcf295e521fbec4e01b69c5421f3f3f3e5"1368machine # [ 29.545652] k3s[888]: time="2026-09-19T21:50:47Z" level=info msg="Imported docker.io/rancher/mirrored-library-traefik:3.7.8"1369machine # [ 29.551487] k3s[888]: time="2026-09-19T21:50:47Z" level=info msg="Tagged docker.io/rancher/mirrored-library-traefik@sha256:4299bbed850421258fc5448c2e0e6ad350981d4d335a68de11b92448aedbefe5"1370machine # [ 29.551782] k3s[888]: time="2026-09-19T21:50:47Z" level=info msg="Imported docker.io/rancher/mirrored-metrics-server:v0.9.0"1371machine # [ 29.559359] k3s[888]: time="2026-09-19T21:50:47Z" level=info msg="Tagged docker.io/rancher/mirrored-metrics-server@sha256:d9862115e7c7881280d3d75ca26bda8ffc0fc213315979575bf23ce9826205c0"1372machine # [ 29.559500] k3s[888]: time="2026-09-19T21:50:47Z" level=info msg="Imported docker.io/rancher/mirrored-pause:3.10.2"1373machine # [ 29.565448] k3s[888]: time="2026-09-19T21:50:47Z" level=info msg="Tagged docker.io/rancher/mirrored-pause@sha256:f548e0e8e3dc1896ca956272154dde3314e8cc4fde0a57577ee9fa1c63f5baf4"1374machine # Error from server (NotFound): namespaces "farm" not found1375machine # [ 29.783723] k3s[888]: I0919 21:50:47.695456 888 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="storageversion-garbage-collector-controller" requiredFeatureGates=["APIServerIdentity","StorageVersionAPI"]1376machine # [ 29.784121] k3s[888]: I0919 21:50:47.695493 888 controllermanager.go:579] "Warning: skipping controller" controller="storageversion-garbage-collector-controller"1377machine # [ 29.788228] k3s[888]: time="2026-09-19T21:50:47Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=AppliedManifest type=Normal1378machine # [ 29.799532] k3s[888]: time="2026-09-19T21:50:47Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=ApplyingManifest type=Normal1379machine # [ 29.813556] k3s[888]: time="2026-09-19T21:50:47Z" level=info msg="Imported 8 images from /var/lib/rancher/k3s/agent/images/k3s-airgap-images-amd64.tar.zst in 5.186767312s"1380machine # [ 29.815231] k3s[888]: time="2026-09-19T21:50:47Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-lb.tar"1381machine # [ 30.092861] k3s[888]: time="2026-09-19T21:50:48Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=AppliedManifest type=Normal1382machine # [ 30.106972] k3s[888]: time="2026-09-19T21:50:48Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=ApplyingManifest type=Normal1383machine # [ 30.361807] k3s[888]: time="2026-09-19T21:50:48Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found"1384machine # [ 30.470575] k3s[888]: time="2026-09-19T21:50:48Z" level=info msg="Starting rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding controller"1385machine # [ 30.474257] k3s[888]: time="2026-09-19T21:50:48Z" level=info msg="Starting batch/v1, Kind=Job controller"1386machine # [ 30.476058] k3s[888]: time="2026-09-19T21:50:48Z" level=info msg="Starting /v1, Kind=ConfigMap controller"1387machine # [ 30.476639] k3s[888]: time="2026-09-19T21:50:48Z" level=info msg="Starting /v1, Kind=ServiceAccount controller"1388machine # [ 30.477433] k3s[888]: time="2026-09-19T21:50:48Z" level=info msg="Starting /v1, Kind=Secret controller"1389machine # [ 30.479243] k3s[888]: time="2026-09-19T21:50:48Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChart controller"1390machine # [ 30.479735] k3s[888]: time="2026-09-19T21:50:48Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChartConfig controller"1391machine # [ 30.604839] k3s[888]: I0919 21:50:48.516966 888 serving.go:392] Generated self-signed cert in-memory1392machine # [ 30.751769] k3s[888]: I0919 21:50:48.663478 888 serving.go:392] Generated self-signed cert in-memory1393machine # [ 30.809943] k3s[888]: I0919 21:50:48.721768 888 controllermanager.go:160] Version: v1.35.8+k3s11394machine # [ 30.817073] k3s[888]: I0919 21:50:48.726938 888 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"1395machine # [ 30.817360] k3s[888]: I0919 21:50:48.726979 888 shared_informer.go:370] "Waiting for caches to sync"1396machine # [ 30.817871] k3s[888]: I0919 21:50:48.726984 888 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"1397machine # [ 30.818481] k3s[888]: I0919 21:50:48.726925 888 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController1398machine # [ 30.818991] k3s[888]: I0919 21:50:48.727017 888 shared_informer.go:370] "Waiting for caches to sync"1399machine # [ 30.819480] k3s[888]: I0919 21:50:48.727198 888 secure_serving.go:211] Serving securely on 127.0.0.1:102581400machine # [ 30.821150] k3s[888]: I0919 21:50:48.727020 888 shared_informer.go:370] "Waiting for caches to sync"1401machine # [ 30.821841] k3s[888]: I0919 21:50:48.727573 888 tlsconfig.go:243] "Starting DynamicServingCertificateController"1402machine # [ 30.822493] k3s[888]: time="2026-09-19T21:50:48Z" level=info msg="Creating service-lb-controller event broadcaster"1403machine # [ 30.843344] k3s[888]: I0919 21:50:48.755512 888 range_allocator.go:113] "No Secondary Service CIDR provided. Skipping filtering out secondary service addresses" logger="node-ipam-controller"1404machine # [ 30.843680] k3s[888]: I0919 21:50:48.755567 888 controllermanager.go:627] "Warning: controller is disabled" controller="cloud-node-lifecycle-controller"1405machine # [ 30.844207] k3s[888]: I0919 21:50:48.755579 888 controllermanager.go:627] "Warning: controller is disabled" controller="service-lb-controller"1406machine # [ 30.844672] k3s[888]: I0919 21:50:48.755589 888 controllermanager.go:627] "Warning: controller is disabled" controller="bootstrap-signer-controller"1407machine # [ 30.853644] k3s[888]: I0919 21:50:48.765842 888 controllermanager.go:579] "Warning: skipping controller" controller="storage-version-migrator-controller"1408machine # [ 30.853928] k3s[888]: I0919 21:50:48.765866 888 controllermanager.go:627] "Warning: controller is disabled" controller="selinux-warning-controller"1409machine # [ 30.887561] k3s[888]: I0919 21:50:48.799714 888 controller.go:667] quota admission added evaluator for: deployments.apps1410machine # [ 30.915216] k3s[888]: I0919 21:50:48.827356 888 shared_informer.go:377] "Caches are synced"1411machine # [ 30.917419] k3s[888]: I0919 21:50:48.829371 888 shared_informer.go:377] "Caches are synced"1412machine # [ 30.917978] k3s[888]: I0919 21:50:48.829421 888 shared_informer.go:377] "Caches are synced"1413machine: (finished: waiting for success: kubectl get ns farm, in 2.75 seconds)1414machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/kp4hvipjm36bm67lbwnmka0j153vc80m-k3s-farm-certs/lb.crt --key=/nix/store/kp4hvipjm36bm67lbwnmka0j153vc80m-k3s-farm-certs/lb.key1415machine # [ 31.042167] k3s[888]: I0919 21:50:48.953419 888 alloc.go:329] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.43.0.10"}1416machine # [ 31.043092] k3s[888]: time="2026-09-19T21:50:48Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=AppliedManifest type=Normal1417machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/kp4hvipjm36bm67lbwnmka0j153vc80m-k3s-farm-certs/lb.crt --key=/nix/store/kp4hvipjm36bm67lbwnmka0j153vc80m-k3s-farm-certs/lb.key, in 0.21 seconds)1418machine: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/kp4hvipjm36bm67lbwnmka0j153vc80m-k3s-farm-certs/worker.crt --key=/nix/store/kp4hvipjm36bm67lbwnmka0j153vc80m-k3s-farm-certs/worker.key1419machine # [ 31.243512] k3s[888]: time="2026-09-19T21:50:49Z" level=info msg="Starting /v1, Kind=Node controller"1420machine # [ 31.247872] k3s[888]: time="2026-09-19T21:50:49Z" level=info msg="Starting /v1, Kind=Pod controller"1421machine # [ 31.251995] k3s[888]: time="2026-09-19T21:50:49Z" level=info msg="Starting apps/v1, Kind=DaemonSet controller"1422machine # [ 31.258077] k3s[888]: time="2026-09-19T21:50:49Z" level=info msg="Starting discovery.k8s.io/v1, Kind=EndpointSlice controller"1423machine # [ 31.258366] k3s[888]: I0919 21:50:49.168616 888 controllermanager.go:329] Started "service-lb-controller"1424machine # [ 31.258836] k3s[888]: W0919 21:50:49.168640 888 controllermanager.go:306] "node-route-controller" is disabled1425machine # [ 31.259466] k3s[888]: I0919 21:50:49.168810 888 controller.go:235] Starting service controller1426machine # [ 31.259970] k3s[888]: I0919 21:50:49.168820 888 controllermanager.go:329] Started "cloud-node-controller"1427machine # [ 31.260583] k3s[888]: I0919 21:50:49.168847 888 shared_informer.go:370] "Waiting for caches to sync"1428machine # [ 31.261105] k3s[888]: I0919 21:50:49.168932 888 controllermanager.go:329] Started "cloud-node-lifecycle-controller"1429machine # [ 31.261560] k3s[888]: I0919 21:50:49.169059 888 node_controller.go:176] Sending events to api server.1430machine # [ 31.261751] k3s[888]: I0919 21:50:49.169120 888 node_controller.go:185] Waiting for informer caches to sync1431machine # [ 31.262415] k3s[888]: I0919 21:50:49.169316 888 node_lifecycle_controller.go:112] Sending events to api server1432machine # [ 31.363103] k3s[888]: time="2026-09-19T21:50:49Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found"1433machine: (finished: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/kp4hvipjm36bm67lbwnmka0j153vc80m-k3s-farm-certs/worker.crt --key=/nix/store/kp4hvipjm36bm67lbwnmka0j153vc80m-k3s-farm-certs/worker.key, in 0.22 seconds)1434machine: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/kp4hvipjm36bm67lbwnmka0j153vc80m-k3s-farm-certs/ca.crt1435machine # [ 31.457726] k3s[888]: I0919 21:50:49.369879 888 shared_informer.go:377] "Caches are synced"1436machine # [ 31.482537] k3s[888]: I0919 21:50:49.394664 888 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="podcertificaterequest-cleaner-controller" requiredFeatureGates=["PodCertificateRequest"]1437machine # [ 31.482947] k3s[888]: I0919 21:50:49.394705 888 controllermanager.go:579] "Warning: skipping controller" controller="podcertificaterequest-cleaner-controller"1438machine: (finished: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/kp4hvipjm36bm67lbwnmka0j153vc80m-k3s-farm-certs/ca.crt, in 0.20 seconds)1439subtest: chart deploys and workers become Ready1440machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s1441machine # [ 31.784794] k3s[888]: time="2026-09-19T21:50:49Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" object=kube-system/local-storage reason=DeletingManifest type=Normal1442machine # [ 31.793398] k3s[888]: time="2026-09-19T21:50:49Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=ApplyingManifest type=Normal1443machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found1444machine # [ 31.936232] k3s[888]: I0919 21:50:49.847994 888 controller.go:667] quota admission added evaluator for: helmcharts.helm.cattle.io1445machine # [ 31.938626] k3s[888]: time="2026-09-19T21:50:49Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=AppliedManifest type=Normal1446machine # [ 31.950830] k3s[888]: time="2026-09-19T21:50:49Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=ApplyingManifest type=Normal1447machine # [ 32.086377] k3s[888]: I0919 21:50:49.998449 888 clusterroleaggregation_controller.go:194] "Starting ClusterRoleAggregator controller"1448machine # [ 32.086602] k3s[888]: I0919 21:50:49.998486 888 shared_informer.go:370] "Waiting for caches to sync"1449machine # [ 32.087412] k3s[888]: time="2026-09-19T21:50:49Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Applying HelmChart from https://%{KUBERNETES_API}%/static/charts/nix-grpc-farm.tgz using Job kube-system/helm-install-nix-grpc-farm " object=kube-system/nix-grpc-farm reason=ApplyJob type=Normal1450machine # [ 32.090038] k3s[888]: I0919 21:50:50.002120 888 shared_informer.go:370] "Waiting for caches to sync"1451machine # [ 32.090606] k3s[888]: I0919 21:50:50.002180 888 gc_controller.go:98] "Starting GC controller"1452machine # [ 32.091106] k3s[888]: I0919 21:50:50.002193 888 shared_informer.go:370] "Waiting for caches to sync"1453machine # [ 32.091560] k3s[888]: I0919 21:50:50.002226 888 namespace_controller.go:202] "Starting namespace controller"1454machine # [ 32.092078] k3s[888]: I0919 21:50:50.002238 888 shared_informer.go:370] "Waiting for caches to sync"1455machine # [ 32.092610] k3s[888]: I0919 21:50:50.002352 888 daemon_controller.go:309] "Starting daemon sets controller"1456machine # [ 32.094762] k3s[888]: I0919 21:50:50.002365 888 shared_informer.go:370] "Waiting for caches to sync"1457machine # [ 32.095528] k3s[888]: I0919 21:50:50.002403 888 cleaner.go:83] "Starting CSR cleaner controller"1458machine # [ 32.096032] k3s[888]: I0919 21:50:50.002472 888 expand_controller.go:328] "Starting expand controller"1459machine # [ 32.096477] k3s[888]: I0919 21:50:50.002485 888 shared_informer.go:370] "Waiting for caches to sync"1460machine # [ 32.098387] k3s[888]: I0919 21:50:50.002521 888 pv_protection_controller.go:81] "Starting PV protection controller"1461machine # [ 32.098680] k3s[888]: I0919 21:50:50.002534 888 shared_informer.go:370] "Waiting for caches to sync"1462machine # [ 32.099181] k3s[888]: I0919 21:50:50.002647 888 publisher.go:107] "Starting root CA cert publisher controller"1463machine # [ 32.099615] k3s[888]: I0919 21:50:50.002660 888 shared_informer.go:370] "Waiting for caches to sync"1464machine # [ 32.100121] k3s[888]: I0919 21:50:50.002731 888 deployment_controller.go:172] "Starting controller" controller="deployment"1465machine # [ 32.100576] k3s[888]: I0919 21:50:50.002744 888 shared_informer.go:370] "Waiting for caches to sync"1466machine # [ 32.101124] k3s[888]: I0919 21:50:50.002810 888 replica_set.go:241] "Starting controller" name="replicaset"1467machine # [ 32.101802] k3s[888]: I0919 21:50:50.002823 888 shared_informer.go:370] "Waiting for caches to sync"1468machine # [ 32.102423] k3s[888]: I0919 21:50:50.002879 888 stateful_set.go:180] "Starting stateful set controller"1469machine # [ 32.102910] k3s[888]: I0919 21:50:50.002891 888 shared_informer.go:370] "Waiting for caches to sync"1470machine # [ 32.103531] k3s[888]: I0919 21:50:50.002959 888 cronjob_controllerv2.go:143] "Starting cronjob controller v2"1471machine # [ 32.104046] k3s[888]: I0919 21:50:50.002972 888 shared_informer.go:370] "Waiting for caches to sync"1472machine # [ 32.104489] k3s[888]: I0919 21:50:50.003006 888 tokencleaner.go:117] "Starting token cleaner controller"1473machine # [ 32.104984] k3s[888]: I0919 21:50:50.003018 888 shared_informer.go:370] "Waiting for caches to sync"1474machine # [ 32.105607] k3s[888]: I0919 21:50:50.003081 888 node_lifecycle_controller.go:453] "Sending events to api server"1475machine # [ 32.106134] k3s[888]: I0919 21:50:50.003106 888 node_lifecycle_controller.go:460] "Starting node controller"1476machine # [ 32.106588] k3s[888]: I0919 21:50:50.003115 888 shared_informer.go:370] "Waiting for caches to sync"1477machine # [ 32.107103] k3s[888]: I0919 21:50:50.003187 888 attach_detach_controller.go:335] "Starting attach detach controller"1478machine # [ 32.107561] k3s[888]: I0919 21:50:50.003200 888 shared_informer.go:370] "Waiting for caches to sync"1479machine # [ 32.108089] k3s[888]: I0919 21:50:50.003290 888 endpointslicemirroring_controller.go:226] "Starting EndpointSliceMirroring controller"1480machine # [ 32.108539] k3s[888]: I0919 21:50:50.003303 888 shared_informer.go:370] "Waiting for caches to sync"1481machine # [ 32.109054] k3s[888]: I0919 21:50:50.003593 888 job_controller.go:254] "Starting job controller"1482machine # [ 32.109508] k3s[888]: I0919 21:50:50.003606 888 shared_informer.go:370] "Waiting for caches to sync"1483machine # [ 32.109684] k3s[888]: I0919 21:50:50.003646 888 ttl_controller.go:127] "Starting TTL controller"1484machine # [ 32.110174] k3s[888]: I0919 21:50:50.003659 888 shared_informer.go:370] "Waiting for caches to sync"1485machine # [ 32.110617] k3s[888]: I0919 21:50:50.003693 888 pvc_protection_controller.go:166] "Starting PVC protection controller"1486machine # [ 32.111138] k3s[888]: I0919 21:50:50.003705 888 shared_informer.go:370] "Waiting for caches to sync"1487machine # [ 32.111596] k3s[888]: I0919 21:50:50.003740 888 ttlafterfinished_controller.go:112] "Starting TTL after finished controller"1488machine # [ 32.112104] k3s[888]: I0919 21:50:50.003753 888 shared_informer.go:370] "Waiting for caches to sync"1489machine # [ 32.112564] k3s[888]: I0919 21:50:50.003793 888 controller.go:174] "Starting ephemeral volume controller"1490machine # [ 32.113073] k3s[888]: I0919 21:50:50.003807 888 shared_informer.go:370] "Waiting for caches to sync"1491machine # [ 32.113532] k3s[888]: I0919 21:50:50.003865 888 replica_set.go:241] "Starting controller" name="replicationcontroller"1492machine # [ 32.114050] k3s[888]: I0919 21:50:50.003877 888 shared_informer.go:370] "Waiting for caches to sync"1493machine # [ 32.114499] k3s[888]: I0919 21:50:50.003907 888 certificate_controller.go:120] "Starting certificate controller" name="csrapproving"1494machine # [ 32.115028] k3s[888]: I0919 21:50:50.003919 888 shared_informer.go:370] "Waiting for caches to sync"1495machine # [ 32.115473] k3s[888]: I0919 21:50:50.003950 888 vac_protection_controller.go:206] "Starting VAC protection controller"1496machine # [ 32.115975] k3s[888]: I0919 21:50:50.003961 888 shared_informer.go:370] "Waiting for caches to sync"1497machine # [ 32.116594] k3s[888]: I0919 21:50:50.004028 888 controller.go:423] "Starting resource claim controller"1498machine # [ 32.117111] k3s[888]: I0919 21:50:50.004041 888 shared_informer.go:370] "Waiting for caches to sync"1499machine # [ 32.117567] k3s[888]: I0919 21:50:50.004075 888 shared_informer.go:370] "Waiting for caches to sync"1500machine # [ 32.118078] k3s[888]: I0919 21:50:50.004162 888 servicecidrs_controller.go:136] "Starting" controller="service-cidr-controller"1501machine # [ 32.118532] k3s[888]: I0919 21:50:50.004175 888 shared_informer.go:370] "Waiting for caches to sync"1502machine # [ 32.119053] k3s[888]: I0919 21:50:50.004214 888 horizontal.go:204] "Starting HPA controller"1503machine # [ 32.119505] k3s[888]: I0919 21:50:50.004228 888 shared_informer.go:370] "Waiting for caches to sync"1504machine # [ 32.119680] k3s[888]: I0919 21:50:50.004311 888 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-legacy-unknown"1505machine # [ 32.120163] k3s[888]: I0919 21:50:50.004324 888 shared_informer.go:370] "Waiting for caches to sync"1506machine # [ 32.120623] k3s[888]: I0919 21:50:50.004412 888 node_ipam_controller.go:142] "Starting ipam controller"1507machine # [ 32.121150] k3s[888]: I0919 21:50:50.004424 888 shared_informer.go:370] "Waiting for caches to sync"1508machine # [ 32.121615] k3s[888]: I0919 21:50:50.004461 888 taint_eviction.go:283] "Starting" controller="taint-eviction-controller"1509machine # [ 32.122131] k3s[888]: I0919 21:50:50.004516 888 taint_eviction.go:288] "Sending events to API server"1510machine # [ 32.122582] k3s[888]: I0919 21:50:50.004526 888 shared_informer.go:370] "Waiting for caches to sync"1511machine # [ 32.123390] k3s[888]: I0919 21:50:50.004587 888 endpoints_controller.go:193] "Starting endpoint controller"1512machine # [ 32.124513] k3s[888]: I0919 21:50:50.004599 888 shared_informer.go:370] "Waiting for caches to sync"1513machine # [ 32.125634] k3s[888]: I0919 21:50:50.004630 888 serviceaccounts_controller.go:117] "Starting service account controller"1514machine # [ 32.126939] k3s[888]: I0919 21:50:50.004643 888 shared_informer.go:370] "Waiting for caches to sync"1515machine # [ 32.127898] k3s[888]: I0919 21:50:50.004803 888 disruption.go:458] "Sending events to api server."1516machine # [ 32.129035] k3s[888]: I0919 21:50:50.004831 888 disruption.go:465] "Starting disruption controller"1517machine # [ 32.130155] k3s[888]: I0919 21:50:50.004849 888 shared_informer.go:370] "Waiting for caches to sync"1518machine # [ 32.131480] k3s[888]: I0919 21:50:50.004885 888 legacy_serviceaccount_token_cleaner.go:103] "Starting legacy service account token cleaner controller"1519machine # [ 32.132871] k3s[888]: I0919 21:50:50.004899 888 shared_informer.go:370] "Waiting for caches to sync"1520machine # [ 32.133826] k3s[888]: I0919 21:50:50.004966 888 endpointslice_controller.go:283] "Starting endpoint slice controller"1521machine # [ 32.135166] k3s[888]: I0919 21:50:50.004978 888 shared_informer.go:370] "Waiting for caches to sync"1522machine # [ 32.136389] k3s[888]: I0919 21:50:50.005038 888 pv_controller_base.go:307] "Starting persistent volume controller"1523machine # [ 32.137878] k3s[888]: I0919 21:50:50.005052 888 shared_informer.go:370] "Waiting for caches to sync"1524machine # [ 32.138936] k3s[888]: I0919 21:50:50.006152 888 resource_quota_controller.go:297] "Starting resource quota controller"1525machine # [ 32.140574] k3s[888]: I0919 21:50:50.006168 888 shared_informer.go:370] "Waiting for caches to sync"1526machine # [ 32.141685] k3s[888]: I0919 21:50:50.006250 888 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-serving"1527machine # [ 32.143550] k3s[888]: I0919 21:50:50.006286 888 shared_informer.go:370] "Waiting for caches to sync"1528machine # [ 32.144863] k3s[888]: I0919 21:50:50.006323 888 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-client"1529machine # [ 32.186175] k3s[888]: I0919 21:50:50.006335 888 shared_informer.go:370] "Waiting for caches to sync"1530machine # [ 32.186911] k3s[888]: I0919 21:50:50.006380 888 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kube-apiserver-client"1531machine # [ 32.187530] k3s[888]: I0919 21:50:50.006394 888 shared_informer.go:370] "Waiting for caches to sync"1532machine # [ 32.188047] k3s[888]: I0919 21:50:50.006433 888 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key"1533machine # [ 32.188511] k3s[888]: I0919 21:50:50.006641 888 garbagecollector.go:141] "Starting controller" controller="garbagecollector"1534machine # [ 32.188982] k3s[888]: I0919 21:50:50.006671 888 shared_informer.go:370] "Waiting for caches to sync"1535machine # [ 32.189611] k3s[888]: I0919 21:50:50.007339 888 resource_quota_monitor.go:309] "QuotaMonitor running"1536machine # [ 32.190136] k3s[888]: I0919 21:50:50.007465 888 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key"1537machine # [ 32.190600] k3s[888]: I0919 21:50:50.007546 888 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key"1538machine # [ 32.191122] k3s[888]: I0919 21:50:50.007611 888 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key"1539machine # [ 32.191580] k3s[888]: I0919 21:50:50.007857 888 graph_builder.go:386] "Running" component="GraphBuilder"1540machine # [ 32.199984] k3s[888]: I0919 21:50:50.112143 888 shared_informer.go:370] "Waiting for caches to sync"1541machine # [ 32.215520] k3s[888]: I0919 21:50:50.127708 888 shared_informer.go:370] "Waiting for caches to sync"1542machine # [ 32.251135] k3s[888]: I0919 21:50:50.163184 888 controller.go:667] quota admission added evaluator for: jobs.batch1543machine # [ 32.290575] k3s[888]: I0919 21:50:50.202734 888 shared_informer.go:377] "Caches are synced"1544machine # [ 32.291590] k3s[888]: I0919 21:50:50.203803 888 shared_informer.go:377] "Caches are synced"1545machine # [ 32.293840] k3s[888]: I0919 21:50:50.204692 888 shared_informer.go:377] "Caches are synced"1546machine # [ 32.294153] k3s[888]: I0919 21:50:50.204172 888 shared_informer.go:377] "Caches are synced"1547machine # [ 32.294632] k3s[888]: I0919 21:50:50.204205 888 shared_informer.go:377] "Caches are synced"1548machine # [ 32.295166] k3s[888]: I0919 21:50:50.204229 888 shared_informer.go:377] "Caches are synced"1549machine # [ 32.295611] k3s[888]: I0919 21:50:50.204346 888 shared_informer.go:377] "Caches are synced"1550machine # [ 32.296120] k3s[888]: I0919 21:50:50.204293 888 shared_informer.go:377] "Caches are synced"1551machine # [ 32.296575] k3s[888]: I0919 21:50:50.204391 888 shared_informer.go:377] "Caches are synced"1552machine # [ 32.297119] k3s[888]: I0919 21:50:50.204412 888 shared_informer.go:377] "Caches are synced"1553machine # [ 32.297531] k3s[888]: I0919 21:50:50.204369 888 shared_informer.go:377] "Caches are synced"1554machine # [ 32.298047] k3s[888]: I0919 21:50:50.204433 888 shared_informer.go:377] "Caches are synced"1555machine # [ 32.298484] k3s[888]: I0919 21:50:50.204563 888 shared_informer.go:377] "Caches are synced"1556machine # [ 32.298991] k3s[888]: I0919 21:50:50.205009 888 range_allocator.go:177] "Sending events to api server"1557machine # [ 32.305137] k3s[888]: I0919 21:50:50.205053 888 range_allocator.go:181] "Starting range CIDR allocator"1558machine # [ 32.305761] k3s[888]: I0919 21:50:50.205063 888 shared_informer.go:370] "Waiting for caches to sync"1559machine # [ 32.306379] k3s[888]: I0919 21:50:50.205074 888 shared_informer.go:377] "Caches are synced"1560machine # [ 32.306845] k3s[888]: I0919 21:50:50.204596 888 shared_informer.go:377] "Caches are synced"1561machine # [ 32.307461] k3s[888]: I0919 21:50:50.204630 888 shared_informer.go:377] "Caches are synced"1562machine # [ 32.307945] k3s[888]: I0919 21:50:50.205302 888 shared_informer.go:377] "Caches are synced"1563machine # [ 32.308561] k3s[888]: I0919 21:50:50.204455 888 shared_informer.go:377] "Caches are synced"1564machine # [ 32.309063] k3s[888]: I0919 21:50:50.205989 888 shared_informer.go:377] "Caches are synced"1565machine # [ 32.309541] k3s[888]: I0919 21:50:50.208230 888 shared_informer.go:377] "Caches are synced"1566machine # [ 32.343423] k3s[888]: time="2026-09-19T21:50:50Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=AppliedManifest type=Normal1567machine # [ 32.356565] k3s[888]: time="2026-09-19T21:50:50Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=ApplyingManifest type=Normal1568machine # [ 32.363065] k3s[888]: time="2026-09-19T21:50:50Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found"1569machine # [ 32.390325] k3s[888]: I0919 21:50:50.302484 888 shared_informer.go:377] "Caches are synced"1570machine # [ 32.390743] k3s[888]: I0919 21:50:50.302533 888 shared_informer.go:377] "Caches are synced"1571machine # [ 32.391667] k3s[888]: I0919 21:50:50.303878 888 shared_informer.go:377] "Caches are synced"1572machine # [ 32.392949] k3s[888]: I0919 21:50:50.303906 888 shared_informer.go:377] "Caches are synced"1573machine # [ 32.394193] k3s[888]: I0919 21:50:50.303922 888 shared_informer.go:377] "Caches are synced"1574machine # [ 32.394724] k3s[888]: I0919 21:50:50.303965 888 shared_informer.go:377] "Caches are synced"1575machine # [ 32.395589] k3s[888]: I0919 21:50:50.304003 888 shared_informer.go:377] "Caches are synced"1576machine # [ 32.396227] k3s[888]: I0919 21:50:50.304032 888 shared_informer.go:377] "Caches are synced"1577machine # [ 32.396583] k3s[888]: I0919 21:50:50.304079 888 shared_informer.go:377] "Caches are synced"1578machine # [ 32.397311] k3s[888]: I0919 21:50:50.304218 888 shared_informer.go:377] "Caches are synced"1579machine # [ 32.398032] k3s[888]: I0919 21:50:50.304563 888 shared_informer.go:377] "Caches are synced"1580machine # [ 32.398430] k3s[888]: I0919 21:50:50.303876 888 shared_informer.go:377] "Caches are synced"1581machine # [ 32.399095] k3s[888]: I0919 21:50:50.304641 888 shared_informer.go:377] "Caches are synced"1582machine # [ 32.399802] k3s[888]: I0919 21:50:50.304688 888 shared_informer.go:377] "Caches are synced"1583machine # [ 32.400696] k3s[888]: I0919 21:50:50.304918 888 shared_informer.go:377] "Caches are synced"1584machine # [ 32.401553] k3s[888]: I0919 21:50:50.305014 888 shared_informer.go:377] "Caches are synced"1585machine # [ 32.402208] k3s[888]: I0919 21:50:50.305093 888 shared_informer.go:377] "Caches are synced"1586machine # [ 32.402952] k3s[888]: I0919 21:50:50.306903 888 shared_informer.go:377] "Caches are synced"1587machine # [ 32.403921] k3s[888]: I0919 21:50:50.306898 888 shared_informer.go:377] "Caches are synced"1588machine # [ 32.404715] k3s[888]: I0919 21:50:50.306943 888 shared_informer.go:377] "Caches are synced"1589machine # [ 32.405681] k3s[888]: I0919 21:50:50.306952 888 shared_informer.go:377] "Caches are synced"1590machine # [ 32.406576] k3s[888]: I0919 21:50:50.307001 888 shared_informer.go:377] "Caches are synced"1591machine # [ 32.407519] k3s[888]: I0919 21:50:50.312908 888 shared_informer.go:377] "Caches are synced"1592machine # [ 32.539440] k3s[888]: time="2026-09-19T21:50:50Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Resumed synced Job kube-system/helm-install-nix-grpc-farm" object=kube-system/nix-grpc-farm reason=ResumeJob type=Normal1593machine # [ 32.576434] k3s[888]: time="2026-09-19T21:50:50Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=AppliedManifest type=Normal1594machine # [ 32.708439] k3s[888]: time="2026-09-19T21:50:50Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/traefik.yaml\"" object=kube-system/traefik reason=DeletingManifest type=Normal1595machine # [ 32.717071] k3s[888]: time="2026-09-19T21:50:50Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Deferred node password secret validation complete" object=machine reason=NodePasswordValidationComplete type=Normal1596machine # [ 32.888876] k3s[888]: I0919 21:50:50.801025 888 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/161597machine # [ 32.895469] k3s[888]: I0919 21:50:50.807624 888 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/161598machine # [ 32.937284] k3s[888]: I0919 21:50:50.849062 888 controller.go:667] quota admission added evaluator for: replicasets.apps1599machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found1600machine # [ 33.362387] k3s[888]: time="2026-09-19T21:50:51Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found"1601machine # [ 33.595267] k3s[888]: I0919 21:50:51.507402 888 shared_informer.go:377] "Caches are synced"1602machine # [ 33.596962] k3s[888]: I0919 21:50:51.507435 888 garbagecollector.go:166] "Garbage collector: all resource monitors have synced"1603machine # [ 33.599126] k3s[888]: I0919 21:50:51.507446 888 garbagecollector.go:169] "Proceeding to collect garbage"1604machine # [ 33.616349] k3s[888]: I0919 21:50:51.528466 888 shared_informer.go:377] "Caches are synced"1605machine # [ 33.981496] k3s[888]: time="2026-09-19T21:50:51Z" level=info msg="Imported docker.io/library/nix-grpc-farm-lb:0.1.0"1606machine # [ 33.984715] k3s[888]: time="2026-09-19T21:50:51Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-lb@sha256:a3fb275e15335967c368c203214cabcce2886a8867fcd31c07e4effd2ad9a5ec"1607machine # [ 34.040816] k3s[888]: time="2026-09-19T21:50:51Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-lb.tar in 4.226509514s"1608machine # [ 34.043902] k3s[888]: time="2026-09-19T21:50:51Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm.tar"1609machine # [ 34.136084] k3s[888]: time="2026-09-19T21:50:52Z" level=info msg="Running kubelet --cloud-provider=external --config-dir=/var/lib/rancher/k3s/agent/etc/kubelet.conf.d --containerd=/run/k3s/containerd/containerd.sock --eviction-hard=nodefs.available<1%,imagefs.available<1% --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubelet.kubeconfig --node-ip=10.0.2.15,fec0::2747:9aec:a8ac:e17f --node-labels= --read-only-port=0"1610machine # [ 34.142164] k3s[888]: Flag --containerd has been deprecated, This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed.1611machine # [ 34.154726] k3s[888]: I0919 21:50:52.066899 888 server.go:521] "Kubelet version" kubeletVersion="v1.35.8+k3s1"1612machine # [ 34.155081] k3s[888]: I0919 21:50:52.066948 888 server.go:523] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""1613machine # [ 34.159116] k3s[888]: I0919 21:50:52.071244 888 watchdog_linux.go:95] "Systemd watchdog is not enabled"1614machine # [ 34.160782] k3s[888]: I0919 21:50:52.071296 888 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."1615machine # [ 34.161799] k3s[888]: I0919 21:50:52.072958 888 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/agent/client-ca.crt"1616machine # [ 34.166221] k3s[888]: I0919 21:50:52.078377 888 server.go:1414] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"1617machine # [ 34.171130] k3s[888]: I0919 21:50:52.083093 888 server.go:771] "--cgroups-per-qos enabled, but --cgroup-root was not specified. Defaulting to /"1618machine # [ 34.171643] k3s[888]: I0919 21:50:52.083141 888 server.go:832] "NoSwap is set due to memorySwapBehavior not specified" memorySwapBehavior="" FailSwapOn=false1619machine # [ 34.172767] k3s[888]: I0919 21:50:52.083553 888 container_manager_linux.go:272] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]1620machine # [ 34.173621] k3s[888]: I0919 21:50:52.083585 888 container_manager_linux.go:277] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"machine","RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}1621machine # [ 34.175762] k3s[888]: I0919 21:50:52.083790 888 topology_manager.go:143] "Creating topology manager with none policy"1622machine # [ 34.176539] k3s[888]: I0919 21:50:52.083806 888 container_manager_linux.go:308] "Creating device plugin manager"1623machine # [ 34.177062] k3s[888]: I0919 21:50:52.083884 888 container_manager_linux.go:317] "Creating Dynamic Resource Allocation (DRA) manager"1624machine # [ 34.177569] k3s[888]: I0919 21:50:52.087214 888 state_mem.go:41] "Initialized" logger="CPUManager state memory"1625machine # [ 34.178486] k3s[888]: I0919 21:50:52.087532 888 kubelet.go:482] "Attempting to sync node with API server"1626machine # [ 34.179638] k3s[888]: I0919 21:50:52.087552 888 kubelet.go:383] "Adding static pod path" path="/var/lib/rancher/k3s/agent/pod-manifests"1627machine # [ 34.180586] k3s[888]: I0919 21:50:52.087592 888 kubelet.go:394] "Adding apiserver pod source"1628machine # [ 34.181575] k3s[888]: I0919 21:50:52.087614 888 apiserver.go:42] "Waiting for node sync before watching apiserver pods"1629machine # [ 34.200305] k3s[888]: I0919 21:50:52.112484 888 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="containerd" version="2.2.7-k3s1" apiVersion="v1"1630machine # [ 34.201052] k3s[888]: I0919 21:50:52.113182 888 kubelet.go:945] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"1631machine # [ 34.201695] k3s[888]: I0919 21:50:52.113215 888 kubelet.go:972] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"1632machine # [ 34.206527] k3s[888]: I0919 21:50:52.116228 888 server.go:1252] "Started kubelet"1633machine # [ 34.207367] k3s[888]: I0919 21:50:52.116610 888 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=101634machine # [ 34.207983] k3s[888]: I0919 21:50:52.116677 888 server_v1.go:49] "podresources" method="list" useActivePods=true1635machine # [ 34.208453] k3s[888]: I0919 21:50:52.116839 888 server.go:182] "Starting to listen" address="0.0.0.0" port=102501636machine # [ 34.209169] k3s[888]: I0919 21:50:52.116922 888 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"1637machine # [ 34.209872] k3s[888]: I0919 21:50:52.117851 888 server.go:317] "Adding debug handlers to kubelet server"1638machine # [ 34.210590] k3s[888]: I0919 21:50:52.119963 888 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"1639machine # [ 34.211227] k3s[888]: I0919 21:50:52.120192 888 dynamic_serving_content.go:135] "Starting controller" name="kubelet-server-cert-files::/var/lib/rancher/k3s/agent/serving-kubelet.crt::/var/lib/rancher/k3s/agent/serving-kubelet.key"1640machine # [ 34.211713] k3s[888]: I0919 21:50:52.120481 888 volume_manager.go:311] "Starting Kubelet Volume Manager"1641machine # [ 34.212200] k3s[888]: I0919 21:50:52.120727 888 desired_state_of_world_populator.go:146] "Desired state populator starts to run"1642machine # [ 34.212718] k3s[888]: I0919 21:50:52.120801 888 reconciler.go:29] "Reconciler: start to sync state"1643machine # [ 34.213387] k3s[888]: E0919 21:50:52.121026 888 kubelet_node_status.go:392] "Error getting the current node from lister" err="node \"machine\" not found"1644machine # [ 34.213966] k3s[888]: I0919 21:50:52.123452 888 factory.go:223] Registration of the systemd container factory successfully1645machine # [ 34.214309] k3s[888]: I0919 21:50:52.123570 888 factory.go:221] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory1646machine # [ 34.220061] k3s[888]: E0919 21:50:52.132230 888 kubelet.go:1661] "Image garbage collection failed once. Stats initialization may not have completed yet" err="invalid capacity 0 on image filesystem"1647machine # [ 34.225431] k3s[888]: I0919 21:50:52.137630 888 factory.go:223] Registration of the containerd container factory successfully1648machine # [ 34.242662] k3s[888]: I0919 21:50:52.153366 888 cpu_manager.go:225] "Starting" policy="none"1649machine # [ 34.242949] k3s[888]: I0919 21:50:52.153390 888 cpu_manager.go:226] "Reconciling" reconcilePeriod="10s"1650machine # [ 34.243635] k3s[888]: I0919 21:50:52.153414 888 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"1651machine # [ 34.251177] k3s[888]: I0919 21:50:52.163387 888 policy_none.go:50] "Start"1652machine # [ 34.251552] k3s[888]: I0919 21:50:52.163779 888 memory_manager.go:187] "Starting memorymanager" policy="None"1653machine # [ 34.252110] k3s[888]: I0919 21:50:52.164335 888 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"1654machine # [ 34.260049] k3s[888]: E0919 21:50:52.172213 888 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"machine\" not found" node="machine"1655machine # [ 34.261442] k3s[888]: I0919 21:50:52.173110 888 policy_none.go:44] "Start"1656machine # [ 34.266537] systemd[1]: Created slice libcontainer container kubepods.slice.1657machine # [ 34.278324] systemd[1]: Created slice libcontainer container kubepods-burstable.slice.1658machine # [ 34.285948] systemd[1]: Created slice libcontainer container kubepods-besteffort.slice.1659machine # [ 34.294504] k3s[888]: E0919 21:50:52.206687 888 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"1660machine # [ 34.294650] k3s[888]: I0919 21:50:52.206816 888 eviction_manager.go:194] "Eviction manager: starting control loop"1661machine # [ 34.295167] k3s[888]: I0919 21:50:52.206845 888 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"1662machine # [ 34.295666] k3s[888]: I0919 21:50:52.207608 888 plugin_manager.go:121] "Starting Kubelet Plugin Manager"1663machine # [ 34.303684] k3s[888]: E0919 21:50:52.215816 888 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="no imagefs label for configured runtime"1664machine # [ 34.303798] k3s[888]: E0919 21:50:52.215873 888 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"machine\" not found"1665machine # [ 34.362143] k3s[888]: time="2026-09-19T21:50:52Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found"1666machine # [ 34.397759] k3s[888]: I0919 21:50:52.309931 888 kubelet_node_status.go:74] "Attempting to register node" node="machine"1667machine # [ 34.409305] k3s[888]: I0919 21:50:52.321056 888 node_controller.go:429] Initializing node machine with cloud provider1668machine # [ 34.409605] k3s[888]: I0919 21:50:52.321155 888 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing1669machine # [ 34.410589] k3s[888]: E0919 21:50:52.321181 888 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError"1670machine # [ 34.411489] k3s[888]: I0919 21:50:52.321928 888 kubelet_node_status.go:77] "Successfully registered node" node="machine"1671machine # [ 34.418099] k3s[888]: I0919 21:50:52.327955 888 node_controller.go:429] Initializing node machine with cloud provider1672machine # [ 34.419047] k3s[888]: I0919 21:50:52.328042 888 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing1673machine # [ 34.420566] k3s[888]: E0919 21:50:52.328070 888 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError"1674machine # [ 34.422122] k3s[888]: time="2026-09-19T21:50:52Z" level=info msg="Adding node OwnerReference to node-password secret machine.node-password.k3s"1675machine # [ 34.425675] k3s[888]: I0919 21:50:52.337734 888 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"machine\" does not exist"1676machine # [ 34.442507] k3s[888]: I0919 21:50:52.354642 888 node_controller.go:429] Initializing node machine with cloud provider1677machine # [ 34.444680] k3s[888]: I0919 21:50:52.356864 888 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing1678machine # [ 34.446088] k3s[888]: E0919 21:50:52.356899 888 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError"1679machine # [ 34.450641] k3s[888]: time="2026-09-19T21:50:52Z" level=info msg="Synced coredns NodeHosts entries for machine"1680machine # [ 34.451511] k3s[888]: time="2026-09-19T21:50:52Z" level=info msg="Annotations and labels have been set successfully on node: machine"1681machine # [ 34.452624] k3s[888]: time="2026-09-19T21:50:52Z" level=info msg="Starting flannel with backend vxlan"1682machine # [ 34.454195] k3s[888]: I0919 21:50:52.365882 888 node_controller.go:429] Initializing node machine with cloud provider1683machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found1684machine # [ 34.471144] k3s[888]: I0919 21:50:52.383335 888 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"1685machine # [ 34.473984] k3s[888]: I0919 21:50:52.386075 888 range_allocator.go:433] "Set node PodCIDR" node="machine" podCIDRs=["10.42.0.0/24"]1686machine # [ 34.486681] k3s[888]: I0919 21:50:52.398882 888 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"1687machine # [ 34.488467] k3s[888]: I0919 21:50:52.400574 888 status_manager.go:249] "Starting to sync pod status with apiserver"1688machine # [ 34.488939] k3s[888]: I0919 21:50:52.400616 888 kubelet.go:2506] "Starting kubelet main sync loop"1689machine # [ 34.489785] k3s[888]: E0919 21:50:52.400665 888 kubelet.go:2530] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"1690machine # [ 34.495424] k3s[888]: time="2026-09-19T21:50:52Z" level=info msg="Flannel found PodCIDR assigned for node machine"1691machine # [ 34.499207] k3s[888]: time="2026-09-19T21:50:52Z" level=info msg="The interface eth0 with ipv4 address 10.0.2.15 will be used by flannel"1692machine # [ 34.499813] k3s[888]: I0919 21:50:52.411970 888 kube.go:139] Waiting 10m0s for node controller to sync1693machine # [ 34.500938] k3s[888]: I0919 21:50:52.412043 888 kube.go:537] Starting kube subnet manager1694machine # [ 34.543120] k3s[888]: I0919 21:50:52.455240 888 node_controller.go:474] Successfully initialized node machine with cloud provider1695machine # [ 34.543412] k3s[888]: I0919 21:50:52.455585 888 event.go:389] "Event occurred" object="machine" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="Synced" message="Node synced successfully"1696machine # [ 34.549871] k3s[888]: I0919 21:50:52.461989 888 server.go:173] "Starting Kubernetes Scheduler" version="v1.35.8+k3s1"1697machine # [ 34.550641] k3s[888]: I0919 21:50:52.462013 888 server.go:175] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""1698machine # [ 34.554986] k3s[888]: I0919 21:50:52.465738 888 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController1699machine # [ 34.555307] k3s[888]: I0919 21:50:52.465764 888 shared_informer.go:370] "Waiting for caches to sync"1700machine # [ 34.555846] k3s[888]: I0919 21:50:52.465803 888 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"1701machine # [ 34.556537] k3s[888]: I0919 21:50:52.465823 888 shared_informer.go:370] "Waiting for caches to sync"1702machine # [ 34.557087] k3s[888]: I0919 21:50:52.465850 888 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"1703machine # [ 34.557601] k3s[888]: I0919 21:50:52.465864 888 shared_informer.go:370] "Waiting for caches to sync"1704machine # [ 34.558200] k3s[888]: I0919 21:50:52.465871 888 secure_serving.go:211] Serving securely on 127.0.0.1:102591705machine # [ 34.559359] k3s[888]: I0919 21:50:52.465977 888 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key"1706machine # [ 34.560808] k3s[888]: I0919 21:50:52.466307 888 tlsconfig.go:243] "Starting DynamicServingCertificateController"1707machine # [ 34.570332] k3s[888]: I0919 21:50:52.482531 888 kuberuntime_manager.go:2095] "Updating runtime config through cri with podcidr" CIDR="10.42.0.0/24"1708machine # [ 34.571712] k3s[888]: I0919 21:50:52.483637 888 kubelet_network.go:47] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.42.0.0/24"1709machine # [ 34.676361] k3s[888]: I0919 21:50:52.588519 888 kubelet_node_status.go:427] "Fast updating node status as it just became ready"1710machine # [ 34.688019] k3s[888]: I0919 21:50:52.600144 888 topologycache.go:237] "Can't get CPU or zone information for node" node="machine"1711machine # [ 34.754191] k3s[888]: I0919 21:50:52.666315 888 shared_informer.go:377] "Caches are synced"1712machine # [ 34.754980] k3s[888]: I0919 21:50:52.666376 888 shared_informer.go:377] "Caches are synced"1713machine # [ 34.755967] k3s[888]: I0919 21:50:52.666416 888 shared_informer.go:377] "Caches are synced"1714machine # [ 34.761958] postgres[1234]: [1234] ERROR: relation "goose_db_version" does not exist at character 361715machine # [ 34.763610] postgres[1234]: [1234] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC1716machine # [ 34.800339] niks3-server[1219]: 2026/09/19 21:50:52 OK 20241026095416_initial_model.sql (11.24ms)1717machine # [ 34.803592] niks3-server[1219]: 2026/09/19 21:50:52 OK 20251210153512_drop_unused_gin_index.sql (3.23ms)1718machine # [ 34.807700] niks3-server[1219]: 2026/09/19 21:50:52 OK 20251218171726_add_pins.sql (3.19ms)1719machine # [ 34.813424] niks3-server[1219]: 2026/09/19 21:50:52 OK 20260628120000_add_object_size_and_stats.sql (6.48ms)1720machine # [ 34.818756] niks3-server[1219]: 2026/09/19 21:50:52 OK 20260905000000_add_claims.sql (5.22ms)1721machine # [ 34.819476] niks3-server[1219]: 2026/09/19 21:50:52 goose: successfully migrated database to version: 202609050000001722machine # [ 34.825571] niks3-server[1219]: 2026/09/19 21:50:52 OK 1_commit_pending_closure.sql (6.77ms)1723machine # [ 34.827281] niks3-server[1219]: 2026/09/19 21:50:52 OK 2_object_stats_trigger.sql (1.62ms)1724machine # [ 34.827695] niks3-server[1219]: 2026/09/19 21:50:52 goose: up to current file version: 21725machine # [ 34.850711] niks3-server[1219]: 2026/09/19 21:50:52 INFO OIDC provider initialized name=kubernetes issuer=https://kubernetes.default.svc.cluster.local1726machine # [ 34.850869] niks3-server[1219]: 2026/09/19 21:50:52 INFO OIDC authentication enabled config=/nix/store/2xcn0lgmca14rg9xzcfqj65j9hs85hn6-niks3-oidc.json1727machine # [ 34.852651] niks3-server[1219]: 2026/09/19 21:50:52 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key1728machine # [ 34.860807] k3s[888]: I0919 21:50:52.772925 888 server.go:218] "Successfully retrieved NodeIPs" NodeIPs=["10.0.2.15","fec0::2747:9aec:a8ac:e17f"]1729machine # [ 34.861195] k3s[888]: E0919 21:50:52.773063 888 server.go:255] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"1730machine # [ 34.904166] k3s[888]: I0919 21:50:52.816223 888 server.go:264] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"1731machine # [ 34.904574] k3s[888]: I0919 21:50:52.816312 888 server_linux.go:136] "Using iptables Proxier"1732machine # [ 34.935088] niks3-server[1219]: 2026/09/19 21:50:52 INFO Read proxy enabled — serving cache objects from S31733machine # [ 34.935300] niks3-server[1219]: 2026/09/19 21:50:52 INFO Using socket-activated listener address=0.0.0.0:57511734machine # [ 34.936391] systemd[1]: Started niks3 server.1735machine # [ 34.937843] niks3-server[1219]: 2026/09/19 21:50:52 INFO Starting HTTP server address=0.0.0.0:57511736machine # [ 34.938684] niks3-server[1219]: 2026/09/19 21:50:52 INFO systemd watchdog enabled interval=15s1737machine # [ 34.940323] systemd[1]: Reached target Multi-User System.1738machine # [ 34.940985] systemd[1]: Startup finished in 1.094s (kernel) + 3.990s (initrd) + 29.854s (userspace) = 34.939s.1739machine # [ 34.951641] k3s[888]: I0919 21:50:52.863810 888 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"1740machine # [ 34.976284] k3s[888]: I0919 21:50:52.888247 888 server.go:529] "Version info" version="v1.35.8+k3s1"1741machine # [ 34.976624] k3s[888]: I0919 21:50:52.888325 888 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""1742machine # [ 34.978213] k3s[888]: I0919 21:50:52.890407 888 config.go:200] "Starting service config controller"1743machine # [ 34.979643] k3s[888]: I0919 21:50:52.890442 888 shared_informer.go:349] "Waiting for caches to sync" controller="service config"1744machine # [ 34.979837] k3s[888]: I0919 21:50:52.890521 888 config.go:309] "Starting node config controller"1745machine # [ 34.980730] k3s[888]: I0919 21:50:52.890534 888 shared_informer.go:349] "Waiting for caches to sync" controller="node config"1746machine # [ 34.982370] k3s[888]: I0919 21:50:52.890546 888 shared_informer.go:356] "Caches are synced" controller="node config"1747machine # [ 34.983595] k3s[888]: I0919 21:50:52.890878 888 config.go:403] "Starting serviceCIDR config controller"1748machine # [ 34.984716] k3s[888]: I0919 21:50:52.890892 888 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config"1749machine # [ 34.985582] k3s[888]: I0919 21:50:52.890930 888 config.go:106] "Starting endpoint slice config controller"1750machine # [ 34.986507] k3s[888]: I0919 21:50:52.890943 888 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config"1751machine # [ 35.176939] k3s[888]: I0919 21:50:53.088998 888 apiserver.go:52] "Watching apiserver"1752machine # [ 35.366128] k3s[888]: time="2026-09-19T21:50:53Z" level=info msg="Labels and annotations have been set successfully on node: machine"1753machine # [ 35.380412] k3s[888]: I0919 21:50:53.291405 888 shared_informer.go:356] "Caches are synced" controller="endpoint slice config"1754machine # [ 35.380743] k3s[888]: I0919 21:50:53.291415 888 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config"1755machine # [ 35.381609] systemd[1]: Created slice libcontainer container kubepods-burstable-pod6af889d0_df30_4a8f_bec2_a817e1a1d2a2.slice.1756machine # [ 35.382161] k3s[888]: I0919 21:50:53.292658 888 shared_informer.go:356] "Caches are synced" controller="service config"1757machine # [ 35.397269] systemd[1]: Created slice libcontainer container kubepods-burstable-pode0940ad4_4522_4b54_9fa9_7f75698c976b.slice.1758machine # [ 35.408820] k3s[888]: I0919 21:50:53.320988 888 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"1759machine # [ 35.419133] k3s[888]: I0919 21:50:53.331289 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"values\" (UniqueName: \"kubernetes.io/projected/6af889d0-df30-4a8f-bec2-a817e1a1d2a2-values\") pod \"helm-install-nix-grpc-farm-6sk95\" (UID: \"6af889d0-df30-4a8f-bec2-a817e1a1d2a2\") " pod="kube-system/helm-install-nix-grpc-farm-6sk95"1760machine # [ 35.419545] k3s[888]: I0919 21:50:53.331356 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"content\" (UniqueName: \"kubernetes.io/configmap/6af889d0-df30-4a8f-bec2-a817e1a1d2a2-content\") pod \"helm-install-nix-grpc-farm-6sk95\" (UID: \"6af889d0-df30-4a8f-bec2-a817e1a1d2a2\") " pod="kube-system/helm-install-nix-grpc-farm-6sk95"1761machine # [ 35.420315] k3s[888]: I0919 21:50:53.331391 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbh4c\" (UniqueName: \"kubernetes.io/projected/e0940ad4-4522-4b54-9fa9-7f75698c976b-kube-api-access-xbh4c\") pod \"coredns-c5fdd76cf-mhdrd\" (UID: \"e0940ad4-4522-4b54-9fa9-7f75698c976b\") " pod="kube-system/coredns-c5fdd76cf-mhdrd"1762machine # [ 35.420914] k3s[888]: I0919 21:50:53.331719 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/6af889d0-df30-4a8f-bec2-a817e1a1d2a2-klipper-helm\") pod \"helm-install-nix-grpc-farm-6sk95\" (UID: \"6af889d0-df30-4a8f-bec2-a817e1a1d2a2\") " pod="kube-system/helm-install-nix-grpc-farm-6sk95"1763machine # [ 35.421906] k3s[888]: I0919 21:50:53.331773 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/6af889d0-df30-4a8f-bec2-a817e1a1d2a2-klipper-cache\") pod \"helm-install-nix-grpc-farm-6sk95\" (UID: \"6af889d0-df30-4a8f-bec2-a817e1a1d2a2\") " pod="kube-system/helm-install-nix-grpc-farm-6sk95"1764machine # [ 35.423043] k3s[888]: I0919 21:50:53.331799 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6af889d0-df30-4a8f-bec2-a817e1a1d2a2-tmp\") pod \"helm-install-nix-grpc-farm-6sk95\" (UID: \"6af889d0-df30-4a8f-bec2-a817e1a1d2a2\") " pod="kube-system/helm-install-nix-grpc-farm-6sk95"1765machine # [ 35.423735] k3s[888]: I0919 21:50:53.331827 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kjm9\" (UniqueName: \"kubernetes.io/projected/6af889d0-df30-4a8f-bec2-a817e1a1d2a2-kube-api-access-2kjm9\") pod \"helm-install-nix-grpc-farm-6sk95\" (UID: \"6af889d0-df30-4a8f-bec2-a817e1a1d2a2\") " pod="kube-system/helm-install-nix-grpc-farm-6sk95"1766machine # [ 35.424705] k3s[888]: I0919 21:50:53.331858 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e0940ad4-4522-4b54-9fa9-7f75698c976b-config-volume\") pod \"coredns-c5fdd76cf-mhdrd\" (UID: \"e0940ad4-4522-4b54-9fa9-7f75698c976b\") " pod="kube-system/coredns-c5fdd76cf-mhdrd"1767machine # [ 35.425603] k3s[888]: I0919 21:50:53.331883 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0940ad4-4522-4b54-9fa9-7f75698c976b-custom-config-volume\") pod \"coredns-c5fdd76cf-mhdrd\" (UID: \"e0940ad4-4522-4b54-9fa9-7f75698c976b\") " pod="kube-system/coredns-c5fdd76cf-mhdrd"1768machine # [ 35.426693] k3s[888]: I0919 21:50:53.331907 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/6af889d0-df30-4a8f-bec2-a817e1a1d2a2-klipper-config\") pod \"helm-install-nix-grpc-farm-6sk95\" (UID: \"6af889d0-df30-4a8f-bec2-a817e1a1d2a2\") " pod="kube-system/helm-install-nix-grpc-farm-6sk95"1769machine # [ 35.500266] k3s[888]: I0919 21:50:53.412234 888 kube.go:163] Node controller sync successful1770machine # [ 35.500449] k3s[888]: I0919 21:50:53.412325 888 vxlan.go:128] VXLAN config: VNI=1 Port=0 GBP=false Learning=false DirectRouting=false1771machine # [ 35.501370] k3s[888]: time="2026-09-19T21:50:53Z" level=info msg="Tunnel authorizer set Kubelet Port 0.0.0.0:10250"1772machine # [ 35.504222] k3s[888]: I0919 21:50:53.416336 888 kube.go:704] List of node(machine) annotations: map[string]string{"alpha.kubernetes.io/provided-node-ip":"10.0.2.15,fec0::2747:9aec:a8ac:e17f", "k3s.io/hostname":"machine", "k3s.io/internal-ip":"10.0.2.15,fec0::2747:9aec:a8ac:e17f", "k3s.io/node-args":"[\"server\",\"--disable\",\"traefik\",\"--disable\",\"metrics-server\",\"--disable\",\"local-storage\",\"--kubelet-arg\",\"eviction-hard=nodefs.available\\u003c1%,imagefs.available\\u003c1%\"]", "k3s.io/node-config-hash":"EFXPOZ7ZWHRCLFNW4X4ZDPFQMSAOP3BLEIN2VE47TDRKQ4UIWKUQ====", "k3s.io/node-env":"{}", "node.alpha.kubernetes.io/ttl":"0", "volumes.kubernetes.io/controller-managed-attach-detach":"true"}1773machine # [ 35.548150] (udev-worker)[1253]: Network interface NamePolicy= disabled on kernel command line.1774machine # [ 35.558108] k3s[888]: I0919 21:50:53.469491 888 kube.go:558] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.42.0.0/24]1775machine # [ 35.562332] k3s[888]: I0919 21:50:53.474524 888 iptables.go:50] Starting flannel in iptables mode...1776machine # [ 35.562853] k3s[888]: time="2026-09-19T21:50:53Z" level=warning msg="no subnet found for key: FLANNEL_NETWORK in file: /run/flannel/subnet.env"1777machine # [ 35.565111] k3s[888]: time="2026-09-19T21:50:53Z" level=warning msg="no subnet found for key: FLANNEL_SUBNET in file: /run/flannel/subnet.env"1778machine # [ 35.566351] k3s[888]: time="2026-09-19T21:50:53Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_NETWORK in file: /run/flannel/subnet.env"1779machine # [ 35.567519] k3s[888]: time="2026-09-19T21:50:53Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_SUBNET in file: /run/flannel/subnet.env"1780machine # [ 35.569079] k3s[888]: I0919 21:50:53.474623 888 iptables.go:101] Current network or subnet (10.42.0.0/16, 10.42.0.0/24) is not equal to previous one (0.0.0.0/0, 0.0.0.0/0), trying to recycle old iptables rules1781machine # [ 35.598725] dhcpcd[678]: flannel.1: IAID 27:46:0d:501782machine # [ 35.599122] dhcpcd[678]: flannel.1: adding address fe80::ac29:27ff:fe46:d501783machine # [ 35.665161] k3s[888]: I0919 21:50:53.577309 888 iptables.go:111] Setting up masking rules1784machine # [ 35.686402] k3s[888]: I0919 21:50:53.598556 888 iptables.go:212] Changing default FORWARD chain policy to ACCEPT1785machine # [ 35.701629] k3s[888]: time="2026-09-19T21:50:53Z" level=info msg="Wrote flannel subnet file to /run/flannel/subnet.env"1786machine # [ 35.703884] k3s[888]: time="2026-09-19T21:50:53Z" level=info msg="Running flannel backend"1787machine # [ 35.705644] k3s[888]: I0919 21:50:53.613809 888 vxlan_network.go:68] watching for new subnet leases1788machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found1789machine # [ 35.709070] k3s[888]: I0919 21:50:53.613836 888 vxlan_network.go:115] starting vxlan device watcher1790machine # [ 35.710861] k3s[888]: time="2026-09-19T21:50:53Z" level=info msg="Started tunnel to 10.0.2.15:6443"1791machine # [ 35.712508] k3s[888]: time="2026-09-19T21:50:53Z" level=info msg="Connecting to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect"1792machine # [ 35.714914] k3s[888]: time="2026-09-19T21:50:53Z" level=info msg="Proxy done" err="context canceled" url="wss://127.0.0.1:6443/v1-k3s/connect"1793machine # [ 35.715193] k3s[888]: time="2026-09-19T21:50:53Z" level=info msg="Stopped tunnel to 127.0.0.1:6443"1794machine # [ 35.715701] k3s[888]: time="2026-09-19T21:50:53Z" level=info msg="error in remotedialer server [400]: websocket: close 1006 (abnormal closure): unexpected EOF"1795machine # [ 35.716672] k3s[888]: time="2026-09-19T21:50:53Z" level=info msg="Handling backend connection request [machine]"1796machine # [ 35.717454] k3s[888]: time="2026-09-19T21:50:53Z" level=info msg="Connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect"1797machine # [ 35.717822] k3s[888]: time="2026-09-19T21:50:53Z" level=info msg="Remotedialer connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect"1798machine # [ 35.792596] k3s[888]: I0919 21:50:53.704542 888 iptables.go:358] bootstrap done1799machine # [ 35.978500] cni0: port 1(veth9835a522) entered blocking state1800machine # [ 35.979536] cni0: port 1(veth9835a522) entered disabled state1801machine # [ 35.980556] veth9835a522: entered allmulticast mode1802machine # [ 35.981625] veth9835a522: entered promiscuous mode1803machine # [ 35.983893] cni0: port 2(vethbb0eec57) entered blocking state1804machine # [ 35.830242] ([ 35.985006] cni0: port 2(vethbb0eec57) entered disabled state1805machine # udev-worker)[1254]: Network interface NamePolicy[ 35.986668] vethbb0eec57: entered allmulticast mode1806machine # = disabled on kernel command lin[ 35.987806] vethbb0eec57: entered promiscuous mode1807machine # e.1808machine # [ 36.010295] cni0: port 2(vethbb0eec57) entered blocking state1809machine # [ 36.011227] cni0: port 2(vethbb0eec57) entered forwarding state1810machine # [ 36.013990] cni0: port 1(veth9835a522) entered blocking state1811machine # [ 36.014732] cni0: port 1(veth9835a522) entered forwarding state1812machine # [ 35.894650] k3s[888]: I0919 21:50:53.806806 888 iptables.go:358] bootstrap done1813machine # [ 35.898654] dhcpcd[678]: veth9835a522: waiting for carrier1814machine # [ 35.917532] dhcpcd[678]: vethbb0eec57: IAID ab:d3:71:cf1815machine # [ 35.917718] dhcpcd[678]: vethbb0eec57: adding address fe80::ecb2:abff:fed3:71cf1816machine # [ 35.917941] dhcpcd[678]: veth9835a522: carrier acquired1817machine # [ 35.927120] dhcpcd[678]: veth9835a522: IAID 3e:e7:e2:6d1818machine # [ 35.927601] dhcpcd[678]: veth9835a522: adding address fe80::f8c7:3eff:fee7:e26d1819machine # [ 36.025676] dhcpcd[678]: flannel.1: soliciting a DHCP lease1820machine # [ 36.071437] systemd[1]: Started libcontainer container 3a2fe3991f76c22353b9cb09824303cf5cc727282c03fe12e7acaa771f247cf6.1821machine # [ 36.073845] systemd[1]: Started libcontainer container 5cf535a22944545db6b8aadaad5642225e9da21fd1025a2dc99e37fe0c135e9a.1822machine # [ 36.137633] dhcpcd[678]: vethbb0eec57: soliciting a DHCP lease1823machine # [ 36.656361] k3s[888]: time="2026-09-19T21:50:54Z" level=info msg="Starting network policy controller version v2.6.3-k3s1, built on 1970-01-01T01:01:01Z, go1.26.7"1824machine # [ 36.656906] k3s[888]: I0919 21:50:54.568084 888 network_policy_controller.go:164] Starting network policy controller1825machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found1826machine # [ 36.996680] dhcpcd[678]: veth9835a522: soliciting a DHCP lease1827machine # [ 37.040216] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount701566951.mount: Deactivated successfully.1828machine # [ 37.093516] systemd[1]: Started libcontainer container 4971d778a3b4a6e874f7c33103e86a788b0093802d0e5cd7a94dbf538026dcbc.1829machine # [ 37.125823] k3s[888]: I0919 21:50:55.037935 888 network_policy_controller.go:179] Starting network policy controller full sync goroutine1830machine # [ 37.238385] systemd[1]: Started libcontainer container 42adf2329d7beb1fdf70575c84127b80a7eea7ac42ce6c3be708f378cac5ed59.1831machine # [ 37.394993] k3s[888]: I0919 21:50:55.305882 888 node_lifecycle_controller.go:1234] "Initializing eviction metric for zone" zone=""1832machine # [ 37.395216] k3s[888]: I0919 21:50:55.306958 888 node_lifecycle_controller.go:886] "Missing timestamp for Node. Assuming now as a timestamp" node="machine"1833machine # [ 37.395634] k3s[888]: I0919 21:50:55.307074 888 node_lifecycle_controller.go:1080] "Controller detected that zone is now in new state" zone="" newState="Normal"1834machine # [ 37.533549] k3s[888]: I0919 21:50:55.441443 888 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/coredns-c5fdd76cf-mhdrd" podStartSLOduration=4.441416293 podStartE2EDuration="4.441416293s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 21:50:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 21:50:55.440555569 +0000 UTC m=+16.230795254" watchObservedRunningTime="2026-09-19 21:50:55.441416293 +0000 UTC m=+16.231655698"1835machine # [ 37.545717] k3s[888]: I0919 21:50:55.457889 888 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/helm-install-nix-grpc-farm-6sk95" podStartSLOduration=5.457873134 podStartE2EDuration="5.457873134s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 21:50:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 21:50:55.457554657 +0000 UTC m=+16.247816970" watchObservedRunningTime="2026-09-19 21:50:55.457873134 +0000 UTC m=+16.248112818"1836machine # [ 37.702368] dhcpcd[678]: flannel.1: soliciting an IPv6 router1837machine # [ 37.845573] dhcpcd[678]: veth9835a522: soliciting an IPv6 router1838machine # [ 37.898395] dhcpcd[678]: vethbb0eec57: soliciting an IPv6 router1839machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found1840machine # [ 38.814420] k3s[888]: E0919 21:50:56.726168 888 status.go:71] "Unhandled Error" err="apiserver received an error that is not an metav1.Status: &errors.errorString{s:\"failed to create typed patch object (farm/nix-grpc-farm-scheduler; /v1, Kind=Service): .spec.selector.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}\"}: failed to create typed patch object (farm/nix-grpc-farm-scheduler; /v1, Kind=Service): .spec.selector.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}" logger="UnhandledError"1841machine # [ 38.823073] k3s[888]: I0919 21:50:56.735223 888 alloc.go:329] "allocated clusterIPs" service="farm/nix-grpc-farm" clusterIPs={"IPv4":"10.43.249.108"}1842machine # [ 38.833072] k3s[888]: E0919 21:50:56.744919 888 status.go:71] "Unhandled Error" err=<1843machine # [ 38.833324] k3s[888]: apiserver received an error that is not an metav1.Status: &errors.errorString{s:"failed to create typed patch object (farm/nix-grpc-farm-scheduler; apps/v1, Kind=Deployment): errors:\n .spec.template.metadata.labels.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}\n .spec.selector.matchLabels.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}"}: failed to create typed patch object (farm/nix-grpc-farm-scheduler; apps/v1, Kind=Deployment): errors:1844machine # [ 38.834567] k3s[888]: .spec.template.metadata.labels.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}1845machine # [ 38.835955] k3s[888]: .spec.selector.matchLabels.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}1846machine # [ 38.836989] k3s[888]: > logger="UnhandledError"1847machine # [ 38.877973] systemd[1]: cri-containerd-42adf2329d7beb1fdf70575c84127b80a7eea7ac42ce6c3be708f378cac5ed59.scope: Deactivated successfully.1848machine # [ 38.878390] systemd[1]: cri-containerd-42adf2329d7beb1fdf70575c84127b80a7eea7ac42ce6c3be708f378cac5ed59.scope: Consumed 544ms CPU time over 1.638s wall clock time, 33.7M memory peak, 2.4M incoming IP traffic, 123.8K outgoing IP traffic.1849machine # [ 38.936108] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod6e0d5d2b_c212_493b_9c2a_24493642fb0b.slice.1850machine # [ 38.957368] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-42adf2329d7beb1fdf70575c84127b80a7eea7ac42ce6c3be708f378cac5ed59-rootfs.mount: Deactivated successfully.1851machine # [ 38.964872] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod66cc6219_28e0_4b00_bee9_b4a4f7388ec5.slice.1852machine # [ 38.979464] k3s[888]: I0919 21:50:56.891622 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/6e0d5d2b-c212-493b-9c2a-24493642fb0b-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-pkbtm\" (UID: \"6e0d5d2b-c212-493b-9c2a-24493642fb0b\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-pkbtm"1853machine # [ 38.982561] k3s[888]: I0919 21:50:56.891690 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/6e0d5d2b-c212-493b-9c2a-24493642fb0b-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-pkbtm\" (UID: \"6e0d5d2b-c212-493b-9c2a-24493642fb0b\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-pkbtm"1854machine # [ 38.983300] k3s[888]: I0919 21:50:56.891737 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6e0d5d2b-c212-493b-9c2a-24493642fb0b-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-pkbtm\" (UID: \"6e0d5d2b-c212-493b-9c2a-24493642fb0b\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-pkbtm"1855machine # [ 38.983771] k3s[888]: I0919 21:50:56.891768 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/66cc6219-28e0-4b00-bee9-b4a4f7388ec5-tls-lb\") pod \"nix-grpc-farm-lb-688d8d547b-gk2n2\" (UID: \"66cc6219-28e0-4b00-bee9-b4a4f7388ec5\") " pod="farm/nix-grpc-farm-lb-688d8d547b-gk2n2"1856machine # [ 38.984475] k3s[888]: I0919 21:50:56.891794 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/6e0d5d2b-c212-493b-9c2a-24493642fb0b-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-pkbtm\" (UID: \"6e0d5d2b-c212-493b-9c2a-24493642fb0b\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-pkbtm"1857machine # [ 38.984991] k3s[888]: I0919 21:50:56.891830 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/6e0d5d2b-c212-493b-9c2a-24493642fb0b-build\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-pkbtm\" (UID: \"6e0d5d2b-c212-493b-9c2a-24493642fb0b\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-pkbtm"1858machine # [ 38.987108] k3s[888]: I0919 21:50:56.891865 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/6e0d5d2b-c212-493b-9c2a-24493642fb0b-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-pkbtm\" (UID: \"6e0d5d2b-c212-493b-9c2a-24493642fb0b\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-pkbtm"1859machine # [ 38.987707] k3s[888]: I0919 21:50:56.891896 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/6e0d5d2b-c212-493b-9c2a-24493642fb0b-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-pkbtm\" (UID: \"6e0d5d2b-c212-493b-9c2a-24493642fb0b\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-pkbtm"1860machine # [ 38.988406] k3s[888]: I0919 21:50:56.892022 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/66cc6219-28e0-4b00-bee9-b4a4f7388ec5-config\") pod \"nix-grpc-farm-lb-688d8d547b-gk2n2\" (UID: \"66cc6219-28e0-4b00-bee9-b4a4f7388ec5\") " pod="farm/nix-grpc-farm-lb-688d8d547b-gk2n2"1861machine # [ 38.990104] k3s[888]: I0919 21:50:56.892057 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66cc6219-28e0-4b00-bee9-b4a4f7388ec5-tmp\") pod \"nix-grpc-farm-lb-688d8d547b-gk2n2\" (UID: \"66cc6219-28e0-4b00-bee9-b4a4f7388ec5\") " pod="farm/nix-grpc-farm-lb-688d8d547b-gk2n2"1862machine # [ 38.991550] k3s[888]: I0919 21:50:56.892092 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r886n\" (UniqueName: \"kubernetes.io/projected/6e0d5d2b-c212-493b-9c2a-24493642fb0b-kube-api-access-r886n\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-pkbtm\" (UID: \"6e0d5d2b-c212-493b-9c2a-24493642fb0b\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-pkbtm"1863machine # [ 38.992189] k3s[888]: I0919 21:50:56.892195 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/66cc6219-28e0-4b00-bee9-b4a4f7388ec5-tls-ca\") pod \"nix-grpc-farm-lb-688d8d547b-gk2n2\" (UID: \"66cc6219-28e0-4b00-bee9-b4a4f7388ec5\") " pod="farm/nix-grpc-farm-lb-688d8d547b-gk2n2"1864machine # [ 39.146854] systemd[1]: Created slice libcontainer container kubepods-besteffort-poddb834e5c_50e5_486c_9843_f58007a3dfe0.slice.1865machine # [ 39.181042] k3s[888]: I0919 21:50:57.093156 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/db834e5c-50e5-486c-9843-f58007a3dfe0-build\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-ktvvb\" (UID: \"db834e5c-50e5-486c-9843-f58007a3dfe0\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-ktvvb"1866machine # [ 39.181466] k3s[888]: I0919 21:50:57.093210 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/db834e5c-50e5-486c-9843-f58007a3dfe0-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-ktvvb\" (UID: \"db834e5c-50e5-486c-9843-f58007a3dfe0\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-ktvvb"1867machine # [ 39.182055] k3s[888]: I0919 21:50:57.093432 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/db834e5c-50e5-486c-9843-f58007a3dfe0-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-ktvvb\" (UID: \"db834e5c-50e5-486c-9843-f58007a3dfe0\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-ktvvb"1868machine # [ 39.182478] k3s[888]: I0919 21:50:57.093465 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/db834e5c-50e5-486c-9843-f58007a3dfe0-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-ktvvb\" (UID: \"db834e5c-50e5-486c-9843-f58007a3dfe0\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-ktvvb"1869machine # [ 39.182978] k3s[888]: I0919 21:50:57.093542 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/db834e5c-50e5-486c-9843-f58007a3dfe0-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-ktvvb\" (UID: \"db834e5c-50e5-486c-9843-f58007a3dfe0\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-ktvvb"1870machine # [ 39.183614] k3s[888]: I0919 21:50:57.093592 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/db834e5c-50e5-486c-9843-f58007a3dfe0-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-ktvvb\" (UID: \"db834e5c-50e5-486c-9843-f58007a3dfe0\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-ktvvb"1871machine # [ 39.184257] k3s[888]: I0919 21:50:57.093726 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2nc6\" (UniqueName: \"kubernetes.io/projected/db834e5c-50e5-486c-9843-f58007a3dfe0-kube-api-access-m2nc6\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-ktvvb\" (UID: \"db834e5c-50e5-486c-9843-f58007a3dfe0\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-ktvvb"1872machine # [ 39.184782] k3s[888]: I0919 21:50:57.093884 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/db834e5c-50e5-486c-9843-f58007a3dfe0-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-ktvvb\" (UID: \"db834e5c-50e5-486c-9843-f58007a3dfe0\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-ktvvb"1873machine # [ 39.431699] cni0: port 3(veth24fc42c1) entered blocking state1874machine # [ 39.277604] (udev-worker)[1866]: Network interface NamePolicy= disabled on ke[ 39.434192] cni0: port 3(veth24fc42c1) entered disabled state1875machine # rnel command lin[ 39.435388] veth24fc42c1: entered allmulticast mode1876machine # e.1877machine # [ 39.436611] veth24fc42c1: entered promiscuous mode1878machine # [ 39.454916] cni0: port 3(veth24fc42c1) entered blocking state1879machine # [ 39.455788] cni0: port 3(veth24fc42c1) entered forwarding state1880machine # [ 39.329263] dhcpcd[678]: veth24fc42c1: IAID 4f:e6:e0:441881machine # [ 39.329642] dhcpcd[678]: veth24fc42c1: adding address fe80::60d6:4fff:fee6:e0441882machine # [ 39.491012] cni0: port 4(veth0634d5f3) entered blocking state1883machine # [ 39.337320] ([ 39.491984] cni0: port 4(veth0634d5f3) entered disabled state1884machine # udev-worker)[2000]: Network inte[ 39.493091] veth0634d5f3: entered allmulticast mode1885machine # rface NamePolicy= disabled on ke[ 39.494237] veth0634d5f3: entered promiscuous mode1886machine # rnel command line.1887machine # [ 39.510132] cni0: port 4(veth0634d5f3) entered blocking state1888machine # [ 39.510872] cni0: port 4(veth0634d5f3) entered forwarding state1889machine # [ 39.387784] dhcpcd[678]: veth0634d5f3: IAID 03:63:cd:b11890machine # [ 39.388052] dhcpcd[678]: veth0634d5f3: adding address fe80::e877:3ff:fe63:cdb11891machine # [ 39.461946] systemd[1]: Started libcontainer container 03c08de02ba1ea865e8d946347eea9da5b7d8f62145c8bbfc1d0f091cfb25a00.1892machine # [ 39.647980] cni0: port 5(veth51b182f7) entered blocking state1893machine # [ 39.649356] cni0: port 5(veth51b182f7) entered disabled state1894machine # [ 39.651541] veth51b182f7: entered allmulticast mode1895machine # [ 39.652624] veth51b182f7: entered promiscuous mode1896machine # [ 39.513154] systemd[1]: Started libcontainer container cabb35715f0ceb231ccae67195e7ce870747f765c4628879ac714a1032c2862d.1897machine # [ 39.673917] cni0: port 5(veth51b182f7) entered blocking state1898machine # [ 39.674657] cni0: port 5(veth51b182f7) entered forwarding state1899machine # [ 39.536372] k3s[888]: I0919 21:50:57.448559 888 scope.go:122] "RemoveContainer" containerID="42adf2329d7beb1fdf70575c84127b80a7eea7ac42ce6c3be708f378cac5ed59"1900machine # [ 39.565306] k3s[888]: E0919 21:50:57.477465 888 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0"1901machine # [ 39.565647] k3s[888]: E0919 21:50:57.477559 888 kuberuntime_image.go:43] "Failed to pull image" err="failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0"1902machine # [ 39.566109] k3s[888]: E0919 21:50:57.477780 888 kuberuntime_manager.go:1674] "Unhandled Error" err="init container seed-store start failed in pod nix-grpc-farm-worker-x86-64-linux-5cdbdb595-pkbtm_farm(6e0d5d2b-c212-493b-9c2a-24493642fb0b): ErrImagePull: failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0\": dial tcp: lookup registry-1.docker.io: no such host" logger="UnhandledError"1903machine # [ 39.585707] k3s[888]: E0919 21:50:57.477840 888 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-pkbtm" podUID="6e0d5d2b-c212-493b-9c2a-24493642fb0b"1904machine # [ 39.607949] dhcpcd[678]: veth51b182f7: waiting for carrier1905machine # [ 39.608347] dhcpcd[678]: veth51b182f7: carrier acquired1906machine # [ 39.619262] dhcpcd[678]: veth51b182f7: IAID 3e:1c:f5:341907machine # [ 39.619620] dhcpcd[678]: veth51b182f7: adding address fe80::74a8:3eff:fe1c:f5341908machine # [ 39.643358] systemd[1]: Started libcontainer container c860694542143e1b450ee3f0fc411c5dbb1036addebc91c5461c661cfbf9c6b9.1909machine # [ 39.731453] systemd[1]: Started libcontainer container 71a89eaa5a6a3af658c2e30ea73cfdad6a31d8070bef967fb30d7b5d601c1364.1910machine # [ 39.855686] k3s[888]: E0919 21:50:57.767515 888 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0"1911machine # [ 39.855872] k3s[888]: E0919 21:50:57.767586 888 kuberuntime_image.go:43] "Failed to pull image" err="failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0"1912machine # [ 39.856760] k3s[888]: E0919 21:50:57.767826 888 kuberuntime_manager.go:1674] "Unhandled Error" err="init container seed-store start failed in pod nix-grpc-farm-worker-x86-64-linux-5cdbdb595-ktvvb_farm(db834e5c-50e5-486c-9843-f58007a3dfe0): ErrImagePull: failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0\": dial tcp: lookup registry-1.docker.io: no such host" logger="UnhandledError"1913machine # [ 39.857515] k3s[888]: E0919 21:50:57.767895 888 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-ktvvb" podUID="db834e5c-50e5-486c-9843-f58007a3dfe0"1914machine # [ 40.024103] dhcpcd[678]: veth24fc42c1: soliciting a DHCP lease1915machine # [ 40.190699] systemd[1]: Started libcontainer container 1fc183832826354e6344bd46020c1939f04cb02c0cc64ca20400058c13531ea1.1916machine # [ 40.230181] dhcpcd[678]: veth0634d5f3: soliciting a DHCP lease1917machine # [ 40.399990] dhcpcd[678]: veth24fc42c1: soliciting an IPv6 router1918machine # [ 40.544305] systemd[1]: cri-containerd-c860694542143e1b450ee3f0fc411c5dbb1036addebc91c5461c661cfbf9c6b9.scope: Deactivated successfully.1919machine # [ 40.544991] systemd[1]: cri-containerd-c860694542143e1b450ee3f0fc411c5dbb1036addebc91c5461c661cfbf9c6b9.scope: Consumed 300ms CPU time over 900ms wall clock time, 17.1M memory peak, 425.8K incoming IP traffic, 18.6K outgoing IP traffic.1920machine # [ 40.547720] k3s[888]: E0919 21:50:58.459894 888 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ImagePullBackOff: \"Back-off pulling image \\\"nix-grpc-farm:0.1.0\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-ktvvb" podUID="db834e5c-50e5-486c-9843-f58007a3dfe0"1921machine # [ 40.558465] k3s[888]: E0919 21:50:58.470561 888 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ImagePullBackOff: \"Back-off pulling image \\\"nix-grpc-farm:0.1.0\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-pkbtm" podUID="6e0d5d2b-c212-493b-9c2a-24493642fb0b"1922machine # [ 40.589573] k3s[888]: I0919 21:50:58.501746 888 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-688d8d547b-gk2n2" podStartSLOduration=2.501724517 podStartE2EDuration="2.501724517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 21:50:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 21:50:58.501573659 +0000 UTC m=+19.291813064" watchObservedRunningTime="2026-09-19 21:50:58.501724517 +0000 UTC m=+19.291963642"1923machine # [ 40.605891] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-c860694542143e1b450ee3f0fc411c5dbb1036addebc91c5461c661cfbf9c6b9-rootfs.mount: Deactivated successfully.1924machine # [ 41.026185] dhcpcd[678]: flannel.1: probing for an IPv4LL address1925machine # [ 41.138403] dhcpcd[678]: vethbb0eec57: probing for an IPv4LL address1926machine # [ 41.297647] dhcpcd[678]: veth51b182f7: soliciting a DHCP lease1927machine # [ 41.480686] dhcpcd[678]: veth51b182f7: soliciting an IPv6 router1928machine # [ 41.565643] k3s[888]: I0919 21:50:59.477323 888 scope.go:122] "RemoveContainer" containerID="42adf2329d7beb1fdf70575c84127b80a7eea7ac42ce6c3be708f378cac5ed59"1929machine # [ 41.707089] dhcpcd[678]: veth0634d5f3: soliciting an IPv6 router1930machine # [ 41.996700] dhcpcd[678]: veth9835a522: probing for an IPv4LL address1931machine # [ 42.593931] systemd[1]: cri-containerd-3a2fe3991f76c22353b9cb09824303cf5cc727282c03fe12e7acaa771f247cf6.scope: Deactivated successfully.1932machine # [ 42.639439] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-3a2fe3991f76c22353b9cb09824303cf5cc727282c03fe12e7acaa771f247cf6-rootfs.mount: Deactivated successfully.1933machine # [ 42.693252] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-3a2fe3991f76c22353b9cb09824303cf5cc727282c03fe12e7acaa771f247cf6-shm.mount: Deactivated successfully.1934machine # [ 42.906588] cni0: port 1(veth9835a522) entered disabled state1935machine # [ 42.753418] dhcpcd[678]: veth9835a522: carrier lost1936machine # [ 42.909111] veth9835a522 (unregistering): left allmulticast mode1937machine # [ 42.910053] veth9835a522 (unregistering): left promiscuous mode1938machine # [ 42.911113] cni0: port 1(veth9835a522) entered disabled state1939machine # [ 42.777328] systemd[1]: run-netns-cni\x2d4d07b45d\x2dfae7\x2d26a5\x2dac04\x2d51b5b6313706.mount: Deactivated successfully.1940machine # [ 42.806879] dhcpcd[678]: veth9835a522: deleting address fe80::f8c7:3eff:fee7:e26d1941machine # [ 42.868543] dhcpcd[678]: veth9835a522: removing interface1942machine # [ 42.908201] k3s[888]: I0919 21:51:00.819981 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6af889d0-df30-4a8f-bec2-a817e1a1d2a2-content\" (UniqueName: \"kubernetes.io/configmap/6af889d0-df30-4a8f-bec2-a817e1a1d2a2-content\") pod \"6af889d0-df30-4a8f-bec2-a817e1a1d2a2\" (UID: \"6af889d0-df30-4a8f-bec2-a817e1a1d2a2\") "1943machine # [ 42.908430] k3s[888]: I0919 21:51:00.820043 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6af889d0-df30-4a8f-bec2-a817e1a1d2a2-tmp\" (UniqueName: \"kubernetes.io/empty-dir/6af889d0-df30-4a8f-bec2-a817e1a1d2a2-tmp\") pod \"6af889d0-df30-4a8f-bec2-a817e1a1d2a2\" (UID: \"6af889d0-df30-4a8f-bec2-a817e1a1d2a2\") "1944machine # [ 42.909101] k3s[888]: I0919 21:51:00.820091 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6af889d0-df30-4a8f-bec2-a817e1a1d2a2-klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/6af889d0-df30-4a8f-bec2-a817e1a1d2a2-klipper-config\") pod \"6af889d0-df30-4a8f-bec2-a817e1a1d2a2\" (UID: \"6af889d0-df30-4a8f-bec2-a817e1a1d2a2\") "1945machine # [ 42.909254] k3s[888]: I0919 21:51:00.820129 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6af889d0-df30-4a8f-bec2-a817e1a1d2a2-kube-api-access-2kjm9\" (UniqueName: \"kubernetes.io/projected/6af889d0-df30-4a8f-bec2-a817e1a1d2a2-kube-api-access-2kjm9\") pod \"6af889d0-df30-4a8f-bec2-a817e1a1d2a2\" (UID: \"6af889d0-df30-4a8f-bec2-a817e1a1d2a2\") "1946machine # [ 42.909343] k3s[888]: I0919 21:51:00.820163 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6af889d0-df30-4a8f-bec2-a817e1a1d2a2-klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/6af889d0-df30-4a8f-bec2-a817e1a1d2a2-klipper-helm\") pod \"6af889d0-df30-4a8f-bec2-a817e1a1d2a2\" (UID: \"6af889d0-df30-4a8f-bec2-a817e1a1d2a2\") "1947machine # [ 42.910344] k3s[888]: I0919 21:51:00.820192 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6af889d0-df30-4a8f-bec2-a817e1a1d2a2-values\" (UniqueName: \"kubernetes.io/projected/6af889d0-df30-4a8f-bec2-a817e1a1d2a2-values\") pod \"6af889d0-df30-4a8f-bec2-a817e1a1d2a2\" (UID: \"6af889d0-df30-4a8f-bec2-a817e1a1d2a2\") "1948machine # [ 42.910853] k3s[888]: I0919 21:51:00.820217 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6af889d0-df30-4a8f-bec2-a817e1a1d2a2-klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/6af889d0-df30-4a8f-bec2-a817e1a1d2a2-klipper-cache\") pod \"6af889d0-df30-4a8f-bec2-a817e1a1d2a2\" (UID: \"6af889d0-df30-4a8f-bec2-a817e1a1d2a2\") "1949machine # [ 42.921917] systemd[1]: var-lib-kubelet-pods-6af889d0\x2ddf30\x2d4a8f\x2dbec2\x2da817e1a1d2a2-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dhelm.mount: Deactivated successfully.1950machine # [ 42.922579] systemd[1]: var-lib-kubelet-pods-6af889d0\x2ddf30\x2d4a8f\x2dbec2\x2da817e1a1d2a2-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dcache.mount: Deactivated successfully.1951machine # [ 42.923317] systemd[1]: var-lib-kubelet-pods-6af889d0\x2ddf30\x2d4a8f\x2dbec2\x2da817e1a1d2a2-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2d2kjm9.mount: Deactivated successfully.1952machine # [ 42.924585] systemd[1]: var-lib-kubelet-pods-6af889d0\x2ddf30\x2d4a8f\x2dbec2\x2da817e1a1d2a2-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dconfig.mount: Deactivated successfully.1953machine # [ 42.925334] systemd[1]: var-lib-kubelet-pods-6af889d0\x2ddf30\x2d4a8f\x2dbec2\x2da817e1a1d2a2-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully.1954machine # [ 42.961476] k3s[888]: I0919 21:51:00.820481 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6af889d0-df30-4a8f-bec2-a817e1a1d2a2-content" pod "6af889d0-df30-4a8f-bec2-a817e1a1d2a2" (UID: "6af889d0-df30-4a8f-bec2-a817e1a1d2a2"). InnerVolumeSpecName "content". PluginName "kubernetes.io/configmap", VolumeGIDValue ""1955machine # [ 42.963924] k3s[888]: I0919 21:51:00.876097 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6af889d0-df30-4a8f-bec2-a817e1a1d2a2-klipper-helm" pod "6af889d0-df30-4a8f-bec2-a817e1a1d2a2" (UID: "6af889d0-df30-4a8f-bec2-a817e1a1d2a2"). InnerVolumeSpecName "klipper-helm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""1956machine # [ 42.973042] k3s[888]: I0919 21:51:00.885043 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6af889d0-df30-4a8f-bec2-a817e1a1d2a2-tmp" pod "6af889d0-df30-4a8f-bec2-a817e1a1d2a2" (UID: "6af889d0-df30-4a8f-bec2-a817e1a1d2a2"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""1957machine # [ 42.973187] k3s[888]: I0919 21:51:00.885133 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6af889d0-df30-4a8f-bec2-a817e1a1d2a2-klipper-config" pod "6af889d0-df30-4a8f-bec2-a817e1a1d2a2" (UID: "6af889d0-df30-4a8f-bec2-a817e1a1d2a2"). InnerVolumeSpecName "klipper-config". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""1958machine # [ 42.975094] k3s[888]: I0919 21:51:00.887145 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6af889d0-df30-4a8f-bec2-a817e1a1d2a2-values" pod "6af889d0-df30-4a8f-bec2-a817e1a1d2a2" (UID: "6af889d0-df30-4a8f-bec2-a817e1a1d2a2"). InnerVolumeSpecName "values". PluginName "kubernetes.io/projected", VolumeGIDValue ""1959machine # [ 42.976301] k3s[888]: I0919 21:51:00.887177 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6af889d0-df30-4a8f-bec2-a817e1a1d2a2-kube-api-access-2kjm9" pod "6af889d0-df30-4a8f-bec2-a817e1a1d2a2" (UID: "6af889d0-df30-4a8f-bec2-a817e1a1d2a2"). InnerVolumeSpecName "kube-api-access-2kjm9". PluginName "kubernetes.io/projected", VolumeGIDValue ""1960machine # [ 42.976815] k3s[888]: I0919 21:51:00.887175 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6af889d0-df30-4a8f-bec2-a817e1a1d2a2-klipper-cache" pod "6af889d0-df30-4a8f-bec2-a817e1a1d2a2" (UID: "6af889d0-df30-4a8f-bec2-a817e1a1d2a2"). InnerVolumeSpecName "klipper-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""1961machine # [ 43.008725] k3s[888]: I0919 21:51:00.920861 888 reconciler_common.go:299] "Volume detached for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/6af889d0-df30-4a8f-bec2-a817e1a1d2a2-klipper-cache\") on node \"machine\" DevicePath \"\""1962machine # [ 43.009225] k3s[888]: I0919 21:51:00.920985 888 reconciler_common.go:299] "Volume detached for volume \"content\" (UniqueName: \"kubernetes.io/configmap/6af889d0-df30-4a8f-bec2-a817e1a1d2a2-content\") on node \"machine\" DevicePath \"\""1963machine # [ 43.009597] k3s[888]: I0919 21:51:00.921012 888 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6af889d0-df30-4a8f-bec2-a817e1a1d2a2-tmp\") on node \"machine\" DevicePath \"\""1964machine # [ 43.010301] k3s[888]: I0919 21:51:00.921032 888 reconciler_common.go:299] "Volume detached for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/6af889d0-df30-4a8f-bec2-a817e1a1d2a2-klipper-config\") on node \"machine\" DevicePath \"\""1965machine # [ 43.010926] k3s[888]: I0919 21:51:00.921049 888 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kjm9\" (UniqueName: \"kubernetes.io/projected/6af889d0-df30-4a8f-bec2-a817e1a1d2a2-kube-api-access-2kjm9\") on node \"machine\" DevicePath \"\""1966machine # [ 43.011831] k3s[888]: I0919 21:51:00.921065 888 reconciler_common.go:299] "Volume detached for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/6af889d0-df30-4a8f-bec2-a817e1a1d2a2-klipper-helm\") on node \"machine\" DevicePath \"\""1967machine # [ 43.012495] k3s[888]: I0919 21:51:00.921079 888 reconciler_common.go:299] "Volume detached for volume \"values\" (UniqueName: \"kubernetes.io/projected/6af889d0-df30-4a8f-bec2-a817e1a1d2a2-values\") on node \"machine\" DevicePath \"\""1968machine # [ 43.576399] k3s[888]: I0919 21:51:01.488524 888 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3a2fe3991f76c22353b9cb09824303cf5cc727282c03fe12e7acaa771f247cf6"1969machine # [ 43.584047] systemd[1]: Removed slice libcontainer container kubepods-burstable-pod6af889d0_df30_4a8f_bec2_a817e1a1d2a2.slice.1970machine # [ 43.586531] systemd[1]: kubepods-burstable-pod6af889d0_df30_4a8f_bec2_a817e1a1d2a2.slice: Consumed 882ms CPU time over 8.202s wall clock time, 34.1M memory peak, 2.8M incoming IP traffic, 142.5K outgoing IP traffic.1971machine # [ 43.614580] k3s[888]: time="2026-09-19T21:51:01Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Suspended Job kube-system/helm-install-nix-grpc-farm for delete" object=kube-system/nix-grpc-farm reason=SuspendJob type=Normal1972machine # [ 43.618527] k3s[888]: time="2026-09-19T21:51:01Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Applying HelmChart from https://%{KUBERNETES_API}%/static/charts/nix-grpc-farm.tgz using Job kube-system/helm-install-nix-grpc-farm " object=kube-system/nix-grpc-farm reason=ApplyJob type=Normal1973machine # [ 43.621818] k3s[888]: time="2026-09-19T21:51:01Z" level=error msg="error syncing 'kube-system/nix-grpc-farm': handler helm-controller-chart-registration: DesiredSet - Replace Wait batch/v1, Kind=Job kube-system/helm-install-nix-grpc-farm for helm-controller-chart-registration kube-system/nix-grpc-farm, requeuing"1974machine # [ 43.639908] systemd[1]: var-lib-kubelet-pods-6af889d0\x2ddf30\x2d4a8f\x2dbec2\x2da817e1a1d2a2-volumes-kubernetes.io\x7eprojected-values.mount: Deactivated successfully.1975machine # [ 43.813280] k3s[888]: time="2026-09-19T21:51:01Z" level=info msg="Imported docker.io/library/nix-grpc-farm:0.1.0"1976machine # [ 43.815327] k3s[888]: time="2026-09-19T21:51:01Z" level=info msg="Tagged docker.io/library/nix-grpc-farm@sha256:50a1b7a436bb4f4524e21d95dde2da5735c12f537f9d4cbd8cda14ea5f5b755f"1977machine # [ 44.130143] k3s[888]: time="2026-09-19T21:51:02Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm.tar in 10.086450093s"1978machine # [ 44.411547] k3s[888]: time="2026-09-19T21:51:02Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Applying HelmChart from https://%{KUBERNETES_API}%/static/charts/nix-grpc-farm.tgz using Job kube-system/helm-install-nix-grpc-farm " object=kube-system/nix-grpc-farm reason=ApplyJob type=Normal1979machine # [ 44.497185] k3s[888]: I0919 21:51:02.409183 888 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6af889d0-df30-4a8f-bec2-a817e1a1d2a2" path="/var/lib/kubelet/pods/6af889d0-df30-4a8f-bec2-a817e1a1d2a2/volumes"1980machine # [ 44.545421] k3s[888]: time="2026-09-19T21:51:02Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Resumed synced Job kube-system/helm-install-nix-grpc-farm" object=kube-system/nix-grpc-farm reason=ResumeJob type=Normal1981machine # [ 44.579957] systemd[1]: Created slice libcontainer container kubepods-burstable-pod0758217b_c7d3_4cab_abc0_35bace80ed3f.slice.1982machine # [ 44.618410] k3s[888]: I0919 21:51:02.530488 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/0758217b-c7d3-4cab-abc0-35bace80ed3f-klipper-helm\") pod \"helm-install-nix-grpc-farm-7fwh5\" (UID: \"0758217b-c7d3-4cab-abc0-35bace80ed3f\") " pod="kube-system/helm-install-nix-grpc-farm-7fwh5"1983machine # [ 44.619365] k3s[888]: I0919 21:51:02.530584 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/0758217b-c7d3-4cab-abc0-35bace80ed3f-klipper-cache\") pod \"helm-install-nix-grpc-farm-7fwh5\" (UID: \"0758217b-c7d3-4cab-abc0-35bace80ed3f\") " pod="kube-system/helm-install-nix-grpc-farm-7fwh5"1984machine # [ 44.620842] k3s[888]: I0919 21:51:02.530641 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/0758217b-c7d3-4cab-abc0-35bace80ed3f-klipper-config\") pod \"helm-install-nix-grpc-farm-7fwh5\" (UID: \"0758217b-c7d3-4cab-abc0-35bace80ed3f\") " pod="kube-system/helm-install-nix-grpc-farm-7fwh5"1985machine # [ 44.622302] k3s[888]: I0919 21:51:02.530853 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0758217b-c7d3-4cab-abc0-35bace80ed3f-tmp\") pod \"helm-install-nix-grpc-farm-7fwh5\" (UID: \"0758217b-c7d3-4cab-abc0-35bace80ed3f\") " pod="kube-system/helm-install-nix-grpc-farm-7fwh5"1986machine # [ 44.623649] k3s[888]: I0919 21:51:02.531053 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"values\" (UniqueName: \"kubernetes.io/projected/0758217b-c7d3-4cab-abc0-35bace80ed3f-values\") pod \"helm-install-nix-grpc-farm-7fwh5\" (UID: \"0758217b-c7d3-4cab-abc0-35bace80ed3f\") " pod="kube-system/helm-install-nix-grpc-farm-7fwh5"1987machine # [ 44.626095] k3s[888]: I0919 21:51:02.531236 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"content\" (UniqueName: \"kubernetes.io/configmap/0758217b-c7d3-4cab-abc0-35bace80ed3f-content\") pod \"helm-install-nix-grpc-farm-7fwh5\" (UID: \"0758217b-c7d3-4cab-abc0-35bace80ed3f\") " pod="kube-system/helm-install-nix-grpc-farm-7fwh5"1988machine # [ 44.627275] k3s[888]: I0919 21:51:02.531300 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fhkf\" (UniqueName: \"kubernetes.io/projected/0758217b-c7d3-4cab-abc0-35bace80ed3f-kube-api-access-5fhkf\") pod \"helm-install-nix-grpc-farm-7fwh5\" (UID: \"0758217b-c7d3-4cab-abc0-35bace80ed3f\") " pod="kube-system/helm-install-nix-grpc-farm-7fwh5"1989machine # [ 45.024750] dhcpcd[678]: veth24fc42c1: probing for an IPv4LL address1990machine # [ 45.384295] cni0: port 1(veth5805111a) entered blocking state1991machine # [ 45.385109] cni0: port 1(veth5805111a) entered disabled state1992machine # [ 45.385875] veth5805111a: entered allmulticast mode1993machine # [ 45.231340] d[ 45.387026] veth5805111a: entered promiscuous mode1994machine # hcpcd[678]: veth0634d5f3: probing for an IPv4LL address1995machine # [ 45.398597] cni0: port 1(veth5805111a) entered blocking state1996machine # [ 45.399905] cni0: port 1(veth5805111a) entered forwarding state1997machine # [ 45.336324] (udev-worker)[2697]: Network interface NamePolicy= disabled on kernel command line.1998machine # [ 45.377570] systemd[1]: Started libcontainer container 0ad5103beb6d5c5004afc6ae321b091d87cfc3f534f81384093eb1dcb098250d.1999machine # [ 45.383457] dhcpcd[678]: veth5805111a: IAID e5:f9:b2:e32000machine # [ 45.384071] dhcpcd[678]: veth5805111a: adding address fe80::d88c:e5ff:fef9:b2e32001machine # [ 45.509398] systemd[1]: Started libcontainer container 4351329d12bf235a6e0e14466a1ea91b70fa89db4708da7d911e4308320eabaf.2002machine # [ 45.606762] k3s[888]: I0919 21:51:03.518509 888 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/helm-install-nix-grpc-farm-7fwh5" podStartSLOduration=1.518473572 podStartE2EDuration="1.518473572s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 21:51:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 21:51:03.518243934 +0000 UTC m=+24.308483618" watchObservedRunningTime="2026-09-19 21:51:03.518473572 +0000 UTC m=+24.308713256"2003machine # [ 45.699833] dhcpcd[678]: flannel.1: using IPv4LL address 169.254.39.2272004machine # [ 45.700972] dhcpcd[678]: flannel.1: adding route to 169.254.0.0/162005machine # [ 46.299228] dhcpcd[678]: veth51b182f7: probing for an IPv4LL address2006machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 15.00 seconds)2007machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s2008machine # [ 46.793319] dhcpcd[678]: vethbb0eec57: using IPv4LL address 169.254.23.1552009machine # [ 46.795832] dhcpcd[678]: vethbb0eec57: adding route to 169.254.0.0/162010machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found2011machine # [ 46.992955] dhcpcd[678]: veth5805111a: soliciting a DHCP lease2012machine # [ 47.655098] dhcpcd[678]: veth5805111a: soliciting an IPv6 router2013machine # [ 47.706302] systemd[1]: cri-containerd-71a89eaa5a6a3af658c2e30ea73cfdad6a31d8070bef967fb30d7b5d601c1364.scope: Deactivated successfully.2014machine # [ 47.715173] systemd[1]: cri-containerd-03c08de02ba1ea865e8d946347eea9da5b7d8f62145c8bbfc1d0f091cfb25a00.scope: Deactivated successfully.2015machine # [ 47.722274] systemd[1]: cri-containerd-1fc183832826354e6344bd46020c1939f04cb02c0cc64ca20400058c13531ea1.scope: Deactivated successfully.2016machine # [ 47.722884] systemd[1]: cri-containerd-1fc183832826354e6344bd46020c1939f04cb02c0cc64ca20400058c13531ea1.scope: Consumed 136ms CPU time over 7.531s wall clock time, 15.2M memory peak, 3.9K incoming IP traffic, 4.9K outgoing IP traffic.2017machine # [ 47.761098] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-71a89eaa5a6a3af658c2e30ea73cfdad6a31d8070bef967fb30d7b5d601c1364-rootfs.mount: Deactivated successfully.2018machine # [ 47.769217] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-03c08de02ba1ea865e8d946347eea9da5b7d8f62145c8bbfc1d0f091cfb25a00-rootfs.mount: Deactivated successfully.2019machine # [ 47.773154] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-1fc183832826354e6344bd46020c1939f04cb02c0cc64ca20400058c13531ea1-rootfs.mount: Deactivated successfully.2020machine # [ 47.802345] systemd[1]: cri-containerd-cabb35715f0ceb231ccae67195e7ce870747f765c4628879ac714a1032c2862d.scope: Deactivated successfully.2021machine # [ 47.810608] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-71a89eaa5a6a3af658c2e30ea73cfdad6a31d8070bef967fb30d7b5d601c1364-shm.mount: Deactivated successfully.2022machine # [ 47.812256] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-03c08de02ba1ea865e8d946347eea9da5b7d8f62145c8bbfc1d0f091cfb25a00-shm.mount: Deactivated successfully.2023machine # [ 48.026618] cni0: port 5(veth51b182f7) entered disabled state2024machine # [ 47.873283] dhcpcd[678]: veth51b182f7: carrier lost2025machine # [ 48.029579] veth51b182f7 (unregistering): left allmulticast mode2026machine # [ 48.031189] veth51b182f7 (unregistering): left promiscuous mode2027machine # [ 48.032588] cni0: port 5(veth51b182f7) entered disabled state2028machine # [ 48.035938] cni0: port 3(veth24fc42c1) entered disabled state2029machine # [ 48.037889] veth24fc42c1 (unregistering): left allmulticast mode2030machine # [ 48.039540] veth24fc42c1 (unregistering): left promiscuous mode2031machine # [ 48.040807] cni0: port 3(veth24fc42c1) entered disabled state2032machine # [ 47.931439] dhcpcd[678]: veth51b182f7: deleting address fe80::74a8:3eff:fe1c:f5342033machine # [ 48.117558] cni0: port 4(veth0634d5f3) entered disabled state2034machine # [ 48.119710] veth0634d5f3 (unregistering): left allmulticast mode2035machine # [ 48.121142] veth0634d5f3 (unregistering): left promiscuous mode2036machine # [ 48.122568] cni0: port 4(veth0634d5f3) entered disabled state2037machine # [ 48.014552] dhcpcd[678]: veth51b182f7: removing interface2038machine # [ 48.044869] k3s[888]: I0919 21:51:05.956739 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6e0d5d2b-c212-493b-9c2a-24493642fb0b-niks3-token\" (UniqueName: \"kubernetes.io/projected/6e0d5d2b-c212-493b-9c2a-24493642fb0b-niks3-token\") pod \"6e0d5d2b-c212-493b-9c2a-24493642fb0b\" (UID: \"6e0d5d2b-c212-493b-9c2a-24493642fb0b\") "2039machine # [ 48.045095] k3s[888]: I0919 21:51:05.956802 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/db834e5c-50e5-486c-9843-f58007a3dfe0-kube-api-access-m2nc6\" (UniqueName: \"kubernetes.io/projected/db834e5c-50e5-486c-9843-f58007a3dfe0-kube-api-access-m2nc6\") pod \"db834e5c-50e5-486c-9843-f58007a3dfe0\" (UID: \"db834e5c-50e5-486c-9843-f58007a3dfe0\") "2040machine # [ 48.045527] k3s[888]: I0919 21:51:05.956846 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/db834e5c-50e5-486c-9843-f58007a3dfe0-nix\" (UniqueName: \"kubernetes.io/empty-dir/db834e5c-50e5-486c-9843-f58007a3dfe0-nix\") pod \"db834e5c-50e5-486c-9843-f58007a3dfe0\" (UID: \"db834e5c-50e5-486c-9843-f58007a3dfe0\") "2041machine # [ 48.046048] k3s[888]: I0919 21:51:05.956883 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/db834e5c-50e5-486c-9843-f58007a3dfe0-nixconf\" (UniqueName: \"kubernetes.io/configmap/db834e5c-50e5-486c-9843-f58007a3dfe0-nixconf\") pod \"db834e5c-50e5-486c-9843-f58007a3dfe0\" (UID: \"db834e5c-50e5-486c-9843-f58007a3dfe0\") "2042machine # [ 48.046536] k3s[888]: I0919 21:51:05.956917 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/db834e5c-50e5-486c-9843-f58007a3dfe0-ca\" (UniqueName: \"kubernetes.io/secret/db834e5c-50e5-486c-9843-f58007a3dfe0-ca\") pod \"db834e5c-50e5-486c-9843-f58007a3dfe0\" (UID: \"db834e5c-50e5-486c-9843-f58007a3dfe0\") "2043machine # [ 48.047527] k3s[888]: I0919 21:51:05.956949 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6e0d5d2b-c212-493b-9c2a-24493642fb0b-nixconf\" (UniqueName: \"kubernetes.io/configmap/6e0d5d2b-c212-493b-9c2a-24493642fb0b-nixconf\") pod \"6e0d5d2b-c212-493b-9c2a-24493642fb0b\" (UID: \"6e0d5d2b-c212-493b-9c2a-24493642fb0b\") "2044machine # [ 48.047710] k3s[888]: I0919 21:51:05.956982 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/db834e5c-50e5-486c-9843-f58007a3dfe0-oidc\" (UniqueName: \"kubernetes.io/secret/db834e5c-50e5-486c-9843-f58007a3dfe0-oidc\") pod \"db834e5c-50e5-486c-9843-f58007a3dfe0\" (UID: \"db834e5c-50e5-486c-9843-f58007a3dfe0\") "2045machine # [ 48.049040] k3s[888]: I0919 21:51:05.957008 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6e0d5d2b-c212-493b-9c2a-24493642fb0b-build\" (UniqueName: \"kubernetes.io/empty-dir/6e0d5d2b-c212-493b-9c2a-24493642fb0b-build\") pod \"6e0d5d2b-c212-493b-9c2a-24493642fb0b\" (UID: \"6e0d5d2b-c212-493b-9c2a-24493642fb0b\") "2046machine # [ 48.049713] k3s[888]: I0919 21:51:05.957039 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/db834e5c-50e5-486c-9843-f58007a3dfe0-niks3-token\" (UniqueName: \"kubernetes.io/projected/db834e5c-50e5-486c-9843-f58007a3dfe0-niks3-token\") pod \"db834e5c-50e5-486c-9843-f58007a3dfe0\" (UID: \"db834e5c-50e5-486c-9843-f58007a3dfe0\") "2047machine # [ 48.050464] k3s[888]: I0919 21:51:05.957072 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/db834e5c-50e5-486c-9843-f58007a3dfe0-tls\" (UniqueName: \"kubernetes.io/secret/db834e5c-50e5-486c-9843-f58007a3dfe0-tls\") pod \"db834e5c-50e5-486c-9843-f58007a3dfe0\" (UID: \"db834e5c-50e5-486c-9843-f58007a3dfe0\") "2048machine # [ 48.051140] k3s[888]: I0919 21:51:05.957098 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6e0d5d2b-c212-493b-9c2a-24493642fb0b-ca\" (UniqueName: \"kubernetes.io/secret/6e0d5d2b-c212-493b-9c2a-24493642fb0b-ca\") pod \"6e0d5d2b-c212-493b-9c2a-24493642fb0b\" (UID: \"6e0d5d2b-c212-493b-9c2a-24493642fb0b\") "2049machine # [ 48.052095] k3s[888]: I0919 21:51:05.957134 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6e0d5d2b-c212-493b-9c2a-24493642fb0b-oidc\" (UniqueName: \"kubernetes.io/secret/6e0d5d2b-c212-493b-9c2a-24493642fb0b-oidc\") pod \"6e0d5d2b-c212-493b-9c2a-24493642fb0b\" (UID: \"6e0d5d2b-c212-493b-9c2a-24493642fb0b\") "2050machine # [ 48.052804] k3s[888]: I0919 21:51:05.963081 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e0d5d2b-c212-493b-9c2a-24493642fb0b-nixconf" pod "6e0d5d2b-c212-493b-9c2a-24493642fb0b" (UID: "6e0d5d2b-c212-493b-9c2a-24493642fb0b"). InnerVolumeSpecName "nixconf". PluginName "kubernetes.io/configmap", VolumeGIDValue ""2051machine # [ 48.059189] k3s[888]: I0919 21:51:05.970547 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e0d5d2b-c212-493b-9c2a-24493642fb0b-build" pod "6e0d5d2b-c212-493b-9c2a-24493642fb0b" (UID: "6e0d5d2b-c212-493b-9c2a-24493642fb0b"). InnerVolumeSpecName "build". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""2052machine # [ 48.124077] dhcpcd[678]: dhcp_readbpf: unexpected event 0x01002053machine # [ 48.124915] k3s[888]: I0919 21:51:05.985477 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db834e5c-50e5-486c-9843-f58007a3dfe0-nix" pod "db834e5c-50e5-486c-9843-f58007a3dfe0" (UID: "db834e5c-50e5-486c-9843-f58007a3dfe0"). InnerVolumeSpecName "nix". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""2054machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found2055machine # [ 48.125899] k3s[888]: I0919 21:51:05.985573 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db834e5c-50e5-486c-9843-f58007a3dfe0-nixconf" pod "db834e5c-50e5-486c-9843-f58007a3dfe0" (UID: "db834e5c-50e5-486c-9843-f58007a3dfe0"). InnerVolumeSpecName "nixconf". PluginName "kubernetes.io/configmap", VolumeGIDValue ""2056machine # [ 48.127274] dhcpcd[678]: dhcp_readbpf: veth24fc42c1: Network is down2057machine # [ 48.138938] k3s[888]: I0919 21:51:06.050987 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6e0d5d2b-c212-493b-9c2a-24493642fb0b-tls\" (UniqueName: \"kubernetes.io/secret/6e0d5d2b-c212-493b-9c2a-24493642fb0b-tls\") pod \"6e0d5d2b-c212-493b-9c2a-24493642fb0b\" (UID: \"6e0d5d2b-c212-493b-9c2a-24493642fb0b\") "2058machine # [ 48.139551] k3s[888]: I0919 21:51:06.051142 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6e0d5d2b-c212-493b-9c2a-24493642fb0b-kube-api-access-r886n\" (UniqueName: \"kubernetes.io/projected/6e0d5d2b-c212-493b-9c2a-24493642fb0b-kube-api-access-r886n\") pod \"6e0d5d2b-c212-493b-9c2a-24493642fb0b\" (UID: \"6e0d5d2b-c212-493b-9c2a-24493642fb0b\") "2059machine # [ 48.141432] k3s[888]: I0919 21:51:06.051177 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/66cc6219-28e0-4b00-bee9-b4a4f7388ec5-config\" (UniqueName: \"kubernetes.io/configmap/66cc6219-28e0-4b00-bee9-b4a4f7388ec5-config\") pod \"66cc6219-28e0-4b00-bee9-b4a4f7388ec5\" (UID: \"66cc6219-28e0-4b00-bee9-b4a4f7388ec5\") "2060machine # [ 48.143602] k3s[888]: I0919 21:51:06.051210 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6e0d5d2b-c212-493b-9c2a-24493642fb0b-nix\" (UniqueName: \"kubernetes.io/empty-dir/6e0d5d2b-c212-493b-9c2a-24493642fb0b-nix\") pod \"6e0d5d2b-c212-493b-9c2a-24493642fb0b\" (UID: \"6e0d5d2b-c212-493b-9c2a-24493642fb0b\") "2061machine # [ 48.145142] k3s[888]: I0919 21:51:06.051237 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/db834e5c-50e5-486c-9843-f58007a3dfe0-build\" (UniqueName: \"kubernetes.io/empty-dir/db834e5c-50e5-486c-9843-f58007a3dfe0-build\") pod \"db834e5c-50e5-486c-9843-f58007a3dfe0\" (UID: \"db834e5c-50e5-486c-9843-f58007a3dfe0\") "2062machine # [ 48.146810] k3s[888]: I0919 21:51:06.051337 888 reconciler_common.go:299] "Volume detached for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/db834e5c-50e5-486c-9843-f58007a3dfe0-nix\") on node \"machine\" DevicePath \"\""2063machine # [ 48.147945] k3s[888]: I0919 21:51:06.051354 888 reconciler_common.go:299] "Volume detached for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/db834e5c-50e5-486c-9843-f58007a3dfe0-nixconf\") on node \"machine\" DevicePath \"\""2064machine # [ 48.178184] k3s[888]: I0919 21:51:06.090325 888 reconciler_common.go:299] "Volume detached for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/6e0d5d2b-c212-493b-9c2a-24493642fb0b-nixconf\") on node \"machine\" DevicePath \"\""2065machine # [ 48.182594] k3s[888]: I0919 21:51:06.094673 888 reconciler_common.go:299] "Volume detached for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/6e0d5d2b-c212-493b-9c2a-24493642fb0b-build\") on node \"machine\" DevicePath \"\""2066machine # [ 48.183051] k3s[888]: I0919 21:51:06.053834 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e0d5d2b-c212-493b-9c2a-24493642fb0b-nix" pod "6e0d5d2b-c212-493b-9c2a-24493642fb0b" (UID: "6e0d5d2b-c212-493b-9c2a-24493642fb0b"). InnerVolumeSpecName "nix". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""2067machine # [ 48.183536] k3s[888]: I0919 21:51:06.053982 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db834e5c-50e5-486c-9843-f58007a3dfe0-build" pod "db834e5c-50e5-486c-9843-f58007a3dfe0" (UID: "db834e5c-50e5-486c-9843-f58007a3dfe0"). InnerVolumeSpecName "build". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""2068machine # [ 48.185198] k3s[888]: I0919 21:51:06.054151 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db834e5c-50e5-486c-9843-f58007a3dfe0-ca" pod "db834e5c-50e5-486c-9843-f58007a3dfe0" (UID: "db834e5c-50e5-486c-9843-f58007a3dfe0"). InnerVolumeSpecName "ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""2069machine # [ 48.186179] k3s[888]: I0919 21:51:06.054226 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e0d5d2b-c212-493b-9c2a-24493642fb0b-niks3-token" pod "6e0d5d2b-c212-493b-9c2a-24493642fb0b" (UID: "6e0d5d2b-c212-493b-9c2a-24493642fb0b"). InnerVolumeSpecName "niks3-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""2070machine # [ 48.187522] k3s[888]: I0919 21:51:06.054446 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db834e5c-50e5-486c-9843-f58007a3dfe0-niks3-token" pod "db834e5c-50e5-486c-9843-f58007a3dfe0" (UID: "db834e5c-50e5-486c-9843-f58007a3dfe0"). InnerVolumeSpecName "niks3-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""2071machine # [ 48.188455] k3s[888]: I0919 21:51:06.054572 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db834e5c-50e5-486c-9843-f58007a3dfe0-kube-api-access-m2nc6" pod "db834e5c-50e5-486c-9843-f58007a3dfe0" (UID: "db834e5c-50e5-486c-9843-f58007a3dfe0"). InnerVolumeSpecName "kube-api-access-m2nc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""2072machine # [ 48.189089] k3s[888]: I0919 21:51:06.054619 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e0d5d2b-c212-493b-9c2a-24493642fb0b-oidc" pod "6e0d5d2b-c212-493b-9c2a-24493642fb0b" (UID: "6e0d5d2b-c212-493b-9c2a-24493642fb0b"). InnerVolumeSpecName "oidc". PluginName "kubernetes.io/secret", VolumeGIDValue ""2073machine # [ 48.195178] dhcpcd[678]: arp_read: unexpected event 0x01002074machine # [ 48.196609] dhcpcd[678]: arp_read: veth24fc42c1: Network is down2075machine # [ 48.199718] k3s[888]: I0919 21:51:06.111833 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66cc6219-28e0-4b00-bee9-b4a4f7388ec5-config" pod "66cc6219-28e0-4b00-bee9-b4a4f7388ec5" (UID: "66cc6219-28e0-4b00-bee9-b4a4f7388ec5"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""2076machine # [ 48.235988] k3s[888]: I0919 21:51:06.054664 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db834e5c-50e5-486c-9843-f58007a3dfe0-tls" pod "db834e5c-50e5-486c-9843-f58007a3dfe0" (UID: "db834e5c-50e5-486c-9843-f58007a3dfe0"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""2077machine # [ 48.241931] k3s[888]: I0919 21:51:06.054692 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e0d5d2b-c212-493b-9c2a-24493642fb0b-tls" pod "6e0d5d2b-c212-493b-9c2a-24493642fb0b" (UID: "6e0d5d2b-c212-493b-9c2a-24493642fb0b"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""2078machine # [ 48.242287] k3s[888]: I0919 21:51:06.054808 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db834e5c-50e5-486c-9843-f58007a3dfe0-oidc" pod "db834e5c-50e5-486c-9843-f58007a3dfe0" (UID: "db834e5c-50e5-486c-9843-f58007a3dfe0"). InnerVolumeSpecName "oidc". PluginName "kubernetes.io/secret", VolumeGIDValue ""2079machine # [ 48.242922] k3s[888]: I0919 21:51:06.054880 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e0d5d2b-c212-493b-9c2a-24493642fb0b-ca" pod "6e0d5d2b-c212-493b-9c2a-24493642fb0b" (UID: "6e0d5d2b-c212-493b-9c2a-24493642fb0b"). InnerVolumeSpecName "ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""2080machine # [ 48.243597] k3s[888]: I0919 21:51:06.094464 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e0d5d2b-c212-493b-9c2a-24493642fb0b-kube-api-access-r886n" pod "6e0d5d2b-c212-493b-9c2a-24493642fb0b" (UID: "6e0d5d2b-c212-493b-9c2a-24493642fb0b"). InnerVolumeSpecName "kube-api-access-r886n". PluginName "kubernetes.io/projected", VolumeGIDValue ""2081machine # [ 48.244495] dhcpcd[678]: arp_probe1: No such device or address2082machine # [ 48.245430] dhcpcd[678]: dhcp_readbpf: unexpected event 0x01002083machine # [ 48.246252] dhcpcd[678]: dhcp_readbpf: veth0634d5f3: Network is down2084machine # [ 48.263210] dhcpcd[678]: arp_read: unexpected event 0x01002085machine # [ 48.263677] dhcpcd[678]: arp_read: veth0634d5f3: Network is down2086machine # [ 48.271341] dhcpcd[678]: veth24fc42c1: removing interface2087machine # [ 48.271550] dhcpcd[678]: veth24fc42c1: deleting address fe80::60d6:4fff:fee6:e0442088machine # [ 48.282926] k3s[888]: I0919 21:51:06.195070 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/66cc6219-28e0-4b00-bee9-b4a4f7388ec5-tls-lb\" (UniqueName: \"kubernetes.io/secret/66cc6219-28e0-4b00-bee9-b4a4f7388ec5-tls-lb\") pod \"66cc6219-28e0-4b00-bee9-b4a4f7388ec5\" (UID: \"66cc6219-28e0-4b00-bee9-b4a4f7388ec5\") "2089machine # [ 48.283110] k3s[888]: I0919 21:51:06.195123 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/66cc6219-28e0-4b00-bee9-b4a4f7388ec5-tls-ca\" (UniqueName: \"kubernetes.io/secret/66cc6219-28e0-4b00-bee9-b4a4f7388ec5-tls-ca\") pod \"66cc6219-28e0-4b00-bee9-b4a4f7388ec5\" (UID: \"66cc6219-28e0-4b00-bee9-b4a4f7388ec5\") "2090machine # [ 48.283813] k3s[888]: I0919 21:51:06.195162 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66cc6219-28e0-4b00-bee9-b4a4f7388ec5-tmp\" (UniqueName: \"kubernetes.io/empty-dir/66cc6219-28e0-4b00-bee9-b4a4f7388ec5-tmp\") pod \"66cc6219-28e0-4b00-bee9-b4a4f7388ec5\" (UID: \"66cc6219-28e0-4b00-bee9-b4a4f7388ec5\") "2091machine # [ 48.285617] k3s[888]: I0919 21:51:06.195205 888 reconciler_common.go:299] "Volume detached for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/db834e5c-50e5-486c-9843-f58007a3dfe0-oidc\") on node \"machine\" DevicePath \"\""2092machine # [ 48.287984] k3s[888]: I0919 21:51:06.195221 888 reconciler_common.go:299] "Volume detached for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/db834e5c-50e5-486c-9843-f58007a3dfe0-niks3-token\") on node \"machine\" DevicePath \"\""2093machine # [ 48.289937] k3s[888]: I0919 21:51:06.195236 888 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/db834e5c-50e5-486c-9843-f58007a3dfe0-tls\") on node \"machine\" DevicePath \"\""2094machine # [ 48.291082] k3s[888]: I0919 21:51:06.195249 888 reconciler_common.go:299] "Volume detached for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6e0d5d2b-c212-493b-9c2a-24493642fb0b-ca\") on node \"machine\" DevicePath \"\""2095machine # [ 48.293918] k3s[888]: I0919 21:51:06.195286 888 reconciler_common.go:299] "Volume detached for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/6e0d5d2b-c212-493b-9c2a-24493642fb0b-oidc\") on node \"machine\" DevicePath \"\""2096machine # [ 48.294395] k3s[888]: I0919 21:51:06.195298 888 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/6e0d5d2b-c212-493b-9c2a-24493642fb0b-tls\") on node \"machine\" DevicePath \"\""2097machine # [ 48.295053] k3s[888]: I0919 21:51:06.195318 888 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r886n\" (UniqueName: \"kubernetes.io/projected/6e0d5d2b-c212-493b-9c2a-24493642fb0b-kube-api-access-r886n\") on node \"machine\" DevicePath \"\""2098machine # [ 48.295736] k3s[888]: I0919 21:51:06.195331 888 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/66cc6219-28e0-4b00-bee9-b4a4f7388ec5-config\") on node \"machine\" DevicePath \"\""2099machine # [ 48.297172] k3s[888]: I0919 21:51:06.195344 888 reconciler_common.go:299] "Volume detached for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/6e0d5d2b-c212-493b-9c2a-24493642fb0b-nix\") on node \"machine\" DevicePath \"\""2100machine # [ 48.298231] k3s[888]: I0919 21:51:06.195355 888 reconciler_common.go:299] "Volume detached for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/db834e5c-50e5-486c-9843-f58007a3dfe0-build\") on node \"machine\" DevicePath \"\""2101machine # [ 48.299133] k3s[888]: I0919 21:51:06.195367 888 reconciler_common.go:299] "Volume detached for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/6e0d5d2b-c212-493b-9c2a-24493642fb0b-niks3-token\") on node \"machine\" DevicePath \"\""2102machine # [ 48.300042] k3s[888]: I0919 21:51:06.195380 888 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2nc6\" (UniqueName: \"kubernetes.io/projected/db834e5c-50e5-486c-9843-f58007a3dfe0-kube-api-access-m2nc6\") on node \"machine\" DevicePath \"\""2103machine # [ 48.300948] k3s[888]: I0919 21:51:06.195392 888 reconciler_common.go:299] "Volume detached for volume \"ca\" (UniqueName: \"kubernetes.io/secret/db834e5c-50e5-486c-9843-f58007a3dfe0-ca\") on node \"machine\" DevicePath \"\""2104machine # [ 48.350469] k3s[888]: I0919 21:51:06.262568 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66cc6219-28e0-4b00-bee9-b4a4f7388ec5-tls-ca" pod "66cc6219-28e0-4b00-bee9-b4a4f7388ec5" (UID: "66cc6219-28e0-4b00-bee9-b4a4f7388ec5"). InnerVolumeSpecName "tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""2105machine # [ 48.351250] k3s[888]: I0919 21:51:06.263363 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66cc6219-28e0-4b00-bee9-b4a4f7388ec5-tmp" pod "66cc6219-28e0-4b00-bee9-b4a4f7388ec5" (UID: "66cc6219-28e0-4b00-bee9-b4a4f7388ec5"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""2106machine # [ 48.362132] k3s[888]: I0919 21:51:06.274310 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66cc6219-28e0-4b00-bee9-b4a4f7388ec5-tls-lb" pod "66cc6219-28e0-4b00-bee9-b4a4f7388ec5" (UID: "66cc6219-28e0-4b00-bee9-b4a4f7388ec5"). InnerVolumeSpecName "tls-lb". PluginName "kubernetes.io/secret", VolumeGIDValue ""2107machine # [ 48.384289] k3s[888]: I0919 21:51:06.296433 888 reconciler_common.go:299] "Volume detached for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/66cc6219-28e0-4b00-bee9-b4a4f7388ec5-tls-lb\") on node \"machine\" DevicePath \"\""2108machine # [ 48.384512] k3s[888]: I0919 21:51:06.296464 888 reconciler_common.go:299] "Volume detached for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/66cc6219-28e0-4b00-bee9-b4a4f7388ec5-tls-ca\") on node \"machine\" DevicePath \"\""2109machine # [ 48.384647] k3s[888]: I0919 21:51:06.296477 888 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66cc6219-28e0-4b00-bee9-b4a4f7388ec5-tmp\") on node \"machine\" DevicePath \"\""2110machine # [ 48.399700] dhcpcd[678]: veth0634d5f3: removing interface2111machine # [ 48.400081] dhcpcd[678]: veth0634d5f3: deleting address fe80::e877:3ff:fe63:cdb12112machine # [ 48.501797] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod66cc6219_28e0_4b00_bee9_b4a4f7388ec5.slice.2113machine # [ 48.502132] systemd[1]: kubepods-besteffort-pod66cc6219_28e0_4b00_bee9_b4a4f7388ec5.slice: Consumed 180ms CPU time over 9.536s wall clock time, 15.4M memory peak, 3.9K incoming IP traffic, 4.9K outgoing IP traffic.2114machine # [ 48.503709] systemd[1]: Removed slice libcontainer container kubepods-besteffort-poddb834e5c_50e5_486c_9843_f58007a3dfe0.slice.2115machine # [ 48.506433] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod6e0d5d2b_c212_493b_9c2a_24493642fb0b.slice.2116machine # [ 48.614715] k3s[888]: I0919 21:51:06.526105 888 scope.go:122] "RemoveContainer" containerID="1fc183832826354e6344bd46020c1939f04cb02c0cc64ca20400058c13531ea1"2117machine # [ 48.632037] k3s[888]: I0919 21:51:06.542508 888 scope.go:122] "RemoveContainer" containerID="1fc183832826354e6344bd46020c1939f04cb02c0cc64ca20400058c13531ea1"2118machine # [ 48.632905] k3s[888]: E0919 21:51:06.545116 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"1fc183832826354e6344bd46020c1939f04cb02c0cc64ca20400058c13531ea1\": not found" containerID="1fc183832826354e6344bd46020c1939f04cb02c0cc64ca20400058c13531ea1"2119machine # [ 48.633845] k3s[888]: I0919 21:51:06.545966 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"1fc183832826354e6344bd46020c1939f04cb02c0cc64ca20400058c13531ea1"} err="failed to get container status \"1fc183832826354e6344bd46020c1939f04cb02c0cc64ca20400058c13531ea1\": rpc error: code = NotFound desc = an error occurred when try to find container \"1fc183832826354e6344bd46020c1939f04cb02c0cc64ca20400058c13531ea1\": not found"2120machine # [ 48.761490] systemd[1]: var-lib-kubelet-pods-66cc6219\x2d28e0\x2d4b00\x2dbee9\x2db4a4f7388ec5-volume\x2dsubpaths-config-envoy-0.mount: Deactivated successfully.2121machine # [ 48.761714] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-cabb35715f0ceb231ccae67195e7ce870747f765c4628879ac714a1032c2862d-rootfs.mount: Deactivated successfully.2122machine # [ 48.761883] systemd[1]: run-netns-cni\x2d930731c6\x2d5d65\x2d41cb\x2da261\x2db0efede6f1c0.mount: Deactivated successfully.2123machine # [ 48.762552] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-cabb35715f0ceb231ccae67195e7ce870747f765c4628879ac714a1032c2862d-shm.mount: Deactivated successfully.2124machine # [ 48.762886] systemd[1]: var-lib-kubelet-pods-db834e5c\x2d50e5\x2d486c\x2d9843\x2df58007a3dfe0-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dm2nc6.mount: Deactivated successfully.2125machine # [ 48.771188] systemd[1]: var-lib-kubelet-pods-db834e5c\x2d50e5\x2d486c\x2d9843\x2df58007a3dfe0-volumes-kubernetes.io\x7esecret-tls.mount: Deactivated successfully.2126machine # [ 48.771538] systemd[1]: var-lib-kubelet-pods-db834e5c\x2d50e5\x2d486c\x2d9843\x2df58007a3dfe0-volumes-kubernetes.io\x7eprojected-niks3\x2dtoken.mount: Deactivated successfully.2127machine # [ 48.771750] systemd[1]: run-netns-cni\x2d9d59e48d\x2d1fef\x2d4111\x2dfaf5\x2d4ca255dd3ba8.mount: Deactivated successfully.2128machine # [ 48.772908] systemd[1]: var-lib-kubelet-pods-db834e5c\x2d50e5\x2d486c\x2d9843\x2df58007a3dfe0-volumes-kubernetes.io\x7esecret-oidc.mount: Deactivated successfully.2129machine # [ 48.773634] systemd[1]: var-lib-kubelet-pods-db834e5c\x2d50e5\x2d486c\x2d9843\x2df58007a3dfe0-volumes-kubernetes.io\x7esecret-ca.mount: Deactivated successfully.2130machine # [ 48.774279] systemd[1]: run-netns-cni\x2d18d88491\x2d3876\x2d2a7e\x2d840b\x2de5570d6283e5.mount: Deactivated successfully.2131machine # [ 48.774679] systemd[1]: var-lib-kubelet-pods-6e0d5d2b\x2dc212\x2d493b\x2d9c2a\x2d24493642fb0b-volumes-kubernetes.io\x7eprojected-niks3\x2dtoken.mount: Deactivated successfully.2132machine # [ 48.774908] systemd[1]: var-lib-kubelet-pods-6e0d5d2b\x2dc212\x2d493b\x2d9c2a\x2d24493642fb0b-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dr886n.mount: Deactivated successfully.2133machine # [ 48.775737] systemd[1]: var-lib-kubelet-pods-66cc6219\x2d28e0\x2d4b00\x2dbee9\x2db4a4f7388ec5-volumes-kubernetes.io\x7esecret-tls\x2dlb.mount: Deactivated successfully.2134machine # [ 48.775971] systemd[1]: var-lib-kubelet-pods-6e0d5d2b\x2dc212\x2d493b\x2d9c2a\x2d24493642fb0b-volumes-kubernetes.io\x7esecret-oidc.mount: Deactivated successfully.2135machine # [ 48.776771] systemd[1]: var-lib-kubelet-pods-6e0d5d2b\x2dc212\x2d493b\x2d9c2a\x2d24493642fb0b-volumes-kubernetes.io\x7esecret-tls.mount: Deactivated successfully.2136machine # [ 48.776996] systemd[1]: var-lib-kubelet-pods-66cc6219\x2d28e0\x2d4b00\x2dbee9\x2db4a4f7388ec5-volumes-kubernetes.io\x7esecret-tls\x2dca.mount: Deactivated successfully.2137machine # [ 48.777428] systemd[1]: var-lib-kubelet-pods-66cc6219\x2d28e0\x2d4b00\x2dbee9\x2db4a4f7388ec5-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully.2138machine # [ 48.778037] systemd[1]: var-lib-kubelet-pods-6e0d5d2b\x2dc212\x2d493b\x2d9c2a\x2d24493642fb0b-volumes-kubernetes.io\x7esecret-ca.mount: Deactivated successfully.2139machine # [ 48.907135] k3s[888]: E0919 21:51:06.819283 888 status.go:71] "Unhandled Error" err="apiserver received an error that is not an metav1.Status: &errors.errorString{s:\"failed to create typed patch object (farm/nix-grpc-farm-scheduler; /v1, Kind=Service): .spec.selector.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}\"}: failed to create typed patch object (farm/nix-grpc-farm-scheduler; /v1, Kind=Service): .spec.selector.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}" logger="UnhandledError"2140machine # [ 48.923288] k3s[888]: I0919 21:51:06.835452 888 alloc.go:329] "allocated clusterIPs" service="farm/nix-grpc-farm" clusterIPs={"IPv4":"10.43.68.72"}2141machine # [ 48.940843] k3s[888]: E0919 21:51:06.851874 888 status.go:71] "Unhandled Error" err=<2142machine # [ 48.942355] k3s[888]: apiserver received an error that is not an metav1.Status: &errors.errorString{s:"failed to create typed patch object (farm/nix-grpc-farm-scheduler; apps/v1, Kind=Deployment): errors:\n .spec.selector.matchLabels.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}\n .spec.template.metadata.labels.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}"}: failed to create typed patch object (farm/nix-grpc-farm-scheduler; apps/v1, Kind=Deployment): errors:2143machine # [ 48.948948] k3s[888]: .spec.selector.matchLabels.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}2144machine # [ 48.951110] k3s[888]: .spec.template.metadata.labels.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}2145machine # [ 48.953219] k3s[888]: > logger="UnhandledError"2146machine # [ 48.966094] systemd[1]: cri-containerd-4351329d12bf235a6e0e14466a1ea91b70fa89db4708da7d911e4308320eabaf.scope: Deactivated successfully.2147machine # [ 48.968214] systemd[1]: cri-containerd-4351329d12bf235a6e0e14466a1ea91b70fa89db4708da7d911e4308320eabaf.scope: Consumed 1.059s CPU time over 3.456s wall clock time, 31.7M memory peak, 3.3M incoming IP traffic, 198.8K outgoing IP traffic.2148machine # [ 49.001574] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod3884ab8e_abae_4dfb_b47c_fc022975d75a.slice.2149machine # [ 49.021149] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod7d6f2ed9_d9ee_455a_b80b_32f88927d8fc.slice.2150machine # [ 49.039105] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod147062f0_7fb1_4989_80d8_c05198f2e383.slice.2151machine # [ 49.046510] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-4351329d12bf235a6e0e14466a1ea91b70fa89db4708da7d911e4308320eabaf-rootfs.mount: Deactivated successfully.2152machine # [ 49.089665] k3s[888]: I0919 21:51:07.001455 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx27c\" (UniqueName: \"kubernetes.io/projected/147062f0-7fb1-4989-80d8-c05198f2e383-kube-api-access-mx27c\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-995wz\" (UID: \"147062f0-7fb1-4989-80d8-c05198f2e383\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-995wz"2153machine # [ 49.089918] k3s[888]: I0919 21:51:07.001531 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/3884ab8e-abae-4dfb-b47c-fc022975d75a-tls-lb\") pod \"nix-grpc-farm-lb-688d8d547b-xkg9r\" (UID: \"3884ab8e-abae-4dfb-b47c-fc022975d75a\") " pod="farm/nix-grpc-farm-lb-688d8d547b-xkg9r"2154machine # [ 49.090652] k3s[888]: I0919 21:51:07.001643 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/7d6f2ed9-d9ee-455a-b80b-32f88927d8fc-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-7zzkd\" (UID: \"7d6f2ed9-d9ee-455a-b80b-32f88927d8fc\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-7zzkd"2155machine # [ 49.090867] k3s[888]: I0919 21:51:07.001682 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/147062f0-7fb1-4989-80d8-c05198f2e383-build\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-995wz\" (UID: \"147062f0-7fb1-4989-80d8-c05198f2e383\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-995wz"2156machine # [ 49.091299] k3s[888]: I0919 21:51:07.001717 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3884ab8e-abae-4dfb-b47c-fc022975d75a-config\") pod \"nix-grpc-farm-lb-688d8d547b-xkg9r\" (UID: \"3884ab8e-abae-4dfb-b47c-fc022975d75a\") " pod="farm/nix-grpc-farm-lb-688d8d547b-xkg9r"2157machine # [ 49.091522] k3s[888]: I0919 21:51:07.001859 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/3884ab8e-abae-4dfb-b47c-fc022975d75a-tls-ca\") pod \"nix-grpc-farm-lb-688d8d547b-xkg9r\" (UID: \"3884ab8e-abae-4dfb-b47c-fc022975d75a\") " pod="farm/nix-grpc-farm-lb-688d8d547b-xkg9r"2158machine # [ 49.091937] k3s[888]: I0919 21:51:07.001889 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/7d6f2ed9-d9ee-455a-b80b-32f88927d8fc-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-7zzkd\" (UID: \"7d6f2ed9-d9ee-455a-b80b-32f88927d8fc\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-7zzkd"2159machine # [ 49.092794] k3s[888]: I0919 21:51:07.001920 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7d6f2ed9-d9ee-455a-b80b-32f88927d8fc-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-7zzkd\" (UID: \"7d6f2ed9-d9ee-455a-b80b-32f88927d8fc\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-7zzkd"2160machine # [ 49.093447] k3s[888]: I0919 21:51:07.001954 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/147062f0-7fb1-4989-80d8-c05198f2e383-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-995wz\" (UID: \"147062f0-7fb1-4989-80d8-c05198f2e383\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-995wz"2161machine # [ 49.128638] k3s[888]: I0919 21:51:07.040790 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/7d6f2ed9-d9ee-455a-b80b-32f88927d8fc-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-7zzkd\" (UID: \"7d6f2ed9-d9ee-455a-b80b-32f88927d8fc\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-7zzkd"2162machine # [ 49.129024] k3s[888]: I0919 21:51:07.040845 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/147062f0-7fb1-4989-80d8-c05198f2e383-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-995wz\" (UID: \"147062f0-7fb1-4989-80d8-c05198f2e383\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-995wz"2163machine # [ 49.129516] k3s[888]: I0919 21:51:07.041010 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3884ab8e-abae-4dfb-b47c-fc022975d75a-tmp\") pod \"nix-grpc-farm-lb-688d8d547b-xkg9r\" (UID: \"3884ab8e-abae-4dfb-b47c-fc022975d75a\") " pod="farm/nix-grpc-farm-lb-688d8d547b-xkg9r"2164machine # [ 49.141273] k3s[888]: I0919 21:51:07.053231 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/7d6f2ed9-d9ee-455a-b80b-32f88927d8fc-build\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-7zzkd\" (UID: \"7d6f2ed9-d9ee-455a-b80b-32f88927d8fc\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-7zzkd"2165machine # [ 49.141583] k3s[888]: I0919 21:51:07.053337 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/147062f0-7fb1-4989-80d8-c05198f2e383-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-995wz\" (UID: \"147062f0-7fb1-4989-80d8-c05198f2e383\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-995wz"2166machine # [ 49.142430] k3s[888]: I0919 21:51:07.053492 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/7d6f2ed9-d9ee-455a-b80b-32f88927d8fc-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-7zzkd\" (UID: \"7d6f2ed9-d9ee-455a-b80b-32f88927d8fc\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-7zzkd"2167machine # [ 49.142982] k3s[888]: I0919 21:51:07.053542 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rl46\" (UniqueName: \"kubernetes.io/projected/7d6f2ed9-d9ee-455a-b80b-32f88927d8fc-kube-api-access-7rl46\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-7zzkd\" (UID: \"7d6f2ed9-d9ee-455a-b80b-32f88927d8fc\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-7zzkd"2168machine # [ 49.143667] k3s[888]: I0919 21:51:07.053613 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/147062f0-7fb1-4989-80d8-c05198f2e383-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-995wz\" (UID: \"147062f0-7fb1-4989-80d8-c05198f2e383\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-995wz"2169machine # [ 49.144299] k3s[888]: I0919 21:51:07.053702 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/147062f0-7fb1-4989-80d8-c05198f2e383-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-995wz\" (UID: \"147062f0-7fb1-4989-80d8-c05198f2e383\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-995wz"2170machine # [ 49.144799] k3s[888]: I0919 21:51:07.053763 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/147062f0-7fb1-4989-80d8-c05198f2e383-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-995wz\" (UID: \"147062f0-7fb1-4989-80d8-c05198f2e383\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-995wz"2171machine # [ 49.145502] k3s[888]: I0919 21:51:07.053797 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/7d6f2ed9-d9ee-455a-b80b-32f88927d8fc-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-7zzkd\" (UID: \"7d6f2ed9-d9ee-455a-b80b-32f88927d8fc\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-7zzkd"2172machine # [ 49.507956] cni0: port 3(veth24f14b1b) entered blocking state2173machine # [ 49.509793] cni0: port 3(veth24f14b1b) entered disabled state2174machine # [ 49.511254] veth24f14b1b: entered allmulticast mode2175machine # [ 49.512471] veth24f14b1b: entered promiscuous mode2176machine # [ 49.516715] cni0: port 4(vethbc0cde69) entered blocking state2177machine # [ 49.520445] cni0: port 4(vethbc0cde69) entered disabled state2178machine # [ 49.522472] vethbc0cde69: entered allmulticast mode2179machine # [ 49.524165] vethbc0cde69: entered promiscuous mode2180machine # [ 49.530798] cni0: port 3(veth24f14b1b) entered blocking state2181machine # [ 49.532231] cni0: port 3(veth24f14b1b) entered forwarding state2182machine # [ 49.540237] cni0: port 5(veth718690aa) entered blocking state2183machine # [ 49.542321] cni0: port 5(veth718690aa) entered disabled state2184machine # [ 49.544116] veth718690aa: entered allmulticast mode2185machine # [ 49.545021] veth718690aa: entered promiscuous mode2186machine # [ 49.546941] cni0: port 4(vethbc0cde69) entered blocking state2187machine # [ 49.549016] cni0: port 4(vethbc0cde69) entered forwarding state2188machine # [ 49.561372] cni0: port 5(veth718690aa) entered blocking state2189machine # [ 49.562432] cni0: port 5(veth718690aa) entered forwarding state2190machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found2191machine # [ 49.451547] (udev-worker)[3419]: Network interface NamePolicy= disabled on kernel command line.2192machine # [ 49.455096] (udev-worker)[3422]: Network interface NamePolicy= disabled on kernel command line.2193machine # [ 49.456057] (udev-worker)[3421]: Network interface NamePolicy= disabled on kernel command line.2194machine # [ 49.506158] dhcpcd[678]: veth718690aa: IAID d7:a5:0e:e92195machine # [ 49.506383] dhcpcd[678]: veth718690aa: adding address fe80::1076:d7ff:fea5:ee92196machine # [ 49.531909] dhcpcd[678]: vethbc0cde69: IAID 82:5a:d9:2f2197machine # [ 49.532127] dhcpcd[678]: vethbc0cde69: adding address fe80::544a:82ff:fe5a:d92f2198machine # [ 49.549293] systemd[1]: Started libcontainer container d6403aedd604bec65e54bc0b49da09d518160513422c87db1dae8b8270ba74b2.2199machine # [ 49.552447] systemd[1]: Started libcontainer container f136316f417f38a6b6103deff7daa1022ba6ead4e694b68a71ceda72b97b6903.2200machine # [ 49.561350] dhcpcd[678]: veth24f14b1b: IAID 77:e9:d3:542201machine # [ 49.561718] dhcpcd[678]: veth24f14b1b: adding address fe80::fcbd:77ff:fee9:d3542202machine # [ 49.577454] systemd[1]: Started libcontainer container 4de97c03451a20c58946ff202fe690a254ca7e1da1d8719d3cb8b0e0d54ccbb2.2203machine # [ 49.629788] k3s[888]: I0919 21:51:07.540044 888 scope.go:122] "RemoveContainer" containerID="4351329d12bf235a6e0e14466a1ea91b70fa89db4708da7d911e4308320eabaf"2204machine # [ 49.717397] systemd[1]: Started libcontainer container df42a60a3e35495a43d72a452de97e8d6e500b4fde56fe52d7ae0ff17cf59ede.2205machine # [ 49.747367] systemd[1]: Started libcontainer container 732f2e31ccb5e9f6cac88f7e40395e0e08167a4fda79d04ea02df6a81a69cc2a.2206machine # [ 49.749093] dhcpcd[678]: flannel.1: no IPv6 Routers available2207machine # [ 49.900589] dhcpcd[678]: vethbb0eec57: no IPv6 Routers available2208machine # [ 50.315400] dhcpcd[678]: veth718690aa: soliciting a DHCP lease2209machine # [ 50.493785] k3s[888]: I0919 21:51:08.405558 888 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="66cc6219-28e0-4b00-bee9-b4a4f7388ec5" path="/var/lib/kubelet/pods/66cc6219-28e0-4b00-bee9-b4a4f7388ec5/volumes"2210machine # [ 50.497142] k3s[888]: I0919 21:51:08.409302 888 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6e0d5d2b-c212-493b-9c2a-24493642fb0b" path="/var/lib/kubelet/pods/6e0d5d2b-c212-493b-9c2a-24493642fb0b/volumes"2211machine # [ 50.500585] k3s[888]: I0919 21:51:08.412777 888 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="db834e5c-50e5-486c-9843-f58007a3dfe0" path="/var/lib/kubelet/pods/db834e5c-50e5-486c-9843-f58007a3dfe0/volumes"2212machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found2213machine # [ 51.059781] dhcpcd[678]: veth718690aa: soliciting an IPv6 router2214machine # [ 51.219591] dhcpcd[678]: veth24f14b1b: soliciting a DHCP lease2215machine # [ 51.364708] dhcpcd[678]: vethbc0cde69: soliciting a DHCP lease2216machine # [ 51.675130] k3s[888]: I0919 21:51:09.586574 888 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-688d8d547b-xkg9r" podStartSLOduration=3.586518253 podStartE2EDuration="3.586518253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 21:51:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 21:51:08.609428707 +0000 UTC m=+29.399668671" watchObservedRunningTime="2026-09-19 21:51:09.586518253 +0000 UTC m=+30.376757937"2217machine # [ 51.691323] dhcpcd[678]: vethbc0cde69: soliciting an IPv6 router2218machine # [ 51.763871] k3s[888]: E0919 21:51:09.676013 888 configmap.go:193] Couldn't get configMap farm/nix-grpc-farm-lb: configmap "nix-grpc-farm-lb" not found2219machine # [ 51.766496] k3s[888]: E0919 21:51:09.676144 888 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3884ab8e-abae-4dfb-b47c-fc022975d75a-config podName:3884ab8e-abae-4dfb-b47c-fc022975d75a nodeName:}" failed. No retries permitted until 2026-09-19 21:51:10.17610869 +0000 UTC m=+30.966348374 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config" (UniqueName: "kubernetes.io/configmap/3884ab8e-abae-4dfb-b47c-fc022975d75a-config") pod "nix-grpc-farm-lb-688d8d547b-xkg9r" (UID: "3884ab8e-abae-4dfb-b47c-fc022975d75a") : configmap "nix-grpc-farm-lb" not found2220machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found2221machine # [ 51.993742] dhcpcd[678]: veth5805111a: probing for an IPv4LL address2222machine # [ 52.238511] dhcpcd[678]: veth24f14b1b: soliciting an IPv6 router2223machine # [ 52.246409] k3s[888]: E0919 21:51:10.157904 888 status.go:71] "Unhandled Error" err="apiserver received an error that is not an metav1.Status: &errors.errorString{s:\"failed to create typed patch object (farm/nix-grpc-farm-scheduler; /v1, Kind=Service): .spec.selector.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}\"}: failed to create typed patch object (farm/nix-grpc-farm-scheduler; /v1, Kind=Service): .spec.selector.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}" logger="UnhandledError"2224machine # [ 52.253724] k3s[888]: I0919 21:51:10.164202 888 alloc.go:329] "allocated clusterIPs" service="farm/nix-grpc-farm" clusterIPs={"IPv4":"10.43.94.129"}2225machine # [ 52.265176] k3s[888]: E0919 21:51:10.175122 888 status.go:71] "Unhandled Error" err=<2226machine # [ 52.266479] k3s[888]: apiserver received an error that is not an metav1.Status: &errors.errorString{s:"failed to create typed patch object (farm/nix-grpc-farm-scheduler; apps/v1, Kind=Deployment): errors:\n .spec.selector.matchLabels.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}\n .spec.template.metadata.labels.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}"}: failed to create typed patch object (farm/nix-grpc-farm-scheduler; apps/v1, Kind=Deployment): errors:2227machine # [ 52.272580] k3s[888]: .spec.selector.matchLabels.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}2228machine # [ 52.274291] k3s[888]: .spec.template.metadata.labels.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}2229machine # [ 52.276061] k3s[888]: > logger="UnhandledError"2230machine # [ 52.291036] systemd[1]: cri-containerd-df42a60a3e35495a43d72a452de97e8d6e500b4fde56fe52d7ae0ff17cf59ede.scope: Deactivated successfully.2231machine # [ 52.291764] systemd[1]: cri-containerd-df42a60a3e35495a43d72a452de97e8d6e500b4fde56fe52d7ae0ff17cf59ede.scope: Consumed 833ms CPU time over 2.573s wall clock time, 32.6M memory peak, 3.3M incoming IP traffic, 195.5K outgoing IP traffic.2232machine # [ 52.329211] systemd[1]: Created slice libcontainer container kubepods-besteffort-podf3164493_56a6_433c_b2ff_4d76f22a248d.slice.2233machine # [ 52.339842] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod8cab976f_c7e4_49ae_ae16_2445af0d5dbd.slice.2234machine # [ 52.347956] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod9dab768b_4c34_45f9_a1d7_ccbbdbeeecdc.slice.2235machine # [ 52.366272] k3s[888]: I0919 21:51:10.278430 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8cab976f-c7e4-49ae-ae16-2445af0d5dbd-config\") pod \"nix-grpc-farm-lb-688d8d547b-m9bz2\" (UID: \"8cab976f-c7e4-49ae-ae16-2445af0d5dbd\") " pod="farm/nix-grpc-farm-lb-688d8d547b-m9bz2"2236machine # [ 52.366608] k3s[888]: I0919 21:51:10.278468 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8cab976f-c7e4-49ae-ae16-2445af0d5dbd-tmp\") pod \"nix-grpc-farm-lb-688d8d547b-m9bz2\" (UID: \"8cab976f-c7e4-49ae-ae16-2445af0d5dbd\") " pod="farm/nix-grpc-farm-lb-688d8d547b-m9bz2"2237machine # [ 52.368046] k3s[888]: I0919 21:51:10.279465 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/8cab976f-c7e4-49ae-ae16-2445af0d5dbd-tls-ca\") pod \"nix-grpc-farm-lb-688d8d547b-m9bz2\" (UID: \"8cab976f-c7e4-49ae-ae16-2445af0d5dbd\") " pod="farm/nix-grpc-farm-lb-688d8d547b-m9bz2"2238machine # [ 52.368784] k3s[888]: I0919 21:51:10.279510 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-vc94k\" (UID: \"9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-vc94k"2239machine # [ 52.369619] k3s[888]: I0919 21:51:10.279537 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f3164493-56a6-433c-b2ff-4d76f22a248d-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-4vm2g\" (UID: \"f3164493-56a6-433c-b2ff-4d76f22a248d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-4vm2g"2240machine # [ 52.370306] k3s[888]: I0919 21:51:10.279567 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-vc94k\" (UID: \"9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-vc94k"2241machine # [ 52.370875] k3s[888]: I0919 21:51:10.279594 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/f3164493-56a6-433c-b2ff-4d76f22a248d-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-4vm2g\" (UID: \"f3164493-56a6-433c-b2ff-4d76f22a248d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-4vm2g"2242machine # [ 52.371790] k3s[888]: I0919 21:51:10.279621 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-vc94k\" (UID: \"9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-vc94k"2243machine # [ 52.372704] k3s[888]: I0919 21:51:10.279647 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7nwd\" (UniqueName: \"kubernetes.io/projected/9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc-kube-api-access-g7nwd\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-vc94k\" (UID: \"9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-vc94k"2244machine # [ 52.373559] k3s[888]: I0919 21:51:10.279675 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/f3164493-56a6-433c-b2ff-4d76f22a248d-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-4vm2g\" (UID: \"f3164493-56a6-433c-b2ff-4d76f22a248d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-4vm2g"2245machine # [ 52.374127] k3s[888]: I0919 21:51:10.279698 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/f3164493-56a6-433c-b2ff-4d76f22a248d-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-4vm2g\" (UID: \"f3164493-56a6-433c-b2ff-4d76f22a248d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-4vm2g"2246machine # [ 52.374594] k3s[888]: I0919 21:51:10.279723 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/8cab976f-c7e4-49ae-ae16-2445af0d5dbd-tls-lb\") pod \"nix-grpc-farm-lb-688d8d547b-m9bz2\" (UID: \"8cab976f-c7e4-49ae-ae16-2445af0d5dbd\") " pod="farm/nix-grpc-farm-lb-688d8d547b-m9bz2"2247machine # [ 52.376440] k3s[888]: I0919 21:51:10.279755 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc-build\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-vc94k\" (UID: \"9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-vc94k"2248machine # [ 52.380577] k3s[888]: I0919 21:51:10.279784 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-vc94k\" (UID: \"9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-vc94k"2249machine # [ 52.384966] k3s[888]: I0919 21:51:10.279807 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-vc94k\" (UID: \"9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-vc94k"2250machine # [ 52.389412] k3s[888]: I0919 21:51:10.279833 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-vc94k\" (UID: \"9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-vc94k"2251machine # [ 52.431492] k3s[888]: I0919 21:51:10.279860 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/f3164493-56a6-433c-b2ff-4d76f22a248d-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-4vm2g\" (UID: \"f3164493-56a6-433c-b2ff-4d76f22a248d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-4vm2g"2252machine # [ 52.432304] k3s[888]: I0919 21:51:10.279884 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/f3164493-56a6-433c-b2ff-4d76f22a248d-build\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-4vm2g\" (UID: \"f3164493-56a6-433c-b2ff-4d76f22a248d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-4vm2g"2253machine # [ 52.432681] k3s[888]: I0919 21:51:10.279912 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/f3164493-56a6-433c-b2ff-4d76f22a248d-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-4vm2g\" (UID: \"f3164493-56a6-433c-b2ff-4d76f22a248d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-4vm2g"2254machine # [ 52.433172] k3s[888]: I0919 21:51:10.279940 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd5js\" (UniqueName: \"kubernetes.io/projected/f3164493-56a6-433c-b2ff-4d76f22a248d-kube-api-access-cd5js\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-4vm2g\" (UID: \"f3164493-56a6-433c-b2ff-4d76f22a248d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-4vm2g"2255machine # [ 52.461105] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-df42a60a3e35495a43d72a452de97e8d6e500b4fde56fe52d7ae0ff17cf59ede-rootfs.mount: Deactivated successfully.2256machine # [ 52.830620] cni0: port 6(veth0b1b91d2) entered blocking state2257machine # [ 52.832903] cni0: port 6(veth0b1b91d2) entered disabled state2258machine # [ 52.834434] veth0b1b91d2: entered allmulticast mode2259machine # [ 52.837722] veth0b1b91d2: entered promiscuous mode2260machine # [ 52.693733] k3s[888]: I0919 21:51:10.604651 888 scope.go:122] "RemoveContainer" containerID="4351329d12bf235a6e0e14466a1ea91b70fa89db4708da7d911e4308320eabaf"2261machine # [ 52.693953] k3s[888]: I0919 21:51:10.605193 888 scope.go:122] "RemoveContainer" containerID="df42a60a3e35495a43d72a452de97e8d6e500b4fde56fe52d7ae0ff17cf59ede"2262machine # [ 52.695036] k3s[888]: E0919 21:51:10.605383 888 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"helm\" with CrashLoopBackOff: \"back-off 10s restarting failed container=helm pod=helm-install-nix-grpc-farm-7fwh5_kube-system(0758217b-c7d3-4cab-abc0-35bace80ed3f)\"" pod="kube-system/helm-install-nix-grpc-farm-7fwh5" podUID="0758217b-c7d3-4cab-abc0-35bace80ed3f"2263machine # [ 52.864286] cni0: port 6(veth0b1b91d2) entered blocking state2264machine # [ 52.866533] cni0: port 6(veth0b1b91d2) entered forwarding state2265machine # [ 52.875990] cni0: port 7(vethe2f07415) entered blocking state2266machine # [ 52.877991] cni0: port 7(vethe2f07415) entered disabled state2267machine # [ 52.880015] vethe2f07415: entered allmulticast mode2268machine # [ 52.881517] vethe2f07415: entered promiscuous mode2269machine # [ 52.752087] systemd[1]: cri-containerd-732f2e31ccb5e9f6cac88f7e40395e0e08167a4fda79d04ea02df6a81a69cc2a.scope[ 52.908335] cni0: port 8(veth94b2c805) entered blocking state2270machine # : Deactivated successfully.2271machine # [ 52.753246] systemd[1]: cri-containerd-732f2e31c[ 52.910332] cni0: port 8(veth94b2c805) entered disabled state2272machine # cb5e9f6cac88f7e40395e0e08167a4fda79d04ea02df6a81a69cc2a.scope: C[ 52.912604] veth94b2c805: entered allmulticast mode2273machine # onsumed 92ms CPU time over 3.004s wall clock tim[ 52.914453] veth94b2c805: entered promiscuous mode2274machine # e, 15.1M memory peak, 3.5K incoming IP traffic, 4.4K outgoing IP traffic.2275machine # [ 52.917982] cni0: port 7(vethe2f07415) entered blocking state2276machine # [ 52.919741] cni0: port 7(vethe2f07415) entered forwarding state2277machine # [ 52.930180] cni0: port 8(veth94b2c805) entered blocking state2278machine # [ 52.932361] cni0: port 8(veth94b2c805) entered forwarding state2279machine # [ 52.787272] (udev-worker)[3916]: Network interface NamePolicy= disabled on kernel command line.2280machine # [ 52.795271] (udev-worker)[3919]: Network interface NamePolicy= disabled on kernel command line.2281machine # [ 52.798051] (udev-worker)[3921]: Network interface NamePolicy= disabled on kernel command line.2282machine # [ 52.849285] dhcpcd[678]: veth0b1b91d2: IAID 65:e7:74:b32283machine # [ 52.850995] dhcpcd[678]: veth0b1b91d2: adding address fe80::c89d:65ff:fee7:74b32284machine # [ 52.876150] dhcpcd[678]: veth94b2c805: IAID 9f:4f:d7:072285machine # [ 52.879736] dhcpcd[678]: veth94b2c805: adding address fe80::6886:9fff:fe4f:d7072286machine # [ 52.891523] systemd[1]: Started libcontainer container dec6326519f0f1ef10307324dd0ad29e91f2689c68bd5e0d3f381fdfb79f0002.2287machine # [ 52.901957] dhcpcd[678]: vethe2f07415: IAID 48:02:01:742288machine # [ 52.903839] dhcpcd[678]: vethe2f07415: adding address fe80::a8a0:48ff:fe02:1742289machine # [ 52.923494] systemd[1]: cri-containerd-f136316f417f38a6b6103deff7daa1022ba6ead4e694b68a71ceda72b97b6903.scope: Deactivated successfully.2290machine # [ 52.929122] dhcpcd[678]: veth94b2c805: soliciting a DHCP lease2291machine # [ 52.962656] systemd[1]: Started libcontainer container 57d5e0e73588b96c5740a2fc231820872dc63c2ec7fdf27088c81d1fc10e665e.2292machine # [ 52.972420] systemd[1]: Started libcontainer container 49195a0bcead4aefb93d89e7e7eb601cf87ee43385de2a6463caa1b643ee2f9b.2293machine # [ 53.007369] systemd[1]: Started libcontainer container a742c8bfc104805172b44f5856327e7366c20ac3033866f14d190a5436745ea9.2294machine # [ 53.030830] systemd[1]: Started libcontainer container 8a558d8e2ce81c9252cbbd15dedde7137affc585115686e17de7c61eae5a29aa.2295machine # [ 53.201547] systemd[1]: Started libcontainer container cdddee3343731d6f86ca15e371a68afea769aa565a65d4fa4fc8bc39ead9788e.2296machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found2297machine # [ 53.345360] systemd[1]: Started libcontainer container 1136cb5c9b5da00b6cd842e539ea1891a3b02a58803890a57ba84858e304367e.2298machine # [ 53.540201] cni0: port 3(veth24f14b1b) entered disabled state2299machine # [ 53.388400] dhcpcd[678]: veth24f14b1b: carrier lost2300machine # [ 53.544380] veth24f14b1b (unregistering): left allmulticast mode2301machine # [ 53.547434] veth24f14b1b (unregistering): left promiscuous mode2302machine # [ 53.548993] cni0: port 3(veth24f14b1b) entered disabled state2303machine # [ 53.440634] systemd[1]: Started libcontainer container bdbc4c9e321df63f2308289c7d567b805af33a0aac58b43029c19cf9ba682e79.2304machine # [ 53.483822] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-732f2e31ccb5e9f6cac88f7e40395e0e08167a4fda79d04ea02df6a81a69cc2a-rootfs.mount: Deactivated successfully.2305machine # [ 53.484092] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-f136316f417f38a6b6103deff7daa1022ba6ead4e694b68a71ceda72b97b6903-rootfs.mount: Deactivated successfully.2306machine # [ 53.485211] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-f136316f417f38a6b6103deff7daa1022ba6ead4e694b68a71ceda72b97b6903-shm.mount: Deactivated successfully.2307machine # [ 53.488718] dhcpcd[678]: veth24f14b1b: deleting address fe80::fcbd:77ff:fee9:d3542308machine # [ 53.489721] systemd[1]: run-netns-cni\x2d0ed59a51\x2d92de\x2d2cba\x2d1ab1\x2d548a61dcd5cc.mount: Deactivated successfully.2309machine # [ 53.595807] dhcpcd[678]: veth24f14b1b: removing interface2310machine # [ 53.598417] k3s[888]: I0919 21:51:11.509569 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3884ab8e-abae-4dfb-b47c-fc022975d75a-tmp\" (UniqueName: \"kubernetes.io/empty-dir/3884ab8e-abae-4dfb-b47c-fc022975d75a-tmp\") pod \"3884ab8e-abae-4dfb-b47c-fc022975d75a\" (UID: \"3884ab8e-abae-4dfb-b47c-fc022975d75a\") "2311machine # [ 53.612696] k3s[888]: I0919 21:51:11.510547 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3884ab8e-abae-4dfb-b47c-fc022975d75a-tls-lb\" (UniqueName: \"kubernetes.io/secret/3884ab8e-abae-4dfb-b47c-fc022975d75a-tls-lb\") pod \"3884ab8e-abae-4dfb-b47c-fc022975d75a\" (UID: \"3884ab8e-abae-4dfb-b47c-fc022975d75a\") "2312machine # [ 53.613348] k3s[888]: I0919 21:51:11.510588 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3884ab8e-abae-4dfb-b47c-fc022975d75a-config\" (UniqueName: \"kubernetes.io/configmap/3884ab8e-abae-4dfb-b47c-fc022975d75a-config\") pod \"3884ab8e-abae-4dfb-b47c-fc022975d75a\" (UID: \"3884ab8e-abae-4dfb-b47c-fc022975d75a\") "2313machine # [ 53.614195] k3s[888]: I0919 21:51:11.510624 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3884ab8e-abae-4dfb-b47c-fc022975d75a-tls-ca\" (UniqueName: \"kubernetes.io/secret/3884ab8e-abae-4dfb-b47c-fc022975d75a-tls-ca\") pod \"3884ab8e-abae-4dfb-b47c-fc022975d75a\" (UID: \"3884ab8e-abae-4dfb-b47c-fc022975d75a\") "2314machine # [ 53.622838] systemd[1]: var-lib-kubelet-pods-3884ab8e\x2dabae\x2d4dfb\x2db47c\x2dfc022975d75a-volume\x2dsubpaths-config-envoy-0.mount: Deactivated successfully.2315machine # [ 53.645229] systemd[1]: var-lib-kubelet-pods-3884ab8e\x2dabae\x2d4dfb\x2db47c\x2dfc022975d75a-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully.2316machine # [ 53.645536] systemd[1]: var-lib-kubelet-pods-3884ab8e\x2dabae\x2d4dfb\x2db47c\x2dfc022975d75a-volumes-kubernetes.io\x7esecret-tls\x2dlb.mount: Deactivated successfully.2317machine # [ 53.660438] k3s[888]: I0919 21:51:11.572604 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3884ab8e-abae-4dfb-b47c-fc022975d75a-tmp" pod "3884ab8e-abae-4dfb-b47c-fc022975d75a" (UID: "3884ab8e-abae-4dfb-b47c-fc022975d75a"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""2318machine # [ 53.662229] k3s[888]: I0919 21:51:11.572739 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3884ab8e-abae-4dfb-b47c-fc022975d75a-config" pod "3884ab8e-abae-4dfb-b47c-fc022975d75a" (UID: "3884ab8e-abae-4dfb-b47c-fc022975d75a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""2319machine # [ 53.662878] k3s[888]: I0919 21:51:11.572793 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3884ab8e-abae-4dfb-b47c-fc022975d75a-tls-ca" pod "3884ab8e-abae-4dfb-b47c-fc022975d75a" (UID: "3884ab8e-abae-4dfb-b47c-fc022975d75a"). InnerVolumeSpecName "tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""2320machine # [ 53.668070] k3s[888]: I0919 21:51:11.577475 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3884ab8e-abae-4dfb-b47c-fc022975d75a-tls-lb" pod "3884ab8e-abae-4dfb-b47c-fc022975d75a" (UID: "3884ab8e-abae-4dfb-b47c-fc022975d75a"). InnerVolumeSpecName "tls-lb". PluginName "kubernetes.io/secret", VolumeGIDValue ""2321machine # [ 53.700906] k3s[888]: I0919 21:51:11.612773 888 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3884ab8e-abae-4dfb-b47c-fc022975d75a-tmp\") on node \"machine\" DevicePath \"\""2322machine # [ 53.701084] k3s[888]: I0919 21:51:11.612806 888 reconciler_common.go:299] "Volume detached for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/3884ab8e-abae-4dfb-b47c-fc022975d75a-tls-lb\") on node \"machine\" DevicePath \"\""2323machine # [ 53.705299] k3s[888]: I0919 21:51:11.612820 888 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3884ab8e-abae-4dfb-b47c-fc022975d75a-config\") on node \"machine\" DevicePath \"\""2324machine # [ 53.715844] k3s[888]: I0919 21:51:11.612832 888 reconciler_common.go:299] "Volume detached for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/3884ab8e-abae-4dfb-b47c-fc022975d75a-tls-ca\") on node \"machine\" DevicePath \"\""2325machine # [ 53.751101] k3s[888]: I0919 21:51:11.661289 888 scope.go:122] "RemoveContainer" containerID="732f2e31ccb5e9f6cac88f7e40395e0e08167a4fda79d04ea02df6a81a69cc2a"2326machine # [ 53.776740] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod3884ab8e_abae_4dfb_b47c_fc022975d75a.slice.2327machine # [ 53.777115] systemd[1]: kubepods-besteffort-pod3884ab8e_abae_4dfb_b47c_fc022975d75a.slice: Consumed 126ms CPU time over 4.773s wall clock time, 15.4M memory peak, 3.5K incoming IP traffic, 4.4K outgoing IP traffic.2328machine # [ 53.861564] k3s[888]: I0919 21:51:11.771041 888 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-688d8d547b-m9bz2" podStartSLOduration=1.7710148860000001 podStartE2EDuration="1.771014886s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 21:51:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 21:51:11.753858515 +0000 UTC m=+32.544097920" watchObservedRunningTime="2026-09-19 21:51:11.771014886 +0000 UTC m=+32.561254850"2329machine # [ 53.870355] systemd[1]: cri-containerd-dec6326519f0f1ef10307324dd0ad29e91f2689c68bd5e0d3f381fdfb79f0002.scope: Deactivated successfully.2330machine # [ 53.871408] systemd[1]: cri-containerd-dec6326519f0f1ef10307324dd0ad29e91f2689c68bd5e0d3f381fdfb79f0002.scope: Consumed 487ms CPU time over 979ms wall clock time, 278.1M memory peak, 28K read from disk, 190.3M written to disk.2331machine # [ 53.872393] systemd[1]: cri-containerd-49195a0bcead4aefb93d89e7e7eb601cf87ee43385de2a6463caa1b643ee2f9b.scope: Deactivated successfully.2332machine # [ 53.873138] systemd[1]: cri-containerd-49195a0bcead4aefb93d89e7e7eb601cf87ee43385de2a6463caa1b643ee2f9b.scope: Consumed 391ms CPU time over 900ms wall clock time, 221.5M memory peak, 20K read from disk, 223M written to disk.2333machine # [ 53.934232] k3s[888]: I0919 21:51:11.846186 888 scope.go:122] "RemoveContainer" containerID="732f2e31ccb5e9f6cac88f7e40395e0e08167a4fda79d04ea02df6a81a69cc2a"2334machine # [ 53.957498] k3s[888]: E0919 21:51:11.869596 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"732f2e31ccb5e9f6cac88f7e40395e0e08167a4fda79d04ea02df6a81a69cc2a\": not found" containerID="732f2e31ccb5e9f6cac88f7e40395e0e08167a4fda79d04ea02df6a81a69cc2a"2335machine # [ 53.957670] k3s[888]: I0919 21:51:11.869678 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"732f2e31ccb5e9f6cac88f7e40395e0e08167a4fda79d04ea02df6a81a69cc2a"} err="failed to get container status \"732f2e31ccb5e9f6cac88f7e40395e0e08167a4fda79d04ea02df6a81a69cc2a\": rpc error: code = NotFound desc = an error occurred when try to find container \"732f2e31ccb5e9f6cac88f7e40395e0e08167a4fda79d04ea02df6a81a69cc2a\": not found"2336machine # [ 54.207724] dhcpcd[678]: vethe2f07415: soliciting a DHCP lease2337machine # [ 54.218883] systemd[1]: cri-containerd-d6403aedd604bec65e54bc0b49da09d518160513422c87db1dae8b8270ba74b2.scope: Deactivated successfully.2338machine # [ 54.224874] systemd[1]: cri-containerd-4de97c03451a20c58946ff202fe690a254ca7e1da1d8719d3cb8b0e0d54ccbb2.scope: Deactivated successfully.2339machine # [ 54.304290] systemd[1]: cri-containerd-cdddee3343731d6f86ca15e371a68afea769aa565a65d4fa4fc8bc39ead9788e.scope: Deactivated successfully.2340machine # [ 54.305085] systemd[1]: cri-containerd-cdddee3343731d6f86ca15e371a68afea769aa565a65d4fa4fc8bc39ead9788e.scope: Consumed 549ms CPU time over 1.103s wall clock time, 296.1M memory peak, 100K read from disk, 256.4M written to disk.2341machine # [ 54.333535] dhcpcd[678]: veth0b1b91d2: soliciting a DHCP lease2342machine # [ 54.409537] systemd[1]: cri-containerd-1136cb5c9b5da00b6cd842e539ea1891a3b02a58803890a57ba84858e304367e.scope: Deactivated successfully.2343machine # [ 54.410628] systemd[1]: cri-containerd-1136cb5c9b5da00b6cd842e539ea1891a3b02a58803890a57ba84858e304367e.scope: Consumed 515ms CPU time over 1.064s wall clock time, 314.1M memory peak, 80K read from disk, 275.5M written to disk.2344machine # [ 54.461282] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-cdddee3343731d6f86ca15e371a68afea769aa565a65d4fa4fc8bc39ead9788e-rootfs.mount: Deactivated successfully.2345machine # [ 54.461572] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-49195a0bcead4aefb93d89e7e7eb601cf87ee43385de2a6463caa1b643ee2f9b-rootfs.mount: Deactivated successfully.2346machine # [ 54.463889] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-dec6326519f0f1ef10307324dd0ad29e91f2689c68bd5e0d3f381fdfb79f0002-rootfs.mount: Deactivated successfully.2347machine # [ 54.464672] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-4de97c03451a20c58946ff202fe690a254ca7e1da1d8719d3cb8b0e0d54ccbb2-rootfs.mount: Deactivated successfully.2348machine # [ 54.465832] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-d6403aedd604bec65e54bc0b49da09d518160513422c87db1dae8b8270ba74b2-rootfs.mount: Deactivated successfully.2349machine # [ 54.467364] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-4de97c03451a20c58946ff202fe690a254ca7e1da1d8719d3cb8b0e0d54ccbb2-shm.mount: Deactivated successfully.2350machine # [ 54.468101] systemd[1]: var-lib-kubelet-pods-3884ab8e\x2dabae\x2d4dfb\x2db47c\x2dfc022975d75a-volumes-kubernetes.io\x7esecret-tls\x2dca.mount: Deactivated successfully.2351machine # [ 54.485889] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-d6403aedd604bec65e54bc0b49da09d518160513422c87db1dae8b8270ba74b2-shm.mount: Deactivated successfully.2352machine # [ 54.494088] k3s[888]: I0919 21:51:12.406066 888 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3884ab8e-abae-4dfb-b47c-fc022975d75a" path="/var/lib/kubelet/pods/3884ab8e-abae-4dfb-b47c-fc022975d75a/volumes"2353machine # [ 54.509070] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-1136cb5c9b5da00b6cd842e539ea1891a3b02a58803890a57ba84858e304367e-rootfs.mount: Deactivated successfully.2354machine # [ 54.701935] cni0: port 5(veth718690aa) entered disabled state2355machine # [ 54.548430] dhcpcd[678]: veth718690aa: carrier lost2356machine # [ 54.704719] veth718690aa (unregistering): left allmulticast mode2357machine # [ 54.706514] veth718690aa (unregistering): left promiscuous mode2358machine # [ 54.707906] cni0: port 5(veth718690aa) entered disabled state2359machine # [ 54.716529] cni0: port 4(vethbc0cde69) entered disabled state2360machine # [ 54.720431] vethbc0cde69 (unregistering): left allmulticast mode2361machine # [ 54.722543] vethbc0cde69 (unregistering): left promiscuous mode2362machine # [ 54.724274] cni0: port 4(vethbc0cde69) entered disabled state2363machine # [ 54.579876] systemd[1]: run-netns-cni\x2de125b954\x2dc10a\x2da4b8\x2dc9a4\x2d704d8abe79cf.mount: Deactivated successfully.2364machine # [ 54.598038] systemd[1]: run-netns-cni\x2da271049f\x2d0b9a\x2d0517\x2d5c2f\x2dd3fa8d32579c.mount: Deactivated successfully.2365machine # [ 54.619351] dhcpcd[678]: veth718690aa: deleting address fe80::1076:d7ff:fea5:ee92366machine # [ 54.621899] k3s[888]: I0919 21:51:12.533674 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/147062f0-7fb1-4989-80d8-c05198f2e383-ca\" (UniqueName: \"kubernetes.io/secret/147062f0-7fb1-4989-80d8-c05198f2e383-ca\") pod \"147062f0-7fb1-4989-80d8-c05198f2e383\" (UID: \"147062f0-7fb1-4989-80d8-c05198f2e383\") "2367machine # [ 54.622518] k3s[888]: I0919 21:51:12.533740 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/147062f0-7fb1-4989-80d8-c05198f2e383-kube-api-access-mx27c\" (UniqueName: \"kubernetes.io/projected/147062f0-7fb1-4989-80d8-c05198f2e383-kube-api-access-mx27c\") pod \"147062f0-7fb1-4989-80d8-c05198f2e383\" (UID: \"147062f0-7fb1-4989-80d8-c05198f2e383\") "2368machine # [ 54.623540] k3s[888]: I0919 21:51:12.533774 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/147062f0-7fb1-4989-80d8-c05198f2e383-niks3-token\" (UniqueName: \"kubernetes.io/projected/147062f0-7fb1-4989-80d8-c05198f2e383-niks3-token\") pod \"147062f0-7fb1-4989-80d8-c05198f2e383\" (UID: \"147062f0-7fb1-4989-80d8-c05198f2e383\") "2369machine # [ 54.624679] k3s[888]: I0919 21:51:12.533817 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/147062f0-7fb1-4989-80d8-c05198f2e383-build\" (UniqueName: \"kubernetes.io/empty-dir/147062f0-7fb1-4989-80d8-c05198f2e383-build\") pod \"147062f0-7fb1-4989-80d8-c05198f2e383\" (UID: \"147062f0-7fb1-4989-80d8-c05198f2e383\") "2370machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found2371machine # [ 54.625504] k3s[888]: I0919 21:51:12.533847 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/147062f0-7fb1-4989-80d8-c05198f2e383-nixconf\" (UniqueName: \"kubernetes.io/configmap/147062f0-7fb1-4989-80d8-c05198f2e383-nixconf\") pod \"147062f0-7fb1-4989-80d8-c05198f2e383\" (UID: \"147062f0-7fb1-4989-80d8-c05198f2e383\") "2372machine # [ 54.626823] k3s[888]: I0919 21:51:12.533873 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/147062f0-7fb1-4989-80d8-c05198f2e383-oidc\" (UniqueName: \"kubernetes.io/secret/147062f0-7fb1-4989-80d8-c05198f2e383-oidc\") pod \"147062f0-7fb1-4989-80d8-c05198f2e383\" (UID: \"147062f0-7fb1-4989-80d8-c05198f2e383\") "2373machine # [ 54.627198] k3s[888]: I0919 21:51:12.533905 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/147062f0-7fb1-4989-80d8-c05198f2e383-tls\" (UniqueName: \"kubernetes.io/secret/147062f0-7fb1-4989-80d8-c05198f2e383-tls\") pod \"147062f0-7fb1-4989-80d8-c05198f2e383\" (UID: \"147062f0-7fb1-4989-80d8-c05198f2e383\") "2374machine # [ 54.627651] k3s[888]: I0919 21:51:12.533934 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/147062f0-7fb1-4989-80d8-c05198f2e383-nix\" (UniqueName: \"kubernetes.io/empty-dir/147062f0-7fb1-4989-80d8-c05198f2e383-nix\") pod \"147062f0-7fb1-4989-80d8-c05198f2e383\" (UID: \"147062f0-7fb1-4989-80d8-c05198f2e383\") "2375machine # [ 54.668976] k3s[888]: I0919 21:51:12.581114 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/147062f0-7fb1-4989-80d8-c05198f2e383-build" pod "147062f0-7fb1-4989-80d8-c05198f2e383" (UID: "147062f0-7fb1-4989-80d8-c05198f2e383"). InnerVolumeSpecName "build". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""2376machine # [ 54.670213] k3s[888]: I0919 21:51:12.581419 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/147062f0-7fb1-4989-80d8-c05198f2e383-nixconf" pod "147062f0-7fb1-4989-80d8-c05198f2e383" (UID: "147062f0-7fb1-4989-80d8-c05198f2e383"). InnerVolumeSpecName "nixconf". PluginName "kubernetes.io/configmap", VolumeGIDValue ""2377machine # [ 54.684261] k3s[888]: I0919 21:51:12.596416 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/147062f0-7fb1-4989-80d8-c05198f2e383-tls" pod "147062f0-7fb1-4989-80d8-c05198f2e383" (UID: "147062f0-7fb1-4989-80d8-c05198f2e383"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""2378machine # [ 54.684764] k3s[888]: I0919 21:51:12.596930 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/147062f0-7fb1-4989-80d8-c05198f2e383-niks3-token" pod "147062f0-7fb1-4989-80d8-c05198f2e383" (UID: "147062f0-7fb1-4989-80d8-c05198f2e383"). InnerVolumeSpecName "niks3-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""2379machine # [ 54.685794] k3s[888]: I0919 21:51:12.596965 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/147062f0-7fb1-4989-80d8-c05198f2e383-ca" pod "147062f0-7fb1-4989-80d8-c05198f2e383" (UID: "147062f0-7fb1-4989-80d8-c05198f2e383"). InnerVolumeSpecName "ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""2380machine # [ 54.686583] k3s[888]: I0919 21:51:12.597482 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/147062f0-7fb1-4989-80d8-c05198f2e383-oidc" pod "147062f0-7fb1-4989-80d8-c05198f2e383" (UID: "147062f0-7fb1-4989-80d8-c05198f2e383"). InnerVolumeSpecName "oidc". PluginName "kubernetes.io/secret", VolumeGIDValue ""2381machine # [ 54.712438] k3s[888]: I0919 21:51:12.624153 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/147062f0-7fb1-4989-80d8-c05198f2e383-kube-api-access-mx27c" pod "147062f0-7fb1-4989-80d8-c05198f2e383" (UID: "147062f0-7fb1-4989-80d8-c05198f2e383"). InnerVolumeSpecName "kube-api-access-mx27c". PluginName "kubernetes.io/projected", VolumeGIDValue ""2382machine # [ 54.722503] k3s[888]: I0919 21:51:12.634689 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d6f2ed9-d9ee-455a-b80b-32f88927d8fc-nix\" (UniqueName: \"kubernetes.io/empty-dir/7d6f2ed9-d9ee-455a-b80b-32f88927d8fc-nix\") pod \"7d6f2ed9-d9ee-455a-b80b-32f88927d8fc\" (UID: \"7d6f2ed9-d9ee-455a-b80b-32f88927d8fc\") "2383machine # [ 54.722813] k3s[888]: I0919 21:51:12.634738 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7d6f2ed9-d9ee-455a-b80b-32f88927d8fc-oidc\" (UniqueName: \"kubernetes.io/secret/7d6f2ed9-d9ee-455a-b80b-32f88927d8fc-oidc\") pod \"7d6f2ed9-d9ee-455a-b80b-32f88927d8fc\" (UID: \"7d6f2ed9-d9ee-455a-b80b-32f88927d8fc\") "2384machine # [ 54.723471] k3s[888]: I0919 21:51:12.634786 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7d6f2ed9-d9ee-455a-b80b-32f88927d8fc-kube-api-access-7rl46\" (UniqueName: \"kubernetes.io/projected/7d6f2ed9-d9ee-455a-b80b-32f88927d8fc-kube-api-access-7rl46\") pod \"7d6f2ed9-d9ee-455a-b80b-32f88927d8fc\" (UID: \"7d6f2ed9-d9ee-455a-b80b-32f88927d8fc\") "2385machine # [ 54.723954] k3s[888]: I0919 21:51:12.634821 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7d6f2ed9-d9ee-455a-b80b-32f88927d8fc-tls\" (UniqueName: \"kubernetes.io/secret/7d6f2ed9-d9ee-455a-b80b-32f88927d8fc-tls\") pod \"7d6f2ed9-d9ee-455a-b80b-32f88927d8fc\" (UID: \"7d6f2ed9-d9ee-455a-b80b-32f88927d8fc\") "2386machine # [ 54.724580] k3s[888]: I0919 21:51:12.634850 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7d6f2ed9-d9ee-455a-b80b-32f88927d8fc-ca\" (UniqueName: \"kubernetes.io/secret/7d6f2ed9-d9ee-455a-b80b-32f88927d8fc-ca\") pod \"7d6f2ed9-d9ee-455a-b80b-32f88927d8fc\" (UID: \"7d6f2ed9-d9ee-455a-b80b-32f88927d8fc\") "2387machine # [ 54.725127] k3s[888]: I0919 21:51:12.634884 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7d6f2ed9-d9ee-455a-b80b-32f88927d8fc-niks3-token\" (UniqueName: \"kubernetes.io/projected/7d6f2ed9-d9ee-455a-b80b-32f88927d8fc-niks3-token\") pod \"7d6f2ed9-d9ee-455a-b80b-32f88927d8fc\" (UID: \"7d6f2ed9-d9ee-455a-b80b-32f88927d8fc\") "2388machine # [ 54.725561] k3s[888]: I0919 21:51:12.634912 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7d6f2ed9-d9ee-455a-b80b-32f88927d8fc-nixconf\" (UniqueName: \"kubernetes.io/configmap/7d6f2ed9-d9ee-455a-b80b-32f88927d8fc-nixconf\") pod \"7d6f2ed9-d9ee-455a-b80b-32f88927d8fc\" (UID: \"7d6f2ed9-d9ee-455a-b80b-32f88927d8fc\") "2389machine # [ 54.726101] k3s[888]: I0919 21:51:12.634944 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d6f2ed9-d9ee-455a-b80b-32f88927d8fc-build\" (UniqueName: \"kubernetes.io/empty-dir/7d6f2ed9-d9ee-455a-b80b-32f88927d8fc-build\") pod \"7d6f2ed9-d9ee-455a-b80b-32f88927d8fc\" (UID: \"7d6f2ed9-d9ee-455a-b80b-32f88927d8fc\") "2390machine # [ 54.726555] k3s[888]: I0919 21:51:12.634986 888 reconciler_common.go:299] "Volume detached for volume \"ca\" (UniqueName: \"kubernetes.io/secret/147062f0-7fb1-4989-80d8-c05198f2e383-ca\") on node \"machine\" DevicePath \"\""2391machine # [ 54.727094] k3s[888]: I0919 21:51:12.635002 888 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mx27c\" (UniqueName: \"kubernetes.io/projected/147062f0-7fb1-4989-80d8-c05198f2e383-kube-api-access-mx27c\") on node \"machine\" DevicePath \"\""2392machine # [ 54.727556] k3s[888]: I0919 21:51:12.635015 888 reconciler_common.go:299] "Volume detached for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/147062f0-7fb1-4989-80d8-c05198f2e383-niks3-token\") on node \"machine\" DevicePath \"\""2393machine # [ 54.728086] k3s[888]: I0919 21:51:12.635028 888 reconciler_common.go:299] "Volume detached for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/147062f0-7fb1-4989-80d8-c05198f2e383-build\") on node \"machine\" DevicePath \"\""2394machine # [ 54.728549] k3s[888]: I0919 21:51:12.635040 888 reconciler_common.go:299] "Volume detached for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/147062f0-7fb1-4989-80d8-c05198f2e383-nixconf\") on node \"machine\" DevicePath \"\""2395machine # [ 54.729085] k3s[888]: I0919 21:51:12.635052 888 reconciler_common.go:299] "Volume detached for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/147062f0-7fb1-4989-80d8-c05198f2e383-oidc\") on node \"machine\" DevicePath \"\""2396machine # [ 54.729539] k3s[888]: I0919 21:51:12.635064 888 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/147062f0-7fb1-4989-80d8-c05198f2e383-tls\") on node \"machine\" DevicePath \"\""2397machine # [ 54.760275] k3s[888]: I0919 21:51:12.672425 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/147062f0-7fb1-4989-80d8-c05198f2e383-nix" pod "147062f0-7fb1-4989-80d8-c05198f2e383" (UID: "147062f0-7fb1-4989-80d8-c05198f2e383"). InnerVolumeSpecName "nix". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""2398machine # [ 54.774678] dhcpcd[678]: veth0b1b91d2: soliciting an IPv6 router2399machine # [ 54.775381] dhcpcd[678]: veth94b2c805: soliciting an IPv6 router2400machine # [ 54.776325] dhcpcd[678]: veth718690aa: removing interface2401machine # [ 54.778427] k3s[888]: I0919 21:51:12.687732 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d6f2ed9-d9ee-455a-b80b-32f88927d8fc-build" pod "7d6f2ed9-d9ee-455a-b80b-32f88927d8fc" (UID: "7d6f2ed9-d9ee-455a-b80b-32f88927d8fc"). InnerVolumeSpecName "build". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""2402machine # [ 54.789696] k3s[888]: I0919 21:51:12.701828 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d6f2ed9-d9ee-455a-b80b-32f88927d8fc-tls" pod "7d6f2ed9-d9ee-455a-b80b-32f88927d8fc" (UID: "7d6f2ed9-d9ee-455a-b80b-32f88927d8fc"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""2403machine # [ 54.790104] k3s[888]: I0919 21:51:12.702319 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d6f2ed9-d9ee-455a-b80b-32f88927d8fc-kube-api-access-7rl46" pod "7d6f2ed9-d9ee-455a-b80b-32f88927d8fc" (UID: "7d6f2ed9-d9ee-455a-b80b-32f88927d8fc"). InnerVolumeSpecName "kube-api-access-7rl46". PluginName "kubernetes.io/projected", VolumeGIDValue ""2404machine # [ 54.791436] k3s[888]: I0919 21:51:12.703227 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d6f2ed9-d9ee-455a-b80b-32f88927d8fc-niks3-token" pod "7d6f2ed9-d9ee-455a-b80b-32f88927d8fc" (UID: "7d6f2ed9-d9ee-455a-b80b-32f88927d8fc"). InnerVolumeSpecName "niks3-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""2405machine # [ 54.792897] k3s[888]: I0919 21:51:12.703580 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d6f2ed9-d9ee-455a-b80b-32f88927d8fc-nixconf" pod "7d6f2ed9-d9ee-455a-b80b-32f88927d8fc" (UID: "7d6f2ed9-d9ee-455a-b80b-32f88927d8fc"). InnerVolumeSpecName "nixconf". PluginName "kubernetes.io/configmap", VolumeGIDValue ""2406machine # [ 54.804755] k3s[888]: I0919 21:51:12.716934 888 scope.go:122] "RemoveContainer" containerID="dec6326519f0f1ef10307324dd0ad29e91f2689c68bd5e0d3f381fdfb79f0002"2407machine # [ 54.815199] dhcpcd[678]: dhcp_readbpf: unexpected event 0x01002408machine # [ 54.815494] dhcpcd[678]: dhcp_readbpf: vethbc0cde69: Network is down2409machine # [ 54.819456] dhcpcd[678]: vethbc0cde69: removing interface2410machine # [ 54.819604] dhcpcd[678]: vethbc0cde69: deleting address fe80::544a:82ff:fe5a:d92f2411machine # [ 54.822527] k3s[888]: I0919 21:51:12.734468 888 scope.go:122] "RemoveContainer" containerID="dec6326519f0f1ef10307324dd0ad29e91f2689c68bd5e0d3f381fdfb79f0002"2412machine # [ 54.823399] k3s[888]: E0919 21:51:12.735606 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"dec6326519f0f1ef10307324dd0ad29e91f2689c68bd5e0d3f381fdfb79f0002\": not found" containerID="dec6326519f0f1ef10307324dd0ad29e91f2689c68bd5e0d3f381fdfb79f0002"2413machine # [ 54.825204] k3s[888]: I0919 21:51:12.736217 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"dec6326519f0f1ef10307324dd0ad29e91f2689c68bd5e0d3f381fdfb79f0002"} err="failed to get container status \"dec6326519f0f1ef10307324dd0ad29e91f2689c68bd5e0d3f381fdfb79f0002\": rpc error: code = NotFound desc = an error occurred when try to find container \"dec6326519f0f1ef10307324dd0ad29e91f2689c68bd5e0d3f381fdfb79f0002\": not found"2414machine # [ 54.826960] k3s[888]: I0919 21:51:12.736246 888 scope.go:122] "RemoveContainer" containerID="49195a0bcead4aefb93d89e7e7eb601cf87ee43385de2a6463caa1b643ee2f9b"2415machine # [ 54.827981] k3s[888]: I0919 21:51:12.735833 888 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/7d6f2ed9-d9ee-455a-b80b-32f88927d8fc-tls\") on node \"machine\" DevicePath \"\""2416machine # [ 54.829175] k3s[888]: I0919 21:51:12.736375 888 reconciler_common.go:299] "Volume detached for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/7d6f2ed9-d9ee-455a-b80b-32f88927d8fc-niks3-token\") on node \"machine\" DevicePath \"\""2417machine # [ 54.831503] k3s[888]: I0919 21:51:12.736390 888 reconciler_common.go:299] "Volume detached for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/7d6f2ed9-d9ee-455a-b80b-32f88927d8fc-nixconf\") on node \"machine\" DevicePath \"\""2418machine # [ 54.832599] k3s[888]: I0919 21:51:12.736404 888 reconciler_common.go:299] "Volume detached for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/7d6f2ed9-d9ee-455a-b80b-32f88927d8fc-build\") on node \"machine\" DevicePath \"\""2419machine # [ 54.833194] k3s[888]: I0919 21:51:12.736420 888 reconciler_common.go:299] "Volume detached for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/147062f0-7fb1-4989-80d8-c05198f2e383-nix\") on node \"machine\" DevicePath \"\""2420machine # [ 54.833441] k3s[888]: I0919 21:51:12.736436 888 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rl46\" (UniqueName: \"kubernetes.io/projected/7d6f2ed9-d9ee-455a-b80b-32f88927d8fc-kube-api-access-7rl46\") on node \"machine\" DevicePath \"\""2421machine # [ 54.846249] k3s[888]: I0919 21:51:12.758245 888 scope.go:122] "RemoveContainer" containerID="49195a0bcead4aefb93d89e7e7eb601cf87ee43385de2a6463caa1b643ee2f9b"2422machine # [ 54.847341] k3s[888]: E0919 21:51:12.759555 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"49195a0bcead4aefb93d89e7e7eb601cf87ee43385de2a6463caa1b643ee2f9b\": not found" containerID="49195a0bcead4aefb93d89e7e7eb601cf87ee43385de2a6463caa1b643ee2f9b"2423machine # [ 54.847756] k3s[888]: I0919 21:51:12.759968 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"49195a0bcead4aefb93d89e7e7eb601cf87ee43385de2a6463caa1b643ee2f9b"} err="failed to get container status \"49195a0bcead4aefb93d89e7e7eb601cf87ee43385de2a6463caa1b643ee2f9b\": rpc error: code = NotFound desc = an error occurred when try to find container \"49195a0bcead4aefb93d89e7e7eb601cf87ee43385de2a6463caa1b643ee2f9b\": not found"2424machine # [ 54.868324] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod147062f0_7fb1_4989_80d8_c05198f2e383.slice.2425machine # [ 54.869479] systemd[1]: kubepods-besteffort-pod147062f0_7fb1_4989_80d8_c05198f2e383.slice: Consumed 405ms CPU time over 5.828s wall clock time, 221.8M memory peak, 20K read from disk, 230.9M written to disk.2426machine # [ 54.888171] k3s[888]: I0919 21:51:12.800182 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d6f2ed9-d9ee-455a-b80b-32f88927d8fc-oidc" pod "7d6f2ed9-d9ee-455a-b80b-32f88927d8fc" (UID: "7d6f2ed9-d9ee-455a-b80b-32f88927d8fc"). InnerVolumeSpecName "oidc". PluginName "kubernetes.io/secret", VolumeGIDValue ""2427machine # [ 54.902329] k3s[888]: I0919 21:51:12.814373 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d6f2ed9-d9ee-455a-b80b-32f88927d8fc-ca" pod "7d6f2ed9-d9ee-455a-b80b-32f88927d8fc" (UID: "7d6f2ed9-d9ee-455a-b80b-32f88927d8fc"). InnerVolumeSpecName "ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""2428machine # [ 54.926938] k3s[888]: I0919 21:51:12.838062 888 reconciler_common.go:299] "Volume detached for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/7d6f2ed9-d9ee-455a-b80b-32f88927d8fc-oidc\") on node \"machine\" DevicePath \"\""2429machine # [ 54.929978] k3s[888]: I0919 21:51:12.838093 888 reconciler_common.go:299] "Volume detached for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7d6f2ed9-d9ee-455a-b80b-32f88927d8fc-ca\") on node \"machine\" DevicePath \"\""2430machine # [ 54.940561] k3s[888]: I0919 21:51:12.852701 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d6f2ed9-d9ee-455a-b80b-32f88927d8fc-nix" pod "7d6f2ed9-d9ee-455a-b80b-32f88927d8fc" (UID: "7d6f2ed9-d9ee-455a-b80b-32f88927d8fc"). InnerVolumeSpecName "nix". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""2431machine # [ 54.996780] systemd[1]: Started libcontainer container 94d1ad101da6f04948f27be21c70437f6e3e18c3fdf482e1eb5aa204393f08fa.2432machine # [ 54.999216] systemd[1]: Started libcontainer container c3a99fffc38fab3375984f1c93affcd30755b415a1f4998ba41aeda43f2bf7ad.2433machine # [ 55.026617] k3s[888]: I0919 21:51:12.938718 888 reconciler_common.go:299] "Volume detached for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/7d6f2ed9-d9ee-455a-b80b-32f88927d8fc-nix\") on node \"machine\" DevicePath \"\""2434machine # [ 55.113818] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod7d6f2ed9_d9ee_455a_b80b_32f88927d8fc.slice.2435machine # [ 55.114360] systemd[1]: kubepods-besteffort-pod7d6f2ed9_d9ee_455a_b80b_32f88927d8fc.slice: Consumed 504ms CPU time over 6.092s wall clock time, 278.4M memory peak, 28K read from disk, 267.3M written to disk.2436machine # [ 55.168501] systemd[1]: Started libcontainer container 24a308907065bebf2d5cd6f758b420d05499227f69acccfa11bfa2b0427bd1e1.2437machine # [ 55.175883] systemd[1]: Started libcontainer container 7a9a9e789d42c0d6d94de4ace88676b800e7aa5ac8ffbc0605e175fe3a85b25c.2438machine # [ 55.334425] systemd[1]: Started libcontainer container 5c9cde9a5ca55416a5a87963e1bda97429ce6c33f67d03caf69a4ffbf7bc1ed4.2439machine # [ 55.337404] systemd[1]: Started libcontainer container 6e34fc157e8c3caa6e646bb9fd43b11617a44ad5d0d4ad7489341937282a3bf9.2440machine # [ 55.467208] dhcpcd[678]: vethe2f07415: soliciting an IPv6 router2441machine # [ 55.476851] systemd[1]: var-lib-kubelet-pods-7d6f2ed9\x2dd9ee\x2d455a\x2db80b\x2d32f88927d8fc-volumes-kubernetes.io\x7eprojected-niks3\x2dtoken.mount: Deactivated successfully.2442machine # [ 55.477048] systemd[1]: var-lib-kubelet-pods-147062f0\x2d7fb1\x2d4989\x2d80d8\x2dc05198f2e383-volumes-kubernetes.io\x7eprojected-niks3\x2dtoken.mount: Deactivated successfully.2443machine # [ 55.477439] systemd[1]: var-lib-kubelet-pods-147062f0\x2d7fb1\x2d4989\x2d80d8\x2dc05198f2e383-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dmx27c.mount: Deactivated successfully.2444machine # [ 55.477968] systemd[1]: var-lib-kubelet-pods-147062f0\x2d7fb1\x2d4989\x2d80d8\x2dc05198f2e383-volumes-kubernetes.io\x7esecret-ca.mount: Deactivated successfully.2445machine # [ 55.478633] systemd[1]: var-lib-kubelet-pods-7d6f2ed9\x2dd9ee\x2d455a\x2db80b\x2d32f88927d8fc-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2d7rl46.mount: Deactivated successfully.2446machine # [ 55.479753] systemd[1]: var-lib-kubelet-pods-7d6f2ed9\x2dd9ee\x2d455a\x2db80b\x2d32f88927d8fc-volumes-kubernetes.io\x7esecret-ca.mount: Deactivated successfully.2447machine # [ 55.481231] systemd[1]: var-lib-kubelet-pods-7d6f2ed9\x2dd9ee\x2d455a\x2db80b\x2d32f88927d8fc-volumes-kubernetes.io\x7esecret-oidc.mount: Deactivated successfully.2448machine # [ 55.496159] systemd[1]: var-lib-kubelet-pods-147062f0\x2d7fb1\x2d4989\x2d80d8\x2dc05198f2e383-volumes-kubernetes.io\x7esecret-oidc.mount: Deactivated successfully.2449machine # [ 55.496934] systemd[1]: var-lib-kubelet-pods-7d6f2ed9\x2dd9ee\x2d455a\x2db80b\x2d32f88927d8fc-volumes-kubernetes.io\x7esecret-tls.mount: Deactivated successfully.2450machine # [ 55.497985] systemd[1]: var-lib-kubelet-pods-147062f0\x2d7fb1\x2d4989\x2d80d8\x2dc05198f2e383-volumes-kubernetes.io\x7esecret-tls.mount: Deactivated successfully.2451machine # [ 55.881796] k3s[888]: I0919 21:51:13.793319 888 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-4vm2g" podStartSLOduration=2.821653165 podStartE2EDuration="3.793252907s" totalImagesPullingTime="0s" totalInitContainerRuntime="971.599742ms" isStatefulPod=false podCreationTimestamp="2026-09-19 21:51:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 21:51:13.79276318 +0000 UTC m=+34.583002865" watchObservedRunningTime="2026-09-19 21:51:13.793252907 +0000 UTC m=+34.583492312"2452machine # [ 55.882040] k3s[888]: I0919 21:51:13.793475 888 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-vc94k" podStartSLOduration=2.923237864 podStartE2EDuration="3.793464666s" totalImagesPullingTime="0s" totalInitContainerRuntime="870.226802ms" isStatefulPod=false podCreationTimestamp="2026-09-19 21:51:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 21:51:13.781558404 +0000 UTC m=+34.571798089" watchObservedRunningTime="2026-09-19 21:51:13.793464666 +0000 UTC m=+34.583704071"2453machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found2454machine # [ 56.493693] k3s[888]: I0919 21:51:14.405819 888 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="147062f0-7fb1-4989-80d8-c05198f2e383" path="/var/lib/kubelet/pods/147062f0-7fb1-4989-80d8-c05198f2e383/volumes"2455machine # [ 56.494149] k3s[888]: I0919 21:51:14.406346 888 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7d6f2ed9-d9ee-455a-b80b-32f88927d8fc" path="/var/lib/kubelet/pods/7d6f2ed9-d9ee-455a-b80b-32f88927d8fc/volumes"2456machine # [ 56.774818] dhcpcd[678]: segfault at 5af1995f7 ip 00005af175f31cb3 sp 00007ffe97e52cc8 error 4 in dhcpcd[38cb3,5af175f02000+40000] likely on CPU 0 (core 0, socket 0)2457machine # [ 56.779465] Code: 45 ae 01 e9 0f fe ff ff 0f 1f 80 00 00 00 00 c6 45 af 01 e9 ff fd ff ff e8 fa 05 fd ff 66 2e 0f 1f 84 00 00 00 00 00 48 8b 07 <48> 8b 80 50 03 00 00 48 85 c0 74 31 90 48 8b 00 48 85 c0 74 1e 482458machine # [ 56.644538] systemd-coredump[5081]: Process 678 (dhcpcd) of user 999 terminated abnormally with signal 11/SEGV, processing...2459machine # [ 56.659326] systemd[1]: Created slice Slice /system/systemd-coredump.2460machine # [ 56.665370] systemd[1]: Started Process Core Dump (PID 5081/UID 0).2461machine # [ 56.959881] systemd-coredump[5083]: Process 678 (dhcpcd) of user 999 dumped core.2462machine # 2463machine # Module udev.so without build-id.2464machine # Module dhcpcd without build-id.2465machine # Stack trace of thread 678:2466machine # #0 0x00005af175f31cb3 ipv6nd_expire (dhcpcd + 0x38cb3)2467machine # #1 0x00005af175f0b06a eloop_start (dhcpcd + 0x1206a)2468machine # #2 0x00005af175f03300 main (dhcpcd + 0xa300)2469machine # #3 0x000078d487642285 __libc_start_call_main (libc.so.6 + 0x2b285)2470machine # #4 0x000078d487642338 __libc_start_main@@GLIBC_2.34 (libc.so.6 + 0x2b338)2471machine # #5 0x00005af175f04365 _start (dhcpcd + 0xb365)2472machine # ELF object binary architecture: AMD x86-642473machine # 2474machine # [ 56.971957] systemd[1]: systemd-coredump@0-1-5081_5082-0.service: Deactivated successfully.2475machine # [ 57.024332] systemd[1]: dhcpcd.service: Main process exited, code=dumped, status=11/SEGV2476machine # [ 57.024628] systemd[1]: dhcpcd.service: Failed with result 'core-dump'.2477machine # [ 57.025593] systemd[1]: dhcpcd.service: Consumed 604ms CPU time over 47.897s wall clock time, 6.2M memory peak, 8K written to disk, 96B incoming IP traffic, 1.4K outgoing IP traffic.2478machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found2479machine # [ 57.201580] systemd[1]: dhcpcd.service: Scheduled restart job, restart counter is at 1.2480machine # [ 57.205745] systemd[1]: Starting DHCP Client...2481machine # [ 57.391844] dhcpcd[5121]: dhcpcd-10.3.2 starting2482machine # [ 57.397536] dhcpcd[5125]: dev: loaded udev2483machine # [ 57.399405] dhcpcd[5125]: DUID 00:01:00:01:32:41:c0:23:52:54:00:12:34:562484machine # [ 57.630485] dhcpcd[5125]: eth0: IAID 00:12:34:562485machine # [ 57.631429] dhcpcd[5125]: flannel.1: IAID 27:46:0d:502486machine # [ 57.632192] dhcpcd[5125]: vethbb0eec57: IAID ab:d3:71:cf2487machine # [ 57.633027] dhcpcd[5125]: veth5805111a: IAID e5:f9:b2:e32488machine # [ 57.633791] dhcpcd[5125]: veth0b1b91d2: IAID 65:e7:74:b32489machine # [ 57.634562] dhcpcd[5125]: vethe2f07415: IAID 48:02:01:742490machine # [ 57.635355] dhcpcd[5125]: veth94b2c805: IAID 9f:4f:d7:072491machine # [ 57.649153] dhcpcd[5125]: veth5805111a: soliciting an IPv6 router2492machine # [ 57.885280] dhcpcd[5125]: vethbb0eec57: soliciting an IPv6 router2493machine # [ 57.937585] dhcpcd[5125]: vethe2f07415: soliciting an IPv6 router2494machine # [ 58.025820] dhcpcd[5125]: flannel.1: soliciting an IPv6 router2495machine # [ 58.153287] dhcpcd[5125]: veth94b2c805: soliciting an IPv6 router2496machine # [ 58.183423] dhcpcd[5125]: eth0: soliciting an IPv6 router2497machine # [ 58.184160] dhcpcd[5125]: eth0: Router Advertisement from fe80::22498machine # [ 58.185290] dhcpcd[5125]: eth0: adding address fec0::5054:ff:fe12:3456/642499machine # [ 58.270980] dhcpcd[5125]: veth0b1b91d2: soliciting an IPv6 router2500machine # [ 58.422828] dhcpcd[5125]: eth0: rebinding lease of 10.0.2.152501machine # [ 58.434511] dhcpcd[5125]: eth0: leased 10.0.2.15 for 86400 seconds2502machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found2503machine # [ 58.508437] systemd[1]: Started DHCP Client.2504machine # [ 58.510360] dhcpcd[5125]: veth0b1b91d2: soliciting a DHCP lease2505machine # [ 58.665361] dhcpcd[5125]: veth5805111a: soliciting a DHCP lease2506machine # [ 58.850027] dhcpcd[5125]: vethbb0eec57: soliciting a DHCP lease2507machine # [ 59.145703] dhcpcd[5125]: flannel.1: soliciting a DHCP lease2508machine # [ 59.198610] dhcpcd[5125]: vethe2f07415: soliciting a DHCP lease2509machine # [ 59.431536] dhcpcd[5125]: veth94b2c805: soliciting a DHCP lease2510machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found2511machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found2512machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found2513machine # [ 62.490174] k3s[888]: I0919 21:51:20.401864 888 scope.go:122] "RemoveContainer" containerID="df42a60a3e35495a43d72a452de97e8d6e500b4fde56fe52d7ae0ff17cf59ede"2514machine # [ 62.553731] systemd[1]: Started libcontainer container 3eb3b8b6fdd0186fe71ba6e674f137d33a6f7c779050c7f23153a111d7ae0376.2515machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found2516machine # [ 63.511075] dhcpcd[5125]: veth0b1b91d2: probing for an IPv4LL address2517machine # [ 63.647650] systemd[1]: cri-containerd-bdbc4c9e321df63f2308289c7d567b805af33a0aac58b43029c19cf9ba682e79.scope: Deactivated successfully.2518machine # [ 63.652247] systemd[1]: cri-containerd-bdbc4c9e321df63f2308289c7d567b805af33a0aac58b43029c19cf9ba682e79.scope: Consumed 150ms CPU time over 10.206s wall clock time, 15.5M memory peak, 14.6K incoming IP traffic, 11.8K outgoing IP traffic.2519machine # [ 63.665689] dhcpcd[5125]: veth5805111a: probing for an IPv4LL address2520machine # [ 63.694654] systemd[1]: cri-containerd-5c9cde9a5ca55416a5a87963e1bda97429ce6c33f67d03caf69a4ffbf7bc1ed4.scope: Deactivated successfully.2521machine # [ 63.699062] systemd[1]: cri-containerd-6e34fc157e8c3caa6e646bb9fd43b11617a44ad5d0d4ad7489341937282a3bf9.scope: Deactivated successfully.2522machine # [ 63.713216] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-bdbc4c9e321df63f2308289c7d567b805af33a0aac58b43029c19cf9ba682e79-rootfs.mount: Deactivated successfully.2523machine # [ 63.737833] systemd[1]: cri-containerd-94d1ad101da6f04948f27be21c70437f6e3e18c3fdf482e1eb5aa204393f08fa.scope: Deactivated successfully.2524machine # [ 63.741204] systemd[1]: cri-containerd-c3a99fffc38fab3375984f1c93affcd30755b415a1f4998ba41aeda43f2bf7ad.scope: Deactivated successfully.2525machine # [ 63.752560] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-6e34fc157e8c3caa6e646bb9fd43b11617a44ad5d0d4ad7489341937282a3bf9-rootfs.mount: Deactivated successfully.2526machine # [ 63.765117] systemd[1]: cri-containerd-a742c8bfc104805172b44f5856327e7366c20ac3033866f14d190a5436745ea9.scope: Deactivated successfully.2527machine # [ 63.769146] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-5c9cde9a5ca55416a5a87963e1bda97429ce6c33f67d03caf69a4ffbf7bc1ed4-rootfs.mount: Deactivated successfully.2528machine # [ 63.810408] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-94d1ad101da6f04948f27be21c70437f6e3e18c3fdf482e1eb5aa204393f08fa-rootfs.mount: Deactivated successfully.2529machine # [ 63.810879] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-a742c8bfc104805172b44f5856327e7366c20ac3033866f14d190a5436745ea9-rootfs.mount: Deactivated successfully.2530machine # [ 63.820428] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-c3a99fffc38fab3375984f1c93affcd30755b415a1f4998ba41aeda43f2bf7ad-rootfs.mount: Deactivated successfully.2531machine # [ 63.906044] k3s[888]: I0919 21:51:21.817860 888 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a742c8bfc104805172b44f5856327e7366c20ac3033866f14d190a5436745ea9"2532machine # [ 64.067199] cni0: port 7(vethe2f07415) entered disabled state2533machine # [ 63.914338] dhcpcd[5125]: vethe2f07415: carrier lost2534machine # [ 64.070151] vethe2f07415 (unregistering): left allmulticast mode2535machine # [ 64.071344] vethe2f07415 (unregistering): left promiscuous mode2536machine # [ 64.072303] cni0: port 7(vethe2f07415) entered disabled state2537machine # [ 63.986667] k3s[888]: I0919 21:51:21.898839 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8cab976f-c7e4-49ae-ae16-2445af0d5dbd-tls-ca\" (UniqueName: \"kubernetes.io/secret/8cab976f-c7e4-49ae-ae16-2445af0d5dbd-tls-ca\") pod \"8cab976f-c7e4-49ae-ae16-2445af0d5dbd\" (UID: \"8cab976f-c7e4-49ae-ae16-2445af0d5dbd\") "2538machine # [ 63.986870] k3s[888]: I0919 21:51:21.898887 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8cab976f-c7e4-49ae-ae16-2445af0d5dbd-tls-lb\" (UniqueName: \"kubernetes.io/secret/8cab976f-c7e4-49ae-ae16-2445af0d5dbd-tls-lb\") pod \"8cab976f-c7e4-49ae-ae16-2445af0d5dbd\" (UID: \"8cab976f-c7e4-49ae-ae16-2445af0d5dbd\") "2539machine # [ 63.987925] k3s[888]: I0919 21:51:21.898937 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8cab976f-c7e4-49ae-ae16-2445af0d5dbd-config\" (UniqueName: \"kubernetes.io/configmap/8cab976f-c7e4-49ae-ae16-2445af0d5dbd-config\") pod \"8cab976f-c7e4-49ae-ae16-2445af0d5dbd\" (UID: \"8cab976f-c7e4-49ae-ae16-2445af0d5dbd\") "2540machine # [ 63.989051] k3s[888]: I0919 21:51:21.900935 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8cab976f-c7e4-49ae-ae16-2445af0d5dbd-tmp\" (UniqueName: \"kubernetes.io/empty-dir/8cab976f-c7e4-49ae-ae16-2445af0d5dbd-tmp\") pod \"8cab976f-c7e4-49ae-ae16-2445af0d5dbd\" (UID: \"8cab976f-c7e4-49ae-ae16-2445af0d5dbd\") "2541machine # [ 64.012417] k3s[888]: I0919 21:51:21.924605 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cab976f-c7e4-49ae-ae16-2445af0d5dbd-tmp" pod "8cab976f-c7e4-49ae-ae16-2445af0d5dbd" (UID: "8cab976f-c7e4-49ae-ae16-2445af0d5dbd"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""2542machine # [ 64.013887] k3s[888]: I0919 21:51:21.926098 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cab976f-c7e4-49ae-ae16-2445af0d5dbd-config" pod "8cab976f-c7e4-49ae-ae16-2445af0d5dbd" (UID: "8cab976f-c7e4-49ae-ae16-2445af0d5dbd"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""2543machine # [ 64.024524] k3s[888]: I0919 21:51:21.936651 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cab976f-c7e4-49ae-ae16-2445af0d5dbd-tls-ca" pod "8cab976f-c7e4-49ae-ae16-2445af0d5dbd" (UID: "8cab976f-c7e4-49ae-ae16-2445af0d5dbd"). InnerVolumeSpecName "tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""2544machine # [ 64.040273] k3s[888]: I0919 21:51:21.952438 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cab976f-c7e4-49ae-ae16-2445af0d5dbd-tls-lb" pod "8cab976f-c7e4-49ae-ae16-2445af0d5dbd" (UID: "8cab976f-c7e4-49ae-ae16-2445af0d5dbd"). InnerVolumeSpecName "tls-lb". PluginName "kubernetes.io/secret", VolumeGIDValue ""2545machine # [ 64.058331] dhcpcd[5125]: vethe2f07415: removing interface2546machine # [ 64.089206] k3s[888]: I0919 21:51:22.001165 888 reconciler_common.go:299] "Volume detached for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/8cab976f-c7e4-49ae-ae16-2445af0d5dbd-tls-lb\") on node \"machine\" DevicePath \"\""2547machine # [ 64.090460] k3s[888]: I0919 21:51:22.001194 888 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8cab976f-c7e4-49ae-ae16-2445af0d5dbd-config\") on node \"machine\" DevicePath \"\""2548machine # [ 64.091059] k3s[888]: I0919 21:51:22.001206 888 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8cab976f-c7e4-49ae-ae16-2445af0d5dbd-tmp\") on node \"machine\" DevicePath \"\""2549machine # [ 64.091720] k3s[888]: I0919 21:51:22.001220 888 reconciler_common.go:299] "Volume detached for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/8cab976f-c7e4-49ae-ae16-2445af0d5dbd-tls-ca\") on node \"machine\" DevicePath \"\""2550machine # [ 64.393515] k3s[888]: E0919 21:51:22.305088 888 status.go:71] "Unhandled Error" err="apiserver received an error that is not an metav1.Status: &errors.errorString{s:\"failed to create typed patch object (farm/nix-grpc-farm-scheduler; /v1, Kind=Service): .spec.selector.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}\"}: failed to create typed patch object (farm/nix-grpc-farm-scheduler; /v1, Kind=Service): .spec.selector.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}" logger="UnhandledError"2551machine # [ 64.400193] k3s[888]: I0919 21:51:22.310123 888 alloc.go:329] "allocated clusterIPs" service="farm/nix-grpc-farm" clusterIPs={"IPv4":"10.43.191.26"}2552machine # [ 64.404672] k3s[888]: E0919 21:51:22.316866 888 status.go:71] "Unhandled Error" err=<2553machine # [ 64.405980] k3s[888]: apiserver received an error that is not an metav1.Status: &errors.errorString{s:"failed to create typed patch object (farm/nix-grpc-farm-scheduler; apps/v1, Kind=Deployment): errors:\n .spec.selector.matchLabels.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}\n .spec.template.metadata.labels.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}"}: failed to create typed patch object (farm/nix-grpc-farm-scheduler; apps/v1, Kind=Deployment): errors:2554machine # [ 64.412179] k3s[888]: .spec.selector.matchLabels.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}2555machine # [ 64.413848] k3s[888]: .spec.template.metadata.labels.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}2556machine # [ 64.415489] k3s[888]: > logger="UnhandledError"2557machine # [ 64.431369] systemd[1]: cri-containerd-3eb3b8b6fdd0186fe71ba6e674f137d33a6f7c779050c7f23153a111d7ae0376.scope: Deactivated successfully.2558machine # [ 64.433310] systemd[1]: cri-containerd-3eb3b8b6fdd0186fe71ba6e674f137d33a6f7c779050c7f23153a111d7ae0376.scope: Consumed 824ms CPU time over 1.877s wall clock time, 31.1M memory peak, 3.3M incoming IP traffic, 200.8K outgoing IP traffic.2559machine # [ 64.436484] dhcpcd[5125]: veth94b2c805: probing for an IPv4LL address2560machine # [ 64.449259] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod955e321a_589d_4504_a12a_a9555c293ed1.slice.2561machine # [ 64.491106] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod8ee2855c_6889_4a07_ba1b_745f39ff15e0.slice.2562machine # [ 64.492118] k3s[888]: I0919 21:51:22.403727 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twpbn\" (UniqueName: \"kubernetes.io/projected/8ee2855c-6889-4a07-ba1b-745f39ff15e0-kube-api-access-twpbn\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-fvc8j\" (UID: \"8ee2855c-6889-4a07-ba1b-745f39ff15e0\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-fvc8j"2563machine # [ 64.492786] k3s[888]: I0919 21:51:22.403775 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/8ee2855c-6889-4a07-ba1b-745f39ff15e0-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-fvc8j\" (UID: \"8ee2855c-6889-4a07-ba1b-745f39ff15e0\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-fvc8j"2564machine # [ 64.493402] k3s[888]: I0919 21:51:22.403803 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/8ee2855c-6889-4a07-ba1b-745f39ff15e0-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-fvc8j\" (UID: \"8ee2855c-6889-4a07-ba1b-745f39ff15e0\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-fvc8j"2565machine # [ 64.493886] k3s[888]: I0919 21:51:22.403833 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/8ee2855c-6889-4a07-ba1b-745f39ff15e0-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-fvc8j\" (UID: \"8ee2855c-6889-4a07-ba1b-745f39ff15e0\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-fvc8j"2566machine # [ 64.494518] k3s[888]: I0919 21:51:22.403860 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/8ee2855c-6889-4a07-ba1b-745f39ff15e0-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-fvc8j\" (UID: \"8ee2855c-6889-4a07-ba1b-745f39ff15e0\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-fvc8j"2567machine # [ 64.494684] k3s[888]: I0919 21:51:22.403886 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/955e321a-589d-4504-a12a-a9555c293ed1-tmp\") pod \"nix-grpc-farm-lb-688d8d547b-jtnv7\" (UID: \"955e321a-589d-4504-a12a-a9555c293ed1\") " pod="farm/nix-grpc-farm-lb-688d8d547b-jtnv7"2568machine # [ 64.495501] k3s[888]: I0919 21:51:22.403912 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/8ee2855c-6889-4a07-ba1b-745f39ff15e0-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-fvc8j\" (UID: \"8ee2855c-6889-4a07-ba1b-745f39ff15e0\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-fvc8j"2569machine # [ 64.495682] k3s[888]: I0919 21:51:22.403940 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/8ee2855c-6889-4a07-ba1b-745f39ff15e0-build\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-fvc8j\" (UID: \"8ee2855c-6889-4a07-ba1b-745f39ff15e0\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-fvc8j"2570machine # [ 64.496184] k3s[888]: I0919 21:51:22.403988 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/8ee2855c-6889-4a07-ba1b-745f39ff15e0-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-fvc8j\" (UID: \"8ee2855c-6889-4a07-ba1b-745f39ff15e0\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-fvc8j"2571machine # [ 64.496645] k3s[888]: I0919 21:51:22.404018 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/955e321a-589d-4504-a12a-a9555c293ed1-config\") pod \"nix-grpc-farm-lb-688d8d547b-jtnv7\" (UID: \"955e321a-589d-4504-a12a-a9555c293ed1\") " pod="farm/nix-grpc-farm-lb-688d8d547b-jtnv7"2572machine # [ 64.497184] k3s[888]: I0919 21:51:22.404041 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/955e321a-589d-4504-a12a-a9555c293ed1-tls-lb\") pod \"nix-grpc-farm-lb-688d8d547b-jtnv7\" (UID: \"955e321a-589d-4504-a12a-a9555c293ed1\") " pod="farm/nix-grpc-farm-lb-688d8d547b-jtnv7"2573machine # [ 64.497717] k3s[888]: I0919 21:51:22.404067 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/955e321a-589d-4504-a12a-a9555c293ed1-tls-ca\") pod \"nix-grpc-farm-lb-688d8d547b-jtnv7\" (UID: \"955e321a-589d-4504-a12a-a9555c293ed1\") " pod="farm/nix-grpc-farm-lb-688d8d547b-jtnv7"2574machine # [ 64.571507] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod8cab976f_c7e4_49ae_ae16_2445af0d5dbd.slice.2575machine # [ 64.573182] systemd[1]: kubepods-besteffort-pod8cab976f_c7e4_49ae_ae16_2445af0d5dbd.slice: Consumed 183ms CPU time over 12.230s wall clock time, 15.7M memory peak, 14.6K incoming IP traffic, 11.8K outgoing IP traffic.2576machine # [ 64.587670] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod0e745c8c_184c_4e86_8671_f9243fa1a1c5.slice.2577machine # [ 64.592587] k3s[888]: I0919 21:51:22.504358 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/0e745c8c-184c-4e86-8671-f9243fa1a1c5-build\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-p7ztl\" (UID: \"0e745c8c-184c-4e86-8671-f9243fa1a1c5\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-p7ztl"2578machine # [ 64.593070] k3s[888]: I0919 21:51:22.504434 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/0e745c8c-184c-4e86-8671-f9243fa1a1c5-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-p7ztl\" (UID: \"0e745c8c-184c-4e86-8671-f9243fa1a1c5\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-p7ztl"2579machine # [ 64.593806] k3s[888]: I0919 21:51:22.504572 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/0e745c8c-184c-4e86-8671-f9243fa1a1c5-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-p7ztl\" (UID: \"0e745c8c-184c-4e86-8671-f9243fa1a1c5\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-p7ztl"2580machine # [ 64.594715] k3s[888]: I0919 21:51:22.504597 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/0e745c8c-184c-4e86-8671-f9243fa1a1c5-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-p7ztl\" (UID: \"0e745c8c-184c-4e86-8671-f9243fa1a1c5\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-p7ztl"2581machine # [ 64.597386] k3s[888]: I0919 21:51:22.504641 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/0e745c8c-184c-4e86-8671-f9243fa1a1c5-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-p7ztl\" (UID: \"0e745c8c-184c-4e86-8671-f9243fa1a1c5\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-p7ztl"2582machine # [ 64.621637] k3s[888]: I0919 21:51:22.504669 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0e745c8c-184c-4e86-8671-f9243fa1a1c5-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-p7ztl\" (UID: \"0e745c8c-184c-4e86-8671-f9243fa1a1c5\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-p7ztl"2583machine # [ 64.622044] k3s[888]: I0919 21:51:22.504708 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/0e745c8c-184c-4e86-8671-f9243fa1a1c5-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-p7ztl\" (UID: \"0e745c8c-184c-4e86-8671-f9243fa1a1c5\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-p7ztl"2584machine # [ 64.622589] k3s[888]: I0919 21:51:22.504740 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x9pp\" (UniqueName: \"kubernetes.io/projected/0e745c8c-184c-4e86-8671-f9243fa1a1c5-kube-api-access-6x9pp\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-p7ztl\" (UID: \"0e745c8c-184c-4e86-8671-f9243fa1a1c5\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-p7ztl"2585machine # [ 64.726911] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-3eb3b8b6fdd0186fe71ba6e674f137d33a6f7c779050c7f23153a111d7ae0376-rootfs.mount: Deactivated successfully.2586machine # [ 64.727534] systemd[1]: var-lib-kubelet-pods-8cab976f\x2dc7e4\x2d49ae\x2dae16\x2d2445af0d5dbd-volume\x2dsubpaths-config-envoy-0.mount: Deactivated successfully.2587machine # [ 64.728588] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-a742c8bfc104805172b44f5856327e7366c20ac3033866f14d190a5436745ea9-shm.mount: Deactivated successfully.2588machine # [ 64.729490] systemd[1]: run-netns-cni\x2de36cb4f8\x2d7188\x2d85a1\x2da006\x2d2ac5115db2aa.mount: Deactivated successfully.2589machine # [ 64.730080] systemd[1]: var-lib-kubelet-pods-8cab976f\x2dc7e4\x2d49ae\x2dae16\x2d2445af0d5dbd-volumes-kubernetes.io\x7esecret-tls\x2dlb.mount: Deactivated successfully.2590machine # [ 64.730716] systemd[1]: var-lib-kubelet-pods-8cab976f\x2dc7e4\x2d49ae\x2dae16\x2d2445af0d5dbd-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully.2591machine # [ 64.731658] systemd[1]: var-lib-kubelet-pods-8cab976f\x2dc7e4\x2d49ae\x2dae16\x2d2445af0d5dbd-volumes-kubernetes.io\x7esecret-tls\x2dca.mount: Deactivated successfully.2592machine # [ 64.940365] cni0: port 3(vethf068f20b) entered blocking state2593machine # [ 64.941967] cni0: port 3(vethf068f20b) entered disabled state2594machine # [ 64.943352] vethf068f20b: entered allmulticast mode2595machine # [ 64.944907] vethf068f20b: entered promiscuous mode2596machine # [ 64.794580] (udev-worker)[5561]: Network interface NamePolicy= disabled on kernel command line.2597machine # [ 64.956453] cni0: port 3(vethf068f20b) entered blocking state2598machine # [ 64.958065] cni0: port 3(vethf068f20b) entered forwarding state2599machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found2600machine # [ 64.995360] cni0: port 4(vethba2c9076) entered blocking state2601machine # [ 64.997125] cni0: port 4(vethba2c9076) entered disabled state2602machine # [ 64.998720] vethba2c9076: entered allmulticast mode2603machine # [ 65.000050] vethba2c9076: entered promiscuous mode2604machine # [ 64.848354] (udev-worker)[5726]: Network interface NamePolicy= disabled on kernel command line.2605machine # [ 64.849497] dhcpcd[5125]: vethf068f20b: IAID fa:f8:20:622606machine # [ 64.849995] dhcpcd[5125]: vethf068f20b: adding address fe80::d805:faff:fef8:20622607machine # [ 65.014665] cni0: port 4(vethba2c9076) entered blocking state2608machine # [ 65.015947] cni0: port 4(vethba2c9076) entered forwarding state2609machine # [ 64.895298] dhcpcd[5125]: vethba2c9076: IAID 0f:d9:4c:f92610machine # [ 64.895517] dhcpcd[5125]: vethba2c9076: adding address fe80::e0ee:fff:fed9:4cf92611machine # [ 65.076356] cni0: port 5(veth36e9c6b7) entered blocking state2612machine # [ 65.078133] cni0: port 5(veth36e9c6b7) entered disabled state2613machine # [ 65.079657] veth36e9c6b7: entered allmulticast mode2614machine # [ 65.080924] veth36e9c6b7: entered promiscuous mode2615machine # [ 64.927367] k3s[888]: I0919 21:51:22.837062 888 scope.go:122] "RemoveContainer" containerID="df42a60a3e35495a43d72a452de97e8d6e500b4fde56fe52d7ae0ff17cf59ede"2616machine # [ 64.928080] k3s[888]: I0919 21:51:22.839028 888 scope.go:122] "RemoveContainer" containerID="3eb3b8b6fdd0186fe71ba6e674f137d33a6f7c779050c7f23153a111d7ae0376"2617machine # [ 64.928883] k3s[888]: E0919 21:51:22.839319 888 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"helm\" with CrashLoopBackOff: \"back-off 20s restarting failed container=helm pod=helm-install-nix-grpc-farm-7fwh5_kube-system(0758217b-c7d3-4cab-abc0-35bace80ed3f)\"" pod="kube-system/helm-install-nix-grpc-farm-7fwh5" podUID="0758217b-c7d3-4cab-abc0-35bace80ed3f"2618machine # [ 64.944688] systemd[1]: Started libcontainer container 18090416cf7b041eb4cce92b912b6701e44ff2ec15f360cf9a91c42a13f7fa0f.2619machine # [ 65.111731] cni0: port 5(veth36e9c6b7) entered blocking state2620machine # [ 65.112666] cni0: port 5(veth36e9c6b7) entered forwarding state2621machine # [ 64.986361] dhcpcd[5125]: veth36e9c6b7: IAID a6:e9:eb:c02622machine # [ 64.986757] dhcpcd[5125]: veth36e9c6b7: adding address fe80::e01b:a6ff:fee9:ebc02623machine # [ 65.011670] systemd[1]: Started libcontainer container 628d9968b1ade3828b8ad0ee7961e75e1141ae2d5692af660fe79950db0f7174.2624machine # [ 65.095527] systemd[1]: Started libcontainer container ad0cce4d009dbc8447c45ffb9c539a60786024cc6b0b4717b29c9ab58a701d96.2625machine # [ 65.099096] systemd[1]: Started libcontainer container 75cbf9b05847c0a7ccc8a249cca37520a8796070ec0e192dabcc5650067a3431.2626machine # [ 65.132551] systemd[1]: Started libcontainer container baea10602a8747ba2a9939f747d9c6dc41921dca1ea7480b03a4d9b5358f3f3b.2627machine # [ 65.221398] systemd[1]: Started libcontainer container 7cf06df1abf9fe1fcb88cd1fd2cfcf38ed3a0e0d482d02a3e92a565eae7b4be6.2628machine # [ 65.673190] systemd[1]: cri-containerd-baea10602a8747ba2a9939f747d9c6dc41921dca1ea7480b03a4d9b5358f3f3b.scope: Deactivated successfully.2629machine # [ 65.675329] systemd[1]: cri-containerd-baea10602a8747ba2a9939f747d9c6dc41921dca1ea7480b03a4d9b5358f3f3b.scope: Consumed 474ms CPU time over 540ms wall clock time, 304M memory peak, 164K read from disk, 170M written to disk.2630machine # [ 65.751746] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-baea10602a8747ba2a9939f747d9c6dc41921dca1ea7480b03a4d9b5358f3f3b-rootfs.mount: Deactivated successfully.2631machine # [ 65.754474] systemd[1]: cri-containerd-7cf06df1abf9fe1fcb88cd1fd2cfcf38ed3a0e0d482d02a3e92a565eae7b4be6.scope: Deactivated successfully.2632machine # [ 65.756053] systemd[1]: cri-containerd-7cf06df1abf9fe1fcb88cd1fd2cfcf38ed3a0e0d482d02a3e92a565eae7b4be6.scope: Consumed 477ms CPU time over 533ms wall clock time, 308.5M memory peak, 212K read from disk, 131.6M written to disk.2633machine # [ 65.824256] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-7cf06df1abf9fe1fcb88cd1fd2cfcf38ed3a0e0d482d02a3e92a565eae7b4be6-rootfs.mount: Deactivated successfully.2634machine # [ 65.992814] k3s[888]: I0919 21:51:23.904323 888 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-688d8d547b-jtnv7" podStartSLOduration=1.9042999809999999 podStartE2EDuration="1.904299981s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 21:51:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 21:51:23.874016802 +0000 UTC m=+44.664256207" watchObservedRunningTime="2026-09-19 21:51:23.904299981 +0000 UTC m=+44.694539665"2635machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found2636machine # [ 66.463305] dhcpcd[5125]: vethf068f20b: soliciting an IPv6 router2637machine # [ 66.496264] k3s[888]: I0919 21:51:24.408382 888 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8cab976f-c7e4-49ae-ae16-2445af0d5dbd" path="/var/lib/kubelet/pods/8cab976f-c7e4-49ae-ae16-2445af0d5dbd/volumes"2638machine # [ 66.546701] dhcpcd[5125]: vethf068f20b: soliciting a DHCP lease2639machine # [ 66.606734] dhcpcd[5125]: vethba2c9076: soliciting a DHCP lease2640machine # [ 66.660638] dhcpcd[5125]: vethba2c9076: soliciting an IPv6 router2641machine # [ 66.843783] dhcpcd[5125]: veth36e9c6b7: soliciting an IPv6 router2642machine # [ 66.943252] dhcpcd[5125]: veth36e9c6b7: soliciting a DHCP lease2643machine # [ 67.041428] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount1028553461.mount: Deactivated successfully.2644machine # [ 67.090311] systemd[1]: Started libcontainer container 7d71e2c7617c2a5254bbab4adac97f4dfc7e7948c53789f7782fd8ab3dcedae8.2645machine # [ 67.094285] systemd[1]: Started libcontainer container c8f77c7204f499cb31b01a80f809cd8cd7aabc344f3bc7af35479a0f3fcf1048.2646machine # [ 67.264359] systemd[1]: Started libcontainer container 2685b0de6c4da38912e1ee966ee1d7510faaf85833bbbb710292acb9a865879b.2647machine # [ 67.267283] systemd[1]: Started libcontainer container 61907770fefa2c0a75e9dae1a255d8b9b8f1bbcb98b36c7b276a6433510841eb.2648machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found2649machine # [ 67.406418] systemd[1]: Started libcontainer container 623677c2c463ad9dde9a9e7f356552d50ec77ab3ab073e817546db806545ccb7.2650machine # [ 67.422289] systemd[1]: Started libcontainer container d9973db08a094bfe31fdc16976a62fc6c7553eefcdc224331fdd6d461d510574.2651machine # [ 67.847261] dhcpcd[5125]: veth5805111a: using IPv4LL address 169.254.169.2342652machine # [ 67.850907] dhcpcd[5125]: flannel.1: adding route to 169.254.0.0/162653machine # [ 67.853810] dhcpcd[5125]: vethbb0eec57: adding route to 169.254.0.0/162654machine # [ 67.857108] dhcpcd[5125]: veth5805111a: adding route to 169.254.0.0/162655machine # [ 68.048960] k3s[888]: I0919 21:51:25.960417 888 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-p7ztl" podStartSLOduration=3.462898909 podStartE2EDuration="3.96036381s" totalImagesPullingTime="0s" totalInitContainerRuntime="497.464901ms" isStatefulPod=false podCreationTimestamp="2026-09-19 21:51:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 21:51:25.960315759 +0000 UTC m=+46.750559913" watchObservedRunningTime="2026-09-19 21:51:25.96036381 +0000 UTC m=+46.750606288"2656machine # [ 68.069398] k3s[888]: I0919 21:51:25.960705 888 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-fvc8j" podStartSLOduration=3.4536569520000002 podStartE2EDuration="3.960686756s" totalImagesPullingTime="0s" totalInitContainerRuntime="507.029804ms" isStatefulPod=false podCreationTimestamp="2026-09-19 21:51:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 21:51:25.941061077 +0000 UTC m=+46.731305231" watchObservedRunningTime="2026-09-19 21:51:25.960686756 +0000 UTC m=+46.750929234"2657machine # [ 68.421564] dhcpcd[5125]: veth0b1b91d2: using IPv4LL address 169.254.165.32658machine # [ 68.426138] dhcpcd[5125]: veth0b1b91d2: adding route to 169.254.0.0/162659machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found2660machine # [ 68.819253] dhcpcd[5125]: vethbb0eec57: using IPv4LL address 169.254.23.1552661machine # [ 69.301134] systemd[1]: cri-containerd-7a9a9e789d42c0d6d94de4ace88676b800e7aa5ac8ffbc0605e175fe3a85b25c.scope: Deactivated successfully.2662machine # [ 69.302211] systemd[1]: cri-containerd-7a9a9e789d42c0d6d94de4ace88676b800e7aa5ac8ffbc0605e175fe3a85b25c.scope: Consumed 118ms CPU time over 14.123s wall clock time, 13.2M memory peak, 5.3M read from disk, 7.6K incoming IP traffic, 8K outgoing IP traffic.2663machine # [ 69.317191] systemd[1]: cri-containerd-24a308907065bebf2d5cd6f758b420d05499227f69acccfa11bfa2b0427bd1e1.scope: Deactivated successfully.2664machine # [ 69.319311] systemd[1]: cri-containerd-24a308907065bebf2d5cd6f758b420d05499227f69acccfa11bfa2b0427bd1e1.scope: Consumed 130ms CPU time over 14.148s wall clock time, 19.1M memory peak, 11.6M read from disk, 7.5K incoming IP traffic, 8K outgoing IP traffic.2665machine # [ 69.385028] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-7a9a9e789d42c0d6d94de4ace88676b800e7aa5ac8ffbc0605e175fe3a85b25c-rootfs.mount: Deactivated successfully.2666machine # [ 69.399125] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-24a308907065bebf2d5cd6f758b420d05499227f69acccfa11bfa2b0427bd1e1-rootfs.mount: Deactivated successfully.2667machine # [ 69.432162] systemd[1]: cri-containerd-57d5e0e73588b96c5740a2fc231820872dc63c2ec7fdf27088c81d1fc10e665e.scope: Deactivated successfully.2668machine # [ 69.435200] systemd[1]: cri-containerd-8a558d8e2ce81c9252cbbd15dedde7137affc585115686e17de7c61eae5a29aa.scope: Deactivated successfully.2669machine # [ 69.477368] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-8a558d8e2ce81c9252cbbd15dedde7137affc585115686e17de7c61eae5a29aa-rootfs.mount: Deactivated successfully.2670machine # [ 69.479728] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-57d5e0e73588b96c5740a2fc231820872dc63c2ec7fdf27088c81d1fc10e665e-rootfs.mount: Deactivated successfully.2671machine # [ 69.495502] dhcpcd[5125]: flannel.1: using IPv4LL address 169.254.39.2272672machine # [ 69.513539] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-57d5e0e73588b96c5740a2fc231820872dc63c2ec7fdf27088c81d1fc10e665e-shm.mount: Deactivated successfully.2673machine # [ 69.722200] cni0: port 6(veth0b1b91d2) entered disabled state2674machine # [ 69.570269] dhcpcd[5125]: veth0b1b91d2: carrier lost[ 69.724719] veth0b1b91d2 (unregistering): left allmulticast mode2675machine # 2676machine # [ 69.726724] veth0b1b91d2 (unregistering): left promiscuous mode2677machine # [ 69.728104] cni0: port 6(veth0b1b91d2) entered disabled state2678machine # [ 69.730579] cni0: port 8(veth94b2c805) entered disabled state2679machine # [ 69.732710] veth94b2c805 (unregistering): left allmulticast mode2680machine # [ 69.734391] veth94b2c805 (unregistering): left promiscuous mode2681machine # [ 69.735701] cni0: port 8(veth94b2c805) entered disabled state2682machine # [ 69.626219] dhcpcd[5125]: veth0b1b91d2: deleting route to 169.254.0.0/162683machine # [ 69.737326] k3s[888]: I0919 21:51:27.648206 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc-niks3-token\" (UniqueName: \"kubernetes.io/projected/9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc-niks3-token\") pod \"9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc\" (UID: \"9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc\") "2684machine # [ 69.744180] k3s[888]: I0919 21:51:27.648253 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc-oidc\" (UniqueName: \"kubernetes.io/secret/9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc-oidc\") pod \"9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc\" (UID: \"9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc\") "2685machine # [ 69.751562] k3s[888]: I0919 21:51:27.648319 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc-nixconf\" (UniqueName: \"kubernetes.io/configmap/9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc-nixconf\") pod \"9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc\" (UID: \"9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc\") "2686machine # [ 69.759086] k3s[888]: I0919 21:51:27.648346 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f3164493-56a6-433c-b2ff-4d76f22a248d-ca\" (UniqueName: \"kubernetes.io/secret/f3164493-56a6-433c-b2ff-4d76f22a248d-ca\") pod \"f3164493-56a6-433c-b2ff-4d76f22a248d\" (UID: \"f3164493-56a6-433c-b2ff-4d76f22a248d\") "2687machine # [ 69.764640] k3s[888]: I0919 21:51:27.648375 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc-nix\" (UniqueName: \"kubernetes.io/empty-dir/9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc-nix\") pod \"9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc\" (UID: \"9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc\") "2688machine # [ 69.771722] k3s[888]: I0919 21:51:27.648401 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f3164493-56a6-433c-b2ff-4d76f22a248d-kube-api-access-cd5js\" (UniqueName: \"kubernetes.io/projected/f3164493-56a6-433c-b2ff-4d76f22a248d-kube-api-access-cd5js\") pod \"f3164493-56a6-433c-b2ff-4d76f22a248d\" (UID: \"f3164493-56a6-433c-b2ff-4d76f22a248d\") "2689machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found2690machine # [ 69.779055] k3s[888]: I0919 21:51:27.648428 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f3164493-56a6-433c-b2ff-4d76f22a248d-niks3-token\" (UniqueName: \"kubernetes.io/projected/f3164493-56a6-433c-b2ff-4d76f22a248d-niks3-token\") pod \"f3164493-56a6-433c-b2ff-4d76f22a248d\" (UID: \"f3164493-56a6-433c-b2ff-4d76f22a248d\") "2691machine # [ 69.785533] k3s[888]: I0919 21:51:27.648457 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f3164493-56a6-433c-b2ff-4d76f22a248d-tls\" (UniqueName: \"kubernetes.io/secret/f3164493-56a6-433c-b2ff-4d76f22a248d-tls\") pod \"f3164493-56a6-433c-b2ff-4d76f22a248d\" (UID: \"f3164493-56a6-433c-b2ff-4d76f22a248d\") "2692machine # [ 69.790442] k3s[888]: I0919 21:51:27.648488 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc-tls\" (UniqueName: \"kubernetes.io/secret/9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc-tls\") pod \"9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc\" (UID: \"9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc\") "2693machine # [ 69.797157] k3s[888]: I0919 21:51:27.648522 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f3164493-56a6-433c-b2ff-4d76f22a248d-oidc\" (UniqueName: \"kubernetes.io/secret/f3164493-56a6-433c-b2ff-4d76f22a248d-oidc\") pod \"f3164493-56a6-433c-b2ff-4d76f22a248d\" (UID: \"f3164493-56a6-433c-b2ff-4d76f22a248d\") "2694machine # [ 69.803386] k3s[888]: I0919 21:51:27.648550 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc-kube-api-access-g7nwd\" (UniqueName: \"kubernetes.io/projected/9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc-kube-api-access-g7nwd\") pod \"9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc\" (UID: \"9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc\") "2695machine # [ 69.804484] k3s[888]: I0919 21:51:27.648575 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc-build\" (UniqueName: \"kubernetes.io/empty-dir/9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc-build\") pod \"9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc\" (UID: \"9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc\") "2696machine # [ 69.804913] k3s[888]: I0919 21:51:27.648601 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc-ca\" (UniqueName: \"kubernetes.io/secret/9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc-ca\") pod \"9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc\" (UID: \"9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc\") "2697machine # [ 69.805677] k3s[888]: I0919 21:51:27.648626 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f3164493-56a6-433c-b2ff-4d76f22a248d-nix\" (UniqueName: \"kubernetes.io/empty-dir/f3164493-56a6-433c-b2ff-4d76f22a248d-nix\") pod \"f3164493-56a6-433c-b2ff-4d76f22a248d\" (UID: \"f3164493-56a6-433c-b2ff-4d76f22a248d\") "2698machine # [ 69.806755] k3s[888]: I0919 21:51:27.648656 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f3164493-56a6-433c-b2ff-4d76f22a248d-build\" (UniqueName: \"kubernetes.io/empty-dir/f3164493-56a6-433c-b2ff-4d76f22a248d-build\") pod \"f3164493-56a6-433c-b2ff-4d76f22a248d\" (UID: \"f3164493-56a6-433c-b2ff-4d76f22a248d\") "2699machine # [ 69.809809] k3s[888]: I0919 21:51:27.648688 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f3164493-56a6-433c-b2ff-4d76f22a248d-nixconf\" (UniqueName: \"kubernetes.io/configmap/f3164493-56a6-433c-b2ff-4d76f22a248d-nixconf\") pod \"f3164493-56a6-433c-b2ff-4d76f22a248d\" (UID: \"f3164493-56a6-433c-b2ff-4d76f22a248d\") "2700machine # [ 69.810795] k3s[888]: I0919 21:51:27.649009 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3164493-56a6-433c-b2ff-4d76f22a248d-nixconf" pod "f3164493-56a6-433c-b2ff-4d76f22a248d" (UID: "f3164493-56a6-433c-b2ff-4d76f22a248d"). InnerVolumeSpecName "nixconf". PluginName "kubernetes.io/configmap", VolumeGIDValue ""2701machine # [ 69.811612] k3s[888]: I0919 21:51:27.656947 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3164493-56a6-433c-b2ff-4d76f22a248d-tls" pod "f3164493-56a6-433c-b2ff-4d76f22a248d" (UID: "f3164493-56a6-433c-b2ff-4d76f22a248d"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""2702machine # [ 69.813545] k3s[888]: I0919 21:51:27.657186 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc-niks3-token" pod "9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc" (UID: "9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc"). InnerVolumeSpecName "niks3-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""2703machine # [ 69.814378] k3s[888]: I0919 21:51:27.658394 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc-build" pod "9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc" (UID: "9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc"). InnerVolumeSpecName "build". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""2704machine # [ 69.814951] k3s[888]: I0919 21:51:27.664579 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc-ca" pod "9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc" (UID: "9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc"). InnerVolumeSpecName "ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""2705machine # [ 69.815562] k3s[888]: I0919 21:51:27.664836 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc-oidc" pod "9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc" (UID: "9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc"). InnerVolumeSpecName "oidc". PluginName "kubernetes.io/secret", VolumeGIDValue ""2706machine # [ 69.816115] k3s[888]: I0919 21:51:27.665069 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc-nixconf" pod "9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc" (UID: "9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc"). InnerVolumeSpecName "nixconf". PluginName "kubernetes.io/configmap", VolumeGIDValue ""2707machine # [ 69.816893] k3s[888]: I0919 21:51:27.673387 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3164493-56a6-433c-b2ff-4d76f22a248d-oidc" pod "f3164493-56a6-433c-b2ff-4d76f22a248d" (UID: "f3164493-56a6-433c-b2ff-4d76f22a248d"). InnerVolumeSpecName "oidc". PluginName "kubernetes.io/secret", VolumeGIDValue ""2708machine # [ 69.867838] k3s[888]: I0919 21:51:27.673479 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc-kube-api-access-g7nwd" pod "9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc" (UID: "9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc"). InnerVolumeSpecName "kube-api-access-g7nwd". PluginName "kubernetes.io/projected", VolumeGIDValue ""2709machine # [ 69.868590] k3s[888]: I0919 21:51:27.677970 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3164493-56a6-433c-b2ff-4d76f22a248d-ca" pod "f3164493-56a6-433c-b2ff-4d76f22a248d" (UID: "f3164493-56a6-433c-b2ff-4d76f22a248d"). InnerVolumeSpecName "ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""2710machine # [ 69.869120] k3s[888]: I0919 21:51:27.678856 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc-tls" pod "9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc" (UID: "9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""2711machine # [ 69.869586] k3s[888]: I0919 21:51:27.679189 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3164493-56a6-433c-b2ff-4d76f22a248d-build" pod "f3164493-56a6-433c-b2ff-4d76f22a248d" (UID: "f3164493-56a6-433c-b2ff-4d76f22a248d"). InnerVolumeSpecName "build". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""2712machine # [ 69.870589] k3s[888]: I0919 21:51:27.686087 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3164493-56a6-433c-b2ff-4d76f22a248d-kube-api-access-cd5js" pod "f3164493-56a6-433c-b2ff-4d76f22a248d" (UID: "f3164493-56a6-433c-b2ff-4d76f22a248d"). InnerVolumeSpecName "kube-api-access-cd5js". PluginName "kubernetes.io/projected", VolumeGIDValue ""2713machine # [ 69.872332] k3s[888]: I0919 21:51:27.693352 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3164493-56a6-433c-b2ff-4d76f22a248d-niks3-token" pod "f3164493-56a6-433c-b2ff-4d76f22a248d" (UID: "f3164493-56a6-433c-b2ff-4d76f22a248d"). InnerVolumeSpecName "niks3-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""2714machine # [ 69.873065] dhcpcd[5125]: veth5805111a: no IPv6 Routers available2715machine # [ 69.873702] k3s[888]: I0919 21:51:27.763253 888 reconciler_common.go:299] "Volume detached for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc-ca\") on node \"machine\" DevicePath \"\""2716machine # [ 69.874778] k3s[888]: I0919 21:51:27.763312 888 reconciler_common.go:299] "Volume detached for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/f3164493-56a6-433c-b2ff-4d76f22a248d-build\") on node \"machine\" DevicePath \"\""2717machine # [ 69.876043] k3s[888]: I0919 21:51:27.763328 888 reconciler_common.go:299] "Volume detached for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/f3164493-56a6-433c-b2ff-4d76f22a248d-nixconf\") on node \"machine\" DevicePath \"\""2718machine # [ 69.876412] k3s[888]: I0919 21:51:27.763342 888 reconciler_common.go:299] "Volume detached for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc-niks3-token\") on node \"machine\" DevicePath \"\""2719machine # [ 69.876919] k3s[888]: I0919 21:51:27.763353 888 reconciler_common.go:299] "Volume detached for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc-oidc\") on node \"machine\" DevicePath \"\""2720machine # [ 69.877557] k3s[888]: I0919 21:51:27.763365 888 reconciler_common.go:299] "Volume detached for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc-nixconf\") on node \"machine\" DevicePath \"\""2721machine # [ 69.878330] k3s[888]: I0919 21:51:27.763382 888 reconciler_common.go:299] "Volume detached for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f3164493-56a6-433c-b2ff-4d76f22a248d-ca\") on node \"machine\" DevicePath \"\""2722machine # [ 69.880331] k3s[888]: I0919 21:51:27.763399 888 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cd5js\" (UniqueName: \"kubernetes.io/projected/f3164493-56a6-433c-b2ff-4d76f22a248d-kube-api-access-cd5js\") on node \"machine\" DevicePath \"\""2723machine # [ 69.880987] k3s[888]: I0919 21:51:27.763411 888 reconciler_common.go:299] "Volume detached for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/f3164493-56a6-433c-b2ff-4d76f22a248d-niks3-token\") on node \"machine\" DevicePath \"\""2724machine # [ 69.881701] k3s[888]: I0919 21:51:27.763424 888 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/f3164493-56a6-433c-b2ff-4d76f22a248d-tls\") on node \"machine\" DevicePath \"\""2725machine # [ 69.882852] k3s[888]: I0919 21:51:27.763436 888 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc-tls\") on node \"machine\" DevicePath \"\""2726machine # [ 69.883986] k3s[888]: I0919 21:51:27.763448 888 reconciler_common.go:299] "Volume detached for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/f3164493-56a6-433c-b2ff-4d76f22a248d-oidc\") on node \"machine\" DevicePath \"\""2727machine # [ 69.885036] k3s[888]: I0919 21:51:27.763462 888 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7nwd\" (UniqueName: \"kubernetes.io/projected/9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc-kube-api-access-g7nwd\") on node \"machine\" DevicePath \"\""2728machine # [ 69.888219] k3s[888]: I0919 21:51:27.763474 888 reconciler_common.go:299] "Volume detached for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc-build\") on node \"machine\" DevicePath \"\""2729machine # [ 69.952766] dhcpcd[5125]: dhcp_readbpf: unexpected event 0x01002730machine # [ 69.955220] dhcpcd[5125]: dhcp_readbpf: veth94b2c805: Network is down2731machine # [ 69.958232] dhcpcd[5125]: arp_read: unexpected event 0x01002732machine # [ 69.959659] dhcpcd[5125]: arp_read: veth94b2c805: Network is down2733machine # [ 69.961795] dhcpcd[5125]: veth0b1b91d2: removing interface2734machine # [ 69.963762] dhcpcd[5125]: vethbb0eec57: no IPv6 Routers available2735machine # [ 69.963942] dhcpcd[5125]: veth94b2c805: removing interface2736machine # [ 70.028054] k3s[888]: I0919 21:51:27.940092 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3164493-56a6-433c-b2ff-4d76f22a248d-nix" pod "f3164493-56a6-433c-b2ff-4d76f22a248d" (UID: "f3164493-56a6-433c-b2ff-4d76f22a248d"). InnerVolumeSpecName "nix". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""2737machine # [ 70.033548] k3s[888]: I0919 21:51:27.940367 888 scope.go:122] "RemoveContainer" containerID="5c9cde9a5ca55416a5a87963e1bda97429ce6c33f67d03caf69a4ffbf7bc1ed4"2738machine # [ 70.036095] dhcpcd[5125]: flannel.1: no IPv6 Routers available2739machine # [ 70.039115] k3s[888]: I0919 21:51:27.951283 888 scope.go:122] "RemoveContainer" containerID="24a308907065bebf2d5cd6f758b420d05499227f69acccfa11bfa2b0427bd1e1"2740machine # [ 70.048258] systemd[1]: Removed slice libcontainer container kubepods-besteffort-podf3164493_56a6_433c_b2ff_4d76f22a248d.slice.2741machine # [ 70.049359] systemd[1]: kubepods-besteffort-podf3164493_56a6_433c_b2ff_4d76f22a248d.slice: Consumed 777ms CPU time over 17.718s wall clock time, 311.6M memory peak, 5.4M read from disk, 283.8M written to disk, 7.6K incoming IP traffic, 8K outgoing IP traffic.2742machine # [ 70.052785] k3s[888]: I0919 21:51:27.964969 888 reconciler_common.go:299] "Volume detached for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/f3164493-56a6-433c-b2ff-4d76f22a248d-nix\") on node \"machine\" DevicePath \"\""2743machine # [ 70.056050] k3s[888]: I0919 21:51:27.967949 888 scope.go:122] "RemoveContainer" containerID="c3a99fffc38fab3375984f1c93affcd30755b415a1f4998ba41aeda43f2bf7ad"2744machine # [ 70.071573] k3s[888]: I0919 21:51:27.981596 888 scope.go:122] "RemoveContainer" containerID="1136cb5c9b5da00b6cd842e539ea1891a3b02a58803890a57ba84858e304367e"2745machine # [ 70.081384] k3s[888]: I0919 21:51:27.993563 888 scope.go:122] "RemoveContainer" containerID="5c9cde9a5ca55416a5a87963e1bda97429ce6c33f67d03caf69a4ffbf7bc1ed4"2746machine # [ 70.084101] k3s[888]: E0919 21:51:27.994699 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"5c9cde9a5ca55416a5a87963e1bda97429ce6c33f67d03caf69a4ffbf7bc1ed4\": not found" containerID="5c9cde9a5ca55416a5a87963e1bda97429ce6c33f67d03caf69a4ffbf7bc1ed4"2747machine # [ 70.089096] k3s[888]: I0919 21:51:27.994734 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"5c9cde9a5ca55416a5a87963e1bda97429ce6c33f67d03caf69a4ffbf7bc1ed4"} err="failed to get container status \"5c9cde9a5ca55416a5a87963e1bda97429ce6c33f67d03caf69a4ffbf7bc1ed4\": rpc error: code = NotFound desc = an error occurred when try to find container \"5c9cde9a5ca55416a5a87963e1bda97429ce6c33f67d03caf69a4ffbf7bc1ed4\": not found"2748machine # [ 70.095932] k3s[888]: I0919 21:51:27.994760 888 scope.go:122] "RemoveContainer" containerID="24a308907065bebf2d5cd6f758b420d05499227f69acccfa11bfa2b0427bd1e1"2749machine # [ 70.096294] k3s[888]: E0919 21:51:27.995540 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"24a308907065bebf2d5cd6f758b420d05499227f69acccfa11bfa2b0427bd1e1\": not found" containerID="24a308907065bebf2d5cd6f758b420d05499227f69acccfa11bfa2b0427bd1e1"2750machine # [ 70.096760] k3s[888]: I0919 21:51:27.995577 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"24a308907065bebf2d5cd6f758b420d05499227f69acccfa11bfa2b0427bd1e1"} err="failed to get container status \"24a308907065bebf2d5cd6f758b420d05499227f69acccfa11bfa2b0427bd1e1\": rpc error: code = NotFound desc = an error occurred when try to find container \"24a308907065bebf2d5cd6f758b420d05499227f69acccfa11bfa2b0427bd1e1\": not found"2751machine # [ 70.097468] k3s[888]: I0919 21:51:27.995612 888 scope.go:122] "RemoveContainer" containerID="c3a99fffc38fab3375984f1c93affcd30755b415a1f4998ba41aeda43f2bf7ad"2752machine # [ 70.097968] k3s[888]: E0919 21:51:27.996073 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"c3a99fffc38fab3375984f1c93affcd30755b415a1f4998ba41aeda43f2bf7ad\": not found" containerID="c3a99fffc38fab3375984f1c93affcd30755b415a1f4998ba41aeda43f2bf7ad"2753machine # [ 70.098666] k3s[888]: I0919 21:51:27.996094 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"c3a99fffc38fab3375984f1c93affcd30755b415a1f4998ba41aeda43f2bf7ad"} err="failed to get container status \"c3a99fffc38fab3375984f1c93affcd30755b415a1f4998ba41aeda43f2bf7ad\": rpc error: code = NotFound desc = an error occurred when try to find container \"c3a99fffc38fab3375984f1c93affcd30755b415a1f4998ba41aeda43f2bf7ad\": not found"2754machine # [ 70.098905] k3s[888]: I0919 21:51:27.996112 888 scope.go:122] "RemoveContainer" containerID="1136cb5c9b5da00b6cd842e539ea1891a3b02a58803890a57ba84858e304367e"2755machine # [ 70.099683] k3s[888]: E0919 21:51:27.997638 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"1136cb5c9b5da00b6cd842e539ea1891a3b02a58803890a57ba84858e304367e\": not found" containerID="1136cb5c9b5da00b6cd842e539ea1891a3b02a58803890a57ba84858e304367e"2756machine # [ 70.100454] k3s[888]: I0919 21:51:27.997664 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"1136cb5c9b5da00b6cd842e539ea1891a3b02a58803890a57ba84858e304367e"} err="failed to get container status \"1136cb5c9b5da00b6cd842e539ea1891a3b02a58803890a57ba84858e304367e\": rpc error: code = NotFound desc = an error occurred when try to find container \"1136cb5c9b5da00b6cd842e539ea1891a3b02a58803890a57ba84858e304367e\": not found"2757machine # [ 70.101127] k3s[888]: I0919 21:51:27.997683 888 scope.go:122] "RemoveContainer" containerID="6e34fc157e8c3caa6e646bb9fd43b11617a44ad5d0d4ad7489341937282a3bf9"2758machine # [ 70.101703] k3s[888]: I0919 21:51:28.005658 888 scope.go:122] "RemoveContainer" containerID="7a9a9e789d42c0d6d94de4ace88676b800e7aa5ac8ffbc0605e175fe3a85b25c"2759machine # [ 70.104071] k3s[888]: I0919 21:51:28.016234 888 scope.go:122] "RemoveContainer" containerID="94d1ad101da6f04948f27be21c70437f6e3e18c3fdf482e1eb5aa204393f08fa"2760machine # [ 70.113389] k3s[888]: I0919 21:51:28.025577 888 scope.go:122] "RemoveContainer" containerID="cdddee3343731d6f86ca15e371a68afea769aa565a65d4fa4fc8bc39ead9788e"2761machine # [ 70.117602] k3s[888]: I0919 21:51:28.029781 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc-nix" pod "9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc" (UID: "9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc"). InnerVolumeSpecName "nix". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""2762machine # [ 70.124684] k3s[888]: I0919 21:51:28.036726 888 scope.go:122] "RemoveContainer" containerID="6e34fc157e8c3caa6e646bb9fd43b11617a44ad5d0d4ad7489341937282a3bf9"2763machine # [ 70.125567] k3s[888]: E0919 21:51:28.037585 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"6e34fc157e8c3caa6e646bb9fd43b11617a44ad5d0d4ad7489341937282a3bf9\": not found" containerID="6e34fc157e8c3caa6e646bb9fd43b11617a44ad5d0d4ad7489341937282a3bf9"2764machine # [ 70.125694] k3s[888]: I0919 21:51:28.037620 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"6e34fc157e8c3caa6e646bb9fd43b11617a44ad5d0d4ad7489341937282a3bf9"} err="failed to get container status \"6e34fc157e8c3caa6e646bb9fd43b11617a44ad5d0d4ad7489341937282a3bf9\": rpc error: code = NotFound desc = an error occurred when try to find container \"6e34fc157e8c3caa6e646bb9fd43b11617a44ad5d0d4ad7489341937282a3bf9\": not found"2765machine # [ 70.126168] k3s[888]: I0919 21:51:28.037645 888 scope.go:122] "RemoveContainer" containerID="7a9a9e789d42c0d6d94de4ace88676b800e7aa5ac8ffbc0605e175fe3a85b25c"2766machine # [ 70.126629] k3s[888]: E0919 21:51:28.038157 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"7a9a9e789d42c0d6d94de4ace88676b800e7aa5ac8ffbc0605e175fe3a85b25c\": not found" containerID="7a9a9e789d42c0d6d94de4ace88676b800e7aa5ac8ffbc0605e175fe3a85b25c"2767machine # [ 70.126806] k3s[888]: I0919 21:51:28.038180 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"7a9a9e789d42c0d6d94de4ace88676b800e7aa5ac8ffbc0605e175fe3a85b25c"} err="failed to get container status \"7a9a9e789d42c0d6d94de4ace88676b800e7aa5ac8ffbc0605e175fe3a85b25c\": rpc error: code = NotFound desc = an error occurred when try to find container \"7a9a9e789d42c0d6d94de4ace88676b800e7aa5ac8ffbc0605e175fe3a85b25c\": not found"2768machine # [ 70.127478] k3s[888]: I0919 21:51:28.038198 888 scope.go:122] "RemoveContainer" containerID="94d1ad101da6f04948f27be21c70437f6e3e18c3fdf482e1eb5aa204393f08fa"2769machine # [ 70.127680] k3s[888]: E0919 21:51:28.038795 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"94d1ad101da6f04948f27be21c70437f6e3e18c3fdf482e1eb5aa204393f08fa\": not found" containerID="94d1ad101da6f04948f27be21c70437f6e3e18c3fdf482e1eb5aa204393f08fa"2770machine # [ 70.128148] k3s[888]: I0919 21:51:28.038831 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"94d1ad101da6f04948f27be21c70437f6e3e18c3fdf482e1eb5aa204393f08fa"} err="failed to get container status \"94d1ad101da6f04948f27be21c70437f6e3e18c3fdf482e1eb5aa204393f08fa\": rpc error: code = NotFound desc = an error occurred when try to find container \"94d1ad101da6f04948f27be21c70437f6e3e18c3fdf482e1eb5aa204393f08fa\": not found"2771machine # [ 70.168849] k3s[888]: I0919 21:51:28.038859 888 scope.go:122] "RemoveContainer" containerID="cdddee3343731d6f86ca15e371a68afea769aa565a65d4fa4fc8bc39ead9788e"2772machine # [ 70.169600] k3s[888]: E0919 21:51:28.039452 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"cdddee3343731d6f86ca15e371a68afea769aa565a65d4fa4fc8bc39ead9788e\": not found" containerID="cdddee3343731d6f86ca15e371a68afea769aa565a65d4fa4fc8bc39ead9788e"2773machine # [ 70.169748] k3s[888]: I0919 21:51:28.039473 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"cdddee3343731d6f86ca15e371a68afea769aa565a65d4fa4fc8bc39ead9788e"} err="failed to get container status \"cdddee3343731d6f86ca15e371a68afea769aa565a65d4fa4fc8bc39ead9788e\": rpc error: code = NotFound desc = an error occurred when try to find container \"cdddee3343731d6f86ca15e371a68afea769aa565a65d4fa4fc8bc39ead9788e\": not found"2774machine # [ 70.170409] k3s[888]: I0919 21:51:28.066163 888 reconciler_common.go:299] "Volume detached for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc-nix\") on node \"machine\" DevicePath \"\""2775machine # [ 70.336470] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod9dab768b_4c34_45f9_a1d7_ccbbdbeeecdc.slice.2776machine # [ 70.336726] systemd[1]: kubepods-besteffort-pod9dab768b_4c34_45f9_a1d7_ccbbdbeeecdc.slice: Consumed 752ms CPU time over 17.987s wall clock time, 314.3M memory peak, 11.7M read from disk, 283.8M written to disk, 7.5K incoming IP traffic, 8K outgoing IP traffic.2777machine # [ 70.385250] systemd[1]: var-lib-kubelet-pods-9dab768b\x2d4c34\x2d45f9\x2da1d7\x2dccbbdbeeecdc-volume\x2dsubpaths-nix-gc-0.mount: Deactivated successfully.2778machine # [ 70.385444] systemd[1]: var-lib-kubelet-pods-f3164493\x2d56a6\x2d433c\x2db2ff\x2d4d76f22a248d-volume\x2dsubpaths-nix-gc-0.mount: Deactivated successfully.2779machine # [ 70.386549] systemd[1]: var-lib-kubelet-pods-f3164493\x2d56a6\x2d433c\x2db2ff\x2d4d76f22a248d-volume\x2dsubpaths-nix-nix\x2dgrpc\x2ddaemon-0.mount: Deactivated successfully.2780machine # [ 70.388126] systemd[1]: var-lib-kubelet-pods-9dab768b\x2d4c34\x2d45f9\x2da1d7\x2dccbbdbeeecdc-volume\x2dsubpaths-nix-nix\x2dgrpc\x2ddaemon-0.mount: Deactivated successfully.2781machine # [ 70.388792] systemd[1]: var-lib-kubelet-pods-f3164493\x2d56a6\x2d433c\x2db2ff\x2d4d76f22a248d-volume\x2dsubpaths-nix-nix\x2ddaemon-0.mount: Deactivated successfully.2782machine # [ 70.389900] systemd[1]: var-lib-kubelet-pods-9dab768b\x2d4c34\x2d45f9\x2da1d7\x2dccbbdbeeecdc-volume\x2dsubpaths-nix-nix\x2ddaemon-0.mount: Deactivated successfully.2783machine # [ 70.391126] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-8a558d8e2ce81c9252cbbd15dedde7137affc585115686e17de7c61eae5a29aa-shm.mount: Deactivated successfully.2784machine # [ 70.391786] systemd[1]: run-netns-cni\x2d06b63e3a\x2d4b0d\x2d3eca\x2db832\x2d1424e77ea42b.mount: Deactivated successfully.2785machine # [ 70.392891] systemd[1]: run-netns-cni\x2db14504de\x2df682\x2df553\x2dea4b\x2da9e03561b39e.mount: Deactivated successfully.2786machine # [ 70.394024] systemd[1]: var-lib-kubelet-pods-9dab768b\x2d4c34\x2d45f9\x2da1d7\x2dccbbdbeeecdc-volumes-kubernetes.io\x7eprojected-niks3\x2dtoken.mount: Deactivated successfully.2787machine # [ 70.394781] systemd[1]: var-lib-kubelet-pods-f3164493\x2d56a6\x2d433c\x2db2ff\x2d4d76f22a248d-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dcd5js.mount: Deactivated successfully.2788machine # [ 70.395893] systemd[1]: var-lib-kubelet-pods-9dab768b\x2d4c34\x2d45f9\x2da1d7\x2dccbbdbeeecdc-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dg7nwd.mount: Deactivated successfully.2789machine # [ 70.396826] systemd[1]: var-lib-kubelet-pods-9dab768b\x2d4c34\x2d45f9\x2da1d7\x2dccbbdbeeecdc-volumes-kubernetes.io\x7esecret-ca.mount: Deactivated successfully.2790machine # [ 70.397716] systemd[1]: var-lib-kubelet-pods-f3164493\x2d56a6\x2d433c\x2db2ff\x2d4d76f22a248d-volumes-kubernetes.io\x7eprojected-niks3\x2dtoken.mount: Deactivated successfully.2791machine # [ 70.398756] systemd[1]: var-lib-kubelet-pods-9dab768b\x2d4c34\x2d45f9\x2da1d7\x2dccbbdbeeecdc-volumes-kubernetes.io\x7esecret-oidc.mount: Deactivated successfully.2792machine # [ 70.399650] systemd[1]: var-lib-kubelet-pods-f3164493\x2d56a6\x2d433c\x2db2ff\x2d4d76f22a248d-volumes-kubernetes.io\x7esecret-tls.mount: Deactivated successfully.2793machine # [ 70.400544] systemd[1]: var-lib-kubelet-pods-f3164493\x2d56a6\x2d433c\x2db2ff\x2d4d76f22a248d-volumes-kubernetes.io\x7esecret-oidc.mount: Deactivated successfully.2794machine # [ 70.401459] systemd[1]: var-lib-kubelet-pods-9dab768b\x2d4c34\x2d45f9\x2da1d7\x2dccbbdbeeecdc-volumes-kubernetes.io\x7esecret-tls.mount: Deactivated successfully.2795machine # [ 70.402071] systemd[1]: var-lib-kubelet-pods-f3164493\x2d56a6\x2d433c\x2db2ff\x2d4d76f22a248d-volumes-kubernetes.io\x7esecret-ca.mount: Deactivated successfully.2796machine # [ 70.494443] k3s[888]: I0919 21:51:28.405420 888 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc" path="/var/lib/kubelet/pods/9dab768b-4c34-45f9-a1d7-ccbbdbeeecdc/volumes"2797machine # [ 70.494898] k3s[888]: I0919 21:51:28.406132 888 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f3164493-56a6-433c-b2ff-4d76f22a248d" path="/var/lib/kubelet/pods/f3164493-56a6-433c-b2ff-4d76f22a248d/volumes"2798machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found2799machine # [ 71.547967] dhcpcd[5125]: vethf068f20b: probing for an IPv4LL address2800machine # [ 71.607791] dhcpcd[5125]: vethba2c9076: probing for an IPv4LL address2801machine # [ 71.944347] dhcpcd[5125]: veth36e9c6b7: probing for an IPv4LL address2802machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found2803machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found2804machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found2805machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found2806machine # [ 76.795859] dhcpcd[5125]: vethf068f20b: using IPv4LL address 169.254.24.1812807machine # [ 76.796890] dhcpcd[5125]: vethf068f20b: adding route to 169.254.0.0/162808machine # [ 76.946194] dhcpcd[5125]: vethba2c9076: using IPv4LL address 169.254.8.1302809machine # [ 76.946461] dhcpcd[5125]: vethba2c9076: adding route to 169.254.0.0/162810machine # [ 77.031907] dhcpcd[5125]: veth36e9c6b7: using IPv4LL address 169.254.153.2362811machine # [ 77.035270] dhcpcd[5125]: veth36e9c6b7: adding route to 169.254.0.0/162812machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found2813machine # [ 78.466548] dhcpcd[5125]: vethf068f20b: no IPv6 Routers available2814machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found2815machine # [ 78.663801] dhcpcd[5125]: vethba2c9076: no IPv6 Routers available2816machine # [ 78.845412] dhcpcd[5125]: veth36e9c6b7: no IPv6 Routers available2817machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found2818machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found2819machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found2820machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found2821machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found2822machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found2823machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found2824machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found2825machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found2826machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found2827machine # [ 91.490323] k3s[888]: I0919 21:51:49.402123 888 scope.go:122] "RemoveContainer" containerID="3eb3b8b6fdd0186fe71ba6e674f137d33a6f7c779050c7f23153a111d7ae0376"2828machine # [ 91.551162] systemd[1]: Started libcontainer container d4676778af2edf62a1b612f318021577bbdaebb4c2370d59c2686535d420fbe3.2829machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found2830machine # [ 92.664303] systemd[1]: cri-containerd-ad0cce4d009dbc8447c45ffb9c539a60786024cc6b0b4717b29c9ab58a701d96.scope: Deactivated successfully.2831machine # [ 92.664716] systemd[1]: cri-containerd-ad0cce4d009dbc8447c45ffb9c539a60786024cc6b0b4717b29c9ab58a701d96.scope: Consumed 334ms CPU time over 27.568s wall clock time, 15.8M memory peak, 35.7K incoming IP traffic, 30.9K outgoing IP traffic.2832machine # [ 92.686448] systemd[1]: cri-containerd-d9973db08a094bfe31fdc16976a62fc6c7553eefcdc224331fdd6d461d510574.scope: Deactivated successfully.2833machine # [ 92.687373] systemd[1]: cri-containerd-d9973db08a094bfe31fdc16976a62fc6c7553eefcdc224331fdd6d461d510574.scope: Consumed 37ms CPU time over 25.264s wall clock time, 6.8M memory peak, 5.1M read from disk.2834machine # [ 92.701734] systemd[1]: cri-containerd-623677c2c463ad9dde9a9e7f356552d50ec77ab3ab073e817546db806545ccb7.scope: Deactivated successfully.2835machine # [ 92.703293] systemd[1]: cri-containerd-623677c2c463ad9dde9a9e7f356552d50ec77ab3ab073e817546db806545ccb7.scope: Consumed 38ms CPU time over 25.295s wall clock time, 8.2M memory peak, 6.3M read from disk.2836machine # [ 92.739448] systemd[1]: cri-containerd-c8f77c7204f499cb31b01a80f809cd8cd7aabc344f3bc7af35479a0f3fcf1048.scope: Deactivated successfully.2837machine # [ 92.740634] systemd[1]: cri-containerd-c8f77c7204f499cb31b01a80f809cd8cd7aabc344f3bc7af35479a0f3fcf1048.scope: Consumed 79ms CPU time over 25.645s wall clock time, 40.2M memory peak, 30.4M read from disk.2838machine # [ 92.743648] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-ad0cce4d009dbc8447c45ffb9c539a60786024cc6b0b4717b29c9ab58a701d96-rootfs.mount: Deactivated successfully.2839machine # [ 92.752663] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-d9973db08a094bfe31fdc16976a62fc6c7553eefcdc224331fdd6d461d510574-rootfs.mount: Deactivated successfully.2840machine # [ 92.758384] systemd[1]: cri-containerd-7d71e2c7617c2a5254bbab4adac97f4dfc7e7948c53789f7782fd8ab3dcedae8.scope: Deactivated successfully.2841machine # [ 92.759045] systemd[1]: cri-containerd-7d71e2c7617c2a5254bbab4adac97f4dfc7e7948c53789f7782fd8ab3dcedae8.scope: Consumed 71ms CPU time over 25.668s wall clock time, 11.2M memory peak, 4.7M read from disk.2842machine # [ 92.768185] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-623677c2c463ad9dde9a9e7f356552d50ec77ab3ab073e817546db806545ccb7-rootfs.mount: Deactivated successfully.2843machine # [ 92.795563] systemd[1]: cri-containerd-18090416cf7b041eb4cce92b912b6701e44ff2ec15f360cf9a91c42a13f7fa0f.scope: Deactivated successfully.2844machine # [ 92.823315] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-c8f77c7204f499cb31b01a80f809cd8cd7aabc344f3bc7af35479a0f3fcf1048-rootfs.mount: Deactivated successfully.2845machine # [ 92.828464] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-7d71e2c7617c2a5254bbab4adac97f4dfc7e7948c53789f7782fd8ab3dcedae8-rootfs.mount: Deactivated successfully.2846machine # [ 93.082055] cni0: port 3(vethf068f20b) entered disabled state2847machine # [ 92.928655] dhcpcd[5125]: vethf068f20b: carrier lost2848machine # [ 93.084464] vethf068f20b (unregistering): left allmulticast mode2849machine # [ 93.085715] vethf068f20b (unregistering): left promiscuous mode2850machine # [ 93.087005] cni0: port 3(vethf068f20b) entered disabled state2851machine # [ 92.978780] dhcpcd[5125]: vethf068f20b: deleting address fe80::d805:faff:fef8:20622852machine # [ 92.984215] dhcpcd[5125]: vethf068f20b: deleting route to 169.254.0.0/162853machine # [ 93.089306] dhcpcd[5125]: vethf068f20b: removing interface2854machine # [ 93.124852] k3s[888]: I0919 21:51:51.036724 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/955e321a-589d-4504-a12a-a9555c293ed1-tmp\" (UniqueName: \"kubernetes.io/empty-dir/955e321a-589d-4504-a12a-a9555c293ed1-tmp\") pod \"955e321a-589d-4504-a12a-a9555c293ed1\" (UID: \"955e321a-589d-4504-a12a-a9555c293ed1\") "2855machine # [ 93.125283] k3s[888]: I0919 21:51:51.036773 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/955e321a-589d-4504-a12a-a9555c293ed1-tls-lb\" (UniqueName: \"kubernetes.io/secret/955e321a-589d-4504-a12a-a9555c293ed1-tls-lb\") pod \"955e321a-589d-4504-a12a-a9555c293ed1\" (UID: \"955e321a-589d-4504-a12a-a9555c293ed1\") "2856machine # [ 93.126074] k3s[888]: I0919 21:51:51.036806 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/955e321a-589d-4504-a12a-a9555c293ed1-config\" (UniqueName: \"kubernetes.io/configmap/955e321a-589d-4504-a12a-a9555c293ed1-config\") pod \"955e321a-589d-4504-a12a-a9555c293ed1\" (UID: \"955e321a-589d-4504-a12a-a9555c293ed1\") "2857machine # [ 93.126470] k3s[888]: I0919 21:51:51.036834 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/955e321a-589d-4504-a12a-a9555c293ed1-tls-ca\" (UniqueName: \"kubernetes.io/secret/955e321a-589d-4504-a12a-a9555c293ed1-tls-ca\") pod \"955e321a-589d-4504-a12a-a9555c293ed1\" (UID: \"955e321a-589d-4504-a12a-a9555c293ed1\") "2858machine # [ 93.148669] k3s[888]: I0919 21:51:51.060764 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/955e321a-589d-4504-a12a-a9555c293ed1-tls-ca" pod "955e321a-589d-4504-a12a-a9555c293ed1" (UID: "955e321a-589d-4504-a12a-a9555c293ed1"). InnerVolumeSpecName "tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""2859machine # [ 93.150619] k3s[888]: I0919 21:51:51.061340 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/955e321a-589d-4504-a12a-a9555c293ed1-tmp" pod "955e321a-589d-4504-a12a-a9555c293ed1" (UID: "955e321a-589d-4504-a12a-a9555c293ed1"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""2860machine # [ 93.151554] k3s[888]: I0919 21:51:51.062398 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/955e321a-589d-4504-a12a-a9555c293ed1-tls-lb" pod "955e321a-589d-4504-a12a-a9555c293ed1" (UID: "955e321a-589d-4504-a12a-a9555c293ed1"). InnerVolumeSpecName "tls-lb". PluginName "kubernetes.io/secret", VolumeGIDValue ""2861machine # [ 93.164881] k3s[888]: I0919 21:51:51.077056 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/955e321a-589d-4504-a12a-a9555c293ed1-config" pod "955e321a-589d-4504-a12a-a9555c293ed1" (UID: "955e321a-589d-4504-a12a-a9555c293ed1"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""2862machine # [ 93.178743] k3s[888]: I0919 21:51:51.089225 888 scope.go:122] "RemoveContainer" containerID="ad0cce4d009dbc8447c45ffb9c539a60786024cc6b0b4717b29c9ab58a701d96"2863machine # [ 93.190947] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod955e321a_589d_4504_a12a_a9555c293ed1.slice.2864machine # [ 93.191378] systemd[1]: kubepods-besteffort-pod955e321a_589d_4504_a12a_a9555c293ed1.slice: Consumed 364ms CPU time over 28.741s wall clock time, 16M memory peak, 35.7K incoming IP traffic, 30.9K outgoing IP traffic.2865machine # [ 93.195160] k3s[888]: I0919 21:51:51.107328 888 scope.go:122] "RemoveContainer" containerID="ad0cce4d009dbc8447c45ffb9c539a60786024cc6b0b4717b29c9ab58a701d96"2866machine # [ 93.196367] k3s[888]: E0919 21:51:51.108541 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"ad0cce4d009dbc8447c45ffb9c539a60786024cc6b0b4717b29c9ab58a701d96\": not found" containerID="ad0cce4d009dbc8447c45ffb9c539a60786024cc6b0b4717b29c9ab58a701d96"2867machine # [ 93.197319] k3s[888]: I0919 21:51:51.108576 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"ad0cce4d009dbc8447c45ffb9c539a60786024cc6b0b4717b29c9ab58a701d96"} err="failed to get container status \"ad0cce4d009dbc8447c45ffb9c539a60786024cc6b0b4717b29c9ab58a701d96\": rpc error: code = NotFound desc = an error occurred when try to find container \"ad0cce4d009dbc8447c45ffb9c539a60786024cc6b0b4717b29c9ab58a701d96\": not found"2868machine # [ 93.224964] k3s[888]: I0919 21:51:51.137135 888 reconciler_common.go:299] "Volume detached for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/955e321a-589d-4504-a12a-a9555c293ed1-tls-lb\") on node \"machine\" DevicePath \"\""2869machine # [ 93.225370] k3s[888]: I0919 21:51:51.137163 888 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/955e321a-589d-4504-a12a-a9555c293ed1-config\") on node \"machine\" DevicePath \"\""2870machine # [ 93.225932] k3s[888]: I0919 21:51:51.137177 888 reconciler_common.go:299] "Volume detached for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/955e321a-589d-4504-a12a-a9555c293ed1-tls-ca\") on node \"machine\" DevicePath \"\""2871machine # [ 93.226744] k3s[888]: I0919 21:51:51.137189 888 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/955e321a-589d-4504-a12a-a9555c293ed1-tmp\") on node \"machine\" DevicePath \"\""2872machine # [ 93.433080] k3s[888]: E0919 21:51:51.345124 888 status.go:71] "Unhandled Error" err="apiserver received an error that is not an metav1.Status: &errors.errorString{s:\"failed to create typed patch object (farm/nix-grpc-farm-scheduler; /v1, Kind=Service): .spec.selector.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}\"}: failed to create typed patch object (farm/nix-grpc-farm-scheduler; /v1, Kind=Service): .spec.selector.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}" logger="UnhandledError"2873machine # [ 93.443869] k3s[888]: I0919 21:51:51.356030 888 alloc.go:329] "allocated clusterIPs" service="farm/nix-grpc-farm" clusterIPs={"IPv4":"10.43.73.137"}2874machine # [ 93.450946] k3s[888]: E0919 21:51:51.363144 888 status.go:71] "Unhandled Error" err=<2875machine # [ 93.451412] k3s[888]: apiserver received an error that is not an metav1.Status: &errors.errorString{s:"failed to create typed patch object (farm/nix-grpc-farm-scheduler; apps/v1, Kind=Deployment): errors:\n .spec.selector.matchLabels.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}\n .spec.template.metadata.labels.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}"}: failed to create typed patch object (farm/nix-grpc-farm-scheduler; apps/v1, Kind=Deployment): errors:2876machine # [ 93.452095] k3s[888]: .spec.selector.matchLabels.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}2877machine # [ 93.452725] k3s[888]: .spec.template.metadata.labels.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}2878machine # [ 93.455072] k3s[888]: > logger="UnhandledError"2879machine # [ 93.487176] systemd[1]: cri-containerd-d4676778af2edf62a1b612f318021577bbdaebb4c2370d59c2686535d420fbe3.scope: Deactivated successfully.2880machine # [ 93.489409] systemd[1]: cri-containerd-d4676778af2edf62a1b612f318021577bbdaebb4c2370d59c2686535d420fbe3.scope: Consumed 756ms CPU time over 1.937s wall clock time, 31.7M memory peak, 3.3M incoming IP traffic, 198.4K outgoing IP traffic.2881machine # [ 93.571726] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod1089c142_023b_4122_b705_31689da73eb5.slice.2882machine # [ 93.581064] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod39f3aca1_daea_4d62_afac_2a4d997bc397.slice.2883machine # [ 93.591672] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod1039bfa3_cc1f_46c7_8406_c7fbb1352a93.slice.2884machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found2885machine # [ 93.627165] k3s[888]: I0919 21:51:51.539151 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1039bfa3-cc1f-46c7-8406-c7fbb1352a93-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-bfqjk\" (UID: \"1039bfa3-cc1f-46c7-8406-c7fbb1352a93\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-bfqjk"2886machine # [ 93.633472] k3s[888]: I0919 21:51:51.539208 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/39f3aca1-daea-4d62-afac-2a4d997bc397-tls-ca\") pod \"nix-grpc-farm-lb-688d8d547b-wl6qj\" (UID: \"39f3aca1-daea-4d62-afac-2a4d997bc397\") " pod="farm/nix-grpc-farm-lb-688d8d547b-wl6qj"2887machine # [ 93.638876] k3s[888]: I0919 21:51:51.539317 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/1089c142-023b-4122-b705-31689da73eb5-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-7q8dz\" (UID: \"1089c142-023b-4122-b705-31689da73eb5\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-7q8dz"2888machine # [ 93.645121] k3s[888]: I0919 21:51:51.539392 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1089c142-023b-4122-b705-31689da73eb5-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-7q8dz\" (UID: \"1089c142-023b-4122-b705-31689da73eb5\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-7q8dz"2889machine # [ 93.651300] k3s[888]: I0919 21:51:51.539426 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/1089c142-023b-4122-b705-31689da73eb5-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-7q8dz\" (UID: \"1089c142-023b-4122-b705-31689da73eb5\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-7q8dz"2890machine # [ 93.657425] k3s[888]: I0919 21:51:51.539451 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/1089c142-023b-4122-b705-31689da73eb5-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-7q8dz\" (UID: \"1089c142-023b-4122-b705-31689da73eb5\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-7q8dz"2891machine # [ 93.663831] k3s[888]: I0919 21:51:51.539474 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/1039bfa3-cc1f-46c7-8406-c7fbb1352a93-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-bfqjk\" (UID: \"1039bfa3-cc1f-46c7-8406-c7fbb1352a93\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-bfqjk"2892machine # [ 93.670037] k3s[888]: I0919 21:51:51.539507 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/1039bfa3-cc1f-46c7-8406-c7fbb1352a93-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-bfqjk\" (UID: \"1039bfa3-cc1f-46c7-8406-c7fbb1352a93\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-bfqjk"2893machine # [ 93.676858] k3s[888]: I0919 21:51:51.539534 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/1089c142-023b-4122-b705-31689da73eb5-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-7q8dz\" (UID: \"1089c142-023b-4122-b705-31689da73eb5\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-7q8dz"2894machine # [ 93.684518] k3s[888]: I0919 21:51:51.539560 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39f3aca1-daea-4d62-afac-2a4d997bc397-tmp\") pod \"nix-grpc-farm-lb-688d8d547b-wl6qj\" (UID: \"39f3aca1-daea-4d62-afac-2a4d997bc397\") " pod="farm/nix-grpc-farm-lb-688d8d547b-wl6qj"2895machine # [ 93.690881] k3s[888]: I0919 21:51:51.539584 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/1039bfa3-cc1f-46c7-8406-c7fbb1352a93-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-bfqjk\" (UID: \"1039bfa3-cc1f-46c7-8406-c7fbb1352a93\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-bfqjk"2896machine # [ 93.698358] k3s[888]: I0919 21:51:51.539609 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/1039bfa3-cc1f-46c7-8406-c7fbb1352a93-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-bfqjk\" (UID: \"1039bfa3-cc1f-46c7-8406-c7fbb1352a93\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-bfqjk"2897machine # [ 93.705558] k3s[888]: I0919 21:51:51.539633 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp6ct\" (UniqueName: \"kubernetes.io/projected/1039bfa3-cc1f-46c7-8406-c7fbb1352a93-kube-api-access-gp6ct\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-bfqjk\" (UID: \"1039bfa3-cc1f-46c7-8406-c7fbb1352a93\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-bfqjk"2898machine # [ 93.713636] k3s[888]: I0919 21:51:51.539660 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/1089c142-023b-4122-b705-31689da73eb5-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-7q8dz\" (UID: \"1089c142-023b-4122-b705-31689da73eb5\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-7q8dz"2899machine # [ 93.721081] k3s[888]: I0919 21:51:51.539686 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/1089c142-023b-4122-b705-31689da73eb5-build\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-7q8dz\" (UID: \"1089c142-023b-4122-b705-31689da73eb5\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-7q8dz"2900machine # [ 93.727629] k3s[888]: I0919 21:51:51.539712 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/39f3aca1-daea-4d62-afac-2a4d997bc397-config\") pod \"nix-grpc-farm-lb-688d8d547b-wl6qj\" (UID: \"39f3aca1-daea-4d62-afac-2a4d997bc397\") " pod="farm/nix-grpc-farm-lb-688d8d547b-wl6qj"2901machine # [ 93.737662] k3s[888]: I0919 21:51:51.539735 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/39f3aca1-daea-4d62-afac-2a4d997bc397-tls-lb\") pod \"nix-grpc-farm-lb-688d8d547b-wl6qj\" (UID: \"39f3aca1-daea-4d62-afac-2a4d997bc397\") " pod="farm/nix-grpc-farm-lb-688d8d547b-wl6qj"2902machine # [ 93.745736] k3s[888]: I0919 21:51:51.539764 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gds7q\" (UniqueName: \"kubernetes.io/projected/1089c142-023b-4122-b705-31689da73eb5-kube-api-access-gds7q\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-7q8dz\" (UID: \"1089c142-023b-4122-b705-31689da73eb5\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-7q8dz"2903machine # [ 93.755024] k3s[888]: I0919 21:51:51.539788 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/1039bfa3-cc1f-46c7-8406-c7fbb1352a93-build\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-bfqjk\" (UID: \"1039bfa3-cc1f-46c7-8406-c7fbb1352a93\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-bfqjk"2904machine # [ 93.755340] k3s[888]: I0919 21:51:51.539812 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/1039bfa3-cc1f-46c7-8406-c7fbb1352a93-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-bfqjk\" (UID: \"1039bfa3-cc1f-46c7-8406-c7fbb1352a93\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-bfqjk"2905machine # [ 93.756297] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-d4676778af2edf62a1b612f318021577bbdaebb4c2370d59c2686535d420fbe3-rootfs.mount: Deactivated successfully.2906machine # [ 93.757355] systemd[1]: var-lib-kubelet-pods-955e321a\x2d589d\x2d4504\x2da12a\x2da9555c293ed1-volume\x2dsubpaths-config-envoy-0.mount: Deactivated successfully.2907machine # [ 93.758312] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-18090416cf7b041eb4cce92b912b6701e44ff2ec15f360cf9a91c42a13f7fa0f-rootfs.mount: Deactivated successfully.2908machine # [ 93.759323] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-18090416cf7b041eb4cce92b912b6701e44ff2ec15f360cf9a91c42a13f7fa0f-shm.mount: Deactivated successfully.2909machine # [ 93.760175] systemd[1]: run-netns-cni\x2dd93b283b\x2da497\x2d2ffa\x2dc093\x2d4e2a6e59a86a.mount: Deactivated successfully.2910machine # [ 93.760918] systemd[1]: var-lib-kubelet-pods-955e321a\x2d589d\x2d4504\x2da12a\x2da9555c293ed1-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully.2911machine # [ 93.761781] systemd[1]: var-lib-kubelet-pods-955e321a\x2d589d\x2d4504\x2da12a\x2da9555c293ed1-volumes-kubernetes.io\x7esecret-tls\x2dca.mount: Deactivated successfully.2912machine # [ 93.762181] systemd[1]: var-lib-kubelet-pods-955e321a\x2d589d\x2d4504\x2da12a\x2da9555c293ed1-volumes-kubernetes.io\x7esecret-tls\x2dlb.mount: Deactivated successfully.2913machine # [ 94.058133] cni0: port 3(vethea686f0f) entered blocking state2914machine # [ 94.059876] cni0: port 3(vethea686f0f) entered disabled state2915machine # [ 94.061396] vethea686f0f: entered allmulticast mode2916machine # [ 94.062775] vethea686f0f: entered promiscuous mode2917machine # [ 93.911721] (udev-worker)[7575]: Network interface NamePolicy= disabled on kernel command line.2918machine # [ 94.079320] cni0: port 3(vethea686f0f) entered blocking state2919machine # [ 94.080642] cni0: port 3(vethea686f0f) entered forwarding state2920machine # [ 93.933498] (udev-worker)[7576]: Network interface NamePolicy= disabled on kernel command line.[ 94.089934] cni0: port 6(veth8e821e73) entered blocking state2921machine # 2922machine # [ 94.092594] cni0: port 6(veth8e821e73) entered disabled state2923machine # [ 94.094329] veth8e821e73: entered allmulticast mode2924machine # [ 94.096159] veth8e821e73: entered promiscuous mode2925machine # [ 94.106794] cni0: port 6(veth8e821e73) entered blocking state2926machine # [ 94.108742] cni0: port 6(veth8e821e73) entered forwarding state2927machine # [ 93.961901] dhcpcd[5125]: vethea686f0f: IAID 68:43:ac:d72928machine # [ 93.962421] dhcpcd[5125]: vethea686f0f: adding address fe80::9c79:68ff:fe43:acd72929machine # [ 93.984793] dhcpcd[5125]: veth8e821e73: IAID fd:25:34:fb2930machine # [ 93.985127] dhcpcd[5125]: veth8e821e73: adding address fe80::b47f:fdff:fe25:34fb2931machine # [ 94.035432] systemd[1]: Started libcontainer container 790feb824ce6eb184e4e4b05a67e43f82ccdef67b1c80731542b4dfee390ec43.2932machine # [ 94.055601] systemd[1]: Started libcontainer container dd328b3e56ef1f1928447a699f2e244582468dbe8e256a21dd077eca8f1e8728.2933machine # [ 94.135364] systemd[1]: Started libcontainer container d6befc003b8219fde148c883abc09ef66beba85014b3ebea88f32b075e1f4e7d.2934machine # [ 94.156321] systemd[1]: Started libcontainer container 35fed3bc7bd130667e23c8b0a061121690489dce04c5fc15c3869905d2c22b95.2935machine # [ 94.224718] k3s[888]: I0919 21:51:52.136590 888 scope.go:122] "RemoveContainer" containerID="bdbc4c9e321df63f2308289c7d567b805af33a0aac58b43029c19cf9ba682e79"2936machine # [ 94.226796] k3s[888]: I0919 21:51:52.138983 888 scope.go:122] "RemoveContainer" containerID="3eb3b8b6fdd0186fe71ba6e674f137d33a6f7c779050c7f23153a111d7ae0376"2937machine # [ 94.240390] (udev-worker)[7772]: Network interface NamePolicy= disabled on kernel command line.2938machine # [ 94.399418] cni0: port 7(veth9ac3d344) entered blocking state2939machine # [ 94.406883] cni0: port 7(veth9ac3d344) entered disabled state2940machine # [ 94.407759] veth9ac3d344: entered allmulticast mode2941machine # [ 94.259149] k3s[888]: I0919 21:51:52.171353 888 scope.go:122] "RemoveContainer" containerID="d4676778af2edf62a1b612f318021577bbdaebb4c2370d59c2686535d420fbe3"2942machine # [ 94.261042] k3s[888]: E0919 21:51:52.173222 888 pod_workers.go:1324] "Error syncin[ 94.416250] veth9ac3d344: entered promiscuous mode2943machine # g pod, skipping" err="failed to \"StartContainer\" for \"helm\" with CrashLoopBackOff: \"back-off 40s restarting failed container=helm pod=helm-install-nix-grpc-farm-7fwh5_kube-system(0758217b-c7d3-4cab-abc0-35bace80ed3f)\"" pod="kube-system/helm-install-nix-grpc-farm-7fwh5" podUID="0758217b-c7d3-4cab-abc0-35bace80ed3f"2944machine # [ 94.274544] k3s[888]: I0919 21:51:52.186728 888 scope.go:122] "RemoveContainer" containerID="c860694542143e1b450ee3f0fc411c5dbb1036addebc91c5461c661cfbf9c6b9"2945machine # [ 94.301446] k3s[888]: I0919 21:51:52.213590 888 scope.go:122] "RemoveContainer" containerID="3eb3b8b6fdd0186fe71ba6e674f137d33a6f7c779050c7f23153a111d7ae0376"2946machine # [ 94.302285] k3s[888]: E0919 21:51:52.214484 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"3eb3b8b6fdd0186fe71ba6e674f137d33a6f7c779050c7f23153a111d7ae0376\": not found" containerID="3eb3b8b6fdd0186fe71ba6e674f137d33a6f7c779050c7f23153a111d7ae0376"2947machine # [ 94.304871] k3s[888]: E0919 21:51:52.216313 888 kuberuntime_gc.go:151] "Failed to remove container" err="failed to get container status \"3eb3b8b6fdd0186fe71ba6e674f137d33a6f7c779050c7f23153a111d7ae0376\": rpc error: code = NotFound desc = an error occurred when try to find container \"3eb3b8b6fdd0186fe71ba6e674f137d33a6f7c779050c7f23153a111d7ae0376\": not found" containerID="3eb3b8b6fdd0186fe71ba6e674f137d33a6f7c779050c7f23153a111d7ae0376"2948machine # [ 94.473486] cni0: port 7(veth9ac3d344) entered blocking state2949machine # [ 94.474374] cni0: port 7(veth9ac3d344) entered forwarding state2950machine # [ 94.406546] dhcpcd[5125]: veth9ac3d344: waiting for carrier2951machine # [ 94.406799] dhcpcd[5125]: veth9ac3d344: carrier acquired2952machine # [ 94.427845] dhcpcd[5125]: veth9ac3d344: IAID b0:f9:bf:f52953machine # [ 94.428072] dhcpcd[5125]: veth9ac3d344: adding address fe80::9c21:b0ff:fef9:bff52954machine # [ 94.493050] k3s[888]: I0919 21:51:52.405057 888 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="955e321a-589d-4504-a12a-a9555c293ed1" path="/var/lib/kubelet/pods/955e321a-589d-4504-a12a-a9555c293ed1/volumes"2955machine # [ 94.600503] systemd[1]: Started libcontainer container c8e287c4947c53c256538096fea67283b15db1fe96dafad1b44f5a68bbba4285.2956machine # [ 94.778645] systemd[1]: cri-containerd-35fed3bc7bd130667e23c8b0a061121690489dce04c5fc15c3869905d2c22b95.scope: Deactivated successfully.2957machine # [ 94.780541] systemd[1]: cri-containerd-35fed3bc7bd130667e23c8b0a061121690489dce04c5fc15c3869905d2c22b95.scope: Consumed 483ms CPU time over 619ms wall clock time, 302.3M memory peak, 24K read from disk, 146.7M written to disk.2958machine # [ 94.782970] systemd[1]: cri-containerd-d6befc003b8219fde148c883abc09ef66beba85014b3ebea88f32b075e1f4e7d.scope: Deactivated successfully.2959machine # [ 94.784201] systemd[1]: cri-containerd-d6befc003b8219fde148c883abc09ef66beba85014b3ebea88f32b075e1f4e7d.scope: Consumed 483ms CPU time over 646ms wall clock time, 308.7M memory peak, 12K read from disk, 157.9M written to disk.2960machine # [ 94.862131] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-35fed3bc7bd130667e23c8b0a061121690489dce04c5fc15c3869905d2c22b95-rootfs.mount: Deactivated successfully.2961machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found2962machine # [ 94.936550] systemd[1]: Started libcontainer container 9d884a941b6dda2f2fc66822df3d0443b680715f86777d4012506901e6d19201.2963machine # [ 95.395196] systemd[1]: Started libcontainer container 7d38fba2a70d5f8787d85834ca0db306fdeca2537bed7593baad4216bbd19754.2964machine # [ 95.411845] systemd[1]: cri-containerd-61907770fefa2c0a75e9dae1a255d8b9b8f1bbcb98b36c7b276a6433510841eb.scope: Deactivated successfully.2965machine # [ 95.413248] systemd[1]: cri-containerd-61907770fefa2c0a75e9dae1a255d8b9b8f1bbcb98b36c7b276a6433510841eb.scope: Consumed 183ms CPU time over 28.144s wall clock time, 13M memory peak, 5M read from disk, 16.7K incoming IP traffic, 16.2K outgoing IP traffic.2966machine # [ 95.422116] systemd[1]: Started libcontainer container d2a76477593a6434b6b4b8ed43ea56d5f7b01fb9d9f54ba814ea4288ee4582d2.2967machine # [ 95.424851] dhcpcd[5125]: vethea686f0f: soliciting a DHCP lease2968machine # [ 95.461483] systemd[1]: cri-containerd-2685b0de6c4da38912e1ee966ee1d7510faaf85833bbbb710292acb9a865879b.scope: Deactivated successfully.2969machine # [ 95.465172] systemd[1]: cri-containerd-2685b0de6c4da38912e1ee966ee1d7510faaf85833bbbb710292acb9a865879b.scope: Consumed 193ms CPU time over 28.198s wall clock time, 23.9M memory peak, 16.2M read from disk, 16.4K incoming IP traffic, 15.9K outgoing IP traffic.2970machine # [ 95.513251] dhcpcd[5125]: veth8e821e73: soliciting an IPv6 router2971machine # [ 95.567297] systemd[1]: cri-containerd-75cbf9b05847c0a7ccc8a249cca37520a8796070ec0e192dabcc5650067a3431.scope: Deactivated successfully.2972machine # [ 95.598453] systemd[1]: cri-containerd-628d9968b1ade3828b8ad0ee7961e75e1141ae2d5692af660fe79950db0f7174.scope: Deactivated successfully.2973machine # [ 95.618329] systemd[1]: Started libcontainer container ca2057a9b9df6fbb95eaa2f9251328385539fcd8e2a1c692b4a671eddaa2010f.2974machine # [ 95.639534] dhcpcd[5125]: veth9ac3d344: soliciting a DHCP lease2975machine # [ 95.640895] systemd[1]: Started libcontainer container 91bfebd866e10c28cbdcd8f0d9525ccddb5879ed3d880e5c9d243d1254526c50.2976machine # [ 95.763731] dhcpcd[5125]: veth8e821e73: soliciting a DHCP lease2977machine # [ 95.766760] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-d6befc003b8219fde148c883abc09ef66beba85014b3ebea88f32b075e1f4e7d-rootfs.mount: Deactivated successfully.2978machine # [ 95.770081] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-61907770fefa2c0a75e9dae1a255d8b9b8f1bbcb98b36c7b276a6433510841eb-rootfs.mount: Deactivated successfully.2979machine # [ 95.771134] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-2685b0de6c4da38912e1ee966ee1d7510faaf85833bbbb710292acb9a865879b-rootfs.mount: Deactivated successfully.2980machine # [ 95.771937] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-75cbf9b05847c0a7ccc8a249cca37520a8796070ec0e192dabcc5650067a3431-rootfs.mount: Deactivated successfully.2981machine # [ 95.773066] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-75cbf9b05847c0a7ccc8a249cca37520a8796070ec0e192dabcc5650067a3431-shm.mount: Deactivated successfully.2982machine # [ 95.773573] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-628d9968b1ade3828b8ad0ee7961e75e1141ae2d5692af660fe79950db0f7174-rootfs.mount: Deactivated successfully.2983machine # [ 95.774164] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-628d9968b1ade3828b8ad0ee7961e75e1141ae2d5692af660fe79950db0f7174-shm.mount: Deactivated successfully.2984machine # [ 95.792639] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount431290925.mount: Deactivated successfully.2985machine # [ 95.807188] dhcpcd[5125]: vethea686f0f: soliciting an IPv6 router2986machine # [ 95.835294] d[ 95.988992] cni0: port 5(veth36e9c6b7) entered disabled state2987machine # hcpcd[5125]: veth36e9c6b7: carrier lost2988machine # [ 95.993724] veth36e9c6b7 (unregistering): left allmulticast mode2989machine # [ 95.995819] veth36e9c6b7 (unregistering): left promiscuous mode2990machine # [ 95.844319] systemd[1]: Start[ 95.998138] cni0: port 5(veth36e9c6b7) entered disabled state2991machine # ed libcontainer container 399563d2f8cea088f626c691dbd76abe75f0a0d514d4c34b24b5cada517b1d3a.2992machine # [ 95.859359] systemd[1]: Started libcontainer container 53e8f14ebdcaeae1c113dbd7391553dc36af6d5157ce1dbd7467bfd09b9b6e49.2993machine # [ 96.015547] cni0: port 4(vethba2c9076) entered disabled state2994machine # [ 96.020055] vethba2c9076 (unregistering): left allmulticast mode2995machine # [ 96.021737] vethba2c9076 (unregistering): left promiscuous mode2996machine # [ 96.022967] cni0: port 4(vethba2c9076) entered disabled state2997machine # [ 95.901789] dhcpcd[5125]: veth36e9c6b7: deleting address fe80::e01b:a6ff:fee9:ebc02998machine # [ 95.906307] dhcpcd[5125]: veth36e9c6b7: deleting route to 169.254.0.0/162999machine # [ 95.936470] k3s[888]: I0919 21:51:53.847827 888 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-688d8d547b-wl6qj" podStartSLOduration=2.847800338 podStartE2EDuration="2.847800338s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 21:51:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 21:51:53.264011617 +0000 UTC m=+74.054251301" watchObservedRunningTime="2026-09-19 21:51:53.847800338 +0000 UTC m=+74.638040023"3000machine # [ 95.954269] k3s[888]: I0919 21:51:53.865592 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8ee2855c-6889-4a07-ba1b-745f39ff15e0-kube-api-access-twpbn\" (UniqueName: \"kubernetes.io/projected/8ee2855c-6889-4a07-ba1b-745f39ff15e0-kube-api-access-twpbn\") pod \"8ee2855c-6889-4a07-ba1b-745f39ff15e0\" (UID: \"8ee2855c-6889-4a07-ba1b-745f39ff15e0\") "3001machine # [ 95.961628] k3s[888]: I0919 21:51:53.865645 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0e745c8c-184c-4e86-8671-f9243fa1a1c5-oidc\" (UniqueName: \"kubernetes.io/secret/0e745c8c-184c-4e86-8671-f9243fa1a1c5-oidc\") pod \"0e745c8c-184c-4e86-8671-f9243fa1a1c5\" (UID: \"0e745c8c-184c-4e86-8671-f9243fa1a1c5\") "3002machine # [ 95.968020] k3s[888]: I0919 21:51:53.865675 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8ee2855c-6889-4a07-ba1b-745f39ff15e0-build\" (UniqueName: \"kubernetes.io/empty-dir/8ee2855c-6889-4a07-ba1b-745f39ff15e0-build\") pod \"8ee2855c-6889-4a07-ba1b-745f39ff15e0\" (UID: \"8ee2855c-6889-4a07-ba1b-745f39ff15e0\") "3003machine # [ 95.977239] k3s[888]: I0919 21:51:53.865705 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0e745c8c-184c-4e86-8671-f9243fa1a1c5-nixconf\" (UniqueName: \"kubernetes.io/configmap/0e745c8c-184c-4e86-8671-f9243fa1a1c5-nixconf\") pod \"0e745c8c-184c-4e86-8671-f9243fa1a1c5\" (UID: \"0e745c8c-184c-4e86-8671-f9243fa1a1c5\") "3004machine # [ 95.985122] k3s[888]: I0919 21:51:53.865738 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8ee2855c-6889-4a07-ba1b-745f39ff15e0-oidc\" (UniqueName: \"kubernetes.io/secret/8ee2855c-6889-4a07-ba1b-745f39ff15e0-oidc\") pod \"8ee2855c-6889-4a07-ba1b-745f39ff15e0\" (UID: \"8ee2855c-6889-4a07-ba1b-745f39ff15e0\") "3005machine # [ 95.993946] k3s[888]: I0919 21:51:53.865766 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0e745c8c-184c-4e86-8671-f9243fa1a1c5-nix\" (UniqueName: \"kubernetes.io/empty-dir/0e745c8c-184c-4e86-8671-f9243fa1a1c5-nix\") pod \"0e745c8c-184c-4e86-8671-f9243fa1a1c5\" (UID: \"0e745c8c-184c-4e86-8671-f9243fa1a1c5\") "3006machine # [ 95.999490] k3s[888]: I0919 21:51:53.865793 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0e745c8c-184c-4e86-8671-f9243fa1a1c5-tls\" (UniqueName: \"kubernetes.io/secret/0e745c8c-184c-4e86-8671-f9243fa1a1c5-tls\") pod \"0e745c8c-184c-4e86-8671-f9243fa1a1c5\" (UID: \"0e745c8c-184c-4e86-8671-f9243fa1a1c5\") "3007machine # [ 96.006282] k3s[888]: I0919 21:51:53.865818 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0e745c8c-184c-4e86-8671-f9243fa1a1c5-ca\" (UniqueName: \"kubernetes.io/secret/0e745c8c-184c-4e86-8671-f9243fa1a1c5-ca\") pod \"0e745c8c-184c-4e86-8671-f9243fa1a1c5\" (UID: \"0e745c8c-184c-4e86-8671-f9243fa1a1c5\") "3008machine # [ 96.013334] k3s[888]: I0919 21:51:53.865844 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0e745c8c-184c-4e86-8671-f9243fa1a1c5-build\" (UniqueName: \"kubernetes.io/empty-dir/0e745c8c-184c-4e86-8671-f9243fa1a1c5-build\") pod \"0e745c8c-184c-4e86-8671-f9243fa1a1c5\" (UID: \"0e745c8c-184c-4e86-8671-f9243fa1a1c5\") "3009machine # [ 96.022189] k3s[888]: I0919 21:51:53.865875 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8ee2855c-6889-4a07-ba1b-745f39ff15e0-nix\" (UniqueName: \"kubernetes.io/empty-dir/8ee2855c-6889-4a07-ba1b-745f39ff15e0-nix\") pod \"8ee2855c-6889-4a07-ba1b-745f39ff15e0\" (UID: \"8ee2855c-6889-4a07-ba1b-745f39ff15e0\") "3010machine # [ 96.022315] k3s[888]: I0919 21:51:53.865904 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8ee2855c-6889-4a07-ba1b-745f39ff15e0-nixconf\" (UniqueName: \"kubernetes.io/configmap/8ee2855c-6889-4a07-ba1b-745f39ff15e0-nixconf\") pod \"8ee2855c-6889-4a07-ba1b-745f39ff15e0\" (UID: \"8ee2855c-6889-4a07-ba1b-745f39ff15e0\") "3011machine # [ 96.022850] k3s[888]: I0919 21:51:53.865930 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8ee2855c-6889-4a07-ba1b-745f39ff15e0-niks3-token\" (UniqueName: \"kubernetes.io/projected/8ee2855c-6889-4a07-ba1b-745f39ff15e0-niks3-token\") pod \"8ee2855c-6889-4a07-ba1b-745f39ff15e0\" (UID: \"8ee2855c-6889-4a07-ba1b-745f39ff15e0\") "3012machine # [ 96.023330] k3s[888]: I0919 21:51:53.865944 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ee2855c-6889-4a07-ba1b-745f39ff15e0-build" pod "8ee2855c-6889-4a07-ba1b-745f39ff15e0" (UID: "8ee2855c-6889-4a07-ba1b-745f39ff15e0"). InnerVolumeSpecName "build". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""3013machine # [ 96.023547] k3s[888]: I0919 21:51:53.865956 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8ee2855c-6889-4a07-ba1b-745f39ff15e0-ca\" (UniqueName: \"kubernetes.io/secret/8ee2855c-6889-4a07-ba1b-745f39ff15e0-ca\") pod \"8ee2855c-6889-4a07-ba1b-745f39ff15e0\" (UID: \"8ee2855c-6889-4a07-ba1b-745f39ff15e0\") "3014machine # [ 96.023971] k3s[888]: I0919 21:51:53.866039 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8ee2855c-6889-4a07-ba1b-745f39ff15e0-tls\" (UniqueName: \"kubernetes.io/secret/8ee2855c-6889-4a07-ba1b-745f39ff15e0-tls\") pod \"8ee2855c-6889-4a07-ba1b-745f39ff15e0\" (UID: \"8ee2855c-6889-4a07-ba1b-745f39ff15e0\") "3015machine # [ 96.024799] k3s[888]: I0919 21:51:53.866075 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0e745c8c-184c-4e86-8671-f9243fa1a1c5-niks3-token\" (UniqueName: \"kubernetes.io/projected/0e745c8c-184c-4e86-8671-f9243fa1a1c5-niks3-token\") pod \"0e745c8c-184c-4e86-8671-f9243fa1a1c5\" (UID: \"0e745c8c-184c-4e86-8671-f9243fa1a1c5\") "3016machine # [ 96.025537] k3s[888]: I0919 21:51:53.866105 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0e745c8c-184c-4e86-8671-f9243fa1a1c5-kube-api-access-6x9pp\" (UniqueName: \"kubernetes.io/projected/0e745c8c-184c-4e86-8671-f9243fa1a1c5-kube-api-access-6x9pp\") pod \"0e745c8c-184c-4e86-8671-f9243fa1a1c5\" (UID: \"0e745c8c-184c-4e86-8671-f9243fa1a1c5\") "3017machine # [ 96.026164] k3s[888]: I0919 21:51:53.866171 888 reconciler_common.go:299] "Volume detached for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/8ee2855c-6889-4a07-ba1b-745f39ff15e0-build\") on node \"machine\" DevicePath \"\""3018machine # [ 96.026461] k3s[888]: I0919 21:51:53.870637 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e745c8c-184c-4e86-8671-f9243fa1a1c5-nixconf" pod "0e745c8c-184c-4e86-8671-f9243fa1a1c5" (UID: "0e745c8c-184c-4e86-8671-f9243fa1a1c5"). InnerVolumeSpecName "nixconf". PluginName "kubernetes.io/configmap", VolumeGIDValue ""3019machine # [ 96.026941] k3s[888]: I0919 21:51:53.871343 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ee2855c-6889-4a07-ba1b-745f39ff15e0-nixconf" pod "8ee2855c-6889-4a07-ba1b-745f39ff15e0" (UID: "8ee2855c-6889-4a07-ba1b-745f39ff15e0"). InnerVolumeSpecName "nixconf". PluginName "kubernetes.io/configmap", VolumeGIDValue ""3020machine # [ 96.028142] k3s[888]: I0919 21:51:53.871869 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e745c8c-184c-4e86-8671-f9243fa1a1c5-build" pod "0e745c8c-184c-4e86-8671-f9243fa1a1c5" (UID: "0e745c8c-184c-4e86-8671-f9243fa1a1c5"). InnerVolumeSpecName "build". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""3021machine # [ 96.028860] k3s[888]: I0919 21:51:53.884100 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ee2855c-6889-4a07-ba1b-745f39ff15e0-kube-api-access-twpbn" pod "8ee2855c-6889-4a07-ba1b-745f39ff15e0" (UID: "8ee2855c-6889-4a07-ba1b-745f39ff15e0"). InnerVolumeSpecName "kube-api-access-twpbn". PluginName "kubernetes.io/projected", VolumeGIDValue ""3022machine # [ 96.080615] k3s[888]: I0919 21:51:53.895726 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ee2855c-6889-4a07-ba1b-745f39ff15e0-ca" pod "8ee2855c-6889-4a07-ba1b-745f39ff15e0" (UID: "8ee2855c-6889-4a07-ba1b-745f39ff15e0"). InnerVolumeSpecName "ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""3023machine # [ 96.081308] k3s[888]: I0919 21:51:53.899927 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e745c8c-184c-4e86-8671-f9243fa1a1c5-kube-api-access-6x9pp" pod "0e745c8c-184c-4e86-8671-f9243fa1a1c5" (UID: "0e745c8c-184c-4e86-8671-f9243fa1a1c5"). InnerVolumeSpecName "kube-api-access-6x9pp". PluginName "kubernetes.io/projected", VolumeGIDValue ""3024machine # [ 96.081976] k3s[888]: I0919 21:51:53.905889 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e745c8c-184c-4e86-8671-f9243fa1a1c5-tls" pod "0e745c8c-184c-4e86-8671-f9243fa1a1c5" (UID: "0e745c8c-184c-4e86-8671-f9243fa1a1c5"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""3025machine # [ 96.083202] k3s[888]: I0919 21:51:53.906019 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e745c8c-184c-4e86-8671-f9243fa1a1c5-oidc" pod "0e745c8c-184c-4e86-8671-f9243fa1a1c5" (UID: "0e745c8c-184c-4e86-8671-f9243fa1a1c5"). InnerVolumeSpecName "oidc". PluginName "kubernetes.io/secret", VolumeGIDValue ""3026machine # [ 96.083995] k3s[888]: I0919 21:51:53.907048 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e745c8c-184c-4e86-8671-f9243fa1a1c5-niks3-token" pod "0e745c8c-184c-4e86-8671-f9243fa1a1c5" (UID: "0e745c8c-184c-4e86-8671-f9243fa1a1c5"). InnerVolumeSpecName "niks3-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""3027machine # [ 96.085123] k3s[888]: I0919 21:51:53.908126 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ee2855c-6889-4a07-ba1b-745f39ff15e0-tls" pod "8ee2855c-6889-4a07-ba1b-745f39ff15e0" (UID: "8ee2855c-6889-4a07-ba1b-745f39ff15e0"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""3028machine # [ 96.086292] k3s[888]: I0919 21:51:53.907740 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ee2855c-6889-4a07-ba1b-745f39ff15e0-niks3-token" pod "8ee2855c-6889-4a07-ba1b-745f39ff15e0" (UID: "8ee2855c-6889-4a07-ba1b-745f39ff15e0"). InnerVolumeSpecName "niks3-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""3029machine # [ 96.087612] k3s[888]: I0919 21:51:53.911556 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e745c8c-184c-4e86-8671-f9243fa1a1c5-ca" pod "0e745c8c-184c-4e86-8671-f9243fa1a1c5" (UID: "0e745c8c-184c-4e86-8671-f9243fa1a1c5"). InnerVolumeSpecName "ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""3030machine # [ 96.088689] k3s[888]: I0919 21:51:53.919789 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ee2855c-6889-4a07-ba1b-745f39ff15e0-oidc" pod "8ee2855c-6889-4a07-ba1b-745f39ff15e0" (UID: "8ee2855c-6889-4a07-ba1b-745f39ff15e0"). InnerVolumeSpecName "oidc". PluginName "kubernetes.io/secret", VolumeGIDValue ""3031machine # [ 96.093875] k3s[888]: I0919 21:51:54.002752 888 reconciler_common.go:299] "Volume detached for volume \"ca\" (UniqueName: \"kubernetes.io/secret/8ee2855c-6889-4a07-ba1b-745f39ff15e0-ca\") on node \"machine\" DevicePath \"\""3032machine # [ 96.095435] k3s[888]: I0919 21:51:54.002780 888 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/8ee2855c-6889-4a07-ba1b-745f39ff15e0-tls\") on node \"machine\" DevicePath \"\""3033machine # [ 96.097666] k3s[888]: I0919 21:51:54.002796 888 reconciler_common.go:299] "Volume detached for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/0e745c8c-184c-4e86-8671-f9243fa1a1c5-niks3-token\") on node \"machine\" DevicePath \"\""3034machine # [ 96.099218] k3s[888]: I0919 21:51:54.002811 888 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6x9pp\" (UniqueName: \"kubernetes.io/projected/0e745c8c-184c-4e86-8671-f9243fa1a1c5-kube-api-access-6x9pp\") on node \"machine\" DevicePath \"\""3035machine # [ 96.099314] k3s[888]: I0919 21:51:54.002824 888 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twpbn\" (UniqueName: \"kubernetes.io/projected/8ee2855c-6889-4a07-ba1b-745f39ff15e0-kube-api-access-twpbn\") on node \"machine\" DevicePath \"\""3036machine # [ 96.101506] k3s[888]: I0919 21:51:54.002836 888 reconciler_common.go:299] "Volume detached for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/0e745c8c-184c-4e86-8671-f9243fa1a1c5-oidc\") on node \"machine\" DevicePath \"\""3037machine # [ 96.102213] k3s[888]: I0919 21:51:54.002850 888 reconciler_common.go:299] "Volume detached for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/0e745c8c-184c-4e86-8671-f9243fa1a1c5-nixconf\") on node \"machine\" DevicePath \"\""3038machine # [ 96.102692] k3s[888]: I0919 21:51:54.002862 888 reconciler_common.go:299] "Volume detached for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/8ee2855c-6889-4a07-ba1b-745f39ff15e0-oidc\") on node \"machine\" DevicePath \"\""3039machine # [ 96.104027] k3s[888]: I0919 21:51:54.002874 888 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/0e745c8c-184c-4e86-8671-f9243fa1a1c5-tls\") on node \"machine\" DevicePath \"\""3040machine # [ 96.104129] k3s[888]: I0919 21:51:54.002886 888 reconciler_common.go:299] "Volume detached for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0e745c8c-184c-4e86-8671-f9243fa1a1c5-ca\") on node \"machine\" DevicePath \"\""3041machine # [ 96.108185] k3s[888]: I0919 21:51:54.002898 888 reconciler_common.go:299] "Volume detached for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/0e745c8c-184c-4e86-8671-f9243fa1a1c5-build\") on node \"machine\" DevicePath \"\""3042machine # [ 96.111178] k3s[888]: I0919 21:51:54.002910 888 reconciler_common.go:299] "Volume detached for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/8ee2855c-6889-4a07-ba1b-745f39ff15e0-nixconf\") on node \"machine\" DevicePath \"\""3043machine # [ 96.113582] k3s[888]: I0919 21:51:54.002922 888 reconciler_common.go:299] "Volume detached for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/8ee2855c-6889-4a07-ba1b-745f39ff15e0-niks3-token\") on node \"machine\" DevicePath \"\""3044machine # [ 96.241087] k3s[888]: I0919 21:51:54.153137 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e745c8c-184c-4e86-8671-f9243fa1a1c5-nix" pod "0e745c8c-184c-4e86-8671-f9243fa1a1c5" (UID: "0e745c8c-184c-4e86-8671-f9243fa1a1c5"). InnerVolumeSpecName "nix". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""3045machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3046machine # [ 96.251342] dhcpcd[5125]: veth9ac3d344: soliciting an IPv6 router3047machine # [ 96.251843] dhcpcd[5125]: veth36e9c6b7: removing interface3048machine # [ 96.279265] k3s[888]: I0919 21:51:54.191362 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ee2855c-6889-4a07-ba1b-745f39ff15e0-nix" pod "8ee2855c-6889-4a07-ba1b-745f39ff15e0" (UID: "8ee2855c-6889-4a07-ba1b-745f39ff15e0"). InnerVolumeSpecName "nix". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""3049machine # [ 96.285719] dhcpcd[5125]: dhcp_readbpf: unexpected event 0x01003050machine # [ 96.285986] dhcpcd[5125]: dhcp_readbpf: vethba2c9076: Network is down3051machine # [ 96.291176] dhcpcd[5125]: arp_read: unexpected event 0x01003052machine # [ 96.291388] dhcpcd[5125]: arp_read: vethba2c9076: Network is down3053machine # [ 96.293287] k3s[888]: I0919 21:51:54.205428 888 reconciler_common.go:299] "Volume detached for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/8ee2855c-6889-4a07-ba1b-745f39ff15e0-nix\") on node \"machine\" DevicePath \"\""3054machine # [ 96.293690] k3s[888]: I0919 21:51:54.205461 888 reconciler_common.go:299] "Volume detached for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/0e745c8c-184c-4e86-8671-f9243fa1a1c5-nix\") on node \"machine\" DevicePath \"\""3055machine # [ 96.302366] dhcpcd[5125]: vethba2c9076: removing interface3056machine # [ 96.303723] dhcpcd[5125]: vethba2c9076: deleting address fe80::e0ee:fff:fed9:4cf93057machine # [ 96.304658] dhcpcd[5125]: vethba2c9076: deleting route to 169.254.0.0/163058machine # [ 96.330036] k3s[888]: I0919 21:51:54.242178 888 scope.go:122] "RemoveContainer" containerID="623677c2c463ad9dde9a9e7f356552d50ec77ab3ab073e817546db806545ccb7"3059machine # [ 96.338273] k3s[888]: I0919 21:51:54.250445 888 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-bfqjk" podStartSLOduration=2.662369228 podStartE2EDuration="3.25042637s" totalImagesPullingTime="0s" totalInitContainerRuntime="588.057142ms" isStatefulPod=false podCreationTimestamp="2026-09-19 21:51:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 21:51:54.248646815 +0000 UTC m=+75.038886499" watchObservedRunningTime="2026-09-19 21:51:54.25042637 +0000 UTC m=+75.040666334"3060machine # [ 96.347537] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod8ee2855c_6889_4a07_ba1b_745f39ff15e0.slice.3061machine # [ 96.347958] systemd[1]: kubepods-besteffort-pod8ee2855c_6889_4a07_ba1b_745f39ff15e0.slice: Consumed 800ms CPU time over 31.847s wall clock time, 304.4M memory peak, 53.2M read from disk, 283.8M written to disk, 16.4K incoming IP traffic, 15.9K outgoing IP traffic.3062machine # [ 96.349062] k3s[888]: I0919 21:51:54.261227 888 scope.go:122] "RemoveContainer" containerID="2685b0de6c4da38912e1ee966ee1d7510faaf85833bbbb710292acb9a865879b"3063machine # [ 96.361087] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod0e745c8c_184c_4e86_8671_f9243fa1a1c5.slice.3064machine # [ 96.361482] systemd[1]: kubepods-besteffort-pod0e745c8c_184c_4e86_8671_f9243fa1a1c5.slice: Consumed 783ms CPU time over 31.771s wall clock time, 319M memory peak, 15.1M read from disk, 283.8M written to disk, 16.7K incoming IP traffic, 16.2K outgoing IP traffic.3065machine # [ 96.369600] k3s[888]: I0919 21:51:54.281775 888 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-7q8dz" podStartSLOduration=2.7094838770000003 podStartE2EDuration="3.281756051s" totalImagesPullingTime="0s" totalInitContainerRuntime="572.272174ms" isStatefulPod=false podCreationTimestamp="2026-09-19 21:51:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 21:51:54.280738323 +0000 UTC m=+75.070978287" watchObservedRunningTime="2026-09-19 21:51:54.281756051 +0000 UTC m=+75.071996014"3066machine # [ 96.378757] k3s[888]: I0919 21:51:54.290934 888 scope.go:122] "RemoveContainer" containerID="c8f77c7204f499cb31b01a80f809cd8cd7aabc344f3bc7af35479a0f3fcf1048"3067machine # [ 96.394955] k3s[888]: I0919 21:51:54.307157 888 scope.go:122] "RemoveContainer" containerID="baea10602a8747ba2a9939f747d9c6dc41921dca1ea7480b03a4d9b5358f3f3b"3068machine # [ 96.406748] k3s[888]: I0919 21:51:54.318940 888 scope.go:122] "RemoveContainer" containerID="623677c2c463ad9dde9a9e7f356552d50ec77ab3ab073e817546db806545ccb7"3069machine # [ 96.408363] k3s[888]: E0919 21:51:54.320542 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"623677c2c463ad9dde9a9e7f356552d50ec77ab3ab073e817546db806545ccb7\": not found" containerID="623677c2c463ad9dde9a9e7f356552d50ec77ab3ab073e817546db806545ccb7"3070machine # [ 96.408551] k3s[888]: I0919 21:51:54.320593 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"623677c2c463ad9dde9a9e7f356552d50ec77ab3ab073e817546db806545ccb7"} err="failed to get container status \"623677c2c463ad9dde9a9e7f356552d50ec77ab3ab073e817546db806545ccb7\": rpc error: code = NotFound desc = an error occurred when try to find container \"623677c2c463ad9dde9a9e7f356552d50ec77ab3ab073e817546db806545ccb7\": not found"3071machine # [ 96.409206] k3s[888]: I0919 21:51:54.320628 888 scope.go:122] "RemoveContainer" containerID="2685b0de6c4da38912e1ee966ee1d7510faaf85833bbbb710292acb9a865879b"3072machine # [ 96.409904] k3s[888]: E0919 21:51:54.321190 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"2685b0de6c4da38912e1ee966ee1d7510faaf85833bbbb710292acb9a865879b\": not found" containerID="2685b0de6c4da38912e1ee966ee1d7510faaf85833bbbb710292acb9a865879b"3073machine # [ 96.410550] k3s[888]: I0919 21:51:54.321214 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"2685b0de6c4da38912e1ee966ee1d7510faaf85833bbbb710292acb9a865879b"} err="failed to get container status \"2685b0de6c4da38912e1ee966ee1d7510faaf85833bbbb710292acb9a865879b\": rpc error: code = NotFound desc = an error occurred when try to find container \"2685b0de6c4da38912e1ee966ee1d7510faaf85833bbbb710292acb9a865879b\": not found"3074machine # [ 96.411230] k3s[888]: I0919 21:51:54.321234 888 scope.go:122] "RemoveContainer" containerID="c8f77c7204f499cb31b01a80f809cd8cd7aabc344f3bc7af35479a0f3fcf1048"3075machine # [ 96.411913] k3s[888]: E0919 21:51:54.321909 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"c8f77c7204f499cb31b01a80f809cd8cd7aabc344f3bc7af35479a0f3fcf1048\": not found" containerID="c8f77c7204f499cb31b01a80f809cd8cd7aabc344f3bc7af35479a0f3fcf1048"3076machine # [ 96.412397] k3s[888]: I0919 21:51:54.321931 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"c8f77c7204f499cb31b01a80f809cd8cd7aabc344f3bc7af35479a0f3fcf1048"} err="failed to get container status \"c8f77c7204f499cb31b01a80f809cd8cd7aabc344f3bc7af35479a0f3fcf1048\": rpc error: code = NotFound desc = an error occurred when try to find container \"c8f77c7204f499cb31b01a80f809cd8cd7aabc344f3bc7af35479a0f3fcf1048\": not found"3077machine # [ 96.413069] k3s[888]: I0919 21:51:54.321950 888 scope.go:122] "RemoveContainer" containerID="baea10602a8747ba2a9939f747d9c6dc41921dca1ea7480b03a4d9b5358f3f3b"3078machine # [ 96.413756] k3s[888]: E0919 21:51:54.322480 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"baea10602a8747ba2a9939f747d9c6dc41921dca1ea7480b03a4d9b5358f3f3b\": not found" containerID="baea10602a8747ba2a9939f747d9c6dc41921dca1ea7480b03a4d9b5358f3f3b"3079machine # [ 96.413934] k3s[888]: I0919 21:51:54.322508 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"baea10602a8747ba2a9939f747d9c6dc41921dca1ea7480b03a4d9b5358f3f3b"} err="failed to get container status \"baea10602a8747ba2a9939f747d9c6dc41921dca1ea7480b03a4d9b5358f3f3b\": rpc error: code = NotFound desc = an error occurred when try to find container \"baea10602a8747ba2a9939f747d9c6dc41921dca1ea7480b03a4d9b5358f3f3b\": not found"3080machine # [ 96.414331] k3s[888]: I0919 21:51:54.322525 888 scope.go:122] "RemoveContainer" containerID="d9973db08a094bfe31fdc16976a62fc6c7553eefcdc224331fdd6d461d510574"3081machine # [ 96.420279] k3s[888]: I0919 21:51:54.332352 888 scope.go:122] "RemoveContainer" containerID="61907770fefa2c0a75e9dae1a255d8b9b8f1bbcb98b36c7b276a6433510841eb"3082machine # [ 96.428908] k3s[888]: I0919 21:51:54.341096 888 scope.go:122] "RemoveContainer" containerID="7d71e2c7617c2a5254bbab4adac97f4dfc7e7948c53789f7782fd8ab3dcedae8"3083machine # [ 96.438323] k3s[888]: I0919 21:51:54.350492 888 scope.go:122] "RemoveContainer" containerID="7cf06df1abf9fe1fcb88cd1fd2cfcf38ed3a0e0d482d02a3e92a565eae7b4be6"3084machine # [ 96.445371] k3s[888]: I0919 21:51:54.357525 888 scope.go:122] "RemoveContainer" containerID="d9973db08a094bfe31fdc16976a62fc6c7553eefcdc224331fdd6d461d510574"3085machine # [ 96.446511] k3s[888]: E0919 21:51:54.358702 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"d9973db08a094bfe31fdc16976a62fc6c7553eefcdc224331fdd6d461d510574\": not found" containerID="d9973db08a094bfe31fdc16976a62fc6c7553eefcdc224331fdd6d461d510574"3086machine # [ 96.447952] k3s[888]: I0919 21:51:54.358740 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"d9973db08a094bfe31fdc16976a62fc6c7553eefcdc224331fdd6d461d510574"} err="failed to get container status \"d9973db08a094bfe31fdc16976a62fc6c7553eefcdc224331fdd6d461d510574\": rpc error: code = NotFound desc = an error occurred when try to find container \"d9973db08a094bfe31fdc16976a62fc6c7553eefcdc224331fdd6d461d510574\": not found"3087machine # [ 96.448715] k3s[888]: I0919 21:51:54.358769 888 scope.go:122] "RemoveContainer" containerID="61907770fefa2c0a75e9dae1a255d8b9b8f1bbcb98b36c7b276a6433510841eb"3088machine # [ 96.450127] k3s[888]: E0919 21:51:54.359393 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"61907770fefa2c0a75e9dae1a255d8b9b8f1bbcb98b36c7b276a6433510841eb\": not found" containerID="61907770fefa2c0a75e9dae1a255d8b9b8f1bbcb98b36c7b276a6433510841eb"3089machine # [ 96.450503] k3s[888]: I0919 21:51:54.359571 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"61907770fefa2c0a75e9dae1a255d8b9b8f1bbcb98b36c7b276a6433510841eb"} err="failed to get container status \"61907770fefa2c0a75e9dae1a255d8b9b8f1bbcb98b36c7b276a6433510841eb\": rpc error: code = NotFound desc = an error occurred when try to find container \"61907770fefa2c0a75e9dae1a255d8b9b8f1bbcb98b36c7b276a6433510841eb\": not found"3090machine # [ 96.451290] k3s[888]: I0919 21:51:54.359601 888 scope.go:122] "RemoveContainer" containerID="7d71e2c7617c2a5254bbab4adac97f4dfc7e7948c53789f7782fd8ab3dcedae8"3091machine # [ 96.451828] k3s[888]: E0919 21:51:54.360283 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"7d71e2c7617c2a5254bbab4adac97f4dfc7e7948c53789f7782fd8ab3dcedae8\": not found" containerID="7d71e2c7617c2a5254bbab4adac97f4dfc7e7948c53789f7782fd8ab3dcedae8"3092machine # [ 96.511682] k3s[888]: I0919 21:51:54.360309 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"7d71e2c7617c2a5254bbab4adac97f4dfc7e7948c53789f7782fd8ab3dcedae8"} err="failed to get container status \"7d71e2c7617c2a5254bbab4adac97f4dfc7e7948c53789f7782fd8ab3dcedae8\": rpc error: code = NotFound desc = an error occurred when try to find container \"7d71e2c7617c2a5254bbab4adac97f4dfc7e7948c53789f7782fd8ab3dcedae8\": not found"3093machine # [ 96.512555] k3s[888]: I0919 21:51:54.360332 888 scope.go:122] "RemoveContainer" containerID="7cf06df1abf9fe1fcb88cd1fd2cfcf38ed3a0e0d482d02a3e92a565eae7b4be6"3094machine # [ 96.513073] k3s[888]: E0919 21:51:54.361184 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"7cf06df1abf9fe1fcb88cd1fd2cfcf38ed3a0e0d482d02a3e92a565eae7b4be6\": not found" containerID="7cf06df1abf9fe1fcb88cd1fd2cfcf38ed3a0e0d482d02a3e92a565eae7b4be6"3095machine # [ 96.513777] k3s[888]: I0919 21:51:54.361210 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"7cf06df1abf9fe1fcb88cd1fd2cfcf38ed3a0e0d482d02a3e92a565eae7b4be6"} err="failed to get container status \"7cf06df1abf9fe1fcb88cd1fd2cfcf38ed3a0e0d482d02a3e92a565eae7b4be6\": rpc error: code = NotFound desc = an error occurred when try to find container \"7cf06df1abf9fe1fcb88cd1fd2cfcf38ed3a0e0d482d02a3e92a565eae7b4be6\": not found"3096machine # [ 96.514850] k3s[888]: I0919 21:51:54.404732 888 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0e745c8c-184c-4e86-8671-f9243fa1a1c5" path="/var/lib/kubelet/pods/0e745c8c-184c-4e86-8671-f9243fa1a1c5/volumes"3097machine # [ 96.515290] k3s[888]: I0919 21:51:54.405493 888 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8ee2855c-6889-4a07-ba1b-745f39ff15e0" path="/var/lib/kubelet/pods/8ee2855c-6889-4a07-ba1b-745f39ff15e0/volumes"3098machine # [ 96.748838] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount2734353322.mount: Deactivated successfully.3099machine # [ 96.749227] systemd[1]: var-lib-kubelet-pods-0e745c8c\x2d184c\x2d4e86\x2d8671\x2df9243fa1a1c5-volume\x2dsubpaths-nix-gc-0.mount: Deactivated successfully.3100machine # [ 96.750047] systemd[1]: var-lib-kubelet-pods-8ee2855c\x2d6889\x2d4a07\x2dba1b\x2d745f39ff15e0-volume\x2dsubpaths-nix-gc-0.mount: Deactivated successfully.3101machine # [ 96.750844] systemd[1]: var-lib-kubelet-pods-0e745c8c\x2d184c\x2d4e86\x2d8671\x2df9243fa1a1c5-volume\x2dsubpaths-nix-nix\x2dgrpc\x2ddaemon-0.mount: Deactivated successfully.3102machine # [ 96.752798] systemd[1]: var-lib-kubelet-pods-8ee2855c\x2d6889\x2d4a07\x2dba1b\x2d745f39ff15e0-volume\x2dsubpaths-nix-nix\x2dgrpc\x2ddaemon-0.mount: Deactivated successfully.3103machine # [ 96.754977] systemd[1]: var-lib-kubelet-pods-0e745c8c\x2d184c\x2d4e86\x2d8671\x2df9243fa1a1c5-volume\x2dsubpaths-nix-nix\x2ddaemon-0.mount: Deactivated successfully.3104machine # [ 96.755879] systemd[1]: var-lib-kubelet-pods-8ee2855c\x2d6889\x2d4a07\x2dba1b\x2d745f39ff15e0-volume\x2dsubpaths-nix-nix\x2ddaemon-0.mount: Deactivated successfully.3105machine # [ 96.756710] systemd[1]: run-netns-cni\x2d516dc156\x2dd197\x2d8f50\x2d502f\x2d3bebfb5a2fba.mount: Deactivated successfully.3106machine # [ 96.758158] systemd[1]: run-netns-cni\x2d4b4cbedc\x2d3e5e\x2d2de2\x2d9049\x2d28bbe22013ab.mount: Deactivated successfully.3107machine # [ 96.758979] systemd[1]: var-lib-kubelet-pods-0e745c8c\x2d184c\x2d4e86\x2d8671\x2df9243fa1a1c5-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2d6x9pp.mount: Deactivated successfully.3108machine # [ 96.760096] systemd[1]: var-lib-kubelet-pods-0e745c8c\x2d184c\x2d4e86\x2d8671\x2df9243fa1a1c5-volumes-kubernetes.io\x7eprojected-niks3\x2dtoken.mount: Deactivated successfully.3109machine # [ 96.761090] systemd[1]: var-lib-kubelet-pods-0e745c8c\x2d184c\x2d4e86\x2d8671\x2df9243fa1a1c5-volumes-kubernetes.io\x7esecret-oidc.mount: Deactivated successfully.3110machine # [ 96.764900] systemd[1]: var-lib-kubelet-pods-0e745c8c\x2d184c\x2d4e86\x2d8671\x2df9243fa1a1c5-volumes-kubernetes.io\x7esecret-tls.mount: Deactivated successfully.3111machine # [ 96.767087] systemd[1]: var-lib-kubelet-pods-0e745c8c\x2d184c\x2d4e86\x2d8671\x2df9243fa1a1c5-volumes-kubernetes.io\x7esecret-ca.mount: Deactivated successfully.3112machine # [ 96.769164] systemd[1]: var-lib-kubelet-pods-8ee2855c\x2d6889\x2d4a07\x2dba1b\x2d745f39ff15e0-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dtwpbn.mount: Deactivated successfully.3113machine # [ 96.771058] systemd[1]: var-lib-kubelet-pods-8ee2855c\x2d6889\x2d4a07\x2dba1b\x2d745f39ff15e0-volumes-kubernetes.io\x7eprojected-niks3\x2dtoken.mount: Deactivated successfully.3114machine # [ 96.773271] systemd[1]: var-lib-kubelet-pods-8ee2855c\x2d6889\x2d4a07\x2dba1b\x2d745f39ff15e0-volumes-kubernetes.io\x7esecret-ca.mount: Deactivated successfully.3115machine # [ 96.775252] systemd[1]: var-lib-kubelet-pods-8ee2855c\x2d6889\x2d4a07\x2dba1b\x2d745f39ff15e0-volumes-kubernetes.io\x7esecret-oidc.mount: Deactivated successfully.3116machine # [ 96.777753] systemd[1]: var-lib-kubelet-pods-8ee2855c\x2d6889\x2d4a07\x2dba1b\x2d745f39ff15e0-volumes-kubernetes.io\x7esecret-tls.mount: Deactivated successfully.3117machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3118machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3119machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3120machine # [ 100.422984] dhcpcd[5125]: vethea686f0f: probing for an IPv4LL address3121machine # [ 100.640604] dhcpcd[5125]: veth9ac3d344: probing for an IPv4LL address3122machine # [ 100.764073] dhcpcd[5125]: veth8e821e73: probing for an IPv4LL address3123machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3124machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3125machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3126machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3127machine # [ 105.225919] dhcpcd[5125]: veth9ac3d344: using IPv4LL address 169.254.116.2023128machine # [ 105.230579] dhcpcd[5125]: veth9ac3d344: adding route to 169.254.0.0/163129machine # [ 105.712912] dhcpcd[5125]: vethea686f0f: using IPv4LL address 169.254.74.393130machine # [ 105.714589] dhcpcd[5125]: vethea686f0f: adding route to 169.254.0.0/163131machine # [ 105.842048] dhcpcd[5125]: veth8e821e73: using IPv4LL address 169.254.13.633132machine # [ 105.842339] dhcpcd[5125]: veth8e821e73: adding route to 169.254.0.0/163133machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3134machine # [ 107.517861] dhcpcd[5125]: veth8e821e73: no IPv6 Routers available3135machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3136machine # [ 107.809340] dhcpcd[5125]: vethea686f0f: no IPv6 Routers available3137machine # [ 108.254791] dhcpcd[5125]: veth9ac3d344: no IPv6 Routers available3138machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3139machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3140machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3141machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3142machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3143machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3144machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3145machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3146machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3147machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3148machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3149machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3150machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3151machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3152machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3153machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3154machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3155machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3156machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3157machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3158machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3159machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3160machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3161machine # [ 137.491336] k3s[888]: I0919 21:52:35.402736 888 scope.go:122] "RemoveContainer" containerID="d4676778af2edf62a1b612f318021577bbdaebb4c2370d59c2686535d420fbe3"3162machine # [ 137.577941] systemd[1]: Started libcontainer container 3efb052b77f7eb1252244ff8ff5e8b19a8073ed1d07e57871c0bbc337341b8e3.3163machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3164machine # [ 138.893528] systemd[1]: cri-containerd-9d884a941b6dda2f2fc66822df3d0443b680715f86777d4012506901e6d19201.scope: Deactivated successfully.3165machine # [ 138.894415] systemd[1]: cri-containerd-9d884a941b6dda2f2fc66822df3d0443b680715f86777d4012506901e6d19201.scope: Consumed 340ms CPU time over 43.956s wall clock time, 15.9M memory peak, 51.2K incoming IP traffic, 46.1K outgoing IP traffic.3166machine # [ 138.920336] systemd[1]: cri-containerd-53e8f14ebdcaeae1c113dbd7391553dc36af6d5157ce1dbd7467bfd09b9b6e49.scope: Deactivated successfully.3167machine # [ 138.924699] systemd[1]: cri-containerd-399563d2f8cea088f626c691dbd76abe75f0a0d514d4c34b24b5cada517b1d3a.scope: Deactivated successfully.3168machine # [ 138.955987] systemd[1]: cri-containerd-7d38fba2a70d5f8787d85834ca0db306fdeca2537bed7593baad4216bbd19754.scope: Deactivated successfully.3169machine # [ 138.959776] systemd[1]: cri-containerd-d2a76477593a6434b6b4b8ed43ea56d5f7b01fb9d9f54ba814ea4288ee4582d2.scope: Deactivated successfully.3170machine # [ 138.968519] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-9d884a941b6dda2f2fc66822df3d0443b680715f86777d4012506901e6d19201-rootfs.mount: Deactivated successfully.3171machine # [ 138.979690] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-53e8f14ebdcaeae1c113dbd7391553dc36af6d5157ce1dbd7467bfd09b9b6e49-rootfs.mount: Deactivated successfully.3172machine # [ 138.992934] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-399563d2f8cea088f626c691dbd76abe75f0a0d514d4c34b24b5cada517b1d3a-rootfs.mount: Deactivated successfully.3173machine # [ 139.008081] systemd[1]: cri-containerd-c8e287c4947c53c256538096fea67283b15db1fe96dafad1b44f5a68bbba4285.scope: Deactivated successfully.3174machine # [ 139.020811] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-7d38fba2a70d5f8787d85834ca0db306fdeca2537bed7593baad4216bbd19754-rootfs.mount: Deactivated successfully.3175machine # [ 139.030159] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-d2a76477593a6434b6b4b8ed43ea56d5f7b01fb9d9f54ba814ea4288ee4582d2-rootfs.mount: Deactivated successfully.3176machine # [ 139.284382] cni0: port 7(veth9ac3d344) entered disabled state3177machine # [ 139.131328] dhcpcd[5125]: veth9ac3d344: carrier lost3178machine # [ 139.286931] veth9ac3d344 (unregistering): left allmulticast mode3179machine # [ 139.288358] veth9ac3d344 (unregistering): left promiscuous mode3180machine # [ 139.289750] cni0: port 7(veth9ac3d344) entered disabled state3181machine # [ 139.185478] dhcpcd[5125]: veth9ac3d344: deleting address fe80::9c21:b0ff:fef9:bff53182machine # [ 139.191307] dhcpcd[5125]: veth9ac3d344: deleting route to 169.254.0.0/163183machine # [ 139.218731] k3s[888]: I0919 21:52:37.130467 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/39f3aca1-daea-4d62-afac-2a4d997bc397-tls-lb\" (UniqueName: \"kubernetes.io/secret/39f3aca1-daea-4d62-afac-2a4d997bc397-tls-lb\") pod \"39f3aca1-daea-4d62-afac-2a4d997bc397\" (UID: \"39f3aca1-daea-4d62-afac-2a4d997bc397\") "3184machine # [ 139.218920] k3s[888]: I0919 21:52:37.130576 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/39f3aca1-daea-4d62-afac-2a4d997bc397-tls-ca\" (UniqueName: \"kubernetes.io/secret/39f3aca1-daea-4d62-afac-2a4d997bc397-tls-ca\") pod \"39f3aca1-daea-4d62-afac-2a4d997bc397\" (UID: \"39f3aca1-daea-4d62-afac-2a4d997bc397\") "3185machine # [ 139.219467] k3s[888]: I0919 21:52:37.130612 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/39f3aca1-daea-4d62-afac-2a4d997bc397-config\" (UniqueName: \"kubernetes.io/configmap/39f3aca1-daea-4d62-afac-2a4d997bc397-config\") pod \"39f3aca1-daea-4d62-afac-2a4d997bc397\" (UID: \"39f3aca1-daea-4d62-afac-2a4d997bc397\") "3186machine # [ 139.221161] k3s[888]: I0919 21:52:37.130650 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/39f3aca1-daea-4d62-afac-2a4d997bc397-tmp\" (UniqueName: \"kubernetes.io/empty-dir/39f3aca1-daea-4d62-afac-2a4d997bc397-tmp\") pod \"39f3aca1-daea-4d62-afac-2a4d997bc397\" (UID: \"39f3aca1-daea-4d62-afac-2a4d997bc397\") "3187machine # [ 139.246451] k3s[888]: I0919 21:52:37.158619 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39f3aca1-daea-4d62-afac-2a4d997bc397-tmp" pod "39f3aca1-daea-4d62-afac-2a4d997bc397" (UID: "39f3aca1-daea-4d62-afac-2a4d997bc397"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""3188machine # [ 139.246619] k3s[888]: I0919 21:52:37.158785 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39f3aca1-daea-4d62-afac-2a4d997bc397-config" pod "39f3aca1-daea-4d62-afac-2a4d997bc397" (UID: "39f3aca1-daea-4d62-afac-2a4d997bc397"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""3189machine # [ 139.247790] k3s[888]: I0919 21:52:37.159476 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39f3aca1-daea-4d62-afac-2a4d997bc397-tls-lb" pod "39f3aca1-daea-4d62-afac-2a4d997bc397" (UID: "39f3aca1-daea-4d62-afac-2a4d997bc397"). InnerVolumeSpecName "tls-lb". PluginName "kubernetes.io/secret", VolumeGIDValue ""3190machine # [ 139.273101] k3s[888]: I0919 21:52:37.184611 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39f3aca1-daea-4d62-afac-2a4d997bc397-tls-ca" pod "39f3aca1-daea-4d62-afac-2a4d997bc397" (UID: "39f3aca1-daea-4d62-afac-2a4d997bc397"). InnerVolumeSpecName "tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""3191machine # [ 139.318845] k3s[888]: I0919 21:52:37.230990 888 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39f3aca1-daea-4d62-afac-2a4d997bc397-tmp\") on node \"machine\" DevicePath \"\""3192machine # [ 139.319045] k3s[888]: I0919 21:52:37.231023 888 reconciler_common.go:299] "Volume detached for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/39f3aca1-daea-4d62-afac-2a4d997bc397-tls-lb\") on node \"machine\" DevicePath \"\""3193machine # [ 139.319602] k3s[888]: I0919 21:52:37.231036 888 reconciler_common.go:299] "Volume detached for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/39f3aca1-daea-4d62-afac-2a4d997bc397-tls-ca\") on node \"machine\" DevicePath \"\""3194machine # [ 139.319846] k3s[888]: I0919 21:52:37.231049 888 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/39f3aca1-daea-4d62-afac-2a4d997bc397-config\") on node \"machine\" DevicePath \"\""3195machine # [ 139.357835] dhcpcd[5125]: veth9ac3d344: removing interface3196machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3197machine # [ 139.524658] k3s[888]: I0919 21:52:37.436232 888 scope.go:122] "RemoveContainer" containerID="9d884a941b6dda2f2fc66822df3d0443b680715f86777d4012506901e6d19201"3198machine # [ 139.536138] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod39f3aca1_daea_4d62_afac_2a4d997bc397.slice.3199machine # [ 139.536527] systemd[1]: kubepods-besteffort-pod39f3aca1_daea_4d62_afac_2a4d997bc397.slice: Consumed 375ms CPU time over 45.954s wall clock time, 16.2M memory peak, 51.2K incoming IP traffic, 46.1K outgoing IP traffic.3200machine # [ 139.538667] k3s[888]: I0919 21:52:37.450868 888 scope.go:122] "RemoveContainer" containerID="9d884a941b6dda2f2fc66822df3d0443b680715f86777d4012506901e6d19201"3201machine # [ 139.541172] k3s[888]: E0919 21:52:37.453368 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"9d884a941b6dda2f2fc66822df3d0443b680715f86777d4012506901e6d19201\": not found" containerID="9d884a941b6dda2f2fc66822df3d0443b680715f86777d4012506901e6d19201"3202machine # [ 139.542510] k3s[888]: I0919 21:52:37.453409 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"9d884a941b6dda2f2fc66822df3d0443b680715f86777d4012506901e6d19201"} err="failed to get container status \"9d884a941b6dda2f2fc66822df3d0443b680715f86777d4012506901e6d19201\": rpc error: code = NotFound desc = an error occurred when try to find container \"9d884a941b6dda2f2fc66822df3d0443b680715f86777d4012506901e6d19201\": not found"3203machine # [ 139.684143] k3s[888]: E0919 21:52:37.596251 888 status.go:71] "Unhandled Error" err="apiserver received an error that is not an metav1.Status: &errors.errorString{s:\"failed to create typed patch object (farm/nix-grpc-farm-scheduler; /v1, Kind=Service): .spec.selector.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}\"}: failed to create typed patch object (farm/nix-grpc-farm-scheduler; /v1, Kind=Service): .spec.selector.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}" logger="UnhandledError"3204machine # [ 139.693147] k3s[888]: I0919 21:52:37.601916 888 alloc.go:329] "allocated clusterIPs" service="farm/nix-grpc-farm" clusterIPs={"IPv4":"10.43.111.104"}3205machine # [ 139.697681] k3s[888]: E0919 21:52:37.609865 888 status.go:71] "Unhandled Error" err=<3206machine # [ 139.699346] k3s[888]: apiserver received an error that is not an metav1.Status: &errors.errorString{s:"failed to create typed patch object (farm/nix-grpc-farm-scheduler; apps/v1, Kind=Deployment): errors:\n .spec.selector.matchLabels.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}\n .spec.template.metadata.labels.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}"}: failed to create typed patch object (farm/nix-grpc-farm-scheduler; apps/v1, Kind=Deployment): errors:3207machine # [ 139.705952] k3s[888]: .spec.selector.matchLabels.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}3208machine # [ 139.708176] k3s[888]: .spec.template.metadata.labels.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}3209machine # [ 139.711773] k3s[888]: > logger="UnhandledError"3210machine # [ 139.729427] systemd[1]: cri-containerd-3efb052b77f7eb1252244ff8ff5e8b19a8073ed1d07e57871c0bbc337341b8e3.scope: Deactivated successfully.3211machine # [ 139.731851] systemd[1]: cri-containerd-3efb052b77f7eb1252244ff8ff5e8b19a8073ed1d07e57871c0bbc337341b8e3.scope: Consumed 870ms CPU time over 2.151s wall clock time, 36.9M memory peak, 3.3M incoming IP traffic, 199.9K outgoing IP traffic.3212machine # [ 139.777663] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod2b62ac4d_5e92_4c1a_af0f_7274fbba8175.slice.3213machine # [ 139.788075] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod97b70126_2cba_444d_8916_2b00a400e084.slice.3214machine # [ 139.794288] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod14f3d126_f395_4eb8_a428_22e1b61f593c.slice.3215machine # [ 139.824666] k3s[888]: I0919 21:52:37.736822 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/14f3d126-f395-4eb8-a428-22e1b61f593c-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-hnz4k\" (UID: \"14f3d126-f395-4eb8-a428-22e1b61f593c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-hnz4k"3216machine # [ 139.831247] k3s[888]: I0919 21:52:37.736870 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/14f3d126-f395-4eb8-a428-22e1b61f593c-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-hnz4k\" (UID: \"14f3d126-f395-4eb8-a428-22e1b61f593c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-hnz4k"3217machine # [ 139.837383] k3s[888]: I0919 21:52:37.736899 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/2b62ac4d-5e92-4c1a-af0f-7274fbba8175-tls-lb\") pod \"nix-grpc-farm-lb-688d8d547b-6l2bf\" (UID: \"2b62ac4d-5e92-4c1a-af0f-7274fbba8175\") " pod="farm/nix-grpc-farm-lb-688d8d547b-6l2bf"3218machine # [ 139.843224] k3s[888]: I0919 21:52:37.736925 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/97b70126-2cba-444d-8916-2b00a400e084-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-k2ng6\" (UID: \"97b70126-2cba-444d-8916-2b00a400e084\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-k2ng6"3219machine # [ 139.848985] k3s[888]: I0919 21:52:37.737078 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/14f3d126-f395-4eb8-a428-22e1b61f593c-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-hnz4k\" (UID: \"14f3d126-f395-4eb8-a428-22e1b61f593c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-hnz4k"3220machine # [ 139.855083] k3s[888]: I0919 21:52:37.737155 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/97b70126-2cba-444d-8916-2b00a400e084-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-k2ng6\" (UID: \"97b70126-2cba-444d-8916-2b00a400e084\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-k2ng6"3221machine # [ 139.861555] k3s[888]: I0919 21:52:37.737212 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/97b70126-2cba-444d-8916-2b00a400e084-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-k2ng6\" (UID: \"97b70126-2cba-444d-8916-2b00a400e084\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-k2ng6"3222machine # [ 139.867174] k3s[888]: I0919 21:52:37.737357 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm8xq\" (UniqueName: \"kubernetes.io/projected/14f3d126-f395-4eb8-a428-22e1b61f593c-kube-api-access-vm8xq\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-hnz4k\" (UID: \"14f3d126-f395-4eb8-a428-22e1b61f593c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-hnz4k"3223machine # [ 139.874565] k3s[888]: I0919 21:52:37.737405 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/97b70126-2cba-444d-8916-2b00a400e084-build\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-k2ng6\" (UID: \"97b70126-2cba-444d-8916-2b00a400e084\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-k2ng6"3224machine # [ 139.881650] k3s[888]: I0919 21:52:37.737570 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/97b70126-2cba-444d-8916-2b00a400e084-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-k2ng6\" (UID: \"97b70126-2cba-444d-8916-2b00a400e084\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-k2ng6"3225machine # [ 139.888440] k3s[888]: I0919 21:52:37.737675 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/97b70126-2cba-444d-8916-2b00a400e084-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-k2ng6\" (UID: \"97b70126-2cba-444d-8916-2b00a400e084\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-k2ng6"3226machine # [ 139.895548] k3s[888]: I0919 21:52:37.737702 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9n9t\" (UniqueName: \"kubernetes.io/projected/97b70126-2cba-444d-8916-2b00a400e084-kube-api-access-n9n9t\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-k2ng6\" (UID: \"97b70126-2cba-444d-8916-2b00a400e084\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-k2ng6"3227machine # [ 139.904463] k3s[888]: I0919 21:52:37.737729 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/14f3d126-f395-4eb8-a428-22e1b61f593c-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-hnz4k\" (UID: \"14f3d126-f395-4eb8-a428-22e1b61f593c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-hnz4k"3228machine # [ 139.913770] k3s[888]: I0919 21:52:37.737755 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/14f3d126-f395-4eb8-a428-22e1b61f593c-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-hnz4k\" (UID: \"14f3d126-f395-4eb8-a428-22e1b61f593c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-hnz4k"3229machine # [ 139.923114] k3s[888]: I0919 21:52:37.737781 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2b62ac4d-5e92-4c1a-af0f-7274fbba8175-config\") pod \"nix-grpc-farm-lb-688d8d547b-6l2bf\" (UID: \"2b62ac4d-5e92-4c1a-af0f-7274fbba8175\") " pod="farm/nix-grpc-farm-lb-688d8d547b-6l2bf"3230machine # [ 139.930643] k3s[888]: I0919 21:52:37.737810 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/14f3d126-f395-4eb8-a428-22e1b61f593c-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-hnz4k\" (UID: \"14f3d126-f395-4eb8-a428-22e1b61f593c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-hnz4k"3231machine # [ 139.942086] k3s[888]: I0919 21:52:37.737838 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b62ac4d-5e92-4c1a-af0f-7274fbba8175-tmp\") pod \"nix-grpc-farm-lb-688d8d547b-6l2bf\" (UID: \"2b62ac4d-5e92-4c1a-af0f-7274fbba8175\") " pod="farm/nix-grpc-farm-lb-688d8d547b-6l2bf"3232machine # [ 139.950657] k3s[888]: I0919 21:52:37.737866 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/2b62ac4d-5e92-4c1a-af0f-7274fbba8175-tls-ca\") pod \"nix-grpc-farm-lb-688d8d547b-6l2bf\" (UID: \"2b62ac4d-5e92-4c1a-af0f-7274fbba8175\") " pod="farm/nix-grpc-farm-lb-688d8d547b-6l2bf"3233machine # [ 139.958743] k3s[888]: I0919 21:52:37.737889 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/97b70126-2cba-444d-8916-2b00a400e084-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-k2ng6\" (UID: \"97b70126-2cba-444d-8916-2b00a400e084\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-k2ng6"3234machine # [ 139.959563] k3s[888]: I0919 21:52:37.737919 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/14f3d126-f395-4eb8-a428-22e1b61f593c-build\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-hnz4k\" (UID: \"14f3d126-f395-4eb8-a428-22e1b61f593c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-hnz4k"3235machine # [ 139.979155] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-3efb052b77f7eb1252244ff8ff5e8b19a8073ed1d07e57871c0bbc337341b8e3-rootfs.mount: Deactivated successfully.3236machine # [ 139.979370] systemd[1]: var-lib-kubelet-pods-39f3aca1\x2ddaea\x2d4d62\x2dafac\x2d2a4d997bc397-volume\x2dsubpaths-config-envoy-0.mount: Deactivated successfully.3237machine # [ 139.979809] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-c8e287c4947c53c256538096fea67283b15db1fe96dafad1b44f5a68bbba4285-rootfs.mount: Deactivated successfully.3238machine # [ 139.980702] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-c8e287c4947c53c256538096fea67283b15db1fe96dafad1b44f5a68bbba4285-shm.mount: Deactivated successfully.3239machine # [ 139.981601] systemd[1]: run-netns-cni\x2daf4dc073\x2de71b\x2d53e2\x2d925c\x2d4a35b52ab220.mount: Deactivated successfully.3240machine # [ 139.982168] systemd[1]: var-lib-kubelet-pods-39f3aca1\x2ddaea\x2d4d62\x2dafac\x2d2a4d997bc397-volumes-kubernetes.io\x7esecret-tls\x2dlb.mount: Deactivated successfully.3241machine # [ 139.982645] systemd[1]: var-lib-kubelet-pods-39f3aca1\x2ddaea\x2d4d62\x2dafac\x2d2a4d997bc397-volumes-kubernetes.io\x7esecret-tls\x2dca.mount: Deactivated successfully.3242machine # [ 139.983216] systemd[1]: var-lib-kubelet-pods-39f3aca1\x2ddaea\x2d4d62\x2dafac\x2d2a4d997bc397-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully.3243machine # [ 140.283776] cni0: port 4(vethc4c31fef) entered blocking state3244machine # [ 140.285449] cni0: port 4(vethc4c31fef) entered disabled state3245machine # [ 140.132167] (udev-worker)[10427]: Network interface NamePolic[ 140.286688] vethc4c31fef: entered allmulticast mode3246machine # y= disabled on kernel command line.3247machine # [ 140.290355] vethc4c31fef: entered promiscuous mode3248machine # [ 140.141422] (udev-worker)[10428]: Network interface NamePolic[ 140.295639] cni0: port 5(veth1baec785) entered blocking state3249machine # y= disabled on kernel command line.3250machine # [ 140.297940] cni0: port 5(veth1baec785) entered disabled state3251machine # [ 140.300328] veth1baec785: entered allmulticast mode3252machine # [ 140.302194] veth1baec785: entered promiscuous mode3253machine # [ 140.159671] (udev-worker)[106[ 140.313333] cni0: port 7(vetha1298504) entered blocking state3254machine # 31]: Network interface NamePolicy= disabled on kernel command li[ 140.315492] cni0: port 7(vetha1298504) entered disabled state3255machine # ne.3256machine # [ 140.317097] vetha1298504: entered allmulticast mode3257machine # [ 140.318770] vetha1298504: entered promiscuous mode3258machine # [ 140.321076] cni0: port 4(vethc4c31fef) entered blocking state3259machine # [ 140.322011] cni0: port 4(vethc4c31fef) entered forwarding state3260machine # [ 140.330596] cni0: port 5(veth1baec785) entered blocking state3261machine # [ 140.332450] cni0: port 5(veth1baec785) entered forwarding state3262machine # [ 140.347872] cni0: port 7(vetha1298504) entered blocking state3263machine # [ 140.349629] cni0: port 7(vetha1298504) entered forwarding state3264machine # [ 140.231578] dhcpcd[5125]: veth1baec785: waiting for carrier3265machine # [ 140.252711] dhcpcd[5125]: vethc4c31fef: IAID cf:c7:9b:953266machine # [ 140.252882] dhcpcd[5125]: vethc4c31fef: adding address fe80::40c3:cfff:fec7:9b953267machine # [ 140.273473] dhcpcd[5125]: vetha1298504: IAID cc:4d:03:ca3268machine # [ 140.273649] dhcpcd[5125]: vetha1298504: adding address fe80::c8bb:ccff:fe4d:3ca3269machine # [ 140.274545] dhcpcd[5125]: veth1baec785: carrier acquired3270machine # [ 140.285899] dhcpcd[5125]: veth1baec785: IAID 34:02:a3:d73271machine # [ 140.286395] dhcpcd[5125]: veth1baec785: adding address fe80::6cba:34ff:fe02:a3d73272machine # [ 140.317512] systemd[1]: Started libcontainer container 4b46750920671cff8b4b89fbacea0ea45ef1d4a59704b09fc62b9dd00a3965e5.3273machine # [ 140.319996] systemd[1]: Started libcontainer container 9c13a25be3d44c0c446942377e27fc8060a2d5c325288b18f610e555fb0ebb3f.3274machine # [ 140.324976] systemd[1]: Started libcontainer container 3cca0fc16a3ffee5529ac29236e994442e0c19b1a71428f512c4f0ef45f117d5.3275machine # [ 140.355119] dhcpcd[5125]: veth1baec785: soliciting a DHCP lease3276machine # [ 140.437599] systemd[1]: Started libcontainer container 5d6cbad5b9a38afcd226e4adf28e12e4921b0931b2a5458f73fb34076a537e93.3277machine # [ 140.439639] systemd[1]: Started libcontainer container 10b12da6185543316df7845c61276384d211588228d3737ce24d4891e0641f5d.3278machine # [ 140.466319] systemd[1]: Started libcontainer container 790c0d1d7fbc65a7446667e4dd367e829ab8660dcbf20314f5a5e128217bf4f0.3279machine # [ 140.501746] k3s[888]: I0919 21:52:38.413640 888 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="39f3aca1-daea-4d62-afac-2a4d997bc397" path="/var/lib/kubelet/pods/39f3aca1-daea-4d62-afac-2a4d997bc397/volumes"3280machine # [ 140.564979] k3s[888]: I0919 21:52:38.477138 888 scope.go:122] "RemoveContainer" containerID="d4676778af2edf62a1b612f318021577bbdaebb4c2370d59c2686535d420fbe3"3281machine # [ 140.567494] k3s[888]: I0919 21:52:38.479672 888 scope.go:122] "RemoveContainer" containerID="3efb052b77f7eb1252244ff8ff5e8b19a8073ed1d07e57871c0bbc337341b8e3"3282machine # [ 140.567663] k3s[888]: E0919 21:52:38.479830 888 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"helm\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=helm pod=helm-install-nix-grpc-farm-7fwh5_kube-system(0758217b-c7d3-4cab-abc0-35bace80ed3f)\"" pod="kube-system/helm-install-nix-grpc-farm-7fwh5" podUID="0758217b-c7d3-4cab-abc0-35bace80ed3f"3283machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3284machine # [ 141.043928] systemd[1]: cri-containerd-10b12da6185543316df7845c61276384d211588228d3737ce24d4891e0641f5d.scope: Deactivated successfully.3285machine # [ 141.050196] systemd[1]: cri-containerd-10b12da6185543316df7845c61276384d211588228d3737ce24d4891e0641f5d.scope: Consumed 502ms CPU time over 603ms wall clock time, 310M memory peak, 44K read from disk, 259.9M written to disk.3286machine # [ 141.056981] systemd[1]: cri-containerd-5d6cbad5b9a38afcd226e4adf28e12e4921b0931b2a5458f73fb34076a537e93.scope: Deactivated successfully.3287machine # [ 141.061218] systemd[1]: cri-containerd-5d6cbad5b9a38afcd226e4adf28e12e4921b0931b2a5458f73fb34076a537e93.scope: Consumed 498ms CPU time over 609ms wall clock time, 309.4M memory peak, 12K read from disk, 267M written to disk.3288machine # [ 141.113171] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-5d6cbad5b9a38afcd226e4adf28e12e4921b0931b2a5458f73fb34076a537e93-rootfs.mount: Deactivated successfully.3289machine # [ 141.115956] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-10b12da6185543316df7845c61276384d211588228d3737ce24d4891e0641f5d-rootfs.mount: Deactivated successfully.3290machine # [ 141.311429] dhcpcd[5125]: vetha1298504: soliciting an IPv6 router3291machine # [ 141.428413] dhcpcd[5125]: vetha1298504: soliciting a DHCP lease3292machine # [ 141.583923] dhcpcd[5125]: vethc4c31fef: soliciting a DHCP lease3293machine # [ 141.661082] k3s[888]: I0919 21:52:39.572063 888 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-688d8d547b-6l2bf" podStartSLOduration=2.571951587 podStartE2EDuration="2.571951587s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 21:52:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 21:52:38.591799361 +0000 UTC m=+119.382038766" watchObservedRunningTime="2026-09-19 21:52:39.571951587 +0000 UTC m=+120.362264186"3294machine # [ 141.738372] systemd[1]: Started libcontainer container f833aabf75df9a7a3b03835241d8c85ea26bfedf78443b964aefd935295f3785.3295machine # [ 141.742972] systemd[1]: Started libcontainer container 9e7f919ce17e1c7cb35d9228da4097810f270917cd33d1c200e8ddf3d4b1a62d.3296machine # [ 141.887423] systemd[1]: Started libcontainer container 26425fb1cbb6078482918f46c602ffcf7697c2ba6ed05618e4ad847375727d3a.3297machine # [ 141.894174] systemd[1]: Started libcontainer container 66a02954cd331774fd770df9c322e5cf0c704c6d7a38defdecb509c7d8a62500.3298machine # [ 142.012670] dhcpcd[5125]: vethc4c31fef: soliciting an IPv6 router3299machine # [ 142.015915] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount1049834343.mount: Deactivated successfully.3300machine # [ 142.016349] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount602638392.mount: Deactivated successfully.3301machine # [ 142.061514] systemd[1]: Started libcontainer container 81b859107ae751e3ab106bc2abc9a99a86026237c22e0580bf37b3027d58eca8.3302machine # [ 142.075328] systemd[1]: Started libcontainer container 3c022f3880654559459bc4e22e491049f6b8a9d287502c3f0c48081aa411bc5e.3303machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3304machine # [ 142.318370] dhcpcd[5125]: veth1baec785: soliciting an IPv6 router3305machine # [ 142.689181] k3s[888]: I0919 21:52:40.600587 888 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-hnz4k" podStartSLOduration=3.039136941 podStartE2EDuration="3.60053399s" totalImagesPullingTime="0s" totalInitContainerRuntime="561.397049ms" isStatefulPod=false podCreationTimestamp="2026-09-19 21:52:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 21:52:40.59768726 +0000 UTC m=+121.387932252" watchObservedRunningTime="2026-09-19 21:52:40.60053399 +0000 UTC m=+121.390780380"3306machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3307machine # [ 143.807479] systemd[1]: cri-containerd-ca2057a9b9df6fbb95eaa2f9251328385539fcd8e2a1c692b4a671eddaa2010f.scope: Deactivated successfully.3308machine # [ 143.815124] systemd[1]: cri-containerd-ca2057a9b9df6fbb95eaa2f9251328385539fcd8e2a1c692b4a671eddaa2010f.scope: Consumed 310ms CPU time over 48.188s wall clock time, 14.8M memory peak, 7M read from disk, 22.8K incoming IP traffic, 21.8K outgoing IP traffic.3309machine # [ 143.827699] systemd[1]: cri-containerd-91bfebd866e10c28cbdcd8f0d9525ccddb5879ed3d880e5c9d243d1254526c50.scope: Deactivated successfully.3310machine # [ 143.828700] systemd[1]: cri-containerd-91bfebd866e10c28cbdcd8f0d9525ccddb5879ed3d880e5c9d243d1254526c50.scope: Consumed 313ms CPU time over 48.187s wall clock time, 21.5M memory peak, 13.6M read from disk, 23.1K incoming IP traffic, 21.6K outgoing IP traffic.3311machine # [ 143.889085] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-91bfebd866e10c28cbdcd8f0d9525ccddb5879ed3d880e5c9d243d1254526c50-rootfs.mount: Deactivated successfully.3312machine # [ 143.894484] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-ca2057a9b9df6fbb95eaa2f9251328385539fcd8e2a1c692b4a671eddaa2010f-rootfs.mount: Deactivated successfully.3313machine # [ 143.934363] systemd[1]: cri-containerd-790feb824ce6eb184e4e4b05a67e43f82ccdef67b1c80731542b4dfee390ec43.scope: Deactivated successfully.3314machine # [ 143.943510] systemd[1]: cri-containerd-dd328b3e56ef1f1928447a699f2e244582468dbe8e256a21dd077eca8f1e8728.scope: Deactivated successfully.3315machine # [ 143.978666] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-790feb824ce6eb184e4e4b05a67e43f82ccdef67b1c80731542b4dfee390ec43-rootfs.mount: Deactivated successfully.3316machine # [ 143.989066] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-dd328b3e56ef1f1928447a699f2e244582468dbe8e256a21dd077eca8f1e8728-rootfs.mount: Deactivated successfully.3317machine # [ 144.018447] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-790feb824ce6eb184e4e4b05a67e43f82ccdef67b1c80731542b4dfee390ec43-shm.mount: Deactivated successfully.3318machine # [ 144.028355] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-dd328b3e56ef1f1928447a699f2e244582468dbe8e256a21dd077eca8f1e8728-shm.mount: Deactivated successfully.3319machine # [ 144.084835] dhcpcd[5125]: vethea686f0f: carrier lost3320machine # [ 144.238094] cni0: port 3(vethea686f0f) entered disabled state3321machine # [ 144.242545] vethea686f0f (unregistering): left allmulticast mode3322machine # [ 144.244139] vethea686f0f (unregistering): left promiscuous mode3323machine # [ 144.245510] cni0: port 3(vethea686f0f) entered disabled state3324machine # [ 144.251139] cni0: port 6(veth8e821e73) entered disabled state3325machine # [ 144.254860] veth8e821e73 (unregistering): left allmulticast mode3326machine # [ 144.256949] veth8e821e73 (unregistering): left promiscuous mode3327machine # [ 144.259163] cni0: port 6(veth8e821e73) entered disabled state3328machine # [ 144.112429] systemd[1]: run-netns-cni\x2d1755081d\x2d5361\x2deb8a\x2dd96a\x2d7dd0b6aabba2.mount: Deactivated successfully.3329machine # [ 144.147192] dhcpcd[5125]: vethea686f0f: deleting address fe80::9c79:68ff:fe43:acd73330machine # [ 144.148856] k3s[888]: I0919 21:52:42.060579 888 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-k2ng6" podStartSLOduration=4.494858828 podStartE2EDuration="5.0605581s" totalImagesPullingTime="0s" totalInitContainerRuntime="565.699272ms" isStatefulPod=false podCreationTimestamp="2026-09-19 21:52:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 21:52:40.633791569 +0000 UTC m=+121.424034327" watchObservedRunningTime="2026-09-19 21:52:42.0605581 +0000 UTC m=+122.850797505"3331machine # [ 144.159357] dhcpcd[5125]: vethea686f0f: deleting route to 169.254.0.0/163332machine # [ 144.267630] k3s[888]: I0919 21:52:42.179607 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1089c142-023b-4122-b705-31689da73eb5-kube-api-access-gds7q\" (UniqueName: \"kubernetes.io/projected/1089c142-023b-4122-b705-31689da73eb5-kube-api-access-gds7q\") pod \"1089c142-023b-4122-b705-31689da73eb5\" (UID: \"1089c142-023b-4122-b705-31689da73eb5\") "3333machine # [ 144.268083] k3s[888]: I0919 21:52:42.179665 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1039bfa3-cc1f-46c7-8406-c7fbb1352a93-tls\" (UniqueName: \"kubernetes.io/secret/1039bfa3-cc1f-46c7-8406-c7fbb1352a93-tls\") pod \"1039bfa3-cc1f-46c7-8406-c7fbb1352a93\" (UID: \"1039bfa3-cc1f-46c7-8406-c7fbb1352a93\") "3334machine # [ 144.268546] k3s[888]: I0919 21:52:42.179691 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1039bfa3-cc1f-46c7-8406-c7fbb1352a93-kube-api-access-gp6ct\" (UniqueName: \"kubernetes.io/projected/1039bfa3-cc1f-46c7-8406-c7fbb1352a93-kube-api-access-gp6ct\") pod \"1039bfa3-cc1f-46c7-8406-c7fbb1352a93\" (UID: \"1039bfa3-cc1f-46c7-8406-c7fbb1352a93\") "3335machine # [ 144.269276] k3s[888]: I0919 21:52:42.179723 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1089c142-023b-4122-b705-31689da73eb5-niks3-token\" (UniqueName: \"kubernetes.io/projected/1089c142-023b-4122-b705-31689da73eb5-niks3-token\") pod \"1089c142-023b-4122-b705-31689da73eb5\" (UID: \"1089c142-023b-4122-b705-31689da73eb5\") "3336machine # [ 144.269957] k3s[888]: I0919 21:52:42.180319 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1039bfa3-cc1f-46c7-8406-c7fbb1352a93-niks3-token\" (UniqueName: \"kubernetes.io/projected/1039bfa3-cc1f-46c7-8406-c7fbb1352a93-niks3-token\") pod \"1039bfa3-cc1f-46c7-8406-c7fbb1352a93\" (UID: \"1039bfa3-cc1f-46c7-8406-c7fbb1352a93\") "3337machine # [ 144.271067] k3s[888]: I0919 21:52:42.180492 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1039bfa3-cc1f-46c7-8406-c7fbb1352a93-ca\" (UniqueName: \"kubernetes.io/secret/1039bfa3-cc1f-46c7-8406-c7fbb1352a93-ca\") pod \"1039bfa3-cc1f-46c7-8406-c7fbb1352a93\" (UID: \"1039bfa3-cc1f-46c7-8406-c7fbb1352a93\") "3338machine # [ 144.271295] k3s[888]: I0919 21:52:42.180537 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1039bfa3-cc1f-46c7-8406-c7fbb1352a93-nix\" (UniqueName: \"kubernetes.io/empty-dir/1039bfa3-cc1f-46c7-8406-c7fbb1352a93-nix\") pod \"1039bfa3-cc1f-46c7-8406-c7fbb1352a93\" (UID: \"1039bfa3-cc1f-46c7-8406-c7fbb1352a93\") "3339machine # [ 144.271893] k3s[888]: I0919 21:52:42.180566 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1039bfa3-cc1f-46c7-8406-c7fbb1352a93-nixconf\" (UniqueName: \"kubernetes.io/configmap/1039bfa3-cc1f-46c7-8406-c7fbb1352a93-nixconf\") pod \"1039bfa3-cc1f-46c7-8406-c7fbb1352a93\" (UID: \"1039bfa3-cc1f-46c7-8406-c7fbb1352a93\") "3340machine # [ 144.272815] k3s[888]: I0919 21:52:42.180598 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1039bfa3-cc1f-46c7-8406-c7fbb1352a93-oidc\" (UniqueName: \"kubernetes.io/secret/1039bfa3-cc1f-46c7-8406-c7fbb1352a93-oidc\") pod \"1039bfa3-cc1f-46c7-8406-c7fbb1352a93\" (UID: \"1039bfa3-cc1f-46c7-8406-c7fbb1352a93\") "3341machine # [ 144.273460] k3s[888]: I0919 21:52:42.180623 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1089c142-023b-4122-b705-31689da73eb5-build\" (UniqueName: \"kubernetes.io/empty-dir/1089c142-023b-4122-b705-31689da73eb5-build\") pod \"1089c142-023b-4122-b705-31689da73eb5\" (UID: \"1089c142-023b-4122-b705-31689da73eb5\") "3342machine # [ 144.274269] k3s[888]: I0919 21:52:42.180649 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1089c142-023b-4122-b705-31689da73eb5-nixconf\" (UniqueName: \"kubernetes.io/configmap/1089c142-023b-4122-b705-31689da73eb5-nixconf\") pod \"1089c142-023b-4122-b705-31689da73eb5\" (UID: \"1089c142-023b-4122-b705-31689da73eb5\") "3343machine # [ 144.275862] k3s[888]: I0919 21:52:42.180675 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1089c142-023b-4122-b705-31689da73eb5-nix\" (UniqueName: \"kubernetes.io/empty-dir/1089c142-023b-4122-b705-31689da73eb5-nix\") pod \"1089c142-023b-4122-b705-31689da73eb5\" (UID: \"1089c142-023b-4122-b705-31689da73eb5\") "3344machine # [ 144.277996] k3s[888]: I0919 21:52:42.180707 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1089c142-023b-4122-b705-31689da73eb5-ca\" (UniqueName: \"kubernetes.io/secret/1089c142-023b-4122-b705-31689da73eb5-ca\") pod \"1089c142-023b-4122-b705-31689da73eb5\" (UID: \"1089c142-023b-4122-b705-31689da73eb5\") "3345machine # [ 144.335685] k3s[888]: I0919 21:52:42.180735 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1089c142-023b-4122-b705-31689da73eb5-tls\" (UniqueName: \"kubernetes.io/secret/1089c142-023b-4122-b705-31689da73eb5-tls\") pod \"1089c142-023b-4122-b705-31689da73eb5\" (UID: \"1089c142-023b-4122-b705-31689da73eb5\") "3346machine # [ 144.336532] k3s[888]: I0919 21:52:42.180761 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1089c142-023b-4122-b705-31689da73eb5-oidc\" (UniqueName: \"kubernetes.io/secret/1089c142-023b-4122-b705-31689da73eb5-oidc\") pod \"1089c142-023b-4122-b705-31689da73eb5\" (UID: \"1089c142-023b-4122-b705-31689da73eb5\") "3347machine # [ 144.337019] k3s[888]: I0919 21:52:42.180838 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1039bfa3-cc1f-46c7-8406-c7fbb1352a93-build\" (UniqueName: \"kubernetes.io/empty-dir/1039bfa3-cc1f-46c7-8406-c7fbb1352a93-build\") pod \"1039bfa3-cc1f-46c7-8406-c7fbb1352a93\" (UID: \"1039bfa3-cc1f-46c7-8406-c7fbb1352a93\") "3348machine # [ 144.337454] k3s[888]: I0919 21:52:42.181164 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1039bfa3-cc1f-46c7-8406-c7fbb1352a93-build" pod "1039bfa3-cc1f-46c7-8406-c7fbb1352a93" (UID: "1039bfa3-cc1f-46c7-8406-c7fbb1352a93"). InnerVolumeSpecName "build". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""3349machine # [ 144.338076] k3s[888]: I0919 21:52:42.182748 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1039bfa3-cc1f-46c7-8406-c7fbb1352a93-nixconf" pod "1039bfa3-cc1f-46c7-8406-c7fbb1352a93" (UID: "1039bfa3-cc1f-46c7-8406-c7fbb1352a93"). InnerVolumeSpecName "nixconf". PluginName "kubernetes.io/configmap", VolumeGIDValue ""3350machine # [ 144.338573] k3s[888]: I0919 21:52:42.183418 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1089c142-023b-4122-b705-31689da73eb5-build" pod "1089c142-023b-4122-b705-31689da73eb5" (UID: "1089c142-023b-4122-b705-31689da73eb5"). InnerVolumeSpecName "build". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""3351machine # [ 144.339117] k3s[888]: I0919 21:52:42.183645 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1089c142-023b-4122-b705-31689da73eb5-nixconf" pod "1089c142-023b-4122-b705-31689da73eb5" (UID: "1089c142-023b-4122-b705-31689da73eb5"). InnerVolumeSpecName "nixconf". PluginName "kubernetes.io/configmap", VolumeGIDValue ""3352machine # [ 144.367181] k3s[888]: I0919 21:52:42.279315 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1039bfa3-cc1f-46c7-8406-c7fbb1352a93-oidc" pod "1039bfa3-cc1f-46c7-8406-c7fbb1352a93" (UID: "1039bfa3-cc1f-46c7-8406-c7fbb1352a93"). InnerVolumeSpecName "oidc". PluginName "kubernetes.io/secret", VolumeGIDValue ""3353machine # [ 144.368039] k3s[888]: I0919 21:52:42.279511 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1089c142-023b-4122-b705-31689da73eb5-niks3-token" pod "1089c142-023b-4122-b705-31689da73eb5" (UID: "1089c142-023b-4122-b705-31689da73eb5"). InnerVolumeSpecName "niks3-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""3354machine # [ 144.368803] k3s[888]: I0919 21:52:42.279623 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1089c142-023b-4122-b705-31689da73eb5-tls" pod "1089c142-023b-4122-b705-31689da73eb5" (UID: "1089c142-023b-4122-b705-31689da73eb5"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""3355machine # [ 144.370091] k3s[888]: I0919 21:52:42.279735 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1039bfa3-cc1f-46c7-8406-c7fbb1352a93-niks3-token" pod "1039bfa3-cc1f-46c7-8406-c7fbb1352a93" (UID: "1039bfa3-cc1f-46c7-8406-c7fbb1352a93"). InnerVolumeSpecName "niks3-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""3356machine # [ 144.370900] k3s[888]: I0919 21:52:42.279882 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1039bfa3-cc1f-46c7-8406-c7fbb1352a93-kube-api-access-gp6ct" pod "1039bfa3-cc1f-46c7-8406-c7fbb1352a93" (UID: "1039bfa3-cc1f-46c7-8406-c7fbb1352a93"). InnerVolumeSpecName "kube-api-access-gp6ct". PluginName "kubernetes.io/projected", VolumeGIDValue ""3357machine # [ 144.371816] k3s[888]: I0919 21:52:42.279876 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1089c142-023b-4122-b705-31689da73eb5-oidc" pod "1089c142-023b-4122-b705-31689da73eb5" (UID: "1089c142-023b-4122-b705-31689da73eb5"). InnerVolumeSpecName "oidc". PluginName "kubernetes.io/secret", VolumeGIDValue ""3358machine # [ 144.373263] k3s[888]: I0919 21:52:42.279916 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1089c142-023b-4122-b705-31689da73eb5-ca" pod "1089c142-023b-4122-b705-31689da73eb5" (UID: "1089c142-023b-4122-b705-31689da73eb5"). InnerVolumeSpecName "ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""3359machine # [ 144.374051] k3s[888]: I0919 21:52:42.279966 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1039bfa3-cc1f-46c7-8406-c7fbb1352a93-tls" pod "1039bfa3-cc1f-46c7-8406-c7fbb1352a93" (UID: "1039bfa3-cc1f-46c7-8406-c7fbb1352a93"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""3360machine # [ 144.375111] k3s[888]: I0919 21:52:42.281244 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1039bfa3-cc1f-46c7-8406-c7fbb1352a93-ca" pod "1039bfa3-cc1f-46c7-8406-c7fbb1352a93" (UID: "1039bfa3-cc1f-46c7-8406-c7fbb1352a93"). InnerVolumeSpecName "ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""3361machine # [ 144.375850] k3s[888]: I0919 21:52:42.281475 888 reconciler_common.go:299] "Volume detached for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/1039bfa3-cc1f-46c7-8406-c7fbb1352a93-nixconf\") on node \"machine\" DevicePath \"\""3362machine # [ 144.377093] k3s[888]: I0919 21:52:42.281492 888 reconciler_common.go:299] "Volume detached for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/1039bfa3-cc1f-46c7-8406-c7fbb1352a93-oidc\") on node \"machine\" DevicePath \"\""3363machine # [ 144.377774] k3s[888]: I0919 21:52:42.281515 888 reconciler_common.go:299] "Volume detached for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/1089c142-023b-4122-b705-31689da73eb5-build\") on node \"machine\" DevicePath \"\""3364machine # [ 144.378417] k3s[888]: I0919 21:52:42.281537 888 reconciler_common.go:299] "Volume detached for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/1089c142-023b-4122-b705-31689da73eb5-nixconf\") on node \"machine\" DevicePath \"\""3365machine # [ 144.378936] k3s[888]: I0919 21:52:42.281551 888 reconciler_common.go:299] "Volume detached for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1089c142-023b-4122-b705-31689da73eb5-ca\") on node \"machine\" DevicePath \"\""3366machine # [ 144.379547] k3s[888]: I0919 21:52:42.281568 888 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/1089c142-023b-4122-b705-31689da73eb5-tls\") on node \"machine\" DevicePath \"\""3367machine # [ 144.380077] k3s[888]: I0919 21:52:42.281582 888 reconciler_common.go:299] "Volume detached for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/1089c142-023b-4122-b705-31689da73eb5-oidc\") on node \"machine\" DevicePath \"\""3368machine # [ 144.381505] k3s[888]: I0919 21:52:42.281594 888 reconciler_common.go:299] "Volume detached for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/1039bfa3-cc1f-46c7-8406-c7fbb1352a93-build\") on node \"machine\" DevicePath \"\""3369machine # [ 144.383823] k3s[888]: I0919 21:52:42.281605 888 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/1039bfa3-cc1f-46c7-8406-c7fbb1352a93-tls\") on node \"machine\" DevicePath \"\""3370machine # [ 144.386458] k3s[888]: I0919 21:52:42.281618 888 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gp6ct\" (UniqueName: \"kubernetes.io/projected/1039bfa3-cc1f-46c7-8406-c7fbb1352a93-kube-api-access-gp6ct\") on node \"machine\" DevicePath \"\""3371machine # [ 144.389156] k3s[888]: I0919 21:52:42.281634 888 reconciler_common.go:299] "Volume detached for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/1089c142-023b-4122-b705-31689da73eb5-niks3-token\") on node \"machine\" DevicePath \"\""3372machine # [ 144.391759] k3s[888]: I0919 21:52:42.281653 888 reconciler_common.go:299] "Volume detached for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/1039bfa3-cc1f-46c7-8406-c7fbb1352a93-niks3-token\") on node \"machine\" DevicePath \"\""3373machine # [ 144.394618] k3s[888]: I0919 21:52:42.281667 888 reconciler_common.go:299] "Volume detached for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1039bfa3-cc1f-46c7-8406-c7fbb1352a93-ca\") on node \"machine\" DevicePath \"\""3374machine # [ 144.440622] dhcpcd[5125]: dhcp_readbpf: unexpected event 0x01003375machine # [ 144.441584] dhcpcd[5125]: dhcp_readbpf: veth8e821e73: Network is down3376machine # [ 144.446221] dhcpcd[5125]: arp_read: unexpected event 0x01003377machine # [ 144.446783] dhcpcd[5125]: arp_read: veth8e821e73: Network is down3378machine # [ 144.450653] k3s[888]: I0919 21:52:42.362798 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1089c142-023b-4122-b705-31689da73eb5-kube-api-access-gds7q" pod "1089c142-023b-4122-b705-31689da73eb5" (UID: "1089c142-023b-4122-b705-31689da73eb5"). InnerVolumeSpecName "kube-api-access-gds7q". PluginName "kubernetes.io/projected", VolumeGIDValue ""3379machine # [ 144.456121] dhcpcd[5125]: vethea686f0f: removing interface3380machine # [ 144.470452] k3s[888]: I0919 21:52:42.382455 888 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gds7q\" (UniqueName: \"kubernetes.io/projected/1089c142-023b-4122-b705-31689da73eb5-kube-api-access-gds7q\") on node \"machine\" DevicePath \"\""3381machine # [ 144.488418] dhcpcd[5125]: veth8e821e73: removing interface3382machine # [ 144.489847] dhcpcd[5125]: veth8e821e73: deleting address fe80::b47f:fdff:fe25:34fb3383machine # [ 144.491338] dhcpcd[5125]: veth8e821e73: deleting route to 169.254.0.0/163384machine # [ 144.657075] k3s[888]: I0919 21:52:42.568925 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1089c142-023b-4122-b705-31689da73eb5-nix" pod "1089c142-023b-4122-b705-31689da73eb5" (UID: "1089c142-023b-4122-b705-31689da73eb5"). InnerVolumeSpecName "nix". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""3385machine # [ 144.666432] k3s[888]: I0919 21:52:42.578575 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1039bfa3-cc1f-46c7-8406-c7fbb1352a93-nix" pod "1039bfa3-cc1f-46c7-8406-c7fbb1352a93" (UID: "1039bfa3-cc1f-46c7-8406-c7fbb1352a93"). InnerVolumeSpecName "nix". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""3386machine # [ 144.670892] k3s[888]: I0919 21:52:42.583036 888 reconciler_common.go:299] "Volume detached for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/1039bfa3-cc1f-46c7-8406-c7fbb1352a93-nix\") on node \"machine\" DevicePath \"\""3387machine # [ 144.671631] k3s[888]: I0919 21:52:42.583071 888 reconciler_common.go:299] "Volume detached for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/1089c142-023b-4122-b705-31689da73eb5-nix\") on node \"machine\" DevicePath \"\""3388machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3389machine # [ 144.689476] k3s[888]: I0919 21:52:42.601350 888 scope.go:122] "RemoveContainer" containerID="53e8f14ebdcaeae1c113dbd7391553dc36af6d5157ce1dbd7467bfd09b9b6e49"3390machine # [ 144.700120] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod1089c142_023b_4122_b705_31689da73eb5.slice.3391machine # [ 144.700496] systemd[1]: kubepods-besteffort-pod1089c142_023b_4122_b705_31689da73eb5.slice: Consumed 990ms CPU time over 51.127s wall clock time, 325.1M memory peak, 13.6M read from disk, 283.9M written to disk, 23.1K incoming IP traffic, 21.6K outgoing IP traffic.3392machine # [ 144.707264] k3s[888]: I0919 21:52:42.619165 888 scope.go:122] "RemoveContainer" containerID="91bfebd866e10c28cbdcd8f0d9525ccddb5879ed3d880e5c9d243d1254526c50"3393machine # [ 144.709614] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod1039bfa3_cc1f_46c7_8406_c7fbb1352a93.slice.3394machine # [ 144.710534] systemd[1]: kubepods-besteffort-pod1039bfa3_cc1f_46c7_8406_c7fbb1352a93.slice: Consumed 970ms CPU time over 51.117s wall clock time, 319.3M memory peak, 7M read from disk, 283.9M written to disk, 22.8K incoming IP traffic, 21.8K outgoing IP traffic.3395machine # [ 144.724648] k3s[888]: I0919 21:52:42.636790 888 scope.go:122] "RemoveContainer" containerID="7d38fba2a70d5f8787d85834ca0db306fdeca2537bed7593baad4216bbd19754"3396machine # [ 144.734672] k3s[888]: I0919 21:52:42.646825 888 scope.go:122] "RemoveContainer" containerID="d6befc003b8219fde148c883abc09ef66beba85014b3ebea88f32b075e1f4e7d"3397machine # [ 144.742266] k3s[888]: I0919 21:52:42.654438 888 scope.go:122] "RemoveContainer" containerID="53e8f14ebdcaeae1c113dbd7391553dc36af6d5157ce1dbd7467bfd09b9b6e49"3398machine # [ 144.742891] k3s[888]: E0919 21:52:42.655078 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"53e8f14ebdcaeae1c113dbd7391553dc36af6d5157ce1dbd7467bfd09b9b6e49\": not found" containerID="53e8f14ebdcaeae1c113dbd7391553dc36af6d5157ce1dbd7467bfd09b9b6e49"3399machine # [ 144.743627] k3s[888]: I0919 21:52:42.655125 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"53e8f14ebdcaeae1c113dbd7391553dc36af6d5157ce1dbd7467bfd09b9b6e49"} err="failed to get container status \"53e8f14ebdcaeae1c113dbd7391553dc36af6d5157ce1dbd7467bfd09b9b6e49\": rpc error: code = NotFound desc = an error occurred when try to find container \"53e8f14ebdcaeae1c113dbd7391553dc36af6d5157ce1dbd7467bfd09b9b6e49\": not found"3400machine # [ 144.744174] k3s[888]: I0919 21:52:42.655156 888 scope.go:122] "RemoveContainer" containerID="91bfebd866e10c28cbdcd8f0d9525ccddb5879ed3d880e5c9d243d1254526c50"3401machine # [ 144.744655] k3s[888]: E0919 21:52:42.655803 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"91bfebd866e10c28cbdcd8f0d9525ccddb5879ed3d880e5c9d243d1254526c50\": not found" containerID="91bfebd866e10c28cbdcd8f0d9525ccddb5879ed3d880e5c9d243d1254526c50"3402machine # [ 144.745463] k3s[888]: I0919 21:52:42.655877 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"91bfebd866e10c28cbdcd8f0d9525ccddb5879ed3d880e5c9d243d1254526c50"} err="failed to get container status \"91bfebd866e10c28cbdcd8f0d9525ccddb5879ed3d880e5c9d243d1254526c50\": rpc error: code = NotFound desc = an error occurred when try to find container \"91bfebd866e10c28cbdcd8f0d9525ccddb5879ed3d880e5c9d243d1254526c50\": not found"3403machine # [ 144.746023] k3s[888]: I0919 21:52:42.655901 888 scope.go:122] "RemoveContainer" containerID="7d38fba2a70d5f8787d85834ca0db306fdeca2537bed7593baad4216bbd19754"3404machine # [ 144.746515] k3s[888]: E0919 21:52:42.656404 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"7d38fba2a70d5f8787d85834ca0db306fdeca2537bed7593baad4216bbd19754\": not found" containerID="7d38fba2a70d5f8787d85834ca0db306fdeca2537bed7593baad4216bbd19754"3405machine # [ 144.747123] k3s[888]: I0919 21:52:42.656445 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"7d38fba2a70d5f8787d85834ca0db306fdeca2537bed7593baad4216bbd19754"} err="failed to get container status \"7d38fba2a70d5f8787d85834ca0db306fdeca2537bed7593baad4216bbd19754\": rpc error: code = NotFound desc = an error occurred when try to find container \"7d38fba2a70d5f8787d85834ca0db306fdeca2537bed7593baad4216bbd19754\": not found"3406machine # [ 144.747905] k3s[888]: I0919 21:52:42.656475 888 scope.go:122] "RemoveContainer" containerID="d6befc003b8219fde148c883abc09ef66beba85014b3ebea88f32b075e1f4e7d"3407machine # [ 144.748675] k3s[888]: E0919 21:52:42.657015 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"d6befc003b8219fde148c883abc09ef66beba85014b3ebea88f32b075e1f4e7d\": not found" containerID="d6befc003b8219fde148c883abc09ef66beba85014b3ebea88f32b075e1f4e7d"3408machine # [ 144.749349] k3s[888]: I0919 21:52:42.657044 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"d6befc003b8219fde148c883abc09ef66beba85014b3ebea88f32b075e1f4e7d"} err="failed to get container status \"d6befc003b8219fde148c883abc09ef66beba85014b3ebea88f32b075e1f4e7d\": rpc error: code = NotFound desc = an error occurred when try to find container \"d6befc003b8219fde148c883abc09ef66beba85014b3ebea88f32b075e1f4e7d\": not found"3409machine # [ 144.750046] k3s[888]: I0919 21:52:42.657064 888 scope.go:122] "RemoveContainer" containerID="399563d2f8cea088f626c691dbd76abe75f0a0d514d4c34b24b5cada517b1d3a"3410machine # [ 144.753470] k3s[888]: I0919 21:52:42.665661 888 scope.go:122] "RemoveContainer" containerID="ca2057a9b9df6fbb95eaa2f9251328385539fcd8e2a1c692b4a671eddaa2010f"3411machine # [ 144.760601] k3s[888]: I0919 21:52:42.672653 888 scope.go:122] "RemoveContainer" containerID="d2a76477593a6434b6b4b8ed43ea56d5f7b01fb9d9f54ba814ea4288ee4582d2"3412machine # [ 144.768249] k3s[888]: I0919 21:52:42.680435 888 scope.go:122] "RemoveContainer" containerID="35fed3bc7bd130667e23c8b0a061121690489dce04c5fc15c3869905d2c22b95"3413machine # [ 144.776324] k3s[888]: I0919 21:52:42.688530 888 scope.go:122] "RemoveContainer" containerID="399563d2f8cea088f626c691dbd76abe75f0a0d514d4c34b24b5cada517b1d3a"3414machine # [ 144.779797] k3s[888]: E0919 21:52:42.691849 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"399563d2f8cea088f626c691dbd76abe75f0a0d514d4c34b24b5cada517b1d3a\": not found" containerID="399563d2f8cea088f626c691dbd76abe75f0a0d514d4c34b24b5cada517b1d3a"3415machine # [ 144.780643] k3s[888]: I0919 21:52:42.691891 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"399563d2f8cea088f626c691dbd76abe75f0a0d514d4c34b24b5cada517b1d3a"} err="failed to get container status \"399563d2f8cea088f626c691dbd76abe75f0a0d514d4c34b24b5cada517b1d3a\": rpc error: code = NotFound desc = an error occurred when try to find container \"399563d2f8cea088f626c691dbd76abe75f0a0d514d4c34b24b5cada517b1d3a\": not found"3416machine # [ 144.781197] k3s[888]: I0919 21:52:42.691916 888 scope.go:122] "RemoveContainer" containerID="ca2057a9b9df6fbb95eaa2f9251328385539fcd8e2a1c692b4a671eddaa2010f"3417machine # [ 144.782082] k3s[888]: E0919 21:52:42.694208 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"ca2057a9b9df6fbb95eaa2f9251328385539fcd8e2a1c692b4a671eddaa2010f\": not found" containerID="ca2057a9b9df6fbb95eaa2f9251328385539fcd8e2a1c692b4a671eddaa2010f"3418machine # [ 144.782832] k3s[888]: I0919 21:52:42.694283 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"ca2057a9b9df6fbb95eaa2f9251328385539fcd8e2a1c692b4a671eddaa2010f"} err="failed to get container status \"ca2057a9b9df6fbb95eaa2f9251328385539fcd8e2a1c692b4a671eddaa2010f\": rpc error: code = NotFound desc = an error occurred when try to find container \"ca2057a9b9df6fbb95eaa2f9251328385539fcd8e2a1c692b4a671eddaa2010f\": not found"3419machine # [ 144.783435] k3s[888]: I0919 21:52:42.694316 888 scope.go:122] "RemoveContainer" containerID="d2a76477593a6434b6b4b8ed43ea56d5f7b01fb9d9f54ba814ea4288ee4582d2"3420machine # [ 144.784048] k3s[888]: E0919 21:52:42.694933 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"d2a76477593a6434b6b4b8ed43ea56d5f7b01fb9d9f54ba814ea4288ee4582d2\": not found" containerID="d2a76477593a6434b6b4b8ed43ea56d5f7b01fb9d9f54ba814ea4288ee4582d2"3421machine # [ 144.784465] k3s[888]: I0919 21:52:42.694958 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"d2a76477593a6434b6b4b8ed43ea56d5f7b01fb9d9f54ba814ea4288ee4582d2"} err="failed to get container status \"d2a76477593a6434b6b4b8ed43ea56d5f7b01fb9d9f54ba814ea4288ee4582d2\": rpc error: code = NotFound desc = an error occurred when try to find container \"d2a76477593a6434b6b4b8ed43ea56d5f7b01fb9d9f54ba814ea4288ee4582d2\": not found"3422machine # [ 144.785034] k3s[888]: I0919 21:52:42.694981 888 scope.go:122] "RemoveContainer" containerID="35fed3bc7bd130667e23c8b0a061121690489dce04c5fc15c3869905d2c22b95"3423machine # [ 144.786757] k3s[888]: E0919 21:52:42.695543 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"35fed3bc7bd130667e23c8b0a061121690489dce04c5fc15c3869905d2c22b95\": not found" containerID="35fed3bc7bd130667e23c8b0a061121690489dce04c5fc15c3869905d2c22b95"3424machine # [ 144.790535] k3s[888]: I0919 21:52:42.695563 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"35fed3bc7bd130667e23c8b0a061121690489dce04c5fc15c3869905d2c22b95"} err="failed to get container status \"35fed3bc7bd130667e23c8b0a061121690489dce04c5fc15c3869905d2c22b95\": rpc error: code = NotFound desc = an error occurred when try to find container \"35fed3bc7bd130667e23c8b0a061121690489dce04c5fc15c3869905d2c22b95\": not found"3425machine # [ 144.978728] systemd[1]: var-lib-kubelet-pods-1089c142\x2d023b\x2d4122\x2db705\x2d31689da73eb5-volume\x2dsubpaths-nix-gc-0.mount: Deactivated successfully.3426machine # [ 144.978968] systemd[1]: var-lib-kubelet-pods-1039bfa3\x2dcc1f\x2d46c7\x2d8406\x2dc7fbb1352a93-volume\x2dsubpaths-nix-gc-0.mount: Deactivated successfully.3427machine # [ 144.980432] systemd[1]: var-lib-kubelet-pods-1089c142\x2d023b\x2d4122\x2db705\x2d31689da73eb5-volume\x2dsubpaths-nix-nix\x2dgrpc\x2ddaemon-0.mount: Deactivated successfully.3428machine # [ 144.981084] systemd[1]: var-lib-kubelet-pods-1039bfa3\x2dcc1f\x2d46c7\x2d8406\x2dc7fbb1352a93-volume\x2dsubpaths-nix-nix\x2dgrpc\x2ddaemon-0.mount: Deactivated successfully.3429machine # [ 144.981545] systemd[1]: var-lib-kubelet-pods-1039bfa3\x2dcc1f\x2d46c7\x2d8406\x2dc7fbb1352a93-volume\x2dsubpaths-nix-nix\x2ddaemon-0.mount: Deactivated successfully.3430machine # [ 144.982101] systemd[1]: var-lib-kubelet-pods-1089c142\x2d023b\x2d4122\x2db705\x2d31689da73eb5-volume\x2dsubpaths-nix-nix\x2ddaemon-0.mount: Deactivated successfully.3431machine # [ 144.982600] systemd[1]: run-netns-cni\x2d38224c3a\x2d3a27\x2d8e9d\x2d0bed\x2d6f98cb612377.mount: Deactivated successfully.3432machine # [ 144.983103] systemd[1]: var-lib-kubelet-pods-1039bfa3\x2dcc1f\x2d46c7\x2d8406\x2dc7fbb1352a93-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dgp6ct.mount: Deactivated successfully.3433machine # [ 144.983553] systemd[1]: var-lib-kubelet-pods-1089c142\x2d023b\x2d4122\x2db705\x2d31689da73eb5-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dgds7q.mount: Deactivated successfully.3434machine # [ 144.983758] systemd[1]: var-lib-kubelet-pods-1089c142\x2d023b\x2d4122\x2db705\x2d31689da73eb5-volumes-kubernetes.io\x7eprojected-niks3\x2dtoken.mount: Deactivated successfully.3435machine # [ 144.984410] systemd[1]: var-lib-kubelet-pods-1039bfa3\x2dcc1f\x2d46c7\x2d8406\x2dc7fbb1352a93-volumes-kubernetes.io\x7eprojected-niks3\x2dtoken.mount: Deactivated successfully.3436machine # [ 144.984888] systemd[1]: var-lib-kubelet-pods-1089c142\x2d023b\x2d4122\x2db705\x2d31689da73eb5-volumes-kubernetes.io\x7esecret-ca.mount: Deactivated successfully.3437machine # [ 144.985521] systemd[1]: var-lib-kubelet-pods-1039bfa3\x2dcc1f\x2d46c7\x2d8406\x2dc7fbb1352a93-volumes-kubernetes.io\x7esecret-ca.mount: Deactivated successfully.3438machine # [ 144.986026] systemd[1]: var-lib-kubelet-pods-1089c142\x2d023b\x2d4122\x2db705\x2d31689da73eb5-volumes-kubernetes.io\x7esecret-tls.mount: Deactivated successfully.3439machine # [ 144.986502] systemd[1]: var-lib-kubelet-pods-1039bfa3\x2dcc1f\x2d46c7\x2d8406\x2dc7fbb1352a93-volumes-kubernetes.io\x7esecret-tls.mount: Deactivated successfully.3440machine # [ 144.987068] systemd[1]: var-lib-kubelet-pods-1039bfa3\x2dcc1f\x2d46c7\x2d8406\x2dc7fbb1352a93-volumes-kubernetes.io\x7esecret-oidc.mount: Deactivated successfully.3441machine # [ 144.987570] systemd[1]: var-lib-kubelet-pods-1089c142\x2d023b\x2d4122\x2db705\x2d31689da73eb5-volumes-kubernetes.io\x7esecret-oidc.mount: Deactivated successfully.3442machine # [ 145.355875] dhcpcd[5125]: veth1baec785: probing for an IPv4LL address3443machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3444machine # [ 146.429960] dhcpcd[5125]: vetha1298504: probing for an IPv4LL address3445machine # [ 146.497224] k3s[888]: I0919 21:52:44.408589 888 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1039bfa3-cc1f-46c7-8406-c7fbb1352a93" path="/var/lib/kubelet/pods/1039bfa3-cc1f-46c7-8406-c7fbb1352a93/volumes"3446machine # [ 146.498078] k3s[888]: I0919 21:52:44.410164 888 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1089c142-023b-4122-b705-31689da73eb5" path="/var/lib/kubelet/pods/1089c142-023b-4122-b705-31689da73eb5/volumes"3447machine # [ 146.584717] dhcpcd[5125]: vethc4c31fef: probing for an IPv4LL address3448machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3449machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3450machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3451machine # [ 150.322644] dhcpcd[5125]: veth1baec785: using IPv4LL address 169.254.74.743452machine # [ 150.323208] dhcpcd[5125]: veth1baec785: adding route to 169.254.0.0/163453machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3454machine # [ 151.287712] dhcpcd[5125]: vethc4c31fef: using IPv4LL address 169.254.65.2273455machine # [ 151.288288] dhcpcd[5125]: vethc4c31fef: adding route to 169.254.0.0/163456machine # [ 151.960441] dhcpcd[5125]: vetha1298504: using IPv4LL address 169.254.120.563457machine # [ 151.960832] dhcpcd[5125]: vetha1298504: adding route to 169.254.0.0/163458machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3459machine # [ 153.314609] dhcpcd[5125]: vetha1298504: no IPv6 Routers available3460machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3461machine # [ 154.016071] dhcpcd[5125]: vethc4c31fef: no IPv6 Routers available3462machine # [ 154.320933] dhcpcd[5125]: veth1baec785: no IPv6 Routers available3463machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3464machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3465machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3466machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3467machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3468machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3469machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3470machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3471machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3472machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3473machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3474machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3475machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3476machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3477machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3478machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3479machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3480machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3481machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3482machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3483machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3484machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3485machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3486machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3487machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3488machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3489machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3490machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3491machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3492machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3493machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3494machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3495machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3496machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3497machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3498machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3499machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3500machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3501machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3502machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3503machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3504machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3505machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3506machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3507machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3508machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3509machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3510machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3511machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3512machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3513machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3514machine # [ 219.490697] k3s[888]: I0919 21:53:57.401726 888 scope.go:122] "RemoveContainer" containerID="3efb052b77f7eb1252244ff8ff5e8b19a8073ed1d07e57871c0bbc337341b8e3"3515machine # [ 219.491302] k3s[888]: E0919 21:53:57.401927 888 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"helm\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=helm pod=helm-install-nix-grpc-farm-7fwh5_kube-system(0758217b-c7d3-4cab-abc0-35bace80ed3f)\"" pod="kube-system/helm-install-nix-grpc-farm-7fwh5" podUID="0758217b-c7d3-4cab-abc0-35bace80ed3f"3516machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3517machine # [ 220.489986] k3s[888]: I0919 21:53:58.402025 888 scope.go:122] "RemoveContainer" containerID="3efb052b77f7eb1252244ff8ff5e8b19a8073ed1d07e57871c0bbc337341b8e3"3518machine # [ 220.556026] systemd[1]: Started libcontainer container d408d79e39ea6f9824ed837148942389557f289fcc73d37cb7a1ed4149f58dfb.3519machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3520machine # [ 221.740531] systemd[1]: cri-containerd-790c0d1d7fbc65a7446667e4dd367e829ab8660dcbf20314f5a5e128217bf4f0.scope: Deactivated successfully.3521machine # [ 221.741480] systemd[1]: cri-containerd-790c0d1d7fbc65a7446667e4dd367e829ab8660dcbf20314f5a5e128217bf4f0.scope: Consumed 585ms CPU time over 1min 21.273s wall clock time, 15.8M memory peak, 82.3K incoming IP traffic, 78.1K outgoing IP traffic.3522machine # [ 221.763969] systemd[1]: cri-containerd-3c022f3880654559459bc4e22e491049f6b8a9d287502c3f0c48081aa411bc5e.scope: Deactivated successfully.3523machine # [ 221.773760] systemd[1]: cri-containerd-81b859107ae751e3ab106bc2abc9a99a86026237c22e0580bf37b3027d58eca8.scope: Deactivated successfully.3524machine # [ 221.809168] systemd[1]: cri-containerd-f833aabf75df9a7a3b03835241d8c85ea26bfedf78443b964aefd935295f3785.scope: Deactivated successfully.3525machine # [ 221.813329] systemd[1]: cri-containerd-9e7f919ce17e1c7cb35d9228da4097810f270917cd33d1c200e8ddf3d4b1a62d.scope: Deactivated successfully.3526machine # [ 221.816936] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-790c0d1d7fbc65a7446667e4dd367e829ab8660dcbf20314f5a5e128217bf4f0-rootfs.mount: Deactivated successfully.3527machine # [ 221.833194] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-81b859107ae751e3ab106bc2abc9a99a86026237c22e0580bf37b3027d58eca8-rootfs.mount: Deactivated successfully.3528machine # [ 221.841058] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-3c022f3880654559459bc4e22e491049f6b8a9d287502c3f0c48081aa411bc5e-rootfs.mount: Deactivated successfully.3529machine # [ 221.861628] systemd[1]: cri-containerd-4b46750920671cff8b4b89fbacea0ea45ef1d4a59704b09fc62b9dd00a3965e5.scope: Deactivated successfully.3530machine # [ 221.896925] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-9e7f919ce17e1c7cb35d9228da4097810f270917cd33d1c200e8ddf3d4b1a62d-rootfs.mount: Deactivated successfully.3531machine # [ 221.901291] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-f833aabf75df9a7a3b03835241d8c85ea26bfedf78443b964aefd935295f3785-rootfs.mount: Deactivated successfully.3532machine # [ 221.985470] k3s[888]: I0919 21:53:59.897130 888 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b46750920671cff8b4b89fbacea0ea45ef1d4a59704b09fc62b9dd00a3965e5"3533machine # [ 222.161364] cni0: port 4(vethc4c31fef) entered disabled state3534machine # [ 222.008483] dhcpcd[5125]: vethc4c31fef: carrier lost3535machine # [ 222.167189] vethc4c31fef (unregistering): left allmulticast mode3536machine # [ 222.169733] vethc4c31fef (unregistering): left promiscuous mode3537machine # [ 222.171342] cni0: port 4(vethc4c31fef) entered disabled state3538machine # [ 222.066683] dhcpcd[5125]: vethc4c31fef: deleting address fe80::40c3:cfff:fec7:9b953539machine # [ 222.071179] dhcpcd[5125]: vethc4c31fef: deleting route to 169.254.0.0/163540machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3541machine # [ 222.139272] k3s[888]: I0919 21:54:00.051025 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2b62ac4d-5e92-4c1a-af0f-7274fbba8175-tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b62ac4d-5e92-4c1a-af0f-7274fbba8175-tmp\") pod \"2b62ac4d-5e92-4c1a-af0f-7274fbba8175\" (UID: \"2b62ac4d-5e92-4c1a-af0f-7274fbba8175\") "3542machine # [ 222.139479] k3s[888]: I0919 21:54:00.051372 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2b62ac4d-5e92-4c1a-af0f-7274fbba8175-tls-ca\" (UniqueName: \"kubernetes.io/secret/2b62ac4d-5e92-4c1a-af0f-7274fbba8175-tls-ca\") pod \"2b62ac4d-5e92-4c1a-af0f-7274fbba8175\" (UID: \"2b62ac4d-5e92-4c1a-af0f-7274fbba8175\") "3543machine # [ 222.139962] k3s[888]: I0919 21:54:00.051469 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2b62ac4d-5e92-4c1a-af0f-7274fbba8175-config\" (UniqueName: \"kubernetes.io/configmap/2b62ac4d-5e92-4c1a-af0f-7274fbba8175-config\") pod \"2b62ac4d-5e92-4c1a-af0f-7274fbba8175\" (UID: \"2b62ac4d-5e92-4c1a-af0f-7274fbba8175\") "3544machine # [ 222.140269] k3s[888]: I0919 21:54:00.051585 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2b62ac4d-5e92-4c1a-af0f-7274fbba8175-tls-lb\" (UniqueName: \"kubernetes.io/secret/2b62ac4d-5e92-4c1a-af0f-7274fbba8175-tls-lb\") pod \"2b62ac4d-5e92-4c1a-af0f-7274fbba8175\" (UID: \"2b62ac4d-5e92-4c1a-af0f-7274fbba8175\") "3545machine # [ 222.167412] k3s[888]: I0919 21:54:00.079569 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b62ac4d-5e92-4c1a-af0f-7274fbba8175-tls-ca" pod "2b62ac4d-5e92-4c1a-af0f-7274fbba8175" (UID: "2b62ac4d-5e92-4c1a-af0f-7274fbba8175"). InnerVolumeSpecName "tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""3546machine # [ 222.167797] k3s[888]: I0919 21:54:00.080005 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b62ac4d-5e92-4c1a-af0f-7274fbba8175-config" pod "2b62ac4d-5e92-4c1a-af0f-7274fbba8175" (UID: "2b62ac4d-5e92-4c1a-af0f-7274fbba8175"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""3547machine # [ 222.168545] k3s[888]: I0919 21:54:00.080740 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b62ac4d-5e92-4c1a-af0f-7274fbba8175-tmp" pod "2b62ac4d-5e92-4c1a-af0f-7274fbba8175" (UID: "2b62ac4d-5e92-4c1a-af0f-7274fbba8175"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""3548machine # [ 222.168869] k3s[888]: I0919 21:54:00.081075 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b62ac4d-5e92-4c1a-af0f-7274fbba8175-tls-lb" pod "2b62ac4d-5e92-4c1a-af0f-7274fbba8175" (UID: "2b62ac4d-5e92-4c1a-af0f-7274fbba8175"). InnerVolumeSpecName "tls-lb". PluginName "kubernetes.io/secret", VolumeGIDValue ""3549machine # [ 222.201326] dhcpcd[5125]: vethc4c31fef: removing interface3550machine # [ 222.240069] k3s[888]: I0919 21:54:00.152223 888 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2b62ac4d-5e92-4c1a-af0f-7274fbba8175-config\") on node \"machine\" DevicePath \"\""3551machine # [ 222.240274] k3s[888]: I0919 21:54:00.152252 888 reconciler_common.go:299] "Volume detached for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/2b62ac4d-5e92-4c1a-af0f-7274fbba8175-tls-lb\") on node \"machine\" DevicePath \"\""3552machine # [ 222.240445] k3s[888]: I0919 21:54:00.152287 888 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b62ac4d-5e92-4c1a-af0f-7274fbba8175-tmp\") on node \"machine\" DevicePath \"\""3553machine # [ 222.241322] k3s[888]: I0919 21:54:00.152299 888 reconciler_common.go:299] "Volume detached for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/2b62ac4d-5e92-4c1a-af0f-7274fbba8175-tls-ca\") on node \"machine\" DevicePath \"\""3554machine # [ 222.500878] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod2b62ac4d_5e92_4c1a_af0f_7274fbba8175.slice.3555machine # [ 222.501873] systemd[1]: kubepods-besteffort-pod2b62ac4d_5e92_4c1a_af0f_7274fbba8175.slice: Consumed 617ms CPU time over 1min 22.721s wall clock time, 16M memory peak, 82.3K incoming IP traffic, 78.1K outgoing IP traffic.3556machine # [ 222.528947] k3s[888]: E0919 21:54:00.441058 888 status.go:71] "Unhandled Error" err="apiserver received an error that is not an metav1.Status: &errors.errorString{s:\"failed to create typed patch object (farm/nix-grpc-farm-scheduler; /v1, Kind=Service): .spec.selector.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}\"}: failed to create typed patch object (farm/nix-grpc-farm-scheduler; /v1, Kind=Service): .spec.selector.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}" logger="UnhandledError"3557machine # [ 222.534482] k3s[888]: I0919 21:54:00.446657 888 alloc.go:329] "allocated clusterIPs" service="farm/nix-grpc-farm" clusterIPs={"IPv4":"10.43.136.252"}3558machine # [ 222.547103] k3s[888]: E0919 21:54:00.457682 888 status.go:71] "Unhandled Error" err=<3559machine # [ 222.548385] k3s[888]: apiserver received an error that is not an metav1.Status: &errors.errorString{s:"failed to create typed patch object (farm/nix-grpc-farm-scheduler; apps/v1, Kind=Deployment): errors:\n .spec.template.metadata.labels.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}\n .spec.selector.matchLabels.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}"}: failed to create typed patch object (farm/nix-grpc-farm-scheduler; apps/v1, Kind=Deployment): errors:3560machine # [ 222.548889] k3s[888]: .spec.template.metadata.labels.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}3561machine # [ 222.549779] k3s[888]: .spec.selector.matchLabels.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}3562machine # [ 222.550637] k3s[888]: > logger="UnhandledError"3563machine # [ 222.574131] systemd[1]: cri-containerd-d408d79e39ea6f9824ed837148942389557f289fcc73d37cb7a1ed4149f58dfb.scope: Deactivated successfully.3564machine # [ 222.576675] systemd[1]: cri-containerd-d408d79e39ea6f9824ed837148942389557f289fcc73d37cb7a1ed4149f58dfb.scope: Consumed 909ms CPU time over 2.018s wall clock time, 31.2M memory peak, 3.3M incoming IP traffic, 194.7K outgoing IP traffic.3565machine # [ 222.819389] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-d408d79e39ea6f9824ed837148942389557f289fcc73d37cb7a1ed4149f58dfb-rootfs.mount: Deactivated successfully.3566machine # [ 222.819965] systemd[1]: var-lib-kubelet-pods-2b62ac4d\x2d5e92\x2d4c1a\x2daf0f\x2d7274fbba8175-volume\x2dsubpaths-config-envoy-0.mount: Deactivated successfully.3567machine # [ 222.822414] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-4b46750920671cff8b4b89fbacea0ea45ef1d4a59704b09fc62b9dd00a3965e5-rootfs.mount: Deactivated successfully.3568machine # [ 222.824170] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-4b46750920671cff8b4b89fbacea0ea45ef1d4a59704b09fc62b9dd00a3965e5-shm.mount: Deactivated successfully.3569machine # [ 222.825412] systemd[1]: run-netns-cni\x2d5ed7fcb7\x2dcd55\x2d0d7e\x2d1e6e\x2d6df404df1e16.mount: Deactivated successfully.3570machine # [ 222.827124] systemd[1]: var-lib-kubelet-pods-2b62ac4d\x2d5e92\x2d4c1a\x2daf0f\x2d7274fbba8175-volumes-kubernetes.io\x7esecret-tls\x2dlb.mount: Deactivated successfully.3571machine # [ 222.828400] systemd[1]: var-lib-kubelet-pods-2b62ac4d\x2d5e92\x2d4c1a\x2daf0f\x2d7274fbba8175-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully.3572machine # [ 222.829620] systemd[1]: var-lib-kubelet-pods-2b62ac4d\x2d5e92\x2d4c1a\x2daf0f\x2d7274fbba8175-volumes-kubernetes.io\x7esecret-tls\x2dca.mount: Deactivated successfully.3573machine # [ 223.011782] k3s[888]: I0919 21:54:00.921899 888 scope.go:122] "RemoveContainer" containerID="3efb052b77f7eb1252244ff8ff5e8b19a8073ed1d07e57871c0bbc337341b8e3"3574machine # [ 223.012348] k3s[888]: I0919 21:54:00.922888 888 scope.go:122] "RemoveContainer" containerID="d408d79e39ea6f9824ed837148942389557f289fcc73d37cb7a1ed4149f58dfb"3575machine # [ 223.016253] k3s[888]: E0919 21:54:00.923537 888 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"helm\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=helm pod=helm-install-nix-grpc-farm-7fwh5_kube-system(0758217b-c7d3-4cab-abc0-35bace80ed3f)\"" pod="kube-system/helm-install-nix-grpc-farm-7fwh5" podUID="0758217b-c7d3-4cab-abc0-35bace80ed3f"3576machine # [ 223.101658] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod2a287058_984a_464d_a81e_68d2dc80ab68.slice.3577machine # [ 223.116506] systemd[1]: Created slice libcontainer container kubepods-besteffort-poded26935c_22fd_4c10_af0f_68c643e6bd2d.slice.3578machine # [ 223.126332] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod0c46eb13_9cfa_46ac_8361_570e73bbc99b.slice.3579machine # [ 223.160079] k3s[888]: I0919 21:54:01.071060 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ed26935c-22fd-4c10-af0f-68c643e6bd2d-config\") pod \"nix-grpc-farm-lb-688d8d547b-n9pvj\" (UID: \"ed26935c-22fd-4c10-af0f-68c643e6bd2d\") " pod="farm/nix-grpc-farm-lb-688d8d547b-n9pvj"3580machine # [ 223.160297] k3s[888]: I0919 21:54:01.071109 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/2a287058-984a-464d-a81e-68d2dc80ab68-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-ncctl\" (UID: \"2a287058-984a-464d-a81e-68d2dc80ab68\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-ncctl"3581machine # [ 223.160375] k3s[888]: I0919 21:54:01.071772 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/0c46eb13-9cfa-46ac-8361-570e73bbc99b-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-w85mx\" (UID: \"0c46eb13-9cfa-46ac-8361-570e73bbc99b\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-w85mx"3582machine # [ 223.163831] k3s[888]: I0919 21:54:01.071816 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0c46eb13-9cfa-46ac-8361-570e73bbc99b-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-w85mx\" (UID: \"0c46eb13-9cfa-46ac-8361-570e73bbc99b\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-w85mx"3583machine # [ 223.166597] k3s[888]: I0919 21:54:01.071841 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/ed26935c-22fd-4c10-af0f-68c643e6bd2d-tls-lb\") pod \"nix-grpc-farm-lb-688d8d547b-n9pvj\" (UID: \"ed26935c-22fd-4c10-af0f-68c643e6bd2d\") " pod="farm/nix-grpc-farm-lb-688d8d547b-n9pvj"3584machine # [ 223.169363] k3s[888]: I0919 21:54:01.071868 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/2a287058-984a-464d-a81e-68d2dc80ab68-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-ncctl\" (UID: \"2a287058-984a-464d-a81e-68d2dc80ab68\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-ncctl"3585machine # [ 223.171474] k3s[888]: I0919 21:54:01.071912 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2a287058-984a-464d-a81e-68d2dc80ab68-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-ncctl\" (UID: \"2a287058-984a-464d-a81e-68d2dc80ab68\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-ncctl"3586machine # [ 223.172600] k3s[888]: I0919 21:54:01.071946 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/2a287058-984a-464d-a81e-68d2dc80ab68-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-ncctl\" (UID: \"2a287058-984a-464d-a81e-68d2dc80ab68\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-ncctl"3587machine # [ 223.175342] k3s[888]: I0919 21:54:01.072019 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8pqr\" (UniqueName: \"kubernetes.io/projected/2a287058-984a-464d-a81e-68d2dc80ab68-kube-api-access-h8pqr\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-ncctl\" (UID: \"2a287058-984a-464d-a81e-68d2dc80ab68\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-ncctl"3588machine # [ 223.176489] k3s[888]: I0919 21:54:01.072064 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/0c46eb13-9cfa-46ac-8361-570e73bbc99b-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-w85mx\" (UID: \"0c46eb13-9cfa-46ac-8361-570e73bbc99b\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-w85mx"3589machine # [ 223.177676] k3s[888]: I0919 21:54:01.072090 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/ed26935c-22fd-4c10-af0f-68c643e6bd2d-tls-ca\") pod \"nix-grpc-farm-lb-688d8d547b-n9pvj\" (UID: \"ed26935c-22fd-4c10-af0f-68c643e6bd2d\") " pod="farm/nix-grpc-farm-lb-688d8d547b-n9pvj"3590machine # [ 223.178477] k3s[888]: I0919 21:54:01.072119 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/2a287058-984a-464d-a81e-68d2dc80ab68-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-ncctl\" (UID: \"2a287058-984a-464d-a81e-68d2dc80ab68\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-ncctl"3591machine # [ 223.233663] k3s[888]: I0919 21:54:01.072334 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g276x\" (UniqueName: \"kubernetes.io/projected/0c46eb13-9cfa-46ac-8361-570e73bbc99b-kube-api-access-g276x\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-w85mx\" (UID: \"0c46eb13-9cfa-46ac-8361-570e73bbc99b\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-w85mx"3592machine # [ 223.234556] k3s[888]: I0919 21:54:01.072363 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/2a287058-984a-464d-a81e-68d2dc80ab68-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-ncctl\" (UID: \"2a287058-984a-464d-a81e-68d2dc80ab68\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-ncctl"3593machine # [ 223.235107] k3s[888]: I0919 21:54:01.072412 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/0c46eb13-9cfa-46ac-8361-570e73bbc99b-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-w85mx\" (UID: \"0c46eb13-9cfa-46ac-8361-570e73bbc99b\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-w85mx"3594machine # [ 223.235540] k3s[888]: I0919 21:54:01.072448 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed26935c-22fd-4c10-af0f-68c643e6bd2d-tmp\") pod \"nix-grpc-farm-lb-688d8d547b-n9pvj\" (UID: \"ed26935c-22fd-4c10-af0f-68c643e6bd2d\") " pod="farm/nix-grpc-farm-lb-688d8d547b-n9pvj"3595machine # [ 223.236149] k3s[888]: I0919 21:54:01.072475 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/2a287058-984a-464d-a81e-68d2dc80ab68-build\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-ncctl\" (UID: \"2a287058-984a-464d-a81e-68d2dc80ab68\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-ncctl"3596machine # [ 223.236817] k3s[888]: I0919 21:54:01.072512 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/0c46eb13-9cfa-46ac-8361-570e73bbc99b-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-w85mx\" (UID: \"0c46eb13-9cfa-46ac-8361-570e73bbc99b\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-w85mx"3597machine # [ 223.237462] k3s[888]: I0919 21:54:01.072542 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/0c46eb13-9cfa-46ac-8361-570e73bbc99b-build\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-w85mx\" (UID: \"0c46eb13-9cfa-46ac-8361-570e73bbc99b\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-w85mx"3598machine # [ 223.238179] k3s[888]: I0919 21:54:01.072567 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/0c46eb13-9cfa-46ac-8361-570e73bbc99b-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-w85mx\" (UID: \"0c46eb13-9cfa-46ac-8361-570e73bbc99b\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-w85mx"3599machine # [ 223.592361] cni0: port 3(vethab24064f) entered blocking state3600machine # [ 223.594565] cni0: port 3(vethab24064f) entered disabled state3601machine # [ 223.596271] vethab24064f: entered allmulticast mode3602machine # [ 223.597160] vethab24064f: entered promiscuous mode3603machine # [ 223.447830] (udev-worker)[13660]: Network interface NamePolicy= disabled on kernel command line.3604machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3605machine # [ 223.627472] cni0: port 3(vethab24064f) entered blocking state3606machine # [ 223.628561] cni0: port 3(vethab24064f) entered forwarding state3607machine # [ 223.652909] cni0: port 4(veth6f03ad42) entered blocking state3608machine # [ 223.656992] cni0: port 4(veth6f03ad42) entered disabled state3609machine # [ 223.662113] veth6f03ad42: entered allmulticast mode3610machine # [ 223.510968] dhcpcd[5125]: vet[ 223.664270] veth6f03ad42: entered promiscuous mode3611machine # hab24064f: IAID 77:50:9f:b63612machine # [ 223.511207] dhcpcd[5125]: vethab24064f: adding address fe80::dce5:77ff:fe50:9fb63613machine # [ 223.516535] (udev-worker)[13819]: Network interface NamePolicy= disabled on kernel command line.3614machine # [ 223.677675] cni0: port 4(veth6f03ad42) entered blocking state3615machine # [ 223.679063] cni0: port 4(veth6f03ad42) entered forwarding state3616machine # [ 223.568590] dhcpcd[5125]: veth6f03ad42: IAID 47:4a:1d:483617machine # [ 223.569227] dhcpcd[5125]: veth6f03ad42: adding address fe80::a480:47ff:fe4a:1d483618machine # [ 223.623354] systemd[1]: Started libcontainer container 6bc47d38afcfdf306a7e25efa10ffe1d284b080bad1e2f4496c8c6df2d3cd1f4.3619machine # [ 223.645663] systemd[1]: Started libcontainer container 1f453af42d899a994b9b95c384368f41c8c4700d71dee059bed4a9b66c33003e.3620machine # [ 223.725542] systemd[1]: Started libcontainer container a5711abd2f4336544623a60b050d4ffc953523e2cec902f4b699f4faead8b57a.3621machine # [ 223.901697] cni0: port 6(veth53fabe75) entered blocking state3622machine # [ 223.749296] systemd[1]: Started libcontainer container a65aa0[ 223.903810] cni0: port 6(veth53fabe75) entered disabled state3623machine # 6d1f9aaec3ce4d065fbde757f381ae591f2be461afa3724e92c37fb874.3624machine # [ 223.906083] veth53fabe75: entered allmulticast mode3625machine # [ 223.907703] veth53fabe75: entered promiscuous mode3626machine # [ 223.923893] cni0: port 6(veth53fabe75) entered blocking state3627machine # [ 223.924893] cni0: port 6(veth53fabe75) entered forwarding state3628machine # [ 223.795209] dhcpcd[5125]: veth53fabe75: IAID 7e:ad:bb:3d3629machine # [ 223.795431] dhcpcd[5125]: veth53fabe75: adding address fe80::f424:7eff:fead:bb3d3630machine # [ 223.884990] systemd[1]: Started libcontainer container 0f33007de9fb20704513fd6db9332ee570cc46e33b9ecbd687fc751efb4c7f06.3631machine # [ 224.206369] systemd[1]: Started libcontainer container e6da4defa263f962191a3dbd7fbd30338dd0f4ce8f3a0c9d18492263dc6f06e3.3632machine # [ 224.330823] systemd[1]: cri-containerd-a5711abd2f4336544623a60b050d4ffc953523e2cec902f4b699f4faead8b57a.scope: Deactivated successfully.3633machine # [ 224.341289] systemd[1]: cri-containerd-a5711abd2f4336544623a60b050d4ffc953523e2cec902f4b699f4faead8b57a.scope: Consumed 499ms CPU time over 604ms wall clock time, 305.8M memory peak, 158.3M written to disk.3634machine # [ 224.341627] systemd[1]: cri-containerd-a65aa06d1f9aaec3ce4d065fbde757f381ae591f2be461afa3724e92c37fb874.scope: Deactivated successfully.3635machine # [ 224.343730] systemd[1]: cri-containerd-a65aa06d1f9aaec3ce4d065fbde757f381ae591f2be461afa3724e92c37fb874.scope: Consumed 489ms CPU time over 585ms wall clock time, 304.7M memory peak, 16K read from disk, 159.2M written to disk.3636machine # [ 224.390493] dhcpcd[5125]: vethab24064f: soliciting a DHCP lease3637machine # [ 224.493874] k3s[888]: I0919 21:54:02.405610 888 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2b62ac4d-5e92-4c1a-af0f-7274fbba8175" path="/var/lib/kubelet/pods/2b62ac4d-5e92-4c1a-af0f-7274fbba8175/volumes"3638machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3639machine # [ 224.819573] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount4148112899.mount: Deactivated successfully.3640machine # [ 224.819937] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-a65aa06d1f9aaec3ce4d065fbde757f381ae591f2be461afa3724e92c37fb874-rootfs.mount: Deactivated successfully.3641machine # [ 224.820589] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-a5711abd2f4336544623a60b050d4ffc953523e2cec902f4b699f4faead8b57a-rootfs.mount: Deactivated successfully.3642machine # [ 225.181461] k3s[888]: I0919 21:54:03.093306 888 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-688d8d547b-n9pvj" podStartSLOduration=3.093255821 podStartE2EDuration="3.093255821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 21:54:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 21:54:03.091810666 +0000 UTC m=+203.882050071" watchObservedRunningTime="2026-09-19 21:54:03.093255821 +0000 UTC m=+203.883518414"3643machine # [ 225.215888] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount1320149025.mount: Deactivated successfully.3644machine # [ 225.225283] dhcpcd[5125]: veth6f03ad42: soliciting a DHCP lease3645machine # [ 225.238375] dhcpcd[5125]: veth6f03ad42: soliciting an IPv6 router3646machine # [ 225.262497] systemd[1]: Started libcontainer container 83666b04ef246a9fc0cb687dbacd46b01882b8161f40eece52bb57933beaa8e5.3647machine # [ 225.271193] systemd[1]: Started libcontainer container a3d5327cb12246482a085734d9f7c9febd07e14fa9f26be42ff36f85d06cd910.3648machine # [ 225.419575] systemd[1]: Started libcontainer container a1d21f7571ba54e65eef368a7776f549ecdc0fa9ac82a5abbd51a1a12e8f24f0.3649machine # [ 225.422361] systemd[1]: Started libcontainer container 8cb6c7977cf3a0b76762cf2179f359f607c791a0950e6f65af8f782924963cb9.3650machine # [ 225.529408] dhcpcd[5125]: veth53fabe75: soliciting a DHCP lease3651machine # [ 225.569336] systemd[1]: Started libcontainer container 8e937e0c79ea194a59a5805f374cb8efe978bf17098173bbb0e59d87cb5cf388.3652machine # [ 225.571710] systemd[1]: Started libcontainer container 1940b00794684f7317e8f2426a9686039dcaf106ea709c88a30caca0d1d3b019.3653machine # [ 225.762629] dhcpcd[5125]: vethab24064f: soliciting an IPv6 router3654machine # [ 225.780832] dhcpcd[5125]: veth53fabe75: soliciting an IPv6 router3655machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3656machine # [ 226.089446] systemd[1]: cri-containerd-66a02954cd331774fd770df9c322e5cf0c704c6d7a38defdecb509c7d8a62500.scope: Deactivated successfully.3657machine # [ 226.089913] systemd[1]: cri-containerd-66a02954cd331774fd770df9c322e5cf0c704c6d7a38defdecb509c7d8a62500.scope: Consumed 398ms CPU time over 1min 24.194s wall clock time, 12.8M memory peak, 4.8M read from disk, 35.1K incoming IP traffic, 31K outgoing IP traffic.3658machine # [ 226.105933] systemd[1]: cri-containerd-26425fb1cbb6078482918f46c602ffcf7697c2ba6ed05618e4ad847375727d3a.scope: Deactivated successfully.3659machine # [ 226.108184] systemd[1]: cri-containerd-26425fb1cbb6078482918f46c602ffcf7697c2ba6ed05618e4ad847375727d3a.scope: Consumed 396ms CPU time over 1min 24.218s wall clock time, 10.1M memory peak, 2.7M read from disk, 34.8K incoming IP traffic, 31K outgoing IP traffic.3660machine # [ 226.188313] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-66a02954cd331774fd770df9c322e5cf0c704c6d7a38defdecb509c7d8a62500-rootfs.mount: Deactivated successfully.3661machine # [ 226.196796] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-26425fb1cbb6078482918f46c602ffcf7697c2ba6ed05618e4ad847375727d3a-rootfs.mount: Deactivated successfully.3662machine # [ 226.208030] k3s[888]: I0919 21:54:04.119813 888 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-w85mx" podStartSLOduration=3.577120111 podStartE2EDuration="4.119783494s" totalImagesPullingTime="0s" totalInitContainerRuntime="542.663383ms" isStatefulPod=false podCreationTimestamp="2026-09-19 21:54:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 21:54:04.107054502 +0000 UTC m=+204.897294187" watchObservedRunningTime="2026-09-19 21:54:04.119783494 +0000 UTC m=+204.910022900"3663machine # [ 226.208300] k3s[888]: I0919 21:54:04.120033 888 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-ncctl" podStartSLOduration=3.5583442610000002 podStartE2EDuration="4.12002291s" totalImagesPullingTime="0s" totalInitContainerRuntime="561.678649ms" isStatefulPod=false podCreationTimestamp="2026-09-19 21:54:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 21:54:04.11964465 +0000 UTC m=+204.909884893" watchObservedRunningTime="2026-09-19 21:54:04.12002291 +0000 UTC m=+204.910262315"3664machine # [ 226.230524] systemd[1]: cri-containerd-9c13a25be3d44c0c446942377e27fc8060a2d5c325288b18f610e555fb0ebb3f.scope: Deactivated successfully.3665machine # [ 226.235489] systemd[1]: cri-containerd-3cca0fc16a3ffee5529ac29236e994442e0c19b1a71428f512c4f0ef45f117d5.scope: Deactivated successfully.3666machine # [ 226.278594] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-9c13a25be3d44c0c446942377e27fc8060a2d5c325288b18f610e555fb0ebb3f-rootfs.mount: Deactivated successfully.3667machine # [ 226.290944] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-3cca0fc16a3ffee5529ac29236e994442e0c19b1a71428f512c4f0ef45f117d5-rootfs.mount: Deactivated successfully.3668machine # [ 226.533366] cni0: port 7(vetha1298504) entered disabled state3669machine # [ 226.381988] dhcpcd[5125]: vetha1298504: carrier lost3670machine # [ 226.537030] vetha1298504 (unregistering): left allmulticast mode3671machine # [ 226.538590] vetha1298504 (unregistering): left promiscuous mode3672machine # [ 226.540723] cni0: port 7(vetha1298504) entered disabled state3673machine # [ 226.544061] cni0: port 5(veth1baec785) entered disabled state3674machine # [ 226.546743] veth1baec785 (unregistering): left allmulticast mode3675machine # [ 226.548468] veth1baec785 (unregistering): left promiscuous mode3676machine # [ 226.550226] cni0: port 5(veth1baec785) entered disabled state3677machine # [ 226.438733] dhcpcd[5125]: vetha1298504: deleting address fe80::c8bb:ccff:fe4d:3ca3678machine # [ 226.442224] dhcpcd[5125]: vetha1298504: deleting route to 169.254.0.0/163679machine # [ 226.558264] dhcpcd[5125]: dhcp_readbpf: unexpected event 0x01003680machine # [ 226.558513] dhcpcd[5125]: dhcp_readbpf: veth1baec785: Network is down3681machine # [ 226.563115] dhcpcd[5125]: arp_read: unexpected event 0x01003682machine # [ 226.563269] dhcpcd[5125]: arp_read: veth1baec785: Network is down3683machine # [ 226.567286] dhcpcd[5125]: vetha1298504: removing interface3684machine # [ 226.592152] dhcpcd[5125]: veth1baec785: removing interface3685machine # [ 226.592423] dhcpcd[5125]: veth1baec785: deleting address fe80::6cba:34ff:fe02:a3d73686machine # [ 226.592849] dhcpcd[5125]: veth1baec785: deleting route to 169.254.0.0/163687machine # [ 226.601270] k3s[888]: I0919 21:54:04.513421 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/14f3d126-f395-4eb8-a428-22e1b61f593c-build\" (UniqueName: \"kubernetes.io/empty-dir/14f3d126-f395-4eb8-a428-22e1b61f593c-build\") pod \"14f3d126-f395-4eb8-a428-22e1b61f593c\" (UID: \"14f3d126-f395-4eb8-a428-22e1b61f593c\") "3688machine # [ 226.601755] k3s[888]: I0919 21:54:04.513516 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/97b70126-2cba-444d-8916-2b00a400e084-niks3-token\" (UniqueName: \"kubernetes.io/projected/97b70126-2cba-444d-8916-2b00a400e084-niks3-token\") pod \"97b70126-2cba-444d-8916-2b00a400e084\" (UID: \"97b70126-2cba-444d-8916-2b00a400e084\") "3689machine # [ 226.602791] k3s[888]: I0919 21:54:04.513550 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/97b70126-2cba-444d-8916-2b00a400e084-kube-api-access-n9n9t\" (UniqueName: \"kubernetes.io/projected/97b70126-2cba-444d-8916-2b00a400e084-kube-api-access-n9n9t\") pod \"97b70126-2cba-444d-8916-2b00a400e084\" (UID: \"97b70126-2cba-444d-8916-2b00a400e084\") "3690machine # [ 226.603329] k3s[888]: I0919 21:54:04.514215 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14f3d126-f395-4eb8-a428-22e1b61f593c-build" pod "14f3d126-f395-4eb8-a428-22e1b61f593c" (UID: "14f3d126-f395-4eb8-a428-22e1b61f593c"). InnerVolumeSpecName "build". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""3691machine # [ 226.627783] k3s[888]: I0919 21:54:04.539962 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/97b70126-2cba-444d-8916-2b00a400e084-oidc\" (UniqueName: \"kubernetes.io/secret/97b70126-2cba-444d-8916-2b00a400e084-oidc\") pod \"97b70126-2cba-444d-8916-2b00a400e084\" (UID: \"97b70126-2cba-444d-8916-2b00a400e084\") "3692machine # [ 226.629060] k3s[888]: I0919 21:54:04.539998 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/14f3d126-f395-4eb8-a428-22e1b61f593c-niks3-token\" (UniqueName: \"kubernetes.io/projected/14f3d126-f395-4eb8-a428-22e1b61f593c-niks3-token\") pod \"14f3d126-f395-4eb8-a428-22e1b61f593c\" (UID: \"14f3d126-f395-4eb8-a428-22e1b61f593c\") "3693machine # [ 226.629789] k3s[888]: I0919 21:54:04.540034 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/14f3d126-f395-4eb8-a428-22e1b61f593c-ca\" (UniqueName: \"kubernetes.io/secret/14f3d126-f395-4eb8-a428-22e1b61f593c-ca\") pod \"14f3d126-f395-4eb8-a428-22e1b61f593c\" (UID: \"14f3d126-f395-4eb8-a428-22e1b61f593c\") "3694machine # [ 226.631379] k3s[888]: I0919 21:54:04.540061 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/97b70126-2cba-444d-8916-2b00a400e084-nix\" (UniqueName: \"kubernetes.io/empty-dir/97b70126-2cba-444d-8916-2b00a400e084-nix\") pod \"97b70126-2cba-444d-8916-2b00a400e084\" (UID: \"97b70126-2cba-444d-8916-2b00a400e084\") "3695machine # [ 226.642151] k3s[888]: I0919 21:54:04.553900 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97b70126-2cba-444d-8916-2b00a400e084-niks3-token" pod "97b70126-2cba-444d-8916-2b00a400e084" (UID: "97b70126-2cba-444d-8916-2b00a400e084"). InnerVolumeSpecName "niks3-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""3696machine # [ 226.643092] k3s[888]: I0919 21:54:04.553971 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97b70126-2cba-444d-8916-2b00a400e084-kube-api-access-n9n9t" pod "97b70126-2cba-444d-8916-2b00a400e084" (UID: "97b70126-2cba-444d-8916-2b00a400e084"). InnerVolumeSpecName "kube-api-access-n9n9t". PluginName "kubernetes.io/projected", VolumeGIDValue ""3697machine # [ 226.663382] k3s[888]: I0919 21:54:04.575006 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/14f3d126-f395-4eb8-a428-22e1b61f593c-oidc\" (UniqueName: \"kubernetes.io/secret/14f3d126-f395-4eb8-a428-22e1b61f593c-oidc\") pod \"14f3d126-f395-4eb8-a428-22e1b61f593c\" (UID: \"14f3d126-f395-4eb8-a428-22e1b61f593c\") "3698machine # [ 226.664132] k3s[888]: I0919 21:54:04.575053 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/97b70126-2cba-444d-8916-2b00a400e084-build\" (UniqueName: \"kubernetes.io/empty-dir/97b70126-2cba-444d-8916-2b00a400e084-build\") pod \"97b70126-2cba-444d-8916-2b00a400e084\" (UID: \"97b70126-2cba-444d-8916-2b00a400e084\") "3699machine # [ 226.664930] k3s[888]: I0919 21:54:04.575085 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/14f3d126-f395-4eb8-a428-22e1b61f593c-nix\" (UniqueName: \"kubernetes.io/empty-dir/14f3d126-f395-4eb8-a428-22e1b61f593c-nix\") pod \"14f3d126-f395-4eb8-a428-22e1b61f593c\" (UID: \"14f3d126-f395-4eb8-a428-22e1b61f593c\") "3700machine # [ 226.666092] k3s[888]: I0919 21:54:04.575118 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/14f3d126-f395-4eb8-a428-22e1b61f593c-tls\" (UniqueName: \"kubernetes.io/secret/14f3d126-f395-4eb8-a428-22e1b61f593c-tls\") pod \"14f3d126-f395-4eb8-a428-22e1b61f593c\" (UID: \"14f3d126-f395-4eb8-a428-22e1b61f593c\") "3701machine # [ 226.666321] k3s[888]: I0919 21:54:04.575164 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/14f3d126-f395-4eb8-a428-22e1b61f593c-kube-api-access-vm8xq\" (UniqueName: \"kubernetes.io/projected/14f3d126-f395-4eb8-a428-22e1b61f593c-kube-api-access-vm8xq\") pod \"14f3d126-f395-4eb8-a428-22e1b61f593c\" (UID: \"14f3d126-f395-4eb8-a428-22e1b61f593c\") "3702machine # [ 226.666891] k3s[888]: I0919 21:54:04.575195 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/97b70126-2cba-444d-8916-2b00a400e084-nixconf\" (UniqueName: \"kubernetes.io/configmap/97b70126-2cba-444d-8916-2b00a400e084-nixconf\") pod \"97b70126-2cba-444d-8916-2b00a400e084\" (UID: \"97b70126-2cba-444d-8916-2b00a400e084\") "3703machine # [ 226.667827] k3s[888]: I0919 21:54:04.575229 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/97b70126-2cba-444d-8916-2b00a400e084-ca\" (UniqueName: \"kubernetes.io/secret/97b70126-2cba-444d-8916-2b00a400e084-ca\") pod \"97b70126-2cba-444d-8916-2b00a400e084\" (UID: \"97b70126-2cba-444d-8916-2b00a400e084\") "3704machine # [ 226.668891] k3s[888]: I0919 21:54:04.575283 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/14f3d126-f395-4eb8-a428-22e1b61f593c-nixconf\" (UniqueName: \"kubernetes.io/configmap/14f3d126-f395-4eb8-a428-22e1b61f593c-nixconf\") pod \"14f3d126-f395-4eb8-a428-22e1b61f593c\" (UID: \"14f3d126-f395-4eb8-a428-22e1b61f593c\") "3705machine # [ 226.668965] k3s[888]: I0919 21:54:04.575316 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/97b70126-2cba-444d-8916-2b00a400e084-tls\" (UniqueName: \"kubernetes.io/secret/97b70126-2cba-444d-8916-2b00a400e084-tls\") pod \"97b70126-2cba-444d-8916-2b00a400e084\" (UID: \"97b70126-2cba-444d-8916-2b00a400e084\") "3706machine # [ 226.670186] k3s[888]: I0919 21:54:04.575395 888 reconciler_common.go:299] "Volume detached for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/14f3d126-f395-4eb8-a428-22e1b61f593c-build\") on node \"machine\" DevicePath \"\""3707machine # [ 226.670774] k3s[888]: I0919 21:54:04.575415 888 reconciler_common.go:299] "Volume detached for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/97b70126-2cba-444d-8916-2b00a400e084-niks3-token\") on node \"machine\" DevicePath \"\""3708machine # [ 226.670842] k3s[888]: I0919 21:54:04.575434 888 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9n9t\" (UniqueName: \"kubernetes.io/projected/97b70126-2cba-444d-8916-2b00a400e084-kube-api-access-n9n9t\") on node \"machine\" DevicePath \"\""3709machine # [ 226.671362] k3s[888]: I0919 21:54:04.576204 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97b70126-2cba-444d-8916-2b00a400e084-build" pod "97b70126-2cba-444d-8916-2b00a400e084" (UID: "97b70126-2cba-444d-8916-2b00a400e084"). InnerVolumeSpecName "build". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""3710machine # [ 226.733293] k3s[888]: I0919 21:54:04.577097 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14f3d126-f395-4eb8-a428-22e1b61f593c-nixconf" pod "14f3d126-f395-4eb8-a428-22e1b61f593c" (UID: "14f3d126-f395-4eb8-a428-22e1b61f593c"). InnerVolumeSpecName "nixconf". PluginName "kubernetes.io/configmap", VolumeGIDValue ""3711machine # [ 226.734083] k3s[888]: I0919 21:54:04.577278 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97b70126-2cba-444d-8916-2b00a400e084-nixconf" pod "97b70126-2cba-444d-8916-2b00a400e084" (UID: "97b70126-2cba-444d-8916-2b00a400e084"). InnerVolumeSpecName "nixconf". PluginName "kubernetes.io/configmap", VolumeGIDValue ""3712machine # [ 226.734825] k3s[888]: I0919 21:54:04.577579 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97b70126-2cba-444d-8916-2b00a400e084-oidc" pod "97b70126-2cba-444d-8916-2b00a400e084" (UID: "97b70126-2cba-444d-8916-2b00a400e084"). InnerVolumeSpecName "oidc". PluginName "kubernetes.io/secret", VolumeGIDValue ""3713machine # [ 226.735696] k3s[888]: I0919 21:54:04.577713 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14f3d126-f395-4eb8-a428-22e1b61f593c-niks3-token" pod "14f3d126-f395-4eb8-a428-22e1b61f593c" (UID: "14f3d126-f395-4eb8-a428-22e1b61f593c"). InnerVolumeSpecName "niks3-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""3714machine # [ 226.735946] k3s[888]: I0919 21:54:04.579623 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14f3d126-f395-4eb8-a428-22e1b61f593c-ca" pod "14f3d126-f395-4eb8-a428-22e1b61f593c" (UID: "14f3d126-f395-4eb8-a428-22e1b61f593c"). InnerVolumeSpecName "ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""3715machine # [ 226.764590] k3s[888]: I0919 21:54:04.676735 888 reconciler_common.go:299] "Volume detached for volume \"ca\" (UniqueName: \"kubernetes.io/secret/14f3d126-f395-4eb8-a428-22e1b61f593c-ca\") on node \"machine\" DevicePath \"\""3716machine # [ 226.765310] k3s[888]: I0919 21:54:04.677469 888 reconciler_common.go:299] "Volume detached for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/97b70126-2cba-444d-8916-2b00a400e084-build\") on node \"machine\" DevicePath \"\""3717machine # [ 226.766640] k3s[888]: I0919 21:54:04.677492 888 reconciler_common.go:299] "Volume detached for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/97b70126-2cba-444d-8916-2b00a400e084-nixconf\") on node \"machine\" DevicePath \"\""3718machine # [ 226.767597] k3s[888]: I0919 21:54:04.677513 888 reconciler_common.go:299] "Volume detached for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/14f3d126-f395-4eb8-a428-22e1b61f593c-nixconf\") on node \"machine\" DevicePath \"\""3719machine # [ 226.767698] k3s[888]: I0919 21:54:04.677560 888 reconciler_common.go:299] "Volume detached for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/97b70126-2cba-444d-8916-2b00a400e084-oidc\") on node \"machine\" DevicePath \"\""3720machine # [ 226.768598] k3s[888]: I0919 21:54:04.677576 888 reconciler_common.go:299] "Volume detached for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/14f3d126-f395-4eb8-a428-22e1b61f593c-niks3-token\") on node \"machine\" DevicePath \"\""3721machine # [ 226.791265] k3s[888]: I0919 21:54:04.703399 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97b70126-2cba-444d-8916-2b00a400e084-ca" pod "97b70126-2cba-444d-8916-2b00a400e084" (UID: "97b70126-2cba-444d-8916-2b00a400e084"). InnerVolumeSpecName "ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""3722machine # [ 226.792053] k3s[888]: I0919 21:54:04.704212 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14f3d126-f395-4eb8-a428-22e1b61f593c-kube-api-access-vm8xq" pod "14f3d126-f395-4eb8-a428-22e1b61f593c" (UID: "14f3d126-f395-4eb8-a428-22e1b61f593c"). InnerVolumeSpecName "kube-api-access-vm8xq". PluginName "kubernetes.io/projected", VolumeGIDValue ""3723machine # [ 226.792612] k3s[888]: I0919 21:54:04.704478 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14f3d126-f395-4eb8-a428-22e1b61f593c-tls" pod "14f3d126-f395-4eb8-a428-22e1b61f593c" (UID: "14f3d126-f395-4eb8-a428-22e1b61f593c"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""3724machine # [ 226.793268] k3s[888]: I0919 21:54:04.704988 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97b70126-2cba-444d-8916-2b00a400e084-tls" pod "97b70126-2cba-444d-8916-2b00a400e084" (UID: "97b70126-2cba-444d-8916-2b00a400e084"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""3725machine # [ 226.813776] k3s[888]: I0919 21:54:04.725904 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14f3d126-f395-4eb8-a428-22e1b61f593c-oidc" pod "14f3d126-f395-4eb8-a428-22e1b61f593c" (UID: "14f3d126-f395-4eb8-a428-22e1b61f593c"). InnerVolumeSpecName "oidc". PluginName "kubernetes.io/secret", VolumeGIDValue ""3726machine # [ 226.818063] systemd[1]: var-lib-kubelet-pods-97b70126\x2d2cba\x2d444d\x2d8916\x2d2b00a400e084-volume\x2dsubpaths-nix-gc-0.mount: Deactivated successfully.3727machine # [ 226.820166] systemd[1]: var-lib-kubelet-pods-14f3d126\x2df395\x2d4eb8\x2da428\x2d22e1b61f593c-volume\x2dsubpaths-nix-gc-0.mount: Deactivated successfully.3728machine # [ 226.820771] systemd[1]: var-lib-kubelet-pods-97b70126\x2d2cba\x2d444d\x2d8916\x2d2b00a400e084-volume\x2dsubpaths-nix-nix\x2dgrpc\x2ddaemon-0.mount: Deactivated successfully.3729machine # [ 226.820966] systemd[1]: var-lib-kubelet-pods-14f3d126\x2df395\x2d4eb8\x2da428\x2d22e1b61f593c-volume\x2dsubpaths-nix-nix\x2ddaemon-0.mount: Deactivated successfully.3730machine # [ 226.821798] systemd[1]: var-lib-kubelet-pods-97b70126\x2d2cba\x2d444d\x2d8916\x2d2b00a400e084-volume\x2dsubpaths-nix-nix\x2ddaemon-0.mount: Deactivated successfully.3731machine # [ 226.822761] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-3cca0fc16a3ffee5529ac29236e994442e0c19b1a71428f512c4f0ef45f117d5-shm.mount: Deactivated successfully.3732machine # [ 226.823461] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-9c13a25be3d44c0c446942377e27fc8060a2d5c325288b18f610e555fb0ebb3f-shm.mount: Deactivated successfully.3733machine # [ 226.823680] systemd[1]: run-netns-cni\x2d6c59dc3a\x2ddbd6\x2dbbac\x2d7e49\x2dd9e338084fe2.mount: Deactivated successfully.3734machine # [ 226.827125] systemd[1]: run-netns-cni\x2d2d68f3b3\x2d7cfc\x2d2e3d\x2de6ae\x2d0a667e825875.mount: Deactivated successfully.3735machine # [ 226.827754] systemd[1]: var-lib-kubelet-pods-14f3d126\x2df395\x2d4eb8\x2da428\x2d22e1b61f593c-volumes-kubernetes.io\x7eprojected-niks3\x2dtoken.mount: Deactivated successfully.3736machine # [ 226.828676] systemd[1]: var-lib-kubelet-pods-14f3d126\x2df395\x2d4eb8\x2da428\x2d22e1b61f593c-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dvm8xq.mount: Deactivated successfully.3737machine # [ 226.829189] systemd[1]: var-lib-kubelet-pods-97b70126\x2d2cba\x2d444d\x2d8916\x2d2b00a400e084-volumes-kubernetes.io\x7eprojected-niks3\x2dtoken.mount: Deactivated successfully.3738machine # [ 226.829700] systemd[1]: var-lib-kubelet-pods-97b70126\x2d2cba\x2d444d\x2d8916\x2d2b00a400e084-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dn9n9t.mount: Deactivated successfully.3739machine # [ 226.830258] systemd[1]: var-lib-kubelet-pods-97b70126\x2d2cba\x2d444d\x2d8916\x2d2b00a400e084-volumes-kubernetes.io\x7esecret-tls.mount: Deactivated successfully.3740machine # [ 226.830718] systemd[1]: var-lib-kubelet-pods-97b70126\x2d2cba\x2d444d\x2d8916\x2d2b00a400e084-volumes-kubernetes.io\x7esecret-ca.mount: Deactivated successfully.3741machine # [ 226.831436] systemd[1]: var-lib-kubelet-pods-14f3d126\x2df395\x2d4eb8\x2da428\x2d22e1b61f593c-volumes-kubernetes.io\x7esecret-oidc.mount: Deactivated successfully.3742machine # [ 226.831992] systemd[1]: var-lib-kubelet-pods-97b70126\x2d2cba\x2d444d\x2d8916\x2d2b00a400e084-volumes-kubernetes.io\x7esecret-oidc.mount: Deactivated successfully.3743machine # [ 226.832626] systemd[1]: var-lib-kubelet-pods-14f3d126\x2df395\x2d4eb8\x2da428\x2d22e1b61f593c-volumes-kubernetes.io\x7esecret-tls.mount: Deactivated successfully.3744machine # [ 226.833163] systemd[1]: var-lib-kubelet-pods-14f3d126\x2df395\x2d4eb8\x2da428\x2d22e1b61f593c-volumes-kubernetes.io\x7esecret-ca.mount: Deactivated successfully.3745machine # [ 226.833625] systemd[1]: var-lib-kubelet-pods-14f3d126\x2df395\x2d4eb8\x2da428\x2d22e1b61f593c-volume\x2dsubpaths-nix-nix\x2dgrpc\x2ddaemon-0.mount: Deactivated successfully.3746machine # [ 226.866206] k3s[888]: I0919 21:54:04.778335 888 reconciler_common.go:299] "Volume detached for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/14f3d126-f395-4eb8-a428-22e1b61f593c-oidc\") on node \"machine\" DevicePath \"\""3747machine # [ 226.866691] k3s[888]: I0919 21:54:04.778381 888 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/14f3d126-f395-4eb8-a428-22e1b61f593c-tls\") on node \"machine\" DevicePath \"\""3748machine # [ 226.867191] k3s[888]: I0919 21:54:04.778399 888 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vm8xq\" (UniqueName: \"kubernetes.io/projected/14f3d126-f395-4eb8-a428-22e1b61f593c-kube-api-access-vm8xq\") on node \"machine\" DevicePath \"\""3749machine # [ 226.867630] k3s[888]: I0919 21:54:04.778415 888 reconciler_common.go:299] "Volume detached for volume \"ca\" (UniqueName: \"kubernetes.io/secret/97b70126-2cba-444d-8916-2b00a400e084-ca\") on node \"machine\" DevicePath \"\""3750machine # [ 226.868418] k3s[888]: I0919 21:54:04.778436 888 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/97b70126-2cba-444d-8916-2b00a400e084-tls\") on node \"machine\" DevicePath \"\""3751machine # [ 226.984855] k3s[888]: I0919 21:54:04.896980 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97b70126-2cba-444d-8916-2b00a400e084-nix" pod "97b70126-2cba-444d-8916-2b00a400e084" (UID: "97b70126-2cba-444d-8916-2b00a400e084"). InnerVolumeSpecName "nix". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""3752machine # [ 227.019865] k3s[888]: I0919 21:54:04.931980 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14f3d126-f395-4eb8-a428-22e1b61f593c-nix" pod "14f3d126-f395-4eb8-a428-22e1b61f593c" (UID: "14f3d126-f395-4eb8-a428-22e1b61f593c"). InnerVolumeSpecName "nix". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""3753machine # [ 227.067538] k3s[888]: I0919 21:54:04.979662 888 reconciler_common.go:299] "Volume detached for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/97b70126-2cba-444d-8916-2b00a400e084-nix\") on node \"machine\" DevicePath \"\""3754machine # [ 227.073118] k3s[888]: I0919 21:54:04.979702 888 reconciler_common.go:299] "Volume detached for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/14f3d126-f395-4eb8-a428-22e1b61f593c-nix\") on node \"machine\" DevicePath \"\""3755machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3756machine # [ 227.186538] k3s[888]: I0919 21:54:05.098668 888 scope.go:122] "RemoveContainer" containerID="3c022f3880654559459bc4e22e491049f6b8a9d287502c3f0c48081aa411bc5e"3757machine # [ 227.194418] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod14f3d126_f395_4eb8_a428_22e1b61f593c.slice.3758machine # [ 227.195119] systemd[1]: kubepods-besteffort-pod14f3d126_f395_4eb8_a428_22e1b61f593c.slice: Consumed 1.146s CPU time over 1min 27.399s wall clock time, 323.9M memory peak, 2.7M read from disk, 283.9M written to disk, 34.8K incoming IP traffic, 31K outgoing IP traffic.3759machine # [ 227.198756] k3s[888]: I0919 21:54:05.110942 888 scope.go:122] "RemoveContainer" containerID="26425fb1cbb6078482918f46c602ffcf7697c2ba6ed05618e4ad847375727d3a"3760machine # [ 227.213337] k3s[888]: I0919 21:54:05.124918 888 scope.go:122] "RemoveContainer" containerID="9e7f919ce17e1c7cb35d9228da4097810f270917cd33d1c200e8ddf3d4b1a62d"3761machine # [ 227.214721] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod97b70126_2cba_444d_8916_2b00a400e084.slice.3762machine # [ 227.216509] systemd[1]: kubepods-besteffort-pod97b70126_2cba_444d_8916_2b00a400e084.slice: Consumed 1.154s CPU time over 1min 27.425s wall clock time, 325M memory peak, 4.9M read from disk, 283.9M written to disk, 35.1K incoming IP traffic, 31K outgoing IP traffic.3763machine # [ 227.223650] k3s[888]: I0919 21:54:05.135788 888 scope.go:122] "RemoveContainer" containerID="5d6cbad5b9a38afcd226e4adf28e12e4921b0931b2a5458f73fb34076a537e93"3764machine # [ 227.235667] k3s[888]: I0919 21:54:05.147811 888 scope.go:122] "RemoveContainer" containerID="3c022f3880654559459bc4e22e491049f6b8a9d287502c3f0c48081aa411bc5e"3765machine # [ 227.236516] k3s[888]: E0919 21:54:05.148698 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"3c022f3880654559459bc4e22e491049f6b8a9d287502c3f0c48081aa411bc5e\": not found" containerID="3c022f3880654559459bc4e22e491049f6b8a9d287502c3f0c48081aa411bc5e"3766machine # [ 227.237630] k3s[888]: I0919 21:54:05.148742 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"3c022f3880654559459bc4e22e491049f6b8a9d287502c3f0c48081aa411bc5e"} err="failed to get container status \"3c022f3880654559459bc4e22e491049f6b8a9d287502c3f0c48081aa411bc5e\": rpc error: code = NotFound desc = an error occurred when try to find container \"3c022f3880654559459bc4e22e491049f6b8a9d287502c3f0c48081aa411bc5e\": not found"3767machine # [ 227.239127] k3s[888]: I0919 21:54:05.148777 888 scope.go:122] "RemoveContainer" containerID="26425fb1cbb6078482918f46c602ffcf7697c2ba6ed05618e4ad847375727d3a"3768machine # [ 227.239794] k3s[888]: E0919 21:54:05.149422 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"26425fb1cbb6078482918f46c602ffcf7697c2ba6ed05618e4ad847375727d3a\": not found" containerID="26425fb1cbb6078482918f46c602ffcf7697c2ba6ed05618e4ad847375727d3a"3769machine # [ 227.240678] k3s[888]: I0919 21:54:05.149450 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"26425fb1cbb6078482918f46c602ffcf7697c2ba6ed05618e4ad847375727d3a"} err="failed to get container status \"26425fb1cbb6078482918f46c602ffcf7697c2ba6ed05618e4ad847375727d3a\": rpc error: code = NotFound desc = an error occurred when try to find container \"26425fb1cbb6078482918f46c602ffcf7697c2ba6ed05618e4ad847375727d3a\": not found"3770machine # [ 227.243021] k3s[888]: I0919 21:54:05.149471 888 scope.go:122] "RemoveContainer" containerID="9e7f919ce17e1c7cb35d9228da4097810f270917cd33d1c200e8ddf3d4b1a62d"3771machine # [ 227.243634] k3s[888]: E0919 21:54:05.149919 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"9e7f919ce17e1c7cb35d9228da4097810f270917cd33d1c200e8ddf3d4b1a62d\": not found" containerID="9e7f919ce17e1c7cb35d9228da4097810f270917cd33d1c200e8ddf3d4b1a62d"3772machine # [ 227.244042] k3s[888]: I0919 21:54:05.149941 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"9e7f919ce17e1c7cb35d9228da4097810f270917cd33d1c200e8ddf3d4b1a62d"} err="failed to get container status \"9e7f919ce17e1c7cb35d9228da4097810f270917cd33d1c200e8ddf3d4b1a62d\": rpc error: code = NotFound desc = an error occurred when try to find container \"9e7f919ce17e1c7cb35d9228da4097810f270917cd33d1c200e8ddf3d4b1a62d\": not found"3773machine # [ 227.244122] k3s[888]: I0919 21:54:05.149958 888 scope.go:122] "RemoveContainer" containerID="5d6cbad5b9a38afcd226e4adf28e12e4921b0931b2a5458f73fb34076a537e93"3774machine # [ 227.244682] k3s[888]: E0919 21:54:05.150381 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"5d6cbad5b9a38afcd226e4adf28e12e4921b0931b2a5458f73fb34076a537e93\": not found" containerID="5d6cbad5b9a38afcd226e4adf28e12e4921b0931b2a5458f73fb34076a537e93"3775machine # [ 227.245419] k3s[888]: I0919 21:54:05.150401 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"5d6cbad5b9a38afcd226e4adf28e12e4921b0931b2a5458f73fb34076a537e93"} err="failed to get container status \"5d6cbad5b9a38afcd226e4adf28e12e4921b0931b2a5458f73fb34076a537e93\": rpc error: code = NotFound desc = an error occurred when try to find container \"5d6cbad5b9a38afcd226e4adf28e12e4921b0931b2a5458f73fb34076a537e93\": not found"3776machine # [ 227.245971] k3s[888]: I0919 21:54:05.150420 888 scope.go:122] "RemoveContainer" containerID="81b859107ae751e3ab106bc2abc9a99a86026237c22e0580bf37b3027d58eca8"3777machine # [ 227.246632] k3s[888]: I0919 21:54:05.158442 888 scope.go:122] "RemoveContainer" containerID="66a02954cd331774fd770df9c322e5cf0c704c6d7a38defdecb509c7d8a62500"3778machine # [ 227.256123] k3s[888]: I0919 21:54:05.168162 888 scope.go:122] "RemoveContainer" containerID="f833aabf75df9a7a3b03835241d8c85ea26bfedf78443b964aefd935295f3785"3779machine # [ 227.265047] k3s[888]: I0919 21:54:05.176954 888 scope.go:122] "RemoveContainer" containerID="10b12da6185543316df7845c61276384d211588228d3737ce24d4891e0641f5d"3780machine # [ 227.271980] k3s[888]: I0919 21:54:05.184177 888 scope.go:122] "RemoveContainer" containerID="81b859107ae751e3ab106bc2abc9a99a86026237c22e0580bf37b3027d58eca8"3781machine # [ 227.273757] k3s[888]: E0919 21:54:05.185956 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"81b859107ae751e3ab106bc2abc9a99a86026237c22e0580bf37b3027d58eca8\": not found" containerID="81b859107ae751e3ab106bc2abc9a99a86026237c22e0580bf37b3027d58eca8"3782machine # [ 227.275467] k3s[888]: I0919 21:54:05.185993 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"81b859107ae751e3ab106bc2abc9a99a86026237c22e0580bf37b3027d58eca8"} err="failed to get container status \"81b859107ae751e3ab106bc2abc9a99a86026237c22e0580bf37b3027d58eca8\": rpc error: code = NotFound desc = an error occurred when try to find container \"81b859107ae751e3ab106bc2abc9a99a86026237c22e0580bf37b3027d58eca8\": not found"3783machine # [ 227.276289] k3s[888]: I0919 21:54:05.186020 888 scope.go:122] "RemoveContainer" containerID="66a02954cd331774fd770df9c322e5cf0c704c6d7a38defdecb509c7d8a62500"3784machine # [ 227.276628] k3s[888]: E0919 21:54:05.186754 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"66a02954cd331774fd770df9c322e5cf0c704c6d7a38defdecb509c7d8a62500\": not found" containerID="66a02954cd331774fd770df9c322e5cf0c704c6d7a38defdecb509c7d8a62500"3785machine # [ 227.279745] k3s[888]: I0919 21:54:05.186795 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"66a02954cd331774fd770df9c322e5cf0c704c6d7a38defdecb509c7d8a62500"} err="failed to get container status \"66a02954cd331774fd770df9c322e5cf0c704c6d7a38defdecb509c7d8a62500\": rpc error: code = NotFound desc = an error occurred when try to find container \"66a02954cd331774fd770df9c322e5cf0c704c6d7a38defdecb509c7d8a62500\": not found"3786machine # [ 227.345350] k3s[888]: I0919 21:54:05.186827 888 scope.go:122] "RemoveContainer" containerID="f833aabf75df9a7a3b03835241d8c85ea26bfedf78443b964aefd935295f3785"3787machine # [ 227.346367] k3s[888]: E0919 21:54:05.187459 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"f833aabf75df9a7a3b03835241d8c85ea26bfedf78443b964aefd935295f3785\": not found" containerID="f833aabf75df9a7a3b03835241d8c85ea26bfedf78443b964aefd935295f3785"3788machine # [ 227.347066] k3s[888]: I0919 21:54:05.187485 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"f833aabf75df9a7a3b03835241d8c85ea26bfedf78443b964aefd935295f3785"} err="failed to get container status \"f833aabf75df9a7a3b03835241d8c85ea26bfedf78443b964aefd935295f3785\": rpc error: code = NotFound desc = an error occurred when try to find container \"f833aabf75df9a7a3b03835241d8c85ea26bfedf78443b964aefd935295f3785\": not found"3789machine # [ 227.347688] k3s[888]: I0919 21:54:05.187513 888 scope.go:122] "RemoveContainer" containerID="10b12da6185543316df7845c61276384d211588228d3737ce24d4891e0641f5d"3790machine # [ 227.348603] k3s[888]: E0919 21:54:05.187983 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"10b12da6185543316df7845c61276384d211588228d3737ce24d4891e0641f5d\": not found" containerID="10b12da6185543316df7845c61276384d211588228d3737ce24d4891e0641f5d"3791machine # [ 227.349252] k3s[888]: I0919 21:54:05.188012 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"10b12da6185543316df7845c61276384d211588228d3737ce24d4891e0641f5d"} err="failed to get container status \"10b12da6185543316df7845c61276384d211588228d3737ce24d4891e0641f5d\": rpc error: code = NotFound desc = an error occurred when try to find container \"10b12da6185543316df7845c61276384d211588228d3737ce24d4891e0641f5d\": not found"3792machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3793machine # [ 228.497472] k3s[888]: I0919 21:54:06.408819 888 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="14f3d126-f395-4eb8-a428-22e1b61f593c" path="/var/lib/kubelet/pods/14f3d126-f395-4eb8-a428-22e1b61f593c/volumes"3794machine # [ 228.506564] k3s[888]: I0919 21:54:06.418683 888 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="97b70126-2cba-444d-8916-2b00a400e084" path="/var/lib/kubelet/pods/97b70126-2cba-444d-8916-2b00a400e084/volumes"3795machine # [ 229.391780] dhcpcd[5125]: vethab24064f: probing for an IPv4LL address3796machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3797machine # [ 230.226265] dhcpcd[5125]: veth6f03ad42: probing for an IPv4LL address3798machine # [ 230.530408] dhcpcd[5125]: veth53fabe75: probing for an IPv4LL address3799machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3800machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3801machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3802machine # [ 234.832430] dhcpcd[5125]: vethab24064f: using IPv4LL address 169.254.31.363803machine # [ 234.832679] dhcpcd[5125]: vethab24064f: adding route to 169.254.0.0/163804machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3805machine # [ 234.942528] dhcpcd[5125]: veth53fabe75: using IPv4LL address 169.254.203.1973806machine # [ 234.942989] dhcpcd[5125]: veth53fabe75: adding route to 169.254.0.0/163807machine # [ 235.531093] dhcpcd[5125]: veth6f03ad42: using IPv4LL address 169.254.183.1083808machine # [ 235.531610] dhcpcd[5125]: veth6f03ad42: adding route to 169.254.0.0/163809machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3810machine # [ 237.242962] dhcpcd[5125]: veth6f03ad42: no IPv6 Routers available3811machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3812machine # [ 237.765671] dhcpcd[5125]: vethab24064f: no IPv6 Routers available3813machine # [ 237.782876] dhcpcd[5125]: veth53fabe75: no IPv6 Routers available3814machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3815machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3816machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3817machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3818machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3819machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3820machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3821machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3822machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3823machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3824machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3825machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3826machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3827machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3828machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3829machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3830machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3831machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3832machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3833machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3834machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3835machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3836machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3837machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3838machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3839machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3840machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3841machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3842machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3843machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3844machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3845machine # [ 277.186767] k3s[888]: I0919 21:54:55.098213 888 scope.go:122] "RemoveContainer" containerID="790c0d1d7fbc65a7446667e4dd367e829ab8660dcbf20314f5a5e128217bf4f0"3846machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3847machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3848machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3849machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3850machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3851machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3852machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3853machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3854machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3855machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3856machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3857machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3858machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3859machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3860machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3861machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3862machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3863machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3864machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3865machine # [ 302.490795] k3s[888]: I0919 21:55:20.402210 888 scope.go:122] "RemoveContainer" containerID="d408d79e39ea6f9824ed837148942389557f289fcc73d37cb7a1ed4149f58dfb"3866machine # [ 302.491287] k3s[888]: E0919 21:55:20.402632 888 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"helm\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=helm pod=helm-install-nix-grpc-farm-7fwh5_kube-system(0758217b-c7d3-4cab-abc0-35bace80ed3f)\"" pod="kube-system/helm-install-nix-grpc-farm-7fwh5" podUID="0758217b-c7d3-4cab-abc0-35bace80ed3f"3867machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3868machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3869machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3870machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3871machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3872machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3873machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3874machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3875machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3876machine # [ 313.497878] postgres[782]: [782] LOG: checkpoint starting: time3877machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3878machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3879machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3880machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3881machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3882machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3883machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3884machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3885machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3886machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3887machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3888machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3889machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3890machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3891machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3892machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3893machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3894machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3895machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3896machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3897machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3898machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3899machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3900machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3901machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3902machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3903machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3904machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3905machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3906machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3907machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3908machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3909machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3910machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3911machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3912machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3913machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3914machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3915machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3916machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3917machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3918machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3919machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3920machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3921machine # [ 370.491407] k3s[888]: I0919 21:56:28.402531 888 scope.go:122] "RemoveContainer" containerID="d408d79e39ea6f9824ed837148942389557f289fcc73d37cb7a1ed4149f58dfb"3922machine # [ 370.497577] k3s[888]: E0919 21:56:28.402847 888 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"helm\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=helm pod=helm-install-nix-grpc-farm-7fwh5_kube-system(0758217b-c7d3-4cab-abc0-35bace80ed3f)\"" pod="kube-system/helm-install-nix-grpc-farm-7fwh5" podUID="0758217b-c7d3-4cab-abc0-35bace80ed3f"3923machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3924machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3925machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3926machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3927machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3928machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3929machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3930machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3931machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3932machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3933machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3934machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3935machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3936machine # [ 387.490662] k3s[888]: I0919 21:56:45.401828 888 scope.go:122] "RemoveContainer" containerID="d408d79e39ea6f9824ed837148942389557f289fcc73d37cb7a1ed4149f58dfb"3937machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3938machine # [ 387.565597] systemd[1]: Started libcontainer container b114f09cc9f40c3c1d2335b905e293e66e3aefa4cc79ea49658c6a9c16b1c76f.3939machine # [ 388.780146] systemd[1]: cri-containerd-8e937e0c79ea194a59a5805f374cb8efe978bf17098173bbb0e59d87cb5cf388.scope: Deactivated successfully.3940machine # [ 388.784729] systemd[1]: cri-containerd-e6da4defa263f962191a3dbd7fbd30338dd0f4ce8f3a0c9d18492263dc6f06e3.scope: Deactivated successfully.3941machine # [ 388.785145] systemd[1]: cri-containerd-e6da4defa263f962191a3dbd7fbd30338dd0f4ce8f3a0c9d18492263dc6f06e3.scope: Consumed 1.144s CPU time over 2min 44.576s wall clock time, 15.8M memory peak, 153.8K incoming IP traffic, 151K outgoing IP traffic.3942machine # [ 388.801906] systemd[1]: cri-containerd-1940b00794684f7317e8f2426a9686039dcaf106ea709c88a30caca0d1d3b019.scope: Deactivated successfully.3943machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found3944machine # [ 388.845367] systemd[1]: cri-containerd-a3d5327cb12246482a085734d9f7c9febd07e14fa9f26be42ff36f85d06cd910.scope: Deactivated successfully.3945machine # [ 388.849230] systemd[1]: cri-containerd-83666b04ef246a9fc0cb687dbacd46b01882b8161f40eece52bb57933beaa8e5.scope: Deactivated successfully.3946machine # [ 388.860793] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-8e937e0c79ea194a59a5805f374cb8efe978bf17098173bbb0e59d87cb5cf388-rootfs.mount: Deactivated successfully.3947machine # [ 388.872798] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-e6da4defa263f962191a3dbd7fbd30338dd0f4ce8f3a0c9d18492263dc6f06e3-rootfs.mount: Deactivated successfully.3948machine # [ 388.882389] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-1940b00794684f7317e8f2426a9686039dcaf106ea709c88a30caca0d1d3b019-rootfs.mount: Deactivated successfully.3949machine # [ 388.902250] systemd[1]: cri-containerd-0f33007de9fb20704513fd6db9332ee570cc46e33b9ecbd687fc751efb4c7f06.scope: Deactivated successfully.3950machine # [ 388.924631] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-a3d5327cb12246482a085734d9f7c9febd07e14fa9f26be42ff36f85d06cd910-rootfs.mount: Deactivated successfully.3951machine # [ 388.933313] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-83666b04ef246a9fc0cb687dbacd46b01882b8161f40eece52bb57933beaa8e5-rootfs.mount: Deactivated successfully.3952machine # [ 389.207974] cni0: port 6(veth53fabe75) entered disabled state3953machine # [ 389.055963] dhcpcd[5125]: veth53fabe75: carrier lost3954machine # [ 389.212099] veth53fabe75 (unregistering): left allmulticast mode3955machine # [ 389.213860] veth53fabe75 (unregistering): left promiscuous mode3956machine # [ 389.215904] cni0: port 6(veth53fabe75) entered disabled state3957machine # [ 389.114603] dhcpcd[5125]: veth53fabe75: deleting address fe80::f424:7eff:fead:bb3d3958machine # [ 389.119180] dhcpcd[5125]: veth53fabe75: deleting route to 169.254.0.0/163959machine # [ 389.194331] k3s[888]: I0919 21:56:47.106148 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ed26935c-22fd-4c10-af0f-68c643e6bd2d-tls-ca\" (UniqueName: \"kubernetes.io/secret/ed26935c-22fd-4c10-af0f-68c643e6bd2d-tls-ca\") pod \"ed26935c-22fd-4c10-af0f-68c643e6bd2d\" (UID: \"ed26935c-22fd-4c10-af0f-68c643e6bd2d\") "3960machine # [ 389.194560] k3s[888]: I0919 21:56:47.106229 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ed26935c-22fd-4c10-af0f-68c643e6bd2d-tls-lb\" (UniqueName: \"kubernetes.io/secret/ed26935c-22fd-4c10-af0f-68c643e6bd2d-tls-lb\") pod \"ed26935c-22fd-4c10-af0f-68c643e6bd2d\" (UID: \"ed26935c-22fd-4c10-af0f-68c643e6bd2d\") "3961machine # [ 389.195087] k3s[888]: I0919 21:56:47.106651 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ed26935c-22fd-4c10-af0f-68c643e6bd2d-tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed26935c-22fd-4c10-af0f-68c643e6bd2d-tmp\") pod \"ed26935c-22fd-4c10-af0f-68c643e6bd2d\" (UID: \"ed26935c-22fd-4c10-af0f-68c643e6bd2d\") "3962machine # [ 389.195375] k3s[888]: I0919 21:56:47.106754 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ed26935c-22fd-4c10-af0f-68c643e6bd2d-config\" (UniqueName: \"kubernetes.io/configmap/ed26935c-22fd-4c10-af0f-68c643e6bd2d-config\") pod \"ed26935c-22fd-4c10-af0f-68c643e6bd2d\" (UID: \"ed26935c-22fd-4c10-af0f-68c643e6bd2d\") "3963machine # [ 389.221218] k3s[888]: I0919 21:56:47.133369 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed26935c-22fd-4c10-af0f-68c643e6bd2d-tmp" pod "ed26935c-22fd-4c10-af0f-68c643e6bd2d" (UID: "ed26935c-22fd-4c10-af0f-68c643e6bd2d"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""3964machine # [ 389.221568] k3s[888]: I0919 21:56:47.133455 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed26935c-22fd-4c10-af0f-68c643e6bd2d-tls-ca" pod "ed26935c-22fd-4c10-af0f-68c643e6bd2d" (UID: "ed26935c-22fd-4c10-af0f-68c643e6bd2d"). InnerVolumeSpecName "tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""3965machine # [ 389.222964] k3s[888]: I0919 21:56:47.134453 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed26935c-22fd-4c10-af0f-68c643e6bd2d-config" pod "ed26935c-22fd-4c10-af0f-68c643e6bd2d" (UID: "ed26935c-22fd-4c10-af0f-68c643e6bd2d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""3966machine # [ 389.224283] k3s[888]: I0919 21:56:47.136468 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed26935c-22fd-4c10-af0f-68c643e6bd2d-tls-lb" pod "ed26935c-22fd-4c10-af0f-68c643e6bd2d" (UID: "ed26935c-22fd-4c10-af0f-68c643e6bd2d"). InnerVolumeSpecName "tls-lb". PluginName "kubernetes.io/secret", VolumeGIDValue ""3967machine # [ 389.262624] dhcpcd[5125]: veth53fabe75: removing interface3968machine # [ 389.294943] k3s[888]: I0919 21:56:47.207066 888 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ed26935c-22fd-4c10-af0f-68c643e6bd2d-config\") on node \"machine\" DevicePath \"\""3969machine # [ 389.299461] k3s[888]: I0919 21:56:47.207098 888 reconciler_common.go:299] "Volume detached for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/ed26935c-22fd-4c10-af0f-68c643e6bd2d-tls-ca\") on node \"machine\" DevicePath \"\""3970machine # [ 389.299917] k3s[888]: I0919 21:56:47.207111 888 reconciler_common.go:299] "Volume detached for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/ed26935c-22fd-4c10-af0f-68c643e6bd2d-tls-lb\") on node \"machine\" DevicePath \"\""3971machine # [ 389.300578] k3s[888]: I0919 21:56:47.207124 888 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed26935c-22fd-4c10-af0f-68c643e6bd2d-tmp\") on node \"machine\" DevicePath \"\""3972machine # [ 389.570634] k3s[888]: E0919 21:56:47.482437 888 status.go:71] "Unhandled Error" err="apiserver received an error that is not an metav1.Status: &errors.errorString{s:\"failed to create typed patch object (farm/nix-grpc-farm-scheduler; /v1, Kind=Service): .spec.selector.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}\"}: failed to create typed patch object (farm/nix-grpc-farm-scheduler; /v1, Kind=Service): .spec.selector.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}" logger="UnhandledError"3973machine # [ 389.583850] k3s[888]: I0919 21:56:47.495989 888 alloc.go:329] "allocated clusterIPs" service="farm/nix-grpc-farm" clusterIPs={"IPv4":"10.43.231.245"}3974machine # [ 389.589817] k3s[888]: E0919 21:56:47.501962 888 status.go:71] "Unhandled Error" err=<3975machine # [ 389.590252] k3s[888]: apiserver received an error that is not an metav1.Status: &errors.errorString{s:"failed to create typed patch object (farm/nix-grpc-farm-scheduler; apps/v1, Kind=Deployment): errors:\n .spec.selector.matchLabels.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}\n .spec.template.metadata.labels.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}"}: failed to create typed patch object (farm/nix-grpc-farm-scheduler; apps/v1, Kind=Deployment): errors:3976machine # [ 389.590898] k3s[888]: .spec.selector.matchLabels.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}3977machine # [ 389.591720] k3s[888]: .spec.template.metadata.labels.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}3978machine # [ 389.592663] k3s[888]: > logger="UnhandledError"3979machine # [ 389.630079] systemd[1]: cri-containerd-b114f09cc9f40c3c1d2335b905e293e66e3aefa4cc79ea49658c6a9c16b1c76f.scope: Deactivated successfully.3980machine # [ 389.632093] systemd[1]: cri-containerd-b114f09cc9f40c3c1d2335b905e293e66e3aefa4cc79ea49658c6a9c16b1c76f.scope: Consumed 959ms CPU time over 2.064s wall clock time, 32.4M memory peak, 3.3M incoming IP traffic, 195.6K outgoing IP traffic.3981machine # [ 389.820624] k3s[888]: I0919 21:56:47.732569 888 scope.go:122] "RemoveContainer" containerID="d408d79e39ea6f9824ed837148942389557f289fcc73d37cb7a1ed4149f58dfb"3982machine # [ 389.822936] k3s[888]: I0919 21:56:47.735003 888 scope.go:122] "RemoveContainer" containerID="b114f09cc9f40c3c1d2335b905e293e66e3aefa4cc79ea49658c6a9c16b1c76f"3983machine # [ 389.824378] k3s[888]: E0919 21:56:47.735393 888 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"helm\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=helm pod=helm-install-nix-grpc-farm-7fwh5_kube-system(0758217b-c7d3-4cab-abc0-35bace80ed3f)\"" pod="kube-system/helm-install-nix-grpc-farm-7fwh5" podUID="0758217b-c7d3-4cab-abc0-35bace80ed3f"3984machine # [ 389.835786] k3s[888]: I0919 21:56:47.747975 888 scope.go:122] "RemoveContainer" containerID="e6da4defa263f962191a3dbd7fbd30338dd0f4ce8f3a0c9d18492263dc6f06e3"3985machine # [ 389.840576] systemd[1]: Removed slice libcontainer container kubepods-besteffort-poded26935c_22fd_4c10_af0f_68c643e6bd2d.slice.3986machine # [ 389.842048] systemd[1]: kubepods-besteffort-poded26935c_22fd_4c10_af0f_68c643e6bd2d.slice: Consumed 1.177s CPU time over 2min 46.723s wall clock time, 16M memory peak, 153.8K incoming IP traffic, 151K outgoing IP traffic.3987machine # [ 389.852568] k3s[888]: I0919 21:56:47.764764 888 scope.go:122] "RemoveContainer" containerID="e6da4defa263f962191a3dbd7fbd30338dd0f4ce8f3a0c9d18492263dc6f06e3"3988machine # [ 389.853582] k3s[888]: E0919 21:56:47.765652 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"e6da4defa263f962191a3dbd7fbd30338dd0f4ce8f3a0c9d18492263dc6f06e3\": not found" containerID="e6da4defa263f962191a3dbd7fbd30338dd0f4ce8f3a0c9d18492263dc6f06e3"3989machine # [ 389.854056] k3s[888]: I0919 21:56:47.765685 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"e6da4defa263f962191a3dbd7fbd30338dd0f4ce8f3a0c9d18492263dc6f06e3"} err="failed to get container status \"e6da4defa263f962191a3dbd7fbd30338dd0f4ce8f3a0c9d18492263dc6f06e3\": rpc error: code = NotFound desc = an error occurred when try to find container \"e6da4defa263f962191a3dbd7fbd30338dd0f4ce8f3a0c9d18492263dc6f06e3\": not found"3990machine # [ 389.859917] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-b114f09cc9f40c3c1d2335b905e293e66e3aefa4cc79ea49658c6a9c16b1c76f-rootfs.mount: Deactivated successfully.3991machine # [ 389.860705] systemd[1]: var-lib-kubelet-pods-ed26935c\x2d22fd\x2d4c10\x2daf0f\x2d68c643e6bd2d-volume\x2dsubpaths-config-envoy-0.mount: Deactivated successfully.3992machine # [ 389.861653] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-0f33007de9fb20704513fd6db9332ee570cc46e33b9ecbd687fc751efb4c7f06-rootfs.mount: Deactivated successfully.3993machine # [ 389.862717] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-0f33007de9fb20704513fd6db9332ee570cc46e33b9ecbd687fc751efb4c7f06-shm.mount: Deactivated successfully.3994machine # [ 389.863702] systemd[1]: run-netns-cni\x2d23b580ae\x2d410e\x2dfd9f\x2de096\x2d60b2310400f3.mount: Deactivated successfully.3995machine # [ 389.864636] systemd[1]: var-lib-kubelet-pods-ed26935c\x2d22fd\x2d4c10\x2daf0f\x2d68c643e6bd2d-volumes-kubernetes.io\x7esecret-tls\x2dlb.mount: Deactivated successfully.3996machine # [ 389.865215] systemd[1]: var-lib-kubelet-pods-ed26935c\x2d22fd\x2d4c10\x2daf0f\x2d68c643e6bd2d-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully.3997machine # [ 389.865683] systemd[1]: var-lib-kubelet-pods-ed26935c\x2d22fd\x2d4c10\x2daf0f\x2d68c643e6bd2d-volumes-kubernetes.io\x7esecret-tls\x2dca.mount: Deactivated successfully.3998machine # [ 389.901517] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod6425bd14_0e47_49f3_836c_b37ee13c58df.slice.3999machine # [ 389.911352] systemd[1]: Created slice libcontainer container kubepods-besteffort-podad151751_25f8_4872_9fa0_cb8f90bd4df0.slice.4000machine # [ 389.916790] systemd[1]: Created slice libcontainer container kubepods-besteffort-poda6939e8c_c830_4383_9457_319755672140.slice.4001machine # [ 389.999661] k3s[888]: I0919 21:56:47.911775 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad151751-25f8-4872-9fa0-cb8f90bd4df0-tmp\") pod \"nix-grpc-farm-lb-688d8d547b-mqc9d\" (UID: \"ad151751-25f8-4872-9fa0-cb8f90bd4df0\") " pod="farm/nix-grpc-farm-lb-688d8d547b-mqc9d"4002machine # [ 390.007591] k3s[888]: I0919 21:56:47.911829 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/a6939e8c-c830-4383-9457-319755672140-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28\" (UID: \"a6939e8c-c830-4383-9457-319755672140\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28"4003machine # [ 390.015364] k3s[888]: I0919 21:56:47.911858 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/ad151751-25f8-4872-9fa0-cb8f90bd4df0-tls-ca\") pod \"nix-grpc-farm-lb-688d8d547b-mqc9d\" (UID: \"ad151751-25f8-4872-9fa0-cb8f90bd4df0\") " pod="farm/nix-grpc-farm-lb-688d8d547b-mqc9d"4004machine # [ 390.023691] k3s[888]: I0919 21:56:47.911882 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/a6939e8c-c830-4383-9457-319755672140-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28\" (UID: \"a6939e8c-c830-4383-9457-319755672140\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28"4005machine # [ 390.031925] k3s[888]: I0919 21:56:47.911912 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/6425bd14-0e47-49f3-836c-b37ee13c58df-build\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv\" (UID: \"6425bd14-0e47-49f3-836c-b37ee13c58df\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv"4006machine # [ 390.039278] k3s[888]: I0919 21:56:47.911937 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/a6939e8c-c830-4383-9457-319755672140-build\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28\" (UID: \"a6939e8c-c830-4383-9457-319755672140\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28"4007machine # [ 390.046170] k3s[888]: I0919 21:56:47.911961 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6425bd14-0e47-49f3-836c-b37ee13c58df-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv\" (UID: \"6425bd14-0e47-49f3-836c-b37ee13c58df\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv"4008machine # [ 390.052558] k3s[888]: I0919 21:56:47.912002 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a6939e8c-c830-4383-9457-319755672140-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28\" (UID: \"a6939e8c-c830-4383-9457-319755672140\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28"4009machine # [ 390.058183] k3s[888]: I0919 21:56:47.912030 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/6425bd14-0e47-49f3-836c-b37ee13c58df-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv\" (UID: \"6425bd14-0e47-49f3-836c-b37ee13c58df\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv"4010machine # [ 390.064897] k3s[888]: I0919 21:56:47.912054 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/a6939e8c-c830-4383-9457-319755672140-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28\" (UID: \"a6939e8c-c830-4383-9457-319755672140\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28"4011machine # [ 390.072729] k3s[888]: I0919 21:56:47.912120 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb26l\" (UniqueName: \"kubernetes.io/projected/a6939e8c-c830-4383-9457-319755672140-kube-api-access-gb26l\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28\" (UID: \"a6939e8c-c830-4383-9457-319755672140\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28"4012machine # [ 390.073544] k3s[888]: I0919 21:56:47.912175 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/6425bd14-0e47-49f3-836c-b37ee13c58df-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv\" (UID: \"6425bd14-0e47-49f3-836c-b37ee13c58df\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv"4013machine # [ 390.074812] k3s[888]: I0919 21:56:47.912198 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ad151751-25f8-4872-9fa0-cb8f90bd4df0-config\") pod \"nix-grpc-farm-lb-688d8d547b-mqc9d\" (UID: \"ad151751-25f8-4872-9fa0-cb8f90bd4df0\") " pod="farm/nix-grpc-farm-lb-688d8d547b-mqc9d"4014machine # [ 390.075806] k3s[888]: I0919 21:56:47.912221 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/6425bd14-0e47-49f3-836c-b37ee13c58df-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv\" (UID: \"6425bd14-0e47-49f3-836c-b37ee13c58df\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv"4015machine # [ 390.076830] k3s[888]: I0919 21:56:47.912245 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/ad151751-25f8-4872-9fa0-cb8f90bd4df0-tls-lb\") pod \"nix-grpc-farm-lb-688d8d547b-mqc9d\" (UID: \"ad151751-25f8-4872-9fa0-cb8f90bd4df0\") " pod="farm/nix-grpc-farm-lb-688d8d547b-mqc9d"4016machine # [ 390.078309] k3s[888]: I0919 21:56:47.912293 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/a6939e8c-c830-4383-9457-319755672140-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28\" (UID: \"a6939e8c-c830-4383-9457-319755672140\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28"4017machine # [ 390.079802] k3s[888]: I0919 21:56:47.912322 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/a6939e8c-c830-4383-9457-319755672140-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28\" (UID: \"a6939e8c-c830-4383-9457-319755672140\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28"4018machine # [ 390.081070] k3s[888]: I0919 21:56:47.912348 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zsgc\" (UniqueName: \"kubernetes.io/projected/6425bd14-0e47-49f3-836c-b37ee13c58df-kube-api-access-2zsgc\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv\" (UID: \"6425bd14-0e47-49f3-836c-b37ee13c58df\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv"4019machine # [ 390.082152] k3s[888]: I0919 21:56:47.912374 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/6425bd14-0e47-49f3-836c-b37ee13c58df-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv\" (UID: \"6425bd14-0e47-49f3-836c-b37ee13c58df\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv"4020machine # [ 390.083242] k3s[888]: I0919 21:56:47.912421 888 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/6425bd14-0e47-49f3-836c-b37ee13c58df-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv\" (UID: \"6425bd14-0e47-49f3-836c-b37ee13c58df\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv"4021machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4022machine # [ 390.238916] (udev-worker)[18263]: Network interface NamePolicy= disabled on kernel command line.4023machine # [ 390.392777] cni0: port 5(veth9bd06f1f) entered blocking state4024machine # [ 390.394867] cni0: port 5(veth9bd06f1f) entered disabled state4025machine # [ 390.397449] veth9bd06f1f: entered allmulticast mode4026machine # [ 390.399239] veth9bd06f1f: entered promiscuous mode4027machine # [ 390.257203] (udev-worker)[184[ 390.410135] cni0: port 6(veth22170ca2) entered blocking state4028machine # 54]: Network interface NamePolicy= disabled on kernel command line.4029machine # [ 390.257983] (udev-worker)[18262]: Network interface NamePolicy= disabled on kernel command line.4030machine # [ 390.413706] cni0: port 6(veth22170ca2) entered disabled state4031machine # [ 390.415328] veth22170ca2: entered allmulticast mode4032machine # [ 390.416920] veth22170ca2: entered promiscuous mode4033machine # [ 390.418836] cni0: port 7(vetheb965cd1) entered blocking state4034machine # [ 390.421231] cni0: port 7(vetheb965cd1) entered disabled state4035machine # [ 390.423194] vetheb965cd1: entered allmulticast mode4036machine # [ 390.424904] vetheb965cd1: entered promiscuous mode4037machine # [ 390.427238] cni0: port 5(veth9bd06f1f) entered blocking state4038machine # [ 390.429069] cni0: port 5(veth9bd06f1f) entered forwarding state4039machine # [ 390.449146] cni0: port 6(veth22170ca2) entered blocking state4040machine # [ 390.450218] cni0: port 6(veth22170ca2) entered forwarding state4041machine # [ 390.453893] cni0: port 7(vetheb965cd1) entered blocking state4042machine # [ 390.455071] cni0: port 7(vetheb965cd1) entered forwarding state4043machine # [ 390.307984] dhcpcd[5125]: veth9bd06f1f: IAID 5f:77:e4:a04044machine # [ 390.308968] dhcpcd[5125]: veth9bd06f1f: adding address fe80::8c46:5fff:fe77:e4a04045machine # [ 390.327342] dhcpcd[5125]: vetheb965cd1: IAID 46:76:6f:144046machine # [ 390.327991] dhcpcd[5125]: vetheb965cd1: adding address fe80::3031:46ff:fe76:6f144047machine # [ 390.328911] dhcpcd[5125]: vetheb965cd1: carrier lost4048machine # [ 390.373254] dhcpcd[5125]: vetheb965cd1: deleting address fe80::3031:46ff:fe76:6f144049machine # [ 390.394911] dhcpcd[5125]: veth22170ca2: IAID 1e:c1:db:e84050machine # [ 390.395593] dhcpcd[5125]: veth22170ca2: adding address fe80::64ee:1eff:fec1:dbe84051machine # [ 390.396609] dhcpcd[5125]: veth22170ca2: carrier lost4052machine # [ 390.408967] systemd[1]: Started libcontainer container a6323284ee8fdb193b53ab958084a9b1cb3cf4642268862e18ddda0f245909a9.4053machine # [ 390.438292] systemd[1]: Started libcontainer container 3a9eb6cbce9194a90d67c719463ab68a5a1d5711e845a4a06b0372d5565352b8.4054machine # [ 390.444544] systemd[1]: Started libcontainer container 345fa273bb739c238f3b792b274337ae73eb64f5a226a3ed020230de548eb865.4055machine # [ 390.445255] dhcpcd[5125]: veth22170ca2: deleting address fe80::64ee:1eff:fec1:dbe84056machine # [ 390.446534] dhcpcd[5125]: veth22170ca2: carrier acquired4057machine # [ 390.460053] dhcpcd[5125]: veth22170ca2: IAID 1e:c1:db:e84058machine # [ 390.460870] dhcpcd[5125]: veth22170ca2: adding address fe80::64ee:1eff:fec1:dbe84059machine # [ 390.461825] dhcpcd[5125]: vetheb965cd1: carrier acquired4060machine # [ 390.475360] dhcpcd[5125]: vetheb965cd1: IAID 46:76:6f:144061machine # [ 390.475748] dhcpcd[5125]: vetheb965cd1: adding address fe80::3031:46ff:fe76:6f144062machine # [ 390.495114] k3s[888]: I0919 21:56:48.405952 888 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ed26935c-22fd-4c10-af0f-68c643e6bd2d" path="/var/lib/kubelet/pods/ed26935c-22fd-4c10-af0f-68c643e6bd2d/volumes"4063machine # [ 390.551352] systemd[1]: Started libcontainer container 4dd2f4c49d470cfd743f87c028c937174b7981d3065b7d7eae8d3dba38721e5d.4064machine # [ 390.575353] systemd[1]: Started libcontainer container 92591e73dea392f405d16addc3cc9912d17e6bb91fe8aa97cb434f8d2ec2b845.4065machine # [ 390.598291] systemd[1]: Started libcontainer container 36f1d5051d9a1e18d67d3e1c84220b547d9ae548f6998eca3fa520735b8f6fe5.4066machine # [ 391.163445] systemd[1]: cri-containerd-4dd2f4c49d470cfd743f87c028c937174b7981d3065b7d7eae8d3dba38721e5d.scope: Deactivated successfully.4067machine # [ 391.165500] systemd[1]: cri-containerd-4dd2f4c49d470cfd743f87c028c937174b7981d3065b7d7eae8d3dba38721e5d.scope: Consumed 504ms CPU time over 611ms wall clock time, 305.7M memory peak, 157.7M written to disk.4068machine # [ 391.173113] systemd[1]: cri-containerd-92591e73dea392f405d16addc3cc9912d17e6bb91fe8aa97cb434f8d2ec2b845.scope: Deactivated successfully.4069machine # [ 391.175456] systemd[1]: cri-containerd-92591e73dea392f405d16addc3cc9912d17e6bb91fe8aa97cb434f8d2ec2b845.scope: Consumed 507ms CPU time over 593ms wall clock time, 305.9M memory peak, 139.7M written to disk.4070machine # [ 391.260109] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-92591e73dea392f405d16addc3cc9912d17e6bb91fe8aa97cb434f8d2ec2b845-rootfs.mount: Deactivated successfully.4071machine # [ 391.262954] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-4dd2f4c49d470cfd743f87c028c937174b7981d3065b7d7eae8d3dba38721e5d-rootfs.mount: Deactivated successfully.4072machine # [ 391.419522] dhcpcd[5125]: veth22170ca2: soliciting a DHCP lease4073machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4074machine # [ 391.435510] dhcpcd[5125]: vetheb965cd1: soliciting a DHCP lease4075machine # [ 391.929849] dhcpcd[5125]: veth22170ca2: soliciting an IPv6 router4076machine # [ 391.996259] dhcpcd[5125]: veth9bd06f1f: soliciting an IPv6 router4077machine # [ 392.002738] k3s[888]: I0919 21:56:49.913924 888 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-688d8d547b-mqc9d" podStartSLOduration=2.913895297 podStartE2EDuration="2.913895297s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 21:56:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 21:56:48.957602528 +0000 UTC m=+369.747841933" watchObservedRunningTime="2026-09-19 21:56:49.913895297 +0000 UTC m=+370.704134981"4078machine # [ 392.087352] systemd[1]: Started libcontainer container 659eb5239ff21908d54e9762c7ebe7353fc0330925659d18dfdc3f94531c0890.4079machine # [ 392.089547] systemd[1]: Started libcontainer container 11f30293663b82eea7a419245b9d87a52b29a6cba64e7686988df40b3314a751.4080machine # [ 392.100565] dhcpcd[5125]: veth9bd06f1f: soliciting a DHCP lease4081machine # [ 392.247647] systemd[1]: Started libcontainer container 06470d7b2995925d00b9f77466933fea8e5a4248159b0c376ce10a895c501cf7.4082machine # [ 392.249815] systemd[1]: Started libcontainer container badeb648bb698f7a13e9a7717859a90f8f180d71488592168a37a99974d9ba3f.4083machine # [ 392.397367] systemd[1]: Started libcontainer container 7d3e80bffd729126c84d56b05b215f8989d1e9776d70ccc30317d665414e8868.4084machine # [ 392.401874] systemd[1]: Started libcontainer container b16b52632270cb9ec8b869dc255c48cf71122e66e02e7be6d4d656fd9c3be462.4085machine # [ 392.644965] dhcpcd[5125]: vetheb965cd1: soliciting an IPv6 router4086machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4087machine # [ 393.030455] k3s[888]: I0919 21:56:50.941772 888 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28" podStartSLOduration=3.403994178 podStartE2EDuration="3.941723135s" totalImagesPullingTime="0s" totalInitContainerRuntime="537.728957ms" isStatefulPod=false podCreationTimestamp="2026-09-19 21:56:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 21:56:50.939038157 +0000 UTC m=+371.729282311" watchObservedRunningTime="2026-09-19 21:56:50.941723135 +0000 UTC m=+371.731967290"4088machine # [ 393.061878] k3s[888]: I0919 21:56:50.973513 888 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv" podStartSLOduration=3.3973095300000002 podStartE2EDuration="3.973464041s" totalImagesPullingTime="0s" totalInitContainerRuntime="576.154511ms" isStatefulPod=false podCreationTimestamp="2026-09-19 21:56:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 21:56:50.972483469 +0000 UTC m=+371.762726786" watchObservedRunningTime="2026-09-19 21:56:50.973464041 +0000 UTC m=+371.763708475"4089machine # [ 393.674742] systemd[1]: cri-containerd-8cb6c7977cf3a0b76762cf2179f359f607c791a0950e6f65af8f782924963cb9.scope: Deactivated successfully.4090machine # [ 393.690139] systemd[1]: cri-containerd-8cb6c7977cf3a0b76762cf2179f359f607c791a0950e6f65af8f782924963cb9.scope: Consumed 732ms CPU time over 2min 48.249s wall clock time, 17.3M memory peak, 8.4M read from disk, 59.3K incoming IP traffic, 50.3K outgoing IP traffic.4091machine # [ 393.715799] systemd[1]: cri-containerd-a1d21f7571ba54e65eef368a7776f549ecdc0fa9ac82a5abbd51a1a12e8f24f0.scope: Deactivated successfully.4092machine # [ 393.730918] systemd[1]: cri-containerd-a1d21f7571ba54e65eef368a7776f549ecdc0fa9ac82a5abbd51a1a12e8f24f0.scope: Consumed 731ms CPU time over 2min 48.296s wall clock time, 18M memory peak, 8.9M read from disk, 59K incoming IP traffic, 50K outgoing IP traffic.4093machine # [ 393.762319] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-a1d21f7571ba54e65eef368a7776f549ecdc0fa9ac82a5abbd51a1a12e8f24f0-rootfs.mount: Deactivated successfully.4094machine # [ 393.769831] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-8cb6c7977cf3a0b76762cf2179f359f607c791a0950e6f65af8f782924963cb9-rootfs.mount: Deactivated successfully.4095machine # [ 393.801514] systemd[1]: cri-containerd-1f453af42d899a994b9b95c384368f41c8c4700d71dee059bed4a9b66c33003e.scope: Deactivated successfully.4096machine # [ 393.805774] systemd[1]: cri-containerd-6bc47d38afcfdf306a7e25efa10ffe1d284b080bad1e2f4496c8c6df2d3cd1f4.scope: Deactivated successfully.4097machine # [ 393.853351] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-1f453af42d899a994b9b95c384368f41c8c4700d71dee059bed4a9b66c33003e-rootfs.mount: Deactivated successfully.4098machine # [ 393.859065] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-6bc47d38afcfdf306a7e25efa10ffe1d284b080bad1e2f4496c8c6df2d3cd1f4-rootfs.mount: Deactivated successfully.4099machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4100machine # [ 394.107886] cni0: port 4(veth6f03ad42) entered disabled state4101machine # [ 393.956354] dhcpcd[5125]: veth6f03ad42: carrier lost4102machine # [ 394.111209] veth6f03ad42 (unregistering): left allmulticast mode4103machine # [ 394.112988] veth6f03ad42 (unregistering): left promiscuous mode4104machine # [ 394.114567] cni0: port 4(veth6f03ad42) entered disabled state4105machine # [ 394.119612] cni0: port 3(vethab24064f) entered disabled state4106machine # [ 394.122227] vethab24064f (unregistering): left allmulticast mode4107machine # [ 394.123706] vethab24064f (unregistering): left promiscuous mode4108machine # [ 394.125299] cni0: port 3(vethab24064f) entered disabled state4109machine # [ 393.997637] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-1f453af42d899a994b9b95c384368f41c8c4700d71dee059bed4a9b66c33003e-shm.mount: Deactivated successfully.4110machine # [ 394.001179] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-6bc47d38afcfdf306a7e25efa10ffe1d284b080bad1e2f4496c8c6df2d3cd1f4-shm.mount: Deactivated successfully.4111machine # [ 394.004982] systemd[1]: run-netns-cni\x2d426bb561\x2d8c3a\x2d18c6\x2de839\x2d3a326ab776be.mount: Deactivated successfully.4112machine # [ 394.006767] systemd[1]: run-netns-cni\x2d85e561f6\x2de935\x2dfab3\x2df6c2\x2d69b393d21e6f.mount: Deactivated successfully.4113machine # [ 394.008692] dhcpcd[5125]: veth6f03ad42: deleting address fe80::a480:47ff:fe4a:1d484114machine # [ 394.012708] dhcpcd[5125]: veth6f03ad42: deleting route to 169.254.0.0/164115machine # [ 394.029692] k3s[888]: I0919 21:56:51.941862 888 scope.go:122] "RemoveContainer" containerID="8e937e0c79ea194a59a5805f374cb8efe978bf17098173bbb0e59d87cb5cf388"4116machine # [ 394.046638] k3s[888]: I0919 21:56:51.958356 888 scope.go:122] "RemoveContainer" containerID="8cb6c7977cf3a0b76762cf2179f359f607c791a0950e6f65af8f782924963cb9"4117machine # [ 394.059461] k3s[888]: I0919 21:56:51.971554 888 scope.go:122] "RemoveContainer" containerID="83666b04ef246a9fc0cb687dbacd46b01882b8161f40eece52bb57933beaa8e5"4118machine # [ 394.067430] k3s[888]: I0919 21:56:51.979529 888 scope.go:122] "RemoveContainer" containerID="a65aa06d1f9aaec3ce4d065fbde757f381ae591f2be461afa3724e92c37fb874"4119machine # [ 394.074768] k3s[888]: I0919 21:56:51.986949 888 scope.go:122] "RemoveContainer" containerID="8e937e0c79ea194a59a5805f374cb8efe978bf17098173bbb0e59d87cb5cf388"4120machine # [ 394.076842] k3s[888]: E0919 21:56:51.988993 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"8e937e0c79ea194a59a5805f374cb8efe978bf17098173bbb0e59d87cb5cf388\": not found" containerID="8e937e0c79ea194a59a5805f374cb8efe978bf17098173bbb0e59d87cb5cf388"4121machine # [ 394.077967] k3s[888]: I0919 21:56:51.989048 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"8e937e0c79ea194a59a5805f374cb8efe978bf17098173bbb0e59d87cb5cf388"} err="failed to get container status \"8e937e0c79ea194a59a5805f374cb8efe978bf17098173bbb0e59d87cb5cf388\": rpc error: code = NotFound desc = an error occurred when try to find container \"8e937e0c79ea194a59a5805f374cb8efe978bf17098173bbb0e59d87cb5cf388\": not found"4122machine # [ 394.080040] k3s[888]: I0919 21:56:51.989082 888 scope.go:122] "RemoveContainer" containerID="8cb6c7977cf3a0b76762cf2179f359f607c791a0950e6f65af8f782924963cb9"4123machine # [ 394.081493] k3s[888]: E0919 21:56:51.989681 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"8cb6c7977cf3a0b76762cf2179f359f607c791a0950e6f65af8f782924963cb9\": not found" containerID="8cb6c7977cf3a0b76762cf2179f359f607c791a0950e6f65af8f782924963cb9"4124machine # [ 394.081702] k3s[888]: I0919 21:56:51.989702 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"8cb6c7977cf3a0b76762cf2179f359f607c791a0950e6f65af8f782924963cb9"} err="failed to get container status \"8cb6c7977cf3a0b76762cf2179f359f607c791a0950e6f65af8f782924963cb9\": rpc error: code = NotFound desc = an error occurred when try to find container \"8cb6c7977cf3a0b76762cf2179f359f607c791a0950e6f65af8f782924963cb9\": not found"4125machine # [ 394.083162] k3s[888]: I0919 21:56:51.989722 888 scope.go:122] "RemoveContainer" containerID="83666b04ef246a9fc0cb687dbacd46b01882b8161f40eece52bb57933beaa8e5"4126machine # [ 394.084302] k3s[888]: E0919 21:56:51.990218 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"83666b04ef246a9fc0cb687dbacd46b01882b8161f40eece52bb57933beaa8e5\": not found" containerID="83666b04ef246a9fc0cb687dbacd46b01882b8161f40eece52bb57933beaa8e5"4127machine # [ 394.085030] k3s[888]: I0919 21:56:51.990242 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"83666b04ef246a9fc0cb687dbacd46b01882b8161f40eece52bb57933beaa8e5"} err="failed to get container status \"83666b04ef246a9fc0cb687dbacd46b01882b8161f40eece52bb57933beaa8e5\": rpc error: code = NotFound desc = an error occurred when try to find container \"83666b04ef246a9fc0cb687dbacd46b01882b8161f40eece52bb57933beaa8e5\": not found"4128machine # [ 394.086514] k3s[888]: I0919 21:56:51.990289 888 scope.go:122] "RemoveContainer" containerID="a65aa06d1f9aaec3ce4d065fbde757f381ae591f2be461afa3724e92c37fb874"4129machine # [ 394.087485] k3s[888]: E0919 21:56:51.992001 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"a65aa06d1f9aaec3ce4d065fbde757f381ae591f2be461afa3724e92c37fb874\": not found" containerID="a65aa06d1f9aaec3ce4d065fbde757f381ae591f2be461afa3724e92c37fb874"4130machine # [ 394.087819] k3s[888]: I0919 21:56:51.992044 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"a65aa06d1f9aaec3ce4d065fbde757f381ae591f2be461afa3724e92c37fb874"} err="failed to get container status \"a65aa06d1f9aaec3ce4d065fbde757f381ae591f2be461afa3724e92c37fb874\": rpc error: code = NotFound desc = an error occurred when try to find container \"a65aa06d1f9aaec3ce4d065fbde757f381ae591f2be461afa3724e92c37fb874\": not found"4131machine # [ 394.089323] k3s[888]: I0919 21:56:51.992086 888 scope.go:122] "RemoveContainer" containerID="1940b00794684f7317e8f2426a9686039dcaf106ea709c88a30caca0d1d3b019"4132machine # [ 394.090157] k3s[888]: I0919 21:56:52.002197 888 scope.go:122] "RemoveContainer" containerID="a1d21f7571ba54e65eef368a7776f549ecdc0fa9ac82a5abbd51a1a12e8f24f0"4133machine # [ 394.097322] k3s[888]: I0919 21:56:52.009487 888 scope.go:122] "RemoveContainer" containerID="a3d5327cb12246482a085734d9f7c9febd07e14fa9f26be42ff36f85d06cd910"4134machine # [ 394.106518] k3s[888]: I0919 21:56:52.018685 888 scope.go:122] "RemoveContainer" containerID="a5711abd2f4336544623a60b050d4ffc953523e2cec902f4b699f4faead8b57a"4135machine # [ 394.117267] k3s[888]: I0919 21:56:52.028999 888 scope.go:122] "RemoveContainer" containerID="1940b00794684f7317e8f2426a9686039dcaf106ea709c88a30caca0d1d3b019"4136machine # [ 394.118030] k3s[888]: E0919 21:56:52.029675 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"1940b00794684f7317e8f2426a9686039dcaf106ea709c88a30caca0d1d3b019\": not found" containerID="1940b00794684f7317e8f2426a9686039dcaf106ea709c88a30caca0d1d3b019"4137machine # [ 394.118474] k3s[888]: I0919 21:56:52.029732 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"1940b00794684f7317e8f2426a9686039dcaf106ea709c88a30caca0d1d3b019"} err="failed to get container status \"1940b00794684f7317e8f2426a9686039dcaf106ea709c88a30caca0d1d3b019\": rpc error: code = NotFound desc = an error occurred when try to find container \"1940b00794684f7317e8f2426a9686039dcaf106ea709c88a30caca0d1d3b019\": not found"4138machine # [ 394.119059] k3s[888]: I0919 21:56:52.029771 888 scope.go:122] "RemoveContainer" containerID="a1d21f7571ba54e65eef368a7776f549ecdc0fa9ac82a5abbd51a1a12e8f24f0"4139machine # [ 394.119544] k3s[888]: E0919 21:56:52.030347 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"a1d21f7571ba54e65eef368a7776f549ecdc0fa9ac82a5abbd51a1a12e8f24f0\": not found" containerID="a1d21f7571ba54e65eef368a7776f549ecdc0fa9ac82a5abbd51a1a12e8f24f0"4140machine # [ 394.120071] k3s[888]: I0919 21:56:52.030366 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"a1d21f7571ba54e65eef368a7776f549ecdc0fa9ac82a5abbd51a1a12e8f24f0"} err="failed to get container status \"a1d21f7571ba54e65eef368a7776f549ecdc0fa9ac82a5abbd51a1a12e8f24f0\": rpc error: code = NotFound desc = an error occurred when try to find container \"a1d21f7571ba54e65eef368a7776f549ecdc0fa9ac82a5abbd51a1a12e8f24f0\": not found"4141machine # [ 394.120539] k3s[888]: I0919 21:56:52.030385 888 scope.go:122] "RemoveContainer" containerID="a3d5327cb12246482a085734d9f7c9febd07e14fa9f26be42ff36f85d06cd910"4142machine # [ 394.121199] k3s[888]: E0919 21:56:52.031017 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"a3d5327cb12246482a085734d9f7c9febd07e14fa9f26be42ff36f85d06cd910\": not found" containerID="a3d5327cb12246482a085734d9f7c9febd07e14fa9f26be42ff36f85d06cd910"4143machine # [ 394.121689] k3s[888]: I0919 21:56:52.031041 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"a3d5327cb12246482a085734d9f7c9febd07e14fa9f26be42ff36f85d06cd910"} err="failed to get container status \"a3d5327cb12246482a085734d9f7c9febd07e14fa9f26be42ff36f85d06cd910\": rpc error: code = NotFound desc = an error occurred when try to find container \"a3d5327cb12246482a085734d9f7c9febd07e14fa9f26be42ff36f85d06cd910\": not found"4144machine # [ 394.122448] k3s[888]: I0919 21:56:52.031061 888 scope.go:122] "RemoveContainer" containerID="a5711abd2f4336544623a60b050d4ffc953523e2cec902f4b699f4faead8b57a"4145machine # [ 394.123024] k3s[888]: E0919 21:56:52.031562 888 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"a5711abd2f4336544623a60b050d4ffc953523e2cec902f4b699f4faead8b57a\": not found" containerID="a5711abd2f4336544623a60b050d4ffc953523e2cec902f4b699f4faead8b57a"4146machine # [ 394.126589] k3s[888]: I0919 21:56:52.031586 888 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"a5711abd2f4336544623a60b050d4ffc953523e2cec902f4b699f4faead8b57a"} err="failed to get container status \"a5711abd2f4336544623a60b050d4ffc953523e2cec902f4b699f4faead8b57a\": rpc error: code = NotFound desc = an error occurred when try to find container \"a5711abd2f4336544623a60b050d4ffc953523e2cec902f4b699f4faead8b57a\": not found"4147machine # [ 394.154213] k3s[888]: I0919 21:56:52.066344 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2a287058-984a-464d-a81e-68d2dc80ab68-build\" (UniqueName: \"kubernetes.io/empty-dir/2a287058-984a-464d-a81e-68d2dc80ab68-build\") pod \"2a287058-984a-464d-a81e-68d2dc80ab68\" (UID: \"2a287058-984a-464d-a81e-68d2dc80ab68\") "4148machine # [ 394.154766] k3s[888]: I0919 21:56:52.066411 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0c46eb13-9cfa-46ac-8361-570e73bbc99b-nixconf\" (UniqueName: \"kubernetes.io/configmap/0c46eb13-9cfa-46ac-8361-570e73bbc99b-nixconf\") pod \"0c46eb13-9cfa-46ac-8361-570e73bbc99b\" (UID: \"0c46eb13-9cfa-46ac-8361-570e73bbc99b\") "4149machine # [ 394.155564] k3s[888]: I0919 21:56:52.066456 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2a287058-984a-464d-a81e-68d2dc80ab68-tls\" (UniqueName: \"kubernetes.io/secret/2a287058-984a-464d-a81e-68d2dc80ab68-tls\") pod \"2a287058-984a-464d-a81e-68d2dc80ab68\" (UID: \"2a287058-984a-464d-a81e-68d2dc80ab68\") "4150machine # [ 394.156484] k3s[888]: I0919 21:56:52.066484 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2a287058-984a-464d-a81e-68d2dc80ab68-oidc\" (UniqueName: \"kubernetes.io/secret/2a287058-984a-464d-a81e-68d2dc80ab68-oidc\") pod \"2a287058-984a-464d-a81e-68d2dc80ab68\" (UID: \"2a287058-984a-464d-a81e-68d2dc80ab68\") "4151machine # [ 394.157317] k3s[888]: I0919 21:56:52.066522 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0c46eb13-9cfa-46ac-8361-570e73bbc99b-oidc\" (UniqueName: \"kubernetes.io/secret/0c46eb13-9cfa-46ac-8361-570e73bbc99b-oidc\") pod \"0c46eb13-9cfa-46ac-8361-570e73bbc99b\" (UID: \"0c46eb13-9cfa-46ac-8361-570e73bbc99b\") "4152machine # [ 394.158113] k3s[888]: I0919 21:56:52.066550 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2a287058-984a-464d-a81e-68d2dc80ab68-nixconf\" (UniqueName: \"kubernetes.io/configmap/2a287058-984a-464d-a81e-68d2dc80ab68-nixconf\") pod \"2a287058-984a-464d-a81e-68d2dc80ab68\" (UID: \"2a287058-984a-464d-a81e-68d2dc80ab68\") "4153machine # [ 394.159121] k3s[888]: I0919 21:56:52.066936 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c46eb13-9cfa-46ac-8361-570e73bbc99b-nixconf" pod "0c46eb13-9cfa-46ac-8361-570e73bbc99b" (UID: "0c46eb13-9cfa-46ac-8361-570e73bbc99b"). InnerVolumeSpecName "nixconf". PluginName "kubernetes.io/configmap", VolumeGIDValue ""4154machine # [ 394.161231] k3s[888]: I0919 21:56:52.066956 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a287058-984a-464d-a81e-68d2dc80ab68-nixconf" pod "2a287058-984a-464d-a81e-68d2dc80ab68" (UID: "2a287058-984a-464d-a81e-68d2dc80ab68"). InnerVolumeSpecName "nixconf". PluginName "kubernetes.io/configmap", VolumeGIDValue ""4155machine # [ 394.167401] k3s[888]: I0919 21:56:52.067060 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0c46eb13-9cfa-46ac-8361-570e73bbc99b-build\" (UniqueName: \"kubernetes.io/empty-dir/0c46eb13-9cfa-46ac-8361-570e73bbc99b-build\") pod \"0c46eb13-9cfa-46ac-8361-570e73bbc99b\" (UID: \"0c46eb13-9cfa-46ac-8361-570e73bbc99b\") "4156machine # [ 394.232766] k3s[888]: I0919 21:56:52.067114 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2a287058-984a-464d-a81e-68d2dc80ab68-ca\" (UniqueName: \"kubernetes.io/secret/2a287058-984a-464d-a81e-68d2dc80ab68-ca\") pod \"2a287058-984a-464d-a81e-68d2dc80ab68\" (UID: \"2a287058-984a-464d-a81e-68d2dc80ab68\") "4157machine # [ 394.233928] k3s[888]: I0919 21:56:52.067141 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0c46eb13-9cfa-46ac-8361-570e73bbc99b-nix\" (UniqueName: \"kubernetes.io/empty-dir/0c46eb13-9cfa-46ac-8361-570e73bbc99b-nix\") pod \"0c46eb13-9cfa-46ac-8361-570e73bbc99b\" (UID: \"0c46eb13-9cfa-46ac-8361-570e73bbc99b\") "4158machine # [ 394.234678] k3s[888]: I0919 21:56:52.067170 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0c46eb13-9cfa-46ac-8361-570e73bbc99b-ca\" (UniqueName: \"kubernetes.io/secret/0c46eb13-9cfa-46ac-8361-570e73bbc99b-ca\") pod \"0c46eb13-9cfa-46ac-8361-570e73bbc99b\" (UID: \"0c46eb13-9cfa-46ac-8361-570e73bbc99b\") "4159machine # [ 394.235666] k3s[888]: I0919 21:56:52.067198 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2a287058-984a-464d-a81e-68d2dc80ab68-kube-api-access-h8pqr\" (UniqueName: \"kubernetes.io/projected/2a287058-984a-464d-a81e-68d2dc80ab68-kube-api-access-h8pqr\") pod \"2a287058-984a-464d-a81e-68d2dc80ab68\" (UID: \"2a287058-984a-464d-a81e-68d2dc80ab68\") "4160machine # [ 394.236442] k3s[888]: I0919 21:56:52.067232 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0c46eb13-9cfa-46ac-8361-570e73bbc99b-niks3-token\" (UniqueName: \"kubernetes.io/projected/0c46eb13-9cfa-46ac-8361-570e73bbc99b-niks3-token\") pod \"0c46eb13-9cfa-46ac-8361-570e73bbc99b\" (UID: \"0c46eb13-9cfa-46ac-8361-570e73bbc99b\") "4161machine # [ 394.236947] k3s[888]: I0919 21:56:52.067305 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2a287058-984a-464d-a81e-68d2dc80ab68-niks3-token\" (UniqueName: \"kubernetes.io/projected/2a287058-984a-464d-a81e-68d2dc80ab68-niks3-token\") pod \"2a287058-984a-464d-a81e-68d2dc80ab68\" (UID: \"2a287058-984a-464d-a81e-68d2dc80ab68\") "4162machine # [ 394.237664] k3s[888]: I0919 21:56:52.067335 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0c46eb13-9cfa-46ac-8361-570e73bbc99b-kube-api-access-g276x\" (UniqueName: \"kubernetes.io/projected/0c46eb13-9cfa-46ac-8361-570e73bbc99b-kube-api-access-g276x\") pod \"0c46eb13-9cfa-46ac-8361-570e73bbc99b\" (UID: \"0c46eb13-9cfa-46ac-8361-570e73bbc99b\") "4163machine # [ 394.238226] k3s[888]: I0919 21:56:52.067362 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0c46eb13-9cfa-46ac-8361-570e73bbc99b-tls\" (UniqueName: \"kubernetes.io/secret/0c46eb13-9cfa-46ac-8361-570e73bbc99b-tls\") pod \"0c46eb13-9cfa-46ac-8361-570e73bbc99b\" (UID: \"0c46eb13-9cfa-46ac-8361-570e73bbc99b\") "4164machine # [ 394.238987] k3s[888]: I0919 21:56:52.067390 888 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2a287058-984a-464d-a81e-68d2dc80ab68-nix\" (UniqueName: \"kubernetes.io/empty-dir/2a287058-984a-464d-a81e-68d2dc80ab68-nix\") pod \"2a287058-984a-464d-a81e-68d2dc80ab68\" (UID: \"2a287058-984a-464d-a81e-68d2dc80ab68\") "4165machine # [ 394.239870] k3s[888]: I0919 21:56:52.067468 888 reconciler_common.go:299] "Volume detached for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/0c46eb13-9cfa-46ac-8361-570e73bbc99b-nixconf\") on node \"machine\" DevicePath \"\""4166machine # [ 394.240762] k3s[888]: I0919 21:56:52.067486 888 reconciler_common.go:299] "Volume detached for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/2a287058-984a-464d-a81e-68d2dc80ab68-nixconf\") on node \"machine\" DevicePath \"\""4167machine # [ 394.241777] k3s[888]: I0919 21:56:52.067859 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a287058-984a-464d-a81e-68d2dc80ab68-build" pod "2a287058-984a-464d-a81e-68d2dc80ab68" (UID: "2a287058-984a-464d-a81e-68d2dc80ab68"). InnerVolumeSpecName "build". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""4168machine # [ 394.298619] k3s[888]: I0919 21:56:52.083647 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c46eb13-9cfa-46ac-8361-570e73bbc99b-build" pod "0c46eb13-9cfa-46ac-8361-570e73bbc99b" (UID: "0c46eb13-9cfa-46ac-8361-570e73bbc99b"). InnerVolumeSpecName "build". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""4169machine # [ 394.299868] systemd[1]: var-lib-kubelet-pods-2a287058\x2d984a\x2d464d\x2da81e\x2d68d2dc80ab68-volumes-kubernetes.io\x7esecret-oidc.mount: Deactivated successfully.4170machine # [ 394.300718] k3s[888]: I0919 21:56:52.167749 888 reconciler_common.go:299] "Volume detached for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/2a287058-984a-464d-a81e-68d2dc80ab68-build\") on node \"machine\" DevicePath \"\""4171machine # [ 394.301217] k3s[888]: I0919 21:56:52.167774 888 reconciler_common.go:299] "Volume detached for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/0c46eb13-9cfa-46ac-8361-570e73bbc99b-build\") on node \"machine\" DevicePath \"\""4172machine # [ 394.301808] systemd[1]: var-lib-kubelet-pods-2a287058\x2d984a\x2d464d\x2da81e\x2d68d2dc80ab68-volume\x2dsubpaths-nix-gc-0.mount: Deactivated successfully.4173machine # [ 394.302570] systemd[1]: var-lib-kubelet-pods-2a287058\x2d984a\x2d464d\x2da81e\x2d68d2dc80ab68-volumes-kubernetes.io\x7esecret-tls.mount: Deactivated successfully.4174machine # [ 394.303252] systemd[1]: var-lib-kubelet-pods-0c46eb13\x2d9cfa\x2d46ac\x2d8361\x2d570e73bbc99b-volumes-kubernetes.io\x7esecret-oidc.mount: Deactivated successfully.4175machine # [ 394.303714] systemd[1]: var-lib-kubelet-pods-2a287058\x2d984a\x2d464d\x2da81e\x2d68d2dc80ab68-volumes-kubernetes.io\x7esecret-ca.mount: Deactivated successfully.4176machine # [ 394.304245] systemd[1]: var-lib-kubelet-pods-0c46eb13\x2d9cfa\x2d46ac\x2d8361\x2d570e73bbc99b-volumes-kubernetes.io\x7esecret-ca.mount: Deactivated successfully.4177machine # [ 394.304696] systemd[1]: var-lib-kubelet-pods-2a287058\x2d984a\x2d464d\x2da81e\x2d68d2dc80ab68-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dh8pqr.mount: Deactivated successfully.4178machine # [ 394.324465] dhcpcd[5125]: dhcp_readbpf: unexpected event 0x01004179machine # [ 394.324738] dhcpcd[5125]: dhcp_readbpf: vethab24064f: Network is down4180machine # [ 394.326354] k3s[888]: I0919 21:56:52.238398 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c46eb13-9cfa-46ac-8361-570e73bbc99b-oidc" pod "0c46eb13-9cfa-46ac-8361-570e73bbc99b" (UID: "0c46eb13-9cfa-46ac-8361-570e73bbc99b"). InnerVolumeSpecName "oidc". PluginName "kubernetes.io/secret", VolumeGIDValue ""4181machine # [ 394.327072] k3s[888]: I0919 21:56:52.238696 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a287058-984a-464d-a81e-68d2dc80ab68-oidc" pod "2a287058-984a-464d-a81e-68d2dc80ab68" (UID: "2a287058-984a-464d-a81e-68d2dc80ab68"). InnerVolumeSpecName "oidc". PluginName "kubernetes.io/secret", VolumeGIDValue ""4182machine # [ 394.328075] k3s[888]: I0919 21:56:52.239091 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c46eb13-9cfa-46ac-8361-570e73bbc99b-tls" pod "0c46eb13-9cfa-46ac-8361-570e73bbc99b" (UID: "0c46eb13-9cfa-46ac-8361-570e73bbc99b"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""4183machine # [ 394.328917] k3s[888]: I0919 21:56:52.239297 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a287058-984a-464d-a81e-68d2dc80ab68-kube-api-access-h8pqr" pod "2a287058-984a-464d-a81e-68d2dc80ab68" (UID: "2a287058-984a-464d-a81e-68d2dc80ab68"). InnerVolumeSpecName "kube-api-access-h8pqr". PluginName "kubernetes.io/projected", VolumeGIDValue ""4184machine # [ 394.330533] k3s[888]: I0919 21:56:52.239313 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c46eb13-9cfa-46ac-8361-570e73bbc99b-niks3-token" pod "0c46eb13-9cfa-46ac-8361-570e73bbc99b" (UID: "0c46eb13-9cfa-46ac-8361-570e73bbc99b"). InnerVolumeSpecName "niks3-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""4185machine # [ 394.331274] k3s[888]: I0919 21:56:52.239415 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c46eb13-9cfa-46ac-8361-570e73bbc99b-kube-api-access-g276x" pod "0c46eb13-9cfa-46ac-8361-570e73bbc99b" (UID: "0c46eb13-9cfa-46ac-8361-570e73bbc99b"). InnerVolumeSpecName "kube-api-access-g276x". PluginName "kubernetes.io/projected", VolumeGIDValue ""4186machine # [ 394.331989] k3s[888]: I0919 21:56:52.239818 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a287058-984a-464d-a81e-68d2dc80ab68-tls" pod "2a287058-984a-464d-a81e-68d2dc80ab68" (UID: "2a287058-984a-464d-a81e-68d2dc80ab68"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""4187machine # [ 394.333192] k3s[888]: I0919 21:56:52.239843 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a287058-984a-464d-a81e-68d2dc80ab68-ca" pod "2a287058-984a-464d-a81e-68d2dc80ab68" (UID: "2a287058-984a-464d-a81e-68d2dc80ab68"). InnerVolumeSpecName "ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""4188machine # [ 394.333623] k3s[888]: I0919 21:56:52.240337 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a287058-984a-464d-a81e-68d2dc80ab68-niks3-token" pod "2a287058-984a-464d-a81e-68d2dc80ab68" (UID: "2a287058-984a-464d-a81e-68d2dc80ab68"). InnerVolumeSpecName "niks3-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""4189machine # [ 394.334900] k3s[888]: I0919 21:56:52.240461 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c46eb13-9cfa-46ac-8361-570e73bbc99b-ca" pod "0c46eb13-9cfa-46ac-8361-570e73bbc99b" (UID: "0c46eb13-9cfa-46ac-8361-570e73bbc99b"). InnerVolumeSpecName "ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""4190machine # [ 394.356612] k3s[888]: I0919 21:56:52.268752 888 reconciler_common.go:299] "Volume detached for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0c46eb13-9cfa-46ac-8361-570e73bbc99b-ca\") on node \"machine\" DevicePath \"\""4191machine # [ 394.357462] k3s[888]: I0919 21:56:52.268788 888 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8pqr\" (UniqueName: \"kubernetes.io/projected/2a287058-984a-464d-a81e-68d2dc80ab68-kube-api-access-h8pqr\") on node \"machine\" DevicePath \"\""4192machine # [ 394.358062] k3s[888]: I0919 21:56:52.268807 888 reconciler_common.go:299] "Volume detached for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/0c46eb13-9cfa-46ac-8361-570e73bbc99b-niks3-token\") on node \"machine\" DevicePath \"\""4193machine # [ 394.358907] k3s[888]: I0919 21:56:52.268821 888 reconciler_common.go:299] "Volume detached for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/2a287058-984a-464d-a81e-68d2dc80ab68-niks3-token\") on node \"machine\" DevicePath \"\""4194machine # [ 394.359566] k3s[888]: I0919 21:56:52.268833 888 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g276x\" (UniqueName: \"kubernetes.io/projected/0c46eb13-9cfa-46ac-8361-570e73bbc99b-kube-api-access-g276x\") on node \"machine\" DevicePath \"\""4195machine # [ 394.360116] k3s[888]: I0919 21:56:52.268846 888 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/0c46eb13-9cfa-46ac-8361-570e73bbc99b-tls\") on node \"machine\" DevicePath \"\""4196machine # [ 394.360647] k3s[888]: I0919 21:56:52.268858 888 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/2a287058-984a-464d-a81e-68d2dc80ab68-tls\") on node \"machine\" DevicePath \"\""4197machine # [ 394.361392] k3s[888]: I0919 21:56:52.268869 888 reconciler_common.go:299] "Volume detached for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/2a287058-984a-464d-a81e-68d2dc80ab68-oidc\") on node \"machine\" DevicePath \"\""4198machine # [ 394.361936] k3s[888]: I0919 21:56:52.268881 888 reconciler_common.go:299] "Volume detached for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/0c46eb13-9cfa-46ac-8361-570e73bbc99b-oidc\") on node \"machine\" DevicePath \"\""4199machine # [ 394.362834] k3s[888]: I0919 21:56:52.268892 888 reconciler_common.go:299] "Volume detached for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2a287058-984a-464d-a81e-68d2dc80ab68-ca\") on node \"machine\" DevicePath \"\""4200machine # [ 394.401228] dhcpcd[5125]: arp_read: unexpected event 0x01004201machine # [ 394.401914] dhcpcd[5125]: arp_read: vethab24064f: Network is down4202machine # [ 394.406512] dhcpcd[5125]: veth6f03ad42: removing interface4203machine # [ 394.439904] dhcpcd[5125]: vethab24064f: removing interface4204machine # [ 394.440301] dhcpcd[5125]: vethab24064f: deleting address fe80::dce5:77ff:fe50:9fb64205machine # [ 394.440701] dhcpcd[5125]: vethab24064f: deleting route to 169.254.0.0/164206machine # [ 394.575412] k3s[888]: I0919 21:56:52.487412 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c46eb13-9cfa-46ac-8361-570e73bbc99b-nix" pod "0c46eb13-9cfa-46ac-8361-570e73bbc99b" (UID: "0c46eb13-9cfa-46ac-8361-570e73bbc99b"). InnerVolumeSpecName "nix". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""4207machine # [ 394.580742] k3s[888]: I0919 21:56:52.491057 888 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a287058-984a-464d-a81e-68d2dc80ab68-nix" pod "2a287058-984a-464d-a81e-68d2dc80ab68" (UID: "2a287058-984a-464d-a81e-68d2dc80ab68"). InnerVolumeSpecName "nix". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""4208machine # [ 394.637429] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod0c46eb13_9cfa_46ac_8361_570e73bbc99b.slice.4209machine # [ 394.638034] systemd[1]: kubepods-besteffort-pod0c46eb13_9cfa_46ac_8361_570e73bbc99b.slice: Consumed 1.665s CPU time over 2min 51.510s wall clock time, 322.5M memory peak, 8.4M read from disk, 283.9M written to disk, 59.3K incoming IP traffic, 50.3K outgoing IP traffic.4210machine # [ 394.648488] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod2a287058_984a_464d_a81e_68d2dc80ab68.slice.4211machine # [ 394.650850] systemd[1]: kubepods-besteffort-pod2a287058_984a_464d_a81e_68d2dc80ab68.slice: Consumed 1.712s CPU time over 2min 51.546s wall clock time, 323.7M memory peak, 8.9M read from disk, 283.9M written to disk, 59K incoming IP traffic, 50K outgoing IP traffic.4212machine # [ 394.658219] k3s[888]: I0919 21:56:52.570371 888 reconciler_common.go:299] "Volume detached for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/0c46eb13-9cfa-46ac-8361-570e73bbc99b-nix\") on node \"machine\" DevicePath \"\""4213machine # [ 394.661361] k3s[888]: I0919 21:56:52.570407 888 reconciler_common.go:299] "Volume detached for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/2a287058-984a-464d-a81e-68d2dc80ab68-nix\") on node \"machine\" DevicePath \"\""4214machine # [ 394.999969] systemd[1]: var-lib-kubelet-pods-0c46eb13\x2d9cfa\x2d46ac\x2d8361\x2d570e73bbc99b-volume\x2dsubpaths-nix-gc-0.mount: Deactivated successfully.4215machine # [ 395.000424] systemd[1]: var-lib-kubelet-pods-0c46eb13\x2d9cfa\x2d46ac\x2d8361\x2d570e73bbc99b-volume\x2dsubpaths-nix-nix\x2dgrpc\x2ddaemon-0.mount: Deactivated successfully.4216machine # [ 395.001526] systemd[1]: var-lib-kubelet-pods-2a287058\x2d984a\x2d464d\x2da81e\x2d68d2dc80ab68-volume\x2dsubpaths-nix-nix\x2dgrpc\x2ddaemon-0.mount: Deactivated successfully.4217machine # [ 395.003329] systemd[1]: var-lib-kubelet-pods-2a287058\x2d984a\x2d464d\x2da81e\x2d68d2dc80ab68-volume\x2dsubpaths-nix-nix\x2ddaemon-0.mount: Deactivated successfully.4218machine # [ 395.003810] systemd[1]: var-lib-kubelet-pods-0c46eb13\x2d9cfa\x2d46ac\x2d8361\x2d570e73bbc99b-volume\x2dsubpaths-nix-nix\x2ddaemon-0.mount: Deactivated successfully.4219machine # [ 395.035436] systemd[1]: var-lib-kubelet-pods-2a287058\x2d984a\x2d464d\x2da81e\x2d68d2dc80ab68-volumes-kubernetes.io\x7eprojected-niks3\x2dtoken.mount: Deactivated successfully.4220machine # [ 395.042666] systemd[1]: var-lib-kubelet-pods-0c46eb13\x2d9cfa\x2d46ac\x2d8361\x2d570e73bbc99b-volumes-kubernetes.io\x7eprojected-niks3\x2dtoken.mount: Deactivated successfully.4221machine # [ 395.049785] systemd[1]: var-lib-kubelet-pods-0c46eb13\x2d9cfa\x2d46ac\x2d8361\x2d570e73bbc99b-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dg276x.mount: Deactivated successfully.4222machine # [ 395.059462] systemd[1]: var-lib-kubelet-pods-0c46eb13\x2d9cfa\x2d46ac\x2d8361\x2d570e73bbc99b-volumes-kubernetes.io\x7esecret-tls.mount: Deactivated successfully.4223machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4224machine # [ 396.419998] dhcpcd[5125]: veth22170ca2: probing for an IPv4LL address4225machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4226machine # [ 396.436586] dhcpcd[5125]: vetheb965cd1: probing for an IPv4LL address4227machine # [ 396.497156] k3s[888]: I0919 21:56:54.408540 888 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0c46eb13-9cfa-46ac-8361-570e73bbc99b" path="/var/lib/kubelet/pods/0c46eb13-9cfa-46ac-8361-570e73bbc99b/volumes"4228machine # [ 396.497530] k3s[888]: I0919 21:56:54.409405 888 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2a287058-984a-464d-a81e-68d2dc80ab68" path="/var/lib/kubelet/pods/2a287058-984a-464d-a81e-68d2dc80ab68/volumes"4229machine # [ 397.101160] dhcpcd[5125]: veth9bd06f1f: probing for an IPv4LL address4230machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4231machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4232machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4233machine # [ 401.052104] dhcpcd[5125]: veth22170ca2: using IPv4LL address 169.254.143.114234machine # [ 401.052734] dhcpcd[5125]: veth22170ca2: adding route to 169.254.0.0/164235machine # [ 401.477722] dhcpcd[5125]: veth9bd06f1f: using IPv4LL address 169.254.109.1874236machine # [ 401.482927] dhcpcd[5125]: veth9bd06f1f: adding route to 169.254.0.0/164237machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4238machine # [ 401.792987] dhcpcd[5125]: vetheb965cd1: using IPv4LL address 169.254.26.834239machine # [ 401.799542] dhcpcd[5125]: vetheb965cd1: adding route to 169.254.0.0/164240machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4241machine # [ 403.933107] dhcpcd[5125]: veth22170ca2: no IPv6 Routers available4242machine # [ 403.998915] dhcpcd[5125]: veth9bd06f1f: no IPv6 Routers available4243machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4244machine # [ 404.647212] dhcpcd[5125]: vetheb965cd1: no IPv6 Routers available4245machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4246machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4247machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4248machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4249machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4250machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4251machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4252machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4253machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4254machine # [ 416.022981] postgres[782]: [782] LOG: checkpoint complete: wrote 1021 buffers (6.2%), wrote 3 SLRU buffers; 1 WAL file(s) added, 0 removed, 0 recycled; write=102.444 s, sync=0.051 s, total=102.525 s; sync files=363, longest=0.006 s, average=0.001 s; distance=4901 kB, estimate=4901 kB; lsn=0/1C2F680, redo lsn=0/1C2F5F04255machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4256machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4257machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4258machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4259machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4260machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4261machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4262machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4263machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4264machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4265machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4266machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4267machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4268machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4269machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4270machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4271machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4272machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4273machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4274machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4275machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4276machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4277machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4278machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4279machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4280machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4281machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4282machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4283machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4284machine # [ 453.491212] k3s[888]: I0919 21:57:51.402088 888 scope.go:122] "RemoveContainer" containerID="b114f09cc9f40c3c1d2335b905e293e66e3aefa4cc79ea49658c6a9c16b1c76f"4285machine # [ 453.496738] k3s[888]: E0919 21:57:51.402523 888 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"helm\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=helm pod=helm-install-nix-grpc-farm-7fwh5_kube-system(0758217b-c7d3-4cab-abc0-35bace80ed3f)\"" pod="kube-system/helm-install-nix-grpc-farm-7fwh5" podUID="0758217b-c7d3-4cab-abc0-35bace80ed3f"4286machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4287machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4288machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4289machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4290machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4291machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4292machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4293machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4294machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4295machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4296machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4297machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-scheduler" not found4298machine # NAMESPACE NAME READY STATUS RESTARTS AGE4299machine # farm nix-grpc-farm-lb-688d8d547b-mqc9d 1/1 Running 0 78s4300machine # farm nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28 3/3 Running 0 78s4301machine # farm nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv 3/3 Running 0 78s4302machine # kube-system coredns-c5fdd76cf-mhdrd 1/1 Running 0 7m14s4303machine # kube-system helm-install-nix-grpc-farm-7fwh5 0/1 CrashLoopBackOff 6 (78s ago) 7m3s4304machine # farm 80s Normal Killing pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-w85mx Stopping container nix-daemon4305machine # farm 80s Normal Killing pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-w85mx Stopping container nix-grpc-daemon4306machine # farm 80s Normal Killing pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-ncctl Stopping container gc4307machine # farm 80s Normal Killing pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-ncctl Stopping container nix-grpc-daemon4308machine # farm 80s Normal Killing pod/nix-grpc-farm-lb-688d8d547b-n9pvj Stopping container envoy4309machine # farm 80s Normal Killing pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-ncctl Stopping container nix-daemon4310machine # farm 79s Normal SuccessfulCreate replicaset/nix-grpc-farm-worker-x86-64-linux-5cdbdb595 Created pod: nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml284311machine # farm 79s Normal ScalingReplicaSet deployment/nix-grpc-farm-lb Scaled up replica set nix-grpc-farm-lb-688d8d547b from 0 to 14312machine # farm 79s Normal SuccessfulCreate replicaset/nix-grpc-farm-lb-688d8d547b Created pod: nix-grpc-farm-lb-688d8d547b-mqc9d4313machine # farm 79s Normal ScalingReplicaSet deployment/nix-grpc-farm-worker-x86-64-linux Scaled up replica set nix-grpc-farm-worker-x86-64-linux-5cdbdb595 from 0 to 24314machine # farm 79s Normal SuccessfulCreate replicaset/nix-grpc-farm-worker-x86-64-linux-5cdbdb595 Created pod: nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv4315machine # farm 78s Normal Created pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28 Container created4316machine # farm 78s Normal Pulled pod/nix-grpc-farm-lb-688d8d547b-mqc9d Container image "nix-grpc-farm-lb:0.1.0" already present on machine and can be accessed by the pod4317machine # farm 78s Normal Started pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv Container started4318machine # farm 78s Normal Pulled pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28 Container image "nix-grpc-farm:0.1.0" already present on machine and can be accessed by the pod4319machine # farm 78s Normal Created pod/nix-grpc-farm-lb-688d8d547b-mqc9d Container created4320machine # farm 78s Normal Started pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28 Container started4321machine # farm 78s Normal Created pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv Container created4322machine # farm 78s Normal Started pod/nix-grpc-farm-lb-688d8d547b-mqc9d Container started4323machine # farm 78s Normal Pulled pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv Container image "nix-grpc-farm:0.1.0" already present on machine and can be accessed by the pod4324machine # farm 77s Normal Pulled pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28 Container image "nix-grpc-farm:0.1.0" already present on machine and can be accessed by the pod4325machine # farm 77s Normal Pulled pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv Container image "nix-grpc-farm:0.1.0" already present on machine and can be accessed by the pod4326machine # farm 77s Normal Created pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28 Container created4327machine # farm 77s Normal Created pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv Container created4328machine # farm 77s Warning Unhealthy pod/nix-grpc-farm-lb-688d8d547b-mqc9d Readiness probe failed: HTTP probe failed with statuscode: 5034329machine # farm 76s Normal Started pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28 Container started4330machine # farm 76s Normal Started pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv Container started4331machine # farm 76s Normal Pulled pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28 Container image "nix-grpc-farm:0.1.0" already present on machine and can be accessed by the pod4332machine # farm 76s Normal Started pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28 Container started4333machine # farm 76s Normal Created pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv Container created4334machine # farm 76s Normal Started pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28 Container started4335machine # farm 76s Normal Started pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv Container started4336machine # farm 76s Normal Created pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28 Container created4337machine # farm 76s Normal Created pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28 Container created4338machine # farm 76s Normal Pulled pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv Container image "nix-grpc-farm:0.1.0" already present on machine and can be accessed by the pod4339machine # farm 76s Normal Pulled pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv Container image "nix-grpc-farm:0.1.0" already present on machine and can be accessed by the pod4340machine # farm 76s Normal Created pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv Container created4341machine # farm 76s Normal Started pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv Container started4342machine # farm 76s Normal Pulled pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28 Container image "nix-grpc-farm:0.1.0" already present on machine and can be accessed by the pod4343machine # kube-system 15s Warning BackOff pod/helm-install-nix-grpc-farm-7fwh5 Back-off restarting failed container helm in pod helm-install-nix-grpc-farm-7fwh5_kube-system(0758217b-c7d3-4cab-abc0-35bace80ed3f)4344machine # + [[ -z 1 ]]4345machine # + check_revision 14346machine # + set -e4347machine # + REVISION=14348machine # + [[ -n 1 ]]4349machine # + [[ 1 != 1 ]]4350machine # + set +e4351machine # + [[ failed =~ ^(pending-install|pending-upgrade|pending-rollback|superseded|uninstalling)$ ]]4352machine # + [[ failed =~ ^deployed$ ]]4353machine # + [[ failed =~ ^(deleted|failed|null|unknown)$ ]]4354machine # + case "${FAILURE_POLICY:-reinstall}" in4355machine # + echo 'Uninstalling failed helm chart'4356machine # + helm uninstall nix-grpc-farm --namespace farm --wait4357machine # release "nix-grpc-farm" uninstalled4358machine # + echo Deleted4359machine # Deleted4360machine # ++ get_ssa_args '' '' auto false4361machine # ++ set -e4362machine # ++ REVISION=4363machine # ++ APPLY_METHOD=4364machine # ++ SERVER_SIDE=auto4365machine # ++ FORCE_CONFLICTS=false4366machine # ++ [[ -z '' ]]4367machine # ++ [[ auto =~ ^auto$ ]]4368machine # ++ SERVER_SIDE=true4369machine # ++ [[ false =~ ^true$ ]]4370machine # ++ [[ -n true ]]4371machine # ++ echo -n '--server-side=true '4372machine # ++ [[ -n false ]]4373machine # ++ echo -n '--force-conflicts=false '4374machine # ++ echo4375machine # ++ set +e4376machine # + SSA_ARGS='--server-side=true --force-conflicts=false '4377machine # + echo 'Installing helm chart'4378machine # + helm install --namespace farm nix-grpc-farm https://10.43.0.1:443/static/charts/nix-grpc-farm.tgz --labels helmcharts.helm.cattle.io/configHash=68C1C1B485DA72929DFAF7B1476413DFE982F4E7429B88269B82ADF71F73F2A --server-side=true --force-conflicts=false --values /config/values-0-000-HelmChart-ValuesContent.yaml4379machine # Error: INSTALLATION FAILED: failed to create typed patch object (farm/nix-grpc-farm-scheduler; /v1, Kind=Service): .spec.selector.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}4380machine # failed to create typed patch object (farm/nix-grpc-farm-scheduler; apps/v1, Kind=Deployment): errors:4381machine # .spec.selector.matchLabels.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}4382machine # .spec.template.metadata.labels.app.kubernetes.io/instance-rank: expected string, got &value.valueUnstructured{Value:0}4383machine # + exit4384machine # Host Port: <none>4385machine # Command:4386machine # /bin/sh4387machine # -ec4388machine # Args:4389machine # while :; do4390machine # harmonia-gc --ensure-free 2G --no-vacuum || echo "gc: exit $?" >&24391machine # sleep 104392machine # done4393machine # 4394machine # State: Running4395machine # Started: Sat, 19 Sep 2026 21:56:50 +00004396machine # Ready: True4397machine # Restart Count: 04398machine # Environment: <none>4399machine # Mounts:4400machine # /etc/nix/nix.conf.d from nixconf (rw)4401machine # /nix from nix (rw,path="nix")4402machine # /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-2zsgc (ro)4403machine # Conditions:4404machine # Type Status4405machine # PodReadyToStartContainers True4406machine # Initialized True4407machine # Ready True4408machine # ContainersReady True4409machine # PodScheduled True4410machine # Volumes:4411machine # nix:4412machine # Type: EmptyDir (a temporary directory that shares a pod's lifetime)4413machine # Medium:4414machine # SizeLimit: <unset>4415machine # build:4416machine # Type: EmptyDir (a temporary directory that shares a pod's lifetime)4417machine # Medium:4418machine # SizeLimit: <unset>4419machine # nixconf:4420machine # Type: ConfigMap (a volume populated by a ConfigMap)4421machine # Name: nix-grpc-farm-worker-x86-64-linux4422machine # Optional: false4423machine # niks3-token:4424machine # Type: Projected (a volume that contains injected data from multiple sources)4425machine # TokenExpirationSeconds: 36004426machine # tls:4427machine # Type: Secret (a volume populated by a Secret)4428machine # SecretName: farm-worker-tls4429machine # Optional: false4430machine # ca:4431machine # Type: Secret (a volume populated by a Secret)4432machine # SecretName: farm-ca4433machine # Optional: false4434machine # oidc:4435machine # Type: Secret (a volume populated by a Secret)4436machine # SecretName: nix-grpc-farm-oidc4437machine # Optional: false4438machine # kube-api-access-2zsgc:4439machine # Type: Projected (a volume that contains injected data from multiple sources)4440machine # TokenExpirationSeconds: 36074441machine # ConfigMapName: kube-root-ca.crt4442machine # Optional: false4443machine # DownwardAPI: true4444machine # QoS Class: BestEffort4445machine # Node-Selectors: <none>4446machine # Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s4447machine # node.kubernetes.io/unreachable:NoExecute op=Exists for 300s4448machine # Events:4449machine # Type Reason Age From Message4450machine # ---- ------ ---- ---- -------4451machine # Normal Scheduled 79s default-scheduler Successfully assigned farm/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv to machine4452machine # Normal Pulled 78s kubelet spec.initContainers{seed-store}: Container image "nix-grpc-farm:0.1.0" already present on machine and can be accessed by the pod4453machine # Normal Created 78s kubelet spec.initContainers{seed-store}: Container created4454machine # Normal Started 78s kubelet spec.initContainers{seed-store}: Container started4455machine # Normal Pulled 77s kubelet spec.containers{nix-daemon}: Container image "nix-grpc-farm:0.1.0" already present on machine and can be accessed by the pod4456machine # Normal Created 77s kubelet spec.containers{nix-daemon}: Container created4457machine # Normal Started 76s kubelet spec.containers{nix-daemon}: Container started4458machine # Normal Pulled 76s kubelet spec.containers{nix-grpc-daemon}: Container image "nix-grpc-farm:0.1.0" already present on machine and can be accessed by the pod4459machine # Normal Created 76s kubelet spec.containers{nix-grpc-daemon}: Container created4460machine # Normal Started 76s kubelet spec.containers{nix-grpc-daemon}: Container started4461machine # Normal Pulled 76s kubelet spec.containers{gc}: Container image "nix-grpc-farm:0.1.0" already present on machine and can be accessed by the pod4462machine # Normal Created 76s kubelet spec.containers{gc}: Container created4463machine # Normal Started 76s kubelet spec.containers{gc}: Container started4464machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28/nix-daemon] accepted connection from pid 67, user root (trusted)4465machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28/nix-daemon] accepted connection from pid 98, user root (trusted)4466machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28/nix-grpc-daemon] ts=2026-09-19T21:56:50Z level=info event=oidc_provider name=kubernetes issuer=https://kubernetes.default.svc.cluster.local4467machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28/nix-grpc-daemon] ts=2026-09-19T21:56:50Z level=info event=roles builder=1 scheduler=0 scheduler_addr=nix-grpc-farm-scheduler.farm.svc:50051 advertise=10.42.0.27:50051 niks3=http://192.168.1.1:5751 max_jobs=24468machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28/nix-grpc-daemon] ts=2026-09-19T21:56:50Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket4469machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28/nix-grpc-daemon] ts=2026-09-19T21:56:51Z level=info event=scheduler_disconnected addr=nix-grpc-farm-scheduler.farm.svc:50051 error="errors resolving nix-grpc-farm-scheduler.farm.svc:50051: [field:hostname lookup error:address lookup failed for nix-grpc-farm-scheduler.farm.svc:50051: DNS query cancelled]"4470machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28/nix-grpc-daemon] ts=2026-09-19T21:56:51Z level=info event=scheduler_disconnected addr=nix-grpc-farm-scheduler.farm.svc:50051 error="errors resolving nix-grpc-farm-scheduler.farm.svc:50051: [field:hostname lookup error:address lookup failed for nix-grpc-farm-scheduler.farm.svc:50051: DNS query cancelled]"4471machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28/nix-grpc-daemon] ts=2026-09-19T21:56:51Z level=info event=scheduler_disconnected addr=nix-grpc-farm-scheduler.farm.svc:50051 error="errors resolving nix-grpc-farm-scheduler.farm.svc:50051: [field:hostname lookup error:address lookup failed for nix-grpc-farm-scheduler.farm.svc:50051: DNS query cancelled]"4472machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28/nix-grpc-daemon] ts=2026-09-19T21:56:52Z level=info event=scheduler_disconnected addr=nix-grpc-farm-scheduler.farm.svc:50051 error="errors resolving nix-grpc-farm-scheduler.farm.svc:50051: [field:hostname lookup error:address lookup failed for nix-grpc-farm-scheduler.farm.svc:50051: DNS query cancelled]"4473machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28/nix-grpc-daemon] ts=2026-09-19T21:56:54Z level=info event=scheduler_disconnected addr=nix-grpc-farm-scheduler.farm.svc:50051 error="errors resolving nix-grpc-farm-scheduler.farm.svc:50051: [field:hostname lookup error:address lookup failed for nix-grpc-farm-scheduler.farm.svc:50051: DNS query cancelled]"4474machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28/nix-grpc-daemon] ts=2026-09-19T21:56:57Z level=info event=scheduler_disconnected addr=nix-grpc-farm-scheduler.farm.svc:50051 error="errors resolving nix-grpc-farm-scheduler.farm.svc:50051: [field:hostname lookup error:address lookup failed for nix-grpc-farm-scheduler.farm.svc:50051: DNS query cancelled]"4475machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28/nix-grpc-daemon] ts=2026-09-19T21:57:02Z level=info event=scheduler_disconnected addr=nix-grpc-farm-scheduler.farm.svc:50051 error="errors resolving nix-grpc-farm-scheduler.farm.svc:50051: [field:hostname lookup error:address lookup failed for nix-grpc-farm-scheduler.farm.svc:50051: DNS query cancelled]"4476machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28/nix-grpc-daemon] ts=2026-09-19T21:57:07Z level=info event=scheduler_disconnected addr=nix-grpc-farm-scheduler.farm.svc:50051 error="errors resolving nix-grpc-farm-scheduler.farm.svc:50051: [field:hostname lookup error:address lookup failed for nix-grpc-farm-scheduler.farm.svc:50051: DNS query cancelled]"4477machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28/nix-grpc-daemon] ts=2026-09-19T21:57:12Z level=info event=scheduler_disconnected addr=nix-grpc-farm-scheduler.farm.svc:50051 error="errors resolving nix-grpc-farm-scheduler.farm.svc:50051: [field:hostname lookup error:address lookup failed for nix-grpc-farm-scheduler.farm.svc:50051: DNS query cancelled]"4478machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28/nix-grpc-daemon] ts=2026-09-19T21:57:17Z level=info event=scheduler_disconnected addr=nix-grpc-farm-scheduler.farm.svc:50051 error="errors resolving nix-grpc-farm-scheduler.farm.svc:50051: [field:hostname lookup error:address lookup failed for nix-grpc-farm-scheduler.farm.svc:50051: DNS query cancelled]"4479machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28/nix-grpc-daemon] ts=2026-09-19T21:57:22Z level=info event=scheduler_disconnected addr=nix-grpc-farm-scheduler.farm.svc:50051 error="errors resolving nix-grpc-farm-scheduler.farm.svc:50051: [field:hostname lookup error:address lookup failed for nix-grpc-farm-scheduler.farm.svc:50051: DNS query cancelled]"4480machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28/nix-grpc-daemon] ts=2026-09-19T21:57:27Z level=info event=scheduler_disconnected addr=nix-grpc-farm-scheduler.farm.svc:50051 error="errors resolving nix-grpc-farm-scheduler.farm.svc:50051: [field:hostname lookup error:address lookup failed for nix-grpc-farm-scheduler.farm.svc:50051: DNS query cancelled]"4481machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28/nix-grpc-daemon] ts=2026-09-19T21:57:32Z level=info event=scheduler_disconnected addr=nix-grpc-farm-scheduler.farm.svc:50051 error="errors resolving nix-grpc-farm-scheduler.farm.svc:50051: [field:hostname lookup error:address lookup failed for nix-grpc-farm-scheduler.farm.svc:50051: DNS query cancelled]"4482machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28/nix-grpc-daemon] ts=2026-09-19T21:57:37Z level=info event=scheduler_disconnected addr=nix-grpc-farm-scheduler.farm.svc:50051 error="errors resolving nix-grpc-farm-scheduler.farm.svc:50051: [field:hostname lookup error:address lookup failed for nix-grpc-farm-scheduler.farm.svc:50051: DNS query cancelled]"4483machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28/nix-grpc-daemon] ts=2026-09-19T21:57:42Z level=info event=scheduler_disconnected addr=nix-grpc-farm-scheduler.farm.svc:50051 error="errors resolving nix-grpc-farm-scheduler.farm.svc:50051: [field:hostname lookup error:address lookup failed for nix-grpc-farm-scheduler.farm.svc:50051: DNS query cancelled]"4484machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28/nix-grpc-daemon] ts=2026-09-19T21:57:47Z level=info event=scheduler_disconnected addr=nix-grpc-farm-scheduler.farm.svc:50051 error="errors resolving nix-grpc-farm-scheduler.farm.svc:50051: [field:hostname lookup error:address lookup failed for nix-grpc-farm-scheduler.farm.svc:50051: DNS query cancelled]"4485machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28/nix-grpc-daemon] ts=2026-09-19T21:57:52Z level=info event=scheduler_disconnected addr=nix-grpc-farm-scheduler.farm.svc:50051 error="errors resolving nix-grpc-farm-scheduler.farm.svc:50051: [field:hostname lookup error:address lookup failed for nix-grpc-farm-scheduler.farm.svc:50051: DNS query cancelled]"4486machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28/nix-grpc-daemon] ts=2026-09-19T21:57:57Z level=info event=scheduler_disconnected addr=nix-grpc-farm-scheduler.farm.svc:50051 error="errors resolving nix-grpc-farm-scheduler.farm.svc:50051: [field:hostname lookup error:address lookup failed for nix-grpc-farm-scheduler.farm.svc:50051: DNS query cancelled]"4487machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28/nix-grpc-daemon] ts=2026-09-19T21:58:02Z level=info event=scheduler_disconnected addr=nix-grpc-farm-scheduler.farm.svc:50051 error="errors resolving nix-grpc-farm-scheduler.farm.svc:50051: [field:hostname lookup error:address lookup failed for nix-grpc-farm-scheduler.farm.svc:50051: DNS query cancelled]"4488machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28/gc] 2026-09-19T21:56:50.366229Z WARN harmonia_gc: no private mount namespace: setting up a private mount namespace: EPERM: Operation not permitted4489machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28/gc] 11.99 GiB already free, nothing to do4490machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28/gc] 2026-09-19T21:57:00.379137Z WARN harmonia_gc: no private mount namespace: setting up a private mount namespace: EPERM: Operation not permitted4491machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28/gc] 12.56 GiB already free, nothing to do4492machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28/gc] 2026-09-19T21:57:10.387155Z WARN harmonia_gc: no private mount namespace: setting up a private mount namespace: EPERM: Operation not permitted4493machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28/gc] 12.56 GiB already free, nothing to do4494machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28/gc] 2026-09-19T21:57:20.394079Z WARN harmonia_gc: no private mount namespace: setting up a private mount namespace: EPERM: Operation not permitted4495machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28/gc] 12.54 GiB already free, nothing to do4496machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28/gc] 2026-09-19T21:57:30.400821Z WARN harmonia_gc: no private mount namespace: setting up a private mount namespace: EPERM: Operation not permitted4497machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28/gc] 12.54 GiB already free, nothing to do4498machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28/gc] 2026-09-19T21:57:40.407948Z WARN harmonia_gc: no private mount namespace: setting up a private mount namespace: EPERM: Operation not permitted4499machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28/gc] 12.54 GiB already free, nothing to do4500machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28/gc] 2026-09-19T21:57:50.413681Z WARN harmonia_gc: no private mount namespace: setting up a private mount namespace: EPERM: Operation not permitted4501machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28/gc] 12.54 GiB already free, nothing to do4502machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28/gc] 2026-09-19T21:58:00.419348Z WARN harmonia_gc: no private mount namespace: setting up a private mount namespace: EPERM: Operation not permitted4503machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-rml28/gc] 12.54 GiB already free, nothing to do4504machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv/nix-daemon] accepted connection from pid 66, user root (trusted)4505machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv/nix-daemon] accepted connection from pid 98, user root (trusted)4506machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv/nix-grpc-daemon] ts=2026-09-19T21:56:50Z level=info event=oidc_provider name=kubernetes issuer=https://kubernetes.default.svc.cluster.local4507machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv/nix-grpc-daemon] ts=2026-09-19T21:56:50Z level=info event=roles builder=1 scheduler=0 scheduler_addr=nix-grpc-farm-scheduler.farm.svc:50051 advertise=10.42.0.26:50051 niks3=http://192.168.1.1:5751 max_jobs=24508machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv/nix-grpc-daemon] ts=2026-09-19T21:56:50Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket4509machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv/nix-grpc-daemon] ts=2026-09-19T21:56:51Z level=info event=scheduler_disconnected addr=nix-grpc-farm-scheduler.farm.svc:50051 error="errors resolving nix-grpc-farm-scheduler.farm.svc:50051: [field:hostname lookup error:address lookup failed for nix-grpc-farm-scheduler.farm.svc:50051: DNS query cancelled]"4510machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv/nix-grpc-daemon] ts=2026-09-19T21:56:51Z level=info event=scheduler_disconnected addr=nix-grpc-farm-scheduler.farm.svc:50051 error="errors resolving nix-grpc-farm-scheduler.farm.svc:50051: [field:hostname lookup error:address lookup failed for nix-grpc-farm-scheduler.farm.svc:50051: DNS query cancelled]"4511machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv/nix-grpc-daemon] ts=2026-09-19T21:56:51Z level=info event=scheduler_disconnected addr=nix-grpc-farm-scheduler.farm.svc:50051 error="errors resolving nix-grpc-farm-scheduler.farm.svc:50051: [field:hostname lookup error:address lookup failed for nix-grpc-farm-scheduler.farm.svc:50051: DNS query cancelled]"4512machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv/nix-grpc-daemon] ts=2026-09-19T21:56:52Z level=info event=scheduler_disconnected addr=nix-grpc-farm-scheduler.farm.svc:50051 error="errors resolving nix-grpc-farm-scheduler.farm.svc:50051: [field:hostname lookup error:address lookup failed for nix-grpc-farm-scheduler.farm.svc:50051: DNS query cancelled]"4513machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv/nix-grpc-daemon] ts=2026-09-19T21:56:54Z level=info event=scheduler_disconnected addr=nix-grpc-farm-scheduler.farm.svc:50051 error="errors resolving nix-grpc-farm-scheduler.farm.svc:50051: [field:hostname lookup error:address lookup failed for nix-grpc-farm-scheduler.farm.svc:50051: DNS query cancelled]"4514machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv/nix-grpc-daemon] ts=2026-09-19T21:56:57Z level=info event=scheduler_disconnected addr=nix-grpc-farm-scheduler.farm.svc:50051 error="errors resolving nix-grpc-farm-scheduler.farm.svc:50051: [field:hostname lookup error:address lookup failed for nix-grpc-farm-scheduler.farm.svc:50051: DNS query cancelled]"4515machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv/nix-grpc-daemon] ts=2026-09-19T21:57:02Z level=info event=scheduler_disconnected addr=nix-grpc-farm-scheduler.farm.svc:50051 error="errors resolving nix-grpc-farm-scheduler.farm.svc:50051: [field:hostname lookup error:address lookup failed for nix-grpc-farm-scheduler.farm.svc:50051: DNS query cancelled]"4516machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv/nix-grpc-daemon] ts=2026-09-19T21:57:07Z level=info event=scheduler_disconnected addr=nix-grpc-farm-scheduler.farm.svc:50051 error="errors resolving nix-grpc-farm-scheduler.farm.svc:50051: [field:hostname lookup error:address lookup failed for nix-grpc-farm-scheduler.farm.svc:50051: DNS query cancelled]"4517machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv/nix-grpc-daemon] ts=2026-09-19T21:57:12Z level=info event=scheduler_disconnected addr=nix-grpc-farm-scheduler.farm.svc:50051 error="errors resolving nix-grpc-farm-scheduler.farm.svc:50051: [field:hostname lookup error:address lookup failed for nix-grpc-farm-scheduler.farm.svc:50051: DNS query cancelled]"4518machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv/nix-grpc-daemon] ts=2026-09-19T21:57:17Z level=info event=scheduler_disconnected addr=nix-grpc-farm-scheduler.farm.svc:50051 error="errors resolving nix-grpc-farm-scheduler.farm.svc:50051: [field:hostname lookup error:address lookup failed for nix-grpc-farm-scheduler.farm.svc:50051: DNS query cancelled]"4519machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv/nix-grpc-daemon] ts=2026-09-19T21:57:22Z level=info event=scheduler_disconnected addr=nix-grpc-farm-scheduler.farm.svc:50051 error="errors resolving nix-grpc-farm-scheduler.farm.svc:50051: [field:hostname lookup error:address lookup failed for nix-grpc-farm-scheduler.farm.svc:50051: DNS query cancelled]"4520machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv/nix-grpc-daemon] ts=2026-09-19T21:57:27Z level=info event=scheduler_disconnected addr=nix-grpc-farm-scheduler.farm.svc:50051 error="errors resolving nix-grpc-farm-scheduler.farm.svc:50051: [field:hostname lookup error:address lookup failed for nix-grpc-farm-scheduler.farm.svc:50051: DNS query cancelled]"4521machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv/nix-grpc-daemon] ts=2026-09-19T21:57:32Z level=info event=scheduler_disconnected addr=nix-grpc-farm-scheduler.farm.svc:50051 error="errors resolving nix-grpc-farm-scheduler.farm.svc:50051: [field:hostname lookup error:address lookup failed for nix-grpc-farm-scheduler.farm.svc:50051: DNS query cancelled]"4522machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv/nix-grpc-daemon] ts=2026-09-19T21:57:37Z level=info event=scheduler_disconnected addr=nix-grpc-farm-scheduler.farm.svc:50051 error="errors resolving nix-grpc-farm-scheduler.farm.svc:50051: [field:hostname lookup error:address lookup failed for nix-grpc-farm-scheduler.farm.svc:50051: DNS query cancelled]"4523machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv/nix-grpc-daemon] ts=2026-09-19T21:57:42Z level=info event=scheduler_disconnected addr=nix-grpc-farm-scheduler.farm.svc:50051 error="errors resolving nix-grpc-farm-scheduler.farm.svc:50051: [field:hostname lookup error:address lookup failed for nix-grpc-farm-scheduler.farm.svc:50051: DNS query cancelled]"4524machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv/nix-grpc-daemon] ts=2026-09-19T21:57:47Z level=info event=scheduler_disconnected addr=nix-grpc-farm-scheduler.farm.svc:50051 error="errors resolving nix-grpc-farm-scheduler.farm.svc:50051: [field:hostname lookup error:address lookup failed for nix-grpc-farm-scheduler.farm.svc:50051: DNS query cancelled]"4525machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv/nix-grpc-daemon] ts=2026-09-19T21:57:52Z level=info event=scheduler_disconnected addr=nix-grpc-farm-scheduler.farm.svc:50051 error="errors resolving nix-grpc-farm-scheduler.farm.svc:50051: [field:hostname lookup error:address lookup failed for nix-grpc-farm-scheduler.farm.svc:50051: DNS query cancelled]"4526machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv/nix-grpc-daemon] ts=2026-09-19T21:57:57Z level=info event=scheduler_disconnected addr=nix-grpc-farm-scheduler.farm.svc:50051 error="errors resolving nix-grpc-farm-scheduler.farm.svc:50051: [field:hostname lookup error:address lookup failed for nix-grpc-farm-scheduler.farm.svc:50051: DNS query cancelled]"4527machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv/nix-grpc-daemon] ts=2026-09-19T21:58:02Z level=info event=scheduler_disconnected addr=nix-grpc-farm-scheduler.farm.svc:50051 error="errors resolving nix-grpc-farm-scheduler.farm.svc:50051: [field:hostname lookup error:address lookup failed for nix-grpc-farm-scheduler.farm.svc:50051: DNS query cancelled]"4528machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv/gc] 2026-09-19T21:56:50.358155Z WARN harmonia_gc: no private mount namespace: setting up a private mount namespace: EPERM: Operation not permitted4529machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv/gc] 11.99 GiB already free, nothing to do4530machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv/gc] 2026-09-19T21:57:00.364344Z WARN harmonia_gc: no private mount namespace: setting up a private mount namespace: EPERM: Operation not permitted4531machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv/gc] 12.56 GiB already free, nothing to do4532machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv/gc] 2026-09-19T21:57:10.372543Z WARN harmonia_gc: no private mount namespace: setting up a private mount namespace: EPERM: Operation not permitted4533machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv/gc] 12.56 GiB already free, nothing to do4534machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv/gc] 2026-09-19T21:57:20.379046Z WARN harmonia_gc: no private mount namespace: setting up a private mount namespace: EPERM: Operation not permitted4535machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv/gc] 12.54 GiB already free, nothing to do4536machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv/gc] 2026-09-19T21:57:30.385361Z WARN harmonia_gc: no private mount namespace: setting up a private mount namespace: EPERM: Operation not permitted4537machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv/gc] 12.54 GiB already free, nothing to do4538machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv/gc] 2026-09-19T21:57:40.390203Z WARN harmonia_gc: no private mount namespace: setting up a private mount namespace: EPERM: Operation not permitted4539machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv/gc] 12.54 GiB already free, nothing to do4540machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv/gc] 2026-09-19T21:57:50.395689Z WARN harmonia_gc: no private mount namespace: setting up a private mount namespace: EPERM: Operation not permitted4541machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv/gc] 12.54 GiB already free, nothing to do4542machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv/gc] 2026-09-19T21:58:00.401718Z WARN harmonia_gc: no private mount namespace: setting up a private mount namespace: EPERM: Operation not permitted4543machine # [pod/nix-grpc-farm-worker-x86-64-linux-5cdbdb595-xrnlv/gc] 12.54 GiB already free, nothing to do4544machine # No resources found in farm namespace.4545!!! Test "chart deploys and workers become Ready" failed with error: "action timed out after 420.90 seconds (timeout=420.0)"4546!!! Traceback (most recent call last):4547!!! File "<string>", line 19, in <module>4548!!! machine.wait_until_succeeds(kubectl + "rollout status deployment nix-grpc-farm-scheduler --timeout=10s", timeout=420)4549!!! 4550!!! RequestedAssertionFailed: action timed out after 420.90 seconds (timeout=420.0)4551cleanup4552kill QemuMachine (pid 45)4553machine # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)4554(finished: cleanup, in 1.32 seconds)4555additionally exposed symbols:4556 machine,4557 vlan1,4558 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh